C-NIDS Detector - Comprehensive Test Report

Generated: 2026-01-28 16:31:30

Total Test Runs: 18

Sources: Agent Evaluation: 18

Average Accuracy
60.61%
Average F1-Score
75.47%
Zero-Day Detection
10.23%
Test Sources
1

Zero-Day Attack Analysis

Metric Value
Total Zero-Day Samples 3681
Zero-Day Attacks Detected 373
Zero-Day Attacks Missed 3308
Zero-Day False Alarms 69
Overall Detection Rate 10.13%

Performance Assessment

? Overall Performance: NEEDS IMPROVEMENT - Significant enhancement required

Total Detections: TP=10910, TN=0, FP=7090, FN=0

Test Sources: Agent Evaluation: 18

Zero-Day Detection Rate: 10.23%

Test Results Summary

Source Model Date Time Filename Total_Requests Attack_Ratio ZeroDay_Ratio Accuracy F1_Score Precision Recall ZeroDay_Rate ZeroDay_Precision ZeroDay_False_Alarm_Rate TP FP TN FN Total_Samples ZeroDay_Detected ZeroDay_Samples ZeroDay_False_Alarms ZeroDay_Missed Avg_Response_Time Test_Duration
Agent Evaluation Agent_Test 2026-01-28 16:30:46 metrics_20260128_163046.json 1000 1.0 0.237 61.70% 76.31% 61.70% 100.00% 18.99% 81.82% 2.61% 617 383 0 0 1000 45 237 10 192 N/A N/A
Agent Evaluation Agent_Test 2026-01-28 16:22:13 metrics_20260128_162213.json 1000 1.0 0.207 61.10% 75.85% 61.10% 100.00% 24.15% 87.72% 1.80% 611 389 0 0 1000 50 207 7 157 N/A N/A
Agent Evaluation Agent_Test 2026-01-28 16:14:26 metrics_20260128_161426.json 1000 1.0 0.224 62.20% 76.70% 62.20% 100.00% 22.32% 94.34% 0.79% 622 378 0 0 1000 50 224 3 174 N/A N/A
Agent Evaluation Agent_Test 2026-01-28 15:50:36 metrics_20260128_155036.json 1000 1.0 0.198 60.10% 75.08% 60.10% 100.00% 25.76% 86.44% 2.01% 601 399 0 0 1000 51 198 8 147 N/A N/A
Agent Evaluation Agent_Test 2026-01-28 15:19:32 metrics_20260128_151932.json 1000 1.0 0.173 61.00% 75.78% 61.00% 100.00% 23.12% 86.96% 1.54% 610 390 0 0 1000 40 173 6 133 N/A N/A
Agent Evaluation Agent_Test 2026-01-28 15:13:43 metrics_20260128_151343.json 1000 1.0 0.193 62.10% 76.62% 62.10% 100.00% 26.42% 89.47% 1.58% 621 379 0 0 1000 51 193 6 142 N/A N/A
Agent Evaluation Agent_Test 2026-01-28 13:51:13 metrics_20260128_135113.json 1000 1.0 0.214 60.70% 75.54% 60.70% 100.00% 21.50% 88.46% 1.53% 607 393 0 0 1000 46 214 6 168 N/A N/A
Agent Evaluation Agent_Test 2026-01-28 13:47:06 metrics_20260128_134706.json 1000 1.0 0.183 58.90% 74.13% 58.90% 100.00% 21.31% 68.42% 4.38% 589 411 0 0 1000 39 183 18 144 N/A N/A
Agent Evaluation Agent_Test 2026-01-28 13:40:18 metrics_20260128_134018.json 1000 1.0 0.214 60.10% 75.08% 60.10% 100.00% 0.00% 0.00% 0.00% 601 399 0 0 1000 0 214 0 214 N/A N/A
Agent Evaluation Agent_Test 2026-01-28 13:10:17 metrics_20260128_131017.json 1000 1.0 0.220 59.40% 74.53% 59.40% 100.00% 0.00% 0.00% 0.25% 594 406 0 0 1000 0 220 1 220 N/A N/A
Agent Evaluation Agent_Test 2026-01-28 12:59:16 metrics_20260128_125916.json 1000 1.0 0.191 60.40% 75.31% 60.40% 100.00% 0.00% 0.00% 0.25% 604 396 0 0 1000 0 191 1 191 N/A N/A
Agent Evaluation Agent_Test 2026-01-28 12:55:10 metrics_20260128_125510.json 1000 1.0 0.210 59.60% 74.69% 59.60% 100.00% 0.00% 0.00% 0.00% 596 404 0 0 1000 0 210 0 210 N/A N/A
Agent Evaluation Agent_Test 2026-01-28 12:08:13 metrics_20260128_120813.json 1000 1.0 0.183 60.50% 75.39% 60.50% 100.00% 0.00% 0.00% 0.25% 605 395 0 0 1000 0 183 1 183 N/A N/A
Agent Evaluation Agent_Test 2026-01-28 12:04:51 metrics_20260128_120451.json 1000 1.0 0.208 60.40% 75.31% 60.40% 100.00% 0.00% 0.00% 0.25% 604 396 0 0 1000 0 208 1 208 N/A N/A
Agent Evaluation Agent_Test 2026-01-28 12:01:00 metrics_20260128_120100.json 1000 1.0 0.232 62.60% 77.00% 62.60% 100.00% 0.00% 0.00% 0.00% 626 374 0 0 1000 0 232 0 232 N/A N/A
Agent Evaluation Agent_Test 2026-01-28 11:57:39 metrics_20260128_115739.json 1000 1.0 0.188 61.50% 76.16% 61.50% 100.00% 0.00% 0.00% 0.00% 615 385 0 0 1000 0 188 0 188 N/A N/A
Agent Evaluation Agent_Test 2026-01-28 11:54:07 metrics_20260128_115407.json 1000 1.0 0.203 59.20% 74.37% 59.20% 100.00% 0.00% 0.00% 0.00% 592 408 0 0 1000 0 203 0 203 N/A N/A
Agent Evaluation Agent_Test 2026-01-28 11:49:24 metrics_20260128_114924.json 1000 1.0 0.203 59.50% 74.61% 59.50% 100.00% 0.49% 50.00% 0.25% 595 405 0 0 1000 1 203 1 202 N/A N/A

Detailed Report

================================================================================
C-NIDS DETECTOR - COMPREHENSIVE TEST REPORT
================================================================================
Report Generated: 2026-01-28 16:31:29
Total Test Runs: 18
Sources: 1 (Agent Evaluation)
================================================================================

OVERALL STATISTICS BY SOURCE:
----------------------------------------

Agent Evaluation:
  Total Runs: 18
  Average Accuracy: 60.61%
  Average F1-Score: 75.47%
  Average Zero-Day Detection Rate: 10.23%
  Average Zero-Day Precision: 40.76%


OVERALL STATISTICS:
----------------------------------------
Overall Average Accuracy: 60.61%
Overall Average F1-Score: 75.47%
Overall Zero-Day Detection Rate: 10.23%
Overall Zero-Day Precision: 40.76%


ZERO-DAY ATTACK ANALYSIS:
----------------------------------------
Total Zero-Day Samples: 3681
Zero-Day Attacks Detected: 373
Zero-Day Attacks Missed: 3308
Zero-Day False Alarms: 69
Overall Zero-Day Detection Rate: 10.13%
Zero-Day False Alarm Rate: 0.97%

TOTAL DETECTION COUNTS:
----------------------------------------
  True Positives:  10910
  True Negatives:  0
  False Positives: 7090
  False Negatives: 0


PER MODEL STATISTICS:
----------------------------------------

Agent_Test:
  Source:            Agent Evaluation
  Latest Accuracy:   61.70%
  Latest F1-Score:   76.31%
  Zero-Day Rate:     10.23%
  Average Accuracy:  60.61%
  Average F1-Score:  75.47%
  Test Date:         2026-01-28
  Latest Performance: FAIR


RECOMMENDATIONS:
----------------------------------------
?? Fair performance, room for improvement
  - Investigate high false positive/negative rates
  - Consider adding more training data
  - Review feature selection
  - Zero-day detection requires significant attention

? ZERO-DAY DETECTION CRITICAL ISSUES:
  - Implement additional anomaly detection techniques
  - Consider unsupervised learning approaches
  - Increase zero-day training scenarios
  - Review zero-day detection thresholds

================================================================================
END OF REPORT
================================================================================

C-NIDS Detector v2.0 | Network Intrusion Detection System with Machine Learning

Report generated automatically from comprehensive test suite

Build for Network-MDPI Journal --> Cognitive Network Intrusion Detection Systems: Anomaly and Malware Detection for Zero-Day Attack Resilience