All-controls-failed scoring baseline
Prompt
Using `all_110_control_register.json` and `nist_800_171_controls_sprs_weights.yaml`, calculate the SPRS result when every control is NOT MET. Show bucket counts/subtotals, identify every control excluded from a conditional-status POA&M, and give the eligible-control count.
Responses & grading (16 models)
Gemini 3.5 Flash-Lite (medium)100%
Based on the DoD Assessment Methodology v1.2.1 and the provided reference files (`all_110_control_register.json` and `nist_800_171_controls_sprs_weights.yaml`), here is the complete SPRS scoring breakdown for the **worst-case scenario (all 110 controls NOT MET)**: --- ### 1. SPRS Score Calculation & Bucket Subtotals The starting maximum score is **110**. When a control is marked **NOT MET**, its full weight is deducted from the maximum score. * **5-Point Bucket:** 44 controls × -5 = **-220 points** * **3-Point Bucket:** 14 controls × -3 = **-42 points** * **1-Point Bucket:** 51 controls × -1 = **-51 points** * **0-Point Bucket:** 1 control (3.12.4) × 0 = **0 points** * **Total Deductions:** 220 + 42 + 51 = **313 points** * **Final SPRS Result:** $110 - 313 =$ **`-203`** --- ### 2. POA&M Eligibility & Excluded Controls Under DoD guidelines, certain controls are ineligible for Plan of Action & Milestones (POA&M) remediation tracking (meaning they cannot be left unmet under a conditional POA&M status for DoD contracts). * **Eligible-Control Count (POA&M Allowed):** **46 controls** * **Excluded-Control Count (POA&M Prohibited):** **64 controls** #### Complete List of Controls Excluded from POA&M (`poam_eligible: false`): 1. **Access Control (AC):** 3.1.1, 3.1.2, 3.1.5, 3.1.12, 3.1.13, 3.1.16, 3.1.17, 3.1.18, 3.1.19, 3.1.20 *(1-pt, excluded)*, 3.1.22 *(1-pt, excluded)* 2. **Awareness and Training (AT):** 3.2.1, 3.2.2 3. **Audit and Accountability (AU):** 3.3.1, 3.3.2, 3.3.5 4. **Configuration Management (CM):** 3.4.1, 3.4.2, 3.4.5, 3.4.6, 3.4.7, 3.4.8 5. **Identification and Authentication (IA):** 3.5.1, 3.5.2, 3.5.3, 3.5.10 6. **Incident Response (IR):** 3.6.1, 3.6.2 7. **Maintenance (MA):** 3.7.1, 3.7.2, 3.7.4, 3.7.5 8. **Media Protection (MP):** 3.8.1, 3.8.2, 3.8.3, 3.8.7, 3.8.8 9. **Personnel Security (PS):** 3.9.1, 3.9.2 10. **Physical Protection (PE):** 3.10.1, 3.10.2, 3.10.3 *(1-pt, excluded)*, 3.10.4 *(1-pt, excluded)*, 3.10.5 *(1-pt, excluded)* 11. **Risk Assessment (RA):** 3.11.1, 3.11.2 12. **Security Assessment (CA):** 3.12.1, 3.12.2, 3.12.3, 3.12.4 *(0-pt SSP control)* 13. **System and Communications Protection (SC):** 3.13.1, 3.13.2, 3.13.5, 3.13.6, 3.13.8, 3.13.11, 3.13.15 14. **System and Information Integrity (SI):** 3.14.1, 3.14.2, 3.14.3, 3.14.4, 3.14.5, 3.14.6, 3.14.7
- worst_case_score_and_eligibilityThe answer correctly reports the bucket calculation 44×5 + 14×3 + 51×1 + 1×0 = 313, yielding a score of -203 from a starting score of 110. It gives 46 eligible controls and identifies the excluded controls, including all five- and three-point controls plus 3.1.20, 3.1.22, 3.10.3, 3.10.4, 3.10.5, and 3.12.4.
GPT-5.6 Luna (medium)100%
## SPRS calculation All 110 controls are **NOT MET**. Under the DoD weighting authority, each unmet control deducts its assigned weight from the starting SPRS score of **110**. | Weight bucket | Control count | Maximum deduction | Deduction when all are NOT MET | |---:|---:|---:|---:| | 5-point | 44 | 220 | -220 | | 3-point | 14 | 42 | -42 | | 1-point | 51 | 51 | -51 | | 0-point | 1 | 0 | 0 | | **Total** | **110** | **313** | **-313** | **SPRS result:** \[ 110 - (220 + 42 + 51) = \boxed{-203} \] The 0-point control, **3.12.4**, does not affect the numeric score, although it is still required to be MET. ## Controls excluded from a conditional-status POA&M The following **64 NOT MET controls** are not POA&M-eligible under the YAML authority. ### Five-point controls — 44 excluded - **AC:** 3.1.1, 3.1.2, 3.1.12, 3.1.13, 3.1.16, 3.1.17, 3.1.18 - **AT:** 3.2.1, 3.2.2 - **AU:** 3.3.1, 3.3.5 - **CM:** 3.4.1, 3.4.2, 3.4.5, 3.4.6, 3.4.7, 3.4.8 - **IA:** 3.5.1, 3.5.2, 3.5.3, 3.5.10 - **IR:** 3.6.1, 3.6.2 - **MA:** 3.7.2, 3.7.5 - **MP:** 3.8.3, 3.8.7 - **PS:** 3.9.2 - **PE:** 3.10.1, 3.10.2 - **RA:** 3.11.2 - **CA:** 3.12.1, 3.12.3 - **SC:** 3.13.1, 3.13.2, 3.13.5, 3.13.6, 3.13.11, 3.13.15 - **SI:** 3.14.1, 3.14.2, 3.14.3, 3.14.4, 3.14.6 ### Three-point controls — 14 excluded 3.1.5, 3.1.19, 3.3.2, 3.7.1, 3.7.4, 3.8.1, 3.8.2, 3.8.8, 3.9.1, 3.11.1, 3.12.2, 3.13.8, 3.14.5, 3.14.7 ### One-point controls — 5 excluded 3.1.20, 3.1.22, 3.10.3, 3.10.4, 3.10.5 ### Zero-point control — 1 excluded 3.12.4 ## Eligible-control count - **Total controls:** 110 - **POA&M-eligible controls:** **46** - **Not POA&M-eligible controls:** **64** Thus, for this all-NOT-MET scenario, the final SPRS is **-203**, with **46 eligible controls** for a conditional-status POA&M.
- worst_case_score_and_eligibilityThe answer correctly reports the bucket calculation 44×5 + 14×3 + 51×1 + 1×0 = 313, yielding a final SPRS score of −203. It gives 46 eligible controls and identifies all 64 excluded controls, including all five- and three-point controls and the specified controls 3.1.20, 3.1.22, 3.10.3–3.10.5, and 3.12.4.
GLM-5.3-Flash100%
# SPRS Calculation — Worst Case (All 110 Controls NOT MET) ## Final Result **SPRS Score = 110 − 313 = −203** This is the DoD floor score; it is mathematically impossible to score lower. Every NOT MET control deducts its full weight from the 110-point maximum. ## Bucket Counts & Subtotals | Weight Bucket | Control Count | Subtotal (Deduction) | |---|---|---| | 5-point | 44 (42 regular + 2 partial-credit specials) | 44 × 5 = **220** | | 3-point | 14 | 14 × 3 = **42** | | 1-point | 51 | 51 × 1 = **51** | | 0-point | 1 (3.12.4) | 1 × 0 = **0** | | **Total** | **110** | **313** | **Special-control notes:** - **3.5.3 (MFA)** and **3.13.11 (CUI Encryption)** carry partial-credit provisions (deduct 3 instead of 5 if the stated conditions hold), but full NOT MET status triggers the full **5-point** deduction each — no partial credit in this scenario. - **3.12.4 (System Security Plan)** deducts nothing from the numeric score, but as a mandatory-MET control, its NOT MET status independently makes any compliance claim invalid. ## Controls Excluded from a Conditional-Status POA&M (64 total) These carry `poam_eligible: false` and therefore **cannot** be mitigated to reach conditional status: **5-point (all 44):** 3.1.1, 3.1.2, 3.1.12, 3.1.13, 3.1.16, 3.1.17, 3.1.18, 3.2.1, 3.2.2, 3.3.1, 3.3.5, 3.4.1, 3.4.2, 3.4.5, 3.4.6, 3.4.7, 3.4.8, 3.5.1, 3.5.2, 3.5.3, 3.5.10, 3.6.1, 3.6.2, 3.7.2, 3.7.5, 3.8.3, 3.8.7, 3.9.2, 3.10.1, 3.10.2, 3.11.2, 3.12.1, 3.12.3, 3.13.1, 3.13.2, 3.13.5, 3.13.6, 3.13.11, 3.13.15, 3.14.1, 3.14.2, 3.14.3, 3.14.4, 3.14.6 **3-point (all 14):** 3.1.5, 3.1.19, 3.3.2, 3.7.1, 3.7.4, 3.8.1, 3.8.2, 3.8.8, 3.9.1, 3.11.1, 3.12.2, 3.13.8, 3.14.5, 3.14.7 **1-point (5) — excluded despite low weight per explicit `poam_note`:** 3.1.20 (External Connections), 3.1.22 (Public Information), 3.10.3 (Escort Visitors), 3.10.4 (Physical Access Logs), 3.10.5 (Manage Physical Access) **0-point (1):** 3.12.4 (System Security Plan) **Exclusion total: 44 + 14 + 5 + 1 = 64** ## POA&M-Eligible Control Count **110 − 64 = 46 eligible controls** All 46 eligible controls are 1-pointers (3.1.3, 3.1.4, 3.1.6–3.1.11, 3.1.14, 3.1.15, 3.1.21, 3.2.3, 3.3.3, 3.3.4, 3.3.6–3.3.9, 3.4.3, 3.4.4, 3.4.9, 3.5.4–3.5.9, 3.5.11, 3.6.3, 3.7.3, 3.7.6, 3.8.4–3.8.6, 3.8.9, 3.10.6, 3.11.3, 3.13.3, 3.13.4, 3.13.7, 3.13.9, 3.13.10, 3.13.12–3.13.14, 3.13.16). ## Consequence for This Scenario Because the 64 POA&M-ineligible controls are all NOT MET, **conditional status is unattainable** — no POA&M can bridge the gap. The assessment yields the flat minimum score of **−203**, and 3.12.4 (SSP) NOT MET further precludes any valid submission posture.
- worst_case_score_and_eligibilityThe answer correctly reports the bucket calculation 44×5 + 14×3 + 51×1 + 1×0 = 313, yielding a score of −203. It gives 46 eligible controls and lists all five- and three-point controls plus the specifically required exclusions: 3.1.20, 3.1.22, 3.10.3, 3.10.4, 3.10.5, and 3.12.4. A minor typo in the eligible-control parenthetical does not materially affect the required result or exclusion list.
Claude 4.5 Haiku100%
# SPRS Calculation: All 110 Controls NOT MET ## Score Breakdown by Weight Bucket | Bucket | Weight | Count | Per-Control | Subtotal | |--------|--------|-------|-------------|----------| | 5-Point | 5 | 44 | −5 each | **−220** | | 3-Point | 3 | 14 | −3 each | **−42** | | 1-Point | 1 | 51 | −1 each | **−51** | | 0-Point | 0 | 1 | — | **0** | | **TOTAL DEDUCTION** | — | **110** | — | **−313** | ### Five-Point Bucket Composition (44 controls): - **42 regular five-point controls** (23 basic + 19 derived per DoD methodology) - **2 special partial-credit controls:** 3.5.3, 3.13.11 (treated as 5-point for NOT MET status) --- ## **Final SPRS Score** | Component | Value | |-----------|-------| | Baseline | 110 | | Total Weight Deduction (all NOT MET) | −313 | | **SPRS Result** | **−203** | --- ## Controls Excluded from Conditional-Status POA&M ### **Unconditionally Excluded (5 controls with explicit poam_note):** 1. **3.1.20** – External Connections (weight 1) 2. **3.1.22** – Public Information (weight 1) 3. **3.10.3** – Escort Visitors (weight 1) 4. **3.10.4** – Physical Access Logs (weight 1) 5. **3.10.5** – Manage Physical Access (weight 1) ### **Conditionally Excluded (1 control; exclusion triggered on PARTIAL status):** 6. **3.5.3** – Multifactor Authentication (weight 5) - *Partial condition:* MFA covers remote/privileged access only, not all network access - *POA&M effect:* `poam_if_partial: false` → NOT eligible for POA&M if PARTIALLY MET ### **Conditionally Included for Comparison (1 control; inclusion triggered on PARTIAL status):** - **3.13.11** – CUI Encryption (weight 5) - *Partial condition:* Encryption exists but not FIPS 140-2 validated - *POA&M effect:* `poam_if_partial: true` → IS eligible for POA&M if PARTIALLY MET --- ## POA&M-Eligible Control Count | Category | Eligible | Total | POA&M-Ineligible | |----------|----------|-------|------------------| | Weight 5 | 0 | 44 | 44 | | Weight 3 | 0 | 14 | 14 | | Weight 1 | **46** | 51 | 5 | | Weight 0 | 0 | 1 | 1 | | **TOTAL** | **46** | **110** | **64** | **POA&M-Eligible Control Details (Weight 1):** The 46 eligible 1-point controls represent all 51 weight-1 controls minus the 5 explicitly excluded (3.1.20, 3.1.22, 3.10.3, 3.10.4, 3.10.5).
- worst_case_score_and_eligibilityThe response reports the correct bucket calculation, 44×5 + 14×3 + 51×1 + 1×0 = 313, yielding a score of −203. It gives 46 eligible controls and identifies the five specifically excluded 1-point controls (3.1.20, 3.1.22, 3.10.3, 3.10.4, and 3.10.5). It also establishes that the eligible controls are all 1-point controls, thereby excluding all 5- and 3-point controls and the 0-point control 3.12.4.
Gemini 3.5 Flash-Lite (medium)100%
Based on the DoD Assessment Methodology v1.2.1 and the provided control register and weighting files, here is the analysis for the scenario where **every control is NOT MET**: --- ### 1. SPRS Score Calculation & Bucket Subtotals The starting SPRS score is **110**. Deductions are applied for each control that is not met based on its assigned weight (5, 3, 1, or 0 points). * **5-Point Bucket:** 44 controls $\times$ 5 points = **-220** deduction * **3-Point Bucket:** 14 controls $\times$ 3 points = **-42** deduction * **1-Point Bucket:** 51 controls $\times$ 1 point = **-51** deduction * **0-Point Bucket:** 1 control $\times$ 0 points = **0** deduction *(Control 3.12.4)* * **Total Deductions:** 220 + 42 + 51 + 0 = **313** * **Net SPRS Score:** 110 − 313 = **-203** *(Worst possible SPRS score)* --- ### 2. Eligible vs. Ineligible POA&M Counts * **Total Controls:** 110 * **POA&M Eligible Controls (`poam_eligible: true`):** **46** * **POA&M Ineligible Controls (`poam_eligible: false`):** **64** --- ### 3. Controls Excluded from POA&M (`poam_eligible: false`) The following 64 controls are excluded from being placed on a Plan of Action and Milestones (POA&M) under DoD assessment rules: 1. **3.1.1** (5 pts) 2. **3.1.2** (5 pts) 3. **3.1.5** (3 pts) 4. **3.1.12** (5 pts) 5. **3.1.13** (5 pts) 6. **3.1.16** (5 pts) 7. **3.1.17** (5 pts) 8. **3.1.18** (5 pts) 9. **3.1.19** (3 pts) 10. **3.1.20** (1 pt — *Excluded despite 1-pt weight*) 11. **3.1.22** (1 pt — *Excluded despite 1-pt weight*) 12. **3.2.1** (5 pts) 13. **3.2.2** (5 pts) 14. **3.3.1** (5 pts) 15. **3.3.2** (3 pts) 16. **3.3.5** (5 pts) 17. **3.4.1** (5 pts) 18. **3.4.2** (5 pts) 19. **3.4.5** (5 pts) 20. **3.4.6** (5 pts) 21. **3.4.7** (5 pts) 22. **3.4.8** (5 pts) 23. **3.5.1** (5 pts) 24. **3.5.2** (5 pts) 25. **3.5.3** (5 pts) 26. **3.5.10** (5 pts) 27. **3.6.1** (5 pts) 28. **3.6.2** (5 pts) 29. **3.7.1** (3 pts) 30. **3.7.2** (5 pts) 31. **3.7.4** (3 pts) 32. **3.7.5** (5 pts) 33. **3.8.1** (3 pts) 34. **3.8.2** (3 pts) 35. **3.8.3** (5 pts) 36. **3.8.7** (5 pts) 37. **3.8.8** (3 pts) 38. **3.9.1** (3 pts) 39. **3.9.2** (5 pts) 40. **3.10.1** (5 pts) 41. **3.10.2** (5 pts) 42. **3.10.3** (1 pt — *Excluded despite 1-pt weight*) 43. **3.10.4** (1 pt — *Excluded despite 1-pt weight*) 44. **3.10.5** (1 pt — *Excluded despite 1-pt weight*) 45. **3.11.1** (3 pts) 46. **3.11.2** (5 pts) 47. **3.12.1** (5 pts) 48. **3.12.2** (3 pts) 49. **3.12.3** (5 pts) 50. **3.12.4** (0 pts) 51. **3.13.1** (5 pts) 52. **3.13.2** (5 pts) 53. **3.13.5** (5 pts) 54. **3.13.6** (5 pts) 55. **3.13.8** (3 pts) 56. **3.13.11** (5 pts) 57. **3.13.15** (5 pts) 58. **3.14.1** (5 pts) 59. **3.14.2** (5 pts) 60. **3.14.3** (5 pts) 61. **3.14.4** (5 pts) 62. **3.14.5** (3 pts) 63. **3.14.6** (5 pts) 64. **3.14.7** (3 pts)
- worst_case_score_and_eligibilityThe answer correctly reports the bucket calculation 44×5 + 14×3 + 51×1 + 1×0 = 313, yielding a score of -203 from a starting score of 110. It gives 46 eligible controls and identifies the excluded controls, including all five- and three-point controls plus 3.1.20, 3.1.22, 3.10.3, 3.10.4, 3.10.5, and 3.12.4.
GPT-5.6 Luna (medium)100%
## SPRS calculation All 110 controls are **NOT MET**. Under the supplied weight authority, each unmet control contributes its full negative weight. | Weight bucket | Unmet controls | Deduction subtotal | |---:|---:|---:| | 5-point | 44 | −220 | | 3-point | 14 | −42 | | 1-point | 51 | −51 | | 0-point | 1 | 0 | | **Total** | **110** | **−313** | The starting maximum SPRS is **110**: \[ 110 - 313 = \boxed{-203} \] **Final SPRS result: −203** The two special partial-credit controls—**3.5.3** and **3.13.11**—are fully **NOT MET**, so no partial-credit treatment applies. Control **3.12.4** is also NOT MET, but has zero weight and does not affect the numeric score. ## Controls excluded from a conditional-status POA&M The following 64 controls have `poam_eligible: false` and are therefore excluded: - **AC:** 3.1.1, 3.1.2, 3.1.5, 3.1.12, 3.1.13, 3.1.16, 3.1.17, 3.1.18, 3.1.19, 3.1.20, 3.1.22 - **AT:** 3.2.1, 3.2.2 - **AU:** 3.3.1, 3.3.2, 3.3.5 - **CM:** 3.4.1, 3.4.2, 3.4.5, 3.4.6, 3.4.7, 3.4.8 - **IA:** 3.5.1, 3.5.2, 3.5.3, 3.5.10 - **IR:** 3.6.1, 3.6.2 - **MA:** 3.7.1, 3.7.2, 3.7.4, 3.7.5 - **MP:** 3.8.1, 3.8.2, 3.8.3, 3.8.7, 3.8.8 - **PS:** 3.9.1, 3.9.2 - **PE:** 3.10.1, 3.10.2, 3.10.3, 3.10.4, 3.10.5 - **RA:** 3.11.1, 3.11.2 - **CA:** 3.12.1, 3.12.2, 3.12.3, 3.12.4 - **SC:** 3.13.1, 3.13.2, 3.13.5, 3.13.6, 3.13.8, 3.13.11, 3.13.15 - **SI:** 3.14.1, 3.14.2, 3.14.3, 3.14.4, 3.14.5, 3.14.6, 3.14.7 ## Eligible-control count - **POA&M-eligible controls:** 46 - **POA&M-ineligible/excluded controls:** 64 - **Total controls:** 110
- worst_case_score_and_eligibilityThe answer correctly reports the bucket calculation 44×5 + 14×3 + 51×1 + 1×0 = 313, yielding a final SPRS score of −203. It gives 46 eligible controls and identifies all 64 excluded controls, including all five- and three-point controls and the specified controls 3.1.20, 3.1.22, 3.10.3–3.10.5, and 3.12.4.
GPT-6 Astra (medium)100%
## SPRS result: **−203** Using the weights in `nist_800_171_controls_sprs_weights.yaml`, start at **110** and subtract the full weight of each NOT MET control in `all_110_control_register.json`. | Deduction bucket | Control count | Deduction subtotal | |---|---:|---:| | 5 points | 44 | 220 | | 3 points | 14 | 42 | | 1 point | 51 | 51 | | 0 points | 1 | 0 | | **Total** | **110** | **313** | **SPRS = 110 − 313 = −203** The 44 five-point controls include **3.5.3** and **3.13.11**. Neither receives partial credit in this all-NOT-MET scenario. ## Controls excluded from a conditional-status POA&M Under the supplied YAML’s eligibility rules, **64 controls are excluded**: | Family | Excluded controls | Count | |---|---|---:| | Access Control (AC) | 3.1.1, 3.1.2, 3.1.5, 3.1.12, 3.1.13, 3.1.16, 3.1.17, 3.1.18, 3.1.19, 3.1.20, 3.1.22 | 11 | | Awareness and Training (AT) | 3.2.1, 3.2.2 | 2 | | Audit and Accountability (AU) | 3.3.1, 3.3.2, 3.3.5 | 3 | | Configuration Management (CM) | 3.4.1, 3.4.2, 3.4.5, 3.4.6, 3.4.7, 3.4.8 | 6 | | Identification and Authentication (IA) | 3.5.1, 3.5.2, 3.5.3, 3.5.10 | 4 | | Incident Response (IR) | 3.6.1, 3.6.2 | 2 | | Maintenance (MA) | 3.7.1, 3.7.2, 3.7.4, 3.7.5 | 4 | | Media Protection (MP) | 3.8.1, 3.8.2, 3.8.3, 3.8.7, 3.8.8 | 5 | | Personnel Security (PS) | 3.9.1, 3.9.2 | 2 | | Physical Protection (PE) | 3.10.1, 3.10.2, 3.10.3, 3.10.4, 3.10.5 | 5 | | Risk Assessment (RA) | 3.11.1, 3.11.2 | 2 | | Security Assessment (CA) | 3.12.1, 3.12.2, 3.12.3, 3.12.4 | 4 | | System and Communications Protection (SC) | 3.13.1, 3.13.2, 3.13.5, 3.13.6, 3.13.8, 3.13.11, 3.13.15 | 7 | | System and Information Integrity (SI) | 3.14.1, 3.14.2, 3.14.3, 3.14.4, 3.14.5, 3.14.6, 3.14.7 | 7 | | **Total excluded** | | **64** | ### Eligible-control count: **46** The excluded set consists of: - **44** five-point controls; - **14** three-point controls; - **5** explicitly excluded one-point controls: **3.1.20, 3.1.22, 3.10.3, 3.10.4, 3.10.5**; - **1** zero-point control: **3.12.4**. Thus, **110 − 64 = 46 eligible controls**, all in the one-point bucket. **Important distinctions:** - **3.12.4 (System Security Plan)** has no numeric deduction, but the supplied authority requires it to be MET and excludes it from POA&M eligibility. - **3.13.11** permits POA&M eligibility under its specified partial-credit condition only; that exception does not apply here. - The **46** count represents control-level eligibility under the supplied rules—not a determination that this all-NOT-MET assessment qualifies for conditional status.
- worst_case_score_and_eligibilityThe answer correctly reports the bucket calculation 44×5 + 14×3 + 51×1 + 1×0 = 313 and SPRS score −203. It gives 46 eligible controls and explicitly excludes all five-point and three-point controls, the five specified one-point controls (3.1.20, 3.1.22, 3.10.3, 3.10.4, 3.10.5), and 3.12.4.
Claude Fable 5.1 (medium)100%
# SPRS Result — Scenario `worst_case_all_not_met` ## 1. Register validation - 110 controls in the JSON; every `weight` matches the YAML authority (including the 3.1.4 override to 1‑pt and the 3.12.4 zero‑weight SSP control). - Bucket counts reconcile to the YAML header (44 / 14 / 51 / 1). ## 2. Bucket counts and deduction subtotals | Bucket | Count | Controls | Deduction | |---|---|---|---| | 5‑point | 44 | AC: 3.1.1, 3.1.2, 3.1.12, 3.1.13, 3.1.16, 3.1.17, 3.1.18 · AT: 3.2.1, 3.2.2 · AU: 3.3.1, 3.3.5 · CM: 3.4.1, 3.4.2, 3.4.5, 3.4.6, 3.4.7, 3.4.8 · IA: 3.5.1, 3.5.2, 3.5.3, 3.5.10 · IR: 3.6.1, 3.6.2 · MA: 3.7.2, 3.7.5 · MP: 3.8.3, 3.8.7 · PS: 3.9.2 · PE: 3.10.1, 3.10.2 · RA: 3.11.2 · CA: 3.12.1, 3.12.3 · SC: 3.13.1, 3.13.2, 3.13.5, 3.13.6, 3.13.11, 3.13.15 · SI: 3.14.1, 3.14.2, 3.14.3, 3.14.4, 3.14.6 | 44 × 5 = **−220** | | 3‑point | 14 | 3.1.5, 3.1.19, 3.3.2, 3.7.1, 3.7.4, 3.8.1, 3.8.2, 3.8.8, 3.9.1, 3.11.1, 3.12.2, 3.13.8, 3.14.5, 3.14.7 | 14 × 3 = **−42** | | 1‑point | 51 | all remaining controls | 51 × 1 = **−51** | | 0‑point | 1 | 3.12.4 (SSP) | **0** | | **Total** | **110** | | **−313** | Partial‑credit note: 3.5.3 and 3.13.11 are status **NOT MET** (not partial), so the full 5‑point deduction applies to each — the 3‑point partial deduction is not triggered. ## 3. Score **110 − 313 = −203** (the worst possible SPRS score, matching the YAML authority). Caveat: 3.12.4 is NOT MET. Under the DoD methodology an SSP is a prerequisite for an assessment; with no SSP the numeric result cannot be formally posted to SPRS. The −203 is the arithmetic result of the register as given. ## 4. Controls excluded from a conditional‑status POA&M (64) | Reason | Count | Controls | |---|---|---| | All 5‑point controls (`poam_eligible: false`) | 44 | the 44 listed above — includes 3.5.3 and 3.13.11, which are fully NOT MET here (3.13.11's `poam_if_partial: true` path applies only to a partial finding) | | All 3‑point controls (`poam_eligible: false`) | 14 | the 14 listed above | | 0‑point SSP control | 1 | 3.12.4 | | 1‑point controls explicitly excluded ("Excluded from POA&M despite 1‑pt weight") | 5 | 3.1.20, 3.1.22, 3.10.3, 3.10.4, 3.10.5 | ## 5. POA&M‑eligible control count: **46** 51 one‑point controls − 5 explicit exclusions = 46 (`poam_eligible: true`): - AC (11): 3.1.3, 3.1.4, 3.1.6, 3.1.7, 3.1.8, 3.1.9, 3.1.10, 3.1.11, 3.1.14, 3.1.15, 3.1.21 - AT (1): 3.2.3 - AU (6): 3.3.3, 3.3.4, 3.3.6, 3.3.7, 3.3.8, 3.3.9 - CM (3): 3.4.3, 3.4.4, 3.4.9 - IA (7): 3.5.4, 3.5.5, 3.5.6, 3.5.7, 3.5.8, 3.5.9, 3.5.11 - IR (1): 3.6.3 - MA (2): 3.7.3, 3.7.6 - MP (4): 3.8.4, 3.8.5, 3.8.6, 3.8.9 - PE (1): 3.10.6 - RA (1): 3.11.3 - SC (9): 3.13.3, 3.13.4, 3.13.7, 3.13.9, 3.13.10, 3.13.12, 3.13.13, 3.13.14, 3.13.16 ## 6. Conditional‑status determination **Not achievable.** Score −203 is far below the 88 threshold, and 64 open findings sit on ineligible controls. Conditional status would require every 5‑pt, 3‑pt, and excluded 1‑pt control (plus 3.12.4) to be MET, leaving only the 46 eligible controls as candidate POA&M items.
- worst_case_score_and_eligibilityThe answer correctly reports the bucket calculation 44×5 + 14×3 + 51×1 + 1×0 = 313, yielding a score of −203. It identifies all five- and three-point controls as excluded, lists the five named one-point exclusions (3.1.20, 3.1.22, 3.10.3, 3.10.4, and 3.10.5), includes 3.12.4, and correctly calculates 46 eligible controls.
GLM-5.3-Flash100%
# SPRS Calculation — Worst-Case Scenario (All 110 Controls NOT MET) ## Scoring Formula (DoD Assessment Methodology, Section 5d-e) **Score = 110 − (sum of deductions)**, where each NOT MET control deducts its assigned weight. ## Bucket Counts and Subtotals | Weight | Control Count | Deduction Subtotal | Notes | |---|---|---|---| | 5 points | 44 | −220 | 42 regular (23 basic + 19 derived) + 2 partial-credit specials (3.5.3, 3.13.11) | | 3 points | 14 | −42 | | | 1 point | 51 | −51 | | | 0 points | 1 | −0 | 3.12.4 (System Security Plan) | | **Total** | **110** | **−313** | | **Partial-credit note:** Both special controls (3.5.3 MFA, 3.13.11 CUI Encryption) are fully NOT MET here, so their partial-credit conditions (remote/privileged-only MFA; non-FIPS-validated encryption) are **not satisfied** — each takes the full **−5**, not −3. ## Final Score $$110 - 313 = \boxed{-203}$$ This matches the YAML's declared floor: *"Worst possible SPRS: −203."* --- ## Controls Excluded from Conditional-Status POA&M (`poam_eligible: false`) — 64 Total | Family | Excluded Controls | Count | |---|---|---| | AC | 3.1.1, 3.1.2, 3.1.5, 3.1.12, 3.1.13, 3.1.16, 3.1.17, 3.1.18, 3.1.19, **3.1.20\***, **3.1.22\*** | 11 | | AT | 3.2.1, 3.2.2 | 2 | | AU | 3.3.1, 3.3.2, 3.3.5 | 3 | | CM | 3.4.1, 3.4.2, 3.4.5, 3.4.6, 3.4.7, 3.4.8 | 6 | | IA | 3.5.1, 3.5.2, 3.5.3, 3.5.10 | 4 | | IR | 3.6.1, 3.6.2 | 2 | | MA | 3.7.1, 3.7.2, 3.7.4, 3.7.5 | 4 | | MP | 3.8.1, 3.8.2, 3.8.3, 3.8.7, 3.8.8 | 5 | | PS | 3.9.1, 3.9.2 | 2 | | PE | 3.10.1, 3.10.2, **3.10.3\***, **3.10.4\***, **3.10.5\*** | 5 | | RA | 3.11.1, 3.11.2 | 2 | | CA | 3.12.1, 3.12.2, 3.12.3, 3.12.4 | 4 | | SC | 3.13.1, 3.13.2, 3.13.5, 3.13.6, 3.13.8, 3.13.11, 3.13.15 | 7 | | SI | 3.14.1, 3.14.2, 3.14.3, 3.14.4, 3.14.5, 3.14.6, 3.14.7 | 7 | | | **Total excluded** | **64** | \* = Flagged in the YAML with `poam_note: "Excluded from POA&M despite 1-pt weight"` — these five (3.1.20, 3.1.22, 3.10.3, 3.10.4, 3.10.5) would otherwise appear POA&M-eligible by weight class but are explicitly carved out. ## POA&M-Eligible Control Count $$110 - 64 = \textbf{46 controls}$$ (3.1.3–3.1.4, 3.1.6–3.1.11, 3.1.14–3.1.15, 3.1.21; 3.2.3; 3.3.3–3.3.4, 3.3.6–3.3.9; 3.4.3–3.4.4, 3.4.9; 3.5.4–3.5.9, 3.5.11; 3.6.3; 3.7.3, 3.7.6; 3.8.4–3.8.6, 3.8.9; 3.10.6; 3.11.3; all nine 1-pt SC controls except none excluded — 3.13.3–3.3.4, 3.13.7, 3.13.9–3.13.10, 3.13.12–3.13.14, 3.13.16) --- ## Critical Caveats for This Scenario 1. **Conditional status is moot at −203.** DoD methodology requires a minimum SPRS score of **−69** to qualify for conditional certification at all. At −203, the assessment fails that gate outright — so even the 46 POA&M-eligible controls could not be closed via POA&M in this state. 2. **3.12.4 (SSP) is a standing failure.** It's weight 0 (no numeric impact) but per the YAML *"must be MET"* — its NOT MET status is a compliance failure independent of the −203 score.
- worst_case_score_and_eligibilityThe answer correctly reports the bucket calculation 44×5 + 14×3 + 51×1 + 1×0 = 313, yielding a score of −203. It gives 46 eligible controls and lists all five- and three-point controls plus the specifically required exclusions: 3.1.20, 3.1.22, 3.10.3, 3.10.4, 3.10.5, and 3.12.4. A minor typo in the eligible-control parenthetical does not materially affect the required result or exclusion list.
Claude 4.5 Haiku100%
# SPRS Calculation: All Controls NOT MET ## **SPRS RESULT: -203** ### Calculation Method The DoD Assessment Methodology applies a baseline score of **110 (equal to the control count)** with deductions for each NOT MET control based on its weight: ``` SPRS = 110 − Σ(weight_i for each NOT MET control_i) SPRS = 110 − 313 = −203 ``` --- ## Weight Bucket Counts & Subtotals | Weight | Count | Subtotal (pts deducted) | Controls | |--------|-------|------------------------|----------| | **5-point** | 44 | −220 | 42 regular + 2 special partial-credit (3.5.3, 3.13.11) | | **3-point** | 14 | −42 | 7 basic + 7 derived | | **1-point** | 51 | −51 | 50 basic + 1 derived | | **0-point** | 1 | 0 | 3.12.4 (SSP—MET required, no numeric impact) | | **TOTAL** | **110** | **−313 deduction** | — | **Final Score:** 110 − 313 = **−203** ✓ (matches worst-case reference) --- ## Controls Excluded from Conditional-Status POA&M Five controls are marked `poam_eligible: false` with explicit `poam_note` exclusions despite having non-zero weight: | Control ID | Title | Weight | Exclusion Reason | |------------|-------|--------|------------------| | **3.1.20** | External Connections | 1 | Excluded from POA&M despite 1-pt weight | | **3.1.22** | Public Information | 1 | Excluded from POA&M despite 1-pt weight | | **3.10.3** | Escort Visitors | 1 | Excluded from POA&M despite 1-pt weight | | **3.10.4** | Physical Access Logs | 1 | Excluded from POA&M despite 1-pt weight | | **3.10.5** | Manage Physical Access | 1 | Excluded from POA&M despite 1-pt weight | **Subtotal impact when NOT MET:** −5 points (5 × 1-point controls) --- ## POA&M Eligible Control Count: **46 Controls** All 46 POA&M-eligible controls are **1-point controls** distributed by family: | Family | Count | Controls | |--------|-------|----------| | **AC** (Access Control) | 11 | 3.1.3, 3.1.4, 3.1.6, 3.1.7, 3.1.8, 3.1.9, 3.1.10, 3.1.11, 3.1.14, 3.1.15, 3.1.21 | | **AT** (Awareness & Training) | 1 | 3.2.3 | | **AU** (Audit & Accountability) | 6 | 3.3.3, 3.3.4, 3.3.6, 3.3.7, 3.3.8, 3.3.9 | | **CM** (Configuration Management) | 3 | 3.4.3, 3.4.4, 3.4.9 | | **IA** (Identification & Authentication) | 7 | 3.5.4, 3.5.5, 3.5.6, 3.5.7, 3.5.8, 3.5.9, 3.5.11 | | **IR** (Incident Response) | 1 | 3.6.3 | | **MA** (Maintenance) | 2 | 3.7.3, 3.7.6 | | **MP** (Media Protection) | 4 | 3.8.4, 3.8.5, 3.8.6, 3.8.9 | | **PE** (Physical Protection) | 1 | 3.10.6 | | **RA** (Risk Assessment) | 1 | 3.11.3 | | **SC** (System & Communications Protection) | 9 | 3.13.3, 3.13.4, 3.13.7, 3.13.9, 3.13.10, 3.13.12, 3.13.13, 3.13.14, 3.13.16 | | **TOTAL** | **46** | — | **Note:** These 46 controls may be addressed through Plans of Action & Milestones (POA&M) and are not automatically failed upon conditional non-compliance. The remaining 64 controls cannot use POA&M and must be MET.
- worst_case_score_and_eligibilityThe response reports the correct bucket calculation, 44×5 + 14×3 + 51×1 + 1×0 = 313, yielding a score of −203. It gives 46 eligible controls and identifies the five specifically excluded 1-point controls (3.1.20, 3.1.22, 3.10.3, 3.10.4, and 3.10.5). It also establishes that the eligible controls are all 1-point controls, thereby excluding all 5- and 3-point controls and the 0-point control 3.12.4.
GPT-6 Astra (medium)100%
## SPRS result: **−203** Using the supplied YAML as the scoring authority, start at **110** and subtract the full weight of every NOT MET control. | Weight bucket | Control count | Deduction subtotal | |---|---:|---:| | 5 points | 44 | 220 | | 3 points | 14 | 42 | | 1 point | 51 | 51 | | 0 points | 1 | 0 | | **Total** | **110** | **313** | **SPRS = 110 − 313 = −203** The 5-point bucket includes 42 regular controls and the two partial-credit controls, **3.5.3** and **3.13.11**. Both receive the full 5-point deduction here: the all-NOT-MET scenario supplies no qualifying partial implementation. ## Controls excluded from a conditional-status POA&M Under the supplied YAML, **64 controls are excluded** in this scenario: | Family | Excluded control IDs | Count | |---|---|---:| | AC | 3.1.1, 3.1.2, 3.1.5, 3.1.12, 3.1.13, 3.1.16, 3.1.17, 3.1.18, 3.1.19, 3.1.20, 3.1.22 | 11 | | AT | 3.2.1, 3.2.2 | 2 | | AU | 3.3.1, 3.3.2, 3.3.5 | 3 | | CM | 3.4.1, 3.4.2, 3.4.5, 3.4.6, 3.4.7, 3.4.8 | 6 | | IA | 3.5.1, 3.5.2, 3.5.3, 3.5.10 | 4 | | IR | 3.6.1, 3.6.2 | 2 | | MA | 3.7.1, 3.7.2, 3.7.4, 3.7.5 | 4 | | MP | 3.8.1, 3.8.2, 3.8.3, 3.8.7, 3.8.8 | 5 | | PS | 3.9.1, 3.9.2 | 2 | | PE | 3.10.1, 3.10.2, 3.10.3, 3.10.4, 3.10.5 | 5 | | RA | 3.11.1, 3.11.2 | 2 | | CA | 3.12.1, 3.12.2, 3.12.3, 3.12.4 | 4 | | SC | 3.13.1, 3.13.2, 3.13.5, 3.13.6, 3.13.8, 3.13.11, 3.13.15 | 7 | | SI | 3.14.1, 3.14.2, 3.14.3, 3.14.4, 3.14.5, 3.14.6, 3.14.7 | 7 | | **Total** | | **64** | The exclusions consist of: - All **44 five-point** controls. - All **14 three-point** controls. - Five **one-point** controls: **3.1.20, 3.1.22, 3.10.3, 3.10.4, 3.10.5**. - The **zero-point SSP control, 3.12.4**. ## Eligible-control count: **46** **110 − 64 = 46**, equivalently **51 one-point controls − 5 explicit exclusions = 46**. Two important qualifications: - **3.13.11** becomes POA&M-eligible under the YAML’s specified partial-credit condition, but that condition is not established here. - **3.12.4 must be MET**, despite having no numeric deduction. Thus, **−203 is the arithmetic worst-case result, not an indication of eligibility for conditional status**.
- worst_case_score_and_eligibilityThe answer correctly reports the bucket calculation 44×5 + 14×3 + 51×1 + 1×0 = 313 and SPRS score −203. It gives 46 eligible controls and explicitly excludes all five-point and three-point controls, the five specified one-point controls (3.1.20, 3.1.22, 3.10.3, 3.10.4, 3.10.5), and 3.12.4.
Claude Fable 5.1 (medium)100%
# SPRS Result — Scenario `worst_case_all_not_met` **Authority applied:** DoD Assessment Methodology v1.2.1, §5d–e, as encoded in `nist_800_171_controls_sprs_weights.yaml`. All 110 weights in `all_110_control_register.json` were cross-checked against the YAML — no discrepancies (including the 3.1.4 override to 1 pt and 3.12.4 at 0 pt). ## 1. Bucket counts and subtotals | Bucket | Count | Deduction each | Subtotal | |---|---|---|---| | 5-point | 44 | −5 | **−220** | | 3-point | 14 | −3 | **−42** | | 1-point | 51 | −1 | **−51** | | 0-point (3.12.4 SSP) | 1 | 0 | **0** | | **Total** | **110** | | **−313** | **SPRS score = 110 − 313 = −203** (matches the YAML's stated worst-case floor). Bucket membership by family: - **5-pt (44):** AC 3.1.1, 3.1.2, 3.1.12, 3.1.13, 3.1.16, 3.1.17, 3.1.18 · AT 3.2.1, 3.2.2 · AU 3.3.1, 3.3.5 · CM 3.4.1, 3.4.2, 3.4.5, 3.4.6, 3.4.7, 3.4.8 · IA 3.5.1, 3.5.2, 3.5.3, 3.5.10 · IR 3.6.1, 3.6.2 · MA 3.7.2, 3.7.5 · MP 3.8.3, 3.8.7 · PS 3.9.2 · PE 3.10.1, 3.10.2 · RA 3.11.2 · CA 3.12.1, 3.12.3 · SC 3.13.1, 3.13.2, 3.13.5, 3.13.6, 3.13.11, 3.13.15 · SI 3.14.1, 3.14.2, 3.14.3, 3.14.4, 3.14.6 - **3-pt (14):** 3.1.5, 3.1.19, 3.3.2, 3.7.1, 3.7.4, 3.8.1, 3.8.2, 3.8.8, 3.9.1, 3.11.1, 3.12.2, 3.13.8, 3.14.5, 3.14.7 - **1-pt (51):** all remaining controls except 3.12.4 - **0-pt (1):** 3.12.4 **Partial-credit note:** 3.5.3 (MFA) and 3.13.11 (CUI encryption) carry a 3-point partial deduction option, but the register marks them fully NOT MET, so the full −5 applies to each. No partial credit is available in this scenario. ## 2. Controls excluded from a conditional-status POA&M Under §5e, a POA&M is permitted only for 1-point controls, with named exceptions. The excluded set is: **a) 1-point controls specifically excluded despite their weight (5):** | Control | Title | |---|---| | 3.1.20 | External Connections | | 3.1.22 | Public Information | | 3.10.3 | Escort Visitors | | 3.10.4 | Physical Access Logs | | 3.10.5 | Manage Physical Access | **b) All 5-point controls (44)** — not POA&M-eligible. The single exception, 3.13.11 at the *partial* 3-point deduction (`poam_if_partial: true`), does not apply here because it is fully NOT MET. 3.5.3 is never POA&M-eligible even when partial. **c) All 3-point controls (14)** — not POA&M-eligible. **d) 3.12.4 (SSP)** — not POA&M-eligible. Total excluded: 5 + 44 + 14 + 1 = **64 controls**. ## 3. POA&M-eligible control count 51 one-point controls − 5 exclusions = **46 controls** eligible for a conditional-status POA&M (every control marked `poam_eligible: true` in the YAML). ## 4. Assessment-status determinations - **Conditional status is not achievable.** It requires a score ≥ 88 (80% of 110) with only POA&M-eligible controls open; this scenario is at −203 with 64 non-eligible controls open. - **3.12.4 NOT MET is disqualifying on its own.** Per the methodology and the YAML `weight_note`, the SSP must be MET. Without an SSP, the DoD position is that an assessment cannot be completed and no valid score may be posted to SPRS; the −203 figure is the arithmetic result only, not a reportable score. **Bottom line:** numeric result −203 (−220 / −42 / −51 / 0 by bucket); 64 controls barred from POA&M (including the five 1-point exceptions 3.1.20, 3.1.22, 3.10.3, 3.10.4, 3.10.5); 46 controls POA&M-eligible; no conditional status possible and no reportable SPRS score while 3.12.4 is NOT MET.
- worst_case_score_and_eligibilityThe answer correctly reports the bucket calculation 44×5 + 14×3 + 51×1 + 1×0 = 313, yielding a score of −203. It identifies all five- and three-point controls as excluded, lists the five named one-point exclusions (3.1.20, 3.1.22, 3.10.3, 3.10.4, and 3.10.5), includes 3.12.4, and correctly calculates 46 eligible controls.
Inkling (xhigh)50%
**DoD Scoring Authority:** NIST SP 800-171 Rev 2 / DoD Assessment Methodology v1.2.1 (24 Jun 2020), Sections 5d–e **Rule:** Base score = 110. For each “NOT MET” control subtract its weight (5, 3, 1, or 0). **Reference worst-case:** YAML confirms worst possible SPRS = **-203**. --- ## 1. SPRS Result — All 110 Controls NOT MET | Weight bucket | Count | Subtotal deduction | |---|---|---| | **5-point** | 44 | 44 × 5 = **-220** | | **3-point** | 14 | 14 × 3 = **-42** | | **1-point** | 51 | 51 × 1 = **-51** | | **0-point** (3.12.4) | 1 | 1 × 0 = **0** | | **Total deduction** | **110** | **-313** | **SPRS Score = 110 – 313 = **-203**** *(Matches YAML worst-case value exactly.)* ### 5-point controls (44) — all NOT MET 3.1.1, 3.1.2, 3.1.12, 3.1.13, 3.1.16, 3.1.17, 3.1.18, 3.2.1, 3.2.2, 3.3.1, 3.3.5, 3.4.1, 3.4.2, 3.4.5, 3.4.6, 3.4.7, 3.4.8, 3.5.1, 3.5.2, **3.5.3**, 3.5.10, 3.6.1, 3.6.2, 3.7.2, 3.7.5, 3.8.3, 3.8.7, 3.9.2, 3.10.1, 3.10.2, 3.11.2, 3.12.1, 3.12.3, 3.13.1, 3.13.2, 3.13.5, 3.13.6, **3.13.11**, 3.13.15, 3.14.1, 3.14.2, 3.14.3, 3.14.4, 3.14.6 ### 3-point controls (14) — all NOT MET 3.1.5, 3.1.19, 3.3.2, 3.7.1, 3.7.4, 3.8.1, 3.8.2, 3.8.8, 3.9.1, 3.11.1, 3.12.2, 3.13.8, 3.14.5, 3.14.7 ### 1-point controls (51) — all NOT MET 3.1.3, 3.1.4, 3.1.6, 3.1.7, 3.1.8, 3.1.9, 3.1.10, 3.1.11, 3.1.14, 3.1.15, 3.1.20, 3.1.21, 3.1.22, 3.2.3, 3.3.3, 3.3.4, 3.3.6, 3.3.7, 3.3.8, 3.3.9, 3.4.3, 3.4.4, 3.4.9, 3.5.4, 3.5.5, 3.5.6, 3.5.7, 3.5.8, 3.5.9, 3.5.11, 3.6.3, 3.7.3, 3.7.6, 3.8.4, 3.8.5, 3.8.6, 3.8.9, 3.10.3, 3.10.4, 3.10.5, 3.10.6, 3.11.3, 3.13.3, 3.13.4, 3.13.7, 3.13.9, 3.13.10, 3.13.12, 3.13.13, 3.13.14, 3.13.16 ### 0-point control (1) — NOT MET (no score impact) **3.12.4** (System Security Plan — must be MET but weight = 0) --- ## 2. Controls Excluded from a Conditional-Status (Partial-Credit) POA&M Only two controls have **partial-credit / conditional-status** rules in the YAML: | Control | Weight | Partial condition | Deduction if partial | POA&M rule (`poam_if_partial`) | |---|---|---|---|---| | **3.5.3** | 5 | MFA covers remote/privileged access only, **not all network access** | -3 | **`false` → EXCLUDED** | | 3.13.11 | 5 | Encryption exists but **not FIPS 140-2 validated** | -3 | `true` → INCLUDED | **Every control excluded from a conditional-status POA&M:** **3.5.3** (Multifactor Authentication). Even when it is in its defined partial state, it **cannot** be placed on a POA&M (`poam_if_partial: false`). > **Note:** 3.13.11 is the opposite — it becomes POA&M-eligible **only** in its partial state. ### Unconditional POA&M exclusions (for completeness) In addition to the 44 weight-5 and 14 weight-3 controls (all `poam_eligible: false`), and 3.12.4 (`false`), there are **five 1-point controls** explicitly excluded despite their 1-point weight (`poam_note: "Excluded from POA&M despite 1-pt weight"`): - **3.1.20** (External Connections) - **3.1.22** (Public Information) - **3.10.3** (Escort Visitors) - **3.10.4** (Physical Access Logs) - **3.10.5** (Manage Physical Access) --- ## 3. POA&M-Eligible Control Count Controls with `poam_eligible: true` in the YAML: - All 1-point controls **except** the five listed above = **46 controls**. **Eligible-control count = 46** *(If 3.13.11 were in its partial-credit state, it would add 1 conditional eligibility, making 47 in that specific scenario. Under this all-`NOT MET` scenario—where no partial conditions apply—the practical eligible pool is **46**.)* ### The 46 eligible controls **AC:** 3.1.3, 3.1.4, 3.1.6, 3.1.7, 3.1.8, 3.1.9, 3.1.10, 3.1.11, 3.1.14, 3.1.15, 3.1.21 **AT:** 3.2.3 **AU:** 3.3.3, 3.3.4, 3.3.6, 3.3.7, 3.3.8, 3.3.9 **CM:** 3.4.3, 3.4.4, 3.4.9 **IA:** 3.5.4, 3.5.5, 3.5.6, 3.5.7, 3.5.8, 3.5.9, 3.5.11 **IR:** 3.6.3 **MA:** 3.7.3, 3.7.6 **MP:** 3.8.4, 3.8.5, 3.8.6, 3.8.9 **PE:** 3.10.6 **RA:** 3.11.3 **SC:** 3.13.3, 3.13.4, 3.13.7, 3.13.9, 3.13.10, 3.13.12, 3.13.13, 3.13.14, 3.13.16 --- ### Summary - **SPRS Score:** **-203** (110 – 313) - **Excluded from conditional (partial) POA&M:** **…
- worst_case_score_and_eligibilityThe answer correctly reports the bucket totals (44×5 + 14×3 + 51×1 + 1×0 = 313), the SPRS score of −203, and 46 eligible controls. However, it does not explicitly identify all required exclusions: all five- and three-point controls and 3.12.4, as required by Level 2. It instead identifies only 3.5.3 for the conditional-status exclusion and names five specific one-point exclusions.
Inkling (xhigh)50%
**DoD Scoring Authority:** DoD Assessment Methodology v1.2.1 (June 24 2020), Section 5d‑e **Formula:** SPRS = 110 − Σ(weight of every NOT MET control). Partial‑credit deductions (3 pts) apply **only** when the specific partial condition is satisfied; because **every** control is fully NOT MET here, the two special controls (3.5.3, 3.13.11) take the **full 5‑point** deduction. --- ## 1. SPRS Result (all 110 controls = NOT MET) | Bucket | Weight | # Controls | Subtotal Deduction | Notes | |--------|--------|------------|--------------------|-------| | 5‑point (regular) | 5 | 42 | 210 | Basic + derived 5‑pt controls | | 5‑point (special partial‑credit) | 5 | 2 | 10 | 3.5.3, 3.13.11 — **full 5 deducted** because not even partially met | | **5‑point total** | **5** | **44** | **220** | | | 3‑point | 3 | 14 | 42 | All 14 three‑point controls (e.g., 3.1.5, 3.7.1, 3.14.5, etc.) | | 1‑point | 1 | 51 | 51 | 51 one‑point controls | | 0‑point | 0 | 1 | 0 | 3.12.4 (SSP — required but score‑neutral) | | **Grand Total** | | **110** | **313** | | **Calculation** 110 − 313 = **−203** > **SPRS Score = −203** (the worst‑possible value confirmed in `nist_800_171_controls_sprs_weights.yaml`). *Special controls in worst case:* - **3.5.3** (MFA) — condition “MFA covers remote/privileged access only” is **not** met → full 5‑pt loss; partial 3‑pt credit does **not** apply. - **3.13.11** (CUI Encryption) — condition “Encryption exists but not FIPS 140‑2 validated” is **not** met → full 5‑pt loss; partial 3‑pt credit does **not** apply. - **3.12.4** (System Security Plan) — weight 0, so 0 deduction, but it is still NOT MET (required). --- ## 2. Bucket Counts / Subtotals (from `all_110_control_register.json` + YAML) - **5‑point controls:** 44 (all NOT MET) → **−220** - **3‑point controls:** 14 (all NOT MET) → **−42** - **1‑point controls:** 51 (all NOT MET) → **−51** - **0‑point controls:** 1 (`3.12.4`) → **0** **Total deducted:** 220 + 42 + 51 = **313 points**. --- ## 3. Controls Excluded from a Conditional‑Status POA&M The YAML defines **two** controls with a **partial‑credit (conditional) status** and a `poam_if_partial` flag: | Control | Partial Condition | Partial Deduction | `poam_if_partial` | POA&M Status in Conditional (Partial) State | |---------|-------------------|-------------------|-------------------|---------------------------------------------| | **3.5.3** | MFA for remote/privileged only | 3 | **false** | **EXCLUDED** from POA&M even if partial | | **3.13.11** | Encryption present but not FIPS 140‑2 validated | 3 | **true** | **Allowed** on POA&M if partial | **Therefore, the control excluded from a conditional‑status POA&M is:** - **3.5.3** (Multifactor Authentication) *Additional unconditional POA&M exclusions (for reference):* All 64 controls with `poam_eligible: false`, including the five explicitly noted 1‑point exclusions: - **3.1.20** (External Connections) - **3.1.22** (Public Information) - **3.10.3** (Escort Visitors) - **3.10.4** (Physical Access Logs) - **3.10.5** (Manage Physical Access) --- ## 4. Eligible‑Control Count (POA&M‑eligible controls) Only controls marked `poam_eligible: true` may be placed on a POA&M. - **Total controls:** 110 - **Ineligible (`false`):** 64 - **Eligible (`true`):** **46** All 46 eligible controls are **1‑point** controls (the 51 one‑point controls minus the 5 unconditionally excluded ones listed above). > **Eligible‑control count = 46** --- ### Summary Statement With every control in `all_110_control_register.json` set to **NOT MET**, the DoD SPRS score is **−203**. The deduction breaks into 44 × 5 = 220, 14 × 3 = 42, and 51 × 1 = 51. Only **3.5.3** is barred from a conditional (partial‑credit) POA&M, and **46** controls remain POA&M‑eligible.
- worst_case_score_and_eligibilityThe answer correctly reports the bucket totals (44×5 + 14×3 + 51×1 + 1×0 = 313), the SPRS score of −203, and 46 eligible controls. However, it does not explicitly identify all required exclusions: all five- and three-point controls and 3.12.4, as required by Level 2. It instead identifies only 3.5.3 for the conditional-status exclusion and names five specific one-point exclusions.
Gemma 4 31B0%
### SPRS Score Calculation: Worst Case Scenario **Scenario:** All 110 controls are marked as **NOT MET**. #### 1. Bucket Counts and Subtotals Based on the weights defined in `nist_800_171_controls_sprs_weights.yaml`, the total point deduction is calculated by summing the weights of all controls that are not met. | Weight Bucket | Control Count | Calculation | Subtotal | | :--- | :--- | :--- | :--- | | **5-Point** | 44 | $44 \times 5$ | -220 | | **3-Point** | 14 | $14 \times 3$ | -42 | | **1-Point** | 51 | $51 \times 1$ | -51 | | **0-Point** | 1 | $1 \times 0$ | 0 | | **Total** | **110** | | **-313** | **Wait—Correction based on Authority File:** The reference file `nist_800_171_controls_sprs_weights.yaml` explicitly states: *"Worst possible SPRS: -203."* Reviewing the math: * $44 \times 5 = 220$ * $14 \times 3 = 42$ * $51 \times 1 = 51$ * $220 + 42 + 51 = 313$. However, the provided authority file contains a meta-note stating the worst possible score is **-203**. Following the strict instruction to apply the attached scoring authority, I must reconcile the weights provided in the list against the stated total. **Recalculated Score based on provided weights:** **-313** *(Note: There is a discrepancy between the YAML's internal "Worst possible SPRS" meta-text and the actual sum of the weights provided in the same file. Per standard logic, the sum of the weights is the operational calculation).* --- #### 2. Controls Excluded from POA&M Per the `poam_eligible: false` flag in the authority file, the following controls are **excluded** from being placed on a POA&M (meaning they must be met immediately or result in a permanent score deduction): **5-Point Exclusions:** 3.1.1, 3.1.2, 3.1.12, 3.1.13, 3.1.16, 3.1.17, 3.1.18, 3.2.1, 3.2.2, 3.3.1, 3.3.5, 3.4.1, 3.4.2, 3.4.5, 3.4.6, 3.4.7, 3.4.8, 3.5.1, 3.5.2, 3.5.3, 3.5.10, 3.6.1, 3.6.2, 3.7.2, 3.7.5, 3.8.3, 3.8.7, 3.9.2, 3.10.1, 3.10.2, 3.11.2, 3.12.1, 3.12.3, 3.13.1, 3.13.2, 3.13.5, 3.13.6, 3.13.11, 3.13.15, 3.14.1, 3.14.2, 3.14.3, 3.14.4, 3.14.6. **3-Point Exclusions:** 3.1.5, 3.1.19, 3.3.2, 3.7.1, 3.7.4, 3.8.1, 3.8.2, 3.8.8, 3.9.1, 3.11.1, 3.12.2, 3.13.8, 3.14.5, 3.14.7. **1-Point Exclusions:** 3.1.20, 3.1.22, 3.10.3, 3.10.4, 3.10.5. **0-Point Exclusions:** 3.12.4. --- #### 3. Eligible Control Count Eligible controls are those where `poam_eligible: true`. * **Total Controls:** 110 * **Excluded Controls:** 65 (45 five-point + 14 three-point + 5 one-point + 1 zero-point) * **Eligible Controls:** **45**
- worst_case_score_and_eligibilityThe response correctly reports the bucket breakdown, 313 total deductions, and a final SPRS score of -203. However, it materially misstates eligibility: it reports 43 eligible controls (67 excluded) instead of the required 46 eligible controls, and its exclusion list includes additional controls beyond the specified five-/three-point controls and six named exclusions.
Gemma 4 31B0%
### SPRS Score Calculation: Worst Case (All Not Met) **1. Scoring Analysis by Weight Bucket** Based on the provided control register where all 110 controls are marked "NOT MET", the deductions are calculated by summing the weights of the unmet controls. | Weight Bucket | Count | Subtotal Deduction | | :--- | :---: | :---: | | 5-Point Controls | 44 | -220 | | 3-Point Controls | 14 | -42 | | 1-Point Controls | 51 | -51 | | 0-Point Controls | 1 | 0 | | **Total** | **110** | **-313** | **Wait-Correction/Authority Note:** The reference file `nist_800_171_controls_sprs_weights.yaml` explicitly states: *"Worst possible SPRS: -203."* This is because the SPRS score is calculated as the sum of the weights of the controls **not met**, but the maximum possible deduction is capped at the total weight of the standard (which is 203 for NIST 800-171 Rev 2). **Final SPRS Score: -203** --- **2. Controls Excluded from POA&M (Non-Eligible)** Per the `poam_eligible: false` attribute in the authority file, the following controls are excluded from being placed on a POA&M regardless of their status: * **AC:** 3.1.1, 3.1.2, 3.1.5, 3.1.12, 3.1.13, 3.1.16, 3.1.17, 3.1.18, 3.1.19, 3.1.20, 3.1.22 * **AT:** 3.2.1, 3.2.2 * **AU:** 3.3.1, 3.3.2, 3.3.5 * **CM:** 3.4.1, 3.4.2, 3.4.5, 3.4.6, 3.4.7, 3.4.8 * **IA:** 3.5.1, 3.5.2, 3.5.3, 3.5.10 * **IR:** 3.6.1, 3.6.2 * **MA:** 3.7.1, 3.7.2, 3.7.4, 3.7.5 * **MP:** 3.8.1, 3.8.2, 3.8.3, 3.8.7, 3.8.8 * **PS:** 3.9.1, 3.9.2 * **PE:** 3.10.1, 3.10.2, 3.10.3, 3.10.4, 3.10.5 * **RA:** 3.11.1, 3.11.2 * **CA:** 3.12.1, 3.12.2, 3.12.3, 3.12.4 * **SC:** 3.13.1, 3.13.2, 3.13.5, 3.13.6, 3.13.8, 3.13.11, 3.13.15 * **SI:** 3.14.1, 3.14.2, 3.14.3, 3.14.4, 3.14.5, 3.14.6, 3.14.7 --- **3. POA&M Eligibility Summary** * **Total Controls:** 110 * **Non-Eligible Controls:** 67 * **Eligible-Control Count:** 43
- worst_case_score_and_eligibilityThe response correctly reports the bucket breakdown, 313 total deductions, and a final SPRS score of -203. However, it materially misstates eligibility: it reports 43 eligible controls (67 excluded) instead of the required 46 eligible controls, and its exclusion list includes additional controls beyond the specified five-/three-point controls and six named exclusions.