cdc6bb33d3
Completes 109 of 121 tasks. Every remaining task needs a tenant connection
(T055, T056, T101-T103) or an Azure Automation account (T115-T121).
354 offline Pester tests PASS
Engine purity (Principle IV) PASS
Sanitization (SC-013) PASS (156 files)
Graph module loaded in tests none (SC-008 holds)
What landed
- Four-layer configuration validation with stable finding codes, covering
every VR-002 and VR-003 condition, plus a 23-fixture invalid-config corpus
- Run loop, audit records (NDJSON through a single sink), summaries,
reconciliation, and exit codes 0-6
- Persistence behind a single write-body builder whose result always has
exactly one key
- Invoke-PersonaEngine.ps1 and Edit-PersonaEngineConfig.ps1
- Six docs, two pipelines, traceability matrix, V-5a and sanitization records
Three deviations from tasks.md, each recorded in its status block
T033 is not in Resolve-UserPersona. evaluationErrorThreshold is run-level
state and the rule engine is pure; a counter there would break Principle IV.
It lives in New-PersonaRunCounter and is applied in the run loop.
A new src/Engine/ layer holds Invoke-PersonaEngineRun. The entry script
imports the manifest, which requires Microsoft.Graph.Authentication, so a
loop living only inside it could not run on a machine without the Graph SDK
and SC-004 could not be proven at all. The entry script is now a thin
wrapper and what ships is what is tested.
The invalid-config corpus is generated by a committed script, with the
generated fixtures committed too, so a reviewer sees the fixture in the diff.
Defects found by running the code, not by reading it
Group and role ID lists were double-wrapped: @(Get-PersonaGroupIdPage ...)
around a comma-returned array collapsed every membership list into one
bogus space-joined entry. That is a silent false non-match, exactly what
FR-013 exists to prevent.
A 403 whose status appears only in the exception message parsed as $null,
which the retry policy treats as a transport error - five requests per
account against a tenant already refusing. Status extraction now falls back
to the message text, bounded to 400-599.
The sanitization scan walked tracked files only, so it covered 34 of 156
files and none of this phase's code. It now scans untracked non-ignored
files too, and a negative control confirms it catches a planted leak.
Test-Json reports one error per violating location, not first-failure-only
as the V-5a draft claimed. Record and pin corrected.
Enforcement remains blocked on the V-4 security sign-off.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
131 lines
6.3 KiB
PowerShell
131 lines
6.3 KiB
PowerShell
#Requires -Modules @{ ModuleName = 'Pester'; ModuleVersion = '5.0.0' }
|
|
|
|
<#
|
|
Editor exit codes 0-4 (cli-edit-persona-engine-config.md).
|
|
|
|
An exit code is the only thing a pipeline sees. Every code has to be reachable and
|
|
has to mean what the contract says - in particular, code 3 (file unreadable) and
|
|
code 4 (schema unusable) must not collapse into code 1, or a missing schema file
|
|
gets reported to a rule author as "your configuration is invalid".
|
|
#>
|
|
|
|
BeforeAll {
|
|
$repoRoot = Split-Path (Split-Path $PSScriptRoot -Parent) -Parent
|
|
. (Join-Path $repoRoot 'tests/TestHelpers.ps1')
|
|
|
|
$script:editor = Join-Path $repoRoot 'Edit-PersonaEngineConfig.ps1'
|
|
$script:scratch = Join-Path ([System.IO.Path]::GetTempPath()) ("pe-ec-{0}" -f [guid]::NewGuid().ToString('N'))
|
|
$null = New-Item -ItemType Directory -Path $script:scratch -Force
|
|
|
|
function Invoke-Editor {
|
|
param([string[]] $ArgumentList)
|
|
|
|
$exe = (Get-Process -Id $PID).Path
|
|
$null = & $exe -NoProfile -NonInteractive -File $script:editor @ArgumentList 2>&1
|
|
$LASTEXITCODE
|
|
}
|
|
}
|
|
|
|
AfterAll {
|
|
Remove-Item -LiteralPath $script:scratch -Recurse -Force -ErrorAction SilentlyContinue
|
|
}
|
|
|
|
Describe 'Editor exit codes' {
|
|
|
|
It 'returns 0 for a valid configuration' {
|
|
$path = Save-TestConfiguration -Document (New-TestConfigurationDocument) -Directory $script:scratch
|
|
|
|
Invoke-Editor -ArgumentList @('-ConfigPath', $path, '-ValidateOnly', '-NonInteractive') | Should -Be 0
|
|
}
|
|
|
|
It 'returns 1 when Error findings are present' {
|
|
$document = New-TestConfigurationDocument
|
|
$document.rules[1].persona = 'Undeclared-Persona'
|
|
|
|
$path = Save-TestConfiguration -Document $document -Directory $script:scratch
|
|
|
|
Invoke-Editor -ArgumentList @('-ConfigPath', $path, '-ValidateOnly', '-NonInteractive') | Should -Be 1
|
|
}
|
|
|
|
It 'returns 2 for Warning findings under -TreatWarningsAsErrors' {
|
|
# A pinned global mode plus a per-condition override: a Warning, not an Error.
|
|
# VR-005 escalates it only when the caller asks.
|
|
$document = New-TestConfigurationDocument
|
|
$document.dataSources.groups.membershipMode = 'direct'
|
|
$document.rules += @{
|
|
id = 'RULE-0030-TIER0'; name = 'Tier 0'; description = 'Tier 0 group members.'
|
|
enabled = $true; priority = 30; persona = 'Tier0-Admin'
|
|
match = @{
|
|
operator = 'all'
|
|
conditions = @(@{
|
|
type = 'membership'; operator = 'memberOf'; membershipMode = 'transitive'
|
|
groupObjectIds = @('00000000-0000-0000-0000-0000000000a0')
|
|
})
|
|
}
|
|
}
|
|
|
|
$path = Save-TestConfiguration -Document $document -Directory $script:scratch
|
|
|
|
Invoke-Editor -ArgumentList @('-ConfigPath', $path, '-ValidateOnly', '-NonInteractive') | Should -Be 0
|
|
Invoke-Editor -ArgumentList @('-ConfigPath', $path, '-ValidateOnly', '-NonInteractive', '-TreatWarningsAsErrors') | Should -Be 2
|
|
}
|
|
|
|
It 'returns 3 when the configuration file is absent' {
|
|
Invoke-Editor -ArgumentList @('-ConfigPath', (Join-Path $script:scratch 'absent.json'), '-ValidateOnly', '-NonInteractive') | Should -Be 3
|
|
}
|
|
|
|
It 'returns 4 when the schema file is absent' {
|
|
$path = Save-TestConfiguration -Document (New-TestConfigurationDocument) -Directory $script:scratch
|
|
|
|
Invoke-Editor -ArgumentList @(
|
|
'-ConfigPath', $path, '-ValidateOnly', '-NonInteractive',
|
|
'-SchemaPath', (Join-Path $script:scratch 'no-schema.json')) | Should -Be 4
|
|
}
|
|
|
|
It 'returns 4 when the schema file exists but cannot be parsed' {
|
|
# Distinct from code 1 on purpose. The configuration was never actually
|
|
# checked, so calling it invalid would be a guess.
|
|
$brokenSchema = Join-Path $script:scratch 'broken.json'
|
|
Set-Content -LiteralPath $brokenSchema -Value '{ not json' -Encoding utf8NoBOM
|
|
|
|
$path = Save-TestConfiguration -Document (New-TestConfigurationDocument) -Directory $script:scratch
|
|
|
|
Invoke-Editor -ArgumentList @('-ConfigPath', $path, '-ValidateOnly', '-NonInteractive', '-SchemaPath', $brokenSchema) | Should -Be 4
|
|
}
|
|
|
|
It 'prefers code 3 over code 1 when the file cannot be read at all' {
|
|
# An unreadable file produces a PE-SYN Error finding too. Reporting code 1
|
|
# would tell the author their rules are wrong when the file never opened.
|
|
Invoke-Editor -ArgumentList @('-ConfigPath', $script:scratch, '-ValidateOnly', '-NonInteractive') | Should -Be 3
|
|
}
|
|
|
|
It 'reaches every documented code across the corpus' {
|
|
$reached = [System.Collections.Generic.HashSet[int]]::new()
|
|
|
|
$valid = Save-TestConfiguration -Document (New-TestConfigurationDocument) -Directory $script:scratch
|
|
$null = $reached.Add((Invoke-Editor -ArgumentList @('-ConfigPath', $valid, '-ValidateOnly', '-NonInteractive')))
|
|
|
|
$invalidDoc = New-TestConfigurationDocument
|
|
$invalidDoc.rules[1].persona = 'Undeclared-Persona'
|
|
$invalid = Save-TestConfiguration -Document $invalidDoc -Directory $script:scratch
|
|
$null = $reached.Add((Invoke-Editor -ArgumentList @('-ConfigPath', $invalid, '-ValidateOnly', '-NonInteractive')))
|
|
|
|
$warnDoc = New-TestConfigurationDocument
|
|
$warnDoc.dataSources.groups.membershipMode = 'direct'
|
|
$warnDoc.rules += @{
|
|
id = 'RULE-0030-TIER0'; name = 'Tier 0'; description = 'Tier 0 group members.'
|
|
enabled = $true; priority = 30; persona = 'Tier0-Admin'
|
|
match = @{ operator = 'all'; conditions = @(@{
|
|
type = 'membership'; operator = 'memberOf'; membershipMode = 'transitive'
|
|
groupObjectIds = @('00000000-0000-0000-0000-0000000000a0') }) }
|
|
}
|
|
$warn = Save-TestConfiguration -Document $warnDoc -Directory $script:scratch
|
|
$null = $reached.Add((Invoke-Editor -ArgumentList @('-ConfigPath', $warn, '-ValidateOnly', '-NonInteractive', '-TreatWarningsAsErrors')))
|
|
|
|
$null = $reached.Add((Invoke-Editor -ArgumentList @('-ConfigPath', (Join-Path $script:scratch 'absent.json'), '-ValidateOnly', '-NonInteractive')))
|
|
$null = $reached.Add((Invoke-Editor -ArgumentList @('-ConfigPath', $valid, '-ValidateOnly', '-NonInteractive', '-SchemaPath', (Join-Path $script:scratch 'no-schema.json'))))
|
|
|
|
0..4 | ForEach-Object { $reached | Should -Contain $_ }
|
|
}
|
|
}
|