cdc6bb33d3
Completes 109 of 121 tasks. Every remaining task needs a tenant connection
(T055, T056, T101-T103) or an Azure Automation account (T115-T121).
354 offline Pester tests PASS
Engine purity (Principle IV) PASS
Sanitization (SC-013) PASS (156 files)
Graph module loaded in tests none (SC-008 holds)
What landed
- Four-layer configuration validation with stable finding codes, covering
every VR-002 and VR-003 condition, plus a 23-fixture invalid-config corpus
- Run loop, audit records (NDJSON through a single sink), summaries,
reconciliation, and exit codes 0-6
- Persistence behind a single write-body builder whose result always has
exactly one key
- Invoke-PersonaEngine.ps1 and Edit-PersonaEngineConfig.ps1
- Six docs, two pipelines, traceability matrix, V-5a and sanitization records
Three deviations from tasks.md, each recorded in its status block
T033 is not in Resolve-UserPersona. evaluationErrorThreshold is run-level
state and the rule engine is pure; a counter there would break Principle IV.
It lives in New-PersonaRunCounter and is applied in the run loop.
A new src/Engine/ layer holds Invoke-PersonaEngineRun. The entry script
imports the manifest, which requires Microsoft.Graph.Authentication, so a
loop living only inside it could not run on a machine without the Graph SDK
and SC-004 could not be proven at all. The entry script is now a thin
wrapper and what ships is what is tested.
The invalid-config corpus is generated by a committed script, with the
generated fixtures committed too, so a reviewer sees the fixture in the diff.
Defects found by running the code, not by reading it
Group and role ID lists were double-wrapped: @(Get-PersonaGroupIdPage ...)
around a comma-returned array collapsed every membership list into one
bogus space-joined entry. That is a silent false non-match, exactly what
FR-013 exists to prevent.
A 403 whose status appears only in the exception message parsed as $null,
which the retry policy treats as a transport error - five requests per
account against a tenant already refusing. Status extraction now falls back
to the message text, bounded to 400-599.
The sanitization scan walked tracked files only, so it covered 34 of 156
files and none of this phase's code. It now scans untracked non-ignored
files too, and a negative control confirms it catches a planted leak.
Test-Json reports one error per violating location, not first-failure-only
as the V-5a draft claimed. Record and pin corrected.
Enforcement remains blocked on the V-4 security sign-off.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
115 lines
5.2 KiB
PowerShell
115 lines
5.2 KiB
PowerShell
#Requires -Modules @{ ModuleName = 'Pester'; ModuleVersion = '5.0.0' }
|
|
|
|
<#
|
|
SC-002: a second consecutive run over unchanged input proposes zero changes.
|
|
|
|
Idempotence is what makes the engine safe to schedule. A run that rewrites the
|
|
same value every time produces directory churn, floods the audit trail, and makes
|
|
a genuine change indistinguishable from routine noise.
|
|
#>
|
|
|
|
BeforeAll {
|
|
$repoRoot = Split-Path (Split-Path $PSScriptRoot -Parent) -Parent
|
|
. (Join-Path $repoRoot 'tests/TestHelpers.ps1')
|
|
foreach ($file in (Get-PersonaSourceFile -RepoRoot $repoRoot)) { . $file }
|
|
|
|
$script:target = 'extension_<EXTENSION-APP-ID>_<PERSONA>'
|
|
$script:config = New-TestRuntimeConfiguration -TargetAttribute $target
|
|
}
|
|
|
|
Describe 'Idempotence across consecutive runs (SC-002)' -Tag 'Safety' {
|
|
|
|
BeforeEach {
|
|
Mock Write-Host { }
|
|
|
|
# A mutable population, so the second run genuinely sees what the first wrote
|
|
# rather than a fresh copy of the original fixtures. Re-reading the same
|
|
# unchanged fixtures would prove nothing about idempotence.
|
|
$script:store = @{}
|
|
foreach ($user in (New-TestPopulation -Count 20 -TargetAttribute $script:target)) {
|
|
$script:store[$user['id']] = $user
|
|
}
|
|
|
|
Mock Get-PersonaUsers { $script:store.Values }
|
|
|
|
Mock Set-UserPersonaAttribute {
|
|
$script:store[$UserObjectId][$AttributeName] = $Value
|
|
[pscustomobject]@{ Succeeded = $true; AccountObjectId = $UserObjectId; Value = $Value; PreviousValue = $PreviousValue }
|
|
}
|
|
}
|
|
|
|
It 'proposes zero changes on the second run' {
|
|
$first = Invoke-PersonaEngineRun -Configuration $config -TargetAttribute $target `
|
|
-Context (New-TestAuditContext -Mode 'Enforce') -IsEnforcing `
|
|
-ShouldProcessGate { param($t, $d) $true }
|
|
|
|
$first.Counters.Updated | Should -BeGreaterThan 0
|
|
|
|
$second = Invoke-PersonaEngineRun -Configuration $config -TargetAttribute $target `
|
|
-Context (New-TestAuditContext -Mode 'Enforce') -IsEnforcing `
|
|
-ShouldProcessGate { param($t, $d) $true }
|
|
|
|
$second.Counters.Updated | Should -Be 0
|
|
$second.Counters.WouldUpdate | Should -Be 0
|
|
}
|
|
|
|
It 'issues no write request at all on the second run' {
|
|
$null = Invoke-PersonaEngineRun -Configuration $config -TargetAttribute $target `
|
|
-Context (New-TestAuditContext -Mode 'Enforce') -IsEnforcing `
|
|
-ShouldProcessGate { param($t, $d) $true }
|
|
|
|
$writesAfterFirst = 0
|
|
Should -Invoke Set-UserPersonaAttribute -Times 0 -Exactly -Scope It -ParameterFilter { $false }
|
|
|
|
$before = $script:store.Values | ForEach-Object { $_[$script:target] }
|
|
|
|
$second = Invoke-PersonaEngineRun -Configuration $config -TargetAttribute $target `
|
|
-Context (New-TestAuditContext -Mode 'Enforce') -IsEnforcing `
|
|
-ShouldProcessGate { param($t, $d) $true }
|
|
|
|
$after = $script:store.Values | ForEach-Object { $_[$script:target] }
|
|
|
|
($after -join '|') | Should -Be ($before -join '|')
|
|
$second.Counters.Unchanged | Should -Be $second.Counters.Processed
|
|
}
|
|
|
|
It 'produces identical counters on the second and third runs' {
|
|
$null = Invoke-PersonaEngineRun -Configuration $config -TargetAttribute $target `
|
|
-Context (New-TestAuditContext -Mode 'Enforce') -IsEnforcing `
|
|
-ShouldProcessGate { param($t, $d) $true }
|
|
|
|
$second = Invoke-PersonaEngineRun -Configuration $config -TargetAttribute $target `
|
|
-Context (New-TestAuditContext -Mode 'Enforce') -IsEnforcing `
|
|
-ShouldProcessGate { param($t, $d) $true }
|
|
|
|
$third = Invoke-PersonaEngineRun -Configuration $config -TargetAttribute $target `
|
|
-Context (New-TestAuditContext -Mode 'Enforce') -IsEnforcing `
|
|
-ShouldProcessGate { param($t, $d) $true }
|
|
|
|
$third.Counters.Matched | Should -Be $second.Counters.Matched
|
|
$third.Counters.Unclassified | Should -Be $second.Counters.Unclassified
|
|
$third.Counters.Unchanged | Should -Be $second.Counters.Unchanged
|
|
$third.Counters.Updated | Should -Be $second.Counters.Updated
|
|
}
|
|
|
|
It 'treats a case-only difference as a real change, so it converges rather than oscillating' {
|
|
# Change detection is ordinal (FR-015). A stored 'employee' against a
|
|
# calculated 'Employee' is corrected once and then stays corrected - the
|
|
# failure mode this guards against is a run that rewrites it every time.
|
|
foreach ($user in $script:store.Values) {
|
|
if ($user[$script:target]) { $user[$script:target] = ([string]$user[$script:target]).ToLowerInvariant() }
|
|
}
|
|
|
|
$first = Invoke-PersonaEngineRun -Configuration $config -TargetAttribute $target `
|
|
-Context (New-TestAuditContext -Mode 'Enforce') -IsEnforcing `
|
|
-ShouldProcessGate { param($t, $d) $true }
|
|
|
|
$second = Invoke-PersonaEngineRun -Configuration $config -TargetAttribute $target `
|
|
-Context (New-TestAuditContext -Mode 'Enforce') -IsEnforcing `
|
|
-ShouldProcessGate { param($t, $d) $true }
|
|
|
|
$first.Counters.Updated | Should -BeGreaterThan 0
|
|
$second.Counters.Updated | Should -Be 0
|
|
}
|
|
}
|