Summary
Add a CI workflow that runs complyctl commands inside the devcontainer environment and validates the resulting EvaluationLog against the Gemara CUE schema. This gives PR authors and reviewers confidence that scan output conforms to the schema before merge. This will allow users to check the fields of the EvaluationLog and ensure their values are consistent with the expected testdata (e.g., EvaluationLog using mock-oci-registry test-opa-bp policy-id should include assessment-logs with the testdata gemara requirement ids check-run-as-nonroot and check-resource-limits).
Problem
The existing cross-repo integration test validates structural correctness but does not validate EvaluationLog conformance against the Gemara CUE schema. This gap allowed complytime/complytime-providers#63 to reach main — the OPA provider returned steps: [], violating the schema's minimum-one-step constraint.
Hat tip to @hbraswelrh for giving the notes for the issue.
Acceptance Criteria
Summary
Add a CI workflow that runs
complyctlcommands inside the devcontainer environment and validates the resulting EvaluationLog against the Gemara CUE schema. This gives PR authors and reviewers confidence that scan output conforms to the schema before merge. This will allow users to check the fields of the EvaluationLog and ensure their values are consistent with the expected testdata (e.g.,EvaluationLogusing mock-oci-registrytest-opa-bppolicy-id should include assessment-logs with the testdata gemara requirement idscheck-run-as-nonrootandcheck-resource-limits).Problem
The existing cross-repo integration test validates structural correctness but does not validate EvaluationLog conformance against the Gemara CUE schema. This gap allowed complytime/complytime-providers#63 to reach main — the OPA provider returned
steps: [], violating the schema's minimum-one-step constraint.Hat tip to @hbraswelrh for giving the notes for the issue.
Acceptance Criteria
.devcontainer/complyctl get,generate, andscanfor available test providerscue vetagainst the Gemara schemaworkflow_dispatchfor manual triggering