Define the boundaries
Set expectations before execution. Human-readable standards and reusable agent skills guide planning, implementation, review, security, QA, and release work.
AI Engineering Guardrails / standards, skills, and verification
AI turns directives into code faster than ever. Build assurance into the work before changes ship. AI Engineering Guardrails provides the foundation: clear standards, controlled agent skills, and checks connected to evidence.
Your directives. Disciplined execution. Evidence before release.
Set expectations before execution. Human-readable standards and reusable agent skills guide planning, implementation, review, security, QA, and release work.
Run your build, tests, QA, and scanners against the change. Choose the checks, thresholds, and enforcement that fit your repository’s risks.
Proof binds results to the evaluated revision. Inspect passing checks, failures, and missing evidence before making a release decision.
All toolkit checks are optional to adopt. Installing skills does not run them or make checks required. Your team owns its application, commands, review decisions, and release authority.
Separate decisions · separate checks
A PR review and verification after merge answer different questions. Each checkpoint below has its own check list, revision and evidence. There is no combined score.
Historical examples from ravisingh11/ai-software-toolkit. These runs come from different changes. They are fixed teaching examples, not the latest results for the repository shown on this page.
Recorded PR policy evidence · advisory
Ready for review?
pull_request_target2388c864ef72Four PR checks from the recorded evaluation of PR #164.
Review the recorded metadata and size findings. Collect fresh evidence and inspect current merge requirements before deciding to merge.
Inspect this recorded runRecorded workflow observations · main
Did this main revision pass its adopted verification?
push: refs/heads/main8a36b246f6bdThree verification steps from Distribution Acceptance on main. These are workflow outcomes, not a Proof policy score.
Inspect evidence for the resulting main revision. Release, deployment approval and live health each need their own evidence and authorization.
Inspect this recorded runPR findings do not become main results. Main CI does not establish deployment health. These examples never contribute to the live scorecard totals below. Checks remain optional, Core advisory, and lifecycle/polyglot manual.
CI evidence / change assessment
Latest published PR results for ravisingh11/ai-engineering-guardrails.
Evaluation stage: Pull-request development. The catalog offers tools to adopt as your project needs them; it is not a checklist every project must complete.
Explore the full built-in catalog. All checks are optional to adopt. Only selected checks applicable to this evaluation count toward the score.
Included in this evaluation; selection does not mean passed.
Optional checks outside this evaluation’s score.
Checks for later stages. Lifecycle verification stays manual.
Results reflect the checks and policy used for that PR. Updating this page doesn’t rerun checks or verify current main.
No enforced controls are configured, so the policy decision is not gated by any control and every result is advisory. It does not establish mergeability or release readiness. GitHub required merge checks are separate. Advisory results do not block the toolkit policy decision. Enforced checks require a pass: a failed, blocked, or unverifiable enforced check blocks that decision. GitHub blocks merging only through its configured required checks and rulesets.
checks passed
Failed: 2
checks enforced
No checks enforced
checks passed
Failed: 2
The totals count 16 selected checks. Of the 33 built-in checks listed below, 16 are selected, 9 available to adopt and 8 relevant later. Only selected checks applicable to this evaluation count toward the totals; adoption options and later-stage checks are excluded. Selection does not mean execution or enforcement. See all checks ↑
| Controls | Passed | Failed |
|---|---|---|
| All selected checks | 14 | 2 |
| Advisory | 14 | 2 |
Failed means a reported failure. Blocked means the producer reported a blocker. Unavailable evidence includes not configured, disabled, awaiting manual run, and checks marked Unable to verify; see their separate counts and labels below. Zero-count categories are hidden; a dash means no results in that category. Tools available to adopt and checks relevant later are excluded from this stage’s score. Checks evaluated on another subject are identified separately. Unreported checks have unknown selection and are not assumed excluded.
Stage-specific evaluation
Built-in activation and evidence availability: No unavailable evidence reported. Advisory is a policy mode, independent of provider activation. These categories split unavailable evidence for built-in checks; none counts as passed.
These are the checks selected for this evaluation, plus any entries whose selection could not be validated. Adoption options and later-stage checks are listed separately below. Select a check to inspect its evidence. Provider names link to trusted base configuration when its identity is recorded. Latest reported run links open available evidence for this snapshot, not a newer scan. Provider names describe selection, not credential readiness or a passing scan. Not configured means required provider configuration is absent; it does not change the selected policy mode. Not reported means no validated row in this snapshot; it does not imply disabled or passed. A dash means the check has no active mode in this snapshot. Custom controls may contribute to totals without publishing their private names.
Checks needing attention come first. Source report links open the evaluation run containing the detailed evidence.
documentation-validationValidate documentation structure, links, and declared targets
Provider: Repository Validators · Latest reported run ↗
Advisory
The producer reported a failure.
Ran for 9s · completed
202 Markdown files · 487 local links checked · 0 broken · 1 documentation mapping failuresSelf-reported by the pull request's own workflow run; not independently verified and never used for the result.
| Assessment | Documentation integrity |
|---|---|
| Evaluates | Local Markdown links, declared documentation targets, and required documentation updates for changed files |
| Expected result | No broken local links and every documentation mapping is satisfied |
| Started (UTC) | 2026-11-03T16:37:21Z |
| Completed (UTC) | 2026-11-03T16:37:30Z |
| Execution time | 9s (9 seconds) |
| Producer conclusion | failure |
| Self-reported measurements | 202 Markdown files · 487 local links checked · 0 broken · 1 documentation mapping failures |
pr-metadataValidate pull-request title and body requirements against mutable PR state
Provider: Repository PR Metadata · Latest reported run ↗
Advisory
Missing required PR body section: ## Verification. Update the PR description and collect a fresh metadata result.
Title does not match the required format · 0 of 1 required section presentEvaluated by the trusted base-branch PR metadata validator. The title, description, and section names are not published.
| Assessment | PR title and description |
|---|---|
| Evaluates | Configured title pattern and required description sections; title and description text are not published |
| Expected result | Title matches the configured pattern and every required section is present |
| Execution time | Not supplied by this source report |
| Evaluated | Title does not match the required format · 0 of 1 required section present |
repository-validationValidate repository-owned contracts and configuration
Provider: Repository Validators · Latest reported run ↗
Advisory
Ran for 8s · completed
4 passed · 0 failed · 0 not run (4 contract groups)Self-reported by the pull request's own workflow run; not independently verified and never used for the result.
| Assessment | Installed Proof contracts |
|---|---|
| Evaluates | Installed runtime files, Semgrep self-test fixtures, schemas, and the control catalog, profiles, providers, and policy |
| Expected result | Every contract group validates; the first failure stops the run |
| Started (UTC) | 2026-11-03T16:37:18Z |
| Completed (UTC) | 2026-11-03T16:37:26Z |
| Execution time | 8s (8 seconds) |
| Producer conclusion | success |
| Self-reported measurements | 4 passed · 0 failed · 0 not run (4 contract groups) |
repository-ground-truthValidate declared repository architecture and engineering documents
Provider: Repository Validators · Latest reported run ↗
Advisory
Ran for 7s · completed
6 of 6 declared documents found · 0 missingSelf-reported by the pull request's own workflow run; not independently verified and never used for the result.
| Assessment | Declared engineering ground truth |
|---|---|
| Evaluates | Documents declared in .proof/ground-truth-ai.yaml, such as agent instructions and architecture, testing, security, and contribution guides |
| Expected result | Every declared document exists in the repository; document contents are not assessed |
| Started (UTC) | 2026-11-03T16:37:12Z |
| Completed (UTC) | 2026-11-03T16:37:19Z |
| Execution time | 7s (7 seconds) |
| Producer conclusion | success |
| Self-reported measurements | 6 of 6 declared documents found · 0 missing |
change-scopeDetect oversized or unexpectedly broad changes
Provider: PR Size / Files & LOC · Latest reported run ↗
Advisory
Ran for 0s · completed
| Assessment | Change size |
|---|---|
| Evaluates | Counted files, added lines, changed lines, and maximum additions per file |
| Expected result | Each measurement is within its configured limit |
| Started (UTC) | 2026-11-03T16:37:19Z |
| Completed (UTC) | 2026-11-03T16:37:19Z |
| Execution time | 0s (0 seconds) |
| Producer conclusion | success |
Large PRs can overwhelm human reviewers; smaller, focused PRs make feedback more actionable.
Exceeding a limit warns only; it does not block the policy decision.
| Measurement | Counted | Limit | Result |
|---|---|---|---|
| Counted files | 3 | 12 | Within limit |
| Added lines | 46 | 300 | Within limit |
| Added + deleted lines | 52 | 500 | Within limit |
| Most added lines in one file | 16 | 150 | Within limit |
Total diff
3 files · 46 added lines · 52 added + deleted lines
Excluded from limits
0 files · 0 added lines · 0 added + deleted lines
Counted changes exclude the configured path patterns. Binary files: 0 counted; 0 excluded. Binary contents have no line count. File paths are not published.
format-and-lintVerify repository formatting and lint rules with the repository-owned command
Provider: Repository Format and Lint Command · Latest reported run ↗
Advisory
Ran for 14s · completed
| Assessment | Formatting and lint rules |
|---|---|
| Evaluates | Repository-configured formatter and lint command |
| Expected result | Configured command completes successfully |
| Started (UTC) | 2026-11-03T16:37:12Z |
| Completed (UTC) | 2026-11-03T16:37:26Z |
| Execution time | 14s (14 seconds) |
| Producer conclusion | success |
| Counts not reported | Only the command's exit status is reported. This repository supplies the command, so counts such as files checked, errors, warnings depend on its tools; open the source report for their output. |
migration-validationValidate repository-specific database and data migration safety
Provider: Repository Migration Validation Command · Latest reported run ↗
Advisory
Ran for 10s · completed
No migrations found to checkSelf-reported by the pull request's own workflow run; not independently verified and never used for the result.
| Assessment | Migration safety |
|---|---|
| Evaluates | Repository-specific migration checks, or declared absence of migrations |
| Expected result | Repository migration validator succeeds |
| Started (UTC) | 2026-11-03T16:37:12Z |
| Completed (UTC) | 2026-11-03T16:37:22Z |
| Execution time | 10s (10 seconds) |
| Producer conclusion | success |
| Self-reported measurements | No migrations found to check |
buildDetect compilation, packaging, and build-time regressions
Provider: Repository Build Command · Latest reported run ↗
Advisory
Ran for 14s · completed
| Assessment | Build and packaging |
|---|---|
| Evaluates | Repository-configured build command |
| Expected result | Build command completes successfully |
| Started (UTC) | 2026-11-03T16:37:13Z |
| Completed (UTC) | 2026-11-03T16:37:27Z |
| Execution time | 14s (14 seconds) |
| Producer conclusion | success |
| Counts not reported | Only the command's exit status is reported. This repository supplies the command, so counts such as artifacts produced, build errors depend on its tools; open the source report for their output. |
unit-testsDetect functional regressions in changed behavior
Provider: Repository Unit Test Command · Latest reported run ↗
Advisory
Ran for 11m 46s · completed
1,155 passed · 0 failed · 2 skipped (1,157 tests)Self-reported by the pull request's own workflow run; not independently verified and never used for the result.
| Assessment | Automated unit tests |
|---|---|
| Evaluates | Repository-configured test command and selected test suites |
| Expected result | Test command completes successfully |
| Started (UTC) | 2026-11-03T16:38:30Z |
| Completed (UTC) | 2026-11-03T16:50:16Z |
| Execution time | 11m 46s (706 seconds) |
| Producer conclusion | success |
| Self-reported measurements | 1,155 passed · 0 failed · 2 skipped (1,157 tests) |
changed-code-coverageMeasure test coverage for changed code
Provider: Repository Changed Code Coverage Command · Latest reported run ↗
Advisory
Ran for 13m 37s · completed
5 of 5 changed lines covered (100.0%) · target 90%Self-reported by the pull request's own workflow run; not independently verified and never used for the result.
| Assessment | Coverage of changed code |
|---|---|
| Evaluates | Executable changed lines compared with repository coverage policy |
| Expected result | Changed-line coverage meets the repository-configured threshold |
| Started (UTC) | 2026-11-03T16:37:43Z |
| Completed (UTC) | 2026-11-03T16:51:20Z |
| Execution time | 13m 37s (817 seconds) |
| Producer conclusion | success |
| Self-reported measurements | 5 of 5 changed lines covered (100.0%) · target 90% |
custom-static-analysisRun repository and organization-specific static rules
Provider: Semgrep Community Edition · Latest reported run ↗
Advisory
Ran for 6m 15s · completed
No findings reportedSelf-reported by the pull request's own workflow run; not independently verified and never used for the result.
| Assessment | Custom static rules |
|---|---|
| Evaluates | Repository and organization-specific analysis rules |
| Expected result | Configured analyzer completes without policy-blocking findings |
| Started (UTC) | 2026-11-03T16:37:12Z |
| Completed (UTC) | 2026-11-03T16:43:27Z |
| Execution time | 6m 15s (375 seconds) |
| Producer conclusion | success |
| Self-reported measurements | No findings reported |
secret-detectionDetect credentials and authentication material in source history
Provider: Gitleaks CLI · Latest reported run ↗
Advisory
Ran for 14s · completed
No findings reportedSelf-reported by the pull request's own workflow run; not independently verified and never used for the result.
| Assessment | Secrets in source history |
|---|---|
| Evaluates | Credential patterns in the configured scan scope |
| Expected result | Scanner reports no policy-blocking secret findings |
| Started (UTC) | 2026-11-03T16:37:12Z |
| Completed (UTC) | 2026-11-03T16:37:26Z |
| Execution time | 14s (14 seconds) |
| Producer conclusion | success |
| Self-reported measurements | No findings reported |
deep-sastDetect security vulnerabilities through semantic source analysis
Provider: GitHub CodeQL · Latest reported run ↗
Advisory
Ran for 1m 38s · completed
0 critical · 3 high · 0 medium · 0 lowSelf-reported by the pull request's own workflow run; not independently verified and never used for the result.
| Assessment | Semantic security analysis |
|---|---|
| Evaluates | Data flow and security queries for configured languages |
| Expected result | Selected security analysis satisfies its configured policy |
| Started (UTC) | 2026-11-03T16:37:12Z |
| Completed (UTC) | 2026-11-03T16:38:50Z |
| Execution time | 1m 38s (98 seconds) |
| Producer conclusion | success |
| Self-reported measurements | 0 critical · 3 high · 0 medium · 0 low |
dependency-change-reviewReview security and license risk introduced by dependency changes
Provider: GitHub Dependency Review · Latest reported run ↗
Advisory
Ran for 8s · completed
| Assessment | Dependency changes |
|---|---|
| Evaluates | New or changed dependencies and associated security/license risk |
| Expected result | Changes satisfy the configured dependency review policy |
| Started (UTC) | 2026-11-03T16:37:13Z |
| Completed (UTC) | 2026-11-03T16:37:21Z |
| Execution time | 8s (8 seconds) |
| Producer conclusion | success |
| Counts not reported | Only the overall result is reported. GitHub Dependency Review writes changed dependencies, new vulnerabilities, and license violations to its own job summary; open the pull request's Dependency Review check for them. |
platform-secret-protectionVerify platform secret scanning and push protection
Provider: GitHub Secret Protection · Latest reported run ↗
Advisory
Ran for 0s · completed
| Assessment | Platform protection settings |
|---|---|
| Evaluates | Secret scanning and push protection capability checks |
| Expected result | Required platform protections are enabled and verified |
| Started (UTC) | 2026-11-03T16:37:14Z |
| Completed (UTC) | 2026-11-03T16:37:14Z |
| Execution time | 0s (0 seconds) |
| Producer conclusion | success |
| Counts not reported | Only the overall result was reported. This report does not include secret scanning enabled, push protection enabled. |
dependency-remediationVerify automated dependency security remediation is configured
Provider: GitHub Dependabot · Latest reported run ↗
Advisory
Ran for 0s · completed
| Assessment | Remediation configuration |
|---|---|
| Evaluates | Automated dependency security update configuration |
| Expected result | Required dependency remediation automation is configured |
| Started (UTC) | 2026-11-03T16:37:13Z |
| Completed (UTC) | 2026-11-03T16:37:13Z |
| Execution time | 0s (0 seconds) |
| Producer conclusion | success |
| Counts not reported | Only the overall result was reported. This report does not include security updates enabled, configuration checks. |
These tools are excluded from the current score. Adopt them when they fit the project and its evaluation stage; they are not missing requirements.
Static Quality · Dependency Vulnerability · License Compliance · IaC Misconfiguration · Functional QA · AI Engineering Review · AI QA Review · AI Security Review · AI Repository Standards Review
static-qualityEvaluate maintainability, reliability, and static quality gates
Useful during: Pull-request development, when this tool fits your project.
Optional; excluded from this stage’s score. No passing or failing result is implied.
Example provider: SonarQube
static-quality as advisory under overrides.change in .proof/policy.yaml.dependency-vulnerabilityDetect known vulnerabilities in resolved dependencies
Useful during: Pull-request development, when this tool fits your project.
Optional; excluded from this stage’s score. No passing or failing result is implied.
Example provider: Snyk Open Source
dependency-vulnerability as advisory under overrides.change in .proof/policy.yaml.license-complianceEvaluate dependency licenses against repository policy
Useful during: Pull-request development, when this tool fits your project.
Optional; excluded from this stage’s score. No passing or failing result is implied.
Example provider: FOSSA
license-compliance as advisory under overrides.change in .proof/policy.yaml.iac-misconfigurationDetect insecure infrastructure-as-code configuration
Useful during: Pull-request development, when this tool fits your project.
Optional; excluded from this stage’s score. No passing or failing result is implied.
Example provider: Trivy IaC Configuration
iac-misconfiguration as advisory under overrides.change in .proof/policy.yaml.functional-qaExercise the running application as a user to detect functional regressions in changed behavior
Useful during: Pull-request development, when this tool fits your project.
Optional; excluded from this stage’s score. No passing or failing result is implied.
Example provider: QA Bootstrap Workflow
functional-qa as advisory under overrides.change in .proof/policy.yaml.ai-engineering-reviewReview correctness, architecture, maintainability, and regression risk
Useful during: Pull-request development, when this tool fits your project.
Optional; excluded from this stage’s score. No passing or failing result is implied.
Example provider: Codex Code Review
ai-engineering-review as advisory under overrides.change in .proof/policy.yaml.ai-qa-reviewReview tests, edge cases, failure paths, and assertions
Useful during: Pull-request development, when this tool fits your project.
Optional; excluded from this stage’s score. No passing or failing result is implied.
Example provider: AI QA Review Adapter
ai-qa-review as advisory under overrides.change in .proof/policy.yaml.ai-security-reviewReview authentication, isolation, injection, secrets, and privilege risks
Useful during: Pull-request development, when this tool fits your project.
Optional; excluded from this stage’s score. No passing or failing result is implied.
Example provider: AI Security Review Adapter
ai-security-review as advisory under overrides.change in .proof/policy.yaml.ai-repository-standards-reviewReview changes against repository-owned engineering ground truth
Useful during: Pull-request development, when this tool fits your project.
Optional; excluded from this stage’s score. No passing or failing result is implied.
Example provider: AI Repository Standards Review Adapter
ai-repository-standards-review as advisory under overrides.change in .proof/policy.yaml.These tools are excluded from the current score. Adopt them when they fit the project and its evaluation stage; they are not missing requirements.
Artifact Provenance · Runtime Soak · Container Vulnerability · Artifact SBOM · Artifact Vulnerability · Deployment Policy · Dynamic Application Security · Runtime Assurance
artifact-provenanceAttest where and how a release artifact was built
Useful during: Release.
Optional; excluded from this stage’s score. No passing or failing result is implied.
Example provider: GitHub Artifact Attestations
artifact-provenance as advisory under overrides.release in .proof/policy.yaml.runtime-soakDetect runtime degradation, leaks, and performance drift over time
Useful during: Pre-release.
Optional; excluded from this stage’s score. No passing or failing result is implied.
Example provider: Repository Soak Command
runtime-soak as advisory under overrides.release in .proof/policy.yaml.container-vulnerabilityDetect vulnerabilities in container images
Useful during: Release.
Optional; excluded from this stage’s score. No passing or failing result is implied.
Example provider: Trivy Container Image
container-vulnerability as advisory under overrides.release in .proof/policy.yaml.artifact-sbomRecord the software components contained in an artifact
Useful during: Release.
Optional; excluded from this stage’s score. No passing or failing result is implied.
Example provider: Trivy Artifact SBOM
artifact-sbom as advisory under overrides.release in .proof/policy.yaml.artifact-vulnerabilityDetect vulnerabilities in a built release artifact
Useful during: Release.
Optional; excluded from this stage’s score. No passing or failing result is implied.
Example provider: Trivy Artifact Vulnerabilities
artifact-vulnerability as advisory under overrides.release in .proof/policy.yaml.deployment-policyVerify deployment approval and environment policy
Useful during: Deployment.
Optional; excluded from this stage’s score. No passing or failing result is implied.
Example provider: Verification Deployment Policy
deployment-policy as advisory under overrides.release in .proof/policy.yaml.dynamic-application-securityDetect vulnerabilities in a running application
Useful during: Post-deployment.
Optional; excluded from this stage’s score. No passing or failing result is implied.
Example provider: OWASP ZAP Local Baseline
dynamic-application-security as advisory under overrides.release in .proof/policy.yaml.runtime-assuranceVerify runtime security and operational safeguards
Useful during: Runtime.
Optional; excluded from this stage’s score. No passing or failing result is implied.
Example provider: Verification Runtime Assurance
runtime-assurance as advisory under overrides.release in .proof/policy.yaml.Open the source CI run for the full scorecard, individual controls, and supporting results.
View source CI runSubject digestsha256:713bd9ebd5320d14839bec65ccaa2a7d8f9ebee97e4dc42abe8559c74fe5e607