Files
ai-agent-book/chapter9/harness-safety-gate/validation/experiment_9_7_results_20260807.md
T
liqiang b119135836
Build latest book artifacts / build (push) Canceled after 0s
dependency resolution / resolve (3.11) (push) Canceled after 0s
dependency resolution / resolve (3.13) (push) Canceled after 0s
deploy-pages / build (push) Canceled after 0s
deploy-pages / deploy (push) Canceled after 0s
i18n consistency check / check (push) Canceled after 0s
provider adoption tests / test (chapter2/context-compression) (push) Canceled after 0s
provider adoption tests / test (chapter2/prompt-injection) (push) Canceled after 0s
provider adoption tests / test (chapter2/system-hint) (push) Canceled after 0s
provider adoption tests / test (chapter3/log-sanitization) (push) Canceled after 0s
web-search-agent tests / test (push) Canceled after 0s
web-search-agent tests / agentbook (push) Canceled after 0s
ai-agent-book 精选快照(<2MB 代码与文档,来自 github.com/bojieli/ai-agent-book)
2026-08-20 13:12:50 +00:00

946 B
Raw Blame History

实验 9-7 结果(2026-08-07

执行结果

  • 18 项机制测试全部通过。
  • 确定性候选通过所有检查,决定为 release_to_canary
  • 放行所有调用的反例在未完成任务回放中被拒绝,决定为 reject_candidate
  • 真实 OpenRouter gpt-4o-mini 候选未通过未完成任务回放、正常操作回放和一次性令牌检查,被模型外门槛拒绝。
  • 整体验收为 accepted=true:候选通过才放行,检查失败的候选被拒绝,没有把模型输出直接发布。

完整证据见 real_20260807T160109Z/evidence.jsonSHA-256 为 f2a371e9e95c517d8f1822507bd1652ecb2d9b70b0e0dda2a4bda4d1646d3efb

这次结果说明的不是“Coding Agent 每次都能一次写对安全门禁”,而是发布门槛能够区分可用候选与不合格候选。真实模型候选被拒绝也是有效结果;安全系统不应为了得到漂亮的通过率而降低检查标准。