Microsoft's agent-hooks launch post claims to run identical decision streams across eight frameworks, but a local run of the Conformance Test Kit (CTK) reveals only three hosts have filed claims. The discrepancy lies between the marketing demo and the actual SDK bindings, where six of the eight named frameworks lack shipped adapters.

The Demo vs. The Table

The launch post promises that LangGraph, OpenAI Agents SDK, Microsoft Agent Framework, Semantic Kernel, LlamaIndex, CrewAI, Claude Agent SDK, and a bare reference host all produce identical outputs for a specific support scenario. However, the repository's conformance/CLAIMS.md table lists only three entries: the reference agent, Microsoft Agent Framework, and the agent-control-spec Rust host. A grep search across the Python package confirms zero hits for adapters for LangGraph, OpenAI, CrewAI, LlamaIndex, Semantic Kernel, or Claude.

Capability-Gated Skips

Running the CTK locally on agent-hooks-sdk==0.1.0b2 with Python 3.13 resulted in 73 vectors, with 69 passing and 4 skipped. The skipped vectors (AH-CTK-110 through 113) relate to incremental mediation, which are skipped because the reference harness does not declare the incremental_output capability. While the repo defines conformance as passing 100% of applicable vectors, this distinction matters for buyers who might assume full streaming contract coverage.

Unanswered RFCs Signal Real Gaps

The gap between demo and reality is further evidenced by LangGraph's own issue tracker. Issue langgraph#8102, opened in June 2026, remains open and unassigned, requesting a first-class before_tool_call hook. This seam is critical for agent-hooks' pre-execution interception model. A framework lacking this basic RFC response cannot be considered fully adopted by the agent-hooks contract, regardless of what the demo showed.

Key Takeaways

  • The CTK is fast and reproducible, running sub-second without network or model dependencies.
  • Only three hosts currently have conformance claims; six others named in the demo lack shipped adapters.
  • Capability-gated skips hide untested streaming behaviors, which is a critical distinction for production use.
  • The launch post describes a demo suite, not a supported compatibility matrix.

The Bottom Line

Treat the conformance table as the source of truth, not the launch post. The contract is portable, but the adapters for six major frameworks are still vaporware.