First end-to-end 2026-07-28 stateless tools/call (experimental entry + ClientSession pin) (#2917)
This commit is contained in:
parent
1cec2d60f4
commit
84bf9bde05
2 changed files with 1515 additions and 93 deletions
|
|
@ -82,33 +82,11 @@ client:
|
|||
# neither run nor evaluated on this leg.
|
||||
|
||||
server:
|
||||
# --- No stateless server path on main yet (carried-forward 2025-era scenarios) ---
|
||||
# mcp-everything-server only runs in 2025 stateful mode. With
|
||||
# --spec-version 2026-07-28 the harness sends stateless requests
|
||||
# (MCP-Protocol-Version: 2026-07-28, _meta envelope, no initialize), which
|
||||
# the server rejects before the handler runs. These scenarios all pass on
|
||||
# the 2025 legs; they unblock once mcp-everything-server routes 2026
|
||||
# requests through a stateless path.
|
||||
- completion-complete
|
||||
- tools-list
|
||||
- tools-call-simple-text
|
||||
- tools-call-image
|
||||
- tools-call-audio
|
||||
- tools-call-embedded-resource
|
||||
- tools-call-mixed-content
|
||||
- tools-call-error
|
||||
# --- Carried-forward 2025-era scenarios still failing on the 2026 wire ---
|
||||
# The stateless 2026 path now reaches handlers for plain request/response
|
||||
# scenarios; tools-call-with-progress still fails because the stateless
|
||||
# server has no channel for server→client progress notifications.
|
||||
- tools-call-with-progress
|
||||
- server-sse-multiple-streams
|
||||
- resources-list
|
||||
- resources-read-text
|
||||
- resources-read-binary
|
||||
- resources-templates-read
|
||||
- prompts-list
|
||||
- prompts-get-simple
|
||||
- prompts-get-with-args
|
||||
- prompts-get-embedded-resource
|
||||
- prompts-get-with-image
|
||||
- dns-rebinding-protection
|
||||
# SEP-2106 (JSON Schema 2020-12 in tool inputSchema): the fixture tool's
|
||||
# schema has none of the 2020-12 keywords the scenario checks. The scenario
|
||||
# is in `--suite all` but not `--suite active`, so this is the only leg that
|
||||
|
|
@ -130,12 +108,10 @@ server:
|
|||
- input-required-result-result-type
|
||||
- input-required-result-tampered-state
|
||||
- input-required-result-capability-check
|
||||
# SEP-2549 (caching): no ttlMs/cacheScope support.
|
||||
- caching
|
||||
- input-required-result-validate-input
|
||||
# SEP-2243 (HTTP header standardization): -32020 HeaderMismatch handling and
|
||||
# case-insensitive/whitespace-trimmed header validation not implemented.
|
||||
- http-header-validation
|
||||
- http-custom-header-server-validation
|
||||
|
||||
# --- WARNING-only entries ---
|
||||
# These scenarios emit no FAILURE checks, only SHOULD-level WARNINGs, but
|
||||
|
|
@ -143,7 +119,5 @@ server:
|
|||
# as the draft suite in expected-failures.yml.
|
||||
# SEP-2164: server returns -32600 (not -32602) and omits error.data.uri.
|
||||
- sep-2164-resource-not-found
|
||||
# SEP-2322 SHOULD-level behaviours (re-request missing inputResponses,
|
||||
# ignore unrecognized inputResponses keys).
|
||||
# SEP-2322 SHOULD-level behaviour (re-request missing inputResponses).
|
||||
- input-required-result-missing-input-response
|
||||
- input-required-result-ignore-extra-params
|
||||
|
|
|
|||
|
|
@ -65,23 +65,19 @@ server:
|
|||
- input-required-result-result-type
|
||||
- input-required-result-tampered-state
|
||||
- input-required-result-capability-check
|
||||
# SEP-2549 (caching): no ttlMs/cacheScope support; scenario also hits the
|
||||
# stateful-mode "Missing session ID" error.
|
||||
- caching
|
||||
# SEP-2243 (HTTP header standardization): -32020 HeaderMismatch handling and
|
||||
# case-insensitive/whitespace-trimmed header validation not implemented.
|
||||
- http-header-validation
|
||||
- http-custom-header-server-validation
|
||||
# WARNING-only entries: these scenarios emit no FAILURE checks, only SHOULD-level
|
||||
# WARNINGs, but the expected-failures evaluator counts WARNINGs as failures.
|
||||
# SEP-2164: server returns -32600 (not -32602) and omits error.data.uri.
|
||||
- sep-2164-resource-not-found
|
||||
# SEP-2322 SHOULD-level behaviours (re-request missing inputResponses, ignore
|
||||
# unrecognized inputResponses keys).
|
||||
# SEP-2322 SHOULD-level behaviour (re-request missing inputResponses).
|
||||
- input-required-result-missing-input-response
|
||||
- input-required-result-ignore-extra-params
|
||||
# Intentionally NOT baselined (2 of 19 draft scenarios): the SEP-2322
|
||||
# negative-case scenarios input-required-result-unsupported-methods and
|
||||
# input-required-result-validate-input pass today only because the stateful
|
||||
# server's -32600 "Missing session ID" satisfies their assertions. They will
|
||||
# start failing for real once stateless mode lands; add them then.
|
||||
# SEP-2322 negative-case scenarios: input-required-result-validate-input is
|
||||
# now baselined (added when the stateless path landed — the stateless server
|
||||
# reaches the handler, so the previous accidental pass via -32600 "Missing
|
||||
# session ID" no longer applies). input-required-result-unsupported-methods
|
||||
# is intentionally NOT baselined: it still passes for now; add it once it
|
||||
# starts failing for real.
|
||||
- input-required-result-validate-input
|
||||
|
|
|
|||
Loading…
Reference in a new issue