7ffc739fe7* [CI] Matrix the conformance jobs over both spec revisions Runs server/client conformance against both 2025-11-25 and 2026-07-28, each against its own endpoint and baseline. PR pipeline pins an exact conformance package version; conformance-weekly tracks the moving target on both dist-tags. * [CI] Run the draft conformance suite from the alpha package The conformance repo now ships 2026-07-28 scenarios on its alpha dist-tag, so the draft targets no longer need a local checkout. Pinned to the same version the pipeline runs. * [CI] Baseline the failures --suite all newly exposes The old workflow ran without --suite all/--spec-version, so several pre-existing gaps never surfaced in CI. Now that both revisions run the full suite: - server: json-schema-2020-12 and resources-templates-read are fixture bugs shared by both revisions; 2026-07-28 also needs resources/subscribe and resources/unsubscribe declared removed under the stateless wire, which the server doesn't yet do - client: the example client doesn't call add_numbers or echo back a tool's inputSchema; against 2026-07-28 it doesn't speak the lifecycle or OAuth at all yet, so every such scenario fails Verified locally: all four conformance jobs (server/client x 2025-11-25/2026-07-28) pass against these baselines.
77 lines
3 KiB
Makefile
77 lines
3 KiB
Makefile
.PHONY: deps-stable deps-low cs phpstan tests unit-tests integration-tests inspector-tests coverage ci ci-stable ci-lowest conformance-tests conformance-server conformance-client conformance-draft conformance-draft-server conformance-draft-client docs
|
|
|
|
# The 2026-07-28 scenarios ship on the `alpha` dist-tag; `latest` (0.1.x) has
|
|
# none of them. Pinned to the same version CI runs (see
|
|
# .github/workflows/pipeline.yaml), so a local pass means a green pipeline.
|
|
CONFORMANCE_VERSION ?= 0.2.0-alpha.11
|
|
CONFORMANCE = npx --yes @modelcontextprotocol/conformance@$(CONFORMANCE_VERSION)
|
|
|
|
deps-stable:
|
|
composer update --prefer-stable
|
|
|
|
deps-low:
|
|
composer update --prefer-lowest
|
|
|
|
cs:
|
|
vendor/bin/php-cs-fixer fix --diff --verbose
|
|
|
|
phpstan:
|
|
vendor/bin/phpstan --memory-limit=-1
|
|
|
|
tests:
|
|
vendor/bin/phpunit
|
|
|
|
unit-tests:
|
|
vendor/bin/phpunit --testsuite=unit
|
|
|
|
integration-tests:
|
|
vendor/bin/phpunit --testsuite=integration
|
|
|
|
inspector-tests:
|
|
vendor/bin/phpunit --testsuite=inspector
|
|
|
|
conformance-tests: conformance-server conformance-client
|
|
|
|
conformance-server:
|
|
docker compose -f tests/Conformance/Fixtures/docker-compose.yml up -d
|
|
@echo "Waiting for server to start..."
|
|
@sleep 5
|
|
rm -rf tests/Conformance/results
|
|
cd tests/Conformance && npx @modelcontextprotocol/conformance server --url http://localhost:8000/ --spec-version 2025-11-25 --output-dir results || true
|
|
php tests/Conformance/score.php server
|
|
docker compose -f tests/Conformance/Fixtures/docker-compose.yml down
|
|
|
|
conformance-client:
|
|
rm -rf tests/Conformance/results
|
|
cd tests/Conformance && npx @modelcontextprotocol/conformance client --command "php $(CURDIR)/tests/Conformance/client.php" --suite all --spec-version 2025-11-25 --expected-failures conformance-baseline.yml --output-dir results || true
|
|
php tests/Conformance/score.php client
|
|
|
|
# --- 2026-07-28 (SEP-2575 stateless lifecycle) ------------------------------
|
|
|
|
conformance-draft: conformance-draft-server conformance-draft-client
|
|
|
|
conformance-draft-server:
|
|
docker compose -f tests/Conformance/Fixtures/docker-compose.yml up -d
|
|
@echo "Waiting for server to start..."
|
|
@sleep 5
|
|
rm -rf tests/Conformance/results-2026-07-28
|
|
cd tests/Conformance && $(CONFORMANCE) server --url http://localhost:8000/stateless --suite all --spec-version 2026-07-28 --expected-failures conformance-baseline-2026-07-28.yml --output-dir results-2026-07-28 || true
|
|
docker compose -f tests/Conformance/Fixtures/docker-compose.yml down
|
|
|
|
conformance-draft-client:
|
|
rm -rf tests/Conformance/results-2026-07-28
|
|
cd tests/Conformance && $(CONFORMANCE) client --command "php $(CURDIR)/tests/Conformance/client.php" --suite all --spec-version 2026-07-28 --expected-failures conformance-baseline-2026-07-28.yml --output-dir results-2026-07-28 || true
|
|
|
|
coverage:
|
|
XDEBUG_MODE=coverage vendor/bin/phpunit --testsuite=unit --coverage-html=coverage
|
|
|
|
ci: ci-stable
|
|
|
|
ci-stable: deps-stable cs phpstan tests
|
|
|
|
ci-lowest: deps-low cs phpstan tests
|
|
|
|
docs:
|
|
vendor/bin/phpdoc
|
|
@grep -q 'No errors have been found' .phpdoc/build/reports/errors.html || \
|
|
(echo "Documentation errors found. See build/docs/reports/errors.html" && exit 1)
|