Foundry
Home Schema

Planemo test report (JSON)

JSON Schema for the report emitted by `planemo test --test_output_json` (and friends), vendored from upstream planemo.

draft schematarget/galaxy
Revised
2026-05-11
Rev
1
Related
schema planemo-test-report @galaxy-foundry/planemo-test-report-schema upstream ↗
No schema registered for planemo-test-report. Add an entry to site/src/lib/schema-registry.ts.

This page describes the JSON Schema that planemo test --test_output_json out.json writes. The concrete Foundry artifact is packages/planemo-test-report-schema/src/test-report.schema.json, synced from upstream planemo’s planemo output_schema --schema test-report command.

Source-of-truth chain:

  1. planemo/test/models.py (PlanemoTestReport Pydantic model) in galaxyproject/planemo — currently pinned to PR #1636 (OPEN) via jmchilton/planemo@a9b8b8bc.
  2. planemo output_schema --schema test-report emits a versioned envelope (schema_version, planemo_version, schemas). @galaxy-foundry/planemo-test-report-schema’s scripts/sync-from-planemo.mjs shells out, unwraps, and writes src/test-report.schema.json (AJV-ready) + src/test-report.provenance.json (planemo_version + schema_version + source SHA) — mirrors tests-format-schema’s integrity-sidecar pattern.
  3. scripts/sync-schema.mjs regenerates the TS mirrors from the JSON; contributor laptops never need planemo. The cast pipeline imports planemoTestReportSchema and serializes it into cast bundles per the casting policy in docs/COMPILATION_PIPELINE.md.

At runtime in cast skills: the convergence loop in convert-nfcore-module-to-galaxy-tool (and any other Mold that runs planemo test) consumes --test_output_json output, AJV-validates it against this schema, and classifies failures from structured keys instead of free-text parsing. validate-planemo-test-report wraps the AJV gate as a CLI for cast skills.

Pin caveats. The schema is sourced from an open upstream PR. Unpin once galaxyproject/planemo#1636 merges and ships in a planemo release; the SHA recorded in src/test-report.provenance.json is the unpin checkpoint.