Home CLI Command

planemo test

Run specified tool or workflow tests within Galaxy.

Revised
2026-05-11
Rev
1
cli planemo test
No CLI metadata registered for planemo/test. The note body below remains the source of truth until the upstream package's meta subpath is wired into this site.

planemo test

Run specified tool or workflow tests within Galaxy.

Synopsis

planemo test [OPTIONS] TOOL_PATH

Arguments

ArgumentTypeRequiredHelp
TOOL_PATHpath

Options

OptionTypeDefaultRequiredHelp
—failedflagfalseRe-run only failed tests. This command will read tool_test_output.json to determine which tests failed so this file must have been produced with the same set of tool ids previously.
—test_indexinteger[]Index(es) of specific test(s) to run (1-based). Can be specified multiple times (e.g., —test_index 1 —test_index 3) to run specific tests. If not specified, all tests are run.
—polling_backoffinteger0Poll resources with an increasing interval between requests. Useful when testing against remote and/or production instances to limit generated traffic.
—galaxy_rootdirectoryRoot of development galaxy directory to execute command with.
—galaxy_python_versionchoicePython version to start Galaxy under
—extra_toolspathExtra tool sources to include in Galaxy’s tool panel (file or directory). These will not be linted/tested/etc… but they will be available to workflows and for interactive use.
—install_galaxyflagfalseDownload and configure a disposable copy of Galaxy from github.
—galaxy_branchtextBranch of Galaxy to target (defaults to master) if a Galaxy root isn’t specified.
—galaxy_sourcetextGit source of Galaxy to target (defaults to the official galaxyproject github source if a Galaxy root isn’t specified.
—skip_venvflagfalseDo not create or source a virtualenv environment for Galaxy, this should be used to preserve an externally configured virtual environment or conda environment.
—no_cache_galaxyflagfalseSkip caching of Galaxy source and dependencies obtained with —install_galaxy. Not caching this results in faster downloads (no git) - so is better on throw away instances such with TravisCI.
—no_cleanupflagfalseDo not cleanup temp files created for and by Galaxy.
—galaxy_emailtextplanemo@galaxyproject.orgE-mail address to use when launching single-user Galaxy server.
—docker, —no_dockerflagfalseRun Galaxy tools in Docker if enabled.
—docker_cmdtextdockerCommand used to launch docker (defaults to docker).
—docker_sudo, —no_docker_sudoflagfalseFlag to use sudo when running docker.
—docker_hosttextDocker host to target when executing docker commands (defaults to localhost).
—docker_sudo_cmdtextsudosudo command to use when —docker_sudo is enabled (defaults to sudo).
—docker_run_extra_argumentstextExtra arguments to pass to docker run.
—mulled_containers, —biocontainersflagfalseTest tools against mulled containers (forces —docker). Disables conda resolution unless any conda option has been set explicitly.
—galaxy_startup_timeoutinteger range900Wait for galaxy to start before assuming Galaxy did not start.
—job_config_filefileJob configuration file for Galaxy to target.
—job_workersinteger1Number of workers for the local job runner (default 1).
—tool_dependency_dirdirectoryTool dependency dir for Galaxy to target.
—tool_data_pathdirectoryDirectory where data used by tools is located. Required if tests are run in docker and should make use of external reference data.
—test_datadirectorytest-data directory to for specified tool(s).
—tool_data_tablepathtool_data_table_conf.xml file to for specified tool(s).
—dependency_resolvers_config_filefileDependency resolver configuration for Galaxy to target.
—brew_dependency_resolutionflagfalseConfigure Galaxy to use plain brew dependency resolution.
—shed_dependency_resolutionflagfalseConfigure Galaxy to use brewed Tool Shed dependency resolution.
—no_dependency_resolutionflagfalseConfigure Galaxy with no dependency resolvers.
—conda_prefixdirectoryConda prefix to use for conda dependency commands.
—conda_execfileLocation of conda executable.
—conda_channels, —conda_ensure_channelstextconda-forge,biocondaEnsure conda is configured with specified comma separated list of channels.
—conda_use_localflagfalseUse locally built packages while building Conda environments.
—conda_dependency_resolutionflagfalseConfigure Galaxy to use only conda for dependency resolution.
—conda_auto_install, —no_conda_auto_installflagtrueConda dependency resolution for Galaxy will attempt to install requested but missing packages.
—conda_auto_init, —no_conda_auto_initflagtrueConda dependency resolution for Galaxy will auto install conda itself using miniforge if not availabe on conda_prefix.
—simultaneous_uploads, —no_simultaneous_uploadsflagfalseWhen uploading files to Galaxy for tool or workflow tests or runs, upload multiple files simultaneously without waiting for the previous file upload to complete.
—check_uploads_ok, —no_check_uploads_okflagtrueWhen uploading files to Galaxy for tool or workflow tests or runs, check that the history is in an ‘ok’ state before beginning tool or workflow execution.
—profiletextName of profile (created with the profile_create command) to use with this command.
—database_typechoiceautoType of database to use for profile - ‘auto’, ‘sqlite’, ‘postgres’, ‘postgres_docker’ , and postgres_singularity are available options. Use postgres to use an existing postgres server you user can access without a password via the psql command. Use postgres_docker to have Planemo manage a docker container running postgres. . Use postgres_singularity to have Planemo run postgres using singularity/apptainer. Data with postgres_docker is not yet persisted past when you restart the docker container launched by Planemo so be careful with this option.
—postgres_psql_pathtextpsqlName or or path to postgres client binary (psql).
—postgres_database_usertextpostgresPostgres username for managed development databases.
—postgres_database_hosttextPostgres host name for managed development databases.
—postgres_database_porttextPostgres port for managed development databases.
—file_pathdirectoryLocation for files created by Galaxy (e.g. database/files).
—database_connectiontextDatabase connection string to use for Galaxy.
—postgres-storage-locationtextstorage path for postgres database, used for local singularity postgres.
—shed_tool_conftextLocation of shed tools conf file for Galaxy.
—shed_tool_pathtextLocation of shed tools directory for Galaxy.
—galaxy_single_user, —no_galaxy_single_userflagtrueBy default Planemo will configure Galaxy to run in single-user mode where there is just one user and this user is automatically logged it. Use —no_galaxy_single_user to prevent Galaxy from running this way.
—tool_evaluation_strategychoiceDetermines which process will evaluate the tool command line. If set to ‘local’ the tool command line will be templated in the job handler process. If set to ‘remote’ the tool command line will be built as part of the submitted job (beta). Setting this to ‘remote’ will also implicitly set metadata_strategy to ‘extended’, which is required for remote tool evaluation.
—paste_test_data_paths, —no_paste_test_data_pathsflagBy default Planemo will use or not use Galaxy’s path paste option to load test data into a history based on the engine type it is targeting. This can override the logic to explicitly enable or disable path pasting.
—update_test_dataflagfalseUpdate test-data directory with job outputs (normally written to directory —job_output_files if specified.)
—test_outputpathtool_test_output.htmlOutput test report (HTML - for humans) defaults to tool_test_output.html.
—test_output_textpathOutput test report (Basic text - for display in CI)
—test_output_markdownpathOutput test report (Markdown style - for humans & computers)
—test_output_markdown_minimalpathOutput test report (Minimal markdown style - jost the table)
—test_output_xunitpathOutput test report (xunit style - for CI systems
—test_output_junitpathOutput test report (jUnit style - for CI systems
—test_output_alluredirectoryOutput test allure2 framework resutls
—test_output_jsonpathtool_test_output.jsonOutput test report (planemo json) defaults to tool_test_output.json.
—job_output_filesdirectoryWrite job outputs to specified directory.
—summarychoiceminimalSummary style printed to planemo’s standard output (see output reports for more complete summary). Set to ‘none’ to disable completely.
—test_timeoutinteger86400Maximum runtime of a single test in seconds.
—fail_fastflagfalseStop on first job failure.
—enginechoiceSelect an engine to run or test artifacts such as tools and workflows. Defaults to a local Galaxy, but running Galaxy within a Docker container or the CWL reference implementation ‘cwltool’ and ‘toil’ be selected.
—non_strict_cwlflagfalseDisable strict validation of CWL.
—no-container, —no_containerflagfalseIf cwltool engine is used, disable Docker container usage.
—docker_galaxy_imagetextquay.io/bgruening/galaxyDocker image identifier for docker-galaxy-flavor used if engine type is specified as docker-galaxy. Defaults to quay.io/bgruening/galaxy.
—docker_extra_volumepathExtra path to mount if —engine docker or --biocontainers or --docker.
—ignore_dependency_problemsflagfalseWhen installing shed repositories for workflows, ignore dependency issues. These likely indicate a problem but in some cases may not prevent a workflow from successfully executing.
—shed_install, —no_shed_installflagtrueBy default Planemo will attempt to install repositories needed for workflow testing. This may not be appropriate for production servers and so this can disabled by calling planemo with —no_shed_install.
—install_tool_dependencies, —no_install_tool_dependenciesflagfalseTurn on installation of tool dependencies using classic toolshed packages.
—install_resolver_dependencies, —no_install_resolver_dependenciesflagtrueSkip installing tool dependencies through resolver (e.g. conda).
—install_repository_dependencies, —no_install_repository_dependenciesflagtrueSkip installing the repository dependencies.
—galaxy_urltextRemote Galaxy URL to use with external Galaxy engine.
—galaxy_admin_keytextAdmin key to use with external Galaxy engine.
—galaxy_user_keytextUser key to use with external Galaxy engine.
—history_nametextName to give a Galaxy history, if one is created.
—history_idtextSend the results of the run to the history with the provided ID. A history with this ID must exist.
—no_waitflagfalseAfter invoking a job or workflow, do not wait for completion.

Output

Use --test_output_json <path> for machine-readable results; stdout and stderr are human-oriented.

Examples

planemo test <tool_dir> --test_output_json <tool_dir>/_planemo_test_report.json

Gotchas

No Foundry-specific gotchas recorded yet.

Incoming References (1)

  • Planemo test report (JSON)related note— JSON Schema for the report emitted by `planemo test --test_output_json` (and friends), vendored from upstream planemo.