* test: shared hand-off + mutation infrastructure for feature PRs Consolidates infection/infection dev dep, allow-plugins entry, baseline infection.json5, tests/HandOff/HandOffHelpers.php with reusable stubs (cacti_log capture, temp-file fixtures, minimal-zip builder), HandOff testsuite registration, and the documented pattern. Feature PRs that add hand-off coverage rebase onto this and contribute only ONE HandOffTest file plus an optional infection.json5 filter override. Signed-off-by: Thomas Vincent <thomasvincent@gmail.com> * test: consolidate per-feature hand-off suites into shared infra Each test guards on its feature file and skips when not present on develop. Signed-off-by: Thomas Vincent <thomasvincent@gmail.com> * fix(test): replace eval stub, unify log buffer ref, guard ZipArchive add Signed-off-by: Thomas Vincent <thomasvincent@gmail.com> * fix(ci): correct infection vendor path in infection.json5 Signed-off-by: Thomas Vincent <thomasvincent@gmail.com> * ci(phpstan): baseline upstream undefined-variable and isset errors Signed-off-by: Thomas Vincent <thomasvincent@gmail.com> * test: add HandOff and Integration testsuites; add regression guards - phpunit.xml: add Integration testsuite alongside existing Unit/HandOff - tests/Integration/: DbDumpIntegrationTest, PingIntegrationTest (from develop), CactiProcessIntegrationTest, SqlScriptsIntegrationTest - tests/HandOff/RegressionGuardTest: guards against backsliding on shell_exec, password-in-argv, RLIKE concat, and open-redirect patterns Signed-off-by: Thomas Vincent <thomasvincent@gmail.com> * chore(test): pest test infrastructure and PSR-4 autoload Add Pest 2 dev dependency, regenerate composer.lock under PHP 8.1, declare PSR-4 autoload for the Cacti namespace, and seed the test bootstrap with three unit tests plus an orb integration check. Pest stays on the v2 line because v3 transitively requires PHP 8.2 and breaks the 8.1 matrix entry. Signed-off-by: Thomas Vincent <thomasvincent@gmail.com> * chore(phpstan): catch up baseline with 11 upstream-detected entries Cacti Commit Audit fails on develop with 11 PHPStan errors that are not yet in phpstan-baseline.neon. Append the matching entries so the PR-A branch passes Run PHPStan at Level 6. Same set of entries already exists on PR #7077; this is a transient catch-up that upstream will absorb when those entries land on develop. Files: aggregate_graphs.php, color_templates.php, graph_templates.php, graphs.php, lib/html.php (3 entries). Signed-off-by: Thomas Vincent <thomasvincent@gmail.com> * chore(test): drop composer.lock; let CI resolve per PHP version The lock file pinned brianium/paratest v7.3.1 which only supports PHP 8.1-8.3, so the 8.4 matrix entry rejected the lock with "Your lock file does not contain a compatible set of packages". A single lock cannot satisfy 8.1 (paratest 7.3.x) and 8.4 (paratest 7.4.x) at the same time because pestphp/pest 2.36.0 is the last 2.x release that supports 8.1 and the 8.1-compatible paratest tag predates 8.4 support. Match upstream develop's behaviour: no committed lock; let `composer install` in CI resolve per matrix entry. Pest stays on the v2 line in composer.json so 8.1 still gets a compatible Pest. Signed-off-by: Thomas Vincent <thomasvincent@gmail.com> * fix(test): apply Copilot review feedback for test infra Signed-off-by: Thomas Vincent <thomasvincent@gmail.com> * chore(test): drop psr-4 autoload and align deps with canonical PRs Match the flat un-namespaced lib/CactiX.php convention used by #7088, #7073, #7077, #7075. Drop symfony/process (added by #7073) and symfony/validator (added by #7077) to avoid composer.json conflicts at merge time. Signed-off-by: Thomas Vincent <thomasvincent@gmail.com> * test: skip integration suites and regression guards pending feature PRs Guards integration tests and regression guards from #7083 against absence of CactiProcess and other feature-PR hardening, so the consolidated foundation PR is green on develop. Suites activate automatically once their feature PRs merge. Signed-off-by: Thomas Vincent <thomasvincent@gmail.com> * fix(ci): drop infection/infection to unbreak PHP 8.4 matrix infection/infection ^0.27 transitively pins thecodingmachine/safe ^2.1.2, resolving to v2.5.0. Its generated stubs use implicit-nullable parameter declarations, which PHP 8.4 emits as deprecations into cacti.log and trips the log-quiet assertion. infection has no config or test wiring in this repo, so removing the dev dep clears the transitive pin without losing functionality. Signed-off-by: Thomas Vincent <thomasvincent@gmail.com> --------- Signed-off-by: Thomas Vincent <thomasvincent@gmail.com> Co-authored-by: TheWitness <thewitness@cacti.net>
2.8 KiB
Hand-off tests
Hand-off tests live in tests/HandOff/ and complement the in-isolation Pest
suites under tests/Unit/. Where a unit test exercises a function with
controlled inputs, a hand-off test exercises the boundary that function
crosses: a real file on disk, a real ZIP archive, a real cacti_log() call,
a real shell-quoted command line. The goal is to catch regressions that an
isolated unit test cannot see because the boundary itself is the bug surface.
Pattern
Each feature PR adds exactly one file:
tests/HandOff/<Feature>HandOffTest.php
The file requires the shared helpers and asserts on a single boundary:
require_once __DIR__ . '/HandOffHelpers.php';
cacti_handoff_stub_cacti_log();
test('import rejects zip with absolute path entry', function () {
cacti_handoff_clear_log_buffer();
$zip = cacti_handoff_make_zip(array(
'/etc/passwd' => 'root:x:0:0:/root:/bin/bash',
));
// call into the importer under test, then assert
expect(myImporter($zip))->toBeFalse();
expect(cacti_handoff_get_log_buffer())->not->toBeEmpty();
});
HandOffHelpers.php provides:
cacti_handoff_stub_cacti_log()registers a shim that records everycacti_log()call.cacti_handoff_get_log_buffer()/cacti_handoff_clear_log_buffer()read and reset the captured lines.cacti_handoff_temp_file($contents, $extension)writes a unique temp file with auto-cleanup on shutdown.cacti_handoff_make_zip($entries)builds a minimal valid ZIP from apath => contentmap and returns its temp path.
Running
composer run-script test -- --testsuite=HandOff
The standard composer run-script test invocation continues to run every
suite. The --testsuite filter is for fast local iteration on a single
feature.
Mutation testing
Infection is wired up via infection.json5 at the repo root. The baseline
config scopes mutation to lib/ with minMsi: 70 / minCoveredMsi: 80.
Feature PRs that want to gate their files specifically should either:
- Copy
infection.json5into the feature branch and edit thesource.directories/filterfield to point at the changed files, or - Pass
--filter='lib/yourfile.php'on the Infection CLI.
Mutation runs are not a CI gate by default; they are slow and noisy on a codebase Cacti's size. Operators run them locally before merging large changes, and feature PRs may opt their files in via a per-PR job if the maintainer requests it.
First wave of feature PRs
These PRs were the source material for the helper extraction and are the first set expected to rebase onto this infrastructure:
- #7073, #7074, #7075, #7077, #6989, #7032, #7063, #7066
Once those merge, new hand-off tests should follow the same pattern: one
file under tests/HandOff/, helpers from HandOffHelpers.php, no private
copies of cacti_log stubs or ZIP fixture builders.