mirror of
https://github.com/apple/swift-nio
synced 2026-11-22 04:30:41 +00:00
### Motivation: We have GitHub Actions CI running Swift Package Benchmark benchmarks on each commit but when the values don't match updating them can be time consuming. Particularly because you need to may need to exactly match the running environment in CI to get matching numbers. ### Modifications: Added a new dev script which pulls the output for the benchmark GitHub actions runs on a PR and updates your local threshold files ### Result: Easier benchmark threshold updates Example interaction (actually on my branch of NIO SSL where I've messed with the thresholds so they need an update): ``` ❯ FETCH_PR_URL=https://github.com/rnro/swift-nio-ssl/pull/5 OUTPUT_DIRECTORY=Benchmarks/Thresholds/ ../swift-nio/dev/thresholds-from-benchmark-output.sh ** Updating: Benchmarks/Thresholds//nightly-main/NIOSSHBenchmarks.SimpleHandshake.p90.json job:39048331461 ** Nothing to update: rnro/swift-nio-ssl 5.10 job:39048331486 ** Nothing to update: rnro/swift-nio-ssl 5.9 job:39048331454 ** Nothing to update: rnro/swift-nio-ssl 6.0 job:39048331469 ** Nothing to update: rnro/swift-nio-ssl nightly-next job:39048331466