889 Commits

Author SHA1 Message Date
Eric
b6b595aab5
Allow debug runs from the github UI 2025-06-04 15:55:16 +10:00
Eric
fc63ee188e
clean up 2025-06-04 15:55:16 +10:00
Eric
9cd9f5e29f
increase port gap by 1000 to avoid clashes in windows 2025-06-04 15:55:16 +10:00
Eric
c51103165b
lock codex port selection in multinodesuites
Codex api/disc ports were clashing in windows because `lastUsedCodexApiPort` and `lastUsedCodeexDiscPort` were not locked when read and written, while client and provider nodes were started concurrently (async).
2025-06-04 15:55:16 +10:00
Eric
9ac24ff2fa
add test name to datadir path
avoids reusing datadirs between tests
2025-06-04 15:55:15 +10:00
Eric
c196920d20
update Make flag to simply debug
DEBUG -> enables DebugCodexNodes, DebugTestHarness, and ShowContinuousStatusUpdates
DEBUG_HARDHAT -> enables DebugHardhat
PARALLEL -> enables EnableParallelTests

Additionally, when DEBUG is enabled, all integration tests debug configs are enabled for Codex nodes, the Codex node output is printed with the test output (not interleaved), and the Codex node output is logged to file in `tests/integrations/logs/<starttime>__IntegrationTests/<integration_test_name>/<suite_name>/<testname>/<role>_<idx>.log`.
When DEBUG_HARDHAT is enabled, all hardhat output is printed with the test output (not interleaved), and the output is also written to a log file in `tests/integrations/logs/<starttime>__IntegrationTests/<integration_test_name>/hardhat.log
2025-06-04 15:55:15 +10:00
Eric
405eb370b3
cancel processes soon
Windows really does not like to terminate processes, so if we try to cancel the process, we will hang in Windows.
2025-06-04 15:54:29 +10:00
Eric
eb50409356
fix: hardhot not being stopped when test times out 2025-06-04 15:54:29 +10:00
Eric
43fd465ec9
Allow parallel integration tests to be disabled
Disable with `make ENABLE_PARALLEL_TESTS=0 testIntegration`
2025-06-04 15:54:28 +10:00
Eric
055744a0c7
fix: use the last used port instead of the globally defined port 2025-06-04 15:54:28 +10:00
Eric
9f83213757
Increase hardhat, codex api, and codex discovery ports for each subsequent test
Previously, each test would start with a port specified by a global const and overwritable using `define` cli flag. This seems to be causing some port clashes that `nextFreePort` is not picking up. Instead of relying on `nextFreePort`, do not reuse port numbers for any of the tests.
2025-06-04 15:54:28 +10:00
Eric
b1fe15f6ac
enable debug logs for testpurchasing since the failure in ci 2025-06-04 15:54:28 +10:00
Eric
f278d11b70
swap linux large runner 2025-06-04 15:54:28 +10:00
Eric
9cc5baef09
fix waiting for hardhat node process exit on windows 2025-06-04 15:54:28 +10:00
Eric
6d9cac3892
handle cancellations for race and allFutures 2025-06-04 15:54:27 +10:00
Eric
5ddccb6523
fix hardhat running on windows
Solution was two-fold:
1. Run the hardhat.cmd script instead of hardhat
2. Use the absolute path to the script executable instead of relative to the working directory
2025-06-04 15:54:27 +10:00
Eric
bf3775270a
Bubble errors from hardhat start
- bubble errors from hardhatprocess.start (instead of just logging)
- push raises: [] in all nodeprocess procs/methods to avoid leaking `Exception` exception types in method overrides
2025-06-04 15:54:27 +10:00
Eric
69b9bb0030
re-add windows to CI 2025-06-04 15:54:27 +10:00
Eric
09ccdfaa2b
nil check hardhat process before stopping 2025-06-04 15:54:27 +10:00
Eric
809558e9a7
fix exit status 2025-06-04 15:54:26 +10:00
Eric
5dea609386
use macos-14-large
windows is failing with SIGSEGV so remove it for now
2025-06-04 15:54:26 +10:00
Eric
951da79a4e
add windows large runner 32vcpu 2025-06-04 15:54:26 +10:00
Eric
a6214d693b
indicate with exit code 1 if the tests failed 2025-06-04 15:54:26 +10:00
Eric
e8d28499b6
fix: pass show continuous updates into test manager instance 2025-06-04 15:54:26 +10:00
Eric
1e4e8c8a8d
trying a self-hosted runner to see if it has more resources 2025-06-04 15:54:26 +10:00
Eric
3e86cb47f2
bump to larger runner, linux only 2025-06-04 15:54:25 +10:00
Eric
36cc3b2a8f
temp remove coverage from ci workflow 2025-06-04 15:53:45 +10:00
Eric
c695a3fee0
try large runners for linux/windows 2025-06-04 15:52:32 +10:00
Eric
3737e147c4
use large linux runner and disable other tests 2025-06-04 15:52:09 +10:00
Eric
034bbc7672
undo changes done for CI debugging 2025-06-04 15:50:47 +10:00
Eric
29394329b3
temporarily remove linux test to see if macos works in ci 2025-06-04 15:50:46 +10:00
Eric
b20b12a232
Back off port inc in the hopes that this is causing issues with CI 2025-06-04 15:49:17 +10:00
Eric
627bdecee0
enable CI debugging 2025-06-04 15:49:17 +10:00
Eric
7eac5fe06b
disable windows integration tests for now 2025-06-04 15:49:17 +10:00
Eric
58cca7ce65
npm install to install the hardhat binary in CI 2025-06-04 15:49:17 +10:00
Eric
a7fd01c3de
formatting
trying to make nph happy
2025-06-04 15:49:17 +10:00
Eric
910af93dab
formatting 2025-06-04 15:49:16 +10:00
Eric
985d1243be
clean up 2025-06-04 15:49:16 +10:00
Eric
d2be32f7b0
use tracked futures for showContinuousStatusUpdates 2025-06-04 15:49:16 +10:00
Eric
d0c3da654c
formatting 2025-06-04 15:49:16 +10:00
Eric
b2c0e77f02
CI: do not start hardhat for integration tests 2025-06-04 15:49:16 +10:00
Eric
3ecfa25920
automatically enable chronicles logs for the test harness when DEBUG_TESTHARNESS=1 2025-06-04 15:49:16 +10:00
Eric
13ad7d0014
format info blurbs 2025-06-04 15:49:15 +10:00
Eric
034a6ade74
allow test parameters to be set from make testIntegration command 2025-06-04 15:49:15 +10:00
Eric
3564b7afeb
DIsable continuous updates by default (for CI) 2025-06-04 15:47:41 +10:00
Eric
5f3a2b70f1
fix rebase, formatting 2025-06-04 15:47:41 +10:00
Eric
528f27245d
fix rebase 2025-06-04 15:47:40 +10:00
Eric
f1c5daad9d
Use absolute path for binary when checking for existence 2025-06-04 15:47:40 +10:00
Eric
6987aefc84
fail early with message when hardhat binary not found
# Conflicts:
#	tests/integration/hardhatprocess.nim
2025-06-04 15:47:40 +10:00
Eric
7a855f0f2b
remove unneeded sleep 2025-06-04 15:47:40 +10:00