Eric
4119dd6a53
update Make flag to simply debug
...
DEBUG -> enables DebugCodexNodes, DebugTestHarness, and ShowContinuousStatusUpdates
DEBUG_HARDHAT -> enables DebugHardhat
PARALLEL -> enables EnableParallelTests
Additionally, when DEBUG is enabled, all integration tests debug configs are enabled for Codex nodes, the Codex node output is printed with the test output (not interleaved), and the Codex node output is logged to file in `tests/integrations/logs/<starttime>__IntegrationTests/<integration_test_name>/<suite_name>/<testname>/<role>_<idx>.log`.
When DEBUG_HARDHAT is enabled, all hardhat output is printed with the test output (not interleaved), and the output is also written to a log file in `tests/integrations/logs/<starttime>__IntegrationTests/<integration_test_name>/hardhat.log
2025-02-19 15:43:29 +11:00
Eric
22b4847179
cancel processes soon
...
Windows really does not like to terminate processes, so if we try to cancel the process, we will hang in Windows.
2025-02-19 15:43:29 +11:00
Eric
7628aa529c
fix: hardhot not being stopped when test times out
2025-02-19 15:43:28 +11:00
Eric
49d8f99987
Allow parallel integration tests to be disabled
...
Disable with `make ENABLE_PARALLEL_TESTS=0 testIntegration`
2025-02-19 15:43:28 +11:00
Eric
a1569c5a16
fix: use the last used port instead of the globally defined port
2025-02-19 15:43:28 +11:00
Eric
8468fc4c74
Increase hardhat, codex api, and codex discovery ports for each subsequent test
...
Previously, each test would start with a port specified by a global const and overwritable using `define` cli flag. This seems to be causing some port clashes that `nextFreePort` is not picking up. Instead of relying on `nextFreePort`, do not reuse port numbers for any of the tests.
2025-02-19 15:43:27 +11:00
Eric
3ec996699d
enable debug logs for testpurchasing since the failure in ci
2025-02-19 15:43:27 +11:00
Eric
274c0f0c07
swap linux large runner
2025-02-19 15:43:27 +11:00
Eric
b0ac3fd180
fix waiting for hardhat node process exit on windows
2025-02-19 15:43:27 +11:00
Eric
5fbd3d167a
handle cancellations for race and allFutures
2025-02-19 15:43:26 +11:00
Eric
0c53371cc0
fix hardhat running on windows
...
Solution was two-fold:
1. Run the hardhat.cmd script instead of hardhat
2. Use the absolute path to the script executable instead of relative to the working directory
2025-02-19 15:43:26 +11:00
Eric
1f5fca88ca
Bubble errors from hardhat start
...
- bubble errors from hardhatprocess.start (instead of just logging)
- push raises: [] in all nodeprocess procs/methods to avoid leaking `Exception` exception types in method overrides
2025-02-19 15:43:26 +11:00
Eric
f7a6c17bce
re-add windows to CI
2025-02-19 15:43:26 +11:00
Eric
2bbf903062
nil check hardhat process before stopping
2025-02-19 15:43:25 +11:00
Eric
943b552e5f
fix exit status
2025-02-19 15:43:25 +11:00
Eric
60b36044b2
use macos-14-large
...
windows is failing with SIGSEGV so remove it for now
2025-02-19 15:43:25 +11:00
Eric
57f00681f2
add windows large runner 32vcpu
2025-02-19 15:43:24 +11:00
Eric
84d04815b9
indicate with exit code 1 if the tests failed
2025-02-19 15:43:24 +11:00
Eric
ba2ce9eef2
fix: pass show continuous updates into test manager instance
2025-02-19 15:43:24 +11:00
Eric
68ebb3a4fd
trying a self-hosted runner to see if it has more resources
2025-02-19 15:43:23 +11:00
Eric
e1f8295afc
bump to larger runner, linux only
2025-02-19 15:43:23 +11:00
Eric
97ea13922f
temp remove coverage from ci workflow
2025-02-19 15:43:23 +11:00
Eric
5442ea2c27
try large runners for linux/windows
2025-02-19 15:43:23 +11:00
Eric
50a0ef2952
use large linux runner and disable other tests
2025-02-19 15:43:22 +11:00
Eric
b0fd67ca53
undo changes done for CI debugging
2025-02-19 15:43:22 +11:00
Eric
eebe07b21c
temporarily remove linux test to see if macos works in ci
2025-02-19 15:43:22 +11:00
Eric
6a3813debf
temporarily remove testecbug as CI appears to be terminating after starting this process ( could just be that it's the last test)
2025-02-19 15:43:22 +11:00
Eric
dd1a761a5e
Back off port inc in the hopes that this is causing issues with CI
2025-02-19 15:43:21 +11:00
Eric
d606f9978b
enable CI debugging
2025-02-19 15:43:21 +11:00
Eric
86a19967cd
disable windows integration tests for now
2025-02-19 15:43:21 +11:00
Eric
618dc5b026
npm install to install the hardhat binary in CI
2025-02-19 15:43:20 +11:00
Eric
9ebc95fe89
formatting
...
trying to make nph happy
2025-02-19 15:43:20 +11:00
Eric
a99949228b
formatting
2025-02-19 15:43:20 +11:00
Eric
8e8cbc511f
clean up
2025-02-19 15:43:20 +11:00
Eric
7132983e1d
use tracked futures for showContinuousStatusUpdates
2025-02-19 15:43:19 +11:00
Eric
b290ee758e
formatting
2025-02-19 15:43:19 +11:00
Eric
2315b0f1d2
CI: do not start hardhat for integration tests
2025-02-19 15:43:19 +11:00
Eric
6051c64f30
automatically enable chronicles logs for the test harness when DEBUG_TESTHARNESS=1
2025-02-19 15:43:18 +11:00
Eric
533c508932
format info blurbs
2025-02-19 15:41:48 +11:00
Eric
c0d114972d
allow test parameters to be set from make testIntegration command
2025-02-19 15:41:48 +11:00
Eric
a5396953fe
DIsable continuous updates by default (for CI)
2025-02-19 15:41:48 +11:00
Eric
583792f52c
fix rebase, formatting
2025-02-19 15:41:47 +11:00
Eric
849fd00a2c
fix rebase
2025-02-19 15:41:47 +11:00
Eric
ca3aeb28cf
Use absolute path for binary when checking for existence
2025-02-19 15:41:47 +11:00
Eric
567a8444cb
fail early with message when hardhat binary not found
...
# Conflicts:
# tests/integration/hardhatprocess.nim
2025-02-19 15:41:47 +11:00
Eric
cc8f00e707
remove unneeded sleep
2025-02-19 15:41:46 +11:00
Eric
9b0eca0815
make onoutputline callback gcsafe
2025-02-19 15:41:46 +11:00
Eric
aea6c99a69
increase port distance per test run
2025-02-19 15:41:46 +11:00
Eric
7f058deece
add constructor param for continuous status update in terminal
...
# Conflicts:
# tests/testIntegration.nim
2025-02-19 15:41:45 +11:00
Eric
749f65b134
fix nodeprocess not exiting
2025-02-19 15:41:45 +11:00
