Eric
25ce97e81e
update Make flag to simply debug
...
DEBUG -> enables DebugCodexNodes, DebugTestHarness, and ShowContinuousStatusUpdates
DEBUG_HARDHAT -> enables DebugHardhat
PARALLEL -> enables EnableParallelTests
Additionally, when DEBUG is enabled, all integration tests debug configs are enabled for Codex nodes, the Codex node output is printed with the test output (not interleaved), and the Codex node output is logged to file in `tests/integrations/logs/<starttime>__IntegrationTests/<integration_test_name>/<suite_name>/<testname>/<role>_<idx>.log`.
When DEBUG_HARDHAT is enabled, all hardhat output is printed with the test output (not interleaved), and the output is also written to a log file in `tests/integrations/logs/<starttime>__IntegrationTests/<integration_test_name>/hardhat.log
2025-06-05 15:58:02 +10:00
Eric
29df100e93
cancel processes soon
...
Windows really does not like to terminate processes, so if we try to cancel the process, we will hang in Windows.
2025-06-05 15:58:01 +10:00
Eric
92ca6de95b
fix: hardhot not being stopped when test times out
2025-06-05 15:58:01 +10:00
Eric
7ea21795c9
Allow parallel integration tests to be disabled
...
Disable with `make ENABLE_PARALLEL_TESTS=0 testIntegration`
2025-06-05 15:58:01 +10:00
Eric
44f99f5d39
fix: use the last used port instead of the globally defined port
2025-06-05 15:58:01 +10:00
Eric
42701ee54e
Increase hardhat, codex api, and codex discovery ports for each subsequent test
...
Previously, each test would start with a port specified by a global const and overwritable using `define` cli flag. This seems to be causing some port clashes that `nextFreePort` is not picking up. Instead of relying on `nextFreePort`, do not reuse port numbers for any of the tests.
2025-06-05 15:58:01 +10:00
Eric
fb39f12fe4
enable debug logs for testpurchasing since the failure in ci
2025-06-05 15:58:01 +10:00
Eric
7695610307
fix waiting for hardhat node process exit on windows
2025-06-05 15:58:00 +10:00
Eric
3554c772cc
handle cancellations for race and allFutures
2025-06-05 15:58:00 +10:00
Eric
dca40e0682
fix hardhat running on windows
...
Solution was two-fold:
1. Run the hardhat.cmd script instead of hardhat
2. Use the absolute path to the script executable instead of relative to the working directory
2025-06-05 15:58:00 +10:00
Eric
7c248b45ab
Bubble errors from hardhat start
...
- bubble errors from hardhatprocess.start (instead of just logging)
- push raises: [] in all nodeprocess procs/methods to avoid leaking `Exception` exception types in method overrides
2025-06-05 15:58:00 +10:00
Eric
52479ef0e8
nil check hardhat process before stopping
2025-06-05 15:58:00 +10:00
Eric
d260e6350c
fix exit status
2025-06-05 15:57:59 +10:00
Eric
0dcf8ded69
indicate with exit code 1 if the tests failed
2025-06-05 15:57:59 +10:00
Eric
7d3013f3b3
fix: pass show continuous updates into test manager instance
2025-06-05 15:57:59 +10:00
Eric
e902df5365
undo changes done for CI debugging
2025-06-05 15:57:58 +10:00
Eric
d3245c3aa8
Back off port inc in the hopes that this is causing issues with CI
2025-06-05 15:57:57 +10:00
Eric
6b8f6d539a
formatting
...
trying to make nph happy
2025-06-05 15:57:57 +10:00
Eric
8b70cbc13a
formatting
2025-06-05 15:57:57 +10:00
Eric
2cfd9635e7
clean up
2025-06-05 15:57:56 +10:00
Eric
e4ebfaafac
use tracked futures for showContinuousStatusUpdates
2025-06-05 15:57:56 +10:00
Eric
1218c493be
formatting
2025-06-05 15:57:56 +10:00
Eric
e98b60196a
format info blurbs
2025-06-05 15:57:56 +10:00
Eric
05a11cbe44
allow test parameters to be set from make testIntegration command
2025-06-05 15:57:55 +10:00
Eric
5338c567ed
DIsable continuous updates by default (for CI)
2025-06-05 15:57:55 +10:00
Eric
81ace10454
fix rebase, formatting
2025-06-05 15:57:55 +10:00
Eric
9a81fb9949
fix rebase
2025-06-05 15:57:55 +10:00
Eric
87727fbcd6
Use absolute path for binary when checking for existence
2025-06-05 15:57:55 +10:00
Eric
4661f467e6
fail early with message when hardhat binary not found
...
# Conflicts:
# tests/integration/hardhatprocess.nim
2025-06-05 15:57:55 +10:00
Eric
756af9b2ab
remove unneeded sleep
2025-06-05 15:57:54 +10:00
Eric
8ca9d9f78d
make onoutputline callback gcsafe
2025-06-05 15:57:54 +10:00
Eric
982af54648
increase port distance per test run
2025-06-05 15:57:54 +10:00
Eric
35964f6e73
add constructor param for continuous status update in terminal
...
# Conflicts:
# tests/testIntegration.nim
2025-06-05 15:57:54 +10:00
Eric
52efcbea57
fix nodeprocess not exiting
2025-06-05 15:57:54 +10:00
Eric
ff1eb8b05e
ensure timeouts work
...
Work around the AsyncProcess timeout not working correctly
2025-06-05 15:57:54 +10:00
Eric
78260feda3
continually show test status updates
...
allows user to know which tests are still running
2025-06-05 15:57:54 +10:00
Eric
855ba637e3
cleanup
...
# Conflicts:
# tests/testIntegration.nim
2025-06-05 15:57:53 +10:00
Eric
c8d69b646c
lock hardhat start to avoid intermittent start failures
2025-06-05 15:57:53 +10:00
Eric
44faac5a97
clean up
2025-06-05 15:57:53 +10:00
Eric
5db892adf3
print hardhat testmanager errors and hardhat stdout when there is an error starting hardhat
2025-06-05 15:57:53 +10:00
Eric
0d186c69a1
hang manager off IntegrationTest, cleanup
...
- add a TestManager property to IntegrationTest, so manager does not need to be passed into all functions
- cleanup:
- remove unneeded stopHardhat function
- add hardhat instance to manager outside of startHardhat
2025-06-05 15:57:53 +10:00
Eric
79812001f1
pass hardhat port to ethersuite
...
# Conflicts:
# tests/ethertest.nim
2025-06-05 15:57:53 +10:00
Eric
878a384794
reinstate removed types
2025-06-05 15:57:52 +10:00
Eric
f957c58c58
Add additional logging info print outs
...
# Conflicts:
# tests/integration/testcli.nim
2025-06-05 15:57:52 +10:00
Eric
3af3162c04
expect process exit code
...
prevents showing error in the logs when an expected process exit code is encountered
# Conflicts:
# tests/integration/testcli.nim
2025-06-05 15:57:52 +10:00
Eric
f9e26bde31
stop hardhat and show logs
...
# Conflicts:
# tests/integration/hardhatprocess.nim
2025-06-05 15:57:52 +10:00
Eric
b841f04602
default test name to the filename of the integration test
...
# Conflicts:
# tests/testIntegration.nim
2025-06-05 15:57:52 +10:00
Eric
8cce661d76
print start/finish stderr/stdout markers
...
# Conflicts:
# tests/testIntegration.nim
2025-06-05 15:57:52 +10:00
Eric
bbea4371da
clean up
2025-06-05 15:57:51 +10:00
Eric
0e9439b201
stdout formatting for test results
...
# Conflicts:
# tests/testIntegration.nim
2025-06-05 15:57:51 +10:00
