102 lines
18 KiB
Plaintext

2026-03-12 04:35:29.010 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-12 04:35:29.011 DEBUG [tests.conftest] Running test: test_single_content_topic[/app/29/sometopic/someencoding] with id: 2026-03-12_04-35-29__5eff3656-0042-45d6-8259-3455bb0dfdc6
2026-03-12 04:35:29.011 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-12 04:35:29.011 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-12 04:35:29.011 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-12 04:35:29.020 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-12 04:35:29.020 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-12_04-35-29__5eff3656-0042-45d6-8259-3455bb0dfdc6__wakuorg_nwaku:latest.log
2026-03-12 04:35:29.020 DEBUG [src.node.waku_node] Starting Node...
2026-03-12 04:35:29.020 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-12 04:35:29.022 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-12 04:35:29.022 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.78.97
2026-03-12 04:35:29.022 DEBUG [src.node.docker_mananger] Generated ports ['11318', '11319', '11320', '11321', '11322']
2026-03-12 04:35:29.022 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-12 04:35:29.022 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-12 04:35:29.023 DEBUG [src.node.waku_node] Using volumes []
2026-03-12 04:35:29.023 DEBUG [src.node.docker_mananger] docker run -i -t -p 11318:11318 -p 11319:11319 -p 11320:11320 -p 11321:11321 -p 11322:11322 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=11320 --rest-port=11318 --tcp-port=11319 --discv5-udp-port=11321 --rest-address=0.0.0.0 --nat=extip:172.18.78.97 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=f3eba1b4f066b534f2d257af96b2ebd1612cbf7e3cc76ddc2e0d031fbd2cebae --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=11322 --metrics-logging=true --relay=true --filter=true --content-topic=/app/29/sometopic/someencoding
2026-03-12 04:35:29.205 ERROR [src.node.docker_mananger] Max retries reached for container ce4bbbf99e46. Exiting log stream.
2026-03-12 04:35:29.238 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.78.97 waku 504b1969f0c473c2307b47ab6c25bfab33540076dfaada4280b678747e116978
2026-03-12 04:35:29.273 DEBUG [src.node.docker_mananger] Container started with ID 504b1969f0c4. Setting up logs at ./log/docker/node1_2026-03-12_04-35-29__5eff3656-0042-45d6-8259-3455bb0dfdc6__wakuorg_nwaku:latest.log
2026-03-12 04:35:29.274 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 11318
2026-03-12 04:35:29.274 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-12 04:35:29.744 ERROR [src.node.docker_mananger] Max retries reached for container 11a2d0a8319f. Exiting log stream.
2026-03-12 04:35:30.276 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11318/health" -H "Content-Type: application/json" -d 'None'
2026-03-12 04:35:30.279 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-12 04:35:30.379 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11318/health" -H "Content-Type: application/json" -d 'None'
2026-03-12 04:35:30.400 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-12 04:35:30.501 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11318/health" -H "Content-Type: application/json" -d 'None'
2026-03-12 04:35:30.504 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-12 04:35:30.504 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-12 04:35:30.504 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11318/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-12 04:35:30.513 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.78.97/tcp/11319/p2p/16Uiu2HAmLLs3u2b9YTFZe5DinitKrYeUgtgfDi4oPGgybsmWy8Hp","/ip4/172.18.78.97/tcp/11320/ws/p2p/16Uiu2HAmLLs3u2b9YTFZe5DinitKrYeUgtgfDi4oPGgybsmWy8Hp"],"enrUri":"enr:-L24QNfXBbsbDa_RduxzAwMe-EG1XCJB2pdywAVe7MR-Hu3uO1pe-xMNMSExZoJcCZbt33EHJXcVUw9S4XMAcFPd9ccCgmlkgnY0gmlwhKwSTmGKbXVsdGlhZGRyc5YACASsEk5hBiw3AAoErBJOYQYsON0DgnJzhQACAQAAiXNlY3AyNTZrMaEDcjjJcBPbpbDhQxmKHfETDsELoEDC-lwI4O21LOev4luDdGNwgiw3g3VkcIIsOYV3YWt1MgU"}'
2026-03-12 04:35:30.513 INFO [src.node.waku_node] REST service is ready !!
2026-03-12 04:35:30.520 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-12 04:35:30.521 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-12_04-35-29__5eff3656-0042-45d6-8259-3455bb0dfdc6__wakuorg_nwaku:latest.log
2026-03-12 04:35:30.521 DEBUG [src.node.waku_node] Starting Node...
2026-03-12 04:35:30.521 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-12 04:35:30.522 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-12 04:35:30.522 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.102.255
2026-03-12 04:35:30.522 DEBUG [src.node.docker_mananger] Generated ports ['26158', '26159', '26160', '26161', '26162']
2026-03-12 04:35:30.523 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-12 04:35:30.523 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-12 04:35:30.523 DEBUG [src.node.waku_node] Using volumes []
2026-03-12 04:35:30.523 DEBUG [src.node.docker_mananger] docker run -i -t -p 26158:26158 -p 26159:26159 -p 26160:26160 -p 26161:26161 -p 26162:26162 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=26160 --rest-port=26158 --tcp-port=26159 --discv5-udp-port=26161 --rest-address=0.0.0.0 --nat=extip:172.18.102.255 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=41af9801dffdbd8c2baf97da94efa0fdadfba4ffae0d96cb16a16f4f72873f6f --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=26162 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QNfXBbsbDa_RduxzAwMe-EG1XCJB2pdywAVe7MR-Hu3uO1pe-xMNMSExZoJcCZbt33EHJXcVUw9S4XMAcFPd9ccCgmlkgnY0gmlwhKwSTmGKbXVsdGlhZGRyc5YACASsEk5hBiw3AAoErBJOYQYsON0DgnJzhQACAQAAiXNlY3AyNTZrMaEDcjjJcBPbpbDhQxmKHfETDsELoEDC-lwI4O21LOev4luDdGNwgiw3g3VkcIIsOYV3YWt1MgU --content-topic=/app/29/sometopic/someencoding
2026-03-12 04:35:30.737 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.102.255 waku 42bf9fe8236da5255e2552a175c404ebb369e0bc76869143e0dee4192f126494
2026-03-12 04:35:30.774 DEBUG [src.node.docker_mananger] Container started with ID 42bf9fe8236d. Setting up logs at ./log/docker/node2_2026-03-12_04-35-29__5eff3656-0042-45d6-8259-3455bb0dfdc6__wakuorg_nwaku:latest.log
2026-03-12 04:35:30.774 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 26158
2026-03-12 04:35:30.774 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-12 04:35:31.775 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26158/health" -H "Content-Type: application/json" -d 'None'
2026-03-12 04:35:31.778 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-12 04:35:31.879 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26158/health" -H "Content-Type: application/json" -d 'None'
2026-03-12 04:35:31.881 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-12 04:35:31.982 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26158/health" -H "Content-Type: application/json" -d 'None'
2026-03-12 04:35:31.985 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-12 04:35:32.085 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26158/health" -H "Content-Type: application/json" -d 'None'
2026-03-12 04:35:32.088 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-12 04:35:32.188 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26158/health" -H "Content-Type: application/json" -d 'None'
2026-03-12 04:35:32.191 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-12 04:35:32.291 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26158/health" -H "Content-Type: application/json" -d 'None'
2026-03-12 04:35:32.294 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-12 04:35:32.394 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26158/health" -H "Content-Type: application/json" -d 'None'
2026-03-12 04:35:32.397 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-12 04:35:32.497 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26158/health" -H "Content-Type: application/json" -d 'None'
2026-03-12 04:35:32.500 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-12 04:35:32.600 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26158/health" -H "Content-Type: application/json" -d 'None'
2026-03-12 04:35:32.603 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-12 04:35:32.704 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26158/health" -H "Content-Type: application/json" -d 'None'
2026-03-12 04:35:32.706 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-12 04:35:32.806 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26158/health" -H "Content-Type: application/json" -d 'None'
2026-03-12 04:35:32.811 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-12 04:35:32.912 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26158/health" -H "Content-Type: application/json" -d 'None'
2026-03-12 04:35:32.915 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-12 04:35:33.015 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26158/health" -H "Content-Type: application/json" -d 'None'
2026-03-12 04:35:33.018 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Connected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-12 04:35:33.018 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-12 04:35:33.018 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26158/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-12 04:35:33.021 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.102.255/tcp/26159/p2p/16Uiu2HAm21XbtiqFu7ig144SngZKXpxZDbmqCPbHQuYJHvXiSkaw","/ip4/172.18.102.255/tcp/26160/ws/p2p/16Uiu2HAm21XbtiqFu7ig144SngZKXpxZDbmqCPbHQuYJHvXiSkaw"],"enrUri":"enr:-L24QLesETFUZLw4Att5-8q417oDqBV4E7uWqufMpI504PtYLyqKblo3UFGlgIH_R_E_3EI-5w0cJXakutmZFNCpss8CgmlkgnY0gmlwhKwSZv-KbXVsdGlhZGRyc5YACASsEmb_BmYvAAoErBJm_wZmMN0DgnJzhQACAQAAiXNlY3AyNTZrMaECYdJlf8lx2BFB3fIj1_ZCukeEdhdrWO-0TYWAezWb3TSDdGNwgmYvg3VkcIJmMYV3YWt1MgE"}'
2026-03-12 04:35:33.021 INFO [src.node.waku_node] REST service is ready !!
2026-03-12 04:35:33.021 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26158/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.78.97/tcp/11319/p2p/16Uiu2HAmLLs3u2b9YTFZe5DinitKrYeUgtgfDi4oPGgybsmWy8Hp"]'
2026-03-12 04:35:33.045 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-12 04:35:33.045 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:11318/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/app/29/sometopic/someencoding"]'
2026-03-12 04:35:33.050 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-12 04:35:33.051 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:26158/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/app/29/sometopic/someencoding"]'
2026-03-12 04:35:33.055 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-12 04:35:33.056 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:11318/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/app/29/sometopic/someencoding", "timestamp": '$(date +%s%N)'}'
2026-03-12 04:35:33.066 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-12 04:35:33.066 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-12 04:35:33.166 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-12 04:35:33.167 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11318/relay/v1/auto/messages/%2Fapp%2F29%2Fsometopic%2Fsomeencoding" -H "Content-Type: application/json" -d 'None'
2026-03-12 04:35:33.169 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/app/29/sometopic/someencoding","version":0,"timestamp":1773290133056152831,"ephemeral":false,"proof":""}]'
2026-03-12 04:35:33.171 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-12 04:35:33.171 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:26158/relay/v1/auto/messages/%2Fapp%2F29%2Fsometopic%2Fsomeencoding" -H "Content-Type: application/json" -d 'None'
2026-03-12 04:35:33.174 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/app/29/sometopic/someencoding","version":0,"timestamp":1773290133056152831,"ephemeral":false,"proof":""}]'
2026-03-12 04:35:33.176 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-12 04:35:33.178 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-12 04:35:33.178 DEBUG [src.node.waku_node] Stopping container with id 504b1969f0c4
2026-03-12 04:35:33.810 DEBUG [src.node.waku_node] Container stopped.
2026-03-12 04:35:33.811 DEBUG [src.node.waku_node] Stopping container with id 42bf9fe8236d
2026-03-12 04:35:34.372 DEBUG [src.node.waku_node] Container stopped.
2026-03-12 04:35:34.376 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-12 04:35:34.414 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-12 04:35:34.441 DEBUG [src.node.docker_mananger] No errors found in the waku logs.