96 lines
16 KiB
Plaintext

2026-03-26 04:48:15.451 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-26 04:48:15.451 DEBUG [tests.conftest] Running test: test_single_content_topic[/app/29/sometopic/someencoding] with id: 2026-03-26_04-48-15__c537e438-2f75-4e10-b482-f7551637866b
2026-03-26 04:48:15.451 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-26 04:48:15.451 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-26 04:48:15.452 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-26 04:48:15.459 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-26 04:48:15.460 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-26_04-48-15__c537e438-2f75-4e10-b482-f7551637866b__wakuorg_nwaku:latest.log
2026-03-26 04:48:15.460 DEBUG [src.node.waku_node] Starting Node...
2026-03-26 04:48:15.460 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-26 04:48:15.461 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-26 04:48:15.462 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.149.251
2026-03-26 04:48:15.462 DEBUG [src.node.docker_mananger] Generated ports ['12962', '12963', '12964', '12965', '12966']
2026-03-26 04:48:15.462 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-26 04:48:15.462 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-26 04:48:15.462 DEBUG [src.node.waku_node] Using volumes []
2026-03-26 04:48:15.462 DEBUG [src.node.docker_mananger] docker run -i -t -p 12962:12962 -p 12963:12963 -p 12964:12964 -p 12965:12965 -p 12966:12966 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=12964 --rest-port=12962 --tcp-port=12963 --discv5-udp-port=12965 --rest-address=0.0.0.0 --nat=extip:172.18.149.251 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=ed38a5b8dbe8a135e2af7e3ed709e67ced19aa9df96c1d1b9f6dc54c7bf883b5 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=12966 --metrics-logging=true --relay=true --filter=true --content-topic=/app/29/sometopic/someencoding
2026-03-26 04:48:15.656 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.149.251 waku 83e458624c2abc8c938d281f5ccb2f9dcbfa0c14b30430e68757fa298f803b03
2026-03-26 04:48:15.688 ERROR [src.node.docker_mananger] Max retries reached for container ba6f1e7cdfe2. Exiting log stream.
2026-03-26 04:48:15.693 DEBUG [src.node.docker_mananger] Container started with ID 83e458624c2a. Setting up logs at ./log/docker/node1_2026-03-26_04-48-15__c537e438-2f75-4e10-b482-f7551637866b__wakuorg_nwaku:latest.log
2026-03-26 04:48:15.694 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 12962
2026-03-26 04:48:15.694 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-26 04:48:16.171 ERROR [src.node.docker_mananger] Max retries reached for container 2e4db0fed66b. Exiting log stream.
2026-03-26 04:48:16.695 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12962/health" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:48:16.698 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-26 04:48:16.698 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-26 04:48:16.699 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12962/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:48:16.702 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.149.251/tcp/12963/p2p/16Uiu2HAm6N8aN2G5gX24QosR1U8BJ8qDvmoC4k3gFiDPqbMffKBz","/ip4/172.18.149.251/tcp/12964/ws/p2p/16Uiu2HAm6N8aN2G5gX24QosR1U8BJ8qDvmoC4k3gFiDPqbMffKBz"],"enrUri":"enr:-L24QFlYifybEdm7W-xEyF62skSJ_YJoe8MYqaMiYrwkRfgjJxk93gL18q1AjH6Xi-BFLCOHzk4Cffs9FWVHvnSes4cCgmlkgnY0gmlwhKwSlfuKbXVsdGlhZGRyc5YACASsEpX7BjKjAAoErBKV-wYypN0DgnJzhQACAQAAiXNlY3AyNTZrMaECoohOIFFE0Zyd80Sjw4CilZ83G8mwYWTizWLfu7gH8FWDdGNwgjKjg3VkcIIypYV3YWt1MgU"}'
2026-03-26 04:48:16.703 INFO [src.node.waku_node] REST service is ready !!
2026-03-26 04:48:16.712 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-26 04:48:16.712 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-26_04-48-15__c537e438-2f75-4e10-b482-f7551637866b__wakuorg_nwaku:latest.log
2026-03-26 04:48:16.712 DEBUG [src.node.waku_node] Starting Node...
2026-03-26 04:48:16.712 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-26 04:48:16.713 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-26 04:48:16.714 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.116.80
2026-03-26 04:48:16.714 DEBUG [src.node.docker_mananger] Generated ports ['4076', '4077', '4078', '4079', '4080']
2026-03-26 04:48:16.714 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-26 04:48:16.714 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-26 04:48:16.714 DEBUG [src.node.waku_node] Using volumes []
2026-03-26 04:48:16.714 DEBUG [src.node.docker_mananger] docker run -i -t -p 4076:4076 -p 4077:4077 -p 4078:4078 -p 4079:4079 -p 4080:4080 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=4078 --rest-port=4076 --tcp-port=4077 --discv5-udp-port=4079 --rest-address=0.0.0.0 --nat=extip:172.18.116.80 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=aeefa99e5faab6caae9cd153cafbbab57fcfecccff7b429ca59ba5e9f4851c72 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=4080 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QFlYifybEdm7W-xEyF62skSJ_YJoe8MYqaMiYrwkRfgjJxk93gL18q1AjH6Xi-BFLCOHzk4Cffs9FWVHvnSes4cCgmlkgnY0gmlwhKwSlfuKbXVsdGlhZGRyc5YACASsEpX7BjKjAAoErBKV-wYypN0DgnJzhQACAQAAiXNlY3AyNTZrMaECoohOIFFE0Zyd80Sjw4CilZ83G8mwYWTizWLfu7gH8FWDdGNwgjKjg3VkcIIypYV3YWt1MgU --content-topic=/app/29/sometopic/someencoding
2026-03-26 04:48:16.921 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.116.80 waku 1db97e5308b97a265426617130d1faa553e9974c46b80d2c83a9a64e3173a3c3
2026-03-26 04:48:16.966 DEBUG [src.node.docker_mananger] Container started with ID 1db97e5308b9. Setting up logs at ./log/docker/node2_2026-03-26_04-48-15__c537e438-2f75-4e10-b482-f7551637866b__wakuorg_nwaku:latest.log
2026-03-26 04:48:16.967 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 4076
2026-03-26 04:48:16.967 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-26 04:48:17.967 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:4076/health" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:48:17.970 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-26 04:48:18.070 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:4076/health" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:48:18.073 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-26 04:48:18.174 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:4076/health" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:48:18.176 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-26 04:48:18.277 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:4076/health" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:48:18.280 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-26 04:48:18.380 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:4076/health" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:48:18.383 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-26 04:48:18.483 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:4076/health" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:48:18.486 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-26 04:48:18.586 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:4076/health" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:48:18.589 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-26 04:48:18.690 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:4076/health" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:48:18.692 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-26 04:48:18.793 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:4076/health" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:48:18.796 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-26 04:48:18.896 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:4076/health" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:48:18.899 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-26 04:48:18.999 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:4076/health" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:48:19.032 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-26 04:48:19.132 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:4076/health" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:48:19.135 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-26 04:48:19.135 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-26 04:48:19.135 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:4076/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:48:19.137 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.116.80/tcp/4077/p2p/16Uiu2HAmRvGRuehCo8niZY8djxueVevx55H4pB2rFqiPdNVmVFDS","/ip4/172.18.116.80/tcp/4078/ws/p2p/16Uiu2HAmRvGRuehCo8niZY8djxueVevx55H4pB2rFqiPdNVmVFDS"],"enrUri":"enr:-L24QDE1dvmV_mTBSGMfiZvbKEDE7ablBybeRfroBvCiNvG1IQcbK6aTGY8L-U0y0RjCL3r1sGV9aoma-ptD4KQTNPcCgmlkgnY0gmlwhKwSdFCKbXVsdGlhZGRyc5YACASsEnRQBg_tAAoErBJ0UAYP7t0DgnJzhQACAQAAiXNlY3AyNTZrMaEDxRHSz2m1dh7EJm_J-BwGezMoR2OjV4NcNwAOayKj0KmDdGNwgg_tg3VkcIIP74V3YWt1MgE"}'
2026-03-26 04:48:19.138 INFO [src.node.waku_node] REST service is ready !!
2026-03-26 04:48:19.138 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:4076/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.149.251/tcp/12963/p2p/16Uiu2HAm6N8aN2G5gX24QosR1U8BJ8qDvmoC4k3gFiDPqbMffKBz"]'
2026-03-26 04:48:19.177 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-26 04:48:19.178 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12962/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/app/29/sometopic/someencoding"]'
2026-03-26 04:48:19.184 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-26 04:48:19.185 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:4076/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/app/29/sometopic/someencoding"]'
2026-03-26 04:48:19.191 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-26 04:48:19.192 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:12962/relay/v1/auto/messages" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/app/29/sometopic/someencoding", "timestamp": '$(date +%s%N)'}'
2026-03-26 04:48:19.201 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-26 04:48:19.202 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-26 04:48:19.302 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-26 04:48:19.303 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:12962/relay/v1/auto/messages/%2Fapp%2F29%2Fsometopic%2Fsomeencoding" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:48:19.305 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/app/29/sometopic/someencoding","version":0,"timestamp":1774500499192647222,"ephemeral":false,"proof":""}]'
2026-03-26 04:48:19.307 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-26 04:48:19.307 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:4076/relay/v1/auto/messages/%2Fapp%2F29%2Fsometopic%2Fsomeencoding" -H "Content-Type: application/json" -d 'None'
2026-03-26 04:48:19.309 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/app/29/sometopic/someencoding","version":0,"timestamp":1774500499192647222,"ephemeral":false,"proof":""}]'
2026-03-26 04:48:19.314 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-26 04:48:19.315 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-26 04:48:19.315 DEBUG [src.node.waku_node] Stopping container with id 83e458624c2a
2026-03-26 04:48:19.883 DEBUG [src.node.waku_node] Container stopped.
2026-03-26 04:48:19.884 DEBUG [src.node.waku_node] Stopping container with id 1db97e5308b9
2026-03-26 04:48:20.482 DEBUG [src.node.waku_node] Container stopped.
2026-03-26 04:48:20.484 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-26 04:48:20.542 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-26 04:48:20.573 DEBUG [src.node.docker_mananger] No errors found in the waku logs.