93 lines
16 KiB
Plaintext

2026-03-20 04:34:07.177 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-20 04:34:07.177 DEBUG [tests.conftest] Running test: test_relay_resubscribe_to_unsubscribed_pubsub_topic with id: 2026-03-20_04-34-07__0512fabe-a782-4621-b7be-be4f9b07c58f
2026-03-20 04:34:07.178 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-20 04:34:07.178 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-20 04:34:07.178 DEBUG [src.steps.relay] Running fixture setup: setup_main_relay_nodes
2026-03-20 04:34:07.185 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-20 04:34:07.186 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-20_04-34-07__0512fabe-a782-4621-b7be-be4f9b07c58f__wakuorg_nwaku:latest.log
2026-03-20 04:34:07.186 DEBUG [src.node.waku_node] Starting Node...
2026-03-20 04:34:07.187 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-20 04:34:07.189 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-20 04:34:07.189 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.17.38
2026-03-20 04:34:07.189 DEBUG [src.node.docker_mananger] Generated ports ['63612', '63613', '63614', '63615', '63616']
2026-03-20 04:34:07.189 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-20 04:34:07.190 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-20 04:34:07.190 DEBUG [src.node.waku_node] Using volumes []
2026-03-20 04:34:07.190 DEBUG [src.node.docker_mananger] docker run -i -t -p 63612:63612 -p 63613:63613 -p 63614:63614 -p 63615:63615 -p 63616:63616 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=63614 --rest-port=63612 --tcp-port=63613 --discv5-udp-port=63615 --rest-address=0.0.0.0 --nat=extip:172.18.17.38 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=0fe03fb5fdcaaf87ab34fdfd7a46bfafbb8dcbe9df9e2e25bea1854a9faf6e4a --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=63616 --metrics-logging=true --relay=true
2026-03-20 04:34:07.392 ERROR [src.node.docker_mananger] Max retries reached for container f2131ad53acc. Exiting log stream.
2026-03-20 04:34:07.402 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.17.38 waku f39ca620124f00f0d288ca2166b832debf7f19f537b5d958d014b22f9ee54aef
2026-03-20 04:34:07.437 DEBUG [src.node.docker_mananger] Container started with ID f39ca620124f. Setting up logs at ./log/docker/node1_2026-03-20_04-34-07__0512fabe-a782-4621-b7be-be4f9b07c58f__wakuorg_nwaku:latest.log
2026-03-20 04:34:07.438 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 63612
2026-03-20 04:34:07.439 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-20 04:34:07.974 ERROR [src.node.docker_mananger] Max retries reached for container fd33c0f49812. Exiting log stream.
2026-03-20 04:34:08.439 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63612/health" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:34:08.442 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-20 04:34:08.443 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-20 04:34:08.443 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63612/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:34:08.445 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.17.38/tcp/63613/p2p/16Uiu2HAmCcQweEXbGB7i4Ngd3KdcE7PWJpdToxvWwRNxmKUPaSGw","/ip4/172.18.17.38/tcp/63614/ws/p2p/16Uiu2HAmCcQweEXbGB7i4Ngd3KdcE7PWJpdToxvWwRNxmKUPaSGw"],"enrUri":"enr:-L24QAkn2JGhy2ikk3mRMG3WA0MHH7VCyuE5rWYdpAJMtPP-O-OA_xCpRwCd-xqQRu15P7GHqE3d_N3s212Y8owy9-4CgmlkgnY0gmlwhKwSESaKbXVsdGlhZGRyc5YACASsEhEmBvh9AAoErBIRJgb4ft0DgnJzhQADAQAAiXNlY3AyNTZrMaEC_1cQbSB03hWYMnZoV_en_ZSDb4XRIFUxt6de_zA9KgiDdGNwgvh9g3VkcIL4f4V3YWt1MgE"}'
2026-03-20 04:34:08.446 INFO [src.node.waku_node] REST service is ready !!
2026-03-20 04:34:08.453 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-20 04:34:08.453 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-20_04-34-07__0512fabe-a782-4621-b7be-be4f9b07c58f__wakuorg_nwaku:latest.log
2026-03-20 04:34:08.453 DEBUG [src.node.waku_node] Starting Node...
2026-03-20 04:34:08.453 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-20 04:34:08.455 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-20 04:34:08.455 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.205.20
2026-03-20 04:34:08.455 DEBUG [src.node.docker_mananger] Generated ports ['45542', '45543', '45544', '45545', '45546']
2026-03-20 04:34:08.455 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-20 04:34:08.455 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-20 04:34:08.455 DEBUG [src.node.waku_node] Using volumes []
2026-03-20 04:34:08.455 DEBUG [src.node.docker_mananger] docker run -i -t -p 45542:45542 -p 45543:45543 -p 45544:45544 -p 45545:45545 -p 45546:45546 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=45544 --rest-port=45542 --tcp-port=45543 --discv5-udp-port=45545 --rest-address=0.0.0.0 --nat=extip:172.18.205.20 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=bbcf50bce4a05cb86aacb7ee0dcfaa8cabc086aa050facb40ecca42f2ae65efd --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=45546 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QAkn2JGhy2ikk3mRMG3WA0MHH7VCyuE5rWYdpAJMtPP-O-OA_xCpRwCd-xqQRu15P7GHqE3d_N3s212Y8owy9-4CgmlkgnY0gmlwhKwSESaKbXVsdGlhZGRyc5YACASsEhEmBvh9AAoErBIRJgb4ft0DgnJzhQADAQAAiXNlY3AyNTZrMaEC_1cQbSB03hWYMnZoV_en_ZSDb4XRIFUxt6de_zA9KgiDdGNwgvh9g3VkcIL4f4V3YWt1MgE
2026-03-20 04:34:08.666 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.205.20 waku 8014597ad258120a75be769609bcb2f654de298e4810b37715b42d3151514fef
2026-03-20 04:34:08.706 DEBUG [src.node.docker_mananger] Container started with ID 8014597ad258. Setting up logs at ./log/docker/node2_2026-03-20_04-34-07__0512fabe-a782-4621-b7be-be4f9b07c58f__wakuorg_nwaku:latest.log
2026-03-20 04:34:08.707 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 45542
2026-03-20 04:34:08.707 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-20 04:34:09.708 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45542/health" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:34:09.722 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-20 04:34:09.726 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-20 04:34:09.726 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45542/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:34:09.732 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.205.20/tcp/45543/p2p/16Uiu2HAkzv1hNYF2UwEES4XDb2rqprhc2QYQ4VNmHf1z7pLyw675","/ip4/172.18.205.20/tcp/45544/ws/p2p/16Uiu2HAkzv1hNYF2UwEES4XDb2rqprhc2QYQ4VNmHf1z7pLyw675"],"enrUri":"enr:-L24QFpNGXlucfD-0duE8UUwuQtcuo0tkBnfnp71bpmh5UMhEdZ-yistVWHPpj7hrWOAEaFPSppHyVAigviwpoF9oq0CgmlkgnY0gmlwhKwSzRSKbXVsdGlhZGRyc5YACASsEs0UBrHnAAoErBLNFAax6N0DgnJzhQADAQAAiXNlY3AyNTZrMaECUYz9wPbxIhpokT7FiMEPvXtcoFcOXIZtI3QBIIfX86SDdGNwgrHng3VkcIKx6YV3YWt1MgE"}'
2026-03-20 04:34:09.733 INFO [src.node.waku_node] REST service is ready !!
2026-03-20 04:34:09.733 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45542/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.17.38/tcp/63613/p2p/16Uiu2HAmCcQweEXbGB7i4Ngd3KdcE7PWJpdToxvWwRNxmKUPaSGw"]'
2026-03-20 04:34:09.738 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:34:09.739 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63612/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-20 04:34:09.744 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:34:09.744 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45542/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-20 04:34:09.749 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:34:09.750 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63612/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:34:09.756 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:34:09.756 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-20 04:34:09.857 DEBUG [src.steps.relay] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-20 04:34:09.857 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63612/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:34:09.860 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1773981249750261760,"ephemeral":false,"proof":""}]'
2026-03-20 04:34:09.861 DEBUG [src.steps.relay] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-20 04:34:09.861 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45542/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:34:09.864 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1773981249750261760,"ephemeral":false,"proof":""}]'
2026-03-20 04:34:09.865 INFO [src.node.api_clients.base_client] curl -v -X DELETE "http://127.0.0.1:63612/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-20 04:34:09.870 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:34:09.872 INFO [src.node.api_clients.base_client] curl -v -X DELETE "http://127.0.0.1:45542/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-20 04:34:09.875 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:34:09.875 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63612/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:34:09.879 ERROR [src.node.api_clients.base_client] HTTP error occurred: 400 Client Error: Bad Request for url: http://127.0.0.1:63612/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1. Response content: b'Failed to publish: Node not subscribed to topic: /waku/2/rs/3/1'
2026-03-20 04:34:09.879 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63612/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-20 04:34:09.883 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:34:09.883 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:45542/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-20 04:34:09.887 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:34:09.888 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:63612/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "UmVsYXkgd29ya3MhIQ==", "contentTopic": "/test/1/waku-relay/proto", "timestamp": '$(date +%s%N)'}'
2026-03-20 04:34:09.892 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-20 04:34:09.893 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-20 04:34:09.994 DEBUG [src.steps.relay] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-20 04:34:09.994 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:63612/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:34:09.997 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1773981249888489385,"ephemeral":false,"proof":""}]'
2026-03-20 04:34:09.999 DEBUG [src.steps.relay] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-20 04:34:09.999 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:45542/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-20 04:34:10.001 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"UmVsYXkgd29ya3MhIQ==","contentTopic":"/test/1/waku-relay/proto","version":0,"timestamp":1773981249888489385,"ephemeral":false,"proof":""}]'
2026-03-20 04:34:10.004 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-20 04:34:10.005 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-20 04:34:10.005 DEBUG [src.node.waku_node] Stopping container with id f39ca620124f
2026-03-20 04:34:10.602 DEBUG [src.node.waku_node] Container stopped.
2026-03-20 04:34:10.602 DEBUG [src.node.waku_node] Stopping container with id 8014597ad258
2026-03-20 04:34:11.159 DEBUG [src.node.waku_node] Container stopped.
2026-03-20 04:34:11.161 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-20 04:34:11.175 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-20 04:34:11.181 DEBUG [src.node.docker_mananger] No errors found in the waku logs.