167 lines
31 KiB
Plaintext

2026-03-13 04:41:51.614 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-13 04:41:51.615 DEBUG [tests.conftest] Running test: test_unsubscribe_from_all_pubsub_topics with id: 2026-03-13_04-41-51__64790ab4-a911-4bbb-a206-ddaada60e6bb
2026-03-13 04:41:51.615 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-13 04:41:51.615 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-13 04:41:51.615 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-13 04:41:51.623 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-13 04:41:51.623 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-13_04-41-51__64790ab4-a911-4bbb-a206-ddaada60e6bb__wakuorg_nwaku:latest.log
2026-03-13 04:41:51.623 DEBUG [src.node.waku_node] Starting Node...
2026-03-13 04:41:51.623 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-13 04:41:51.624 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-13 04:41:51.625 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.121.5
2026-03-13 04:41:51.625 DEBUG [src.node.docker_mananger] Generated ports ['52619', '52620', '52621', '52622', '52623']
2026-03-13 04:41:51.625 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-13 04:41:51.625 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-13 04:41:51.625 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-13 04:41:51.625 DEBUG [src.node.waku_node] Using volumes []
2026-03-13 04:41:51.625 DEBUG [src.node.docker_mananger] docker run -i -t -p 52619:52619 -p 52620:52620 -p 52621:52621 -p 52622:52622 -p 52623:52623 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=52621 --rest-port=52619 --tcp-port=52620 --discv5-udp-port=52622 --rest-address=0.0.0.0 --nat=extip:172.18.121.5 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=a1477ecbcfdebc8d2ba41abe3e8bdaedde56152cbae0dce2ed4d2a7aec94a7d0 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=52623 --metrics-logging=true --relay=true --filter=true
2026-03-13 04:41:51.817 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.121.5 waku 603a4e8a20370739f2d5c50d460947a019c9d2a401c4e2065a4a0f374d992ec8
2026-03-13 04:41:51.854 DEBUG [src.node.docker_mananger] Container started with ID 603a4e8a2037. Setting up logs at ./log/docker/node1_2026-03-13_04-41-51__64790ab4-a911-4bbb-a206-ddaada60e6bb__wakuorg_nwaku:latest.log
2026-03-13 04:41:51.854 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 52619
2026-03-13 04:41:51.855 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-13 04:41:51.855 ERROR [src.node.docker_mananger] Max retries reached for container faebf2446442. Exiting log stream.
2026-03-13 04:41:52.333 ERROR [src.node.docker_mananger] Max retries reached for container 68f7a08dd37c. Exiting log stream.
2026-03-13 04:41:52.857 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:52619/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:41:52.859 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-13 04:41:52.960 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:52619/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:41:52.962 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-13 04:41:53.062 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:52619/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:41:53.065 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-13 04:41:53.165 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:52619/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:41:53.168 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-13 04:41:53.168 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-13 04:41:53.168 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:52619/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:41:53.170 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.121.5/tcp/52620/p2p/16Uiu2HAm8brdnDTTGThAUZ3CjFouqh2hyUUaQkHCCuRUK54h8LbV","/ip4/172.18.121.5/tcp/52621/ws/p2p/16Uiu2HAm8brdnDTTGThAUZ3CjFouqh2hyUUaQkHCCuRUK54h8LbV"],"enrUri":"enr:-L24QIPkvX1egTF4CUQVWtFa-XZwmsOMVdqqq45vTcgMa8zVF1_gdUDVIBY0Gy54OZ6aL_2_r070We6E1nKIwN_HiqoCgmlkgnY0gmlwhKwSeQWKbXVsdGlhZGRyc5YACASsEnkFBs2MAAoErBJ5BQbNjd0DgnJzhQACAQAAiXNlY3AyNTZrMaECw8PJJOMvtrSIX185SyhjNE4diJ7uaA05VDO_7bgqfPSDdGNwgs2Mg3VkcILNjoV3YWt1MgU"}'
2026-03-13 04:41:53.171 INFO [src.node.waku_node] REST service is ready !!
2026-03-13 04:41:53.178 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-13 04:41:53.178 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-13_04-41-51__64790ab4-a911-4bbb-a206-ddaada60e6bb__wakuorg_nwaku:latest.log
2026-03-13 04:41:53.178 DEBUG [src.node.waku_node] Starting Node...
2026-03-13 04:41:53.178 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-13 04:41:53.179 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-13 04:41:53.179 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.88.89
2026-03-13 04:41:53.180 DEBUG [src.node.docker_mananger] Generated ports ['56546', '56547', '56548', '56549', '56550']
2026-03-13 04:41:53.180 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-13 04:41:53.180 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-13 04:41:53.180 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-13 04:41:53.180 DEBUG [src.node.waku_node] Using volumes []
2026-03-13 04:41:53.180 DEBUG [src.node.docker_mananger] docker run -i -t -p 56546:56546 -p 56547:56547 -p 56548:56548 -p 56549:56549 -p 56550:56550 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=56548 --rest-port=56546 --tcp-port=56547 --discv5-udp-port=56549 --rest-address=0.0.0.0 --nat=extip:172.18.88.89 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=7c285be8c64eef3b6bfffd3e25dde3aa254a72acf3eadfbaec26da98b85fdf4b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=56550 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QIPkvX1egTF4CUQVWtFa-XZwmsOMVdqqq45vTcgMa8zVF1_gdUDVIBY0Gy54OZ6aL_2_r070We6E1nKIwN_HiqoCgmlkgnY0gmlwhKwSeQWKbXVsdGlhZGRyc5YACASsEnkFBs2MAAoErBJ5BQbNjd0DgnJzhQACAQAAiXNlY3AyNTZrMaECw8PJJOMvtrSIX185SyhjNE4diJ7uaA05VDO_7bgqfPSDdGNwgs2Mg3VkcILNjoV3YWt1MgU
2026-03-13 04:41:53.386 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.88.89 waku 129696a487817c36f4b48996aea531a2ff3abfb6e60f24325bbe4ccb940b3791
2026-03-13 04:41:53.428 DEBUG [src.node.docker_mananger] Container started with ID 129696a48781. Setting up logs at ./log/docker/node2_2026-03-13_04-41-51__64790ab4-a911-4bbb-a206-ddaada60e6bb__wakuorg_nwaku:latest.log
2026-03-13 04:41:53.429 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 56546
2026-03-13 04:41:53.430 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-13 04:41:54.430 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56546/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:41:54.456 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-13 04:41:54.556 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56546/health" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:41:54.559 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-13 04:41:54.559 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-13 04:41:54.559 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56546/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:41:54.561 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.88.89/tcp/56547/p2p/16Uiu2HAkwrWbsZXPuviwDFmNguaQ5Jcg9o8zUBfSVsz7YkjuDWgD","/ip4/172.18.88.89/tcp/56548/ws/p2p/16Uiu2HAkwrWbsZXPuviwDFmNguaQ5Jcg9o8zUBfSVsz7YkjuDWgD"],"enrUri":"enr:-L24QBzmT5W0u8p5yYWeDc63gd56Bmnpt06TtDEIob3woW5IEQm9uoGsWXFfYfhScy60mZNgRifgtySP-UZSDpakxeYCgmlkgnY0gmlwhKwSWFmKbXVsdGlhZGRyc5YACASsElhZBtzjAAoErBJYWQbc5N0DgnJzhQACAQAAiXNlY3AyNTZrMaECJBRKV63MMXneyaGqVZxlCBtgUTHDv1WmJxSwNh8c7ZaDdGNwgtzjg3VkcILc5YV3YWt1MgE"}'
2026-03-13 04:41:54.562 INFO [src.node.waku_node] REST service is ready !!
2026-03-13 04:41:54.562 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:56546/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.121.5/tcp/52620/p2p/16Uiu2HAm8brdnDTTGThAUZ3CjFouqh2hyUUaQkHCCuRUK54h8LbV"]'
2026-03-13 04:41:54.601 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:41:54.602 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:52619/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7"]'
2026-03-13 04:41:54.609 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:41:54.609 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:56546/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7"]'
2026-03-13 04:41:54.614 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:41:54.615 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:52619/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:41:54.626 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:41:54.627 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-13 04:41:54.727 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-13 04:41:54.728 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:52619/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:41:54.730 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773376914615580285,"ephemeral":false,"proof":""}]'
2026-03-13 04:41:54.732 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-13 04:41:54.732 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56546/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:41:54.734 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773376914615580285,"ephemeral":false,"proof":""}]'
2026-03-13 04:41:54.736 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:52619/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:41:54.744 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:41:54.746 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-13 04:41:54.846 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-13 04:41:54.847 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:52619/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:41:54.849 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773376914736190319,"ephemeral":false,"proof":""}]'
2026-03-13 04:41:54.850 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-13 04:41:54.850 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56546/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:41:54.853 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773376914736190319,"ephemeral":false,"proof":""}]'
2026-03-13 04:41:54.854 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:52619/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F2" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:41:54.862 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:41:54.863 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-13 04:41:54.964 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-13 04:41:54.964 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:52619/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F2" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:41:54.966 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773376914854543964,"ephemeral":false,"proof":""}]'
2026-03-13 04:41:54.968 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-13 04:41:54.968 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56546/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F2" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:41:54.970 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773376914854543964,"ephemeral":false,"proof":""}]'
2026-03-13 04:41:54.972 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:52619/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F3" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:41:54.980 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:41:54.980 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-13 04:41:55.081 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-13 04:41:55.081 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:52619/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F3" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:41:55.083 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773376914972302576,"ephemeral":false,"proof":""}]'
2026-03-13 04:41:55.085 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-13 04:41:55.085 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56546/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F3" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:41:55.088 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773376914972302576,"ephemeral":false,"proof":""}]'
2026-03-13 04:41:55.089 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:52619/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F4" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:41:55.097 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:41:55.098 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-13 04:41:55.199 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-13 04:41:55.199 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:52619/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F4" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:41:55.201 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773376915089544006,"ephemeral":false,"proof":""}]'
2026-03-13 04:41:55.203 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-13 04:41:55.203 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56546/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F4" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:41:55.205 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773376915089544006,"ephemeral":false,"proof":""}]'
2026-03-13 04:41:55.207 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:52619/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F5" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:41:55.217 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:41:55.217 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-13 04:41:55.318 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-13 04:41:55.318 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:52619/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F5" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:41:55.321 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773376915207132734,"ephemeral":false,"proof":""}]'
2026-03-13 04:41:55.322 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-13 04:41:55.322 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56546/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F5" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:41:55.325 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773376915207132734,"ephemeral":false,"proof":""}]'
2026-03-13 04:41:55.327 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:52619/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F6" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:41:55.335 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:41:55.337 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-13 04:41:55.437 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-13 04:41:55.437 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:52619/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F6" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:41:55.439 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773376915327397712,"ephemeral":false,"proof":""}]'
2026-03-13 04:41:55.441 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-13 04:41:55.441 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56546/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F6" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:41:55.443 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773376915327397712,"ephemeral":false,"proof":""}]'
2026-03-13 04:41:55.445 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:52619/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F7" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:41:55.454 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:41:55.455 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-13 04:41:55.555 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-13 04:41:55.556 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:52619/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F7" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:41:55.558 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773376915445171725,"ephemeral":false,"proof":""}]'
2026-03-13 04:41:55.559 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-13 04:41:55.559 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:56546/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F7" -H "Content-Type: application/json" -d 'None'
2026-03-13 04:41:55.561 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773376915445171725,"ephemeral":false,"proof":""}]'
2026-03-13 04:41:55.563 INFO [src.node.api_clients.base_client] curl -v -X DELETE "http://127.0.0.1:52619/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7"]'
2026-03-13 04:41:55.607 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:41:55.607 INFO [src.node.api_clients.base_client] curl -v -X DELETE "http://127.0.0.1:56546/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7"]'
2026-03-13 04:41:55.653 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-13 04:41:55.654 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:52619/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:41:55.657 ERROR [src.node.api_clients.base_client] HTTP error occurred: 400 Client Error: Bad Request for url: http://127.0.0.1:52619/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0. Response content: b'Failed to publish: Node not subscribed to topic: /waku/2/rs/2/0'
2026-03-13 04:41:55.659 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:52619/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:41:55.661 ERROR [src.node.api_clients.base_client] HTTP error occurred: 400 Client Error: Bad Request for url: http://127.0.0.1:52619/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1. Response content: b'Failed to publish: Node not subscribed to topic: /waku/2/rs/2/1'
2026-03-13 04:41:55.663 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:52619/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F2" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:41:55.665 ERROR [src.node.api_clients.base_client] HTTP error occurred: 400 Client Error: Bad Request for url: http://127.0.0.1:52619/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F2. Response content: b'Failed to publish: Node not subscribed to topic: /waku/2/rs/2/2'
2026-03-13 04:41:55.667 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:52619/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F3" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:41:55.669 ERROR [src.node.api_clients.base_client] HTTP error occurred: 400 Client Error: Bad Request for url: http://127.0.0.1:52619/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F3. Response content: b'Failed to publish: Node not subscribed to topic: /waku/2/rs/2/3'
2026-03-13 04:41:55.671 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:52619/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F4" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:41:55.673 ERROR [src.node.api_clients.base_client] HTTP error occurred: 400 Client Error: Bad Request for url: http://127.0.0.1:52619/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F4. Response content: b'Failed to publish: Node not subscribed to topic: /waku/2/rs/2/4'
2026-03-13 04:41:55.675 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:52619/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F5" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:41:55.677 ERROR [src.node.api_clients.base_client] HTTP error occurred: 400 Client Error: Bad Request for url: http://127.0.0.1:52619/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F5. Response content: b'Failed to publish: Node not subscribed to topic: /waku/2/rs/2/5'
2026-03-13 04:41:55.680 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:52619/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F6" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:41:55.682 ERROR [src.node.api_clients.base_client] HTTP error occurred: 400 Client Error: Bad Request for url: http://127.0.0.1:52619/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F6. Response content: b'Failed to publish: Node not subscribed to topic: /waku/2/rs/2/6'
2026-03-13 04:41:55.684 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:52619/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F7" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-13 04:41:55.686 ERROR [src.node.api_clients.base_client] HTTP error occurred: 400 Client Error: Bad Request for url: http://127.0.0.1:52619/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F7. Response content: b'Failed to publish: Node not subscribed to topic: /waku/2/rs/2/7'
2026-03-13 04:41:55.694 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-13 04:41:55.700 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-13 04:41:55.700 DEBUG [src.node.waku_node] Stopping container with id 603a4e8a2037
2026-03-13 04:41:56.265 DEBUG [src.node.waku_node] Container stopped.
2026-03-13 04:41:56.265 DEBUG [src.node.waku_node] Stopping container with id 129696a48781
2026-03-13 04:41:56.824 DEBUG [src.node.waku_node] Container stopped.
2026-03-13 04:41:56.826 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-13 04:41:56.864 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-13 04:41:56.904 DEBUG [src.node.docker_mananger] No errors found in the waku logs.