194 lines
35 KiB
Plaintext

2026-03-03 04:40:54.537 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-03 04:40:54.537 DEBUG [tests.conftest] Running test: test_unsubscribe_from_some_pubsub_topics with id: 2026-03-03_04-40-54__e25ca992-f124-4742-97a9-2cedf6464157
2026-03-03 04:40:54.537 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-03 04:40:54.538 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-03 04:40:54.538 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-03 04:40:54.546 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-03 04:40:54.547 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-03_04-40-54__e25ca992-f124-4742-97a9-2cedf6464157__wakuorg_nwaku:latest.log
2026-03-03 04:40:54.547 DEBUG [src.node.waku_node] Starting Node...
2026-03-03 04:40:54.547 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-03 04:40:54.548 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-03 04:40:54.549 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.9.45
2026-03-03 04:40:54.549 DEBUG [src.node.docker_mananger] Generated ports ['20534', '20535', '20536', '20537', '20538']
2026-03-03 04:40:54.549 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-03 04:40:54.549 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-03 04:40:54.549 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-03 04:40:54.549 DEBUG [src.node.waku_node] Using volumes []
2026-03-03 04:40:54.550 DEBUG [src.node.docker_mananger] docker run -i -t -p 20534:20534 -p 20535:20535 -p 20536:20536 -p 20537:20537 -p 20538:20538 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=20536 --rest-port=20534 --tcp-port=20535 --discv5-udp-port=20537 --rest-address=0.0.0.0 --nat=extip:172.18.9.45 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=ae4b589e03ec4cfe88380d7dc9e6e13ae938fdb3e30aba70d09d803cc7daf7b2 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=20538 --metrics-logging=true --relay=true --filter=true
2026-03-03 04:40:54.753 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.9.45 waku 8d878e81fd79e5e61214c700a6a32ac69172801e6083894355d8910896ea3c29
2026-03-03 04:40:54.773 ERROR [src.node.docker_mananger] Max retries reached for container 2eaff71217a4. Exiting log stream.
2026-03-03 04:40:54.791 DEBUG [src.node.docker_mananger] Container started with ID 8d878e81fd79. Setting up logs at ./log/docker/node1_2026-03-03_04-40-54__e25ca992-f124-4742-97a9-2cedf6464157__wakuorg_nwaku:latest.log
2026-03-03 04:40:54.791 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 20534
2026-03-03 04:40:54.791 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-03 04:40:55.324 ERROR [src.node.docker_mananger] Max retries reached for container 3c1f1d3fb262. Exiting log stream.
2026-03-03 04:40:55.792 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20534/health" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:40:55.795 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-03 04:40:55.795 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-03 04:40:55.795 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20534/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:40:55.798 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.9.45/tcp/20535/p2p/16Uiu2HAmPu8cWMMKe1EDTJSetfSPHX2Ni3MGfCwkGhz5dyy7Xwi2","/ip4/172.18.9.45/tcp/20536/ws/p2p/16Uiu2HAmPu8cWMMKe1EDTJSetfSPHX2Ni3MGfCwkGhz5dyy7Xwi2"],"enrUri":"enr:-L24QOTZGpMBJz48LfbwdRqnmRA_aznzcH2cJxKu5hv_6ulvLFEyOO_CogiYE0gKL5oRzixiha7SCM0AMWZHzPyNbr0CgmlkgnY0gmlwhKwSCS2KbXVsdGlhZGRyc5YACASsEgktBlA3AAoErBIJLQZQON0DgnJzhQACAQAAiXNlY3AyNTZrMaEDpxAHoO1YrGd2OcCtdtIhEBkCA_wmLMlqyj2AOy6tFvODdGNwglA3g3VkcIJQOYV3YWt1MgU"}'
2026-03-03 04:40:55.798 INFO [src.node.waku_node] REST service is ready !!
2026-03-03 04:40:55.806 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-03 04:40:55.806 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-03_04-40-54__e25ca992-f124-4742-97a9-2cedf6464157__wakuorg_nwaku:latest.log
2026-03-03 04:40:55.806 DEBUG [src.node.waku_node] Starting Node...
2026-03-03 04:40:55.806 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-03 04:40:55.808 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-03 04:40:55.808 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.60.158
2026-03-03 04:40:55.808 DEBUG [src.node.docker_mananger] Generated ports ['60113', '60114', '60115', '60116', '60117']
2026-03-03 04:40:55.808 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-03 04:40:55.808 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-03 04:40:55.808 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-03 04:40:55.808 DEBUG [src.node.waku_node] Using volumes []
2026-03-03 04:40:55.809 DEBUG [src.node.docker_mananger] docker run -i -t -p 60113:60113 -p 60114:60114 -p 60115:60115 -p 60116:60116 -p 60117:60117 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=60115 --rest-port=60113 --tcp-port=60114 --discv5-udp-port=60116 --rest-address=0.0.0.0 --nat=extip:172.18.60.158 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=c393fceba6a563d8cd3de0cebe4fbdaa1c81e1ad77c4bf8b263abde9bd1c37a1 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=60117 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QOTZGpMBJz48LfbwdRqnmRA_aznzcH2cJxKu5hv_6ulvLFEyOO_CogiYE0gKL5oRzixiha7SCM0AMWZHzPyNbr0CgmlkgnY0gmlwhKwSCS2KbXVsdGlhZGRyc5YACASsEgktBlA3AAoErBIJLQZQON0DgnJzhQACAQAAiXNlY3AyNTZrMaEDpxAHoO1YrGd2OcCtdtIhEBkCA_wmLMlqyj2AOy6tFvODdGNwglA3g3VkcIJQOYV3YWt1MgU
2026-03-03 04:40:56.007 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.60.158 waku de2b85af12e1f6d160cc86d22c22ff102848e63ca529f356e563079861864cf0
2026-03-03 04:40:56.040 DEBUG [src.node.docker_mananger] Container started with ID de2b85af12e1. Setting up logs at ./log/docker/node2_2026-03-03_04-40-54__e25ca992-f124-4742-97a9-2cedf6464157__wakuorg_nwaku:latest.log
2026-03-03 04:40:56.040 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 60113
2026-03-03 04:40:56.041 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-03 04:40:57.041 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60113/health" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:40:57.060 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-03 04:40:57.061 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-03 04:40:57.062 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60113/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:40:57.069 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.60.158/tcp/60114/p2p/16Uiu2HAm7cYt3ziWH1nEjT2tEdTF1v3EB9TTYhH7D7BCK4G2hWCA","/ip4/172.18.60.158/tcp/60115/ws/p2p/16Uiu2HAm7cYt3ziWH1nEjT2tEdTF1v3EB9TTYhH7D7BCK4G2hWCA"],"enrUri":"enr:-L24QGvy1E91xfFzwQ632ZeZVagCJlEa2hHIVZ-hfTMrGxKvZNEYtONvhR_LgG0DXShyfv0-tECuhunHYqiM_8QPng4CgmlkgnY0gmlwhKwSPJ6KbXVsdGlhZGRyc5YACASsEjyeBurSAAoErBI8ngbq090DgnJzhQACAQAAiXNlY3AyNTZrMaECtRWa7GLlxffG0LR0yYirtzwf3hxbGBNf5Fv95DdHHguDdGNwgurSg3VkcILq1IV3YWt1MgE"}'
2026-03-03 04:40:57.070 INFO [src.node.waku_node] REST service is ready !!
2026-03-03 04:40:57.070 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:60113/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.9.45/tcp/20535/p2p/16Uiu2HAmPu8cWMMKe1EDTJSetfSPHX2Ni3MGfCwkGhz5dyy7Xwi2"]'
2026-03-03 04:40:57.073 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:40:57.074 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20534/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7"]'
2026-03-03 04:40:57.082 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:40:57.083 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:60113/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7"]'
2026-03-03 04:40:57.097 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:40:57.100 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20534/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:40:57.110 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:40:57.111 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-03 04:40:57.213 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-03 04:40:57.214 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20534/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:40:57.216 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772512857100035305,"ephemeral":false,"proof":""}]'
2026-03-03 04:40:57.218 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-03 04:40:57.218 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60113/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:40:57.220 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772512857100035305,"ephemeral":false,"proof":""}]'
2026-03-03 04:40:57.222 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20534/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:40:57.227 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:40:57.227 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-03 04:40:57.328 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-03 04:40:57.329 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20534/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:40:57.331 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772512857222293058,"ephemeral":false,"proof":""}]'
2026-03-03 04:40:57.333 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-03 04:40:57.333 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60113/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:40:57.335 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772512857222293058,"ephemeral":false,"proof":""}]'
2026-03-03 04:40:57.337 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20534/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F2" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:40:57.342 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:40:57.343 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-03 04:40:57.443 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-03 04:40:57.444 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20534/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F2" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:40:57.447 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772512857337521914,"ephemeral":false,"proof":""}]'
2026-03-03 04:40:57.448 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-03 04:40:57.448 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60113/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F2" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:40:57.450 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772512857337521914,"ephemeral":false,"proof":""}]'
2026-03-03 04:40:57.452 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20534/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F3" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:40:57.457 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:40:57.457 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-03 04:40:57.557 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-03 04:40:57.558 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20534/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F3" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:40:57.561 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772512857452413017,"ephemeral":false,"proof":""}]'
2026-03-03 04:40:57.563 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-03 04:40:57.563 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60113/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F3" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:40:57.565 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772512857452413017,"ephemeral":false,"proof":""}]'
2026-03-03 04:40:57.567 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20534/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F4" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:40:57.572 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:40:57.573 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-03 04:40:57.673 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-03 04:40:57.674 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20534/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F4" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:40:57.677 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772512857567432440,"ephemeral":false,"proof":""}]'
2026-03-03 04:40:57.678 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-03 04:40:57.678 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60113/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F4" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:40:57.681 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772512857567432440,"ephemeral":false,"proof":""}]'
2026-03-03 04:40:57.682 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20534/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F5" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:40:57.687 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:40:57.688 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-03 04:40:57.788 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-03 04:40:57.789 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20534/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F5" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:40:57.791 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772512857682668588,"ephemeral":false,"proof":""}]'
2026-03-03 04:40:57.793 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-03 04:40:57.793 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60113/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F5" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:40:57.796 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772512857682668588,"ephemeral":false,"proof":""}]'
2026-03-03 04:40:57.797 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20534/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F6" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:40:57.803 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:40:57.804 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-03 04:40:57.904 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-03 04:40:57.905 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20534/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F6" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:40:57.907 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772512857797856903,"ephemeral":false,"proof":""}]'
2026-03-03 04:40:57.909 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-03 04:40:57.909 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60113/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F6" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:40:57.912 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772512857797856903,"ephemeral":false,"proof":""}]'
2026-03-03 04:40:57.913 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20534/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F7" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:40:57.918 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:40:57.918 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-03 04:40:58.019 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-03 04:40:58.020 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20534/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F7" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:40:58.024 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772512857913792056,"ephemeral":false,"proof":""}]'
2026-03-03 04:40:58.026 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-03 04:40:58.026 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60113/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F7" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:40:58.028 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772512857913792056,"ephemeral":false,"proof":""}]'
2026-03-03 04:40:58.030 INFO [src.node.api_clients.base_client] curl -v -X DELETE "http://127.0.0.1:20534/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2"]'
2026-03-03 04:40:58.038 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:40:58.038 INFO [src.node.api_clients.base_client] curl -v -X DELETE "http://127.0.0.1:60113/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2"]'
2026-03-03 04:40:58.047 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:40:58.048 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20534/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:40:58.052 ERROR [src.node.api_clients.base_client] HTTP error occurred: 400 Client Error: Bad Request for url: http://127.0.0.1:20534/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0. Response content: b'Failed to publish: Node not subscribed to topic: /waku/2/rs/2/0'
2026-03-03 04:40:58.053 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20534/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:40:58.055 ERROR [src.node.api_clients.base_client] HTTP error occurred: 400 Client Error: Bad Request for url: http://127.0.0.1:20534/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1. Response content: b'Failed to publish: Node not subscribed to topic: /waku/2/rs/2/1'
2026-03-03 04:40:58.057 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20534/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F2" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:40:58.059 ERROR [src.node.api_clients.base_client] HTTP error occurred: 400 Client Error: Bad Request for url: http://127.0.0.1:20534/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F2. Response content: b'Failed to publish: Node not subscribed to topic: /waku/2/rs/2/2'
2026-03-03 04:40:58.061 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20534/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F3" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:40:58.065 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:40:58.066 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-03 04:40:58.166 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-03 04:40:58.167 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20534/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F3" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:40:58.169 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772512858061033803,"ephemeral":false,"proof":""}]'
2026-03-03 04:40:58.171 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-03 04:40:58.171 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60113/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F3" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:40:58.173 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772512858061033803,"ephemeral":false,"proof":""}]'
2026-03-03 04:40:58.175 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20534/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F4" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:40:58.181 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:40:58.182 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-03 04:40:58.282 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-03 04:40:58.283 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20534/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F4" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:40:58.285 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772512858175256708,"ephemeral":false,"proof":""}]'
2026-03-03 04:40:58.287 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-03 04:40:58.287 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60113/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F4" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:40:58.289 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772512858175256708,"ephemeral":false,"proof":""}]'
2026-03-03 04:40:58.291 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20534/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F5" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:40:58.296 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:40:58.296 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-03 04:40:58.397 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-03 04:40:58.397 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20534/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F5" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:40:58.400 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772512858291356336,"ephemeral":false,"proof":""}]'
2026-03-03 04:40:58.401 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-03 04:40:58.402 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60113/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F5" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:40:58.404 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772512858291356336,"ephemeral":false,"proof":""}]'
2026-03-03 04:40:58.405 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20534/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F6" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:40:58.411 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:40:58.412 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-03 04:40:58.512 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-03 04:40:58.512 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20534/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F6" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:40:58.515 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772512858405830562,"ephemeral":false,"proof":""}]'
2026-03-03 04:40:58.516 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-03 04:40:58.517 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60113/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F6" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:40:58.519 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772512858405830562,"ephemeral":false,"proof":""}]'
2026-03-03 04:40:58.520 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:20534/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F7" -H "Content-Type: application/json" -d '{"payload": "U2hhcmRpbmcgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-03 04:40:58.526 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-03 04:40:58.527 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-03 04:40:58.627 DEBUG [src.steps.sharding] Checking that peer NODE_1:wakuorg/nwaku:latest can find the published message
2026-03-03 04:40:58.628 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:20534/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F7" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:40:58.631 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772512858520726214,"ephemeral":false,"proof":""}]'
2026-03-03 04:40:58.632 DEBUG [src.steps.sharding] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-03 04:40:58.632 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:60113/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F7" -H "Content-Type: application/json" -d 'None'
2026-03-03 04:40:58.635 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1772512858520726214,"ephemeral":false,"proof":""}]'
2026-03-03 04:40:58.637 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-03 04:40:58.639 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-03 04:40:58.639 DEBUG [src.node.waku_node] Stopping container with id 8d878e81fd79
2026-03-03 04:40:59.196 DEBUG [src.node.waku_node] Container stopped.
2026-03-03 04:40:59.196 DEBUG [src.node.waku_node] Stopping container with id de2b85af12e1
2026-03-03 04:40:59.799 DEBUG [src.node.waku_node] Container stopped.
2026-03-03 04:40:59.803 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-03 04:40:59.818 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-03 04:40:59.833 DEBUG [src.node.docker_mananger] No errors found in the waku logs.