183 lines
34 KiB
Plaintext

2026-02-01 04:45:51.969 DEBUG [tests.conftest] Running fixture setup: test_id
2026-02-01 04:45:51.969 DEBUG [tests.conftest] Running test: test_check_sync_when_2_nodes_publish with id: 2026-02-01_04-45-51__c750816e-9769-409a-a8d3-6e03246b46d7
2026-02-01 04:45:51.970 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-02-01 04:45:51.976 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-01 04:45:51.976 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-02-01_04-45-51__c750816e-9769-409a-a8d3-6e03246b46d7__wakuorg_nwaku:latest.log
2026-02-01 04:45:51.981 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-01 04:45:51.982 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-02-01_04-45-51__c750816e-9769-409a-a8d3-6e03246b46d7__wakuorg_nwaku:latest.log
2026-02-01 04:45:51.987 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-02-01 04:45:51.987 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-02-01_04-45-51__c750816e-9769-409a-a8d3-6e03246b46d7__wakuorg_nwaku:latest.log
2026-02-01 04:45:51.987 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-02-01 04:45:51.988 DEBUG [src.node.waku_node] Starting Node...
2026-02-01 04:45:51.988 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-01 04:45:51.990 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-01 04:45:51.990 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.70.160
2026-02-01 04:45:51.990 DEBUG [src.node.docker_mananger] Generated ports ['62418', '62419', '62420', '62421', '62422']
2026-02-01 04:45:51.990 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-01 04:45:51.990 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-01 04:45:51.990 DEBUG [src.node.waku_node] Using volumes []
2026-02-01 04:45:51.991 DEBUG [src.node.docker_mananger] docker run -i -t -p 62418:62418 -p 62419:62419 -p 62420:62420 -p 62421:62421 -p 62422:62422 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=62420 --rest-port=62418 --tcp-port=62419 --discv5-udp-port=62421 --rest-address=0.0.0.0 --nat=extip:172.18.70.160 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=b77dc3c0c28f0d6f146ef7e3d4ad4eb33ecfab66fcabbbabdebaf4d2d544b1af --store-sync=true --store=true --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=62422 --metrics-logging=true --relay=true
2026-02-01 04:45:52.174 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.70.160 waku 3f187300134b64d1dd36da7ef77c6ecc41e10402961265de18e2337486a38ae5
2026-02-01 04:45:52.205 DEBUG [src.node.docker_mananger] Container started with ID 3f187300134b. Setting up logs at ./log/docker/node1_2026-02-01_04-45-51__c750816e-9769-409a-a8d3-6e03246b46d7__wakuorg_nwaku:latest.log
2026-02-01 04:45:52.207 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 62418
2026-02-01 04:45:52.207 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-01 04:45:52.249 ERROR [src.node.docker_mananger] Max retries reached for container 519479cc02bc. Exiting log stream.
2026-02-01 04:45:52.776 ERROR [src.node.docker_mananger] Max retries reached for container ef6fe96686d2. Exiting log stream.
2026-02-01 04:45:53.208 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:62418/health" -H "Content-Type: application/json" -d 'None'
2026-02-01 04:45:53.211 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2026-02-01 04:45:53.211 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-01 04:45:53.211 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:62418/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-01 04:45:53.213 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.70.160/tcp/62419/p2p/16Uiu2HAm47ht5CsZFpW5SbBsu5aL1vcniXbPhrvbc1hq9wXSuUXQ","/ip4/172.18.70.160/tcp/62420/ws/p2p/16Uiu2HAm47ht5CsZFpW5SbBsu5aL1vcniXbPhrvbc1hq9wXSuUXQ"],"enrUri":"enr:-L24QLSAMYV65-cujwj6tFhk8gEKlIY27aEbZC1siCxpjMX4Xo9UK3JmGjKH4_TYHvzsfsxUEsFlJ6tjaMz374MzSawCgmlkgnY0gmlwhKwSRqCKbXVsdGlhZGRyc5YACASsEkagBvPTAAoErBJGoAbz1N0DgnJzhQADAQAAiXNlY3AyNTZrMaECgR7grrwj32jDHou-ktxkOL8xVHcidoEaOAesWv5RBp-DdGNwgvPTg3VkcILz1YV3YWt1MhM"}'
2026-02-01 04:45:53.214 INFO [src.node.waku_node] REST service is ready !!
2026-02-01 04:45:53.214 DEBUG [src.node.waku_node] Starting Node...
2026-02-01 04:45:53.214 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-01 04:45:53.215 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-01 04:45:53.215 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.143.183
2026-02-01 04:45:53.216 DEBUG [src.node.docker_mananger] Generated ports ['30489', '30490', '30491', '30492', '30493']
2026-02-01 04:45:53.216 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-01 04:45:53.216 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-01 04:45:53.216 DEBUG [src.node.waku_node] Using volumes []
2026-02-01 04:45:53.216 DEBUG [src.node.docker_mananger] docker run -i -t -p 30489:30489 -p 30490:30490 -p 30491:30491 -p 30492:30492 -p 30493:30493 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=30491 --rest-port=30489 --tcp-port=30490 --discv5-udp-port=30492 --rest-address=0.0.0.0 --nat=extip:172.18.143.183 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=af0c60e3166445c4ddfbcf58ebb5412dfe4079fd4fd2d14b5c1c000734fa710e --store-sync=true --store=true --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=30493 --metrics-logging=true --relay=true --storenode=/ip4/172.18.70.160/tcp/62419/p2p/16Uiu2HAm47ht5CsZFpW5SbBsu5aL1vcniXbPhrvbc1hq9wXSuUXQ --discv5-bootstrap-node=enr:-L24QLSAMYV65-cujwj6tFhk8gEKlIY27aEbZC1siCxpjMX4Xo9UK3JmGjKH4_TYHvzsfsxUEsFlJ6tjaMz374MzSawCgmlkgnY0gmlwhKwSRqCKbXVsdGlhZGRyc5YACASsEkagBvPTAAoErBJGoAbz1N0DgnJzhQADAQAAiXNlY3AyNTZrMaECgR7grrwj32jDHou-ktxkOL8xVHcidoEaOAesWv5RBp-DdGNwgvPTg3VkcILz1YV3YWt1MhM
2026-02-01 04:45:53.406 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.143.183 waku 815477c2d5d9bfe3d73c9b8b3dcb8b00cb45e1d20fd09c7b5734134217674e90
2026-02-01 04:45:53.438 DEBUG [src.node.docker_mananger] Container started with ID 815477c2d5d9. Setting up logs at ./log/docker/node2_2026-02-01_04-45-51__c750816e-9769-409a-a8d3-6e03246b46d7__wakuorg_nwaku:latest.log
2026-02-01 04:45:53.438 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 30489
2026-02-01 04:45:53.439 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-01 04:45:54.439 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:30489/health" -H "Content-Type: application/json" -d 'None'
2026-02-01 04:45:54.443 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"READY"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"READY"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2026-02-01 04:45:54.444 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-01 04:45:54.444 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:30489/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-01 04:45:54.446 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.143.183/tcp/30490/p2p/16Uiu2HAmSmDWLe5uhKtGGr8DT6CABngZB2CGpD1P3ANtQLqLhUdc","/ip4/172.18.143.183/tcp/30491/ws/p2p/16Uiu2HAmSmDWLe5uhKtGGr8DT6CABngZB2CGpD1P3ANtQLqLhUdc"],"enrUri":"enr:-L24QEtzn8-hFJaJ3wIvSA7EajUnwjrm5NFrzCqsYTzZ7vhQCjJh0O7EVw1ZJ__cYEygWm5M6sbTLYjaT7x0I5lFsKcCgmlkgnY0gmlwhKwSj7eKbXVsdGlhZGRyc5YACASsEo-3BncaAAoErBKPtwZ3G90DgnJzhQADAQAAiXNlY3AyNTZrMaED0Zv6Nj8Wr1-1_l2-_ijPIqDwV2x8SzRE3zeygsPnmMeDdGNwgncag3VkcIJ3HIV3YWt1MhM"}'
2026-02-01 04:45:54.446 INFO [src.node.waku_node] REST service is ready !!
2026-02-01 04:45:54.446 DEBUG [src.node.waku_node] Starting Node...
2026-02-01 04:45:54.447 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-02-01 04:45:54.448 DEBUG [src.node.docker_mananger] Network waku already exists
2026-02-01 04:45:54.448 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.229.114
2026-02-01 04:45:54.448 DEBUG [src.node.docker_mananger] Generated ports ['42801', '42802', '42803', '42804', '42805']
2026-02-01 04:45:54.449 DEBUG [src.node.waku_node] RLN credentials were not set
2026-02-01 04:45:54.449 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-02-01 04:45:54.449 DEBUG [src.node.waku_node] Using volumes []
2026-02-01 04:45:54.449 DEBUG [src.node.docker_mananger] docker run -i -t -p 42801:42801 -p 42802:42802 -p 42803:42803 -p 42804:42804 -p 42805:42805 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=42803 --rest-port=42801 --tcp-port=42802 --discv5-udp-port=42804 --rest-address=0.0.0.0 --nat=extip:172.18.229.114 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=584ed27ba4ce136ca7870adcff6dc7f6de2aa1ef6fcbbefc0fdfdac3c9cfe5ab --store-sync=true --store=false --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=42805 --metrics-logging=true --relay=false --storenode=/ip4/172.18.143.183/tcp/30490/p2p/16Uiu2HAmSmDWLe5uhKtGGr8DT6CABngZB2CGpD1P3ANtQLqLhUdc --discv5-bootstrap-node=enr:-L24QEtzn8-hFJaJ3wIvSA7EajUnwjrm5NFrzCqsYTzZ7vhQCjJh0O7EVw1ZJ__cYEygWm5M6sbTLYjaT7x0I5lFsKcCgmlkgnY0gmlwhKwSj7eKbXVsdGlhZGRyc5YACASsEo-3BncaAAoErBKPtwZ3G90DgnJzhQADAQAAiXNlY3AyNTZrMaED0Zv6Nj8Wr1-1_l2-_ijPIqDwV2x8SzRE3zeygsPnmMeDdGNwgncag3VkcIJ3HIV3YWt1MhM
2026-02-01 04:45:54.635 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.229.114 waku 8ba52006fcf23db8e64ae40f2123e69d9e6217b12bce01361f431c6832c9d940
2026-02-01 04:45:54.668 DEBUG [src.node.docker_mananger] Container started with ID 8ba52006fcf2. Setting up logs at ./log/docker/node3_2026-02-01_04-45-51__c750816e-9769-409a-a8d3-6e03246b46d7__wakuorg_nwaku:latest.log
2026-02-01 04:45:54.668 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 42801
2026-02-01 04:45:54.669 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-02-01 04:45:55.669 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42801/health" -H "Content-Type: application/json" -d 'None'
2026-02-01 04:45:55.673 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"READY"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2026-02-01 04:45:55.673 INFO [src.node.waku_node] Node protocols are initialized !!
2026-02-01 04:45:55.673 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42801/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-02-01 04:45:55.676 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.229.114/tcp/42802/p2p/16Uiu2HAm8duJbxakfB3X1siCQiM9qPwb9iFW6StvSotiYQQpmXs8","/ip4/172.18.229.114/tcp/42803/ws/p2p/16Uiu2HAm8duJbxakfB3X1siCQiM9qPwb9iFW6StvSotiYQQpmXs8"],"enrUri":"enr:-L24QD8BugFdM2Hvvy0A4rG9oUr3blZ5MqDtlkLkJped9wZtU0DmqCXHlsJCcF4x-KR2lI6dy0t8vDzZMm3eJBFCYsgCgmlkgnY0gmlwhKwS5XKKbXVsdGlhZGRyc5YACASsEuVyBqcyAAoErBLlcganM90DgnJzhQADAQAAiXNlY3AyNTZrMaECxEn3MWqLvl0gFnOcYPmYxsvpMo2OqUfwIE2EMtgtqAODdGNwgqcyg3VkcIKnNIV3YWt1MgA"}'
2026-02-01 04:45:55.676 INFO [src.node.waku_node] REST service is ready !!
2026-02-01 04:45:55.676 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30489/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.70.160/tcp/62419/p2p/16Uiu2HAm47ht5CsZFpW5SbBsu5aL1vcniXbPhrvbc1hq9wXSuUXQ"]'
2026-02-01 04:45:55.679 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-01 04:45:55.679 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:42801/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.143.183/tcp/30490/p2p/16Uiu2HAmSmDWLe5uhKtGGr8DT6CABngZB2CGpD1P3ANtQLqLhUdc"]'
2026-02-01 04:45:55.707 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-01 04:45:55.707 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62418/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-02-01 04:45:55.712 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-01 04:45:55.713 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30489/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-02-01 04:45:55.716 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-01 04:45:55.717 DEBUG [src.steps.store] Relaying message
2026-02-01 04:45:55.717 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62418/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-01 04:45:55.724 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-01 04:45:55.724 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-02-01 04:45:55.735 DEBUG [src.steps.store] Relaying message
2026-02-01 04:45:55.735 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62418/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-01 04:45:55.740 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-01 04:45:55.740 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-02-01 04:45:55.750 DEBUG [src.steps.store] Relaying message
2026-02-01 04:45:55.750 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62418/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-01 04:45:55.755 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-01 04:45:55.755 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-02-01 04:45:55.765 DEBUG [src.steps.store] Relaying message
2026-02-01 04:45:55.766 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62418/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-01 04:45:55.770 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-01 04:45:55.771 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-02-01 04:45:55.781 DEBUG [src.steps.store] Relaying message
2026-02-01 04:45:55.781 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62418/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-01 04:45:55.786 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-01 04:45:55.787 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-02-01 04:45:55.798 DEBUG [src.steps.store] Relaying message
2026-02-01 04:45:55.798 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62418/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-01 04:45:55.803 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-01 04:45:55.803 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-02-01 04:45:55.813 DEBUG [src.steps.store] Relaying message
2026-02-01 04:45:55.814 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62418/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-01 04:45:55.818 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-01 04:45:55.819 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-02-01 04:45:55.829 DEBUG [src.steps.store] Relaying message
2026-02-01 04:45:55.829 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62418/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-01 04:45:55.835 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-01 04:45:55.835 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-02-01 04:45:55.846 DEBUG [src.steps.store] Relaying message
2026-02-01 04:45:55.846 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62418/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-01 04:45:55.850 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-01 04:45:55.851 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-02-01 04:45:55.862 DEBUG [src.steps.store] Relaying message
2026-02-01 04:45:55.862 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62418/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-01 04:45:55.867 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-01 04:45:55.867 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-02-01 04:45:55.878 DEBUG [src.steps.store] Relaying message
2026-02-01 04:45:55.878 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30489/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-01 04:45:55.882 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-01 04:45:55.883 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-02-01 04:45:55.893 DEBUG [src.steps.store] Relaying message
2026-02-01 04:45:55.893 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30489/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-01 04:45:55.898 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-01 04:45:55.898 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-02-01 04:45:55.909 DEBUG [src.steps.store] Relaying message
2026-02-01 04:45:55.909 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30489/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-01 04:45:55.913 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-01 04:45:55.914 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-02-01 04:45:55.925 DEBUG [src.steps.store] Relaying message
2026-02-01 04:45:55.925 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30489/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-01 04:45:55.930 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-01 04:45:55.930 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-02-01 04:45:55.941 DEBUG [src.steps.store] Relaying message
2026-02-01 04:45:55.941 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30489/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-01 04:45:55.946 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-01 04:45:55.946 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-02-01 04:45:55.957 DEBUG [src.steps.store] Relaying message
2026-02-01 04:45:55.957 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30489/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-01 04:45:55.962 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-01 04:45:55.962 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-02-01 04:45:55.973 DEBUG [src.steps.store] Relaying message
2026-02-01 04:45:55.973 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30489/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-01 04:45:55.977 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-01 04:45:55.978 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-02-01 04:45:55.988 DEBUG [src.steps.store] Relaying message
2026-02-01 04:45:55.988 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30489/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-01 04:45:55.993 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-01 04:45:55.994 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-02-01 04:45:56.004 DEBUG [src.steps.store] Relaying message
2026-02-01 04:45:56.005 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30489/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-01 04:45:56.009 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-01 04:45:56.010 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-02-01 04:45:56.021 DEBUG [src.steps.store] Relaying message
2026-02-01 04:45:56.021 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:30489/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-02-01 04:45:56.026 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-02-01 04:45:56.026 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-02-01 04:45:56.037 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-02-01 04:45:56.037 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:62418/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-02-01 04:45:56.040 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x592ee010260f1fb03ba843dc47528913cd295e9e41e92f16ca62bfac9da28088"},{"messageHash":"0xd55276c644e657732306b9cb0c0b03f0c0151cd0b246dca5dc3a485b88842a74"},{"messageHash":"0xa527522ed1e4ae83982dd3e2a7577876ce854672ccf2a3a7bb19047273454299"},{"messageHash":"0x356679b1f6b13b9630b89fbf3833cb7c37f0b516a2db07ca31c247f596e469e1"},{"messageHash":"0x84825e72503922f8a056c217c537ebd0c34677c4af5a2525db5dc7cc20846a0f"},{"messageHash":"0xad7c8f0343feed9eae01e23a5dbfe48a2e81faec8b36f25d734b681928d24be1"},{"messageHash":"0x5129b16bb824d67c6544b24ac8c96ddc5f8a2b03285e86ae28b2ec56e51002bf"},{"messageHash":"0xfa5552f01cc125c1ea9cc02df4ff635e0225c978eee9013a51dafafcdb93330b"},{"messageHash":"0x2390cadd6f66f0ccdcb1f781c910ba834ac238554fc49aed2f596840e49ee811"},{"messageHash":"0x3b5d6fa807a5d26fe9d46157c9d3f321707bccfa057faa9ae66810ab80332121"},{"messageHash":"0xe7ad966b54b585133731b6539b09f0ee618c0c9c1b035a8ed438b02861fef632"},{"messageHash":"0x19b0bc7e98daf1f4bf30c84c52e99e72bdd0f39a772219594371a0fa672edb86"},{"messageHash":"0x95650e08b86976ca79b5359823ae89251eea983ac917d10605b79976a77f44ef"},{"messageHash":"0x8c124a1525e418b80b4d5d48d6aee941790063f09a9ed7910889df8d53a06a59"},{"messageHash":"0x66d117efa0bcf42433d9cdaaa8de974d80dc4044cc80ad317ef2466142a8a433"},{"messageHash":"0x047d06d91d9efb83125e0bcc82bb2a5b3235997c3d916912828cae906bb39b04"},{"messageHash":"0x67ab700d9e956f47828dfff4122ba7a38ff8e95cdc44caa1b1662769298d25b9"},{"messageHash":"0x3884c8a670480d4cf468f43a75e50d33e05ef9a99264cd6fef45ae8c2ccf4470"},{"messageHash":"0x78d02a4a789ac44c0665b96b9dab1190e77ec7a6b519e7607c4c75663a32aeff"},{"messageHash":"0xdd66d4de1173d261149785c824f836a1c5e20348cd3a21a4b48b202385d202e6"}]}'
2026-02-01 04:45:56.040 DEBUG [src.steps.store] messages length is 20
2026-02-01 04:45:56.042 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-02-01 04:45:56.043 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:30489/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-02-01 04:45:56.045 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x592ee010260f1fb03ba843dc47528913cd295e9e41e92f16ca62bfac9da28088"},{"messageHash":"0xd55276c644e657732306b9cb0c0b03f0c0151cd0b246dca5dc3a485b88842a74"},{"messageHash":"0xa527522ed1e4ae83982dd3e2a7577876ce854672ccf2a3a7bb19047273454299"},{"messageHash":"0x356679b1f6b13b9630b89fbf3833cb7c37f0b516a2db07ca31c247f596e469e1"},{"messageHash":"0x84825e72503922f8a056c217c537ebd0c34677c4af5a2525db5dc7cc20846a0f"},{"messageHash":"0xad7c8f0343feed9eae01e23a5dbfe48a2e81faec8b36f25d734b681928d24be1"},{"messageHash":"0x5129b16bb824d67c6544b24ac8c96ddc5f8a2b03285e86ae28b2ec56e51002bf"},{"messageHash":"0xfa5552f01cc125c1ea9cc02df4ff635e0225c978eee9013a51dafafcdb93330b"},{"messageHash":"0x2390cadd6f66f0ccdcb1f781c910ba834ac238554fc49aed2f596840e49ee811"},{"messageHash":"0x3b5d6fa807a5d26fe9d46157c9d3f321707bccfa057faa9ae66810ab80332121"},{"messageHash":"0xe7ad966b54b585133731b6539b09f0ee618c0c9c1b035a8ed438b02861fef632"},{"messageHash":"0x19b0bc7e98daf1f4bf30c84c52e99e72bdd0f39a772219594371a0fa672edb86"},{"messageHash":"0x95650e08b86976ca79b5359823ae89251eea983ac917d10605b79976a77f44ef"},{"messageHash":"0x8c124a1525e418b80b4d5d48d6aee941790063f09a9ed7910889df8d53a06a59"},{"messageHash":"0x66d117efa0bcf42433d9cdaaa8de974d80dc4044cc80ad317ef2466142a8a433"},{"messageHash":"0x047d06d91d9efb83125e0bcc82bb2a5b3235997c3d916912828cae906bb39b04"},{"messageHash":"0x67ab700d9e956f47828dfff4122ba7a38ff8e95cdc44caa1b1662769298d25b9"},{"messageHash":"0x3884c8a670480d4cf468f43a75e50d33e05ef9a99264cd6fef45ae8c2ccf4470"},{"messageHash":"0x78d02a4a789ac44c0665b96b9dab1190e77ec7a6b519e7607c4c75663a32aeff"},{"messageHash":"0xdd66d4de1173d261149785c824f836a1c5e20348cd3a21a4b48b202385d202e6"}]}'
2026-02-01 04:45:56.046 DEBUG [src.steps.store] messages length is 20
2026-02-01 04:45:56.048 DEBUG [src.steps.store] Checking that peer wakuorg/nwaku:latest can find the stored messages
2026-02-01 04:45:56.048 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:42801/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-02-01 04:45:56.056 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"361e4bd252874e891204","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x592ee010260f1fb03ba843dc47528913cd295e9e41e92f16ca62bfac9da28088"},{"messageHash":"0xd55276c644e657732306b9cb0c0b03f0c0151cd0b246dca5dc3a485b88842a74"},{"messageHash":"0xa527522ed1e4ae83982dd3e2a7577876ce854672ccf2a3a7bb19047273454299"},{"messageHash":"0x356679b1f6b13b9630b89fbf3833cb7c37f0b516a2db07ca31c247f596e469e1"},{"messageHash":"0x84825e72503922f8a056c217c537ebd0c34677c4af5a2525db5dc7cc20846a0f"},{"messageHash":"0xad7c8f0343feed9eae01e23a5dbfe48a2e81faec8b36f25d734b681928d24be1"},{"messageHash":"0x5129b16bb824d67c6544b24ac8c96ddc5f8a2b03285e86ae28b2ec56e51002bf"},{"messageHash":"0xfa5552f01cc125c1ea9cc02df4ff635e0225c978eee9013a51dafafcdb93330b"},{"messageHash":"0x2390cadd6f66f0ccdcb1f781c910ba834ac238554fc49aed2f596840e49ee811"},{"messageHash":"0x3b5d6fa807a5d26fe9d46157c9d3f321707bccfa057faa9ae66810ab80332121"},{"messageHash":"0xe7ad966b54b585133731b6539b09f0ee618c0c9c1b035a8ed438b02861fef632"},{"messageHash":"0x19b0bc7e98daf1f4bf30c84c52e99e72bdd0f39a772219594371a0fa672edb86"},{"messageHash":"0x95650e08b86976ca79b5359823ae89251eea983ac917d10605b79976a77f44ef"},{"messageHash":"0x8c124a1525e418b80b4d5d48d6aee941790063f09a9ed7910889df8d53a06a59"},{"messageHash":"0x66d117efa0bcf42433d9cdaaa8de974d80dc4044cc80ad317ef2466142a8a433"},{"messageHash":"0x047d06d91d9efb83125e0bcc82bb2a5b3235997c3d916912828cae906bb39b04"},{"messageHash":"0x67ab700d9e956f47828dfff4122ba7a38ff8e95cdc44caa1b1662769298d25b9"},{"messageHash":"0x3884c8a670480d4cf468f43a75e50d33e05ef9a99264cd6fef45ae8c2ccf4470"},{"messageHash":"0x78d02a4a789ac44c0665b96b9dab1190e77ec7a6b519e7607c4c75663a32aeff"},{"messageHash":"0xdd66d4de1173d261149785c824f836a1c5e20348cd3a21a4b48b202385d202e6"}]}'
2026-02-01 04:45:56.056 DEBUG [src.steps.store] messages length is 20
2026-02-01 04:45:56.060 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-02-01 04:45:56.061 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-02-01 04:45:56.061 DEBUG [src.node.waku_node] Stopping container with id 3f187300134b
2026-02-01 04:45:56.590 DEBUG [src.node.waku_node] Container stopped.
2026-02-01 04:45:56.591 DEBUG [src.node.waku_node] Stopping container with id 815477c2d5d9
2026-02-01 04:45:57.148 DEBUG [src.node.waku_node] Container stopped.
2026-02-01 04:45:57.148 DEBUG [src.node.waku_node] Stopping container with id 8ba52006fcf2
2026-02-01 04:45:57.403 ERROR [src.node.docker_mananger] Max retries reached for container 3f187300134b. Exiting log stream.
2026-02-01 04:45:57.643 DEBUG [src.node.waku_node] Container stopped.
2026-02-01 04:45:57.644 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-02-01 04:45:57.654 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-01 04:45:57.666 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-02-01 04:45:57.670 DEBUG [src.node.docker_mananger] No errors found in the waku logs.