2026-03-16 12:56:34 +00:00

183 lines
34 KiB
Plaintext

2026-03-16 12:37:03.526 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-16 12:37:03.527 DEBUG [tests.conftest] Running test: test_check_sync_when_2_nodes_publish with id: 2026-03-16_12-37-03__433f9e06-e3e3-4d79-82c2-f89b65a546a1
2026-03-16 12:37:03.527 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-16 12:37:03.533 DEBUG [src.node.docker_mananger] Docker client initialized with image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0
2026-03-16 12:37:03.533 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-16_12-37-03__433f9e06-e3e3-4d79-82c2-f89b65a546a1__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-16 12:37:03.539 DEBUG [src.node.docker_mananger] Docker client initialized with image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0
2026-03-16 12:37:03.540 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-16_12-37-03__433f9e06-e3e3-4d79-82c2-f89b65a546a1__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-16 12:37:03.545 DEBUG [src.node.docker_mananger] Docker client initialized with image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0
2026-03-16 12:37:03.546 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node3_2026-03-16_12-37-03__433f9e06-e3e3-4d79-82c2-f89b65a546a1__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-16 12:37:03.546 DEBUG [src.steps.store] Running fixture setup: store_setup
2026-03-16 12:37:03.547 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 12:37:03.547 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 12:37:03.548 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 12:37:03.549 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.185.125
2026-03-16 12:37:03.549 DEBUG [src.node.docker_mananger] Generated ports ['62849', '62850', '62851', '62852', '62853']
2026-03-16 12:37:03.549 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 12:37:03.549 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 12:37:03.549 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 12:37:03.549 DEBUG [src.node.docker_mananger] docker run -i -t -p 62849:62849 -p 62850:62850 -p 62851:62851 -p 62852:62852 -p 62853:62853 harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=62851 --rest-port=62849 --tcp-port=62850 --discv5-udp-port=62852 --rest-address=0.0.0.0 --nat=extip:172.18.185.125 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=349bb7de8812d4958afb1f0b6be6760be0e7afada15dce89a88caacbcf0f0eac --store-sync=true --store=true --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=62853 --metrics-logging=true --relay=true
2026-03-16 12:37:03.739 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.185.125 waku 083a509a1b59c9c60d2a350b2f7b1ae9b96ed481024debf0768ba116fc6c75a4
2026-03-16 12:37:03.771 ERROR [src.node.docker_mananger] Max retries reached for container 555ecbf52ec9. Exiting log stream.
2026-03-16 12:37:03.773 DEBUG [src.node.docker_mananger] Container started with ID 083a509a1b59. Setting up logs at ./log/docker/node1_2026-03-16_12-37-03__433f9e06-e3e3-4d79-82c2-f89b65a546a1__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-16 12:37:03.774 DEBUG [src.node.waku_node] Started container from image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0. REST: 62849
2026-03-16 12:37:03.774 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 12:37:04.325 ERROR [src.node.docker_mananger] Max retries reached for container c109f63d6535. Exiting log stream.
2026-03-16 12:37:04.775 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:62849/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:04.777 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 12:37:04.778 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 12:37:04.778 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:62849/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:04.780 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.185.125/tcp/62850/p2p/16Uiu2HAmP75yMXLvEhCgPjRyLzDJWbPWDU3UFAWyM6ht8q84Rp5V","/ip4/172.18.185.125/tcp/62851/ws/p2p/16Uiu2HAmP75yMXLvEhCgPjRyLzDJWbPWDU3UFAWyM6ht8q84Rp5V"],"enrUri":"enr:-L24QINy1FxfP0ani6QgJARJUvFKzXEiDJSfHGQgoHbNpcryAhLgpYPBdyEHqkCDAw7IvsofV1RC0ViMPmHtETz_ecYCgmlkgnY0gmlwhKwSuX2KbXVsdGlhZGRyc5YACASsErl9BvWCAAoErBK5fQb1g90DgnJzhQADAQAAiXNlY3AyNTZrMaEDm0RTr35CHir86M_is5jCW-wxhU7SgjW6sVv-fAzhiXCDdGNwgvWCg3VkcIL1hIV3YWt1MhM"}'
2026-03-16 12:37:04.780 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 12:37:04.781 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 12:37:04.781 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 12:37:04.782 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 12:37:04.782 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.147.111
2026-03-16 12:37:04.782 DEBUG [src.node.docker_mananger] Generated ports ['7029', '7030', '7031', '7032', '7033']
2026-03-16 12:37:04.783 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 12:37:04.783 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 12:37:04.783 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 12:37:04.783 DEBUG [src.node.docker_mananger] docker run -i -t -p 7029:7029 -p 7030:7030 -p 7031:7031 -p 7032:7032 -p 7033:7033 harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=7031 --rest-port=7029 --tcp-port=7030 --discv5-udp-port=7032 --rest-address=0.0.0.0 --nat=extip:172.18.147.111 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=e9d52cbd6b24c87d0ec7b08eb8d3d13feeabfebbecd239dccb73c4d88cda6f2f --store-sync=true --store=true --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=7033 --metrics-logging=true --relay=true --storenode=/ip4/172.18.185.125/tcp/62850/p2p/16Uiu2HAmP75yMXLvEhCgPjRyLzDJWbPWDU3UFAWyM6ht8q84Rp5V --discv5-bootstrap-node=enr:-L24QINy1FxfP0ani6QgJARJUvFKzXEiDJSfHGQgoHbNpcryAhLgpYPBdyEHqkCDAw7IvsofV1RC0ViMPmHtETz_ecYCgmlkgnY0gmlwhKwSuX2KbXVsdGlhZGRyc5YACASsErl9BvWCAAoErBK5fQb1g90DgnJzhQADAQAAiXNlY3AyNTZrMaEDm0RTr35CHir86M_is5jCW-wxhU7SgjW6sVv-fAzhiXCDdGNwgvWCg3VkcIL1hIV3YWt1MhM
2026-03-16 12:37:04.983 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.147.111 waku 5945ecb55d307476ac08f61795329d9bc920598f3479df25a6712a13b2853c86
2026-03-16 12:37:05.022 DEBUG [src.node.docker_mananger] Container started with ID 5945ecb55d30. Setting up logs at ./log/docker/node2_2026-03-16_12-37-03__433f9e06-e3e3-4d79-82c2-f89b65a546a1__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-16 12:37:05.023 DEBUG [src.node.waku_node] Started container from image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0. REST: 7029
2026-03-16 12:37:05.023 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 12:37:06.023 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:7029/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:06.026 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 12:37:06.027 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 12:37:06.027 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:7029/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:06.029 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.147.111/tcp/7030/p2p/16Uiu2HAky1XQuaLcGXPyeCE5F9yZuNiRwoDjJLb8s49oKZ9uoQ55","/ip4/172.18.147.111/tcp/7031/ws/p2p/16Uiu2HAky1XQuaLcGXPyeCE5F9yZuNiRwoDjJLb8s49oKZ9uoQ55"],"enrUri":"enr:-L24QE2rE6fHM6JdYtZOAM7XeN9v-Ok6SnhWwqajGSKc-vv-NR97RwEe9_SuicqJXVStHcjkF1-vFu1Kr50FJQt5Nl8CgmlkgnY0gmlwhKwSk2-KbXVsdGlhZGRyc5YACASsEpNvBht2AAoErBKTbwYbd90DgnJzhQADAQAAiXNlY3AyNTZrMaECNT8fHZWjxvRYGlF31vJZNX4bKncRvnbdsM7hlqn5JZiDdGNwght2g3VkcIIbeIV3YWt1MhM"}'
2026-03-16 12:37:06.029 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 12:37:06.029 DEBUG [src.node.waku_node] Starting Node...
2026-03-16 12:37:06.029 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-16 12:37:06.031 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-16 12:37:06.031 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.101.99
2026-03-16 12:37:06.031 DEBUG [src.node.docker_mananger] Generated ports ['58524', '58525', '58526', '58527', '58528']
2026-03-16 12:37:06.031 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-16 12:37:06.031 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-16 12:37:06.031 DEBUG [src.node.waku_node] Using volumes []
2026-03-16 12:37:06.031 DEBUG [src.node.docker_mananger] docker run -i -t -p 58524:58524 -p 58525:58525 -p 58526:58526 -p 58527:58527 -p 58528:58528 harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=58526 --rest-port=58524 --tcp-port=58525 --discv5-udp-port=58527 --rest-address=0.0.0.0 --nat=extip:172.18.101.99 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=23dba42bb9d9dd7c3c663caa1bd680d5210baad257b7b3d3d2ac3e7e8acd6fec --store-sync=true --store=false --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=58528 --metrics-logging=true --relay=false --storenode=/ip4/172.18.147.111/tcp/7030/p2p/16Uiu2HAky1XQuaLcGXPyeCE5F9yZuNiRwoDjJLb8s49oKZ9uoQ55 --discv5-bootstrap-node=enr:-L24QE2rE6fHM6JdYtZOAM7XeN9v-Ok6SnhWwqajGSKc-vv-NR97RwEe9_SuicqJXVStHcjkF1-vFu1Kr50FJQt5Nl8CgmlkgnY0gmlwhKwSk2-KbXVsdGlhZGRyc5YACASsEpNvBht2AAoErBKTbwYbd90DgnJzhQADAQAAiXNlY3AyNTZrMaECNT8fHZWjxvRYGlF31vJZNX4bKncRvnbdsM7hlqn5JZiDdGNwght2g3VkcIIbeIV3YWt1MhM
2026-03-16 12:37:06.233 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.101.99 waku a270129c1af722762c46f7f25e75a1a0568308ead51fa08e82a340506555c081
2026-03-16 12:37:06.270 DEBUG [src.node.docker_mananger] Container started with ID a270129c1af7. Setting up logs at ./log/docker/node3_2026-03-16_12-37-03__433f9e06-e3e3-4d79-82c2-f89b65a546a1__harbor.status.im_wakuorg_nwaku:v0.38.0-rc.0.log
2026-03-16 12:37:06.270 DEBUG [src.node.waku_node] Started container from image harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0. REST: 58524
2026-03-16 12:37:06.270 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-16 12:37:07.270 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:58524/health" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:07.273 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-16 12:37:07.274 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-16 12:37:07.274 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:58524/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:07.276 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.101.99/tcp/58525/p2p/16Uiu2HAmHnBEivA5vSwxEDxRbFexRKpt6fQDzzV5uPorwpyUoikF","/ip4/172.18.101.99/tcp/58526/ws/p2p/16Uiu2HAmHnBEivA5vSwxEDxRbFexRKpt6fQDzzV5uPorwpyUoikF"],"enrUri":"enr:-L24QHVW83zFwBMGp_7PrLVRAFbGZ8-SjyPCkpeZdkiQcNbNFuN1rUzposejI96B4bbDlFoW8W-UiDzLmPNGYlVq1bQCgmlkgnY0gmlwhKwSZWOKbXVsdGlhZGRyc5YACASsEmVjBuSdAAoErBJlYwbknt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDTCHPXcMaVzlHDamekzdTfFBLomaQrSnPo-1RDbn7hTCDdGNwguSdg3VkcILkn4V3YWt1MgA"}'
2026-03-16 12:37:07.276 INFO [src.node.waku_node] REST service is ready !!
2026-03-16 12:37:07.277 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:7029/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.185.125/tcp/62850/p2p/16Uiu2HAmP75yMXLvEhCgPjRyLzDJWbPWDU3UFAWyM6ht8q84Rp5V"]'
2026-03-16 12:37:07.280 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:07.280 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:58524/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.147.111/tcp/7030/p2p/16Uiu2HAky1XQuaLcGXPyeCE5F9yZuNiRwoDjJLb8s49oKZ9uoQ55"]'
2026-03-16 12:37:07.312 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:07.313 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62849/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-16 12:37:07.320 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:07.322 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:7029/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2026-03-16 12:37:07.327 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:07.329 DEBUG [src.steps.store] Relaying message
2026-03-16 12:37:07.329 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62849/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:07.335 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:07.336 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 12:37:07.346 DEBUG [src.steps.store] Relaying message
2026-03-16 12:37:07.347 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62849/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:07.352 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:07.353 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 12:37:07.363 DEBUG [src.steps.store] Relaying message
2026-03-16 12:37:07.363 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62849/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:07.369 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:07.370 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 12:37:07.381 DEBUG [src.steps.store] Relaying message
2026-03-16 12:37:07.381 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62849/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:07.386 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:07.386 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 12:37:07.397 DEBUG [src.steps.store] Relaying message
2026-03-16 12:37:07.398 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62849/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:07.403 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:07.403 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 12:37:07.414 DEBUG [src.steps.store] Relaying message
2026-03-16 12:37:07.414 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62849/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:07.420 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:07.420 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 12:37:07.431 DEBUG [src.steps.store] Relaying message
2026-03-16 12:37:07.431 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62849/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:07.436 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:07.437 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 12:37:07.447 DEBUG [src.steps.store] Relaying message
2026-03-16 12:37:07.448 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62849/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:07.453 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:07.453 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 12:37:07.464 DEBUG [src.steps.store] Relaying message
2026-03-16 12:37:07.464 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62849/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:07.469 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:07.470 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 12:37:07.480 DEBUG [src.steps.store] Relaying message
2026-03-16 12:37:07.481 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:62849/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:07.486 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:07.486 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 12:37:07.497 DEBUG [src.steps.store] Relaying message
2026-03-16 12:37:07.497 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:7029/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:07.502 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:07.502 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 12:37:07.513 DEBUG [src.steps.store] Relaying message
2026-03-16 12:37:07.513 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:7029/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:07.518 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:07.519 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 12:37:07.529 DEBUG [src.steps.store] Relaying message
2026-03-16 12:37:07.530 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:7029/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:07.534 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:07.535 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 12:37:07.545 DEBUG [src.steps.store] Relaying message
2026-03-16 12:37:07.546 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:7029/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:07.551 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:07.551 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 12:37:07.562 DEBUG [src.steps.store] Relaying message
2026-03-16 12:37:07.562 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:7029/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:07.568 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:07.568 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 12:37:07.579 DEBUG [src.steps.store] Relaying message
2026-03-16 12:37:07.579 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:7029/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:07.584 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:07.584 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 12:37:07.595 DEBUG [src.steps.store] Relaying message
2026-03-16 12:37:07.595 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:7029/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:07.600 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:07.601 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 12:37:07.612 DEBUG [src.steps.store] Relaying message
2026-03-16 12:37:07.612 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:7029/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:07.617 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:07.618 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 12:37:07.628 DEBUG [src.steps.store] Relaying message
2026-03-16 12:37:07.629 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:7029/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:07.634 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:07.635 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 12:37:07.646 DEBUG [src.steps.store] Relaying message
2026-03-16 12:37:07.646 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:7029/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-16 12:37:07.651 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-16 12:37:07.651 DEBUG [src.libs.common] Sleeping for 0.01 seconds
2026-03-16 12:37:07.662 DEBUG [src.steps.store] Checking that peer harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the stored messages
2026-03-16 12:37:07.662 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:62849/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:07.665 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x737b02ae373cab1a1d22896622cf83c9f9c2511399b0da3418bc19ada6939e61"},{"messageHash":"0x626eb1ede7d7f8499fa036829950a15f2c371d056d70fad3bfa353b751deeb08"},{"messageHash":"0x22f3adaf0e5e97aeaea5ace3e706000e1c30f081cded5f3826d95f70992f1991"},{"messageHash":"0x097d60719458344fba0d50bbbe960260152ab448f3c8f0db3b6b364fdb09ed61"},{"messageHash":"0x34c2147b6f2a406b084022bb54007b3b7218b9abee6c05146ee9605e7e38a3e3"},{"messageHash":"0x5a21c9d4118d79f181ae16b96d802ec515e3b697217ed794dd7932c47c34edf7"},{"messageHash":"0xd5366396e28249d9f18aba76f925c450dcec3c400b7ac5298c5bf202ca011a62"},{"messageHash":"0x0b77a640fe401465c1bdc2cdaae073dbca69404b406c024c84a19a6b40d1ee9f"},{"messageHash":"0xdf5a81575b6984cd99843587496ed29f4faf53b8a2e6b2c132d2d62d1c0cc89c"},{"messageHash":"0xaed2fce1907f0595f763da6051684d460107afe8bbaf1cb8a9b15e1a82b78b13"},{"messageHash":"0x46af640784b7bdff27e430358ea7692e619fca7d771f2612d2c82633a28ce518"},{"messageHash":"0x97b96ef752488cf3f4267a5318e1ad9a8693e98f707e3651aa76c6a32c8517cb"},{"messageHash":"0xce6a4c129d36421f7e66bea0c11daa719bb04a586583b1f6730bcabad4077d60"},{"messageHash":"0x67b198dfd334b74d32b70e362e4dac47fdfc9a7d6b7679bc2c751440b1acdd0f"},{"messageHash":"0x2c1597bfacffc8db7b939a21a0df22fec54c31d0bfbb1a6ce44f2b2af0733e27"},{"messageHash":"0x83f237e63d4730cb48be64ccefd087ccd9157093bbd45def311e8f370ab56fbc"},{"messageHash":"0x15451da84b91bf3872192c3614cb3007f97cd3e5020328674230e167dec541a2"},{"messageHash":"0x20dca7f7d5c3703fb2e6294a0fecb32edf8e977858a8b8dc9acec01d026ca933"},{"messageHash":"0xf69301f55d087a4a42028fb8a5906614e8dc3e11413c3c0ae41b944cad983155"},{"messageHash":"0xec6ceaea66f96018e1594468ea0f7815874a92f9ac0e8b2761d904333a8a47d1"}]}'
2026-03-16 12:37:07.666 DEBUG [src.steps.store] messages length is 20
2026-03-16 12:37:07.668 DEBUG [src.steps.store] Checking that peer harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the stored messages
2026-03-16 12:37:07.668 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:7029/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:07.671 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x737b02ae373cab1a1d22896622cf83c9f9c2511399b0da3418bc19ada6939e61"},{"messageHash":"0x626eb1ede7d7f8499fa036829950a15f2c371d056d70fad3bfa353b751deeb08"},{"messageHash":"0x22f3adaf0e5e97aeaea5ace3e706000e1c30f081cded5f3826d95f70992f1991"},{"messageHash":"0x097d60719458344fba0d50bbbe960260152ab448f3c8f0db3b6b364fdb09ed61"},{"messageHash":"0x34c2147b6f2a406b084022bb54007b3b7218b9abee6c05146ee9605e7e38a3e3"},{"messageHash":"0x5a21c9d4118d79f181ae16b96d802ec515e3b697217ed794dd7932c47c34edf7"},{"messageHash":"0xd5366396e28249d9f18aba76f925c450dcec3c400b7ac5298c5bf202ca011a62"},{"messageHash":"0x0b77a640fe401465c1bdc2cdaae073dbca69404b406c024c84a19a6b40d1ee9f"},{"messageHash":"0xdf5a81575b6984cd99843587496ed29f4faf53b8a2e6b2c132d2d62d1c0cc89c"},{"messageHash":"0xaed2fce1907f0595f763da6051684d460107afe8bbaf1cb8a9b15e1a82b78b13"},{"messageHash":"0x46af640784b7bdff27e430358ea7692e619fca7d771f2612d2c82633a28ce518"},{"messageHash":"0x97b96ef752488cf3f4267a5318e1ad9a8693e98f707e3651aa76c6a32c8517cb"},{"messageHash":"0xce6a4c129d36421f7e66bea0c11daa719bb04a586583b1f6730bcabad4077d60"},{"messageHash":"0x67b198dfd334b74d32b70e362e4dac47fdfc9a7d6b7679bc2c751440b1acdd0f"},{"messageHash":"0x2c1597bfacffc8db7b939a21a0df22fec54c31d0bfbb1a6ce44f2b2af0733e27"},{"messageHash":"0x83f237e63d4730cb48be64ccefd087ccd9157093bbd45def311e8f370ab56fbc"},{"messageHash":"0x15451da84b91bf3872192c3614cb3007f97cd3e5020328674230e167dec541a2"},{"messageHash":"0x20dca7f7d5c3703fb2e6294a0fecb32edf8e977858a8b8dc9acec01d026ca933"},{"messageHash":"0xf69301f55d087a4a42028fb8a5906614e8dc3e11413c3c0ae41b944cad983155"},{"messageHash":"0xec6ceaea66f96018e1594468ea0f7815874a92f9ac0e8b2761d904333a8a47d1"}]}'
2026-03-16 12:37:07.671 DEBUG [src.steps.store] messages length is 20
2026-03-16 12:37:07.674 DEBUG [src.steps.store] Checking that peer harbor.status.im/wakuorg/nwaku:v0.38.0-rc.0 can find the stored messages
2026-03-16 12:37:07.674 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:58524/store/v3/messages?pubsubTopic=%2Fwaku%2F2%2Frs%2F3%2F0&pageSize=100&ascending=true" -H "Content-Type: application/json" -d 'None'
2026-03-16 12:37:07.683 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"ebb7e413978bad1df670","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x737b02ae373cab1a1d22896622cf83c9f9c2511399b0da3418bc19ada6939e61"},{"messageHash":"0x626eb1ede7d7f8499fa036829950a15f2c371d056d70fad3bfa353b751deeb08"},{"messageHash":"0x22f3adaf0e5e97aeaea5ace3e706000e1c30f081cded5f3826d95f70992f1991"},{"messageHash":"0x097d60719458344fba0d50bbbe960260152ab448f3c8f0db3b6b364fdb09ed61"},{"messageHash":"0x34c2147b6f2a406b084022bb54007b3b7218b9abee6c05146ee9605e7e38a3e3"},{"messageHash":"0x5a21c9d4118d79f181ae16b96d802ec515e3b697217ed794dd7932c47c34edf7"},{"messageHash":"0xd5366396e28249d9f18aba76f925c450dcec3c400b7ac5298c5bf202ca011a62"},{"messageHash":"0x0b77a640fe401465c1bdc2cdaae073dbca69404b406c024c84a19a6b40d1ee9f"},{"messageHash":"0xdf5a81575b6984cd99843587496ed29f4faf53b8a2e6b2c132d2d62d1c0cc89c"},{"messageHash":"0xaed2fce1907f0595f763da6051684d460107afe8bbaf1cb8a9b15e1a82b78b13"},{"messageHash":"0x46af640784b7bdff27e430358ea7692e619fca7d771f2612d2c82633a28ce518"},{"messageHash":"0x97b96ef752488cf3f4267a5318e1ad9a8693e98f707e3651aa76c6a32c8517cb"},{"messageHash":"0xce6a4c129d36421f7e66bea0c11daa719bb04a586583b1f6730bcabad4077d60"},{"messageHash":"0x67b198dfd334b74d32b70e362e4dac47fdfc9a7d6b7679bc2c751440b1acdd0f"},{"messageHash":"0x2c1597bfacffc8db7b939a21a0df22fec54c31d0bfbb1a6ce44f2b2af0733e27"},{"messageHash":"0x83f237e63d4730cb48be64ccefd087ccd9157093bbd45def311e8f370ab56fbc"},{"messageHash":"0x15451da84b91bf3872192c3614cb3007f97cd3e5020328674230e167dec541a2"},{"messageHash":"0x20dca7f7d5c3703fb2e6294a0fecb32edf8e977858a8b8dc9acec01d026ca933"},{"messageHash":"0xf69301f55d087a4a42028fb8a5906614e8dc3e11413c3c0ae41b944cad983155"},{"messageHash":"0xec6ceaea66f96018e1594468ea0f7815874a92f9ac0e8b2761d904333a8a47d1"}]}'
2026-03-16 12:37:07.683 DEBUG [src.steps.store] messages length is 20
2026-03-16 12:37:07.687 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-16 12:37:07.688 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-16 12:37:07.688 DEBUG [src.node.waku_node] Stopping container with id 083a509a1b59
2026-03-16 12:37:08.267 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 12:37:08.268 DEBUG [src.node.waku_node] Stopping container with id 5945ecb55d30
2026-03-16 12:37:08.851 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 12:37:08.853 DEBUG [src.node.waku_node] Stopping container with id a270129c1af7
2026-03-16 12:37:09.082 ERROR [src.node.docker_mananger] Max retries reached for container 083a509a1b59. Exiting log stream.
2026-03-16 12:37:09.431 DEBUG [src.node.waku_node] Container stopped.
2026-03-16 12:37:09.433 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-16 12:37:09.443 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 12:37:09.468 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-16 12:37:09.472 DEBUG [src.node.docker_mananger] No errors found in the waku logs.