2025-12-10 04:17:09.216 DEBUG [tests.conftest] Running fixture setup: test_id
2025-12-10 04:17:09.216 DEBUG [tests.conftest] Running test: test_store_with_multiple_content_topics with id: 2025-12-10_04-17-09__da7c34d4-578d-465a-b9ea-903ee7b07ad2
2025-12-10 04:17:09.217 DEBUG [src.steps.common] Running fixture setup: common_setup
2025-12-10 04:17:09.217 DEBUG [src.steps.store] Running fixture setup: store_setup
2025-12-10 04:17:09.217 DEBUG [src.steps.store] Running fixture setup: node_setup
2025-12-10 04:17:09.223 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2025-12-10 04:17:09.223 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/publishing_node1_2025-12-10_04-17-09__da7c34d4-578d-465a-b9ea-903ee7b07ad2__wakuorg_nwaku:latest.log
2025-12-10 04:17:09.223 DEBUG [src.node.waku_node] Starting Node...
2025-12-10 04:17:09.223 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2025-12-10 04:17:09.225 DEBUG [src.node.docker_mananger] Network waku already exists
2025-12-10 04:17:09.225 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.83.234
2025-12-10 04:17:09.225 DEBUG [src.node.docker_mananger] Generated ports ['11887', '11888', '11889', '11890', '11891']
2025-12-10 04:17:09.225 DEBUG [src.node.waku_node] RLN credentials were not set
2025-12-10 04:17:09.225 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2025-12-10 04:17:09.225 DEBUG [src.node.waku_node] Using volumes []
2025-12-10 04:17:09.226 DEBUG [src.node.docker_mananger] docker run -i -t -p 11887:11887 -p 11888:11888 -p 11889:11889 -p 11890:11890 -p 11891:11891 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=11889 --rest-port=11887 --tcp-port=11888 --discv5-udp-port=11890 --rest-address=0.0.0.0 --nat=extip:172.18.83.234 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=e1e8fa62ede68cda6a71df4f85dc4ff40ea47b7bc2bb6383394f4cc6d0939c1a --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=11891 --metrics-logging=true --store=true --relay=true
2025-12-10 04:17:09.384 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.83.234 waku cd8c0ba2e76e3031562935ff83116d8543a22af91fb9197c0bd3322f0ff323a2
2025-12-10 04:17:09.409 DEBUG [src.node.docker_mananger] Container started with ID cd8c0ba2e76e. Setting up logs at ./log/docker/publishing_node1_2025-12-10_04-17-09__da7c34d4-578d-465a-b9ea-903ee7b07ad2__wakuorg_nwaku:latest.log
2025-12-10 04:17:09.410 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 11887
2025-12-10 04:17:09.411 DEBUG [src.libs.common] Sleeping for 1 seconds
2025-12-10 04:17:09.512 ERROR [src.node.docker_mananger] Max retries reached for container 578de3ac43d8. Exiting log stream.
2025-12-10 04:17:10.013 ERROR [src.node.docker_mananger] Max retries reached for container 6ef17a5a08fb. Exiting log stream.
2025-12-10 04:17:10.412 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11887/health" -H "Content-Type: application/json" -d 'None'
2025-12-10 04:17:10.415 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2025-12-10 04:17:10.416 INFO [src.node.waku_node] Node protocols are initialized !!
2025-12-10 04:17:10.416 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11887/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2025-12-10 04:17:10.418 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.83.234/tcp/11888/p2p/16Uiu2HAm8W3Es8pZK1pne9BMVkwJU4gMq6Zea21uf2ZYSaMRvngo","/ip4/172.18.83.234/tcp/11889/ws/p2p/16Uiu2HAm8W3Es8pZK1pne9BMVkwJU4gMq6Zea21uf2ZYSaMRvngo"],"enrUri":"enr:-L24QF2EpWRdhJhKsm3iPXqw5ubQofkaAm9y5aVRqypl13xxD0hA7FG4AJ6YSiJIrWNLxkIbGwv0-tkTf-4KDuX9hBcCgmlkgnY0gmlwhKwSU-qKbXVsdGlhZGRyc5YACASsElPqBi5wAAoErBJT6gYucd0DgnJzhQADAQAAiXNlY3AyNTZrMaECwkZKuFuGurVJY0aG2AE2Oo7JVlXx8o-UA3mgnKE9dGCDdGNwgi5wg3VkcIIucoV3YWt1MgM"}'
2025-12-10 04:17:10.418 INFO [src.node.waku_node] REST service is ready !!
2025-12-10 04:17:10.424 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2025-12-10 04:17:10.424 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/store_node1_2025-12-10_04-17-09__da7c34d4-578d-465a-b9ea-903ee7b07ad2__wakuorg_nwaku:latest.log
2025-12-10 04:17:10.424 DEBUG [src.node.waku_node] Starting Node...
2025-12-10 04:17:10.425 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2025-12-10 04:17:10.426 DEBUG [src.node.docker_mananger] Network waku already exists
2025-12-10 04:17:10.426 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.107.139
2025-12-10 04:17:10.426 DEBUG [src.node.docker_mananger] Generated ports ['35506', '35507', '35508', '35509', '35510']
2025-12-10 04:17:10.426 DEBUG [src.node.waku_node] RLN credentials were not set
2025-12-10 04:17:10.426 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2025-12-10 04:17:10.426 DEBUG [src.node.waku_node] Using volumes []
2025-12-10 04:17:10.427 DEBUG [src.node.docker_mananger] docker run -i -t -p 35506:35506 -p 35507:35507 -p 35508:35508 -p 35509:35509 -p 35510:35510 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=35508 --rest-port=35506 --tcp-port=35507 --discv5-udp-port=35509 --rest-address=0.0.0.0 --nat=extip:172.18.107.139 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=41fa4b8c66353c1aa97fef4c57f355bc1f3c8d72cf49c98adc59baadb6dc2fd7 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=35510 --metrics-logging=true --discv5-bootstrap-node=enr:-L24QF2EpWRdhJhKsm3iPXqw5ubQofkaAm9y5aVRqypl13xxD0hA7FG4AJ6YSiJIrWNLxkIbGwv0-tkTf-4KDuX9hBcCgmlkgnY0gmlwhKwSU-qKbXVsdGlhZGRyc5YACASsElPqBi5wAAoErBJT6gYucd0DgnJzhQADAQAAiXNlY3AyNTZrMaECwkZKuFuGurVJY0aG2AE2Oo7JVlXx8o-UA3mgnKE9dGCDdGNwgi5wg3VkcIIucoV3YWt1MgM --storenode=/ip4/172.18.83.234/tcp/11888/p2p/16Uiu2HAm8W3Es8pZK1pne9BMVkwJU4gMq6Zea21uf2ZYSaMRvngo --store=true --relay=true
2025-12-10 04:17:10.594 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.107.139 waku ee0e85d6415bd8ae63f24866a19d9bfa70920f74b5893148a758b5aaf896bf3e
2025-12-10 04:17:10.620 DEBUG [src.node.docker_mananger] Container started with ID ee0e85d6415b. Setting up logs at ./log/docker/store_node1_2025-12-10_04-17-09__da7c34d4-578d-465a-b9ea-903ee7b07ad2__wakuorg_nwaku:latest.log
2025-12-10 04:17:10.621 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 35506
2025-12-10 04:17:10.621 DEBUG [src.libs.common] Sleeping for 1 seconds
2025-12-10 04:17:11.621 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35506/health" -H "Content-Type: application/json" -d 'None'
2025-12-10 04:17:11.625 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","protocolsHealth":[{"Relay":"READY"},{"Rln Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"READY"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"READY"},{"Legacy Store Client":"READY"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"}]}'
2025-12-10 04:17:11.626 INFO [src.node.waku_node] Node protocols are initialized !!
2025-12-10 04:17:11.626 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35506/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2025-12-10 04:17:11.628 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.107.139/tcp/35507/p2p/16Uiu2HAmHKZtq1xPA9WHF5FSJkoNf6ZQv8UtnWVGhiX9vvRv5DyP","/ip4/172.18.107.139/tcp/35508/ws/p2p/16Uiu2HAmHKZtq1xPA9WHF5FSJkoNf6ZQv8UtnWVGhiX9vvRv5DyP"],"enrUri":"enr:-L24QFYPHu7PNOynVH-QmFeeads-aphIGhE1sU-ZCRj6O3sqUMIKqyYGRwh9woVB_OJKj2kgzcAe4NyZwmtUGTVe7VcCgmlkgnY0gmlwhKwSa4uKbXVsdGlhZGRyc5YACASsEmuLBoqzAAoErBJriwaKtN0DgnJzhQADAQAAiXNlY3AyNTZrMaEDRVC_G5jeWkHHBlpNMkxibTYHEEv4Wf-vlst7dpHLriaDdGNwgoqzg3VkcIKKtYV3YWt1MgM"}'
2025-12-10 04:17:11.628 INFO [src.node.waku_node] REST service is ready !!
2025-12-10 04:17:11.628 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35506/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.83.234/tcp/11888/p2p/16Uiu2HAm8W3Es8pZK1pne9BMVkwJU4gMq6Zea21uf2ZYSaMRvngo"]'
2025-12-10 04:17:11.631 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-10 04:17:11.631 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:11887/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2025-12-10 04:17:11.634 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-10 04:17:11.634 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35506/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/0"]'
2025-12-10 04:17:11.636 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-10 04:17:11.636 DEBUG [src.steps.store] Relaying message
2025-12-10 04:17:11.636 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:11887/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2025-12-10 04:17:11.641 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-10 04:17:11.641 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2025-12-10 04:17:11.842 DEBUG [src.steps.store] Relaying message
2025-12-10 04:17:11.843 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:11887/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/waku/2/content/test.js", "timestamp": '$(date +%s%N)'}'
2025-12-10 04:17:11.848 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-10 04:17:11.848 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2025-12-10 04:17:12.049 DEBUG [src.steps.store] Relaying message
2025-12-10 04:17:12.049 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:11887/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/app/22/sometopic/someencoding", "timestamp": '$(date +%s%N)'}'
2025-12-10 04:17:12.054 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-10 04:17:12.055 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2025-12-10 04:17:12.255 DEBUG [src.steps.store] Relaying message
2025-12-10 04:17:12.256 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:11887/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/toychat/2/huilong/proto", "timestamp": '$(date +%s%N)'}'
2025-12-10 04:17:12.262 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-10 04:17:12.262 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2025-12-10 04:17:12.463 DEBUG [src.steps.store] Relaying message
2025-12-10 04:17:12.463 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:11887/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/statusim/1/community/cbor", "timestamp": '$(date +%s%N)'}'
2025-12-10 04:17:12.469 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-10 04:17:12.469 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2025-12-10 04:17:12.670 DEBUG [src.steps.store] Relaying message
2025-12-10 04:17:12.670 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:11887/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/app/27/sometopic/someencoding", "timestamp": '$(date +%s%N)'}'
2025-12-10 04:17:12.675 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-10 04:17:12.676 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2025-12-10 04:17:12.876 DEBUG [src.steps.store] Relaying message
2025-12-10 04:17:12.877 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:11887/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/app/29/sometopic/someencoding", "timestamp": '$(date +%s%N)'}'
2025-12-10 04:17:12.882 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-10 04:17:12.882 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2025-12-10 04:17:13.083 DEBUG [src.steps.store] Relaying message
2025-12-10 04:17:13.083 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:11887/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F0" -H "Content-Type: application/json" -d '{"payload": "U3RvcmUgd29ya3MhIQ==", "contentTopic": "/app/20/sometopic/someencoding", "timestamp": '$(date +%s%N)'}'
2025-12-10 04:17:13.088 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2025-12-10 04:17:13.089 DEBUG [src.libs.common] Sleeping for 0.2 seconds
2025-12-10 04:17:13.290 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:11887/store/v3/messages?contentTopics=%2Fmyapp%2F1%2Flatest%2Fproto%2C%2Fstatusim%2F1%2Fcommunity%2Fcbor&pageSize=20&ascending=true" -H "Content-Type: application/json" -d 'None'
2025-12-10 04:17:13.294 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x7e6bdbc39d0e8ffd83014909d61ccc405617fe09d9b12fbf9bce9d1e620f66c4"},{"messageHash":"0x2811ed59afb145d7dfbd78c6b5e9e0533a369a33cc5532a368021d510bce235a"}]}'
2025-12-10 04:17:13.294 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35506/store/v3/messages?contentTopics=%2Fmyapp%2F1%2Flatest%2Fproto%2C%2Fstatusim%2F1%2Fcommunity%2Fcbor&pageSize=20&ascending=true" -H "Content-Type: application/json" -d 'None'
2025-12-10 04:17:13.297 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"","statusCode":200,"statusDesc":"OK","messages":[{"messageHash":"0x7e6bdbc39d0e8ffd83014909d61ccc405617fe09d9b12fbf9bce9d1e620f66c4"},{"messageHash":"0x2811ed59afb145d7dfbd78c6b5e9e0533a369a33cc5532a368021d510bce235a"}]}'
2025-12-10 04:17:13.299 DEBUG [tests.conftest] Running fixture teardown: test_setup
2025-12-10 04:17:13.300 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2025-12-10 04:17:13.300 DEBUG [src.node.waku_node] Stopping container with id cd8c0ba2e76e
2025-12-10 04:17:13.832 DEBUG [src.node.waku_node] Container stopped.
2025-12-10 04:17:13.832 DEBUG [src.node.waku_node] Stopping container with id ee0e85d6415b
2025-12-10 04:17:14.309 DEBUG [src.node.waku_node] Container stopped.
2025-12-10 04:17:14.310 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2025-12-10 04:17:14.317 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2025-12-10 04:17:14.323 DEBUG [src.node.docker_mananger] No errors found in the waku logs.