199 lines
35 KiB
Plaintext

2026-04-23 22:00:48.669 DEBUG [tests.conftest] Running fixture setup: test_id
2026-04-23 22:00:48.671 DEBUG [tests.conftest] Running test: test_2_nodes_different_content_topic_different_shard with id: 2026-04-23_22-00-48__77e21055-0ee5-47e4-a600-04eb1c8fde0b
2026-04-23 22:00:48.672 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-04-23 22:00:48.672 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-04-23 22:00:48.672 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-04-23 22:00:48.685 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 22:00:48.685 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-04-23_22-00-48__77e21055-0ee5-47e4-a600-04eb1c8fde0b__wakuorg_nwaku:latest.log
2026-04-23 22:00:48.685 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 22:00:48.685 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 22:00:48.686 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 22:00:48.687 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.91.249
2026-04-23 22:00:48.687 DEBUG [src.node.docker_mananger] Generated ports ['48520', '48521', '48522', '48523', '48524']
2026-04-23 22:00:48.687 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 22:00:48.687 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 22:00:48.687 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 22:00:48.687 DEBUG [src.node.docker_mananger] docker run -i -t -p 48520:48520 -p 48521:48521 -p 48522:48522 -p 48523:48523 -p 48524:48524 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=48522 --rest-port=48520 --tcp-port=48521 --discv5-udp-port=48523 --rest-address=0.0.0.0 --nat=extip:172.18.91.249 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=75bd5cefecc7d6aabe96bf5a1cb33caedec52bc07cfc87dedd315cda102f7abb --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=48524 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto
2026-04-23 22:00:48.872 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.91.249 waku 15de395339e6698cce6ab4c93ae9cc14226612abe9d17ee77ab7272d3dde0e68
2026-04-23 22:00:48.910 DEBUG [src.node.docker_mananger] Container started with ID 15de395339e6. Setting up logs at ./log/docker/node1_2026-04-23_22-00-48__77e21055-0ee5-47e4-a600-04eb1c8fde0b__wakuorg_nwaku:latest.log
2026-04-23 22:00:48.910 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 48520
2026-04-23 22:00:48.910 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 22:00:49.043 ERROR [src.node.docker_mananger] Max retries reached for container eff369495eae. Exiting log stream.
2026-04-23 22:00:49.499 ERROR [src.node.docker_mananger] Max retries reached for container 270abbb55c6c. Exiting log stream.
2026-04-23 22:00:49.911 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:48520/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:00:49.913 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 22:00:49.914 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 22:00:49.914 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:48520/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:00:49.916 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.91.249/tcp/48521/p2p/16Uiu2HAm8GknQsD3idb9LnnmDrM7NpQB8xBofJYCURB44QqemQ3c","/ip4/172.18.91.249/tcp/48522/ws/p2p/16Uiu2HAm8GknQsD3idb9LnnmDrM7NpQB8xBofJYCURB44QqemQ3c"],"enrUri":"enr:-L24QNccOIOaf-627eUFkIuEBseRGObBsZn6awcaLEmiutGXcA73j2xDXH_G-m0Spm2RNddWB6D6Gra6VeVGlZUJQ9sCgmlkgnY0gmlwhKwSW_mKbXVsdGlhZGRyc5YACASsElv5Br2JAAoErBJb-Qa9it0DgnJzhQDHAQAAiXNlY3AyNTZrMaECvt8iaD_sWLPDFcxMHXGgRwijyk974gfItNF_yYxXPUODdGNwgr2Jg3VkcIK9i4V3YWt1MgU"}'
2026-04-23 22:00:49.916 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 22:00:49.923 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 22:00:49.923 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-04-23_22-00-48__77e21055-0ee5-47e4-a600-04eb1c8fde0b__wakuorg_nwaku:latest.log
2026-04-23 22:00:49.923 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 22:00:49.923 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 22:00:49.925 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 22:00:49.925 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.164.83
2026-04-23 22:00:49.925 DEBUG [src.node.docker_mananger] Generated ports ['10283', '10284', '10285', '10286', '10287']
2026-04-23 22:00:49.925 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 22:00:49.925 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 22:00:49.925 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 22:00:49.926 DEBUG [src.node.docker_mananger] docker run -i -t -p 10283:10283 -p 10284:10284 -p 10285:10285 -p 10286:10286 -p 10287:10287 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=10285 --rest-port=10283 --tcp-port=10284 --discv5-udp-port=10286 --rest-address=0.0.0.0 --nat=extip:172.18.164.83 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=adb67f9c8ae5a60beb00ab2e836314d1b11ac5ed144c5af4aab96a5bf8f09777 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=10287 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QNccOIOaf-627eUFkIuEBseRGObBsZn6awcaLEmiutGXcA73j2xDXH_G-m0Spm2RNddWB6D6Gra6VeVGlZUJQ9sCgmlkgnY0gmlwhKwSW_mKbXVsdGlhZGRyc5YACASsElv5Br2JAAoErBJb-Qa9it0DgnJzhQDHAQAAiXNlY3AyNTZrMaECvt8iaD_sWLPDFcxMHXGgRwijyk974gfItNF_yYxXPUODdGNwgr2Jg3VkcIK9i4V3YWt1MgU --content-topic=/waku/2/content/test.js
2026-04-23 22:00:50.113 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.164.83 waku 9366b5e79208b134d57b2217b4ad0a3e59e97ae1944da9c2b9e003c1a3b1f96c
2026-04-23 22:00:50.148 DEBUG [src.node.docker_mananger] Container started with ID 9366b5e79208. Setting up logs at ./log/docker/node2_2026-04-23_22-00-48__77e21055-0ee5-47e4-a600-04eb1c8fde0b__wakuorg_nwaku:latest.log
2026-04-23 22:00:50.149 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 10283
2026-04-23 22:00:50.149 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 22:00:51.149 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10283/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:00:51.158 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 22:00:51.159 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 22:00:51.159 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:10283/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:00:51.163 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.164.83/tcp/10284/p2p/16Uiu2HAmJkAVjGx6SESW31nRwEs7UdF8jDwADBZYMTbWF3M4DeKR","/ip4/172.18.164.83/tcp/10285/ws/p2p/16Uiu2HAmJkAVjGx6SESW31nRwEs7UdF8jDwADBZYMTbWF3M4DeKR"],"enrUri":"enr:-L24QLoGPdXCdxokl3dN_O3pmShNZ42mmCwi5i6bvuST_qbtHHlHfWry6Zg_GH1BvcGNnM25e01roja5QwmtRyYuuIECgmlkgnY0gmlwhKwSpFOKbXVsdGlhZGRyc5YACASsEqRTBigsAAoErBKkUwYoLd0DgnJzhQDHAQAAiXNlY3AyNTZrMaEDWnl_Rrj3bOW8zbSidtBqRpwL0OlswDV8WUg_nfkIJHCDdGNwgigsg3VkcIIoLoV3YWt1MgE"}'
2026-04-23 22:00:51.163 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 22:00:51.163 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:10283/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.91.249/tcp/48521/p2p/16Uiu2HAm8GknQsD3idb9LnnmDrM7NpQB8xBofJYCURB44QqemQ3c"]'
2026-04-23 22:00:51.166 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 22:00:51.166 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:48520/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-04-23 22:00:51.169 ERROR [src.node.api_clients.base_client] HTTP error occurred: 500 Server Error: Internal Server Error for url: http://127.0.0.1:48520/relay/v1/auto/subscriptions. Response content: b'Subscribe failed:Failed to decode subscription event: Static sharding is used, relay subscriptions must specify a pubsub topic'
2026-04-23 22:00:51.237 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-04-23 22:00:51.238 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-04-23 22:00:51.238 DEBUG [src.node.waku_node] Stopping container with id 15de395339e6
2026-04-23 22:00:51.718 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 22:00:51.718 DEBUG [src.node.waku_node] Stopping container with id 9366b5e79208
2026-04-23 22:00:52.154 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 22:00:52.155 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-04-23 22:00:52.161 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 22:00:52.168 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 22:00:52.169 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-04-23 22:00:52.169 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-04-23 22:00:52.169 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-04-23_22-00-48__77e21055-0ee5-47e4-a600-04eb1c8fde0b__wakuorg_nwaku:latest.log
2026-04-23 22:00:52.170 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-04-23_22-00-48__77e21055-0ee5-47e4-a600-04eb1c8fde0b__wakuorg_nwaku:latest.log
2026-04-23 22:00:52.173 DEBUG [tests.conftest] Running fixture setup: test_id
2026-04-23 22:00:52.173 DEBUG [tests.conftest] Running test: test_2_nodes_different_content_topic_different_shard with id: 2026-04-23_22-00-52__ced9d22f-a4f4-446a-a9a4-c076dd204336
2026-04-23 22:00:52.174 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-04-23 22:00:52.174 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-04-23 22:00:52.174 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-04-23 22:00:52.181 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 22:00:52.181 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-04-23_22-00-52__ced9d22f-a4f4-446a-a9a4-c076dd204336__wakuorg_nwaku:latest.log
2026-04-23 22:00:52.181 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 22:00:52.181 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 22:00:52.183 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 22:00:52.183 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.115.32
2026-04-23 22:00:52.183 DEBUG [src.node.docker_mananger] Generated ports ['15923', '15924', '15925', '15926', '15927']
2026-04-23 22:00:52.183 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 22:00:52.183 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 22:00:52.184 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 22:00:52.184 DEBUG [src.node.docker_mananger] docker run -i -t -p 15923:15923 -p 15924:15924 -p 15925:15925 -p 15926:15926 -p 15927:15927 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=15925 --rest-port=15923 --tcp-port=15924 --discv5-udp-port=15926 --rest-address=0.0.0.0 --nat=extip:172.18.115.32 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=b2ce4deabcee0f6eab6851ded99f9bcff40fd7ed90bc3a8ef0e82820d40bfd8f --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=15927 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto
2026-04-23 22:00:52.368 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.115.32 waku 7917d63e11f64d549840d6ee602a3a19e7e78369a70ace4335f12b9abe3869cc
2026-04-23 22:00:52.400 DEBUG [src.node.docker_mananger] Container started with ID 7917d63e11f6. Setting up logs at ./log/docker/node1_2026-04-23_22-00-52__ced9d22f-a4f4-446a-a9a4-c076dd204336__wakuorg_nwaku:latest.log
2026-04-23 22:00:52.401 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 15923
2026-04-23 22:00:52.401 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 22:00:52.534 ERROR [src.node.docker_mananger] Max retries reached for container 15de395339e6. Exiting log stream.
2026-04-23 22:00:52.980 ERROR [src.node.docker_mananger] Max retries reached for container 9366b5e79208. Exiting log stream.
2026-04-23 22:00:53.402 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:15923/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:00:53.405 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 22:00:53.405 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 22:00:53.405 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:15923/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:00:53.408 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.115.32/tcp/15924/p2p/16Uiu2HAmMPWWqgTZV2wU1W958SuasvX7Z5LcCnopJWaac6etiaK2","/ip4/172.18.115.32/tcp/15925/ws/p2p/16Uiu2HAmMPWWqgTZV2wU1W958SuasvX7Z5LcCnopJWaac6etiaK2"],"enrUri":"enr:-L24QObLuTLDfIo6rAibpUxaa79UtxOqBLLQSnWrKF3-KsnLW-kDD6Iqjrt_19OkY_FvBCh6w1Cl3XtyYTGS_RPPfXgCgmlkgnY0gmlwhKwScyCKbXVsdGlhZGRyc5YACASsEnMgBj40AAoErBJzIAY-Nd0DgnJzhQDHAQAAiXNlY3AyNTZrMaEDgcH_JoF5wSpfHZJlhqbI63birQhsmc3kXwcMj58RNjGDdGNwgj40g3VkcII-NoV3YWt1MgU"}'
2026-04-23 22:00:53.408 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 22:00:53.415 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 22:00:53.415 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-04-23_22-00-52__ced9d22f-a4f4-446a-a9a4-c076dd204336__wakuorg_nwaku:latest.log
2026-04-23 22:00:53.415 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 22:00:53.415 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 22:00:53.417 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 22:00:53.417 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.217.71
2026-04-23 22:00:53.417 DEBUG [src.node.docker_mananger] Generated ports ['27361', '27362', '27363', '27364', '27365']
2026-04-23 22:00:53.417 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 22:00:53.417 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 22:00:53.417 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 22:00:53.418 DEBUG [src.node.docker_mananger] docker run -i -t -p 27361:27361 -p 27362:27362 -p 27363:27363 -p 27364:27364 -p 27365:27365 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=27363 --rest-port=27361 --tcp-port=27362 --discv5-udp-port=27364 --rest-address=0.0.0.0 --nat=extip:172.18.217.71 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=d94fceaba4233786761d3ccd8cf1ff3b37bfaca18adb07c46d39ccce60b54ed1 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=27365 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QObLuTLDfIo6rAibpUxaa79UtxOqBLLQSnWrKF3-KsnLW-kDD6Iqjrt_19OkY_FvBCh6w1Cl3XtyYTGS_RPPfXgCgmlkgnY0gmlwhKwScyCKbXVsdGlhZGRyc5YACASsEnMgBj40AAoErBJzIAY-Nd0DgnJzhQDHAQAAiXNlY3AyNTZrMaEDgcH_JoF5wSpfHZJlhqbI63birQhsmc3kXwcMj58RNjGDdGNwgj40g3VkcII-NoV3YWt1MgU --content-topic=/waku/2/content/test.js
2026-04-23 22:00:53.613 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.217.71 waku 89a7633d29b59d5df90ea6716e7766fab1837e746cbf7e58178cb902b472cafc
2026-04-23 22:00:53.651 DEBUG [src.node.docker_mananger] Container started with ID 89a7633d29b5. Setting up logs at ./log/docker/node2_2026-04-23_22-00-52__ced9d22f-a4f4-446a-a9a4-c076dd204336__wakuorg_nwaku:latest.log
2026-04-23 22:00:53.651 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 27361
2026-04-23 22:00:53.652 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 22:00:54.655 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:27361/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:00:54.661 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 22:00:54.662 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 22:00:54.662 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:27361/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:00:54.665 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.217.71/tcp/27362/p2p/16Uiu2HAmJZtLhTTunNVvBJUxBr4s9eS2mJqA8yYXTYYRgspa4G3F","/ip4/172.18.217.71/tcp/27363/ws/p2p/16Uiu2HAmJZtLhTTunNVvBJUxBr4s9eS2mJqA8yYXTYYRgspa4G3F"],"enrUri":"enr:-L24QHaDcOcLDDp21hvQzCSi-Zh8wUJ1LfjPOsyQCXRtdqaLTcW6HLtyivilAtjF3v4TqZg2dt5G6nJQ3y_46l7PKTgCgmlkgnY0gmlwhKwS2UeKbXVsdGlhZGRyc5YACASsEtlHBmriAAoErBLZRwZq490DgnJzhQDHAQAAiXNlY3AyNTZrMaEDV9dr-GhY3PbRVaZPGFMa0uWRnfDSESW875FUUHA714aDdGNwgmrig3VkcIJq5IV3YWt1MgE"}'
2026-04-23 22:00:54.665 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 22:00:54.665 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:27361/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.115.32/tcp/15924/p2p/16Uiu2HAmMPWWqgTZV2wU1W958SuasvX7Z5LcCnopJWaac6etiaK2"]'
2026-04-23 22:00:54.668 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 22:00:54.668 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:15923/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-04-23 22:00:54.671 ERROR [src.node.api_clients.base_client] HTTP error occurred: 500 Server Error: Internal Server Error for url: http://127.0.0.1:15923/relay/v1/auto/subscriptions. Response content: b'Subscribe failed:Failed to decode subscription event: Static sharding is used, relay subscriptions must specify a pubsub topic'
2026-04-23 22:00:54.706 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-04-23 22:00:54.707 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-04-23 22:00:54.707 DEBUG [src.node.waku_node] Stopping container with id 7917d63e11f6
2026-04-23 22:00:55.178 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 22:00:55.181 DEBUG [src.node.waku_node] Stopping container with id 89a7633d29b5
2026-04-23 22:00:55.610 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 22:00:55.611 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-04-23 22:00:55.617 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 22:00:55.624 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 22:00:55.624 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-04-23 22:00:55.625 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-04-23 22:00:55.625 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-04-23_22-00-52__ced9d22f-a4f4-446a-a9a4-c076dd204336__wakuorg_nwaku:latest.log
2026-04-23 22:00:55.626 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-04-23_22-00-52__ced9d22f-a4f4-446a-a9a4-c076dd204336__wakuorg_nwaku:latest.log
2026-04-23 22:00:55.629 DEBUG [tests.conftest] Running fixture setup: test_id
2026-04-23 22:00:55.629 DEBUG [tests.conftest] Running test: test_2_nodes_different_content_topic_different_shard with id: 2026-04-23_22-00-55__2a46471a-24af-4d07-994a-f81ee41aca79
2026-04-23 22:00:55.629 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-04-23 22:00:55.630 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-04-23 22:00:55.630 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-04-23 22:00:55.637 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 22:00:55.637 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-04-23_22-00-55__2a46471a-24af-4d07-994a-f81ee41aca79__wakuorg_nwaku:latest.log
2026-04-23 22:00:55.637 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 22:00:55.637 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 22:00:55.639 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 22:00:55.639 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.203.194
2026-04-23 22:00:55.639 DEBUG [src.node.docker_mananger] Generated ports ['49696', '49697', '49698', '49699', '49700']
2026-04-23 22:00:55.639 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 22:00:55.639 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 22:00:55.640 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 22:00:55.640 DEBUG [src.node.docker_mananger] docker run -i -t -p 49696:49696 -p 49697:49697 -p 49698:49698 -p 49699:49699 -p 49700:49700 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=49698 --rest-port=49696 --tcp-port=49697 --discv5-udp-port=49699 --rest-address=0.0.0.0 --nat=extip:172.18.203.194 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=bd7486bc84daa5295a4cedad2aa30d0a04d9c045eaf6c0de0ae277a65dc2dceb --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=49700 --metrics-logging=true --relay=true --filter=true --content-topic=/myapp/1/latest/proto
2026-04-23 22:00:55.830 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.203.194 waku 6104f2109d2bf070e0b217b4b263cf3d7d6fdcd456f0eb346392ab080a753225
2026-04-23 22:00:55.868 DEBUG [src.node.docker_mananger] Container started with ID 6104f2109d2b. Setting up logs at ./log/docker/node1_2026-04-23_22-00-55__2a46471a-24af-4d07-994a-f81ee41aca79__wakuorg_nwaku:latest.log
2026-04-23 22:00:55.868 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 49696
2026-04-23 22:00:55.868 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 22:00:56.000 ERROR [src.node.docker_mananger] Max retries reached for container 7917d63e11f6. Exiting log stream.
2026-04-23 22:00:56.435 ERROR [src.node.docker_mananger] Max retries reached for container 89a7633d29b5. Exiting log stream.
2026-04-23 22:00:56.870 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:49696/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:00:56.873 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 22:00:56.873 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 22:00:56.873 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:49696/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:00:56.875 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.203.194/tcp/49697/p2p/16Uiu2HAmQLjSJKDXNXRtcMNwS8hciqVdUAWuuzSURWapmr9jZizL","/ip4/172.18.203.194/tcp/49698/ws/p2p/16Uiu2HAmQLjSJKDXNXRtcMNwS8hciqVdUAWuuzSURWapmr9jZizL"],"enrUri":"enr:-L24QCyvpsXTHdz8Ho8oywLjgPdI4rswcq9KxAb_gKO2VunwHRdMQqQIteuP1i0GhNw_iq76ONwbvUuEgoXfxoUmuqACgmlkgnY0gmlwhKwSy8KKbXVsdGlhZGRyc5YACASsEsvCBsIhAAoErBLLwgbCIt0DgnJzhQDHAQAAiXNlY3AyNTZrMaEDrZ7s9-Ziq1hlskxzIY5RgArRny4tf1e7ijlg9YyiS6GDdGNwgsIhg3VkcILCI4V3YWt1MgU"}'
2026-04-23 22:00:56.875 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 22:00:56.882 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-04-23 22:00:56.882 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-04-23_22-00-55__2a46471a-24af-4d07-994a-f81ee41aca79__wakuorg_nwaku:latest.log
2026-04-23 22:00:56.883 DEBUG [src.node.waku_node] Starting Node...
2026-04-23 22:00:56.883 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-04-23 22:00:56.884 DEBUG [src.node.docker_mananger] Network waku already exists
2026-04-23 22:00:56.885 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.23.178
2026-04-23 22:00:56.885 DEBUG [src.node.docker_mananger] Generated ports ['36966', '36967', '36968', '36969', '36970']
2026-04-23 22:00:56.885 DEBUG [src.node.waku_node] RLN credentials were not set
2026-04-23 22:00:56.885 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-04-23 22:00:56.885 DEBUG [src.node.waku_node] Using volumes []
2026-04-23 22:00:56.885 DEBUG [src.node.docker_mananger] docker run -i -t -p 36966:36966 -p 36967:36967 -p 36968:36968 -p 36969:36969 -p 36970:36970 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=36968 --rest-port=36966 --tcp-port=36967 --discv5-udp-port=36969 --rest-address=0.0.0.0 --nat=extip:172.18.23.178 --peer-exchange=true --discv5-discovery=true --cluster-id=199 --nodekey=3c446efec1aded93cbe7dc6a623c0d2095ddbac56ecf7320cfa82aff553edb93 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=36970 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QCyvpsXTHdz8Ho8oywLjgPdI4rswcq9KxAb_gKO2VunwHRdMQqQIteuP1i0GhNw_iq76ONwbvUuEgoXfxoUmuqACgmlkgnY0gmlwhKwSy8KKbXVsdGlhZGRyc5YACASsEsvCBsIhAAoErBLLwgbCIt0DgnJzhQDHAQAAiXNlY3AyNTZrMaEDrZ7s9-Ziq1hlskxzIY5RgArRny4tf1e7ijlg9YyiS6GDdGNwgsIhg3VkcILCI4V3YWt1MgU --content-topic=/waku/2/content/test.js
2026-04-23 22:00:57.077 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.23.178 waku 55f8ab8a7114b82eaa4ced9fd23ec86d0e1e14a21b3b2e1f361a3ddc25b83dac
2026-04-23 22:00:57.115 DEBUG [src.node.docker_mananger] Container started with ID 55f8ab8a7114. Setting up logs at ./log/docker/node2_2026-04-23_22-00-55__2a46471a-24af-4d07-994a-f81ee41aca79__wakuorg_nwaku:latest.log
2026-04-23 22:00:57.115 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 36966
2026-04-23 22:00:57.115 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-04-23 22:00:58.119 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:36966/health" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:00:58.123 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-04-23 22:00:58.124 INFO [src.node.waku_node] Node protocols are initialized !!
2026-04-23 22:00:58.124 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:36966/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-04-23 22:00:58.127 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.23.178/tcp/36967/p2p/16Uiu2HAm87hAUu9pntC4eochntPYYW8aWfzBgS6dE7UPvhaStVAP","/ip4/172.18.23.178/tcp/36968/ws/p2p/16Uiu2HAm87hAUu9pntC4eochntPYYW8aWfzBgS6dE7UPvhaStVAP"],"enrUri":"enr:-L24QJer_UM3_Zl8VDorRMSdD8mh2OkmYgzokxxpV-CMowIHdXrh7dIjyEmycyaQdfnw61xYHpVavOfIPKWE0sjfaqwCgmlkgnY0gmlwhKwSF7KKbXVsdGlhZGRyc5YACASsEheyBpBnAAoErBIXsgaQaN0DgnJzhQDHAQAAiXNlY3AyNTZrMaECvIzQhmDM8uqyPkC6dXWPNTjKnT5Iy-fTPe2LKgq_EriDdGNwgpBng3VkcIKQaYV3YWt1MgE"}'
2026-04-23 22:00:58.128 INFO [src.node.waku_node] REST service is ready !!
2026-04-23 22:00:58.128 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:36966/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.203.194/tcp/49697/p2p/16Uiu2HAmQLjSJKDXNXRtcMNwS8hciqVdUAWuuzSURWapmr9jZizL"]'
2026-04-23 22:00:58.131 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-04-23 22:00:58.131 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:49696/relay/v1/auto/subscriptions" -H "Content-Type: application/json" -d '["/myapp/1/latest/proto"]'
2026-04-23 22:00:58.133 ERROR [src.node.api_clients.base_client] HTTP error occurred: 500 Server Error: Internal Server Error for url: http://127.0.0.1:49696/relay/v1/auto/subscriptions. Response content: b'Subscribe failed:Failed to decode subscription event: Static sharding is used, relay subscriptions must specify a pubsub topic'
2026-04-23 22:00:58.170 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-04-23 22:00:58.171 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-04-23 22:00:58.171 DEBUG [src.node.waku_node] Stopping container with id 6104f2109d2b
2026-04-23 22:00:58.632 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 22:00:58.633 DEBUG [src.node.waku_node] Stopping container with id 55f8ab8a7114
2026-04-23 22:00:59.088 DEBUG [src.node.waku_node] Container stopped.
2026-04-23 22:00:59.089 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-04-23 22:00:59.102 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 22:00:59.107 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-04-23 22:00:59.108 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-04-23 22:00:59.108 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-04-23 22:00:59.108 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-04-23_22-00-55__2a46471a-24af-4d07-994a-f81ee41aca79__wakuorg_nwaku:latest.log
2026-04-23 22:00:59.109 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-04-23_22-00-55__2a46471a-24af-4d07-994a-f81ee41aca79__wakuorg_nwaku:latest.log