100 lines
18 KiB
Plaintext

2026-03-12 04:37:05.802 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-12 04:37:05.803 DEBUG [tests.conftest] Running test: test_publish_on_multiple_pubsub_topics_and_only_after_fetch_them with id: 2026-03-12_04-37-05__c85e8b2e-bb41-4f4e-8923-7b022dad18a9
2026-03-12 04:37:05.803 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-12 04:37:05.803 DEBUG [src.steps.relay] Running fixture setup: relay_setup
2026-03-12 04:37:05.803 DEBUG [src.steps.sharding] Running fixture setup: sharding_setup
2026-03-12 04:37:05.810 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-12 04:37:05.810 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-12_04-37-05__c85e8b2e-bb41-4f4e-8923-7b022dad18a9__wakuorg_nwaku:latest.log
2026-03-12 04:37:05.810 DEBUG [src.node.waku_node] Starting Node...
2026-03-12 04:37:05.810 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-12 04:37:05.812 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-12 04:37:05.812 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.247.138
2026-03-12 04:37:05.812 DEBUG [src.node.docker_mananger] Generated ports ['34720', '34721', '34722', '34723', '34724']
2026-03-12 04:37:05.812 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-12 04:37:05.812 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-12 04:37:05.812 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-12 04:37:05.812 DEBUG [src.node.waku_node] Using volumes []
2026-03-12 04:37:05.812 DEBUG [src.node.docker_mananger] docker run -i -t -p 34720:34720 -p 34721:34721 -p 34722:34722 -p 34723:34723 -p 34724:34724 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=34722 --rest-port=34720 --tcp-port=34721 --discv5-udp-port=34723 --rest-address=0.0.0.0 --nat=extip:172.18.247.138 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=d60ac4c6e1e64ab41d57be6507d4b2ae7189d2553d0bed0ed39430b9cd8e77ef --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=34724 --metrics-logging=true --relay=true --filter=true
2026-03-12 04:37:05.965 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.247.138 waku 186defb0b65b6967041943887c13b1d5db68a664486617fbd3822eedb79a70a8
2026-03-12 04:37:05.992 DEBUG [src.node.docker_mananger] Container started with ID 186defb0b65b. Setting up logs at ./log/docker/node1_2026-03-12_04-37-05__c85e8b2e-bb41-4f4e-8923-7b022dad18a9__wakuorg_nwaku:latest.log
2026-03-12 04:37:05.994 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 34720
2026-03-12 04:37:05.994 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-12 04:37:06.094 ERROR [src.node.docker_mananger] Max retries reached for container de3d4b0bbaec. Exiting log stream.
2026-03-12 04:37:06.557 ERROR [src.node.docker_mananger] Max retries reached for container db3b6e8aa540. Exiting log stream.
2026-03-12 04:37:06.995 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34720/health" -H "Content-Type: application/json" -d 'None'
2026-03-12 04:37:06.997 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"READY"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-12 04:37:06.998 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-12 04:37:06.998 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:34720/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-12 04:37:07.000 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.247.138/tcp/34721/p2p/16Uiu2HAmTR3pnvraTKoq2Xe332fLMzsj9NdnpFZB5nFb7296daPg","/ip4/172.18.247.138/tcp/34722/ws/p2p/16Uiu2HAmTR3pnvraTKoq2Xe332fLMzsj9NdnpFZB5nFb7296daPg"],"enrUri":"enr:-L24QBlRaLZZERf0q1Cfgo6OwhcooCQ24U3py8VLzfoknfwpYIWIG8RDouTm9IuuMjzQOoH6UKqsBQ9K8MnsFrQ5_-sCgmlkgnY0gmlwhKwS94qKbXVsdGlhZGRyc5YACASsEveKBoehAAoErBL3igaHot0DgnJzhQACAQAAiXNlY3AyNTZrMaED200Z0N5NgmbANjoGuiZz27n2m9H6_Ofn6TF8XWENOfeDdGNwgoehg3VkcIKHo4V3YWt1MgU"}'
2026-03-12 04:37:07.000 INFO [src.node.waku_node] REST service is ready !!
2026-03-12 04:37:07.009 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-12 04:37:07.009 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-12_04-37-05__c85e8b2e-bb41-4f4e-8923-7b022dad18a9__wakuorg_nwaku:latest.log
2026-03-12 04:37:07.009 DEBUG [src.node.waku_node] Starting Node...
2026-03-12 04:37:07.009 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-12 04:37:07.010 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-12 04:37:07.011 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.232.0
2026-03-12 04:37:07.011 DEBUG [src.node.docker_mananger] Generated ports ['58872', '58873', '58874', '58875', '58876']
2026-03-12 04:37:07.011 DEBUG [src.node.waku_node] Removing pubsub-topic from nwaku args
2026-03-12 04:37:07.011 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-12 04:37:07.011 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-12 04:37:07.011 DEBUG [src.node.waku_node] Using volumes []
2026-03-12 04:37:07.011 DEBUG [src.node.docker_mananger] docker run -i -t -p 58872:58872 -p 58873:58873 -p 58874:58874 -p 58875:58875 -p 58876:58876 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=58874 --rest-port=58872 --tcp-port=58873 --discv5-udp-port=58875 --rest-address=0.0.0.0 --nat=extip:172.18.232.0 --peer-exchange=true --discv5-discovery=true --cluster-id=2 --nodekey=4e1b06df401df63bc6b6cfa14dfc7347bf0f48aabeeffd11711516bbdcd7bdae --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=58876 --metrics-logging=true --relay=true --discv5-bootstrap-node=enr:-L24QBlRaLZZERf0q1Cfgo6OwhcooCQ24U3py8VLzfoknfwpYIWIG8RDouTm9IuuMjzQOoH6UKqsBQ9K8MnsFrQ5_-sCgmlkgnY0gmlwhKwS94qKbXVsdGlhZGRyc5YACASsEveKBoehAAoErBL3igaHot0DgnJzhQACAQAAiXNlY3AyNTZrMaED200Z0N5NgmbANjoGuiZz27n2m9H6_Ofn6TF8XWENOfeDdGNwgoehg3VkcIKHo4V3YWt1MgU
2026-03-12 04:37:07.183 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.232.0 waku b7f13764fc08a30023c76f2a4e8d7fd912b674304b64cb3f9c90942148bebfdf
2026-03-12 04:37:07.210 DEBUG [src.node.docker_mananger] Container started with ID b7f13764fc08. Setting up logs at ./log/docker/node2_2026-03-12_04-37-05__c85e8b2e-bb41-4f4e-8923-7b022dad18a9__wakuorg_nwaku:latest.log
2026-03-12 04:37:07.211 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 58872
2026-03-12 04:37:07.211 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-12 04:37:08.212 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:58872/health" -H "Content-Type: application/json" -d 'None'
2026-03-12 04:37:08.214 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-12 04:37:08.315 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:58872/health" -H "Content-Type: application/json" -d 'None'
2026-03-12 04:37:08.317 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"INITIALIZING","connectionStatus":"Disconnected","protocolsHealth":[]}'
2026-03-12 04:37:08.417 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:58872/health" -H "Content-Type: application/json" -d 'None'
2026-03-12 04:37:08.420 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"PartiallyConnected","protocolsHealth":[{"Relay":"READY"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"READY"},{"Legacy Lightpush Client":"READY"},{"Store Client":"READY"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"READY"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-12 04:37:08.420 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-12 04:37:08.420 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:58872/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-12 04:37:08.423 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.232.0/tcp/58873/p2p/16Uiu2HAm3xbe7Uii9uiU5fPFvYYoGjmbk3WnU32Wwd3j9YPPE8Er","/ip4/172.18.232.0/tcp/58874/ws/p2p/16Uiu2HAm3xbe7Uii9uiU5fPFvYYoGjmbk3WnU32Wwd3j9YPPE8Er"],"enrUri":"enr:-L24QCR4IhPZ7n1IsSFuRIJqogM3mk-x5B_vjYJZEKASOrS_WxSlWhAYQi058AhUKfylcq8AuzoKteAN7w4daR9tacMCgmlkgnY0gmlwhKwS6ACKbXVsdGlhZGRyc5YACASsEugABuX5AAoErBLoAAbl-t0DgnJzhQACAQAAiXNlY3AyNTZrMaECfsmYEEoh6_yith8MFITDLbSCrYVDXQlIVVkrDRGW0geDdGNwguX5g3VkcILl-4V3YWt1MgE"}'
2026-03-12 04:37:08.423 INFO [src.node.waku_node] REST service is ready !!
2026-03-12 04:37:08.424 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:58872/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.247.138/tcp/34721/p2p/16Uiu2HAmTR3pnvraTKoq2Xe332fLMzsj9NdnpFZB5nFb7296daPg"]'
2026-03-12 04:37:08.442 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-12 04:37:08.444 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:34720/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7"]'
2026-03-12 04:37:08.458 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-12 04:37:08.460 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:58872/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/0", "/waku/2/rs/2/1", "/waku/2/rs/2/2", "/waku/2/rs/2/3", "/waku/2/rs/2/4", "/waku/2/rs/2/5", "/waku/2/rs/2/6", "/waku/2/rs/2/7"]'
2026-03-12 04:37:08.465 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-12 04:37:08.466 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:34720/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d '{"payload": "L3dha3UvMi9ycy8yLzA=", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-12 04:37:08.475 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-12 04:37:08.475 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:34720/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d '{"payload": "L3dha3UvMi9ycy8yLzE=", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-12 04:37:08.488 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-12 04:37:08.489 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:34720/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F2" -H "Content-Type: application/json" -d '{"payload": "L3dha3UvMi9ycy8yLzI=", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-12 04:37:08.497 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-12 04:37:08.498 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:34720/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F3" -H "Content-Type: application/json" -d '{"payload": "L3dha3UvMi9ycy8yLzM=", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-12 04:37:08.507 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-12 04:37:08.508 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:34720/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F4" -H "Content-Type: application/json" -d '{"payload": "L3dha3UvMi9ycy8yLzQ=", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-12 04:37:08.520 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-12 04:37:08.520 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:34720/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F5" -H "Content-Type: application/json" -d '{"payload": "L3dha3UvMi9ycy8yLzU=", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-12 04:37:08.529 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-12 04:37:08.530 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:34720/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F6" -H "Content-Type: application/json" -d '{"payload": "L3dha3UvMi9ycy8yLzY=", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-12 04:37:08.540 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-12 04:37:08.541 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:34720/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F7" -H "Content-Type: application/json" -d '{"payload": "L3dha3UvMi9ycy8yLzc=", "contentTopic": "/myapp/1/latest/proto", "timestamp": '$(date +%s%N)'}'
2026-03-12 04:37:08.550 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-12 04:37:08.550 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-12 04:37:08.651 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:58872/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F0" -H "Content-Type: application/json" -d 'None'
2026-03-12 04:37:08.658 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"L3dha3UvMi9ycy8yLzA=","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773290228466492916,"ephemeral":false,"proof":""}]'
2026-03-12 04:37:08.659 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:58872/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-12 04:37:08.662 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"L3dha3UvMi9ycy8yLzE=","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773290228475652577,"ephemeral":false,"proof":""}]'
2026-03-12 04:37:08.662 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:58872/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F2" -H "Content-Type: application/json" -d 'None'
2026-03-12 04:37:08.664 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"L3dha3UvMi9ycy8yLzI=","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773290228488943995,"ephemeral":false,"proof":""}]'
2026-03-12 04:37:08.665 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:58872/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F3" -H "Content-Type: application/json" -d 'None'
2026-03-12 04:37:08.667 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"U2hhcmRpbmcgd29ya3MhIQ==","contentTopic":"/toychat/2/huilong/proto","version":0,"timestamp":1773290228471158803,"ephemeral":false,"proof":""},{"payload":"L3dha3UvMi9ycy8yLzM=","contentTopic":"/myapp/1/latest/proto","version":0,"timestamp":1773290228498327100,"ephemeral":false,"proof":""}]'
2026-03-12 04:37:08.707 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-12 04:37:08.708 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-12 04:37:08.708 DEBUG [src.node.waku_node] Stopping container with id 186defb0b65b
2026-03-12 04:37:09.226 DEBUG [src.node.waku_node] Container stopped.
2026-03-12 04:37:09.228 DEBUG [src.node.waku_node] Stopping container with id b7f13764fc08
2026-03-12 04:37:09.729 DEBUG [src.node.waku_node] Container stopped.
2026-03-12 04:37:09.732 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-12 04:37:09.780 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-12 04:37:09.822 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-12 04:37:09.822 DEBUG [tests.conftest] Running fixture teardown: attach_logs_on_fail
2026-03-12 04:37:09.823 DEBUG [tests.conftest] Test failed, attempting to attach logs to the allure reports
2026-03-12 04:37:09.823 DEBUG [src.libs.common] Attaching file ./log/docker/node1_2026-03-12_04-37-05__c85e8b2e-bb41-4f4e-8923-7b022dad18a9__wakuorg_nwaku:latest.log
2026-03-12 04:37:09.824 DEBUG [src.libs.common] Attaching file ./log/docker/node2_2026-03-12_04-37-05__c85e8b2e-bb41-4f4e-8923-7b022dad18a9__wakuorg_nwaku:latest.log