95 lines
17 KiB
Plaintext

2026-03-07 04:31:27.966 DEBUG [tests.conftest] Running fixture setup: test_id
2026-03-07 04:31:27.966 DEBUG [tests.conftest] Running test: test_filter_subscribe_to_pubsub_topics_from_multiple_clusters with id: 2026-03-07_04-31-27__1d56d23b-7650-4b39-8020-6f5e31e1fce8
2026-03-07 04:31:27.966 DEBUG [src.steps.common] Running fixture setup: common_setup
2026-03-07 04:31:27.967 DEBUG [src.steps.filter] Running fixture setup: filter_setup
2026-03-07 04:31:27.967 DEBUG [src.steps.filter] Running fixture setup: setup_main_relay_node
2026-03-07 04:31:27.974 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-07 04:31:27.974 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node1_2026-03-07_04-31-27__1d56d23b-7650-4b39-8020-6f5e31e1fce8__wakuorg_nwaku:latest.log
2026-03-07 04:31:27.974 DEBUG [src.node.waku_node] Starting Node...
2026-03-07 04:31:27.974 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-07 04:31:27.976 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-07 04:31:27.976 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.206.186
2026-03-07 04:31:27.976 DEBUG [src.node.docker_mananger] Generated ports ['50318', '50319', '50320', '50321', '50322']
2026-03-07 04:31:27.976 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-07 04:31:27.976 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-07 04:31:27.976 DEBUG [src.node.waku_node] Using volumes []
2026-03-07 04:31:27.977 DEBUG [src.node.docker_mananger] docker run -i -t -p 50318:50318 -p 50319:50319 -p 50320:50320 -p 50321:50321 -p 50322:50322 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=50320 --rest-port=50318 --tcp-port=50319 --discv5-udp-port=50321 --rest-address=0.0.0.0 --nat=extip:172.18.206.186 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=876b2cef779d59ceca2d75df678e20c8ad4dac3cadcf1a759d9c5fefb7cf1d3b --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=50322 --metrics-logging=true --relay=true --filter=true
2026-03-07 04:31:28.164 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.206.186 waku 42a08fdc99c088052f1b085cdbb16169c7125907db715482c7cd6eaf74c1b2c7
2026-03-07 04:31:28.198 DEBUG [src.node.docker_mananger] Container started with ID 42a08fdc99c0. Setting up logs at ./log/docker/node1_2026-03-07_04-31-27__1d56d23b-7650-4b39-8020-6f5e31e1fce8__wakuorg_nwaku:latest.log
2026-03-07 04:31:28.198 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 50318
2026-03-07 04:31:28.200 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-07 04:31:28.214 ERROR [src.node.docker_mananger] Max retries reached for container 2cc9c4326daf. Exiting log stream.
2026-03-07 04:31:28.775 ERROR [src.node.docker_mananger] Max retries reached for container b7de04d9fde6. Exiting log stream.
2026-03-07 04:31:29.201 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:50318/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:29.204 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_READY","desc":"No connected peers"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_READY","desc":"Relay is not ready, filter will not be able to sort out messages"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-07 04:31:29.204 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-07 04:31:29.204 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:50318/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:29.206 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.206.186/tcp/50319/p2p/16Uiu2HAkvNMwLHJWQhqkqXtyN5iVE29s7tBHtNn6DA7bQRv4Xyjp","/ip4/172.18.206.186/tcp/50320/ws/p2p/16Uiu2HAkvNMwLHJWQhqkqXtyN5iVE29s7tBHtNn6DA7bQRv4Xyjp"],"enrUri":"enr:-L24QLA5m9r15yohV6tJrJh_d-k2hc9D6iaJ4UC_Jaj3TQDtSrhnXA9puHGpJUjCFj8PrndMAjDL3Qq6uVs0syMN0_cCgmlkgnY0gmlwhKwSzrqKbXVsdGlhZGRyc5YACASsEs66BsSPAAoErBLOugbEkN0DgnJzhQADAQAAiXNlY3AyNTZrMaECDgKLOyr4M-25eBD9Hg5QJUjhd1UCIqTD62IbJtWpVRODdGNwgsSPg3VkcILEkYV3YWt1MgU"}'
2026-03-07 04:31:29.206 INFO [src.node.waku_node] REST service is ready !!
2026-03-07 04:31:29.207 DEBUG [src.steps.filter] Running fixture setup: setup_main_filter_node
2026-03-07 04:31:29.214 DEBUG [src.node.docker_mananger] Docker client initialized with image wakuorg/nwaku:latest
2026-03-07 04:31:29.214 DEBUG [src.node.waku_node] WakuNode instance initialized with log path ./log/docker/node2_2026-03-07_04-31-27__1d56d23b-7650-4b39-8020-6f5e31e1fce8__wakuorg_nwaku:latest.log
2026-03-07 04:31:29.214 DEBUG [src.node.waku_node] Starting Node...
2026-03-07 04:31:29.214 DEBUG [src.node.docker_mananger] Attempting to create or retrieve network waku
2026-03-07 04:31:29.216 DEBUG [src.node.docker_mananger] Network waku already exists
2026-03-07 04:31:29.216 DEBUG [src.node.docker_mananger] Generated random external IP 172.18.99.93
2026-03-07 04:31:29.216 DEBUG [src.node.docker_mananger] Generated ports ['35748', '35749', '35750', '35751', '35752']
2026-03-07 04:31:29.216 DEBUG [src.node.waku_node] RLN credentials were not set
2026-03-07 04:31:29.216 INFO [src.node.waku_node] RLN credentials not set or credential store not available, starting without RLN
2026-03-07 04:31:29.217 DEBUG [src.node.waku_node] Using volumes []
2026-03-07 04:31:29.217 DEBUG [src.node.docker_mananger] docker run -i -t -p 35748:35748 -p 35749:35749 -p 35750:35750 -p 35751:35751 -p 35752:35752 wakuorg/nwaku:latest --listen-address=0.0.0.0 --rest=true --rest-admin=true --websocket-support=true --log-level=TRACE --rest-relay-cache-capacity=100 --websocket-port=35750 --rest-port=35748 --tcp-port=35749 --discv5-udp-port=35751 --rest-address=0.0.0.0 --nat=extip:172.18.99.93 --peer-exchange=true --discv5-discovery=true --cluster-id=3 --nodekey=8d2e1028ff9b1c833c7e41cd27d0c5bad50cd2ce2a64d7c4cdf7d8e36362b398 --shard=0 --metrics-server=true --metrics-server-address=0.0.0.0 --metrics-server-port=35752 --metrics-logging=true --relay=false --discv5-bootstrap-node=enr:-L24QLA5m9r15yohV6tJrJh_d-k2hc9D6iaJ4UC_Jaj3TQDtSrhnXA9puHGpJUjCFj8PrndMAjDL3Qq6uVs0syMN0_cCgmlkgnY0gmlwhKwSzrqKbXVsdGlhZGRyc5YACASsEs66BsSPAAoErBLOugbEkN0DgnJzhQADAQAAiXNlY3AyNTZrMaECDgKLOyr4M-25eBD9Hg5QJUjhd1UCIqTD62IbJtWpVRODdGNwgsSPg3VkcILEkYV3YWt1MgU --filternode=/ip4/172.18.206.186/tcp/50319/p2p/16Uiu2HAkvNMwLHJWQhqkqXtyN5iVE29s7tBHtNn6DA7bQRv4Xyjp
2026-03-07 04:31:29.409 DEBUG [src.node.docker_mananger] docker network connect --ip 172.18.99.93 waku c1819cf2e9e843fdf33913e1d3eb7c9d58ddf8732f605c1cd950b1a0e9634bae
2026-03-07 04:31:29.442 DEBUG [src.node.docker_mananger] Container started with ID c1819cf2e9e8. Setting up logs at ./log/docker/node2_2026-03-07_04-31-27__1d56d23b-7650-4b39-8020-6f5e31e1fce8__wakuorg_nwaku:latest.log
2026-03-07 04:31:29.443 DEBUG [src.node.waku_node] Started container from image wakuorg/nwaku:latest. REST: 35748
2026-03-07 04:31:29.443 DEBUG [src.libs.common] Sleeping for 1 seconds
2026-03-07 04:31:30.444 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35748/health" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:30.447 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"nodeHealth":"READY","connectionStatus":"Disconnected","protocolsHealth":[{"Relay":"NOT_MOUNTED"},{"Lightpush":"NOT_MOUNTED"},{"Legacy Lightpush":"NOT_MOUNTED"},{"Filter":"NOT_MOUNTED"},{"Store":"NOT_MOUNTED"},{"Legacy Store":"NOT_MOUNTED"},{"Peer Exchange":"READY"},{"Rendezvous":"NOT_READY","desc":"No Rendezvous peers are available yet"},{"Mix":"NOT_MOUNTED"},{"Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Legacy Lightpush Client":"NOT_READY","desc":"No Lightpush service peer available yet"},{"Store Client":"NOT_READY","desc":"No Store service peer available yet, neither Store service set up for the node"},{"Legacy Store Client":"NOT_READY","desc":"No Legacy Store service peers are available yet, neither Store service set up for the node"},{"Filter Client":"NOT_READY","desc":"No Filter service peer available yet"},{"Rln Relay":"NOT_MOUNTED"}]}'
2026-03-07 04:31:30.447 INFO [src.node.waku_node] Node protocols are initialized !!
2026-03-07 04:31:30.447 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35748/debug/v1/info" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:30.450 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"listenAddresses":["/ip4/172.18.99.93/tcp/35749/p2p/16Uiu2HAmEdiia3NMiFE4ZaHCRddXkuMDttUFNcCsfiqXjLq46Ecu","/ip4/172.18.99.93/tcp/35750/ws/p2p/16Uiu2HAmEdiia3NMiFE4ZaHCRddXkuMDttUFNcCsfiqXjLq46Ecu"],"enrUri":"enr:-L24QJ0CdBL6CQSJ-fI8JpJ71v9M_mqUKZrxnGfXSKqlWI9fDEUyYLVHoGNhtnSOhoGGAeL7KI5LpL2ds7UGZvoe4nMCgmlkgnY0gmlwhKwSY12KbXVsdGlhZGRyc5YACASsEmNdBoulAAoErBJjXQaLpt0DgnJzhQADAQAAiXNlY3AyNTZrMaEDHWQd3LcXipyFhvUtV0U_0tCS6it0pWKwW8C59-35rK6DdGNwgoulg3VkcIKLp4V3YWt1MgA"}'
2026-03-07 04:31:30.450 INFO [src.node.waku_node] REST service is ready !!
2026-03-07 04:31:30.450 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35748/admin/v1/peers" -H "Content-Type: application/json" -d '["/ip4/172.18.206.186/tcp/50319/p2p/16Uiu2HAkvNMwLHJWQhqkqXtyN5iVE29s7tBHtNn6DA7bQRv4Xyjp"]'
2026-03-07 04:31:30.488 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:31:30.491 DEBUG [tests.filter.test_subscribe_create] Running test with pubsub topic: /waku/2/rs/3/1
2026-03-07 04:31:30.492 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:50318/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/1"]'
2026-03-07 04:31:30.510 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:31:30.512 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35748/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "7dc63524-ab3a-4bbe-8016-ca0b98f0e2a6", "contentFilters": ["/waku/2/rs/3/1"], "pubsubTopic": "/waku/2/rs/3/1"}'
2026-03-07 04:31:30.525 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"7dc63524-ab3a-4bbe-8016-ca0b98f0e2a6","statusDesc":"OK"}'
2026-03-07 04:31:30.526 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:50318/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/waku/2/rs/3/1", "timestamp": '$(date +%s%N)'}'
2026-03-07 04:31:30.533 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:31:30.533 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-07 04:31:30.633 DEBUG [src.steps.filter] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-07 04:31:30.634 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35748/filter/v2/messages/%2Fwaku%2F2%2Frs%2F3%2F1" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:30.636 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/waku/2/rs/3/1","version":0,"timestamp":1772857890526039128,"ephemeral":false}]'
2026-03-07 04:31:30.638 DEBUG [tests.filter.test_subscribe_create] Running test with pubsub topic: /waku/2/rs/2/2
2026-03-07 04:31:30.639 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:50318/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/2/2"]'
2026-03-07 04:31:30.642 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:31:30.642 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35748/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "cf6fc3da-c4df-42ac-bc79-374a66ccdcae", "contentFilters": ["/waku/2/rs/2/2"], "pubsubTopic": "/waku/2/rs/2/2"}'
2026-03-07 04:31:30.652 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"cf6fc3da-c4df-42ac-bc79-374a66ccdcae","statusDesc":"OK"}'
2026-03-07 04:31:30.653 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:50318/relay/v1/messages/%2Fwaku%2F2%2Frs%2F2%2F2" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/waku/2/rs/2/2", "timestamp": '$(date +%s%N)'}'
2026-03-07 04:31:30.657 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:31:30.658 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-07 04:31:30.758 DEBUG [src.steps.filter] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-07 04:31:30.759 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35748/filter/v2/messages/%2Fwaku%2F2%2Frs%2F2%2F2" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:30.761 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/waku/2/rs/2/2","version":0,"timestamp":1772857890653330797,"ephemeral":false}]'
2026-03-07 04:31:30.763 DEBUG [tests.filter.test_subscribe_create] Running test with pubsub topic: /waku/2/rs/3/9
2026-03-07 04:31:30.763 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:50318/relay/v1/subscriptions" -H "Content-Type: application/json" -d '["/waku/2/rs/3/9"]'
2026-03-07 04:31:30.766 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:31:30.766 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:35748/filter/v2/subscriptions" -H "Content-Type: application/json" -d '{"requestId": "1b8a978d-2323-4664-a92c-5905cfd22278", "contentFilters": ["/waku/2/rs/3/9"], "pubsubTopic": "/waku/2/rs/3/9"}'
2026-03-07 04:31:30.776 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'{"requestId":"1b8a978d-2323-4664-a92c-5905cfd22278","statusDesc":"OK"}'
2026-03-07 04:31:30.776 INFO [src.node.api_clients.base_client] curl -v -X POST "http://127.0.0.1:50318/relay/v1/messages/%2Fwaku%2F2%2Frs%2F3%2F9" -H "Content-Type: application/json" -d '{"payload": "RmlsdGVyIHdvcmtzISE=", "contentTopic": "/waku/2/rs/3/9", "timestamp": '$(date +%s%N)'}'
2026-03-07 04:31:30.781 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'OK'
2026-03-07 04:31:30.782 DEBUG [src.libs.common] Sleeping for 0.1 seconds
2026-03-07 04:31:30.882 DEBUG [src.steps.filter] Checking that peer NODE_2:wakuorg/nwaku:latest can find the published message
2026-03-07 04:31:30.882 INFO [src.node.api_clients.base_client] curl -v -X GET "http://127.0.0.1:35748/filter/v2/messages/%2Fwaku%2F2%2Frs%2F3%2F9" -H "Content-Type: application/json" -d 'None'
2026-03-07 04:31:30.885 INFO [src.node.api_clients.base_client] Response status code: 200. Response content: b'[{"payload":"RmlsdGVyIHdvcmtzISE=","contentTopic":"/waku/2/rs/3/9","version":0,"timestamp":1772857890776587449,"ephemeral":false}]'
2026-03-07 04:31:30.887 DEBUG [tests.conftest] Running fixture teardown: test_setup
2026-03-07 04:31:30.888 DEBUG [tests.conftest] Running fixture teardown: close_open_nodes
2026-03-07 04:31:30.889 DEBUG [src.node.waku_node] Stopping container with id 42a08fdc99c0
2026-03-07 04:31:31.459 DEBUG [src.node.waku_node] Container stopped.
2026-03-07 04:31:31.459 DEBUG [src.node.waku_node] Stopping container with id c1819cf2e9e8
2026-03-07 04:31:32.020 DEBUG [src.node.waku_node] Container stopped.
2026-03-07 04:31:32.022 DEBUG [tests.conftest] Running fixture teardown: check_waku_log_errors
2026-03-07 04:31:32.030 DEBUG [src.node.docker_mananger] No errors found in the waku logs.
2026-03-07 04:31:32.036 DEBUG [src.node.docker_mananger] No errors found in the waku logs.