<titledata-rh="true">Performance Benchmarks and Test Reports | Waku Documentation</title><metadata-rh="true"name="viewport"content="width=device-width,initial-scale=1"><metadata-rh="true"name="twitter:card"content="summary_large_image"><metadata-rh="true"property="og:url"content="https://docs.waku.org/research/benchmarks/test-results-summary"><metadata-rh="true"name="docusaurus_locale"content="en-GB"><metadata-rh="true"name="docsearch:language"content="en-GB"><metadata-rh="true"name="keywords"content="waku, web3"><metadata-rh="true"name="image"content="theme/image/preview-image.png"><metadata-rh="true"name="docusaurus_version"content="current"><metadata-rh="true"name="docusaurus_tag"content="docs-default-current"><metadata-rh="true"name="docsearch:version"content="current"><metadata-rh="true"name="docsearch:docusaurus_tag"content="docs-default-current"><metadata-rh="true"property="og:title"content="Performance Benchmarks and Test Reports | Waku Documentation"><metadata-rh="true"name="description"content="Introduction"><metadata-rh="true"property="og:description"content="Introduction"><linkdata-rh="true"rel="icon"href="/theme/image/favicon.ico"><linkdata-rh="true"rel="canonical"href="https://docs.waku.org/research/benchmarks/test-results-summary"><linkdata-rh="true"rel="alternate"href="https://docs.waku.org/research/benchmarks/test-results-summary"hreflang="en-GB"><linkdata-rh="true"rel="alternate"href="https://docs.waku.org/research/benchmarks/test-results-summary"hreflang="x-default"><linkrel="alternate icon"type="image/png"href="/theme/image/favicon.png">
<!---->We compare the latency in different network configurations for the following simulation parameters:</p><ul><li>Total messages published: 600</li><li>Message size: 1KB</li><li>Message injection rate: 1msg/s</li></ul><p>The different network configurations tested are:</p><ul><li>Relay Config: 1000 nodes with relay enabled</li><li>Mixed Config: 210 nodes, consisting of bootstrap nodes, filter clients and servers, lightpush clients and servers, store nodes</li><li>Non-persistent Relay Config: 500 persistent relay nodes, 10 store nodes and 100 non-persistent relay nodes</li></ul><p>Click on a specific config to see the detailed test report.</p><table><thead><tr><th>Config</th><th>Average Message Propagation Latency (s)</th><th>Max Message Propagation Latency (s)</th></tr></thead><tbody><tr><td><ahref="https://www.notion.so/Waku-regression-testing-v0-34-1618f96fb65c803bb7bad6ecd6bafff9"target="_blank"rel="noopener noreferrer">Relay</a> (1000 nodes)</td><td>0.05</td><td>1.6</td></tr><tr><td><ahref="https://www.notion.so/Mixed-environment-analysis-1688f96fb65c809eb235c59b97d6e15b"target="_blank"rel="noopener noreferrer">Mixed</a> (210 nodes)</td><td>0.0125</td><td>0.007</td></tr><tr><td><ahref="https://www.notion.so/High-Churn-Relay-Store-Reliability-16c8f96fb65c8008bacaf5e86881160c"target="_blank"rel="noopener noreferrer">Non-persistent Relay</a> (510 nodes)</td><td>0.0125</td><td>0.25</td></tr></tbody></table><h3class="anchor anchorWithHideOnScrollNavbar_WYt5"id="discv5-bandwidth-usage-nwaku-v0340">Discv5 Bandwidth Usage: nwaku v0.34.0<ahref="#discv5-bandwidth-usage-nwaku-v0340"class="hash-link"aria-label="Direct link to Discv5 Bandwidth Usage: nwaku v0.34.0"title="Direct link to Discv5 Bandwidth Usage: nwaku v0.34.0"></a></h3><p>The average bandwidth usage of discv5 for a network of 100 nodes and message injection rate of 0 or 1msg/s.<br>
<!---->The measurements are based on a stable network where all nodes have already connected to peers to form a healthy mesh.</p><table><thead><tr><th>Message size</th><th>Average discv5 incoming bandwidth (KB/s)</th><th>Average discv5 outgoing bandwidth (KB/s)</th></tr></thead><tbody><tr><td>no message injection</td><td>7.88</td><td>6.70</td></tr><tr><td>1KB</td><td>8.04</td><td>7.40</td></tr><tr><td>10KB</td><td>8.03</td><td>7.45</td></tr></tbody></table><h2class="anchor anchorWithHideOnScrollNavbar_WYt5"id="testing">Testing<ahref="#testing"class="hash-link"aria-label="Direct link to Testing"title="Direct link to Testing"></a></h2><h3class="anchor anchorWithHideOnScrollNavbar_WYt5"id="dst">DST<ahref="#dst"class="hash-link"aria-label="Direct link to DST"title="Direct link to DST"></a></h3><p>The VAC DST team performs regression testing on all new <strong>nwaku</strong> releases, comparing performance with previous versions.<br>
<!---->They simulate large Waku networks with a variety of network and protocol configurations that are representative of real-world usage.</p><p><strong>Test Reports</strong>: <ahref="https://www.notion.so/DST-Reports-1228f96fb65c80729cd1d98a7496fe6f"target="_blank"rel="noopener noreferrer">DST Reports</a></p><h3class="anchor anchorWithHideOnScrollNavbar_WYt5"id="qa">QA<ahref="#qa"class="hash-link"aria-label="Direct link to QA"title="Direct link to QA"></a></h3><p>The VAC QA team performs interoperability tests for <strong>nwaku</strong> and <strong>go-waku</strong> using the latest main branch builds.<br>
<!---->These tests run daily and verify protocol functionality by targeting specific features of each protocol. </p><p><strong>Test Reports</strong>: <ahref="https://discord.com/channels/1110799176264056863/1196933819614363678"target="_blank"rel="noopener noreferrer">QA Reports</a></p><h3class="anchor anchorWithHideOnScrollNavbar_WYt5"id="nwaku">nwaku<ahref="#nwaku"class="hash-link"aria-label="Direct link to nwaku"title="Direct link to nwaku"></a></h3><p>The <strong>nwaku</strong> team follows a structured release procedure for all release candidates.<br>
<!---->This involves deploying RCs to <code>status.staging</code> fleet for validation and performing sanity checks. </p><p><strong>Release Process</strong>: <ahref="https://github.com/waku-org/nwaku/blob/master/.github/ISSUE_TEMPLATE/prepare_release.md"target="_blank"rel="noopener noreferrer">nwaku Release Procedure</a></p><h3class="anchor anchorWithHideOnScrollNavbar_WYt5"id="research">Research<ahref="#research"class="hash-link"aria-label="Direct link to Research"title="Direct link to Research"></a></h3><p>The Waku Research team conducts a variety of benchmarking, performance testing, proof-of-concept validations and debugging efforts.<br>
