Commit Graph

299 Commits

Author SHA1 Message Date
github-actions[bot] da5d3f4924 chore: update the link to the interop dashboard [skip ci] 2023-08-09 23:58:35 +00:00
github-actions[bot] a674f734cc chore: update the link to the interop dashboard [skip ci] 2023-08-04 17:17:09 +00:00
Max Inden ad43602e63
fix(perf): increase root volume size (#249)
Multiple perf runs have failed due to "no space left on device". See e.g. https://github.com/libp2p/test-plans/actions/runs/5727165977/job/15527780097.

The perf terraform launch template previously did not specify a root volume
size. Thus terraform used the default:

```
df -h

Filesystem      Size  Used Avail Use% Mounted on
devtmpfs        4.0M     0  4.0M   0% /dev
tmpfs            63G     0   63G   0% /dev/shm
tmpfs            25G  540K   25G   1% /run
/dev/nvme0n1p1  8.0G  1.9G  6.1G  24% /
tmpfs            63G     0   63G   0% /tmp
tmpfs            13G     0   13G   0% /run/user/1000
```

With this commit the root volume is increased to 100GB:

```
df -h

Filesystem      Size  Used Avail Use% Mounted on
devtmpfs        4.0M     0  4.0M   0% /dev
tmpfs            63G     0   63G   0% /dev/shm
tmpfs            25G  564K   25G   1% /run
/dev/nvme0n1p1  100G  2.6G   98G   3% /
tmpfs            63G  8.0K   63G   1% /tmp
tmpfs            13G     0   13G   0% /run/user/0
tmpfs            13G     0   13G   0% /run/user/1000
```
2023-08-04 18:50:32 +02:00
github-actions[bot] b31b44fbde chore: update the link to the interop dashboard [skip ci] 2023-08-04 08:49:48 +00:00
Max Inden cfd1049e8a
fix(perf): run iperf on TCP and set TCP windows to bdp (#241)
This commit makes iperf use TCP instead of UDP. Using UDP allows the sender to
send as much data as they can, not as much data as the receiver can handle.
Using TCP measures the actual bandwidth of the connection.

This commit sets the TCP send and receive window to the bandwidth-delay-product.
In order to exhaust the whole bandwidth between the two nodes, TCP needs to be
able to buffer all bytes on the wire in the case of packet loss.
2023-08-04 10:23:47 +02:00
github-actions[bot] e8c0733ce5 chore: update the link to the interop dashboard [skip ci] 2023-08-01 15:06:26 +00:00
Max Inden ffc7ae0d5f
fix(perf): replace rust-libp2p-quinn/ with rust-libp2p/master (#246)
With https://github.com/libp2p/rust-libp2p/pull/3454 merged we can now test the
new rust-libp2p QUIC implementation based on upstream quinn directly from
rust-libp2p `master`.

This commit does the following in libp2p/test-plans:

1. Remove the `perf/impl/rust-libp2p-quinn` implementation.
2. Introduce the `perf/impl/rust-libp2p/master` version of the rust-libp2p implementation.

We can promote the latter to a proper version on the next rust-libp2p release.
2023-08-01 16:40:02 +02:00
github-actions[bot] 003ac2c02d chore: update the link to the interop dashboard [skip ci] 2023-08-01 01:14:15 +00:00
github-actions[bot] d8913edb57 chore: update the link to the interop dashboard [skip ci] 2023-07-26 17:08:44 +00:00
Max Inden 3d9be81c9a
docs(perf): document how to add a new version of existing impl (#243) 2023-07-26 18:41:49 +02:00
github-actions[bot] 66a596ce53 chore: update the link to the interop dashboard [skip ci] 2023-07-26 12:27:58 +00:00
Max Inden 35eb403b2d
feat(perf): add go-libp2p v0.29 (#242) 2023-07-26 14:01:46 +02:00
github-actions[bot] f0437a8ec2 chore: update the link to the interop dashboard [skip ci] 2023-07-20 06:21:22 +00:00
Alex Potsides 5c74bfec3d
feat: expose name-ignore setting (#239)
Exposes `--name-ignore` as `test-ignore` in the ping test github action to be consistent with how `--name-filter` is exposed as `test-filter`

Follows on from #225
2023-07-20 06:54:46 +01:00
github-actions[bot] 5a337a4b64 chore: update the link to the interop dashboard [skip ci] 2023-07-19 17:09:51 +00:00
github-actions[bot] 0b2fa59a56 chore: update the link to the interop dashboard [skip ci] 2023-07-19 17:06:16 +00:00
Steve Loeppky 7e074ba39a
Update README.md - fix link to libp2p observable (#238) 2023-07-19 09:38:18 -07:00
Marco Munizaga 8834ac1555
Add go-libp2p v0.29.0 (#234) 2023-07-19 09:37:06 -07:00
github-actions[bot] 3132bf12b3 chore: update the link to the interop dashboard [skip ci] 2023-07-14 21:28:51 +00:00
Marco Munizaga 1ebb8b505c
multidim-interop: Prune older versions (#233)
* Remove older versions

* Remove older chromium versions
2023-07-14 14:01:52 -07:00
github-actions[bot] 1191bb5f13 chore: update the link to the interop dashboard [skip ci] 2023-07-14 19:32:58 +00:00
Marco Munizaga 4bd0f9992f
Revert "Install playwright in the base image so it is cached (#226)" (#231)
* Revert "Install playwright in the base image so it is cached (#226)"

This reverts commit d21d042ddd.

* Add comment
2023-07-14 11:48:08 -07:00
github-actions[bot] e69e155fe9 chore: update the link to the interop dashboard [skip ci] 2023-07-14 17:46:59 +00:00
Marco Munizaga cbca2c06de
multidim-interop: Update rust-libp2p .gitignore with chromium-image.json (#232)
* .gitignore chromium-image.json

* Assert that git tree is clean
2023-07-14 10:00:35 -07:00
github-actions[bot] 00170f36e3 chore: update the link to the interop dashboard [skip ci] 2023-07-13 20:01:43 +00:00
Marco Munizaga fff587f66f
More resilient stdout parsing of dialer stdout (#224)
* More resilient stdout parsing of dialer stdout

* Add another test case

* Handle JS cases where timings aren't the only thing on stdout
2023-07-13 12:14:43 -07:00
github-actions[bot] f954fd8522 chore: update the link to the interop dashboard [skip ci] 2023-07-11 00:35:27 +00:00
Marco Munizaga 81e78aed34
multidim-interop: Add name ignore option (#225)
* Add name ignore option

* Update multidim-interop/testplans.ts

Co-authored-by: Thomas Eizinger <thomas@eizinger.io>

---------

Co-authored-by: Thomas Eizinger <thomas@eizinger.io>
2023-07-10 16:49:46 -07:00
github-actions[bot] ba8169f189 chore: update the link to the interop dashboard [skip ci] 2023-07-10 03:52:51 +00:00
Max Inden d7391f13e1
fix(perf): increase iterations (#213)
- Increase upload/download benchmark iterations. Still conservative value of `10` due to slow rust-libp2p tcp. See https://github.com/libp2p/rust-yamux/issues/162. Note however that this is 10x an upload of 100MB.
- Increase latency benchmark iterations.
2023-07-10 05:06:51 +02:00
github-actions[bot] 289e90b80a chore: update the link to the interop dashboard [skip ci] 2023-07-08 05:01:33 +00:00
Marco Munizaga d21d042ddd
Install playwright in the base image so it is cached (#226) 2023-07-07 21:15:16 -07:00
github-actions[bot] 81b339dd70 chore: update the link to the interop dashboard [skip ci] 2023-07-07 23:25:17 +00:00
Piotr Galar 35ab35b1a4
feat: run multidim-interop.yml on self-hosted runners (#154)
* feat: run multidim-interop.yml on self-hosted runners

* feat: make worker count configurable

* feat: enable docker.io proxy on self-hosted runners

* chore: provide s3 creds through env

* Try 4 workers

* ci: run-multidim-interop on 16 workers

* chore: change self hosted labels

* Update .github/workflows/multidim-interop.yml

Co-authored-by: Piotr Galar <piotr.galar@gmail.com>

* Use self-hosted runners for now

This reverts commit 7e868ea6b486798c03ad5b88f14c1a78e51e7c26.

---------

Co-authored-by: Marco Munizaga <git@marcopolo.io>
Co-authored-by: Marco Munizaga <marco@marcopolo.io>
2023-07-07 15:41:38 -07:00
github-actions[bot] 22c7e58513 chore: update the link to the interop dashboard [skip ci] 2023-07-07 13:07:57 +00:00
Max Inden ce83afc1b0
feat(interop): add rust-libp2p chromium WASM WebTransport (#217)
Introduced in rust-libp2p with https://github.com/libp2p/rust-libp2p/pull/4015.
2023-07-07 14:37:57 +02:00
Max Inden 465065cff8
fix(interop): use standaloneTransports as string instead of param (#219)
* fix(interop): use standaloneTransports as string instead of param

When generating the test specification (docker-compose file) we enumerate all
transport permutations. While some of our transports need to be upgraded (e.g.
TCP and WS) some don't (e.g. QUIC or WebRTC). To differentiate the two we
execute two SQL queries (`queryResults` and `standaloneTransportsQueryResults`),
each with either a `AND _ NOT IN` or `AND _ IN`.

The previous implementation would use `node-sqlite3` query parameters (see
https://github.com/TryGhost/node-sqlite3/wiki/API#runsql--param---callback) to
provide the list of transport protocols that don't need upgrading as an array.

The problem is that `node-sqlite3` does not support arrays as query parameters,
see https://github.com/TryGhost/node-sqlite3/issues/762.

This commit uses string interpolation instead to inject the list of standalone
transports into the SQL queries.

* Nit

---------

Co-authored-by: Marco Munizaga <git@marcopolo.io>
Co-authored-by: Marco Munizaga <marco@marcopolo.io>
2023-07-05 16:57:30 -07:00
Marco Munizaga ec32d36cab
Add debug logging if JSON parse fails (#223) 2023-07-05 18:59:03 +00:00
github-actions[bot] 9277cff3bd chore: update the link to the interop dashboard [skip ci] 2023-07-05 06:34:30 +00:00
github-actions[bot] bd57868279 chore: update the link to the interop dashboard [skip ci] 2023-07-05 05:07:51 +00:00
Max Inden acea8b5e0c
fix(perf): increase MAX_AGE_MINUTES to 120 (#215)
- When experimenting with increasing iterations, instances are taken down
prematurely. See e.g. https://github.com/libp2p/test-plans/actions/runs/5418669631/jobs/9850992882

- When benchmarking from a local developer machine, experimenting for longer is useful.

- The AWS Lambda is only a safety net machanism. In the rare case where we
miss to clean up, running the machines for <1h or 2h doesn't matter cost wise.
2023-07-05 07:06:39 +02:00
Piotr Galar 1b187a379c
chore: move perf cleanup test code to a test directory (#216) 2023-07-05 05:46:58 +02:00
github-actions[bot] 4fd3b087d1 chore: update the link to the interop dashboard [skip ci] 2023-06-30 20:32:36 +00:00
github-actions[bot] ed962f61bb chore: update the link to the interop dashboard [skip ci] 2023-06-30 20:23:31 +00:00
Marco Munizaga a4e5381432
Remove often wrong patch version from id (#211) 2023-06-30 12:11:10 -07:00
github-actions[bot] 6fecac3b91 chore: update the link to the interop dashboard [skip ci] 2023-06-30 03:59:56 +00:00
Max Inden 0df7762587
chore(perf): document GitHub action usage (#212) 2023-06-30 04:25:05 +02:00
github-actions[bot] 7c43c940ce chore: update the link to the interop dashboard [skip ci] 2023-06-29 23:33:52 +00:00
Marco Munizaga 95f1277fed
Squash queries down to just 2 (#210) 2023-06-29 15:16:32 -07:00
github-actions[bot] 7268d72a65 chore: update the link to the interop dashboard [skip ci] 2023-06-29 21:04:08 +00:00