Commit Graph

56 Commits

Author SHA1 Message Date
Richard Ramos 83c4b5f04e
chore: choose store version 2024-06-06 19:44:36 -04:00
Richard Ramos 608d8c2b09
feat: add query tool 2024-06-06 19:29:09 -04:00
Richard Ramos 8969e4a1d0
chore: update go-waku 2024-05-24 13:44:53 -04:00
Ivan Folgueira Bande 209913ed4f
Update waku-store-request-maker image
The latest image, 1b7c16, introduces the following:

    Passing peers as a list and using pubsubTopic & contentTopic params

    This commit represents changes on how the parameters are handled.
    There are many automatic/formatic changes made by the IDE.
    The major changes are:
    - The user can pass a comma-separated list of peers
    (peer-store-sqlite-addr-list and peer-store-postgres-addr-list.)
- The pubsubTopic and contentTopic, which are part of the Store
request,
    can be passed as a parameters as well.
2023-11-28 11:21:47 +01:00
Ivan Folgueira Bande aa91ff6b82
Giving more trials when trying to connect to the bootstrap node 2023-11-27 18:49:27 +01:00
Ivan Folgueira Bande fef29cea18
run_nwaku_store_postgres_ubuntu: Removing unused line 2023-11-27 15:43:48 +01:00
Ivan Folgueira Bande cfc0a5596d Setting a similar topology to status.test fleet 2023-11-27 15:41:30 +01:00
Ivan Folgueira Bande 214367dbbb Avoid db-postgres-hammer to full the disk with logs 2023-11-27 15:41:30 +01:00
Ivan Folgueira Bande c4abd5b04a Better depends_on in docker compose file 2023-11-27 15:41:30 +01:00
Ivan Folgueira Bande fe01c381f9 simple change typo in comment 2023-11-27 15:41:30 +01:00
Ivan Folgueira Bande 086dd971a4 Adding node replicas to perform insert operations to the database 2023-11-27 15:41:30 +01:00
Ivan Folgueira Bande 50c8a6c678 run_database_hammer.sh: comment out sleep command for intense queries 2023-11-27 15:41:30 +01:00
Ivan Folgueira Bande 052aff45bd Allowing logs from db-postgres-hammer container 2023-11-27 15:41:30 +01:00
Ivan Folgueira Bande c824a8018e simplification of database hammer code base 2023-11-27 15:41:30 +01:00
Ivan Folgueira Bande 6236cc3d54 Adding new 'db-postgres-hammer' service to stress PostgreSQL DB 2023-11-27 15:41:30 +01:00
Ivan Folgueira Bande d8ed7607b2 docker-compose-manual-binaries: using shared folder for sqlite binary 2023-11-07 12:57:20 +01:00
Ivan Folgueira Bande 03bd17cdb1 docker-compose-manual-binaries add MALLOC_CHECK_ debug possible crashes 2023-11-07 12:57:20 +01:00
Ivan Folgueira Bande fd1f70610d max-connections=2 in both sqlite and postgres nodes 2023-11-07 12:57:20 +01:00
Ivan Folgueira Bande 623988e99b Stop using the "replica" concept from docker-compose-manual-binaries 2023-11-07 12:57:20 +01:00
Ivan Folgueira Bande 3c602482b2 limin max peers in both postgres and sqlite nodes
This is aimed to narrow down the test environment and avoid
interferences because we have different number of nodes sharing
messages.
2023-11-07 12:57:20 +01:00
Ivan Folgueira Bande 013d62d17d docker-compose-manual: set num users store_query_maker from env 2023-11-07 12:57:20 +01:00
Ivan Folgueira Bande b00e5be192 run_bootstrap: adding status.prod dns-discovery-url 2023-11-07 12:57:20 +01:00
Ivan Folgueira Bande 77b3387137 Moving jmeter related files to a jmeter folder 2023-11-07 12:57:20 +01:00
Ivan Folgueira Bande 7090cd125e Setting retention policy limit to 12mil messages 2023-10-23 22:43:21 +02:00
Ivan Folgueira Bande f2099153e6 docker-compose-manual-binaries: expose metrics ports 2023-10-23 22:43:21 +02:00
Ivan Folgueira Bande ca409b4966 docker-compose-manual-binaries: limit for more realistic container
The CPU and memory limits are set as per the dimension
of the machine used in wakuv2.prod.
2023-10-23 22:43:21 +02:00
Ivan Folgueira Bande a3ea38b0eb docker-compose-manual-binaries.yml /home/shared folder for metal-01.he-eu-hel1.wakudev.misc 2023-10-23 22:43:21 +02:00
Ivan Folgueira Bande 2d85df9cd5 postgres.conf for 2GB RAM and 1 core 2023-10-23 22:43:21 +02:00
Ivan Folgueira Bande ebef1fd33f docker-compose-manual-binaries.yml - limit the num of store queries to 1 2023-10-23 22:43:21 +02:00
Ivan Folgueira Bande 989c4f5ac3 docker/run_waku_store_query_maker: reduce num concurrent users 2023-10-23 22:43:21 +02:00
Ivan Folgueira Bande 8e3ed8aa7e Connecting nodes with bootstrap node and adding go-waku store clients
One "go-waku" relay node is responsible for generating
traffic, which in turns creates "insert" events. And another
go-waku node that acts as a store client to generate "store"
requests to both "sqlite" and "postgres" nwaku store nodes.
2023-10-23 22:43:21 +02:00
Ivan Folgueira Bande 4a6cea6c68 Introducing a richer dashboard where we can compare better 2023-10-23 22:43:21 +02:00
Ivan Folgueira Bande afea9054b2 docker-compose.yml: uncommenting the 'msg_publisher'. 2023-10-23 22:43:21 +02:00
Ivan Folgueira Bande 00b4be5021 Changing log level to debug in 'run_nwaku_store_postgres|sqlite.sh' 2023-10-23 22:43:21 +02:00
Ivan Folgueira Bande 1002b6ebb4 docker-compose.yml
Uncommenting publisher container.
Exposing ports outside the containers.
Upgrading pending containers to nwaku version 0.20.0.
2023-10-23 22:43:21 +02:00
Ivan Folgueira Bande b025e85816 docker/msg_publisher.sh: setting a more realisting message size 2023-10-15 20:28:11 +02:00
Ivan Folgueira Bande d025a62e47 sh/publish_one_client.sh: adding content topic 2023-10-15 20:28:11 +02:00
Ivan Folgueira Bande 5c80a9fb7f docker compose: not exposing ports 2023-10-15 20:28:11 +02:00
Ivan Folgueira Bande 19fdb11f20 docker-compose-manual-binaries.yml: adapting to metal-01.he-eu-hel1.wakudev.misc.statusim.net 2023-10-15 20:28:11 +02:00
Ivan Folgueira Bande d73ed6e93b docker: adding scripts to perform comparison with locally built binary 2023-10-15 20:28:11 +02:00
Ivan Folgueira Bande a8529c7b49 go/main_test.go: adding new test to compare databases performance 2023-10-15 20:28:11 +02:00
Ivan Folgueira Bande a65882529d docker/run_nwaku_store_store|sqlite.sh: capacity retention policy 2023-10-15 20:28:11 +02:00
Ivan Folgueira Bande 025639b180 msg_publisher.sh: making it to publish random messages 2023-10-15 20:28:11 +02:00
Ivan Folgueira Bande 375a2b524b docker-compose-yml: updating images versions 2023-10-15 20:28:11 +02:00
Ivan Folgueira Bande ed6cce6ef2
Merge pull request #5 from waku-org/add-jmeter
Including jmeter to allow concurrent Store requests easily
2023-09-08 10:59:41 +02:00
Ivan Folgueira Bande 016941972d
Including jmeter to allow concurrent Store requests easily 2023-09-05 14:44:57 +02:00
Ivan Folgueira Bande 0273e77c0f
Merge pull request #4 from waku-org/docker-testing-approach
chore(store): adding a Docker compose option that allows to compare postgres & sqlite metrics
2023-08-30 18:29:52 +02:00
Ivan Folgueira Bande 49415b209b
Grafana dashboard: setting the default period time to "last 5 min" 2023-08-25 10:45:37 +02:00
Ivan Folgueira Bande 7cdd7e4fad
Setting storenode counter parts
With this parameter, each node is configured as "store client" and the
"store server" is the one indicated in the "storenode" parameter.
2023-08-25 10:27:41 +02:00
Ivan Folgueira Bande 0068bb24b8
adding a Docker compose option that allows to compare postgres & sqlite metrics 2023-08-24 19:25:29 +02:00