57f4b6f7cb
Merge pull request #103 from codex-storage/fix-randomNodes
...
fix potential infinite loop in randomNodes
2024-10-18 20:45:49 +02:00
ee4e2102d9
Merge pull request #99 from codex-storage/fix-removal
...
add link reliability metrics, fix aggressive node removal on first packet loss
2024-10-18 20:14:23 +02:00
a6cfe1a084
fix potential infinite loop in randomNodes
...
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2024-10-17 12:38:54 +02:00
1a344f1fd7
log reliability based on loss statistics
...
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2024-10-15 18:17:49 +02:00
fee5a9ced2
set NoreplyRemoveThreshold to 0.5
...
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2024-10-14 15:35:15 +02:00
6310c50ce0
introduce NoreplyRemoveThreshold
...
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
# Conflicts:
# codexdht/private/eth/p2p/discoveryv5/protocol.nim
2024-10-14 15:35:10 +02:00
7507e99c96
register "not seen" when missing replies
...
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2024-10-14 15:33:34 +02:00
02bc12e639
change node seen flag to an exponential moving average
...
keep defaults as before
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
# Conflicts:
# codexdht/private/eth/p2p/discoveryv5/node.nim
# codexdht/private/eth/p2p/discoveryv5/routing_table.nim
2024-10-14 15:33:29 +02:00
e1c1089e4f
fix aggressive node removal from on first packet loss
...
UDP packets get lost easily. We can't just remove
nodes from the routing table at first loss, as it can
create issues in small networks and in cases of temporary
connection failures.
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2024-10-14 15:28:09 +02:00
c1d2ea410d
Merge pull request #102 from codex-storage/measure-rtt-bw
...
Measure rtt, estimate bw, and log every 5 minutes
2024-10-14 14:19:35 +02:00
8b1660464d
don't log bandwidth estimates
...
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2024-10-14 13:57:52 +02:00
7057663f81
fixup: remove excessive debug
...
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2024-10-14 11:19:36 +02:00
ff5391a35e
Merge pull request #100 from codex-storage/metrics
...
rename and add more dht metrics
2024-10-10 12:51:09 +02:00
4ccaaee721
rename metrics to dht_ from discovery_
...
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
# Conflicts:
# codexdht/private/eth/p2p/discoveryv5/transport.nim
2024-10-10 11:44:26 +02:00
80cc069c5e
metrics: add transport byte counters
...
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
# Conflicts:
# codexdht/private/eth/p2p/discoveryv5/transport.nim
2024-10-10 11:43:23 +02:00
ffeeeeb3fb
transport: add metrics
...
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
# Conflicts:
# codexdht/private/eth/p2p/discoveryv5/transport.nim
2024-10-10 11:42:11 +02:00
4d2250477e
metrics: add discovery_routing_table_buckets
...
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2024-10-10 11:40:45 +02:00
b7b04ed9e4
metrics: rename routing_table_nodes to discovery_routing_table_nodes
...
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2024-10-10 11:40:44 +02:00
6e180af4aa
Merge pull request #101 from codex-storage/logging
...
Logging updates
2024-10-10 11:22:23 +02:00
706cb50041
add debugPrintLoop to print neighborhood info
...
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2024-10-08 11:31:06 +02:00
0825d887ea
add bandwidth estimate
...
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2024-10-08 11:31:06 +02:00
ec4f0d4a84
add transport level RTT measurement
...
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2024-10-08 11:18:02 +02:00
0b69de242f
add rtt measurement
...
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2024-10-08 11:17:58 +02:00
f3eec2a202
node: add RTT and bandwidth measurement holders
...
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2024-10-08 11:17:29 +02:00
f6971cc947
logging: better logging of SPR update
...
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2024-10-08 11:15:50 +02:00
4d9e39d86c
transport: improve logging
...
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
# Conflicts:
# codexdht/private/eth/p2p/discoveryv5/transport.nim
2024-10-08 11:15:20 +02:00
b8bcb2d08d
Merge pull request #95 from codex-storage/factorize
...
Factorize code
2024-10-07 14:06:59 +02:00
f121d080e7
Merge pull request #96 from codex-storage/reduce-timeouts
...
Reduce timeouts
2024-10-03 10:54:44 +02:00
fef297c622
Merge pull request #94 from codex-storage/feature-FindNodeFastResultLimit
...
Add separate limit for results returned in FindNodeFast
2024-10-01 15:04:26 +02:00
936a5ec6fa
Merge pull request #93 from codex-storage/fix-FindNodeResultLimit
...
fix returning too many nodes when FindNodeResultLimit!=BUCKET_SIZE
2024-10-01 14:51:33 +02:00
9acdca795b
routing table logging update ( #97 )
...
* Clear logs for adding and removing of nodes. routingtable log topic for filtering.
* Makes node ID shortening consistent with other short-id formats
* redundant else block
* fixes dependencies
2024-09-23 15:49:08 +02:00
5f38fd9570
GCC-14 ( #98 )
...
* bumps bearssl
* updates version of bearssl in lockfiles
* fixes that checksum
* attempt to bump various dependencies
* updates asynctest version tag
* asynctest sha
* bumps to working version of nim-datastore
* adjusts asynctest imports for chronos
* chronos checksum
* checksum for datastore
* libp2p version tag
* libp2p checksum
* moves libp2p from codex-branch to latest master
* libp2p checksum
* splits the test dependencies from the dev dependencies (example nim-ethers)
* sets path
* pathing in tests
* oops wrong version
* adds build.nims to installfiles for test module
* attempt to fix import paths
* bumps nim-datastore
* datastore checksum
* greatly simplify CI
* fixes asynctest import
* builds parallel tests before running
* bumps datastore
* turns nim-stable back off
* pins nim-datastore version
* bumps checkout to v4
* Review comment by Mark
Co-authored-by: markspanbroek <mark@spanbroek.net>
* Review comment by Mark
Co-authored-by: markspanbroek <mark@spanbroek.net>
---------
Co-authored-by: markspanbroek <mark@spanbroek.net>
2024-08-20 11:04:48 +02:00
5624700855
reduce default timeouts
...
We really don't need these to be 2 and 4 seconds.
Later we should tune it better based on measurements
or estimates. We should also check the relation between
these three values.
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2024-07-01 04:34:10 +02:00
76da855725
use handshakeTimeout if handshake starting in sendMessage
...
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2024-07-01 04:20:20 +02:00
4c9c92232b
remove unused sendRequest call
...
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2024-07-01 04:14:17 +02:00
148b10908d
trace log: do not log binary encoding
...
Even at trace level this feels too much.
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2024-07-01 04:14:13 +02:00
f299c23e2e
remove lookupWorkerFast duplicate code
...
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2024-07-01 04:14:03 +02:00
bdf57381e3
introduce FindNodeFastResultLimit
...
We do not need that many responses with FindNodeFast, since the
reposes can be ordered by distance
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2024-07-01 04:06:43 +02:00
4b82bdc2f9
fix returning too many nodes when FindNodeResultLimit!=BUCKET_SIZE
...
Code assumed these two values to be the same, resulting in
reception errors.
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2024-07-01 03:55:03 +02:00
d8160ff0f7
add logging helper for Protocol
...
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2024-06-28 17:39:13 +02:00
f766cb39b1
encoding: introducing type cipher=aes128
...
Introducing the cipher type to ease changing cipher.
No functional change
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2024-06-28 17:37:26 +02:00
316464fc71
dht: waitMessage: expose timeout as parameter, keeping default
...
defults to ResponseTimeout as before
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2024-06-28 17:35:29 +02:00
6e61e02091
fixup: move sendRequest forward
...
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2024-06-28 17:34:49 +02:00
dfff39091b
introduce waitResponse wrapper
...
initialize wait for response before sending request.
This is needed in cases where the response arrives before
moving to the next instruction, such as a directly connected
test.
Signed-off-by: Csaba Kiraly <csaba.kiraly@gmail.com>
2024-06-28 17:33:56 +02:00
63822e8356
Update nim-codex-dht to Chronos V4 ( #90 )
...
Update nim-codex-dht to Chronos v4
2024-05-23 17:49:44 -03:00
2299317116
Merge pull request #91 from codex-storage/chore/update-libp2p-repo
...
Update repo for libp2p
2024-03-18 19:40:01 -03:00
717cd0a50c
Merge branch 'master' into chore/update-libp2p-repo
2024-03-18 19:11:57 -03:00
223ce9240b
Merge pull request #92 from codex-storage/fix/nimble-archive-osx
...
fix name for nimble archive for OSX
2024-03-18 19:11:28 -03:00
709a873862
fix name for nimble archive for OSX
2024-03-18 18:48:04 -03:00
b3d01245e9
update repo for libp2p
2024-03-18 18:42:48 -03:00
Csaba Kiraly
Csaba Kiraly
Ben Bierens
Giuliano Mega