c45e77b0b5
Merge pull request #2571 from ralexstokes/add-timing-info-to-test-gen
...
add timing information to spec test generation
2021-08-26 17:14:52 -06:00
74fcf67cf4
Fix a performance bug with the randomized block tests from #2560
2021-08-26 13:42:12 -07:00
9474f0a051
construct and supply scenario-wide state to facilitate deposit processing
2021-08-26 12:02:59 -07:00
b45601f44c
add timing information to spec test generation
...
in particular, warn if any particular operation takes longer than
some threshold, e.g. 1.0 second.
2021-08-26 11:50:24 -07:00
1f34ef9b56
modularize the random deposit helpers
2021-08-26 10:50:50 -07:00
17fece57b6
Merge pull request #2560 from ralexstokes/add-broad-spectrum-spec-tests
...
Broad-spectrum randomized block tests
2021-08-25 20:34:47 -06:00
a890d04a62
Merge branch 'add-broad-spectrum-spec-tests' of https://github.com/ralexstokes/eth2.0-specs into add-broad-spectrum-spec-tests
2021-08-25 17:18:08 -07:00
874ea80cb8
use more precise name for altair block randomizer and re-gen tests
2021-08-25 17:18:02 -07:00
4b3022a767
Update tests/generators/random/generate.py
2021-08-25 16:19:46 -06:00
5b0d2627c3
apply pr feedback on randrange
2021-08-25 15:13:20 -07:00
c206a2772a
update docs via PR feedback
2021-08-25 14:46:17 -07:00
e2dc9f9ec2
update generation of randomized scenarios for more variability
2021-08-25 14:42:41 -07:00
047ff5b099
unify visibility on names for doc purposes
2021-08-25 14:16:39 -07:00
961953ac15
update parameter name
2021-08-25 13:10:41 -07:00
377797fd0d
code layout change
2021-08-25 11:20:17 -07:00
14518d4d64
update name of utility module to be more specific
2021-08-25 11:15:59 -07:00
a6f8870e18
update makefile to use correct python version
2021-08-25 11:15:27 -07:00
0da1fe947d
clarify how the random block generator works
2021-08-25 11:09:35 -07:00
81971a8957
update readme for pytest
2021-08-25 11:01:26 -07:00
e575b222be
clarify readme
2021-08-25 10:54:55 -07:00
e72edf07f9
consolidate call to `max` into `randrange`
2021-08-25 10:40:15 -07:00
4d4f4e89f4
be specific about which slot we want a sync committee root for
2021-08-25 10:38:01 -07:00
02bc6541d9
extend Makefile
2021-08-24 16:40:16 -07:00
7874e8db88
clean up unnecessary comment
2021-08-24 16:40:16 -07:00
33c96127da
fix bug with random sync aggregate helper
2021-08-24 16:40:15 -07:00
f7c0dc36be
skip running heavy randomized tests in CI
2021-08-24 15:05:07 -07:00
933c1323dd
lint updates
2021-08-24 14:46:31 -07:00
8a32bef58b
update skipped test count when test already exists
2021-08-24 13:19:31 -07:00
8e5a34c38a
adjust helper to account for additional slashings
2021-08-24 12:46:03 -07:00
d1f3ec59af
ensure at least 1 operation when making random block
2021-08-24 11:56:19 -07:00
c27e4d140e
move to code-gen under new test generator
2021-08-24 11:56:15 -07:00
505bdba8f8
fix imports
2021-08-23 12:49:36 -07:00
d037c6662a
lint fix
2021-08-23 12:40:42 -07:00
cc04da8e79
add randomized block tests for altair
2021-08-23 12:30:05 -07:00
58c6f33e85
ensure at least one proposer slashing
2021-08-23 12:15:22 -07:00
7b9d70fcec
allow test customization (for future forks)
2021-08-23 12:15:09 -07:00
ff6863e689
fix bug with deposit generation code
2021-08-23 12:01:05 -07:00
31d46247ce
file re-org to re-use for later forks
2021-08-23 11:48:22 -07:00
20e3934fa2
do not exit validators who are already exited
2021-08-23 11:46:20 -07:00
16423880aa
add multiple blocks to each test
2021-08-23 11:00:33 -07:00
6316c7d364
ensure at least 1 attester slashing
2021-08-23 10:29:39 -07:00
361d97c54b
fix bug with proposer search
2021-08-23 10:13:19 -07:00
15a6c48a46
Merge pull request #2518 from ethereum/fix-store-justified-checkpoint
...
Fix fork choice store checkpoints inconsistency issue
2021-08-23 23:41:11 +08:00
838c263c4a
Apply suggestions from code review
...
Co-authored-by: Aditya Asgaonkar <adiasg@users.noreply.github.com>
2021-08-23 23:21:15 +08:00
2db01ba6d0
use fixed seed for block randomization
2021-08-22 13:55:29 -07:00
253f927c0a
fix randomness seed across randomized test
2021-08-22 13:55:29 -07:00
0c401a3e2a
filter for exit eligibility in helper
2021-08-22 13:55:28 -07:00
ce471b702e
code org
2021-08-22 10:54:00 -07:00
f76a29c1f9
patch state to not be leaking at start
2021-08-22 10:52:22 -07:00
993997aca5
ensure no leak on "normal" transitions
2021-08-22 10:19:21 -07:00
270814e20f
fix bug with `_epochs_until_leak` helper
2021-08-22 09:59:28 -07:00
820affd2aa
extend validator set so randomized helpers have more room for operation
2021-08-22 09:58:54 -07:00
513f57f74c
formatting
2021-08-22 09:56:03 -07:00
b17ada2d67
only target phase 0 and altair for now
2021-08-21 18:24:26 -07:00
9e6a51ef70
update fn name for test id
2021-08-21 18:10:27 -07:00
fde71cbe74
add warnings if empty block
2021-08-21 18:10:27 -07:00
7bc2f9547a
skip validators when building a random block if they are slashed
2021-08-21 17:52:26 -07:00
86643d805a
adjust some helper code for randomized environment
...
1. randomized block helpers assume most of the validator set is not slashed
2. `randomize_state` helper slashes or exits ~1/2 of the validator set
So, adjust helpers to be less aggresive with exits and slashings and
to skip elements as needed if we happen to make something by
a validator who has been slashed.
2021-08-21 17:36:50 -07:00
6da2c7a916
ensure all validators in randomized test are active
2021-08-21 16:59:54 -07:00
5094193f9a
formatting
2021-08-21 16:59:02 -07:00
92aabcd207
add randomized block tests to test generator
2021-08-21 15:48:29 -07:00
619e828898
Progress on block test gen
2021-08-21 15:48:29 -07:00
4420d13816
add helper to check existence of many validator types
2021-08-21 15:48:29 -07:00
00df808f59
expose functionality to make random block
2021-08-21 15:48:28 -07:00
29c7184b7b
bump VERSION.txt to 1.1.0-beta.3
2021-08-20 08:42:22 -06:00
f30e7c8ef3
Merge pull request #2559 from ralexstokes/update-full-random-tests-to-all-phases
...
Extend randomized block tests to all phases
2021-08-20 08:20:55 -06:00
2c632c0087
Merge pull request #2555 from ethereum/great-renaming
...
modify docs for great renaming
2021-08-20 08:14:49 -06:00
eadefa274d
WIP: broad-spectrum randomized block tests
2021-08-19 12:54:21 -06:00
cdf1914e98
Extend randomized block tests to all phases
...
Some existing randomized block tests only ran for phase 0,
when they should run for all phases to increase overall test coverage.
2021-08-19 11:00:14 -06:00
70d4ddf613
Merge pull request #2556 from ralexstokes/add-randomized-testing-for-altair-inactivity-scores
...
Add randomized testing for altair inactivity scores
2021-08-19 07:42:46 -07:00
b809d86736
add test for `process_inactivity_updates` for randomized state
2021-08-19 07:43:16 -06:00
7f70a7704b
fix validator state during deposit randomization
2021-08-19 07:43:15 -06:00
4c1156d504
rename eth1 and eth2 throughout specs and readme where reasonable
2021-08-18 17:13:24 -06:00
f6aa54b66f
Merge pull request #2554 from ralexstokes/refactor-sync-committee-tests
...
Refactor sync committee tests
2021-08-18 16:38:56 -06:00
5a918dbdf3
Add test count to test gen diagnostics
2021-08-18 10:49:44 -06:00
5a17fa65b2
group test files into subdirectory
2021-08-18 10:49:44 -06:00
817d2ee7bf
Refactor sync committee tests so rewards are verified for all test cases
2021-08-18 10:49:43 -06:00
6ffc735642
Merge branch 'dev' into fix-store-justified-checkpoint
2021-08-17 21:28:42 +08:00
3a9dcbadf0
Merge pull request #2487 from ethereum/on-block-tests
...
Rework + add some `on_block` tests
2021-08-17 21:21:44 +08:00
471cc870c3
remove print statements
2021-08-16 13:10:58 -06:00
301157c027
Change base_fee_per_gas type to Bytes32
2021-08-13 14:21:37 +06:00
c404cd144a
Merge pull request #2533 from mkalinin/rebase-with-london
...
Rebase Merge spec with London
2021-08-10 16:37:32 -06:00
b184fa25a7
Merge pull request #2542 from ralexstokes/add-inactivity-updates-test-with-exited-validator
...
Add test for exited validators during inactivity leak
2021-08-06 08:58:01 -06:00
ad4445fa9e
Apply PR feedback from Danny and clean up the BLS test format docs
2021-08-06 16:39:35 +08:00
170d7dc023
Update tests/core/pyspec/eth2spec/test/altair/epoch_processing/test_process_inactivity_updates.py
...
Co-authored-by: Danny Ryan <dannyjryan@gmail.com>
2021-08-05 16:54:29 -07:00
6f56e33f00
Update tests/core/pyspec/eth2spec/test/altair/epoch_processing/test_process_inactivity_updates.py
...
Co-authored-by: Danny Ryan <dannyjryan@gmail.com>
2021-08-05 16:54:22 -07:00
93af122b2d
PR feedback from @ralexstokes and add single pubkey aggregate tests
2021-08-05 12:09:30 +08:00
3b86bd340f
Rename eth2_* to eth_*
2021-08-05 11:20:49 +08:00
a8383be878
Apply suggestions from code review
...
Co-authored-by: Alex Stokes <r.alex.stokes@gmail.com>
2021-08-05 11:12:36 +08:00
2ff143c719
Add test for exited validators during inactivity leak
2021-08-04 16:28:42 -07:00
43a1617ffa
Ensure that the given PKs are valid PKs + fix typos
2021-08-04 21:25:37 +08:00
d8d0686400
Add tests for the Altair BLS helpers
2021-08-04 02:07:57 +08:00
d58ffc7dfc
Add genesis settings section
2021-07-30 16:10:33 +06:00
9a1a30c3d4
Rebase Merge spec with London
2021-07-26 19:55:35 +06:00
37da2018a3
bump VERSION.txt to 1.1.0-beta.2
2021-07-23 08:22:53 -06:00
8318441474
Fix remaining merge-rebase-altair tests
2021-07-22 19:59:15 +02:00
17fad2dea2
rebase The Merge onto Altair base functionality
2021-07-22 16:36:41 +02:00
758b828ecb
Update slashing helper to avoid proposer.
...
Fixes #2521 .
2021-07-19 14:20:44 -07:00
f16cfe7c3a
update sync aggregate tests
2021-07-17 14:46:25 +02:00
11d54af89d
Add test to confirm infinite signature is invalid when there are participants.
2021-07-17 16:34:41 +10:00
f668b2b433
Add tests for SyncAggregate with no participants and all zero signature.
2021-07-17 16:26:18 +10:00
c420968f66
fix last beta.1 mainnet test
2021-07-14 11:11:24 -06:00
cc3690ce38
Add unit tests to test the new condition.
2021-07-14 20:05:14 +08:00
5582490364
Apply missing spec_test decorators, to handle generator_mode flag
2021-07-14 13:40:34 +02:00
b25d690ee8
bump VERSION.txt to 1.1.0-beta.1
2021-07-13 16:18:37 -06:00
93a31f9011
Fix test: use mainnet preset and accept deviation
2021-07-13 00:16:57 +08:00
0c01b9e812
Merge pull request #2511 from ethereum/inactivity-updates-tests
...
extend inactivity updates tests
2021-07-08 13:10:48 -06:00
f460870c11
clean up some leak tests
2021-07-08 12:50:45 -06:00
a5a48d5a23
PR feedback from @ralexstokes
2021-07-08 12:18:54 -06:00
19001055e9
Update tests/core/pyspec/eth2spec/test/altair/sanity/test_blocks.py
2021-07-08 06:14:47 -07:00
36d2dacdcf
added slashed tests to leak score tests
2021-07-07 16:10:06 -06:00
48382ce09c
extend inactivity updates tests
2021-07-07 12:20:34 -06:00
3161846aed
Apply suggestions from code review
2021-07-07 10:29:14 -06:00
fdcb0780d2
add randomized testing for sync aggregate block processing
2021-07-06 18:13:33 -07:00
ac8b4000d3
remove unnecessary assert
2021-07-06 17:28:55 -07:00
153e1b34dd
Merge pull request #2504 from ralexstokes/add-altair-process-sync-aggregate-tests
...
add more Altair tests for `process_sync_aggregate`
2021-07-02 15:55:22 -06:00
8ad73d75a6
Merge pull request #2505 from ethereum/test_get_sync_subcommittee_pubkeys
...
Add Altair networking helper tests
2021-07-02 15:33:49 -06:00
1865cdb4fc
add comment
2021-07-02 15:28:05 -06:00
2d4ff72b2d
Update tests/core/pyspec/eth2spec/test/altair/block_processing/test_process_sync_aggregate.py
...
Co-authored-by: Hsiao-Wei Wang <hsiaowei.eth@gmail.com>
2021-07-02 08:38:03 -07:00
3d7471a52c
Merge pull request #2502 from ethereum/sc-update-tests
...
add more process_sync_committee_updates tests
2021-07-02 09:33:35 -06:00
e95d71f85d
pr feedback
2021-07-02 09:25:08 -06:00
7bde1729b1
Add Altair networking helper tests
2021-07-02 14:42:02 +08:00
f9b4d7f287
add test for sync aggregate with proposer in sync committee
2021-07-01 17:36:30 -07:00
49c433746d
sync aggregate test with proposer in the committee
2021-07-01 17:35:48 -07:00
faf1ba1f4f
clean up test
...
this test does not need to collect the intermediate blocks it produces
2021-07-01 17:30:40 -07:00
b3a879c990
add tests for duplicated sync committee members with various amounts of participation
2021-07-01 17:30:40 -07:00
21aaab5a1e
add test for sync aggregate with bad domain in signature
2021-07-01 17:30:40 -07:00
2aa5bf8384
assert active validator set is larger than sync committee size
...
ensure set is larger, rather than just equal to
2021-07-01 16:35:03 -07:00
927b26636e
add more test_process_participation_flag_updates tests
2021-07-01 13:12:15 -06:00
0ed032d392
add more process_sync_committee_updates tests
2021-07-01 12:53:12 -06:00
bb327d274e
Add more Altair validator guide unit tests
...
Add `test_get_sync_committee_message`
Add `test_get_sync_committee_selection_proof`
Add `always_bls` deco
Add `test_is_sync_committee_aggregator`
Add `test_get_contribution_and_proof` and `test_get_contribution_and_proof_signature` + fixes
2021-07-01 22:49:23 +08:00
27763bdd86
clean up
2021-06-30 05:40:26 +08:00
29a93f6285
Move more unit tests to test vectors
2021-06-30 04:55:41 +08:00
44a3113ce1
fix spacing for linter
2021-06-24 09:24:58 -07:00
dbf7fbd3d0
encode, decode and randomize ssz Union types
2021-06-24 17:13:36 +02:00
989c9620c7
bump VERSION.txt to 1.1.0-alpha.8
2021-06-23 08:32:52 -06:00
f55afefe90
Move more tests from unittests to testgen tests
...
- `test_on_block_before_finalized`
- `test_on_block_finalized_skip_slots`
- `test_on_block_finalized_skip_slots_not_in_skip_chain`
2021-06-23 04:58:27 +08:00
69a645aa8b
Apply PR feedback
2021-06-23 04:50:13 +08:00
88be6cdf60
Apply Danny's suggestions from code review
...
Co-authored-by: Danny Ryan <dannyjryan@gmail.com>
2021-06-22 20:55:52 +08:00
83598af188
Add `test_new_justified_is_later_than_store_justified` and fix test
...
cases
- Fix `on_tick` calls
- Refactor test cases
2021-06-22 20:04:47 +08:00
e5c01061af
Add couple of cosmetic fixes
2021-06-22 14:26:38 +06:00
ac19aa3e2d
Accept polishing suggested by Justin
2021-06-22 14:23:26 +06:00
199d6aee58
Merge remote-tracking branch 'origin/dev' into randao_in_execution_payload
2021-06-19 00:28:38 +06:00
7a9ae57335
Minor formatting. `True` -> `true`, `False` -> `false`
2021-06-19 02:13:02 +08:00
2445fe5a76
Add new test cases
...
- `test_new_finalized_slot_is_not_justified_checkpoint_ancestor`
- `test_new_finalized_slot_is_justified_checkpoint_ancestor`
2021-06-19 02:03:37 +08:00
fb2465db45
Rework `on_block` unit tests
2021-06-19 02:03:33 +08:00
878b15df6a
polish merge/beacon-chain.md ( #2472 )
...
Polish `merge/beacon-chain.md` with mostly non-substantive changes.
**Non-substantive changes**
* rename `MAX_EXECUTION_TRANSACTIONS` to `MAX_TRANSACTIONS_PER_PAYLOAD`
- rename "execution transaction" to just "transaction" as per discussion with Danny
* rename `compute_time_at_slot` to `compute_timestamp_at_slot`
- the function returns a Unix timestamp
- "timestamp" matches `execution_payload.timestamp`
* be explicit about `ExecutionEngine.execution_state` for clarity
* rename `ExecutionPayload.number` to `ExecutionPayload.block_number`
- more specific ("number" is pretty vague)
- consistent with `ExecutionPayload.block_hash`
* rename `new_block` to `on_payload`
- the `on_` prefix is consistent with other event handlers (e.g. see `on_tick`, `on_block`, `on_attestation` [here](https://github.com/ethereum/eth2.0-specs/blob/dev/specs/phase0/fork-choice.md#handlers ))
- the `_payload` suffix is more to the point given the function accepts an `execution_payload`
- avoids conflict with `on_block` which is already used in the fork choice
* rework the table of contents for consistency
* order `is_execution_enabled` after `is_transition_completed` and `is_transition_block`
- `is_execution_enabled` refers to `is_transition_completed` and `is_transition_block`
* rename "transition" to "merge"
- "transition" is a bit vague—we will have other transitions at future hard forks
- there is no need for two words to refer to the same concept
* add a bunch of inline comments, e.g. in `process_execution_payload`
* make the `process_execution_payload` signature consistent with the other `process_` functions in `process_block` which take as arguments `state` and `block.body`
* remove `TRANSITION_TOTAL_DIFFICULTY`
- to be put in `merge/fork-choice.md` where it is used
* various misc cleanups
**Substantive changes**
* reorder `ExecutionPayload` fields
- for consistency with yellow paper and Eth1
- same for `ExecutionPayloadHeader`
- added comments separating out the execution block header fields from the extra fields (cosmetic)
2021-06-18 11:09:30 +01:00
6e86d8a696
Rename randao->random, other fixes as per review
2021-06-17 21:20:17 +06:00
42eae81013
WIP. Rework on_block tests
2021-06-15 21:52:25 +08:00
cc20b80103
Fix linter, add more test helpers
2021-06-15 14:55:06 +06:00
Danny Ryan
Alex Stokes
Hsiao-Wei Wang
Mikhail Kalinin
protolambda
Adrian Sutton
Justin