optimism: historical Bedrock geth rollup changes
This commit squashes the op-geth fork history into a more maintainable
diff for rebasing upon upstream geth.
reference-optimistic-geth changes (origins of op-geth in early Bedrock
development stage):
- Deposit TX Type
- Enable deposit tx in EVM/tx pool
- Change deposit nonce to not be the max nonce
- Extend PayloadAttributesV1 with a Transactions field
- Force deposits at the start of each L2 block
- Fix height check
- noTxPool flag, reproduce block in verifier mode without tx pool interference
- Fix RPC json marshalling (ref op-geth PR 4)
- Deposit txs block height check in block body validation (ref op-geth PR 5)
- core: do not try to reinject deposit txs into tx-pool (ref-op-geth PR 6)
- deposit source hash field instead of L2 block height and tx index combination
- Include invalid deposits, rewind state, but always persist mint (#10)
- Provide gas to Call/Create in deposit transactions (#12)
- Add docker builds (ref-op-geth PR 16, 17)
- Don't panic on deposit transaction signature values or chain ID (ref-op-geth PR 18)
- core: Add version to DepositTx (ref-op-geth PR 19)
- Enable Geth build/lint/test in CircleCI (ref-op-geth PR 23)
- core: Include guaranteed gas in the gas pool (ref-op-geth PR 21)
- core: handle base fee, l1 availability fee, tx fee (ref-op-geth PR 27)
- fix: deposit tx hash
- fix l1 fee cache, rpc, tracing and tx pool
- core: remove deposit-tx sub-type (a.k.a. deposit version byte)
- eth/catalyst: allow engine user to reorg own chain
- miner: restore ability to reorg deep as block builder
- params: print Optimism consensus type in banner
- core/types: remove unused protected() method, see upstream PR 23376
- core: do not mutate original balance value in tx pool l1 cost adjustment
- core: subtract deposit gas from pool, so other txs do not use the same gas. And fail tx processing if deposits reach gas limit
- core/types: deposits do not tip, avoid basefee subtraction
- Unmeter the L1 Attributes Transaction
- miner: handle force tx errors as critical, clean up diff
- ci: Switch branch
- eth,miner: return STATUS_INVALID when failing to process forced transactions in request (ref-op-geth PR 40)
- verifier: forward tx to sequencer based on flag
- txpool: add flag to disable tx gossip (ref-op-geth PR 42)
- Add op-geth version in addition to geth version (ref-op-geth PR 43)
- ci: CircleCI improvements (ref-op-geth PR 44)
- Rename to op-geth
- Build latest tag on optimism branch
op-geth changes:
- Expose cache config in simulated backend (#2)
- Add EIP-1559 parameters
- eth/catalyst: update payload id computation (#1)
- make eip1559 configurable (#4)
- post-merge network should not log warnings about missing transition information (#5)
- Make the simulator more configurable (#6)
- fix OPB-6 - IsDepositTx check instead of artificial nonce value check (#7)
- Simulated backend - enable proof of stake consensus type and fix performance issue (#8)
- accounts: simulated backend consensus engine option and immediate tx indexing
- consensus/beacon: recognize all blocks as reached TTD with 0 TTD in chain config
- Add --rollup.historicalhttp CLI flag and fix backend iface
- Flags and interfaces for historical RPC requests (#12)
- Redirect historical RPC requests (#13)
- Use the pre-existing ethereum.NotFound error (#18)
- Add historical endpoint to TraceBlockByNumber and TraceBlockByHash (#19)
- Add historical endpoint to TraceTransaction (#20)
- Add historical endpoint to TraceCall (#21)
- optimism: fee params from info txi, update l1 cost func GPO params read (#15)
- add hardcoded addresses for fee payouts (#23)
- dynamic gas limit via engine API (#22)
Co-authored-by: Matthew Slipper <me@matthewslipper.com>
Co-authored-by: Joshua Gutow <jgutow@oplabs.co>
Co-authored-by: protolambda <proto@protolambda.com>
Co-authored-by: Mark Tyneway <mark.tyneway@gmail.com>
Co-authored-by: Maurelian <maurelian@protonmail.ch>
2022-03-10 12:13:11 -08:00
|
|
|
version: 2.1
|
|
|
|
|
2023-03-03 17:09:02 -07:00
|
|
|
orbs:
|
|
|
|
gcp-cli: circleci/gcp-cli@3.0.1
|
|
|
|
|
|
|
|
commands:
|
|
|
|
gcp-oidc-authenticate:
|
|
|
|
description: "Authenticate with GCP using a CircleCI OIDC token."
|
|
|
|
parameters:
|
|
|
|
project_id:
|
|
|
|
type: env_var_name
|
|
|
|
default: GCP_PROJECT_ID
|
|
|
|
workload_identity_pool_id:
|
|
|
|
type: env_var_name
|
|
|
|
default: GCP_WIP_ID
|
|
|
|
workload_identity_pool_provider_id:
|
|
|
|
type: env_var_name
|
|
|
|
default: GCP_WIP_PROVIDER_ID
|
|
|
|
service_account_email:
|
|
|
|
type: env_var_name
|
|
|
|
default: GCP_SERVICE_ACCOUNT_EMAIL
|
|
|
|
gcp_cred_config_file_path:
|
|
|
|
type: string
|
|
|
|
default: /home/circleci/gcp_cred_config.json
|
|
|
|
oidc_token_file_path:
|
|
|
|
type: string
|
|
|
|
default: /home/circleci/oidc_token.json
|
|
|
|
steps:
|
|
|
|
- run:
|
|
|
|
name: "Create OIDC credential configuration"
|
|
|
|
command: |
|
|
|
|
# Store OIDC token in temp file
|
|
|
|
echo $CIRCLE_OIDC_TOKEN > << parameters.oidc_token_file_path >>
|
|
|
|
# Create a credential configuration for the generated OIDC ID Token
|
|
|
|
gcloud iam workload-identity-pools create-cred-config \
|
|
|
|
"projects/${<< parameters.project_id >>}/locations/global/workloadIdentityPools/${<< parameters.workload_identity_pool_id >>}/providers/${<< parameters.workload_identity_pool_provider_id >>}"\
|
|
|
|
--output-file="<< parameters.gcp_cred_config_file_path >>" \
|
|
|
|
--service-account="${<< parameters.service_account_email >>}" \
|
|
|
|
--credential-source-file=<< parameters.oidc_token_file_path >>
|
|
|
|
- run:
|
|
|
|
name: "Authenticate with GCP using OIDC"
|
|
|
|
command: |
|
|
|
|
# Configure gcloud to leverage the generated credential configuration
|
|
|
|
gcloud auth login --brief --cred-file "<< parameters.gcp_cred_config_file_path >>"
|
|
|
|
# Configure ADC
|
|
|
|
echo "export GOOGLE_APPLICATION_CREDENTIALS='<< parameters.gcp_cred_config_file_path >>'" | tee -a "$BASH_ENV"
|
|
|
|
|
optimism: historical Bedrock geth rollup changes
This commit squashes the op-geth fork history into a more maintainable
diff for rebasing upon upstream geth.
reference-optimistic-geth changes (origins of op-geth in early Bedrock
development stage):
- Deposit TX Type
- Enable deposit tx in EVM/tx pool
- Change deposit nonce to not be the max nonce
- Extend PayloadAttributesV1 with a Transactions field
- Force deposits at the start of each L2 block
- Fix height check
- noTxPool flag, reproduce block in verifier mode without tx pool interference
- Fix RPC json marshalling (ref op-geth PR 4)
- Deposit txs block height check in block body validation (ref op-geth PR 5)
- core: do not try to reinject deposit txs into tx-pool (ref-op-geth PR 6)
- deposit source hash field instead of L2 block height and tx index combination
- Include invalid deposits, rewind state, but always persist mint (#10)
- Provide gas to Call/Create in deposit transactions (#12)
- Add docker builds (ref-op-geth PR 16, 17)
- Don't panic on deposit transaction signature values or chain ID (ref-op-geth PR 18)
- core: Add version to DepositTx (ref-op-geth PR 19)
- Enable Geth build/lint/test in CircleCI (ref-op-geth PR 23)
- core: Include guaranteed gas in the gas pool (ref-op-geth PR 21)
- core: handle base fee, l1 availability fee, tx fee (ref-op-geth PR 27)
- fix: deposit tx hash
- fix l1 fee cache, rpc, tracing and tx pool
- core: remove deposit-tx sub-type (a.k.a. deposit version byte)
- eth/catalyst: allow engine user to reorg own chain
- miner: restore ability to reorg deep as block builder
- params: print Optimism consensus type in banner
- core/types: remove unused protected() method, see upstream PR 23376
- core: do not mutate original balance value in tx pool l1 cost adjustment
- core: subtract deposit gas from pool, so other txs do not use the same gas. And fail tx processing if deposits reach gas limit
- core/types: deposits do not tip, avoid basefee subtraction
- Unmeter the L1 Attributes Transaction
- miner: handle force tx errors as critical, clean up diff
- ci: Switch branch
- eth,miner: return STATUS_INVALID when failing to process forced transactions in request (ref-op-geth PR 40)
- verifier: forward tx to sequencer based on flag
- txpool: add flag to disable tx gossip (ref-op-geth PR 42)
- Add op-geth version in addition to geth version (ref-op-geth PR 43)
- ci: CircleCI improvements (ref-op-geth PR 44)
- Rename to op-geth
- Build latest tag on optimism branch
op-geth changes:
- Expose cache config in simulated backend (#2)
- Add EIP-1559 parameters
- eth/catalyst: update payload id computation (#1)
- make eip1559 configurable (#4)
- post-merge network should not log warnings about missing transition information (#5)
- Make the simulator more configurable (#6)
- fix OPB-6 - IsDepositTx check instead of artificial nonce value check (#7)
- Simulated backend - enable proof of stake consensus type and fix performance issue (#8)
- accounts: simulated backend consensus engine option and immediate tx indexing
- consensus/beacon: recognize all blocks as reached TTD with 0 TTD in chain config
- Add --rollup.historicalhttp CLI flag and fix backend iface
- Flags and interfaces for historical RPC requests (#12)
- Redirect historical RPC requests (#13)
- Use the pre-existing ethereum.NotFound error (#18)
- Add historical endpoint to TraceBlockByNumber and TraceBlockByHash (#19)
- Add historical endpoint to TraceTransaction (#20)
- Add historical endpoint to TraceCall (#21)
- optimism: fee params from info txi, update l1 cost func GPO params read (#15)
- add hardcoded addresses for fee payouts (#23)
- dynamic gas limit via engine API (#22)
Co-authored-by: Matthew Slipper <me@matthewslipper.com>
Co-authored-by: Joshua Gutow <jgutow@oplabs.co>
Co-authored-by: protolambda <proto@protolambda.com>
Co-authored-by: Mark Tyneway <mark.tyneway@gmail.com>
Co-authored-by: Maurelian <maurelian@protonmail.ch>
2022-03-10 12:13:11 -08:00
|
|
|
jobs:
|
2023-03-03 17:09:02 -07:00
|
|
|
docker-release:
|
|
|
|
environment:
|
|
|
|
DOCKER_BUILDKIT: 1
|
|
|
|
parameters:
|
|
|
|
docker_name:
|
|
|
|
description: Docker image name
|
|
|
|
type: string
|
|
|
|
default: "op-geth"
|
|
|
|
docker_tags:
|
|
|
|
description: Docker image tags as csv
|
|
|
|
type: string
|
|
|
|
registry:
|
|
|
|
description: Docker registry
|
|
|
|
type: string
|
|
|
|
default: "us-docker.pkg.dev"
|
|
|
|
repo:
|
|
|
|
description: Docker repo
|
|
|
|
type: string
|
|
|
|
default: "oplabs-tools-artifacts/images"
|
|
|
|
machine:
|
|
|
|
image: ubuntu-2204:2022.07.1
|
|
|
|
resource_class: xlarge
|
|
|
|
steps:
|
|
|
|
- gcp-cli/install
|
|
|
|
- gcp-oidc-authenticate
|
|
|
|
- checkout
|
|
|
|
- run:
|
|
|
|
name: Configure Docker
|
|
|
|
command: |
|
|
|
|
gcloud auth configure-docker <<parameters.registry>>
|
|
|
|
- run:
|
|
|
|
name: Build and push
|
|
|
|
command: |
|
2023-03-06 21:43:15 -07:00
|
|
|
RAW_TAGS="<<parameters.docker_tags>>"
|
|
|
|
if [ "$CIRCLE_BRANCH" = "optimism" ]; then
|
|
|
|
RAW_TAGS="$RAW_TAGS,optimism"
|
|
|
|
fi
|
2023-03-03 17:09:02 -07:00
|
|
|
IMAGE_BASE="<<parameters.registry>>/<<parameters.repo>>/<<parameters.docker_name>>"
|
2023-03-06 21:43:15 -07:00
|
|
|
DOCKER_TAGS=$(echo -ne "$RAW_TAGS" | sed "s/,/\n/g" | sed "s/[^a-zA-Z0-9\n.]/-/g" | sed -e "s|^|-t ${IMAGE_BASE}:|")
|
2023-03-03 17:09:02 -07:00
|
|
|
docker context create buildx-build
|
|
|
|
docker buildx create --use buildx-build
|
|
|
|
docker buildx build --push \
|
|
|
|
$(echo -ne $DOCKER_TAGS | tr '\n' ' ') \
|
|
|
|
--platform=linux/arm64,linux/amd64 \
|
|
|
|
--build-arg VERSION=$CIRCLE_TAG \
|
|
|
|
--build-arg COMMIT=$CIRCLE_SHA \
|
|
|
|
--build-arg BUILDNUM=$CIRCLE_BUILD_NUM \
|
|
|
|
--progress plain \
|
|
|
|
-f Dockerfile .
|
|
|
|
|
optimism: historical Bedrock geth rollup changes
This commit squashes the op-geth fork history into a more maintainable
diff for rebasing upon upstream geth.
reference-optimistic-geth changes (origins of op-geth in early Bedrock
development stage):
- Deposit TX Type
- Enable deposit tx in EVM/tx pool
- Change deposit nonce to not be the max nonce
- Extend PayloadAttributesV1 with a Transactions field
- Force deposits at the start of each L2 block
- Fix height check
- noTxPool flag, reproduce block in verifier mode without tx pool interference
- Fix RPC json marshalling (ref op-geth PR 4)
- Deposit txs block height check in block body validation (ref op-geth PR 5)
- core: do not try to reinject deposit txs into tx-pool (ref-op-geth PR 6)
- deposit source hash field instead of L2 block height and tx index combination
- Include invalid deposits, rewind state, but always persist mint (#10)
- Provide gas to Call/Create in deposit transactions (#12)
- Add docker builds (ref-op-geth PR 16, 17)
- Don't panic on deposit transaction signature values or chain ID (ref-op-geth PR 18)
- core: Add version to DepositTx (ref-op-geth PR 19)
- Enable Geth build/lint/test in CircleCI (ref-op-geth PR 23)
- core: Include guaranteed gas in the gas pool (ref-op-geth PR 21)
- core: handle base fee, l1 availability fee, tx fee (ref-op-geth PR 27)
- fix: deposit tx hash
- fix l1 fee cache, rpc, tracing and tx pool
- core: remove deposit-tx sub-type (a.k.a. deposit version byte)
- eth/catalyst: allow engine user to reorg own chain
- miner: restore ability to reorg deep as block builder
- params: print Optimism consensus type in banner
- core/types: remove unused protected() method, see upstream PR 23376
- core: do not mutate original balance value in tx pool l1 cost adjustment
- core: subtract deposit gas from pool, so other txs do not use the same gas. And fail tx processing if deposits reach gas limit
- core/types: deposits do not tip, avoid basefee subtraction
- Unmeter the L1 Attributes Transaction
- miner: handle force tx errors as critical, clean up diff
- ci: Switch branch
- eth,miner: return STATUS_INVALID when failing to process forced transactions in request (ref-op-geth PR 40)
- verifier: forward tx to sequencer based on flag
- txpool: add flag to disable tx gossip (ref-op-geth PR 42)
- Add op-geth version in addition to geth version (ref-op-geth PR 43)
- ci: CircleCI improvements (ref-op-geth PR 44)
- Rename to op-geth
- Build latest tag on optimism branch
op-geth changes:
- Expose cache config in simulated backend (#2)
- Add EIP-1559 parameters
- eth/catalyst: update payload id computation (#1)
- make eip1559 configurable (#4)
- post-merge network should not log warnings about missing transition information (#5)
- Make the simulator more configurable (#6)
- fix OPB-6 - IsDepositTx check instead of artificial nonce value check (#7)
- Simulated backend - enable proof of stake consensus type and fix performance issue (#8)
- accounts: simulated backend consensus engine option and immediate tx indexing
- consensus/beacon: recognize all blocks as reached TTD with 0 TTD in chain config
- Add --rollup.historicalhttp CLI flag and fix backend iface
- Flags and interfaces for historical RPC requests (#12)
- Redirect historical RPC requests (#13)
- Use the pre-existing ethereum.NotFound error (#18)
- Add historical endpoint to TraceBlockByNumber and TraceBlockByHash (#19)
- Add historical endpoint to TraceTransaction (#20)
- Add historical endpoint to TraceCall (#21)
- optimism: fee params from info txi, update l1 cost func GPO params read (#15)
- add hardcoded addresses for fee payouts (#23)
- dynamic gas limit via engine API (#22)
Co-authored-by: Matthew Slipper <me@matthewslipper.com>
Co-authored-by: Joshua Gutow <jgutow@oplabs.co>
Co-authored-by: protolambda <proto@protolambda.com>
Co-authored-by: Mark Tyneway <mark.tyneway@gmail.com>
Co-authored-by: Maurelian <maurelian@protonmail.ch>
2022-03-10 12:13:11 -08:00
|
|
|
build-geth:
|
|
|
|
docker:
|
|
|
|
- image: cimg/go:1.18
|
|
|
|
resource_class: medium
|
|
|
|
steps:
|
|
|
|
- checkout
|
|
|
|
- run:
|
|
|
|
command: go run build/ci.go install
|
|
|
|
unit-test:
|
|
|
|
resource_class: medium
|
|
|
|
docker:
|
|
|
|
- image: cimg/go:1.18
|
|
|
|
steps:
|
|
|
|
- checkout
|
|
|
|
- run:
|
|
|
|
command: go run build/ci.go test
|
|
|
|
lint-geth:
|
|
|
|
resource_class: medium
|
|
|
|
docker:
|
|
|
|
- image: cimg/go:1.18
|
|
|
|
steps:
|
|
|
|
- checkout
|
|
|
|
- run:
|
|
|
|
command: go run build/ci.go lint
|
|
|
|
|
|
|
|
workflows:
|
|
|
|
main:
|
|
|
|
jobs:
|
|
|
|
- build-geth:
|
|
|
|
name: Build geth
|
|
|
|
- unit-test:
|
|
|
|
name: Run unit tests for geth
|
|
|
|
- lint-geth:
|
|
|
|
name: Run linter over geth
|
2023-03-03 17:09:02 -07:00
|
|
|
- docker-release:
|
|
|
|
name: Push to Docker
|
|
|
|
docker_tags: <<pipeline.git.revision>>
|
|
|
|
context:
|
|
|
|
- oplabs-gcr
|
|
|
|
release:
|
|
|
|
jobs:
|
|
|
|
- hold:
|
|
|
|
type: approval
|
|
|
|
filters:
|
|
|
|
tags:
|
2023-03-03 17:16:26 -07:00
|
|
|
only: /^v.*/
|
2023-03-03 17:09:02 -07:00
|
|
|
branches:
|
|
|
|
ignore: /.*/
|
|
|
|
- docker-release:
|
|
|
|
name: Push to Docker
|
|
|
|
filters:
|
|
|
|
tags:
|
2023-03-03 17:16:26 -07:00
|
|
|
only: /^v.*/
|
2023-03-03 17:09:02 -07:00
|
|
|
branches:
|
|
|
|
ignore: /.*/
|
|
|
|
docker_tags: <<pipeline.git.revision>>,<<pipeline.git.tag>>
|
|
|
|
context:
|
|
|
|
- oplabs-gcr-release
|
|
|
|
requires:
|
|
|
|
- hold
|