Skip to content

Fail to run all benchmarks #253

@Kenun99

Description

@Kenun99

I was just wondering whether it is possible to help to address the build issue.

Environment: Ubuntu20.04 X86 Rust: x86_64-unknown-linux-gnu rustc v1.70.0
Here are my build commands

git clone https://github.com/ziyadedher/evm-bench.git
git checkout  6d26d92 # the latest commit 

curl -sSL https://install.python-poetry.org | python3 - && export PATH="$HOME/.local/bin:$PATH"` #  install the dependency poetry
sudo apt install pypy3 -y` #  install the dependency pypy3

RUST_LOG=info cargo run --release -- # run

Although all benchmarks are built successfully, none of the eight runners can evaluate any benchmark. Here is the output I obtained.

[2023-06-02T09:17:35Z INFO  evm_bench::metadata] found 5 benchmarks: erc20.mint, snailtracer, erc20.transfer, ten-thousand-hashes, erc20.approval-transfer
[2023-06-02T09:17:35Z INFO  evm_bench::metadata] found 8 runners: py-evm.pypy, ethereumjs, akula, evmone, geth, py-evm.cpython, pyrevm, revm
[2023-06-02T09:17:35Z INFO  evm_bench::build] building 5 benchmarks...
[2023-06-02T09:17:35Z INFO  evm_bench::build] building benchmark erc20.approval-transfer (ERC20ApprovalTransfer.sol w/ solc@stable)...
[2023-06-02T09:17:37Z INFO  evm_bench::build] building benchmark erc20.mint (ERC20Mint.sol w/ solc@stable)...
[2023-06-02T09:17:39Z INFO  evm_bench::build] building benchmark erc20.transfer (ERC20Transfer.sol w/ solc@stable)...
[2023-06-02T09:17:41Z INFO  evm_bench::build] building benchmark snailtracer (SnailTracer.sol w/ solc@0.4.26)...
[2023-06-02T09:17:44Z INFO  evm_bench::build] building benchmark ten-thousand-hashes (TenThousandHashes.sol w/ solc@stable)...
[2023-06-02T09:17:55Z INFO  evm_bench::run] running 5 benchmarks...
[2023-06-02T09:17:55Z INFO  evm_bench::run] running benchmark erc20.approval-transfer on 8 runners...
[2023-06-02T09:17:55Z INFO  evm_bench::run] running benchmark erc20.approval-transfer on runner akula...
[2023-06-02T09:18:17Z WARN  evm_bench::run] could not run benchmark erc20.approval-transfer on runner akula: exit status: 101
[2023-06-02T09:18:17Z INFO  evm_bench::run] running benchmark erc20.approval-transfer on runner ethereumjs...
[2023-06-02T09:18:18Z WARN  evm_bench::run] could not run benchmark erc20.approval-transfer on runner ethereumjs: exit status: 254
[2023-06-02T09:18:18Z INFO  evm_bench::run] running benchmark erc20.approval-transfer on runner evmone...
[2023-06-02T09:18:20Z WARN  evm_bench::run] could not run benchmark erc20.approval-transfer on runner evmone: exit status: 1
[2023-06-02T09:18:20Z INFO  evm_bench::run] running benchmark erc20.approval-transfer on runner geth...
[2023-06-02T09:18:20Z WARN  evm_bench::run] could not run benchmark erc20.approval-transfer on runner geth: exit status: 1
[2023-06-02T09:18:20Z INFO  evm_bench::run] running benchmark erc20.approval-transfer on runner py-evm.cpython...
[2023-06-02T09:18:20Z WARN  evm_bench::run] could not run benchmark erc20.approval-transfer on runner py-evm.cpython: exit status: 1
[2023-06-02T09:18:20Z INFO  evm_bench::run] running benchmark erc20.approval-transfer on runner py-evm.pypy...
[2023-06-02T09:18:20Z WARN  evm_bench::run] could not run benchmark erc20.approval-transfer on runner py-evm.pypy: exit status: 1
[2023-06-02T09:18:20Z INFO  evm_bench::run] running benchmark erc20.approval-transfer on runner pyrevm...
[2023-06-02T09:18:21Z WARN  evm_bench::run] could not run benchmark erc20.approval-transfer on runner pyrevm: exit status: 1
[2023-06-02T09:18:21Z INFO  evm_bench::run] running benchmark erc20.approval-transfer on runner revm...
[2023-06-02T09:18:35Z WARN  evm_bench::run] could not run benchmark erc20.approval-transfer on runner revm: exit status: 101
[2023-06-02T09:18:35Z INFO  evm_bench::run] running benchmark erc20.mint on 8 runners...
[2023-06-02T09:18:35Z INFO  evm_bench::run] running benchmark erc20.mint on runner akula...
[2023-06-02T09:18:40Z WARN  evm_bench::run] could not run benchmark erc20.mint on runner akula: exit status: 101
[2023-06-02T09:18:40Z INFO  evm_bench::run] running benchmark erc20.mint on runner ethereumjs...
[2023-06-02T09:18:42Z WARN  evm_bench::run] could not run benchmark erc20.mint on runner ethereumjs: exit status: 254
[2023-06-02T09:18:42Z INFO  evm_bench::run] running benchmark erc20.mint on runner evmone...
[2023-06-02T09:18:43Z WARN  evm_bench::run] could not run benchmark erc20.mint on runner evmone: exit status: 1
[2023-06-02T09:18:43Z INFO  evm_bench::run] running benchmark erc20.mint on runner geth...
[2023-06-02T09:18:44Z WARN  evm_bench::run] could not run benchmark erc20.mint on runner geth: exit status: 1
[2023-06-02T09:18:44Z INFO  evm_bench::run] running benchmark erc20.mint on runner py-evm.cpython...
[2023-06-02T09:18:44Z WARN  evm_bench::run] could not run benchmark erc20.mint on runner py-evm.cpython: exit status: 1
[2023-06-02T09:18:44Z INFO  evm_bench::run] running benchmark erc20.mint on runner py-evm.pypy...
[2023-06-02T09:18:44Z WARN  evm_bench::run] could not run benchmark erc20.mint on runner py-evm.pypy: exit status: 1
[2023-06-02T09:18:44Z INFO  evm_bench::run] running benchmark erc20.mint on runner pyrevm...
[2023-06-02T09:18:45Z WARN  evm_bench::run] could not run benchmark erc20.mint on runner pyrevm: exit status: 1
[2023-06-02T09:18:45Z INFO  evm_bench::run] running benchmark erc20.mint on runner revm...
[2023-06-02T09:18:45Z WARN  evm_bench::run] could not run benchmark erc20.mint on runner revm: exit status: 101
[2023-06-02T09:18:45Z INFO  evm_bench::run] running benchmark erc20.transfer on 8 runners...
[2023-06-02T09:18:45Z INFO  evm_bench::run] running benchmark erc20.transfer on runner akula...
[2023-06-02T09:18:55Z WARN  evm_bench::run] could not run benchmark erc20.transfer on runner akula: exit status: 101
[2023-06-02T09:18:55Z INFO  evm_bench::run] running benchmark erc20.transfer on runner ethereumjs...
[2023-06-02T09:18:57Z WARN  evm_bench::run] could not run benchmark erc20.transfer on runner ethereumjs: exit status: 254
[2023-06-02T09:18:57Z INFO  evm_bench::run] running benchmark erc20.transfer on runner evmone...
[2023-06-02T09:18:58Z WARN  evm_bench::run] could not run benchmark erc20.transfer on runner evmone: exit status: 1
[2023-06-02T09:18:58Z INFO  evm_bench::run] running benchmark erc20.transfer on runner geth...
[2023-06-02T09:18:58Z WARN  evm_bench::run] could not run benchmark erc20.transfer on runner geth: exit status: 1
[2023-06-02T09:18:58Z INFO  evm_bench::run] running benchmark erc20.transfer on runner py-evm.cpython...
[2023-06-02T09:18:59Z WARN  evm_bench::run] could not run benchmark erc20.transfer on runner py-evm.cpython: exit status: 1
[2023-06-02T09:18:59Z INFO  evm_bench::run] running benchmark erc20.transfer on runner py-evm.pypy...
[2023-06-02T09:18:59Z WARN  evm_bench::run] could not run benchmark erc20.transfer on runner py-evm.pypy: exit status: 1
[2023-06-02T09:18:59Z INFO  evm_bench::run] running benchmark erc20.transfer on runner pyrevm...
[2023-06-02T09:19:00Z WARN  evm_bench::run] could not run benchmark erc20.transfer on runner pyrevm: exit status: 1
[2023-06-02T09:19:00Z INFO  evm_bench::run] running benchmark erc20.transfer on runner revm...
[2023-06-02T09:19:00Z WARN  evm_bench::run] could not run benchmark erc20.transfer on runner revm: exit status: 101
[2023-06-02T09:19:00Z INFO  evm_bench::run] running benchmark snailtracer on 8 runners...
[2023-06-02T09:19:00Z INFO  evm_bench::run] running benchmark snailtracer on runner akula...
[2023-06-02T09:19:10Z WARN  evm_bench::run] could not run benchmark snailtracer on runner akula: exit status: 101
[2023-06-02T09:19:10Z INFO  evm_bench::run] running benchmark snailtracer on runner ethereumjs...
[2023-06-02T09:19:11Z WARN  evm_bench::run] could not run benchmark snailtracer on runner ethereumjs: exit status: 254
[2023-06-02T09:19:11Z INFO  evm_bench::run] running benchmark snailtracer on runner evmone...
[2023-06-02T09:19:13Z INFO  evm_bench::run] running benchmark snailtracer on runner geth...
[2023-06-02T09:19:13Z WARN  evm_bench::run] could not run benchmark snailtracer on runner geth: exit status: 1
[2023-06-02T09:19:13Z INFO  evm_bench::run] running benchmark snailtracer on runner py-evm.cpython...
[2023-06-02T09:19:13Z WARN  evm_bench::run] could not run benchmark snailtracer on runner py-evm.cpython: exit status: 1
[2023-06-02T09:19:13Z INFO  evm_bench::run] running benchmark snailtracer on runner py-evm.pypy...
[2023-06-02T09:19:14Z WARN  evm_bench::run] could not run benchmark snailtracer on runner py-evm.pypy: exit status: 1
[2023-06-02T09:19:14Z INFO  evm_bench::run] running benchmark snailtracer on runner pyrevm...
[2023-06-02T09:19:14Z WARN  evm_bench::run] could not run benchmark snailtracer on runner pyrevm: exit status: 1
[2023-06-02T09:19:14Z INFO  evm_bench::run] running benchmark snailtracer on runner revm...
[2023-06-02T09:19:14Z INFO  evm_bench::run] running benchmark ten-thousand-hashes on 8 runners...
[2023-06-02T09:19:14Z INFO  evm_bench::run] running benchmark ten-thousand-hashes on runner akula...
[2023-06-02T09:19:16Z WARN  evm_bench::run] could not run benchmark ten-thousand-hashes on runner akula: exit status: 101
[2023-06-02T09:19:16Z INFO  evm_bench::run] running benchmark ten-thousand-hashes on runner ethereumjs...
[2023-06-02T09:19:17Z WARN  evm_bench::run] could not run benchmark ten-thousand-hashes on runner ethereumjs: exit status: 254
[2023-06-02T09:19:17Z INFO  evm_bench::run] running benchmark ten-thousand-hashes on runner evmone...
[2023-06-02T09:19:19Z WARN  evm_bench::run] could not run benchmark ten-thousand-hashes on runner evmone: exit status: 1
[2023-06-02T09:19:19Z INFO  evm_bench::run] running benchmark ten-thousand-hashes on runner geth...
[2023-06-02T09:19:19Z WARN  evm_bench::run] could not run benchmark ten-thousand-hashes on runner geth: exit status: 1
[2023-06-02T09:19:19Z INFO  evm_bench::run] running benchmark ten-thousand-hashes on runner py-evm.cpython...
[2023-06-02T09:19:20Z WARN  evm_bench::run] could not run benchmark ten-thousand-hashes on runner py-evm.cpython: exit status: 1
[2023-06-02T09:19:20Z INFO  evm_bench::run] running benchmark ten-thousand-hashes on runner py-evm.pypy...
[2023-06-02T09:19:20Z WARN  evm_bench::run] could not run benchmark ten-thousand-hashes on runner py-evm.pypy: exit status: 1
[2023-06-02T09:19:20Z INFO  evm_bench::run] running benchmark ten-thousand-hashes on runner pyrevm...
[2023-06-02T09:19:21Z WARN  evm_bench::run] could not run benchmark ten-thousand-hashes on runner pyrevm: exit status: 1
[2023-06-02T09:19:21Z INFO  evm_bench::run] running benchmark ten-thousand-hashes on runner revm...
[2023-06-02T09:19:21Z WARN  evm_bench::run] could not run benchmark ten-thousand-hashes on runner revm: exit status: 101
[2023-06-02T09:19:21Z INFO  evm_bench::results] wrote out results to /home/kenun/ethsema/Artifact/evm-bench/outputs/results/2023-06-02T09:19:21.157890950+00:00.evm-bench.results.json

Metadata

Metadata

Assignees

Labels

No labels
No labels

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions