Metropolis Testing Guide - https://gist.github.com/Souptacular/fd197b1fac7c6d2660b0bef27a33ed40
# Before optimizations
./retesteth -t LegacyTests -- --all
*** Execution time stats
Total Tests: : 35009
Total Time: : 6110.731951
# After optimizations
./retesteth -t LegacyTests -- --all
*** Execution time stats
Total Tests: : 34886 (bcForged tests (10 seconds) disabled in legacy)
Total Time: : 3693.973524
40% speed increasehttps://cdn.discordapp.com/attachments/423101253011111937/882264050308894810/20210831_155905.jpg
https://github.com/ethereum/tests/pull/936/files
<jwasinger> so afaik the way to fill tests is to use retesteth and the t8n tool (if using geth as the client for filling). Is there any docs on how to do this?
I see https://github.com/ethereum/retesteth/blob/master/README.md but some of the rpc methods listed under the requirements are not implemented in Geth. which makes me think these instructions are outdated.
to track implementation, I will submit a PR soon 👍
<jwasinger> I'm trying to add a fork config for EIP4758. I added one here: https://github.com/ethereum/retesteth/blob/master/retesteth/configs/clientconfigs/t8ntool.cpp#L11 . But I still get an error when trying to fill tests:
> ~/projects/retesteth$ ./dretesteth.sh -t GeneralStateTests/stShift -- --testpath /home/ubuntu/projects/tests --singletest sendallToSelfFiller.json --filltests
WARNING: Specified network not found: 'EIP4758', skipping the test. Enable the fork network in config file: /root/.retesteth/t8ntool/config
Error: Specified network not found: 'EIP4758' (stShift/sendallToSelf, step: GeneralStateTestFiller)
Error: StateTestFiller convertion error: StateTestFillerExpectSection parse error: Specified network not found: 'EIP4758'Active client configurations: 't8ntool ' . so it at least expects to use t8n
<Dimitry Khokhlov (tests)> @everyone
We have evm state tests regenerated using PoS rules:
Need to double check everything.
https://cdn.discordapp.com/attachments/423101253011111937/976222815357399040/Screenshot_20220517-223824_1.jpg