Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Activity
  • 01:20
    jmederosalvarado commented #4208
  • Sep 28 23:30
    asdacap synchronize #4658
  • Sep 28 23:30

    asdacap on Exit-early-on-error-(#4220)

    Trying to invoke build (compare)

  • Sep 28 23:24
    asdacap commented #4560
  • Sep 28 23:24
    asdacap synchronize #4560
  • Sep 28 23:24

    asdacap on improve-snap-request-batching

    Accidental push (compare)

  • Sep 28 23:23
    asdacap synchronize #4560
  • Sep 28 23:23

    asdacap on improve-snap-request-batching

    Improve snap request batching Add unit test [minor] Format IF clauses and 2 more (compare)

  • Sep 28 23:19
    asdacap synchronize #4560
  • Sep 28 23:19

    asdacap on improve-snap-request-batching

    Revert unnecessary commit (compare)

  • Sep 28 23:18
    asdacap synchronize #4560
  • Sep 28 23:18

    asdacap on improve-snap-request-batching

    Improve snap request batching Add unit test [minor] Format IF clauses and 2 more (compare)

  • Sep 28 23:14
    asdacap edited #4560
  • Sep 28 22:03
    dceleda commented #4658
  • Sep 28 20:32
    dceleda review_requested #4658
  • Sep 28 20:12

    dceleda on master

    fix Nethermind.sln (#4667) (compare)

  • Sep 28 20:12

    dceleda on solution

    (compare)

  • Sep 28 20:12
    dceleda closed #4667
  • Sep 28 20:09
    dceleda review_request_removed #4536
  • Sep 28 20:08
    dceleda review_requested #4536
Gitter Bridge
@nethermind-bridge
[discord] <Micah | serv.eth> 2022-08-11 14:04:51.3883|State Sync 00.06:45:13 | ~0.89 % | 878.26MB / ~98820.00MB | branches: 31.25 % | kB/s: 94 | accounts 319791 | nodes 3084585 | diagnostics: 12.480.66ms
Should I interpret this to mean that syncing is going to take ~100 days? I am in "fast" sync...
[discord] <Micah | serv.eth> 6 hours in, 0.89% of state downloaded.
[discord] <Micah | serv.eth> 66 peers, host should be well connected.
Gitter Bridge
@nethermind-bridge
[discord] <DanielC> It seems you're using Fast Sync and no Snap Sync. Could you confirm?
Which version of Nethermind are you using?
[discord] <Micah | serv.eth> 1.13.5
[discord] <Micah | serv.eth> mainnet.cfg, which I think is fast sync?
[discord] <Micah | serv.eth> Sync.FastBlocks: true as well.
[discord] <Micah | serv.eth> Should I switch to snap sync? Is FastSync no longer reasonable?
[discord] <DanielC> Ok, so 1.13.5 has this well known issue with RocksDB - only Snap Sync works in that version although it take up to 7h to sync which is much slower than before.
Version 1.13.6 has a workaround that solves it but you would have to delete all databases update to 1.13.6 and sync from scratch - then you can use Fast Sync.
Still Fast Sync is waaay slower than Snap Sync. In 1.13.6 you should able to resync with Snap Sync in 3-4 h
[discord] <Micah | serv.eth> Sync.FastSync: false and Sync.SnapSync: true?
[discord] <DanielC> Set both to true.
[discord] <Micah | serv.eth> I can switch mid sync?
[discord] <Micah | serv.eth> I would rather not re-download all of the headers. 😬
[discord] <DanielC> Although SnapSync:true overrides FastSync to true under the hood 😉
Gitter Bridge
@nethermind-bridge
[discord] <DanielC> You can try. If don't delete databases then even if you upgrade to 1.13.6 the workaround will use existing RocksDB version (the one from 1.13.5) so it's going to be slower but still it's going to be max 8 h for the Snap Sync (instead of 3h). Not terrible.
[discord] <Micah | serv.eth> 8h is better than 100 days.
[discord] <DanielC> Yes 😄
[discord] <Micah | serv.eth> How can I tell if it is working other than waiting 8 hours and seeing if I still have 99.5 days left?
[discord] <Micah | serv.eth> The logs look the same after turning on snap sync and restarting.
[discord] <DanielC> When Snap Sync enabled you'll we see new types of log entries.
[discord] <DanielC> You should see SNAP entries at some point.
[discord] <Micah | serv.eth> I still just see
Syncing state nodes 
State Sync 00.06:59:26 | ~0.90 % | 892.62MB / ~98820.00MB | branches: 0.00 % | kB/s:     0 | accounts 323414 | nodes 3131015 | diagnostics: 0.658.40ms 
Changing state StateNodes to FastSync, StateNodes at processed:0|state:0|block:15321161|header:15321166|peer block:15321199 
Sync mode changed from StateNodes to FastSync, StateNodes 
Downloaded 15321167 / 15321199 | current     0.09bps | total     0.03bps 
State Sync 00.06:59:26 | ~0.90 % | 892.62MB / ~98820.00MB | branches: 0.00 % | kB/s:     0 | accounts 323414 | nodes 3131015 | diagnostics: 0.662.25ms 
Changing state FastSync, StateNodes to StateNodes at processed:0|state:0|block:15321161|header:15321167|peer block:15321199 
Sync mode changed from FastSync, StateNodes to StateNodes 
State Sync 00.06:59:26 | ~0.90 % | 892.65MB / ~98820.00MB | branches: 0.00 % | kB/s:    14 | accounts 323433 | nodes 3131083 | diagnostics: 0.665.61ms
[discord] <DanielC> It seems we have some kind of a feature implemented that checks if we some process already started and it continues with it :/
[discord] <DanielC> It wasn't a few months ago when we delivered SNAP sync but it seems it's changed.
[discord] <Micah | serv.eth> Why isn't snap sync default if fast sync is broken?
[discord] <DanielC> Snap Sync never starts immediately, the headers have to catch the pivot hardcoded in the config file,
[discord] <DanielC> I think it is default in the mainnet.cfg
Gitter Bridge
@nethermind-bridge
[discord] <DanielC> It cannot be default for all networks
[discord] <DanielC> because only Geth supports it and there are networks without Geth.
[discord] <DanielC> So the default config files for mainnet and goerli have it switched to true but probably you're using your own config file without this value set to true.
[discord] <Micah | serv.eth> Ah, looks like it changed in 1.13.6.
Gitter Bridge
@nethermind-bridge
[discord] <santamansanta> How did this go?
[discord] <santamansanta> So have to start syncing from the beginning?
Gitter Bridge
@nethermind-bridge
[discord] <Micah | serv.eth> Terribly. Removing only the state folder doesn't work. However, I learned you can trigger a full prune via RPC instead.
Gitter Bridge
@nethermind-bridge
[discord] <santamansanta> I did a full prune too. It took 3 days. state/0 directory is gone and only state/1 exists. But the size is like 13 gb more than what it was before the prune started. But I only had it running for 10 days before I tried to prune
[discord] <santamansanta> I am confused lol
Gitter Bridge
@nethermind-bridge
[discord] <Micah | serv.eth> How big is the state directory?
Gitter Bridge
@nethermind-bridge
[discord] <TobiWo> Hi, I'm new to nethermind and try to connect to our node via the Nethermind.CLI. While connecting I'm receiving Authentication error. This also happens while trying to send a command like eth.blockNumber. On the later I furthermore receive 0.0 indicating that the connection does not work.
Do I need the jwt for those rpc calls as well or how can I authenticate?
Gitter Bridge
@nethermind-bridge
[discord] <TobiWo> Same here
[discord] <TobiWo> Same here for that combi as well.
Gitter Bridge
@nethermind-bridge
[discord] <Yorick | cryptomanufaktur.io> This recovered with a goerli_testing for Nethermind and unstable for Nimbus
Gitter Bridge
@nethermind-bridge
[discord] <TobiWo> Mhh, no develop image tag for nethermind available 🤔
[discord] <TobiWo> Also no unstable or develop image tag for nimbus available.
[discord] <TobiWo> Then I need to build 👷
Gitter Bridge
@nethermind-bridge
[discord] <Yorick | cryptomanufaktur.io> goerli_testing docker tag for Nethermind; unstable source build for Nimbus
[discord] <Yorick | cryptomanufaktur.io> That did the trick here
[discord] <Yorick | cryptomanufaktur.io> Nethermind docker is nethermindeth/nethermind
[discord] <Yorick | cryptomanufaktur.io> That's where the dev stuff lives
Gitter Bridge
@nethermind-bridge
[discord] <santamansanta> It is 176 GB now. It was around 140 GB after the nethermind full/first sync 12 days ago. Before starting pruning it was 159 GB
Gitter Bridge
@nethermind-bridge
[discord] <santamansanta> Makes me wonder this - a fresh new install of nethermiind has the /nethermind_db/mainnet/state directory start at 140 GB. So when it grows to 200 GB in 3 weeks (lets assume) and we trigger a full prune, shouldn't it go back to 140-145 GB range when pruning is done? Or am I not understanding this correctly? @luk @MarekM @DanielC