These are chat archives for cern-eos/eos/operations

17th
May 2016
lmascett
@lmascett
May 17 2016 09:16
@davidjericho does fsck report shadow_fsid?
lmascett
@lmascett
May 17 2016 09:21
@davidjericho 200 threads for the conversion and the draining seems a bit to high.. in general we run a slow pace balancing with few transfers per node (between 2 and 50), how about the rate, what is your setting for balancer.node.rate?
@davidjericho which threshold do you set for the balancing? (balancer.threshold)
Andreas-Joachim Peters
@apeters1971
May 17 2016 11:37
If you have reference to a shadow filesystem, which does not exist anymore, you can still dump it with the command (if you remember the fsid). If you have references to filesystems which are not configured anumore, get you a shadow filesystem entry hint by fsck.
Andreas-Joachim Peters
@apeters1971
May 17 2016 11:51
@davidjericho 2000 slots for balancing can kill your FST because it runs 2000 copy commands in parallel ... can you post your 'group ls' output and 'group ls --IO'
Andreas-Joachim Peters
@apeters1971
May 17 2016 12:28
@davidjericho I think I am confused now if you talk about inter-group balancing or normal balancing within a group? Balancing within a group does not need a converter setting ....
David Jericho
@davidjericho
May 17 2016 22:43
@lmascett no shadow_fsid in the report
@lmascett I realise it's high, which is why I am asking - but when I look at the FST logs, I see it's doing maybe 1 to 2 conversions per second per FST
(per FST, not per FS)
@apeters1971 I've not had problems or errors with the FST crashing since maybe 0.3.166 or so, no reported errors for the balancing that I've found
I realise I could well have some very wacky space settings, I have to admit despite reading the documentation and looking into the code a few times, I'm not totally understanding what each space balancing/draining setting does and how they interplay
David Jericho
@davidjericho
May 17 2016 22:49
https://gist.github.com/davidjericho/e21a07419eee454b3c67b342c58f794b is the output of my group ls and group ls --IO