Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
  • Jan 19 13:48
    nlinker commented #2404
  • Jan 19 13:47
    nlinker commented #2404
  • Jan 19 13:42
    nlinker closed #2361
  • Jan 19 13:42
    nlinker commented #2361
  • Jan 15 13:14
    utopiabound closed #57
  • Jan 13 15:19
  • Jan 13 15:19
  • Jan 12 01:58
    gustavo4passos labeled #2453
  • Jan 12 01:58
    gustavo4passos opened #2453
  • Jan 11 15:06
    mdiep25 added as member
  • Jan 11 15:06
    mdiep25 added as member
  • Jan 11 15:06
    mdiep25 added as member
  • Jan 11 15:06
    mdiep25 added as member
  • Jan 11 15:06
    mdiep25 added as member
  • Jan 11 15:06
    mdiep25 added as member
  • Jan 11 15:06
    mdiep25 added as member
  • Jan 11 15:06
    mdiep25 added as member
  • Jan 11 15:06
    mdiep25 added as member
  • Jan 11 15:06
    mdiep25 added as member
Will Johnson
@johnsonw
Script posted intel-hpdd/intel-manager-for-lustre#637.
Jason Williams
@uberlinuxguy
can I add the targets that should be on oss12 to the target_list variable before I run this?
Will Johnson
@johnsonw
It should be fine but just keep in mind that it hasn’t been tested.
Jason Williams
@uberlinuxguy
kk
Jason Williams
@uberlinuxguy
awesome that cleared the volumes page.
and the number of volumes per host is now 12
Will Johnson
@johnsonw
Excellent news :clap:
And failover still works correct?
Jason Williams
@uberlinuxguy
failing a couple of the targets back to their primary hosts and that seems to be working too.
Will Johnson
@johnsonw
awesome :+1:
Jason Williams
@uberlinuxguy
Things are looking much better now.
Migration works, everything is reporting right, I think we are safe to close the currently open ticket for the upgrade.
Did you get a change to find out anything about the striping and the handful of jobs taking down the OST?
Will Johnson
@johnsonw
Great to hear @uberlinuxguy. I don’t have any information on the striping yet but will let you know as soon as I do.
Jason Williams
@uberlinuxguy
Ok sounds good.
Thank you so much @yguvvala, @johnsonw, and @jgrund for all your help
Joe Grund
@jgrund
@uberlinuxguy glad to hear you’re in a good spot with the upgrade. Gentle reminder to please open tickets on issues discussed earlier (obsoleting apache etc…)
Jason Williams
@uberlinuxguy
Oh yes.
I have those in a text pad somewhere...
Will Johnson
@johnsonw
@uberlinuxguy I just got a reponse on the striping information:
Depending on the number of OSTs, I’ve seen some of the big labs use 4 as a default stripe for the filesystem.

Other than user education, there’s not much you can do by force.  Maybe OST-pools, but that doesn’t prevent someone from hammering a single OST.
Jason Williams
@uberlinuxguy
I guess the other question would be is there a way to update striping for existing files. I believe the answer is no.... cuz how would you do that, but figured it's worth asking.
Will Johnson
@johnsonw
The only way that I’m aware of is to create a new folder with the striping settings that you want and then copy (not move) the files into that folder. They should then take on the new stripe count.
Joe Grund
@jgrund
yeah, I’ve read that you need to copy files to do that
Brian J. Murrell
@brianjmurrell
or you can do it without a folder with a rename, copy, rm. it's not atomic though, obviously. it would be an interesting feature to be able to transparently re-stripe files, in place so that any processes that have it open don't notice the way they would with mv/cp/rm. i'm sure it's not an enhancement that has not been thought of.
yguvvala
@yguvvala
@uberlinuxguy i think as the capacity you are re-striping by copying is a longer process.
Jason Williams
@uberlinuxguy
Quick question: All of my realtime graphs in IML have suddenly stopped working.
Do you all know where I might look to figure out why they look like this now?
image.png
Will Johnson
@johnsonw
Hi @yguvvala and @uberlinuxguy, can you open a support issue in Jira?
Jason Williams
@uberlinuxguy
Ok, sounds good.
Zeeshan Ali Shah
@zeeshanali
For new Lustre cluster what is the big difference in installing it via ILM or manual , we have 6 OSS with 5 OST each , 2 MDS , 2 LNET router setup of about 10PB ..
and wil ILM also configure zfspool over OSTs or that have to be done first manually ?
Tom Nabarro
@tanabarr
currently zfspools have to be configured manually, then they can be used as volumes to create the OSTs and other targets on
Zeeshan Ali Shah
@zeeshanali
thanks Tom
Zeeshan Ali Shah
@zeeshanali
in large scale production , is it preferable to go via ILM or manual ?
Joe Grund
@jgrund
Can you provide details on expected setup?
Zeeshan Ali Shah
@zeeshanali
sure , we have 6 OSS with 12 OSTs totally 1080 Disks -- 2 MDS with 1 MDT , 2nd MDS wl be used as MGS with seperate storage of MGT , furthermore we have 2 Lnet routers and 2 cifs routers
4 OST per 2 OSS --
also OST wl be based on zfs
and my second question is about that.. The 2OSS will be active/active but as zfs pools can only be imported in single OSS host in this case how to achieve active/active HA ?
As what i read is that for active/active both HA hosts should have access to a same sets of disks/volumes.
Joe Grund
@jgrund
hrrm, I haven’t heard of active/active for ZFS
Here’s a doc on how IML expects an HA setup in managed mode: https://whamcloud.github.io/Online-Help/docs/Install_Guide/ig_ch_03_building.html
Joe Grund
@jgrund
We also support a monitor only mode, where you would setup the FS according to your specific HA needs and IML will monitor things like server states and Lustre stats (but will not actively manage your HA setup)
Brian J. Murrell
@brianjmurrell
active/active in the lustre context means that an OSS is active for a subset (usually half in the case of 2-node OSS pairs) of OSTs and it's peers (partner in the 2-node case again) is active for the remaining (other half in the 2-node case) OSTs. so it's active/active OSSes, not active/active OSTs.
Joe Grund
@jgrund
ah, so in with that definition IML supports active/active in managed mode
Brian J. Murrell
@brianjmurrell
yes
Zeeshan Ali Shah
@zeeshanali
Thanks Brian and Joe
e73kiel
@e73kiel
Hi All, Can i install iml to one of my mds servers?