Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
  • Jul 21 23:26
    dependabot[bot] labeled #237
  • Jul 21 23:26
    dependabot[bot] labeled #237
  • Jul 21 23:26
    dependabot[bot] opened #237
  • Jul 21 23:26

    dependabot[bot] on bundler

    Bump tzinfo from 1.2.7 to 1.2.1… (compare)

  • Jun 17 01:31
    dependabot[bot] labeled #99
  • Jun 17 01:31
    dependabot[bot] labeled #99
  • Jun 17 01:31
    dependabot[bot] opened #99
  • Jun 17 01:31

    dependabot[bot] on cargo

    Bump thread_local from 1.0.1 to… (compare)

  • Jun 17 01:19
    dependabot[bot] labeled #98
  • Jun 17 01:19
    dependabot[bot] labeled #98
  • Jun 17 01:19
    dependabot[bot] opened #98
  • Jun 17 01:19

    dependabot[bot] on cargo

    Bump neon from 0.1.23 to 0.10.1… (compare)

  • May 19 16:37
    bvaisvil starred whamcloud/rust-libzfs
  • May 18 20:41

    dependabot[bot] on bundler

    (compare)

  • May 18 20:41
    dependabot[bot] closed #234
  • May 18 20:41
    dependabot[bot] commented #234
  • May 18 20:41
    dependabot[bot] labeled #236
  • May 18 20:41
    dependabot[bot] labeled #236
  • May 18 20:41
    dependabot[bot] opened #236
  • May 18 20:41

    dependabot[bot] on bundler

    Bump nokogiri from 1.10.8 to 1.… (compare)

Alex Talker
@AlexTalker
@ahkumar If not, on each node you must stop "iml-storage-server.target" and clean up files in /var/lib/chroma/I think
Amit Kumar
@ahkumar
@AlexTalker yup there is no button "Force Remove" Even when I hover over the actions button there is no drop down that gives me any option
Alex Talker
@AlexTalker
@ahkumar Then, obviously you either want to wipe database on IML server or re-install the system
Amit Kumar
@ahkumar
@AlexTalker Would this be appropriate link to follow to remove agents https://whamcloud.github.io/Online-Help/docs/Contributor_Docs/cd_UnInstall_IML.html . Although this link assumes that IML was installed in managed mode. I might have to be careful in removing on agent based components true?
Alex Talker
@AlexTalker
@ahkumar Well, this seems about right but limit you actions to the agent. Mean, you don't need to disable corosync or delete the network, just remove the bloody agent.
@ahkumar And skip the step about removing it via UI
@ahkumar Just reinstall
Amit Kumar
@ahkumar
@AlexTalker thank you, will just stick to stopping iml-storage-server.target & chroma-agent.service and removing python2-iml-agent-4.1.4-1.el7.noarch. & clean up /var/lib/chroma
@AlexTalker Hope this works ..
Alex Talker
@AlexTalker
@ahkumar Yeah, good luck
Amit Kumar
@ahkumar
@AlexTalker thank you!!
Amit Kumar
@ahkumar
@AlexTalker @jgrund removing agent and reinstalling went smooth. thank you for your input and help!
Joe Grund
@jgrund
@ahkumar Thanks to @AlexTalker glad it worked for you
Amit Kumar
@ahkumar
@jgrund yes thank you @AlexTalker as well. One of these warnings have been repeating itself. Can this be made not to complain: (/usr/lib/python2.7/site-packages/requests/packages/urllib3/connectionpool.py:821: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.org/en/latest/security.html) ??
@jgrund another question: can I dump the metrics(jobstats) to elasticsearch ? so I can have some historical info?
Joe Grund
@jgrund
@ahkumar, you should be able to script some ingest against the IML REST API
Amit Kumar
@ahkumar
@jgrund Great. I will use the API and script it found an example in the docs. Also wondering if you have an answer for the InsecureRequestWarning above?
Joe Grund
@jgrund
WIll need to take a look futher. Can you open an issue at https://github.com/whamcloud/integrated-manager-for-lustre/issues/new/choose with more detail?
Amit Kumar
@ahkumar
@jgrund sounds good will do!
Amit Kumar
@ahkumar
@jgrund Wondering how frequently is "jobstats" collected? and is it stored in the database that I can retrieve for historical data on jobs IOPS etc? if yes is there an API i can use to get that infromation?
Alex Talker
@AlexTalker
@ahkumar Yes, if you grant access to postgres manually, you can find jobstat info, look for tables with numbers in their names. As for API, AFAIK, the current one just streams information from database by websocket and you can inspect it on jobstat web ui page. Jobstats collected each 10 seconds I think.
Alex Talker
@AlexTalker
@ahkumar Here's my approach to request statistics from PostgreSQL: select s.dt, s."sum", e.name, e.id, t.name from chroma_core_sample_10 s, chroma_core_series e, chroma_core_managedtarget t where s.id = e.id and e.object_id = t.id and t.state = 'mounted' --and t.name = 'lustre1-OST0001' and s.dt >= '2019-06-28 12:30:40.000Z' and s.dt <= '2019-06-28 12:33:10.000Z' and e.name like '%_write_bytes%';
Change parameters to fit your needs, you may remove some conditions to check if data is present
Joe Grund
@jgrund
@ahkumar @AlexTalker There is also Rest JSON API access if you don’t want to hit the db directly
bmerchant
@bmerchant
Is it possible to create a non-HA server with IML? We have a customer with a single MDS/MGS node and the filesystem format fails at configuring corosync and doesn't even attempt to format or start targets
Joe Grund
@jgrund
Deploy Lustre from IML, but no HA?
Not at the moment. IML can monitor existing filesystems without needing HA
bmerchant
@bmerchant
That's what I figured, thanks for confirming. We went manual install + monitor mode route
bmerchant
@bmerchant
Is it possible to recover/reset the superuser password for IML? This is IML 3.0.0.0 and no other users exist besides what was created during initial chroma-config install
Joe Grund
@jgrund
@bmerchant yes
on the manager node:
cd /usr/share/chroma-manager
python ./manage.py changepassword <username>
bmerchant
@bmerchant
Perfect, thanks!
Brian J. Murrell
@brianjmurrell
in
lingforrest
@lingforrest
Hi I am to install IML for Lustre 2.12.2, because I want to install CentOS 7.6.1810 on MDS/OSS nodes. may i install IML 5.1 or IML 5.0 ? I cannot find any installation guide for IML 5.0. who can please help to advise ?
lingforrest
@lingforrest
when I reposync -n --repoid=managerforlustre-manager-for-lustre, a warning : cannot find repository managerforlustre-manager-for-lustre. no repositories found
zmahiri47
@zmahiri47
I am having the same issue when attempting to create an offline repo "cannot find repository managerforlustre-manager-for-lustre. no repositories found"
zmahiri47
@zmahiri47
Update - I was able to successfully perform reposync via dnf by including the complete repoid name. For me the complete command as " dnf reposync -n repoid=copr:copr.fedorainfracloud.org:managerforlustre:manager-for-lustre "
zmahiri47
@zmahiri47
Hello, I can't seem to add any servers to IML (6.0). When I add a server, packages install, but when I add a server the chroma-agent.log give the "daemon WARNING get_nids: failed to open" . Also, when I try to import any of the chroma modules in python I get errors like "ImportError: No module named chroma_core.lib.storage_plugin.base_plugin". How can install the chroma_core modules?
bmerchant
@bmerchant
Are the 2.4 and 3.1 upgrade to 5.1 guides stored somewhere? The online versions don't seem to exist anymore. And what additionally would be involved in taking them to 6.1? This is 3.0.0.0
Atul Yadav
@atulyadavtech
Hi Team, Any PDF doc for the IML 6.x
Joe Grund
@jgrund
@bmerchant It’s probably best to reach out via support channels to discuss this further.
bmerchant
@bmerchant
I got the upgrade guides from the Online-Help git repo and the client only wants to upgrade to 5.1 at this time so I think I'm all set. Thanks!
detritus
@detritus
Hi, is there any documentation for version 6.1? Not sure if I'm looking at the wrong docs or there is an issue in my install but I seem to lack various interface buttons (add servers, configuring volumes, etc).
detritus
@detritus
Any chance anyone can take a look at: whamcloud/integrated-manager-for-lustre#2359 For some reason my installs never seem to detect the zpools I create. I've tried going back to 5.1 and also using 6.2
louiscaocao
@louiscaocao
Dec 29 04:50:57 mds1 iml-agent-daemon: #033[2mDec 29 04:50:57.708#033[0m #033[33m WARN#033[0m iml_agent::reader: Error during session start LustreCollectorError(SerdeYamlError(Message("missing field sent_stats", Some(Pos { marker: Marker { index: 56, line: 4, col: 13 }, path: "net[0].local NI(s)[0]" }))))
Dec 29 04:50:57 mds1 iml-agent-daemon: #033[2mDec 29 04:50:57.708#033[0m #033[32m INFO#033[0m iml_agent::http_comms::session: Terminating session PluginName("stats")/Id("4aa2039c-de80-4b34-a0af-dc04b1ee5cee")
Dec 29 04:50:58 mds1 iml-agent-daemon: #033[2mDec 29 04:50:58.591#033[0m #033[32m INFO#033[0m iml_agent::poller: sending session create request for stats
Dec 29 04:50:58 mds1 iml-agent-daemon: #033[2mDec 29 04:50:58.591#033[0m #033[32m INFO#033[0m iml_agent::http_comms::agent_client: Requesting new session for: PluginName("stats").
Dec 29 04:50:58 mds1 iml-agent-daemon: #033[2mDec 29 04:50:58.710#033[0m #033[32m INFO#033[0m iml_agent::http_comms::session: Created new session PluginName("stats")/Id("e64d0e14-6c7c-4f8a-8cfe-3b7178db5420")
Spoorthisomashekar
@Spoorthisomashekar
Hi, are there any supporting documents for IML version 6.3.0? Is IML version 6.3.0 supported with RHEL 7.8 (Lustre version 2.12.5)?
bpalmer505
@bpalmer505
Hey Guys got the software installed on the lustre management server it's not picking up any of the servers is there some extra step not listed on the github site?
taitobmt
@taitobmt
Hi all, i start to deploy IML following this link: https://whamcloud.github.io/Online-Help/docs/Install_Guide/ig_TOC.html
Do i have to do all the step in this link or do i just need to do some of the items and specifically which one? Many thanks
Hopko
@hopko
Hi all, Is there any development going on in the github version of IML, there are is almost no activity going since the release of 6.3?
junhuizx
@junhuizx
Hi guys, I had installed a lustre cluster with version 2.12.7, and I installed IML(6.3.0) in another node. Then I followed this link(https://whamcloud.github.io/Online-Help/docs/Detect_and_monitor_existing_LFS_7_0.html) to detect luster file system, but I didn't find the 'Configuration' button in the GUI, anyone knows this ?