Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
  • Apr 05 14:35

    utopiabound on postoffice-write

    (compare)

  • Apr 05 14:34
    utopiabound closed #2344
  • Apr 05 14:33
    utopiabound synchronize #2344
  • Mar 30 19:31
    dependabot[bot] labeled #18
  • Mar 30 19:31
    dependabot[bot] opened #18
  • Mar 30 19:31

    dependabot[bot] on npm_and_yarn

    Bump y18n from 3.2.1 to 3.2.2 … (compare)

  • Mar 30 19:30
    dependabot[bot] labeled #18
  • Mar 30 19:30
    dependabot[bot] opened #18
  • Mar 30 19:30

    dependabot[bot] on npm_and_yarn

    Bump y18n from 3.2.1 to 3.2.2 … (compare)

  • Mar 29 23:42

    deiter on cleanup

    (compare)

  • Mar 29 23:42

    deiter on master

    Update Copyright and cleanup (#… (compare)

  • Mar 29 23:42
    deiter closed #2
  • Mar 29 23:42
    deiter opened #2
  • Mar 29 23:41

    deiter on cleanup

    Update Copyright and cleanup S… (compare)

  • Mar 29 23:30

    deiter on copyrights

    (compare)

  • Mar 29 23:30

    deiter on master

    Update copyright Signed-off-by… Update copyright Signed-off-by… (compare)

  • Mar 29 23:30
    deiter closed #1
  • Mar 29 18:53
    deiter added as member
  • Mar 29 14:39
    mdiep25 added as member
  • Mar 27 19:56
Alex Talker
@AlexTalker
@ahkumar I'd rather recommended removing all nodes from IML if you want re-install. If you just shutdown IML server node without de-registering agents, this might lead to interesting behavior I think.
Amit Kumar
@ahkumar
image.png
@AlexTalker thank you for the note. But current state of my monitoring only install of IML is such that I cannot remove the nodes. The action button is grayed out. Any other way to de-register the agents?
Alex Talker
@AlexTalker
@ahkumar Is there no button "Force remove"?
@ahkumar If not, on each node you must stop "iml-storage-server.target" and clean up files in /var/lib/chroma/I think
Amit Kumar
@ahkumar
@AlexTalker yup there is no button "Force Remove" Even when I hover over the actions button there is no drop down that gives me any option
Alex Talker
@AlexTalker
@ahkumar Then, obviously you either want to wipe database on IML server or re-install the system
Amit Kumar
@ahkumar
@AlexTalker Would this be appropriate link to follow to remove agents https://whamcloud.github.io/Online-Help/docs/Contributor_Docs/cd_UnInstall_IML.html . Although this link assumes that IML was installed in managed mode. I might have to be careful in removing on agent based components true?
Alex Talker
@AlexTalker
@ahkumar Well, this seems about right but limit you actions to the agent. Mean, you don't need to disable corosync or delete the network, just remove the bloody agent.
@ahkumar And skip the step about removing it via UI
@ahkumar Just reinstall
Amit Kumar
@ahkumar
@AlexTalker thank you, will just stick to stopping iml-storage-server.target & chroma-agent.service and removing python2-iml-agent-4.1.4-1.el7.noarch. & clean up /var/lib/chroma
@AlexTalker Hope this works ..
Alex Talker
@AlexTalker
@ahkumar Yeah, good luck
Amit Kumar
@ahkumar
@AlexTalker thank you!!
Amit Kumar
@ahkumar
@AlexTalker @jgrund removing agent and reinstalling went smooth. thank you for your input and help!
Joe Grund
@jgrund
@ahkumar Thanks to @AlexTalker glad it worked for you
Amit Kumar
@ahkumar
@jgrund yes thank you @AlexTalker as well. One of these warnings have been repeating itself. Can this be made not to complain: (/usr/lib/python2.7/site-packages/requests/packages/urllib3/connectionpool.py:821: InsecureRequestWarning: Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.org/en/latest/security.html) ??
@jgrund another question: can I dump the metrics(jobstats) to elasticsearch ? so I can have some historical info?
Joe Grund
@jgrund
@ahkumar, you should be able to script some ingest against the IML REST API
Amit Kumar
@ahkumar
@jgrund Great. I will use the API and script it found an example in the docs. Also wondering if you have an answer for the InsecureRequestWarning above?
Joe Grund
@jgrund
WIll need to take a look futher. Can you open an issue at https://github.com/whamcloud/integrated-manager-for-lustre/issues/new/choose with more detail?
Amit Kumar
@ahkumar
@jgrund sounds good will do!
Amit Kumar
@ahkumar
@jgrund Wondering how frequently is "jobstats" collected? and is it stored in the database that I can retrieve for historical data on jobs IOPS etc? if yes is there an API i can use to get that infromation?
Alex Talker
@AlexTalker
@ahkumar Yes, if you grant access to postgres manually, you can find jobstat info, look for tables with numbers in their names. As for API, AFAIK, the current one just streams information from database by websocket and you can inspect it on jobstat web ui page. Jobstats collected each 10 seconds I think.
Alex Talker
@AlexTalker
@ahkumar Here's my approach to request statistics from PostgreSQL: select s.dt, s."sum", e.name, e.id, t.name from chroma_core_sample_10 s, chroma_core_series e, chroma_core_managedtarget t where s.id = e.id and e.object_id = t.id and t.state = 'mounted' --and t.name = 'lustre1-OST0001' and s.dt >= '2019-06-28 12:30:40.000Z' and s.dt <= '2019-06-28 12:33:10.000Z' and e.name like '%_write_bytes%';
Change parameters to fit your needs, you may remove some conditions to check if data is present
Joe Grund
@jgrund
@ahkumar @AlexTalker There is also Rest JSON API access if you don’t want to hit the db directly
bmerchant
@bmerchant
Is it possible to create a non-HA server with IML? We have a customer with a single MDS/MGS node and the filesystem format fails at configuring corosync and doesn't even attempt to format or start targets
Joe Grund
@jgrund
Deploy Lustre from IML, but no HA?
Not at the moment. IML can monitor existing filesystems without needing HA
bmerchant
@bmerchant
That's what I figured, thanks for confirming. We went manual install + monitor mode route
bmerchant
@bmerchant
Is it possible to recover/reset the superuser password for IML? This is IML 3.0.0.0 and no other users exist besides what was created during initial chroma-config install
Joe Grund
@jgrund
@bmerchant yes
on the manager node:
cd /usr/share/chroma-manager
python ./manage.py changepassword <username>
bmerchant
@bmerchant
Perfect, thanks!
Brian J. Murrell
@brianjmurrell
in
lingforrest
@lingforrest
Hi I am to install IML for Lustre 2.12.2, because I want to install CentOS 7.6.1810 on MDS/OSS nodes. may i install IML 5.1 or IML 5.0 ? I cannot find any installation guide for IML 5.0. who can please help to advise ?
lingforrest
@lingforrest
when I reposync -n --repoid=managerforlustre-manager-for-lustre, a warning : cannot find repository managerforlustre-manager-for-lustre. no repositories found
zmahiri47
@zmahiri47
I am having the same issue when attempting to create an offline repo "cannot find repository managerforlustre-manager-for-lustre. no repositories found"
zmahiri47
@zmahiri47
Update - I was able to successfully perform reposync via dnf by including the complete repoid name. For me the complete command as " dnf reposync -n repoid=copr:copr.fedorainfracloud.org:managerforlustre:manager-for-lustre "
zmahiri47
@zmahiri47
Hello, I can't seem to add any servers to IML (6.0). When I add a server, packages install, but when I add a server the chroma-agent.log give the "daemon WARNING get_nids: failed to open" . Also, when I try to import any of the chroma modules in python I get errors like "ImportError: No module named chroma_core.lib.storage_plugin.base_plugin". How can install the chroma_core modules?
bmerchant
@bmerchant
Are the 2.4 and 3.1 upgrade to 5.1 guides stored somewhere? The online versions don't seem to exist anymore. And what additionally would be involved in taking them to 6.1? This is 3.0.0.0
Atul Yadav
@atulyadavtech
Hi Team, Any PDF doc for the IML 6.x
Joe Grund
@jgrund
@bmerchant It’s probably best to reach out via support channels to discuss this further.
bmerchant
@bmerchant
I got the upgrade guides from the Online-Help git repo and the client only wants to upgrade to 5.1 at this time so I think I'm all set. Thanks!
detritus
@detritus
Hi, is there any documentation for version 6.1? Not sure if I'm looking at the wrong docs or there is an issue in my install but I seem to lack various interface buttons (add servers, configuring volumes, etc).
detritus
@detritus
Any chance anyone can take a look at: whamcloud/integrated-manager-for-lustre#2359 For some reason my installs never seem to detect the zpools I create. I've tried going back to 5.1 and also using 6.2
louiscaocao
@louiscaocao
Dec 29 04:50:57 mds1 iml-agent-daemon: #033[2mDec 29 04:50:57.708#033[0m #033[33m WARN#033[0m iml_agent::reader: Error during session start LustreCollectorError(SerdeYamlError(Message("missing field sent_stats", Some(Pos { marker: Marker { index: 56, line: 4, col: 13 }, path: "net[0].local NI(s)[0]" }))))
Dec 29 04:50:57 mds1 iml-agent-daemon: #033[2mDec 29 04:50:57.708#033[0m #033[32m INFO#033[0m iml_agent::http_comms::session: Terminating session PluginName("stats")/Id("4aa2039c-de80-4b34-a0af-dc04b1ee5cee")
Dec 29 04:50:58 mds1 iml-agent-daemon: #033[2mDec 29 04:50:58.591#033[0m #033[32m INFO#033[0m iml_agent::poller: sending session create request for stats
Dec 29 04:50:58 mds1 iml-agent-daemon: #033[2mDec 29 04:50:58.591#033[0m #033[32m INFO#033[0m iml_agent::http_comms::agent_client: Requesting new session for: PluginName("stats").
Dec 29 04:50:58 mds1 iml-agent-daemon: #033[2mDec 29 04:50:58.710#033[0m #033[32m INFO#033[0m iml_agent::http_comms::session: Created new session PluginName("stats")/Id("e64d0e14-6c7c-4f8a-8cfe-3b7178db5420")
Spoorthisomashekar
@Spoorthisomashekar
Hi, are there any supporting documents for IML version 6.3.0? Is IML version 6.3.0 supported with RHEL 7.8 (Lustre version 2.12.5)?