Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
    you06
    @you06
    Hi all, I'm currently learning on lindera.
    Jun Ohtani
    @johtani
    Welcome!
    Paul Masurel
    @fulmicoton
    I think shipping lindera with Bayard is fine... It will be tiny for a server anyway.
    1 reply
    you06
    @you06
    It seems lindera is made for search engine not NLP, right?
    Jun Ohtani
    @johtani
    Basically, yes
    @you06 But, we can use it for NLP. What do you think?
    you06
    @you06
    Yes, but the performance is important. I don't work on NLP, and have more interest in search engine and databases.
    Jun Ohtani
    @johtani
    Great :D
    We can use Lindera to tantivy. I’m not using yet ;p
    Minoru OSUKA
    @mosuka
    @you06 I would like to get a fade back if you know someone who is an NLP engineer.
    I would like to have Lindera used in a wide range of fields.
    you06
    @you06
    No, I don't know NLP engineer. But I know little about NLP, the popular segmentation tool in Chinese even use deep learning for more accuracy. I don't think it's necessary for search engine usage.
    Minoru OSUKA
    @mosuka
    @you06 I see. Do you know those links?
    Minoru OSUKA
    @mosuka
    @you06 Thanks.
    Minoru OSUKA
    @mosuka
    @/all
    Lindera v0.6.0 is now available.
    From this version, we changed the internal data structure from Finite-state transducer (FST) to Double Array Trie, which improved the performance by 11%-28%.
    Thanks to everyone involved.
    you06
    @you06
    🎉
    Jun Ohtani
    @johtani
    :tada:
    Jun Ohtani
    @johtani
    👋
    Takuya Asano
    @takuyaa
    Thank you to adopt my library yada!
    Minoru OSUKA
    @mosuka
    :+1:
    :+1:
    docs.rs のビルドに失敗していた。
    Minoru OSUKA
    @mosuka
    workspaceに移行したタイミングっぽいな。
    0.3.5: 成功 workspace 移行前
    0.4.0: 失敗 workspace 移行後
    Minoru OSUKA
    @mosuka

    https://docs.rs/crate/lindera/0.6.0/builds

    Seems to have reached the resource limit.

    Minoru OSUKA
    @mosuka
    I’ll ask docs.rs team.
    Jun Ohtani
    @johtani
    There is something DNS
    error
    Minoru OSUKA
    @mosuka
    Created a new issue.
    lindera-morphology/lindera#83
    Jun Ohtani
    @johtani
    :+1:
    Minoru OSUKA
    @mosuka
    Hi, guys.
    Right now, the lindera-cli package is managed in the lindera repository as a member of the workspace.
    I'm thinking of keeping the lindera repository for library crates only and moving the binary crates like lindera-cli to a separate repository.
    What do you think?
    Jun Ohtani
    @johtani
    +1
    Takuya Asano
    @takuyaa
    No problem. I don’t have any strong opinions.
    Minoru OSUKA
    @mosuka
    @johtani @takuyaa Thanks, I made an issue.
    lindera-morphology/lindera#87
    Jun Ohtani
    @johtani
    :+1:
    Jun Ohtani
    @johtani
    @mosuka we should change the setting of lindera-ipadic-neologd-builder to require review before merge.
    right?
    Minoru OSUKA
    @mosuka
    Yes, that would be good.
    Minoru OSUKA
    @mosuka
    @johtani Merged!
    Jun Ohtani
    @johtani
    :+1:
    Jun Ohtani
    @johtani
    Same issue on lindra-ko-dic-builder
    Minoru OSUKA
    @mosuka
    Lindera 0.7.0 has been released!
    Thank you for your cooperation!
    Jun Ohtani
    @johtani
    :tada:
    Minoru OSUKA
    @mosuka
    Jun Ohtani
    @johtani
    :tada:
    Takuya Asano
    @takuyaa
    Awesome
    you06
    @you06
    This weekend I learned mecab and cedict_ts(a Chinese dictionary). I have a basic implementation and it worked for parsing cedict_ts to mecab's format now, but still got error when parsing to lindera's. I've filed up a pull request. There are some issues for cedict_ts, they are listed in the PR. lindera-morphology/lindera-cc-cedict-builder#3
    Minoru OSUKA
    @mosuka
    @you06 Thanks!