These are chat archives for soruly/whatanime.ga

19th
Sep 2016
soruly
@soruly
Sep 19 2016 02:11
elasticsearch is for mapping filenames/folders to anilist entries, so I can have anime titles in muliple languages
It doesn't use any special functions of elasticseach. I only use the terms filter. You can use any datastore you like.
If filenames/folder path is all you need, you don't even need that
soruly
@soruly
Sep 19 2016 02:17
For offline use, liresolr and ffmpeg is all you need, the rest are ad hoc scripts you've to write for your specific file structure and use case
soruly
@soruly
Sep 19 2016 02:24
I removed all other image descriptor other than colorlayout because my server run out of space, and to reduce the size of index
Among all image descriptors, the index speed of colorlayout is fastest, while having satisfactory accuracy
soruly
@soruly
Sep 19 2016 02:30
Edge Histogram probably has better accuracy, but only in higher resolution. And it takes more time to indexing.
Scaling down images before passing it to solr indexer has little effect on accuracy on color layout, but would be a big deal for edge histogram
soruly
@soruly
Sep 19 2016 02:44
You also need that python script to transform lire output to append timecodes to filesname
The existing LireRequestHandler uses BooleanClause.Occur.SHOULD on serveral randomly selected hashes, which is very slow and would return different results every time
I changed that to BooleanClause.Occur.MUST, and always start searching from the least populated hashes first, so the results is consistent and cache friendly
soruly
@soruly
Sep 19 2016 02:50
To rebuild liresolr, you need apache ant
I think it's better to just get an idea from my scripts and write your own
soruly
@soruly
Sep 19 2016 02:56
BTW, I'm interested in what if you do it the other way: index these 10,000+ images in liresolr and scan through all your videos as an exhaustive search
performance is unlikely an issue if you just have > 100,000 images in index
Xamayon
@SauceNAO_twitter
Sep 19 2016 04:52
Do you have a feel for how old/new the shows are which you have the screenshots from? I should have a workable solution in the near future if I happen to have the appropriate anime.
soruly
@soruly
Sep 19 2016 10:34
I've just added a system diagram on GitHub, you may take a look