These are chat archives for collectiveaccess/support

21st
Apr 2016
tsitsibau
@tsitsibau
Apr 21 2016 05:41 UTC
hello, i have a problem... that you might be able to help, i just installed my application at the production server... when i add a new collection (or lot etc) it doesn't appear in autocomplete forms... unless i rebuild indices manually...
one solution (just to work for a while) might be to disable search indices... but i'm not sure if and how i can do it... thanks in advance for any help
(i have tried both sqlsearch and elasticsearch so far)
Kehan Harman
@kehh
Apr 21 2016 09:24 UTC
@stefankeidel PHP Fatal error: Uncaught exception 'ImagickException' with message 'Unable to set image colorspace' in /data/deploy/providence/20160321_150127/app/lib/core/Plugins/Media/Imagick.php:559(using master-fix)
PMassoels
@PMassoels
Apr 21 2016 10:45 UTC
Hi there
Someone told me it was possible to get a list of the updated record trough the OAI-PMH provider. Someone here got experience with that?
Stefan
@stefankeidel
Apr 21 2016 10:56 UTC
@tsitsibau My first guess is that the async search indexing is failing on your production system for some reason. Try turning it off (set disable_out_of_process_search_indexing = 1 in app.conf)
@kehh Oh well, Imagick. Have you tried using Gmagick instead? Should be a lot faster and - at least in our experience - a lot less prone to crash
@PMassoels Yup, both the ListRecords and ListIdentifiers verbs have from and until parameters as far as I know.
PMassoels
@PMassoels
Apr 21 2016 11:50 UTC
where do i define the exporter ?
Kehan Harman
@kehh
Apr 21 2016 11:58 UTC
status.png
@stefankeidel ermm??? this says I'm using Gmagick?
Stefan
@stefankeidel
Apr 21 2016 12:05 UTC
Maybe Gmagick is not enabled for your CLI? In Debian/Ubuntu the CLI has a separate config
Does php -i list gmagick?
@PMassoels Which exporter are you talking about?
PMassoels
@PMassoels
Apr 21 2016 12:06 UTC
i'm not familiar with aoi and i try to configure it
i get the following respons <error code="cannotDisseminateFormat">Exporter with code ca_objects does not exist</error>
referring to formats = {
oai_dc = {
mapping = code_of_your_oai_dc_mapping_here,
schema = http://www.openarchives.org/OAI/2.0/oai_dc.xsd,
metadataNamespace = http://www.openarchives.org/OAI/2.0/oai_dc/
}
},
Stefan
@stefankeidel
Apr 21 2016 12:07 UTC
Well you need to hook up a data exporter (http://docs.collectiveaccess.org/wiki/Data_Exporter) for the OAI-PMH provider
OAI-PMH is just a wrapper around whatever export you define. It's usually just dc, but people put all kinds of formats in there
PMassoels
@PMassoels
Apr 21 2016 12:11 UTC
I just want the id's of the updated objects , what exporter would apply for me?
Stefan
@stefankeidel
Apr 21 2016 12:14 UTC
Well you can make a really simple one with just one Mapping that exports the object_id (or idno)
But if all you want is a list of updated/new objects, why not just use the search api instead? You should be able to search for something like updated:2014 or created:yesterday
any valid time expression parser expression will work -- and I think last I checked those worked for elasticsearch too
PMassoels
@PMassoels
Apr 21 2016 12:17 UTC
ok, thanks :)
Stefan
@stefankeidel
Apr 21 2016 12:17 UTC
it might be ca_objects.updated for elasticsearch ... not entirely sure
PMassoels
@PMassoels
Apr 21 2016 12:20 UTC
thanks for the tip :)
PMassoels
@PMassoels
Apr 21 2016 12:25 UTC
created seems to work, updated seems to give back no results
found it , it's "modified" in stead of updated
Stefan
@stefankeidel
Apr 21 2016 12:30 UTC
Oops.
Kehan Harman
@kehh
Apr 21 2016 12:49 UTC
@stefankeidel it is enabled. I saw some switches in the conf about turning different plugins on or off
 php -i|grep magi
/etc/php5/cli/conf.d/20-gmagick.ini,
libmagic => 517
gmagick
gmagick module => enabled
gmagick version => 1.1.7RC3
Kehan Harman
@kehh
Apr 21 2016 13:59 UTC
@stefankeidel oops - helps if I'd done a status check on the actual server that had the exception rather than my dev machine. Gmagick not available. ;)
Stefan
@stefankeidel
Apr 21 2016 14:01 UTC
Oh well
PMassoels
@PMassoels
Apr 21 2016 14:12 UTC
@stefankeidel can i also look for the deleted records?
Stefan
@stefankeidel
Apr 21 2016 15:00 UTC
nope, those are always filtered no matter what
tsitsibau
@tsitsibau
Apr 21 2016 15:36 UTC
@stefankeidel that was awesome support!!! it fixed it! i guess that this might make save take more time?
which file handles out of process search indexing in case i manage to debug this! thanks a lot
Stefan
@stefankeidel
Apr 21 2016 15:46 UTC
We had some problems with the locking/mutex code for that feature in the past. We tried using SysV semaphores but it turns out not that many systems have them and they can get irreversably stuck very easily. Ever since then it's all done with a simple lock file. Maybe you're using an older version that still has the semaphores. The code is in app/models/ca_search_indexing_queue.php
The code that fires of the async request is in app/lib/core/Controller/Request/RequestHTTP.php-- in the close() method
tsitsibau
@tsitsibau
Apr 21 2016 17:10 UTC
thanks, i use the latest version, but there is probably a permissions issue with the lock file
Stefan
@stefankeidel
Apr 21 2016 17:11 UTC
Could be. We're using the PHP temp dir which should be writable --- unless it's not ;-)
tsitsibau
@tsitsibau
Apr 21 2016 17:12 UTC
it is...
tsitsibau
@tsitsibau
Apr 21 2016 17:18 UTC
the app wouldn't work otherwise...
kaiall
@kaiall
Apr 21 2016 18:56 UTC
@stefankeidel Still cleaning out app/tmp/{our install name}. It looks like I may need to clear that location for Providence too. And what about the other files in app/tmp? There are files there from months ago. . . (And this IS taking forever.)
CollectiveAccess
@collectiveaccess
Apr 21 2016 18:57 UTC
If you want to short circuit things and test with an empty app/tmp just rename the tmp directory and create a new one in its place. You should still delete everything to reclaim the space, but at least you won't have to wait around so much
Stefan
@stefankeidel
Apr 21 2016 19:50 UTC
The Providence one shouldn't get nearly as big either. At least in theory
kaiall
@kaiall
Apr 21 2016 19:52 UTC
It looks like it's not as big, but still quite large. (Of course, I still don't know how big Pawtucket's was, since it was too big for me to get into the folder, or to get a count of anything.)