Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
  • Aug 13 13:01
    smokingwheels opened #494
  • Jul 25 20:51
    frankenstein91 commented #492
  • Jul 25 14:14
    RuikangSun commented #493
  • Jul 25 13:58
    frankenstein91 commented #493
  • Jul 25 13:39
    RuikangSun edited #493
  • Jul 25 13:38
    RuikangSun opened #493
  • Jul 25 00:35
    hermann-san commented #492
  • Jul 25 00:28
    hermann-san commented #492
  • Jul 25 00:22
    hermann-san commented #492
  • Jul 22 10:34
    frankenstein91 commented #492
  • Jul 21 17:49
    hermann-san commented #492
  • Jul 21 17:06
    frankenstein91 commented #492
  • Jul 21 16:33
    hermann-san commented #492
  • Jul 21 16:31
    hermann-san commented #492
  • Jul 21 14:34
    frankenstein91 commented #481
  • Jul 21 14:28
    frankenstein91 commented #492
  • Jul 20 21:38
    frankenstein91 commented #491
  • Jul 20 20:03
    hermann-san commented #492
  • Jul 20 18:24
    frankenstein91 commented #492
  • Jul 20 15:41
    hermann-san edited #492
rhubear
@rhubear:matrix.org
[m]
A very basic java question. I don't program in java & I've noticed that YaCy dashboard lists the version of java as "Java version: 1.8.0_242".
Whereas the version of java listed on the YaCy Debian server is: openjdk 11.0.12 2021-07-20.
Am I doing something wrong w my java installation on said Debian box, or are these versions as should be??
TimeWalker
@timewalker:foxden.party
[m]
Debian 9 "stretch" has Java 1.8 as default. Debian 10 "buster" has OpenJDK 11 as default
2 replies
deknos82
@deknos82:matrix.org
[m]
perhaps yacy brings its own java?
Michael Christen
@Orbiter
No, no Java embedded
2 replies
@allen_dema:matrix.org you do not ssh into a container. You can attach a shell wit docker exec
1 reply
Michael Christen
@Orbiter
Ah yes/no: the normal releases do not come with Java but docker images come with their own Java.
rhubear
@rhubear:matrix.org
[m]
@Orbiter: Previously I was asking re attaching yacy docker to an external volume for data storage.
You were saying that I should link the yacy docker filesystem to external storage space.
Since then I've been able to use the "-v" ext-volume docker switch on another docker container, however the syntax is the opposite of what was documented with yacy.
Syntax is: "-v EXT_VOL:/CONTAINER_DATA".
I will try this with my yacy docker.
Can you confirm that the YaCy DATA directory is: yacy_search_server_data? This is what is documented. I've found no way of viewing a container file system by attaching.
rhubear
@rhubear:matrix.org
[m]
Ok, I've realised my prev post was not accurate. The -v is correctly used in the docs.
However, when using the volume option in a docker-compose config, the container starts without error, but obv not using my existing data folder.
Instead YaCy starts a new repo.... W default password (for example).
Michael Christen
@Orbiter
I have Not tried this with docker-compose yet
5 replies
Marx1st
@Marx1st
Hi! I'm running a server with yacy 1.921/9882 and I would like to import a RSS feed, but I only get the error "no valid response from given url" and the log says: "W 2021/12/08 16:11:30 Load_RSS Client can't execute: Received fatal alert: handshake_failure duration=2 for url https://www.uni-wuppertal.de/de/rss.xml"
But it is a valid feed. I checked it with a feed validator.
Marx1st
@Marx1st
I think I found the problem: yacy/yacy_search_server#189
The problem is that my version seems to be too old, so I would like upgrade from my self compiled version to Docker. I've pointed "yacy_search_server_data" to my existing yacy data dir, but the Docker version did not import any configuration or index data.
3 replies
How does one migrate an existing yacy installation to Docker?
The Doctor
@virtadpt
@Marx1st Dump your existing YaCy index to an XML file from the admin control panel, then re-import it into the new one you set up.
Marx1st
@Marx1st
Hi! Is yacy vulnarable to the new Log4Shell exploid? https://www.bugcrowd.com/blog/log4shell-the-worst-java-vulnerability-in-years/
The Doctor
@virtadpt
I've got a weird question about YaCy...
Yesterday, I logged into the admin interface of my YaCy instance to check on things. Said instance has been running since 2019, and had somewhere in the neighborhood of a million URLs in its index. When I looked at the index size it was down around 256 indexed URLs. Gave me a bit of a fright, it did.
So, I logged into the box in question and took a look in the yacy_search_server/DATA/INDEX/ directory. The intranet/ directory is pretty small (because I never use that mode), the freeworld/ directory as well (same reason). webportal/ is huge (which is good).
The Doctor
@virtadpt
Inside the SEGMENTS/ subdirectory of webportal/, I see two Solr directories, solr_6_6/ and solr_8_8_1/. The solr_6_6/ is where all of my indexed URLs are.
My question is, what happened here? And, is there some way of merging the two indices? Do I have to switch back to the solr_6_6/ index and export it, and if so, how?
Michael Christen
@Orbiter
Yes, Ivam very sorry for this, I fucked up the migration...
Migration of one solr Version, can bei done by solr, but not two.
You must Put back the Index to an older version of YaCy and export it, then reindex it with the new version.
I believe this ist a topic somewhe in the forum.
The Doctor
@virtadpt
The Doctor
@virtadpt
I checked out this commit, just prior to the release of yacy_v1.924_20201214_10042.tar.gz: c0d9a3e9a782607acbe90f70abb5c09eb83fea41
I'm using the build process in README.md: cd libbuild/ && mvn clean install -DskipTests
I keep getting this error:
[ERROR] Failed to execute goal on project yacycore: Could not resolve dependencies for
project net.yacy:yacycore:jar:1.922: Failed to collect dependencies at
org.apache.solr:solr-core:jar:6.6.6 -> org.restlet.jee:org.restlet:jar:2.3.0
I had to track down and download solr-core-6.6.6.jar and org.restlet-2.3.0.jar manually because they couldn't be downloaded by Maven (mostly org.restlet, tbh). I even added the switches -rf :yacycore when I tried to rebuild, per the output of Maven.
The Doctor
@virtadpt
Adding the -X flag to the mvn command shows that it can't find the .pom file for org.restlet.jee. I manually downloaded it into the libbuild/ directory but still get the same error.
I think I have to mod a build file or two to make this work, but I'm not sure where. Can you help?
It's because the org.restlet.jee jar file can't be downloaded from that location anymore, it keeps redirecting to jFrog.
Just not sure how to work around it.
Michael Christen
@Orbiter
Oh, that maven File is not the right way. Do: ant clean assemble
The Doctor
@virtadpt
I did, and it seems to be working now. Thank you. Will be writing up for my blog soon.
Now I just need to figure out if the high system load is because somebody popped log4shells on said box.
Wayde
@wad67:matrix.org
[m]
Hello, I have spent a number of hours trying out YaCy today. It is novel but generally does not work? Here is an image
I can find a few articles, generally. Most of the time my results are populated by zip files containing very large dictionaries.
TimeWalker
@timewalker:foxden.party
[m]
Very likely nobody has crawled for jmonkey documentation
Wayde
@wad67:matrix.org
[m]
Righto, so I conduct my own crawl for it. Correct?
I have tried this on a few websites, however it just returns parser errors and does not index anything
The Doctor
@virtadpt
@wad67:matrix.org Yes, that is correct.
Michael Christen
@Orbiter
We are progressing with searchlab.eu .. you can start a crawl now!
James Pedersen
@watcher00090
Hi, how do broken links get handled in Yacy? Do they stay in the index even after subsequent crawls?
Michael Christen
@Orbiter
yes, unless they are deleted. For this, there is an optin for re-crawls to delete old links first
James Pedersen
@watcher00090
@Orbiter Awesome, thanks