wallabag/wallabag

wallabag is a self hostable application for saving web pages.

ploc

@ploc:matrix.gresille.org

I'm not very skilled in php. I know procedural php and not much about object php. I don't know nything about Symphony either.

Would it be hard for me to contribute considering my poor skills?

kartoffelsalat

@kartoffelsalat:tchncs.de

[m]

Hi there!
I have the following parsing problem and hoped that someone here has a handy XPATH-expression for this?
The articles I want to parse have custom article-trigger-element (and similar) tags for some custom highlighting. The actual text is continued in the field "trigger-text". So, for this example,

In Köln habe ich dann das Kommunalwahlprogramm mitgeschrieben, mich als <article-trigger-element trigger-text="City-Lead" article-text="So nennt Volt den Parteivorstand auf lokaler Ebene."> </article-trigger-element> innerhalb der Partei aufstellen lassen und wurde gewählt.

the full sentence would be

"In Köln habe ich dann das Kommunalwahlprogramm mitgeschrieben, mich als City-Lead innerhalb der Partei aufstellen lassen und wurde gewählt."

How can I write a proper XPath config for this? Thanks!

kartoffelsalat

@kartoffelsalat:tchncs.de

[m]

Noone any suggestion for my xpath problem above?

Dmitriy Bogdanov

@di72nn

@kartoffelsalat:tchncs.de I don't remember much about parsing, but I would try replacing <article-trigger-element trigger-text=" with an empty string, article-text=" with some opening tag that is ignored, and "> </article-trigger-element> with respective closing tag.

kartoffelsalat

@kartoffelsalat:tchncs.de

[m]

Thanks @di72nn , good idea! It fails however, because these empty nodes are automatically removed before being able to replace them:

graby.DEBUG: HTML after regex empty nodes stripping

I've specified prune: no and tidy: no but still do not see the tags survive the first processing step ...

André M. Faria

@andre-faria

Hello, I got a problem with my MariaDB where I'm storing the wallabag database, I did a dump and loaded it in another server, configured permissions to remote access and I just can't make wallabag works.

I've changed parameters.yml to point to the new server.

\n\nSQLSTATE[42S02]: Base table or view not found: 1932 Table 'wallabag.wallabag_user' doesn't exist in engine at /var/www/wallabag/vendor/doctrine/dbal/lib/Doctrine/DBAL/Driver/AbstractMySQLDriver.php:115

itresearch

@mg64ve

Hello, I am new to wallabag. It is not clear to me if it is possible to upload locally cached .html files with images and text. Can anyone clarify? My tests fail at the moment...

nicosomb

@nicosomb:matrix.org

[m]

Hello. No it’s not a feature available in wallabag.

kdecherf

@kdecherf:matrix.org

[m]

"well"

I made a hacky controller on my instance to upload pages through the WebScrapBook browser addon

itresearch

@mg64ve

Ok thanks @nicosomb:matrix.org . @kdecherf:matrix.org could you please give me an overview of your solution and some hints on how to implement. Please notice I am more confident with python than php. Are you using wallabag API ? (if they exist, I am not sure)

kdecherf

@kdecherf:matrix.org

[m]

there's no option to upload content through the API at that time, I was forced to edit several projects at once to add this ability. It's not upstream yet.

You will need to change the ContentProxy on wallabag, the main entrypoint of Graby to bypass the http fetcher and so on

I'll try to put my hacky and dirty patch somewhere for others to see it

itresearch

@mg64ve

do you mean this involves PHP hacking of wallabag code @kdecherf:matrix.org ? Does wallabag now have API that allow to do this in another way?

kdecherf

@kdecherf:matrix.org

[m]

yes, it implies to change code on wallabag, no there is no api available to do that

itresearch

@mg64ve

that's a pity @kdecherf:matrix.org . Are API in the wallabag development roadmap?

kdecherf

@kdecherf:matrix.org

[m]

a lot of things are in the backlog, there's low rate of contributions unfortunately

itresearch

@mg64ve

ok thanks @kdecherf:matrix.org

itresearch

@mg64ve

and what is this @kdecherf:matrix.org : https://app.wallabag.it/api/ ?

kdecherf

@kdecherf:matrix.org

[m]

@mg64ve I said that there is an API on wallabag but there is no option nor endpoint to upload actuel content

Dmitriy Bogdanov

@di72nn

@mg64ve @kdecherf:matrix.org it's possible to add articles with custom content and title using the POST /api/entries endpoint.

itresearch

@mg64ve

Thanks @di72nn ! Is it possible to offline batch upload existing .html files with images cached in the local disk to a remote wallabag instance?

kdecherf

@kdecherf:matrix.org

[m]

@di72nn: well, indeed, I forgot that, however this endpoint will save the content as-is, bypassing graby extraction

Dmitriy Bogdanov

@di72nn

@mg64ve you can batch it on the client side, but I don't think there is any easy way to upload local images. I think it should be possible to replace image URLs in the HTML and upload images via other ways (ssh or whatever)

@kdecherf:matrix.org yeah, the applicability depends on use cases 🤷‍♂️

taha

@taha:matrix.org

[m]

I successfully migrated a Wallabag 2.3.8 MySQL database to another Wallabag 2.3.8 PostgreSQL instance using pgloader. All users and their articles can be accessed from the new PostgreSQL-backed Wallabag instance. It's also possible to edit existing article titles, and to delete articles. But, attempting to add new articles leads to "error 500". Ditto if I try to create tags. The specific error message is Undefined table: 7 ERROR: relation "entry_id_seq" does not exist LINE 1: SELECT NEXTVAL('"entry_id_seq"') ^. Am I perhaps missing some obvious database-repair command? Does anyone have any experience with mysql -> pgsql migration for Wallabag?

kartoffelsalat

@kartoffelsalat:tchncs.de

[m]

Does wallabag support client-side javascript rendering (vuejs) to at least some extent?

kdecherf

@kdecherf:matrix.org

[m]

kartoffelsalat: no, there is no javascript rendering done when wallabag fetches articles, and js tags are removed from the output content

(if you're talking about fetching articles)

kartoffelsalat

@kartoffelsalat:tchncs.de

[m]

yes, I'm talking about fetching articles. thanks! (although I wanted to hear that there is an option for that, nevermind).

kdecherf

@kdecherf:matrix.org

[m]

btw you could have a tool that fetch a page using a headless browser and send the complete html to wallabag through the api

kartoffelsalat

@kartoffelsalat:tchncs.de

[m]

ok? that sound's a bit complicated..?

kdecherf

@kdecherf:matrix.org

[m]

probably

@lh:hrdl.eu

[m]

I'm trying to authenticate with a website that requires two additional fields. The following naïve solutions disregards the dependence of the values:

login_extra_fields: login_ticket=@=xpath('//input[@name="login_ticket"]/@value', request_html('https://id.sueddeutsche.de/login'))
login_extra_fields: _csrf=@=xpath('//form[@id="login-form"]//input[@name="_csrf"]/@value', request_html('https://id.sueddeutsche.de/login'))

I couldn't find a configuration-based approach that allows implementing either caching the downloaded page or setting both values at once. What's the best way to go about this in your opinion?

amammad

@amammad

Hey Wallabag team
I hope all for all of you to be good and nice these days ...

Abhilesh Dhawanjewar

@abhilesh

Hey guys, I'm starting to see this error in my database logs -
2021-11-13 18:52:31 6 [Warning] Access denied for user 'root'@'localhost' (using password: NO)

The instance was running perfectly fine but recently I couldn't login with my login details.
I'm running wallabag using docker-compose on a Ubuntu 20.04 VM over Proxmox 7.

Here's the relevant details from my docker-compose -

version: '3'
services:
  wallabag:
          #build: https://github.com/wallabag/docker.git#2.4.2
    image: wallabag/wallabag
    #image: abhilesh7/wallabag-arm
    container_name: wallabag_app
    environment:
      - MYSQL_ROOT_PASSWORD=secure-password
      - SYMFONY__ENV__DATABASE_DRIVER=pdo_mysql
      - SYMFONY__ENV__DATABASE_HOST=db
      - SYMFONY__ENV__DATABASE_PORT=3306
      - SYMFONY__ENV__DATABASE_NAME=wallabag
      - SYMFONY__ENV__DATABASE_USER=wallabag
      - SYMFONY__ENV__DATABASE_PASSWORD=password
      - SYMFONY__ENV__DATABASE_CHARSET=utf8mb4
      - SYMFONY__ENV__MAILER_HOST=smtp.gmail.com
      - SYMFONY__ENV__MAILER_USER=gmail-user
      - SYMFONY__ENV__MAILER_PASSWORD=gmail-password
      - SYMFONY__ENV__FROM_EMAIL=gmail-email-address
      - SYMFONY__ENV__DOMAIN_NAME=https://wallabag.domain.net
      - SYMFONY__ENV__SERVER_NAME="Your wallabag instance"
    ports:
      - 80:80
    volumes:
      - /opt/wallabag/images:/var/www/wallabag/web/assets/images
    healthcheck:
      test: ["CMD", "wget" ,"--no-verbose", "--tries=1", "--spider", "http://localhost"]
      interval: 1m
      timeout: 3s
    depends_on:
      - db
      - redis
    restart: unless-stopped

  db:
    image: mariadb
    container_name: wallabag_db
    environment:
      - MYSQL_ROOT_PASSWORD=secure-password
    volumes:
      - /opt/wallabag/data:/var/lib/mysql
    healthcheck:
      test: ["CMD", "mysqladmin" ,"ping", "-h", "localhost"]
      interval: 20s
      timeout: 3s
    restart: always

  redis:
    image: redis:alpine
    container_name: wallabag_redis
    healthcheck:
      test: ["CMD", "redis-cli", "ping"]
      interval: 20s
      timeout: 3s
    restart: always

Not sure why it's overriding the database login credentials specified in the docker-compose. Any pointers how to fix this

Abhilesh Dhawanjewar

@abhilesh

I also changed the volume mounts to ./wallabag-image such that the directory can be chowned but still the same error

relejek

@relejek:matrix.org

[m]

Hey all. Where can I find a list of public wallabag hosted servers?

kdecherf

@kdecherf:matrix.org

[m]

Hello relejek,, unfortunately there is no such list

nicosomb

@nicosomb:matrix.org

[m]

https://alt.framasoft.org/en/framabag

nicofrand

@nicofrand:matrix.nicofrand.eu

[m]

Hi! The migration from 2.3.8 is failing for several users due to a DROP FOREIGN KEY failing (not existing)

Could someone tell if editing a migration is OK, to add a IF EXISTS clause? See https://github.com/wallabag/wallabag/issues/5233#issuecomment-972667069

月季花中的星辰

@starsareintherose

Hello, when I upload files, it always show 500: Internal Server Error
Unable to write in the "/usr/share/webapps/wallabag/web/uploads/import" directory.

but actually I run nginx and php-fpm as root and make /usr/share/webapps/wallabag and /var/lib/wallabag belong to root.

月季花中的星辰

@starsareintherose

drwxr-xr-x 3 root 4096 Jul 25 16:17 .
drwxr-xr-x 8 root 4096 Nov 28 15:41 ..
drwxr-xr-x 2 root 4096 Nov 28 15:41 import

Adam Monsen

@meonkeys

I self-host wallabag with docker-compose. When the app container starts, the db (mariadb) says:

[Warning] Aborted connection 14 to db: 'unconnected' user: 'unauthenticated' host: '172.22.0.4' (This connection closed normally without authentication)

. Then the app says Provisioner finished.. That aborted connection is most likely from the provisioner. Anyone know what the provisioner is doing?

kdecherf

@kdecherf:matrix.org

[m]

@meonkeys: the docker image starts an Ansible playbook at launch for provisioning things like the user

Where communities thrive

People

Repo info

Activity