wallabag/wallabag

wallabag is a self hostable application for saving web pages.

Christian

@christian:kampka.net

Hi guys, quick question:
From what I can figure, I can tell wallabag to change the user agent on certain sites, however documentation seems to be sparse.
It seems like the configuration moved from internal to site_config but I am not familiar with what that is exactly.
Can someone provide some pointers? 🙃

2 replies

kdecherf

@kdecherf:matrix.org

[m]

Let me know if you still have questions

odyon01

@odyon01

Hi, need some help as I'm getting:

2021/09/11 10:13:35 [error] 174#174: *118 FastCGI sent in stderr: "PHP message: PHP Fatal error:  Uncaught PDOException: SQLSTATE[HY000]: General error: 1 no such table: wallabag_internal_setting in /var/www/wallabag/vendor/doctrine/dbal/lib/Doctrine/DBAL/Driver/PDOConnection.php:67

The table wallabag_internal_setting exists in the DB when I connect using PGadmin.
Wallabag was working fine for months/years, but suddenly (not sure if i updated something back then), it stopped working and i got the above message. I'm running Postgres (12.6), and Wallabag (2.4.2). Do you know if there's some incompatibility with this Postgres version, or should i do something extra after upgrading postgres? All env-settings of wallabag are the same as the used to be when it all worked just fine.
Thanks!

1 reply

Bruno Fontes

@brunofontes:matrix.brunofontes.net

[m]

Its not the first time I see someone having issues with postgres bit I didn't notice versions

odyon01

@odyon01

Yes, I also saw something before. The strange thing is, it was working for more than a year just smoothly.

ploc

@ploc:matrix.gresille.org

[m]

Is it possible de delete a user in Wallabag? I found in the doc that it was possible to create or to deactivate a user, but I found no way to delete an existing user.

By the way I found no way to set an existing user to an admin role within the GUI. Is there a way to do that?

kdecherf

@kdecherf:matrix.org

[m]

ploc you can delete a user from the user management interface after clicking on edit

1 reply

MTX-6oX

@MTX-6oX

hello guys i got 2 questions:

1.some reddit posts are fetched correctly and some get the error "... new Reddit on an old browser. The site may not work ... update your browser ! If you do not update ... visit old reddit ."
links are build exactly the same, no archive or other subdomain on them.
Can somebody explain?

AND
2.what does "content" relate to at the "tagging rules"?
From my observations it seems to be at least title+body? maybe even more like url or like rly everything that was fetched?

Thanks!

kdecherf

@kdecherf:matrix.org

[m]

@MTX-6oX: for the second question, content should only refer to the body of an entry

1 reply

kdecherf

@kdecherf:matrix.org

[m]

ploc: it looks like it's not possible via the api

1 reply

kdecherf

@kdecherf:matrix.org

[m]

I know, feel free to make contributions if you want

ploc

@ploc:matrix.gresille.org

[m]

I'm not very skilled in php. I know procedural php and not much about object php. I don't know nything about Symphony either.

Would it be hard for me to contribute considering my poor skills?

kartoffelsalat

@kartoffelsalat:tchncs.de

[m]

Hi there!
I have the following parsing problem and hoped that someone here has a handy XPATH-expression for this?
The articles I want to parse have custom article-trigger-element (and similar) tags for some custom highlighting. The actual text is continued in the field "trigger-text". So, for this example,

In Köln habe ich dann das Kommunalwahlprogramm mitgeschrieben, mich als <article-trigger-element trigger-text="City-Lead" article-text="So nennt Volt den Parteivorstand auf lokaler Ebene."> </article-trigger-element> innerhalb der Partei aufstellen lassen und wurde gewählt.

the full sentence would be

"In Köln habe ich dann das Kommunalwahlprogramm mitgeschrieben, mich als City-Lead innerhalb der Partei aufstellen lassen und wurde gewählt."

How can I write a proper XPath config for this? Thanks!

kartoffelsalat

@kartoffelsalat:tchncs.de

[m]

Noone any suggestion for my xpath problem above?

Dmitriy Bogdanov

@di72nn

@kartoffelsalat:tchncs.de I don't remember much about parsing, but I would try replacing <article-trigger-element trigger-text=" with an empty string, article-text=" with some opening tag that is ignored, and "> </article-trigger-element> with respective closing tag.

kartoffelsalat

@kartoffelsalat:tchncs.de

[m]

Thanks @di72nn , good idea! It fails however, because these empty nodes are automatically removed before being able to replace them:

graby.DEBUG: HTML after regex empty nodes stripping

I've specified prune: no and tidy: no but still do not see the tags survive the first processing step ...

André M. Faria

@andre-faria

Hello, I got a problem with my MariaDB where I'm storing the wallabag database, I did a dump and loaded it in another server, configured permissions to remote access and I just can't make wallabag works.

I've changed parameters.yml to point to the new server.

\n\nSQLSTATE[42S02]: Base table or view not found: 1932 Table 'wallabag.wallabag_user' doesn't exist in engine at /var/www/wallabag/vendor/doctrine/dbal/lib/Doctrine/DBAL/Driver/AbstractMySQLDriver.php:115

itresearch

@mg64ve

Hello, I am new to wallabag. It is not clear to me if it is possible to upload locally cached .html files with images and text. Can anyone clarify? My tests fail at the moment...

nicosomb

@nicosomb:matrix.org

[m]

Hello. No it’s not a feature available in wallabag.

kdecherf

@kdecherf:matrix.org

[m]

"well"

I made a hacky controller on my instance to upload pages through the WebScrapBook browser addon

itresearch

@mg64ve

Ok thanks @nicosomb:matrix.org . @kdecherf:matrix.org could you please give me an overview of your solution and some hints on how to implement. Please notice I am more confident with python than php. Are you using wallabag API ? (if they exist, I am not sure)

kdecherf

@kdecherf:matrix.org

[m]

there's no option to upload content through the API at that time, I was forced to edit several projects at once to add this ability. It's not upstream yet.

You will need to change the ContentProxy on wallabag, the main entrypoint of Graby to bypass the http fetcher and so on

I'll try to put my hacky and dirty patch somewhere for others to see it

itresearch

@mg64ve

do you mean this involves PHP hacking of wallabag code @kdecherf:matrix.org ? Does wallabag now have API that allow to do this in another way?

kdecherf

@kdecherf:matrix.org

[m]

yes, it implies to change code on wallabag, no there is no api available to do that

itresearch

@mg64ve

that's a pity @kdecherf:matrix.org . Are API in the wallabag development roadmap?

kdecherf

@kdecherf:matrix.org

[m]

a lot of things are in the backlog, there's low rate of contributions unfortunately

itresearch

@mg64ve

ok thanks @kdecherf:matrix.org

itresearch

@mg64ve

and what is this @kdecherf:matrix.org : https://app.wallabag.it/api/ ?

kdecherf

@kdecherf:matrix.org

[m]

@mg64ve I said that there is an API on wallabag but there is no option nor endpoint to upload actuel content

Dmitriy Bogdanov

@di72nn

@mg64ve @kdecherf:matrix.org it's possible to add articles with custom content and title using the POST /api/entries endpoint.

itresearch

@mg64ve

Thanks @di72nn ! Is it possible to offline batch upload existing .html files with images cached in the local disk to a remote wallabag instance?

kdecherf

@kdecherf:matrix.org

[m]

@di72nn: well, indeed, I forgot that, however this endpoint will save the content as-is, bypassing graby extraction

Dmitriy Bogdanov

@di72nn

@mg64ve you can batch it on the client side, but I don't think there is any easy way to upload local images. I think it should be possible to replace image URLs in the HTML and upload images via other ways (ssh or whatever)

@kdecherf:matrix.org yeah, the applicability depends on use cases 🤷‍♂️

taha

@taha:matrix.org

[m]

I successfully migrated a Wallabag 2.3.8 MySQL database to another Wallabag 2.3.8 PostgreSQL instance using pgloader. All users and their articles can be accessed from the new PostgreSQL-backed Wallabag instance. It's also possible to edit existing article titles, and to delete articles. But, attempting to add new articles leads to "error 500". Ditto if I try to create tags. The specific error message is Undefined table: 7 ERROR: relation "entry_id_seq" does not exist LINE 1: SELECT NEXTVAL('"entry_id_seq"') ^. Am I perhaps missing some obvious database-repair command? Does anyone have any experience with mysql -> pgsql migration for Wallabag?

kartoffelsalat

@kartoffelsalat:tchncs.de

[m]

Does wallabag support client-side javascript rendering (vuejs) to at least some extent?

kdecherf

@kdecherf:matrix.org

[m]

kartoffelsalat: no, there is no javascript rendering done when wallabag fetches articles, and js tags are removed from the output content

(if you're talking about fetching articles)

kartoffelsalat

@kartoffelsalat:tchncs.de

[m]

yes, I'm talking about fetching articles. thanks! (although I wanted to hear that there is an option for that, nevermind).

kdecherf

@kdecherf:matrix.org

[m]

btw you could have a tool that fetch a page using a headless browser and send the complete html to wallabag through the api

kartoffelsalat

@kartoffelsalat:tchncs.de

[m]

ok? that sound's a bit complicated..?

kdecherf

@kdecherf:matrix.org

[m]

probably

@lh:hrdl.eu

[m]

I'm trying to authenticate with a website that requires two additional fields. The following naïve solutions disregards the dependence of the values:

login_extra_fields: login_ticket=@=xpath('//input[@name="login_ticket"]/@value', request_html('https://id.sueddeutsche.de/login'))
login_extra_fields: _csrf=@=xpath('//form[@id="login-form"]//input[@name="_csrf"]/@value', request_html('https://id.sueddeutsche.de/login'))

I couldn't find a configuration-based approach that allows implementing either caching the downloaded page or setting both values at once. What's the best way to go about this in your opinion?

amammad

@amammad

Hey Wallabag team
I hope all for all of you to be good and nice these days ...

Where communities thrive

People

Repo info

Activity