Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
    Rodolphe Quiédeville
    @rodo
    seems to work :)
    Dimitri Fontaine
    @dimitri
    Cool! It might be easier to discover and use than IRC... we'll see what happens
    Marcin Kuźmiński
    @marcinkuzminski
    Hi Guys, i have a question, i'm trying to migrate sqlite db into postgresdb, pgloader seems to be the only tools that could do proper conversion
    i'm creating a command script to migrate, but i wonder how can i make it only transfer data ?
    I would like to remove such calls ideally: drop cascades to constraint changeset_comments_pull_request_id_fkey on table changeset_comments
    Marcin Kuźmiński
    @marcinkuzminski
    ok, so create no indexes seems to do what i wanted
    Dimitri Fontaine
    @dimitri
    Hi, happy you did find it!
    Karri Niemelä
    @kakoni
    hi! Tring to use csv loading, but cant get timestamps to work. I've defined ts as => ts[ date format 'YYYYMMDDHH24MI']
    csv looks like this 1;201510101010
    Im getting an error saying; invalid input syntax for type timestamp: "2015--1-0- 10: 1:NIL"
    Dimitri Fontaine
    @dimitri
    with current git master code I have "2015-10-10 10:10:NIL"
    fixing that to be "2015-10-10 10:10:00" instead (defaulting non-provided parts from the format string to 00 in the time parts, so that you can ignore seconds here)
    see dimitri/pgloader@da05782 for your problem case and please recompile from a fresh git clone, you should be good then
    Karri Niemelä
    @kakoni
    Aah, ok. thanks!
    Scott Hillman
    @hillmanov
    Hi guys - I am looking to modify the batch options in my config file, but I am having a hard time figuring out where I need to put that, and what the syntax is. From what I gathered from looking at the source it should simply be a matter of putting "batch size = 10000" somewhere.
    Dimitri Fontaine
    @dimitri
    yeah, in the WITH clause
    see https://github.com/dimitri/pgloader/blob/master/test/csv-districts.load for an example of using the “batch rows” parameter (I think you want batch rows rather than batch size, which is intended as memory size limitation rather than number of rows per batch)
    Scott Hillman
    @hillmanov
    Perfect. Thanks!
    Justin
    @xxdesmus
    can I ask a likely dumb question?
    I'm bugging Dimitri directly on Twitter.
    sorry Dimitri :-/
    Justin
    @xxdesmus
    all set. needed to include WITH data only
    Dimitri Fontaine
    @dimitri
    oh you tried here first... well twitter is good too I guess
    Murilo Capanema
    @mcapanema
    Hello guys, we are intending to use the pgloader as a helping tool for our Snow Plow implementation. The problem is that as far as I can see, pgloader still does not support JSON load, is that correct ?
    sspr28
    @sspr28
    Hello Guys, Good day..I am facing a issues using pgloader configuration file...We are using external file to load data to postgresql database using pgloader..After insert , some of the data's are not inserted as expected null (source has null or blank space)..can you help me how to mention null if blanks on configuration file or any possible way to fix
    Dimitri Fontaine
    @dimitri
    @mcapanema : can you detail your JSON use case a bit please?
    @sspr28 see https://github.com/dimitri/pgloader/blob/master/test/archive.load and https://github.com/dimitri/pgloader/blob/master/test/csv-nulls.load for examples on how to do that
    sspr28
    @sspr28
    Thank you Dimitri...er are tryong to load from Text file.
    sorry for typo...We are trying to load from a text file
    sspr28
    @sspr28
    Hi All,
    I want to skip the 1st line in pgloader.configuration file..I have checked using skip head_lines=1 in my configuration but am getting the error global name 'nb_lines' is not defined..
    Could you help on this .
    rocas82
    @rocas82
    Hi All,
    I would like to build a pgloader binary on my centOS 6.7 from source code:
    rocas82
    @rocas82
    first I used bootstrap-centos.sh to create the environment, then run make and I have the following error message: debugger invoked on a LOAD-SYSTEM-DEFINITION-ERROR in thread #<THREAD "main thread" RUNNING {1002A8BA13}>: Error while trying to load definition for system bordeaux-threads from pathname /home/pgloader-3.2.2/build/quicklisp/dists/quicklisp/software/bordeaux-threads-v0.8.5/bordeaux-threads.asd: READ error during COMPILE-FILE: You need ASDF >= 3.1 to load this system correctly.(in form starting at line: 1, column: 0, file-position: 0)
    could you help on that please ?
    rocas82
    @rocas82
    Could you please help me to compile pgloader-3.2.2 on CentOS 6.7 to obtain a binary format ?
    is there any procedure that I can follow to compile pgloader-3.2.2 on Centos 6.7 ?
    Thank sfor your help
    Dimitri Fontaine
    @dimitri
    The ASDF being too old often is because the compiler itself (SBCL) is too old, which version do you have?
    rocas82
    @rocas82
    I had got the issue with sbcl-1.1.14 , then I installed SBCL 1.2.6 and it seems better,
    I loaded pgloader "3.2.02ecd88" binary format as it is available on your github and I am trying to use it
    Do I need to install SBCL before runing this pgloader binary format ?
    Dimitri Fontaine
    @dimitri
    If you download a pgloader binary, it's self contained (it includes SBCL) so you don't need SBCL at run-time. However it's a good idea to fetch the current git master's version and build from sources, and for that you need SBCL installed.
    rocas82
    @rocas82
    Hello Dimitri

    ./pgloader -V

    pgloader version "3.3.0.50"
    compiled with SBCL 1.3.5
    When I run pgloader, I have got the following error:
    mkdir /tmp/pgloader
    [root@VM_kurmi_Perso pgloaderAndTools-6.2.0]# ./pgloader -v commands
    2016-06-16T12:23:53.269000+02:00 NOTICE Starting pgloader, log system is ready.
    2016-06-16T12:23:53.569000+02:00 LOG Main logs in '/tmp/pgloader/pgloader.log'
    2016-06-16T12:23:53.624000+02:00 LOG Data errors in '/tmp/pgloader/'
    2016-06-16T12:23:53.624000+02:00 LOG Parsing commands from file #P"/root/pgloaderAndTools-6.2.0/commands"
    An unhandled error condition has been signalled:
    PostgreSQL protocol error: Unexpected message received: Z
    rocas82
    @rocas82
    When I run pgaloader in debug mode as following:
    ./pgloader -v -d commands
    the load of data startsand run for about 2 minutes and stop with this output: