by

Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
  • Jan 23 2019 11:40
    pktippa synchronize #467
  • Jan 23 2019 11:30
    pktippa edited #467
  • Jan 23 2019 11:30
    pktippa synchronize #467
  • Jan 23 2019 09:37
    pktippa opened #467
  • Jan 23 2019 09:35
  • Jan 21 2019 16:20
  • Jan 16 2019 03:18
    alexanderfefelov commented #332
  • Jan 05 2019 05:20
    jjmontesl labeled #449
  • Jan 05 2019 05:20
    jjmontesl labeled #449
  • Jan 05 2019 05:19
    jjmontesl assigned #449
  • Jan 05 2019 05:19
    jjmontesl commented #449
  • Jan 05 2019 05:17
    jjmontesl labeled #451
  • Jan 05 2019 05:16
    jjmontesl assigned #451
  • Jan 05 2019 05:16
    jjmontesl closed #451
  • Jan 05 2019 05:16
    jjmontesl commented #451
  • Jan 05 2019 05:11
    jjmontesl milestoned #445
  • Jan 05 2019 05:11
    jjmontesl labeled #445
  • Jan 05 2019 05:10
    jjmontesl unassigned #445
  • Jan 05 2019 05:10
    jjmontesl assigned #445
  • Jan 05 2019 05:10
    jjmontesl closed #445
Stefan Urbanek
@Stiivi
Right now I’m doing amputation surgery to the flask server.
Want to keep the core lean, easier to maintain and be able to deliver correctly annotated core in reasonable time.
Btw. in the meantime if you have any suggestions for the catalog/API changes, we can discuss them here.
Stefan Urbanek
@Stiivi
@/all Slicer server has been DataBrewery/cubes@f9190f1 into the new slicer_flask package.
To implement your own server add something like this in your setup.py entry points:
    entry_points={
        'cubes.servers': ['flask = slicer_flask.base:FlaskSlicerServer'],
    },
To launch your own server through slicer: run slicer serve -t my_server slicer.ini
Will merge to 2.0 soon.
Stefan Urbanek
@Stiivi
@/all RFC before I post it: draft of Cubes 2.0 plan … please leve comments/suggestions within the document
Stefan Urbanek
@Stiivi
RFC: Added new extension mechanism: DataBrewery/cubes#427
Richard Banyi
@richban
Deployment of Slicer to a server. I have my application running on the server the infrastucture is the following : nginx + gunicorn + django app. I have a script which runs the gunicorn and starts the django app. Locally I just manually start the django app and also Slicer server it works. Thefore my question what is the proper way to run the Slicer Server on server? First I thought I will integrate it somewhow into the django app, I thought django has also Blueprint object just like flask, but as far as I know there is nothing like that, so I have just wrote a shell script which runs the command slicer serve slicer.ini doesn’t really work.
also nginx is listening now on ports 80, therefore as far as I am concerned I have to enable port 5000.
Stefan Urbanek
@Stiivi
@richban try to follow this Flask documentation about nginx
Richard Banyi
@richban
I see, just to make sure that I understand it right. Slicer a is WSGI application based on on Flask which comes with uWSGI server - by default it has an entry point for the Flask app, thefore it’s already configured. So if I want to define my own WSGI entry point I can write a WSGI script and afterwards configure the WSGI Server (uWSGI or Gunicorn). Am I correct?
morrme
@morrme
@Stiivi Hi Stefan!
Stefan Urbanek
@Stiivi
Hi @morrme
Stefan Urbanek
@Stiivi
Settings and type-aware extension creation #430
Stefan Urbanek
@Stiivi
@/all Final version of Cubes 2.0 goals: https://gist.github.com/Stiivi/3dd87f0ba920d2cae49e45d210bb0265
Michael Schwab
@schwab
Congratulations on the decision to begin working on Cubes 2.0. Having been a regular user in several projects for years, it's exciting to know the project will be moving forward again!
Stefan Urbanek
@Stiivi
@schwab thank you.
Michael Schwab
@schwab
Do you know BTW if slicer sql denormalize works? If so, is there an example of calling it somewhere? I always get Error: config should be a ConfigParser instance, but is <class 'str'>
Stefan Urbanek
@Stiivi
@schwab Can you please file an issue? Looks like in cubes.slicer.commands module all Workspace(config) have to be replaced with Workspace(read_config(config))
Michael Schwab
@schwab
OK, thanks for the response. I've submitted and issue and will try the fix today. If it goes well I'll submit a pull request.
Michael Schwab
@schwab
That fix gets past the config error, list now works, however denormoralize is now failing with " File "/home/mdmetrix-dev/.local/lib/python2.7/site-packages/cubes/sql/store.py", line 362, in create_denormalized_view
insp = reflection.Inspector.from_engine(engine)
NameError: global name 'engine' is not defined" cannot spend anymore time on it today, but may be able to come back to it towards the end of the week.
Stefan Urbanek
@Stiivi
@schwab replace engine with self.connectable
Jose Juan Montes
@jjmontesl
blob
Stil very early work.
But I'm working on quick integration paths between Pandas, CSV, SQL, Django and Cubes/CubesViewer, also integration with Jupyter Notebook
Jose Juan Montes
@jjmontesl
Automatically generating a model:
blob
Jose Juan Montes
@jjmontesl
Full pandas->cubesviewer pipeline:
blob
Christian Ledermann
@cleder
I'd like to view cubes through superset https://github.com/airbnb/superset has anyone tried this yet?
Jose Juan Montes
@jjmontesl
No, I didn't know it.
Christian Ledermann
@cleder
with bubbles how do I create indexes in the target

import bubbles

src_url = 'postgresql://primarysite:primarysite@localhost/primarysite'
dest_url = 'postgresql://primarysite:primarysite@localhost/slicer_db'

stores = {'source': bubbles.open_store('sql', src_url),
'target': bubbles.open_store('sql', dest_url), }
pl = bubbles.pipeline.Pipeline(stores=stores)
pl.source('source', 'core_site')

pl.create('target', 'core_site')
pl.run()

this creates a table as
CREATE TABLE core_site
(
id integer,
name character varying(255),
...)
without any indexes
Jose Juan Montes
@jjmontesl
not me
are you starting with this ETL now? is it for work or hobby?
Christian Ledermann
@cleder
yes I am starting
for now it is research into the tooling
I had a look at bubbles, metl (very short at petl and pygraml and bonobo)
I think I will use bubbles for the proof of concept and then have a second look at the above other tools#
proof of concept means: I am building a analytics db with cubes and use bubbles to get some initial data into it
Christian Ledermann
@cleder
the db will be used for work
Jose Juan Montes
@jjmontesl
I'm afraid I cannot help there. I use custom code for ETL processes.
krrishnayak
@krrishnayak
hey
when i run "slicer serve slicer.ini" i ge below error
  • Restarting with stat
    File "C:\Users\krishna\AppData\Local\Programs\Python\Python36\Scripts\slicer.exe", line 1
    SyntaxError: Non-UTF-8 code starting with '\x90' in file C:\Users\krishna\AppData\Local\Programs\Python\Python36\Scripts\slicer.exe on line 1, but no encoding declared; see http://python.org/dev/peps/pep-0263/ for details
Plz help