Is Tom A. saying that extension arrays will enable Dask for GeoPandas? https://twitter.com/TomAugspurger/status/1088644514594533376?s=19
Wew, you people are far ahead! Just tonight struggling with
scipy, seaborn pandas (not even geopandas yet) mainly to get plot-formatting right. But awesome R2 ("R-square") results with cheap (< $80,- AlphaSense) Air Quality sensors calibrated with our national Environmental Agency (RIVM) sensors thanks to work from JRC folks, Michel Gerboles et al. Some text on this project for EU JRC in my blog . And the code: https://github.com/smartemission/smartemission/blob/master/etl/calibration/airsenseurplots.py .
Is Tom A. saying that extension arrays will enable Dask for GeoPandas? https://twitter.com/TomAugspurger/status/1088644514594533376?s=19
@anitagraser not directly. But with his recent work, it should become easier to do. But if you want to play with the geopandas / dask combo, I would still recommend looking at https://github.com/mrocklin/dask-geopandas
I can help with setting it up if you want
That experimental package also implements a parallel spatial join, has some functionality to partition the dataset by regions, and already parallelizes all the spatial operations and predicates.
@anitagraser I'll be happy to assist you folks. AlphaSense gas sensors (like above) are good but need quite some extra electronics and calibration, even per-sensor, to get results R2 ~ 0.9, like above. For PM (finedust) there is the Luftdaten project, was at a Meetup this week, amazing fast-growing, low-entry, activist/community project!, felt like when OSM once began: https://luftdaten.info/ and The Map: http://deutschland.maps.luftdaten.info, still coverage to be done in your country! Also Luftdaten sensors (SDS011 for PM10/2.5) have calibration issues. Possibly we Python folks can help out with our Scipy/Numpy/Pandas ANN MLV knowledge there. And if you want (Mikro)Python and LoRaWAN: https://twitter.com/justb4/status/1087740772210884608
Hi All. Really pleased to be part of this group. The growth in Python generally is amazing. I just looked at the stackoverflow trends and more questions are asked about Python now than are asked about Javascript (ok very different languages) but still. https://insights.stackoverflow.com/trends?tags=python%2Cjavascript
It looks (to me at least) that most of this growth seems to come from Pandas and Tensorflow. https://insights.stackoverflow.com/trends?tags=numpy%2Cpandas%2Cscikit-learn%2Ctensorflow
From West to East: Martin Is also organizer of the GeoPython conf: http://2019.geopython.net/
A Python package to read/write spatial data to a geopackage. https://github.com/achapkowski/pygeopackage
Pondering GeoPython conf: http://2019.geopython.net/ Basel, deadline CFP Feb 28. GeoHealthCheck and Stetl. But may collide with FOSS4G-NL, though latter not yet confirmed with LOC. Anyone else going to Basel?
hey all: PSA for thus year’s OSGeo Community Sprint in Minneapolis: https://wiki.osgeo.org/wiki/OSGeo_Community_Sprint_2019
I will be there and hope to see more geo Python folks!
@all hi @/all for the OSGeo Code Sprint in a couple of weeks I put up some items for various geopython projects we can work on: https://wiki.osgeo.org/wiki/OSGeo_Community_Sprint_2019#Project_Plans . Please feel free to add/update.
the dds was not generated with an encode error .. found in the apache log (running pydap as wsgi in apache)
I hacked a temporary fix adding an exception and asking pydap to decode using utf-8 instead of ascii
while ythis fixed the dds rendering
in a python client I can't load such dataset which returns the following error:
---------------------------------------------------------------------------
UnicodeDecodeError Traceback (most recent call last)
<ipython-input-5-2bb713f8a88f> in <module>
1 from pydap.client import open_url
----> 2 dataset = open_url('http://dap.metsis.met.no/SN99938.nc')
/usr/local/lib/python3.7/dist-packages/pydap/client.py in open_url(url, application, session, output_grid, timeout, verify)
65 """
66 dataset = DAPHandler(url, application, session, output_grid,
---> 67 timeout=timeout, verify=verify).dataset
68
69 # attach server-side functions
/usr/local/lib/python3.7/dist-packages/pydap/handlers/dap.py in __init__(self, url, application, session, output_grid, timeout, verify)
61 verify=verify)
62 raise_for_status(r)
---> 63 das = safe_charset_text(r)
64
65 # build the dataset from the DDS and add attributes from the DAS
/usr/local/lib/python3.7/dist-packages/pydap/handlers/dap.py in safe_charset_text(r)
115 else:
116 r.charset = get_charset(r)
--> 117 return r.text
118
119
/usr/local/lib/python3.7/dist-packages/webob/response.py in _text__get(self)
620 decoding = self.charset or self.default_body_encoding
621 body = self.body
--> 622 return body.decode(decoding, self.unicode_errors)
623
624 def _text__set(self, value):
UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 94: ordinal not in range(128)
A Python package for advanced geospatial data analysis.
anyone knows it, or test it ?
