GeoTrellis is a geographic data processing engine for high performance applications.
addSbtPlugin("net.virtual-void" % "sbt-dependency-graph" % "0.9.2")
addSbtPlugin("com.eed3si9n" % "sbt-assembly" % "0.14.10")
addSbtPlugin("com.eed3si9n" % "sbt-unidoc" % "0.4.2")
addSbtPlugin("com.timushev.sbt" % "sbt-updates" % "0.4.0")
addSbtPlugin("de.heikoseeberger" % "sbt-header" % "5.2.0")
// Until we upgrade to Java 11, we can't use JFR with anything later than 0.3.3
addSbtPlugin("pl.project13.scala" % "sbt-jmh" % "0.3.3")
addSbtPlugin("org.scalastyle" %% "scalastyle-sbt-plugin" % "1.0.0")
addSbtPlugin("com.typesafe" % "sbt-mima-plugin" % "0.6.0")
addSbtPlugin("com.thesamet" % "sbt-protoc" % "0.99.23")
libraryDependencies += "com.thesamet.scalapb" %% "compilerplugin" % "0.9.0"
And use the stragety as my old version not what you told me.
the background grayscale image is the layerRDD, each little gray box is a tile
and two green polygons consists the multipolygon
those oranges boxes are some of the tiles returned by the filter which are contained in the top polygon, the problem is none is returned from the bottom one
I would expect thousands of tiles contained in the bottom polygon as well
mb there is a mistake somewhere ~ like in metadata or somewhere else
Just an announcement: we released GeoTrellis 3.0 that depends on Spark 2.4 and has a new RasterSources API released. Also we officially have GDAL package back! https://github.com/locationtech/geotrellis/releases/tag/v3.0.0 any feedback is appreciated :tada:
It is already publish on maven central and locationtech repos
metricLayerRdd.filter(
rddKeyVal => {
val key = rddKeyVal._1
val tileExtentPolygon = key.extent(params.metadata.layout).jtsGeom
val contained = shapePolygon.contains(tileExtentPolygon)
if(tileExtentPolygon.contains(pnt.jtsGeom)) {
println(tileExtentPolygon)
println(shapePolygon)
println(contained)
System.exit(1)
}
contained
})
as geojsons
^ I think (don't really remember the API but can look into it in a while if that would be a problem)
Congratulations to all Geotrellis contributors :clap: :clap: :clap: . 3.0 is a massive leap forward, particularly in fundamental module architecture, providing a fantastic foundation for the future. A substantial achievement in which you should all be very proud. :smile: :smile: :smile:
Hello all, congrats on 3.0
I have an issue I wonder if you can help me with
I keep runnning in a StackOverflow when trying to reproject and RDD to WebMercator
I have an issue I wonder if you can help me with
I keep runnning in a StackOverflow when trying to reproject and RDD to WebMercator
Exception in thread "main" java.lang.StackOverflowError
at org.locationtech.jts.geom.CoordinateArrays.dimension(CoordinateArrays.java:44)
at org.locationtech.jts.geom.impl.CoordinateArraySequence.<init>(CoordinateArraySequence.java:65)
at org.locationtech.jts.geom.impl.CoordinateArraySequenceFactory.create(CoordinateArraySequenceFactory.java:55)
at org.locationtech.jts.geom.GeometryFactory.createPoint(GeometryFactory.java:267)
at geotrellis.vector.Point$.apply(Point.scala:25)
at geotrellis.vector.reproject.Reproject$.refine$1(Reproject.scala:87)
at geotrellis.vector.reproject.Reproject$.refine$1(Reproject.scala:97)
at geotrellis.vector.reproject.Reproject$.refine$1(Reproject.scala:97)
at geotrellis.vector.reproject.Reproject$.refine$1(Reproject.scala:97)
at geotrellis.vector.reproject.Reproject$.refine$1(Reproject.scala:97)
at geotrellis.vector.reproject.Reproject$.refine$1(Reproject.scala:97)
at geotrellis.vector.reproject.Reproject$.refine$1(Reproject.scala:97)
at geotrellis.vector.reproject.Reproject$.refine$1(Reproject.scala:97)
at geotrellis.vector.reproject.Reproject$.refine$1(Reproject.scala:97)
# Continued...
The offending call
def assimilate(path: String, catalog: String)(implicit sc: SparkContext): Unit = {
val scheme = ZoomedLayoutScheme(LatLng, tileSize = 256)
val (zoom, rdd) = netcdfToRDD(path, scheme)
val reprojected = rdd.reproject(WebMercator, scheme, Bilinear)
val attributeStore = new FileAttributeStore(catalog)
val writer = new FileLayerWriter(attributeStore, catalog)
writer.write(LayerId("precipitation", zoom), rdd, ZCurveKeyIndexMethod.byHour())
}
Are you guys familiar with this problem? Otherwise I'll try to send you a snippet to reproduce
@pomadchin here are the shapePolygon and the tileExtent that is inside the polygon
metricLayerRdd.filter( rddKeyVal => {
val key = rddKeyVal._1
val tileExtentPolygon = key.extent(params.metadata.layout)
val contained = shapePolygon.contains(tileExtentPolygon)
if(tileExtentPolygon.contains(pnt.jtsGeom)) {
println(tileExtentPolygon.toGeoJson())
println(shapePolygon.toGeoJson())
println(contained)
System.exit(1)
}
contained
})output
{"type":"Polygon","coordinates":[[[301599.466697037,4932229.096487437],[301599.466697037,4932230.096487457],[301600.46669720486,4932230.096487457],[301600.46669720486,4932229.096487437],[301599.466697037,4932229.096487437]]]}
{"type":"MultiPolygon","coordinates":[[[[301570.4514820544,4932330.550698328],[301608.4739502942,4932329.050574216],[301615.7797098104,4932283.3908159025],[301567.98736547644,4932285.527373691],[301570.4514820544,4932330.550698328]],[[301568.33936377685,4932265.41646293],[301616.3991255134,4932264.116287277],[301607.37711448024,4932221.9959483575],[301576.71921868704,4932223.2709015105],[301568.33936377685,4932265.41646293]]]]}
false
thanks @metasim :tada:
@davidlandry93 yes it is a known bug, first of all try to update up to 3.0 it will write you a better exception :D but it looks like your initial CRS of the rasters you’re reprojecting is in incorrect CRS
for instance you have an extent is some UTM zone and it is in RDD with a LatLng CRS and you’re trying to reproject it into webmercator
@davidlandry93 locationtech/geotrellis#3083 and the related issue with a similar problem you had locationtech/geotrellis#3023
My extent is valid to latlng though it you compare to this https://github.com/locationtech/geotrellis/issues/3023#issuecomment-534733560