alexjbush on storage-configuration
alexjbush on 2.0
alexjbush on 2.0
alexjbush on 2.0
updating poms for branch'releas… (compare)
.openFileCSV("/path/to/my/files/*.csv", "my-new-label", Map("header" -> "true"))
but I get the message org.apache.spark.sql.AnalysisException: Invalid view name: my-new-label;
. I thought the second parameter was whatever label I wanted to add?
scala> val res = spark.read.parquet("...")
res: org.apache.spark.sql.DataFrame = [... 122 more fields]
scala> res.createOrReplaceTempView("people-ww")
org.apache.spark.sql.AnalysisException: Invalid view name: people-ww;
at org.apache.spark.sql.Dataset.org$apache$spark$sql$Dataset$$createTempViewCommand(Dataset.scala:2687)
at org.apache.spark.sql.Dataset$$anonfun$createOrReplaceTempView$1.apply(Dataset.scala:2640)
at org.apache.spark.sql.Dataset$$anonfun$createOrReplaceTempView$1.apply(Dataset.scala:2640)
at org.apache.spark.sql.Dataset.org$apache$spark$sql$Dataset$$withPlan(Dataset.scala:2872)
at org.apache.spark.sql.Dataset.createOrReplaceTempView(Dataset.scala:2639)
... 48 elided