by

Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
    Piyush Rana
    @piyushknoldus
    Hi @team while processing the flink jar I am getting this error -Exception java.util.concurrent.ExecutionException: org.apache.flink.shaded.netty4.io.netty.handler.codec.TooLongFrameException: Response entity too large: DefaultHttpResponse(decodeResult: success, version: HTTP/1.1)
    Job has been submitted with JobID e2411ae0efe9e8a4f71519aeab2aa5d3
    24/04/2020 01:09:33 
    24/04/2020 01:09:33 
    24/04/2020 01:09:33 Exception java.util.concurrent.ExecutionException: org.apache.flink.shaded.netty4.io.netty.handler.codec.TooLongFrameException: Response entity too large: DefaultHttpResponse(decodeResult: success, version: HTTP/1.1)
    24/04/2020 01:09:33 HTTP/1.1 200 OK
    24/04/2020 01:09:33 Content-Type: application/json; charset=UTF-8
    24/04/2020 01:09:33 Access-Control-Allow-Origin: *
    24/04/2020 01:09:33 content-length: 242880344 Try to raise [rest.client.max-content-length] occurred while reading the  file from s3a://loadtesting-sophi-events-2x/tgam/enriched/original/derived_tstamp=2019_12_19/part-00003-f70da1f8-6267-412c-bcb0-c74d0f90a42f-c000.avro
    24/04/2020 01:09:33 
    24/04/2020 01:09:33 java.util.concurrent.ExecutionException: org.apache.flink.shaded.netty4.io.netty.handler.codec.TooLongFrameException: Response entity too large: DefaultHttpResponse(decodeResult: success, version: HTTP/1.1)
    24/04/2020 01:09:33 HTTP/1.1 200 OK
    24/04/2020 01:09:33 Content-Type: application/json; charset=UTF-8
    24/04/2020 01:09:33 Access-Control-Allow-Origin: *
    24/04/2020 01:09:33 content-length: 242880344 Try to raise [rest.client.max-content-length]
    24/04/2020 01:09:33     at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
    24/04/2020 01:09:33     at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1895)
    24/04/2020 01:09:33     at org.apache.flink.client.program.ContextEnvironment.execute(ContextEnvironment.java:73)
    24/04/2020 01:09:33     at org.apache.flink.api.java.ExecutionEnvironment.execute(ExecutionEnvironment.java:844)
    24/04/2020 01:09:33     at org.apache.flink.api.java.DataSet.collect(DataSet.java:413)
    24/04/2020 01:09:33     at record.GenericRecordReader$.readFromS3(GenericRecordReader.scala:41)
    24/04/2020 01:09:33     at record.RecordProcessor.$anonfun$sendInBatches$1(RecordProcessor.scala:36)
    24/04/2020 01:09:33     at scala.util.Try$.apply(Try.scala:209)
    24/04/2020 01:09:33     at record.RecordProcessor.sendInBatches(RecordProcessor.scala:36)
    24/04/2020 01:09:33     at simulator.LoadSimulator.$anonfun$run$4(LoadSimulator.scala:85)
    24/04/2020 01:09:33     at scala.collection.LinearSeqOptimized.foldLeft(LinearSeqOptimized.scala:122)
    24/04/2020 01:09:33     at scala.collection.LinearSeqOptimized.foldLeft$(LinearSeqOptimized.scala:118)
    24/04/2020 01:09:33     at scala.collection.immutable.List.foldLeft(List.scala:85)
    24/04/2020 01:09:33     at simulator.LoadSimulator.$anonfun$run$2(LoadSimulator.scala:80)
    24/04/2020 01:09:33     at scala.collection.LinearSeqOptimized.foldLeft(LinearSeqOptimized.scala:122)
    24/04/2020 01:09:33     at scala.collection.LinearSeqOptimized.foldLeft$(LinearSeqOptimized.scala:118)
    24/04/2020 01:09:33     at scala.collection.immutable.List.foldLeft(List.scala:85)
    24/04/2020 01:09:33     at simulator.LoadSimulator.run(LoadSimulator.scala:72)
    24/04/2020 01:09:33     at simulator.LoadSimulator$.delayedEndpoint$simulator$LoadSimulator$1(LoadSimulator.scala:132)
    24/04/2020 01:09:33     at simulator.LoadSimulator$delayedInit$body.apply(LoadSimulator.scala:130)
    24/04/2020 01:09:33     at scala.Function0.apply$mcV$sp(Function0.scala:34)
    24/04/2020 01:09:33     at scala.Function0.apply$mcV$sp$(Function0.scala:34)
    24/04/2020 01:09:33     at scala.runtime.AbstractFunction0.apply$mcV$sp(AbstractFunction0.scala:12)
    24/04/2020 01:09:33     at scala.App.$anonfun$main$1$adapted(App.scala:76)
    24/04/2020 01:09:33     at scala.collection.immutable.List.foreach(List.scala:388)
    24/04/2020 01:09:33     at scala.App.main(App.scala:76)
    24/04/2020 01:09:33     at scala.App.main$(App.scala:74)
    24/04/2020 01:09:33     at simulator.LoadSimulator$.main(LoadSimulator.scala:130)
    24/04/2020 01:09:33     at simulator.LoadSimulator.main(LoadSimulator.scala)
    24/04/2020 01:09:33     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    24/04/2020 01:09:33     at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    24/04/2020 01:09:33     at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    24/04/2020 0
    Thangavel Loganathan
    @yel_nathan_twitter

    Hi There!

    I'm new to Flink, I want to create a REST endpoint which returns Kafka data via Flink.

    I have posted my query in Stackoverflow in the below link,

    https://stackoverflow.com/questions/63313892/flink-data-stream-conversion-and-expose-to-rest-end-point

    Any suggestions or inputs are appreciated, thank you!

    Adishesh Kishore
    @drwho1990
    Hi!
    I have been working on some of my own sinks and wanted to know if you anyone knows about the Flink state serialisation in detail
    I am facing issues while serialising the state