These are chat archives for linkedin/pinot

24th
Aug 2015
wlf061
@wlf061
Aug 24 2015 05:32
Did anybody meet this problem, when add the realtime table
[root@hx4 pinot-0.016-pkg]# Caught exception in state transition for OFFLINE -> ONLINE for partitionwlf3_REALTIMEServer_192.168.6.152_8098wlf3_REALTIME_1440394462044_001440394462179 of table wlf3_REALTIME
java.lang.NullPointerException
at com.linkedin.pinot.core.realtime.impl.RealtimeSegmentImpl.<init>(RealtimeSegmentImpl.java:96)
at com.linkedin.pinot.core.data.manager.realtime.RealtimeSegmentDataManager.<init>(RealtimeSegmentDataManager.java:119)
at com.linkedin.pinot.core.data.manager.realtime.RealtimeTableDataManager.addSegment(RealtimeTableDataManager.java:198)
at com.linkedin.pinot.server.starter.helix.HelixInstanceDataManager.addSegment(HelixInstanceDataManager.java:238)
at com.linkedin.pinot.server.starter.helix.SegmentOnlineOfflineStateModelFactory$SegmentOnlineOfflineStateModel.onBecomeOnlineFromOfflineForRealtimeSegment(SegmentOnlineOfflineStateModelFactory.java:156)
at com.linkedin.pinot.server.starter.helix.SegmentOnlineOfflineStateModelFactory$SegmentOnlineOfflineStateModel.onBecomeOnlineFromOffline(SegmentOnlineOfflineStateModelFactory.java:131)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at org.apache.helix.messaging.handling.HelixStateTransitionHandler.invoke(HelixStateTransitionHandler.java:344)
at org.apache.helix.messaging.handling.HelixStateTransitionHandler.handleMessage(HelixStateTransitionHandler.java:290)
at org.apache.helix.messaging.handling.HelixTask.call(HelixTask.java:84)
at org.apache.helix.messaging.handling.HelixTask.call(HelixTask.java:41)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Exception while executing a state transition task wlf3_REALTIMEServer_192.168.6.152_8098wlf3_REALTIME_1440394462044_001440394462179
Kishore Gopalakrishna
@kishoreg
Aug 24 2015 06:36
incomingTimeColumnName = dataSchema.getTimeFieldSpec().getIncomingTimeColumnName();
looks like schema is missing a field
can you show me the schema for realtime table?
wlf061
@wlf061
Aug 24 2015 07:03
{
"tableIndexConfig": {
"invertedIndexColumns":["column1","column2"],
"loadMode":"HEAP",
"lazyLoad":"false",
"streamConfigs": {
"streamType": "kafka",
"stream.kafka.consumer.type": "highLevel",
"stream.kafka.topic.name": "1-realtime",
"stream.kafka.decoder.class.name": "com.linkedin.pinot.core.realtime.impl.kafka.KafkaJSONMessageDecoder",
"stream.kafka.zk.broker.url": "localhost:2181",
"stream.kafka.hlc.zk.connect.string": "localhost:2181"
}
},
"tenants":{"server":"","broker":""},
"tableType":"REALTIME","metadata":{"customConfigs":{"d2Name":"xlntBetaPinot"}},
"segmentsConfig":{
"retentionTimeUnit":"DAYS",
"segmentPushFrequency":"daily",
"replication":1,
"timeColumnName":"",
"retentionTimeValue":"700",
"timeType":"",
"segmentPushType":"APPEND",
"schemaName":"baseball",
"segmentAssignmentStrategy":"BalanceNumSegmentAssignmentStrategy"
},
"tableName":"wlf3"
}
@kishoreg this is my realtime table schema, could you help to check that
wlf061
@wlf061
Aug 24 2015 07:14
And the schema for the realtime has just dimensionFieldSpecs and dimensionFieldSpecs , there has no timeFieldSpec , did this is the problem ?