These are chat archives for linkedin/pinot

28th
Jun 2016
Jean-François Im
@jfim
Jun 28 2016 18:51
@tkao1000 Are you using pinot-admin.shto start your cluster?
I think it starts the cluster in default tenant mode so you can't create new tenants
tkao1000
@tkao1000
Jun 28 2016 20:02
oh yeah i am
how should i start up the cluster so that I can create new tenants?
I'm trying to ingest data using kafka, with kafka being on its own node
but when i ingest data, it doesn't show up in pinot
Jean-François Im
@jfim
Jun 28 2016 20:03
I see
tkao1000
@tkao1000
Jun 28 2016 20:03
i think it's because i haven't created any broker/server tenants
Jean-François Im
@jfim
Jun 28 2016 20:03
Did you get an error when you created your table or did it work?
tkao1000
@tkao1000
Jun 28 2016 20:04
it says success when i create the table
Jean-François Im
@jfim
Jun 28 2016 20:04
okay so then it should try to consume
tkao1000
@tkao1000
Jun 28 2016 20:04
should it also say success when i add the schema?
Jean-François Im
@jfim
Jun 28 2016 20:04
yes
It shouldn't let you add a realtime table without schema
Does it say anything in the server logs?
tkao1000
@tkao1000
Jun 28 2016 20:05
sorry i need to check again
just to clarify really quickly
are tenants necessary for realtime ingestion on different nodes?
Jean-François Im
@jfim
Jun 28 2016 20:06
It should say something like Consumed 100000 events from kafka stream ... (rate:18066.848/s)
yes, but we should get realtime ingestion working first :)
I need to step out for about an hour
tkao1000
@tkao1000
Jun 28 2016 20:08
ok no worries, thanks a lot for the help
Jean-François Im
@jfim
Jun 28 2016 20:08
but in the meantime, can you check those things for me?
tkao1000
@tkao1000
Jun 28 2016 20:08
yepyep thank you
Jean-François Im
@jfim
Jun 28 2016 20:08
Open zooinspector and connect it to your zk instance
check IDEALSTATE/yourTable_REALTIME
tkao1000
@tkao1000
Jun 28 2016 20:09
what is this for?
Jean-François Im
@jfim
Jun 28 2016 20:09
If it's empty, that's the cause of your table not consuming
tkao1000
@tkao1000
Jun 28 2016 20:09
oh i see
ok got it
Jean-François Im
@jfim
Jun 28 2016 20:09
if that's it, then restart the controller, it should work after that
also to check if your cluster is in single tenant mode
go in CONFIGURATION/INSTANCES/Server_..._1234
and check the tag on it
if it's defaultTenant something then it's in single tenant mode
that should get you unblocked while I grab lunch :)
tkao1000
@tkao1000
Jun 28 2016 20:11
haha yep thank you
Jean-François Im
@jfim
Jun 28 2016 20:11
sorry for not monitoring gitter as much, been pretty busy :worried:
tkao1000
@tkao1000
Jun 28 2016 20:14
no worries, you got other stuff you need to do
Jean-François Im
@jfim
Jun 28 2016 21:36
Did you have time to look into those?
tkao1000
@tkao1000
Jun 28 2016 21:47
ok so the table is added successfully
but the controller log has this error "broker tenant : DefaultTenant_BROKER is not existed"
i guess this means the cluster is probably in single tenant mode?
how do i change that?
Jean-François Im
@jfim
Jun 28 2016 22:34
It is, but for some reason apparently you have no broker
Do you see a broker in configuration/instances?
tkao1000
@tkao1000
Jun 28 2016 22:37
sorry, where is that directory?
Jean-François Im
@jfim
Jun 28 2016 22:37
in zookeeper
and connect it to your instance of zk
then it should be in /pinot/CONFIGURATION/INSTANCES