One Star

How to setting tkafkaoutput timeout

I use tkafkaoutput component for my job. And I tried to add exception handling for this component by adding tdie,tlogcatcher and tfileoutputdelimited. I test it using the wrong broker list(I connected to localhost:909 which is not exist) and then tkafkaoutput component will throw warning message but it can't stop (no time out). My problem is how to make exception occurs and send the exception log to tfileoutputdelimited and stop the job.
I already add timeout.ms , retry.backoff.ms setting on tkafkaoutput component advanced setting. But nothing works. Can anyone help me to figure this out??
here is the warning message :
Starting job kafkainputoutputwithexceptionhandling at 06:08 28/09/2015.
connecting to socket on port 3850
connected
: org.apache.kafka.clients.producer.ProducerConfig - The configuration value.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer was supplied but isn't a known config.
: org.apache.kafka.clients.producer.ProducerConfig - The configuration key.serializer = class org.apache.kafka.common.serialization.ByteArraySerializer was supplied but isn't a known config.
: kafka.utils.VerifiableProperties - Property serializer.encoding is not valid
: org.apache.kafka.common.network.Selector - Error in I/O with localhost/127.0.0.1
java.net.ConnectException: Connection refused: no further information
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(Unknown Source)
at org.apache.kafka.common.network.Selector.poll(Selector.java:238)
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:192)
at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:191)
at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:122)
at java.lang.Thread.run(Unknown Source)
: org.apache.kafka.common.network.Selector - Error in I/O with localhost/127.0.0.1
java.net.ConnectException: Connection refused: no further information
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(Unknown Source)
at org.apache.kafka.common.network.Selector.poll(Selector.java:238)
at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:192)
at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:191)
at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:122)
at java.lang.Thread.run(Unknown Source)

Thanks
1 REPLY
Moderator

Re: How to setting tkafkaoutput timeout

Hi chandra_huang,

Could you please check this jira issue:https://jira.talendforge.org/browse/TBD-2639 to see if it is what you need?
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.