Package io.deephaven.kafka.ingest

Interface KafkaRecordConsumer

All Superinterfaces:
StreamFailureConsumer
public interface KafkaRecordConsumer extends StreamFailureConsumer
Consumer for lists of ConsumerRecords coming from Kafka. The StreamFailureConsumer is extended so that we can report errors emanating from our consumer thread.

  • Method Summary

    Modifier and Type
    Method
    Description
    long
    consume(long receiveTime, @NotNull List<? extends org.apache.kafka.clients.consumer.ConsumerRecord<?,?>> records)
    Consume a list of ConsumerRecords coming from Kafka.

    Methods inherited from interface io.deephaven.stream.StreamFailureConsumer

    acceptFailure

  • Method Details

    • consume

      long consume(long receiveTime, @NotNull @NotNull List<? extends org.apache.kafka.clients.consumer.ConsumerRecord<?,?>> records)
      Consume a list of ConsumerRecords coming from Kafka.
      Parameters:
      receiveTime - the time, in nanoseconds since the epoch, the records were received in this process
      records - the records to consume
      Returns:
      the total number of message bytes processed, according whether any key and/or value fields were processed, and the corresponding values for org.apache.kafka.clients.consumer.ConsumerRecord.serializedKeySize org.apache.kafka.clients.consumer.ConsumerRecord.serializedValueSize