All Questions
Tagged with bijection apache-kafka
4 questions
0
votes
0
answers
225
views
Retrieve schema from parquet-avro messages pulled from kafka
Using samples from various sources I have written this method (relevant section shown below) where I am pulling parquet-avro messages from kafka for a test application. Based on the code I could find ...
- 2,243
0
votes
1
answer
5k
views
Serializing generic avro records as an Array[Byte] keeps the schema in the object
Situation
I'm currently writing a consumer/producer using AVRO and a schema repository.
From what I gather My options for serializing this data is either use the Confluent's avro serializer, or go ...
- 2,638
1
vote
0
answers
1k
views
Failed to invert twitter bijection exception in kafka spark streaming application using avro :Java
I have been following a tutorial to produce and consume messages from kafka using spark streaming. The idea is to produce simple message which are serialized in avro format. Deserialize the messages ...
- 7,456
1
vote
2
answers
2k
views
Bijection - Java Avro Serialization
I am looking for an example to do Bijection on Avro SpecificRecordBase object similar to a GenericRecordBase or if there is a simpler way to use the AvroSerializer class as the Kafka key and value ...
- 2,774