Click here to Skip to main content

Submit your article

Kafka

Kafka

Great Reads

Uber simple uber app written using loads of stuffz

by Sacha Barber

Simple uber type app using Akka/React/TypeScript/Scala/Play/Kafka/MongoDb/Rx

Apache Kafka 0.9 Scala Producer/Consumer With Some RxScala Pixie Dust

by Sacha Barber

An article on how to use the open source Apache Kafka messaging framework, with a bit of RxScala thrown in for good luck

Simple Kafka Producer and Consumer with C# and Scala

by Igor Ladnik

Simple Kafka producer and consumer written in C# and Scala with Avro schema read either from local file or simple Web server

Madcap Idea 9 : Kafka Streams Interactive Queries

by Sacha Barber

In this post what we will be doing is looking at: How to install Kafka/Zookeeper and get them running on Windows, walking through a KafkaProducer, walking through a Kafka Streams processing node, and the duality of streams, and walking through Kafka Streams interactive queries

Latest Articles

Troubleshoot: Kafka Setup on Windows

by Sandeep Mewara

Issues faced while setting up Kafka on Windows OS and how I resolved it

Beginner’s Guide to Understand Kafka

by Sandeep Mewara

A guide to help learn about Kafka and do a setup & test of data pipeline in Windows environment.

Kafka Produce Not Throwing Exception when Unable to Connect to kafka Cluster in C#

by Alfredo_Fernandez

A quick tip on dealing with failures and errors with Kafta

Simple Kafka Producer and Consumer with C# and Scala

by Igor Ladnik

Simple Kafka producer and consumer written in C# and Scala with Avro schema read either from local file or simple Web server

All Articles

Kafka

Uber simple uber app written using loads of stuffz

6 Feb 2018 by Sacha Barber

Simple uber type app using Akka/React/TypeScript/Scala/Play/Kafka/MongoDb/Rx

Apache Kafka 0.9 Scala Producer/Consumer With Some RxScala Pixie Dust

15 Mar 2016 by Sacha Barber

An article on how to use the open source Apache Kafka messaging framework, with a bit of RxScala thrown in for good luck

Simple Kafka Producer and Consumer with C# and Scala

28 Oct 2019 by Igor Ladnik

Simple Kafka producer and consumer written in C# and Scala with Avro schema read either from local file or simple Web server

Madcap Idea 9 : Kafka Streams Interactive Queries

11 Sep 2017 by Sacha Barber

In this post what we will be doing is looking at: How to install Kafka/Zookeeper and get them running on Windows, walking through a KafkaProducer, walking through a Kafka Streams processing node, and the duality of streams, and walking through Kafka Streams interactive queries

How to Run ELK on Windows

6 Jul 2016 by mahesh.surya87

Configure on Windows zookeeper, kafka, elasticsearch, logstash, kibana

How do I delete the topics in kafka

6 Mar 2017 by Richard MacCutchan

You already posted this at Deleting topics in kafka from cmd[^], please do not repost.

Error while start kafka

7 Apr 2018 by Pankaj.betech

I have install kafka on my centOS 6.5, Java 1.7.0.67 Zookeeper: 3.4.10 bin/kafka-server-start.sh config/server.properties Exception in thread "main" java.lang.UnsupportedClassVersionError: kafka/Kafka : Unsupported major.minor version 52.0 at java.lang.ClassLoader.defineClass1(Native Method)...

Error while start kafka

7 Apr 2018 by Richard MacCutchan

xception in thread "main" java.lang.UnsupportedClassVersionError: kafka/Kafka : Unsupported major.minor version 52.0 The message is quite clear, this version of kafka is not supported. You need to install a supported version.

Win32exception: the specified module could not be found

15 Feb 2019 by Member 13943607

I am trying to run a code sample of Kafka in unity environment and for this reason, I created a consumer client (Code given below). using System.Collections; using System.Collections.Generic; using UnityEngine; using Confluent.Kafka; using Confluent.Kafka.Serialization; using System.Text;...

How to add third party package in eclipse java

12 Feb 2019 by Member 13943607

I am trying to write a java program in Eclipse editor. For this reason i want to add kfka third party library. I add this line in top of the program import kafka.javaapi.producer.Producer; but it giving me error. "The import kafka cannot be resolved. ". I am new to java and eclipse,...

How to add third party package in eclipse java

12 Feb 2019 by CPallini

Possibly there is a mismatch between your code and the jar you downloaded, see api - what's the difference between kafka.javaapi.* and org.apache.kafka.*? - Stack Overflow[^].

Controlling kafka consumer listener

12 May 2019 by Gerry Schmitz

Introducing the Kafka Consumer: Getting Started with the New Apache Kafka 0.9 Consumer Client - Confluent[^]

How do I make my kafka message value not return gibberish?

12 May 2019 by Member 14365415

i am using Confluent.Kafka to Consume data, and my code as(c#): public static class Confluent { public static void Consume() { var conf = new ConsumerConfig { GroupId = Guid.NewGuid().ToString(), BootstrapServers =...

How do I make my kafka message value not return gibberish?

12 May 2019 by Patrice T

Quote: but the return message value like this: \0\0\0\0\u0015\u0002\u001aSandra ...

Kafka Produce Not Throwing Exception when Unable to Connect to kafka Cluster in C#

24 Apr 2020 by Alfredo_Fernandez

A quick tip on dealing with failures and errors with Kafta

Implementation HTTP synchronous request response in kafka

1 May 2020 by arunrv

Hi All, I am working on containerization application where a front-end application calls HTTP request to API gateway. The request data received at API Gateway is forward to Micro service via Kafka. But I have to send the response back the result...

Need to make some design decision based on kafka and cassandra

1 Dec 2020 by Member 15008824

In our use case we want to show some charts, metrices and grid based on Kafka topics data.( All Topics are already loaded with Json data from different systems ) We are planning to use Kafka connect and will sync topics data to Cassandra...

Cassandra sink connector : not able to auto generate cassandra table based on avro schema

31 Dec 2020 by Richard MacCutchan

You already posted this question at Cassandra sink connector : how to add whole topic JSON as it is into single cassandra table column[^]. Please do not repost.

Avro.avroexception: genericrecord required to write against record schema but found avro.generic.genericrecord

10 May 2021 by rkganapathy

I got the exception from confluent Kafka producer like Avro.AvroException: GenericRecord required to write against record schema but found Avro.Generic.GenericRecord \n at Avro.Generic.DefaultWriter.EnsureRecordObject(RecordSchema s, Object...

How do I integrate kafka with .NET 4.5

13 Sep 2022 by Richard MacCutchan

See https://www.confluent.io/lp/apache-kafka-v3/[^]

How to code a pseudo book management application in scala, akka and kafka?

12 Dec 2022 by OriginalGriff

While we are more than willing to help those that are stuck, that doesn't mean that we are here to do it all for you! We can't do all the work, you are either getting paid for this, or it's part of your grades and it wouldn't be at all fair for...

Testcontainers in .NET

6 Sep 2023 by FairPoint

Try the following: 1 - Add Testcontainers and Kafka client dependencies to your project. 2- Start Zookeeper and Kafka containers using Testcontainers in your test setup method. 3 - In your test method, use Kafka clients to create a Kafka topic...

Beginner’s Guide to Understand Kafka

1 Aug 2020 by Sandeep Mewara

A guide to help learn about Kafka and do a setup & test of data pipeline in Windows environment.

29 Jun 2019 by Mahsa Hassankashi

This article explains what is Kafka and its architecture and implementation and its differences with Akka.

Troubleshoot: Kafka Setup on Windows

8 Aug 2020 by Sandeep Mewara

Issues faced while setting up Kafka on Windows OS and how I resolved it

How to code a pseudo book management application in scala, akka and kafka?

13 Dec 2022 by Shrey Jamdar

Develop an psuedo book management application using Scala, Akka and Kafka. 1. Kafka Application should have the below mentioned features - a. Publish/produce the user/author/book details (every 30 seconds for Users/Authors and...

Testcontainers in .NET

6 Sep 2023 by bmw318mt

I am using Testcontainers to setup Zookeeper and Kafka. Containers seem to be starting but I am noticing some errors in kafka. Also, I am trying to create a topic and produce message, but with no success. 2023-09-06 10:03:52 [2023-09-06...

Cassandra sink connector : how to add whole topic JSON as it is into single cassandra table column

30 Dec 2020 by Member 15008824

I am using Cassandra Sink Connector with Kafka, now i want to insert whole topic JSON as it is into single Cassandra table column instead of creating diff cols. so what should be the connector KCQL expression ? INSERT�INTO�connector_json_table...

How do I integrate kafka with .NET 4.5

13 Sep 2022 by Member 14402365

I'm trying to integrate the kafka with .net 4.5. how can the kafka topics consumed from api in .net 4.5? need solution for consuming kafka topics under api and pass front end through webservice. What I have tried: ...

Launch AKHQ from testcontainers in .NET

12 Sep 2023 by bmw318mt

I am trying to launch AKHQ using Testcontainers, however when launching UI, I get the following message: / http://localhost:62732/ { "message": "Couldn't find any clusters on your configuration file, please ensure that the configuration...

Testcontainers in .NET

6 Sep 2023 by bmw318mt

Found out the problem was I was missing .WithHostname(kafkaContainerName)