Role: Kafka Developer

Location: Plano, TX (Onsite)

Mode: Contract

Job Description:

We are seeking a skilled and experienced Kafka Developer with strong knowledge in distributed streaming systems and cloud-based database services like Cosmos DB. The ideal candidate will be part of a digital transformation team working on real-time data ingestion, processing, and integration solutions, primarily for Manufacturing (MFG) and IT business domains.

Key Responsibilities:

• Design, build, and maintain scalable and high-performance Kafka-based data streaming pipelines.
• Integrate Kafka with other components of the data ecosystem (e.g., Cosmos DB, cloud services).
• Work closely with cross-functional teams including Data Engineers, Cloud Architects, and Application Developers.
• Tune Kafka clusters for high throughput, low latency, and fault tolerance.
• Create schemas using Avro/JSON/Protobuf and manage Kafka topics, producers, and consumers.
• Implement best practices for data reliability, security, and retention.
• Troubleshoot and optimize streaming workflows, monitor Kafka health, and handle disaster recovery setups.
• Support real-time analytics use cases for Manufacturing and IT applications.

Required Skills (Primary):

• Strong hands-on experience with Apache Kafka (including Kafka Streams, Kafka Connect).
• Experience with Cosmos DB or similar NoSQL cloud databases (e.g., MongoDB, DynamoDB).
• Experience in streaming data processing and event-driven architecture.
• Good understanding of messaging paradigms (Pub/Sub, Event Sourcing).