Position: Big Data Engineer
Location: Mountain View, CA
Job Type: Contract
Job Description:
We are seeking a skilled Big Data Engineer with hands-on experience in real-time data processing and modern cloud-native architectures. The ideal candidate will have deep knowledge of Apache Flink or Spark Structured Streaming, along with strong backend programming skills and cloud deployment expertise.
Key Responsibilities:
- Design and develop real-time data processing pipelines using Apache Flink or Spark Structured Streaming (Flink preferred)
- Build and maintain high-performance microservices using Java or Scala
- Develop and deploy services on Kubernetes with best practices in scalability and reliability
- Collaborate with DevOps to manage deployments using the AWS ecosystem
- Optimize and tune streaming applications for performance and low-latency delivery
- Troubleshoot data pipeline issues and ensure high availability of production systems
Required Skills:
- Experience with Apache Flink or Spark Structured Streaming
- Strong proficiency in Java or Scala
- Solid experience designing and deploying microservices
- Hands-on experience working with Kubernetes in production environments
- Deep understanding of AWS services such as EC2, S3, Lambda, Kinesis, EKS, etc.
- Strong problem-solving skills and attention to detail