Client: Tech Mahindra

Rate: $58/hr. on C2C

Experience: 8+ Years

Title: Azure Data Engineer

Duration: Long Term Contract

Location: Plano, TX (onsite)

Job Description:

• 7 + years of software development experience in below skills:
• Competent Big Data/Databrick engineer, who is independent, results driven and is capable of taking business requirements and building out the technologies to take it to production.
• Big Data Engineer with expert level experience in Hadoop ecosystem and real time analytics tools including PySpark/Scala, Spark/Hive/Hadoop, CLI/MapReduce/Storm/Kafka/Lambda Architecture/Mongo
• Familiar with job scheduling challenges in Hadoop
• Experienced in creating and submitting Spark jobs
• Experience in high performance tuning and scalability
• Experience in working on real time stream processing technologies like Spark structured streaming, Kafka
• Expertise in Python/Spark and their related libraries and frameworks
• Experience in building CI/CD pipeline and efforts involved in deployment