Job title: Python developer
Location: - Malvern, PA ( Onsite )
Experience: 10+ Years
Visa: H1B only
Mandatory Skills:
- Hands-on experience in Pyspark, EMR/Glue, IAM, Cloud formation
- Experience on AWS S3, Python, Lambda, Redshift
- Design and developing ETL pipelines using PySpark, AWS EMR, and AWS Glue for large-scale data processing.
- Optimize Spark jobs for performance, scalability, and cost efficiency in cloud environments. Manage data transformations, cleansing, and enrichment to ensure high data quality.
- Monitor, troubleshoot, and enhance ETL workflows for reliability and efficiency