Role - SQL Developer
Location - Minneapolis, MN (Remote)
Contract role
Mandatory Skills - SQL Server, Azure Devops
Experience required- 14+ years
Responsibilities:
- Develop, optimize, and maintain ETL/ELT pipelines using PySpark and SQL.
- Work with structured and unstructured data to build scalable data solutions.
- Write efficient and scalable PySpark scripts for data transformation and processing.
- Optimize SQL queries, stored procedures, and indexing strategies to enhance performance.
- Design and implement data models, schemas, and partitioning strategies for large-scale datasets.
- Collaborate with Data Scientists, Analysts, and other Engineers to integrate data workflows.
- Ensure data quality, validation, and consistency in data pipelines.
- Implement error handling, logging, and monitoring for data pipelines.
- Work with cloud platforms (AWS, Azure, or GCP) for data processing and storage.
- Optimize data pipelines for cost efficiency and performance.