Apply Now
Location: Minneapolis, Minnesota (MN)
Contract Type: C2C
Posted: 1 month ago
Closed Date: 05/14/2025
Skills: ETL/ELT pipelines using PySpark and SQL.
Visa Type: Any Visa

Role - SQL Developer

Location - Minneapolis, MN (Remote)

Contract role

Mandatory Skills - SQL Server, Azure Devops

Experience required- 14+ years

 

Responsibilities:

  • Develop, optimize, and maintain ETL/ELT pipelines using PySpark and SQL.
  • Work with structured and unstructured data to build scalable data solutions.
  • Write efficient and scalable PySpark scripts for data transformation and processing.
  • Optimize SQL queries, stored procedures, and indexing strategies to enhance performance.
  • Design and implement data models, schemas, and partitioning strategies for large-scale datasets.
  • Collaborate with Data Scientists, Analysts, and other Engineers to integrate data workflows.
  • Ensure data quality, validation, and consistency in data pipelines.
  • Implement error handling, logging, and monitoring for data pipelines.
  • Work with cloud platforms (AWS, Azure, or GCP) for data processing and storage.
  • Optimize data pipelines for cost efficiency and performance.