Python Job: Data Engineer - Python, PySpark, AWS

Job added on

Company

Strategic Staffing Solutions
United States of America

Location

Remote Position
(From Everywhere/No Office Location)

Job type

Full-Time

Python Job Details

Data Engineer - Python, PySpark, AWS

******W2 ONLY- NO C2C

Location:
Richmond, VA
Setting: May work remote or on site
Contract: 4+months

Position Overview:
As a Data Engineer, you will be responsible for designing, implementing, and maintaining scalable data pipelines and infrastructure. You will work closely with our data scientists and analysts to understand data requirements and ensure data quality and reliability. The ideal candidate will have strong technical skills in Python, PySpark, and AWS, along with experience in data modeling, ETL processes, and cloud-based data solutions.

Key Responsibilities:


  • Design and develop robust data pipelines using Python and PySpark to process large volumes of data from multiple sources.
  • Implement efficient ETL processes to transform and cleanse data before loading into our data warehouse.
  • Collaborate with data scientists and analysts to understand data requirements and ensure data quality and consistency.
  • Optimize data infrastructure and pipeline performance for scalability and reliability.
  • Monitor and troubleshoot data pipelines and infrastructure to ensure uptime and performance.
  • Implement best practices for data security, privacy, and compliance.
  • Stay current with advancements in data engineering technologies and best practices.

Tech stack:


  • Python
  • PySpark
  • AWS

Responsibilities:


  • Development and maintenance of data pipelines using Python, PySpark and various AWS services.
  • End to End testing, deployment, Product support and Defect fixes.

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.