Python Job: Python Big Data Engineer

Job added on

Location

Wilmington, DE - United States of America

Job type

Full-Time

Python Job Details

Hybrid at Plano, TX & Wilmington, DE

W2/1099 only (no C2C)

Spark – Python (PySpark) Library, can perform ETL operations. Candidate should know big data management and move data around AWS. He should have excellent problem solving skills.
 
Job Description:
 
• 5+ years of professional work experience designing and implementing data pipelines in a cloud environment is required.
• 2+ years of experience migrating/developing data solutions in the AWS cloud is required.
• 1+ years of experience building/implementing data pipelines using Databricks or similar cloud database.
• Expert level knowledge of using SQL to write complex, highly-optimized queries across large volumes of data.
• Hands-on object-oriented programming experience using Python is required.
• Professional work experience building real-time data streams using Spark and Experience in Spark.
• Knowledge or experience in architectural best practices in building data lakes