- Programming Skills: Proficiency in Java, Python, and Scala.
- Big Data Technologies: Hands-on experience with BigQuery, Dataflow, Dataproc, and Cloud Composer.
- Data Streaming: Strong knowledge of Kafka, Spark, Airflow, SQL, and NoSQL databases.
- Cloud Data Platforms: Experience with Google Cloud Platform (Google Cloud Platform) services for data processing and analysis.
- Infrastructure as Code (IaC): Hands-on experience with Terraform and Ansible.
- Database Expertise: Experience working with relational, document, in-memory, and time-series databases.
- Agile Development: Experience working in Agile/Scrum environments.
- Problem-Solving: Strong analytical and problem-solving abilities in complex data architectures.
- Data Science & ML: Exposure to Pandas, PyTorch, Keras, and TensorFlow.
- Technical Leadership: Experience serving as a technical lead for complex data engineering projects.
- Certifications: Google Cloud Platform Professional Data Engineer Certification or equivalent.
- Open-Source Contributions: Participation in open-source software development.
- Stakeholder Communication: Ability to collaborate with technical and non-technical stakeholders effectively.
Company
Location
Toronto, Ontario - Canada
Job type
Full-Time
Python Job Details
Job Title: Data Engineer (Google Cloud Platform, Python, Terraform, and Airflow)
Location: Toronto, ON ( Onsite )
Duration/Term: Long Term Contract
Job Description
We are seeking an experienced Senior Data Engineer with expertise in Big Data, cloud-based data engineering, and large-scale distributed data technologies. The ideal candidate will be proficient in Google Cloud Platform (Google Cloud Platform), Terraform, and data streaming tools such as Kafka, Spark, and Airflow. Additional expertise in SQL, NoSQL, Infrastructure as Code (IaC) (e.g., Terraform, Ansible), and Agile/Scrum methodologies is required. This role involves designing, building, and optimizing scalable data solutions while ensuring high performance and reliability.
Qualifications
Must-Have:
Nice-to-Have:
Key Skills
Big Data, Google Cloud Platform, BigQuery, Kafka, Spark, Airflow, Cloud Composer, Dataflow, Dataproc, Terraform, SQL, NoSQL, Java, Python, Scala, Agile, CI/CD, Problem-Solving, Leadership.
VDart Group, a global leader in technology, product, and talent management, empowers businesses with comprehensive solutions through our four distinct, industry leading business units With a diverse team of over 4,000 professionals across 13 countries, we deliver strong results across various industries, including Fortune 500 companies
Committed to "People, Purpose, Planet," we prioritize social responsibility and sustainability, as evidenced by our EcoVadis Bronze Medal Certification and participation in the UN Global Compact
Our dedication to delivering strong results has earned us recognition as a trusted advisor for businesses seeking to drive innovation and growth, including many Fortune 500 companies Join our network! Partner with VDart Group to leverage our global network, industry expertise, and proven track record with a diverse clientele
More Developer Job Boards
Fullstack Developer Jobs Golang Jobs JavaScript Jobs Python Jobs React Jobs Rust Jobs Java Jobs