- Responsibilities:• Member of the Business Date Engineering team, work to deliver Data Ingest/Enrich Pipelines, and Access APIs using common cloud technologies.
• Work with consumers to understand the data requirements and deliver data contracts with well defined SLIs to track SLA agreements.
• Harness modern application best practices with code quality, API test Coverages, Agile Development, DevOps, and Observability and support.
• Maintain programming standards and ensure the usage of the pattern / template for API Proxy.
• Conduct code reviews and automatic test coverage
• Standardize the CI/CD setup for API management tools and automated deployment.
• Utilize problem-solving skills to help your peers in the research and selection of tools, products, and frameworks (which is vital to support business initiatives) - Mandatory Skills Description:
• Data Engineer highly proficient in Python development with 6+ years of ETL development experience with Azure cloud-based experience.
• Can demonstrate the use of modular configurable reusable components, with logging, exception handling and rejection management.
• Strong Python development skills (rest API, and also for connections, encryption-decryption, managing data and storaging data purposes)
• Solid understanding of API and integration design principles and pattern experience with web technologies.
• Design object-oriented, modularized, clean, and maintainable code and creating policies in Python.
• Hands-on experience in designing and developing high-volume REST using API Protocols and Data Formats.
• Experience with test-driven development and API testing automation.
• Understanding of Data Warehouse Concepts such as Real-time Data Ingestion, Data Modeling, Dimensional Modeling, Denormalized Data structures, etc.
• Good exposure to the Azure cloud platform, and knowledge of its key components e.g., Azure Blob Storage, Azure Data Factory, etc.
• Clear understanding of Code testing, e.g., regression, performance & automated tests.
• Implemented ETL solutions in Snowflake, with knowledge of DB components and its DR capabilities.
• Exposed to scripting languages e.g., Shell scripts for data transfers, automated deployments, etc.
• Managed automated deployments using Source code Control & DevOps tools.
• Knowledge of Cloud Security features and their adoption in the Cloud environment and application development.
• Bachelor's degree in IT
Company
Location
New York, NY - United States of America
Job type
Full-Time
Python Job Details
More Developer Job Boards
Fullstack Developer Jobs Golang Jobs JavaScript Jobs Python Jobs React Jobs Rust Jobs Java Jobs