Senior Data Engineer

We are looking for a Senior Data Engineer to work in key areas within Business Intelligence and Advanced Data Analysis.

The role involves migration of existing Data warehouse to a new Cloud Analytics Platform which will serve as a common data repository to fulfill business analytical and reporting needs. Over time, this new established Cloud platform will replace existing data repositories and reporting solutions.

Your main responsibilities would be

• Designing, developing, testing and maintaining data-pipelines
• Implementing and maintaining batch applications
• Data model design, development and optimization for better storage and retrieval
• Requirement specification & translation of business to technical requirements
• Continuously improving the performance of the ecosystem
• Setting up infrastructure to guarantee data quality
• Working closely with other development teams

Your must have experience

• Experience in all phases of the IT development life cycle
• cLDM experience and understanding of Teradata engine architecture
• Proficient in SQL writing, Query tuning and shell scripting.
• Significant experience in problem solving and data analysis
• Good experience in job scheduling through Control M
• Be able to create high-quality documentation
• Experience to ensure deliverables are of high quality by following processes and delivering on schedule
• Working knowledge of Python, Scala, Spark, Kubernetes & Docker
• Ensuring the stability of the application in production
• Keeping a continuous dialogue with our business partners and other stakeholders through the development life cycle
• Experience in at least one of the following Cloud Technologies: MS Azure, GCP or AWS