Location: Stockholm Requisition Number: 230103 Job Category: Data Engineering
Job Description
As a data engineer you will work with either migration of existing datawarehouse to data lakes or enhance and maintain existing on premise or cloud based data lakes.
What will you be doing?
Designing, Developing, Testing and Maintaining data-pipelines
Data model design, development and optimization for highly performing data pipelines
Requirement specification & translation of business needs to technical requirements
Continuously monitoring and improving the performance of the ecosystem
Relentless focus on data quality to ensure business decisions are supported by accurate metrics
Working closely with other development teams and data scientists maintaining data platforms and Analytics ecosystem
Experience
At least 5 years of experience in dealing with data related technologies
3+ years of Experience with Java/Python/Scala in highly desired
2+ Years of Experience with Spark streaming and batch framework
1+ Years of Experience with any message queue systems
1+ Years of Experience in data plane of one of the major cloud platforms
1+ Years of Experience in any of the container platforms
Good understanding of fundamentals of distributed data processing
Good understanding of any RDBMS and Non SQL databases