Data Engineer

Responsibility

The common responsibilities for this position include implementing an investment Enterprise Data Management (EDM) platform, building and managing data sets, designing and publishing dashboards and reporting, automating data processes, and ensuring data quality. The role involves liaising with business units and external consultants, managing data initiatives, and providing consultancy on Data Governance and architectures. The Data Engineer will participate in AI/ML proof of concept projects, collaborate with business teams on cloud/data initiatives, and communicate with senior stakeholders. Responsibilities also include building data lakes and pipelines, performing system health checks and backups, evaluating technology stacks, and delivering AI solutions. The position requires hands-on work with SQL and Python, database development, data analytics, and ensuring data governance best practices are followed. Additionally, the Data Engineer will prepare, clean, and verify data for model training, research and implement techniques in Large Language Models (LLM) and Generative AI, and stay updated with industry trends.

Job Growth

Skills Requirement

The percentages next to each skill reflect the sector’s demands in these respective skills. E.g., 30% means this skill has been listed in 30% of all the job postings in this sector.

• Skill Categories
• Specific Skill Sets

Skills Distribution

The skills distribution tells you what specific skill sets are in demand. E.g., Skills with a distribution of “More than 50%” means that these skills are wanted in more than 50% of the job postings.

• More Than 70%
• More Than 50%
• More Than 30%
• More Than 10%