Deputy Manager Assistant Lead Abinitio Admin null

Job Description

The Data Engineer is a software engineer specialising in data solutions, including technologies to use and scalability of different solutions. Typically reports to the Chapter Lead.

Responsibilities

• Designs, constructs, installs, tests and maintains highly scalable data management systems, to business requirements and industry practices through the application of data modelling, data warehousing and data manipulation techniques and standards;
• Builds and deploys individual datasets for further modelling based on commercial and/or analytical requirements by extracting, loading and transforming data from different sources;
• Supports integration of new data sources (e.g. batch and streaming) into a shared data environment (e.g. EDW, Big Data Platform, etc.);
• Builds high-performance algorithms, prototypes, predictive models and proof of concepts, translating business requirements into concrete data engineering tasks;
• Researches opportunities for data acquisition and new uses for existing data;
• Develops data set processes for data modelling, mining and production;
• Integrates new data management technologies and software engineering tools into existing structures;
• Creates custom software components and analytics applications;
• Employs a variety of languages and tools (e.g. scripting languages) to marry systems together;
• Installs and updates disaster recovery procedures;
• Recommends ways to improve data reliability, efficiency and quality;
• Collaborates with data architects, modellers and IT team members on project goals;
• Designs develop and maintain programmes (e.g. written in Python, Scala, Java);
• Designs create and maintain reports and dashboards.

Skills Required

• Data Modelling
• Data Analytics and Insights
• Data Management and Transformation
• Implementation and Integration
• Coding
• Software Engineering
• Automation and Robotics_2022
• Testing and Evaluation
• AI - Deep and Machine Learning and AR
• Critical Thinking
• Complexity Management
• Communication
• Data Visualisation
• Applied Mathematics and Statistics
• Business and Commercial Acumen