data engineer

Overview

Who you'll be working for

What requirements you'll need to be eligible

• At least a Bachelor or Master Degree in Computer Science / IT / IS or its equivalent  

• Experience with distributed computing, data warehousing concepts, data modelling/architecture and building SQL scripts to support data transformation and data delivery  

• Experience with big data tools such as Hadoop, Spark, etc  

• Experience with cloud solutions preferably AWS  

• 1-2 years working experience, fresh graduates with internship are welcome to apply  
• Proficiency in writing Python, Pyspark, SQL & Unix
   
• Results oriented. Able to identify the root of issues, identify what need to be done and work as team to get the issues resolved  
  
  
• Familiarity with data science techniques 
  

What you'll be doing on the job

• Identify data source required for analytics  

• Responsible to perform thorough data testing and validation in supporting data ingestions while ensuring data quality  

• Analyse and organize raw data from different source systems to build dataset and data model adhering to the data architecture  

• Assembling simple to large sets of data that meet all functional business requirements  

• Work closely with the data science and business units to develop data models and pipelines for research, visual analytics and machine learning 

• Work closely with IT team to automate manual process in handling data scripts  

• Understand the data, maintain documentation and assist in data related queries  

• Ensure compliance with data governance and company security policies  

• Support Senior Data Engineer in delivering analytics solutions

Consultant Contact