IT - Software

junior data engineer

The company bridges the gap between AI's potential and real-world business success.

Requirement:

Bachelor's degree in Computer Science, Information Technology, or a related field.
1-2 years of relevant industry experience in data engineering or a similar role.
Strong programming skills in Python and SQL.
Experience with ETL tools and frameworks (e.g., Apache Airflow).
Familiarity with data scraping techniques and tools (e.g., Scrapy).
Understanding of database design principles (normalization, indexing).
Experience with API development and integration.
Excellent problem-solving and analytical skills.
Strong communication and collaboration skills.
Ability to work independently and as part of a team.

Job Description:

Design, develop, and implement ETL pipelines using Python and SQL to automate data extraction, transformation, and loading processes.
Develop and maintain data pipelines for efficient data ingestion from various sources.
Utilize web scraping techniques to gather relevant data from web sources.
Design and manage relational databases to ensure data integrity and scalability.
Develop and maintain APIs to facilitate data exchange between different systems.
Collaborate with data analysts and data scientists to understand data requirements and build solutions.
Document data pipelines and database structures for clarity and future reference.
Maintain and troubleshoot existing data pipelines and databases.
Stay up-to-date on the latest trends and technologies in data engineering.