Data Engineer

Data Engineer:

Responsibilities:

Develop, implement & test scripts and programs in Python to automate data processing and analysis tasks
Integrate with third party APIs to fetch data which is processed, analyzed and stored in a data store
Implement data ingestion, transformation, and processing workflows using ETL tools and frameworks
Perform data analysis and profiling to identify data quality issues anomalies and opportunities for improvement
Design, model and optimize data models and data structure for efficient reporting analysis, data visualization and data sharing
Collaborate with other teams such as business intelligence, applications, and consultants, to understand and meet client’s data needs and challenges
Document and keep up to date procedures and best practices related to Python, libraries, algorithms, and related data processing technologies and propose innovative solutions

Skills & Experience:

2-3 years of experience in the data engineering
Hands on experience in data processing and tranformation tools using Python (Spark, Pandas, Polars, ...)
Hands on experience in third party APIs integration
Good understanding in different databases (SQL, No-SQL)
Good understanding of job queues and workflows
Experience in workflows or data pipeline orchestration tools
Familiarity with data visualization tools
Experience with version control systems (e.g., Git) and agile methodologies (e.g., Scrum)
Analytical problem-solving capabilities & experience

Plus: