Data Engineer

**About the job Data Engineer**:
**About the Project**:
**Requirements**:

- Design, develop, and maintain data storage solutions and infrastructure.
- Build and optimize ETL (Extract, Transform, Load) pipelines to ensure efficient data processing.
- Handle data quality and data governance aspects, including data cleaning and validation.
- Set up monitoring and alerting systems to ensure data reliability and performance.
- Implement CI/CD (Continuous Integration/Continuous Deployment) practices for data pipelines.
- Enforce data access control and governance policies to maintain data security and compliance.

**Qualifications**:

- Bachelor's degree in Computer Science, Information Technology, or related field (or equivalent experience).
- Proven experience in data engineering and infrastructure, with a focus on AWS Glue, Athena, Apache Spark, Apache Hudi, and Python.
- Strong ETL development skills and expertise in data storage and retrieval.
- Knowledge of data quality best practices and the ability to ensure data integrity.
- Familiarity with CI/CD practices for data pipelines.
- Experience with data governance and access control.
- Strong problem-solving skills and the ability to work collaboratively in a team.
- Nice-to-have: Knowledge in data science, machine learning, analytics, or data warehousing.