Data Engineer

• Build resilient data pipelines using Medallion architecture principles.
• Manage and optimize open storage formats including Parquet, Iceberg, and Delta Lake.
• Design, develop, and maintain distributed data processing workloads using Databricks and Apache Spark.
• Perform database operations, optimization, and maintenance for PostgreSQL and SQLite environments.
• Ensure data quality, reliability, scalability, and performance across data platforms.
• Collaborate with data consumers and stakeholders to support reporting, analytics, and operational data requirements.
• Monitor, troubleshoot, and improve data infrastructure and pipeline performance.
• Follow data engineering best practices, coding standards, and documentation processes.

Requirements

• Bachelor’s degree in Computer Science, Software Engineering, or a related field.
• Approximately 5 years of experience in Data Engineering or a related role.
• Advanced SQL skills with strong expertise in PostgreSQL.
• Strong proficiency in Python and DuckDB.
• Experience with data lakes and open-source query and storage layers.
• Hands-on experience working with Parquet, Iceberg, and Delta Lake.
• Experience with distributed computing frameworks, specifically Databricks and Apache Spark.
• Strong understanding of data modeling, ETL/ELT processes, and data pipeline development.
• Knowledge of database administration, performance tuning, and optimization techniques.
• Excellent problem-solving and analytical skills.
• Ability to work effectively both independently and within a collaborative team environment.
• Excellent English communication skills.

This opportunity is remote for Egyptian applicants and Hybrid for Lebanese applicants.