Python/SQL:
Data Engineer Expectations & Responsibilities:
Proven experience as a Data Engineer or in a similar data infrastructure role.
Strong programming skills in Python and SQL (e.g., Oracle, SQL Server, Snowflake, GCP BQ).
Hands-on experience with data pipeline tools (e.g., Apache Airflow, AWS, Spark).
4+ Years of data engineering experience
Design, develop, and maintain ETL/ELT pipelines for data ingestion, transformation, and storage using SQL and Python
Design, develop, and maintain ETL/ELT pipelines for data ingestion, transformation, and storage.
Build and optimize data warehouses and data lakes to support analytics and reporting needs.
Collaborate with stakeholders to understand data requirements and design efficient data models.
Ensure data quality, consistency, and integrity across multiple systems.
Develop and maintain data APIs and data integration frameworks.
Monitor and troubleshoot data pipelines and infrastructure performance issues.
Implement data governance, lineage, and security best practices.
Automate data workflows using orchestration tools (e.g., Airflow, Prefect, Dagster).
Collaborate with Dev Ops teams to deploy and manage data infrastructure in the cloud.
