Gravity Engineering Services Pvt Ltd.
Apply Now
Data Pipeline Engineer - Junior Level
Description
Kick-start your career as a Junior Data Engineer specializing in data pipelines. In this role, you will design, develop, and maintain robust data solutions using Python and SQL.
You’ll partner with data scientists and product teams to understand specific data needs and deliver well-structured datasets. Additionally, you will implement and manage Airflow DAGs to automate processes while utilizing AWS services for efficient data storage. Your skills will directly impact the reliability and quality of data outputs in our infrastructure.
Key Responsibilities:
• Create data pipelines that ingest and transform data
• Work with teams to ensure comprehensive data documentation
• Automate ETL tasks with Airflow to ensure quality
• Leverage AWS services like Redshift for scalability
• Optimize performance through data profiling and tuning
Requirements:
• Bachelor’s degree in Computer Science or equivalent
• Expertise in Python, SQL, and data frameworks
• Practica...
You’ll partner with data scientists and product teams to understand specific data needs and deliver well-structured datasets. Additionally, you will implement and manage Airflow DAGs to automate processes while utilizing AWS services for efficient data storage. Your skills will directly impact the reliability and quality of data outputs in our infrastructure.
Key Responsibilities:
• Create data pipelines that ingest and transform data
• Work with teams to ensure comprehensive data documentation
• Automate ETL tasks with Airflow to ensure quality
• Leverage AWS services like Redshift for scalability
• Optimize performance through data profiling and tuning
Requirements:
• Bachelor’s degree in Computer Science or equivalent
• Expertise in Python, SQL, and data frameworks
• Practica...