Job Description
Data Engineer to join our dynamic team. In this role, you will be responsible for the design, development, and maintenance of robust data pipelines and architectures that facilitate the processing and analysis of large datasets. Your expertise will be essential in ensuring that our data systems are efficient, reliable, and scalable, enabling informed decision-making across the organization.
Key Responsibilities- Build and maintain data pipelines to ensure high data quality and availability.
- Optimize data pipelines and ETL processes for maximum performance and efficiency.
- Collaborate with data scientists and analysts to understand and fulfill data requirements.
- Implement and manage data storage and retrieval systems.
- Ensure compliance with data governance and security policies.
- Monitor and troubleshoot data infrastructure to ensure smooth operations.
- Stay updated with the latest industry trends and technologies in data engineering.
Requirements
- 2+ years of experience in data engineering or a related field.
- Proficiency in SQL and experience with NoSQL databases.
- Strong programming skills in Python, Java, or similar languages.
- Experience with cloud platforms like AWS, Azure, or Google Cloud.
- Familiarity with data pipeline orchestration tools (e.g., Apache Airflow, Luigi).
- Knowledge of big data technologies (e.g., Hadoop, Spark) is a plus.
- Strong analytical and problem-solving abilities.
- Bachelor's degree in Computer Science, Data Engineering, or a related discipline.
Qualification
Bachelor's Degree
Key skill Required
- Java
- SQL
- JAVA
- Python
- AWS
- Apache
- Apache Airflow
- Azure
- Data Engineering
- Data Governance
- Java
- Analysis
- Big Data
- Compliance
- Computer Science
- Data Infrastructure
- Data Pipelines
- Data Quality
- Data requirements
- Data Storage
- Design
- Development
- Discipline
- Facilitate
- Governance
- Infrastructure
- Maintenance
- NoSQL
- Orchestration
- Pipeline
- Science
- Security
- SPARK
