Job Description
About Position:
We are looking for an experienced and talented Data Engineer- Databricks to join our growing data engineering team.
Role: Data Engineer- Databricks
Location: Pune and Bangalore
Experience: 3 Years- 12 Years
Job Type: Full Time Employment
What You'll Do:
Design and maintain scalable data pipelines using Databricks and Apache Spark.
Develop and optimize ETL/ELT processes for structured and unstructured data.
Implement Lakehouse architecture for efficient data storage, processing, and analytics.
Manage Databricks Workflows, Jobs API, and AWS/Azure/GCP data services.
Optimize queries using pushdown capabilities and indexing strategies.
Ensure data governance with Unity Catalog, security policies, and access controls.
Troubleshoot and improve Databricks jobs and clusters.
Expertise You'll Bring:
3+ years of experience in Big Data technologies like Apache Spark, Databricks.
Strong proficiency in Python or Scala.
Experience with cloud platforms (AWS,Azure, GCP).
Knowledge of data warehousing, ETL processes, and SQL.
Familiarity with CI/CD pipelines, GitHub, and containerization (Docker, Kubernetes).
Benefits:
Competitive salary and benefits package
Culture focused on talent development with quarterly promotion cycles and company-sponsored higher education and certifications
Opportunity to work with cutting-edge technologies
Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
Annual health check-ups
Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents
Inclusive Environment:
Our client is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.
We offer hybrid work options and flexible working hours to accommodate various needs and preferences.
Our office is equipped with accessible facilities, including adjustable workstations, ergonomic chairs, and assistive technologies to support employees with physical disabilities.
If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment. We are committed to creating an inclusive environment where all employees can thrive.
Our company fosters a values-driven and people-centric work environment that enables our employees to:
Accelerate growth, both professionally and personally
Impact the world in powerful, positive ways, using the latest technologies
Enjoy collaborative innovation, with diversity and work-life wellbeing at the core
Unlock global opportunities to work and learn with the industry's best
For more detail, please contact VivekKumar (vivek@talworx.com)
Requirements
3+ years of experience in Big Data technologies like Apache Spark, Databricks.
Python or Scala
AWS,Azure, GCP
Benefits
Competitive salary and benefits package
Culture focused on talent development with quarterly promotion cycles and company-sponsored higher education and certifications
Opportunity to work with cutting-edge technologies
Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
Annual health check-ups
Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents
Qualification
Bachelor's Degree
Key skill Required
- SQL
- GitHub
- Architecture
- Python
- AWS
- Apache
- API
- Azure
- Containerization
- Data Engineering
- Data Governance
- CI/CD
- Analytics
- Apache Spark
- API
- Big Data
- Data Pipelines
- Data Services
- Data Storage
- Design
- Development
- Employee Engagement
- Focused
- Governance
- Health Check
- Inclusive
- Innovation
- Insurance
- Insurance Coverage
- Kubernetes
- Security
- SPARK
- Talent Development
- Talented
- Unity
