Is there a job opening for a Data Integration Engineer in Bengaluru, Karnataka, India?

Weekday AI is currently hiring a Data Integration Engineer in Bengaluru, Karnataka, India. The ideal candidate has skills and work experience of 5 - 6 years of experience as Data Integration Engineer.

Does Weekday AI hire Data Integration Engineer?

Weekday AI looking to hire a qualified Data Integration Engineer in Bengaluru, Karnataka, India. The candidate will have 5 - 6 years of experience as Data Integration Engineer.

Top

Data Integration Engineer

Bengaluru, Karnataka, India

110 Days ago

Save Job Quick Apply

Job Description

This role is for one of the Weekday's clients

Min Experience: 3 years

Location: Bengaluru

JobType: full-time

Educational Qualifications

Bachelor's or Master's degree in Computer Science, Engineering, or a related discipline.

Experience Requirements

Minimum 5 years of experience in Data Engineering, ideally within the manufacturing, logistics, or transportation sectors.
Proven track record of delivering robust analytics solutions.
Consulting background is a plus.

Requirements

Technical Expertise

Strong understanding of distributed computing principles.
Hands-on experience implementing data engineering solutions using Big Data technologies in both cloud and on-premise environments.
Skilled in managing large datasets, databases, data lakes, and cloud-based storage solutions.
Expertise in managing and optimizing Spark clusters and related Spark-based technologies.
Proficient in Python and PySpark for data transformation and processing tasks.
Advanced SQL skills with experience in relational databases (PostgreSQL, MySQL, Oracle) and NoSQL databases (MongoDB, Cassandra, DynamoDB).
Experience with cloud-based services such as AWS Glue, S3, Lambda, and Spark on AWS.
Solid understanding of data modeling methodologies including star schema, snowflake schema, and data vault.
Familiar with semantic modeling and BI tools like Power BI and Oracle Analytics Cloud.
Strong analytical and problem-solving skills with the ability to translate business strategy into actionable data and AI products.

Project-Specific Expertise

Data ingestion and transformation through AWS S3 (Landing, Bronze, Silver, Gold layers).
Data manipulation and transformation using Python and PySpark scripts.
Application-level data handling using PostgreSQL.
Focused on generating data extracts and variance analysis (no data science work involved).
Strong knowledge of AWS ecosystem and architecture.

Key Skills

Python, PySpark, PostgreSQL, MySQL, MongoDB, Cassandra, DynamoDB, AWS (S3, Glue, Lambda), Data Modeling, Medallion Architecture, Spark, SQL, BI Tools

Key Skills Required

ManufacturingOracleSQLMYSQLArchitecturePythonAWSPostgreSQLAWS GlueBusiness StrategyData EngineeringMongoDBLogisticsActionable DataAnalysisAnalyticsBig DataComputer ScienceComputingConsultingData HandlingData IngestionData ModelingData ScienceData TransformationDisciplineDistributed ComputingDynamoDBEcosystemEngineering SolutionsFocusedNoSQLOracle Analytics CloudPower BIProven Track RecordPysparkScienceSnowflake SchemaSPARKStar SchemaStrategyTransportationVariance Analysis

Job Overview

Job Function: IT/Computers - Software & Software Services

Job Type: Full Time

Workplace Type: Not Specified

Experience Level: Mid-Senior level

Salary: Competitive & Based on Experience

Experience: 5 - 6 yrs

Contact Information

Company Name: Weekday AI

Recruiting People: HR Department

Website: https://www.weekday.works

Location

Important Fraud Alert:
Beware of imposters. elsejob.com does not guarantee job offers or interviews in exchange for payment. Any requests for money under the guise of registration fees, refundable deposits, or similar claims are fraudulent. Please stay vigilant and report suspicious activity.