Data Engineer

Talworx is an emerging recruitment consulting and services firm , we are hiring for our FintechProductbased client, In this role, you will be working with a team or teams of enthusiastic members supporting our critical technology systems and guiding our business partners & end users with industry best practices, solution design, and creating long term value to our customers.

About the Role:

The Team:

As a member of the Data Transformation team you will work on building ML powered products and capabilities to power natural language understanding, data extraction, information retrieval and data sourcing solutions for Intelligence and our clients. You will spearhead development of production-ready AI products and pipelines while leading-by-example in a highly engaging work environment. You will work in a (truly) global team and encouraged for thoughtful risk-taking and self-initiative.

Key Responsibilities

• Build production ready data acquisition and transformation pipelines from ideation to deployment
• Being a hands-on problem solver and developer helping to extend and manage the data platforms
• Apply best practices in data modeling and building ETL pipelines (streaming and batch) using cloud-native solutions

What We're Looking For:

• 5-7 years of professional software work experience
• Expertise in Python and Apache Spark
• OOP Design patterns, Test-Driven Development and Enterprise System design
• SQL (any variant, bonus if this is a big data variant)
• Linux OS (e.g. bash toolset and other utilities)
• Version control system experience with Git, GitHub, or Azure DevOps.
• Problem-solving and debugging skills
• Software craftsmanship, adherence to Agile principles and taking pride in writing good code
• Techniques to communicate change to non-technical people

Nice to have

• Core Java 17+, preferably Java 21+, and associated toolchain
• DevOps with a keen interest in automation
• Apache Avro
• Apache Kafka
• Kubernetes
• Cloud expertise (AWS and GCP preferably)
• Other JVM based languages - e.g. Kotlin, Scala
• C# - in particular .NET Core

Qualification

Bachelor's Degree