Senior Data Engineer

Job Title: Senior Data Engineer - Data Integrations

About Oblivious

We live in the era of data and AI, but the most impactful data resides behind closed doors and red tape. Using it, which many do, risks undermining the privacy and confidentiality of users, customers, patients... the real people who put trust in businesses and organisations.

At Oblivious, we are driven by a singular mission: to harness the power of artificial intelligence while safeguarding individual privacy and data security. Our cutting-edge technology enables businesses to unlock the full potential of data without compromising on ethical considerations.

As part of our commitment to delivering seamless and secure solutions, we are seeking a Senior Data Engineer to focus on building out our data integrations with third-party DBMS and data products. This is a key role that will directly contribute to enhancing the scalability and robustness of our data frameworks.

About The Role

As a Data Engineer specializing in data integrations, you will be responsible for designing, implementing, and maintaining scalable systems that integrate with various third-party DBMS and data products. Your primary focus will be on managing authentication flows, ensuring data type consistency, and creating a robust framework for managing integrations at scale. The majority of your work will be done in Python, leveraging its ecosystem to build efficient and maintainable solutions.

Requirements

• Design and develop data integrations with third-party DBMS and data products.
• Build and manage robust m2m authentication flows for secure connections.
• Ensure consistent and clean data types across integrations to maintain data integrity.
• Develop a scalable framework to manage multiple data integrations efficiently.
• Collaborate with other teams to identify integration requirements and deliver tailored solutions.
• Write clean, maintainable, and well-documented Python code.
• Monitor and optimize the performance of data integration systems.
• Troubleshoot and resolve issues with data pipelines and integrations.
• Stay up-to-date with industry best practices and emerging technologies in data engineering and integration.

Benefits

• Bachelor's degree in Computer Science, Data Engineering, or a related field. Advanced degrees are a plus.
• Proven experience in data engineering with a focus on integrations and pipelines.
• Strong expertise in Python and its libraries/frameworks for data engineering (e.g., pandas, SQLAlchemy, etc.).
• Experience with m2m authentication flows and secure connection protocols.
• Familiarity with various DBMS and data products, with the ability to integrate seamlessly.
• Strong problem-solving and debugging skills.
• Excellent written and verbal communication skills, with the ability to convey technical concepts clearly.
• A proactive mindset and the ability to work both independently and collaboratively.

Qualification

Bachelor's Degree