Senior Data Engineer

About PrePass

PrePass® is North America's most trusted weigh station bypass and toll management platform. We're transforming how the transportation industry operatescreating solutions that keep trucks moving safely, efficiently, and compliantly. This means making bold decisions and building systems that support not only fleets but the broader economy. It all starts with enabling commercial vehicles to keep rolling with seamless toll management, weigh station bypass, and safety solutions. It's what we do best, and we do it to meet the demands of the road every day.

That's why people join us: our solutions are implemented in real-time, on highways and interstates across the nation, helping fleets go farther, faster. This work challenges and rewards, presenting complex problems that need ambitious answers. We hire bold thinkers with a heart for impact, a passion for progress, and the optimism to shape the future of transportation.

Position Description

As a Senior Data Engineer, you will be responsible for designing and developing pipelines for data ingestion, processing, and distribution. Our solutions range from batch processing to real-time data streaming. You will be challenged with identifying innovative solutions to meet the needs of our growing business. The ideal candidate has a deep understanding of data engineering, particularly in building scalable and efficient data infrastructures on cloud environments. We are looking for someone who enjoys working in a fast-paced environment, who can take on complex challenges, and produce impactful solutions.

Key Responsibilities

• Develop and manage production ETL pipelines on the Azure cloud.
• Formulate complex SQL queries for transforming and collating data across multiple sources.
• Code data transformations and processing logic in Databricks.
• Troubleshoot data integration and data quality issues, diagnose failures, implement optimal solutions, and revise procedures.
• Tune and optimize cluster performance for cost, efficiency, scalability, and resource utilization.
• Partner with team to design and implement a strategy for re-architecting legacy SQL Server Integration Services [SSIS].
• Develop comprehensive solutions for traceability and observability.
• Contribute to documentation and maintain architecture diagrams.
• Participate in proof-of-concept exercises and prototyping. Provide analysis and recommendations based on your findings.
• Mentor and guide junior engineers, encourage a culture of learning.

Requirements

Required

• Bachelor's degree in computer science or equivalent experience.
• Typically, 6+ years of industry experience in data engineering.
• At least 3 years of experience providing technical leadership on large projects.
• Experience using Databricks for data engineering tasks.
• Expert in writing, analyzing, and tuning complex SQL queries.
• Advanced experience with design and data modeling.
• Programming proficiency in Python.
• Familiarity with big data technologies and frameworks such as Apache Spark and Delta Lake.
• Committed to delivering on value-added innovation. Eager to learn and experiment with new technology.

Preferred

• Experience with stream-processing systems like Apache Spark and Kafka.
• Familiarity of event driven architecturequeues, batches, and pub/sub models.
• Proficiency with reporting and data visualization tools, specifically PowerBI.
• Familiarity with data quality and governance principles and best practices.
• Versed in software engineering practices, version control, code reviews, unit testing, and CI/CD.

Benefits

How We Will Take Care of You

• Robust benefit package that includes medical, dental, and vision that start on date of hire.
• Paid Time Off, to include vacation, sick, holidays, and floating holidays.
• 401(k) plan with employer match.
• Company-funded "lifestyle account" upon date of hire for you to apply toward your physical and mental well-being (i.e., ski passes, retreats, gym memberships).
• Tuition Reimbursement Program.
• Voluntary benefits, to include but not limited to Legal and Pet Discounts.
• Employee Assistance Program (available at no cost to you).
• Company-sponsored and funded "Culture Team" that focuses on the Physical, Mental, and Professional well-being of employees.
• Community Give-Back initiatives.
• Culture that focuses on employee development initiatives.

Qualification

Bachelor's Degree