Top

Data & Software Engineer

Chantilly, VA, USA

52 Days ago

Job Description


The Data & Software Engineer works with a small team to build complex data flows for a custom application. Successful candidate will have advanced Python programming skills, familiarity with Java, an understanding of data security, privacy, governance and compliance principles and a demonstrated history of building production data pipelines and ETL workflows at scale. Candidate must have experience:
  • Building?end-to-end data pipelines leveraging Python
  • Using orchestration tools to deploy data pipelines, including configuring and updating Spark Jobs
  • Containerizing?and deploying applications in cloud environments like AWS.
  • Working?with MySQL and PostgreSQL including performance tuning, schema design, and query optimization for complex, analytical workloads.?
  • Leveraging?industry standard tools for code control (Git, IaaC?control, etc.)
  • Working?with data catalogs, tracking data lineage ?and?handling a variety of data formats, including Geospatial.
  • Using?Bash scripting for automation and data processing tasks
  • Integrating?Al/ML services and models
Responsibilities:
  • Work?with stakeholders to understand data requirements, assess feasibility, and design appropriate solutions with minimal oversight
  • Leverage?strong problem-solving and debugging skills for data quality issues, pipeline failures, and performance bottlenecks
  • Leverage?a background in large-scale data migration or platform modernization efforts
  • Contribute to data engineering documentation, best practices, and design patterns.

Requirements Minimum of 5 years' experience with:?

  • Apache?Spark & PySpark
  • Advanced?Python skills (including Pandas & NumPy)
  • Docker, Podman
  • AWS?S3, Lambda & Step functions
  • Apache?Iceberg, Airflow, etc.
  • SQL?(with Trino)
  • NoSQL, DynamoDB
  • Unity?Catalog OSS, Apache Polaris
  • Apache?Superset
  • Terraform?or CloudFormation
  • OpenLineage
  • H3, PostGIS
Benefits Eligibility requirements apply.
  • Employer-Paid Health Care Plan (Medical, Dental & Vision)
  • Retirement Plan (401k, IRA) with a generous matching program
  • Life Insurance (Basic, Voluntary & AD&D)
  • Paid Time Off (Vacation, Sick & Public Holidays)
  • Short Term & Long Term Disability
  • Training & Development
  • Employee Assistance Program

Job Overview


Job Function: IT/Computers - Software & Software Services

Job Type: Full Time

Workplace Type: On-site

Experience Level: Not Specified

Salary: Competitive & Based on Experience

Experience: 0 - 0 yrs

Contact Information


Company Name: Avalore, LLC

Recruiting People: HR Department

Website: http://avalore.ai

Location

Important Alert:
Beware of people who promise you a job or interview in exchange for money. If someone asks you for money and says it's for something like a registration fee or a refundable deposit, it could be a scam. Please be cautious. Remember, elsejob.com does not guarantee a job or interview in exchange for money, so don't give money to anyone like that.

Similar Jobs

Front End Software Engineer (Angular) - TS/SCI w/ Poly

Leading Path Consulting • Chantilly, VA, USA

Experience: 8 - 10 yrs

Salary: Competitive & Based on Experience

View Job
Cleared Software Engineer - Data Focused (backend) - TS/SCI w/Poly required

Leading Path Consulting • Chantilly, VA, USA

Experience: 10 - 15 yrs

Salary: Competitive & Based on Experience

View Job
TS/SCI w/Poly (Front-End Angular, CSS/HTML, JavaScript) Software Engineer

Leading Path Consulting • Chantilly, VA, USA

Experience: 8 - 10 yrs

Salary: Competitive & Based on Experience

View Job
Data Visualization - Active TS/SCI

ENS Solutions, LLC • Chantilly, VA, USA

Experience: 10 - 11 yrs

Salary: Competitive & Based on Experience

View Job
Software Engineer (with Systems Admin responsibilities) - TS/SCI w/ Poly

Leading Path Consulting • Chantilly, VA, USA

Salary: Competitive & Based on Experience

View Job
Software Architect/Engineer

Trinity Global Consulting • Chantilly, VA, USA

Salary: Competitive & Based on Experience

View Job
Automated Test Engineer

Trinity Global Consulting • Chantilly, VA, USA

Experience: 4 - 8 yrs

Salary: Competitive & Based on Experience

View Job
Senior Full Stack Developer

Northstrat • Chantilly, VA, USA

Experience: 5 - 6 yrs

Salary: Competitive & Based on Experience

View Job
Deployment Engineer

Trinity Global Consulting • Chantilly, VA, USA

Experience: 2 - 4 yrs

Salary: Competitive & Based on Experience

View Job
Information Technology Manager

XMSTART • Chantilly, VA, USA

Salary: Competitive & Based on Experience

View Job