Collibra Data Lineage Automation Engineer Job at Alignity Solutions, Mc Lean, IL

Y0ZJenR0NVNyRzJIWUpDUTFJNnhRTkM0UHc9PQ==
  • Alignity Solutions
  • Mc Lean, IL

Job Description

Do you love a career where you Experience , Grow & Contribute at the same time, while earning at least 10% above the market? If so, we are excited to have bumped onto you.

Learn how we are redefining the   meaning of work , and be a part of the team raved by Clients, Job-seekers and Employees.

If you are a Collibra  Data Lineage Automation Engineer looking for excitement, challenge and stability in your work, then you would be glad to come across this page.

We are an IT Solutions Integrator/Consulting Firm helping our clients hire the right professional for an exciting long term project. Here are a few details.

Check if you are up for maximizing your earning/growth potential, leveraging our Disruptive Talent Solution.

Requirements

Position Title:  Collibra  Data Lineage Automation Engineer

Location: Onsite – 5 days/week in McLean, VA

Work Type: 1099 / C2C / W2

Work Authorization: U.S. Citizens, Green Card holders, H1B, H4 EAD

Requirements

We are seeking a highly experienced Collibra  Data Lineage Automation Engineer   to lead the design, implementation, and scaling of automated end-to-end data lineage solutions across a complex enterprise ecosystem. The ideal candidate will have deep expertise in lineage frameworks (e.g., Spline, OpenLineage) , a strong foundation in AI/ML-driven metadata intelligence , and proven experience delivering lineage automation in hybrid cloud and legacy environments .

This is a hands-on engineering role with significant influence on architecture, governance, and enterprise data strategy.

Key Responsibilities

  • Lead the implementation of automated lineage across diverse systems:

    • Cloud platforms (e.g., Snowflake, AWS )

    • Legacy RDBMS and ETLs (e.g., SQL Server, Oracle )

    • NoSQL databases (e.g., MongoDB)

    • BI/reporting tools (e.g., Tableau, Power BI)

  • Design and extend lineage capture frameworks ( Spline, OpenLineage, Marquez ) for enterprise-wide adoption.

  • Build custom connectors, extractors, and agents to capture lineage in systems not natively supported.

  • Integrate lineage with metadata/governance platforms ( Collibra, Alation ) to ensure usability and traceability.

  • Apply AI/ML techniques to infer lineage from logs, query patterns, or unstructured code (e.g., Java-based ETLs).

  • Develop reusable lineage components and promote automation-first, reusable design principles.

  • Collaborate with architecture, governance, and engineering teams to define lineage standards, storage models, and best practices .

Required Skills & Experience

  • Proven success implementing automated lineage solutions in hybrid environments (cloud + legacy).

  • Hands-on experience with Spline, OpenLineage, Marquez , or similar open-source lineage frameworks.

  • Deep knowledge of metadata capture, ETL tracing, and query execution mapping .

  • Strong AI/ML background , with experience in:

    • Metadata intelligence

    • NLP-based code parsing

    • Pattern detection in lineage gaps

  • Programming expertise in Python, Scala, or Java .

  • Strong SQL skills with hands-on exposure to logs/queries from Snowflake, SQL Server, Oracle, MongoDB , etc.

  • Experience integrating lineage into data governance platforms (e.g., Collibra, Alation).

Nice-to-Have / Big Plus Skills

  • Hands-on experience with commercial lineage tools (evaluation or implementation).

  • Background in regulated industries (finance, healthcare, insurance).

  • Familiarity with event-driven architectures for real-time lineage propagation.

  • Exposure to data mesh and domain-driven lineage approaches .

Ideal Candidate Profile

  • Has successfully delivered automated lineage at enterprise scale .

  • Operates at the intersection of data engineering, metadata management, and AI innovation .

  • Acts as a strategic thought partner to architects, governance leads, and business stakeholders.

  • Brings an automation-first, reusable component mindset to all lineage solutions.

Benefits

Visit us at  . Alignity Solutions is an Equal Opportunity Employer, M/F/V/D.

CEO Message:   Click Here

Clients Testimonial:   Click Here

Job Tags

Contract work, H1b,

Similar Jobs

Apple Inc.

SW User Experience Manual QE Job at Apple Inc.

 ...ll add something. Imagine what you could do here! The Software User Experience Quality Team specializes in simulating our customers...  ...customers expectations. We perform functional and user-centric testing on iOS and macOS, with a focus on the overall customer... 

Compass Group

DISHWASHER - Camp Randall Stadium & Kohl Center Arena Job at Compass Group

 ...Position Title: DISHWASHER - Camp Randall Stadium & Kohl Center Arena Pay Range : $17 to $19 From the stadium to the head table, Levy leverages unbridled creativity, custom strategies, impeccable service, and true love for great food to create unforgettable... 

Advanced Automation Corporation

Logistics Program Manager Job at Advanced Automation Corporation

 ...Position Summary: The Logistics Project Manager leads sustainment and logistics efforts for radar programs, depot operations, inventory control...  ...Qualifications: ~ Bachelor's degree in Logistics, Supply Chain Management, Engineering, Business, or a related field.... 

Leewood August Healthcare

Unit Manager -RN Job at Leewood August Healthcare

 ...Purpose of Your Job Position-Unit Manager The primary purpose of your position is to supervise...  ...not exclude them from the position if the work is similar, related or is an essential...  ...death of the resident. Call funeral homes when requested by the family. Staff Development... 

5TH HQ

Trabajadores de Almacen Job at 5TH HQ

 ...constante de actividad fsica. Ubicacin: Hialeah, FL Horarios Disponibles: Turno 1: 7:00 AM - 4:00 PM Salario: $14 por hora...  ...para preservar su frescura y calidad. Mantener el rea de trabajo limpia, organizada y en cumplimiento con las normas de seguridad...