Job Title:
Data Catalog Engineer: In this role you will work closely with senior technical leadership to implement and maintain metadata management solutions build scalable pipelines and ensure seamless integration of data sources into our Informatica CDGC platform. This is a handson role where you will contribute to the foundation of our data governance and quality framework.
Key Responsibilities:
Build Pipelines: Design develop and maintain data pipelines to integrate various data sources into the metadata catalog.
Scan Data Sources: Configure and execute scanning processes for structured semistructured and unstructured data sources using Informatica CDGC and related tools.
Metadata Management: Assist in the creation and maintenance of metadata repositories ensuring consistency and completeness.
Data Dictionaries: Develop and manage comprehensive data dictionaries promoting transparency and standardized definitions across the organization.
Support Lineage Efforts: Collaborate with team members to map data flows and establish clear reliable lineage for critical data assets.
Performance Optimization: Monitor pipeline performance troubleshoot issues and implement enhancements to improve efficiency and scalability.
Collaboration: Work closely with data engineers data scientists and business stakeholders to understand their needs and align metadata solutions with organizational goals.
Documentation: Maintain thorough documentation for pipelines metadata processes and lineage workflows ensuring accessibility for team members and stakeholders. Required Skills and Experience:
Technical Expertise:
o Proficiency in building and managing ETL/ELT pipelines using tools like Informatica AWS Glue Talend Apache NiFi or similar platforms.
o Experience with Informatica CDGC or similar metadata management tools.
o Familiarity with SQL and at least one programming or scripting language (e.g. Python Java).
Data Integration Knowledge:
o Strong understanding of data source scanning techniques for databases files APIs and cloudbased storage.
o Experience in data governance concepts including metadata lineage and data quality.
ProblemSolving Skills:
Ability to troubleshoot and resolve pipeline and integration issues quickly and effectively.
Collaboration: Experience working in crossfunctional teams with excellent communication and stakeholder management skills.
Preferred Qualifications:
Familiarity with Informatica Axon EDC or similar tools.
Exposure to cloudbased data platforms (e.g. AWS Glue Azure Data Factory Google Data Catalog).
Understanding of CI/CD practices for data pipeline development. Knowledge of AIdriven recommendations in metadata management or data quality.
Required Skills : About the Role: Were looking for a Technical Lead to take charge of implementing advanced data governance metadata management and quality initiatives using Informatica CDGC. This is a handson role where you will be a technical leader shaping the foundation for scalable and intelligent data systems.
...About the job Data Entry - Work From Home 100% Remote Company Remote Career Location Nevada Work Type Part Time Classification Human Resource Clerks Required Skills Strong people skills Excellent phone manner Be passionate about growing a...
...visa, walmart lab s etc to name a few. Currently, We are looking for entry-level software programmers, Java Full stack developers, Python/Java developers, Data analysts/ Data Scientists, Machine Learning engineers for full time positions with clients....
...qualifying jurisdictions) Hiring immediately for full-time or part-time hourly restaurant dine-in food and beverage Servers, Waitresses or Waiters. Job Summary: The dine-in food and beverage Servers, Waitress or Waiters are core team members of the scratch...
...Job Announcement: Experienced House Cleaning Contractor (Part-time to Full-time) Pay starting at $35!!! Are you an experienced cleaner with your own supplies, looking for flexible part-time to full-time work? We are a job referral company seeking motivated and detail...
...for all. To learn more visit Welcome to Wellington Regional Medical Center | Wellington, FL Job Requirements: The surgical technician functions as a cooperative team member in the Surgical Services department by demonstrating the ability to provide constant...