SENIOR MANAGER – DATA ENGINEERING

Summary
We are seeking a seasoned Senior Manager to lead our Data Engineering initiatives within the IT Services sector. This pivotal role is responsible for architecting and overseeing robust data infrastructure, ensuring the seamless flow of information through advanced pipelines while maintaining rigorous data governance and quality standards. The successful candidate will drive innovation by integrating cutting-edge technologies such as vector databases, large language models, and knowledge graphs, thereby enabling scalable solutions that support critical business intelligence and artificial intelligence applications.

Responsibilities

• Design and implement comprehensive data governance frameworks to ensure high data quality, integrity, and compliance across the organization.
  
• Architect and optimize complex ETL and ELT pipelines to facilitate efficient data movement and transformation.
  
• Develop and maintain semantic web standards using SHACL and ShEx to validate data structures and relationships.
  
• Build and manage scalable APIs and microservices to support data accessibility and interoperability.
  
• Leverage vector databases and LLM/RAG technologies to enhance data retrieval and enable advanced AI-driven insights.
  
• Construct and manage knowledge graphs using tools like Neo4j to model complex relationships and domain-specific data.
  
• Lead the design of graph data models and schemas to support flexible and efficient data storage solutions.
  
• Utilize Python frameworks to develop custom data processing tools and automate engineering workflows.
  

Requirements

Requirements:

• Possess over a decade of professional experience in data engineering and related technical domains.
  
• Demonstrate deep expertise in data governance principles and data quality management strategies.
  
• Proven track record of designing and deploying high-performance ETL/ELT pipelines.
  
• Proficiency in implementing SHACL and ShEx standards for data validation.
  
• Strong background in developing APIs and microservices architectures.
  
• Hands-on experience with vector databases and integrating LLM/RAG solutions.
  
• Advanced skills in working with knowledge graphs, specifically Neo4j.
  
• Extensive programming knowledge of Python frameworks.
  
• Expertise in graph data modeling and schema design.
  
• Competitive salary range of ₹18-20 LPA.