Senior DataOps / Cloud Data Engineer

Senior DataOps / Cloud Data Engineer
Assignment Number: A2928568
Client: Government Services Integration Cluster (GSIC), Government of Ontario
Ministry: Ministry of Public and Business Service Delivery and Procurement
Location: 595 Bay Street, Toronto, Ontario
Work Arrangement: 100% Onsite – 5 days per week
Contract Start Date: September 21, 2026
Contract End Date: October 1, 2027
Extension: One possible extension
Openings: 1
Submission Limit: One candidate only
Security Clearance: No clearance required
Position Overview
The Government Services Integration Cluster (GSIC) is seeking an experienced Senior DataOps / Cloud Data Engineer to design, develop, implement, and support enterprise-scale cloud data platforms and integration services. The successful candidate will build scalable data pipelines, optimize data processing, automate metadata management, and enable secure, reliable data exchange across cloud and enterprise environments.
The ideal candidate will bring hands-on expertise in Databricks, Delta Lake, Databricks SQL, Medallion Architecture, Azure Data Services, Azure Data Factory, and Informatica or equivalent integration platforms. Experience operationalizing common data models and metadata repositories is essential.
The resource will collaborate with architects, data modellers, governance teams, and technical stakeholders to deliver cloud data modernization, data quality, lineage, integration, and automation solutions.
Key Responsibilities

• Design, develop, implement, and maintain scalable end-to-end data pipelines from source systems to downstream consumers.
  
• Build and optimize ETL/ELT processes for batch and streaming data integration, ingestion, transformation, and provisioning.
  
• Implement cloud-native data engineering solutions using Databricks, Delta Lake, Databricks SQL, and Azure data services.
  
• Apply Medallion Architecture principles to organize, transform, validate, and manage enterprise data.
  
• Develop and maintain integration workflows using Azure Data Factory, Informatica, or equivalent enterprise integration platforms.
  
• Operationalize common data models and metadata repositories, ensuring consistent data definitions, standards, and integration across enterprise systems.
  
• Design and implement automated metadata collection, synchronization, lineage tracking, and data quality processes.
  
• Implement DataOps practices, including CI/CD, automated testing, deployment automation, monitoring, and operational support.
  
• Support cloud data platform implementation, configuration, performance tuning, scalability, and reliability.
  
• Develop and manage data lake, data lakehouse, data warehouse, and cloud storage solutions.
  
• Support large-scale data migration and modernization initiatives involving OLTP and OLAP environments and cloud SaaS, PaaS, and IaaS platforms.
  
• Develop data integration solutions using APIs, event-driven architectures, and batch or streaming technologies.
  
• Implement data governance, security, metadata management, and operational best practices.
  
• Support interoperability and data exchange between cloud platforms, enterprise applications, and on-premises systems.
  
• Collaborate with solution architects, data modellers, governance specialists, and business stakeholders to operationalize enterprise data standards.
  
• Troubleshoot complex data engineering and platform issues and deliver practical, scalable solutions.
  
• Document technical designs, data mappings, workflows, deployment processes, and operational procedures.
  
• Meet project milestones and deadlines while adapting to changing business and technical priorities.
  

Requirements

Mandatory Skills and Experience
Candidates must demonstrate hands-on experience in the following areas.
1. Databricks, Delta Lake and Databricks SQL

• Experience designing, developing, and supporting data engineering solutions using Databricks.
  
• Practical experience with Delta Lake for reliable data storage, transformation, and management.
  
• Experience using Databricks SQL for querying, processing, and working with enterprise data.
  
• Ability to develop and optimize scalable data pipelines within modern cloud data platforms.
  

2. Medallion Architecture

• Knowledge and practical application of Medallion Architecture for organizing data processing and storage.
  
• Understanding of layered data architecture, including Bronze, Silver, and Gold data layers.
  
• Ability to implement data ingestion, cleansing, transformation, validation, and curated data delivery processes.
  

3. Azure Data Services and Azure Data Factory

• Hands-on experience with Microsoft Azure Data Services and Azure Data Factory (ADF).
  
• Experience developing, orchestrating, monitoring, and maintaining data integration pipelines.
  
• Knowledge of cloud data storage, data movement, transformation, scheduling, and workflow automation.
  
• Experience integrating cloud data services with enterprise applications and data platforms.
  

4. Informatica or Equivalent Integration Platforms

• Experience with Informatica or an equivalent enterprise data integration platform.
  
• Ability to develop and maintain integration workflows for data ingestion, transformation, synchronization, and provisioning.
  
• Experience integrating heterogeneous data sources and supporting enterprise data exchange requirements.
  

5. Common Data Models and Metadata Repositories

• Experience operationalizing common data models and metadata repositories within enterprise data environments.
  
• Ability to implement and maintain standardized data definitions, metadata structures, and data mappings.
  
• Experience automating metadata collection, synchronization, and integration with data platforms and governance processes.
  
• Ability to collaborate with data architects, modellers, and governance teams to implement and maintain enterprise data standards.
  

6. Cloud Data Engineering and DataOps

• Demonstrated experience designing, implementing, and supporting cloud-based data platforms and services.
  
• Experience developing scalable ETL/ELT processes, data pipelines, and integration solutions.
  
• Experience implementing DataOps practices, including CI/CD, deployment automation, automated testing, monitoring, and operational support.
  
• Knowledge of cloud-native data engineering architectures, data security, governance, and operational best practices.
  
• Experience with data platform performance optimization, troubleshooting, and scalability.
  

7. Data Migration, Integration and Quality

• Experience supporting cloud modernization, data migration, and interoperability initiatives.
  
• Knowledge of structured, semi-structured, and unstructured data ingestion, processing, and provisioning.
  
• Experience implementing data quality, metadata, lineage, and data governance capabilities.
  
• Knowledge of API-based integration, event-driven architectures, and batch or streaming data processing.
  

8. Professional and Communication Skills

• Strong analytical, problem-solving, and decision-making abilities.
  
• Excellent written and verbal communication skills.
  
• Strong organizational and interpersonal skills.
  
• Ability to work collaboratively with multidisciplinary technical and business teams.
  
• Demonstrated ability to manage competing priorities, meet tight deadlines, and deliver high-quality solutions.
  

Desirable Skills and Experience
The following qualifications are considered assets:

• Previous experience working with the Ontario Public Service (OPS), other provincial governments, or public-sector organizations.
  
• Experience with Microsoft Purview for metadata management, data cataloguing, lineage, and governance.
  
• Experience with Microsoft Fabric and related Azure data services.
  
• Experience with Databricks Lakehouse solutions and advanced Delta Lake capabilities.
  
• Experience implementing enterprise data lakes, data lakehouses, and data warehouses.
  
• Experience with Informatica or other enterprise integration and data management platforms.
  
• Experience with graph technologies and semantic repositories.
  
• Experience operationalizing enterprise metadata repositories and common data models.
  
• Knowledge of the Accessibility for Ontarians with Disabilities Act (AODA) and related accessibility standards.
  
• Ability to adapt quickly to changing project requirements and delivery priorities.
  

Key Deliverables
The successful candidate will be responsible for delivering:

1. Data Pipelines and Integration Services: Scalable, reliable data ingestion, transformation, orchestration, and integration solutions.
   
2. Automated Metadata Management: Automated metadata collection, synchronization, and repository integration processes.
   
3. Cloud Data Platform Implementation: Configuration and implementation of cloud data services and modern data platform components.
   
4. Data Quality and Lineage: Capabilities supporting data validation, quality management, traceability, and lineage.
   
5. CI/CD and DataOps Automation: Automated deployment, testing, monitoring, and operational processes.
   
6. Data Migration and Interoperability: Services supporting cloud modernization, enterprise data migration, and cross-platform data exchange.
   
7. Cloud-Hosted Data Products: Reusable data services, curated datasets, and data products for enterprise consumption.
   
8. Metadata and Governance Integrations: Integration of metadata repositories, common data models, and governance platforms into operational data environments.
   

Ideal Candidate Profile
The ideal candidate is a senior-level cloud data engineering professional with strong hands-on implementation experience across Databricks, Delta Lake, Databricks SQL, Medallion Architecture, Azure Data Factory, and Informatica or equivalent integration technologies. The candidate must also demonstrate practical experience operationalizing common data models and metadata repositories.
Candidates with additional experience in Microsoft Purview, Microsoft Fabric, enterprise data governance, and Ontario public-sector projects will be particularly attractive.