DataOps/Cloud Data Engineer - Senior

DataOps/Cloud Data Engineer - Senior
Onsite - Toronto ON

Mandatory Skills and Experience (8+ years experience):

• Design, build, automate and optimize complex data ETL/ELT processes using Databricks, Delta Live Tables (DLT) and equivalent.
  
• Development of unified data platforms using Databricks and Unity catalog or its equivalent.
  
• Relational databases (Oracle, MySQL, SQL Server), data modelling (relational & dimensional), advanced SQL, query optimization, data replication, administration.
  
• Advanced SQL skills (PL/SQL, TSQL).
  
• Big Data processing Frameworks (PySpark).
  
• Proficient in creating Azure Data Factory pipelines for copy activity and custom data pipelines in Databricks with CI CD (Azure DevOPS Git Integration) .
  
• Data migration and data integration across different platforms Oracle to Azure Data Lake, Oracle to Databricks, Oracle to Microsoft Fabric.
  

Desirable Skills and Experience:

• Data lake design and development with focus on extracting, transforming data coming from various data sources and loading into Lakehouse in medallion architecture.
  
• Advanced skills and hands-on experience with Oracle databases, Azure SQL Server and Azure Data Factory.
  
• Cloud technologies (Azure, Google, AWS).
  
• PL/SQL for data extraction, transformation, and loading, initial setup and other ETL experience management and support, such as troubleshooting, performance tuning, failover and recovery.
  
• Scripting languages (Python, Unix shell, Scala).