Job Description:

Must Have Skills:

Strong hands‑on experience with Azure Data Lake Gen2, Synapse, Databricks

Solid experience in PySpark / Spark SQL, Databricks performance tuning & job optimization

Proficient in Complex SQL (window functions, CTEs, execution plans)

Strong understanding in Mentoring junior and mid‑level engineers, Communicating trade‑offs to architects and product teams

Experience working with Azure DevOps or GitHub Actions

Nice to Have Skills:

Experience with Streaming & Real‑Time Data Processing on Designing low‑latency pipelines.

Exposure to Data Governance & Metadata Management in Data classification & sensitivity labels

Familiarity with Advanced Python Engineering Practices on Performance‑aware Python design

Experience working in Analytics & BI Awareness

Knowledge of Cloud Cost Optimization & FinOps

Detailed Job Description

The Senior Data Engineer will be responsible for designing, building, and operating scalable, secure, and high‑performance data platforms. The role involves critical data pipelines and architectures that power analytics, reporting, and advanced data use cases such as machine learning and real‑time insights.

The candidate will collaborate closely with analytics, data science, product, and business teams while mentoring engineers and driving engineering best practices across the data organization.

The role combines technical leadership, architecture ownership, and business impact.

المهارات المطلوبة

Azure Data Lake Gen2Azure Synapse AnalyticsPySparkSpark SQLDatabricks performance tuning and job optimizationComplex SQL (window functions, CTEs, execution plans)Mentoring and team leadershipCross-functional communication (communicating trade-offs to architects and product teams)Azure DevOps or GitHub Actions (CI/CD)Streaming and real-time data processing (low-latency pipeline design)Data governance and metadata management (data classification and sensitivity labels)Performance-aware Python engineeringAnalytics and BI awarenessCloud cost optimization and FinOpsData platform architecture and architecture ownership

وظائف مشابهة