Must Have Skills: GCP big query , Kubernetes/GKE with SQL Knowledge

Nice to Have Skills:

GCP Certified

Detailed Job Description:

Good communication skills with knowledge on SQL, GCP big query , Kubernetes/GKE

•Strong understanding of SDLC process.

•Should have Strong understanding and trouble shooting skills

Core requirements:

Must have strong experience in building, enhancing, and maintaining data pipeline frameworks supporting batch, streaming, and near‑real‑time processing.

Must be able to design reusable data engineering frameworks, accelerators, and templates to standardize ingestion, transformation, orchestration, and data quality controls.

Must have hands-on experience with GCP data services such as BigQuery, Kubernetes/GKE ,Cloud Dataflow, Dataproc, Pub/Sub, and Cloud Storage.

Must demonstrate proficiency in ETL/ELT development, SQL-based transformations, and distributed data processing.

Must implement production-grade pipelines with appropriate error handling, logging, monitoring, and performance optimization.

Competências necessárias

Google Cloud BigQueryKubernetes / GKESQL (SQL-based transformations)Cloud DataflowDataprocPub/SubCloud StorageData pipeline development (batch, streaming, near-real-time)Design of reusable data engineering frameworks, accelerators, and templatesETL/ELT developmentDistributed data processingProduction-grade pipeline reliability: error handling, logging, monitoring, performance optimizationTroubleshooting and debugging of data systemsSoftware Development Life Cycle (SDLC) knowledgeCommunication and stakeholder collaboration

Vagas similares