Retour aux offres
ScovaiScovaiJobs
AS

Abidi Solutions

AWS Senior ETL Data Engineer

Torrance, USSur siteCDITemps plein

Publié 20 nov. 2026

Cet emploi est publié en EN

AWS Senior ETL Data Engineer

Location: Torrance, CA (Onsite 4 Days per Week)

Contract Duration: 3 Months
Pay Rate: $60/hour (W2 Only)
Employment Type: Contract


Job Overview

We are seeking an experienced Senior AWS ETL Data Engineer with strong hands-on expertise in AWS data engineering, ETL/ELT development, data warehousing, and large-scale data processing.

The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring data quality, reliability, performance, security, and cost efficiency. This role requires extensive experience with AWS services, Python, PySpark, Apache Spark, and modern data integration technologies.

Key Responsibilities

  • Design, develop, and maintain scalable ETL/ELT data pipelines using AWS Glue, EMR, MWAA/Airflow, Lambda, and Redshift.

  • Build and optimize data integration workflows to efficiently extract, transform, and load data into target systems.

  • Utilize Python, PySpark, and Apache Spark to process and transform large datasets.

  • Implement data validation, cleansing, monitoring, and error-handling mechanisms to maintain data quality and integrity.

  • Optimize data pipelines for performance, scalability, reliability, and cost efficiency.

  • Identify and resolve performance bottlenecks, fine-tune SQL queries, and optimize Amazon Redshift workloads.

  • Implement CI/CD pipelines and DevOps practices for automated data pipeline development, deployment, and releases.

  • Manage AWS IAM roles, policies, access controls, and Lake Formation permissions to ensure data security and governance.

  • Integrate data from multiple sources using AWS and Informatica IDMC/Informatica Cloud.

  • Translate business requirements into technical specifications and production-ready data pipelines.

  • Collaborate with data analysts, business stakeholders, and engineering teams to support business intelligence and analytics initiatives.

  • Maintain technical documentation and ensure compliance with data governance, security, and regulatory requirements.

  • Explore and implement Generative AI and Agentic AI use cases within data engineering workflows.



Requirements

Required Qualifications

  • Minimum 7 years of experience in data engineering, database design, ETL processes, and data warehousing.

  • Minimum 5 years of hands-on experience with AWS services and technologies, including:

    • Amazon S3

    • AWS Glue

    • Amazon EMR

    • Amazon Athena

    • Amazon Redshift

    • Amazon RDS

    • Redshift Spectrum

    • Apache Airflow / AWS MWAA

  • Minimum 5 years of programming experience with Python, PySpark, and/or Scala.

  • Minimum 2 years of experience with CI/CD tools and DevOps practices for automated builds, deployments, and releases.

  • Minimum 2 years of hands-on experience with AWS IAM and AWS Lake Formation, including roles, policies, access controls, and data lake security.

  • Strong understanding of data storage, data lakes, distributed computing, and processing frameworks such as Hadoop and Apache Spark.

  • Experience with Informatica IDMC / Informatica Cloud.

Preferred Qualifications

  • Experience implementing Agentic AI or Generative AI use cases in data engineering.

  • Strong understanding of cloud-based data architecture and modern data warehousing solutions.

  • Experience optimizing large-scale data processing workloads.

  • Knowledge of data governance, security, and compliance best practices.

Core Technical Skills

  • Cloud Platform: AWS

  • ETL/ELT: AWS Glue, Informatica IDMC

  • Data Warehousing: Amazon Redshift, Redshift Spectrum

  • Programming: Python, PySpark, Scala

  • Big Data: Apache Spark, Hadoop, Amazon EMR

  • Data Storage: Amazon S3, Amazon RDS

  • Query Services: Amazon Athena

  • Workflow Orchestration: Apache Airflow, AWS MWAA

  • Security & Governance: AWS IAM, AWS Lake Formation

  • DevOps: CI/CD, automated deployment and release management

  • Emerging Technologies: Generative AI, Agentic AI

Work Arrangement

  • Onsite 4 days per week in Torrance, California.

  • Initial contract duration of 3 months.

  • W2 employment only.



Aperçu du poste

Type de poste

Temps plein

Compétences requises

AWS GlueAmazon EMRAmazon RedshiftApache Airflow / AWS MWAAPythonPySparkApache SparkETL/ELT Pipeline EngineeringData WarehousingCI/CD and DevOps for Data PipelinesAWS IAMAWS Lake FormationInformatica IDMC / Informatica CloudData Quality and ValidationLarge-Scale Distributed Data Processing

Emplois similaires

Farmers Insurance District 24/59

Licensed P&C Insurance Agent

Farmers Insurance District 24/59

Torrance, USSur siteCDITemps plein70 000 $US – 150 000 $US / an
le mois dernier
Pioneer Electrocables P Ltd

Area Sales Officer

Pioneer Electrocables P Ltd

Kathmandu, NPSur siteCDITemps plein
il y a 7 heures
TH

Director of Fundraising & Strategic Partnerships

The HR Source

Columbia, USSur siteCDITemps plein
hier
AS

Software Engineer – Full Stack / Generalist

Abidi Solutions

Raleigh, USSur siteCDITemps plein
hier
AS

Enterprise Data Architect – Architect L2

Abidi Solutions

Raymond, USSur siteCDITemps plein
hier
AS

Systems Administrator III

Abidi Solutions

Bellville, USSur siteCDITemps plein
hier