NewFree base camp this Saturday: Agentic AI for Enterprise. Limited seats.

← All jobs

Capgemini Technology Services India Limited

GCP Data Engineer

Hybrid · 50% office · Hyderabad6–8 yrsfulltime

GCP Data Engineer Experience: 6 to 8 Years Location: Hyderabad / PAN India Employment Type: Full-Time Job Summary We are looking for an experienced GCP Data Engineer with strong hands-on expertise in Python, PySpark, SQL, GCP, and BigQuery. The candidate will be responsible for designing, developing, optimizing, and supporting scalable batch and real-time data pipelines, data migration, and cloud data engineering solutions. Required Skills & Experience 5+ years of hands-on experience in Python and Data Engineering. 5+ years of hands-on experience with GCP BigQuery. Strong proficiency in Python, PySpark, Apache Spark, SQL, and Linux. Strong experience in designing and developing end-to-end scalable ETL/ELT data pipelines. Hands-on experience with GCP services, including: BigQuery GCS (Cloud Storage) Pub/Sub Dataflow / Apache Beam Cloud Composer / Apache Airflow Dataproc Cloud Functions Cloud Run Cloud Logging & Monitoring Strong expertise in BigQuery data modeling, SQL, Stored Procedures, partitioning, clustering, performance tuning, and optimization. Experience building batch and real-time data processing pipelines. Experience with real-time streaming using Kafka, Pub/Sub, and Dataflow. Experience with batch ingestion from SQL Server, relational databases, MongoDB, APIs, and enterprise data sources. Experience working with CSV, JSON, Parquet, Avro, and XML file formats. Experience migrating data and pipelines from SQL Server to GCP BigQuery. Strong experience with Apache Airflow / Cloud Composer and DAG development. Hands-on experience with Git, CI/CD pipelines, automated deployments, release management, and DevOps practices. Experience in data modeling, data quality, data governance, metadata, and data lineage. Experience with testing, debugging, monitoring, troubleshooting, and production support of data pipelines. Experience with Vertex AI and Feature Store is preferred. Strong knowledge of Apache Spark/PySpark; Apache Beam experience is an advantage. Experience working in Agile/Scrum environments. Good to Have Google Professional Data Engineer Certification. Experience with cloud migration and modernization projects. Experience with GitHub Copilot. Strong understanding of data warehousing concepts, including Star Schema, Snowflake Schema, and SCDs. Key Competencies Strong problem-solving and analytical skills. Excellent verbal and written communication. Ability to work directly with clients and stakeholders. Strong ownership and accountability. Ability to identify risks and recommend scalable, innovative solutions.

The role

What you'll do

  • Strong expertise in BigQuery data modeling, SQL, Stored Procedures, partitioning, clustering, performance tuning, and optimization. Experience building batch and real-time data processing pipelines. Experience with real-time streaming using Kafka, Pub/Sub, and Dataflow. Experience with batch ingestion from SQL Server, relational databases, MongoDB, APIs, and enterprise data sources.

You bring

Requirements

  • BigQuery GCS (Cloud Storage) Pub/Sub Dataflow / Apache Beam Cloud Composer / Apache Airflow Dataproc Cloud Functions Cloud Run Cloud Logging & Monitoring

Skills

GCPPythonBigQueryPysparkData EngineeringSQLclustering