Pyspark Data Engineer
Hybrid · 50% office · Bengaluru, Hyderabad6–8 yrsfulltime
PySpark Data Engineer Experience: 6 to 8 Years Location: Bangalore /Hyderabad Employment Type: Full-Time Job Summary 5+ years of experience. Google Cloud Platform (GCP): Strong experience designing, implementing, and optimizing solutions using GCP services. Python: Advanced proficiency in Python for application development, automation, and scripting. Strong proficiency in Pyspark, SQL, Linux
The role
What you'll do
- Strong expertise in BigQuery data modeling, SQL, Stored Procedures, partitioning, clustering, performance tuning, and optimization. Experience building batch and real-time data processing pipelines. Experience with real-time streaming using Kafka, Pub/Sub, and Dataflow. Experience with batch ingestion from SQL Server, relational databases, MongoDB, APIs, and enterprise data sources.
You bring
Requirements
- Google Cloud Platform, Python: Advanced proficiency in Python for application development, automation, and scripting. Strong proficiency in Pyspark, SQL, Linux
Skills
GCPPythonPysparkData EngineeringSQL