NewFree base camp this Saturday: Agentic AI for Enterprise. Limited seats.

← All jobs

LTM

Senior Azure Data Engineer / AI Data Engineer

On-site5–10 yrsfulltime

Job Description – Senior Azure Data Engineer / AI Data Engineer Experience: 5–12 Years Job Location: Hyderabad, Bengaluru, Pune, Chennai, Coimbatore, Noida, Mumbai Work Mode: Hybrid Job Summary We are seeking an experienced Senior Azure Data Engineer / AI Data Engineer to design, develop, enhance, and maintain enterprise-scale data engineering solutions on Microsoft Azure. The ideal candidate will have strong expertise in SQL, PySpark, Azure Synapse Analytics, Azure Databricks, and Azure Data Lake technologies, with the ability to work independently throughout the software development lifecycle. Experience in Microsoft Fabric and workload migration is an added advantage. Key Responsibilities Design, develop, and enhance scalable data engineering solutions on Microsoft Azure. Build and optimize ETL/ELT pipelines using PySpark and SQL. Develop and maintain data solutions using Azure Synapse Analytics and Azure Databricks. Implement and manage Azure Data Lake storage solutions. Participate in migration of Azure-based workloads to Microsoft Fabric. Optimize SQL queries and PySpark jobs for performance and scalability. Develop notebooks and modernize data processing pipelines. Perform data validation, testing, deployment, monitoring, and production support. Collaborate with business stakeholders, architects, and cross-functional teams to understand requirements. Troubleshoot production issues and implement sustainable solutions. Take end-to-end ownership of development, testing, deployment, and support activities. Participate in design discussions, code reviews, and technical documentation. Communicate effectively with client stakeholders and work independently with minimal supervision. Mandatory Skills Strong SQL and PL/SQL programming skills. Hands-on expertise in PySpark. Experience with Azure Synapse Analytics and/or Azure Databricks. Strong understanding of Azure Cloud services. 5+ years of hands-on Data Engineering experience. Experience designing and implementing Data Lake solutions. Strong knowledge of ETL/ELT concepts and large-scale data processing. Excellent analytical, debugging, and problem-solving skills. Ability to independently manage development, testing, deployment, and support. Strong stakeholder communication and collaboration skills.

The role

What you'll do

  • Design, develop, and enhance scalable data engineering solutions on Microsoft Azure
  • Build and optimize ETL/ELT pipelines using PySpark and SQL
  • Develop and maintain data solutions using Azure Synapse Analytics and Azure Databricks
  • Implement and manage Azure Data Lake storage solutions
  • Participate in migration of Azure-based workloads to Microsoft Fabric
  • Optimize SQL queries and PySpark jobs for performance and scalability

You bring

Requirements

  • Strong SQL and PL/SQL programming skills
  • Hands-on expertise in PySpark.
  • Experience with Azure Synapse Analytics and/or Azure Databricks
  • Strong understanding of Azure Cloud services
  • 5+ years of hands-on Data Engineering experience
  • Experience designing and implementing Data Lake solutions
  • Strong knowledge of ETL/ELT concepts and large-scale data processing

Skills

Senior Azure Data EngineerAI Data EngineerAzure Cloud servicesETL/ELT conceptsStrong SQL and PL/SQL programmingPySparkMicrosoft FabricMicrosoft Azure