Azure Data Engineer ( Azure Databricks)
Apex One Hyderabad
Job Description
Key Responsibilities- Design, develop, and optimize large-scale data pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse.
- Implement data lake solutions and work with structured and unstructured datasets in Azure Data Lake Storage (ADLS).
- Collaborate with data scientists, analysts, and engineering teams to design and deliver end-to-end data solutions.
- Develop ETL/ELT processes and integrate data from multiple sources.
- Monitor, debug, and optimize workflows for performance and cost-efficiency.
- Ensure data governance, quality, and security best practices are maintained.
- 4+ years of total experience in data engineering.
- 2+ years of experience with Azure Databricks (PySpark, Notebooks, Delta Lake).
- Strong experience with Azure Data Factory, Azure SQL, and ADLS.
- Proficient in writing SQL queries and Python/Scala scripting.
- Understanding of CI/CD pipelines and version control systems (e.g., Git).
- Solid grasp of data modeling and warehousing concepts.
AccentureHyderabad
Project Role : Data Engineer
Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load...
GenpactHyderabad
courage, and innovation, our teams implement data, technology, and AI to create tomorrow, today. Get to know us at genpact.com and on LinkedIn, X, YouTube, and FacebookInviting applications for the role of Consultant_ GCP Data Engineer
We are looking...
IQ-EQHyderabad
We have a fantastic opportunity for an experienced Data Engineer to join our global team in an Engineering Manager role. This role will play a major part in the delivery of our Group Data Strategy and Data Transformation Journey by delivering...