Data Engineer
Accenture Bangalore
Project Role : Data Engineer
Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
Must have skills : Machine Learning (ML)
Good to have skills : NA
Minimum 5 year(s) of experience is required
As a Data Engineer, a typical day involves designing, developing, and maintaining comprehensive data solutions that support the generation, collection, and processing of data. This role requires creating efficient data pipelines and ensuring the integrity and quality of data throughout its lifecycle.
Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
Must have skills : Machine Learning (ML)
Good to have skills : NA
Minimum 5 year(s) of experience is required
Educational Qualification : 15 years full time education
Summary:As a Data Engineer, a typical day involves designing, developing, and maintaining comprehensive data solutions that support the generation, collection, and processing of data. This role requires creating efficient data pipelines and ensuring the integrity and quality of data throughout its lifecycle.
The position also involves implementing processes to extract, transform, and load data, facilitating seamless migration and deployment across various systems. Collaboration with different teams to optimize data workflows and troubleshoot any issues is a key part of daily activities, ensuring that data infrastructure supports organizational needs effectively and reliably.
Roles & Responsibilities:- Expected to be an SME, collaborate and manage the team to perform.
- Responsible for team decisions.
- Engage with multiple teams and contribute on key decisions.
- Provide solutions to problems for their immediate team and across multiple teams.
- Lead the design and implementation of scalable data architectures to support business objectives.
- Mentor junior team members to enhance their technical skills and professional growth.
- Coordinate cross-functional efforts to align data engineering initiatives with organizational goals.
- Architect modular, goal-driven agents with planning, memory, tool use, and context-aware reasoning using LangChain, LangGraph, CrewAI, AutoGen, or Semantic Kernel.
- Develop and optimize RAG pipelines — chunking strategies, hybrid retrieval, re-ranking, and grounding — on vector stores (Pinecone, Weaviate, Chroma, FAISS).
- Integrate LLM APIs from OpenAI, Anthropic Claude, and Google Gemini implement function calling, MCP tool integrations, and multi-step orchestration.
- Apply advanced prompt engineering build evaluation harnesses (RAGAS, DeepEval, Phoenix) to measure faithfulness, relevance, and hallucination rate.
- Collaborate with architects, product managers, and backend engineers to deliver scalable, secure, and observable AI services on AWS / GCP / Azure.
- Contribute to code reviews, LLMOps practices, and continuous learning on emerging agentic-AI research.
- Must To Have Skills: Proficiency in Machine Learning (ML).
- Strong experience in building and optimizing data pipelines and ETL processes.
- Knowledge of data storage solutions and database management systems.
- Ability to work with large datasets and ensure data quality and consistency.
- Familiarity with cloud platforms and distributed computing frameworks.
- Experience in troubleshooting and resolving data-related issues efficiently.
- Must-have skills: AI/LLM-based systems (agents, RAG, orchestration), AI platforms (OpenAI, Claude, Gemini, Azure OpenAI), LangChain / LangGraph / CrewAI, vector databases, Python, prompt engineering, evaluation frameworks, cloud deployment.
- The candidate should have minimum 5 years of experience in Machine Learning (ML).
- This position is based at our Bengaluru office.
- A 15 years full time education is required.
Happiest Minds TechnologiesBangalore
Job Description
Location : Manyata Tech Park, Bangalore
Data Engineer (5 - 8 years).
-- JD --
• Min.5 years of exp. in Data Engineering, Data Lake, Data Mesh, Data Warehousing/ETL
• Min.5 years of exp. working on project(s) involving...
AccentureBangalore
Project Role : Data Engineer
Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load...
AmazonBangalore
Amazon is a place where data drives most of our decision-making. Alexa Enterprise team is looking for a dynamic data engineer who can be innovative, a strong problem solver and can lead the implementation of the analytical data infrastructure...