Data Engineer
Accenture Chennai
Project Role : Data Engineer
Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
Must have skills : IBM Db2, No Technology Specialty
Good to have skills : Payments Fundamentals
Minimum 5 year(s) of experience is required
As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes to migrate and deploy data across various systems.
Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
Must have skills : IBM Db2, No Technology Specialty
Good to have skills : Payments Fundamentals
Minimum 5 year(s) of experience is required
Educational Qualification : 15 years full time education
Summary: Hands-On Experience- Delivering data migration in banking environments, specifically within payments or similarly critical transaction systems
- Indexing, clustering, partitioning and archiving
- Query optimisation in high-volume environments
- Working with high-throughput systems where data extraction must be performed without impacting live processing
- Data mapping and lineage
- Extraction strategies from complex and congested tables
- Reconciliation and validation of migrated datasets
- ETL processes in controlled production environments
- No disruption to BAU payment processing
- Controlled handling of production risk
- Ability to work independently in ambiguous environments
- Proactive identification of issues
- Early and clear escalation of risks
As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes to migrate and deploy data across various systems.
You will collaborate with cross-functional teams to understand data requirements and provide innovative solutions that enhance data accessibility and usability.
Roles & Responsibilities:- Expected to be an SME.
- Collaborate and manage the team to perform.
- Responsible for team decisions.
- Engage with multiple teams and contribute on key decisions.
- Provide solutions to problems for their immediate team and across multiple teams.
- Mentor junior team members to enhance their skills and knowledge in data engineering.
- Must To Have Skills: Proficiency in IBM Db2.
- Good To Have Skills: Experience with Payments Fundamentals.
- Strong understanding of data modeling and database design principles.
- Experience with data integration tools and ETL processes.
- Familiarity with cloud-based data solutions and architectures.
- The candidate should have minimum 5 years of experience in IBM Db2.
- This position is based at our Chennai office.
- A 15 years full time education is required.
softview infotechChennai
Job Description
Role: Big Data Engineer
Experience: 4-8 Years
Location: Chennai, Bangalore
Key Skills: Big Data, Cloudera, Hadoop, Hive
About The Role
We are looking for a skilled Data Engineer with strong expertise in the Cloudera platform...
AccentureChennai
Project Role : Data Engineer
Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load...
GSSTech GroupChennai
We are seeking a highly skilled Senior Data Engineer to design, build, and maintain scalable data pipelines for enterprise-grade data platforms within the Risk & Compliance domain. The ideal candidate will have strong expertise in PySpark, Python...