Lead Data Engineer

 Bangalore - India       Permanent contract        Information Technology


Responsible for understanding the software requirements and developing it into a working source code accordingly.

Profile Required

  • Job Duties

    ·         The role has responsibility to use Informatica BDM/BDQ development platform to profile data, create and execute data quality rules,

    ·         Understand, design and implement data model for data quality metrics

    ·         This role will work closely with big data engineers, product owners, data modelers, business analysts and data governance team to develop appropriate data quality solution architecture and BDM, BDQ development practices

    ·         Communicate with the team to fully understand requirements, provide feedback, and request clarification as needed

    ·         Participating in process and functional design activities, carrying out application design, build, test, and deploy activities

    ·         Create, modify and maintain BDM/BDQ code in GitHub

    ·         Develop test cases for unit testing, regression testing

    ·         Use knowledge of the business (Capital Market) to automate business-specific tests for data content quality

    ·         Automate code deployment and promotion

    ·         Knowledge of agile project management and collaborate with team members in an Agile team (e.g., Scrum)

    ·         Participate as both leader and learner in team tasks for architecture, design and analysis

    ·         Should be able to work with a geographically dispersed team

    Skills Requirements

    ·         Bachelor’s degree in computer science, Information Systems, or related field

    ·         Minimum two years of development experience with BDM/BDQ with a preference for five years of data integration and data quality tool experience including Informatica IDQ, Power Center

    ·         Experience with development of metadata-driven and fully parameterized BDM environments

    ·         Advanced SQL coding skills for data transformations, profiling, and query tasks

    ·         Experience in agile environments such as scrum and Kanban

    ·         Big data development experience with data lake (Hadoop cluster Hortonworks distribution) – Hadoop, Spark, HBase, Hive, Kafka, Flume, Hue, Solr, Knox, Ambari, Yarn

    ·         Development experience with Azure (Hortonworks)

    ·         Language: Python, Scala

    ·         Development experience with big data mapping for Informatica BDM

    ·         Understanding of data quality, data quality rules building using Informatica IDQ/BDQ

    ·         Experience writing in house UNIX shell scripts for Hadoop & Big Data Development

    ·         Skilled in performance tuning of data pipelines, distributed datasets, databases and SQL query performance

    ·         Business knowledge: Capital market, order management, trade lifecycle, equities, fixed income

Business Insight

Societe Generale Global Solution Centre (SG GSC), a 100% owned subsidiary of European banking major Societe Generale (SG), Our role and purpose is to enable the strategic vision of Societe Generale Group. We are doing this by pioneering cutting edge innovation from Design Thinking to Smart Automation & Artificial Intelligence, and applying it to banking.

SG Global Solution Centre provides services in the areas of Application Development and Maintenance, Infrastructure Management, Business Process Management, and Knowledge Process Management, to Societe Generale's business lines around the world.

“We are committed to creating a diverse environment and are proud to be an equal opportunity employer. All qualified applicants receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status”.

All our positions are open to people with disabilities

Job code: 19000QYY
Business unit: SG Global Solution Centre
Starting date: 11/12/2019
Date of publication: 09/10/2019
Share on

Lead Data Engineer

Permanent contract   |   Bangalore - India   |   Information Technology