Lead Data Engineer

Permanent contract|Chennai|Information Technology

Lead Data Engineer

Chennai, India Permanent contract Information Technology


Work collaboratively with a global team to design, develop scalable, maintainable and reliable services that process very large quantities data using Big Data technologies (100 billion daily indicators, 6 TB/day before compression).

Familiar with Object oriented development, with specific experience in at least one major OO language (knowledge of Java is mandatory and if possible java 8). Nice to have: Knowledge of functional programming.

Develop and review end to end application and technical architecture of deliverables within the business services programming including integration with external modules / components

Perform end-to-end software development life cycle functions including Architecture, Design, Development, Performance Analysis & Tuning, Optimization, Testing and Product Maintenance.

Design software components using appropriate design patterns to assist in developing a consistent well throughout the system that’s simple to build, maintain and interface with users and other system components

Ensure quality of deliverables, set development standards in areas of code quality, test coverage, TDD, BDD, monitoring, logging, exception management.

Collaborate and build relation with other development teams, operate and operations partners and business clients.

Profile required

  • The individual must have 8-12 years of diversified experience developing applications using java language with at least 3+ years of experience in Big data technologies Spark, Kafka/Spark Streaming, HBase, Hive, Oozie, Knox, Hadoop (Hortonworks) and related eco system.
  • Experience working on at least 2 big Data projects.
  • Expertise with Hadoop and Spark highly desired including performance optimization know how.
  • Experience with building stream-processing systems using solutions such as Spark-Streaming, Kafka is a plus.
  • Advanced knowledge of principles and components of Big Data processing and analytics highly desired.
  • Messaging formats including XML, JSON, Google Protocol Buffers, Avro.
  • Solid experience in Core java is a must. Good knowledge of SQL is also required.
  • Experience in creating and consuming RESTful web services (with Spring Boot).
  • Experience with Agile and test-driven development methodologies required (TDD with Junit/Hadoop Unit and BDD with cucumber).
  • Proficient in UNIX commands and Shell Scripting.
  • Comfortable working with Eclipse IDE or Intellij IDEA.
  • Experience with Git, MAVEN, Jira tools.
  • Strong analytical and problem-solving skills.
  • You like to have a deep understanding of the technical stacks in which you are developing (not only using the API but knowing how it works behind the wood)
  • Solid application design, coding, testing, maintenance and debugging skills.
  • Experience of Object-Oriented software design and design patterns.
  • Experience in handling a team from a technical perspective.
  • Knowledge on functional programming features in java is highly desired.
  • Nice to Have:
  • Experience within the Financial Services industry is a plus.
  • Experience in working in global teams.
  • Angular JS
  • Scala

Why join us

We are committed to creating a diverse environment and are proud to be an equal opportunity employer. All qualified applicants receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status

Business insight

At Société Générale, we are convinced that people are drivers of change, and that the world of tomorrow will be shaped by all their initiatives, from the smallest to the most ambitious.

Whether you’re joining us for a period of months, years or your entire career, together we can have a positive impact on the future. Creating, daring, innovating and taking action are part of our DNA.

If you too want to be directly involved, grow in a stimulating and caring environment, feel useful on a daily basis and develop or strengthen your expertise, you will feel right at home with us!

Still hesitating?

You should know that our employees can dedicate several days per year to solidarity actions during their working hours, including sponsoring people struggling with their orientation or professional integration, participating in the financial education of young apprentices and sharing their skills with charities. There are many ways to get involved.

We are an equal opportunities employer and we are proud to make diversity a strength for our company. Societe Generale is committed to recognizing and promoting all talents, regardless of their beliefs, age, disability, parental status, ethnic origin, nationality, sexual or gender identity, sexual orientation, membership of a political, religious, trade union or minority organisation, or any other characteristic that could be subject to discrimination.

Reference: 210007SA
Entity: SG Global Solution Centre
Starting date: 2021/06/15
Publication date: 2021/03/24