Big Data & Reporting Software Engineer

Permanent contract|Chicago|IT (Information Technology)

Big Data & Reporting Software Engineer

  • Chicago, United States
  • Permanent contract
  • IT (Information Technology)



As a Big Data Software Engineer, you will support the development of our new data lake. This is a new build project that will use the Microsoft AZURE Infrastructure to develop and deploy a market leading solution. As member of the Feature Team, you will work in autonomy, which includes the following development tasks:

  • Design, develop and implement technical solutions in Microsoft Azure environments using the Java or Python, Spark, Hive, Avro, Parquet, Kubernetes, Java Spring Boot, Elastic Search, Logstash, Kibana, Oozie, Airflow and PostGres SQL. ‘
  • Work with distributed systems with huge volume of data
  • Good working knowledge troubleshooting performance issue
  • Good domain data specific knowledge – Listed and OTC post cleared data.
  • Knowledge of Back Office systems – GMI, Shadow, Murex, Xone
  • Knowledge of reporting systems – SAP BO, SSIS, SSRS
  • Support deconstruction of customer requests into detailed stories by interacting with the Product Owner
  • Deliver working code that meets acceptance criteria as well as meets the definition of done at different levels
  • Write code, deploy scripts, unit test, check code to source code repository, and monitor delivery pipeline activity to ensure product quality and consistency
  • Conduct testing, deployment, and production activities of the team to ensure production stability, applying the guidelines provided by the chapters
  • Engage in pair programming to write high quality code that’s easy to understand and support
  • Write tests - very often before the associated code - at unit level with Junit, Mockito and in BDD style with Cucumber
  • Attend backlog refinement and planning sessions to discuss and estimate (small, medium, large) upcoming stories

Profile required

Technical Skills:

  • Experience with Java/Python/Azure

  • Good domain data specific knowledge – Listed and OTC post cleared data.

  • Knowledge of Back Office systems – GMI, Shadow, Murex, Xone

  • Knowledge of reporting systems – SAP BO, SSIS, SSRS

  • Good working knowledge of distributed systems.

  • Must have working experience with Spark jobs and troubleshooting performance issue.

  • Must have working experience in dealing with high volume of data – batch and realtime processing.

  • Cloud experience is must – AWS or Azure

  • Sound knowledge of Spring Boot or another Java back-end framework, Kafka, Elastic Search, Kibana, & Kubernetes

  • Strong experience with Cloud & Big Data technology (Spark, Hive, Avro, Parquet) & Scala/Kotlin, Airflow

  • Strong experience with relational databases development including Oracle PL/SQL, MS SQL Server.

  • Strong experience with development life cycle products such as SVN, CVS, Maven, Hudson

  • AZURE or AWS Development Environment

  • Designing RESTful APIs and integrating third party RESTful APIs.

  • Working familiarity with code revising and branding, ideally Git.


  • Comfortable working in agile methodologies, ideally Scrum.

  • Experience with automated testing approaches - test driven development, unit testing, integration testing, and BDD testing.

  • Exposure to continuous integration tools.

  • Understanding of service-oriented architectures and message brokers.

  • Strong analytical skills and problem-solving ability.  Able to break down complex problems into simple manageable units, develop solutions for each unit, and integrate them back into the whole. 

  • Results oriented, able to set goals and priorities that maximize the use of resources available to consistently deliver quality results.

  • Team-oriented, client-focused and open to different ideas/viewpoints. Self-awareness of own behavior and work style, as well as tolerant of different needs and viewpoints

  • Good domain data specific knowledge – Listed and OTC post cleared data.

  • Knowledge of Back Office systems – GMI, Shadow, Murex, Xone


  • Experience working in a global / international financial IT environment, where there are a broad range of policies and procedures. 
  • Possess first-hand experience working in a real Change and Release management environment
  • Experience with business analysis methodologies, processes and documentation standards

Experience Needed:

  • 10 plus years of experience working as Senior Programmer Analyst role in a financial industry environment

Educational Requirements:

  • BS/Masters degree in Computer Science, Information Technology or relevant technical field.

            Desired / Plus:

Languages: (Other than English) none

Desired / Plus:

  • French

Business insight

At Societe Generale, we live by our 4 core values of commitment, responsibility, team spirit and innovation. We are engaged and demonstrate consideration for others. We act ethically and with courage. We focus our talent and energy on collective success. We experiment and propose new ideas. This way, we maximize our ability to serve client needs and anticipate market changes. Societe Generale is committed to strengthening bonds with colleagues, communities, and the world in which we live, because relationships are at the heart of how we operate.

Our Diversity & Inclusion Mission: Recruit, develop, advance, and retain a diverse workforce that is united in our efforts to enhance our competitive position and deliver innovative solutions to our clients.

Our Diversity & Inclusion Vision: 
•     Engaged workforce that is demographically diverse in a way that reflects the communities in which we operate
•     Inclusive culture and workplace that recognizes employees' unique needs and utilizes their diverse talents 
•     Engage our community and marketplace, and position the organization to meet the needs of all its clients

For more information about our D&I initiatives, please visit this link (

Societe Generale offers a hybrid work arrangement that offers employees the flexibility to work remotely, as well as on-site, in order to promote interaction and collaboration with colleagues while adhering to all SG standard protocols.  Hybrid work arrangements vary based on business area.  The applicable Business lines will determine and communicate the work arrangements that best meet their business needs.

We are an equal opportunities employer and we are proud to make diversity a strength for our company. Societe Generale is committed to recognizing and promoting all talents, regardless of their beliefs, age, disability, parental status, ethnic origin, nationality, gender identity, sexual orientation, membership of a political, religious, trade union or minority organisation, or any other characteristic that could be subject to discrimination.

  • Reference: 230007OJ
  • Starting date: 2023/06/12
  • Publication date: 2023/03/16