Specialist Software Engineer - Data
Responsibilities
- Independently design components, develop code and test case scenarios by applying relevant software craftsmanship principles and meet the acceptance criteria using Talend on Big Data
• Complete the assigned learning path. Take part in team ceremonies e.g. agile practices .
• Deliver on all aspects of Software Development Lifecyle (SDLC) in-line with Agile and IT craftsmanship principles.
• Deliver high-quality clean code and design that can be re-used.
• Actively, work with other development teams to define and implement data pipelines. .
• Ensure counterparts, stakeholders and partners are rightly communicated on time.
• Assess production improvement areas such as recurrent issues.
• Manage and address Production Loads.
• Provide suggestions for automating the repetitive and regular production activities.
• Perform bug-free release validations and produce metrices, tests and defect reports.
• Assist in developing guidelines and ensuring that team practices them.
• Increase coverage of data models, data dictionary, data pipeline standards, storage of source, process and consumer metadata
• Excellent communication skills
• Agile/Scrum development cycle understanding
Profile required
-
4 to 5 years’ experience in Databricks, Data factory, ADF, ADB, Hive, PySpark, SparkSQL, DataLake, DataLakeHouse, deltalake, Azure SQL, Logic Apps, KeyValut, Log Analytics and Metrics, ETL & ELT concepts
-
Good hands-on Azure Devops, understanding of build and release pipeline will be added advantage.
-
Extract data from source system using Data Factory pipelines and workflows in Azure Data Bricks
-
Good to have knowledge on Error handlings and root cause to solve.
-
Standardize the various integration and migration flows. Knowledge on Developing scalable and refusable frameworks for ingesting and enhancing datasets.
-
Good Analytical and troubleshooting skills to resolve the issues in timebound manner. Ensure data quality and accuracy through testing and validation.
-
Transform data based on business rulesExpose the data for reporting needs and exchange data with downstream applications.
-
Effective team player with ability to work autonomously and in team with cross-cultural environment.
-
Effective verbal and written communication to work closely with all the counterparties.
Why join us
We are committed to creating a diverse environment and are proud to be an equal opportunity employer. All qualified applicants receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status.
Business insight
At Société Générale, we are convinced that people are drivers of change, and that the world of tomorrow will be shaped by all their initiatives, from the smallest to the most ambitious.
Whether you’re joining us for a period of months, years or your entire career, together we can have a positive impact on the future. Creating, daring, innovating and taking action are part of our DNA.
If you too want to be directly involved, grow in a stimulating and caring environment, feel useful on a daily basis and develop or strengthen your expertise, you will feel right at home with us!
Still hesitating?
You should know that our employees can dedicate several days per year to solidarity actions during their working hours, including sponsoring people struggling with their orientation or professional integration, participating in the financial education of young apprentices and sharing their skills with charities. There are many ways to get involved.