Software Development Engineer II

Coding & Development Practices
1. Very strong understanding of distributed computing concepts.
2. Very good knowledge on PySpark and dataframe APIs.
3. Good experience on Spark application performance tuning and optimisations. Should have worked on both batch and streaming data processing.
4. Good understanding of Hive and usage with Spark as well as any other open table format like iceberg.
5. Good knowledge on data integration tools like Sqoop.
6. Experience on orchestration tools like oozie; airflow etc.
7. Basic knowledge on shell scripting.
8. Proven ability to write clean code that’s maintainable and extensible (design patterns; OOPs). Proven ability to write unite test cases.
9. Comfortable with Git and GitHub.
10. Experience in cloud platform like MS Azure is an added advantage.
11. Automate everything by default
12. Build a CI/CD pipeline
13. Automate security scanning and performance testing as part of build.
Design
1. Able to come up with multiple design solutions and justify the reason for chosen solution.
2. Able to understand the impact on the interface across applications.
3. Able to identify risks and come up with mitigation plan.
4. Able to come up with High and Low-Level Design (HLD) for a given requirement.
5. Should be able to work with stake holders and break requirements into user stories.
6. Able to identify / highlight non-functional requirements and the design should cater for the same.
7. Able to do an optimal design and thereby having minimal changes to the system.
8. Design should cater for the future considerations.
9. Understands Requirement Traceability and ensures that all design components are traced back to requirements.
10. Able to design re-usable and scalable modules.
11. Able to anticipate common exceptions and design defensive mechanisms.
12. Able to optimize the design to achieve maximum performance consuming minimal resources.
13. Considers SLA (Service Level Agreement); SLO; SLIs and OLA (Organization Level Agreement) before designing Job schedule.
Problem Solving
1. Solves problems on their own merit.
2. Clarifies requirements and asserts them in unit tests when necessary.
3. Takes an iterative incremental approach to solving the problem.
4. Is able to communicate and discuss the problem effectively with the team.
5. Able to re-create the problematic scenario and suggest ideal solution.

Requirements

Data Engineering; Big Data Processing; Spark; Hadoop; HBase; Hive; Hadoop; Data Pipelines; Python; Scala; CI; CD; Problem Solving; Leadership skills; Performance analysis & improvements

Additional information

Important Notice:

On behalf of Tesco Bengaluru, we must caution all job seekers and educational institutions that Tesco Bengaluru does not authorise any third parties to release employment offers or conduct recruitment drives via a third party. Hence, beware of inauthentic and fraudulent job offers or recruitment drives from any individuals or websites purporting to represent Tesco. Further, Tesco Bengaluru does not charge any fee or other emoluments for any reason (including without limitation, visa fees) or seek compensation from educational institutions to participate in recruitment events.

Accordingly, please check the authenticity of any such offers before acting on them and where acted upon, you do so at your own risk. Tesco Bengaluru shall neither be responsible for honouring or making good the promises made by fraudulent third parties, nor for any monetary or any other loss incurred by the aggrieved individual or educational institution.

In the event that you come across any fraudulent activities in the name of Tesco Bengaluru, please feel free report the incident at [email protected]