Responsibilities

• Work with Product Owner, data architect, data analyst and business team to understand data requirements and convert them into technical implementation solutions

• Design, develop and optimize ETL (data extraction, transformation, loading) processes according to actual business needs to support large-scale data processing and integration

• Build and maintain stable and efficient data pipelines to import multi-source heterogeneous data into big data platforms or data warehouses.

• Use big data technologies (such as spark, etc.) to develop and optimize batch and stream processing tasks

• Participate in and help the team's agile implementation and continuous improvement

• Actively learn and master insurance-related business and system knowledge

• Complete other tasks assigned by the supervisor.

Requirements

• Bachelor’s degree or above in computer-related majors, more than 3 years of experience in big data development and implementation.

• Should have Intense Azure cloud data engineering experience

• Familiar with Linux environment, proficient in at least one scripting language (such as Shell, Python, etc.)

• Familiar with ETL development process, master mainstream big data technologies, such as Hadoop, Spark, Hive, etc. (Good to have)

• Familiar with Git and other code version control technologies

• Familiar with Azure platform, experience in large model development

• Strong analysis and problem-solving skills, and a strong interest in tackling difficult problems

• Good teamwork spirit, communication skills and learning ability

• Those with experience in big data platform construction are preferred

• Those with GenAI project experience are preferred

• Experience in the financial industry is preferred

• Ability to anticipate potential problems, decide and implement solutions

• Strong guidance ability, able to help guide other team members without being limited by the role

• Proficient in English reading and writing, can speak simply, and fluent oral English is preferred.

Please refer to job description.