Responsibilities
1. Responsible for routine evaluation, special evaluation and strategic iteration evaluation of Douyin AI search, and responsible for the quality, quantity and efficiency of the evaluation 2. Based on the evaluation data, be able to conduct effective and in-depth data analysis and produce analysis reports with opinions and suggestions to support product and strategy iteration optimization 3. Understand cutting-edge evaluation methods and tools, explore and introduce more efficient and intelligent evaluation methods, and continuously improve the effectiveness and scientificity of evaluation work 4. Work closely with the product and operation teams, align the evaluation standards and evaluation data, promote the evaluation system to keep up with business goals, and effectively carry out evaluation training within the team to form a good atmosphere of mentoring.
Qualifications
1. Bachelor degree or above, more than 3 years of work experience in evaluation, analysis, strategic products, etc. in the fields of search, promotion, etc., and those with team management experience are preferred 2. Familiar with AIGC, and have more than 1 year of evaluation or analysis work experience related to LLMs in scenarios such as AI search, large model application (Agent), and intelligent hardware, understand the training methods and processes of the model, and understand the evaluation indicator system of LLMs 3. Result-oriented, with strong project coordination and organizational capabilities, and able to combine resources from all parties to effectively promote project implementation 4. Be sensitive to data, good at data analysis, have strong logical thinking ability, and have good summarization and induction capabilities 5. Have strong self-drive, execution, ability to communicate across departments, and be careful and responsible at work.
