Korean AI Model Rater

AI Model Rater, Korean (Coding knowledge required, with focus on APIs)

Join our team of Korean speakers with coding knowledge! Apply now to help improve the next generation of AI models' tool-use capabilities.

Location : Remote, global (not US-based)

Status : Project-based

Pay : USD $24 per hour

Benefits : Flexible schedule

To ensure eligibility for this project, applicants must be international freelancers. Unfortunately, we are unable to hire U.S. citizens, Green Card holders, or candidates currently residing in the U.S. and also in China.

Project Requirements :

• Advanced / Expert fluency in Korean language, as spoken in the South Korea region ( ISO : ko_kr)
• Strong comprehension of English (read and write)
• Strong conceptual knowledge of APIs and digital services (ability to understand how AI tools interact with external apps like search, maps, or calendar, without needing to write code).
• Ability to follow complex technical guidelines precisely.

The Project :

We are seeking detail-oriented and motivated Korean speakers to join our AI LLM evaluation project. This project focuses on assessing the accuracy and quality of AI-generated responses that rely on integrated applications and tools (APIs).

The work involves evaluating a variety of AI-generated outputs, specifically paying attention to the correct and appropriate use of tool outputs (e.g., verifying that a proposed calendar event is correct, or a search result is relevant). This task evolves reading and judging the quality of API code. You must be able to adapt to various API standards by efficiently reading the provided API documentation.

The sample conversations are displayed in Korean (as spoken in South Korea). The entire evaluation must be written in English.

All work must be completed in accordance with the detailed guidelines provided upon acceptance. Please note that this work is project-based, and the workload may vary. There is no guarantee of a minimum or maximum number of hours.

Duties :

Engagement Requirements :

About Us :

As a global data company, Productive Playhouse (“PPH”), is pioneering our approach to language and data services, while incorporating their roots as a production company. Originally creating content to support children's language acquisition, our commitment to excellence, forward-thinking strategies, and world-wide cultural experience has proven key for delivering exceptional service.

Productive Playhouse is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive work environment for all employees. Employment with Productive Playhouse is at-will, meaning that either the employee or the employer can terminate the employment relationship at any time, with or without cause or notice.

All offers of employment at Productive Playhouse are contingent upon the candidate’s ability to provide valid documentation of identity and eligibility to work in the United States or relevant hiring location. Productive Playhouse participates in E-Verify.

Productive Playhouse provides reasonable accommodation for qualified individuals with disabilities. If you need assistance or accommodation due to a disability, please contact the Human Resources Department.

Disclaimer

The job description provided is designed to convey information essential to understanding the scope of the position and the general nature of the work performed. It is not intended to be an exhaustive list of duties, responsibilities, or qualifications associated with the job. Productive Playhouse reserves the right to modify or revise the job description as necessary.

#J-18808-Ljbffr