Generalist Expert
Posted 2 days ago
You'll complete your application on Mercor's career site.
About the Role
This position involves facilitating communication between elite AI research groups and expert human assessors to supply the precise evaluation required for developing cutting-edge models. As a generalist, your feedback acts as a benchmark to verify the logical precision and factual reliability of these systems. This role is intended for those with diverse intellectual capabilities rather than expertise in a narrow subject. This is a recurring recruitment pool that stays open permanently. While task volume fluctuates based on project-specific requirements, you will be considered for relevant assignments as they become available.
Requirements
- Possess strong reading comprehension and logical judgment, backed by professional or academic experience in any discipline.
- Demonstrate proficiency in written communication to explain your evaluation methodology clearly.
- Show comfort handling vague instructions and take the initiative to highlight contradictory or confusing requirements.
- Exhibit an aptitude for detailed analysis and the ability to articulate why specific model outputs are flawed, as no formal certifications are required.
Responsibilities
- Develop prompts and write benchmark responses for general inquiries that demand factual precision.
- Assess model performance by grading general reasoning, fact-checking, and checking for instruction following and thoroughness.
- Identify and report cases of hallucinations, logical inconsistencies, or instances where the model fails to answer the user's prompt.
Benefits & Perks
- Earnings typically fall between 40 and 70 dollars per hour, with exact pay calculated based on the complexity and duration of each assignment.
Note: This listing is summarized and paraphrased by WorkNow from a publicly posted role. For the original wording and full details, please refer to the employer's official posting.
Similar Jobs
Senior Shopify Plus Developer
Hunt St
We are looking for a Senior Shopify Plus Developer to work remotely from the Philippines. The position centers on advanced storefront development, theme tailoring, and sophisticated integrations, with a commitment to maintaining rigorous technical excellence and meeting project requirements. You will handle diverse client demands, ranging from ongoing operational maintenance and retainer engagements to comprehensive project deployments. You will serve as a primary technical authority, guiding projects through the full lifecycle from early estimation to final launch validation. Your role involves generating reliable projections, addressing technical issues, and ensuring tasks align with established budgets and scopes. Success requires consistent communication with internal teams and leads to manage project hurdles and risks. This role suits an expert developer comfortable in a decentralized agency setting. You are encouraged to use advanced AI development tools as part of our forward-thinking strategy and contribute to internal R&D initiatives. The position blends deep technical execution with project oversight, demanding high-quality coding standards and transparent collaboration with clients and management.
Freelance Website Developer, Graphic Designer
Pramira
We are looking for a multi-talented freelance Web Developer and Graphic Designer to work remotely. This position suits a creative expert who can integrate technical web work with superior visual design. Your main tasks include managing our WordPress presence to keep the site fast, secure, and attractive, while also creating various marketing materials. You will assist multiple departments by delivering custom design solutions that match our standards in the telecommunications and engineering sectors. This role provides great flexibility, as you can organize your own hours within a freelance structure. You will partner with our team to run marketing initiatives, keep branding consistent across all channels, and complete various digital and print production assignments. We need someone who can work autonomously, communicate effectively, and document their hours, making this a great fit for a self-driven person interested in varied project work.
Senior Art Director
Construct Digital
This agency focuses on building data-backed brand stories that produce tangible commercial success. Through a mix of artistic flair and sophisticated technical solutions, the firm drives growth in sales, lead acquisition, and ROI. The service offering includes data analysis, UX design, content marketing, and modern AI integration to optimize engagement and performance. As a Senior Art Director, you will work alongside creative technologists, planners, and strategists to deliver impactful solutions for clients throughout the Asia-Pacific territory. This pivotal position requires a blend of aesthetic leadership, hands-on production, and strategic guidance within an environment that promotes experimentation and continuous workflow improvement.