AI Evaluation SME Quality Expert

. AI Evaluation SME Quality Expert Senior Eval Program Expert About our Team Elsevier's Evaluation Operations group supports Health Markets and Research product teams by recruiting, onboarding, and managing large networks of SMEs. We partner with product managers, clinical leaders, data scientists, UX researchers, legal, and procurement to deliver reliable, compliant, and scalable evaluation capacity. Our focus is measurable quality, transparent processes, and a great SME experience. About the Role We are seeking a Senior Eval Program Expert to own SME lifecycle operations from requirements gathering through quality oversight and continuous improvement. You will collaborate with evaluation domain leads to define project specifications, implement consistent quality procedures, and ensure audit-ready documentation. You will set SME performance standards, run calibration and inter-rater reliability activities, and drive process improvements. Your work ensures experts are engaged with clear expectations, efficient workflows, and consistent results. Responsibilities SME Requirements Gathering and Planning Collaborate with evaluation domain leads to collect and document SME requirements by activity type and timeline. Translate evaluation needs into clear SME profiles, sourcing plans, and staffed project specifications. Maintain proactive communication with stakeholders to forecast capacity and mitigate risks. SME Quality Oversight and Evaluation Activity Management Implement quality assurance procedures for SME work, including calibration sessions and inter-rater reliability measurement. Monitor performance, provide structured feedback, and implement corrective actions where needed. Track SME activity completion, invoicing, and payments in partnership with Finance and Procurement. Develop quality dashboards and regular reports for stakeholder visibility. Process Documentation and Continuous Improvement Maintain SOPs, templates, checklists, and playbooks for project readiness and quality management. Drive improvements that increase throughput, reduce cycle time, and improve SME experience. Maintain audit-ready, version-controlled documentation and ensure compliance with privacy and procurement policies. SME Relationship Management Build and nurture ongoing relationships with SME communities across specialties and domains. Coordinate cross-functional collaboration with HR, Tech, Legal, and Evaluation leads. Ensure SMEs receive ongoing support, training updates, and clear communication on SOPs, tools, and rater guidance. Requirements Bachelor's degree in Business Administration, Operations Management, Human Resources, Information Science, Public Health, or related field. 3 to 5 years in operations, program management, or quality assurance, ideally in healthcare or research settings. Experience with project management platforms and workflow tools. Proven ability to produce clear SOPs, training materials, and documentation for technical and non-technical audiences. Strong organization and program management across multiple concurrent projects and deadlines. Quality management expertise, including calibration facilitation and inter-rater reliability fundamentals. Excellent written and verbal communication with strong stakeholder management skills. Experience in process improvement and scaling operations; proficiency in Excel or Google Sheets. Working knowledge of privacy and compliance in healthcare and research such as HIPAA and GDPR fundamentals. Comfortable coordinating with evaluation domain leads and technical teams to drive operational excellence. Preferred Qualifications Experience working with SMEs or external contractor networks at scale. Background in quality assurance or quality management systems. Familiarity with evaluation or assessment operations. Experience with vendor management, invoice reconciliation, and basic budgeting. Project management training or certification (PMP, Lean Six Sigma, or similar). Work in a way that works for you We promote a healthy work/life balance across the organization. We offer an appealing working prospect for our people. With numerous wellbeing initiatives, shared parental leave, study assistance and sabbaticals, we will help you meet your immediate responsibilities and your long-term goals. Flexible working hours - flexing the times when you work in the day to help you fit everything in and work when you are the most productive. Working for you We know that your well-being and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer: Comprehensive Pension Plan Home, office, or commuting allowance. Generous vacation entitlement and option for sabbatical leave Maternity, Paternity, Adoption and Family Care leave Flexible working hours Personal Choice budget Internal communities and networks Various employee discounts Recruitment introduction reward Employee Assistance Program (global) About the business As a global leader in information and analytics, we help researchers and healthcare professionals advance science and improve health outcomes for the benefit of society. Building on our publishing heritage, we combine quality information and vast data sets with analytics to support visionary science and research, health education, and interactive learning, as well as exceptional healthcare and clinical practice. At Elsevier, your work contributes to the world's grand challenges and a more sustainable future. We harness innovative technologies to support science and healthcare to partner for a better world. We know your well-being and happiness are key to a long and successful career. We are delighted to offer country specific benefits. Click to access benefits specific to your location. We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our or please contact 1-. Criminals may pose as recruiters asking for money or personal information. We never request money or banking details from job applicants. Learn more about spotting and avoiding scams . Please read our .We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law. USA Job Seekers: .Elsevier is a global leader in advanced information and decision support for science and healthcare. We believe that by working together with the communities we serve, we can shape human progress to go further, happen faster, and benefit all.We support continuous discovery and uphold the highest standards of content integrity, reliability, and reproducibility so the communities we serve can advance their field of science, healthcare or innovation with confidence. By combining high-quality content with powerful analytics, we transform complexity into clarity and deliver mission-critical insights that help professionals make better decisions when it matters most.We deliver insights that help research institutions, governments, and funders achieve their goals. We help researchers discover and share knowledge, collaborate, and accelerate innovation. We help librarians provide verified, quality information to universities. We help innovators turn knowledge into new products. We help health professionals improve patient care and educators train the next generation of doctors and nurses. Connecting quality content and innovative