Senior Certification Exam Development Specialist (Psychometrician)

One Identity is an award-winning security software provider offering a broad selection of solutions that solve some of the most common and most challenging IT security problems. Part of the One Identity Software group, One Identity solutions eliminate the complexities and time-consuming processes often required to govern identities, manage privileged accounts and control access. Our solutions enhance business agility while addressing IAM challenges within on-premises, cloud and hybrid environments. The combined entity delivers a complete portfolio of market-leading Identity Access Management, Privileged Access Management, and Identity Governance solutions. Now, customers can achieve identity-centric security with trusted, proven technology in each major category.

We are seeking a certification exam development specialist with strong psychometric expertise to establish and maintain standards for our certification and credentialling program.  This includes design, validate, and maintenance of certification exams for one identity’s software solutions.

This role is responsible for translating product knowledge and instructional content into high-quality assessments that accurately measure a learner’s understanding and ability to apply that knowledge. The focus is on creating exams that are rigorous, fair, and aligned to real-world product use.

This individual will partner closely with Product and instructional subject matter experts to ensure that assessments effectively validate the intended learning outcomes.

Assessment Design and Development
Design and build certification exams that measure both knowledge and applied understanding
Translate product functionality and instructional content into structured, testable assessment items
Develop exam blueprints aligned to defined learning objectives and job-relevant skills
Create and maintain item banks including multiple-choice, scenario-based, and case-based questions
Maintain consistency in the credentialling program across products

Psychometric Quality and Rigor
Apply psychometric principles to ensure exams are valid, reliable, and fair
Define scoring models, passing thresholds, and exam structures
Conduct item analysis including difficulty, discrimination, and effectiveness of distractors
Continuously calibrate exams to address variability in perceived difficulty

Curriculum Alignment (Non-Ownership Role)
Partner with Product and instructional SMEs to understand the intent and outcomes of training content
Ensure exams accurately reflect what learners are expected to know and apply
Identify and resolve gaps where exams are perceived as too easy, too difficult, or misaligned
Establish clear linkage between learning objectives, curriculum content, and exam coverage

Lab-Based and Performance Assessment
Design and introduce hands-on, lab-based assessment components to validate real-world application
Define scenarios, tasks, and scoring criteria for performance-based testing
Collaborate with platform owners to integrate lab environments into certification exams
Ensure hands-on assessments are measurable, repeatable, and scalable

Exam Lifecycle Management
Own the lifecycle of certification exams including creation, release, maintenance, and updates
Ensure exams remain current with product changes and evolving use cases
Manage versioning and periodic refresh of exam content

Data Analysis and Continuous Improvement
Analyze exam performance data including pass rates, item performance, and learner outcomes
Identify trends related to exam difficulty and effectiveness
Use data to refine exam quality, consistency, and alignment
Provide insights to improve overall certification credibility and effectiveness

5 - 10+ years of experience in assessment design, certification exam development, or psychometrics
Strong understanding of psychometric principles including validity, reliability, and item analysis
Experience developing technical or software-related certification exams
Proven ability to translate complex technical content into clear, measurable assessment items
Experience developing exam blueprints and structured item banks
Strong collaboration skills when working with SMEs and product teams

Preferred
Background in enterprise software, cybersecurity, or infrastructure technologies
Experience designing performance-based or hands-on assessments
Experience with Lismus, Skytap, and Credly

Familiarity with platforms such as Mindtickle, Skillable, CloudLabs, or Pearson VUE

Company Description  

One Identity enables organizations of all sizes to better secure, manage, monitor, protect, and analyze information and infrastructure to help fuel innovation and drive their businesses forward. With team members around the globe, we intend to continue to grow revenues and add value to customers.  

When you join our team, you will have the opportunity to build and develop products at a scale few others can provide. Our product portfolio serves a large base of customers, and we are addressing the strategic imperatives for enterprise businesses. Working with some of the most talented employees the industry has to offer, we provide enhanced career opportunities for team members to learn and grow in a rapidly changing environment.  

Why work with us?  

-Life at One Identity means collaborating with dedicated professionals with a passion for technology.  

-When we see something that could be improved, we get to work inventing the solution.  

-Our people demonstrate our winning culture through positive and meaningful relationships.  

-We invest in our people and offer a series of programs that enable them to pursue a career that fulfills their potential.  

-Our team members’ health and wellness are our priority, as well as rewarding them for their hard work.  

One Identity is an Equal Opportunity Employer and Prohibits Discrimination and Harassment of Any Kind: One Identity is committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment. All employment decisions at One Identity are based on business needs, job requirements and individual qualifications, without regard to race, color, religion or belief, national, social or ethnic origin, sex (including pregnancy), age, physical, mental or sensory disability, HIV Status, sexual orientation, gender identity and/or expression, marital, civil union or domestic partnership status, past or present military service, family medical history or genetic information, family or parental status, or any other status protected by the laws or regulations in the locations where we operate. One Identity will not tolerate discrimination or harassment based on any of these characteristics. One Identity encourages applicants of all ages.  

Come join us. For more information, visit us on the web at One Identity Careers | Explore Opportunities with the OI Team 

Job seekers should be aware of fraudulent job offers from online scammers and only apply to roles listed on quest.com/careers using our applicant system. Note: We do not use text messaging or third-party messaging apps like Telegram to communicate with applicants, so please exercise caution if you are approached in this way and only interact with people claiming to be Quest employees if they have an email address ending in @quest.com or @oneidentity.com 

#LI-NM1