1) Strategic Scientific Leadership and vision for AI - Define and lead a multi-year research agenda at the intersection of AI and measurement, including: - automated scoring and evaluation (writing, speaking, constructed response, performance tasks) - LLM-enabled assessment design and delivery (e.g., generative task creation, adaptive interactions) - NLP and multimodal modeling for language and skills measurement - psychometric modeling integrated with ML (hybrid models, fairness-aware measurement, Bayesian/ IRT deep learning) - model evaluation frameworks aligned to validity arguments and operational constraints - responsible AI for high-stakes testing (bias, transparency, privacy, security, governance) - Identify emerging opportunities in AI - Serve as a scientific thought leader for ETS on AI-enabled assessment innovation, identifying emerging techniques, risks, and opportunities. - - 2) Research & Innovation Management - - - Lead the design and implementation of complex AI focused research programs requiring coordination of tasks, timelines, data resources, and staff across multiple projects. - Provide hands-on scientific direction and consultation on research protypes, models and analytic tools, methodology, and evaluation strategies. - Monitor research progress, ensure methodological rigor, and guide teams to high-quality deliverables that meet rigorous standards for fairness, reliability, and transparency. - - 3) External Funding, Proposals, and Partnerships - - - Consult on proposal development, identify potential funding agencies, and coordinate responses to RFPs. - Develop strong partnerships with universities, research labs, policy bodies, foundations, and other funding organizations. - Serve as liaison between ETS Research Institute and key client groups, including policy/advisory boards and government agencies. - Represent ETS at conferences and advisory groups - - 4) Dissemination, and Thought Leadership - - - Maintain an active, independent research program with sustained scholarly output. - Disseminate findings through peer-reviewed publications, technical reports, invited talks, and participation in seminars, symposia, and professional organizations. - Represent ETS externally and help position ETS as a global leader in - - AI for assessment and measurement science - - . - - 5) People Leadership & Talent Development - - - Recruit, develop, and mentor researchers and staff, building capability across AI, psychometrics, and applied measurement. - Guide staff work, provide coaching and performance feedback, and foster collaboration across disciplines. - Build an inclusive, high-performance research culture that values scientific integrity, innovation, and impact. - - 6) Center Administration & Operational Leadership - - - Direct center operations including budget planning, fiscal oversight, resource prioritization, and policy implementation. - Monitor and approve research and consulting expenditures; review and approve proposal and project budgets; manage against budgets. - Oversee personnel processes, including staffing plans, performance appraisals, and related actions in alignment with ETS policies. \#LI-RK 1 \#LI-REMOTE - - Required Skills & Expertise - - - - Scientific & Technical Leadership (AI Measurement) - - - Deep expertise in AI/ ML, LLM’s and NLP, with demonstrated application to assessment, learning, education, workforce skills measurement, or human performance evaluation. - Strong command of research design and statistical/quantitative methods, including measurement science and/or psychometrics. - Ability to connect AI modeling choices to assessment constructs, validity, fairness, reliability, and interpretability requirements. - - Research Program Leadership - - - Proven ability to set a compelling scientific agenda, translate it into funded work, and deliver measurable impact. - Demonstrated experience leading complex research programs, multi-project portfolios, and cross-functional teams. - - Communication & Influence - - - Exceptional oral and written communication skills, including the ability to explain complex AI concepts to diverse audiences (researchers, product leaders, policymakers, funders). - Track record of influence within professional communities and among senior stakeholders. - - Leadership & Team Development - - - Demonstrated ability to lead teams, coach and develop talent, and foster a collaborative and inclusive culture. --- - - Education & Experience - - - PhD. in Computer Science, Statistics, Psychology, Cognitive Science, Educational Measurement, or a closely related discipline. - Minimum 10 years of progressively responsible research and/or program leadership experience post-PhD., including evidence of both research excellence and administrative/people leadership. - A strong record of scholarly impact such as: - publications in leading venues relevant to the role (AI/ ML/ NLP and/or measurement/education research), - recognized contributions to the field (invited talks, editorial/service roles, awards, high-impact collaborations), - and/or demonstrated leadership of influential research programs. - Experience with one or more of the following: - large-scale language assessment and automated scoring systems - LL - Ms and evaluation (e.g., robust evaluation frameworks, safety, hallucination mitigation, grounded generation) - fairness-aware ML, bias detection/mitigation, interpretability, and model governance - privacy/security considerations for AI in assessment environments - translating research into operational or product contexts (research-to-practice) --- Why ETS / What You’ll Shape In this role you will help define the scientific future of assessment by advancing AI-enabled measurement that is valid, fair, transparent, and scalable. You will collaborate with world-class researchers and partners, influence global policy conversations, and contribute to ETS’s mission of advancing quality and equity in education. - - ETS is mission driven and action oriented - - We are passionate about hiring innovative thinkers who believe in the promise of education and lifelong learning. We are energized by cultivating growth, innovation, and continuous transformation for the next generation of rising professionals as leaders. Â In support of this ETS offers multiple Business Resource Groups (BRG) for you to learn and advance your career growth! As a not-for-profit organization we will encourage you to lean in to your passion for volunteering. Â At ETS you may qualify for up to an additional 8 hours of PTO for volunteer work on causes that are important to you! The base salary range advertised represents the low and high end of the anticipated salary range for this position. The base pay actually offered will take into account internal equity and also may vary depending on the candidate's geographic region, job-related knowledge, skills, and experience among other factors. The base pay is only one aspect of the Total Rewards Package that will be offered to the successful candidate. Salary Range:$235,000 - $275,000 - - ETS is an