Customer Story · Athena
Athena, a leading staffing platform specializing in matching Fortune 500 executives, startup founders, and high-performing professionals with elite support staff, faced significant challenges in their hiring process. Processing up to 30,000 applications a month for Chief of Staff and Executive Assistant positions, Athena struggled with conventional assessment methods that proved both inefficient and increasingly unreliable.
Traditional fixed-answer assessments were susceptible to answer sharing among candidates, while the resulting lack of reliable hiring data forced greater reliance on time-intensive human screening interviews. These challenges led to extended hiring timelines, increased costs, and concerning levels of new-hire attrition.
“
Eliot Gattegno
Chief Learning Officer, Athena
of team time saved per 1,000 applicants assessed
alignment with Athena’s existing hiring recommendations
applicants assessed monthly, with no preliminary screens
The solution. Athena partnered with Skillfully to vet applicants through AI-enabled simulations that directly mirror real-world job scenarios. The work began with a systematic analysis of role requirements, using NLP extraction to create precise “Skills Targets” that went beyond traditional job descriptions. Working with Athena’s hiring teams, Skillfully developed four distinct, dynamic simulations that recreated the actual conditions and challenges new hires would face on the job.
The key innovation: AI-powered scenarios that adapt based on candidate interactions, eliminating the possibility of answer sharing while providing authentic assessment in a professionally relevant context. In scenarios testing client interaction skills, for example, the simulation evolved dynamically based on the applicant’s approach and responses to a simulated client persona. The result was a genuine evaluation of their capabilities, not their ability to memorize correct answers.
The impact. The initial pilot processed 1,000 applicants, demonstrating 90% alignment with Athena’s existing hiring recommendations while eliminating the need for preliminary screening interviews. Importantly, the platform also identified qualified candidates who might have been overlooked in traditional screening, expanding the pool of potential talent. Athena has since scaled past 10,000 applicants a month, with headroom to 30,000, while holding assessment quality.
The deeper lesson: it isn’t enough to identify required skills. You have to understand how they show up in the actual work. That’s what makes the data useful for both the hiring decision and what comes after it.