Building an Associate-Centered Experience for Member Advocates
The Problem
Contact center associates were leaving at a rate that cost the business twice: in hiring and training, and in performance and member experience metrics, because so many agents were novices. The Chief Experience Office launched an initiative to redesign the associate experience, aiming to cut first-year turnover by 20%.
Our hypothesis: by improving hiring and training during the first 90 days, we would reduce attrition, increase CX metrics, and improve member experience.
The Approach
I designed and conducted three phases of primary quantitative and qualitative research, from understanding why associates leave, to testing a redesigned first 90 days, to checking whether the gains lasted a year later.
My role
- Built buy-in from business leaders for on-site ethnographic research
- Designed and conducted three research phases
- Shared findings with stakeholders, including executives
- Crafted recommendations that fit business needs
Who I worked with
- A steering committee of the CEO, Chief Experience Officer, Chief Human Resources Officers, and VPs of operations
- A human-centered design team of a strategist, a designer, and a data scientist (discovery only)
- 20+ partners across 5 workstreams: talent acquisition and HR, learning and development, engineering and IT, change management, and associate experience
Phase I: Discover
Nov–Dec 2022
- 20 stakeholder interviews
- 20 one-on-one associate interviews
- Thematic analysis of 1,000 open-ended survey responses
- Significance and correlation testing on sentiment data (n=16,095)
Design and pilot
Co-created with partners
- Design workshops turned insights into solutions
- Pilot refined pre-hire communication, benefit education, manager coaching, training, and tools
Phase II: Test
Apr–Jun 2023
- Ethnographic observation: 3 trips, 2 locations, 9 days on site over 2 months
- 12 focus groups of 6–10 participants
- 40 one-on-one interviews
- Moderated survey (n=120)
Phase III: Evaluate
Apr 2024, one year later
- 19 interviews
- Survey (n=19)
- Lasting impact and room for continuous improvement
Listening in the room
In Phase II, on-site ethnographic observation was paired with 12 focus groups of 6–10 participants. Associates placed sticky notes along journey boards to show where their experience helped or hurt, so we could see which parts of the first 90 days the pilot was changing.
What the research found
Discover
Identified the top 8 drivers of attrition and validated their significance at scale, bridging the qual/quant divide with HR data scientists.
Reframed the prior belief that “personal reasons” was the number one reason associates quit.
Test
Found gaps between the pilot’s design and how it was carried out. Delivered 39 tactical recommendations, and 12 were implemented directly.
Shared three rapid insights reports, each less than a week after a site visit, including difficult findings delivered with empathy for advocates and stakeholders.
Evaluate
Showed the return on the pilot enhancements for long-term retention and uncovered opportunities for continued improvement.
“I appreciate that [the research team] watch in and take the time to talk with us to better improve training for the next class and sincerely hope changes are made.”Pilot member advocate
The Impact
Beyond the numbers
A new model of research
This was the first internally led, on-site ethnographic research in the organization.
Human-centered decisions
Leaders made decisions grounded in the needs and voice of the associate.
A foundation for new questions
The insights informed later initiatives, including new CRM technology and introducing AI into workflows.
“Hannah provided comprehensive reports and readouts to leadership so we could appropriately make improvements to provide a better associate experience to our service associates.”Program Owner