CASE STUDY: Centers for Medicare & Medicaid Services
Centers for Medicare & Medicaid shifts from maintenance mode to modernization with SAFe
“SAFe provided a map that enabled us to shift to modernizing versus just maintaining the status quo. As a result, we will deliver value faster to hospitals, clinicians and medical facilities, resulting in better healthcare for our beneficiaries.”
—Brent Weaver, Director of Systems Implementation
Nearly 140 million Americans rely on Medicare, Medicaid, the Children’s Health Insurance Program, and the health insurance exchanges—all programs administered by the Centers for Medicare & Medicaid Services (CMS). The agency pays out approximately $767 billion in benefits annually and employs 4,100 people to administer programs in partnership with state governments.
Amid the pressures of increasing citizen expectations, the CMS environment is complex and ever-changing as budgets and legislation fluctuate—making for a perfect setting to introduce Lean-Agile principles. A few isolated programs had begun using Scrum practices, but given the size and complexity of programs at CMS, Scrum did not lend itself well to longer-range planning and the identification and mitigation of dependencies among the Scrum teams. In addition, the organization still had cultural battles to overcome.
“We were still suffering from a ‘throw-everything-over-the-wall’ mentality,’” explained Brent Weaver, Director of Systems Implementation at CMS. “The few Agile teams were requiring more of programs and that created more frustration on both sides. There was no vision or framework where everyone saw how they fit together. As a result, what they delivered was late, with defects—and not what the market needed.”
SAFe: Systems Thinking for a Complex Organization
In 2017, Weaver arrived with the charge of improving the Agile transformation for the Center of Clinical Standards and Quality (CCSQ) within CMS. In the search for a new approach, the Scaled Agile Framework® (SAFe®) resonated as the right option.
“SAFe brought a much-needed approach to scaling Agile and systems thinking that was critical to an organization of our size and complexity,” Weaver said.
In preparation to obtain buy-in and funding, Weaver built his knowledge of SAFe by taking some initial courses: Leading SAFe®, and later, Implementing SAFe®. Following the Leading SAFe® course, he made the case for the Framework to leadership and earned the full support of Steve Davidson and Mark Plaugher, Directors of the Information Systems Group within CCSQ. Additionally, Debra Santos, Director of Hospitals, ASC, and QIO Systems was also willing to support the adoption of SAFe for one of her systems.
For help, Weaver tapped Scaled Agile Partner, Agile Six Applications, Inc. With Agile Six, CMS decided to implement SAFe first in a group brand-new to Lean-Agile concepts, rather than with those already using Scrum, for a chance to start from scratch. The first teams on SAFe would be those working on CMS’s Hospital Quality Reporting (HQR) system, which healthcare facilities use to report data to CMS.
With leadership backing, they secured the budget and marked the calendar for the first face-to-face Program Increment (PI) planning event—to take place just six weeks in the future.
PI Planning Day One: Messy and Chaotic
To meet the timeframe, CMS decided to shortcut the recommendations from the SAFe Implementation Roadmap and skip SAFe training—a decision that created significant challenges and that, in hindsight, they wouldn’t recommend to other organizations. The fact that many team members were located outside the area, and many were contractors, played into that decision.
To help prepare for PI planning, HQR conducted a four-hour, half-day mock PI session with about 20 percent of team members to give them an idea of what to expect.
For the actual PI Planning event, CMS brought together more than 120 people, with approximately a quarter of them coming from out of town. The first day, unfortunately, proved to be chaotic and more challenging than expected for several reasons, according to Weaver and Ernie Ramirez, President of Agile Six Applications:
- They underestimated the refinement status of the backlog and didn’t follow all relevant parts of the SAFe Implementation Roadmap
- They had a single Certified SAFe® Program Consultant (SPC) in Ramirez (the recommendation is 3 – 5 per 100 development practitioners)
- The agency skipped Leading SAFe®, SAFe® for Teams, and SAFe® Product Owner/Product Manager training
- They did not identify Value Streams
- CMS simultaneously created the implementation plan and prepared for the Agile Release Train (ART) launch
“It cannot be overstated how horrible day one of that PI went,” Ramirez said. “We didn’t lay out an implementation plan as well as we should have, and the development contractor didn’t have the resources or roles we thought they did.”
PI Planning Day Two: ‘Quarter-Million-Dollar Conversations’
Day two, however, could not have played out more differently. “At the end of day one, rather than throw in the towel, we rolled up our sleeves, and resolved to do better in day 2. We came out of day two with a plan that the teams would ultimately deliver on over the next 12 weeks,” Ramirez said.
Ramirez points to a few reasons for the turnaround. After the first day, people returned knowing more of what to expect and came more prepared. Also, the two-day format created a sense of urgency to make progress. Additionally, Ramirez walked around troubleshooting any issues immediately as they arose.
“After the first day, everyone had an opportunity to ‘sleep on it,’” he said. “A lot of the frustration at the end of the first day kind of washed out and everyone came back with a renewed focus and commitment to get the plan done,” Ramirez said.
Team members and program managers alike left the event more hopeful than ever before, believing they could actually hit the plan’s targets. Most promising, Weaver and Ramirez noticed productive discussions happening throughout the room—often between people who had worked together for several years, but had never actually met one another in person.
“We witnessed a lot of team and cross-team bonding that just cannot be replicated over WebEx, Hangouts or Zoom,” Ramirez said. “There is something immeasurably valuable about being in the same room with someone, laughing, joking and yes, respectfully arguing. A lot of trust was earned and built on day two.”
“Quarter-million-dollar conversations were happening all over the place,” Weaver said. “That’s what it would have cost to fix problems down the road if those conversations had not happened.”
Communication, Collaboration across CMS + Contractors
Following that first PI, CMS began adhering to the SAFe Implementation Roadmap. They delivered Leading SAFe®, SAFe® for Teams, and SAFe® Product Owner/Product Manager training. Unlike the first PI, they identified Value Streams.
“For the second PI, we found a lot of value in identifying Value Streams and ARTs, which helped people understand where they fit in and how teams fit together,” Ramirez said.
Agile Six also delivered training to external contractors, including Leading SAFe®, SAFe® for Teams, and SAFe® Product Owner/Product Manager. Several people at contractor organizations earned their SAFe® Program Consultant (SPC) certification and began training their own people—knowing that it is likely to give them one more strength to promote as they seek to win future contracts with CMS.
During RFPs, contract organizations routinely compete against each other. However, once on contract, they must work with team members from competing firms. As an unexpected benefit, SAFe helped unify CMS team members and contractors, as well as contractors from various companies. Face-to-face, they collaborate more effectively and come to personally know the people behind the roles, developing comfortable working relationships with each other.
“It’s fundamentally better for American taxpayers that teams work together and break those walls down,” Weaver said. “I’m really proud of contractors’ ability to collaborate, share information, and work as a single team. Doing so has helped us reduce trouble tickets, so we know we’re delivering higher-quality solutions.
Because of CMS’s heavy use of contractors, each ART is comprised of people from numerous organizations. That required transformation leaders to be sensitive to job functions and responsibilities across the different companies on a single ART to foster trust and teamwork instead of competition. Having a single backlog for an ART creates further harmony among diverse team members.
27% Boost in Employee Satisfaction
So far, CMS has trained more than 200 people, including 25 – 30 Certified SAFe® Program Consultants (SPCs). The agency has also since launched four more Agile Release Trains (ARTs).
With training and preparation, participants have been more engaged in PI Planning events after that first learning experience. Communication, say Weaver and Ramirez, has been critical to acceptance of the new way of working. Especially in the early days, they had to communicate clearly and persistently to convince people to join in the effort and assuage fears about what this meant for their futures.
“We really had to do a lot of selling on SAFe to get people comfortable,” Weaver said. “People were genuinely apprehensive about changing the way they have worked for so long, but as they have seen results, they have embraced it.”
And over time, HQR has implemented other SAFe concepts such as Weighted Shortest Job First (WSJF). Well ahead of a PI, the primary stakeholder has time to weigh the value of work and prioritize—which takes some of the emotion out of the decision, Ramirez says.
They are also in the process of adjusting budgets to fit more with shorter-term planning. Instead of years in advance, they began thinking in terms of three-month increments, in which Ramirez called a halfway step between the traditional approach and the ‘wild west’ of Scrum.
Higher Quality, Happier People
After a bumpy beginning, CMS points to measurable progress:
- Budget shift to modernization versus maintenance – Instead of 100% of the budget going to maintain the existing HQR system, now only 40% is dedicated to it. A full 60% of the budget goes toward innovation for the system, helping the agency deliver on citizen expectations.
- Higher quality – The HQR group reports a 55% decrease in help desk tickets from hospitals—demonstrating a direct impact to customer satisfaction.
- Happier people – Surveys conducted before and after SAFe show a 27% increase in employee satisfaction.
While CMS can’t yet measure customer satisfaction gains directly, they know that fewer quality issues and more innovation contribute to that goal.
“SAFe provided a map that enabled us to shift to modernizing versus just maintaining the status quo,” Weaver said. “Beneficiaries will ultimately benefit from more user-friendly, human-centered design systems, which will allow us to reduce the burden on our providers.”
The group’s success has caught the attention of others, with trains now starting in other CMS groups. “Other programs within CMS have approached HQR asking us how to drive the same outcomes,” Santos said. “It’s a testament to how far we’ve come in the past year.”
8 Tips for a Successful Government SAFe Transformation
- Transformation starts with leadership – Ideally, you need two to three leaders who are fully committed to the change. If possible, send them through SPC training.
- Coaches are a MUST – CMS found substantial value in them
- Agile contracting is necessary – Rigid contracts that have highly specific deliverables can be an obstacle to agility and to embracing shifting priorities as new data emerges
- Use contractors that understand Lean-Agile principles – Hire teams that truly understand what this means, not just those who can talk the talk
- Find collaborative work space – From PI planning events to day-to-day work, collaborative work space enables teams to capture the value of face-to-face interaction
- Just do it! – “If we could time-travel and do it again, we would emphasize a sense of urgency to get going,” Weaver said. “Set a near-term date and follow the roadmap.”
- Engage employees – Any effort is only as strong as its people. Approach the change with empathy for what your team is undergoing and leverage the support of management and coaches to keep employees engaged and excited.
- Start with Essential SAFe® – CMS found it valuable to simplify as much as possible and started with a program that lent itself to Essential SAFe. The learnings they achieved will influence larger programs, which will require multiple Value Streams.
Organization
Centers for Medicare & Medicaid Services (CMS)
Industry
Government
Challenge
Isolated Scrum teams didn’t make much progress within a deeply ingrained waterfall culture and against long-range planning and budgeting.
Solutions
SAFe®
Results
- CMS shifted the budget from 100% dedicated to system maintenance to a 40/60 split between maintenance and innovation
- Help desk tickets decreased by 55%
- Surveys show a 27% increase in employee satisfaction
Sharing Best Practices
- Prepare for face-to-face events – CMS found the SAFe Implementation Roadmap and training invaluable to smooth-running PI planning events
- Establish transparency – Stress the importance of open, honest discussion and engagement
- Communicate the vision – In opening remarks at PI events, CMS reminded team members that their work directly impacts peoples’ health and lives
