Staples

staples.com

Staples.com accelerates time-to-market of Personalization Engine with transformational approach to QA.

With immovable deadlines for a customer-facing personalization engine, Staples leveraged Simulation Testing to make developers more productive, write higher quality code and accelerate time to market.

Zero to Personalization in Record Time

Staples acquired a technology for their personalization engine. The acquired application was originally designed for smaller online retailers and would now have to scale for millions of daily visitors on the Staples.com website. Staples needed to rewrite the application in just a handful of weeks before the public launch and could not risk launching a brand-new customer-facing application without thoroughly testing it.

WIN THE QA BATTLE

Cognitect developers paired side by side with the Staples team to implement a method of QA called Simulation Testing.

Why?

As more organizations move to continuous delivery, QA must somehow shorten testing cycles and reduce the fraction of bugs that slip through. Manual testing cycles are time consuming and expensive and scripted testing can’t catch the “weird” bugs because scripts always act more reasonably than real-world users. Staples, like most organization, needed a way to quickly and accurately test the seemingly untestable user behaviors of a large-scale application.

How?

As the name implies, Simulation Testing simulates a large (potentially endless) population of virtual users, all hitting, navigating, clicking and interacting with the application. By modeling what users could do, and applying controlled randomness to the models, it can simulate months of realistic user behavior (including spikes such as those experienced on Cyber Monday), in a matter of hours.

The Result

Compress Months of QA into a few Hours

Once the virtual users are created, they can be scaled up to mimic the the traffic and user interactions the application would experience over months of real-world deployment, but compressed into a few hours. Simulation Testing discovers and diagnoses more defects than an average-sized QA department and it does it in a fraction of the time.

Continuous Delivery

Simulation Testing tests each new build of the application, each incremental release of code in real time as developers release them. Bugs don’t get a chance to make their way in to the application and never have a chance to create ripples.

Conclusion

Simulation Testing from Cognitect helped Staples.com get to market faster, with higher quality code and with the confidence that their mission critical personalization engine can handle the most intense performance demands. Our approach has helped many other companies do the same.

With Simulation Testing, our customers can experience Cyber Monday workloads repeatedly across their entire system, and in the privacy of their development environment, so when the big day arrives, they are ready - No surprises