There was definitely some luck involved, said VP of Engineering Jess Kahn, but their success has been anything but a fluke.
"We wanted to avoid falling into the trap of testing ourselves," said Jess
"Our target users are teenage boys with no formal tester training," explained Jess
"So as beta testers, they are likely to give us defects that don't contain very much detail.
They tend to point out nuances with the in-game experience - timing issues, high score discrepancies and things like that.
It's certainly valuable feedback, and we are lucky to have it, but unfortunately it's not a substitute for professional testing."
Since offshoring was "out of the question" Jess
would need to find a way to ensure testing coverage that would not burden her
in-house resources any further.
And with another version of Tap Tap Revenge schedule for release in the weeks ahead, she
would need to find such a solution quickly.
"I decided to spend a day doing research," said Jess
"It only took us about a half day to get started with uTest (Applause)," said Jess
"There's no way we could have done this in-house.
Not with our headcount and certainly not with our testing matrix."
As for their matrix, it was particularly important for Jess
to expand their testing coverage by device - a task the Applause platform made incredibly easy via a database that is constantly updated.
"What I really love about uTest (Applause) is that they can help us test on devices we don't have in-house.
Everyone in our office always has the latest and greatest iPhone devices, with the latest software.
uTest (Applause) supplying testing on the rest of the matrix allows us to discover bugs that would have otherwise gone unnoticed."
-- Jess Kahn, VP of Engineering, Tapulous
"uTest's (Applause) project management team has played an enormous role in our success," said Jess
"No matter what type of notice I give in advance, uTest (Applause) is always ready to go," said Jess
As a result, Jess
was able to compile a 'known bugs' list and work towards resolving a variety of critical issues before their next release.