📹 New! Remote User Testing - Get video + voice feedback on designs and prototypes
Request Demo

User Testing Q&A with Marvel’s CEO Murat Mutlu

Posted 10 months ago by Naomi Francis

Recently we hosted a webinar, An Introduction to User Testing in Marveland received loads of great questions about how our new User Testing feature works and what’s coming up in the roadmap.

Read the full list below and learn more about User Testing in Marvel.

Setting up a Test

Can you include follow up questions at the end of a test?

We have included the ability to set a message once the test finishes which can be a question. We’ll be adding some additional functionality around this in coming releases such as feedback submission.

Is there a pre-screener before users are able to access the test and then based on the answers they may or may not be able to do the test?
There is currently no way to ask a screener question before a test starts. However, you can set a welcome message before each test starts. One thing worth noting is that pre-screeners are often used because of the high cost of each video result on other platforms, as Marvel does not charge per test, you don’t have to worry about the surprise costs of test results

Can you add a scenario at the start to get the user in the right frame of mind?
You could do this via the welcome message feature which allows you to enter text before the message starts

Are there any plans to add more objectives and goals into a single test, rather than just a single goal per test?
Yes, this is on our roadmap!

Can we add a number of tasks for a user to complete?
This is also on our roadmap!

Is the audio recording during testing compulsory?
No, they can reject the camera, however, we are going to provide you with the option of switching off recording for the entire project.

Can you set the user demographics for the test? E.g. Age, Location, Gender, Income
Is it possible to upload and test prototype made in Axure or Just in mind? Would this be a possibility in future?

Sharing with participants

Do participants need to download the app to be able to take the tests?
For iPhone and iPad user tests, yes. If a user doesn’t have the Marvel app installed, they will be prompted to install it before starting

Does Marvel enable tests with a moderator?
At the moment, Marvel provides the ability to conduct unmoderated tests, however, you can use Marvel in conjunction with Google Hangouts and Zoom meaning you would get the user test recording and moderate during the session.

Will it be possible to user test a prototype that has been downloaded and therefore offline?
Whilst it is possible to go offline after the participant has started the test, they would need to be online to once it finishes so you can get the result.

Do you inform the user beforehand that voice will be recorded during the test?
Yes! There is a short onboarding flow to set up the camera and microphone.

Can you tell us more about the recruitment feature? Is this hinting at a ready-made pool of testers to access?
We use several partners to provide a pool of ready-made testers from around the world. You select the demographics and then we’ll deliver the test link to those people. You can, of course, use your own testers too.

Test Results

Is there a breakdown of the specific mistaps?
Not yet! This is on our roadmap.

Are mistaps shown on the screen?
We show indicators during the recording playback of each tap and click. Desktop test results also show mouse movement.

Is translation available?
Not yet! This is on our roadmap.

Is it possible to share the user test result videos with clients? E.g. share video via email, or download file.
Every test result has a unique URL which you can share with clients (note: they will need to be collaborators in Marvel).

Can we track gesture-based interactions i.e. pull downs, swipes etc, other than just taps?
Not yet! This is on our roadmap.

Can you compare results against versions/updates made following feedback?
There’s no interface to do this at the moment (like a split view etc) but you can open each test in a new tab and review stats.

Pricing & Availability

Are tests done on a ‘pay as you go’ pricing structure?
No. Our goal is to make it easy to run as many tests as you want so we

When will it be ready to use?
Now! Get it touch to add the User Testing trial to your account

Writing for Marvel. Writing for fun. Eating everywhere, all the time.

Related Posts

“I often think about the fact that the people who will become my students in 2030 are now in elementary school. This new generation grows up on iPads, surrounded by screens, and they often take it for granted,” Sam Anvari, Assistant Professor of Graphic Design at California State University Long Beach School of Art, tells us. “It definitely requires a… Read More →

“If you could go back in time, what career advice would you give your younger self?” This is a question I’ve started to get asked a lot recently. I’m generally someone who prefers to look forward rather than reminisce about what could have been, but upon recent reflection of this question, I realized that there was an epiphany that I… Read More →

I know what you’re going to think. How could I possibly know about the mistakes startups make, since I’ve never run a startup myself? Well no, I haven’t run my own startup, but for the past 4 years, I have worked exclusively for and with startups across a wide range of sectors. With founders of both a technical and non-technical… Read More →