Testing AI Concepts in User Research

Posted 5 months ago by Chris Butler

It is clear that intelligent algorithms such as deep learning, machine learning, artificial intelligence, etc. will have a major impact on the world. However, what isn’t clear is how these technologies can be used to solve real problems for people.

16sNLNSXCgYJwNPzzUg4GpA

Patrick, your friendly robot helper, as designed by my amazing teammates at Philosophie, Jamie and Leah.

At Philosophie we work on experiences that help humans in their day-to-day tasks. We hope to join the benefits of intelligent algorithms with the things that humans do best: deal with complex and creative endeavors that solve their problems towards some purpose.

In this post we will take you through the methods we have used at Philosophie to validate how intelligent algorithms could be used to solve real world problems.

Centaurs or cyborgs?

Scene from COMPUTER CHESS

Scene from COMPUTER CHESS

Our inspiration comes from intelligent algorithms being used in the domain of chess, one of the first ‘hard’ games to be conquered by deep learning. After Garry Kasparov was beaten by Deep Blue he was inspired to start a new form of chess that combines humans and computers together called Advanced Chess. It is also referred to as centaur, advanced, and cyborg chess.

Advanced Chess – WikipediaAdvanced Chess is a relatively new form of chess, wherein each human player uses a computer chess program to help him…

As in the centaur model, we look to the intelligent algorithms as assistants, helpers, and to help the humans they work with achieve the human’s purposes. Not the other way around. It is much like a partnership since the algorithms need to learn from the human counterpart as well.

In this article I try to avoid talking about particular technologies or techniques because people don’t care what you use as long as it helps solve a problem. Generally the systems we are considering use supervised or semi-supervised learning techniques, but it could really be anything (GANs are pretty cool right now).

Always get started with a problem

“First, as with any endeavor, you need to have a real problem that you are trying to solve.”

At this stage of intelligent algorithms, you should be targeting the parts of a problem that are busywork. By busywork, I mean those aspects that feel like routine, are easily documented (say in a manual), or are a heuristic commonly used.

Ideation without an AI PhD

Once you have identified an important problem to solve, you need to ideate solutions with intelligent algorithms in mind. We love to do Crazy Eights when ideating and this is a perfect time to do so.

1w3Wu9PvecR2drr1tegqPeQ

A Crazy Eights exercise sketch by yours truly

To be clear, we don’t assume that in this process you are building anything yet. We are just looking for ideas that an intelligent algorithm acting like another human helping the person. When sketching (and later prototyping) we will just assume some intelligent algorithm ‘magic’ happens behind the scenes.

There are a few questions you should ask yourself when ideating for intelligent algorithms:

Prototyping the algorithms

“Building prototypes (coded or otherwise) with intelligent algorithm support is no different than hiding business or application logic behind an experience.”

While designing the prototype you should be asking the same questions as during ideation: how will the system describe what it is doing, how will the human be able to approve or intervene, and how will feedback be given to the system?

A pattern we have used and seen is fake loading and ‘calculating’ experiences. They can help convey the work going into the suggestion, recommendation or decision to start creating trust with the person using it. This is similar to OpenTable’s old ‘looking for a table’ or TurboTax ‘checking for all possible tax breaks’:

Why Some Apps Use Fake Progress BarsCuriously, the case of the TurboTax animations is a departure from most of the deceptive practices Adar studied: Rather…

We used this concept most recently we were researching how people would work with an intelligent finding the right person to work on a job. Even though ‘Patrick’ would have already calculated the options we walk the person through the criteria he is using so they understand.

Patrick helping the scheduler find the perfect person to work on the job as part of a timeline.

Patrick helping the scheduler find the perfect person to work on the job as part of a timeline.

Also, you shouldn’t ignore the way that a human will give feedback to the intelligent algorithms (aka supervised learning). If the human has to step in then we need to get the feedback to make the algorithm better. This is generally a ‘why did you make that choice’ type of question to the person using it.

Robots love getting feedback!

Robots love getting feedback!

In our case, we wanted to get feedback if the recommendation that Patrick gave was not used.

Research with humans

Once the prototype is ready, it is time to put it front of someone to see how they perceive the intelligent system working.

“When using intelligent algorithms you want to know: 1) if the help they are giving is useful to the problem the person is trying to solve, 2) do they trust the information, and 3) do they feel comfortable giving feedback to the system.”

Like any other test plan you will be focusing on the prototype, but it is important to check in on a few key questions as they go through the experience:

Synthesis

In our most recent process we had been writing observations on post-its and took some time affinitizing them in different ways.

Affinitized, but helpful?

Affinitized, but helpful?

Affinitizing is nice and comfortable, but it doesn’t really help with understanding how people feel about using the intelligent algorithms in their work. Luckily, Leah, my awesome designer teammate on the Philosophie team, came up with a great way to understand the intelligent-algorithm-specific observations: put them on a 2×2 for understanding vs. confusion and positive vs. negative sentiment.

Our new 2x2

Our new 2×2

When looking at the observations this way we found a few different groupings:

If you look at the discussions happening about intelligent algorithms, such as self-driving cars, it mimics the set of general topics.

Dystopian possibilities

1VEZdHO-vfqbr-LgxnAeIgA

As we saw in the negative/understood quadrant of the synthesis, people are worried about how intelligent algorithms impact their lives. This isn’t just that they may lose their jobs, but that when a decision is made by an algorithm there may be no chance to understand why.

“The ethics of why we are creating systems still matters.”

The ethics of why we are creating systems still matters. People’s purposes are what drive the meaning of technology. Creating a person-less bureaucracy isn’t better than what we have now no matter the amount of additional efficiency we get.

A recent article on Real Life was a great piece on how intelligent algorithms when used incorrectly can just create a bureaucracy with no people:

Rule by Nobody – Real LifeThe compensation for a death sentence is knowledge of the exact hour when one is to die. -Cincinnatus C., Invitation to…

A short ebook by Marshall Brain speaks to the possible-post jobs world if you want to go further out:

1Ox6GScNQxJUhtgnE2dcCUQ

I don’t have the answers on what this means, but as creators of these new technologies we need to try to understand and do what is best for all of us.

What’s next?

There is a lot of focus on techniques to create intelligent algorithms technically, but we need people thinking about how they help people. We have outlined some key questions when doing this research before you build.

In the coming months we will post more on how to include these new technologies in products and experience patterns we are starting to see.

Design and prototyping for everyone

Design and prototyping for everyone

Thousands of individuals and teams use Marvel to design and prototype ideas.

Get Started, it's Free!

Chris Butler is Senior Product Strategist at Philosophie in NYC. He has over 15 years of experience working in product, business development, regular development (aka engineering), and tech evangelism for large to small companies (including founding one of his own). He has worked with Microsoft, Waze, Horizon Ventures, KAYAK, and more.

Related Posts

One of the greatest information processors we deal with in our everyday life cannot be seen or touched. It cannot be bought or sold as well as taken from other people; however, it can be developed and strengthened by many ways. It cannot be easily described but belongs to the most precious features of human life and determines perhaps any… Read More →

We have a great opportunity at my company right now: our platform has been developing daily in the last years, but this has happened although we lack a clear process of thinking content embedded in new features. So it’s about time we jump into that gap and fill it with some well developed UX Writing. “We lack a clear process… Read More →

We revisit Chartmogul to take a look at some of the changes and trends in SaaS landing page design in 2017. This expanded analysis looks at the landing pages of over 100 SaaS businesses of all sizes — with some powerful insights! Our last landing page analysis is still one the most popular articles on ChartMogul. Given that it’s been 18 months… Read More →