06/2021 - 09/2021

Reimagine art exhibitions with an AR tour guide

I redesigned the audio guide of SFMOMA to help visitors learn about art faster and more easily.

06/2021 - 09/2021

Reimagine art exhibitions with an AR tour guide

I redesigned the audio guide of SFMOMA to help visitors learn about art faster and more easily.

BACKGROUND

BACKGROUND

❤️ This is a personal project.

❤️ This is a personal project.

Over the years, I noticed that many people find museums confusing and intimidating. As a museum lover, I always want to help people enjoy art.

🤨 Problem: Visitors have trouble understanding artworks.

🤨 Problem: Visitors have trouble understanding artworks.

"What does it mean?" We’ve all asked that question in front of an artwork, and often left the gallery without an answer. I noticed that this experience discourages people from going to museums.

❓ Question: How can we make learning about art easier?

❓ Question: How can we make learning about art easier?

Studies show that people enjoy art more when they understand the story behind it.

I decided to use the audio guide of the San Francisco Museum of Modern Art (SFMOMA) as a starting point because they have a great visual identity, but the app is quite plain.

The old version of SFMOMA audio guide

(Click to enlarge)

INVESTIGATE

INVESTIGATE

📄 Visitors mostly rely on the info labels to learn about an artwork. But label sucks.

📄 Visitors mostly rely on the info labels to learn about an artwork. But label sucks.

I first interviewed a few of my friends and then I observed people in museums to learn about how they behave in exhibitions and the issues they encounter.

❗️ Labels are hard to find

❗️ Labels are hard to find

Labels aren’t always next to the artwork. In grouped displays, it’s even harder to tell which label belongs to which piece.

❗️ Labels are hard to read

❗️ Labels are hard to read

They’re small, and popular works often have crowds around them.

Labels are usually small

(Click to enlarge)

Visitor walked away from the artwork to find the label

(Click to enlarge)

It's hard to find the right label

(Click to enlarge)

❗️ It takes too many steps to learn

❗️ It takes too many steps to learn

To learn about an artwork, visitors must: Find the label, walk to the label, read the label, go back to the artwork. If using audio guide, user also need to scan the QR code or enter a number.

👁️ Insight: A museum guide should inform without distracting.

👁️ Insight: A museum guide should inform without distracting.

We go to exhibitions to see art, which is our priority. Therefore, the goal is actually to make visitor spend more time looking at art, not searching for information.

IDEATE

IDEATE

Current audio guides aren’t much better than labels

Current audio guides aren’t much better than labels

Audio guides have existed for decades and have had various versions. But most of them still depend on label-based codes to locate artworks, which adds friction.

☑️ Task: How to help the app identify the artwork faster?

☑️ Task: How to help the app identify the artwork faster?

I realized that to solve this problem, we have to reduce the dependency between the audio guide and labels.

💡 First idea: Auto-play based on user's location

💡 First idea: Auto-play based on user's location

When I worked at TopView (a double-decker bus tour company), we tried to auto-play audio when the bus passed landmarks. I thought about using the same tech in museums. In fact, I've used something similar on a tour in China. 

However, there is one problem: Even though GPS knows my location, it can’t tell which artwork I'm actually facing. I could be facing multiple artworks, but I only want to learn about one.

✅ Better way: Use AR to recognize the artwork

✅ Better way: Use AR to recognize the artwork

AR is already used to preview furniture, try on clothes, and catch Pokémon. Why not use it to recognize artworks?

With AR, a visitor can simply point their phone at a piece, and the app will recognize it. After researching, I found this direction both feasible and exciting.

FINAL DESIGN

FINAL DESIGN

Reimagine "AR"t exhibitions

Reimagine "AR"t exhibitions

Though I couldn’t build AR features myself, I created a prototype to show what the experience could look like.

Home page

Exhibition page

Scan the room

Choose an artwork

Enter a gallery room

Accessibility

Accessibility

There are plenty of use cases when users can't use the app. Therefore, I planned several alternatives:

  1. Can't listen? Read transcript instead.

  2. Can't load AR? Use list view & map view to locate the work

  3. No access to a smartphone? Read the label instead

There are plenty of use cases when users can't use the app. Therefore, I planned several alternatives:

  1. Can't listen? Read transcript instead.

  2. Can't load AR? Use list view & map view to locate the work

  3. No access to a smartphone? Read the label instead

NEXT?

NEXT?

❤️ This project is close to my heart.

❤️ This project is close to my heart.

As someone who loves art, I believe museums should feel welcoming and engaging for everyone.

If I continue this project, I’d love to:

If I continue this project, I’d love to:

• Show my prototype to AR developers to get feedback.
• Test it in a real museum setting.