StockPylot

AR glasses to speed up workflow of delivery drivers and stocking workers 

MY ROLE

For this project, I guided initial research, created storyboards, and filmed and edited the video prototype.

MY ROLE

For this project, I guided initial research, created storyboards, and filmed and edited the video prototype.

TEAM

Michael Dukes, Salif Guingani, Scott Shimala

TEAM

Michael Dukes, Salif Guingani, Scott Shimala

TOOLS

Miro, Premiere Pro

TOOLS

Miro, Premiere Pro

TIMELINE

Mar. - Apr. 2023

TIMELINE

Mar. - Apr. 2023

MY ROLE

For this project, I guided initial research, created storyboards, and filmed and edited the video prototype.

TEAM

Michael Dukes, Salif Guingani, Scott Shimala

TOOLS

Miro, Premiere Pro

TIMELINE

Mar. - Apr. 2023

Overview

Elevate retail stocking efficiency with our cutting-edge AR glasses system! From clocking in to completing routes, our AR glasses provide seamless guidance. Receive route information, scan items, and confirm placements visually, all without your fingertips. This transformative technology enhances accuracy and productivity throughout the stocking process, helping retail workers perform their tasks with ease and precision.

What was the problem?

How can we design an AR/XR and IoT solution to enhance awareness, communication, and information retrieval for employees?

For this project, we were tasked with utilizing AR/VR/XR to improve awareness, communication, and information retrieval in a chosen industry scenario.

We decided to design an AR/XR and IoT application/device to support employees of large businesses/warehouses that deal with large volumes of product, such as Amazon Warehouse order pickers and stockers and online order/pick-up in-store shopping apps.

Here is the problem statement that we reached:

THE PROBLEM

• Stores have different layouts (for workers that travel)

• Lack of information flow

• Lack of team coordination

POSSIBLE SOLUTIONS

• Augmented reality to guide employee efficiency

• IoT to improve data flow, increase team coordination, and reduce downtime

EXPECTED OUTCOMES

• Improved efficiency and accuracy of employee workflows

• Improved team communication and coordination

• Decreased downtime

• Improved customer service

Research

Following our problem statement, we decided to next analyze other similar products for inspiration and see where we can improve upon features. We then empathized with potential users by conducting user research.

Google Maps Live View

  • Website provides information and resources related to Google's AR and VR technologies.

  • Image shown is Google Maps' Live View, which uses a smartphone's camera to see virtual overlays, such as arrows or directional indicators, on top of the live camera view to help users navigate their surroundings.

  • https://arvr.google.com/ar/

DoorDash Shop and Deliver

  • DoorDash, a popular online food delivery platform, has a feature for Dashers (employees of DoorDash) called Shop and Deliver, which is a system for picking up grocery items and delivering them to customers.

  • Images show the process of adding an item to the cart

  • Uses aisle location to reduce downtime and improve efficiency

Source

Source

Ideation

Further exploring the idea of an AR system, we created storyboards, a user journey map, product sketches, and first-pass UI images

Storyboards

  • Online-order/Pick-up In-Store Scenario

  • Rather than using a handheld scanner that is clunky and can be lost, AR Glasses are used

  • System is connected to all order picking employees and uses AI to parse work based on current assigned orders, specific order details, and work rate

  • Inter-store merchandiser/stocker scenario

  • Uses AR glasses to identify items on a pallet

  • Uses AR glasses to identify individual items and their locations within the store

User Personas

User Flow

User Journey Map

Initial Prototypes

Paper Prototype

To conceptualize our vision for the product, we decided to create a paper prototype of the user journey of the AR glasses.

Testing the Paper Prototype

I showed the prototype to potential users and asked for their thoughts. This helps us understand how users perceive and interact with the design, and guide our improvements. 

General feedback we received was that they really liked the simplicity and functionality of the glasses, but thinks that there should be an option for changing the opacity for the maps feature while driving or disabling it altogether to avoid distractions.

Physical Prototype

We were also tasked with creating a physical prototype of our product. Using our paper prototype and integrating user feedback, we used a pair of glasses and cardboard to simulate an augmented reality experience. The prototype's screens were tailored to fit the glasses, maintaining the user flow from our paper prototype. 

Testing the Physical Prototype

Testing the Physical Prototype

Findings

1

Very close "AR" made it hard to focus on text

1

Very close "AR" made it hard to focus on text

2

User thought an attachment (vs full glasses) might be nice, since she always wears glasses but wouldn't always want to use AR

2

User thought an attachment (vs full glasses) might be nice, since she always wears glasses but wouldn't always want to use AR

3

"I like its simplicity but more information would be nice."

3

"I like its simplicity but more information would be nice."

Recommendations

Using a real Augmented Reality display in future iterations will help with focusing on details

Using a real Augmented Reality display in future iterations will help with focusing on details

Create an attachment for glasses that users can opt out of, especially for those with prescription lenses

Create an attachment for glasses that users can opt out of, especially for those with prescription lenses

Provide users with more information on performance, such as accuracy and speed where appropriate

Provide users with more information on performance, such as accuracy and speed where appropriate

Video Prototype

I created a video showcasing how the product would be used by a worker, and their overall user experience with it.

Final Prototypes

Final Physical Prototype

In response to user testing feedback, we improved the physical prototype by introducing a performance summary screen for users upon completing a store and a full-day route. Additionally, we designed a clip-on version for glasses to offer an alternative for users who need prescription glasses, potentially making it a more cost-effective option compared to a complete AR glasses system.

The screens above (8.1 and 8.2) are screens that were created based on the user feedback from the previous physical prototype. They show the user finishing their store, followed by viewing their performance statistics for that store (speed and accuracy). 

This is similar to a process Kroger (pictured above) uses with their online order employees, which we found through our research.

Interactive Prototype

This prototype uses the scenarios generated in our initial storyboards and research.

1

The flow of the prototype is logical and easy to follow.

1

The flow of the prototype is logical and easy to follow.

2

The use of GPS routing and scanning technology is innovative and could improve efficiency.

2

The use of GPS routing and scanning technology is innovative and could improve efficiency.

3

The validation of the item placement through a picture is a useful feature.

3

The validation of the item placement through a picture is a useful feature.

Findings

Testing the Interactive Prototype

The scenario:

Imagine you are an employee using these AR glasses for the first time. Your task is to complete a route at a store using the glasses to locate and stock items. Please complete the route as you would in a real-world scenario and let us know if you encounter any issues or have any feedback along the way.

Who participated?

  • 32-year-old male "Adam"

  • HCI Master's Student

Findings

1

The flow of the prototype is logical and easy to follow.

2

The use of GPS routing and scanning technology is innovative and could improve efficiency.

3

The validation of the item placement through a picture is a useful feature.

Recommendations

The use of augmented reality technology in the glasses could enhance the user experience by allowing for more accurate scanning and placement of items.

The use of augmented reality technology in the glasses could enhance the user experience by allowing for more accurate scanning and placement of items.

Provide more information on performance and tutorials on how to use the device would help users be more efficient and also understand their progress and motivate them to improve.

Provide more information on performance and tutorials on how to use the device would help users be more efficient and also understand their progress and motivate them to improve.

To help users recognize, diagnose, and recover from errors , the system could benefit from error recovery features, such as a way to correct the placement of an item after the initial picture has been taken.

To help users recognize, diagnose, and recover from errors , the system could benefit from error recovery features, such as a way to correct the placement of an item after the initial picture has been taken.

The system could benefit from error prevention features, such as a warning when a user attempts to scan an incorrect item or incorrect placement of an item.

The system could benefit from error prevention features, such as a warning when a user attempts to scan an incorrect item or incorrect placement of an item.

Consider including a feature that allows users to report issues or errors they encounter while using the prototype, which could help improve the system over time.

Consider including a feature that allows users to report issues or errors they encounter while using the prototype, which could help improve the system over time.

Reflection & Next Steps

What Worked?

  1. Following design thinking methods, having a system and an end goal made the process clearer and more systematic

  2. Researching currently existing products helped give inspiration on what to do, and what not to do

  3. Having two team members with personal experience with grocery stocking helped us empathize with the research and development of the product.

What Didn't Work?

  1. For such a small form factor, it was difficult to prototype some of the elements we wanted to convey. Using slideware can help things like fine print be much more consumable.

  2. Working through meetings on Zoom, it was difficult to have a 1:1 product between team members developing different aspects of it.

What would we do for the next iteration?

1

The next iteration of our product would follow the insights gained from out user testing. These include adding a tutorial for new users, adding error prevention features, and adding an error reporting system.

1

The next iteration of our product would follow the insights gained from out user testing. These include adding a tutorial for new users, adding error prevention features, and adding an error reporting system.

2

We would also like to research whether implementing a goal system (speed, accuracy, time, etc.) would help drive employee engagement and joy.

2

We would also like to research whether implementing a goal system (speed, accuracy, time, etc.) would help drive employee engagement and joy.

3

We also need further research into which form factor users would prefer, as we had two similar, but distinct options.

3

We also need further research into which form factor users would prefer, as we had two similar, but distinct options.

4

Following this iteration, another round of user testing should be done, completing this cycle and increasing fidelity as the product gets closer to the final version.

4

Following this iteration, another round of user testing should be done, completing this cycle and increasing fidelity as the product gets closer to the final version.

BACK TO TOP

Made with a computer by Michael Dukes

Made with a computer by Michael Dukes