OnSight

OnSight is a mobile AR tool that helps construction teams document and share context by pinning photos directly in the space. Informed by real construction practices, it offers a simple, low-friction alternative to spreadsheets or high-end BIM systems.
Role
User Interviews, UX/UI Design, Unity
Course
Spatial Computing
4 days, 2024
Team
Ali Kargin
Eva Barth
Vedant
Instructors
David Rose
Ricardo Acosta

An emerging need

The concept came from interviews with engineers, architects, and builders, where we learned that project changes are constant and historical context is critical. While high-end tools exist, most teams relied on DIY methods like spreadsheets, group texts, or even colored tape to track progress.
Interviewing local construction workers

Building on existing behaviors

Despite hesitation around adopting new tech, workers were already using their phones to take and share progress photos. We saw an opportunity to add value without adding extra steps.

Catch began as an online payment method.

Catch rewards shoppers for using ACH or debit at checkout. Merchants save on credit card fees and offer store credit to boost loyalty, while shoppers earn high rewards (typically 10%) without the drawbacks of credit.
Description
Description

Adding new brands required checkout integration.

By 2024, we had integrated with around 70 merchants, but growth was limited by the need for merchant integration. Potential partner brands had scarce resources for integration, and due to our small network, we didn't yet have the traffic to demonstrate short term value — a real chicken-and-egg situation.
A builder documents his progress.

A shared visual memory

We created OnSight, a simple augmented reality documentation tool for teams working on physical job sites. The mobile app allows users to place photos directly in physical space, creating a shared visual memory of progress, notes, or context—right where it’s needed.
A manager reviews what has changed.

Tap to snap

Users simply tap to take a photo, and it’s automatically pinned to that physical location in AR. Anyone else on the team can then see it in the same spot, offering instant, location-specific insights.
Snapping and pinning photos with a tap.
Viewing photos left by teammates.

From paper to Unity

We started our basic prototyping with tracing paper, and switching to Adobe Aero and Polycam to validate the interaction. I was responsible for building the final app in Unity.
Testing positioning and direction with raycasting
Integrating live photo captures, with help from Leo

Feedback from the pros

“
An issue came up in the field yesterday that the app would have been perfect for! Maintenance folks and even the building users (especially in highly technical spaces like labs, R&D facilities, manufacturing) are always trying to locate sensors, valves, etc, that are hidden. The current way they store their location is spreadsheets and tribal knowledge
Robert Richmond
Construction Project Manager
“
I think you guys are on the right track! You guys asked many good and right questions.  I look forward to seeing the final product!
Yisi Liu

Landscape Architect

“
Whoa, that is so cool! I think this would be super useful. Keep me in the loop as you develop it!!
Catalina Pagnotta

Architect and Real Estate Agent

“
It seems like that would be a good complement to something like a VR BIM!  I think you might want to think about the market. Residential construction is usually pretty cheap, I think it would difficult to find a market with buy-in, but this type of thing is definitely growing in things like industrial construction on really complicated projects.
Andrew Rodgers
Senior Construction Engineer

Up next