DOT GO. THE FIRST CUSTOMIZABLE OBJECT RECOGNITION APP FOR THE VISUALLY IMPAIRED.

Grand Prix

Case Film

Presentation Image

TitleDOT GO. THE FIRST CUSTOMIZABLE OBJECT RECOGNITION APP FOR THE VISUALLY IMPAIRED.
BrandDOT
Product/ServiceDOT GO
Category A04. Early-stage Technology
Entrant SERVICEPLAN GERMANY Munich, GERMANY
Idea Creation SERVICEPLAN GERMANY Munich, GERMANY
Production ALBERT COON Munich, GERMANY
Production 2 PAULUS.CO Seoul, SOUTH KOREA
Additional Company SERVICEPLAN KOREA Seoul, SOUTH KOREA
Additional Company 2 HYPERINTERACTIVE Hamburg, GERMANY
Credits
Name Company Position
Alex Schill SERVICEPLAN GROUP Global Chief Creative Officer
Jason Romeyko SERVICEPLAN GROUP Worldwide Executive Creative Director
Matthias Harbeck SERVICEPLAN GROUP Chief Creative Officer Germany
Eric Ju Yoon Kim Dot Incorporation CEO
Ki Sung Dot Incorporation CTO
Jae Seong Joo Dot Incorporation CDO
Ahrum Choi Dot Incorporation Director of Social Impact
Franz Röppischer SERVICEPLAN GERMANY Executive Creative Director
Lorenz Langgartner SERVICEPLAN GERMANY Executive Creative Director
Saurabh Kakade SERVICEPLAN GERMANY Creative Lead
Eduardo Álvarez Lucas SERVICEPLAN GERMANY Art Director
Sandra Valencia SERVICEPLAN GERMANY Copywriter
Shruthi Subramanian SERVICEPLAN GERMANY Jr. Copywriter
Kai West Schlosser SERVICEPLAN GERMANY Jr. Art Director
Rohil Borole SERVICEPLAN GERMANY Jr. Art Director
Dennis Fritz SERVICEPLAN GERMANY Director und Motion Designer
Kevin Lausen SERVICEPLAN GERMANY DoP und Motion Designer
Julia Kang Serviceplan Korea CEO & Managing Director
Lennert Schrader Freelance Motion Designer
Dieter Pries Hyperinteractive Innovation Director
Andrii Narinian Hyperinteractive iOS Engineer
Alexander Soroka Hyperinteractive Machine Learning Specialist
Alexander Patuk Hyperinteractive Full Stack Mobile Developer
Karolina Woźnicka Hyperinteractive QA
Pavel Larionov Hyperinteractive Creative Technologist
Niklas May Freelance Creative Technologist
Ying Quan Tan Freelance iOS Engineer
Imad El Rayess salty.fruits Creative Producer
Kyungsin Kim Paulus Co., Ltd. Producer
Saffaan Qadir Paulus Co., Ltd. Director
Mirjam Olga Strzata SERVICEPLAN GERMANY Creative Intern
Yago Guimaraes SERVICEPLAN GERMANY Creative Intern
Raquel Vega SERVICEPLAN GERMANY Creative Intern
Yamen Ibrahim SERVICEPLAN GERMANY Creative Intern
Lorenzo Colnaghi SERVICEPLAN GERMANY Creative Intern
Anastasiia Cherniavska SERVICEPLAN GERMANY Creative Intern
Reinier Wortman SERVICEPLAN GERMANY Creative Intern
Changkyu Ku SERVICEPLAN GERMANY Creative Intern
Aušrinė Kurgonaitė SERVICEPLAN GERMANY Creative Intern
Camille Nizet SERVICEPLAN GERMANY Creative Intern
Thinh Nguyen SERVICEPLAN GERMANY Creative Intern
Johannes Maierbacher Albert Coon Editor / Cameraman
Michael Wilk SERVICEPLAN GROUP Global Head of Art
Kwangjae Lee Serviceplan Korea Executive Director
Junghwan Choi Serviceplan Korea Senior Account Manager
Bern Huh Serviceplan Korea Account Manger
Jihyun Seo Serviceplan Korea Art Director
Jiho Ahn Serviceplan Korea Associate Art Director
Yunjung Chae Serviceplan Korea Copywriter
Anton Hofer Albert Coon Soundengineer
Heiko Steudten Freelance DoP
Hee Won Han Paulus Co., Ltd. Assistant Director
Yongsang Cho Paulus Co., Ltd. Cinematographer
Handong Ryu Paulus Co., Ltd. Production Assistant
Saliya Kahawatte Saliya Projects Consultant
Jacqueline Schottes Saliya Projects Creative Director
Florian Beijers Dexxit Consultant
Jung in Park Freelance Consultant
Mouna Nifter Freelance Consultant
Inês Ayer Freelance Developer
Christian Felder Freelance Broadcast Operator

Why is this work relevant for Innovation?

Until now, camera-based assistive apps for the visually impaired relied on proprietary data, making them limited, expensive and fragmented. Dot Go closes this gap leveraging the combined power of open-source object recognition models with the latest LiDAR integration in iPhone models. For the first time, the visually impaired can not only detect any object in their space they also have the freedom to interact with them in any way they desire. Dot Go is the first in a new category of accessible, adaptable and hands-free solutions for everyday use.

Background

As a blind and visually impaired person it’s challenging to live an active, independent lifestyle. Camera-based assistive apps can help, however existing solutions are limiting: They all rely on proprietary data and closed systems, designed for fixed use cases rather than increasing user needs. This leads to fragmentation and makes solutions increasingly expensive, forcing users to choose between adaptability and their individual needs. Dot Go is designed to work as an accessibility tool kit. It empowers users to create custom presets without coding knowledge. It allows them to connect any object – from people and vehicles to signage and equipment – with unique sound, haptic and visual feedback, and trigger automations on external devices, smart home applications and online.

Describe the idea

Traditionally, users would rely on one or more apps for different needs. Existing solutions help with certain use cases but are limited to closed systems, leaving the issue of fragmentation and costliness open. Dot Go solves this by leveraging the many accessible open-source object recognition models – including those of other solutions – together with the new LiDAR integration in iPhone. This allows anyone to customize presets for specific objects, locations and needs, creating a growing library of use cases curated by users, institutions, and brands. Most importantly, it enables the visually impaired community to engage more with the world around them and experience it in their own way. This community-driven approach solves the issue of siloed solutions and their associated costs.

What were the key dates in the development process?

March 2020 – iPad LiDAR integration and development begins October 2020 – iPhone LiDAR integration and Closed Beta Testing begins January 2021 – Apple TestFlight Launch March 2021 – First Beta Feedback

Describe the innovation / technology

Dot Go uses the latest LiDAR integration in iPhone to detect and measure precise distance to any object and trigger an action upon detection. Following the simple material conditional logic from programming – “if x then y” – users can create on a basic principle: Any object can connect with any action. Unlike other solutions that rely on proprietary databases, Dot Go leverages the many accessible open-source object recognition models, including those of other solutions, making the app as accurate as all existing solutions combined, while enabling customization for specific user needs. To enhance usability and performance Dot Go works with, but is not limited to, accessories like the lanyard or active shirt to enable handsfree use. A Pocket Mode helps conserve energy by turning off the display while a double and triple back tap feature allows the user to switch easily between presets. A beta version of Dot Go is underway of testing by users worldwide through the Apple TestFlight program.

Describe the expectations / outcome

Dot Go is set to be the first in a new category of accessible, adaptable and hands-free solutions for the blind and visually impaired. For the first time, an assistive application is leveraging the power of open-source object recognition models together with LiDAR integration in iPhone. This open-source approach allows a growing library of use cases curated by users, public institutions, and brands. Most importantly, it enables the visually impaired community to engage more with the world around them and experience it in their own way. In March 2020, prototype development of Dot Go was started. Since January 2021, a beta version of Dot Go is underway of testing by users worldwide through the Apple TestFlight program.