DOT GO. THE FIRST CUSTOMIZABLE OBJECT RECOGNITION APP FOR THE VISUALLY IMPAIRED.
Grand Prix
Case Film
Presentation Image
Title
DOT GO. THE FIRST CUSTOMIZABLE OBJECT RECOGNITION APP FOR THE VISUALLY IMPAIRED.
Brand
DOT
Product/Service
DOT GO
Category
A04. Early-stage Technology
Entrant
SERVICEPLAN GERMANY Munich, GERMANY
Idea Creation
SERVICEPLAN GERMANY Munich, GERMANY
Production
ALBERT COON Munich, GERMANY
Production 2
PAULUS.CO Seoul, SOUTH KOREA
Additional Company
SERVICEPLAN KOREA Seoul, SOUTH KOREA
Additional Company 2
HYPERINTERACTIVE Hamburg, GERMANY
Credits
Name
Company
Position
Alex Schill
SERVICEPLAN GROUP
Global Chief Creative Officer
Jason Romeyko
SERVICEPLAN GROUP
Worldwide Executive Creative Director
Matthias Harbeck
SERVICEPLAN GROUP
Chief Creative Officer Germany
Eric Ju Yoon Kim
Dot Incorporation
CEO
Ki Sung
Dot Incorporation
CTO
Jae Seong Joo
Dot Incorporation
CDO
Ahrum Choi
Dot Incorporation
Director of Social Impact
Franz Röppischer
SERVICEPLAN GERMANY
Executive Creative Director
Lorenz Langgartner
SERVICEPLAN GERMANY
Executive Creative Director
Saurabh Kakade
SERVICEPLAN GERMANY
Creative Lead
Eduardo Álvarez Lucas
SERVICEPLAN GERMANY
Art Director
Sandra Valencia
SERVICEPLAN GERMANY
Copywriter
Shruthi Subramanian
SERVICEPLAN GERMANY
Jr. Copywriter
Kai West Schlosser
SERVICEPLAN GERMANY
Jr. Art Director
Rohil Borole
SERVICEPLAN GERMANY
Jr. Art Director
Dennis Fritz
SERVICEPLAN GERMANY
Director und Motion Designer
Kevin Lausen
SERVICEPLAN GERMANY
DoP und Motion Designer
Julia Kang
Serviceplan Korea
CEO & Managing Director
Lennert Schrader
Freelance
Motion Designer
Dieter Pries
Hyperinteractive
Innovation Director
Andrii Narinian
Hyperinteractive
iOS Engineer
Alexander Soroka
Hyperinteractive
Machine Learning Specialist
Alexander Patuk
Hyperinteractive
Full Stack Mobile Developer
Karolina Woźnicka
Hyperinteractive
QA
Pavel Larionov
Hyperinteractive
Creative Technologist
Niklas May
Freelance
Creative Technologist
Ying Quan Tan
Freelance
iOS Engineer
Imad El Rayess
salty.fruits
Creative Producer
Kyungsin Kim
Paulus Co., Ltd.
Producer
Saffaan Qadir
Paulus Co., Ltd.
Director
Mirjam Olga Strzata
SERVICEPLAN GERMANY
Creative Intern
Yago Guimaraes
SERVICEPLAN GERMANY
Creative Intern
Raquel Vega
SERVICEPLAN GERMANY
Creative Intern
Yamen Ibrahim
SERVICEPLAN GERMANY
Creative Intern
Lorenzo Colnaghi
SERVICEPLAN GERMANY
Creative Intern
Anastasiia Cherniavska
SERVICEPLAN GERMANY
Creative Intern
Reinier Wortman
SERVICEPLAN GERMANY
Creative Intern
Changkyu Ku
SERVICEPLAN GERMANY
Creative Intern
Aušrinė Kurgonaitė
SERVICEPLAN GERMANY
Creative Intern
Camille Nizet
SERVICEPLAN GERMANY
Creative Intern
Thinh Nguyen
SERVICEPLAN GERMANY
Creative Intern
Johannes Maierbacher
Albert Coon
Editor / Cameraman
Michael Wilk
SERVICEPLAN GROUP
Global Head of Art
Kwangjae Lee
Serviceplan Korea
Executive Director
Junghwan Choi
Serviceplan Korea
Senior Account Manager
Bern Huh
Serviceplan Korea
Account Manger
Jihyun Seo
Serviceplan Korea
Art Director
Jiho Ahn
Serviceplan Korea
Associate Art Director
Yunjung Chae
Serviceplan Korea
Copywriter
Anton Hofer
Albert Coon
Soundengineer
Heiko Steudten
Freelance
DoP
Hee Won Han
Paulus Co., Ltd.
Assistant Director
Yongsang Cho
Paulus Co., Ltd.
Cinematographer
Handong Ryu
Paulus Co., Ltd.
Production Assistant
Saliya Kahawatte
Saliya Projects
Consultant
Jacqueline Schottes
Saliya Projects
Creative Director
Florian Beijers
Dexxit
Consultant
Jung in Park
Freelance
Consultant
Mouna Nifter
Freelance
Consultant
Inês Ayer
Freelance
Developer
Christian Felder
Freelance
Broadcast Operator
Why is this work relevant for Innovation?
Until now, camera-based assistive apps for the visually impaired relied on proprietary data, making them limited, expensive and fragmented. Dot Go closes this gap leveraging the combined power of open-source object recognition models with the latest LiDAR integration in iPhone models. For the first time, the visually impaired can not only detect any object in their space they also have the freedom to interact with them in any way they desire. Dot Go is the first in a new category of accessible, adaptable and hands-free solutions for everyday use.
Background
As a blind and visually impaired person it’s challenging to live an active, independent lifestyle. Camera-based assistive apps can help, however existing solutions are limiting: They all rely on proprietary data and closed systems, designed for fixed use cases rather than increasing user needs. This leads to fragmentation and makes solutions increasingly expensive, forcing users to choose between adaptability and their individual needs. Dot Go is designed to work as an accessibility tool kit. It empowers users to create custom presets without coding knowledge. It allows them to connect any object – from people and vehicles to signage and equipment – with unique sound, haptic and visual feedback, and trigger automations on external devices, smart home applications and online.
Describe the idea
Traditionally, users would rely on one or more apps for different needs. Existing solutions help with certain use cases but are limited to closed systems, leaving the issue of fragmentation and costliness open. Dot Go solves this by leveraging the many accessible open-source object recognition models – including those of other solutions – together with the new LiDAR integration in iPhone. This allows anyone to customize presets for specific objects, locations and needs, creating a growing library of use cases curated by users, institutions, and brands. Most importantly, it enables the visually impaired community to engage more with the world around them and experience it in their own way. This community-driven approach solves the issue of siloed solutions and their associated costs.
What were the key dates in the development process?
March 2020 – iPad LiDAR integration and development begins
October 2020 – iPhone LiDAR integration and Closed Beta Testing begins
January 2021 – Apple TestFlight Launch
March 2021 – First Beta Feedback
Describe the innovation / technology
Dot Go uses the latest LiDAR integration in iPhone to detect and measure precise distance to any object and trigger an action upon detection. Following the simple material conditional logic from programming – “if x then y” – users can create on a basic principle: Any object can connect with any action. Unlike other solutions that rely on proprietary databases, Dot Go leverages the many accessible open-source object recognition models, including those of other solutions, making the app as accurate as all existing solutions combined, while enabling customization for specific user needs.
To enhance usability and performance Dot Go works with, but is not limited to, accessories like the lanyard or active shirt to enable handsfree use. A Pocket Mode helps conserve energy by turning off the display while a double and triple back tap feature allows the user to switch easily between presets. A beta version of Dot Go is underway of testing by users worldwide through the Apple TestFlight program.
Describe the expectations / outcome
Dot Go is set to be the first in a new category of accessible, adaptable and hands-free solutions for the blind and visually impaired. For the first time, an assistive application is leveraging the power of open-source object recognition models together with LiDAR integration in iPhone.
This open-source approach allows a growing library of use cases curated by users, public institutions, and brands. Most importantly, it enables the visually impaired community to engage more with the world around them and experience it in their own way.
In March 2020, prototype development of Dot Go was started. Since January 2021, a beta version of Dot Go is underway of testing by users worldwide through the Apple TestFlight program.