TS-GO is an education platform (APP) that uses augmented reality (AR) technology for teenagers. Users can learn by themselves through TS-GO’s AR function.They can scan relevant objects and relevant creative videos will appear on users’ phones. Users no longer have to follow the traditional education method (passively receiving information). They can simply open TS – GO app to scan any real-world objects. Then they can get the related information from the relevant videos. Our video is a combination of Chinese traditional cultural elements and introduces the knowledge of the physical objects and some innovational concepts such as critical thinking and innovative thinking. After scanning the traffic signs, a video will appear to introduce the meaning of the traffic signs. After scanning chairs, a video will appear with the content teaching people how to associate innovative thinking with chairs. The number of scannable objects may be limited in the early stage, but when users can use the templates provided by the APP for video creation in the later stage, the number of scannable objects will grow exponentially.
In addition, the project’s long-term goal is to expand TS-GO to an inclusive platform where users can create and share educational videos supported by AR.
Member Introduction
Yilun Yang
DKU class of 2024
Team Leader
Content Creation
Major: Economics
Zhe Niu
DKU class of 2024
Content Creation & Technology
Major: Data Science
Shiwen Xu
DKU class of 2024
Fund Manager& Content Creation
Major: Media & Arts
Xiangrong Zhu
DKU class of 2024
Technology
Major: Data Science
Huangrui Chu
DKU class of 2022
Technology
Major: Data Science
Weicheng Zheng
DKU class of 2024
Content Creation
Major: Data Science
Start of the Project
Quotes from members:
“The initial idea of our project was born in SOSC110 class. At that time, our group chose the theme of cultural and creative design + general design, and the idea of using traditional cultural forms and AR technology to publicize traffic signs was proposed as a fit for our theme. After the course, we hoped to make our idea more realistic, so we signed up for Dii under the encouragement of the course instructor Liqi Ren, also the director of Dii.”
【SOSC110 Clas】
“In order to be officially registered as a DKU registered innovation project, there are three assessments — application, proposal and final pitch. After each round of assessments, the school will knock out some projects. Both the application and proposal need to analyze the value, SWOT (Strength, Weakness, Opportunity, Threat) and market prospect of our project. Before the final pitch, we discussed a lot of specific plans for project development and dreamed up many partners (such as driving school, Alipay Scan, Kundu Hut…). At the same time, we imagined a lot of questions that the reviewers might ask (how will the project make money, how many target users…). In addition, after analyzing the market, we found a vacancy in the field of AR+ traditional culture + traffic signs, so we decided to focus on this in the final pitch and finally convinced the judges.”
【Final Pitch现场】
“After being registered as a Dii member, DKU provides us with various resources and guidance, including financial support, direction guidance (TPE), and interaction with other projects (monthly Gathering). We have participated in TPE guidance twice. In the first TPE, the lecturer Martin explained the meaning of the business model, asked about the positioning of our project (profit or non-profit), and suggested us in contacting the transportation department of the government. Liqi Ren provided detailed suggestions for our development direction in the first three months (focusing on education, targeting children, and synchronizing technology with video shooting).”
Potential Challenges
The challenge facing TS-GO is how to identify traffic signs photographed in different environments. With different heights and angle distances, the size and shape of traffic signs taken by users will be quite different. Moreover, under different weather conditions, traffic signs can reflect light, or be darker, somewhat different from their original colour. This also presents a new challenge to our model.
Another consideration is whether the model can detect all traffic signs and give feedback when there are multiple traffic signs in a picture.
Also, the current database is a classification data set based on German traffic signs. At present, there is no comprehensive classification data set of traffic signs in China. How to obtain more data, or how to transfer the classification of German traffic signs to the actual scene of Chinese traffic signs are severe questions facing TS-GO.
Future Plan and Achievement
Based on the existing resources of the project, TS-GO members decided to identify and integrate AR with traffic signs, which were relatively easy to start with, but this was only a small part of the project.
TS-GO is actually positioned as a Toolkits or kit. In the future development, TS-GO will combine existing network resources to establish its own image capture, recognition and AR animation database. TS-GO will not only be limited to traffic sign recognition and animation, but also will expand into new recognition + AR fields. In the final state, TS-GO will become a window for children to know the world, and effectively and interestingly show children all kinds of things in life with traditional Chinese culture elements and art forms as the carrier.