This app is developed with SwiftUI. When apple will soon release their AR glasses this app can maybe be reworked used together with the glasses.
Immersion is an augmented reality language learning app. It lets the user immerse himself in his target language by translating and learning objects in his surroundings.
In the explore mode, the user can point the camera on any item, it will be automatically recognized by machine learning and translated in the selected target language. Found items can be saved to a deck and be learned, either through spaced repetetion in the vocabulary trainer or be used in future challenges.
In a predetermined time window the user can use the camera to find a a set amount of real world items that belong to a choosen deck.
Collected vocabulary / real world items will be saved together with a picture in decks. Decks also save the location where is has been created, to be more easily remembered. When a review session is started, a set of vocabulary will be selected with a spaced repetion system to be used in a short quiz.
The user profile shows a summary of all user activities. Learning activies grant points. Points can be used to help with motivation by showing a daily activity chart. There is also a leaderboard shown to let users compete.
- ROGoogleTranslate
- Firebase
- [Vision]
- Julian Gierl - Initial work