Offline AI Chatbot Assistant for Android (ChatGPT Clone).
ChatMagic AI is artificial intelligence chatbot that works like OpenAI ChatGPT but runs locally on mobile phones without internet connection (offline first). ChatMagic AI uses LLM (Large Language Model) finetuned on chat-instruction dataset. Thanks to a custom runtime, quantization, and various model optimizations, I've managed to make a LLM with approximately 400 million parameters run in mobile devices consuming below 500 MB RAM with decent generation speed which is below 0.1s per token.
Android:
- Android Studio
- Kotlin
- Jetpack Compose
- Firebase
Machine Learning:
- Python
- PyTorch
- ONNX Runtime
- Huggingface Transformers
- DeepSpeed
- Android Studio
- Kotlin programming language
- OOP (object oriented programming) concept
- Dependency injection concept
- MVVM (Model-View-ViewModel) architecture