# OFFLINE MODE for simplified ai

**URL:** <https://forum.rabbitcommunity.tech/t/offline-mode-for-simplified-ai/13740>\
**Category:** suggestions & ideas\
**Created:** [September 3, 2024, 8:37pm UTC](https://forum.rabbitcommunity.tech/t/offline-mode-for-simplified-ai/13740 "2024-09-03T20:37:18Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![WDISTY](https://avatars.discourse-cdn.com/v4/letter/w/7ea924/32.png) [@WDISTY](https://forum.rabbitcommunity.tech/u/WDISTY)\
**Post date:** [September 3, 2024, 8:37pm UTC](https://forum.rabbitcommunity.tech/t/offline-mode-for-simplified-ai/13740/1 "2024-09-03T20:37:19Z")

</div>

With a 7B model being only 5gb and requiring little RAM, there should be a more simplified model to run the rabbit on when not around a network.

---

<div class="post-metadata">

**Author:** ![Designer](https://sea2.discourse-cdn.com/flex002/user_avatar/forum.rabbitcommunity.tech/designer/32/4735_2.png) [@Designer](https://forum.rabbitcommunity.tech/u/Designer)\
**Post date:** [September 3, 2024, 9:19pm UTC](https://forum.rabbitcommunity.tech/t/offline-mode-for-simplified-ai/13740/2 "2024-09-03T21:19:20Z")

</div>

Local inference might be a big challenge for the rabbit hardware but any form of this would be interesting for simple system commands and results that don’t need to be available instantly.

---

<div class="post-metadata">

**Author:** ![Designer](https://sea2.discourse-cdn.com/flex002/user_avatar/forum.rabbitcommunity.tech/designer/32/4735_2.png) [@Designer](https://forum.rabbitcommunity.tech/u/Designer)\
**Post date:** [September 5, 2024, 7:50am UTC](https://forum.rabbitcommunity.tech/t/offline-mode-for-simplified-ai/13740/3 "2024-09-05T07:50:00Z")

</div>

It would be great to have whisper or an other stt model running on the R1.

---

<div class="post-metadata">

**Author:** ![clel](https://sea2.discourse-cdn.com/flex002/user_avatar/forum.rabbitcommunity.tech/clel/32/5349_2.png) [@clel](https://forum.rabbitcommunity.tech/u/clel)\
**Post date:** [November 21, 2024, 3:32pm UTC](https://forum.rabbitcommunity.tech/t/offline-mode-for-simplified-ai/13740/4 "2024-11-21T15:32:08Z")

</div>

Related to [Offline capability](https://forum.rabbitcommunity.tech/t/offline-capability/13455) (@simon)