# Any SelfHosters Here?

**URL:** <https://forum.rabbitcommunity.tech/t/any-selfhosters-here/2116>\
**Category:** tech and gaming\
**Created:** [June 26, 2024, 3:46pm UTC](https://forum.rabbitcommunity.tech/t/any-selfhosters-here/2116 "2024-06-26T15:46:53Z")\
**Posts on this page:** 1\
**Showing post:** 4

<div class="post-metadata">

**Author:** ![Afaces](https://sea2.discourse-cdn.com/flex002/user_avatar/forum.rabbitcommunity.tech/afaces/32/5729_2.png) [@Afaces](https://forum.rabbitcommunity.tech/u/Afaces)\
**Post date:** [July 16, 2024, 7:47am UTC](https://forum.rabbitcommunity.tech/t/any-selfhosters-here/2116/4 "2024-07-16T07:47:53Z")

</div>

### My Adventures in Self-Hosting: LLMs, Text Editors, and More!

Hey fellow self-hosting enthusiasts! 😄

Cat’s impressive list of hosted services inspired me to share my own self-hosting setup. It’s not as extensive, but it’s quite unique in its own way. Let’s dive in!

#### Hosted Services:

**Language Model Hosting:**

- **LLM Model with llama-cpp-python** : I’m hosting my very own language model using `llama-cpp-python`. Currently, I’m running Llama-2-7B-Chat.Q4\_K\_M from [Hugging Face](https://huggingface.co/TheBloke/Llama-2-7B-Chat-GGUF). It’s a blast to interact with this model! For more details on my setup, check out [this post (Spanish)](https://forum.rabbitcommunity.tech/t/r1-en-espana/9110/10#ejecutar-el-servidor-de-llama-cpp-python-en-otro-terminal-aparte-5).

**Custom Text Editor:**

- **My Python Text Editor** : To make the most out of my LLM, I programmed my own text editor in Python. You can check it out on [GitHub](https://github.com/Axlfc/ScriptsEditor). It’s tailored for seamless interaction with my language model server. _And this project has plenty of funny bugs._ 😆

**Development Tools:**

- **Jupyter Notebook Server** : I run a Jupyter Notebook server for all my data science and machine learning experiments. It’s incredibly handy for quick prototyping and interactive coding sessions.

**Remote Desktop:**

- **VNC Server** : I also host a VNC server to connect to my server laptop’s desktop environment from anywhere. It gives me full GUI access, making management a breeze.

**File Sharing:**

- **Samba Share Server** : For easy file sharing across my home network, I set up a Samba share server. It allows seamless access to files from any device within my network.

**Remote Access:**

- **SSH Server** : An SSH server is also in place for secure remote command-line access to my server. It’s essential for managing and troubleshooting my setup.

**Voice-Controlled Automation:**

- **LAMatHome** : I’m using the [LAMatHome repository](https://github.com/dot-Justin/LAMatHome) for handling execution of actions on my computer via voice commands with the Rabbit R1. This setup has been a game-changer for hands-free control! For more details, check out [this guide (Spanish)](https://forum.rabbitcommunity.tech/t/r1-en-espana/9110/9#gua-para-configurar-y-usar-lamathome-con-rabbit-r1-1).

**Work in Progress:**

- **VPN Server** : Once it’s up and running, it will give a secure way to access my home network remotely.
- **Open-Assistant Integration** : I’m also working on integrating Open-Assistant with my local LLM. This will enhance the interactivity and responsiveness of my setup, making it even more powerful.

* * *

So, that’s my current setup! Now, – here are some questions to help me improve my server:

1. **What are some must-have self-hosted services that you recommend?** I’m looking to expand my setup and would love to hear your favorites.
2. **How do you manage security for your self-hosted services?** Any tips or tools you swear by?
3. **Any advice on setting up a VPN server?** I’d appreciate any resources or personal experiences you can share.

A big shoutout to the open-source and free software developers out there – your work makes all of this possible! Keep it up, folks! 😉💪

Looking forward to your suggestions and happy self-hosting, everyone! 🐇✨

---

_[View the full topic](https://forum.rabbitcommunity.tech/t/any-selfhosters-here/2116)._
