Cloud Hosting

Image generated by AI by Author

ChatGPT is great, no doubt about that, but it comes with a significant drawback: everything you write or upload is stored on OpenAIs servers. Although this may be fine in many cases, when dealing with sensitive data this might become a problem.

For this reason, I started exploring open-source LLMs which can be run locally on personal computers. As it turns out, there are actually many more reasons why they are great.

1. Data Privacy: your information stays on your machine.

2. Cost-Effective: no subscription fees or API costs, they are free to use.

3. Customization: models can be fine-tuned with your specific system prompts or datasets.

4. Offline Functionality: no internet connection is required.

5. Unrestricted Use: free from limitations imposed by external APIs.

Now, setting up a local LLM is surprisingly straightforward. This article provides a step-by-step guide to help you install and run an open-source model on your

See the article here:

Running Local LLMs is More Useful and Easier Than You Think - Towards Data Science