Why Use a Local AI Server?
Running an AI model locally with JAN.AI offers several advantages over cloud-based alternatives. First, privacy is a major benefit—since your data stays on your machine, there’s no risk of exposure to third-party servers. Second, speed improves dramatically, as requests are processed instantly without relying on an internet connection. Lastly, cost efficiency is a key factor—running AI locally eliminates ongoing API fees and subscription costs, making it an excellent option for businesses and developers looking to cut expenses while maintaining high-performance AI capabilities.
This guide walks you through setting up JAN.AI, installing AI models, and integrating them with the Kognetiks Chatbot for WordPress.
Step 1: Download and Install JAN.AI
- Visit the JAN.AI official website and download the latest open-source server for your operating system.
- Follow the installation instructions provided on their website to set up the server on your local machine.
- During the setup process, install your first AI model so that JAN.AI can begin processing requests.
Step 2: Installing Additional AI Models
If you want to expand your AI’s capabilities, you can install additional models:
1. Go to Hugging Face’s model repository.
2. Use the search filter “GGUF” to find models compatible with JAN.AI.
3. Search for a specific model by title. For example, searching “bartowski/mistral” will lead you to this model.
4. Copy the model’s download link.
TIP: If you follow the link when viewing the list of models that meet your search criteria, there is a model card with details on the each version of the model. Many models are free to use, however check licensing for any restrictions.
Step 3: Adding Models to JAN.AI
- Open JAN.AI and navigate to Settings.
- In the “My Models” section, paste the copied model link in the field at the top of the screen.
- Wait for the model to finish downloading.
- If prompted to “Use the Model”, select Yes to activate it.
Step 4: Running the JAN.AI Local Server
- Start the JAN.AI server to ensure that your local AI is active and ready to process requests.
Step 5: Configuring Kognetiks Chatbot to Use JAN.AI
- Open your WordPress admin panel and navigate to Kognetiks Chatbot Settings.
2. Click on the General tab. If you’re already on this tab, refresh the page to load the latest settings.
3. In the AI Engine selection dropdown, you should now see your newly installed JAN.AI model available.
4. Select the model you want to use.
5. Click Save Settings at the bottom of the page to apply the changes.
Conclusion
Your WordPress chatbot is now powered by your local JAN.AI server! If you ever switch models, repeat Step 5 to update your selection in the chatbot settings.
#LLM #LocalHost #JAN.AI #OpenSource #HuggingFace.co
About the Author
Stephen Howell is a multifaceted expert with a wealth of experience in technology, business management, and development. He is the innovative mind behind the cutting-edge AI powered Kognetiks Chatbot for WordPress plugin. Utilizing the robust capabilities of OpenAI’s API, this conversational chatbot can dramatically enhance your website’s user engagement. Visit Kognetiks Chatbot for WordPress to explore how to elevate your visitors’ experience, and stay connected with his latest advancements and offerings in the WordPress community.
Leave a Reply
You must be logged in to post a comment.