Hey self-hosted community 👋

My friend and I have been hacking on SecureAI Tools — an open-source AI tools platform for everyone’s productivity. And we have our very first release 🎉

Here is a quick demo: https://youtu.be/v4vqd2nKYj0

Get started: https://github.com/SecureAI-Tools/SecureAI-Tools#install

Highlights:

  • Local inference: Runs AI models locally. Supports 100+ open-source (and semi open-source) AI models.
  • Built-in authentication: A simple email/password authentication so it can be opened to the internet and accessed from anywhere.
  • Built-in user management: So family members or coworkers can use it as well if desired.
  • Self-hosting optimized A simple we A simple email/password authentication so it can be opened to the internet and accessed from anywhere.
  • Lightweight: A simple web app with SQLite DB to avoid having to run additional DB docker. Data is persisted on the host machine through docker volumes

In the future, we are looking to add support for more AI tools like chat-with-documents, discord bot, and many more. Please let us know if you have any specific ones that you’d like us to build, and we will be happy to add them to our to-do list.

Please give it a go and let us know what you think. We’d love to get your feedback. Feel free to contribute to this project, if you’d like – we welcome contributions :)

We also have a small discord community at https://discord.gg/YTyPGHcYP9 so consider joining it if you’d like to follow along

​

  • GodRaine@alien.topBEnglish
    0·
    11 months ago

    Hey Jay - so here’s a use case for you. I run a medium sized physical therapy clinic and my pie in the sky dream is to have a local AI that doesn’t connect to any outside services (for HIPAA reasons) but is capable of providing a conversational AI for my new staff so that they can ask it questions about policies and procedures in the clinic. Essentially an AI that can be a trainer when the trainer isn’t available; can answer questions like “how do I complete authorization for this patient who has this insurance” and it walks you through the steps, etc.

    Do you think that’s doable with this tool? I’ve been trying to set up Danswer for this but it’s extremely resource heavy and I haven’t been able to budget a decent PC / server to run the Docker services for it.

    • jay-workai-tools@alien.topOPBEnglish
      0·
      11 months ago

      Ah, this is a great use case. And it can certainly be done. The policies and procedures in the clinic can be fed into SecureAI Tools as documents and then your trainers can chat with those documents to get answers to their questions.

      And as you mentioned, it all runs locally so it’s compliant with HIPAA (and almost all other compliance regulations).

      I would love to work with you and help you deploy an instance for your needs. Sending you a DM invite so we can chat privately