Open Source AI Resources
Stability AI
https://www.theverge.com/2023/4/19/23689883/stability-ai-open-source-large-language-model-stablelm
https://github.com/stability-AI/stableLM/
Stability is the company behind Stable Diffusion, offering several products including plugins for Blender and Photoshop for generative textures, images, and more:
https://blendermarket.com/products/stability-for-blender
https://exchange.adobe.com/apps/cc/114117da/stable-diffusion
Stable Diffusion
https://github.com/Stability-AI/stablediffusion
https://github.com/CompVis/stable-diffusion
Stable Diffusion is a latent text-to-image diffusion model. Thanks to a generous compute donation from Stability AI and support from LAION, we were able to train a Latent Diffusion Model on 512x512 images from a subset of the LAION-5B database. Similar to Google's Imagen, this model uses a frozen CLIP ViT-L/14 text encoder to condition the model on text prompts. With its 860M UNet and 123M text encoder, the model is relatively lightweight and runs on a GPU with at least 10GB VRAM. See this section below and the model card.
https://www.theverge.com/2022/9/15/23340673/ai-image-generation-stable-diffusion-explained-ethics-copyright-data
The Pile
https://pile.eleuther.ai/
The Pile is a 825 GiB diverse, open source language modelling data set that consists of 22 smaller, high-quality datasets combined together.
DeepSpeech
DeepSpeech by Mozilla offers a training set, models, and code for speech recognition
https://github.com/mozilla/DeepSpeech
https://opensource.com/article/22/1/voice-text-mozilla-deepspeech
Assembly.ai
https://www.assemblyai.com/blog/the-top-free-speech-to-text-apis-and-open-source-engines/
Assembly AI offers a fully-managed paid service built on top of the open source DeepSpeech platform:
Access powerful AI models to transcribe and understand speech
Our simple API exposes AI models for speech recognition, speaker detection, speech summarization, and more. We build on the latest state-of-the-art AI research to offer production-ready, scalable, and secure AI models through a simple API. Used by thousands of breakthrough startups and dozens of global enterprises for mission-critical workloads.
Rasa
https://github.com/RasaHQ/rasa
https://medium.com/rasa-blog/a-new-approach-to-conversational-software-2e64a5d05f2a
Rasa is an open source machine learning framework to automate text and voice-based conversations. With Rasa, you can build contextual assistants on:
Facebook Messenger
Slack
Google Hangouts
Webex Teams
Microsoft Bot Framework
Rocket.Chat
Mattermost
Telegram
Twilio
Your own custom conversational channels
or voice assistants as:
Alexa Skills
Google Home Actions
Rasa helps you build contextual assistants capable of having layered conversations with lots of back-and-forth. In order for a human to have a meaningful exchange with a contextual assistant, the assistant needs to be able to use context to build on things that were previously discussed – Rasa enables you to build assistants that can do this in a scalable way.
There's a lot more background information in this blog post.