Notable AI tools
LLM Chat Logging and Chat API
- Come up with my own CGFS JSON Schema spec
Prompt Version Control
My Ideal Stack
-
Remember
- When Nerds can not solve real problems using a technology they sell a tool box to use said technology
-
Postgres, but then it is not modular
- DuckDB, but then no vector support
- Chroma, I just want collections with ID's not the database
- Write blog post reviewing all text chunkers
- S3 verses SeaweedFS
- We need to have a Auth Proxy in front of these
- Can we use Caddy with some sort of Redis cache
- FastAPI verses Koa
- Python has better
- PDF Parsers
- Text Chunkers
- NodeJS has Pupeteer
- Python has better
Structured Data Extraction (Constrained Gramars)
- ✍️ Constrained Grammars | LocalAI documentation
- Instructor
- R2R
- mirascope
- The Proper Way to Generate Structured Data with LLMs | by Denis Learns Tech | May, 2024 | Medium
Fune Tuning
- OpenAccess-AI-Collective/axolotl: Go ahead and axolotl questions
- milvus-io/bootcamp: Dealing with all unstructured data, such as reverse image search, audio search, molecular search, video analysis, question and answer systems, NLP, etc.
Super Cool
- genai-stack
- microsoft/semantic-kernel: Integrate cutting-edge LLM technology quickly and easily into your apps
- microsoft/autogen: A programming framework for agentic AI. Discord: https://aka.ms/autogen-dc. Roadmap: https://aka.ms/autogen-roadmap
- MeetKai/functionary: Chat language model that can use tools and interpret the results
- eth-sri/lmql: A language for constraint-guided and efficient LLM programming.
- Chatbot Arena
- llamafile
- petals
- SuperDuperDB
- MLC LLM
- OpenRouter
- casibase
- vignshwarar/AI-Employe: Create browser automation as if you were teaching a human using GPT-4 Vision – by far, the most reliable AI first automation available.
- a16z-infra/llm-app-stack
- Visualizing Your Embeddings. An evolutionary guide from SNE to t-SNE… | by Francisco Castillo Carrasco | Towards Data Science
- nlmatics/nlm-ingestor: This repo provides the server side code for llmsherpa API to connect. It includes parsers for various file formats.
To Sort
- trypromptly/LLMStack: No-code multi-agent framework to build LLM Agents, workflows and applications with your data
- yzhao062/pyod: A Comprehensive and Scalable Python Library for Outlier Detection (Anomaly Detection)
- Awesome-chatgpt-prompts Alternatives and Reviews
LLMOps
Text Chunks
- nltk
- spacy
- spacy-llm
- semantic-chunkers
- apovalov/Rag_Text_Splitting
- chunkipy · PyPI
- Text Splitters | 🦜️🔗 LangChain
- Semantic Chunker - LlamaIndex
- Python NLP Library: Flair - DEV Community
- Natural Language Processing with NLTK in Python – Riken Shah - Blog
- How to chunk text into paragraphs using python | by N Polovinkin | Medium
- Python’s Natural Language Tool Kit (NLTK) Tutorial part - 2 | by Ishan Dixit | Medium
- Different ways of Text Splitting for RAG Application | by Barsha Rani Swain | Apr, 2024 | Medium
-
Optimizing Text Input for RAG Models: Chunking & Splitting Strategies
LLM Structured Data Extraction
- jxnl/instructor: structured outputs for llms
- Get Structured Outputs from LLMs. Ever dreamt of automating the tedious… | by Pointless-ia | Medium
- Extracting structured output | 🦜️🔗 LangChain
- Unstructured | The Unstructured Data ETL for Your LLM
Image Structured Data Extraction
- enoch3712/ExtractThinker: ExtractThinker is a Document Intelligence library for LLMs, offering ORM-style interaction for flexible and powerful document workflows.
- eth-sri/lmql: A language for constraint-guided and efficient LLM programming.
- Generating Structured Output from LLMs | Quasilinear Musings
Prompt Communities
- Llama Hub
- LangSmith
- fabric/patterns at main
- ai-boost/awesome-prompts
- mustvlad/ChatGPT-System-Prompts
- ChatGPT Prompts You Can’t Miss in 2024
- Awesome ChatGPT Prompts
- Cool LLM Prompts
LLM Libraries Frameworks
- stanfordnlp/dspy: DSPy: The framework for programming—not prompting—foundation models
- Langchain
- LlamaIndex
- embedchain
- txtai
- Semantic-kernel
- Introduction to Haystack 2.x
Epic AI GUI Apps
Self Hosted Tools
- ollama/ollama: Get up and running with Llama 2, Mistral, and other large language models locally.
- Getting Started with Mixtral-8x7B
- Server
- CLI
- Frontends
- Desktop GUI Clients
- Other
- mlc-llm - WASM in browser
Cool Links
Awesome Tests
- e2b-dev/awesome-ai-agents: A list of AI autonomous agents
- snowfort-ai/awesome-llm-webapps: A collection of open source, actively maintained web apps for LLM applications
- promptslab/Awesome-Prompt-Engineering: This repository contains a hand-curated resources for Prompt Engineering with a focus on Generative Pre-trained Transformer (GPT), ChatGPT, PaLM etc
- Netwrck/Awesome-AI-Chatbots: Awesome AI Chatbots From https://netwrck.com
- owainlewis/awesome-artificial-intelligence: A curated list of Artificial Intelligence (AI) courses, books, video lectures and papers.
- kyrolabs/awesome-langchain: 😎 Awesome list of tools and projects with the awesome LangChain framework
- steven2358/awesome-generative-ai: A curated list of modern Generative Artificial Intelligence projects and services
- sindresorhus/awesome-chatgpt: 🤖 Awesome list for ChatGPT — an artificial intelligence chatbot developed by OpenAI
- kelvins/awesome-mlops: :sunglasses: A curated list of awesome MLOps tools
- ikaijua/Awesome-AITools: Collection of AI-related utilities. Welcome to submit issues and pull requests /收藏AI相关的实用工具，欢迎提交issues 或者pull requests
- promptslab/Awesome-Prompt-Engineering: This repository contains a hand-curated resources for Prompt Engineering with a focus on Generative Pre-trained Transformer (GPT), ChatGPT, PaLM etc
Unsorted
- Noco.ai
- Replicate.com
- Multi On
- Dicklesworthstone/bulk_transcribe_youtube_videos_from_playlist: Easily take an entire YouTube playlist and turn it into high quality transcripts using Whisper.
AI Pipeline GUI's
Text to Image
- Models
- Tutorial
NLP using LLMs
AI that can use API from Docs
- Gorilla
- Scrape and Monitor Data from Any Website with No Code
- DY on X: "AI agents can now teach themselves HOW to use tools (ie. any API) in real time, completely automated! Introducing: Self-Learning Agent for Performing APIs (SLAPA) with @FinsamSamson https://t.co/Fqni8grPMb" / X
Base Models
Multiagent
AI Assistants
- Danswer
- leon-ai/leon: 🧠 Leon is your open-source personal assistant.
- khoj-ai/khoj: An AI personal assistant for your digital brain
Youtube Channels
AI Startups
Knowledge Management Stuff
Other
- automix-llm/automix: Mixing Language Models with Self-Verification and Meta-Verification
- Using LangSmith to test LLMs and AI applications - LogRocket Blog
Awesome Lists
- Significant-Gravitas/AutoGPT: An experimental open-source attempt to make GPT-4 fully autonomous.
- ikaijua/Awesome-AITools: Collection of AI-related utilities. Welcome to submit issues and pull requests /收藏AI相关的实用工具，欢迎提交issues 或者pull requests
- steven2358/awesome-generative-ai: A curated list of modern Generative Artificial Intelligence projects and services
- f/awesome-chatgpt-prompts: This repo includes ChatGPT prompt curation to use ChatGPT better.
- eugeneyan/open-llms: 📋 A list of open LLMs available for commercial use.
- Hannibal046/Awesome-LLM: Awesome-LLM: a curated list of Large Language Model
- EgoAlpha/prompt-in-context-learning: Awesome resources for in-context learning and prompt engineering: Mastery of the LLMs such as ChatGPT, GPT-3, and FlanT5, with up-to-date and cutting-edge updates.
- logikon-ai/awesome-deliberative-prompting: Awesome deliberative prompting: How to ask LLMs to produce reliable reasoning and make reason-responsive decisions.
- danielallhoff/llm-awesome-and-test-prompts: This repository collects some of the interesting prompts that can be used with a Large Language Model (LLM) thanks to a Coursera Course and some self-made prompts which I have designed.
AI Chatbot Tools
- Voxta
- TavernAI/TavernAI: Atmospheric adventure chat for AI language models (KoboldAI, NovelAI, Pygmalion, OpenAI chatgpt, gpt-4)
- KoboldAI/KoboldAI-Client
- NovelAI - The AI Storyteller
AI Chatbot Tutorials
- How to make a Chatbot : Chatbots
- How to Build an Intelligent QA Chatbot on your data with LLM or ChatGPT | by Mahesh | Medium
- LangChain Chatbot Framework With Retrievers | by Cobus Greyling | May, 2024 | Medium
- Build an LLM RAG Chatbot With LangChain – Real Python
Chat with Data Tools
ChatGPT Plugins
Random Stuff
- jtmuller5/AI-Twitter-History: ChatGPT is good but you don't know how to use it
- Ber666/ToolkenGPT: ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool Embeddings - NeurIPS 2023 (oral)
- Bonfire | Enterprise-ChatGPT trained on your data
- KoboldAI/KoboldAI-Client
- kyegomez/tree-of-thoughts: Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning by atleast 70%
- deepdoctection/deepdoctection: A Repo For Document AI
- libraryofcelsus/Aetherius_AI_Assistant: A completely private, locally-operated, highly customizable Ai Companion/Assistant/Agent with realistic Long Term Memory and task-specific modules using Llama 2 with the Oobabooga API, GPT 3.5 Turbo 16k, or GPT 4. Qdrant or Pinecone can be used for the DB.
- deepdoctection/deepdoctection: A Repo For Document AI
- lmsys.org on Twitter: "Excited to release our latest Vicuna v1.5 series, featuring 4K and 16K context lengths with improved performance on almost all benchmarks! Vicuna v1.5 is based on the commercial-friendly Llama 2 and has extended context length via positional interpolation. Since its release,… https://t.co/6MW9YyRWf7" / X
- Stampy