Farfalle
Open-source AI-powered search engine. (Perplexity Clone)
Run local LLMs (llama3, gemma, mistral, phi3), custom LLMs through LiteLLM, or use cloud models (Groq/Llama3, OpenAI/gpt4-o)
https://github.com/rashadphz/farfalle/assets/20783686/9527a8c9-a13b-4e53-9cda-a3ab28d671b2
Please feel free to contact me on Twitter or create an issue if you have any questions.
💻 Live Demo
farfalle.dev (Cloud models only)
📖 Overview
🛣️ Roadmap
- Add support for local LLMs through Ollama
- Docker deployment setup
- Add support for searxng. Eliminates the need for external dependencies.
- Create a pre-built Docker Image
- Add support for custom LLMs through LiteLLM
- Chat History
- Expert Search
- Chat with local files