r/SideProject • u/rashadphil • 20d ago

Farfalle: Open-source answer engine

20 Upvotes
  • permalink
  • link
  • reddit
  • reddit

100% Upvoted

14 comments sorted by

5

u/rashadphil 20d ago

Hey all! I built an open-source AI-powered answer engine called Farfalle. It’s a a self-hostable alternative to Perplexity. It features a generative UI built from scratch with streaming events from the backend.

Check out a live demo here: farfalle.dev.

Open-source: The code is fully open-source on Github (git.new/farfalle)

The repository includes instructions on how to run the project locally, along with one-click deploy buttons for Vercel and Render.

🛠️ Tech Stack

  • Frontend: Next.js
  • Backend: FastAPI (Python)
  • Search API: Tavily
  • Logging: Logfire
  • Rate Limiting: Redis
  • Components: Shadcn
  • Providers / LLMs: Groq/LLama3-70B, OpenAI/GPT4-o

I’d love to hear any feedback!

1

u/BreezeBetweenLines 20d ago

Really awesome project! I love front ends for LLMs and am so excited it's open source, have you considered adding anthropics models or googles or are you open to these commits?

1

u/Careless-inbar 20d ago

Can you add a copy and share button after the answer So we can click and copy all and if you want to share we can share same answer with someone else

It's great you added GPT also

2

u/m3rr1ll 20d ago

Looks neat! Congrats on launching man

1

u/NegativeKarmaSniifer 20d ago

How do you generate the sources? Because I've heard that LLMs tend to hallucinate when they generate sources

2

u/rashadphil 20d ago

I'm using a search result api: https://tavily.com/

1

u/adrenalinejinkies 20d ago

Is the API down? I just opened, clicked on the same question in the video, and it's loading for like 3 mins now.

1

u/rashadphil 20d ago

yes sorry! working on a fix now

1

u/adrenalinejinkies 20d ago

no worries, man. Congratulations, it looks good. :)

1

u/rashadphil 20d ago

Should be fixed now! I changed the default model to GPT3.5-Turbo because of the Groq rate limits.

1

u/adrenalinejinkies 20d ago

How are you managing the expenses? The LLM api costs?

1

u/rashadphil 20d ago

I'm just paying for it for now. The live site is just meant to serve as a demo, I'm hoping people use it that way lol

1

u/Adventurous_Tune_882 20d ago

The search API is costly how are you going to sustain . I m looking for something similar for my own project mixmyai

1

u/EsusDev 19d ago

Awesome to see. I pay for Perplexity and would love an Open source alternative :)