I made a node.js-based "Deep Researcher" web app. It searches internet and creates structured academic-style cited reports based on user's prompt. One can nudge the app to search exclusively through scholar sources with science-related keywords.

The app requires your own api key to run OpenAI's LLMs and the web search tool. The LLM vendor can easily be changed. The search will be changed to "Tavily" if the corresponding api key is provided

Edit: added web search tool.
Edit-2: added a sentence about "Tavily"

Edit 3: My public board for tracking progress

top 8 comments

sorted by: hot top controversial new old

[–] jaredwhite@piefed.social 5 points 1 month ago (1 children)

OpenAi isn't open source. 🤔

[–] maxim_be@lemmy.ml 2 points 1 month ago (1 children)

But my code to work with it is

[–] water@lemmy.world 5 points 1 month ago* (last edited 1 month ago) (1 children)

Can the user supply their own base_url / api_base, to point to their own OpenAI-API compatible endpoint?

[–] maxim_be@lemmy.ml 4 points 1 month ago (1 children)

No, not without substantial code update. But it is a good idea to break a vendor lock.

[–] vala@lemmy.dbzer0.com 3 points 1 month ago (1 children)

How did you design this in a way that it would require a "substantial update" to swap out the API URL? It should be as easy as setting an environmental variable. There are many LLM providers and local LLMs that support the openAI API schema.

[–] maxim_be@lemmy.ml 1 points 1 month ago* (last edited 1 month ago)

I meant that I use OpenAI's web_search tool for the app, changing that is not difficult but would require testing after he fact. Changing LLMs for summarizers, outliners and final report is just few lines of code, especially if the providers use OpenAI formate, and should be easy also test-wise.

I am now working on implementing "tavily" search tool in addition to web_search by OpenAI. The app will default to "tavily" when valid api key is provided by the client.

[–] aurelian@lemmy.ml 1 points 1 month ago* (last edited 1 month ago) (1 children)

How does it compare with GPT Researcher?

[–] maxim_be@lemmy.ml 2 points 1 month ago* (last edited 1 month ago)

I need to study the repo, but the first thing I can say is that mine is in JS.

Edit: in addition, GPT researcher uses tavily for web search and mine uses web_search tool but OpenAI Edit-2: added optin with "tavily" into my app as weel