just for good measures

This is an automated archive made by the Lemmit Bot.

The original was posted on /r/memes by /u/brylex1 on 2025-03-10 03:01:06+00:00.

you are viewing a single comment's thread
view the rest of the comments

[–] thickertoofan@lemm.ee 1 points 1 day ago (2 children)

ayy, that's nice. LLMs are truely overkill just for semantic search though, didnt know there are other ways to achieve this. but we need intelligence too right. (somewhat)

[–] meme_historian@lemmy.dbzer0.com 3 points 1 day ago* (last edited 1 day ago) (1 children)

Don't get me wrong though... throwing an LLM at it would be a lot easier and faster. Just a mind boggling use of resources for a task that could probably be done more efficiently :D

Setting this up with Apache Solr and a suitable search frontend runs a high risk of becoming an abandoned side project itself^^

[–] thickertoofan@lemm.ee 3 points 1 day ago

Yeah LLM seems like the go to solution. And the best one. And talking about resources, we can use barely smart models which can generate coherent sentences, be it 0.5b-3b models offloaded to CPU inference only.

[–] 0xD@infosec.pub 1 points 1 day ago

Yes, your own intelligence that you integrate into the structure of your database and queries ;)