gens

joined 2 years ago
[–] gens@programming.dev 1 points 1 day ago* (last edited 1 day ago)

The programs usually mmap the file into memory. That means that parts of it are loaded as used and unloaded if there is no memory left. That's why it does not say it is using memory. Check disc i/o as it is generating the message. For linux that can be seen in htop or iotop, for win idk.

Note that I use lmstudio, that uses llama.cpp to run models. Gpt4all, I think, uses a modified version of same. Doesn't matter they should all be using mmap to load the file.

PS Depending on the model I also get a couple tokens per sec on the cpu.

Edit: Didn't see someone already said the same, I'l leave this here anyway.

[–] gens@programming.dev 28 points 2 days ago

I'v seen him DJ

[–] gens@programming.dev 9 points 2 days ago

You would crossbreed a perfect killing machine with a xenomorph ? Madness

[–] gens@programming.dev 2 points 3 days ago

The only thing that matters in government politics is public opinion.

[–] gens@programming.dev 2 points 4 days ago (1 children)

Yea, no such thing in my country. Practically everyone returns the cart.

[–] gens@programming.dev -2 points 5 days ago (3 children)

Cart retriever ? Why is that even a job.

[–] gens@programming.dev 3 points 2 weeks ago (1 children)

We still have people atacking people with axes and knives. Thing is you can at least try to run away from an idiot with an axe, unlike an idiot with a gun.

[–] gens@programming.dev 4 points 2 weeks ago (1 children)

It's genetics. We produce some oil or something that mosquitos smell. And some people produce more then others.

Basically bad luck.

[–] gens@programming.dev 1 points 2 weeks ago (2 children)

"Open"ai is definitely sharing everything you tipe with your government. Only difference is that chinese care less about your illusions. That said we are not even a blip in the sea of data so it doesn't matter anyway.

Bdw your patriot act says that any data that goes over your border can be stored and used indefinitely. So me seing your comment means your nsa will store it and can use it, even though spying on your own people is against your constitution or something.

 

It's small, palm sized. Lid is held with friction. Pine in tung oil. Feels much better then it looks. I'm not much of a woodworker, as it shows :)

view more: next ›