Llama 2 70B with 8b quantization takes around 80GB VRAM if I remember correctly. I’ve tested it a while ago.

I think it was around 7.5k EUR. But because I bought and sold Apple shares with this in mind I’ve paid around 500 EUR for that thing.

And what exactly is wrong with that?

My MacBook Pro was 128 GB of memory is so desperate to fill it up that it gives the applications insane amounts of memory. That only took around 30 GB of memory, so the Mac also loaded the entire file system to the memory which takes around 80 GB. The whole system is super fast because it doesn’t have to read the files from a slow SSD, but from a fast memory.

It’s just a matter of how you look at it. The empty memory = wasted memory.

Get fucked for what? That I’m from the EU? That I send donations to the country at war? That I have a gf?

Not everyone! I’m one of those. From time to time some American reminds me but my brain filters out as a completely useless information and I forget it.

And what’s the difference exactly? As a Czech dating an Ukrainian woman, let me tell you that the difference is that “European” women are spoiled and lazy. My girlfriend is working two jobs (14 to 16 hours a day), she’s facing a lot of discrimination and racism and yet she’s always in a good mood. Everyone is her community is like that.

Maybe you are from a non-Slavic country? To you they might seem different because you don’t understand/know? They are listening to the same music as you, they are watching the same shows on Netflix as you. Their stuff is arguably better than “ours” cough Lions on the jeep cough. Learn the language and you’ll see. For a nation that went through so many tragedies I don’t think it’s fair to look down upon them. Even if they primarily want a protection. So what? Why should you have it and they don’t?