I'm highschool student, with budget around 1000€/$1050, for the whole computer (have in mind I am from Europe) and I want to build home server to run all of my services (list below) and even some models for copilot like code completion and integration with my notes app and some light image generatin.
NAS, Cloud, git server, some gaming servers, few databases, media streaming services (Jellyfin, and some soud streaming sofrware), VPN, pyhole, rewerse proxy and also remote gaming VM's for me and my gf. I'd also like to run some LLM's on it and some diffusion models as well.
Okay, I want to ask this, because everywhere it is 3090's 4090's, p40's, v100, and even a100, but no one is talking about people, that want to integrate few programs with it, ask it coupe of queryes a day from web UI and generate some images time to time. I wont have 100% on p40 ever I think, but it is my first time getting in contact with this kinds of GPU's)
The problem is, I am highschool atudent from Czech republic and we don't have much enterprise GPU's laing around locally and if, they are Maxwell, or Keppler GPU's If I see some on ebay, they are supricingly cheap, but all from China and I don't know if I should trust it (never bought shipped second hand) I also have a little budget to fit into, but the prices I see for the p40's are good (usually around $250) i have a budget that is only $400 for the GPU, so only RTX cards in non used market are 4060's (and maybe even some 4070 if I strech my budget enough) but they all have only 8 GB VRAM and I want to run Windows VM on top of proxmox which will run the models as containers, I think it is possible. I would buy some AMD card, but I don't know if it wouldn't be waste if money.
I already have a CPU, so I can theoreticly save on that, and it is fucking ryzen 3 1200 so IDK
I'm building a home server ) and I want to run some LLM's and even something like stable diffussion on it as well.
So, what is the best GPU, that I can get on this budget? (Used and new options, idc, if it's not scatchy)
Can I use AMD GPU's cuz they have more VRAM for less money, but they don't have CUDA, so I don't know?
Is it safe to buy $250 p40 of Chinase company from ebay?