minus-squarecoja@lemmy.mltoSelfhosted@lemmy.world•What would be the cheapest and most cost-effeciant way of self hosting LLMslinkfedilinkarrow-up3·edit-23 months agoNot sure about the setup, but I believe 7600XT would be the best buy, it has 16GB VRAM and it’s supported now linkfedilink
coja@lemmy.ml to Piracy: ꜱᴀɪʟ ᴛʜᴇ ʜɪɢʜ ꜱᴇᴀꜱ@lemmy.dbzer0.com · 10 months agoDeploy the cracklemmy.mlimagemessage-square26fedilinkarrow-up11.02Karrow-down121
arrow-up1997arrow-down1imageDeploy the cracklemmy.mlcoja@lemmy.ml to Piracy: ꜱᴀɪʟ ᴛʜᴇ ʜɪɢʜ ꜱᴇᴀꜱ@lemmy.dbzer0.com · 10 months agomessage-square26fedilink
Not sure about the setup, but I believe 7600XT would be the best buy, it has 16GB VRAM and it’s supported now