Technology fan, Linux user, gamer, 3D animation hobbyist

Also at:

[email protected]

[email protected]

  • 2 Posts
  • 23 Comments
Joined 1 year ago
cake
Cake day: July 24th, 2023

help-circle

  • Probably better to ask on [email protected]. Ollama should be able to give you a decent LLM, and RAG (Retrieval Augmented Generation) will let it reference your dataset.

    The only issue is that you asked for a smart model, which usually means a larger one, plus the RAG portion consumes even more memory, which may be more than a typical laptop can handle. Smaller models have a higher tendency to hallucinate - produce incorrect answers.

    Short answer - yes, you can do it. It’s just a matter of how much RAM you have available and how long you’re willing to wait for an answer.










  • OpticalMoose@discuss.tchncs.detoSelfhosted@lemmy.worldHardware question
    link
    fedilink
    English
    arrow-up
    0
    arrow-down
    1
    ·
    7 months ago

    I just did a quick bing chat search (“does DRI_PRIME work on systems without a cpu with integrated graphics?”) and it says it will work. I can’t check for you because my CPUs all have graphics.

    I CAN tell you that some motherboards will support it (my ASUS does) and some don’t (my MSI).

    BTW, I’m talking about Linux. If you’re using Windows, there’s a whole series of hoops you have to jump through. LTT did a video a while back.










  • OpticalMoose@discuss.tchncs.detoFediverse@lemmy.worldPaid Servers?
    link
    fedilink
    English
    arrow-up
    1
    ·
    edit-2
    11 months ago

    I kind of feel the same way. When someone is offering service in exchange for pay, it signals that they’re serious about this and see it as a part time job at least, as opposed to someone just doing it as a hobby or just for a learning experience.

    In my search I found 3 that offer multiple services for a single donation/subscription:

    • Neat.Computer - Their terms of service weren’t strong enough for me
    • Tromsite.com - I didn’t like their Peertube upload policy
    • Tchncs.de - The one I ended up joining.

    I really wanted a smaller instance, but I just couldn’t find one that I was happy with.