• tal@lemmy.today
    link
    fedilink
    arrow-up
    1
    ·
    10 months ago

    There are some external GPUs that can be USB-attached. Dunno about for the Mac. Latency hit, but probably not as significant for current LLM use than games, as you don’t have a lot of data being pushed over the bus once the model is up.