• 0 Posts
  • 11 Comments
Joined 1 year ago
cake
Cake day: June 16th, 2023

help-circle

  • Well there are 2 things.

    First there is speed for which they do indeed rely on multiple thousands of super high end industrial Nvidia gpus. And since the 10Billion investment from microsoft they likely expanded that capacity. I’ve read somewhere that chatgpt costs about 700,000 a day to keep running.

    There are a few others tricks and caveats here though. Like decreasing the quality of the output when there is high load.

    For that quality of output they do deserve a lot of credit cause they train the models really well and continuously manage to improve their systems to create even higher qualitive and creative outputs.

    I dont think gpt4 is the biggest model that is out there but it does appear to be the best that is available.

    I can run a small llm at home that is much much faster then chatgpt… that is if i want to generate some unintelligent nonsense.

    Likewise there might be a way to redesign gpt-4 to run on consumer graphics card with high quality output… if you don’t mind waiting a week for a single character to be generated.

    I actually think some of the open sourced local runnable llms like llama, vicuna and orca are much more impressive if you judge them on quality vs power requirement.






  • As a lemmy user i can click your name and scroll trough a list of all posts and comments you have made. Thats your data and its currently free for the taking to any corporation.

    Eventually instances may develop ways to protect their users from this for example make posts only visible to verified human members that are members of a community. Now imagine a user joining such community from the meta threads apps. It wouldn’t be beneath them to fulltime record the app screen and ocr all the text the user sees.


  • Pros: millions of users can interact with your instance

    Cons: This is a super blatant attempt to consume all data. They have been doing this for years. “Log in with facebook” They see the value of the fediverse and aim to become the mainstream place for new accounts. Those users can then interact with any kind off community they want. Meta is not responsible for content on other instances. But they are harvesting all of it trough millions of clueless spies.