this post was submitted on 19 Apr 2025
422 points (92.2% liked)

Technology

69156 readers
3676 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] boonhet@lemm.ee 81 points 3 days ago* (last edited 3 days ago) (2 children)

AI AI AI AI

Yawn

Wake me up if they figure out how to make this cheap enough to put in a normal person's server.

[–] Zip2@feddit.uk 121 points 3 days ago (4 children)

normal person’s server.

I’m pretty sure I speak for the majority of normal people, but we don’t have servers.

[–] umbraroze@slrpnk.net 45 points 3 days ago (3 children)

Yeah, when you're a technology enthusiast, it's easy to forget that your average user doesn't have a home server - perhaps they just have a NAS or two.

(Kidding aside, I wish more people had NAS boxes. It's pretty disheartening to help someone find old media and they show a giant box of USB sticks and hard drives. In a good day. I do have a USB floppy drive and a DVD drive just in case.)

[–] KnightontheSun@lemmy.world 15 points 3 days ago (1 children)

Hello fellow home labber! I have a home built xpenology box, proxmox server with a dozen vm’s, a hackentosh, and a workstation with 44 cores running linux. Oh, and a usb floppy drive. We are out here.

I also like long walks in Oblivion.

[–] neatobuilds@lemmy.today 7 points 3 days ago

Man oblivion walks are the best until a crazy woman comes at you trying to steal your soul with a fancy sword

lol yeah, the lemmy userbase is NOT an accurate sample of the technical aptitude of the general population 😂

[–] pivot_root@lemmy.world 4 points 3 days ago

It's pretty disheartening to help someone find old media and they show a giant box of USB sticks and hard drives.

Equally disheartening is knowing that both of those have a shelf-life. Old USB flash drives are more durable than the TLC/QLC cells we use today, but 15 years sitting unpowered in a box doesn't have very good prospects.

[–] peteyestee@feddit.org 53 points 3 days ago

Ikr...Dude thinks we're restaurants or something.

[–] fmstrat@lemmy.nowsci.com 4 points 2 days ago

"Normal person" is a modifier of server. It does not state any expectation of every normal person having a server. Instead, it sets expectation that they are talking about servers owned by normal people. I have a server. I am norm.. crap.

[–] notabot@lemm.ee 18 points 3 days ago (1 children)

You... you don't? Surely there's some mistake, have you checked down the back of your cupboard? Sometimes they fall down there. Where else do you keep your internet?

Appologies, I'm tired and that made more sense in my head.

[–] Zip2@feddit.uk 27 points 3 days ago* (last edited 3 days ago) (1 children)

Well obviously the internet is kept in a box, and it’s wireless. The elders of the internet let me borrow it occasionally.

[–] gravitas_deficiency@sh.itjust.works 6 points 3 days ago (2 children)

You can get a Coral TPU for 40 bucks or so.

You can get an AMD APU with a NN-inference-optimized tile for under 200.

Training can be done with any relatively modern GPU, with varying efficiency and capacity depending on how much you want to spend.

What price point are you trying to hit?

[–] boonhet@lemm.ee 8 points 3 days ago (2 children)

What price point are you trying to hit?

With regards to AI?. None tbh.

With this super fast storage I have other cool ideas but I don't think I can get enough bandwidth to saturate it.

[–] barsoap@lemm.ee 0 points 3 days ago

With regards to AI?. None tbh.

TBH, that might be enough. Stuff like SDXL runs on 4G cards (the trick is using ComfyUI, like 5-10s/it), smaller LLMs reportedly too (haven't tried, not interested). And the reason I'm eyeing a 9070 XT isn't AI it's finally upgrading my GPU, still would be a massive fucking boost for AI workloads.

[–] gravitas_deficiency@sh.itjust.works -1 points 3 days ago (1 children)

You’re willing to pay $none to have hardware ML support for local training and inference?

Well, I’ll just say that you’re gonna get what you pay for.

[–] bassomitron@lemmy.world 9 points 3 days ago (1 children)

No, I think they're saying they're not interested in ML/AI. They want this super fast memory available for regular servers for other use cases.

[–] boonhet@lemm.ee 3 points 2 days ago (1 children)
[–] caseyweederman@lemmy.ca 1 points 2 days ago (1 children)

I have a hard time believing anybody wants AI. I mean, AI as it is being sold to them right now.

[–] boonhet@lemm.ee 3 points 2 days ago

I mean the image generators can be cool and LLMs are great for bouncing ideas off them at 4 AM when everyone else is sleeping. But I can't imagine paying for AI, don't want it integrated into most products, or put a lot of effort into hosting a low parameter model that performs way worse than ChatGPT without a paid plan. So you're exactly right, it's not being sold to me in a way that I would want to pay for it, or invest in hardware resources to host better models.

[–] WorldsDumbestMan@lemmy.today 1 points 2 days ago

I just use pre-made AI's and write some detailed instructions for them, and then watch them churn out basic documents over hours...I need a better Laptop