229
Apple wants AI to run directly on its hardware instead of in the cloud
(arstechnica.com)
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 22 Dec 2023
229 points (95.6% liked)
Technology
58150 readers
6212 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
How's that supposed to work?
I'm picturing a backpack full of batteries and graphics cards. Maybe they're talking about a more limited model?
This is a Financial Times article, regurgitated by Ars Technica. The article isn't by a tech journalist, it's by a business journalist, and their definition of "AI" is a lot looser than what you're thinking of.
I'm pretty sure they're talking about things that Apple is already doing not just on current hardware but even on hardware from a few years ago. For example the keyboard on iOS now uses pretty much the same technology as ChatGPT but scaled way way down to the point where "Tiny Language Model" would probably be more accurate. I wouldn't be surprised if the training data is as small as ten megabytes, compared to half a terabyte for ChatGPT.
The model will learn that you say "Fuck Yeah!" to one person and "That is interesting, thanks for sharing it with me." to someone else. Very cool technology - but it's not AI. The keyboard really will suggest swear words now by the way - if you've used them previously in a similar context to the current one. The old algorithmic keyboard had hardcoded "do not swear, ever" logic.
I've been playing with llama.cpp a bit for the last week and it's surprisingly workable on a recent laptop just using the CPU. It's not really hard to imagine Apple and others adding (more) AI accelerators on mobile.
Oh yes and the CPUs on phones have being getting more powerful every year and there was nothing that could take advantage of their full potential now with a local AI will be great for privacy and response.
Google is already doing this with Gemini Nano. https://store.google.com/intl/en/ideas/articles/pixel-feature-drop-december-2023
They're making their own silicone now. You can achieve a lot more efficiency when you're streamlined the whole way through.
It’s silicon. Silicon is a naturally occurring chemical element, whereas silicone is a synthetic substance.
Silicon is for computer chips, silicone is for boobies.
By making their own, you mean telling Taiwan Semiconductor Manufacturing Company “hey we are going to buy enough of these units that you have to give us the specs we chose at a better price than the competitors, and since we chose the specs off your manufacturing capacity sheets we will say “engineered in Cupertino TM” “
Btw I’m not shitting on Apple here. I love my m2 processor.
Sure, but being that pedantic is neither concise or pertinent to the question at hand.
Apple is neither making nor engineering silicon for any of their produce.
Yes, like google is doing with their tensor chips in the pixels