this post was submitted on 22 Sep 2023
95 points (93.6% liked)
Technology
59593 readers
3385 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
That's really not the differentiating factor.
Easily 80% of young people loudly commenting on the topic online have no idea about nuances as centrally relevant to where the tech is going as "Do Large Language Models learn world models or just surface statistics?".
I see a ton of young people patting themselves on the back regurgitating what at this point is clear misinformation about stochastic parrots and remixing content that they picked up from similarly poorly informed tech writers with skin in the game, oblivious to the emerging picture in ongoing research.
It is moving too quickly.
Just today I was reading a paper on using CoT prompting (research from 2022) to efficiently transfer domain knowledge from a larger model to a much smaller model which then outperforms the original.
What that's going to mean for Meta's open sourced models, for the market for synthetic data, for the practical limitations on the impact of IP cases - is wild.
And that's just this week's news.
It's way too much too quickly.
Keep in mind that the average practicing doctor is on average 17 years out of touch with the most recent research.
To expect a politician of any age to have a solid grasp on this stuff isn't practical.
There are a number of trends in the research that can be reasonably predicted, but I've never seen a field moving this fast.
The very idea of trying to predict the situation even five years out is ludicrous. By the time legislation proposed today is being passed, it's going to be obsolete.
Regulators are screwed.