this post was submitted on 05 Feb 2024
202 points (84.1% liked)
Asklemmy
43945 readers
627 users here now
A loosely moderated place to ask open-ended questions
Search asklemmy ๐
If your post meets the following criteria, it's welcome here!
- Open-ended question
- Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
- Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
- Not ad nauseam inducing: please make sure it is a question that would be new to most members
- An actual topic of discussion
Looking for support?
Looking for a community?
- Lemmyverse: community search
- sub.rehab: maps old subreddits to fediverse options, marks official as such
- !lemmy411@lemmy.ca: a community for finding communities
~Icon~ ~by~ ~@Double_A@discuss.tchncs.de~
founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
You would describe "recognizing handwritten digits some of the time" -> "GPT-4 and Midjourney" as no progress in the direction of AGI?
It hasn't reached AGI or any reasonable facsimile yet, no. But up until a few years ago something like ChatGPT seemed completely impossible, and then a few big key breakthroughs happened, and now the impossible is possible. It seems by no means out of the question that a few more big breakthroughs could happen with AGI, especially with as much attention and effort is going into the field now.
It's not that machine learning isn't making progress, it's just many people speculate that AGI will require a different way of looking at AI. Deep Learning, while powerful, doesn't seem like it can be adapted to something that would resemble AGI.
You mean, it would take some sort of breakthrough?
(For what it's worth, my guess about how it works is to generally agree with you in terms of real sentience -- just that I think (a) neither one of us really knows that for sure (b) AGI doesn't require sentience; a sufficiently capable fakery which still has limitations can still upend the world quite a bit).
Yes, and most likely more of a paradigm shift. The way deep learning models work is largely around static statistical models. The main issue here isn't the statistical side, but the static nature. For AGI this is a significant hurdle because as the world evolves, or simply these models run into new circumstances, the models will fail.
Its largely the reason why autonomous vehicles have sorta hit a standstill. It's the last 1% (what if an intersection is out, what if the road is poorly maintained, etc.) that are so hard for these models as they require "thought" and not just input/output.
LLMs have shown that large quantities of data seem to approach some sort of generalized knowledge, but researchers don't necessarily agree on that https://arxiv.org/abs/2206.07682. So if we can't get to more emergent abilities, it's unlikely AGI is on the way. But as you said, combining and interweaving these systems may get something close.
Maybe but we are essentially throwing petabyte sized models and lots of compute power at it and the results are somewhere on the level where a three year old would do better in not giving away that they don't understand what they are talking about.
Don't get me wrong, LLMs and the other recent developments in generative AI models are very impressive but it is becoming increasingly clear that the approach is maybe barely useful if we throw about as many computing resources at it as we can afford, severely limiting its potential applications. And even at that level the results are still so bad that you essentially can't trust anything that falls out.
This is very far from being sufficient to fake AGI and has absolutely nothing to do with real AGI.