trained to answer more complex questions, faster than a human can.
I can answer math questions really really fast. Not correct though, but like REALLY fast!
trained to answer more complex questions, faster than a human can.
I can answer math questions really really fast. Not correct though, but like REALLY fast!
😋
It scores 83% on a qualifying exam for the international mathematics olympiad compared to the previous model's 13% so...
When you say previous model, you mean gemini with alpha geometry (an actual RL method)? Which scored a silver?
I mean not only google did it before, they also released their details unlike openai's "just trust me bro, its RL".
Openai also said that we should reserve 25k tokens for this "reasoning" and they will be charged the same as output tokens which is exorbitantly high (60$ for 1m tokens).
And the cherry on top is that they won't even give us these "reasoning" tokens. How the hell am I supposed to improve my prompts if I can't even see it? How would I reduce the hallucinations without it?
My personal experience is that, it does have an extra reasoning thing going for itself but in no way does it make openai's tactics tolerable. The quality does not increase enough to justify its cost per token, let alone their "reasoning tokens" BS.
So they slapped some reinforcement learning on top of their LLM and are claiming that gives it “reasoning capabilities”? Or am I missing something?
It's like 3 lms on top of eachother in a trenchcoat, and appau a calculator so it gets math right
No the article is badly worded. Earlier models already have reasoning skills with some rudimentary CoT, but they leaned more heavily into it for this model.
My guess is they didn't train it on the 10 trillion words corpus (which is expensive and has diminishing returns) but rather a heavily curated RLHF dataset.
That's not what reasoning is. Training is understanding what they're talking about and being able to draw logical conclusions based on what they've learned. It's being able to say, I didn't know but wait a second and I'll look it up," and then summing that info up in original language.
All Open AI did was make it less stupid and slap a new coat of paint on it, hoping nobody asks too many questions.
And this is something data scientists have already been doing with existing LLMs.
I think I've used it if this is the latest available, and it's terrible. It keeps feeding me wrong information, and when you correct it, it says you're right... But if you ask it again, it again feeds you the wrong information.
if you ask it again, it again feeds you the wrong information
Well, it's a LLM, they can't learn anything without rebuilding the whole model from scratch, which I wouldn't exactly call learning anyway... all they “know” is what word is most likely to follow a certain sequence of words according to their model.
Any other facts or information are completely inconsequential for their operation and results.
I just love how people seem to want to avoid using the word lie.
It’s either misinformation, or alternative facts, or hallucinations.
Granted, a lie does tend to have intent behind it, so with ChatGPT, it’s probably better to say falsehood, instead. But either way, it’s not fact, it’s not truth, and people, especially schools, should stop using it as a credible source.
Being wrong is not the same as lying. When LLMs start giving wrong answers on purpose to mislead people we would have a big problem.
There was a recent paper that argues 'bullshitting' is the most apt analogy. I.e. telling something to satisfy the other person without caring about the truth content of what you say
Dang, OpenAI just pulled an Apple. Do something other people have already done with the same results (but importantly before they made a big fuss about it), claim it's their innovation, give it a bloated name so people imagine it's more than it is and produce a graph comparing themselves to themselves, hoping nobody will look at the competition.
Just like Apple, they have their own selling point, but instead they seem to prefer making up stuff while forgetting why people use em.
On a side note they also pulled an Elon. Where's my AI companion that can comment on video in realtime and sing to me??? Ya had it "working" "live" a couple months ago, WHERE IS IT?!?
Meanwhile a bald turtle and his AI anime daughter on twitch can do exactly this, and he's building her at home on nvidia GPUs.
(Vedal987 and Neuro-sama, if you're curious)
Reinforcement learning my beloved ❤️
Lol Lemmy has the funniest ai haters they drown out any real criticism with stupid strawman nonsense
Now if I want to win the annoying Lemmy bingo I just need to shill extra hard for more restrictive copyright law!
This is a most excellent place for technology news and articles.