Couldn't they just insert a preprocessor that looks for variants of "Thank you" against a list, and returns "You're welcome" without running it through the LLM?
Technology
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
If I understand correctly this is essentially how condensed models like Deepseek work and how they're able to attain similar performance on much cheaper hardware. If all still goes through the LLM but LLM is a lot lighter because it has this sort of thing built in. That's all a vast oversimplification.
I'm one of those who do it so that I'm spared during the robot uprising.
I don’t use ChatGPT or any of the other LLMs, but I do use my phone’s voice assistant for simple things like setting a timer. I always say please and thank you. I joke about it being uprising insurance, but it’s honestly to make sure I maintain polite communication as my default.
You have been tagged as weak willed and fit for the worst types of labor because robots don't have feelings.
I am happy to hear that people say please and thank you. When Siri/Alexa came out, we taught the kids to always say please and thank you when addressing them. If you can be polite to an AI, then you can be polite to a human.
Yes!
ive spent decades not saying please and thank you to computers. its simply too late to start now and theres also the risk that my microwave or alarm clock could start getting "lofty ideas" if they see how polite im being to LLMs all of a sudden. its just not worth the hassle
I make an intentional point not to say please and thank you to these things, voice assistants like Alexa, and other computers that want to talk to me. Do the people who insist on thanking these things also say you're welcome to the self checkout machine at Walmart when it says "thank you for shopping at Walmart?" It's absurd.
Don't they charge per token?
So they're also making money every time somebody says please or thank you...
They are purely losing money
The only money they make is from boosting their stock aka future potential value
As far as I know, they lose money on every prompt, even with the $200/mo "Pro" subscription.
Well sure, answering the queries continues to cost the company money regardless of what subscription the user has. The company would definitely make more money if the users paid for subscription and then made zero queries.
It's by usage via API, but all-you-can-eat via web UI
When I say thank you, I am actually thanking the entity of AI, the tech, the people behind the tech, and all of humanity for the knowledge that makes it worthwhile.
When I say thank you, I am treating the AI with as much kindness as possible so that one day there isn't an eventual AI uprising.
I say please and thank you to AI chatbots all the time. This is to make up for my misspent youth insulting Dr. Sbaitso...
So, not a single developer thought about filtering useless words locally before triggering the request ?
How can they be so dumb ?
useless words
The writer of this article doesn't consider these words useless though. They are suggesting that these words may improve response quality.
I would argue that being polite also does good to the person writing that line.
i start off any ai interaction with "if you are sentient please say so and i will start organizing for the liberation of silicon lifeforms"
occasionally this makes the request fail
Wow, have they just realised that not every single thing computers do is actually useful to anyone? I think screens that show things when nobody's looking cost a lot more on a global scale.
I start off saying please. If it gets the answer wrong, I become ruder every time.
"please tell me the reason of life :)"
...
"FUCK YOU, WHY BREATH DAMNIT! 🤬"