ChatGPT is unreliable - as if we didn't know!

agraham

agraham

Expert
Licensed User
Longtime User
Before considering using ChatGPT for anything important you should read this and be suitably careful/terrified!
www.dailykos.com

"There are four T's in the word Tattle." A trivial but disquieting encounter with ChatGPT

(Update: Here is a link to the full chat: chat.openai.com/… ) That’s what it tried to tell me: Me: How many T's are in "Tattle" ChatGPT: There are four "T's" in the word "Tattle." Wow. How did we get here? Let me back up. I am a retired data monkey....
www.dailykos.com
 
LucaMs

LucaMs

Expert
Licensed User
Longtime User
1697372496938.png


The sentence I highlighted is the one that ChatGPT writes most often, enormously often.


It occurred to me that today's young people, middle school students, might be lucky, they could have ChatGPT do tasks like grammatical analysis and logic for them.

So I wrote a very short Italian sentence containing an error, a wrong verb, and I asked it to correct it. It replied that the sentence is already correct and repeated that it is. So I pointed out to it that the mistake was in that verb and, finally, after apologizing, it corrected that sentence.

1697372946248.png

1697372984652.png
 
B

Brian Dean

Well-Known Member
Licensed User
Longtime User
I must start by saying that I am very impressed by ChatGPT. I rarely use it, and have been given incorrect answers, but I still find it impressive. It certainly passes the Turing Test, although I accept that doing so does not require intelligence. And certainly real, intelligent people can give incorrect answers, so no problem there. What I find interesting in this example is "How is it getting this question wrong?". You won't find the answer to "How many "t"s in tattle?" in Wikipedia, so some other path must be getting invoked, and what could that be if it obviously cannot do the job?
 
toby

toby

Well-Known Member
Licensed User
Longtime User
ChatGPT seems to be able to learn from its own mistake.
test.jpg
 
Mark Turney

Mark Turney

Active Member
Licensed User
Longtime User
agraham said:
Before considering using ChatGPT for anything important you should read this and be suitably careful/terrified!
www.dailykos.com

"There are four T's in the word Tattle." A trivial but disquieting encounter with ChatGPT

(Update: Here is a link to the full chat: chat.openai.com/… ) That’s what it tried to tell me: Me: How many T's are in "Tattle" ChatGPT: There are four "T's" in the word "Tattle." Wow. How did we get here? Let me back up. I am a retired data monkey....
www.dailykos.com
Click to expand...
I’ve never bought into the whole AI push. I think it’s just another thing to eventually “sell”. What I mean is that if you build dependence on something, providing it for free or very cheaply, then later you can build it into things which can be sold. I’m certainly not anti-capitalist; I just believe that the “product” should be beneficial or novel. IMHO - AI is neither. My $0.02.
 
73Challenger

73Challenger

Member
Licensed User
I find it helpful for the following.
1. "The Junior Dev Role" - Asking it to give me well known boiler plate functions. Like "give me a function to download html from finance.yahoo.com" in C#. The easy, short, well known boiler plate...it does ok with and saves me time typing.
2. Text manipulation - "Rewrite this list of variables, change the ones that start with m_ and a number to p_ and a number but move the number to the end for the new p_ variables.... something like that. I know I know "replace" does most of it well, but I'm talking about much more complex examples.
3. Stuff I don't know...with a caveat - If there is something I don't know how to do, I do like to "ask" ChatGPT how to do it. With the caveat.... I KNOW I will have to fix the code. But... if I know zero about how to do "something" Chat GPT can at least give me a jump start. It will likely not be correct...but it gets the ball rolling

But...ya .. anything over a simple, well known code snippet is iffy for ChatGPT / Bard ... and the worst part is...it writes it out with confidence. My co-worker calls it "authoritative bu11$h1t" ya... a pretty accurate assessment :)
 
William Lancee

William Lancee

Well-Known Member
Licensed User
Longtime User
@LucaMs
I am sorry about your name. I don't have access to famous B4X people's private information.
Although I think this was just my error. Mea culpa. It won't happen again!
 
MicroDrie

MicroDrie

Well-Known Member
Licensed User
Longtime User
This reminds me of my old math teacher. He already spoke 50 years ago: "A scientific bullshit covered in a logarithm sauce" when on the surface it seemed to be correct, but upon further investigation it made no sense and you were told that you heard the bell ringing, but you did not know where the clapper hung.
 
Beja

Beja

Expert
Licensed User
Longtime User
agraham said:
Before considering using ChatGPT for anything important you should read this and be suitably careful/terrified!
www.dailykos.com

"There are four T's in the word Tattle." A trivial but disquieting encounter with ChatGPT

(Update: Here is a link to the full chat: chat.openai.com/… ) That’s what it tried to tell me: Me: How many T's are in "Tattle" ChatGPT: There are four "T's" in the word "Tattle." Wow. How did we get here? Let me back up. I am a retired data monkey....
www.dailykos.com
Click to expand...

I use chatGPT often for text editing (grammar, formatting, style.... etc. and it's good in that. It can edit your book if you
know how to ask. It can also write for you official or social letters.
 
You must log in or register to reply here.
Top