Cheaters beware: ChatGPT maker releases AI detection tool




  • In US
  • 2023-01-31 18:02:32Z
  • By Associated Press

SAN FRANCISCO (AP) - The maker of ChatGPT is trying to curb its reputation as a freewheeling cheating machine with a new tool that can help teachers detect if a student or artificial intelligence wrote that homework.

The new AI Text Classifier launched Tuesday by OpenAI follows a weeks-long discussion at schools and colleges over fears that ChatGPT's ability to write just about anything on command could fuel academic dishonesty and hinder learning.

OpenAI cautions that its new tool - like others already available - is not foolproof. The method for detecting AI-written text "is imperfect and it will be wrong sometimes," said Jan Leike, head of OpenAI's alignment team tasked to make its systems safer.

"Because of that, it shouldn't be solely relied upon when making decisions," Leike said.

Teenagers and college students were among the millions of people who began experimenting with ChatGPT after it launched Nov. 30 as a free application on OpenAI's website. And while many found ways to use it creatively and harmlessly, the ease with which it could answer take-home test questions and assist with other assignments sparked a panic among some educators.

By the time schools opened for the new year, New York City, Los Angeles and other big public school districts began to block its use in classrooms and on school devices.

The Seattle Public Schools district initially blocked ChatGPT on all school devices in December but then opened access to educators who want to use it as a teaching tool, said Tim Robinson, the district spokesman.

"We can't afford to ignore it," Robinson said.

The district is also discussing possibly expanding the use of ChatGPT into classrooms to let teachers use it to train students to be better critical thinkers and to let students use the application as a "personal tutor" or to help generate new ideas when working on an assignment, Robinson said.

School districts around the country say they are seeing the conversation around ChatGPT evolve quickly.

"The initial reaction was 'OMG, how are we going to stem the tide of all the cheating that will happen with ChatGPT,'" said Devin Page, a technology specialist with the Calvert County Public School District in Maryland. Now there is a growing realization that "this is the future" and blocking it is not the solution, he said.

"I think we would be naïve if we were not aware of the dangers this tool poses, but we also would fail to serve our students if we ban them and us from using it for all its potential power," said Page, who thinks districts like his own will eventually unblock ChatGPT, especially once the company's detection service is in place.

OpenAI emphasized the limitations of its detection tool in a blog post Tuesday, but said that in addition to deterring plagiarism, it could help to detect automated disinformation campaigns and other misuse of AI to mimic humans.

The longer a passage of text, the better the tool is at detecting if an AI or human wrote something. Type in any text -- a college admissions essay, or a literary analysis of Ralph Ellison's "Invisible Man" --- and the tool will label it as either "very unlikely, unlikely, unclear if it is, possibly, or likely" AI-generated.

But much like ChatGPT itself, which was trained on a huge trove of digitized books, newspapers and online writings but often confidently spits out falsehoods or nonsense, it's not easy to interpret how it came up with a result.

"We don't fundamentally know what kind of pattern it pays attention to, or how it works internally," Leike said. "There's really not much we could say at this point about how the classifier actually works."

Higher education institutions around the world also have begun debating responsible use of AI technology. Sciences Po, one of France's most prestigious universities, prohibited its use last week and warned that anyone found surreptitiously using ChatGPT and other AI tools to produce written or oral work could be banned from Sciences Po and other institutions.

In response to the backlash, OpenAI said it has been working for several weeks to craft new guidelines to help educators.

"Like many other technologies, it may be that one district decides that it's inappropriate for use in their classrooms," said OpenAI policy researcher Lama Ahmad. "We don't really push them one way or another. We just want to give them the information that they need to be able to make the right decisions for them."

It's an unusually public role for the research-oriented San Francisco startup, now backed by billions of dollars in investment from its partner Microsoft and facing growing interest from the public and governments.

France's digital economy minister Jean-Noël Barrot recently met in California with OpenAI executives, including CEO Sam Altman, and a week later told an audience at the World Economic Forum in Davos, Switzerland that he was optimistic about the technology. But the government minister - a former professor at the Massachusetts Institute of Technology and the French business school HEC in Paris - said there are also difficult ethical questions that will need to be addressed.

"So if you're in the law faculty, there is room for concern because obviously ChatGPT, among other tools, will be able to deliver exams that are relatively impressive," he said. "If you are in the economics faculty, then you're fine because ChatGPT will have a hard time finding or delivering something that is expected when you are in a graduate-level economics faculty."

He said it will be increasingly important for users to understand the basics of how these systems work so they know what biases might exist.

--

O'Brien reported from Providence, Rhode Island. AP writer John Leicester contributed to this report from Paris.

COMMENTS

More Related News

Sergio Romo smiling through final chapter of MLB career with Giants
Sergio Romo smiling through final chapter of MLB career with Giants

Sergio Romo is humbled to be back with the Giants to close the door on a memorable MLB career in the city it all began.

Why Blake Sabol was
Why Blake Sabol was 'elated' Giants traded for him in Rule 5 Draft

Based on Blake Sabol's love for the West Coast, the 25-year-old catcher certainly would prefer to stay with San Francisco.

OpenAI CEO Sam Altman warns that other A.I. developers working on ChatGPT-like tools won
OpenAI CEO Sam Altman warns that other A.I. developers working on ChatGPT-like tools won't put on safety limits-and the clock is ticking

Society "has a limited amount of time to figure out how to react to that," Altman warned in a new interview.

Why the Microsoft Office-ization of AI makes sense
Why the Microsoft Office-ization of AI makes sense

There's a lot of mystery and glamour surrounding the future of artificial intelligence, which suddenly looks to be gaining capabilities at an incredible pace...

'This Is Ridiculous': CNN Crew in San Fran Targeted by Thieves while Doing Story on Rampant Crime

Members of a CNN crew had their bags stolen out of their rental car while on assignment at San Francisco's city hall for a story about the city's rampant...

Leave a Comment

Your email address will not be published. Required fields are marked with *

Cancel reply

Comments

  • rl26 powder
    (2023-02-01 14:59:59Z)

    I’d like to just simply say what a relief this is to find a person who truly understands what they are speaking about online. You definitely understand how to get your position across. Lots more people ought to look at this and understand this side of the story.

    REPLY
  • Ghkrti
    (2023-02-22 06:11:12Z)

    order digoxin oral lanoxin 250 mg cost molnunat

    REPLY
  • Sqewef
    (2023-02-23 22:04:12Z)

    acetazolamide 250 mg drug diamox 250mg without prescription order generic imuran 50mg

    REPLY
  • Uhfzwv
    (2023-02-27 17:41:33Z)

    buy generic carvedilol 25mg elavil 10mg canada elavil 10mg price

    REPLY
  • Bobrog
    (2023-03-01 04:09:14Z)

    amoxicillin 500mg ca order stromectol for sale stromectol tablets

    REPLY
  • Otknmd
    (2023-03-01 05:48:25Z)

    alendronate online order order fosamax without prescription order motrin 400mg online

    REPLY
  • Yebhqx
    (2023-03-02 14:54:14Z)

    priligy pills buy dapoxetine pills order domperidone 10mg pill

    REPLY
  • Kifpss
    (2023-03-02 17:25:58Z)

    nortriptyline 25 mg generic purchase paxil generic paxil 10mg without prescription

    REPLY
  • Taqvqm
    (2023-03-04 05:04:57Z)

    order indocin 50mg indocin for sale online order cenforce 100mg generic

    REPLY
  • Hzhiel
    (2023-03-04 06:03:50Z)

    pepcid 20mg tablet order prograf 5mg without prescription order mirtazapine without prescription

    REPLY
  • Lmfjrk
    (2023-03-05 17:14:04Z)

    requip online order brand labetalol 100 mg trandate 100 mg tablet

    REPLY
  • Uqttet
    (2023-03-05 17:47:22Z)

    doxycycline generic medrol 8mg online methylprednisolone sale

    REPLY
  • Wqcnfk
    (2023-03-07 19:54:29Z)

    order tadalafil 20mg generic generic trimox order trimox 250mg for sale

    REPLY
  • Shlwwx
    (2023-03-08 19:22:32Z)

    order tadalafil generic sildenafil for men over 50 viagra oral

    REPLY
  • Eeajhs
    (2023-03-09 07:31:31Z)

    buy nexium 20mg generic lasix 100mg brand lasix 40mg

    REPLY
  • Pcrftw
    (2023-03-10 09:33:15Z)

    buy generic tadalafil 5mg medications for ed top ed drugs

    REPLY
  • Bwggnx
    (2023-03-11 03:34:20Z)

    buy minocin 100mg pill hytrin pill buy hytrin 5mg pills

    REPLY
  • Opyyqe
    (2023-03-12 05:31:06Z)

    order modafinil 100mg sale promethazine over the counter cost promethazine

    REPLY
  • Ntzzxw
    (2023-03-12 23:47:53Z)

    order metformin 1000mg online buy metformin 1000mg for sale nolvadex order online

    REPLY
  • Ytigyi
    (2023-03-13 23:51:40Z)

    prednisone 20mg cost buy amoxil 1000mg generic order amoxicillin pill

    REPLY
  • Lrhczo
    (2023-03-14 20:48:16Z)

    buy clomiphene 50mg pill clomiphene pills prednisolone 20mg price

    REPLY
  • Puzdxb
    (2023-03-15 21:04:26Z)

    sildenafil 100mg cheap buy fildena 50mg online buy propecia

    REPLY
  • Hbequv
    (2023-03-16 17:17:16Z)

    order generic isotretinoin buy ampicillin online cheap ampicillin usa

    REPLY
  • Xpimct
    (2023-03-17 20:06:43Z)

    order zofran 4mg online cheap buy bactrim generic bactrim 480mg pills

    REPLY
  • Idowck
    (2023-03-18 19:23:16Z)

    ivermectin for cov 19 buy stromectol 6mg prednisone 20mg price

    REPLY
  • Cdxmqg
    (2023-03-19 21:09:22Z)

    buy ventolin inhalator online cheap augmentin us clavulanate price

    REPLY

Top News: US