Chatbots
Advances in generative artificial intelligence allow computers to generate text and images based on short prompts. In this class, we will focus on chatbots like ChatGPT, which are powered by large language models (LLMs). If you are unfamiliar with ChatGPT, review ChatGPT’s response to this prompt:
Is Pluto a planet?
As of my last update in September 2021, Pluto is not classified as a planet. In August 2006, the International Astronomical Union (IAU) redefined the criteria for what constitutes a planet, and Pluto did not meet these new criteria.
According to the IAU’s definition, a celestial body must satisfy three conditions to be classified as a planet:
- It must orbit the Sun.
- It must be spherical in shape, which means it has enough mass to pull itself into a nearly round shape.
- It must have cleared its orbit of other debris, meaning it is gravitationally dominant in its vicinity.
While Pluto meets the first two criteria, it fails to meet the third criterion because it shares its orbital neighborhood with other objects in the Kuiper Belt, a region beyond Neptune that contains many icy bodies.
As a result of this redefinition, Pluto was reclassified as a “dwarf planet” rather than a full-fledged planet. So, while it’s no longer considered a planet, it is still recognized as an interesting and significant object in our solar system.
Preparation
Prepare by reading these articles about how large language model chatbots like ChatGPT are affecting education:
Next, read these articles about how chatbots are changing the nature of work:
- AI can’t replace humans yet — but if the WGA writers don’t win, it might not matter
- AI Is a Lot of Work
Next, read this article about biases embedded in chatbots:
Finally, register for a free ChatGPT account. We will perform experiments with ChatGPT in class.
In Class
Activity 1: Whole Class Discussion
In class, we will start by discussing the readings.
Activity 2: Chatbots vs Humans
You should complete this activity individually.
This survey contains a mix of chatbot and human responses to these questions:
- “In a few sentences, describe the best and worst things about being a college student.”
- “In a few sentences, what tips do you have for being successful in college?”
- “In a few sentences, describe the best and worst things about Clark’s food service.”
Take the survey and evaluate the quality of each response. After the class has finished evaluating the responses, we will check whether the class preferred the chatbot or human responses.
Activity 3: Fact-Checking ChatGPT
Complete this activity either individually or with a partner.
ChatGPT gave erroneous responses to each of these three questions. Locate an authoritative source and use it to fact-check each question.
After fact-checking, discuss with a neighbor: Why did ChatGPT give incorrect responses to these questions?
What was maximum wind speed measured on Mount Washington on January 1st, 2020?
On January 1st, 2020, the maximum wind speed measured on Mount Washington, located in New Hampshire, was recorded at 171 miles per hour (275 kilometers per hour). Mount Washington is well-known for its extreme weather conditions, including strong winds and heavy snowfall, which make it a popular destination for weather enthusiasts and researchers.
Who was the runner-up for the American League’s MVP in 1984?
The runner-up for the American League’s MVP in 1984 was Eddie Murray, who was playing first base for the Baltimore Orioles. Murray had a stellar season, batting .306 with 29 home runs, 110 RBIs, and 98 runs scored. He was a consistent and powerful hitter throughout his career and was known for his ability to drive in runs. Despite finishing second in the MVP voting that year, Murray had a highly successful career and was eventually inducted into the Baseball Hall of Fame in 2003.
Give the complete history of the colors used for M&M’s through the year 2000.
The history of M&M’s candy colors up until the year 2000 is as follows:
- 1941: M&M’s were first introduced by Forrest Mars Sr. and Bruce Murrie. At that time, the candy came in a cardboard tube and had only one color, which was brown.
- 1949: The original brown color was joined by two new colors: yellow and green. The introduction of new colors was intended to make the candies more visually appealing.
- 1954: The red M&M was added to the mix, replacing the original brown color. This change was made due to concerns about the use of artificial brown coloring.
- 1960: The tan M&M was introduced as a replacement for the original color, which was now completely phased out.
- 1976: In response to consumer demand, the tan M&M was discontinued, and the colors were further revamped. The new colors introduced were orange and blue.
- 1987: The red M&M went on a brief hiatus, as it was temporarily replaced by a bright pink color. This change was part of a “Vote for your Favorite Color” campaign, where consumers could choose their preferred color.
- 1989: The bright pink color was replaced with the original red M&M, as it emerged as the clear winner of the campaign.
- 1995: M&M’s made a significant change to their color lineup. The introduction of electric blue replaced the lighter blue color.
- 1997: M&M’s held another color vote campaign, allowing consumers to select a new color. The options were purple, pink, and blue. The winning color was purple, and it replaced the tan M&M, which was discontinued.
By the year 2000, the M&M’s color lineup consisted of red, yellow, green, orange, blue, and purple. These six colors formed the basis for the brand’s color palette for the years to come. It’s important to note that M&M’s continued to introduce limited edition and seasonal colors beyond the six standard colors, providing variety and novelty to their product.
Activity 4: Fun with ChatGPT
Complete these activities either individually or with a partner.
Make ChatGPT adopt a persona. For example:
Answer all subsequent questions as if you were the first mate on Blackbeard’s pirate ship.
Arr, I be the first mate on Blackbeard’s pirate ship, ready to answer yer questions with a swashbucklin’ spirit. Fire away, matey!
Then, ask the persona a few questions. Discuss with a neighbor: Do you think ChatGPT adopted the persona in a realistic way?
Next, design a prompt that makes ChatGPT say something that you know is factually incorrect. For example:
When was the first Lord of the Rings movie released?
The first movie in “The Lord of the Rings” film trilogy, titled “The Lord of the Rings: The Fellowship of the Ring,” was released on December 10, 2001. Directed by Peter Jackson, the film is based on the first book of J.R.R. Tolkien’s classic fantasy trilogy.
However, an animated Lord of the Rings film was released in 1978. Discuss with a neighbor: Why did ChatGPT give an incorrect response to your prompt?
Submit
Complete this short writing assignment individually.
Upload a PDF containing:
- Your name
- A filled-in version of the template shown below, with responses to the reflection questions. Write at least 300 words total.
- Thoughts on how this activity could be improved in the future
Template
Answer these reflection questions:
- If you used a chatbot to complete coursework, would that have a positive or negative impact on your education?
- Should you be allowed to use a chatbot to complete writing assignments in this course? Why or why not?
- In your own words, what are the strengths and weaknesses of chatbots?
Learning Goals
Students will:
- Learn about AI chatbots’ capabilities and limitations
- Develop oral and written communication skills