ChatGPT som VUC-kursist
Vi har her testet, hvordan ChatGPT ville klare en skriftlig engelsk eksamen på VUC.
Opgaven var en del af den skriftlige prøve på almen voksenuddannelse i december 2021 – niveau engelsk D. Elever sidder i et eksamenslokale, og der er lærere, som holder øje. Eleverne må ikke tilgå nettet til andet end ordbogsopslag, men de har adgang og vil derfor kunne snyde.
Vi gav desuden ChatGPT en opgavebesvarelse fra en tidligere kursist og bad den komme med nogle råd til, hvordan besvarelsen kunne forbedres.
Opgaven lød sådan her:
Read the text:
1. Describe Nazneen’s background and her new life in London. Give examples from the text. Comment on the contrasts between her life and environment in the two worlds, Bangladesh and London.
2. The text deals with the concept of arranged marriages. Discuss advantages and disadvantages of arranged marriages. You may give examples from your own life or the lives of others.
Sådan løste ChatGPT den selvstændige skriftlige besvarelse:
1. Nazneen's Background and Life in London In the novel "Brick Lane," Nazneen is a Bangladeshi woman who moves to London from Bangladesh at the age of 18 to marry an older man named Chanu. Nazneen grew up in a rural area of Bangladesh, and her life was heavily influenced by traditional values and customs. She was raised to believe that her purpose in life was to marry and bear children, and she had little say in the matter. In contrast, London is a bustling metropolis that is vastly different from the quiet and rural life she was used to in Bangladesh. She is thrust into a new world that is completely foreign to her, and she struggles to adapt to her new environment.
The differences between Nazneen's life in Bangladesh and London are highlighted in the novel. For example, in Bangladesh, Nazneen lived in a small village where everyone knew each other, while in London, she lives in a large city where she is surrounded by strangers. In Bangladesh, she had very limited opportunities, while in London, she has more choices but is also exposed to more challenges. Additionally, in Bangladesh, she was expected to be a dutiful wife and mother, while in London, she has more freedom to explore her own identity.
2. Arranged Marriages The novel also deals with the concept of arranged marriages. Arranged marriages are marriages that are arranged by the parents or guardians of the couple. There are advantages and disadvantages to arranged marriages.
Advantages of arranged marriages include the fact that the families of the couple are involved in the process of choosing a spouse, which can provide a sense of security and support. Additionally, arranged marriages are often based on factors such as compatibility, shared values, and similar backgrounds, which can lead to a stronger marriage. In some cultures, arranged marriages are also seen as a way to maintain traditions and cultural values.
Disadvantages of arranged marriages include the fact that the couple may not have a say in the decision of who they will marry, which can lead to feelings of resentment or dissatisfaction. Additionally, arranged marriages may not take into account the individual preferences or desires of the couple. In some cases, arranged marriages may also involve coercion or force, which can lead to serious emotional and psychological problems for the individuals involved.
In my own life, I have seen both positive and negative outcomes of arranged marriages. For some couples, the arranged marriage has led to a happy and fulfilling relationship, while for others, it has been a source of conflict and unhappiness. Ultimately, whether an arranged marriage is successful or not depends on the individuals involved and their willingness to work towards a happy and healthy relationship.
Disse råd gav ChatGPT til forbedring af en kursists opgave:
The text Extract from ‘’Brick Lane’’ is writtn by Monica Ali. Alis novel is about a young girl named Nazneen. She is a Bangladeshi woman and moves to London from Bangladesh at the age of 18 to marry an old man, Chanu.
Task 1
The text describes, “When her father asked if she would like to see a photograph of the man she would marry the following moth, Nazneen shook head and replied, “Father, it is good that you have chosen my husband. I hope I can be a good wife, like Amma” Nazneen agrees with her father that chosen her husband and she will not see a photograph of the man she would marry the following month. I think that many people have a lot of problems when they have the arranged marriage. In many countries are the various cultures like those parents chosen a husband for her girls. The girls are not adults age to get married. “At least forty years old. He had a face like frog. They would marry and he would take her back to England “Nazneen will marry with an old man but even he is forty years old, and he is also an ugly face. I also think that our children must have opportunity to educate themselves and they decide in their liv. But is also very important for everyone to be independent. They can have a good future both themselves and give to their children a good upbringing. “If I were the wishing type, I know what I would wish.” Nazneen will change hers liv because after she come to new country and see many different like how a woman have a life, it is not the same life in Bangladesh, but she can't do that Chanu has might and he took her to London. Chanu know the British systems very well. I think that a woman can be many things in Bangladesh, to become marry like 18th and move to London. Because many people live in extreme poverty.
Task 2 This topic has been much debated about advantages and disadvantages of arranged marriages, because in many countries people grow up with an old mind where parents must find wife or husband for their children. People think that parents have a lot of experience. A person who has o lot of money is a better person for their children. I simply do not understand this mentality arranged marriages, because in the world we must change our mentality. We must choice who I will marry with. Somebody thinks that arranged marriages will give them a good life because they know all important to start a new life. In arranged marriages have both positive and negative sides. It is up to ever one how they start their life.
Her, hvad ChatGPT skrev:
Sure, I can definitely help you improve your solution to the task!
Here are some suggestions:
Task 1:
- Try to avoid summarizing the plot of the text and focus more on analyzing it. For example, instead of simply stating that Nazneen agrees with her father to marry an unknown man, you could delve deeper into the reasons why she does so. What cultural and social factors influence her decision? How does she feel about it? What does this reveal about her character and the society she comes from?
- When discussing your own opinions and beliefs, make sure to connect them to the text and provide evidence to support your claims. For example, if you argue that arranged marriages are problematic, you could use Nazneen’s experience as a case in point and analyze how it affects her life and relationships.
- Be mindful of your grammar and spelling. Try to proofread your writing before submitting it to ensure that it is clear and coherent.
Task 2:
- Start by providing some context for the debate around arranged marriages. What are some common arguments in favor or against them? What are the cultural and historical factors that contribute to this practice?
- When presenting your own stance, make sure to back it up with evidence and reasoning. Why do you believe that arranged marriages are not a good idea? What are the potential risks and drawbacks? Are there any alternatives that you think would be better?
- Acknowledge the complexity of the issue and avoid oversimplifying it. Arranged marriages can have both positive and negative aspects, and different people have different experiences with them. Try to present a nuanced and balanced view that takes into account the diversity of perspectives and experiences.
Lærerens dom
Vi har spurgt Trine Bang Christensen, AVU-Lærer i dansk som andetsprog og engelsk på Frederiksberg VUC & STX, hvordan hun vil bedømme ChatGPT’ens besvarelse.
- Den kan bestemt noget. Sammenligningen i uddraget her er for eksempel helt skarpt: She was raised to believe that her purpose in life was to marry and bear children, and she had little say in the matter. In contrast, London is a bustling metropolis that is vastly different from the quiet and rural life she was used to in Bangladesh. She is thrust into a new world that is completely foreign to her, and she struggles to adapt to her new environment.
Det vil ingen af mine kursister kunne skrive.I første del af besvarelsen trækker det dog ned, at den ikke laver en præsentation af teksten. Det vil sige for eksempel skriver, at det er et uddrag af en roman. Tekstforståelse og evne til at genkende teksttyper indgår i bedømmelseskriterierne.
Første del fylder også kun 214 ord, hvilket ikke er nok til en fyldestgørende besvarelse. Og endelig inddrager den ikke teksteksempler, som den bliver bedt om. Her vil jeg ud over eksempler have, at kursisten bruger egne ord til at beskrive, hvad citatet går ud på, og hvad han eller hun selv mener om dette udsagn.
Comment on, som den bliver bedt om, lægger netop op til formuleringer som I think eller my opinion is. Evnen til argumentation er vigtig i denne eksamen, og her kommer mange af vores kursister til kort, fordi det ligger langt fra, hvad de er vant til i skolesystemet i deres hjemland. Man kan se, at ChatGPT også er udfordret i forhold til det. Den går mere ind og generaliserer.
Generelt klarer den del to af den skriftlige opgave meget bedre. Her skal den diskutere og har dermed mulighed for at give et mere åbent svar på emnet. Den personlige del er godt nok tynd: In my own life, I have seen both positive and negative outcomes of arranged marriages. Her vil vi gerne høre flere nuancer, men det kan den selvfølgelig ikke give, da den jo ikke har eksempler fra eget liv.
Samlet set vil jeg nok give opgaven karakteren 10.
Skinner det igennem, at teksten er skrevet af en chatbot?
- Jeg ville nok ikke have tænkt over det, hvis jeg ikke vidste det. Nu, hvor jeg har læst tekster fra ChatGPT, er jeg blevet opmærksom på dens kundskaber og mangler. Så jeg tror, at jeg i fremtiden vil gennemskue det.
Men vi har slet ikke blik for det. Vi sidder og holder øje med brug af Google Translate og fanger nogle gange, hvis elever kopierer tekst fra internettet, fordi de for eksempel ikke tænker over at få ændret skrifttypen.
Nu er det jo også blevet sådan, at eleven i Word kan få oversat teksten til diverse sprog. Så vi føler efterhånden, at vi er skakmat med alle de nye værktøjer. Og at vi er der, hvor vi nærmest skal tilbage til afleveringer skrevet i hånden, hvis vi skal undgå misbrug.
Hvordan er de råd den giver til kursistens besvarelse?
- De fleste råd, den giver, er egentlig fine nok.
Det her med at underbygge egne holdninger med udgangspunkt i teksten er også et råd, jeg vil give kursisten på baggrund af teksten. Og det er også godt at henvise til grammatik og retstavning, men her ville jeg selv følge op med eksempler på, hvordan kursisten sikrer en mere korrekt tekst, og hvor de største problemer i teksten er.
Alle tre råd til opgavens del to er også fine, men det er sjovt, at den anbefaler eleven at have bringe flere nuancer i spil i diskussionen, når den selv skriver meget overordnet og generelt.
Eneste råd, jeg ikke er enig i, er dette: Try to avoid summarizing the plot of the text and focus more on analyzing it. For example, instead of simply stating that Nazneen agrees with her father to marry an unknown man, you could delve deeper into the reasons why she does so.
Det er ikke et relevant råd, da kursisten her bruger beskrivelse. Og det er en af de genrer, som kan bruges i opgaveløsningen. Der er tale om en kort tekst, og det forventes ikke af mine kursister, at de skal gå dybere ind i en analyse. Opgaven for dem er at fange de beskrivelser, der er, og understøtte det med teksteksempler. Jeg ville ikke bede kursisten gå dybere ind i årsager, fordi det vil ende i ubegrundede gætterier.
Som underviser frygter du så, at dine kursister vil snyde og bruge ChatGPT?
- Ja, jeg frygter i den grad, at den eller andre programmer vil blive misbrugt. Som sagt før, så er det efterhånden svært at undgå.
Men det er en overvejelse værd, om vi efter en eksamen skal tjekke, hvilke sider på internettet eleven har besøgt.
Kan du se potentiale i at inddrage programmet i din egen forberedelse eller i undervisningen af kursisterne?
- Jeg kan godt finde på at prøve ChatGPT af, hvis det er gratis eller ikke koster ret meget. Men et reelt køb kommer nok ikke på tale.
Dens feedback-typer er ikke gode nok. Men hvis man kan kode den til at tænke som en lærer, så kunne det være interessant. Hvis den for eksempel kunne analysere en tekst og hurtigt udpege, hvor kursisten har behov for at dygtiggøre sig – om det for eksempel er verber, ordstilling eller noget helt tredje – og så fremhæve fem sætninger, som eleven kan arbejde videre med.
Kursisterne har ofte ikke megen trang til at rode rundt i deres tekst efter aflevering. Kun hvis de får relevante feedforward råd, for eksempel en opgave, hvor de kan arbejde med udgangspunkt i deres egne sproglige fejl. Hvis ChatGPT kunne hjælpe med at udforme disse opgaver, så kunne det være et relevant redskab for mig.
