Monday 31 July 2023

Further experiments with students recording themselves, getting a transcript and getting AI to tidy it up

I want to be able to suggest a series of steps language learners can follow using just their mobile phones to get feedback on their speaking. 

Over the last four days I have been practising the steps using our granddaugher as a pre-intermediate learner of English. The procedure involved combining two of my obsessions: getting students to do extensive reading and getting them to record themselves retelling stories. 

  1. I asked her to read an Oxford Bookworm Starter level reader on the Oxford Reading Club app
  2. She then told me the story in her own words without recording herself
  3. She then recordered herself retelling the story using 'Voice Capture' on Microsoft 365
  4. Voice Capture generates a transcript automatically. I Shared the recording (and transcript) as a Word document
  5. I copied and pasted the transcript into three AI webpages and asked for the transcript to be tidied up
  6. I copied these 'improved' transcripts back into the Word document where with 'Read Aloud' she could listen to the suggested changes.
  7. She selected which of the improved transcripts was the best and I copied and pasted it into WhasApp for her.
  8. I then used WhatsApp to record 'Read Aloud' and add that so she could listen to it again.
Here's a short video I made and posted on YouTube:


My original idea was that this sequence would be followed by a repetition of the task of retelling the stories. However, I didn't use this idea, partly because my granddaugher's original recordings were about 9 minutes long, which is much much longer than my students' typical recordings of two to three minutes, but also because I was beginning to think that the exposure to up to five versions of her own story might be of sufficient benefit. I'm still open to suggestions on this.

Here are two of the AI suggestions - (with the Microsoft Edge browser you can select and right-click and choose 'Read Aloud' to listen to these versions)

ChatGPT suggested:
"The Mystery of Manor Hall" is about two brothers visiting their uncle's dark and mysterious house, which is very big. The brothers visit their uncle's house while their mother is buying a new house and getting everything in order. When they arrive at their uncle's house, he allows them to explore and enter all the places, except for the music room, which makes them curious.

During supper, the uncle points out the new moon and tells them they can't leave their room that night. Later, the sister wakes up and hears a strange sound. The brother listens and convinces his sister to go to the music room. They think they hear their uncle singing, but upon entering, they see a picture of a pirate. The pirate notices them, and they become frightened and attempt to leave the room, but the pirate prevents them from doing so.

The pirate explains his story to the brothers. He used to have a magic picture that allowed him to go sailing with his ship every new moon, but now the house is far from the sea, so he's unable to do so. Meanwhile, the uncle arrives and reveals his story. He had bought the house from an old man who warned him not to enter the music room due to a ghostly presence. The uncle had been afraid and avoided the room ever since.

Eventually, the two brothers move with their mom to the new house, which is located near the sea and took the magic picture. Every new moon, the pirate can now sail and sing quietly. And this is the end of the story.


Bing suggested:
The story is about two brothers who go to their uncle's house. The uncle's house is very dark, mysterious, and big. The brothers go to their uncle's house because their mother is buying a new house and needs to get everything in order. When the brothers arrive at their uncle's house, their uncle tells them that they can look for things and enter all the places in the house, except for the music room.

The brothers are confused because they can't go to the music room. Their curiosity gets the better of them and they try to enter the music room, but their uncle sees them. In the evening, while they are having supper, their uncle tells them to look at the new moon and that they can't leave their room that night.

In the middle of the night, the sister wakes up and tells her brother that she hears a strange sound. The brother listens and they both go outside their room. They don't want to, but they finally go to the music room. They think it's their uncle singing, but when they enter, they don't see anyone. When they turn on the lights, they see a picture of a pirate.

The pirate sees them and comes out of the picture. The brothers are very afraid and want to leave the room, but they can't because the pirate won't let them. Finally, the pirate explains his story to the brothers. He tells them that one day an old woman painted a picture of his ship and said it was a magic picture because every new moon he can come out of the picture and sail with his ship.

He could only do this if the picture was near the sea, but now the house isn't near the sea and he is sad because he can't sail. Then their uncle arrives and explains his story. He bought the house from an old man who told him not to enter the music room because 

Monday 10 July 2023

How to use AI to get feedback on your speaking and learn from it

  •  Record yourself doing a speaking task
  • Use Word to get a transcript and add it to Column 1
  • Manually correct the transcript as far as you can and add it to Column 2 (use tracking)
  • Ask Bing AI Chat to "tidy up" your transcript and copy it to column 3
  • Mark the mistakes in column 2 in red and the corrections in column 3 in green
  • Copy what you have learnt into your notes (see below)

  • Select the transcript in column 3, right-click on it and click on Read Aloud
  • Practise reading this transcript aloud
  • Try recording the story again without reading the transcripts
  • Check you have got the five things to learn right this time

5 things to learn

  • wait for someone
    • Jenny is waiting for Rob in Central Park.
  • have something to share/do/wear
    • Both have good news to share.
  • tell someone to do something
    • Rob tells her to speak first.
  • she/he doesn't need ...
    • She doesn't need to move to London
  • she tells her ... third person -s
    • Jenny tells Barbara to delete her email.