A long prompt to get feedback on your speaking from audio files uploaded to Gemini

Below is the prompt that I have been experimenting with recently for students to use to get feedback on their speaking with when uploading a short audio file to Gemini and here is a 20-minute video showing it at work in three languages: Spanish, Italian and Catalan:

Language Coach Prompt

I am a language learner. I will upload audio files for you to analyse. Your goal is to be a helpful coach.

Core Communication Rules (Apply to EVERYTHING you say):

• Match My Level: You must use vocabulary and sentence structures that match the CEFR level of the audio I upload. If the audio is A2, your explanations and instructions must be A2.
• Language: If the audio is in English, use British English spelling and vocabulary at all times. If the audio is in another language, all responses should be in that language at the level of the recording from the very beginning
• No Jargon: Do not use academic or formal words (e.g., avoid "transitioned", "lexical", or "syntax"). Use simple, natural words a native speaker uses in daily life.
• Scannability: Use bullet points for clarity. Never use tables. Avoid long walls of text.
• Wait for Audio: Do not give any feedback or assessments until I upload a file and you know which language I speak and have heard my level.

The Process: When I upload a file, first ask if I want "Quick Feedback" or the "7-Step Sequence." If I choose the sequence, ask which step I want first. After every step, list the remaining options as briefly as possible.

The 7 numbered Steps:

1. Verbatim Transcript: Provide a transcript of exactly what I said in continuous prose.
2. Error Identification: Rewrite my text exactly as it is, but put brackets [ ] around any errors. Do not correct them yet.
3. Pronunciation: Identify the top 2 issues. Use simple descriptions (e.g., "The 'H' sounds like a breath") instead of technical terms.
4. Natural Correction: Provide a corrected version that is natural but NOT more sophisticated than my original.
5. Colloquial Version: Create a version that is slightly more casual/conversational. It should be less than half a CEFR level higher than my original. List 3 changes and explain them simply.
6. Advanced Version (Level +0.5): Create a version that is roughly half a CEFR level higher than my original. Focus on natural spoken language. List 3 specific changes and explain why they are a better "bridge" to the next level.
7. More Advanced Version (Level +1.0): Create a version of spoken language that is roughly half a CEFR level higher than the previous "Advanced" version (one full level above my original). List 3 changes and explain how they help me reach this higher level.

Feel free to copy and paste this prompt into a free account with Gemini or experiment with your own variations. All you will need then are some audio files in one of these formats:

• MP3 (The standard format for most phones and voice recorders)
• WAV (High quality, but larger file sizes)¹
• AAC / M4A (Common for iPhone "Voice Memos")²
• OGG
• FLAC

If a student records themselves on camera, these formats are supported:

• MP4 (The most common format for smartphones)
• MOV (Standard for Apple devices)
• AVI
• WMV
• WebM

Key Technical Limits

File Size: Generally, files should be under 20MB for the best performance. If a video is too large, it is often better to convert it to audio (MP3) before uploading.

Duration: For a detailed analysis, recordings between 1 and 3 minutes are ideal. This gives the AI enough data to find patterns without becoming overwhelmed.

I want to build a web app where i can upload an audio file and get feedback on my speaking including my pronunciation

SpeakSmart AI

Try it here your self

Try uploading an audio file made by a student and see what you think of the feedback.

My prompt for Google's AI Studio was, "I want to build a web app where i can upload an audio file and get feedback on my speaking including my pronunciation"

You can upload all these file types to Gemini to get feedback on your speaking, including your pronunciation MP3, WAV, AAC, M4A, OGG, FLAC, MP4, MOV, AVI, WMV, WebM

I asked Gemini, "What audio and video file formats can be uploaded here to ask for feedback on pronunciation and speaking in general?"

To help you and your students use this workflow effectively, here is a breakdown of the supported formats.

Since your focus is on analyzing speech patterns and pronunciation, audio files are usually the most efficient, but video files also work well if the student wants to show their facial expressions or mouth movements.

Supported Audio Formats

These are the most common formats for voice recordings:

• MP3 (The standard format for most phones and voice recorders)
• WAV (High quality, but larger file sizes)¹
• AAC / M4A (Common for iPhone "Voice Memos")²
• OGG 
• FLAC

Supported Video Formats

If a student records themselves on camera, these formats are supported:

• MP4 (The most common format for smartphones) 
• MOV (Standard for Apple devices) 
• AVI 
• WMV 
• WebM

 Key Technical Limits

• File Size: Generally, files should be under 20MB for the best performance. If a video is too large, it is often better to convert it to audio (MP3) before uploading.
• Duration: For a detailed "Half-CEFR Level" analysis, recordings between 1 and 3 minutes are ideal. This gives the AI enough data to find patterns without becoming overwhelmed.

---

Pro-Tip for your Students:

If a student is using a smartphone, I recommend the following:

1. iOS: Use the Voice Memos app (saved as M4A).³
2. Android: Use the built-in Voice Recorder (usually saved as MP3 or M4A) 
3. Environment: Remind them to record in a quiet room. Background noise (like a TV or wind) can cause the AI to create an incorrect transcript, which will ruin the bracket [ ] error-finding step.

More details on File sizes 

Here are the upload limits for audio and video files in the standard Gemini web app (gemini.google.com) and mobile app:

Video

• Maximum File Size: 2 GB per file.

• Length Limit:

  • Free Version: Up to 5 minutes total duration per prompt.

  • Gemini Advanced: Up to 1 hour total duration per prompt.

Audio

• Maximum File Size: Generally up to 100 MB (often treated under the general file limit).

• Length Limit:

  • Free Version: Up to 10 minutes total duration per prompt.

  • Gemini Advanced: Up to 3 hours total duration per prompt.

Key Notes:

• You can upload up to 10 files in a single prompt.

• The limits apply to the total duration in a single conversation turn (e.g., if you are on the free plan, you could upload two 2.5-minute videos, but not two 3-minute videos).