[Paid] 🌟 ChatGPT extension to create fantastic conversations with ChatGPT

[Black_Knight]

New update

@Black_Knight

RequestAudioSpeech Function

Description: ​This function asynchronously requests audio speech synthesis from OpenAI's Audio Speech API, utilizing specified parameters such as API key, model, input text, voice, optional instructions, folder path, and file name. The synthesized speech is saved as an MP3 file in the designated location.​

Parameters:

• apiKey (String): Your API key for accessing OpenAI's Audio Speech API.​
• model (String): The model used for speech synthesis. Options include:​
  • tts-1: Optimized for real-time text-to-speech applications.
  • tts-1-hd: Optimized for higher-quality speech synthesis
  • gpt-4o-mini-tts: Built on GPT-4o mini, offering fast and powerful text-to-speech capabilities.
• textInput (String): The text to be synthesized into speech.​
• voice (String): The voice selection for audio generation. Supported voices are:​
• alloy​
• ash​
• ballad
• coral​
• echo​
• fable​
• onyx​
• nova​
• sage​
• shimmer​
• instructions (String, optional): You can provide specific instructions to potentially influence the tone, style, or delivery of the speech (e.g., "Speak in a cheerful and positive tone."). Leave blank if not needed.
• folderPath (String): The directory path where the resulting MP3 file will be saved.​
• fileName (String): The name assigned to the saved MP3 file.

StreamAudioSpeech

Description

Streams audio speech synthesis from OpenAI in real-time and plays it directly through the device speaker. This function is optimized for low latency playback, starting audio almost immediately as it arrives.

It specifically uses the gpt-4o-mini-tts model and requests audio in PCM format, which is required for the direct playback mechanism. The function incorporates pre-buffering, frame alignment, boundary smoothing (cross-fading), and a final fade-out to minimize glitches and provide a smoother listening experience.

Use the separate StopStream block to halt playback manually.

Parameters

• apiKey (Type: Text)
  • Required. Your unique API key for accessing OpenAI services.
• textInput (Type: Text)
  • Required. The text content you want the AI to speak.
• voice (Type: Text)
  • Required. The desired voice for the speech synthesis. Valid options include: alloy, echo, fable, onyx, nova, shimmer. (Note: The underlying model might support more voices than the older TTS-1).
• instructions (Type: Text)
  • Optional. You can provide specific instructions to potentially influence the tone, style, or delivery of the speech (e.g., "Speak in a cheerful and positive tone."). Leave blank if not needed.
• Note: The model and responseFormat are fixed internally by this function:
  • Model: gpt-4o-mini-tts
  • Response Format: pcm (Raw Pulse Code Modulation audio data)

Events Triggered

This function can trigger the following events:

• StartedAudioStream()
  • Fired shortly after the request is made, once enough initial audio data (pre-buffer) has been received and playback is about to begin. Use this to indicate to the user that the audio is starting.
• FinishedAudioStream()
  • Fired only when the entire audio stream has been successfully received from OpenAI and played through to the end naturally (without being manually stopped).
• AudioStreamError(errorMessage Text)
  • Fired if any error occurs during the process:
    • Invalid API key or network issues.
    • Errors reported by the OpenAI API.
    • Problems initializing the device's audio player (AudioTrack).
    • Errors during data writing or processing.
  • The errorMessage parameter provides details about the failure.
• StoppedAudioStream()
  • Important: This event is NOT directly fired by StreamAudioSpeech itself upon completion. It is fired when you explicitly call the StopStream block to manually interrupt the ongoing audio playback. If the stream is stopped manually, FinishedAudioStream will not be fired.

How It Works (Simplified)

1. Request: Sends your text and parameters to OpenAI, specifically requesting a pcm audio stream from the gpt-4o-mini-tts model.
2. Pre-buffer: Receives the first small portion of audio data from OpenAI and holds it temporarily.
3. Initialize Player: Sets up the device's low-level audio player (AudioTrack) configured for the specific PCM format (e.g., 44.1kHz, 16-bit Mono).
4. Write & Play: Writes the pre-buffered data to the player and immediately starts playback.
5. Stream Loop: Continuously receives subsequent small chunks of audio data from OpenAI.
6. Smooth & Play: For each incoming chunk:

• It checks if there's a large, potentially audible jump (discontinuity) between the end of the last played chunk and the start of the new one.
• If a jump is detected, it applies a very short fade-in to the beginning of the new chunk to smooth the transition, reducing clicks/pops.
• It ensures only complete audio frames (pairs of bytes for 16-bit PCM) are sent to the player.
• The processed chunk is sent to the player to be heard.

7. Final Fade-Out: When the stream from OpenAI ends naturally, a short fade-out is applied to the very last segment of audio for a less abrupt ending.
8. Finish/Error/Stop: Triggers the appropriate event (FinishedAudioStream, AudioStreamError, or relies on StopStream triggering StoppedAudioStream).

Audio Generation: File Download vs. Real-time Stream

[Filip_Wozniak]

Hi @Black_Knight , I have just tried to use the GPT Vision using your extension with this code:

and I am getting the error message:
{ "error": { "message": "The model gpt-4-vision-preview has been deprecated, learn more here: https://platform.openai.com/docs/deprecations", "type": "invalid_request_error", "param": null, "code": "model_not_found" }}

Could you please switch the default model for Vision functions to a valid one or provide a parameter for model selection?

I have also tried to pass the images to gpt-4o this way:

but I am getting the error message: "No value for id" in this case.

Could you please provide a way to use GPT Vision again as this was the reason why I bought your extension.

[Black_Knight]

The first issue is because the model was deprecated,
So I have updated the aix and will send the extension for you at pm but first send the payment transaction ID of the extension

And for the second one
Here is how to use the block

@Black_Knight

[Filip_Wozniak]

I will contact you on PM for the fix.
My idea with the second solution was to simply follow the structure from the OpenAI Documentation:

https://platform.openai.com/docs/guides/images?api-mode=responses&lang=javascript&format=base64-encoded
This could have worked when serialization would be used in the extension to map any structure to a JSON - just an idea which I wanted to share!

[Black_Knight]

@Filip_Wozniak I have updated the extension and send it for you at PM

[Black_Knight]

@Filip_Wozniak

Could you please provide a way to use GPT Vision again as this was the reason why I bought your extension.

The vision blocks was already existed I didn't remove them .

[Black_Knight]

ChatGPT extension updated by adding new models

you can now use these models :

• gpt-4.1

• gpt-4.1-mini

• gpt-4.1-nano

• o3

• o4-mini

[Black_Knight]

In this post and audio will calrify the difference between "ChatGPT Assistant Extension" and "ChatGPT extension"

[Paid] ChatGPT extension to create fantastic conversations with ChatGPT

[#Mr_Koder] Introduction Hello everyone I am here today to introduce my new extension called ChatGPT, Unlock the potential of artificial intelligence in your App Inventor projects with the ChatGPT Extension. This powerful tool empowers you to seamlessly integrate OpenAI's cutting-edge language models, enabling you to build sophisticated and engaging AI-powered features within your apps. Why Choose the ChatGPT Extension? Unleash True AI Power: Effortlessly integrate cutting-edge …

[PAID] ChatGPT Assistant Extension for MIT App Inventor

[Whisk_fb52a5c930] GPTAssistant Extension for MIT App Inventor Overview The GPTAssistant extension is engineered to transform MIT App Inventor projects into intelligent, next-generation applications. This powerful tool seamlessly integrates the complete capabilities of the OpenAI Assistants API directly into the no-code development environment. This integration facilitates the development of sophisticated AI-powered applications capable of comprehension, response, and complex task execution, a…

[sparta]

Hallo. I payed now an I tried app. It's very difficult to insert the LONG API key in the first page! It is possible to record the key directly in the block of the App?

[Black_Knight]

Hello @sparta ,
Thank you for your payment — I really appreciate it!
I think you purchased this one

[PAID] ChatGPT Assistant Extension for MIT App Inventor

[Whisk_fb52a5c930] GPTAssistant Extension for MIT App Inventor Overview The GPTAssistant extension is engineered to transform MIT App Inventor projects into intelligent, next-generation applications. This powerful tool seamlessly integrates the complete capabilities of the OpenAI Assistants API directly into the no-code development environment. This integration facilitates the development of sophisticated AI-powered applications capable of comprehension, response, and complex task execution, a…

Not chatGPT extension they are different

But

Could you please clarify your issue a bit more? I'm not entirely sure what you mean.

If you're looking for the ChatGPT API key, you can generate one from the following link:
https://platform.openai.com/api-keys

I hope this ChatGPT extension helps take your apps to the next level!

[Black_Knight]

You can create variable called API key and you can use it inside all methods blocks ,

In the next updated I will add setter and getter functions the set API key one single time , so no need to set the API key each time you use block method!

[sparta]

​Dear Ahmed, thank you very match for you reply!

Obviously, I have an API key, but it's very difficult to copy in te APP a very long string without error...

Do you have some simplest solution?

King regards

Santi

[ABG]

Web browser copy paste Ctrl C and Ctrl V

[Black_Knight]

@sparta

Obviously, I have an API key, but it's very difficult to copy in te APP a very long string without error

I don't understand what do you mean , so I can't recommend a solution,
Please show with images !

[sparta]

Hallo. I buyed your extension to analyze images, but unfortunately the .aix don't have this function!n Why?

[Black_Knight]

@Black_Knight

New Update to deal with image files paths

@clnie2004

@Black_Knight

RequestChatGPTVisionFromFile

Purpose: Analyzes a single local image file and provides insights based on a text prompt.

Parameters:

• apiKey: Your OpenAI API key.
• imagePath: The file path of the image to analyze.
• prompt: A text prompt to guide the analysis (e.g., "What's in this image?").
• detail: The desired level of detail for the analysis ( low , high , or auto).
• maxTokens: The maximum number of tokens allowed in the API response.

RequestChatGPTVisionMultipleImagesFromFile

Purpose: Analyzes multiple local image files and provides insights based on a text prompt.

Parameters:

• apiKey: Your OpenAI API key.
• imagePaths: A YailList containing the file paths of the images to analyze.
• prompt: A text prompt to guide the analysis (e.g., "Compare these images").
• detail: The desired level of detail for the analysis (e.g., "high").
• maxTokens: The maximum number of tokens allowed in the API response.

Check this please

[Black_Knight]

Also check these blocks

@Black_Knight

Function: RequestChatGPTVision(String apiKey, String imageUrl, String prompt)

Purpose: This function sends a request to OpenAI's ChatGPT vision API to analyze an image and provide insights based on the given prompt.

Parameters:

• apiKey: Your OpenAI API key.
• imageUrl: The URL of the image to analyze.
• prompt: A text prompt to guide the analysis (e.g., "What's in this image?").

Function: RequestChatGPTVisionMultipleImages(String apiKey, YailList imageUrls, String prompt)

Purpose: This function sends a request to OpenAI's ChatGPT vision API to analyze multiple images and provide insights based on the given prompt.

Parameters:

• apiKey: Your OpenAI API key.
• imageUrls: A YailList containing the URLs of the images to analyze.
• prompt: A text prompt to guide the analysis (e.g., "Compare these images").

RequestChatGPTVisionFromFile

Purpose: Analyzes a single local image file and provides insights based on a text prompt.

Parameters:

• apiKey: Your OpenAI API key.
• imagePath: The file path of the image to analyze.
• prompt: A text prompt to guide the analysis (e.g., "What's in this image?").
• detail: The desired level of detail for the analysis ( low , high , or auto).
• maxTokens: The maximum number of tokens allowed in the API response.

RequestChatGPTVisionMultipleImagesFromFile

Purpose: Analyzes multiple local image files and provides insights based on a text prompt.

Parameters:

• apiKey: Your OpenAI API key.
• imagePaths: A YailList containing the file paths of the images to analyze.
• prompt: A text prompt to guide the analysis (e.g., "Compare these images").
• detail: The desired level of detail for the analysis (e.g., "high").
• maxTokens: The maximum number of tokens allowed in the API response.

Events:

@sparta also check this section

[sparta]

Sorry, but in my extension we have NO BLOCKS for VISION!

[Black_Knight]

please , check the extension file, not in the AIA file ,
in the aia file is old version

[Black_Knight]

You can PM me with your transaction payment ID and I will send the aix file for you