[PAID] 🧠 Gemini Extension to interact with the Gemini-pro model from Google

Extensions
, , , ,
43

:rocket: The Most Powerful AI Extension for MIT App Inventor! :rocket:

This web app showcases just a few of the incredible features of the Gemini API extension—but there’s so much more!

:sparkles: Key Features:
:white_check_mark: Generate human-like responses
:white_check_mark: Understand and process natural language
:white_check_mark: Perform AI-powered text analysis
:white_check_mark: Enhance your app’s interactivity with smart AI
:white_check_mark: Create customizable data APIs using the Structured Response feature

And that’s just the beginning! :bulb: This extension empowers your app with cutting-edge AI capabilities like never before.

:link: Try the Demo Now: https://astounding-beijinho-4cd939.netlify.app/

44

New Update => (Search the web feature added)

45

How to Build Your Own AI "APIs" in App Inventor—The Easy Way!

Stop Wrestling with Text! Build Your Own AI "APIs" in App Inventor—The Easy Way!

Tired of getting long, messy sentences back from AI and then spending hours trying to pick out the exact piece of information you need with complex text blocks?

Wish you could just ask an AI to do a specific task and get back clean, predictable data ready to plug straight into your app?

Good news! You absolutely can, and it's WAY easier than you think!

Using The Gemini Extension combined with a simple trick—telling Gemini to respond in JSON —you can unlock powerful, custom AI capabilities right within your App Inventor projects.

Think of it like building your own mini-API service, powered by Google's Gemini, without needing any servers or complex coding!

Why is this so EFFECTIVE?

  • AI Power on Demand: Need instant translation? A smart summarizer? Sentiment analysis? Keyword extraction? You can build specialized AI "functions" for almost anything.

  • Predictable Data: No more guessing! JSON gives you structured data (like {"name": "John", "status": "active"}) that App Inventor handles perfectly.

  • Clean Blocks: Your code becomes dramatically simpler and more readable.

Why is this so EASY for App Inventor Developers?

  1. You Define the "API Call" in Plain English: Your "API function" is just part of your prompt! You simply tell Gemini what to do AND how to format the answer as JSON.
  • Example Prompt: "Translate this to Spanish: '{text_to_translate}'. Respond ONLY with JSON like this: {'translation': '...'}. No extra text!"

  1. One Block to Decode: You already have the tool! The standard Web component's JsonTextDecode block instantly turns that clean JSON response into an App Inventor dictionary.

  2. Simple Data Access: Use the basic lookup in pairs dictionary block to grab exactly the piece of data you need (e.g., get the value for the translation key).

See this simple example blocks :

1
13502×884 279 KB

2
21058×242 26.8 KB

3
32410×674 113 KB

That's it! Seriously.

Prompt -> Send with Extension -> Receive Event -> JsonTextDecode -> lookup in pairs -> Use Data!

Forget complicated text parsing or setting up external servers. You leverage the visual blocks you already know to command a powerful AI and get back exactly what you need, neatly packaged.

This method transforms Gemini from just a text generator into a flexible, custom backend service tailor-made for your app's specific needs.

Ready to make your apps smarter and your blocks cleaner? Grab BlackNight's Gemini extension, craft a prompt asking for JSON, and see how easy and effective it is to have your own custom AI service running directly inside App Inventor!

Note : ChatGPT extension has the same feature

1 Like
46

Nice trick!
I think its possible to do it with the ChatBot component too?

1 Like
47

I don't see the structured output response blocks in your topic!
Could you quote the block image of your extension that achieve this .

For more info, see the meaning of structured outputs

1 Like
48

After prompting the AI to respond in json can't we use native dictionary blocks to parse json?

49

Not exactly like this,
This is the difference between the fixed original JSON response of the gemini API
and the customized json structured inside the original json structure that called structed output "

image

  • Free Text Response:

    • What it is: Normal sentences, like a chat conversation.

    • Problem: Unpredictable format. App Inventor needs complex/fragile text blocks (split, segment) to try and find the data. Often breaks.

  • Customized Structured (JSON) Response:

    • What it is: Data organized with specific labels (keys) in a strict format ({"key": "value"}). You tell the AI to use this format.

    • Benefit: Predictable format. App Inventor uses JsonTextDecode + simple dictionary blocks (lookup in pairs) to easily and reliably grab the exact data needed. Much more robust.

50

To clarify it more, see this example

Example: Translation API using Gemini with Structured Output

Here is the JSON schema that defines the structured output for the translation API based on the provided MIT App Inventor blocks.

JSON Schema for Structured Output

{
  "type": "object",
  "properties": {
    "translation": {
      "type": "string",
      "description": "The translated text."
    },
    "original_text": {
      "type": "string",
      "description": "The original input text before translation."
    }
  },
  "required": ["translation", "original_text"]
}

How This Schema Works

  1. Defines an Object: The response is structured as an object.
  2. Includes Two Properties:
  • "translation" → Contains the translated text.
  • "original_text" → Stores the original text before translation.
  1. Required Fields: Ensures that both "translation" and "original_text" are present in every response.

Example API Response Matching the Schema

{
  "translation": "Translate this into English",
  "original_text": "ترجم هذا إلى الإنجليزية"
}

Blocks:

image

image
image1058×242 23.7 KB

image

This schema ensures that the Gemini API consistently returns structured data, making it easy to parse and use in your MIT App Inventor project.

51

@techxsarthak you can try this feature inside Google AI Studio

with structured output

image
image1095×902 49.3 KB

without structured output

image
image1088×860 59 KB

52

Added a block in GroqText, as I said earlier... was working on an update with new blocks, released it just now.

Same for Groq Playground - GroqCloud. Its JSON mode btw :smile:

image
image1918×941 68.3 KB

Added blocks for it in my extension too!

:office: Structured JSON output

RequestCustomStructuredOutput

image
image755×320 21.9 KB

UserRequest= Question to ask to the AI
customScheme= The json type to generate

For eg.

blocks (17)
blocks (17)1734×320 53.8 KB

Output

image
image377×784 55 KB

Yes its now possible with GroqText

Btw Gemini extension is also very good!

1 Like
53

Good job :clap:

1 Like
54

Thanks, your extensions are also good as always

55

:tada: New Update

Gemini extension now allows you to create and modify images via instructions using Google's Gemini AI models directly within your App Inventor projects!

56

New Update: You can now use the Gemini AI model to analyze any video, even from a local path or any Youtube video URL

1 Like
57

Overview

Gemini Extension brings Google’s powerful, multimodal Gemini AI directly into MIT App Inventor, enabling you to build and customize any AI-driven API—text processing, OCR, image analysis, video intelligence, image editing, and more—without incurring extra third-party API fees

Why Gemini Extension?

By embedding Google’s state-of-the-art Gemini model (optimized in Ultra, Pro, and Nano sizes), this extension delivers enterprise-grade AI capabilities right inside your App Inventor projects—no external subscriptions required blog.google. You define your own JSON Schemas to guarantee structured, consistent outputs, eliminating parsing headaches and ensuring your data flows smoothly into your app

Key Features

Structured Outputs & Schemas

  • JSON-Schema Enforcement: Supply any JSON Schema and Gemini Extension will strictly adhere to it, so your responses are always predictable and ready for use

Text Processing & NLP

  • Advanced Language Tasks: Summarization, sentiment analysis, intent classification, and intelligent text generation—all powered by Gemini’s deep understanding of context and nuance blog.google.

OCR & Image Analysis

  • Seamless Text Extraction: Leverage Google Cloud’s OCR API to convert images and documents into machine-readable text, complete with layout and language support Google Cloud.
  • Free Credit on Signup: New users receive $300 of free Google Cloud credits, making it cost-effective to kickstart large-scale OCR projects Google Cloud.

Video Intelligence

  • Smart Video Insights: Automatically detect objects, scenes, and explicit content in videos using Google Cloud Video Intelligence API—ideal for content moderation, metadata generation, and more Google Cloud.

Image Editing & Creative APIs

  • AI-Powered Editing: Perform inpainting, outpainting, background removal, color adjustments, and more, all within your App Inventor blocks—no GPU management needed stablediffusionapi.com.
  • Competitive Alternatives: While other services like Photoroom API and Phot.AI offer image editing, Gemini Extension integrates directly into your project, removing extra steps and costs Photoroomphot.ai.

Benefits

  • Zero Extra API Costs: Build any custom AI pipeline without paying monthly fees to external providers—your only investment is the extension itself mit-cml.github.io.
  • Rapid Development: Install in minutes, configure schemas visually in App Inventor, and start testing—all without backend setup or server maintenance.
  • Scalable for Any Project: From hobby experiments to enterprise deployments with thousands of users, Gemini Extension handles it all under Google’s robust infrastructure.
  • Full Customization: Mix and match features—combine OCR, NLP, image analysis, and video intelligence in a single workflow tailored to your app’s needs

OCR Gemini customized API Example:

image
image777×740 42.9 KB

APK file
Try from here

Get Started Today

Transform the way you build AI features in MIT App Inventor with only 5.99$. Install Gemini Extension now, unlock Google’s Gemini AI, and craft the exact APIs your app demands—cost-efficiently, reliably, and at scale.

58

Hello,

I recently purchased your Gemini Extension for MIT App Inventor through PayPal, but I wasn’t redirected to the download link after payment was completed.

Could you please send the extension file (or the access link) directly to my email address at [mail id removed by mod, please do not post personal info, use PMs]

Let me know if you need any payment confirmation or transaction details.

Thank you for your support!

Best regards,

59

I am sorry for such a situation,
I have sent the Extension for you please check your email,
I hope this extension will move your app development to the next level.

Thanks,

60

New blocks added that will enhance the UX

files Upload Manager

Uploads a local file, waits for it to be processed (ACTIVE), " +
"and returns detailed metadata via the 'GotFileMetadata' event. " +
"Also reports progress via 'FileUploadProgress'.

image
image787×186 8.21 KB

Reports the progress of a file upload (e.g., video, audio, pdf)."
image

Retrieves the direct download URI for the content of a file identified by its resource name (e.g., 'files/your_file_id'). " +
"Use this URI to download the file content directly (e.g., with Web component).
image

image understanding

Analyzes multiple images (from URLs/Paths) based on prompt, streaming results. Optionally provide system instructions and/or JSON schema. Results via GotGeminiStream/StreamFinished events.
image

Analyzes an image from URL based on prompt, streaming results. Optionally provide system instructions and/or a JSON schema for structured output. Results via GotGeminiStream/StreamFinished events.

image

video understanding

image
image513×544 16.8 KB