Each letter is sent one by one to the robotic hand

[SteveJG]

This tutorial may help using your sign language

Sign Language (ASL) from SpeechRecognizer Dictation; a Template

Sign Language Parrot Template is an App Inventor template aia. [hello] The example will help create an app that displays finger spelling sign language letter icons. [signLanguageSR] [asl_1] The app recognizes individual words captured by the SpeechRecognizer and displays a sign glyph for each letter in the word. The individual letters are captured from word text generated by a SpeechRecognizer This is one way to do to use sign language; there are many more potential ways to code a simila…

It discusses how the App Inventor part to your Project might work using the SpeeechRecognizer. You are either using a Button or an Image component.

Show your code that is used to send the letter to your Arduino and someone might be able to help with the Arduino part (sorry I can not) . Please attach an image of your Blocks.