You can try doing something like this: HOW TO: Program the native SpeechRecognizer for Continuous Dictation and to do things .
You can only do this while the app screen is active.
What have you tried. The concept is viable depending on exactly what must be done by the app. You are only limited by your coding ability and the App Inventor controls.