I am pleased to announce that I have developed OnEarth with app inventor, an app that helps users help the planet using AI and mixed reality.
The app won the first prize at Educaixa Challenge from a total of more than 1200 projects.
Many thanks to App Inventor and the entire community for the support and the great app building tool you've created!
How does the app work?
The app is very easy to use and intuitive. It is a game that puts you in the year 3081 where the planet earth is very polluted, users have to try to do fun ecological tasks to help the planet.
An example of these tasks would be to go and throw away the garbage.
When the user finishes a task, it has to be verified by artificial intelligence, depending on the task it will be to take a picture or something similar.
In addition, the game is incorporated with a point system that allows you to count the Kg of CO2 you have helped to reduce. And let's not forget the community! the game also tells you what all users together have helped to reduce!
How do you make the tasks fun?
This is a good question, if we continue with the same example (Go and throw garbage) in the game
it's all about dropping off a package at the checkpoint!
Also, so that you don't get bored during the trip, the app talks to you all the time, giving you tips and asking you questions that you can answer and incredibly, the app understands you and answers you!
Can I hear an example of this app voice?
Yes, here's an example! Keep in mind that when you use the app on your mobile, there is music and sound environment that makes you get even more into the role!
What is mixed reality?
Mixed reality is included in the game and consists of mixing virtual reality (the game, a story) with real life (walking around, having to throw the garbage...) in this way the user experience is much more immersive.
What do I need to be able to play?
To be able to play you need a cell phone, a headset and a desire to help the planet!
What can I do with the points I get?
Currently, you can buy new avatars in the ecoshop, but we are trying to include discounts on real products that can be redeemed for these points!
In which languages is the app available?
Currently, the app is in English, Spanish and Catalan.
The difficulty to develop the app has been high, I have dedicated many hours to programming and many others to solving problems and bugs. In fact, I'm still working on new inclusions such as a tutorial.
To make the graphical part, first a prototype was made in Figma and then it was moved to app inventor.
To give a more fun touch to the game, I have included avatars that give the feeling of being in 3D although the reality is that it is a video.
So that the app does not take up too much space at first, all files such as images, videos and audios are stored in a remote database connected to app inventor. When the app is opened for the first time, these files are downloaded, so the first time you open the app, you will have to wait a little while in a loading screen.
To make the game speak in the tasks, as I wanted to include a quite real voice, I had no choice but to create several text-to-speech audio files with an online app and include them in app inventor.
In addition, so that the missions can be verified and so that users do not cheat, artificial intelligence is included through image recognition that recognizes, for example, garbage cans.
I have tried to make the app as responsive as possible, although there will surely be some problems on specific devices, in that case, if anyone has problems, I appreciate to be notified to fix them.
There are also other inclusions, but it seems to me that these are the most important.
As for the extensions used, I have used many that have allowed me to do from the graphical part to the logical part of the app:
- Glide Image Loader extension by @ Atom_Developer
- Image Loader by @ DevYB
- Material Spotlight Extension by @ zainulhassan
- GestureDetect by @ Aryan_Gupta
- Button Designer by @ ahmad_mtrd
- Async Procedure by @ Abhijith_Dominic
- Plyr Video Player Extension by @ zainulhassan
- Airtable classic by @ Jerin_Jacob
- Floating View Extension by @ jarlissonlira2
- TaifunBattery by @ Taifun
- Wave Loader Extension by @ RudraFromIndia
- TaifunFile by @ Taifun
- TaifunTools by @ Taifun
- HEX2Kodular by @ SRRazmi
- Dynamic Components by @ yusufcihan
- Custom Dialog by @ varsha_naik
- DownloadToASD by @ Anke
- MyFonts by @ Anke
- ClickTools Extension by @ Techno_Vedang
- Phase by @ Shreyash
- Personal Image Classifier
Without the app inventor community that created these extensions, the app could not have been made! Thank you very much to all of you.
You can download the app at Google Play