Facemesh freezes after one minute

MIT App Inventor Help
,
1

Hi,
I am trying various things with Facemesh and I built a program to show some of the important points as listed in the Extension.
I tried it with showing the 450 points and without showing them but in all cases, after about one or two minutes the canvas freezes. Nothing moves. After several minutes the point is showed at another place but there is no fluidity at all.
What could be the reason for that?
Here is the major block I am using.

blocks (6)
blocks (6)1524×1192 192 KB

thanks for your help.

2

Show us those two procedures you call?

3

Here they are.
"Updatepoints" gets all the new coordinates when the face is updated,
"DrawTriangle" draws a triangle between the points called RightNose, LeftNose, NoseBottom

blocks (7)
blocks (7)1534×1118 168 KB

Uploading: blocks (8).png...

Thanks for your help

1 Like
4

I noticed that when I activated the command to show the BackgroundImage I was getting not only the image from the camera but also all the points by numbers. That was triggered by the ShowMesh property in FaceExtension1. When I unchecked this property this "mesh" disppeared and it did not freeze anymore.
However I noticed that my points did not fit the image from the camera, see the video
Why is it offset?
thanks.

5

Your point(s) appear depending on the value of global PointIndex.

I see no place (enabled or visible) where that variable gets updated.

One of your uploads failed.

1 Like
6

Here is the missing block.

blocks (8)
blocks (8)1570×1476 334 KB

The pointIndex comes from the selection index in the List Selector as shown below
blocks (6)
blocks (6)1244×182 36.2 KB

7

Sorry, maybe some one with better French can see the problem.
Upload the .aia here in case some one wants to try.

8

Hi,
I changed the app several times, and made several tests on two phones and it becomes clear that when I asked to show the mesh (the points with their numbers) I get the mesh but after one or two minutes everything is frozen.
If I don't ask for it it stays ok forever..
Here is my app
FaceDetection.aia (2.8 MB)
thanks,

9

I can confirm that behavior.

Usually, such behavior is caused by things piling up somewhere:

  • memory waiting to be reallocated in a garbage collection process
  • display tasks struggling to keep up

If you can find the original announcement of that extension, look for an email address or @ board ID for further inquiries. The extension itself is a black box to me.

10
11

Hi,
Does that mean that I can mail this person for questions?

12

Do these examples work for you?

13

Try this
p299D_puntosFace_v2.aia (2.8 MB)

14

Here is another hypothesis for you, based on the one minute limit.

Is all the work of the extension being done on the phone itself, or is the extension silently passing the work to a server at MIT or Google for the facial recognition part? One minute sounds like a good rate limiter threshhold.

15

From what I just tried by cutting mobile data on my phone:

  • there are calls to some server somewhere at the beginning, which may explain the long time before the first face recognition,
  • but then all the processes take place in the phone.
    That's the same thing if I want the Mesh to be displayed or not. And in both cases, connected or not, showing the mesh stays only one or two minutes and then it freezes.
16

Searching for an Android equivalent of Windows Task Manager, I see Android can tell you the RAM usage of a running app, through Settings->Apps.

Maybe watch that and see if it increases?

17

Well did not see anything special comparing the app with this action and without, and it does not bring anything. Actually the one without showing the mesh uses more RAM...
Is there a name of someone who built this extension that we can question about it?

18

See post 9, if you consider this important enough to pursue.

19

maybe its the storage. i see rhe freeze for problems with external and internal storage permissions

20

It looks like @ellelili2025 was (one of) the author(s)

Taifun