Yes, I agree with you that this should basically be possible using an extension.
But your example is unfortunate, because AI2 has already removed this permission from the Manifest.
However, it should basically be possible to remove a permission from the Manifest via extension, just as it is possible to declare permissions in the manifest via extension in this way.