Ok, right now I think:
You can put a AndroidManifest.xml in /src/debug/ that is only applied (merged with the main one) on the build variant debug. (This includes unit tests and instrumented tests, although it seems noone really knows why this works this way, so you put it in debug instead of test or androidTestas expected.)