This did the trick:
https://marketplace.visualstudio.com/items?itemName=mpotthoff.vscode-android-webview-debug