Following up on this. The problem was as follows. I was setting the server.hostname in the capacitor.config.json file to the domain of our service. On iOS, xhr calls into that domain would succeed. On Android, however, those calls would always just return our local index.html file.
In the end, I switched to using the HTTP community plugin and now everything works as expected.