Crosswalk build with embedded mode is still asking to install crosswalk runtime

I have generated crosswalk build with embedded mode and it generates both apks fine. I used ionic-cli to add crosswalk. They both have runtime embedded, build sizes are 34MB and 37MB. However, when I try to install any build on device, it still gives the popup that crosswalk runtime needs to be installed.
I have tried it in two different devices and they both had the same problem.

My config.xml looks like this
<preference name="xwalkVersion" value="15+" /> <preference name="xwalkCommandLine" value="--disable-pull-to-refresh-effect" /> <preference name="xwalkMode" value="embedded" /> <preference name="xwalkMultipleApk" value="true" />

Device spec
Micromax canvas A120, Android 4.2

I have installed all the sdks from version 15 to 22.
Cordova-cli: 5.3.3
cordova-android: 4.1.1
ionic-cli: 1.7.12

If anyone can help me on this one, I will be grateful to you :). Any pointer to direction which I can use will be useful