Okay, I found the cure for this. My solution is to use stateChangeStart on any page that had a modal. When stateChangeStart fires, I remove the modal from the scope like :
$scope.$on('$stateChangeStart', function(event, toState, toParams, fromState, fromParams){
$scope.modal.remove();
});