Actually, you can use the optional third parameter to do what you want:

"To call RAISE_APPLICATION_ERROR, use the syntax

raise_application_error(error_number, message[, {TRUE | FALSE}]);
...