Can someone explain to me the advantage of a Default Starter service that everyone is bragging about.
There is more or less no relation between the starter service and the error handler. You can keep using the old and not recommended error handler by simply removing Application_Error sub.
You don't need to remove the starter service for this (though you can remove it if you like).
I explained in that tutorial the problems with the old handler:
1. The user cannot really know whether the program can continue correctly after the uncaught exception.
2. A crash report will not be sent to Google Play as the error was eventually caught internally.
3. It is inconsistent as the dialog only appears when the error happens with an activity context.
4. It was not possible to override this behavior and allow sending the error with an email for example.
As a developer you don't need this message as you can see the error in the logs.
Users will not be able to understand the error anyway.
However there is no point in arguing about it. Use whichever handler you like.