No you don't need to resubmit all application.
1. If you are updating old application, just make sure you use the app bundle (aab) with the old keystore.
2. Your New apps will use the RSA key. You can set the new RSA keystore file as default in the IDE and the old apps using the old keystore, include the signing directive