That's why "Privacy Policies" exist, but even though, you will have users complaining and giving you 1 star ratings because your app requires such and such permission, my advise to you, when the app is installed, display an explanation of why some permissions are needed, also, make that clear on you Google Play page.