Yes, that is a problem you will experience in the beginning but there will come a point where you already have all the libraries and you wont need to worry about it anymore!!
Also as Erel said you dont need to restart the IDE.
However, Erel, is there a way to add a preprocessor command to automatically refresh the libraries tab? I have to do that a lot when debugging libraries.