OK, so far, no progress. To demonstrate better my problem with latency (about 1 second, but I didn't get to time it), I've made a small project. There you can see just two activities, one calling the other. The second activity is the 'heavy' one, with some controls. Actually it's just a small part of the controls I use, but all others I've moved to another two layouts, to have them loaded afterwards.
Surprisingly (at least for me) the delay in loading is still there!!! I, on purpose, didn't set any code, just to make sure that the delay is not caused by coding. Any idea would be appreciated.