There are all kinds of ways to access these views.
One simple way is to declare global variables for these views. When you load the layout file the variables will reference the last set of views that were loaded.
For example:
For i = 1 To 100
Panel1.LoadLayout(...)
Label1.Text = "Text"
Next
If you want to access the views at a later stage you can declare a custom type:
Type ItemViews (lbl As Label, btn As Button)
For i = 1 To 100
Panel1.LoadLayout(...)
Dim iv As ItemViews
iv.Initialize
iv.lbl = Label1
iv.btn = Button1
Label1.Text = "Text"
Panel1.Tag = iv
Next
Later you can access the views:
Dim iv As ItemViews = Panel1.Tag
iv.lbl.Text = "sdfsdf"