There are a lot of ways to do this: SQL , Map , List.
For example you can create map similar to this:
Button.Tag = Certain_Color
Label.Tag = Certain_Color
and save it to memory, then load when activity starts. The easiest solution. The more advanced is with SQL.
Useful Class for saves using maps:
Edit: If you will save color as 255,255,255,255 you can then read saved map with this value and split into numbers with regex.split
Dim s() As String
s = Regex.Split (",","255,255,255,255)
Colors.ARGB (s(0),s(1),s(2),s(3)
Best regards