No, CENTER_HORIZONTAL works correctly: it centers the text in the center of the label component; ie, centers it from a left/right stand point.
CENTER_VERTICALLY should center the text from a top/bottom stand point, regardless of what the .Height is of the label.