In the backend, there’s no difference between labels and mailboxes. This switch is purely a boolean that instructs the the webmail client which set of behaviours to use.

Your colours will remain intact if you switch between the two. Mailboxes can have colours too.