Can't unselect a stock state field

1) Setup a new custom state field.
2) Edit a contact.
3) Choose a state.
4) Save.
5) All good so far.
6) Re-edit the contact.
7) De-select the state.
8) Save.
8) Uh-oh, the old state is still there.