Adding language after failed installation does not work (fields remain in DB)

I had an irrecoverable error when adding the Spanish language to CiviCRM. Unfortunately I did not note down the original error, but attempting reinstall fails and leads again to irrecoverable errors, as the DB was partially populated with the spanish related columns and tables.

Duplicate column name 'label_es_ES', 1060

It would probably be useful to have a way to remove all the specific language related fields from the DB