Internally, CiviCRM requires all the data to be encoded in UTF-8.
For import and export CiviCRM uses CSV files, which do not containt any encoding declaration. We should consider mentioning that the exported files are UTF-8-encoded, and consider a mechanism for importing CSV files encoded in other encodings.
Topics to consider:
- a drop-down with possible encodings on import?
- use of iconv for conversion (PHP support requried)?
- a quick check for validity of UTF-8-encoded data?