Dedupe over substrings is slow due to bad MySQL indices

For some reason MySQL does not use existing indices when searching/comparing substrings (via SUBSTR(field, 1, lenght) - so even when they are at the beginning of a given field).

In the case of substring-based dedupe rules we should create appropriate (substring-based) indices instead the current full-width ones.