CiviCRM cannot be used by a user that was deleted then recreated in Joomla

How to recreate the bug:

1) Create a Joomla user id that is also a CiviCRM contact.
2) Delete the Joomla user by using the Joomla User Manager
3) Use the Joomla User Manager to recreate the user, using the same email address as step 1. Make the user a "manager" or better.
4) Log in to Joomla back end using the new user id and password.
5) Click "Components ...CiviCRM"

You will now see:

Sorry. A non-recoverable error has occurred.

DB Error: already exists

Return to home page.

Error Details:

Array
(
[callback] => Array
(
[0] => CRM_Core_Error
[1] => handle
)

[code] => -5
[message] => DB Error: already exists
[mode] => 16
[debug_info] => INSERT INTO civicrm_uf_match (domain_id , uf_id , uf_name , contact_id ) VALUES ( 1 , 67 , 'joe@test.com' , 5 ) [nativecode=1062 ** Duplicate entry 'joe@test.com-1' for key 2]
[type] => DB_Error
[user_info] => INSERT INTO civicrm_uf_match (domain_id , uf_id , uf_name , contact_id ) VALUES ( 1 , 67 , 'joe@test.com' , 5 ) [nativecode=1062 ** Duplicate entry 'joe@test.com-1' for key 2]
[to_string] => [db_error: message="DB Error: already exists" code=-5 mode=callback callback=CRM_Core_Error::handle prefix="" info="INSERT INTO civicrm_uf_match (domain_id , uf_id , uf_name , contact_id ) VALUES ( 1 , 67 , 'joe@test.com' , 5 ) [nativecode=1062 ** Duplicate entry 'joe@test.com-1' for key 2]"]
)