Go to <Xero Tax / Branding> tab

1. Download the contact csv from Xero
2. Download contacts from Salesforce
3. Map Xero ids with Salesforce Ids
4. Bulk update the csv file in Salesforce