Outlook has an Import/Export wizard that makes it easy to import contacts from a CSV file.
Note: These instructions assume you've already backed up your Outlook contacts by exporting it out of Outlook.