There is no simple quick way to do this from an address list. Even looking them up individually via
www.streetmap.co.uk will show minor discrepancies and you will need to 'move' the arrow on streetmap to its proper location a few times.
However if you have Outlook (not express) you might be able to convert the spreadsheet into a list of contacts. Then if you have TTN5 you can navigate direct to each contact.
Just checked and you can import an excel file into your list of contacts. You may have to adjust the spreadsheet to match appropriate columns though, and split first names and last names to separate columns etc.