Is it possible to 'erase' your credit score - ie. to not have one at all?

Is it possible to delete/erase/remove your credit history and credit score data if you have no credit and aren't applying for any new credit facilities?

How do you find out which credit reporting agency (or agencies) has data about you and can you direct the agency to delete your records?