From a prosperous family, Villoresi could afford to buy a car and began competing in local rallies at the age of twenty-two with a Lancia Lambda and a few years later acquired a Fiat Balilla with which he and his brother Emilio competed in the Mille Miglia.