During the 19th century, asparagus gained in popularity as a luxurious and special vegetable, requiring special serving utensils.  Additionally, there was an social aversion that grew out of strict Victorian rules that food was not be touched with one's fingers.  Thus the servers were born.