"Life on a manor was extremely hard for a peasant. It consisted of work and family life. Approximately ninety percent of the people in the middle ages were considered to be peasants. There was a division of the peasants into free and a type of indentured servants. The free peasants worked in their own independent businesses, usually as carpenters, blacksmiths, weavers, or bakers. They paid the lord a type of rent for using their small plots of land. The other, unfree peasants lived on the land without paying any money, but worked for the lord, earning their stay. 
The large amount of land surrounding the castle provided a means for peasants to acquire enough money and food to live by farming. In fact, this is another extension of the fief idea. The average farmer was given a plot of land on which he could farm. He also got a sense of security by living near a castle and potential protection from danger. They also had the privilege of passing their land on through inheritance after their deaths. They had grazing and field rights around their village. They also had right to building materials in the area. They did not have right to hunt most wild game, however.
The lord also had a great deal of control over his peasants, known as serfs. In fact, the serfs were almost like slaves to the feudal lord. He had the right to grant marriages, tax anytime or anything, and to force them to use mills or ovens that he owned. He most often made his serfs work his own land."
http://library.thinkquest.org/10949/fief/lofeudal.html