Food is also used as upkeep for your army. The amount of food consumed by different units varies and can be found in the units page.
Negative food incomeModifier
When you have more soldiers than your farms can produce food for, you have a negative food income.
Always keep the food production higher then the upkeep, or ensure a high enough stock! Otherwise troops will just disappear!