If government was run strictly by people, factions would arise and the tyranny of the majority which Hamilton warned about in Federalist 10 would occur. During the time of the Articles of Confederation, there wasn't anarchy per se, but every state worked and operated for itself and the result was a weak government with no defense and a shitty economy so the nation couldn't function well. That has to be taken into account when dealing with large amounts of people.