Officers said the "most significant activity" took place at the Queen Victoria Market where protesters chanting "freedom" were met with a heavy police presence.
The demonstrators at one point linked arms as they were surrounded by police officers.
Scuffles broke out as arrests were made.
A Victoria Police spokesman said there were between 200 and 250 people involved in the protest activity, and 176 were fined.