All building permits in Columbia Township go through Hamilton County. Columbia Township does not have a planning/zoning department.
https://www.hamiltoncountyohio.gov/government/departments/buildings_and_inspections/permits
The only time to call the township for a permit would be for concrete being poured for a driveway.