When it is in a historic district, yes. You have a problem with that, you take it up with the HPC!
The city currently has height restrictions in the Mill District and the warehouse district. You need to get the city to change that, good luck with that one! Also getting approval from the HPC, again good luck there. There the odds of winning an appeal would be very small, due to the nature of the district.
"Them's the rules" is a very different argument than "it should be that way."
The rules may say that, but it doesn't make it make any sense. The area is pretty filled in with buildings that protect it's historic nature. Building taller things in between them should not be a threat. We're not talking about an area with only a few remaining remnants that might get over-powered. The warehouses are everywhere.