Opponents require two hits to destroy each of your buildings. Assigning a single hit to a building has no effect.