The owners cited the “perils and violence of the downtown environment,” inflation, the decrease in consumer spending, and the demise of retail as reasons.