Time for a Fredaphor:
“Imagine you are driving down the motorway. Ahead of you, you see a coned off area, chopping down the highway to one lane. No one is working in the roadworks section. Does this mean you should barge through the cones into the ‘hazard-zone?’ (If you answered yes, there is a psych-ward near me. I’ll hook you up.) NO.”
For whatever reason you are unable to do pattern work, just obey it. We have no easy way of telling what’s going on on the controllers side, so our best option is to co-operate. Do patter work elsewhere/on solo or just depart out of the airspace.