Yeah, be nice to have that panel, because it's part of how they cool. It forces the convective airflow go move only over the tubes and fins which removes the most amount of heat, making the fridge the most efficent.
But, it can sit flush against a wall and get the same circulation benefit.
In...