Three Barrow areas of historic or cultural importance have been called ‘deteriorating’ and in ‘poor’ condition by government watchdogs.