Can't really find any information on if it's at all worth while insulating a new "A grade" cylinder. It's cold to the touch... But I'd be willing to make the small investment if it did eventually pay for itself in say 5 years?
Pipes aren't insulated so will definitely be doing that.