We have a fireplace and it makes good way to start up the fire with kindling wood 

If you have a single hole punch, you could punch out any private info such as names, addresses and numbers - might take a while but hey it works.

Alternative we have cheap shredder which ends up in the fireplace too. Personally I keep a postal method for 1x utility bill and 1x proof of address for verification/debt validation with some online companies