xpd:
If you just want a MP3 player, then pretty much any Android phone will do the trick for minimal $$. AS for playing where you left off, thats down to the app you use.
You can run VLC on pretty much any Android phone or tablet. Or anything else for that matter.