Amazon as an example remove it at the account level, so unless you manually download it outside of that ecosystem then they COULD remove it from account at any time.
Not if you don't connect your Kindle to the internet ever and download no-DRM epubs, convert to mobi and transfer them across. I also have a backup non-Amazon ereader with zero internet functionality.