You can buy books elsewhere without DRM and copy them to the kindle via cable. You can even buy protected books from the Amazon shop and download them for offline installation. If the device never connects to the web, they can’t delete anything remotely.

Mine has been offline ever since I bought it, 8 years ago.