You need to give your identity to set up a CoinBase account. If you want to have an anonymous bitcoin wallet, you could download and install bitcoin wallet software in your PC or smartphone. Go to App Store and install Bitcoin Wallet app. Bitcoins are stored on the device. If you lose the device, you will lose your bitcoins forever. So you need to back up your wallet. Keep your backup safe and remember the password.