Can I just access the money in my annuity?

Your annuity is essentially fixed until your retirement. In the event of incapacity for work, you may have it paid out early. In emergencies, you can surrender it, but you will have to pay back the previously enjoyed tax benefit plus a 20% penalty. That is why it is sensible to only deposit money that you can truly spare.