Does my annuity count towards the assets test?

No, an annuity for self-employed individuals is safe from the social assistance assessment and does not count as assets. It is also exempt from Box 3 tax. Your pension accrual is therefore always safe, no matter what happens.