Depends. Fatigue stresses does accumulate on aluminium, but aluminum bike frames are generally so overbuilt that you can get billions of 'cycles' (one cycle = one excursion from high stress to low stress at any given point on the frame) before failure. But this is assuming the frame is made in such a way, and used in such a way, that no part sees higher stress than the designer anticipated - things like a bad weld, a void in the material, or a very heavy or strong rider, can result in stresses that will fatigue the frame earlier than you'd expect. Also, heavy jumping or crashing or other non-standard applications of stress are more likely to cause non-fatigue failure.
So the rule is, check your bike regularly for any cracks starting to develop, more often if you feel you are putting higher than normal loads on the frame by the way you use it. Especially check spots near welds and suspension pivots.
I am a big guy who rides a lot of miles and I have only ever had one aluminum frame fail, and it was a road-touring frame I did lots of thoughtless off-roading on, and I was riding it for months not knowing there was a crack before I retired it. I replaced it with an identical aluminum frame and have 10s of thousands of kms on the replacement so far, but fewer abusive 'off road' rides than I had done on the original.