Should I buy a new desktop or upgrade middle aged computer ?

I want to game and the specs on the semi-new desktop are bad real bad, Easier to upgrade and get a gaming desktop or just buy a new one? How much would It cost to add all the good stuff (faster processor, memory, hardrive, graphics card, power supply etc.)?