The current Mac Pro is only 1 year old (although that was just a minor CPU bump). Similarly, graphics cards you can get for the Mac Pro are typically a year or so old. You can buy GTX 680s from NVidia or Radeon HD 7950s from ATI.
The newest cards need to be flashed to Mac firmware. For example, you can buy pre-flashed GTX 770s like this: