You can generally do it either way. I prefer to remove the old drivers first, before shutting own the PC, simply because they are often easier to find while the card is still present.