I should really feel bad for saying this, but I do care about graphics. They add an atmosphere so much more surreal than just blocky, retrograde textures that can have my friends saying "I can see the pixels!". Unless the game is good enough in my honest opinion to have me ignoring the grotesque quality, it can really be a problem.
To be quite honest, a good balance of both is needed for a great game. Without good graphics, there is no appeal and without a good game experience it would be a huge waste of time.