I think it's the content, the look of your site, and how informative it is. I've noticed a big turn off for me is if the color scheme is way too bright or too many contrasting colors.