UX v. SEO: Content v. Form
Imagine a hypothetical Web site that is ready to launch. It looks great, test users love it, the client loves it, and everyone is happy. Everyone, that is, except the SEO expert.
The SEO expert is, after all, responsible for guiding and delivering search engine optimization (SEO). SEO experts provide methods to drive a site up the Google results page, and because what they do often can be quantified quite easily as success or failure, SEO experts can be very specific about what changes are necessary to ensure that the site shows up when people want to find it.
Or, rather, they help ensure that the site shows up when people search for certain things. We’ll get to that why that difference matters in a moment.
An SEO expert might want the page titles changed. No biggie, right? They might want keywords integrated into site copy and image alt tags. Again: that’s cool. So far the great-looking, user-approved, client-adored site is intact, and the “under the hood” SEO adjustments don’t mean any concessions.
But what if the results aren’t good enough? What is the SEO expert to do?
Answer: they want more keywords. They want more and more keywords. They want links and other adjustments to the site that often not only spoil the aesthetic nor the way the client views the site, but the way that users experience it.
The stage has been set, then, for the classic SEO v. UX battle.
User experience (UX) encompasses how the users navigate a site, how they feel about a site, and how key features and messages are delivered. Good UX adds value and, when coupled with content users want, helps define the value of a site.
An argument for compromising UX in the name of SEO is relatively easy to make: if users cannot find the site, they cannot enjoy the experience. By giving a little on the experience front, the thinking goes, traffic will be generated and the site will be better off for being … worse.
In order to challenge this position, I think it’s necessary, first and foremost, to examine what SEO is at its most basic level. It is the manipulation of the difference between the value of a site and what search engines perceive to be the value.
Let’s deconstruct that quickly before we move on. A perfect search engine would know what the user wanted to find and give them the best possible value given that request. It would not be fooled by fake Web sites and it would be able to account for minor user error to point them in the right direction. No search engine is perfect, though, and because of the algorithms and logic used by the software of Google and Microsoft and others, inefficiencies exist: gaps between what the user wants and what the search site delivers. SEO manipulates that inefficiency by knowing (or guessing) at what search sites look for and “gaming the system” for positive results. If that perspective is too cynical for you, gentle reader/conscientious SEO expert, another way of looking at it might be that SEO strives to accurately convey the true value of a site given the search engine’s inability to correctly judge what the user wants when she searches.
SEO, then, is a cosmetic cover-up for the acne-riddled face of search sites.
The early days of search sites saw directories dominate. Microsoft and Yahoo employed teams of worker bees to review sites and classify and rate them, allowing users to have a virtual yellow pages. This didn’t scale, of course, as the number of Web pages exploded. Early attempt at user-updated directories were prone to severe levels of cheating and it was nearly impossible to trust ratings and/or believe that the directory was anything near complete.
The next step was the use of software to supplant directories with search engines. Bots would read pages and see what terms showed up and then spit out results for users on the search pages. Proto-SEO actors would game the system, search sites would adjust, and search engines evolved into what we have today: a reasonably fleshed-out coverage of many parts of the World Wide Web.
The good news is that as technology has improved the gap between search site perception of value and actual value has decreased. The bad news is that the gap is still relatively wide in many cases.
It is in this environment that the hypothetical Web site we’ve created finds itself. Search site placement can be very important, but sacrificing value to users in order to gather users can result in an inferior Web site.
Fortunately, the future might allow the best possible sites to exist with the most possible users. The future might have a superior search approach: one that combines technology with communal eyeballs and collective-approved expert opinion.
Earlier efforts at this sort of thing (by sites like Wikia) have fallen short, but hope is not lost. Zakta seeks to augment its search results by letting users edit, save and share the results for their search terms. A standard Google search for “best HDTVs” might have two pages of questionable or even unusable results—either because of SEO or because of the passage of time and weakness of the search algorithm. On Zakta, the same search may point to a user who has taken the time to build a top 10 list of HDTV review sites and five of his favorite online retailers. Eventually, the same search might result in a half-dozen similar lists, with the searcher able to differentiate between the quality of the lists and/or quality of the list-maker as rated by other users of the search site.
Zakta might not be the next step, but the next step is coming. It’s Wikipedia meets Digg meets Google. It encourages value over gaming and substance over style. And it might signal the end of SEO as we know it.


comment// Dave
date// September 21st, 2009
Seems to me that search engine robots are just looking for well-structured data, and well-structured data benefits both robots and users. And robots, after all, are built by humans. This is why the markup is semantic. I think a site that follows SEO best practices is positioned to also enjoy a happy user, given that the content is valuable, well organized and easy to navigate (the site is designed well). I don’t see these two audience’s needs as being at odds with each other. If you do one right, the other should be a slam dunk with minimal massaging.