Great post, Jeff! Adding features while not fixing usability issues is one of my top peeves with poorly designed software. Fixing usability makes a lot more difference to how easy it is to actually DO something with the software, which is why I bought the %#$* program in the first place. I would way rather pay for enhanced usability than for features I don’t need.
The problem of reviews that obscure the information buyers need in order to make good buying decisions is not unique to software. Back in the '80s when I rode motorcycles, U.S. motorcycle magazines reviewed bikes, and buyers bought bikes, using a feature set similar to “Can do rotating 3D bullet points in color”:
- Engine displacement
- Horsepower
- Acceleration 0 to 60 mph
- Top speed
Engine displacement is irrelevant, since a bike can have a large-displacement, low-horsepower engine, or a small-displacement, high-hp engine. Need for horsepower depends on what you use the bike for most of the time. A bike (or car) with higher horsepower is significantly faster a little bit of the time, heavier and guzzling more gasoline all of the time. For most people, acceleration is less important than the FEEL of acceleration. A bike that accelerates fast but you don’t feel it is boring to ride (80s Honda Interceptor). A bike that accelerates slower but you feel a punch in the gut is more fun to ride. Top speed is relevant to some riders, but most people rarely use it. (Where can YOU ride 150 mph, and how often can you do it?)
Here are some things that make a REAL difference in keeping the bike from gathering dust in the back of the garage. Note that, unlike the list above, these are features that improve your experience of riding and owning the bike MOST OR ALL OF THE TIME:
-
Comfort. If the seat traps you in one position, and the bike buzzes so bad it puts your hands and feet to sleep, the bike won’t get ridden much.
-
Wide power band. This is another a comfort issue. A bike with a peaky power band (like a lot of the race bike clones of that era) requires constant gear changes. That’s okay if you are riding flat-out for 20 minutes, but a hassle on a long ride. If the bike’s not comfy on long rides, you won’t ride it as much.
-
Reliability. If it’s broke, it won’t get ridden. If parts are hard to get, it’ll stay broke longer. (Brands with a high degree of parts interchangeability between models, such as BMWs and Moto Guzzis, were a lot easier to get parts for than more popular Japanese brands that changed models every 0.003 seconds.)
-
Easy to work on. This is important even if you hire all the work done, because a bike that is easy to work on will be inexpensive to tune up and maintain. I’ve seen a lot of bikes sitting in garages because a tune-up cost so much.
-
Low center of gravity. The bike is easier to handle, more fun to ride, less likely to go down, and easier to right if it tips over.
IOW, usability, usability, usability.
I only ever saw one motorcycle model comparison that took real-world riding into account in this way. To simulate a flat rear tire, a magazine had each of 5 brands of touring bike stop by the side of the road and remove and replace the rear wheel. The Gold Wing was still sitting by the side of the road FIVE HOURS LATER when the BMW crossed into the next state. (The Gold Wing’s built-in panniers and loads of bodywork complicated access to the rear wheel. It’s high weight also complicated matters.) Just for fun I tested my sport-touring bike and removing the rear wheel took under 3 minutes, including getting the tools out from under the seat. I rode that bike every day year-round.
I LOVE the idea of applying this to software. How long does it take to do X? Pick some real-world job that users are likely to do. Have some users that are familiar with the old software, some that are familiar with a popular competing brand, and some that are newbies. Observe, and keep the stopwatch going.
Another important issue: useful, time-saving features that are so badly implemented that users don’t use them. Example: Word’s bad parody of style sheets are so poorly implemented that users avoid them. Result: most users don’t know how to use style sheets, and don’t understand their benefits. Which is too bad, because style sheets are one of the biggest time-savers ever invented.
Some of the best software I’ve ever used deliberately restricts the feature set to keep the program fast and functional. I like that.