In my last post I talked about the survey as a conversation with the consumer. But recently it hit home that the survey is a conversation with our clients too. One that - paradoxically - is becoming increasingly more difficult to have as technology improves.
That's because nothing's impossible anymore in contemporary survey execution. Want elaborate skip logic? No problem! Want algorithm-based quota control? Sure thing! Want pop-up instructions and Flash file tours to illuminate complex product concepts? Bring it on.
Want to put all this into a document that your clients can comprehend? Good luck.
Today's questionnaires are more like complex computer code than a series of (related) inquiries, and as a result the task of reading someone else's questionnaire has become intolerable. For sure that's bad research practice - how can anyone else pick up your study and replicate it if they can't even understand what was done? More importantly that complexity leads to bad conversations with clients, who need to "get" what you're trying to accomplish with little need for mental gymnastics. When they don't immediately get the point, trust gets frayed and iterations abound.
I've always said "the questionnaire defines the charts and writes the report." That's still true today, and in all likelihood everything the client (or a colleague) needs to know is in the darn document. Unfortunately more often than not it's hard to tell, and that presents a vexing problem for practitioners who need to accommodate the need for complexity, make sure clients understand and buy in, and keep up with ever tightening timelines.
A list of (modest) suggestions about how to write more effective questionnaires:
So why not just say, "If the respondent is younger than 40 then don't ask them about The Incredible Hulk TV series starring the (taken from us too soon) Bill Bixby"?
I understand (believe me I do) that in the hustle and bustle of finalizing a questionnaire it's almost impossible to develop a parallel document describing the basic charts. But at TRC we've made such documents a standard part of our process. And we've found that when clients know a chart plan is forthcoming, they get far less stressed about whether or not to wade through logic.
What do you think? And how are you dealing with the need to distill ever more complex surveys into easily understood conversations with your clients? I look forward to the discussion.