Words and labels and ambiguity

This Tuesday I went along to the Occupational Psychology/Organizational Behaviour catch-up day at Birkbeck and experienced the luxury of a full day noodling around new research concepts and the thrill of hearing the word ‘critical’ from someone else’s lips.

It was an interesting mixture of heavy content and some of the worst Powerpoint I have seen.   Some of the standouts were actually the Masters projects, rather than faculty.

the stand-out talks

Diane Burns presented a nice project based on discourse analysis, looking at the meaning of ‘collaboration’ in a health service setting.  I liked the concept of ’strategic ambiguity’ – the ways in which people completely fail to define what they are doing, so that they can do lots of different things. Or maintain their power, mwahahahah.

Michael Clarke presented a piece (with photos!!) on the meaning of fatherhood for men working in new media.  This was a delightful talk, introducing the ‘hero culture’ of new media working, and the challenge of overlaying identity as a father onto a youth-driven, youth-pretending industry.  Michael’s talk was the one that made me want to run off and check out some theory (on performing identity), because I’m sad like that.

Andreas Liefhooghe (faculty) gave a perplexing talk (with many, many photos) which personally I found intriguing yet profoundly irritating.  He has done a lot of research on workplace bullying, from a critical perspective, and he drew on Foucault to talk about the difficulties of conceptualising bullying – introducing ‘bullying’ produces a bully/victim binary categorisation that casts people into certain roles. OK, it was more complex than that.

The talk was illustrated with lots of still black and white shots of institutions (the prison, the Panopticon) and people as victims.  It felt extremely manipulative, both as Powerpoint and as talk…verging on the Emperor’s New Clothes in the overuse of bloody Foucault…and yet.   In the midst of my annoyance with it, I could see what he meant. The reduction of personal difficulties to simple categories (stress, bullying, harassment) and binaries (harasser-victim) can set off long chains of unintended and unhelpful consequences.

the joy of labels

What he overlooked, though, is the relief in naming something, even if that naming is a little bit wrong.   It is the difference between listing vague symptoms (I’m sure he’d appreciate the medical analogy) and realising that it all adds up to a recognisable syndrome.  Invoking the label creates a positive basis for action, too, even if there are many things wrong in using the label.

and your point?

But, you say, what is the relevance of all this fine theory to anything practical at all?

I think…I think for me, it focuses me on the need to learn about what is there in front of me (in a qualitative interview or in a questionnaire), where the co-creators of the study want to push it down some well-worn paths and offer some very familiar interpretations.  Many times, the issues don’t fit those neat categories, and it is very tempting to adjust things so that they do.  So, I’m reminded of the value in hanging onto ambiguity and interpreting the thing, not its reflection or its near neighbour. If that makes any sense.

Communicating science: some highlights from the BSA conference, part 1

I just spent 2 days at the British Science Association’s Science Communication Conference.  I haven’t been to this particular shindig in quite a few years; it’s quite a mixture of folk: academics, science popularisers, PR officers, evaluators, artists, you name it.  Five highlights:

1. Tackling obesity through an evidence-based campaign

The ‘Behaviour and Choice’ plenary examined the ‘Change4life’anti-obesity campaign, with input from the Department of Health (who commissioned loads of research), the MRC Human Nutrition Research centre (who converted the science into action points, like reducing your portion size, swapping your snacks and getting 60 minutes of exercise a day); and M&C Saatchi, who developed the advertising campaign.

I had mixed feelings about this one.  It’s working fairly well, God love them, and they have made it highly evidence-based, working hard with the scientists to come up with the best practical advice for families.    The ad campaign and the website (ever seen such an unfriendly domain name?)  seem, um, a bit patronising, and anyone with kids in primary school will know that healthy eating campaigns are two a penny.

2. Getting universities to take communication seriously

After the teeniest conference lunch known to mankind (I had to nip out for a roast beef bap afterwards), it was on to a giant session on the ‘Beacons for Public Engagement’ programme.  This is a complicated set of partners basically trying to get universities to become more committed to explaining themselves to their publics.    The Beacon universities (about 7 of them) are doing this through Action Learning projects, inventing change processes that will enable universities to embed public engagement in what they do.

The speakers were gung-ho and very committed, and were clearly getting a great deal out of the project.   It was a little harder to see what was going on, from a more distant perspective.  As with Change4life, one of the biggest difficulties in evaluating these kinds of projects is that the institutional participants find it life-changing.   One has to be careful that personal fulfilment isn’t obscuring the larger view, which is that you’re actually talking to an external audience and their opinions are what will ultimately count.

3. Evaluation and the power of Three Letter Acronyms

I joined the Evaluation breakout session, as a matter of duty, because, well, evaluation is one of the things I do in the science area.  Leaders from another Beacon-related project described their gold-plated evaluation concept, aka ‘Generic Learning Outcomes’ and put us into small groups to develop GLOs for some science activities.  My wee group found this bloody tricky, as we kept getting sidetracked by greater issues of Methodology.

I might talk a bit more about this when I talk about reactions to the second day.   There’s no doubt that the GLO concept – essentially, measuring interventions on up to 5 dimensions – is fairly sensible.   However, in our group the real question was how to measure response intelligently, and to some degree the actual content was secondary to getting the method right.

I think what GLOs really need is a bit of a makeover, so that the 5 dimensions look pretty and can be summed up by an arresting 5 letter acronym.

4. Scientists doing themselves: blogs, podcasts and Twitter

Final session of the day was an extremely enjoyable tour around the use of new media in science communication.  I didn’t expect to learn lots from this, but in actual fact it was thoroughly novel and highly engaging.

Ed Yong compared his experience with writing a personal science blog (the very lovely Not Exactly Rocket Science), with the approach required in his day job as one of the blogging team for Cancer Research UK’s science update blog. There are lots of science blogs these days, and they are really filling a gap between the abstract language of scientific papers and the dumbed-down media treatment of scientific issues.

Neasan O’Neill talked about using Twitter and blogs for a highly technical worldwide community of particle physicists. Neasan is a veritable Hydra, with many blogs, sites and Twitter identities all maintaining his community in its various forms.

Chris Smith from The Naked Scientists gave a deeply entertaining talk about his radio show and general empire, which has become one of the top podcasts on iTunes, and has pretty much crashed every server it’s ever run on.

Naked Scientists is extremely silly, has a worldwide audience, a website, a forum, and a whole bunch of stupid kitchen-table experiments that you can do at home. I particularly like the home-grown ramshackle nature of this enterprise, which clearly started as a bit of fun and then grew and grew.  The enthusiasm of the contributors is palpable, pretty much to the point where I want to run off and make my own Research Show. Er.

5. Thoughts;  science campaigning; and the power of dialogic methods

I think I’ll save Day 2 for a separate post.  Overall, I was impressed by the ways in which science communication has matured and professionalised itself.  In particular, there are far more scientists who are involved in communicating their science directly.    Scientists have also woken up to the need for proactive communication to prevent certain ethical debates from going postal: so, for example, there was a terrific report (Hype, hope and hybrids) produced on the scientific community’s response to the Government’s original attempt to clamp down on stem cell research.

Government departments are also far more sophisticated and thoughtful, whatever happens at policy level.  At the evening reception, the Sciencewise report on public dialogue methods was launched.  This is worth a read.  Deliberative methods (typically bringing together experts and the public) are powerful ways of looking at public perception and human response to complex problems, and this report outlines the advantages and the issues very clearly.  A good read for anyone in research, even if you’re not a social researcher.  I reckon a few big brands out there could totally benefit from a Consensus Conference…

That’s it from Day One; I’ll round up the second day soon as I can.

Learning to love the stacks

Books in a Stack, by austinevan on Flickr

Books in a Stack, by austinevan on Flickr

I’m just starting a new project that involves doing a literature search before getting stuck into interviewing.

I spent untold years doing ad hoc research, in a cab-style ‘take the next project’ sort of way, and I can’t tell you what a complete pleasure it is to be allowed to go and look at the literature.

It’s maybe peculiar to the places I used to work, but there was quite a disdain towards Doing A Bit of Reading, and a complete horror of exerting one’s database search skills with all the Boolean logic which that entails.

Not all projects need much beyond basic immersion in what went before, but I do projects which involve setting up a new Thing, like a framework, as well as gathering data. What I have learned:

4 benefits of full-on research:

1. Not reinventing the wheel. NOT REINVENTING THE WHEEL!!! So many, many things have been done before, some of them rather well.

2. Allowing time and space for you to really consider the issue Nuff said.

3. Constructing new knowledge Outside well-researched topics, typically you’ll end up synthesising information from a grab-bag of odd-looking books, papers, and commentary.  This is marvellous.

4. You can come up with theories and hypotheses! And then test them! Possibly just me…asking the right people the best questions is a luxury indeed.

And so on to …*drumroll*

7 tips for a successful search :P

1. Join a university library. This can be hard work without current connections, but there may well be a great, relevant library that you can use.  Online catalogues look like the answer to your prayers but in practice can be expensive and difficult to access, depending on the subject area.  Use your academic or professional affiliations to get access to books and journals.  I use the Wellcome Library,  Birkbeck College,  and Cambridge University Library; I also have access to the British Psychological Society’s collection.  Wellcome has a great cafe.

2. Recognise that opinions are legion but facts can be sparse. Most literature reviews outside academia involve several Emperor’s New Clothes moments: typically, the absence of any evidence whatsoever for strongly-held popular opinions.

3. Web resources look infinite but actually aren’t. This is the never-ending Web Ring problem where you chase promising sets of hyperlinks that eventually loop around themselves in a giant spiral of mutual attribution.

4. Look in parallel fields for great answers. It is quite likely that your particular horrible problem has been discussed and perhaps even solved in a rather different field of operation. In my experience, teaching is a completely overlooked source of great information.  Take e-moderating for example: 90% of the problems online researchers face have already been researched, written up and peer-reviewed by academics working in teaching and online learning.

5. Find the official resources. Government sources are excellent and entirely free.  You can find entire datasets this way.

6. Identify the star papers and books as quickly as you can. In any field, there are some essential pieces of reading.  In a brand new field, one of the most useful things you can find is the high-level textbook.  These are your Little Helpers. Love them and treat them well.

7. Be flexible, don’t print out in too small a font, and carry paper, pens and a USB stick everywhere.

Hitting the wall: inevitable Twitter navel-gazing

The Wall, by _spoon_

Image: The Wall, by _spoon_, via Flickr

I think I’ve hit a bit of a wall with Twitter.  The excitement of all the initial exploration and discovery has been overtaken by some feelings of hmmm, how can I put it?  Weary drudgery. Overload.  Disconnection.

I do recognise this flat phase from other networking – eventually after a bit of wild expansion, you need to regroup and consolidate.  I got really excited at uncovering new people and new blogs via Twitter;  then I went a bit mad adding new people and finally, I got to the stage of being unable to keep up, or remember who this person was.

On the whole, I’m loving Twitter, but it’s such an odd window on the world.

Four things that struck me this week:

  • the excitement and the frustration of online networking

Sometimes you hit a good 140 character ‘conversation’ and you think: dang, this chat would be far better carried out over coffee, or a drink, or even something extremely 2003 like Instant Messenger.   The Twitter chat can be great, at times, but it’s also so frustrating and narrow.  You people on the internet, you’re different in real life.  I know that.  I’d like to see that. I’d like to see YOU.

  • the niche nature of online networks

Few social networks, even the high profile ones, truly capture an audience.   There are so many relevant and interesting people who aren’t there.

In the case of Twitter, perhaps it’s maybe likely that everyone in an intense geekspace is present; but outside of that group, online networks are a partial representation of the whole.    Of course, that doesn’t matter:  we talk to the people who are here; but when we generalise beyond ourselves, we need to remember all the other folk who are too busy or too uninterested to get involved.

  • the sheer VOLUME of virtual landfill (blogfill?)

I think it was the NME (someone will correct me) who coined the term ‘indie landfill’  for a certain kind of indie act that would get 6 months of fame if they were lucky.    With Twitter, I click blindly on posts.  Some blogs are lovely, some are dire, some are OK.

THERE ARE SO VERY MANY.

Freshnetworks have a well-written, interesting, pithy post up every single bloody day.   I’m still musing on Tuesday and they’ve bounced on to Thursday.

I can’t keep up.

Finally:

  • We  are weirder than we realise

So. I tweet, I read, I blog, I comment.   When I come across an interesting blog that I’d like to read regularly, I add it to my Netvibes page (my RSS reader).   In the research I did last year amongst young managers, something like 9 per cent had used an RSS feed.    Now, I know fine well that I am not up there with the technogeeks.  Still, I have a Netvibes page.  THIS ACTUALLY MAKES ME QUITE UNUSUAL.  Add in my demographic details and it makes me an actual freak, but we won’t go there.

There’s a moral here somewhere.   Get out more, maybe (note to self).  This is nice, but it’s not the world; and for the most part, it’s not your customers’ world either.

How do you stop yourselves from being overwhelmed?

Early days in online communities: access and social presence

The community staircase

The community staircase

This is a model of research community socialisation that I developed in a white paper for Virtual Surveys a couple of years ago.   I was inspired by two sources: first, the ‘forming, storming, norming, performing’ model of focus group dynamics that all qualitative researchers have drilled into them; and a similar five-step model developed by Gilly Salmon to account for online socialisation in online learning environments.

Most of the chat about community moderation skills focuses on the higher level issues of discussion and debate.   What I wanted to stress in this model was the importance of the two bottom steps, access (getting in) and social presence  (establishing your voice).

Access is probably the most-neglected element of all.  We might invite people.  We might screen them to find certain characteristics.  Whatever we do, participants do not arrive at an online discussion relaxed, chipper and ready to go.   Like the focus group attendee who’s late for a group, they’ve just been on a journey.  It probably involved an invitation and a link; then it may have involved some registration and some screening; then it may have required that they set up a profile.

If we are lucky, then the journey to community entry will have been smooth and enjoyable, like arriving on a clean train at a nice, well organised conference.  If we are unlucky, the whole experience will have been the satanic lovechild of Facebook, MySpace, and the worst online survey you’ve ever taken; and you arrive, bedraggled, twitchy and suspicious, in the online community space.

So, my first memo to community developers: please please put the same amount of effort in designing the entry journey (invitation and screening) as you do into the rest of the community. It will pay off in happy, soothed participants who are reasonably confident that they know who you are and what they’re doing.

Memo number 2 to developers is to think about your conversation feedback loops.   Assuming that your participants won’t be camped on the site 24/7, how are you going to tell them about new content, and how are they going to find out about answers to their own comments?   Emailed comment notification is usually a good idea; if you don’t use this, you need ways of being very sure that participants will visit and revisit regularly.

The last part of access is welcome.   Once you’ve made it in, it’s nice to get a friendly message with a bit of orientation thrown in, maybe a first task.  It makes you feel wanted and valued.

NB Apparently minor things in this journey can be quite important.   If you give no clues at all about the choice of a screen name (and there is another conversation to be had about that in the first place), do not come crying to me later about Bigbottom29’s sense of being bullied.  Think about your audience and their likely online experience.  The under 20s may crop and upload user images at the drop of a hat;  the inexperienced participant in your over-50s life insurance community may panic and flail. Give them some pre-prepared options they can choose from.

The second stage in community development is establishing social presence. For me, a true sense of social presence iss essential for proper discussion to take place.  This rather fluffy phrase means that participants can easily get a sense of what the community itself is like, what other participants are like, and equally are able to communicate themselves reasonably fully within the online setting.

In a community of passion – let’s say a Dr Who community – this will be done at a personal level through username, avatar/signature and point of view.

In a research community, the initial site content that a new recruit finds will be extremely important in helping them develop an understanding of what the community is all about.    How do new recruits create their own presence?  Usernames, avatars and profiles can all be helpful,  but I firmly believe you need to structure the initial online discussions carefully so that you and your participants can get a full sense of each other right from the start.

A good, simple way of doing this is to have a nicely-designed  Introduce Yourself thread.   Model the introduction carefully (model model model I would say) and (1) you’ll get some lovely data right there  (2) the participants will feel a little bit loved and valued and (3) the participants will start to come to life.  (Is this just me?  There is often a golden moment in an online discussion where you truly begin to understand who the other person is.  It usually comes out of authentic exchange, and it’s really what I’m trying to spark in those initial conversations).

What do I mean by model?  Usually there is some important story or introductory background that your participants want to get off their chests.  Let’s say you’re an online retailer.  You’re mostly interested in response to a new design concept; you’re tempted to rush on to that and make early introductions minimal.   If you leave intros entirely up to participants (perhaps in the interests of saving pixels) they will default to name, age, job that’s all 4 now luv u byeee!!!

You will have saved pixels and a bit of effort from the moderator, but your community will have a rather limited sense of itself;  having started out with brief comments and no strokes/feedback, they may never wind up to giving you more heartfelt or difficult comments on the design.   You didn’t appear to care about them, so why bother?   Good introductory experiences pay back tenfold, just as they do in a focus group.

A better self-introduction task would be to ask the participant to introduce themself and say a bit about the last item of clothing they bought, and their personal fashion philosophy.    If the moderator models this by talking about him/herself, or giving a full example, the participant immediately sees what you mean and has a go.    The participant has now contributed fully; add in a couple of replies from the moderator or another participant with similar tastes, and you are on the way to creating a community that will eventually talk without you. The trick is to pick something that is relevant to you and interesting for participants to do; and in the analysis you will probably come back to this thread more than any other.

Teaching my grandmother to suck eggs, I’m sure.

One final comment on the model: each step has participant views and moderator views.  The moderator just as much as the participant has to create a sense of genuine personality and social presence in the content that they write, the questions that they ask and the replies that they make.   Personally, I like moderators to be able to establish authentic contact, and that may mean disclosing more about themselves verbally than they would do in a face-to-face setting.

Still relevant? Do I need to tweak this now?  What else do you think needs to be in place during the first stages of community formation?

The meaning of silence in an online context

I’ve been pondering a few of the discussions I’ve seen on online versus offline research approaches:  Zebrabites’ thoughts on the need to understand users in person as well as hypertext;  Matt Rhodes of Freshnetworks’ recommendation that we understand people in natural online communities as well as specially-constructed research communities.   People share themselves and their opinions differently in different contexts.

We tend to treat an online conversation (on a message board, a blog reply, a social network) as an honest record, right there on the screen, of what Audience A thinks of Topic B.  Or, at least, we might elaborate, what Willing Contributors from Audience A think about Topic B.   As Katie and Matt suggest, it’s not quite that simple.

Why wouldn’t people say what they think, in an online network? Why might they keep quiet?  In my view, social pressures shape our conversations online just as much as they do in everyday life.  Indeed, some of those pressures to behave may be even stronger online.

The other day, I touched on discourse or conversation analysis, where you analyse a given conversation and you look at the way the participants frame their discussion.   You also look, as far as you can, at what’s missing.

What is the meaning of silence, online? (Or: have I gone mad in trying to express what I mean?)

Let me try and explain.  Online, we have talk (the posted conversation which we can analyse to our heart’s content) and we have silence (the large majority who read but don’t contribute).   The posted conversation may not be an accurate reflection of the whole, in the same way that conversations in a group discussion may not always be good representations of individual opinions.

What silences people who might otherwise contribute? Here are my top three.

The silencing power of strong opinions

If I read a blog with lots of passionate contributions, my decision to contribute will depend on my viewpoint and how I feel about throwing it into the conversation.   If I dislike loud online argument, and those who have already commented are arguing passionately with each other, I may choose not to contribute my dissenting comment.

Another example: a couple of years ago, I helped troubleshoot an online community that wasn’t working too well.  It was pretty unmoderated: new people joined but they rarely participated.  It turned out that the community was dominated by a small group of older, vociferous and rather right-wing users.   New users arrived, took one look at some of the ‘hanging’s-too-good-for-them’ rants, and ran away.    They didn’t feel welcome.

Perceived social disapproval

I may choose not to talk about something that actually excites me because I suspect that other people will be negative about it.   To take a minor example, I use the blog network, Livejournal, and I’ve recently become a convert to Twitter.  People on LJ are routinely scathing about Twitter.   When I first started using Twitter seriously, I didn’t mention it on LJ.   Eventually, I broke down and talked about it, and various of my LJ mates broke out and said ‘Ooh, yes, it’s great, I have one too and here it is! ‘

I would never have known if I hadn’t asked.

Online conversation persistence

In stable online networks, our conversations can be very, very easy to follow.   As a result it can be very hard to gossip: nothing is hidden.  In real life we can sit through a boring presentation and then have a whispered chat with our neighbour about how dull it was, before putting on a bright smile and congratulating the speaker as they breeze up to us and ask what we thought.

If we thought that the entire conversation with the neighbour would be retrievable later by the speaker, we might act rather differently. Online, a third party may be able to do exactly that.

The persistence of online conversations also leads us to be careful about expressing our opinion of someone who doesn’t appear to be present.   They might come along in 3 hours or 3 days (or 3 years), and get upset.

‘The lurkers are supporting me in email!’

They might be.

Silence is not necessarily agreement.  It can be curiosity, boredom, or dissent, at the very least.  All of us are lurkers (readers), as well as participants.  Sometimes, we watch the debate and we don’t join in publicly.

If a counter-opinion can’t be expressed openly for fear of social consequences, back channels can help participants let off steam.  Sites like PostSecret help some people express socially unacceptable views.   Private messaging options and quick polls (the kind where you can’t see what everyone else put) can make it safer to express yourself.

You can do all sorts of things to make a network a safe space in which to express opinions.   Ultimately, though, you might need to triangulate your findings by mixing methods: networks and one-to-one, online and in-person.    Lifting an online conversation straight from a ‘natural’ network  may lead you to some highly unreliable conclusions.

Thoughts? Have I managed to express myself on this one?

The business of making communities

On Tuesday I went to Freshnetworks’ session on online communities in retail. Incredibly interesting morning, with 3 different speakers talking about the use of social media from different perspectives:  Helen Trim from Freshnetworks giving her top tips on what to do (and what not to do) in terms of social media;  Joanne Jacobs on measuring return on investment; and James Hart from online fashion site ASOS, talking about the (internal) route to launching the ASOS Life community (apparently launch was this Wednesday so I hope he has recovered now).

For a long while, I used to feel that few people in businesses of any sort really understood what social media did and how it feels – from the inside – to participate.  It was so pleasant listening to these people talk knowledgeably about how to do this.  Helen Trim’s slides in particular nearly made me weep with gratitude.  Yes. This is exactly what it’s like.

Anyway, I chatted to a couple of the delegates who were tussling with the headache-making question of how exactly your brand has a ‘conversation’ with its users.   Can a luxury brand, for example, have any real use for the democratic, tell-it-like-it-is world of social media?  And can you use customer reviews when your CEO has a phobia about negative feedback?

Afterwards I also chatted to the cheerful guys who were making a video of the whole thing.  I may have been overenthusiastic. *facepalm*

Adding beauty to market research

go on, do something different!

I’ve been reading various posts about market research and social media, which tend to focus on the usual self-hating stuff about the market research industry’s vulnerability.  I agree, pretty much:  some of the space that research took up is now being eaten away by other specialisms (data mining,  search engine optimisation, and web analytics), while the rest of what’s rightfully ours is taken by DIY tools such as SurveyMonkey.  (Can QualMonkey be far behind?)

Personally, I would argue that MR agencies have neglected to develop certain 21st-century skills in-house.   Market researchers tend to focus on data collection and analysis technology like Confirmit or SPSS  (if you’re lucky).

Things market researchers don’t bother with:  design.  Graphic design, web design, information design, whatever.   Design is right down at the bottom of the pile.   You buy it in, or you manage without it.

Researchers writing presentations huff over the latest critique of death-by-Powerpoint and insert a couple more company-approved clipart images into the 80-page deck.    Somewhere, a designer is weeping.

So.  If it were up to me,  I would not only run shedloads of training on statistics and experimental design, but I’d include these:

  • Essentials of graphic design
  • Digital photography
  • Photoshop
  • Using stock image libraries
  • Web design and an introduction to CSS

And if I were running a big research agency, I’d invest in some graphic designers and programmers to create some nifty and beautiful interfaces for running surveys and online communities.

Why shouldn’t people expect loveliness in a survey?

What skills would you like to see?

Paradigms in research; or, how your worldview shapes your methodology

In the introductory lectures for my master’s in organisational behaviour, we heard a great deal about paradigms. Indeed, we heard so much about paradigms that several of my classmates were quite keen to go back and get a refund on the course.

We – researchers, embryonic management consultants, careers counsellors and human resources managers – wished to get on with the simple business of learning all about human behaviour so that we could manipulate it for profit.  But first, we had to pass this module.

So.   Paradigms are, roughly speaking, coherent belief structures. Some people describe them as a lens through which to view the world.  A paradigm is a bundle of assumptions about the nature of reality, the status of human knowledge, and the kinds of methods that can be used to answer research questions.   The piece that follows is adapted from Guba and Lincoln’s seminal chapter in the massive tome, Handbook of Qualitative Research – a book which would be extremely useful in hand-to-hand combat.

Anyway. In social science, there are at least three competing paradigms: positivism, constructivism, and critical theory.

Do not panic.   You have been working with these all your life, without knowing it. Let’s take them one by one.

Positivism is where many of us live most of the time. The world is real, that chair is solid, my findings are statistically significant. Positivism is the world of science and testing hypotheses.

In the positivist world, researchers are objective and strive to minimise sources of bias wherever they can. Research is true, researchers exist apart from their data, and the best research (because you can use rigour) is quantitative.

Market research mostly exists in a rather positivist world.  Significance, return on investment, purchase decisions.  These are solid things.  When positivists do qualitative research, they worry about representativeness of findings, and how many people in Birmingham actually said they disliked the concept. (There is of course post-positivism, but I’ll skip over that lightly).

Constructivism. Constructivists wear corduroy trousers and like bright colours.   Constructivists argue that human beings construct their own social realities in relation to one another.  Reality is subjective and experiential : that thing over there that looks like a table is actually being used as a chair. My particular construction of reality might be shared with many other people, but other people could construct the same reality in quite different ways.

Political stances and religious beliefs are examples of large-scale competing explanations of similar realities. Knowledge is not absolute, and (the killer in terms of methodology) the researcher is no longer outside the system, but part of it.  Findings may be idiosyncratic, rather than generalisable; approaches are holistic.  The goal is of constructivist research is understanding and structuring, as opposed to prediction.

Qualitative research leans towards constructivism, as I think you would guess.  However, it also tends to be batted back towards positivism, because full-blown constructivism can be a little too relative for all concerned, especially as lots of market research is done in order to find out what large organisations can actually sell to lots of people.

I am a social constructivist in outlook, so I believe that qualitative researchers are inescapably subjective and research findings are co-created between the researcher and the respondents.   I also subscribe to social constructivism’s Achilles heel, the interpretation problem, AKA ‘Why should I believe your version of events over anyone else’s’, although fortunately social constructivism has a handy get-out-of-jail-free card for that one.*

Which brings us to critical theory.

An observant reader who hasn’t run away screaming might have noticed that positivism and constructivism have slightly different implicit values. Positivism doesn’t really mention values, but its value centre is really data and rigour. Constructivism, all fluffy and relative, is very concerned about the participant, and explaining the participant’s point of view.

In contract, critical theory is all about value, or more precisely, all about power and politics.  Critical theory is concerned with power relations and patterns of dominance.  You’ll also see it described as neo-Marxist theory and indeed a good way of getting into the spirit of critical theory is to analyse any given situation in the manner of Rick from the Young Ones.

Critical theory looks at the world through a political lens, in which certain groups – rich people, politicians, men, capitalism in general – exert power and influence over other groups. If you like, critical theory takes a historical perspective. The goal of critical theory is emancipation of the oppressed.

It was more or less at this point that my fellow Organisational Behaviour students got very, very angry indeed. This was rubbish, one person said. He wasn’t here to learn about stupid critical theory; he was here to learn all about how people worked so he could go back to his company and learn how to manage people better.

The lecturer smiled.

Someone else said: this is total gobbledygook and anyway, it’s all just useless theory – how on earth could anyone take it seriously; and more importantly, how could anyone make a living being a consultant who depended on critical theory??

The lecturer smiled a great shark-like smile.

I love Critical Theory.

Critical theory helps you look at assumptions, and at power relations. In organisational research, you can look at the ways in which management organises and represents certain kinds of meanings. You can look at career progression and the definition of high-flying careers. You can create new concepts, such as the role of emotional labour in customer service jobs. In science communication, you can look at the problematic issue of public engagement, and whether it is meaningful to assume it is value-free.

In market research, you can look at corporate attempts to structure the meaning of a brand, and consumer resistance to such meanings.  You can look at Twitter, or Facebook, or OpenID with your Critical Theorist hat on. Who profits from certain meanings? What actions does the system permit or forbidden? How do users react?

In terms of method, critical theorists use analysis (historical, situational, textual) and qualitative interviewing.   Qual interviews are quite interesting, although most critical theorists will come over all critical while writing it up, rather than when wielding a tape recorder.

Positivism wears a white coat, constructivism accepts a cup of tea, and critical theory is SUSPICIOUS.

I think there’s a kind of paradigmatic mash-up, too: large corporations act in their positivist way, expecting thanks from the masses, and instead of being complicit, the masses are suspicious. They distrust your motives. They rebel. At other times, they carry your message quite happily to the ends of the earth.

Personally, I move between these three paradigms. I spend most of my time being a constructivist with post-positivist leanings: understanding responses and creating persuasive accounts.  I will often flick into a critical perspective, at least in analysing a brief, because critical theory shakes everything up in ways that can be very helpful.  It is perhaps not cricket to use critical theory as a tool for maintaining power relationships, but, well, needs must.

Anyway, that’s it for now.

Questions? Thoughts? Reactions?

*No one has ever asked me, but I have the answer.

Market research opinion: a contradiction in terms?

About 4 years ago, I did a master’s degree in organisational psychology.  I started off with the intention of changing career quite radically; I ended up (in the manner of many career changers) by making a more gentle change, to focus on science, new technology and (where possible) applying all that newly-updated knowledge of psychological theory to real-life projects.

Last year, I mostly worked with non-research organisations: usability agencies, user experience consultants, management consultants and learned societies.  Different working practices, different worldviews, different assumptions.

One huge difference in assumptions is that the practitioner is expected to bring their own professional opinions and wider knowledge to the table.     It may just be my impoverished experience, but too often researchers expect to present the findings rather coldly and consider the job done.   That’s what many research users expect, too.  You decide what to do with the findings once the researchers have backed out of the room.

At the same time, the Market Research Society complains (as it has done for over 20 years if my experience is anything to go by) that researchers are not getting enough respect as providers of true insight.

It is a remarkable thing when researchers offer insight.  Possibly a rather rare thing, too.

I think researchers box themselves in without even knowing it.  It’s a craft job, apprentice-taught.   There’s a startling lack of basic knowledge.  Although professionalism is creeping in via training, you’ll still find plenty of quantitative researchers who can’t tell you what a correlation coefficient is, and plenty of qualitative researchers who think that social constructivism is some form of Russian architecture.

We’re mechanics then, mostly, not designers and theorists.  There isn’t much of a theory of mechanics, and the mechanics struggle to offer meaningful insight into automotive design.

If I think about my own qualitative research training, then I don’t think I received any significantly useful professional development since I sat at the feet of Roddy Glen (himself an ex-planner) as a wee junior.     Doing a qualitative project as my Master’s thesis offered the chance to get stuck into theory;  and theory, as it turns out, is one of the most practical things you can learn.   Understanding competing theories, and you understand your own landscape for the the first time.  You’re clear about what you do, and you can offer your own opinion with far more perspective.

It’s a bit of a stretch, but I also wonder whether that atheoretical, fear-of-taking-a-stance working practice is one reason why there are so few research bloggers.    Having a personal opinion simply isn’t done.

My bad experience? Or would you agree?