There are quite a few questions to ask before you consider launching a continuous market research online community, but of all of them here is the one we've found is the best indicator of long-term success:

Can your company's culture support a continuous MROC? 

This really boils down to the following questions:

• Do you have a constant need for customer feedback?  Is there a consistent (i.e., weekly) stream of questions that need to be answered and issues that need to be explored on an ongoing basis?  While one could argue that having a continuous community available will help generate steady demand for insight, it certainly doesn't hurt if the demand is already there since that will form the basis of topics for the critical first 3-6 months of the community.
• Are people in your organization willing to take the voice of the customer to heart as they make decisions?  Without an environment of open listening and dialogue, it will be difficult to get the full value of an ongoing community initiative.  Again, establishing an insight community could represent a movement toward open dialogue, but changing deeply ingrained attitudes toward customer feedback can be a time consuming and difficult thing to do...

If you have questions as to whether or not you can satisfy these conditions for an ongoing community, then perhaps a pilot community or short-term MROC would be a good way to "test the waters" and start to get people excited about the prospect of having continuous customer feedback...

We just want to say thanks to Kathryn Korostoff for including our blog as a Top 10 Market Research blog in Quirks!  We're honored to be included alongside MR bloggers like Jeffrey Henning, Tom Ewing and Ray Poynter (among others), and hope we can continue to live up to the standards set in the article...

We'll keep trying to share weekly posts on best practices, trends and ideas around online communities for research and insight (and include some humor whenever we can :-)  In the meantime, if you have anything you'd like us to cover in future blog posts, feel free to leave us a note in the comments to any of our posts.

Thanks again to Kathryn and regular readers of the MROC Talk blog!

- PluggedIN

Just kidding ;-)   But now that I have your attention...

The title of this post refers to a recent request we received to build two 120 minute-long online research communities.  By no means is this post a criticism of this individual and their request (they acknowledged they were in a pinch and had no time at all to research the methodology - their client had merely asked for a community).  Of course, they were really looking for an online focus group so I suggested the names of a few vendors they could contact.  However, the conversation got me thinking...

Are we all hyping communities to death?

Calls like these make me worry that people are just looking for the word "community" in anything that they do because it's the hot new thing, and aren't stopping to think about what a community actually is, how the approach should be applied and what it's good for (and not so good for).  Don't get me wrong - companies like PluggedIN have benefitted quite a bit from all the attention given to communities the past few years so I'm not complaining, but having so much hype and confusion around the term isn't good for anyone in the long-term. 

I have a feeling the dust will settle eventually, but I worry about companies that end up with a bad taste for "communities" when in practice what they're really getting is what most qualitative market researchers would call an online focus group or bulletin board.

What is an online research community?

Of course, this also brings up the broader question of what a research community is, and that's where things get a bit trickier...  Going back a few years to Forrester's report "Will Web 2.0 Transform Market Research," a MROC is defined as "captive interactive groups of people online joined together by a common interest, which are systematically harvested for qualitative market research purposes."  Nothing in this definition explicitly states duration or size of the community, so I guess with a definition this broad an OLFG could be considered a form of MROC.

Jeffrey Henning (@jhenning) of Vovici put together a helpful chart with the variations of online research communities ("Online Research Communities by Type") according to whether they are temporary/permanent and open/closed.  The chart includes OLFGs, although Jeffrey acknowledges in the comments that he de-emphasized them on purpose...      

My take on it...

Having been involved in many OLFG, BBFGs, short-term MROCs and continuous MROCs over the years, I can only appeal to personal experience running each.  I can say "qualitatively" that even a short-term MROC (which I'm defining here as at least one month) has a very different feel (and value) than something that is a few hours or days long (like an OLFG or BBFG), but that's just my experience...

What's your take? 

Is the buzz around communities going to help or hurt in the long run?  How do you define a research community (or insight community, market research online community, online research community or whatever you prefer to call it)? 

I'm jumping in late to the game on this conversation so forgive me if I'm rehashing old wounds, but I've been thinking lately about the debate between calling online communities for research/insight "Market Research Online Communities" (MROCs) or "Insight Communities."  The conversation started largely on Twitter and then found its way into various research blogs over a few weeks, including a post shared by Tamara Barber of Forrester that seemed to include many research community industry players chiming in.

First, a bit of background...  When Forrester first introduced the term back in 2008, we were ecstatic.  PluggedIN had spent quite a bit of time at that point educating people on how to use "online communities for market research," so when a nifty acronym came out to describe what we had been trying to educate people about all along, we jumped all over the chance to use it!  Sure, it didn't sound all that sexy, and it still used the "market research" moniker that everyone seems to want to run away from these days, but for convenience sake we decided to run with it, and I'm glad we did.  I hated the acronyms BBFGs and OLFGs back in the day, but they were useful, convenient to use and clients understood them right away so I didn't care...  

When the talk of "insight community" started making the rounds, I was initially excited because it definitely sounded sexier than "MROC" and makes me feel a bit more "warm and fuzzy" inside, but I still have my hesitatations...  Namely, over the years I've noticed the word "insight" is misused, overused and really hard to define exactly.  It's one of those "you know it when you see it" type of moments, which isn't easy to describe or promise in advance.  For a great blog post on this topic alone, look no further than Tom Ewing's recent post on "A Brief and Biased History of Insight."

To me, "insight" doesn't automagically emerge from an online community, so it can be misleading.  One can run an online community for market research without uncovering the magical "insight" we're all looking for (though that would be a shame).  The point is that the "insight" is what should (hopefully) emerge after synthesizing data across a community and other methodologies, as the result of deep observation and analysis.  It doesn't happen just because you're running an online community; rather, it happens as a result of everything a consumer insights team is doing to provide value to the organization.  

However, here's my real point of this blog post...  My problem isn't with the name - call it whatever you want, it's the fact that we're debating topics like this in the MR industry while we face so many other threats.  It's a bit of the old "rearranging the deck chairs on the Titanic" argument (I'm being a bit dramatic here, but you get the idea).  We're selecting the proper acronym to use while our clients are complaining about 70 page decks that make no sense and sit unused on the dusty shelves of the company intranet.  If you haven't already seen this, check out this interview on Research Live with Volkswagen's Insight boss.  This is what we should be figuring out as an industry!  This should be the "hot topic" on Twitter, not "MROC" vs. "IC" and which hashtags we should be using.  Research Rockstar also alluded to the bigger picture challenges in the research industry the other day in her great blog post on market research decentralization.

I know that "MROC" isn't perfect or sexy or whatever, but it works.  It's worked now for more than two years since it was introduced, and it will work for a long time from now.  Let's refocus the conversation away from terminology and toward what really matters - our clients... 

- Matt

I recently read an article on CNET (Sorry, Facebook friends: Our brains can't keep up) about Dunbar's number playing out the same way online as it does offline.  I've blogged a bit about this in the context of other topics, but thought it would be worth mentioning again as it seems to come up quite a bit in the debate on proper MROC sizes. 

For those not familiar with Dunbar's number, it's basically a mental limit to the number of "relationships" that one can maintain at any given time.  The term "relationships" here is a bit fuzzy for some people, but generally means that you know everyone else in the group and have a sense of how people relate in that group.  For more, check out the Wikipedia entry on Dunbar's number.

What does this mean for MROCs?

To me, Dunbar's number provides a starting point for thinking of the size of the MROC you should build.  If you're interested in having members develop connections with each other, and in turn learning through listening carefully to those conversations, then you should consider a community that doesn't exceed 150 active participants.  

Respondent.

Think about that word for a second.  Many of us in the market research industry use it day in and day out, yet we probably don't pause and think of the connotations.  A quick search comes up with the following definition (courtesy of the Market Research Glossary of Terms):

"Respondent - This is the individual that provides data to be collected during the research process. Also referred to as a unit, unit of analysis, participant, experimental unit, or subject."

To me, a "respondent" is someone who is merely asked a series of questions in a 20 minute survey and kicked to the curb for the next "experimental unit" :-) 

Is this how we want people to feel about research?  This certainly isn't what I think of when I see people interacting in online research communities, sharing their thoughts, connecting in meaningful ways and generally enjoying the entire experience.

Here's to hoping that with new research methods we can develop a common language that respects the ways people now interact with us...

-Matt

I caught an article the other day on Social Media Today (direct link here) on how companies are largely undecided on the value of social media when it comes to understanding their customers (which I'll conveniently put under the umbrella of "market research" for the purposes of this post).  According to the article, almost two-thirds (63%) of the people who responded to the survey said they are "undecided" about the value of data collected from social media sites to help them understand more about their organization or customers.

This doesn't come as much of a surprise to me, and here's why:

• The term "social media" is broad - I couldn't find a link to the actual survey or results in the article, but I'm guessing that participants in the survey likely had different definitions of "social media" (if that was the term used in the actual survey).  In fact, I'm not even really sure what it means given all the hype around it.  It's bandied about so much that it's starting to lose meaning.  To me, much of what people describe as "social media" has been around for years (e.g., forums, blogs, wikis, etc...).  Why are we just now getting around to defining it?  Which brings up the next point...
• Social media is overrated - 23% of the survey respondents called social media "overrated," and I'd have to agree, especially when it comes to really understanding customers.  If you're a huge organization with a well known brand name, you're likely to find a wealth of customer conversation around your brand.  If you're not, tough luck...  Now, astute readers of this blog might think that I'm shooting myself in the foot here since some would say that what PluggedIN offers is all about using social media for market research.  However, I like to think of the technology and tools of social media as separate from the destinations where conversations are happening...  I suppose one could say we use the tools of "social media," but for a very specific context that has clear value for companies.  There is a big difference there.
• The data is lacking context and profiling information - I alluded to this in my earlier post on "Twitter as an online qualitative research methodology."  Without context and an understanding of who is talking about their brand on these social media sites, the data that is analyzed will be of marginal value.  Don't get me wrong, I've seen a few well prepared social media reports on brands and products floating around.  However, they still lack much of the context that is necessary to transform the findings into actionable insights for an organization.  It isn't until you apply these findings on the level of your target audience that you'll find the full value of social media analysis (IMHO, at least - I'm willing to be proven wrong).    
• Change takes time - It seems that many "social media gurus" have unreasonable expectations as to how large organizations will be able to adapt their internal processes around social media.  They seem to expect an organization of 50,000 to react like an organization of 50 (which, in turn, makes me wonder how much experience some of these "social media gurus" really have working with large organizations - a topic for another blog post entirely :-)  While continuous listening through social media should be a priority at any large organization in order to stay competitive, it's simply unreasonable to expect these companies to adapt that quickly.  PluggedIN is tiny compared to the organizations we work with, and we still have challenges building social media into our own organizational processes.  I think many large organizations are hearing the message loud and clear, they just need some time to adapt...     

Of course, this all makes me think...  Is "social media" the holy grail of consumer insights that people are making it out to be?  Will organizations ever fully adapt to the steady stream of consumer insights available through social media?  And if so, what will that organization look like?  That's just my two cents.  I'd love to hear what you have to say...

--Matt 

With MROCs (market research online communities), you should be realistic about user-generated content. After all, MROCs are not natural/organic communities of interest like Digg or LinkedIN. They also do not have a sole content-creating focus like Flickr or YouTube, so you have be more active in encouraging content creation in these environments. With this in mind, here are a few tips for encouraging content creation in your MROC:

1. Screen for creators

Only a portion of the general population are likely "content creators." However, you can strive to recruit people into your MROC that are more likely/willing to create content. They are generally more active on the most popular social networks (e.g. Facebook, LinkedIN, Twitter), and have a history of creating content on these sites (e.g. posting group discussions, tweeting regularly, writing blog posts, sharing photo albums). Also, think about the attitudinal elements that make people likely creators.

2. Lead by example

As a community moderator, take the lead and write your own regular blogs (on-topic and off-topic), upload photos of your vacation, ride home from work, or even your office. Post a link to an on-topic article or some other piece of content to encourage conversation on a regular basis aside from your regular research activities.

3. React publicly & quickly

Reward and feature members that create content, and time this as close as you can to the original post time for maximum impact. If you have a points/rewards system, add points for these posts, or feature member content on the community main page. Also, post this content in a spot where the whole community can noticeably react to.

4. Incorporate special contests

Think about unique contests where you pick a winner from the community each month... how about a "funniest workplace moment", "book review" contest, "funniest blog" contest, or "best profile photo" contest.

5. Challenge members & assign tasks:

Consider ways to challenge members to solve problems over time. Split members into teams and have them discuss certain issues in groups, or even assign specific tasks (e.g. go shopping and share a blog of your experience) to get them in a habit of getting outside their comfort zone periodically. Small groups are also a great way to encourage connection and to get people to be more accountable.

- Ben

In the spirit of every blogger's "predictions for 2010" posts, here are PluggedIN's predictions for where MROCs might be heading in 2010...

• Specialization in Custom MROCs - As the methodology is widely adopted across the industry, we'll start to see vendors carve their niche around a speciality.  For example, we might see more companies jumping on B2B MROCs as a focus, or creating methods around ideation/brainstorming specifically.  We have a feeling we won't see this specialization come out of "traditional" MROC vendors, but rather out of those who realize that the tools for building their own MROC approach are readily available, allowing them to use their existing focus in a nascent methodology. 
• Tighter Intergration of Social Media Monitoring and MROCs - At various MR conference this year, the hot topic was how to effectively capture sentiments on brands, products, etc... across the social media landscape.  Various vendors are rushing to address this now (or already have), specifically within the realm of market research.  However, the undertone in each of these conversations was the question of how market researchers can provide context for these responses and understand their implications for our clients specifically.  It's here that MROCs have the opportunity to shine for next year, as social media mining will become more prevalent, along with the need to make sense of these sentiments.  We took baby steps in this area earlier this year when we integrated Twitter and various other social media properties into the PluggedIN Platform, but look for much more from MROC vendors in the year to come... 
• Technology/Platform Prices Dropping - As with any technology, the cost of licensing MROC platforms will likely decrease this year.  While there are many general purpose community platforms out there, and relatively few market research-specific platforms, we think the industry will start to see more solutions custom designed around the needs of market researchers.  More competition for self service clients could drive the prices down across the board.
• Fortune 100 No Longer - It's telling when the analyst report that starts it all in motion (e.g., Brad Bortner's original report on "Will Web 2.0 Transform Market Research?") has the subtitle of "Yes - But High Cost Will Mean That Firms With Big Budgets Lead."  That was 2008, when a handful of firms dominated the space.  In 2010, we see more competition in the MROC space that will force larger vendors to either drop their prices for long-term community engagements, or figure out how to add more value to their approach.  Continuing with the trend we just mentioned (platform prices dropping), 2010 will finally start to see firms without big budgets moving into MROCs as their primary mode of obtaining in-depth qualitative insights in a cost effective manner.  
• MROCs Will Finally Divorce Themselves From Panels - For years now people have used the terms panel and community interchangeably...  In 2009 we started to see a clearly defined difference in the minds of end users, which is something we think will continue into 2010.  Panels are not communities and communities are not panels.  We think the industry has finally caught on, and it's time to figure out how to make the most of the MROC approach.

That's just our two cents after seeing how this niche in the MR industry has evolved over the last four years...  What do you think?  

--Matt & Ben