MMR Strategy Group » Conjoint, MaxDiff, and Discrete Choice Studies https://mmrstrategy.com Thu, 02 Jun 2016 04:34:40 +0000 en-US hourly 1 http://wordpress.org/?v=4.1.1 Apple v. Samsung: The Next Round of Survey Evidence https://mmrstrategy.com/apple-v-samsung-the-next-round-of-survey-evidence-2 https://mmrstrategy.com/apple-v-samsung-the-next-round-of-survey-evidence-2#comments Mon, 12 May 2014 11:35:52 +0000 https://mmrstrategy.com/?p=1181 Most readers of this blog know that over recent years, Apple and Samsung have engaged in high-profile litigation over certain patents used in smartphones and tablets. A decision was just provided in a trial involving five patents from Apple, and two patents from Samsung.   In 2012, I wrote a blog post on the litigation … Read More Apple v. Samsung: The Next Round of Survey Evidence

The post Apple v. Samsung: The Next Round of Survey Evidence appeared first on MMR Strategy Group.

]]>

apple-vs-samsung

Most readers of this blog know that over recent years, Apple and Samsung have engaged in high-profile litigation over certain patents used in smartphones and tablets. A decision was just provided in a trial involving five patents from Apple, and two patents from Samsung.

 
In 2012, I wrote a blog post on the litigation surveys used in an earlier trial, which involved patents relating to earlier models of smartphones and tablets.

 
The ruling in the 2014 trial appears to be mixed. Apple was awarded almost $120 million in damages, and Samsung was awarded approximately $158,000 in damages. These amounts are not very large, particularly compared with the $2.2 billion that Apple had been seeking or the $6.2 million that Samsung had sought. As with the 2012 trial, litigation surveys were both provided and rebutted in this matter.

 
There are summaries of this trial in sources such as The New York Times and Fortune. This blog post discusses the litigation survey evidence presented in the 2014 trial. (A general caveat: I was not involved in this matter. I wrote this blog post from public sources, and am not providing an opinion regarding any side’s argument or witnesses.)

 

A Litigation Survey Using Conjoint Analysis

In the 2014 trial, Professor John Hauser, from the Massachusetts Institute of Technology, provided survey evidence relating to the value of certain patents used in smartphones and tablets.

 
As in the 2012 trial, Professor Hauser used a method called conjoint analysis to measure the importance of certain features in Samsung products that rely on the patents at issue. Those features include universal search, automatic word correction, and slide to unlock. The survey conducted by Professor Hauser evaluated consumers’ willingness to pay for those features, and also measured the decrease in demand for Samsung products without those features.

 
Basically, conjoint is a method used to estimate the demand for certain elements in complex products, such as automobiles or electronics. In a conjoint study, respondents are shown different configurations of product profiles. By measuring consumer preference for the different configurations, conjoint can measure the value of specific features.

 
You can learn more about conjoint from a white paper I’ve written, which is available here. You can read more about Professor Hauser’s testimony, as well as the rebuttal testimony, at websites including theverge, Electronista, Bloomberg, and ZDNet.

 

Rebuttal of the Conjoint Survey

Professor Hauser was rebutted and/or cross-examined by three separate people, all of whom argued that Hauser survey misstated the value of the patents at issue. I’ve summarized their testimony below.

 
First, counsel for Samsung cross-examined Professor Hauser, arguing that key influences on consumer buying decisions were not included in the survey, such as the value of Samsung’s brand and marketing.

 
Second, Wharton Professor David Reibstein, a rebuttal witness, questioned Professor Hauser’s methods and conclusions. Professor Reibstein argued that the research was biased, and did not provide valid measures because it asked only about certain features, and did not ask about the most important features. Professor Reibstein compared this to asking consumers what cup holder they would like in a car, rather than asking about more important features such as their preferred manufacturer.

 
Professor Reibstein also conducted his own research with a smaller sample, which he maintains indicated that consumers do not understand the features involved in Professor Hauser’s conjoint survey.

 
Third, Tulin Erdem, professor of business and marketing at New York University, also rebutted Professor Hauser. She argued that Professor Hauser’s research only asked about certain features and not about other features. According to Professor Erdem, this would tend to elevate the value and importance of those features, by motivating consumers to think about features they normally would not consider in such detail.

 

What We Can Learn From This Litigation Survey

The ongoing battle between Apple and Samsung has been high profile, and this trial received a lot of press. Apple and Samsung are interesting, successful, and well-funded adversaries, and they compete in markets that are important and rapidly-changing. There is even evidence that Google helped fund some of Samsung’s legal fees in this matter. Because smartphones and tablets are markets that move so rapidly, these trials and these patents could have implications for innovations in these important products.

 
Despite the high stakes, the outcome in this round is less conclusive. Although Apple and Samsung spent a lot of time and a lot of money on this trial, they ended up with a mixed verdict – both sides were awarded something, but neither side was awarded what they had requested. Even the jury foreman, who has expertise with IBM in software and patents, states that he did not see the verdict as sending a message. This matter is likely not over, as both sides have promised to appeal.

 
However, the trial does provide a good example of how litigation surveys are often evaluated in court. Professor Hauser is one of the pre-eminent experts on conjoint. The opposition in this matter cross-examined Professor Hauser, and also brought in two additional experts to provide rebuttal testimony. Both sides spend a lot of effort and a lot of money either providing or rebutting the litigation survey.

 
It is not unusual for a survey offered in litigation to be questioned or rebutted by opposing counsel and multiple experts. When a survey is important to the litigation, and the litigation has high stakes to the parties involved, it is likely that the survey will attract extensive criticism from opposing parties. Conjoint is a particularly complex methodology, but this basic principle applies across a wide range of litigation surveys.

 
Bruce Isaacson, President
Dr. Bruce Isaacson
President
MMR Strategy Group

© Copyright MMR Strategy Group, May, 2012. All rights reserved.

 

The post Apple v. Samsung: The Next Round of Survey Evidence appeared first on MMR Strategy Group.

]]>
https://mmrstrategy.com/apple-v-samsung-the-next-round-of-survey-evidence-2/feed 0
[White Paper] MaxDiff vs. Conjoint: Which is Better to Measure Consumer Preferences? https://mmrstrategy.com/white-paper-maxdiff-vs-conjoint-which-is-better-to-measure-consumer-preferences https://mmrstrategy.com/white-paper-maxdiff-vs-conjoint-which-is-better-to-measure-consumer-preferences#comments Mon, 15 Oct 2012 12:36:55 +0000 https://mmrstrategy.com/?p=1195 Marketers who design products, services, and ads need to know which features or elements customers prefer–which positioning is most effective, which price is optimal, and which features must be included. A new and powerful methodology, called MaxDiff, can help answer this question. In this paper you will find out:     How other methods compare … Read More [White Paper] MaxDiff vs. Conjoint: Which is Better to Measure Consumer Preferences?

The post [White Paper] MaxDiff vs. Conjoint: Which is Better to Measure Consumer Preferences? appeared first on MMR Strategy Group.

]]>

Download white paper

Marketers who design products, services, and ads need to know which features or elements customers prefer–which positioning is most effective, which price is optimal, and which features must be included. A new and powerful methodology, called MaxDiff, can help answer this question. In this paper you will find out:    
    • How other methods compare with MaxDiff
 
    • When and where to use MaxDiff
 
    • How you can use MaxDiff to rank highly diverse features and attributes from most preferred to least preferred
 
  • How to develop output that is easy to interpret
 

Click here to download white paper.

 

The post [White Paper] MaxDiff vs. Conjoint: Which is Better to Measure Consumer Preferences? appeared first on MMR Strategy Group.

]]>
https://mmrstrategy.com/white-paper-maxdiff-vs-conjoint-which-is-better-to-measure-consumer-preferences/feed 0
Apple v. Samsung: The Next Round of Survey Evidence https://mmrstrategy.com/apple-v-samsung-the-next-round-of-survey-evidence https://mmrstrategy.com/apple-v-samsung-the-next-round-of-survey-evidence#comments Wed, 22 Aug 2012 06:06:52 +0000 https://mmrstrategy.com/?p=608 The ongoing litigation between Apple and Samsung has attracted a lot of attention, and with good reason. This trial is high profile, with a lot at stake. Apple, arguing that Samsung copied certain features from the iPhone and iPad, has demanded more than $2.5 billion in damages and also requested that Samsung be prohibited from … Read More Apple v. Samsung: The Next Round of Survey Evidence

The post Apple v. Samsung: The Next Round of Survey Evidence appeared first on MMR Strategy Group.

]]>

The ongoing litigation between Apple and Samsung has attracted a lot of attention, and with good reason. This trial is high profile, with a lot at stake. Apple, arguing that Samsung copied certain features from the iPhone and iPad, has demanded more

than $2.5 billion in damages and also requested that Samsung be prohibited from selling certain features. Samsung has counter-argued that Apple infringed wireless patents, and has countersued for hundreds of millions in damages.

 
Over the course of the trial and pre-trial activities, both sides presented a series of witnesses who provided a wide range of evidence, including litigation surveys. With all these experts and intensive media coverage, the trial provides insight into how survey evidence is used and rebutted in litigation. This post describes some of the survey evidence presented by both sides, along with descriptions of how the survey evidence was attacked or countered.
 

Before I begin, a disclaimer: this post relies on information and documents located through public searches. Also, my description of intellectual property surveys and related rebuttals does not mean that I agree with any particular approach.

 

Likelihood of Confusion Surveys

Dr. Kent Van Liere conducted two confusion surveys. The surveys measured whether the trade dress (look and design) of two Samsung smartphones are likely to be confused with the iPhone, and whether a Galaxy tablet computer is likely to be confused with the iPad.
 

Survey respondents were assigned to a test cell or a control cell. Respondents in the test cells viewed images showing one of two Samsung Galaxy smartphones (either the Fascinate or Galaxy S II 4G Touch), or a video showing the Samsung tablet computer (the Galaxy 10.1). The tablet computer was shown either branded or unbranded. Control cell respondents saw either a RIM BlackBerry Storm phone or a Barnes & Noble Nook Color e-reader.
 

After viewing the images or video, respondents were asked questions to measure whether they associated the trade dress with Apple. According to Dr. Van Liere, the measured percentages suggest that consumers are likely to confuse the look of Samsung devices with Apple or the iPhone.
 

To counter, attorneys for Samsung argued that users should have been given the actual devices to see and use in person, and that the views of the products should have included the backs, not just the front and sides. They also argued that the Nook, which is an e-Reader, was the wrong control for the Samsung tablet computer, and that a better control would have been a device closer to the iPad such as another tablet computer.
 

They also differentiated between a survey measuring confusion in a post-sale environment rather than at point of purchase. In other words, while the survey focused on conditions as described in the complaint, the attorneys pointed out that that the survey did not ask respondents whether they would purchase the devices.
 

There is a lot more detail on the back and forth in this minute by minute blog.
 

Secondary Meaning Survey

Hal Poret conducted an online survey to measure whether the trade dress of the iPhone and iPad have secondary meaning, ie whether respondents associate the trade dress of the iPhone and iPad with Apple or more generally with the category.
 

In the Poret survey, images of the iPhone or iPad were shown to consumers with icons blurred out and the home button covered. Survey questions measured whether respondents associated the trade dress with Apple.
 

At trial, Samsung argued that the results of the secondary meaning study would have been different if it was conducted at a different time. In documents filed prior to the trial, Samsung also argued that the universe for the survey was overly broad, and that the manner of the calculations was conducted incorrectly, resulting in an inflated measure of secondary meaning.

 

Litigation survey measuring the value of product features

Professor John Hauser, a well-known marketing professor at MIT and renowned expert on new product development, conducted a survey which measured how much consumers would be willing to pay for three patented smartphone features, such as scrolling and multi-touch. He assigned dollar values to those features using a technique called conjoint analysis. (Conjoint and other types of related studies are commonly used by managers to compare different types of features, different levels of features, or even different price points.)
 

Attorneys for Samsung counter argued that the results of the Hauser survey do not measure what consumers would actually pay for the technology, but simply their overall preferences. One author characterized this as the difference between measured and stated preferences. In other words, argued the attorneys, there might be a difference between what people say they want and how they actually behave in the marketplace.

 

Other survey evidence

This post covers only some of the survey evidence provided in this litigation. There were also internal surveys provided during discovery, such as a Samsung survey from 2011 which measured whether of consumers confused the Galaxy Tab with the iPad.
 

There were other litigation surveys and rebuttal reports as well. For example, Samsung commissioned their own surveys of secondary meaning and survey of likelihood of confusion, both relating to specific elements involved in the matter.
 

At the time I am writing this, the jury is deliberating, and many people are eagerly awaiting the verdict. However this matter is decided, surveys of confusion, secondary meaning, consumer response to pricing, and other topics have played a role in both the trial and the pre-trial proceedings.


Bruce Isaacson, President
Dr. Bruce Isaacson
President
MMR Strategy Group

© Copyright MMR Strategy Group, May, 2012. All rights reserved.

 

The post Apple v. Samsung: The Next Round of Survey Evidence appeared first on MMR Strategy Group.

]]>
https://mmrstrategy.com/apple-v-samsung-the-next-round-of-survey-evidence/feed 0
MaxDiff and Conjoint: Which Should You Use? https://mmrstrategy.com/maxdiff-and-conjoint-which-should-you-use https://mmrstrategy.com/maxdiff-and-conjoint-which-should-you-use#comments Fri, 20 Jul 2012 11:46:49 +0000 https://mmrstrategy.com/?p=1053 It happens to the best of us. You want to analyze customer preferences and you aren’t sure whether to use Conjoint or MaxDiff. This post will help you understand the differences and when to use each one.   What Conjoint and MaxDiff Share in Common Conjoint and MaxDiff are both techniques for analyzing consumer choice. … Read More MaxDiff and Conjoint: Which Should You Use?

The post MaxDiff and Conjoint: Which Should You Use? appeared first on MMR Strategy Group.

]]>

It happens to the best of us. You want to analyze customer preferences and you aren’t sure whether to use Conjoint or MaxDiff. This post will help you understand the differences and when to use each one.

 

What Conjoint and MaxDiff Share in Common

Conjoint and MaxDiff are both techniques for analyzing consumer choice. They both ask consumers to make choices that allow us to measure preferences across features and attributes. From there, though, they differ quite substantially.

 
The quick version? Use conjoint when you want to configure a product or service from a broad list of attributes and levels and you need to understand what combinations are most appealing. By comparison, use MaxDiff to understand the level of importance or preference for a variety of items, such as features, benefits, menu items, advertising slogans, etc.

 

What is Conjoint Analysis?

Conjoint analysis is the better known of the two techniques and has been in use for a number of years. It is very versatile and has been used across a number of categories, such as cars, computers, healthcare plans, food products, etc.

 
Conjoint analysis tests a number of variables, each at different levels. For example, if we wanted to understand what consumers want in a tablet computer, we might include variables such as brand, price, screen size, battery life, memory, and other features. Each variable might have multiple levels, ranging from two levels (yes/no or has it/does not have it), to four or five levels (such as different prices).

 
With conjoint, respondents are shown several descriptions at one time, with the variables at different levels, and asked to select the one description that they prefer. This process is repeated a number of times, for different combinations of levels and features.

 
The output indicates which combinations of features and levels are of greatest interest to consumers. So, when you have multiple variables and levels, conjoint is the better choice.

 

What is MaxDiff?

 
MaxDiff, on the other hand, evaluates preference among a large group of features or benefits. With MaxDiff, respondents typically see a list of features, in groups of three to five items. From this list, a respondent selects the one they prefer or is most important to them and the one they prefer least or is least important to them. An example of a typical list is provided below.

 

 
The output from MaxDiff is wonderfully simple because preference scores for all items add to 100. The higher the score the more important the item is.

 
Here are some situations in which you might consider using Max Diff:

 

  • Menu development: If you have ideas for new menu items, MaxDiff can help you prioritize the interest in these items. Respondents would read a one to two sentence description of each item and then make their selections of the items they are most and least interested in trying.
  • Packaged food varieties: If you are planning to add new varieties to your current line, MaxDiff can help you understand which varieties are of greater interest to your customers or prospects.
  • Slogans or logos: MaxDiff can help you understand which slogans or logos are more impactful or appropriate for your product.
  • Copy points for advertising: Some products or services have a number of features that could be included in advertising. Using MaxDiff you can measure which are more appealing for your customers.

 

So, MaxDiff helps you prioritize which menu items to introduce, which features to call out in your advertising, or what varieties to focus on in your product development. Our advice is to try to use it whenever you can.

 


Debbie Lesnick,
Senior Vice President & Head of Research,
MMR Strategy Group

© Copyright MMR Strategy Group, May, 2012. All rights reserved.

 

The post MaxDiff and Conjoint: Which Should You Use? appeared first on MMR Strategy Group.

]]>
https://mmrstrategy.com/maxdiff-and-conjoint-which-should-you-use/feed 0