I was reminded of why Steve Jobs hated focus groups when I watched the Fox News coverage of the Republican debate, specifically with respect to Donald Trump. Part of that coverage was to have a focus group expert query a captive focus group about their pre- and post-debate impressions -- he instead showcased why most firms should never use focus groups.\u00a0\u00a0\nIn a nutshell, focus groups are really lousy at predicting anything and while they can be good at analyzing past behavior, they are so easily manipulated they generally turn out to be less than worthless (because they can lead folks to believe in a world that doesn\u2019t exist). As a result, it is rare you can depend on their results.\nI spent a lot of my life doing market studies and I\u2019ve both been in and funded focus group studies. Only in some very narrow instances would I ever consider using them. Let me walk you through why.\nWhat a focus group is\nA focus group is a way of sampling a population in order to determine why they did something or what they will do in a given situation. In order for it to work it has to be both representative of the population and not be corrupted by any aspect of the focus group process. The goal isn\u2019t lots of drama, the goal is to gain understanding. Its advantage over doing other forms of sampling is you can pick up emotions you wouldn\u2019t get out of a questionnaire and, done right, the responses are typically far more nuanced and granular.\u00a0\u00a0\nWhy a focus group doesn\u2019t work for prediction\nThis was primarily what Jobs objected to and he was right. One of my first focus group experiences was for Chrysler. They wanted to know if we would buy a new car they were considering and after showing us the car most of us said absolutely, and then the car came out and it didn\u2019t sell that well. This goes to the heart of why focus groups suck at predicting things. By the time the Chrysler car shipped, Ford and Chevy had both improved their lines so that the alternatives were better and ultimately overshadowed the Chrysler. In addition, Chrysler had gone cheap in areas we weren\u2019t aware of in the focus group. So while the car still looked great the actual driving experience wasn\u2019t that good.\u00a0\u00a0\nSo to make a predictive focus group work you have to emulate the full experience. In this case of a car buying experience, the complete process someone is likely to go through includes other car choices available and unless you\u2019re capable of precognition (in which case you don\u2019t need the focus group) chances are you can\u2019t accurately create an environment that matches the future when the decision final will be made.\u00a0\u00a0\nFox and why focus groups fail\nThe very fact that the focus group was on live TV corrupted the Fox focus group because perspective voters would not be making decisions in that kind of situation. Being on TV has a huge influence on someone if you are asking for an opinion.\nIn addition, the environment was one where very strong individuals could pressure weaker members into like positions, and if you watched you saw this play out. Not only were there far more people in support of Trump at the beginning than appeared to be the case in the broad audience, but the percentage change of supporters was unreasonably large.\nOnce someone takes a position it is hard to get him to change it by simply watching a candidate talk because, with confirmation bias, they\u2019ll generally hear what they want to hear particularly early on.\u00a0\u00a0 Yet the focus group appeared to swing solidly against Trump by the end even though Trump\u2019s poll numbers didn\u2019t shift nearly as much.\nIn short, at the beginning there were likely folks saying they supported Trump who really didn\u2019t, and at the end there were folks going with the crowd who wouldn\u2019t have without pressure. So you had too much support up front and then too little at the end with the result being a massively inaccurate representation of what had and eventually did happen.\u00a0\u00a0 In the end, the focus group was worthless other than as an attack vehicle against Trump, which backfired.\nThe analyst appeared to be pushing his group against Trump and later Trump indicated the two had history and it wasn\u2019t good history. The focus group moderator\/analyst has to be unbiased otherwise they will corrupt the results either by influencing the focus group and\/or by misinterpreting the results.\nNow in the case of Fox it did look like it might be manipulating the results in order to influence the population against Trump, which Trump himself seemed to pick up and there is science here because false analysis results, if presented well, can change minds.\u00a0\u00a0 And it is possible that some of Trump\u2019s slight initial fall in the polls could have resulted from this.\nSo you can use a focus group as a competitive weapon but, to be effective, the population has to identify with the group and find the reasons for their positions compelling, both of which require a lot of reach for a large population (which FOX had). You also have to bet the other side won\u2019t be successful in proving your focus group or survey is false, which would destroy your credibility. But there is a big difference between being a representative and being a manipulation tool, and a real danger of forgetting which you are supposed to be.\nDon\u2019t do focus groups\nThere are other more accurate ways to sample a population. The cost of using a fake focus group to manipulate a population isn\u2019t only high, it takes a very specialized moderating skill to pull it off. Oh, and if you get caught, it could become a career ending scandal. It is simply too easy for focus groups to generate misleading or totally inaccurate results and this Fox News attempt showcased this in spades.\u00a0\u00a0\nIn this day and age it is almost impossible not to corrupt a focus group, we all are simply too surrounded by technology now, I wouldn\u2019t use one for analysis particularly in a predictive way and I\u2019d always back it up with some kind of validating study if we were looking at historical behavior. But my general and far easier to follow advice is don\u2019t do focus groups and don\u2019t rely on the results that come out of them.\u00a0\u00a0\nOf course the real interesting result in all of this was that Carly Fiorina was the biggest beneficiary of this event, largely because she was the best prepared to take advantage of it. Not bad for the one tech exec running for the office. It is interesting to note she is likely also the only candidate, because of her marketing background, who really understands the dynamics I\u2019m talking about.