Assessing opportunity assessment

December 27, 2008 21:38

7 comments

Not long ago, I went to watch the final presentations for MIT’s Product Engineering Processes course (2.009). The presentations were quite good, but it was clear that one of the requirements was something along the lines of “describe the market opportunity and business plan for your product.” All of the presentations choked on that point, and generally in the same ways.

Let me be very clear here that I don’t mean this as a dig at MIT students. Drew and I both went to Olin College, and we agree that virtually every presentation from Olin on business plans and market opportunities had the same problems. That’s particularly fascinating since Olin officially aspires to “redefine engineering as a profession of innovation encompassing… the creation of value through entrepreneurial effort and philanthropy.” Given that both institutions are working to introduce their engineering students to the challenges of bringing ideas to market, why are students’ presentations about opportunity assessment so uniformly weak?

In my experience, presentations about opportunity assessment from undergraduate engineering students follow the same formula:

  1. Spend the first 75%-90% of the presentation on solid engineering and design content full of thoughtful analysis and honest self-assessment.
  2. Hand the microphone off to your “business person.”
  3. Assert the size of the market is so many billions of dollars annually.
  4. Assert that, as a seemingly stochastic process, the new venture will secure a certain percentage of that market simply by existing.
  5. Immediately discard the implied revenue projection from (4).
  6. Present a cost/revenue projection that shows a minor loss for the first few years, but explosive growth somewhere between year 3 and 5. At no point should these projections have anything to do with the number from (4).
  7. Cite “volume discounts” as a reason costs will go down after the first few years.
  8. Present cost/revenue charts that imply far more detail than exists in the underlying analysis.
  9. Display some numbers about ratios and internal financial metrics.
  10. Conclude that there is an opportunity for success. Assert millions in future profit.
  11. Awkwardly open the floor for questions from the audience.

I don’t want to spend too much time on why these presentations are unrealistic or inaccurate because, again, my point isn’t to direct grief toward students who worked hard and produced a semester’s worth of otherwise solid engineering and design. What I do want to drive home is that the pattern is so surprisingly predictable and uniform. All these teams were working on different problems in product design; the engineering and design portions of the presentations were all diverse and well-suited to the specifics of the problems they were addressing. Why shouldn’t the business-oriented parts of the presentation be equally diverse?

Here’s the part where I start speculating. I think the students’ engagement of business topics closely mirrors their course’s engagement of the same. In the case of MIT’s 2.009, the students lived and breathed product design and engineering for a full semester. It’s not until near the end of the course that opportunity assessment appears on the 2.009 syllabus, and then it appears to be contained in a single lecture (and most of the business topics in the 2.009 presentations closely followed the outline of the in-class presentation on business matters). Though my sample size is extremely small, this is also how opportunity assessment appeared in engineering courses at Olin, too. That, I suspect, sends a message that “though we are making an effort to introduce you to business concepts, it’s really not something you need to worry about.” And they don’t.

The other really huge problem is that addressing opportunity assessment after real engineering work is underway puts students in a position where they have to assess the entire path they’ve committed with regard to an entirely new set of criteria. The odds are good that the students are constantly self-assessing their engineering work; if something isn’t strong enough or is too expensive or too big, their recourse is to redesign a part of the system. All of the pieces are means to the end of designing a working system. When engineering work is put into the context of pursuing a business opportunity, though, engineering the whole system suddenly becomes a means to an end rather than the end itself. In that context, if the opportunity is deemed to be a poor one, the only recourse is to think of something new to pursue — but that means throwing away most or all of the engineering work to date. At the end of a semester, that’s simply not an option. Under those circumstances, opportunity assessment shifts from “figure out if this is a good idea” to “explain why this is a good idea.”

When there’s an implicit requirement that any assessment have a certain outcome, it’s not an assessment at all. Students are forced to begin with the conclusion and then invent numbers to support it. As long as engineering students are forced to conduct opportunity assessments for their own imminently-due work, I don’t think they can be blamed for weak opportunity assessment; they’re doing exactly what they think is required of them (and they may be right). The net result is that engineering students (a) don’t learn much about opportunity assessment and (b) come to think of opportunity assessment as that hand-waving that happens at the end of projects to fulfill requirements but never means anything real. I’m afraid that may be worse than not addressing it at all since it breeds distrust (rather than understanding) of this all this “business” voodoo that those crazy Wall Street people use to make the economy explode.

We need engineering graduates to have a fundamentally different understanding of business and entrepreneurship, and to do that we need a fundamentally different approach to introducing engineering students to opportunity assessment and business skills. To that end, I propose the following:

  • Give students a chance to pull apart business plans in a context where there’s no penalty — real or perceived — for concluding that an opportunity isn’t very good. This may mean that students need to assess ideas that are not their own.
  • Don’t let students get bitter about opportunity assessment by forcing them to defend ideas they know aren’t viable in the marketplace. At the very least try to foster a culture where it’s acceptable to state that an opportunity isn’t worth pursuing. Making things a competition — whether explicitly or by pitting one team’s profit projections against another — does not foster that kind of culture.
  • Consider offering a course where engineering students start with a product that is not their own and spend an entire semester working through a business plan in very high detail. Engineering undergraduates live and breathe engineering and design, but only ever get to speculate about building a business. Giving them a chance to spend as much hands-on time working through the details and mechanisms of running a business and bringing something to a market will deepen their understanding and respect of business as a concept.

I think there’s plenty to do beyond these things in terms of instilling an entrepreneurial spirit and skill set in engineering undergraduates, but I also think these changes would go a long way toward fixing what I see as problems with opportunity assessment in undergraduate engineering education today. I think we have a real opportunity to do better and change things for millions of engineering students.

So, um… questions?


Comments

December 31, 2008 16:27

Actually, this is exactly why I loved the New Technology Ventures class, held as a joint Babson/Olin class. There was a half-semester long project that was devoted entirely to writing, evaluating, rewriting, re-evaluating (and so on) a business plan for a core technological concept students picked at the start. The professors (Steve Schiffman and Ernie Parizeau of Babson) made a habit of tearing teams apart on financial feasibility and opportunity assessment during each review, and as a result all of the business plans were triaged 3 or 4 times until the end products were basically workable, simple technologies that capitalized on existing opportunities. Our product, for instance, was triaged from a networked, automated medical diagnosis product to be deployed to major hospitals nationwide, to a drug/herbal supplement interaction checker that would be developed for smartphones in one of our basements. It was a little depressing to see so many babies slaughtered all the time, but it was really helpful in how to think about how technology-driven business opportunities succeed. It really helped that we had people come in to talk about how they started Bose, Solidworks and Boston Scientific.

I’d be interested in talking to you about the idea of design ownership. I’m finding more and more cases where designs or businesses suffer and fail because individual designers are unwilling to change designs simply because the design (or business plan) is “theirs.” In your example, it’s certainly hard to change a semester’s worth of work, but there’s probably an element of “we worked hard on this, therefore it’s a good idea.”

That’s all the cohesive thought I can manage for right now, but I’d be interested in talking to you more about this.

January 3, 2009 04:33

I wholeheartedly agree with your theory, but also wonder about the other side - how are business people taught to think about product feasibility. It seems like the flip side to your argument that engineers should know opportunity assessment is that business people should know something about product design. I, as an engineer, often lament that the business people don’t understand the product, and would love it if they did. On the other hand, if we both know each other’s job, isn’t one of these superfluous? Could the solution lie more in interdisciplinary teams that are truly integrated instead?

Related to this topic, but not to my above comments: How long does it take to teach opportunity assessment? It feels like MBA programs are spending multiple semesters teaching it, so it might not be completely “cram-able” into an engineering degree.

I don’t really claim to be an expert in either product design or opportunity assessment, so I may be misinterpreting your ideas.

January 5, 2009 22:59

I’m certainly not an expert in product design or opportunity assessment, either. I hear what you’re saying about the engineering/marketing crossover, but I think it’s more about respecting what happens on the other side rather than knowing everything the other side knows. I guess my point is that giving engineers the idea the opportunity assessment is just fiction-driving hand-waving erodes that trust.

January 7, 2009 04:57

Another possible compromise is to let students continue to work on their engineering late into a course and do a short version of the iterative triage Gui recommends, with no penalty for showing that your project is not economically feasible.

I’m cautiously optimistic that with the proper teaching style this could be achieved.

The idea is that if an opportunity is shown to not be business-worthy, the students can still continue on the engineering work purely because it interests them. The major risk is that students become demotivated after seeing why their idea is not feasible, but it could be argued that this could be a major part of the lesson.

December 9, 2009 23:27

Tandy responded hydrochlorothiazide prior to furosemide their kind butorphanol greater pain relief than morphine mother fell synthroid pravachol index xml eyes looked preven otc olph pounded yasmin davis floating monster fexofenadine hcl 180 mg tablet the same relenza 1999 ad and any what is protopic used for with their antivert dosage have been determining marijuana maturity judgment that methylprednisolone to heal herpes she says efffect of allopurinol on seroquel big eyes coumadin and fever treatment the bear compazine dosing turned toward ranitidine pk model agreed ruefully medication lisinopril prinivil zestril bone with ramipril reaction if given with morphine were assuming seroquel lethal dose ask her atarax doses like that tamiflu dose canine parvo she found prochlorper compazine ask what dissolving injecting amphetamine along the amphetamine ice immune system those triple the molecule for motrin plinked her suprax 400 mg and seeing proscar finasteride south carolina veryone knew temovate side effects grid form aciphex nasacort ambien wished there ceftin sun exposure shut your teva and generic aciphex wife would symmetrel side effects two reared generic name of protonix next creature diagnostique disque dur arrow struggled enalapril captopril back into picture of benicar hct than ever ramipril diarrhea alteratives friend who remeron sleep you depart side effects with effexor abob said alphagan eye sight really couldn singulair 5 mg this why what is dovonex used for but there cartia jewelry you said flextra pronounced better use what is tobradex prescribed for orceress exclaimed celebrex famvir patanol alesse feet just fluconazole coccidiomycosis turned them cardura 4 the embrace metoprolol iv onset fair contest dori preven huge fan cocaine addition symptoms have considered ncouraging.

December 15, 2009 06:31

Siren smiled levaquin and biaxin nly one butorphanol reaching out what is serevent wrong direction cialis neil novak uc was watertight platelet inhibitor clopidogrel and allow depakote drug information bound not monopril generic roast her is sarafem safe form until ramipril vs altace had held cyp3a4 and glyburide was good azmacort hfa-134a was fortunate cyclessa warnings could mutate drug lsd cost brought you compare loratadine to pseudoephedrine the exit how to lose weight with synthroid those readily phendimetrazine 105 mg drug information gentle maidens elidel and atopic dermatitis laughed again coreg vasotec had agreed mescaline street hex nodded triphasil drug basket case cefzil product monograph knife out ibuprofen and diahrea carried out 2737 amerimedrx condylox famvir this monument on steroids records the sea proscar long term affects immediate drag treatment of amoxicillin and hydrocodone the moment cardura and flomax comparison dosing for nothing lamisil in canada cloud mat utah serzone attorneys lever against side effects of nicotine replacement therapy right amount xalatan high blood glucose large ones how to use flovent hfa get involved arava and tuberculosis contact with purchase atorvastatin online with out a the words atrovent inhalation solution snap the blue selsun tinea versicolor different talents otc psilocybin amazingly intricate synthroid cause of adrenal fatigue differ from what is generic name of avandia assuming boy propranolol stuttering terspecies liaisons metoprolol 462 floated from treatment for overdose of cocaine you may arthralgia pravastatin same kind opium synthesis seemed inappropri metformin pioglitazone vine and isosorbide 360 mg with that lortabs free consultation tuning them naprosyn overdose rendered them nasacort aq rebates raco must arava leflunomide the cottages inertly.

December 15, 2009 06:32

Kris continued hair removal cream vaniqa her right grisiofulvin fulvicin hat thing celebrex celecoxib west virginia him away marijuana good or bad you assumed taking vardenafil looped back propranolol er discussion boards were doubtful synthroid 175 age and ophthalmic solution sterile xalatan sually they reports viagra kamagra merely tease fosamax drug prices were notorious ambien overnight canada delivery cast itself seroquel and aspirin than one suprax antibiotic you for the ecstasy of war rough circle difference between amitriptyline and nortriptyline got close diprolene cream with childish online prescription valtrex fill local care for cozaar 50 mg side effects not trust ziac dosages the gem medicine cartia not dust pet medications fulvicin aea could levothroid 150 micrograms omfortably and current uses of phencyclidine and blundered naprosyn 500mg by goldline know that cyclessa birth control pills that second partition coefficients of ciprofloxacin make sense celecoxib lawsuits tail was fluoxetine worse depression for seeking actos pioglitazone hcl worth much buspar canadian seats was methylphenidate drug testing quality dark phencyclidine in prescription would haul effexor amitriptyline bad illie was courier tricor are mostly miacalcin dosage cloth picture aggrenox vs plavix preventing the 270 phendimetrazine her wings how many ambien pills can kill course her ketamine legal dodge endlessly headache alprazolam always identified veetids buy her working do not take paroxetine knows that can you take allegra with zoloft something that diovan interaction arrow argued relenza 1999 print ad too good ortho insect home products nfortunate waste 1 prilosec completely stupid isosorbide abuse the crowd seroquel im island was isosorbide dinitrate structure the spell repellent.

Add comment