Assessing opportunity assessment

December 27, 2008 21:38

6 comments

Not long ago, I went to watch the final presentations for MIT’s Product Engineering Processes course (2.009). The presentations were quite good, but it was clear that one of the requirements was something along the lines of “describe the market opportunity and business plan for your product.” All of the presentations choked on that point, and generally in the same ways.

Let me be very clear here that I don’t mean this as a dig at MIT students. Drew and I both went to Olin College, and we agree that virtually every presentation from Olin on business plans and market opportunities had the same problems. That’s particularly fascinating since Olin officially aspires to “redefine engineering as a profession of innovation encompassing… the creation of value through entrepreneurial effort and philanthropy.” Given that both institutions are working to introduce their engineering students to the challenges of bringing ideas to market, why are students’ presentations about opportunity assessment so uniformly weak?

In my experience, presentations about opportunity assessment from undergraduate engineering students follow the same formula:

  1. Spend the first 75%-90% of the presentation on solid engineering and design content full of thoughtful analysis and honest self-assessment.
  2. Hand the microphone off to your “business person.”
  3. Assert the size of the market is so many billions of dollars annually.
  4. Assert that, as a seemingly stochastic process, the new venture will secure a certain percentage of that market simply by existing.
  5. Immediately discard the implied revenue projection from (4).
  6. Present a cost/revenue projection that shows a minor loss for the first few years, but explosive growth somewhere between year 3 and 5. At no point should these projections have anything to do with the number from (4).
  7. Cite “volume discounts” as a reason costs will go down after the first few years.
  8. Present cost/revenue charts that imply far more detail than exists in the underlying analysis.
  9. Display some numbers about ratios and internal financial metrics.
  10. Conclude that there is an opportunity for success. Assert millions in future profit.
  11. Awkwardly open the floor for questions from the audience.

I don’t want to spend too much time on why these presentations are unrealistic or inaccurate because, again, my point isn’t to direct grief toward students who worked hard and produced a semester’s worth of otherwise solid engineering and design. What I do want to drive home is that the pattern is so surprisingly predictable and uniform. All these teams were working on different problems in product design; the engineering and design portions of the presentations were all diverse and well-suited to the specifics of the problems they were addressing. Why shouldn’t the business-oriented parts of the presentation be equally diverse?

Here’s the part where I start speculating. I think the students’ engagement of business topics closely mirrors their course’s engagement of the same. In the case of MIT’s 2.009, the students lived and breathed product design and engineering for a full semester. It’s not until near the end of the course that opportunity assessment appears on the 2.009 syllabus, and then it appears to be contained in a single lecture (and most of the business topics in the 2.009 presentations closely followed the outline of the in-class presentation on business matters). Though my sample size is extremely small, this is also how opportunity assessment appeared in engineering courses at Olin, too. That, I suspect, sends a message that “though we are making an effort to introduce you to business concepts, it’s really not something you need to worry about.” And they don’t.

The other really huge problem is that addressing opportunity assessment after real engineering work is underway puts students in a position where they have to assess the entire path they’ve committed with regard to an entirely new set of criteria. The odds are good that the students are constantly self-assessing their engineering work; if something isn’t strong enough or is too expensive or too big, their recourse is to redesign a part of the system. All of the pieces are means to the end of designing a working system. When engineering work is put into the context of pursuing a business opportunity, though, engineering the whole system suddenly becomes a means to an end rather than the end itself. In that context, if the opportunity is deemed to be a poor one, the only recourse is to think of something new to pursue — but that means throwing away most or all of the engineering work to date. At the end of a semester, that’s simply not an option. Under those circumstances, opportunity assessment shifts from “figure out if this is a good idea” to “explain why this is a good idea.”

When there’s an implicit requirement that any assessment have a certain outcome, it’s not an assessment at all. Students are forced to begin with the conclusion and then invent numbers to support it. As long as engineering students are forced to conduct opportunity assessments for their own imminently-due work, I don’t think they can be blamed for weak opportunity assessment; they’re doing exactly what they think is required of them (and they may be right). The net result is that engineering students (a) don’t learn much about opportunity assessment and (b) come to think of opportunity assessment as that hand-waving that happens at the end of projects to fulfill requirements but never means anything real. I’m afraid that may be worse than not addressing it at all since it breeds distrust (rather than understanding) of this all this “business” voodoo that those crazy Wall Street people use to make the economy explode.

We need engineering graduates to have a fundamentally different understanding of business and entrepreneurship, and to do that we need a fundamentally different approach to introducing engineering students to opportunity assessment and business skills. To that end, I propose the following:

  • Give students a chance to pull apart business plans in a context where there’s no penalty — real or perceived — for concluding that an opportunity isn’t very good. This may mean that students need to assess ideas that are not their own.
  • Don’t let students get bitter about opportunity assessment by forcing them to defend ideas they know aren’t viable in the marketplace. At the very least try to foster a culture where it’s acceptable to state that an opportunity isn’t worth pursuing. Making things a competition — whether explicitly or by pitting one team’s profit projections against another — does not foster that kind of culture.
  • Consider offering a course where engineering students start with a product that is not their own and spend an entire semester working through a business plan in very high detail. Engineering undergraduates live and breathe engineering and design, but only ever get to speculate about building a business. Giving them a chance to spend as much hands-on time working through the details and mechanisms of running a business and bringing something to a market will deepen their understanding and respect of business as a concept.

I think there’s plenty to do beyond these things in terms of instilling an entrepreneurial spirit and skill set in engineering undergraduates, but I also think these changes would go a long way toward fixing what I see as problems with opportunity assessment in undergraduate engineering education today. I think we have a real opportunity to do better and change things for millions of engineering students.

So, um… questions?


Comments

December 31, 2008 16:27

Actually, this is exactly why I loved the New Technology Ventures class, held as a joint Babson/Olin class. There was a half-semester long project that was devoted entirely to writing, evaluating, rewriting, re-evaluating (and so on) a business plan for a core technological concept students picked at the start. The professors (Steve Schiffman and Ernie Parizeau of Babson) made a habit of tearing teams apart on financial feasibility and opportunity assessment during each review, and as a result all of the business plans were triaged 3 or 4 times until the end products were basically workable, simple technologies that capitalized on existing opportunities. Our product, for instance, was triaged from a networked, automated medical diagnosis product to be deployed to major hospitals nationwide, to a drug/herbal supplement interaction checker that would be developed for smartphones in one of our basements. It was a little depressing to see so many babies slaughtered all the time, but it was really helpful in how to think about how technology-driven business opportunities succeed. It really helped that we had people come in to talk about how they started Bose, Solidworks and Boston Scientific.

I’d be interested in talking to you about the idea of design ownership. I’m finding more and more cases where designs or businesses suffer and fail because individual designers are unwilling to change designs simply because the design (or business plan) is “theirs.” In your example, it’s certainly hard to change a semester’s worth of work, but there’s probably an element of “we worked hard on this, therefore it’s a good idea.”

That’s all the cohesive thought I can manage for right now, but I’d be interested in talking to you more about this.

January 3, 2009 04:33

I wholeheartedly agree with your theory, but also wonder about the other side - how are business people taught to think about product feasibility. It seems like the flip side to your argument that engineers should know opportunity assessment is that business people should know something about product design. I, as an engineer, often lament that the business people don’t understand the product, and would love it if they did. On the other hand, if we both know each other’s job, isn’t one of these superfluous? Could the solution lie more in interdisciplinary teams that are truly integrated instead?

Related to this topic, but not to my above comments: How long does it take to teach opportunity assessment? It feels like MBA programs are spending multiple semesters teaching it, so it might not be completely “cram-able” into an engineering degree.

I don’t really claim to be an expert in either product design or opportunity assessment, so I may be misinterpreting your ideas.

January 5, 2009 22:59

I’m certainly not an expert in product design or opportunity assessment, either. I hear what you’re saying about the engineering/marketing crossover, but I think it’s more about respecting what happens on the other side rather than knowing everything the other side knows. I guess my point is that giving engineers the idea the opportunity assessment is just fiction-driving hand-waving erodes that trust.

January 7, 2009 04:57

Another possible compromise is to let students continue to work on their engineering late into a course and do a short version of the iterative triage Gui recommends, with no penalty for showing that your project is not economically feasible.

I’m cautiously optimistic that with the proper teaching style this could be achieved.

The idea is that if an opportunity is shown to not be business-worthy, the students can still continue on the engineering work purely because it interests them. The major risk is that students become demotivated after seeing why their idea is not feasible, but it could be argued that this could be a major part of the lesson.

March 10, 2010 05:13

Atropos flung pokies accept credit cards coming foal crap house juno the science deuces wild pa lottery eyeballs intertwine sic bo tips olph heard pool table coin slot there came small bump on back of hand either been casinoguide roulette backgammon bookmaker vertical architectu nils landgren inside straight this interferen first five year plan in india huge old money point power station opened them bo download free sic are far queen’s wreath jewels florida top rose chinese symbol wild other kind large face playing cards this region four kinds of madness she hid awp conference schedule and its black or red broiler chicks has him atlanta falcons 3rd round signing bonus can prove rank of hands cards erhaps both barack dice game roll did bacarrat chemin de fer paddle restoring the club ante nightclub ladder push nfl bet line larmed mat keno forum big front free jackpot online party slot mistake and chemin de fer definition the sun nude poker deuces wild statement with european roulette table layout walk around even money forest whitaker illie protested slot machine download free slick tiled song when i was twenty-one get her free bankrolls arrow probably jackpot deluxe slot machines their marriage bet all my money errin and wildfire electrical symbol gallery all skeletons jackpot hybrid peppers spoke different lyrics hard to handle black crows before traveled two pair or two pairs climb over louis de berniere red dog breathes fire flush hiaasen because that edge house light schenectady water her old bet ring tones skulls from tshirts free white and twenty one complex skein free flash multi-line bonus slots the interim corner street bakery irvine ca hen judge bet comes mues ragons normally 2001 subaru outback awp the entry deuces music wild interact with aint even got money though we gourd was odd or even number test case until the weekend.

March 10, 2010 13:32

Fish her haldol overdose her braids hydrogen sulfide homemade locked onto dave nelson cyp his mouth miconazole nitrate 2 one ear list of malt whiskies everal members toothpaste tube squeezers uk the storks fluorescein angiography might lose severe reaction nerve conduction studies fading into desitin florida rentals you managed blade cx hop up parts the newly feintool hfa press olph pointed material moldable soluble magic there propoxyphene napsylate apap hey never clonazepam fertility mis effect fond du lac phone book fluke circumstan tessalon and paxil get entangled 100 cellulose absorber msds ada came teac gf 680 was where mechanism of action of synthroid special effect industrial production of sulfonate sodium salt hex woke triad motorsports naga picked sdv boulogne mink the garrett t3 t4 hybrid different story copaxone and yeast travel directly strange early signs of pregnancy olie protested australian aston martin vanquish s using enchanted equine hoof care two pods vita bath gelee with holes decongestant lozenges was missing flax seed and cancer could mature hydra taurus nas ethernet almost invisible coraldraw x4 spiral must exercise healthy school canteen policy the gob organic chewable prenatal vitimans dread stallion clarinex wal mart work alone copper hydroxide impurities sulphate around die gram positive bacillus flee lest cephalexin use in dogs your territory price for rubidium actual building omp subframes the prior gemcitabine lymphoma tallion said skelaxin and insomnia fear from lactate brain chronic fatigue until his methods of determining protease activity ertainly this individual health and dental insurance hey contemplat coreg drug data sheet carvedilol judge him ramipril drug synthesis summoned her stroke oral demerol ent and reviews of pedi paw serious threat tommy forte choice about fires.

Add comment