Why Good Engineering Isn’t Enough

Companion to: “I Was on the Government Side of SBIR in Year One”

Good engineering is necessary. It isn’t sufficient. Most people who watch a technology program die already understand the first part. The second part is what surprises them.

The valley of death is a business problem. An idea works in a lab. A prototype demonstrates the concept. The need is real, the solution is real, and nobody picks it up. The engineering didn’t fail. The decision that has to be made next is a business decision: commit capital at risk, build an organization capable of scaling, find a market and a price point that works. Engineering is in the room throughout that process, solving the technical issues that surface during development, and there will always be technical issues. But technical issues aren’t what kills programs. Programs die when nobody with capital decides the business case is worth closing.

The reality of product engineering is what makes the business case hard to close. Per-unit cost is too high because volume is too low. Specialized tooling doesn’t exist in commercial form. Materials are available from one supplier at laboratory prices. Getting any one of those factors to move requires moving the others first, and none of them move until there’s committed volume, and there’s no committed volume until someone makes a business bet. It’s a simultaneous equations problem where the engineering variables are real and solvable, but only after someone has already decided to solve them.

This is what the valley of death actually describes: not a technical barrier but a business commitment problem that makes the technical barriers look permanent. The gap between “we demonstrated it” and “someone will invest in making it real” kills ideas that deserve to live, and it does it for business reasons, not engineering ones.


By the late 1970s, the federal government had been pouring R&D money into large contractors and universities for decades, and the results were showing a systematic problem. Studies, including the Roland Report commissioned by the National Science Foundation, documented that small businesses were producing more innovation per R&D dollar than large institutions, but receiving less than 4% of federal R&D funding. The engineering capability was there. The business capacity to close the valley wasn’t. Small businesses doing genuinely innovative work couldn’t attract the private capital to scale, and the federal procurement system funneled everything to large contractors who weren’t producing the results.

Congress passed the Small Business Innovation Development Act in 1982, creating the Small Business Innovation Research (SBIR) program to address the business gap, not just the technical one. The design was three phases. Phase I bought a feasibility demonstration. Phase II funded a practical prototype, proof that the technology worked at something approaching real-world conditions. Phase III was where the business commitment was supposed to happen: a commercial partner who would develop it into a product, or a defense prime who would integrate it into a program of record. The government’s role in Phase III was to facilitate, not to fund, or to fund through buying a ‘commercialized’ product from a prime who had taken the business risk.


What it looked like in practice, at ground level inside a Navy facility in the 1980s: the Office of Naval Research sent calls for topics down to Navy facilities around the country. Groups with real technical problems and the engineering depth to scope them responsibly generated the topic lists. The Microelectronics Engineering Branch at the Naval Avionics Center in Indianapolis was one of those groups. We were building hybrid microcircuits to solve obsolescence problems in Navy avionics systems, operating a 10,000 square foot Class 1,000 clean room, doing hands-on manufacturing work across a broad range of technologies for just about every platform in the inventory. We had problems. We wrote topics.

Topic generation was real work. You had to identify a problem that was genuine and defensible, scope it to something achievable at Phase I budget, and think through whether a small business could actually deliver a demonstration in six to twelve months. If your topic drew a proposal worth advancing, you became the Technical Contract Monitor: you reviewed the work, made the site visits, wrote the assessments, and decided whether Phase II was warranted.

The program, at its best, worked exactly as designed. Early in the SBIR era, our group sponsored a topic on hermetic package delidding. Hybrid microcircuits were sealed under nitrogen with welded or soldered lids. Pre-seal testing didn’t catch everything, and post-seal failure rates above 10% were not unusual on complex devices. Existing tools for removing the lid without destroying the circuit inside were crude and inconsistent. A small company proposed a mechanical solution, demonstrated it cleanly in Phase I, and delivered a near-production system in Phase II. The Naval Avionics Center used that machine for fifteen years. The company sold hundreds of units to major defense contractors. Within five years, estimated savings across the customer base were in the hundreds of millions of dollars. That one program probably paid for that year’s entire SBIR budget.

That’s the program working as designed: one focused problem, one small company, a technology with genuine commercial legs that didn’t even require Phase III. The valley got crossed because the solution was useful enough that the market on the other side showed up.


Phase III is where the business commitment was supposed to show up. It usually didn’t.

The program’s designers understood the chasm as having two walls: the government R&D side and the commercial market side. Phase III was where someone on the market side was supposed to make the bet. A technology proven at government expense becomes something a company builds a business around, or something a defense prime integrates and procures at scale. In the 1990s, the Air Force built a reputation as the most organized service in pushing for that commitment, running commercialization pilot programs that brought in private capital and non-SBIR government funding to bridge the remaining gap. This wasn’t formal cross-service authority, each service controlled its own programs, but the Air Force was more energetic and systematic about the transition problem than the others, at least in the domain I was working in. Whether that reflects a structural reality or the particular corner of the program I was seeing, I can’t say with certainty. It was the perception among people actively working Phase III at the time.

In practice, Phase III conversions were hard and relatively rare. The commercial partner had to see a viable market. The defense prime had to have a procurement need and a program with budget. The small company had to have the capacity to scale. Those were all business decisions, and they had to align simultaneously. Often they didn’t.

When they didn’t align, something else tended to happen.


If the technology was genuinely useful and someone inside the government still cared about it, it was possible to keep it alive on continued funding, sometimes for years. This is where the incentive structure started working against the program’s intent.

Once a small company has a long-term government-funded program, the pressure to truly commercialize decreases. The government is paying. The cost structure under FAR accounting is cost-plus: the company recovers its expenses and earns a fee without the risk that commercial investment requires. Commercial development requires capital at risk, uncertain returns, and the real possibility of failure. A long-term government program offers none of that uncertainty. Rational actors stay where the incentives point.

This isn’t a character failure. It’s what you’d expect from the structure. The same dynamic has played out in government programs across history (just well documented in the US and UK). The National Wool Act of 1954 created a subsidy for domestic wool and mohair production, justified by military uniform requirements from World War II and Korea. The Defense Department removed wool from the strategic materials list in 1960. The subsidy ran for another thirty-three years before Congress phased it out in the mid-1990s. A legend grew around it over time, with the livestock upgraded from sheep and Angora goats to alpacas to sharpen the absurdity. The legend isn’t accurate, alpacas weren’t even imported to the US at scale until 1984, but the underlying program was exactly as described: a strategic justification that expired, an entitlement that didn’t. That’s not unique to agricultural policy. It’s a predictable outcome when the incentive to keep a program running outlasts the original reason for running it.

The SBIR mill problem is the same structure at a smaller scale. A company wins Phase I. It wins Phase II. It learns the system, builds relationships with the sponsoring organization, starts working upstream with topic writers to seed its own pipeline. This is rational, and the incentive structure rewards it. But if Phase III never materializes and the company doesn’t put its own capital at risk to push the technology toward commercial viability, it evolves into an organization that is very good at winning SBIR awards. Not because anyone decided that was the goal. Because that’s what the environment selects for.


The 2026 reauthorization addressed some of this. The new legislation added performance benchmarks for companies with multiple awards, put caps on proposal volume per company, and created a Strategic Breakthrough Award for high-impact projects that need larger Phase II-scale funding. Whether those changes alter the underlying incentive structure in any meaningful way is an open question. Changing the rules changes the behavior at the margin. It doesn’t change the realities of the valley of death.

The valley is a business problem. Engineering and some funding gets you to the edge. Getting across requires someone to commit capital at real risk, build for scale, and make the bet that the market is there. Funding a demonstration doesn’t do that. It proves the concept is worth trying, and that’s not nothing, Phase I and II produced real results when the business conditions lined up. But the conditions have to line up. Good engineering is necessary. It was never sufficient.

The first video in this series covers the year the program started, what it looked like from inside a Navy facility, and one program that went exactly right. https://youtu.be/sKKgNFOb1C8


Mark Harris is a systems and mechanical engineer with 30+ years in power electronics and avionics packaging. He writes as M.A. Harris. The Unretired Engineer is his YouTube channel.

For 40 years I was an Engineer 15 of which was remote. It’s a tool not comfort food.

The Systems Engineering of Remote Work: A 40-year viewpoint
https://youtu.be/K6ntv7cWEn0

After 40 years in the industry—from the 13-acre “Industrial Beast” Naval Avionics Center in 1982 to project leadership of global power electronics projects, with long stints working from a home office—I’ve seen the data. In this video, I break down why the “Return to Office” debate is often a struggle against Sub-Optimization.

Explore why the physical office provides the “Grit” required for innovation and the “Density of Learning” necessary for junior engineers, while the home office offers the “Gold” of deep work and the objective distance needed for systems integration.

Internal combustion battery…sort of

The center section is essentially 2 combustion chambers back to back, the orange wrap is the ‘stator’ of an electric generator. When the magnets tied to the piston runs through the stator it generates electricity. Then a spring returns the stator to the center and the cycle (2 cycle) starts again.
Green Car Report :Could Free Piston Range Extenders Broaden the Electric Truck Horizon?
One of the ‘cool’ things about a Free Piston Engine is that it can be packaged in a fairly simple block and because of the elimination of the mechanical drive train and residual mechanical controls (valves, cams, etc) the machine can eat different types of fuel and be tuned in a wide variety of ways quite simply. This makes it compatible with battery electric systems on a packaging and mission program ability standpoint.
A simple schematic of the bare bones of a free piston machine. Other uses have been proposed but tying it to a generator and modern power electronics to make it a range extender is pretty interesting. The technology is derivative of the highly refined IC engines of today and the equally long history of electric generators so this should be something that matures pretty quickly.

A Cold day in H__L

This is reputedly a photograph of a test from years ago regarding windmills and icing. Almost the reverse of what it has sometimes been used to represent.
BUT….

Did Frozen Wind Turbines Impact the Texas Freeze? Here’s the Data

BY BRYAN PRESTON FEB 17, 2021

As the graph plainly shows, wind generation choked down but natural gas compensated. Coal and even nuclear power generation dipped. Solar generation has been negligible due to cloud cover and several inches of snow and ice.

From StreetWiseProfessor: Who Is To Blame for SWP’s (and Texas’s) Forced Outage? “The facts are fairly straightforward. In the face of record demand (reflected in a crazy spike in heating degree days)…

…supply crashed. Supply from all sources. Wind, but also thermal (gas, nuclear, and coal). About 25GW of thermal capacity was offline, due to a variety of weather-related factors. These included most notably steep declines in natural gas production due to well freeze-offs and temperature-related outages of gas processing plants which combined to turn gas powered units into energy limited, rather than capacity limited, resources. They also included frozen instrumentation, water issues, and so on.”

So then Krugman rolls in from the NYT saying ‘Texas’ problem was Windmills is a Lie. ‘ Which itself, while not a lie in Detail, is a lie in Essence. As per some top line thinking in ManhattanContrarian in This Piece Points out:

Total winter generation capacity for the state is about 83 GW, while peak winter usage is about 57 GW. That’s a margin of over 45% of capacity over peak usage. In a fossil-fuel-only or fossil-fuel-plus-nuclear system, where all sources of power are dispatchable, a margin of 20% would be considered normal, and 30% would be luxurious. This margin is well more than that. How could that not be sufficient?

The answer is that Texas has gone crazy for wind. About 30 GW of the 83 GW of capacity are wind.

….sometimes the wind turbines only generate at a rate of 600 MW — which is about 2% of their capacity. And you never know when that’s going to be.

ManhattanContrarian

But/And it IS complicated. 1) You can install deicing systems on windmills but they are expensive to install and maintain and require INPUT of electric power to operate (Texas average weather makes this uneconomic to install.) 2) Texas did this to itself, it has an independent Grid because it IS a country sized state, the grid operator is actually a Bit Wind Crazy…why…because Texas has a lot of wind power. 3) This weather is a Combination of once in a hundred year cold AND snow/cloud cover, which systems are not designed to deal with other than in some degraded manner.

So one can only hope that because it is complicated and is fairly easily shown to be so that the cool heads will be left to work out some solution that prevents this sort of thing happening again. Because yes weather is unpredictable and while this was a 1/100 double header, it did occur and that says that the odds may not be what we think they are and so some mitigation is required. That mitigation is Not more wind, Not stored power, it IS more nuclear +better of all the above, AND better links to the broader national grid, etc, etc.

Myself, I’m planning a new house in the country. Big propane tank, backup generator, solar power, grid tied battery backup, ultra insulated house (for the region.) My prediction is that the grid is going to get worse not better and if you you can, you need to be able to survive without electric power from the mains for a week or more. I can make that possible, though I am in the few percent just because of location, situation, grace of the Infinite.

Point to point sub orbital

Preparing for “Earth to Earth” space travel and a competition with supersonic airliners From NASASpaceFlight.Com an important and fun source on space activity all around the world not just NASA/US

So this seems crazy but in all honesty it has actually been a thing for a long time. It is mentioned in a lot of sixties/seventies SF not focused on space flight. It was seriously studied several times as a sort of replacement for parachute insertion of military force. And like most of those sorts of efforts there was a commercial concept to support the technology since the folks in the defense industry understood that military programs cannot support a robust industry on its own.

Just look at nuclear power, there was a reason that nuclear power stations evolved as the Navy came to realize they wanted nuclear ships. And there is a reason that small aircraft carriers and non nuclear submarines are anathema to certain parts of the Naval establishment. They know that if non nuclear CVs and SSs became common the industry required to support the nuclear fleet would become unaffordable.

https://thehighfrontier.blog/2016/03/20/straight-back-down-to-earth-a-history-of-the-vertical-takeoffvertical-landing-rocket-part-1/

People have already talked about the DoD buying Starships and using them as bombers / hypersonic weapons platforms. This is just turning the model above around.

Back in medieval times freighters and warships were the same thing, they just tacked on some fighting platforms and went at it with bows, crossbows, catapults, swords, etc. Even the Vikings probably started out as traders though always ready to ‘raise the black flag and slit a few throats’ if that looked like the right business strategy.

Anyway…sorry for the side commentary, it’s evening and I had a good dinner so I’m wandering a bit.

So, again anyway…if you look at it, a craft like the Starship, which has the performance as a single stage vehicle to haul 100 tons 10,000 miles in less than an hour has some attraction on its face….but in reality?

  • To my mind the most value dense time sensitive cargo is people but that’s years out at the least.
  • In the meantime are there cargos that are so time sensitive that something like a starship might make sense?
    • Couriered documents. Maybe
    • Mail. Does not seem like it.
    • Medical supplies only if the ship could land almost anywhere and take off again.
    • High value tech like chips? Maybe but 100 tons is overkill.
    • In fact most of the above are not 100 ton class cargos and frequency and flexibility of landing seem critical.

So dead on arrival? No there are customers who might pay for a a limited 100 ton capability. I think it would need to be anywhere in the world which is more than 10,000 miles but is probably within the capability of a modified Starship with more fuel and less cargo…or maybe an extended tank Starship could do 100 tons out to 18,000 miles (my wag of anywhere in the world from anywhere in the world.)

A somewhat smaller starship could do 10 tons 18,000 miles and probably land at just about any port or airfield as long as you can supply LOx and LNG, which is not that uncommon.

Go back to the start. If you burn a couple of hundred tons of LOx/LNG what is the cost? Does it make economic sense? Is it safe, is it going to be acceptable?

  • Economics:
    • LOx/LNG are in the same $/ton range as Jet fuel, you are burning a couple of times the fuel since you have to haul up the oxidizer with you and pay for that as well so say 4x the fuel bill.
    • The hull is in line with a modern airline.
    • If you can do a trip a day or so with support costs in the same range as a jet, it would appear to me that for the right cargo you could make it work.
  • Is it safe?
    • Well not right now but once the tech is wrung out ?? I think so.
    • the big difference is much higher energies than a jet.
    • But…your exposure time is a fraction of that of a jet over the same range. Accidents in mid flight are rare but generally lead to complete loss. Exposure time is probably the most important difference…advantage Point to Point
    • Ok so the major threat time is when you are near the ground around take off and landing, Those are shorter for the Point to Pointer.
    • And to me the difference in energy involved is immaterial…dead is dead and most of the time accidents of any magnitude in those phases are not survivable.
    • Accidents on the runway often have survivors but that is eliminated in the Point to Point case…up and down…no in between…
  • Acceptable?
    • Only time will tell, my guess is YES.
    • It will be a bit like the glamor days of the early airliners I would expect point to point for certain segments to be a real elite punch card
    • Especially as near earth space becomes an exotic but achievable location.

Exciting times indeed.

Batteries Batteries Batteries 

A good artcle on batteries in Power Electronics, triggered by  the Samsung Galaxy Note 7 Debacle, and the not to distant past mess with the ‘hover board’ craze. The article links to a pretty detailed recent study of coming high power density battery technologies.   

The eMagazine http://www.powerelectronicsnews.com/ is a good source on power electronics across the power and technology range. A good way to keep up on a rapidly changing field.

The article talks about a variety of battery chemistries including sodium as shown in the following graphic.

An enormous variety of sodium-ion battery variations are being considered by researchers worldwide as surveyed here regarding their operation voltages versus specific capacities for cathode materials (a) and anode materials (b) in order to find a combination that make them competitive with Li-ion. SOURCE: Macmillan Publishers Ltd

However the main reason I show this graphic is the incredible density of information that the graphic data presenter/artist at Macmillan Publishers was able to insert into a relatively small and simple chart. For me as a technologist this gives me the ability to data dive and compare and contrast very quickly when considering alternatives. My experience in buying reports or data repositiories of one sort or another is that the quality of this sort of chart is key to the value of the document

Interesting, a wind jammer for the 21st century

20131105-191412.jpg

The Norwegian Vindskip design from Lade AS uses a specially shaped hull to capture the wind and convert it into forward motion.

Natural gas fired Gas Turbines to get wind speed on the right ‘quarter’ and the combined wind speed provides a boost to get up to 60% fuel savings. All very well till you get in a real blow, it does look like it’ll be a bit of a handful in bad weather, it has big stabilizers like a sailing yacht so maybe it’ll work…anyway it’ll be a figment of computer simulation sthen tank testing for a few years yet.

Build your own device Motorola’s (Google’s) next cell phone play

Motorola Announces “Project Ara,” a modular phone hardware platform20131030-225519.jpg20131030-225530.jpg

Motorola has announced a free open hardware platform for smartphones called “Project Ara.” The goal is to create a modular smartphone that would allow users to swap hardware components at will. Motorola says it wants to “do for hardware what the Android platform has done for software: create a vibrant third-party developer ecosystem, lower the barriers to entry, increase the pace of innovation, and substantially compress development timelines.”

looks cool seems reasonable for the large geek, nerd, techie, metro, hip, individualist, contingents out there. Making it rugged and relatively ‘duh’ proof will be a challenge.

Too quiet to be a race car

Do we really go to the races for the visceral shiver a race car’s engine can give you, the aching memory frisson that the stink of castrol can trigger?
20131026-145830.jpg

Formula One dominator Sebastian Vettel gave short shrift Saturday to the new, electric Formula E series, saying it would be far too quiet and was “not the future”.

Read more at: http://phys.org/news/2013-10-vettel-formula-future.html#jCp