Dismantling Silos: A Path to Agile Engineering

Boundaries are necessary. That’s not the argument.

Every engineering project starts with bounding — what you’re solving, what the solution has to do, what’s out of scope. Without that, you’re not engineering, you’re wandering. The boundary is how you make the problem solvable.

The modern corporation learned the same lesson at scale. Adam Smith’s insight wasn’t complicated: split work into elements, run them in parallel, and you can deliver what no individual craftsman ever could. From Renaissance capital markets to the factory floor to the aerospace prime contractor, that logic held. Boundaries enabled scale.

When I joined the workforce in 1982, the logic was still holding — and you could feel why. I had a notebook and an HP calculator. A shared secretary supported the division manager, and before any report left the building it needed sign-off from both my branch manager and his. Not bureaucratic obstruction — that was the information architecture. Reports were dense, slow, and gatekept because they had to be. Management structure existed in large part to curate that flow — to compress what mattered, pass it up the chain, and keep the organization pointed in the right direction. The stovepipe wasn’t a bug. It was load-bearing.

Between 1982 and 2002 two things happened simultaneously that should have changed the equation. First, information handling exploded. The PC, networks, sensors — generating and moving information became cheap and fast. Second, process culture arrived. The US had watched the Japanese manufacturing renaissance and brought back a set of ideas about quality and process that got bolted onto the existing corporate hierarchy. At exactly the moment when individual engineers could span across an organization and get at information directly, the process culture locked the structure down harder.

The result in many companies: more capability to move information, less permission to use it. The stovepipes stayed. The rationale quietly expired.

I ran three programs across my career that show the delta. At SatCon on the AIPM program — Advanced Integrated Power Module, a DOE/Navy cost-share — I was simultaneously program manager and lead engineer, spanning manufacturing, electrical design, mechanical design, and simulation. We went from concept to demonstrated production-ready modules in three years on a modest budget. That approach, the sub-module test-before-integrate architecture we developed, is now standard inside automotive power electronics. Tesla uses a version of it.

At DRS, working with Allison Transmission on an integrated generator for military vehicles, we built a successful solution and demonstrated it to the Army. General officers asked why they couldn’t have more. It took ten years for the technology to gain traction — not because the engineering was wrong, but because the organizational and procurement structure couldn’t move.

At Wolfspeed, deep stovepipes. Marketing, sales, test engineering, module design, device fabrication — separate organizations, separate priorities, separate permission structures. Getting a new product from concept to release meant handing information off at each boundary and then jawboning it forward, because you couldn’t do their job for them and they had to queue the work against their own priorities. Fifteen products out the door. Every one of them harder than it needed to be.

The stovepipes were there to protect quality. They also stopped momentum.

What’s changed now isn’t the human desire to span boundaries — engineers have always wanted to do that. What’s changed is that the tools exist to actually do it. Companies that have built their information architecture from scratch rather than inheriting it — the Teslas, the newer defense tech firms — have demonstrated what happens when low-level actors have access to the full context of what the organization knows. Engineers and technicians can interrogate data, surface patterns, propose action. The information that used to require a management layer to curate is available directly. The span of control moves down the org chart.

For incumbent organizations with data already siloed, this is genuinely hard. The stovepipes aren’t just structural — they’re also where the institutional knowledge lives, and dismantling them requires executives who are willing to accept that the curation function they’ve been performing can be partially replaced. That’s not a technical problem. It’s a political one.

Christensen’s Innovator’s Dilemma describes what happens to incumbents who don’t solve it. A smaller firm with narrower scope but faster movement finds a niche. The niche gets cheaper and easier to serve. The incumbent can’t see it clearly because their whole architecture is optimized for something else. The niche expands. You know the rest.

The boundary isn’t the problem. Bounding a problem is still part of the engineering job. The question is whether, once the problem is bounded and the work begins, you’re working inside a structure that moves — or one that fills up and waits to overflow into the next pipe.

While many organizations are ‘implementing AI’ most are not working through the changes from first principles and often implementing all or nothing. The ones that don’t get around to making sure they break the stovepipes logically are going to run out of time.


This post accompanies the video Why Stovepipe Organizations Stop Working — The Unretired Engineer, April 2026.

Andy Weir’s Genius in Project Hail Mary

Andy Weir has a rare gift: he writes ordinary people — genuinely, recognizably ordinary — who have a skill that is also recognizable, and then puts them in situations where their one extraordinary competence is the only thing standing between them and death (in the case of Project Hail Mary, the extinction of the Human race.) The heroism is quiet and technical and you could almost believe that you could do that in the right circumstances.

You believe it because he’s made you believe in the person first. I saw the movie. I read the book years ago. Both are excellent, and the movie is one of the most faithful book-to-screen adaptations in recent memory.

Like The Martian before it, the film sticks closely to the book in both thesis and spirit. That fidelity matters: both stories rely on the reader/viewer trusting that the protagonist’s problem-solving is real, not movie-magic. Break that contract and the whole thing collapses. Weir earns it on the page; the filmmakers preserved it on screen.

The one genuine gap between novel and film is interior monologue. Novels handle internal states naturally; movies almost cannot. But Weir constructs scenes that externalize internal conflict visually — and those translate superbly.

A couple of minor side arcs from the book are absent, and I think those were wise cuts. They deepened the protagonist on the page but would have felt excessive at feature length.

One thread that bothered me in the book and still bugs me in the movie: Ryland Grace is pulled into the program because in his post-doctoral research he had proposed that alien life does not require water and carbon — and had defended that position to a career-ending degree. When the AstroPhage is first discovered it appears very alien, so Grace is brought in for initial analysis. He then finds it’s made of the same materials as Earth life — which undercuts his entire reason for being there and threatens to sideline him. That it doesn’t is a good twist; go see the movie or read the book for how it resolves.

Here’s where my engineering brain creates further friction. The AstroPhage’s energy density is extraordinary, and the novel acknowledges this and hand-waves it away. I cannot see how any life form built on biology similar to our own could handle those energy levels — it feels bolted in, even if it probably wasn’t. Similarly, Rocky — the alien Grace meets at the target sun — turns out to be exactly what Grace originally proposed: a non-water/carbon life form, which feels a little convenient in vindicating him.

There are complaints about Rocky delivering a specific thematic point about first contact and communication. My view is the opposite (other than the niggle above) that whole piece is brilliantly on point and there would not have been much of a story without it.

None of that diminishes what Weir achieves. He takes relatable people with very human quirks and puts them in situations where they have to fight to survive — and we root for them completely. And here i put the very alien Rocky in the bucket of people…he is about the best alien I have seen in a move ever. I wish I were half the author he is, and I say that as someone who is trying. Project Hail Mary is the rare book where you finish it and immediately want someone else to read it so you can talk about it. The movie earns the same feeling. Go see it.

The Physics Produced the Ship

The Dagger Design

Most fictional spacecraft are designed backwards. The writer decides what the ship needs to do dramatically, then invents a reason it can do that. The result is technology that serves the plot. Which is fine, until you need it to do something different in book three, at which point you quietly bend the rules and hope no one notices.

Engineers don’t do that. Not because we’re more disciplined — because we can’t. You don’t change the spec because the schedule is tight. You re-examine the architecture or you live with the constraint.

That instinct, applied to fiction, produces something different.


The principal auxiliary warship in the Sea of Suns universe is called a Dagger. Here’s how it got its name — and it wasn’t because I thought “dagger” sounded good.

The Transit system — the FTL drive in this universe — works through a rail. The rail is a linear gravity generator that manipulates quantum foam to open a wormhole large enough for the ship to pass through. The rail controls volume you can push through: the more mass you want to move between stars, the more rails you need. Compute controls speed: the transit step is a calculation, and the faster you want to step, the more computing capacity you need.

That trade-off isn’t decoration. It’s the architecture.

An auxiliary warship needs to be fast. In this universe, fast means compute capacity. Compute capacity takes up volume inside the vessel. So a fast warship is, almost by definition, a ship that has traded its interior for processors. Twin rails — enough to move a meaningful crew and weapons load — with almost every remaining cubic metre given over to compute. Crew of two to five on a thousand-foot vessel. Not much else aboard.

Now you have a ship that’s fast, carries almost no cargo, and spends all its operational time in real space. Real space means it’s detectable. A detectable warship needs stealth. The most effective passive stealth for a vessel in this universe is minimising cross-section — flat surfaces, minimal radar return. You sheath the hull in flat panels that force the profile into a long, slender blade shape.

The name isn’t metaphor. It’s a description of what the physics produced.

I didn’t design a cool warship and retrofit a justification. The constraints generated the vessel, and then the vessel generated scenes I hadn’t planned, because once you know what a Dagger can and can’t do, certain tactical situations become inevitable.


That’s the engineer’s advantage in hard SF, and it’s not what most people think it is.

It’s not technical accuracy. You’ve invented the technology — accuracy isn’t really the point. It’s that engineering training gives you a specific habit of mind: ask what the constraints produce, not what you need them to produce. Follow the logic. Let the system build itself.

When the system is honest, the world it generates is consistent without effort, because everything follows from the same rules. The Dagger’s tactical role, its crew size, its limitations, the scenarios it enables — none of that required invention. It came out of the trade-off.

The reader doesn’t need to understand the Transit physics to feel that the Dagger is real. They just need to encounter it behaving consistently with itself across the whole story. That consistency is what creates the texture that makes a fictional universe feel inhabited rather than constructed.

Thirty years of engineering taught me that coherent systems generate their own logic. Turns out that works in fiction too.


Why Engineers Write Better Hard SF is on The Unretired Engineer YouTube channel —

Stranded in the Stars, Book One of the Sea of Suns Trilogy, is available on Kindle. The Dagger appears early and often. https://www.amazon.com/Stranded-Stars-M-Harris-ebook/dp/B0GT123PLP

The Engineer’ Return to the Keyboard

Optimization, Systems, and Storytelling: Why I’m Back

It has been a while—twenty years by some counts—since I first sat down to bridge the gap between “This World” of high-tech engineering and the “Others” I build in my fiction.

For four decades, my world was defined by electronic packaging, power electronics, and project engineering for EVs in both the commercial and defense sectors. I’ve spent my time in the trenches of “Dilbert’s world,” working the real details that make everything from electromagnetic guns to nuclear electric space probes real. But as any engineer knows, a system is only as good as its last optimization.

During those 40-plus years, I was an intermittent author of fiction and science fiction, though at times the projects I worked on felt like fiction as well.

At 68, I was “unretired.” (You can see the genesis of this in my YouTube video, EVs Ate My Job.) Through my channel, The Unretired Engineer, I explore how a lifetime of technical rigor applies to the modern world. Now, I am bringing that same focus back to this blog and my novels. Writing is, after all, the ultimate engineering challenge: building a world from scratch that doesn’t collapse under the weight of its own physics.

What to Expect Moving Forward:

Technical Deep Dives: The “how-to” behind the tech in my books, like the propulsion systems in The Sea of Suns.

The Editing Trench: Updates on my current copy-editing passes for The Sea of Suns and the structural work on Under Siege.

System Reflections: Thoughts on remote work, optimization theory, and the reality of a 40-year career.

World Reflections: Perspectives on technology, civilization, and war based on four decades of study.

The Workshop: Occasional updates on making with wood, resin, and whatever else I’m tinkering with.

I’m no longer just “tinkering.” I’m building. Whether you followed me here from YouTube or found my work on Smashwords, I’m glad you’re part of the system.

Let’s see what we can build next.

A Grumpy Economist on ‘Pay toilets and NYT: a free market microcosm’

So John Cochran of the Grumpy Economist seems a good Blog to follow, this was an amusing reminder of something I had not thought about for awhile.

Nicholas Kristof in Sunday’s New York Times asks a pressing — often quite pressing — question. Why are there no public toilets in America? He is right. He calls for a federal infrastructure plan to fix the problem: “Sure, we need investments to rebuild bridges, highways and, yes, electrical grids, but perhaps America’s most disgraceful infrastructure failing is its lack of public toilets.”

The absence of pay toilets is in fact a delightful encapsulation of so much that is wrong with American economic policy these days. Activists decide free toilets are a human right, and successfully campaign to ban pay toilets. For a while, existing toilets are free. Within months, upkeep is ignored, attendants disappear, and the toilets become disgusting, dysfunctional and dangerous. Within a few years there are no toilets at all. Fast forward, and we have a resurgence of medieval diseases that come from people relieving themselves al fresco. Now let’s talk about rent control.

As with so many things ‘basic human rights’ as espoused by progressives are no such thing. Anything that requires other peoples money is not a ‘basic’ human right, and as above toilets cost money and public toilets are paid for by the public, or no one at all.

In England I know (having lived there in my early years and visited later) that pay toilets were/are a thing. And I have seen articles out of the UK and Europe discussing all sorts of robo toilets to make maintenance less of an issue (Though I seem to remember a story about someone getting stuck in one [maybe after cheating the pay system?] and getting thoroughly doused in sanitizer etc which I think killed that attempt.}

I seem to remember as above that the toilets were 1Penney (spend a penny anyone?) when I was a kid. It was enough. Why is this so onerous on the ‘poor’ you can usually find a penny on the ground if you look hard enough. So what gives? What gives is that the people who can’t pay, won’t pay for this, they would never spend any kind of ‘coin’ that might go for a drink or drugs or….who wants to know? Anyway this is another one of those stupid, stupid, stupid misreadings of human nature and human needs that is tearing our culture, and civilization, apart.

So in flyover country this is not that much of an issue. Any normal fast food facility has reasonably clean bathrooms that are maintained for the use of their staff and customers. While they discourage the use by none customers it’s not that big a deal. I usually stop at a McDonald’s for the ‘duty’ and then get a coffee or a small snack to pay for the privilege and am happy to do it.

I don’t like Cities Sam I am, I do not like them man oh man…

Cheers

Interesting Fuel Cell + Ship Tech

Why the Shipping Industry Is Betting Big on Ammonia
Ammonia engines and fuel cells could slash carbon emissions
Article in IEEE Spectrum MCKIBILLO

There’s a lot to like about ammonia. This colorless fuel emits no carbon dioxide when burned. It’s abundant and common, and it can be made using renewable electricity, water, and air. Both fuel cells and internal combustion engines can use it. Unlike hydrogen, it doesn’t have to be stored in high-pressure tanks or cryogenic dewars. And it has 10 times the energy density of a lithium-ion battery.

So there is always a fly in the ointment of this sort of story…

Manufacturers and engineers must overcome key technical hurdles and safety issues in the design of ammonia engines and fuel cells. Port operators and fuel suppliers must build vast “bunkering” infrastructure so ships can fill ammonia tanks wherever they dock. And energy companies and governments will need to invest heavily in solar, wind, and other renewable-energy capacity to produce enough green ammonia for thousands of ships. Globally, ships consume an estimated 300 million tons of marine fuels every year. Given that ammonia’s energy density is half that of diesel, ammonia producers would need to provide twice as much liquid ammonia, and ships will need to accommodate larger storage tanks, potentially eating into cargo space.

So to fully replace oil you need 600 million tons, all produced artificially in new chemical plants. And then there is the ‘pungent’ odor and its solubility in water where it produces a strong alkaline Ph, the fact that it can cause breathing problems etc etc etc.

Not saying it is not an interesting approach but I really have to wonder how acceptable this would be. This seems like a question of ‘what kind of hell are you willing to accept to reduce CO2’ when the reality is that there are a lot of other things to do first and a lot better future directions to take. I like the idea of the age of windjammers returning…as in the last post.

Cheers

Russian Naval Renaissance

Russian Navy Commissions 1st Project 20385 Corvette ‘Gremyashchy’
From NavalNews.Com

The Russian Navy has a peculiarly multi faced history and reputation. As a land power with huge boarders and vast empty sectors it would seem more than a little excess to needs. In imperial splendor it has burgeoned into one of the greatest navies in history, in troubled times it has rotted or rusted away. It has lost a whole fleet in battle at the far end of the world after a voyage that would have been hailed as incredible except for the ending. It has built ships, particularly submarines second to none in technological innovation, then had to let them rot. Always a technological arm the Navy has often attracted the best and the brightest and being world spanning it has attracted funding to grow hugely when the money was available….

So today Russia is as troubled as ever, but it does sit astride Eurasia and if you consider the polar region is near the Americas. It has intimate contact with the sea and it needs a Navy for reasons both local and global.

The cycles of growth and rot have shown that one should never count the Russian Navy out. While the end Soviet Era strategic Navy is rotting away the latest revival appears to be underway. The article above and others, point to the fact that after a period of grim news about over runs, decades long builds, etc the lates Corvette program and its predecessor appear successful even given quite sever supply chain issues of geopolitical nature.

While one can poo poo a Corvette as a ‘little ship’ the reality is that this firecracker could conceivably sink a fleet of ships boasting the best of 1980’s technology without a scratch. The US navy and others are rapidly rethinking the efficacy and rational for cruiser sized destroyers in this modern age of omnipresent satellite reconnaissance and hypersonic smart munitions.

But beyond this ship the Russians are once again showing their intellectual metal with A New “Universal Sea Complex” ‘Varan.’

Russia Designs A New Class Of Ship: Universal Sea Complex ‘Varan’

“It is a new approach in domestic and global shipbuilding. The project will represent a new class of naval hardware — universal sea complexes (UMK),”

Nevskoe Bureau (a major Russian designer of ships and the sole designer of aircraft carriers and simulators.). NavalNews.com
Nevskoe Bureau (a major Russian designer of ships and the sole designer of aircraft carriers and simulators.). NavalNews.com
Nevskoe Bureau (a major Russian designer of ships and the sole designer of aircraft carriers and simulators.). NavalNews.com

The approach appears well suited to modern ship building practices. At modestly sized commercial yards. It is very much in line with the skeptics view of aircraft carriers as a modestly sized vessels with a reasonable strike force. It is not at all a competitor to a US Nuclear Super Carrier in itself but is well suited for power projection and strike warfare in a fleet setting.

Noting the sea gate at the stern you could see this ship as having a significant landing force either standard or optionally providing a strong ‘swing’ capacity. This might be an ideal Marine Amphibious warfare ship.

Looking at it one can see that it is unlikely to be able to support even the noted 24 aircraft wing for long periods at sea. But is that really necessary if you have enough ships so that in peace time they only spend a couple of months at sea at a time?

You can also see that it is unlikely to be able to support a fleet commanders facilities and staff. Again that makes sense, with high bandwidth covert data links the fleet commander can and ought to be separated from the strike asset.

If there was a significant Marine contingent the air arm would have to shrink. But once more you need to think of distributed capability and building your fleet from blocks of assets rather than one Super Duper anything.

So once more the Russians have set the fox among the hens, at least in an intellectual sense. They are always listening and watching the rest of the world and trying to conceive of a ‘system’ that gives them an advantage versus the rest. It’s always a good idea to understand what they are thinking…as in chess and mathematics they are often leaders in the intellectual sphere.

Oh, oh oh, oh oh oh oh, I saw this coming !

Last Cassette Player Standing, in American Conservative
From the article: Photo by: Education Images/Universal Images Group via Getty Images)

Money Quote:

There are several lessons here. The most politically salient is that in manufacturing, as in cooking, it is possible to “lose the recipe.” And with an accelerating pace of technological progress, it is possible to lose it in an alarmingly short span of time. This is perhaps the strongest argument for some form of industrial policy or trade protection: the recognition that the national value of manufacturing often lies not so much in the end product itself, but in the accumulated knowledge that goes into it, and the possibility of old processes and knowledge sparking new innovation. Of course, innovation is itself what killed the high-end cassette player. But many otherwise viable industries have struggled under the free-trade regime.

The fact is that technology is not embodied in a drawing or set of drawings or any set of instructions. It is embodied in human knowledge. One of the key problems in the industry is the loss of control a customer or prime has when they let a contractor develop the ‘data package’ and ‘product’ with no significant oversight. While the customer or prime may ‘own’ the IP because they paid for it, the fact is that the majority of the capability is embodied in the people and culture of the contractor not in any set of information.

The Hellenic world had machines as complex as early clocks and steam engines of a sort but lost the recipe in a few generations or less. Various complex building skills and wooden machines, metalworking and early chemistry were discovered then lost again and again because the data package was in human brains and examples. This is why the printing press and its ilk were so incredibly important to technological lift off. Along with a culture of progress and invention.

We are far ahead of that world but as above, not above losing the recipe of a complex technology. This is one of the drivers behind Computer Aided Design, Analysis, Documentation, Fabrication. Our cybernetic tools have the ability to record the data package in detail at least for certain classes of things so that we should be able to maintain the ability to replicate things. Making special, small run, even one off technological objects rational rather than nutty.

But at the same time I think that it is likely that the artisanal ethos and products will remain relevant and even increase in value as people shift away from a mind/economy/culture of scarcity to at least sufficiency and if we survive and expand into the universe eventually richness. These transitions will be extremely difficult because they are at odds with many tens of thousands of years of genetic/mimetic coding of our behaviors based on small group hunter gatherers and kin group bonding. Those transition will be enabled by machines that fabricate, even machines that invent. What will happen when humans loose the recipe for technological advancement, because too few engage in the complex enterprise of development??? Is that the point of the Rise of the Machine???

Let space bring us together

One of the things that stabilizes a civilization (IMO) is the ability to expand. Like an imaginary pressure vessel with a self replicating gas one can see that at the beginning the gas molecules bouncing around have plenty of space, the ‘pressure’ on the cylinder is negligible and the molecules don’t collide that often. As the molecules become more abundant the pressure and the collisions build. If there is some external source of ‘heat’ say the energy of invention etc, the pressure builds even more and the ‘collisions’ are more violent. Eventually the pressure vessel gives way along fracture lines and explodes releasing the gas into the void….

Carry that image a bit longer, this almost mimics what happened to a lot of the early civilizations. They blew up and dissipated into the wilds leaving almost nothing behind except wreckage.

America (and other civilizational islands let’s call them) had an immense (to them) hinterland. The pressure vessel had something like a sealed bellows (or say a metal balloon) that was stiff, wouldn’t expand easily but could expand. The particles would ‘explore’ this even early on. The cold walls ‘cooled / calmed’ the average energy and allowed the particles to rub along with each other better. As the particles multiply the bellows/balloon expands releasing the pressure on the parent pressure vessel, and providing more wall to absorb energy at the same time.

The human ‘particles’ in our pressure vessel continue to multiply, thankfully, hopefully, at an increasingly slower rate. But the ‘energy’ of invention and desire for ‘happiness’ continues to flow and be amplified by those people/particles. Rearranging the particles…partially solidifying them?…in urban masses lowers the pressure in some ways but does not eliminate it. It provides pseudo new space for the really energetic particles say. But in reality do what we can on this world the pressure will grow too great unless we expand into, we need newSpace.

Even the space (volume) of our solar system is almost infinite from the perspective of the human particles today. And the boundaries of ‘our system’ are only imaginary. The universe is here there and everywhere and there is no reason not to make it ours except fear, mostly fear of ourselves.

We need frontiers, we need places where we can be with ourselves, we need challenge but also calm centers. While the homes we create away from our birthplace will be nothing like what we see today, our descendants will love and hold them just as close to their heart as we hold our home and our memories.