Systems Thinking

Practical insights on solutions architecture, technology strategy, and business growth.

Tag: AI

  • A Solutions Architecture Approach to Getting Them Under Control

    If you’ve started using AI tools in your business — anything from an LLM API embedded in your product to a handful of AI assistants across your team — there’s a good chance the bill has started climbing faster than anyone expected. It’s becoming one of the most common conversations we’re having with tech-focused SMBs right now: AI spend crept up gradually, nobody quite knows why, and the instinct is to assume you just need to “use it less” — which, much like cloud spend a few years ago, usually isn’t the real answer.

    AI cost problems are rarely about usage being inherently too high. They’re almost always about adoption that happened faster than the architecture around it — because early on, when it was one team experimenting with one tool, it didn’t need a plan. The good news is that this is a genuinely fixable problem, provided you’re solving the right one.

    AI spend has a few characteristics that make it spiral even quicker than the cloud cost creep many businesses have already been through:

    • Per-call pricing with no natural ceiling. 
      • Unlike a fixed server bill, AI API costs scale directly with usage — every request, every token, every generation adds up in real time, often with nobody watching the meter.
    • Model choice matters enormously, and defaults are usually the most expensive option. 
      • It’s common to see a task running on a large, expensive model when a smaller, cheaper one would do the job just as well — because nobody revisited the choice once it was working.
    • Sprawl across tools and teams. 
      • AI capability shows up in a chatbot subscription, an embedded feature in your CRM, a coding assistant, an API integration — each billed separately, each decided on its own, with no one holding the full picture.
    • Experimentation that never gets reviewed. 
      • A proof of concept that worked gets left running in production. Nobody circles back to check whether it’s still needed, or whether it was ever optimised for cost.
    • Redundant calls and poor caching. 
      • The same prompt, or something close to it, gets sent to the model repeatedly because there’s no caching or deduplication layer — paying full price for an answer you already had.

    None of this is exotic, and none of it is a sign of anyone doing something wrong. It’s the predictable result of a genuinely useful technology being adopted quickly, by teams focused — rightly — on what it can do, not yet on what it costs to run at scale.

    The instinctive response to a high AI bill is to restrict usage — cut licences, limit API calls, tell the team to be more careful. That can help at the margins, but it treats the symptom, not the cause, and it risks throttling the exact capability that made the tool worth adopting in the first place.

    A Solutions Architecture approach starts from a different question: not “how do we use this less?” but “does how we’re using this actually match the value it’s creating?” That reframing tends to surface bigger, more durable savings than simply asking people to be more frugal.

    In our experience, the biggest and most durable wins tend to fall into a small number of categories:

    • Right-sizing the model to the task. 
      • Not every task needs the largest, most capable model available. Matching model choice to actual task complexity — using a smaller, cheaper model where it performs just as well — is often the single biggest lever available, and one of the easiest to overlook.
    • Caching and deduplication. 
      • Where the same or similar requests are being made repeatedly, caching results rather than regenerating them can cut costs substantially, particularly for high-volume, low-variability use cases.
    • Prompt and workflow efficiency. 
      • Poorly structured prompts, unnecessary context, or overly chatty multi-step workflows all add cost without adding value. Tightening these up is usually low-risk and high-impact.
    • Consolidating tools and licences. 
      • AI capability adopted piecemeal across different teams often duplicates itself — several tools solving overlapping problems, billed separately. Consolidating onto fewer, well-chosen tools reduces both cost and the operational overhead of managing them.
    • Visibility and ownership. 
      • Just as with cloud spend, you can’t optimise what you can’t see. Attributing AI spend to the team, product, or feature responsible — rather than watching one combined bill arrive each month — makes it possible to prioritise fixes and hold usage accountable.

    The other trap is treating AI cost control as a one-off clean-up: review the spend, fix what’s obviously wasteful, move on. That helps once. Then the same sprawl starts again, because the underlying pattern — fast, ungoverned adoption — is usually still there, and new AI tools keep arriving.

    The more durable fix is building cost and architecture thinking into how AI gets adopted going forward, so “what will this cost at scale, and does it need to run on the most expensive model available?” is part of the decision from the start, not a question asked eight months later when the invoice has become impossible to ignore.

    For a tech-focused SMB, AI spend isn’t a novelty line item anymore — it’s rapidly becoming a real input into margins, alongside infrastructure and headcount. Getting the architecture right doesn’t just reduce cost; it usually improves reliability and performance too, because the same discipline that controls spend — matching the right tool to the right task, avoiding redundant work — tends to produce a better-built system regardless.

    Getting a proper architectural view of your AI usage, before deciding what to cut or restrict, tends to save more money, preserve more of the value the tools were adopted for, and cause far less disruption than reaching for the off switch.


    Ashdown Systems helps UK tech-focused startups and SMBs get their AI adoption — and their AI bills — under control. If any of this sounds familiar, get in touch.

  • Every business, at this point, is being pitched AI. New tools launch weekly, existing software adds an “AI-powered” feature to its marketing, and it’s genuinely hard to tell which of it is worth your attention and which is noise. For a lot of SMBs, the result is a kind of stuck feeling: aware that AI probably matters, unsure what to actually do about it, and wary of either falling behind or wasting money chasing hype.

    The good news is that deciding what’s worth adopting doesn’t actually require becoming an AI expert. It requires treating it like any other architecture decision — because that’s exactly what it is.

    Most technology adoption decisions have a fairly clear shape: there’s a specific problem, a shortlist of tools that solve it, and a reasonably stable set of options to compare. AI adoption right now doesn’t have that shape:

    • The pace of change makes “best in class” a moving target. 
      • A tool that’s clearly leading today may be matched or overtaken within months, which makes normal due diligence feel less reliable.
    • The marketing is louder than the substance. 
      • “AI-powered” gets attached to features that are genuinely useful and features that are barely more than a chatbot bolted onto an existing product, and it’s not always obvious which is which from the outside.
    • The fear of missing out is doing a lot of the decision-making. 
      • A real, if often quiet, anxiety that competitors are pulling ahead pushes businesses toward adopting tools quickly, without the normal scrutiny they’d apply to any other significant purchase.
    • It touches everything at once. 
      • Unlike a single-purpose tool, AI capability can plausibly show up in customer service, marketing, operations, and product all at the same time — which makes it hard to know where to even start evaluating.

    None of this means AI adoption should be treated differently from other technology decisions. If anything, it means the normal discipline matters more, not less, precisely because the noise is louder.

    Strip away the hype, and the evaluation question is the same one that applies to any tool: 

    That second half matters more than it sounds. Plenty of AI tools are solving real problems. Some are solving problems that a simpler, non-AI tool would handle just as well, at lower cost and lower risk. Adopting AI because it’s AI, rather than because it’s the best available solution to a specific problem, is how a lot of wasted spend and abandoned pilots happen.

    When a new AI tool crosses your desk — whether someone on your team is pushing for it or a vendor is pitching it — a few questions consistently separate the genuinely useful adoptions from the ones that fizzle out:

    • What specific, recurring problem does this solve? 
      • Not “it could help with X” in the abstract, but a concrete, repeated task that’s currently slow, expensive, or error-prone. Vague potential is a warning sign; a specific bottleneck is a good one.
    • What does it actually integrate with? 
      • A tool that sits disconnected from your existing systems creates exactly the kind of data silo and manual-reconciliation problem that costs businesses time elsewhere. Integration quality often matters more than the AI capability itself.
    • What’s the real cost at the volume you’d actually use it? 
      • AI tools are frequently priced per-use in ways that scale unpredictably. Understand what the cost looks like at realistic volume, not just the entry-level price you saw in the demo.
    • What happens if it’s wrong? 
      • Every AI tool makes mistakes some percentage of the time. The right question isn’t whether it’s ever wrong, but what the consequence is when it is — and whether there’s a sensible human check in place for anything high-stakes.
    • Who owns it, and who reviews whether it’s still worth it? 
      • A pilot that nobody’s responsible for tends to either quietly become permanent infrastructure with no oversight, or quietly get abandoned without anyone noticing. Both outcomes are avoidable with clear ownership from day one.
    • Does this reduce complexity, or add to it? 
      • A genuinely good AI adoption should make some part of the business simpler to run. If it’s adding another disconnected tool, another login, another system nobody fully understands, that’s a cost worth weighing seriously against the benefit.

    The pressure to “do something with AI” is real, but it’s not a substitute for evaluating a specific tool against a specific problem. Adopting quickly and adopting well aren’t the same thing, and the businesses getting genuine value from AI right now are mostly the ones applying ordinary due diligence, not the ones adopting the most tools the fastest.

    Treated properly, an AI tool is just another architectural decision: does it solve a real problem, does it fit with what you already have, and does the cost and risk make sense at your actual scale. Getting that evaluation right, tool by tool, tends to produce a lot more value than trying to have an overarching “AI strategy” before you’ve adopted anything at all.


    Ashdown Systems helps UK startups and SMBs cut through the noise and evaluate AI tools against real business problems — not hype. If any of this sounds familiar, get in touch.