Disaggregated and Software-Defined Architecture: A Deeper Dive with Lightbits Labs

Release date: 29 November 2023

In recent years, the terms “disaggregation” and “software-defined” have gained significant traction in financial services, particularly within the realms of storage and computer networking. In essence, disaggregation refers to the separation of software and hardware layers, rendering them independent of one another. Software-defined architecture, on the other hand, represents a novel category of products where software takes centre stage, providing solutions rather than relying primarily on hardware. Both concepts offer a wide array of advantages, effectively surpassing the constraints of legacy monolithic architectures.

To gain a comprehensive understanding of disaggregation and software-defined architecture, let’s backtrack and examine the origins of various computer infrastructure components. Consider the ubiquitous server as an example—one that is likely familiar to us all. Today, we take for granted the ability to purchase a server equipped with a general-purpose CPU (be it x86, ARM or RISC) from various hardware vendors, allowing us to install and utilise a diverse selection of operating systems.

However, this was not always the case. In its nascent stages, it was customary to procure servers from vendors providing closed, tightly integrated packages comprising proprietary hardware (often featuring in-house designed CPUs) running proprietary operating systems. Component interchangeability was virtually non-existent, as there was no compatibility between hardware and software offerings from different vendors. The freedom to choose an operating system or upgrade server components, such as RAM modules from a different manufacturer, was simply not an option. What transpired in the server market over the years is precisely what we now define as disaggregation.

Before reaching the era of software-defined product architecture, hardware, particularly in the form of multiple specialised chips designed to perform specific tasks (commonly referred to as ASICs—Application-Specific Integrated Circuits), was the cornerstone of any infrastructure element. This design choice was driven by a simple rationale: the processing power offered by general-purpose CPUs was insufficient for the tasks demanded by specific appliances. For instance, if a storage vendor aimed to incorporate inline compression into its product, a dedicated ASIC, capable of high-speed data encryption was integrated into the design. Whether it was data deduplication or rapid data reconstruction following a disk failure, additional dedicated chips were a necessity to expedite these processes.

Fortunately, with the relentless march of Moore’s Law, which saw the capabilities and performance of general-purpose CPUs continually expand, the need for dedicated chips to deliver product features dwindled. Modern CPUs now boast built-in encryption engines and possess the capability to process gigabytes of data per second, all while utilising a single of its many cores aided by many new dedicated instruction sets. These examples represent only a fraction of the transformations that have occurred, but they highlight the broader shift toward harnessing the processing prowess of contemporary CPUs to encompass the features found in advanced storage systems.

Now, armed with a comprehensive understanding of how disaggregation and software-defined architectures evolved, we can illuminate the benefits they offer.

Lightbits epitomises a fully disaggregated and software-defined block storage solution, capitalising on the advantages of both these cutting-edge technologies. By dismantling the constraints of proprietary hardware entanglement, users gain the flexibility to deploy the solution across an array of commodity servers, effectively reducing the total cost of ownership (TCO). It enhances component availability, allowing users to source components from a variety of vendors—a particularly valuable attribute in supply-constrained markets. Furthermore, it empowers storage users by providing a wide spectrum of hardware choices, putting them in the driver’s seat during price negotiations. Software-defined storage also boasts the advantage of expedited feature delivery and improvements, unshackled from the limitations of underlying specialised hardware.

As we conclude this first blog, we can see how disaggregation and software-defined architecture have emerged as transformative forces in the realm of computer infrastructure. The separation of software and hardware layers, combined with the dominance of software in driving solutions, has ushered in a new era of flexibility, cost-efficiency, and rapid innovation. Lightbits serves as a testament to the potential unlocked by these technologies, offering users unprecedented control and adaptability in the ever-evolving landscape of storage solutions.

Look out for the series of our Lightbits blogs in the coming weeks.

—

To discuss your specific financial trading infrastructure needs, call us on +44 (0) 161 947 4321 or email info@vespertec.com to set up a meeting.