The term "central processing unit" (CPU) has been around since the 1950s. At the heart of every computer or smart device sits the CPU, tirelessly executing traditional applications. Then, the graphical processing unit (GPU) was introduced in the '90s — originally created for the special task of accelerating on-screen computer graphics for engineering workstations, video processing, and gaming to keep up with the extremely demanding expectations of the human visual system. We owe our survival to our ability to be immediately alert to the slightest movement or visual anomaly — and that has always presented a severe challenge to cinema, television, or computer screen design. Whereas CPUs are designed to process a linear stream of data, GPUs are designed to process a multidimensional experience with space, color, and time. In theory, CPUs could handle this, but, in practice, it would be far too slow and imprecise. The fascinating thing about GPUs is that this multidimensional processing skill turns out to be much closer to the requirements of machine learning and big data processing. Something originally created to make computer games more vivid has become a vital part of digital transformation. And, now, it’s time to introduce data processing units (DPUs). Sure, CPUs and GPUs already process data, but DPUs do it differently, managing the way data moves through the data center. And, yes, every DPU has its own CPU.

Consider a high-level international diplomatic conference. In the interests of total accountability and accuracy, one might insist that every speaker’s words be transcribed in their native language and passed to every other participant, who then has the job of translating those exact words into their own language. But, it doesn’t work like that. Instead, we use interpreters. And while translators have time to study dictionaries, interpreters do their jobs on the fly. Experienced interpreters do not simply provide accurate translations; the job requires other skills. First, there must be an understanding of national protocols. An Australian speaker might use the word “mate” as a friendly gesture, but interpreters know there will be less diplomatic friction if mate is replaced by “your esteemed highness" to the attending audience. Then, there is the understanding that phrases familiar in one culture might need explanation for others. There’s also a need to accelerate communication by editing out “ums” and “ers,” dramatic pauses, and rambling personal anecdotes. There can even be some subtle encryption — for example, “our European competitors” might be encoded as “our European allies.” Finally, in the interests of peace and global security, some utterances might simply be best forgotten. Instead of lumbering every delegate with the task of analyzing pages of transcript, a team of skillful interpreters can make sure the essential messages are conveyed in the most economical form to those who need to know while keeping a check on malicious messages. The delegates, spared a load of translating and protocol headaches, can concentrate more on high-level diplomacy. In traditional data centers, networks are no more than a web of cables linked by switches to deliver data to and from the CPUs, where all of the processing takes place. In modern data centers, networks are connected through DPUs that process the data on the fly to reduce the load on the CPUs and free them up for their intended application processing. They play a role not unlike a team of very professional interpreters. So, what is in the DPU?