Apple comes with a groundbreaking hardware innovation that targets demanding professionals, data scientists, and developers working with advanced artificial intelligence. New Mac Studio can be interconnected into high-performance computing clusters. This connection uses the latest Thunderbolt 5 interface in combination with RDMA (Remote Direct Memory Access) technology, which allows direct remote access to the operating memory without unnecessary load on the operating system.
You might be interested in
Shared memory for the largest language models
The main benefit of this network solution is the creation of one giant shared memory pool. Conventional local devices often encounter hardware limits precisely due to the lack of RAM, which is absolutely crucial for the operation of modern large language models. Thanks to RDMA technology, the memory capacities of individual connected machines are effectively combined into a single unit. This opens the door for developers to locally run and test the largest, most demanding and most modern open-weight AI models of today, which would simply not fit on a separate computer.
Gallery
Threefold speed increase in practice
According to official data Applu this solution brings a dramatic increase in computing power. If the user connects four units into one functional cluster Mac Studio, the assembly achieves up to three times faster AI inference compared to performing the same task on a single standalone machine. From macu Studio becomes an extremely efficient and scalable alternative to expensive server setups, bringing top performance for training and running AI directly to your desktop.
