Sign Up to Our Newsletter

Be the first to know the latest updates

Saturday, 28 June 2025
AI & Robotics

The new AI infrastructure reality: Bring compute to data, not data to compute

The new AI infrastructure reality: Bring compute to data, not data to compute

For nearly two decades, join a reliable event by Enterprise leaders. The VB transform brings people together with real venture AI strategy together. learn more


Since AI changes enterprise operations in diverse industries, important challenges remain on the surface around data storage – no matter how advanced the model is, its performance reaches the ability to access large amounts of data quickly, safely and firmly. The correct data can be brought into crawls by slow, fragmented or disabled data pipelines, even the most powerful AI system, without storage infrastructure.

This subject took the center stage in a day VB conversionOne session focused on medical imaging AI innovations Peak: AO And SolidTogether together Medical Open Network for AI (Menai) Project- An open-source framework-way to develop and deploy medical imaging AIs is re-defined how data infrastructure supports real-time estimates and training in hospitals, in which diagnostics increase to increase matters of advanced research and operational use.

,See all our transforms 2025 coverage,

Innovation storage on the edge of clinical AI

Partner managing partner run by Michael Stewart M12 (Microsoft’s Venture Fund) In the session, Roger Coming, Peak CEO: AIO, and Greg Matsson, Solidigam showed insight by the head of products and marketing in Solidigam. The conversation discovered that the next generation, high -capacity storage architecture is opening new doors to medical AI by providing the speed, safety and scalability required to handle a dataset in the clinical environment.

In severe, both companies have been deeply associated with the monsi since their early days. Developed in collaboration with King’s College London and others, Menai is aimed at developing and deploying the AI ​​model in medical imaging. Open-source framework toolset-is titled for unique demands of healthcare-which includes library and tools for DICOM support, 3D image processing, and model pre-training, which are able to make researchers and physicians capable of making higher models for functions such as tumor segmentation and organs classifications.

An important design of the monoti was to support the target on-romance sinsonogen, taking advantage of the standard GPU servers for training and estimating to maintain full control over sensitive patient data. This connects the performance of the framework closely to the data infrastructure below it, requiring a sharp, scalable storage system to fully support the demands of the real -time clinical AI. This is the place where Solidigm and Peak: AIOs come in the game: Solidigm brings high-gradation flash storage to the table, while Peak: Peak: AIO is an expert in manufacturing storage system for AI workload.

“We were very lucky that the King’s College in London and Professor Sebastian Orslund were working early to develop Monai,” the Kamings explained. “Working with Orslund, we developed the underlying infrastructure that allows researchers, doctors and biologists in life science to construct very quickly on top of this structure.”

Calling dual storage demands in Healthcare AI

Mattson reported that he is seeing a clear bilateral in storage hardware with various solutions adapted to the specific stages of the AI ​​data pipeline. To use cases such as monkeys, similar edges AI deployment as well as feeding clusters of training clusters play an important role, as these atmosphere is often required for space and strength, yet the environment requires local access to the dataset.

For example, the Menai was able to store over two million full-body CT scans on a node within the existing IT infrastructure of the hospital. “Very space-wise, power-wide, and very high-capacity storage enabled some notable results,” said Mattson. Such efficiency is a game-changer for Edge AI in healthcare, allowing institutions to run advanced AI models without compromising performance, scalability or data security.

Conversely, the workload includes real -time estimates and active model training, which are very different demands on the system. These functions require storage solutions that can provide exceptionally high input/output operations per second (IOPS) to keep with the data through high-bandwidth memory (HBM) and ensure that GPU is fully used. Peak: The AIO’s software-defined storage layer, combined with the high-performance solid-state drive (SSD) of the solidigom, addresses both ends of this spectrum, requiring the required capacity, efficiency and speed in the Pipeline.

A software-defined layer for clinical AI workload on the edge

Coming reports that Peak: AIO’s software-defined AI storage technology, when paired with high-performance SSD of solidigom, enables the monkey to read, write and collect the dataset on a large scale on speed clinical AI demands. This combination model accelerates training and increases accuracy in health imaging, while healthcare works within an open-source framework to suit the environment.

“We provide a software-defined layer that can be deployed on any commodity server, converting it into a high-demonstration system for AI or HPC workload,” said the Coming. “In the edge environment, we take the same capacity and score it under a single node, where the data remains, it approaches closer.”

An important ability is how the summit: AIO AI directly helps to eliminate traditional memory bottlenecks by integrating memory in AI infrastructure. Coming said, “We consider memory as part of the infrastructure – something that often ignores. Our solution not only storage, but also the memory workspace and the metadata associated with it.” This creates a significant difference for customers who cannot tolerate either in terms of space or cost-to re-run the big model again and again. By keeping the memory-dwellers alive and accessible, the peak: AIO enables efficient, localized estimates without the need for continuous recreation.

Bringing intelligence close to data

Coming insisted that enterprises would need to take more strategic approaches for managing AI workload. “You can’t just be a destination. You have to understand the workload. We do some incredible techniques with solidine and their infrastructure, to be smart on how to get the data processed, how to get a performance from a single node,” Coming explained. “So with such a big push, we are seeing that the generalist is getting more specific. And now we are working that we have done from a single node and pushing it to be more efficient to the data. We want more intelligent data, okay? The only way to do that is to get closer to that data.”

Some clear trends are emerging from large -scale AI deployment, especially in newly created greenfield data centers. These features are designed with highly specific hardware architecture that bring data closer to the GPU. To achieve this, they all rely much on solid-state storage-especially ultra-hai-capacity SSD-designed to give petabite-scal storage with the required speed and access to continuously feed with data on high throopoots.

“Now the same technique is basically being in a subtle world, on the edge, in the enterprise,” the Coming explained. “So it is important to the buyers of the AI ​​system how to choose your hardware and system vendor, even to ensure that if you want to get the most performance from your system, that you are all running on solid-state.


Source link

Anuragbagde69@gmail.com

About Author

Leave a Reply

Your email address will not be published. Required fields are marked *

Stay updated with the latest trending news, insights, and top stories. Get the breaking news and in-depth coverage from around the world!

Get Latest Updates and big deals

    Our expertise, as well as our passion for web design, sets us apart from other agencies.