VIDEO

Intelligence Unlocked: The Data Foundation Fueling AI Factories

As enterprises build and scale AI factories, data performance becomes the critical factor in turning raw information into intelligence. In this episode, Charlie Boyle from NVIDIA and Nilesh Patel from WEKA explain what an AI factory is, why it must remain flexible for future models, and how high-throughput, low-latency data infrastructure fuels modern AI workloads.

The discussion highlights how scalable, curated data platforms enable faster token generation, support reasoning models and agentic workflows, and help enterprises extract real value from decades of data—based on joint learnings from building AI factories with NVIDIA and WEKA.

Transcript

00:06

Nilesh Patel: Hi everyone. This is Nilesh Patel, chief strategy officer at WEKA. I’m glad to be here with Charlie Boyle, VP of DGX Systems at NVIDIA. Charlie, welcome and thanks for joining.

00:15

Charlie Boyle: Thanks, Nilesh.

00:18

Nilesh: And we are here today discussing some of the key factors that a lot of enterprises have to consider in designing, building and scaling their AI infrastructures and take into account some of the challenges of data infrastructure that are associated with that.

Charlie, give us an introduction to AI factory. Why is it needed and the importance of high throughput, low latency data infrastructure for those AI factories?

00:42

Charlie: So an AI factory is really built to create intelligence, and intelligence is in the form of tokens. And you know, what our customers are looking for is one type of infrastructure that can produce the tokens they need today, but also be ready for the future. You know, new models are coming out, new reasoning models, new data models are coming out every day.

And so they want a factory infrastructure that they can depend on, they can grow, and know that as the new latest AI technology comes out, that the factory they’ve built today is going to work with the models of tomorrow. So really building that flexible, adaptable AI factory is, you know, super core to to our customers today.

01:24

Nilesh: That’s great. And I guess AI factories are generating tokens as an output. But the data is the fuel to those AI factories. What’s your experience – and in terms of importance of scalable, high performance data infrastructure, like WEKA’s, for some of those AI factories and those deployments.

01:44

Charlie: Yeah. And you hit it exactly right. You know, data is the fuel for the AI factory. It’s the input. It’s the raw materials. And that’s what really enterprise customers are looking for today is they’re sitting on, you know, decades worth of enterprise data. They know from everything they’ve heard in the media that they can extract value out of that.

But turning that enterprise data they have into intelligence, into tokens, you know, really requires a robust AI infrastructure to do that. But the data infrastructure behind it is so important because your model is only as smart as the data that you put in it. So you don’t just want to give your model everything in your enterprise, because there may be useful things, there’s probably things that aren’t useful.

And so curating the data. Having a data platform that can intelligently figure out what a customer needs to put in their model to get the best output. To get the most valuable tokens out of it is super important.

02:43

Nilesh: That’s a great point, and I believe that’s where WEKA comes into play with WEKA’s NeuralMesh. We’ve been able to deliver, you know, sub millisecond latencies, tens of terabytes per second throughput and amazing scale across hundreds of storage nodes and so on. And that’s helping customers achieve their outcome, particularly when they’re, as you pointed out in the more modern AI infrastructure with energetic workflows, you need a rag of the scale that is not previously thought about – reasoning models, multi-modal environment are really driving the data patterns. That is extremely demanding, and being able to have that deployed at scale is where I think NeuralMesh is delivering tremendous value to the customers in terms of getting their AI outcome faster.

Thank you so much for your time today.

03:32

Charlie: Yep. Thanks for this and thanks for the great partnership.

03:36

Nilesh: If you’re expanding your AI factories or building new ones, come see how NVIDIA and work are building AI factories together and let us share our learning with you.

Related Resources