evoilutioncast 45: How to build a solid foundation for AI on VCF?

06.08.2025 ·52 min 59 s

In this episode of the IT podcast - evoilutioncast, Maciej Lelusz speaks with Frank Denneman - a very AI person in VMware by Broadcom. Frank plays a key role in the VCF division, where he shapes the roadmap for the Private AI Foundation in NVIDIA and heavily influences the division’s overall AI strategy.✔️Fancy to know whether the VCF is an infrastructure for AI? ✔️Does that put an AI construct in the DC?✔️The truth is that with AI, nothing is easy, but you can make it easier. ✔️As well as there are things to be approved by humans and things to be made by AI.✔️Listen to the conversation to find out new trends in AI infrastructure as RAG or #vector database and many more. 🤝 Episode's Partner: VMware by Broadcom𝓛𝓲𝓼𝓽 𝓸𝓯 𝓬𝓸𝓷𝓽𝓮𝓷𝓽:00:02:00 AI on VCF (VMware Cloud Foundation) platform: what's all about?00:06:50 vcf9 as a local hypervisor?00:09:10 SaaS solution as a starter on the cloudfoundation platform00:12:27 Platform, both for engineers and developers - what is this VCF platform? 00:20:58 cost spending tracking on private cloud platform00:24:41 Retrieval Augmented Generation (RAG) is the most common use case00:32:15 The most trending solutions on the market: summarizing based on augmented AI in healthcare00:36:30 digestion pipeline of data by building vector database 00:40:03 Similarity search and embedding model: how does it work?00:42:43 What gives the VCF platform to the organization as an open infrastructure model?00:49:24 Next steps on VCF? Wider integration and an easier way of consuming a platform - giving the best way of consuming the resources that you have🔔 Subskrybuj: https://bit.ly/sub_evoilutioncast

Names mentioned, Names mentioned, Names mentioned, You act like a little bit like a local hypervisor, right? Because we have these two sides of the hypervisor responsibility matrix, right? The hypervisor, let's say, it's responsible to the infra and from the infra, till the, let's say, application layer and so on, their customer. Wydaje mi się, że w porządku VCF-9, a generalnie w conceptu VCF, bardzo dobrze pasuje to, że budujesz swoją prywatną eksperię na górze. Jako sprzedawca infrastruktury dajesz pracownikom, którzy konsumują tą infrastrukturę, rigidną platformę.

Wspomnieliśmy o DLVM, w którym zauważyliśmy wersję gpu w hypervisorze, połączyliśmy ją z gpu w VM, a następnie dajemy wersję gpu w virtual machine. It's a very brittle stack, but we already sold that. It's like a safe place to start your journey and then go for a more sophisticated use if you need them. When you look in the market, the standards Wcześniej nie było standardów. Teraz widzimy, że niektóre biblioteki, niektóre środowiska się rozprzestrzeniają.

Pokazano wszystkie 2 dopasowania. Transkrypcja generowana automatycznie i niesprawdzana ręcznie — może zawierać błędy.