evoilutioncast 45: How to build a solid foundation for AI on VCF?
In this episode of the IT podcast - evoilutioncast, Maciej Lelusz speaks with Frank Denneman - a very AI person in VMware by Broadcom. Frank plays a key role in the VCF division, where he shapes the roadmap for the Private AI Foundation in NVIDIA and heavily influences the division’s overall AI strategy.✔️Fancy to know whether the VCF is an infrastructure for AI? ✔️Does that put an AI construct in the DC?✔️The truth is that with AI, nothing is easy, but you can make it easier. ✔️As well as there are things to be approved by humans and things to be made by AI.✔️Listen to the conversation to find out new trends in AI infrastructure as RAG or #vector database and many more. 🤝 Episode's Partner: VMware by Broadcom𝓛𝓲𝓼𝓽 𝓸𝓯 𝓬𝓸𝓷𝓽𝓮𝓷𝓽:00:02:00 AI on VCF (VMware Cloud Foundation) platform: what's all about?00:06:50 vcf9 as a local hypervisor?00:09:10 SaaS solution as a starter on the cloudfoundation platform00:12:27 Platform, both for engineers and developers - what is this VCF platform? 00:20:58 cost spending tracking on private cloud platform00:24:41 Retrieval Augmented Generation (RAG) is the most common use case00:32:15 The most trending solutions on the market: summarizing based on augmented AI in healthcare00:36:30 digestion pipeline of data by building vector database 00:40:03 Similarity search and embedding model: how does it work?00:42:43 What gives the VCF platform to the organization as an open infrastructure model?00:49:24 Next steps on VCF? Wider integration and an easier way of consuming a platform - giving the best way of consuming the resources that you have🔔 Subskrybuj: https://bit.ly/sub_evoilutioncast
Przede wszystkim, Frank, miło Cię tutaj poznać. Kiedyś w Polsce? Dwa, trzy lata temu? Myślę, że tak. Było to nawet przed COVID-19m. Było to przed COVID-19m. Tak, bo po tym, że Demkan przyjeżdżał do VMAX... Wszystko jest blurowane. Tak, zdecydowanie. Dzień dobry wszystkim. To jest evolutioncast. Nazywam się Maciej Lelusz. Dzisiaj z nami jest Frank Denneman. Siedzę dzisiaj w jego brzuchu. Jak długo siedziałeś w VMware i w Broadcom? W totalności ponad 12 lat, ale miałem krótki stint z start-upem w ekosystemie VMware. Było to 4-3 lata na start-upie.
Back to VMware and now I'm in my eighth year, actually hitting nine in October or something like that. Cool. Twelve years. So you see that, you see the all of ACES, the products, the going out products, the Broadcom acquisition, everything there. I think I saw every CEO except Diane. Ale z powodu tego faktu, że pracowałem w społeczeństwie od 2005 roku, w zasadzie instalując ESXi i idąc od tamtej pory, więc przyjechałem do... mój pierwszy WM World był w 2006 roku, tak, i przyjechałem do TSX w Europie, więc widziałem wszystkich CEO'ów do tej pory, tak. To dobrze, to dobrze, dobry background.
So we build, before we basically go into the use cases, we build a platform that looks at what do you need. Names mentioned in English. Names mentioned, Maciej Lelusz, Frank Denneman, VMware, Broadcom, NVIDIA. Names mentioned, Maciej Lelusz, Frank Denneman, VMware, Broadcom, NVIDIA.
Więc zamiast mówić, o, tutaj jest platforma, Now you basically have to find out everything yourself. We said no. We're going to help you along the way. We're not going to build everything because we have a very strong ecosystem with a lot of partners, but we will give you enough functionality to make your first steps. In essence, what we do with Private AI Foundation is we focus on Names mentioned, Maciej Lelusz, Frank Denneman, VMware, Broadcom
Ludzie bardziej często wybierają, powiedzmy, TensorFlow czy coś takiego. Widzimy, że to coraz bardziej popularne. Wybrałeś to, żeby zbudować platformę dla inżynierów, dla deweloperów, prawda? Tak. Co ta platforma robi? Myślę, że to jest dobre. Przechodzimy do tego zakresu użycia, ponieważ powiedziałeś, że jest to bezpieczne miejsce. Teraz weźmy zakres użycia tego DLVM, czy AI Cage Cluster. Zazwyczaj, co się dzieje, jeśli spojrzymy na Names mentioned, Maciej Lelusz, Frank Denneman, VMware, Broadcom, NVIDIA.
Names mentioned, Maciej Lelusz, Frank Denneman, VMware, Broadcom, NVIDIA. You can download LAMA, the one from Meta, the foundation model from Meta. That means that you have a large language model that's already pre-trained with a lot of knowledge, with a lot of data. Or you can use Mistrals or Mixtrals, one of the European models. Or you can go to China and you can take a look at DeepSeq or whatever. The interesting thing is...
I need to make sure that that's the case, but we are thinking about, okay, can we somehow... Names mentioned, Maciej Lelusz, Frank Denneman, VMware, Broadcom, NVIDIA. Names mentioned, Maciej Lelusz, Frank Denneman, VMware, Broadcom, NVIDIA. Names mentioned, Maciej Lelusz, Frank Denneman, VMware, Broadcom, NVIDIA
Tak, pacjent pyta pytania z wypowiedzi i przetestuje tę rozmowę. Od razu wypełnia wypowiedzię, więc po rozmowie pacjent tylko musi sprawdzić, czy to jest dokładne, a następnie podpisać to do systemu. To zmniejszy tak duży rozmiar pracy. Names mentioned, Maciej Lelusz, Frank Denneman, VMware, Broadcom,
So it's a faster way, it's an efficient way of doing your job. Names mentioned, Names mentioned, Names mentioned, Names mentioned, Maciej Lelusz, Frank Denneman, VMware, Broadcom, NVIDIA. Names mentioned, Maciej Lelusz, Frank Denneman, VMware, Broadcom, NVIDIA.
Są organizacjami, które pracują z AI od początku. Może budują ich modeli, bo są świadomi, że nie są tak wielkie, ale używają czegoś, co jest tam i używają to w bardzo profesjonalny sposób. Mogą zwiększyć możliwość prywatnej AI z NVIDIA, z Broadcom. Names mentioned, Names mentioned, Names mentioned,
However, that's such a corner case that we typically don't see as a true value for our platform. To give you an example, if you want to build a very, very, very large Names mentioned, Maciej Lelusz, Frank Denneman, VMware, Broadcom, They are using two different networks to figure out what's fastest, but for that scenario, we don't say, look, build that on VCF.
Wiele razy z naszymi klienciami słyszymy, że zbudujmy model i mówią, że kochani, kochani, kochani, kochani, kochani, kochani, kochani, kochani, kochani, kochani, kochani, kochani, kochani, kochani, kochani, Nie zapomnijcie zasubskrybować kanał i zafollowować mnie na Facebooku! You are focusing VMware in Broadcom on the infrastructure for AI. Because if you will start to be focused on the use cases, you know, like the specific things, you stop to be infrastructure company and you start to be some crazy startups, ecosystem solving everybody's problem, right?
And I don't believe that it's a... Good place to be. It's more like you enable the platform and maybe in the future some marketplace to buy fast kind of solution on AI. It means this model GUI and stuff like that to run on private AI with NVIDIA from Broadcom plus Tanzu platform, right? Because basically this is it. They deliver that in VMs or containers and they use packed models with some tuning, right? Nie jest to nawet bardzo dużo, szczerze mówiąc. Dla wielu usług, po prostu weźcie swoje dane, nie jest ich tak dużo zmienione. Chodźcie, jeśli jesteście lofem, ile razy otworzyliście nowe usługi. Może trzy razy, cztery razy. Nie jest to trzy tysiące razy.
Pokazano wszystkie 13 dopasowań. Transkrypcja generowana automatycznie i niesprawdzana ręcznie — może zawierać błędy.
Kliknij, aby znaleźć fragmenty, w których pada.
In this episode of the IT podcast - evoilutioncast, Maciej Lelusz speaks with Frank Denneman - a very AI person in VMware by Broadcom. Frank plays a key role in the VCF division, where he shapes the roadmap for the Private AI Foundation in NVIDIA and heavily influences the division’s overall AI strategy.
✔️Fancy to know whether the VCF is an infrastructure for AI?
✔️Does that put an AI construct in the DC?
✔️The truth is that with AI, nothing is easy, but you can make it easier.
✔️As well as there are things to be approved by humans and things to be made by AI.
✔️Listen to the conversation to find out new trends in AI infrastructure as RAG or #vector database and many more.
🤝 Episode's Partner: VMware by Broadcom
𝓛𝓲𝓼𝓽 𝓸𝓯 𝓬𝓸𝓷𝓽𝓮𝓷𝓽:
AI on VCF (VMware Cloud Foundation) platform: what's all about?
vcf9 as a local hypervisor?
SaaS solution as a starter on the cloudfoundation platform
Platform, both for engineers and developers - what is this VCF platform?
cost spending tracking on private cloud platform
Retrieval Augmented Generation (RAG) is the most common use case
The most trending solutions on the market: summarizing based on augmented AI in healthcare
digestion pipeline of data by building vector database
Similarity search and embedding model: how does it work?
What gives the VCF platform to the organization as an open infrastructure model?
Next steps on VCF? Wider integration and an easier way of consuming a platform - giving the best way of consuming the resources that you have
🔔 Subskrybuj: https://bit.ly/sub_evoilutioncast