My KubeCon Europe and AI Day sessions are available on YouTube! You can find the links here: github.com/terrytangyua... #KubeCon #CloudNativeCon #CloudNative #Kubernetes #DevOps #MLOps #AI #K8s @kubernetes.io #KServe #Kubeflow @cncf.io

RE: https://bsky.app/profile/did:plc:wb4chyxecnojex7l6vyha2xf/post/3ljlw3hmafs2y

public-talks/talks/kubecon-eur...

Excited to share that I am speaking at KubeCon Europe in London next month! Looking forward to catching up with friends and collaborators! You can find me at the following sessions 🧵 #KubeCon #CloudNativeCon #CloudNative #Kubernetes #DevOps #MLOps #AI #K8s @kubernetes.io #KServe #Kubeflow @cncf.io

Achieve better large language model inference with fewer GPUs

"we achieved approximately 55-65% of the throughput on a server config that is approximately 15% of the cost"

https://www.redhat.com/en/blog/achieve-better-large-language-model-inference-fewer-gpus

#OpenShiftAI #RedHat #OpenShift #AI #Kubernetes #vllm #kubeflow #kserve

Get ready for KubeCon next week! Below are the three talks I'll be presenting! See you there and let's catch up! #KubeCon #CloudNativeCon #CloudNative #Kubernetes #DevOps #MLOps #AI #K8s @CloudNativeFdn @kubernetesio @kubeflow #KServe

🎄 Happy Holidays! KServe v0.12 release candidate is available! Try it out! https://github.com/kserve/kserve/releases/tag/v0.12.0-rc0 #KServe #kubernetes #MLOps #DevOps #CloudNative #Kubeflow #ModelServing #AI #MachineLearning @KnativeProject @LFAIDataFdn @CloudNativeFdn

Release v0.12.0-rc0 · kserve/k...

🎄 Happy Holidays! KServe v0.12 release candidate is available! Try it out! https://github.com/kserve/kserve/releases/tag/v0.12.0-rc0 #KServe #kubernetes #MLOps #DevOps #CloudNative #Kubeflow #ModelServing #AI #MachineLearning @KnativeProject @CloudNativeFdn

Release v0.12.0-rc0 · kserve/k...

An interesting talk here at #KubeCon by @terrytangyuan from #RedHat and Adam Tetelman from #NVIDIA on the many pitfalls of using LLMs in production.

#KServe and #Knative come to the rescue of many Day 2 problems, but there's still a lot to do.

And, as Adam Teleman said so well, this year's KubeCon could easily be called RAGCon, given how many talks there are about #RAG 😀

#KubeCon24 #AI #LLM

Get ready for KubeCon next week! Below are the three talks I'll be presenting! See you there! https://github.com/terrytangyuan/public-talks

- Cloud Native AI Day Keynote: Advancing Cloud Native AI Innovation Through Open Collaboration, sponsored by Red Hat

- Unlocking Potential of Large Models in Production with Adam Tetelman

- WG Serving: Accelerating AI/ML Inference Workloads on Kubernetes with Eduardo Arango

#KubeCon #CloudNativeCon #CloudNative #Kubernetes #DevOps #MLOps #AI #K8s #KServe #Kubeflow

Get ready for KubeCon next week! Below are the three talks I'll be presenting! See you there and let's catch up! #KubeCon #CloudNativeCon #CloudNative #Kubernetes #DevOps #MLOps #AI #K8s @kubernetes.io #KServe #Kubeflow

AI/ML Innovation in the Kubernetes Ecosystem

https://dzone.com/articles/ai-ml-innovation-in-the-kubernetes-ecosystem

#Kubernetes #OpenShift #AI #OpenShiftAI #RedHat #Kubeflow #Kserve #PyTorch #Ray #Feast #Jupyter

Say Serve to LLM on OpenShift AI- OpenShift’s Multi-GPU Marvel with KServe | by faisal shah https://medium.com/@fassha08/say-serve-to-llm-on-openshift-ai-openshifts-multi-gpu-marvel-with-kserve-2ab2ed393c63
#OpenShift #aiml #llm #genai #kserve