{"id":31879,"date":"2023-03-21T10:00:00","date_gmt":"2023-03-21T17:00:00","guid":{"rendered":"https:\/\/insidebigdata.com\/?p=31879"},"modified":"2023-03-17T10:39:56","modified_gmt":"2023-03-17T17:39:56","slug":"milvus-2-3-massively-accelerates-ai-powered-applications-with-nvidia-gpu-support","status":"publish","type":"post","link":"https:\/\/insidebigdata.com\/2023\/03\/21\/milvus-2-3-massively-accelerates-ai-powered-applications-with-nvidia-gpu-support\/","title":{"rendered":"Milvus 2.3 Massively Accelerates AI-Powered Applications With NVIDIA GPU Support\u00a0"},"content":{"rendered":"
\n
\"\"<\/figure><\/div>\n\n\n

Zilliz<\/a>, the inventor of the open-source vector database Milvus, announced the launch of Milvus 2.3, featuring NVIDIA GPU support for greater flexibility and dramatic improvements in real-time workload performance. <\/p>\n\n\n\n

Purpose-built for AI-powered applications, Milvus stores, indexes and manages billions of embedding vectors generated by large language models (LLMs), convolutional networks and other machine learning (ML) models. Milvus handles all types of unstructured data, eliminating the cost and complication of managing multiple databases. With Milvus, organizations can quickly analyze and act on their data to reduce fraud, deliver better recommendations, avoid downtime and make faster decisions. <\/p>\n\n\n\n

Heterogeneous (CPU + GPU) computing massively improves the performance of real-time recommendation engines, question-and-answer systems, anomaly detection, image and video search and other applications powered by similarity search. Milvus is the first vector database to support heterogeneous compute, and the latest Milvus release brings this powerful capability to the rearchitected cloud-native Milvus 2 platform, which offers hybrid search, tunable consistency, always-online operation and many other advantages. <\/p>\n\n\n\n

With accelerated parallel performance and quicker, more efficient querying, Milvus 2.3 is 4X faster than Milvus 2.0 and more than 10X faster than competitors that retrofit vector search onto traditional database solutions. <\/p>\n\n\n\n

Milvus 2.3 also introduces GPU acceleration that delivers 10X faster performance than the CPU-only version. GPU-accelerated Milvus will continue to improve and provide high-performance vector search capabilities for various applications powered by machine learning and AI. <\/p>\n\n\n\n

\n

\u201cHeterogeneous compute is the key to delivering the processing performance required for AI-powered applications,\u201d said Charles Xie, creator of the Milvus project and CEO, Zilliz. \u201cWith Milvus\u2019s NVIDIA GPU support and RAFT-based integration, that capability is now available at massive scale on CPU and GPU platforms \u2014 or both.\u201d <\/p>\n<\/blockquote>\n\n\n\n

Other notable features of Milvus 2.3 include: <\/p>\n\n\n\n