Clipto Enables ChatGPT and Claude to Search and Analyze Years of Meetings and Video Calls

Associated Writers

Clipto Inc. Launches AI Chatbot Memory Platform to Enhance Business Knowledge Access

Artificial intelligence assistants like ChatGPT and Claude have become indispensable tools for millions of workers globally, enabling them to swiftly compose emails, generate complex code, and draft reports using accessible data. However, these AI models are limited by one significant shortcoming: they struggle to recall specifics from past meetings or client calls.

To address this gap, startup Clipto Inc. has introduced Clipto Studio, an innovative AI chatbot memory platform designed to allow AI assistants to actively listen to calls, presentations, and meetings, as well as to search and analyze this information on demand. Clipto asserts that the ability to access this data is crucial as AI technology becomes increasingly integrated into workplace environments.

While AI chatbots excel at processing information from email inboxes and corporate databases, Clipto points out that many companies’ most valuable insights lie hidden within raw audio and video files. Major decisions often emerge during online meetings and customer interviews, yet these discussions are frequently stored in unstructured formats, making them costly and time-consuming for AI to process. Clipto contends that empowering AI with access to this knowledge could enhance its utility for workforce applications.

Clipto Studio employs a unique capability that integrates seamlessly with ChatGPT, Claude, and other AI systems, utilizing the Model Context Protocol powered by proprietary technology that operates locally on users’ Mac and Windows devices. The platform pre-indexes spoken content, individual speakers’ voices, facial expressions, and on-screen visuals, transforming raw footage into a structured and easily searchable dataset, optimized for use by AI chatbots.

When users inquire about recent conversations or events from as far back as two years, Clipto Studio is capable of retrieving answers by sifting through metadata related to those recordings. Clipto’s founder and Chief Executive, Henry Kang, emphasizes that while AI has extensive knowledge of online content, it has only begun to tap into the vast amounts of audio and video data stored on personal devices.

“The next generation of AI will need to understand the conversations, experiences, and knowledge that never makes it into a text-based document,” Kang stated. “That’s the future we’re building—providing AI with the memory it requires to move beyond simple queries and facilitate real-world tasks based on human experiences.”

Clipto Studio functions similarly to an instant replay service. For example, a management consultant can instruct ChatGPT to identify the precise time a project’s scope changed by analyzing past calls and meetings, allowing it to pinpoint significant moments in detailed discussions. Similarly, a researcher could leverage Claude to highlight common issues identified in numerous customer calls, extracting direct quotes that underline those concerns.

Moreover, users can utilize Clipto Studio to review extensive hours of event presentations and create highlight reels featuring the most pertinent and intriguing moments. The official launch of Clipto Studio is a pivotal milestone for the startup, which recently expanded its team by appointing former Google LLC research scientist Dr. Mei Han as its chief scientist. Han, who holds a doctorate in robotics from Carnegie Mellon University, is set to lead the development of Clipto’s lightweight multimodal AI architecture.

Expressing her belief in Clipto’s vision, Han remarked that the initiative seeks to equip AI with the capability to perceive the world as humans do through senses such as sight and sound. “The challenge isn’t just recognizing speech or identifying what’s on screen; it lies in connecting that information across thousands of recordings so that AI can comprehend context and utilize it,” she explained. “We are developing technology that will make video and audio just as accessible and functional for AI as text, paving the way for a new generation of applications.”

[gspeech type=full]

Share This Article
Leave a comment