Collov Labs Launches NewEyes AI, Bringing Advanced Visual Intelligence to Smartphones
SAN FRANCISCO – Collov Labs, an artificial intelligence research company focused on advancing visual AI technologies, has officially introduced NewEyes AI, a next-generation mobile application that transforms a smartphone camera into an intelligent visual assistant capable of understanding scenes and completing real-world tasks. Powered by the company’s proprietary visual AI platform, the app goes beyond simply identifying objects or answering image-based questions. Instead, it enables AI agents to interpret visual information, reason about context, and perform meaningful actions on behalf of users.
The launch represents a significant milestone for Collov Labs following its $23 million Series A funding round earlier this year. The investment has fueled the company’s research into advanced visual intelligence and accelerated the development of its proprietary AI platform. NewEyes AI is the first consumer application built on this platform, demonstrating the company’s long-term vision that visual understanding—rather than traditional text-based large language models alone—will become the primary way people interact with artificial intelligence.
According to Collov Labs, cameras are emerging as the most intuitive interface between humans and AI. Instead of typing prompts or searching through multiple applications, users can simply point their smartphone camera at a document, room, object, product, or sign, allowing the AI to interpret the scene and automatically perform the next logical action.
Xiao Zhang, Chief Executive Officer and co-founder of Collov Labs, said the company believes cameras provide the simplest way for people to communicate real-world problems to technology.
“For most users, pointing a camera at a situation is much more natural than describing it with words,” Zhang explained. “Once AI can truly understand what it is looking at—whether that’s a living room, a document, or an everyday task—it can become a powerful assistant not only on smartphones but also on future wearable devices such as smart glasses.”
Unlike conventional visual AI systems, which primarily focus on Visual Question Answering (VQA) by recognizing objects and responding to user queries, NewEyes AI introduces a more advanced agentic visual intelligence approach.
Traditional tools stop after identifying what appears in an image. NewEyes AI continues the process by interpreting relationships between objects, understanding materials, spatial layouts, and environmental context before deciding what action should be taken. The system builds a personalized understanding of each user by remembering previously captured information, allowing it to make more intelligent recommendations over time.
For example, if a user photographs their wardrobe, NewEyes AI remembers existing clothing items and suggests only pieces that complement the current collection, helping avoid unnecessary duplicate purchases.
Similarly, a quick photo of a business presentation can be transformed into a fully functional website. Rather than merely extracting text, the AI reconstructs the presentation, generates a website, and hosts it online automatically.
Another practical example involves parking signs. Instead of simply reading parking restrictions, the application interprets time limits and sends reminders before parking expires, helping users avoid fines.
Collov Labs says these examples demonstrate the difference between recognition-based AI and action-oriented AI.
Many existing visual search platforms, including products similar to Google Lens, identify objects and provide information or links for users to explore manually. NewEyes AI integrates recognition with intelligent decision-making, allowing the system to determine appropriate actions and execute them without requiring users to switch between different applications or services.
The company describes this seamless combination of visual understanding and autonomous task execution as one of the defining characteristics of its proprietary platform.
NewEyes AI also benefits from years of real-world learning gathered through Collov Labs’ existing consumer products, Collov AI and CozyAI.
Together, these applications have attracted more than one million users, over 10,000 paying subscribers, and approximately 300 enterprise partners across industries including retail, interior design, and e-commerce.
The company explains that every interaction within these applications has contributed valuable training data, helping improve the accuracy of scene recognition, contextual reasoning, and multi-step task completion. Rather than relying solely on synthetic datasets, NewEyes AI has been refined using millions of practical visual interactions generated by everyday users.
Casey Zhou, Chief Technology Officer and co-founder of Collov Labs, noted that one of the company’s biggest discoveries was how quickly non-technical users embraced visual AI.
“When we launched Collov AI and CozyAI, many users had little or no experience with conversational AI platforms,” Zhou said. “Within days, they became highly engaged because interacting through images felt natural. NewEyes AI expands that same technology into a much broader, general-purpose assistant.”
Beyond shopping recommendations and productivity tasks, NewEyes AI supports a wide variety of everyday applications.
The app can analyze meals by estimating calories, nutritional values, and macronutrient composition. Plant enthusiasts can photograph flowers or houseplants to identify species while receiving customized care recommendations based on environmental conditions.
Pet owners can capture images of their animals to receive breed identification and general health insights.
Consumers comparing products can instantly view side-by-side analyses highlighting advantages, disadvantages, specifications, and pricing information from multiple retailers, complete with purchasing links.
The platform also serves educational purposes by recognizing artwork, identifying artistic techniques, and explaining historical context for paintings and sculptures.
For travelers, the application can translate foreign-language text, extract written information from photographs, or identify landmarks and provide historical background.
Interior design capabilities remain one of Collov Labs’ core strengths. Users can photograph existing rooms and generate redesigned layouts in various styles while comparing furniture options and prices from different retailers.
Developers also benefit from the application’s coding features. NewEyes AI can analyze screenshots of software code, explain programming logic, identify bugs, and recommend improvements.
According to the company, one of the platform’s most important technological advantages lies in its ability to continuously improve through ongoing learning.
Every user interaction is transformed into structured feedback that helps refine multiple components of the AI system, including image understanding, reasoning policies, and quality validation processes.
This continuous feedback loop enables the platform to become increasingly accurate as more users engage with it.
Underlying these capabilities is Collov Labs’ proprietary diffusion transformer architecture, developed entirely in-house. The company says this specialized model has been optimized specifically for image generation, scene understanding, editing, and contextual reasoning, allowing visual AI agents to process complex environments more effectively than traditional image-recognition systems.
While NewEyes AI is launching initially as a smartphone application, Collov Labs views mobile devices as only the beginning of its broader strategy.
The company is actively developing support for wearable technologies, including AI-powered smart glasses, where cameras can provide continuous environmental awareness and contextual assistance.
Its underlying visual intelligence platform is already undergoing beta testing with several wearable hardware manufacturers, including devices based on Meta’s Ray-Ban smart glasses, demonstrating the company’s ambitions to expand beyond smartphones into hands-free AI experiences.
Looking ahead, Collov Labs believes visual intelligence will become one of the defining interfaces of the next generation of artificial intelligence, enabling users to solve problems by simply showing AI what they see rather than describing situations through text.
Founded in 2021 and headquartered in Silicon Valley, Collov Labs specializes in developing foundational visual AI technologies that combine diffusion models, spatial reasoning, and autonomous AI workflows. Its technology enables machines to interpret visual scenes, understand context, and convert images into meaningful real-world actions.
The company’s visual intelligence engine was among the earliest consumer AI applications integrated directly into Qualcomm’s on-device AI platform, including the Qualcomm Hexagon Neural Processing Unit (NPU), enabling advanced AI processing directly on compatible devices.
Today, Collov Labs serves more than one million users, supports over 10,000 paid customers, and collaborates with more than 300 enterprise organizations across retail, design, architecture, and e-commerce. With the introduction of NewEyes AI, the company aims to extend its leadership in visual intelligence while making advanced AI assistance accessible through the simple act of pointing a camera at the world.
Source Link: https://www.businesswire.com/