专利快速检索-快速检索全球专利，免费商用专利数据库-IPRDB

1. 再颁专利

USRE41449E1 Method and apparatus for providing virtual touch interaction in the drive-thru 有权
标题翻译：用于在驱动器中提供虚拟触摸交互的方法和装置
公开(公告)号：USRE41449E1
公开(公告)日：2010-07-20
申请号：US12027879
申请日：2008-02-07
申请人： Nils Krahnstoever , Emilio Schapira , Rajeev Sharma , Namsoon Jung
发明人： Nils Krahnstoever , Emilio Schapira , Rajeev Sharma , Namsoon Jung
IPC分类号： G06F17/00 , G06K9/00
CPC分类号： G06F3/011 , G06F3/017 , G06F3/0304
摘要： The present invention is a method and apparatus for providing an enhanced automatic drive-thru experience to the customers in a vehicle by allowing use of natural hand gestures to interact with digital content. The invention is named Virtual Touch Ordering System (VTOS). In the VTOS, the virtual touch interaction is defined to be a contact free interaction, in which a user is able to select graphical objects within the digital contents on a display system and is able to control the processes connected to the graphical objects, by natural hand gestures without touching any physical devices, such as a keyboard or a touch screen. Using the virtual touch interaction of the VTOS, the user is able to complete transactions or ordering, without leaving the car and without any physical contact with the display. A plurality of Computer Vision algorithms in the VTOS processes a plurality of input image sequences from the image-capturing system that is pointed at the customers in a vehicle and performs the virtual touch interaction by natural hand gestures. The invention can increase the throughput of drive-thru interaction and reduce the delay in wait time, labor cost, and maintenance cost.
摘要翻译：本发明是一种通过允许使用自然手势与数字内容交互来向车辆中的客户提供增强的自动驾驶经验的方法和装置。本发明被命名为虚拟触摸订购系统（VTOS）。在VTOS中，虚拟触摸交互被定义为无联系的交互，其中用户能够在显示系统上的数字内容中选择图形对象，并且能够通过自然来控制连接到图形对象的过程无需触摸任何物理设备（如键盘或触摸屏）的手势。使用VTOS的虚拟触摸交互，用户能够完成交易或订购，而不用离开汽车，并且与显示器没有任何物理接触。 VTOS中的多个计算机视觉算法处理来自图像捕获系统的指向车辆中的客户的多个输入图像序列，并通过自然的手势执行虚拟触摸交互。本发明可以增加驱动通过交互的吞吐量，并减少等待时间，人工成本和维护成本的延迟。

2. 发明授权

US06996460B1 Method and apparatus for providing virtual touch interaction in the drive-thru 有权
标题翻译：用于在驱动器中提供虚拟触摸交互的方法和装置
公开(公告)号：US06996460B1
公开(公告)日：2006-02-07
申请号：US10679226
申请日：2003-10-02
申请人： Nils Krahnstoever , Emilio Schapira , Rajeev Sharma , Namsoon Jung
发明人： Nils Krahnstoever , Emilio Schapira , Rajeev Sharma , Namsoon Jung
IPC分类号： G06F17/00
CPC分类号： G06F3/011 , G06F3/017 , G06F3/0304
摘要： The present invention is a method and apparatus for providing an enhanced automatic drive-thru experience to the customers in a vehicle by allowing use of natural hand gestures to interact with digital content. The invention is named Virtual Touch Ordering System (VTOS). In the VTOS, the virtual touch interaction is defined to be a contact free interaction, in which a user is able to select graphical objects within the digital contents on a display system and is able to control the processes connected to the graphical objects, by natural hand gestures without touching any physical devices, such as a keyboard or a touch screen. Using the virtual touch interaction of the VTOS, the user is able to complete transactions or ordering, without leaving the car and without any physical contact with the display. A plurality of Computer Vision algorithms in the VTOS processes a plurality of input image sequences from the image-capturing system that is pointed at the customers in a vehicle and performs the virtual touch interaction by natural hand gestures. The invention can increase the throughput of drive-thru interaction and reduce the delay in wait time, labor cost, and maintenance cost.
摘要翻译：本发明是一种通过允许使用自然手势与数字内容交互来向车辆中的客户提供增强的自动驾驶经验的方法和装置。本发明被命名为虚拟触摸订购系统（VTOS）。在VTOS中，虚拟触摸交互被定义为无联系的交互，其中用户能够在显示系统上的数字内容中选择图形对象，并且能够通过自然来控制连接到图形对象的过程无需触摸任何物理设备（如键盘或触摸屏）的手势。使用VTOS的虚拟触摸交互，用户能够完成交易或订购，而不用离开汽车，并且与显示器没有任何物理接触。 VTOS中的多个计算机视觉算法处理来自图像捕获系统的指向车辆中的客户的多个输入图像序列，并通过自然的手势执行虚拟触摸交互。本发明可以增加驱动通过交互的吞吐量，并减少等待时间，人工成本和维护成本的延迟。

3. 发明授权

US07274803B1 Method and system for detecting conscious hand movement patterns and computer-generated visual feedback for facilitating human-computer interaction 有权
标题翻译：用于检测有意识的手运动模式的方法和系统以及用于促进人机交互的计算机生成的视觉反馈
公开(公告)号：US07274803B1
公开(公告)日：2007-09-25
申请号：US10403234
申请日：2003-03-31
申请人： Rajeev Sharma , Nils Krahnstoever , Emilio Schapira
发明人： Rajeev Sharma , Nils Krahnstoever , Emilio Schapira
IPC分类号： G06K9/00 , G06K9/34 , H04N7/14 , H04N7/18 , H04N9/47
CPC分类号： G06K9/00375
摘要： The present invention is a system and method for detecting and analyzing motion patterns of individuals present at a multimedia computer terminal from a stream of video frames generated by a video camera and the method of providing visual feedback of the extracted information to aid the interaction process between a user and the system. The method allows multiple people to be present in front of the computer terminal and yet allow one active user to make selections on the computer display. Thus the invention can be used as method for contact-free human-computer interaction in a public place, where the computer terminal can be positioned in a variety of configurations including behind a transparent glass window or at a height or location where the user cannot touch the terminal physically.
摘要翻译：本发明是一种用于从由摄像机产生的视频帧流中检测和分析存在于多媒体计算机终端的个人的运动模式的系统和方法，以及提供所提取的信息的视觉反馈以帮助在用户和系统。该方法允许多个人存在于计算机终端之前，并且允许一个主动用户在计算机显示器上进行选择。因此，本发明可以用作公共场合中的无接触人机交互的方法，其中计算机终端可以以包括透明玻璃窗后面或用户不能接触的高度或位置处的各种配置来定位物理终端。

4. 发明授权

US07317812B1 Method and apparatus for robustly tracking objects 有权
标题翻译：鲁棒跟踪对象的方法和装置
公开(公告)号：US07317812B1
公开(公告)日：2008-01-08
申请号：US10618393
申请日：2003-07-12
申请人： Nils Krahnstoever , Emilio Schapira , Rajeev Sharma
发明人： Nils Krahnstoever , Emilio Schapira , Rajeev Sharma
IPC分类号： G06K9/00
CPC分类号： G06F3/011 , G06K9/00335 , G06T7/285
摘要： The present invention pertains generally to the field of computer graphics user interfaces. More specifically, the present invention discloses a video image based tracking system that allows a computer to robustly locate and track an object in three dimensions within the viewing area of two or more cameras. The preferred embodiment of the disclosed invention tracks a person's appendages in 3D allowing touch free control of interactive devices but the method and apparatus can be used to perform a wide variety of video tracking tasks. The method uses at least two cameras that view the volume of space within which the object is being located and tracked. It operates by maintaining a large number of hypotheses about the actual 3D object location.
摘要翻译：本发明一般涉及计算机图形用户界面领域。更具体地，本发明公开了一种基于视频图像的跟踪系统，其允许计算机在两个或更多个相机的观看区域内以三维方式稳健地定位和跟踪对象。所公开的发明的优选实施例以3D的方式跟踪人的附属物，允许对交互式设备的触摸免费控制，但是该方法和装置可用于执行各种各样的视频跟踪任务。该方法使用至少两个相机来查看对象被定位和跟踪的空间量。它通过维持关于实际3D对象位置的大量假设来操作。

5. 发明授权

US07225414B1 Method and system for virtual touch entertainment 有权
标题翻译：虚拟触摸娱乐的方法和系统
公开(公告)号：US07225414B1
公开(公告)日：2007-05-29
申请号：US10634962
申请日：2003-08-05
申请人： Rajeev Sharma , Emilio Schapira , Namsoon Jung
发明人： Rajeev Sharma , Emilio Schapira , Namsoon Jung
IPC分类号： G06F3/00 , G06F9/00
CPC分类号： G06F3/017 , G06F3/012
摘要： The present invention is a method and apparatus for attracting the attention of people in public places and engaging them in a touch-free interaction with a multimedia display using an image-capturing system and a set of Computer Vision algorithms as a means of informing the public as well as collecting data about/from the users. The invention is named, Virtual Touch Entertainment (VTE) Platform. The VTE Platform comprises of a series of interaction states, such as the Wait State, the Attraction State, the User Engagement State, the User Interaction State, and the Interaction Termination State. The modules in these interaction states handle complicated tasks assigned to them, such as attracting the users, training the users, providing the multimedia digital content to the users, and collecting the user data and statistics, in an efficient and intelligent manner. The user is able to experience a whole new way of interaction paradigm while getting information and entertainment through the rich digital multimedia. The system operates automatically and dynamically in real-time throughout the whole interaction process.
摘要翻译：本发明是一种用于吸引公共场所的人的注意力的方法和装置，并且使用图像捕获系统和一组计算机视觉算法作为通知公众的手段使其与多媒体显示器的无触摸的交互以及从用户那里收集数据。该发明被命名为虚拟触摸娱乐（VTE）平台。 VTE平台包括一系列交互状态，例如等待状态，吸引状态，用户参与状态，用户交互状态和交互终止状态。这些交互状态中的模块处理分配给他们的复杂任务，例如吸引用户，训练用户，向用户提供多媒体数字内容，并以高效智能的方式收集用户数据和统计信息。用户能够通过丰富的数字多媒体获得信息和娱乐，体验全新的互动模式。系统在整个交互过程中实时自动动态地运行。

6. 发明授权

US08665333B1 Method and system for optimizing the observation and annotation of complex human behavior from video sources 有权
标题翻译：从视频源优化复杂人类行为观察和注释的方法和系统
公开(公告)号：US08665333B1
公开(公告)日：2014-03-04
申请号：US12011385
申请日：2008-01-25
申请人： Rajeev Sharma , Satish Mummareddy , Emilio Schapira , Namsoon Jung
发明人： Rajeev Sharma , Satish Mummareddy , Emilio Schapira , Namsoon Jung
IPC分类号： H04N7/18
CPC分类号： G08B13/19613 , G06K9/00771 , G08B13/19643
摘要： The present invention is a method and system for optimizing the observation and annotation of complex human behavior from video sources by automatically detecting predefined events based on the behavior of people in a first video stream from a first means for capturing images in a physical space, accessing a synchronized second video stream from a second means for capturing images that are positioned to observe the people more closely using the timestamps associated with the detected events from the first video stream, and enabling an annotator to annotate each of the events with more labels using a tool. The present invention captures a plurality of input images of the persons by a plurality of means for capturing images and processes the plurality of input images in order to detect the predefined events based on the behavior in an exemplary embodiment. The processes are based on a novel usage of a plurality of computer vision technologies to analyze the human behavior from the plurality of input images. The physical space may be a retail space, and the people may be customers in the retail space.
摘要翻译：本发明是一种通过基于来自用于在物理空间中捕获图像的第一装置的第一视频流中的人的行为自动检测预定义事件来优化来自视频源的复杂人类行为的观察和注释的方法和系统，来自第二装置的同步的第二视频流，用于捕获被定位为使用与来自第一视频流的检测到的事件相关联的时间戳来更密切地观察人的图像，并且使得注释器能够使用更多的标签来注释每个事件工具。本发明通过多个用于捕捉图像并且处理多个输入图像的装置捕获人的多个输入图像，以便在示例性实施例中基于行为来检测预定事件。这些过程基于多个计算机视觉技术的新颖使用，以分析来自多个输入图像的人类行为。物理空间可能是零售空间，人们也许是零售空间的客户。

7. 发明授权

US08462996B2 Method and system for measuring human response to visual stimulus based on changes in facial expression 有权
公开(公告)号：US08462996B2
公开(公告)日：2013-06-11
申请号：US12154002
申请日：2008-05-19
申请人： Hankyu Moon , Rajeev Sharma , Namsoon Jung
发明人： Hankyu Moon , Rajeev Sharma , Namsoon Jung
IPC分类号： G06K9/00
CPC分类号： G06K9/00335 , G06K9/00315
摘要： The present invention is a method and system for measuring human emotional response to visual stimulus, based on the person's facial expressions. Given a detected and tracked human face, it is accurately localized so that the facial features are correctly identified and localized. Face and facial features are localized using the geometrically specialized learning machines. Then the emotion-sensitive features, such as the shapes of the facial features or facial wrinkles, are extracted. The facial muscle actions are estimated using a learning machine trained on the emotion-sensitive features. The instantaneous facial muscle actions are projected to a point in affect space, using the relation between the facial muscle actions and the affective state (arousal, valence, and stance). The series of estimated emotional changes renders a trajectory in affect space, which is further analyzed in relation to the temporal changes in visual stimulus, to determine the response.

8. 发明授权

US08380558B1 Method and system for analyzing shopping behavior in a store by associating RFID data with video-based behavior and segmentation data 有权
标题翻译：通过将RFID数据与基于视频的行为和分段数据相关联来分析商店中的购物行为的方法和系统
公开(公告)号：US08380558B1
公开(公告)日：2013-02-19
申请号：US11999717
申请日：2007-12-06
申请人： Rajeev Sharma , Satish Mummareddy , Jeff Hershey , Namsoon Jung
发明人： Rajeev Sharma , Satish Mummareddy , Jeff Hershey , Namsoon Jung
IPC分类号： G06Q10/00 , H04N5/225
CPC分类号： G06Q30/02
摘要： The present invention is a method and system for analyzing shopping behavior by associating RFID data, such as tracking data by the RFID tag identifications, with video-based behavior and segmentation data, such as behavior analysis and demographic composition analysis of the customers, utilizing a plurality of means for sensing and using RFID tags, a plurality of means for capturing images, and a plurality of computer vision technologies. In the present invention, the association can further comprise the association of the RFID with the transaction data or any time-based measurement in the retail space. The analyzed shopping behavior in the present invention helps people to better understand business elements in a retail space. It is one of the objectives of the present invention to provide an automatic video-based segmentation of customers in the association with the RFID based tracking of the customers, based on a novel usage of a plurality of means for capturing images and a plurality of computer vision technologies on the captured visual information of the people in the retail space. The plurality of computer vision technologies can comprise face detection, person tracking, body parts detection, and demographic classification of the people, on the captured visual information of the people in the retail space.
摘要翻译：本发明是一种用于通过将RFID数据（例如通过RFID标签标识跟踪数据）与基于视频的行为和分段数据（诸如客户的行为分析和人口统计分析）相关联来分析购物行为的方法和系统，利用用于感测和使用RFID标签的多个装置，用于捕获图像的多个装置以及多个计算机视觉技术。在本发明中，关联可以进一步包括RFID与交易数据或零售空间中的任何基于时间的测量的关联。在本发明中分析的购物行为帮助人们更好地了解零售空间中的商业元素。基于用于捕获图像的多个装置的新颖用途和多个计算机，本发明的目标之一是提供与客户的基于RFID的跟踪相关联的客户的基于视频的自动分割视觉技术在零售空间中捕获的视觉信息。多个计算机视觉技术可以包括面部检测，人物跟踪，身体部位检测和人群的人口统计分类，在零售空间中捕获的人的视觉信息。

9. 发明授权

US08379937B1 Method and system for robust human ethnicity recognition using image feature-based probabilistic graphical models 有权
标题翻译：使用基于图像特征的概率图形模型进行强壮人类种族识别的方法和系统
公开(公告)号：US08379937B1
公开(公告)日：2013-02-19
申请号：US12286233
申请日：2008-09-29
申请人： Hankyu Moon , Rajeev Sharma , Namsoon Jung
发明人： Hankyu Moon , Rajeev Sharma , Namsoon Jung
IPC分类号： G06K9/00 , G06K9/62
CPC分类号： G06K9/00281 , G06K9/4609
摘要： The present invention is a method and system to provide a face-based automatic ethnicity recognition system that utilizes ethnicity-sensitive image features and probabilistic graphical models to represent ethnic classes. The ethnicity-sensitive image features are derived from groups of image features so that each grouping of the image features contributes to more accurate recognition of the ethnic class. The ethnicity-sensitive image features can be derived from image filters that are matched to different colors, sizes, and shapes of facial features—such as eyes, mouth, or complexion. The ethnicity-sensitive image features serve as observable quantities in the ethnic class-dependent probabilistic graphical models, where each probabilistic graphical model represents one ethnic class. A given input facial image is corrected for pose and lighting, and ethnicity-sensitive image features are extracted. The extracted image features are fed to the ethnicity-dependent probabilistic graphical models to determine the ethnic class of the input facial image.
摘要翻译：本发明是一种提供基于脸部的自动种族识别系统的方法和系统，该系统利用民族敏感的图像特征和概率图形模型来表示族裔阶层。种族敏感的图像特征是从图像特征的组中导出的，使得每一组图像特征有助于更准确地识别民族阶层。种族敏感的图像特征可以从匹配于不同颜色，尺寸和面部特征（例如眼睛，嘴巴或肤色）的形状的图像滤波器导出。种族敏感的图像特征在民族阶级依赖概率图形模型中可以作为可观察量，其中每个概率图形模型代表一个民族阶级。针对姿态和照明校正给定的输入面部图像，并提取种族敏感的图像特征。提取的图像特征被馈送到种族依赖概率图形模型以确定输入面部图像的民族类别。

10. 发明授权

US08295597B1 Method and system for segmenting people in a physical space based on automatic behavior analysis 有权
标题翻译：基于自动行为分析在物理空间中分割人的方法和系统
公开(公告)号：US08295597B1
公开(公告)日：2012-10-23
申请号：US12075089
申请日：2008-03-07
申请人： Rajeev Sharma , Satish Mummareddy , Jeff Hershey , Namsoon Jung
发明人： Rajeev Sharma , Satish Mummareddy , Jeff Hershey , Namsoon Jung
IPC分类号： G06K9/00 , G06K9/62 , G06K9/34
CPC分类号： G06K9/00342 , G06K9/00718 , G06K9/00771 , G06K2209/27 , G06T7/20 , G06T2207/30196 , G06T2207/30232 , G06T2207/30241
摘要： The present invention is a method and system for segmenting a plurality of persons in a physical space based on automatic behavior analysis of the persons in a preferred embodiment. The behavior analysis can comprise a path analysis as one of the characterization methods. The present invention applies segmentation criteria to the output of the video-based behavior analysis and assigns segmentation label to each of the persons during a predefined window of time. In addition to the behavioral characteristics, the present invention can also utilize other types of visual characterization, such as demographic analysis, or additional input sources, such as sales data, to segment the plurality of persons in another exemplary embodiment. The present invention captures a plurality of input images of the persons in the physical space by a plurality of means for capturing images. The present invention processes the plurality of input images in order to understand the behavioral characteristics, such as shopping behavior, of the persons for the segmentation purpose. The processes are based on a novel usage of a plurality of computer vision technologies to analyze the visual characterization of the persons from the plurality of input images. The physical space may be a retail space, and the persons may be customers in the retail space.
摘要翻译：本发明是一种在优选实施例中基于人的自动行为分析在物理空间中分割多个人的方法和系统。行为分析可以包括作为表征方法之一的路径分析。本发明将分段标准应用于基于视频的行为分析的输出，并且在预定义的时间窗口内为每个人分配分割标签。除了行为特征之外，本发明还可以利用其他类型的视觉表征，诸如人口统计学分析，或其他输入来源，例如销售数据，以在另一示例性实施例中分割多个人。本发明通过用于捕获图像的多个装置捕获物理空间中的人的多个输入图像。本发明处理多个输入图像，以便了解用于分割目的的人的行为特征，诸如购物行为。这些过程基于多个计算机视觉技术的新颖用途，以分析来自多个输入图像的人的视觉表征。物理空间可能是零售空间，人员可能是零售空间的客户。

你已经成功收藏专利！

检索式保存成功!

IPRDB

热门服务

关于我们

友情链接

联系方式