专利快速检索-快速检索全球专利，免费商用专利数据库-IPRDB

41. 发明授权

US10217120B1 Method and system for in-store shopper behavior analysis with multi-modal sensor fusion 有权
公开(公告)号：US10217120B1
公开(公告)日：2019-02-26
申请号：US14692446
申请日：2015-04-21
申请人： Joonhwa Shin , Rajeev Sharma
发明人： Joonhwa Shin , Rajeev Sharma
IPC分类号： G06Q30/02 , G06Q10/06 , H04N5/232 , H04N5/247 , H04N7/18 , H04W4/02 , H04W64/00
摘要： The present invention provides a comprehensive method for automatically and unobtrusively analyzing the in-store behavior of people visiting a physical space using a multi-modal fusion based on multiple types of sensors. The types of sensors employed may include cameras for capturing a plurality of images and mobile signal sensors for capturing a plurality of Wi-Fi signals. The present invention integrates the plurality of input sensor measurements to reliably and persistently track the people's physical attributes and detect the people's interactions with retail elements. The physical and contextual attributes collected from the processed shopper tracks includes the motion dynamics changes triggered by an implicit and explicit interaction to a retail element, comprising the behavior information for the trip of the people. The present invention integrates point-of-sale transaction data with the shopper behavior by finding and associating the transaction data that corresponds to a shopper trajectory and fusing them to generate a complete an intermediate representation of a shopper trip data, called a TripVector. The shopper behavior analyses are carried out based on the extracted TripVector. The analyzed behavior information for the shopper trips yields exemplary behavior analysis comprising map generation as visualization of the behavior, quantitative shopper metric derivation in multiple scales (e.g., store-wide and category-level) including path-to-purchase shopper metrics (e.g., traffic distribution, shopping action distribution, buying action distribution, conversion funnel), category dynamics (e.g., dominant path, category correlation, category sequence). The present invention includes a set of derived methods for different sensor configurations.

42. 发明授权

US08812344B1 Method and system for determining the impact of crowding on retail performance 有权
标题翻译：确定拥挤对零售业绩的影响的方法和系统
公开(公告)号：US08812344B1
公开(公告)日：2014-08-19
申请号：US12459283
申请日：2009-06-29
申请人： Varij Saurabh , Namsoon Jung , Rajeev Sharma
发明人： Varij Saurabh , Namsoon Jung , Rajeev Sharma
IPC分类号： G06Q10/00 , G06Q30/02
CPC分类号： G06Q30/0201 , G06K9/00778
摘要： The present invention is a system, method, and apparatus for determining the impact of crowding on retail performance based on a measurement for behavior patterns of people in a store area. The present invention captures a plurality of input images of the people by at least a means for capturing images, such as cameras, in the store area. In the captured plurality of input images, each person's shopping path is detected by a video analytics-based tracking algorithm. A subset of the people is identified as a crowd in the store area. In relation to the crowd, the behavior patterns of the target person are measured. After aggregating the measurements for the behavior patterns over a predefined window of time, the present invention can calculate a crowd index and a crowd impact index for the store area based on the measurements. A crowd index shows the level of crowd density in the store area caused by a crowd, including traffic count of the crowd in the store area. A crowd impact index comprises a traffic count of the target people who make trips to the store area and a shopping time index, such as average shopping time changes of the target people, in relation to a crowd in the measured store area.
摘要翻译：本发明是一种用于基于对商店区域中的人的行为模式的测量来确定拥挤对零售业绩的影响的系统，方法和装置。本发明通过至少一种用于在商店区域中捕获诸如照相机之类的图像的装置捕获人的多个输入图像。在所捕获的多个输入图像中，通过基于视频分析的跟踪算法来检测每个人的购物路径。人们的一小部分被确定为商店区域的人群。针对人群，衡量目标人员的行为模式。在预定时间窗口聚集了行为模式的测量之后，本发明可以基于测量来计算存储区域的人群指数和人群影响指数。人群指数显示人群造成的店面人群密度，包括店面人群的流量。人群影响指数包括与测量商店区域中的人群相关的进入商店区域的目标人群的交通计数和目标人群的平均购物时间变化等购物时间指数。

43. 发明授权

US08660895B1 Method and system for rating of out-of-home digital media network based on automatic measurement 有权
标题翻译：基于自动测量的户外数字媒体网络评级的方法和系统
公开(公告)号：US08660895B1
公开(公告)日：2014-02-25
申请号：US11818485
申请日：2007-06-14
申请人： Varij Saurabh , Jeff Hershey , Satish Mummareddy , Rajeev Sharma , Namsoon Jung
发明人： Varij Saurabh , Jeff Hershey , Satish Mummareddy , Rajeev Sharma , Namsoon Jung
IPC分类号： G06Q30/02
CPC分类号： G06Q30/0204 , G06Q30/0242
摘要： The present invention is a method and system for producing a set of ratings for out-of-home media based on the measurement of behavior patterns and demographics of the people in a digital media network. The present invention captures a plurality of input images of the people in the vicinity of sampled out-of-home media in a digital media network by a plurality of means for capturing images, and tracks each person. The present invention processes the plurality of input images in order to analyze the behavior and demographics of the people. The present invention aggregates the measurements for the behavior patterns and demographics of the people, analyzes the data, and extracts characteristic information based on the estimated parameters from the aggregated measurements. Finally, the present invention calculates a set of ratings based on the characteristic information. The plurality of computer vision technologies can comprise face detection, person tracking, body parts detection, and demographic classification of the people, on the captured visual information of the people in the vicinity of the out-of-home media.
摘要翻译：本发明是一种用于根据对数字媒体网络中的人的行为模式和人口统计的测量来生产用于户外媒体的一组评级的方法和系统。本发明通过用于捕获图像的多个装置捕获数字媒体网络中的采样的室外媒体附近的人的多个输入图像，并且跟踪每个人。本发明处理多个输入图像以分析人的行为和人口统计。本发明聚合人们的行为模式和人口统计学的测量结果，分析数据，并根据来自聚合测量的估计参数提取特征信息。最后，本发明基于特征信息计算一组评级。多种计算机视觉技术可以包括人脸检测，人物跟踪，身体部位检测和人群的人口统计分类，以及在家外媒体附近的人们所获取的视觉信息。

44. 发明授权

US08520906B1 Method and system for age estimation based on relative ages of pairwise facial images of people 有权
标题翻译：基于成人面部人脸相对年龄的年龄估计方法与系统
公开(公告)号：US08520906B1
公开(公告)日：2013-08-27
申请号：US12283595
申请日：2008-09-12
申请人： Hankyu Moon , Rajeev Sharma , Namsoon Jung
发明人： Hankyu Moon , Rajeev Sharma , Namsoon Jung
IPC分类号： G06K9/00 , G06K9/46 , G06K9/66 , G06K9/62
CPC分类号： G06K9/6292 , G06K9/6263 , G06K2009/00322
摘要： The present invention is a system and method for estimating the age of people based on their facial images. It addresses the difficulty of annotating the age of a person from facial image by utilizing relative age (such as older than, or younger than) and face-based class similarity (gender, ethnicity or appearance-based cluster) of sampled pair-wise facial images. It involves a unique method for the pair-wise face training and a learning machine (or multiple learning machines) which output the relative age along with the face-based class similarity, of the pairwise facial images. At the testing stage, the given input face image is paired with some number of reference images to be fed to the trained machines. The age of the input face is determined by comparing the estimated relative ages of the pairwise facial images to the ages of reference face images. Because age comparison is more meaningful when the pair belongs to the same demographics category (such as gender and ethnicity) or when the pair has similar appearance, the estimated relative ages are weighted according to the face-based class similarity score between the reference face and the input face.
摘要翻译：本发明是一种基于面部图像来估计人的年龄的系统和方法。它解决了通过利用抽样对面面部的相对年龄（如年龄大于或小于）和基于脸部类别（性别，种族或出现的群集）来标注个人年龄的难度图片。它涉及成对面部训练的独特方法和一种学习机器（或多个学习机器），其输出成对面部图像的面部类似度的相对年龄。在测试阶段，给定的输入面部图像与一些数量的参考图像配对，以供给训练有素的机器。通过将成对面部图像的估计相对年龄与参考面部图像的年龄进行比较来确定输入面的年龄。因为年龄比较更有意义，当该对属于相同的人口统计学类别（如性别和种族）时，或者对具有相似的外观时，估计的相对年龄会根据参考面和输入面。

45. 发明授权

US08457466B1 Videore: method and system for storing videos from multiple cameras for behavior re-mining 有权
标题翻译： Videore：用于存储来自多个摄像机的视频以进行行为重新采矿的方法和系统
公开(公告)号：US08457466B1
公开(公告)日：2013-06-04
申请号：US12286138
申请日：2008-09-29
申请人： Rajeev Sharma , Namsoon Jung
发明人： Rajeev Sharma , Namsoon Jung
IPC分类号： H04N5/772
CPC分类号： H04N7/181 , G06F17/30784 , H04N5/247
摘要： The present invention is a method and system for storing videos by track sequences and selection of video segments in a manner to support “re-mining” by indexing and playback of individual visitors' entire trip to an area covered by overlapping cameras, allowing analysis and recognition of detailed behavior. The present invention captures video streams of the people in the area by multiple cameras and tracks the people in each of the video streams, producing track sequences in each video stream. Using the track sequences, the present invention finds trip information of the people. The present invention determines a first set of video segments that contain the trip information of the people, and compacts each of the video streams by removing a second set of video segments that do not contain the trip information of the people from each of the video streams. The video segments in the first set of video segments are associated with the people by indexing the video segments per person based on the trip information. The final storage format of the videos is a trip-centered format which sequences videos from across multiple cameras in a manner to facilitate multiple applications dealing with behavior analysis, and it is an efficient compact format without losing any video segments that contain the track sequences of the people.
摘要翻译：本发明是一种通过轨道序列存储视频和视频片段的选择的方法和系统，以支持通过索引和回放个体访客整个旅行到重叠相机覆盖的区域来支持“重新挖掘”的方式，允许分析和承认详细行为。本发明通过多个摄像机捕获该区域中的人的视频流，并且跟踪每个视频流中的人，并产生每个视频流中的轨道序列。使用轨道序列，本发明找到人的行程信息。本发明确定包含人员的行程信息的第一组视频段，并且通过从每个视频流中移除不包含人员的行程信息的第二组视频段来压缩每个视频流。第一组视频片段中的视频段通过根据旅行信息索引每个人的视频片段与人相关联。视频的最终存储格式是一种以行程为中心的格式，以一种方式对来自多个摄像机的视频进行排序，以便于处理行为分析的多个应用程序，并且它是一种高效的紧凑格式，而不会丢失包含轨迹序列的任何视频段人民。

46. 发明授权

US08401248B1 Method and system for measuring emotional and attentional response to dynamic digital media content 有权
标题翻译：用于衡量对动态数字媒体内容的情感和注意反应的方法和系统
公开(公告)号：US08401248B1
公开(公告)日：2013-03-19
申请号：US12317917
申请日：2008-12-30
申请人： Hankyu Moon , Rajeev Sharma , Namsoon Jung
发明人： Hankyu Moon , Rajeev Sharma , Namsoon Jung
IPC分类号： G06K9/00
CPC分类号： G06K9/00302 , G06K9/00315 , G06K9/00597 , G06Q30/0242
摘要： The present invention is a method and system to provide an automatic measurement of people's responses to dynamic digital media, based on changes in their facial expressions and attention to specific content. First, the method detects and tracks faces from the audience. It then localizes each of the faces and facial features to extract emotion-sensitive features of the face by applying emotion-sensitive feature filters, to determine the facial muscle actions of the face based on the extracted emotion-sensitive features. The changes in facial muscle actions are then converted to the changes in affective state, called an emotion trajectory. On the other hand, the method also estimates eye gaze based on extracted eye images and three-dimensional facial pose of the face based on localized facial images. The gaze direction of the person, is estimated based on the estimated eye gaze and the three-dimensional facial pose of the person. The gaze target on the media display is then estimated based on the estimated gaze direction and the position of the person. Finally, the response of the person to the dynamic digital media content is determined by analyzing the emotion trajectory in relation to the time and screen positions of the specific digital media sub-content that the person is watching.
摘要翻译：本发明是一种方法和系统，其基于他们的面部表情的变化和对特定内容的关注，提供人们对动态数字媒体的响应的自动测量。首先，该方法检测和跟踪观众的面孔。然后通过应用情感敏感的特征过滤器，将每个面部和面部特征进行本地化，以提取面部的情感敏感特征，以基于提取的情感敏感特征来确定面部的面部肌肉动作。然后将面部肌肉动作的变化转化为情感状态的变化，称为情绪轨迹。另一方面，该方法还基于基于局部面部图像的提取的眼睛图像和面部的三维面部姿态来估计眼睛凝视。人的视线方向是根据估计的眼睛凝视度和人的三维面部姿态来估计的。然后基于估计的注视方向和人的位置来估计媒体显示器上的目标目标。最后，通过分析与该人正在观看的特定数字媒体子内容的时间和屏幕位置相关的情绪轨迹来确定该人对动态数字媒体内容的响应。

47. 发明授权

US08351647B2 Automatic detection and aggregation of demographics and behavior of people 有权
标题翻译：人口统计学和人际行为的自动检测和聚合
公开(公告)号：US08351647B2
公开(公告)日：2013-01-08
申请号：US12002398
申请日：2007-12-17
申请人： Rajeev Sharma , Hankyu Moon , Namsoon Jung
发明人： Rajeev Sharma , Hankyu Moon , Namsoon Jung
IPC分类号： G06K9/00 , G06Q30/00
CPC分类号： G06Q30/02
摘要： The present invention is a system and framework for automatically measuring and correlating visual characteristics of people and accumulating the data for the purpose of demographic and behavior analysis. The demographic and behavior characteristics of people are extracted from a sequence of images using techniques from computer vision. The demographic and behavior characteristics are combined with a timestamp and a location marker to provide a feature vector of a person at a particular time at a particular location. These feature vectors are then accumulated and aggregated automatically in order to generate a data set that can be statistically analyzed, data mined and/or queried.
摘要翻译：本发明是用于自动测量和关联人的视觉特征并且为了人口和行为分析的目的而累积数据的系统和框架。使用计算机视觉技术从图像序列中提取人的人口和行为特征。人口统计学和行为特征与时间戳和位置标记组合，以在特定位置处的特定时间提供人的特征向量。然后，这些特征向量自动累积和聚合，以便生成可以进行统计分析，数据挖掘和/或查询的数据集。

48. 发明授权

US08254633B1 Method and system for finding correspondence between face camera views and behavior camera views 有权
标题翻译：用于查找面部摄像机视图和行为摄像机视图之间的对应关系的方法和系统
公开(公告)号：US08254633B1
公开(公告)日：2012-08-28
申请号：US12386656
申请日：2009-04-21
申请人： Hankyu Moon , Rajeev Sharma , Namsoon Jung
发明人： Hankyu Moon , Rajeev Sharma , Namsoon Jung
IPC分类号： G06K9/62
CPC分类号： G06K9/00771
摘要： The present invention is a method and system to provide correspondences between a face camera track and a behavior camera track, for the purpose of making correspondence between the data obtained from each track. First, multiple learning machines are trained so that each of the machines processes pairwise person images from a specific pose region, and estimates the likelihood of two person images belonging to the same person based on image appearances. Then, the system acquires a person image associated with a behavior camera track, determines the pose of the person image based on its floor position, and corrects the pose of the person image. The system also acquires person images from face camera images associated with a face camera track, and combines the images with corrected person images from the previous step to form pairwise person images. The pairwise person image is fed to the trained pose-dependent pairwise person verification machines according to the pose of the person images, to compute the appearance match scores between the pair of person images. Finally, the combination of the appearance match scores and the spatiotemporal match scores of the pair of person images determines whether or not the person images belong to the same person.
摘要翻译：本发明是为了使得从每个轨道获得的数据之间的对应关系，提供面部照相机轨道和行为摄像机轨道之间的对应的方法和系统。首先，训练多个学习机器，使得每个机器从特定的姿势区域处理成对的人物图像，并且基于图像外观来估计属于同一个人的两个人物图像的可能性。然后，系统获取与行为相机轨迹相关联的人物图像，基于其楼层位置确定人物图像的姿势，并且校正人物图像的姿势。该系统还从与脸部相机轨迹相关联的面部摄像机图像中获取人物图像，并且将图像与来自前一步骤的校正的人物图像组合以形成成对的人物图像。根据人物图像的姿态将成对人物图像馈送到经过训练的姿势依赖成对人身份验证机，以计算一对人物图像之间的外观匹配得分。最后，一对人物图像的外观匹配分数和时空匹配分数的组合确定人物图像是否属于同一人物。

49. 发明授权

US08027521B1 Method and system for robust human gender recognition using facial feature localization 有权
标题翻译：使用面部特征定位的强大的人类性别识别方法和系统
公开(公告)号：US08027521B1
公开(公告)日：2011-09-27
申请号：US12079276
申请日：2008-03-25
申请人： Hankyu Moon , Rajeev Sharma , Namsoon Jung
发明人： Hankyu Moon , Rajeev Sharma , Namsoon Jung
IPC分类号： G06K9/62
CPC分类号： G06K9/00288
摘要： The present invention is a method and system to provide a face-based automatic gender recognition system that utilizes localized facial features and hairstyles of humans. Given a human face detected from a face detector, it is accurately localized to facilitate the facial/hair feature detection and localization. Facial features are more finely localized using the geometrically distributed learning machines. Then the position, size, and appearance information of the facial features are extracted. The facial feature localization essentially decouples geometric and appearance information about facial features, so that a more explicit comparison can be made at the recognition stage. The hairstyle features that possess useful gender information are also extracted based on the hair region segmented, using the color discriminant analysis and the estimated geometry of the face. The gender-sensitive feature vector, made up from the extracted facial and hairstyle features, is fed to the gender recognition machines that have been trained using the same kind of gender-sensitive feature vectors of gallery images.
摘要翻译：本发明是一种提供基于脸部的自动性别识别系统的方法和系统，其利用人的局部面部特征和发型。鉴于从面部检测器检测到的人脸，它被精确定位以便于面部/头发特征检测和定位。面部特征使用几何分布式学习机器更精细地定位。然后提取面部特征的位置，大小和外观信息。面部特征定位基本上解除了关于面部特征的几何和外观信息，从而可以在识别阶段进行更明确的比较。还使用颜色判别分析和面部估计的几何形状，基于分割的毛发区域提取具有有用性别信息的发型特征。由提取的面部和发型特征组成的对性别敏感的特征向量被馈送到使用相同种类的对图像图像的性别敏感特征向量训练的性别识别机器。

50. 发明授权

US07987111B1 Method and system for characterizing physical retail spaces by determining the demographic composition of people in the physical retail spaces utilizing video image analysis 有权
标题翻译：通过使用视频图像分析确定物理零售空间人员的人口构成，来描绘物理零售空间的方法和系统
公开(公告)号：US07987111B1
公开(公告)日：2011-07-26
申请号：US11978021
申请日：2007-10-26
申请人： Rajeev Sharma , Satish Mummareddy , Jeff Hershey , Hankyu Moon
发明人： Rajeev Sharma , Satish Mummareddy , Jeff Hershey , Hankyu Moon
IPC分类号： G06Q10/00
CPC分类号： G06Q30/02 , A61B2503/20 , G06Q30/0201
摘要： The present invention is a method and system for characterizing physical space based on automatic demographics measurement, using a plurality of means for capturing images and a plurality of computer vision technologies. The present invention is called demographic-based retail space characterization (DBR). Although the disclosed method is described in the context of retail space, the present invention can be applied to any physical space that has a restricted boundary. In the present invention, the physical space characterization can comprise various types of characterization depending on the objective of the physical space, and it is one of the objectives of the present invention to provide the automatic demographic composition measurement to facilitate the physical space characterization. The demographic classification and composition measurement of people in the physical space is performed automatically based on a novel usage of a plurality of means for capturing images and a plurality of computer vision technologies on the captured visual information of the people in the physical space. The plurality of computer vision technologies can comprise face detection, person tracking, body parts detection, and demographic classification of the people, on the captured visual information of the people in the physical space.
摘要翻译：本发明是一种用于基于自动人口统计测量来表征物理空间的方法和系统，使用多个用于捕获图像的装置和多个计算机视觉技术。本发明被称为基于人口统计的零售空间表征（DBR）。虽然在零售空间的上下文中描述了所公开的方法，但是本发明可以应用于具有有限边界的任何物理空间。在本发明中，物理空间表征可以包括取决于物理空间的目标的各种类型的表征，并且本发明的目的之一是提供自动人口统计量测量以促进物理空间表征。基于对物理空间中人的捕获的视觉信息的多个用于捕获图像和多个计算机视觉技术的新颖的使用，自动执行物理空间中的人的人口统计分类和构图测量。多个计算机视觉技术可以包括人物的人脸检测，人物跟踪，身体部位检测和人口统计学分类，以及物理空间中所捕获的视觉信息。

你已经成功收藏专利！

检索式保存成功!

IPRDB

热门服务

关于我们

友情链接

联系方式