专利快速检索-快速检索全球专利，免费商用专利数据库-IPRDB

1. 发明申请

US20130321396A1 MULTI-INPUT FREE VIEWPOINT VIDEO PROCESSING PIPELINE 审中-公开
标题翻译：多输入免费视点视频处理管道
公开(公告)号：US20130321396A1
公开(公告)日：2013-12-05
申请号：US13599170
申请日：2012-08-30
申请人： Adam Kirk , Kanchan Mitra , Patrick Sweeney , Don Gillett , Neil Fishman , Simon Winder , Yaron Eshet , David Harnett , Amit Mital , David Eraker
发明人： Adam Kirk , Kanchan Mitra , Patrick Sweeney , Don Gillett , Neil Fishman , Simon Winder , Yaron Eshet , David Harnett , Amit Mital , David Eraker
IPC分类号： G06T15/00
CPC分类号： G06T15/04 , G06T15/08 , G06T15/205 , G06T17/00 , G06T2210/56 , H04N7/142 , H04N7/15 , H04N7/157 , H04N13/117 , H04N13/194 , H04N13/239 , H04N13/243 , H04N13/246 , H04N13/257 , H04R2227/005 , H04S2400/15
摘要： Free viewpoint video of a scene is generated and presented to a user. An arrangement of sensors generates streams of sensor data each of which represents the scene from a different geometric perspective. The sensor data streams are calibrated. A scene proxy is generated from the calibrated sensor data streams. The scene proxy geometrically describes the scene as a function of time and includes one or more types of geometric proxy data which is matched to a first set of current pipeline conditions in order to maximize the photo-realism of the free viewpoint video resulting from the scene proxy at each point in time. A current synthetic viewpoint of the scene is generated from the scene proxy. This viewpoint generation maximizes the photo-realism of the current synthetic viewpoint based upon a second set of current pipeline conditions. The current synthetic viewpoint is displayed.
摘要翻译：生成场景的自由视点视频并呈现给用户。传感器的布置产生传感器数据流，每个传感器数据从不同的几何视角表示场景。传感器数据流被校准。从校准的传感器数据流生成场景代理。场景代理将场景几何描述为时间的函数，并且包括与当前流水线条件的第一组匹配的一种或多种类型的几何代理数据，以便最大化场景产生的自由视点视频的照片真实性代理在每个时间点。从场景代理产生现场的合成视点。该视点生成基于第二组当前流水线条件使当前合成视点的照片真实性最大化。显示当前的综合观点。

2. 发明申请

US20130100256A1 GENERATING A DEPTH MAP 有权
标题翻译：生成深度图
公开(公告)号：US20130100256A1
公开(公告)日：2013-04-25
申请号：US13278184
申请日：2011-10-21
申请人： Adam G. Kirk , Yaron Eshet , Kestutis Patiejunas , Sing Bing Kang , Charles Lawrence Zitnick, III , David Eraker , Simon Winder
发明人： Adam G. Kirk , Yaron Eshet , Kestutis Patiejunas , Sing Bing Kang , Charles Lawrence Zitnick, III , David Eraker , Simon Winder
IPC分类号： H04N13/02
CPC分类号： G06T7/0057 , G06T7/521 , G06T7/593 , G06T2207/10048
摘要： Methods and systems for generating a depth map are provided. The method includes projecting an infrared (IR) dot pattern onto a scene. The method also includes capturing stereo images from each of two or more synchronized IR cameras, detecting a number of dots within the stereo images, computing a number of feature descriptors for the dots in the stereo images, and computing a disparity map between the stereo images. The method further includes generating a depth map for the scene using the disparity map.
摘要翻译：提供了生成深度图的方法和系统。该方法包括将红外（IR）点图案投影到场景上。该方法还包括从两个或多个同步红外相机中的每一个捕获立体图像，检测立体图像内的多个点，计算立体图像中的点的特征描述符的数量，以及计算立体图像之间的视差图。该方法还包括使用视差图生成场景的深度图。

3. 发明授权

US08208731B2 Image descriptor quantization 有权
标题翻译：图像描述符量化
公开(公告)号：US08208731B2
公开(公告)日：2012-06-26
申请号：US12098458
申请日：2008-04-07
申请人： Simon Winder
发明人： Simon Winder
IPC分类号： G06K9/46 , G06K9/00 , G06K9/60
CPC分类号： G06K9/4671
摘要： Image descriptor quantization technique embodiments are presented which quantize an image descriptor defined by a vector of number elements. This is generally accomplished by lowering the number of bits per number element to a prescribed degree. The resulting quantized image descriptor exhibits minimal loss of matching reliability while at the same time reducing the amount of storage space needed to store the descriptor in a database. Lowering the number of bits per number element also allows for increased matching speed.
摘要翻译：提供了图像描述符量化技术实施例，其量化由数字元素的向量定义的图像描述符。这通常通过将每个元件的位数减少到规定的程度来实现。所产生的量化图像描述符表现出匹配可靠性的最小损失，同时减少将描述符存储在数据库中所需的存储空间量。降低每个数字元素的位数也允许增加匹配速度。

4. 发明申请

US20120114037A1 COMPRESSING AND DECOMPRESSING MULTIPLE, LAYERED, VIDEO STREAMS EMPLOYING MULTI-DIRECTIONAL SPATIAL ENCODING 有权
标题翻译：压缩和分解采用多方向空间编码的多层，多层视频流
公开(公告)号：US20120114037A1
公开(公告)日：2012-05-10
申请号：US13348262
申请日：2012-01-11
申请人： Simon Winder , Matthew T. Uyttendaele , Charles Lawrence Zitnick, III , Richard Szeliski , Sing Bing Kang
发明人： Simon Winder , Matthew T. Uyttendaele , Charles Lawrence Zitnick, III , Richard Szeliski , Sing Bing Kang
IPC分类号： H04N11/02
CPC分类号： H04N21/4347 , H04N13/111 , H04N19/109 , H04N19/39 , H04N19/593 , H04N19/597 , H04N19/61 , H04N19/70 , H04N19/96 , H04N21/2365
摘要： A process for compressing and decompressing non-keyframes in sequential sets of contemporaneous video frames making up multiple video streams where the video frames in a set depict substantially the same scene from different viewpoints. Each set of contemporaneous video frames has a plurality frames designated as keyframes with the remaining being non-keyframes. In one embodiment, the non-keyframes are compressed using a multi-directional spatial prediction technique. In another embodiment, the non-keyframes of each set of contemporaneous video frames are compressed using a combined chaining and spatial prediction compression technique. The spatial prediction compression technique employed can be a single direction technique where just one reference frame, and so one chain, is used to predict each non-keyframe, or it can be a multi-directional technique where two or more reference frames, and so chains, are used to predict each non-keyframe.
摘要翻译：一种用于在构成多个视频流的同步视频帧的顺序集合中压缩和解压缩非关键帧的过程，其中集合中的视频帧从不同视点描绘基本上相同的场景。每组同时期的视频帧具有指定为关键帧的多个帧，其余的是非关键帧。在一个实施例中，使用多方向空间预测技术来压缩非关键帧。在另一个实施例中，使用组合链接和空间预测压缩技术来压缩每组同时期视频帧的非关键帧。所使用的空间预测压缩技术可以是单向技术，其中仅使用一个参考帧，因此使用一条链来预测每个非关键帧，或者它可以是多方向技术，其中两个或更多个参考帧等链，用于预测每个非关键帧。

5. 发明授权

US07379583B2 Color segmentation-based stereo 3D reconstruction system and process employing overlapping images of a scene captured from viewpoints forming either a line or a grid 有权
标题翻译：基于颜色分割的立体3D重建系统和使用从形成线或网格的视点捕获的场景的重叠图像的过程
公开(公告)号：US07379583B2
公开(公告)日：2008-05-27
申请号：US11097529
申请日：2005-03-31
申请人： Charles Zitnick, III , Sing Bing Kang , Matthew Uyttendaele , Simon Winder , Richard Szeliski
发明人： Charles Zitnick, III , Sing Bing Kang , Matthew Uyttendaele , Simon Winder , Richard Szeliski
IPC分类号： G06K9/00
CPC分类号： G06K9/20 , G06K2209/40 , G06T7/55
摘要： A system and process for computing a 3D reconstruction of a scene from multiple images thereof, which is based on a color segmentation-based approach, is presented. First, each image is independently segmented. Second, an initial disparity space distribution (DSD) is computed for each segment, using the assumption that all pixels within a segment have the same disparity. Next, each segment's DSD is refined using neighboring segments and its projection into other images. The assumption that each segment has a single disparity is then relaxed during a disparity smoothing stage. The result is a disparity map for each image, which in turn can be used to compute a per pixel depth map if the reconstruction application calls for it.
摘要翻译：提出了一种用于基于基于颜色分割的方法从其多个图像计算场景的3D重建的系统和过程。首先，每个图像被独立地分割。第二，使用假设一个段内的所有像素具有相同的视差来为每个段计算初始视差空间分布（DSD）。接下来，每个段的DSD使用相邻段进行细化，并将其投影到其他图像中。然后在视差平滑阶段放宽每个段具有单个视差的假设。结果是每个图像的视差图，如果重建应用程序需要它，它又可以用于计算每像素深度图。

6. 发明授权

US07292257B2 Interactive viewpoint video system and process 有权
标题翻译：互动观点视频系统和过程
公开(公告)号：US07292257B2
公开(公告)日：2007-11-06
申请号：US10880774
申请日：2004-06-28
申请人： Sing Bing Kang , Charles Zitnick, III , Matthew Uyttendaele , Simon Winder , Richard Szeliski
发明人： Sing Bing Kang , Charles Zitnick, III , Matthew Uyttendaele , Simon Winder , Richard Szeliski
IPC分类号： G09G5/00 , G06T15/00 , G06T15/40 , G06K9/00
CPC分类号： H04N5/2627 , G06T7/557 , G06T7/596 , G06T15/205 , G06T2207/10021
摘要： A system and process for generating, and then rendering and displaying, an interactive viewpoint video in which a user can watch a dynamic scene while manipulating (freezing, slowing down, or reversing) time and changing the viewpoint at will. In general, the interactive viewpoint video is generated using a small number of cameras to capture multiple video streams. A multi-view 3D reconstruction and matting technique is employed to create a layered representation of the video frames that enables both efficient compression and interactive playback of the captured dynamic scene, while at the same time allowing for real-time rendering.
摘要翻译：一种用于生成并再现和显示交互视点视频的系统和过程，其中用户可以在操纵（冻结，减慢或反转）时间并随意改变视点的同时观看动态场景。通常，使用少量摄像机生成交互视点视频以捕获多个视频流。采用多视图3D重建和消隐技术来创建视频帧的分层表示，使得能够实现捕获的动态场景的高效压缩和交互式回放，同时允许实时渲染。

7. 发明申请

US20070179921A1 Object instance recognition using feature symbol triplets 有权
标题翻译：使用特征符号三元组的对象实例识别
公开(公告)号：US20070179921A1
公开(公告)日：2007-08-02
申请号：US11342218
申请日：2006-01-27
申请人： Charles Zitnick , Jie Sun , Richard Szeliski , Simon Winder
发明人： Charles Zitnick , Jie Sun , Richard Szeliski , Simon Winder
IPC分类号： G06F15/18
CPC分类号： G06K9/6211
摘要： A feature symbol triplets object instance recognizer and method for recognizing specific objects in a query image. Generally, the recognizer and method find repeatable features in the image, and match the repeatable features between a query image and a set of training images. More specifically, the recognizer and method finds features in the query image and then groups all possible combinations of three features in to feature triplets. Small regions or “patches” in the query image, and an affine transformation is applied to the patches to identify any similarity between patches in a query image and training images. The affine transformation is computed using position of neighboring features in each feature triplet. Next, all similar patches are found, and then pairs of images are aligned to determine if the patches agree in the position of the object. If they do, then it is said that object is found and identified.
摘要翻译：特征符号三元组对象实例识别器和方法，用于识别查询图像中的特定对象。通常，识别器和方法在图像中找到可重复的特征，并且匹配查询图像和一组训练图像之间的可重复特征。更具体地，识别器和方法在查询图像中发现特征，然后将三个特征的所有可能组合分组到特征三元组。查询图像中的小区域或“补丁”，并且仿射变换被应用于补丁以识别查询图像中的修补程序和训练图像之间的任何相似性。使用每个特征三元组中相邻特征的位置来计算仿射变换。接下来，找到所有相似的补丁，然后对对成对的图像以确定补丁是否在对象的位置上一致。如果他们这样做，那么就说发现和识别对象。

8. 发明授权

US07142209B2 Real-time rendering system and process for interactive viewpoint video that was generated using overlapping images of a scene captured from viewpoints forming a grid 有权
标题翻译：使用从形成网格的视点拍摄的场景的重叠图像生成的交互视点视频的实时渲染系统和处理
公开(公告)号：US07142209B2
公开(公告)日：2006-11-28
申请号：US11097549
申请日：2005-03-31
申请人： Matthew Uyttendaele , Simon Winder , Charles Zitnick, III , Richard Szeliski , Sing Bing Kang
发明人： Matthew Uyttendaele , Simon Winder , Charles Zitnick, III , Richard Szeliski , Sing Bing Kang
IPC分类号： G06T15/20
CPC分类号： G06T15/205 , G09G5/14 , G09G2320/0261 , G09G2340/10
摘要： A system and process for rendering and displaying an interactive viewpoint video is presented in which a user can watch a dynamic scene while manipulating (freezing, slowing down, or reversing) time and changing the viewpoint at will. The ability to interactively control viewpoint while watching a video is an exciting new application for image-based rendering. Because any intermediate view can be synthesized at any time, with the potential for space-time manipulation, this type of video has been dubbed interactive viewpoint video.
摘要翻译：呈现用于呈现和显示交互式视点视频的系统和过程，其中用户可以在操纵（冻结，减速或反转）时间并随意改变视点的同时观看动态场景。在观看视频时交互控制视点的能力是基于图像的渲染的令人兴奋的新应用。因为任何中间视图可以随时被合成，具有时空操纵的潜力，这种类型的视频被称为交互视点视频。

9. 发明授权

US07015926B2 System and process for generating a two-layer, 3D representation of a scene 有权
标题翻译：用于生成场景的两层3D表示的系统和过程
公开(公告)号：US07015926B2
公开(公告)日：2006-03-21
申请号：US10879235
申请日：2004-06-28
申请人： Charles Lawrence Zitnick, III , Richard Szeliski , Sing Bing Kang , Matthew T. Uyttendaele , Simon Winder
发明人： Charles Lawrence Zitnick, III , Richard Szeliski , Sing Bing Kang , Matthew T. Uyttendaele , Simon Winder
IPC分类号： G09G5/02
CPC分类号： G06T15/205
摘要： A system and process for generating a two-layer, 3D representation of a digital or digitized image from the image and a pixel disparity map of the image is presented. The two layer representation includes a main layer having pixels exhibiting background colors and background disparities associated with correspondingly located pixels of depth discontinuity areas in the image, as well as pixels exhibiting colors and disparities associated with correspondingly located pixels of the image not found in these depth discontinuity areas. The other layer is a boundary layer made up of pixels exhibiting foreground colors, foreground disparities and alpha values associated with the correspondingly located pixels of the depth discontinuity areas. The depth discontinuity areas correspond to prescribed sized areas surrounding depth discontinuities found in the image using a disparity map thereof.
摘要翻译：提出了一种用于从图像生成数字或数字化图像的二层3D表示和图像的像素视差图的系统和过程。两层表示包括具有显示背景颜色的像素和与图像中的深度不连续区域的相应定位的像素相关联的背景差异的主层以及与在这些深度中未找到的图像的相应定位的像素相关联的颜色和差异的像素不连续区域。另一层是由与前述深度不连续区域的对应位置的像素相关联的前景色，前景差异和α值的像素构成的边界层。深度不连续区域对应于使用其视差图在图像中发现的围绕深度不连续性的规定尺寸的区域。

10. 发明申请

US20050286757A1 Color segmentation-based stereo 3D reconstruction system and process 有权
标题翻译：基于颜色分割的立体3D重建系统和过程
公开(公告)号：US20050286757A1
公开(公告)日：2005-12-29
申请号：US10879327
申请日：2004-06-28
申请人： Charles Zitnick , Sing Kang , Matthew Uyttendaele , Simon Winder , Richard Szeliski
发明人： Charles Zitnick , Sing Kang , Matthew Uyttendaele , Simon Winder , Richard Szeliski
IPC分类号： G06K9/00 , G06T7/00
CPC分类号： G06K9/20 , G06K2209/40 , G06T7/55
摘要： A system and process for computing a 3D reconstruction of a scene from multiple images thereof, which is based on a color segmentation-based approach, is presented. First, each image is independently segmented. Second, an initial disparity space distribution (DSD) is computed for each segment, using the assumption that all pixels within a segment have the same disparity. Next, each segment's DSD is refined using neighboring segments and its projection into other images. The assumption that each segment has a single disparity is then relaxed during a disparity smoothing stage. The result is a disparity map for each image, which in turn can be used to compute a per pixel depth map if the reconstruction application calls for it.
摘要翻译：提出了一种用于基于基于颜色分割的方法从其多个图像计算场景的3D重建的系统和过程。首先，每个图像被独立地分割。第二，使用假设一个段内的所有像素具有相同的视差来为每个段计算初始视差空间分布（DSD）。接下来，每个段的DSD使用相邻段进行细化，并将其投影到其他图像中。然后在视差平滑阶段放宽每个段具有单个视差的假设。结果是每个图像的视差图，如果重建应用程序需要它，它又可以用于计算每像素深度图。

你已经成功收藏专利！

检索式保存成功!

IPRDB

热门服务

关于我们

友情链接

联系方式