专利快速检索-快速检索全球专利，免费商用专利数据库-IPRDB

1. 发明申请

US20170085863A1 METHOD OF CONVERTING 2D VIDEO TO 3D VIDEO USING MACHINE LEARNING 有权
公开(公告)号：US20170085863A1
公开(公告)日：2017-03-23
申请号：US14967939
申请日：2015-12-14
申请人： LEGEND3D, INC.
发明人： Anthony LOPEZ , Jacqueline McFARLAND , Tony BALDRIDGE
IPC分类号： H04N13/02 , H04N13/00
CPC分类号： H04N13/122 , G06T7/557 , G06T2207/20081 , H04N13/128 , H04N13/261
摘要： Machine learning method that learns to convert 2D video to 3D video from a set of training examples. Uses machine learning to perform any or all of the 2D to 3D conversion steps of identifying and locating objects, masking objects, modeling object depth, generating stereoscopic image pairs, and filling gaps created by pixel displacement for depth effects. Training examples comprise inputs and outputs for the conversion steps. The machine learning system generates transformation functions that generate the outputs from the inputs; these functions may then be used on new 2D videos to automate or semi-automate the conversion process. Operator input may be used to augment the results of the machine learning system. Illustrative representations for conversion data in the training examples include object tags to identify objects and locate their features, Bézier curves to mask object regions, and point clouds or geometric shapes to model object depth.

2. 发明授权

US09438878B2 Method of converting 2D video to 3D video using 3D object models 有权
标题翻译：使用3D对象模型将2D视频转换为3D视频的方法
公开(公告)号：US09438878B2
公开(公告)日：2016-09-06
申请号：US14857704
申请日：2015-09-17
申请人： LEGEND3D, Inc.
发明人： Vicente Niebla, Jr. , Tony Baldridge , Thomas Schad , Scott Jones
IPC分类号： G06K9/00 , H04N13/00 , H04N13/02
CPC分类号： H04N13/128 , G06T7/557 , H04N13/122 , H04N13/261
摘要： Method for converting 2D video to 3D video using 3D object models. Embodiments of the invention obtain a 3D object model for one or more objects in a 2D video scene, such as a character. Object models may for example be derived from 3D scanner data; planes, polygons, or surfaces may be fit to this data to generate a 3D model. In each frame in which a modeled object appears, the location and orientation of the 3D model may be determined in the frame, and a depth map for the object may be generated from the model. 3D video may be generated using the depth map. Embodiments may use feature tracking to automatically determine object location and orientation. Embodiments may use rigged 3D models with degrees of freedom to model objects with parts that move relative to one another.
摘要翻译：使用3D对象模型将2D视频转换为3D视频的方法。本发明的实施例为诸如字符的2D视频场景中的一个或多个对象获得3D对象模型。对象模型可以例如从3D扫描器数据导出; 平面，多边形或曲面可以适合该数据以生成3D模型。在其中出现建模对象的每个帧中，可以在帧中确定3D模型的位置和方向，并且可以从模型生成对象的深度图。可以使用深度图生成3D视频。实施例可以使用特征跟踪来自动确定对象位置和方位。实施例可以使用具有自由度的装配3D模型来对具有相对于彼此移动的部件来建模对象。

3. 发明授权

US09286941B2 Image sequence enhancement and motion picture project management system 有权
标题翻译：图像序列增强和电影项目管理系统
公开(公告)号：US09286941B2
公开(公告)日：2016-03-15
申请号：US14709300
申请日：2015-05-11
申请人： LEGEND3D, Inc.
发明人： Barry Sandrew , Tony Baldridge , Jared Sandrew , Anthony Lopez
IPC分类号： H04N5/93 , G11B27/031 , H04N13/02
CPC分类号： H04N13/261 , G11B27/031 , H04N13/257 , H04N13/266
摘要： The system enables conversion of black and white images to color images and/or two-dimensional images into three-dimensional images based on adding color and/or depth to images using masks for regions in the images, as well as reshaping of masks to cover objects that have moved and changed shape as the objects move in a sequence of images. Also, includes motion picture project management system for reviewers, coordinators and artists. Artists utilize image analysis and image enhancement and computer graphics processing for example to convert two-dimensional images into three-dimensional images or otherwise create or alter motion pictures. Enables the efficient management of projects related to motion pictures to enable enterprises to manage assets, control costs, predict budgets and profit margins, reduce archival storage and otherwise provide displays tailored to specific roles to increase worker efficiency.
摘要翻译：该系统能够基于使用图像中的区域的掩模对图像添加颜色和/或深度来将黑白图像转换为彩色图像和/或二维图像成为三维图像，以及重新整形掩模以覆盖随着对象在一系列图像中移动，已经移动和改变形状的对象。此外，还包括评审员，协调员和艺术家的电影项目管理系统。艺术家利用图像分析和图像增强以及计算机图形处理来例如将二维图像转换为三维图像或以其他方式创建或改变运动图像。实现与电影相关的项目的有效管理，使企业能够管理资产，控制成本，预测预算和利润率，减少档案存储，并提供针对特定角色定制的显示器，以提高工作效率。

4. 发明授权

US09609307B1 Method of converting 2D video to 3D video using machine learning 有权
公开(公告)号：US09609307B1
公开(公告)日：2017-03-28
申请号：US14967939
申请日：2015-12-14
申请人： LEGEND3D, INC.
发明人： Anthony Lopez , Jacqueline McFarland , Tony Baldridge
IPC分类号： G06K9/00 , H04N13/02 , H04N13/00
CPC分类号： H04N13/122 , G06T7/557 , G06T2207/20081 , H04N13/128 , H04N13/261
摘要： Machine learning method that learns to convert 2D video to 3D video from a set of training examples. Uses machine learning to perform any or all of the 2D to 3D conversion steps of identifying and locating objects, masking objects, modeling object depth, generating stereoscopic image pairs, and filling gaps created by pixel displacement for depth effects. Training examples comprise inputs and outputs for the conversion steps. The machine learning system generates transformation functions that generate the outputs from the inputs; these functions may then be used on new 2D videos to automate or semi-automate the conversion process. Operator input may be used to augment the results of the machine learning system. Illustrative representations for conversion data in the training examples include object tags to identify objects and locate their features, Bézier curves to mask object regions, and point clouds or geometric shapes to model object depth.

5. 发明授权

US09443555B2 Multi-stage production pipeline system 有权
公开(公告)号：US09443555B2
公开(公告)日：2016-09-13
申请号：US15050381
申请日：2016-02-22
申请人： LEGEND3D, Inc.
发明人： Barry Sandrew , Jared Sandrew , Nancy Wang , Craig Cesareo , James Prola , Jill Hunt , Anthony Lopez
IPC分类号： H04N7/18 , G11B27/031 , G11B27/34 , H04N21/472 , H04N13/00 , H04N13/02 , G06F17/30 , G06Q10/10 , H04N9/79
CPC分类号： G11B27/036 , G06F17/30247 , G06F17/30256 , G06F17/30268 , G06F17/30784 , G06F17/3082 , G06Q10/103 , G11B27/031 , G11B27/34 , H04N9/79 , H04N13/128 , H04N13/15 , H04N13/189 , H04N13/257 , H04N13/261 , H04N13/266 , H04N21/47205
摘要： Multi-stage production pipeline system that may be utilized in conjunction with a motion picture project management system. The multi-stage production pipeline system includes a computer and a database. The database includes metadata associated with at least one shot or associated with regions within the plurality of images in the at least one shot, or both. The computer includes a grouping tool interface for presenting user interface elements and accepting input of the metadata associated with the at least one shot or regions within the plurality of images in the at least one shot, or both. The system enables a large studio workforce to work non-linearly on a film while maintaining a unified vision driven by key creative figures, allowing for more consistent, higher quality, faster, less expensive work product and more efficient project management techniques. The system also enables reuse of project files, masks and other production elements across projects.

6. 发明授权

US09277122B1 System and method for removing camera rotation from a panoramic video 有权
标题翻译：从全景视频中删除相机旋转的系统和方法
公开(公告)号：US09277122B1
公开(公告)日：2016-03-01
申请号：US14825746
申请日：2015-08-13
申请人： Legend3D, Inc.
发明人： Ken Imura , Ryan Cummins
IPC分类号： H04N7/00 , H04N5/232 , G06T19/00 , G06T7/00
CPC分类号： H04N5/23238 , G06T7/246 , G06T7/292 , G06T7/73 , G06T19/003 , G06T19/006 , G06T2200/04 , G06T2207/10016 , H04N5/23254 , H04N5/23267 , H04N13/239
摘要： Removes undesirable camera rotation from a panoramic video. Video frames are mapped to a sphere and then projected to a forward-looking planar video. Camera tracking or other techniques are used to derive camera position and orientation in each frame. From the camera orientation, a correcting rotation is derived and is applied to the sphere onto which the panoramic video was mapped. Re-projecting video from the rotation-corrected sphere reduces or eliminates camera rotation artifacts from the panoramic video. Rotation may be re-introduced and other visual effects may be added to the stabilized video. May be utilized in 2D virtual reality and augmented reality displays. Depth may be accepted by the system for objects in the video and utilized to create 3D stereoscopic virtual reality and augmented reality displays.
摘要翻译：从全景视频中移除不需要的相机旋转。视频帧映射到球体，然后投影到前瞻性平面视频。摄像机跟踪或其他技术用于获取每帧中的摄像机位置和方位。从相机方向，导出校正旋转并将其应用于全景视频映射到的球体上。从旋转校正球重新投影视频会减少或消除全景视频中的相机旋转伪影。可以重新引入旋转，并且可以将其他视觉效果添加到稳定视频中。可用于2D虚拟现实和增强现实显示。深度可以由系统接受视频中的对象并用于创建3D立体虚拟现实和增强现实显示。

7. 发明申请

US20150358612A1 SYSTEM AND METHOD FOR REAL-TIME DEPTH MODIFICATION OF STEREO IMAGES OF A VIRTUAL REALITY ENVIRONMENT 有权
标题翻译：虚拟现实环境立体图像实时深度修改的系统与方法
公开(公告)号：US20150358612A1
公开(公告)日：2015-12-10
申请号：US14827422
申请日：2015-08-17
申请人： LEGEND3D, Inc.
发明人： Jared SANDREW , Tony BALDRIDGE , Anthony LOPEZ , Jacqueline MCFARLAND , Scott JONES , Thomas SCHAD
IPC分类号： H04N13/02 , H04N5/232
CPC分类号： H04N13/271 , G06T15/205 , G06T17/00 , H04N5/23238 , H04N13/122 , H04N13/128 , H04N13/243 , H04N13/257 , H04N13/261 , H04N13/296
摘要： Enables real-time depth modifications to stereo images of a 3D virtual reality environment locally and for example without iterative workflow involving region designers or depth artists that includes re-rendering these images from the original 3D model. Embodiments generate a spherical translation map from the 3D model of the virtual environment; this spherical translation map is a function of the pixel shifts between left and right stereo images for each point of the sphere surrounding the viewer of the virtual environment. Modifications may be made directly to the spherical translation map, and applied directly to the stereo images, without requiring re-rendering of the scene from the complete 3D model. This process enables depth modifications to be viewed in real-time, greatly improving the efficiency of the 3D model creation, review, and update cycle.
摘要翻译：实现对本地3D虚拟现实环境的立体图像进行实时深度修改，例如，无需涉及区域设计师或深度艺术家的迭代工作流程，包括从原始3D模型重新渲染这些图像。实施例从虚拟环境的3D模型生成球面平移图; 该球面平移映射是围绕虚拟环境的观察者的球体的每个点的左和右立体图像之间的像素移动的函数。可以直接对球面平移图进行修改，并且直接应用于立体图像，而不需要从完整的3D模型重新渲染场景。该过程使得能够实时观察深度修改，大大提高了3D模型创建，审查和更新周期的效率。

8. 发明授权

US09595296B2 Multi-stage production pipeline system 有权
标题翻译：多级生产管道系统
公开(公告)号：US09595296B2
公开(公告)日：2017-03-14
申请号：US15263077
申请日：2016-09-12
申请人： LEGEND3D, Inc.
发明人： Barry Sandrew , Jared Sandrew , Nancy Wang , Craig Cesareo , James Prola , Jill Hunt , Anthony Lopez
IPC分类号： H04N5/93 , G11B27/036 , H04N13/02 , G11B27/34 , H04N13/00 , G06F17/30
CPC分类号： G11B27/036 , G06F17/30247 , G06F17/30256 , G06F17/30268 , G06F17/30784 , G06F17/3082 , G06Q10/103 , G11B27/031 , G11B27/34 , H04N9/79 , H04N13/128 , H04N13/15 , H04N13/189 , H04N13/257 , H04N13/261 , H04N13/266 , H04N21/47205
摘要： Multi-stage production pipeline system that may be utilized in conjunction with a motion picture project management system. The multi-stage production pipeline system includes a computer and a database. The database includes metadata associated with at least one shot or associated with regions within the plurality of images in the at least one shot, or both. The computer includes a grouping tool interface for presenting user interface elements and accepting input of the metadata associated with the at least one shot or regions within the plurality of images in the at least one shot, or both. The system enables a large studio workforce to work non-linearly on a film while maintaining a unified vision driven by key creative figures, allowing for more consistent, higher quality, faster, less expensive work product and more efficient project management techniques. The system also enables reuse of project files, masks and other production elements across projects.
摘要翻译：可以与电影项目管理系统结合使用的多阶段生产管道系统。多级生产管道系统包括计算机和数据库。数据库包括与至少一个镜头相关联的元数据，或者与至少一个镜头中的多个图像内的区域相关联的元数据，或两者。计算机包括分组工具界面，用于呈现用户界面元素并接受与至少一个镜头中的多个图像中的至少一个镜头或区域相关联的元数据的输入，或两者兼容。该系统使大型演播室工作人员在电影上非线性地工作，同时保持由关键创意人物驱动的统一视觉，从而实现更一致，更高质量，更快，更便宜的工作产品和更有效的项目管理技术。该系统还可以跨项目重用项目文件，掩码和其他生产要素。

9. 发明授权

US09407904B2 Method for creating 3D virtual reality from 2D images 有权
标题翻译：从2D图像创建3D虚拟现实的方法
公开(公告)号：US09407904B2
公开(公告)日：2016-08-02
申请号：US14709327
申请日：2015-05-11
申请人： LEGEND3D, Inc.
发明人： Jared Sandrew , Tony Baldridge , Jacqueline McFarland , Scott Jones , Thomas Schad
IPC分类号： G06K9/00 , H04N13/02 , H04N13/00 , G06T15/20 , G06T17/00
CPC分类号： H04N13/271 , G06T15/205 , G06T17/00 , H04N13/122 , H04N13/128 , H04N13/261
摘要： A method that enables creation of a 3D virtual reality environment from a series of 2D images of a scene. Embodiments map 2D images onto a sphere to create a composite spherical image, divide the composite image into regions, and add depth information to the regions. Depth information may be generated by mapping regions onto flat or curved surfaces, and positioning these surfaces in 3D space. Some embodiments enable inserting, removing, or extending objects in the scene, adding or modifying depth information as needed. The final composite image and depth information are projected back onto one or more spheres, and then projected onto left and right eye image planes to form a 3D stereoscopic image for a viewer of the virtual reality environment. Embodiments enable 3D images to be generated dynamically for the viewer in response to changes in the viewer's position and orientation in the virtual reality environment.
摘要翻译：一种能够从场景的一系列2D图像创建3D虚拟现实环境的方法。实施例将2D图像映射到球体上以创建复合球形图像，将合成图像划分为区域，并向该区域添加深度信息。可以通过将区域映射到平面或曲面上并将这些表面定位在3D空间中来产生深度信息。一些实施例能够插入，移除或扩展场景中的对象，根据需要添加或修改深度信息。将最终的合成图像和深度信息投射回到一个或多个球体上，然后投影到左眼和右眼图像平面上，以形成用于虚拟现实环境的观看者的3D立体图像。实施例能够响应于观众在虚拟现实环境中的位置和取向的变化而动态地为观众生成3D图像。

10. 发明授权

US09282321B2 3D model multi-reviewer system 有权
标题翻译： 3D模型多评审系统
公开(公告)号：US09282321B2
公开(公告)日：2016-03-08
申请号：US14827482
申请日：2015-08-17
申请人： LEGEND3D, Inc.
发明人： Jared Sandrew , Tony Baldridge , Anthony Lopez , Jacqueline McFarland , Scott Jones , Thomas Schad
IPC分类号： G06K9/00 , H04N13/02 , H04N5/232
CPC分类号： H04N13/271 , G06T15/205 , G06T17/00 , H04N5/23238 , H04N13/122 , H04N13/128 , H04N13/243 , H04N13/257 , H04N13/261 , H04N13/296
摘要： A system that coordinates multiple simultaneous reviews of a 3D model, potentially from different viewpoints. Embodiments support multiple reviewers using review stations that render images of the model based on the pose of the reviewer. For example, multiple reviewers may use virtual reality headsets to observe a 3D virtual environment from different orientations. A coordinator uses a coordinator station to observe the entire 3D model and the viewpoints of each of the reviewers in this 3D model. Embodiments may support reviewer designation of regions within the model that require review or modification; these designated regions are also displayed on the coordinator station. Embodiments may support real time updates to the 3D model and propagation of updated images to the coordinator and to the multiple viewers.
摘要翻译：协调多个同时评估3D模型的系统，可能来自不同的观点。实施例支持使用审查站的多个审阅者，其基于审阅者的姿态来渲染模型的图像。例如，多个审阅者可以使用虚拟现实耳机来从不同的方向观察3D虚拟环境。协调员使用协调台来观察整个3D模型以及该3D模型中每个评论者的观点。实施例可以支持审查者指定模型内需要审查或修改的区域; 这些指定的区域也显示在协调台上。实施例可以支持3D模型的实时更新和更新的图像向协调器和多个观看者的传播。

你已经成功收藏专利！

检索式保存成功!

IPRDB

热门服务

关于我们

友情链接

联系方式