CN110249626A - 增强现实图像的实现方法、装置、终端设备和存储介质 - Google Patents

增强现实图像的实现方法、装置、终端设备和存储介质 Download PDF

Info

Publication number
CN110249626A
CN110249626A CN201780055279.5A CN201780055279A CN110249626A CN 110249626 A CN110249626 A CN 110249626A CN 201780055279 A CN201780055279 A CN 201780055279A CN 110249626 A CN110249626 A CN 110249626A
Authority
CN
China
Prior art keywords
scheme
frame image
posture
shooting
dimensional
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201780055279.5A
Other languages
English (en)
Other versions
CN110249626B (zh
Inventor
王志斌
覃华峥
汪倩怡
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Publication of CN110249626A publication Critical patent/CN110249626A/zh
Application granted granted Critical
Publication of CN110249626B publication Critical patent/CN110249626B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00—3D [Three Dimensional] image rendering
    • G06T15/005—General purpose rendering architectures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30244—Camera pose
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/008—Cut plane or projection plane definition
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/20—Indexing scheme for editing of 3D models
    • G06T2219/2016—Rotation, translation, scaling

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Graphics (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Computer Hardware Design (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Architecture (AREA)
  • Quality & Reliability (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Processing Or Creating Images (AREA)
  • Studio Devices (AREA)

Abstract

本申请公开了增强现实图像的实现方案。其中，增强现实图像的实现方法包括：获取一帧图像以及在拍摄该帧图像时摄像头的姿态方向；确定当摄像头以一种拍摄方式拍摄时在一个三维直角坐标系中的取景区域；确定处于所述取景区域内的二维图形，并获取所确定的每个二维图形的位置参考点的三维坐标；对于所确定的每个二维图形，基于该二维图形的转动基准点而调节姿态，以使得该二维图形与姿态方向呈预定夹角，并获取姿态被调节后的二维图形的位置参考点的三维坐标；通过透视投影变换，将该二维图形的位置参考点的三维坐标投影为相应的平面投影区域上的二维坐标，并根据二维坐标将该二维图形渲染在该帧图像上。

Description

PCT国内申请，说明书已公开。

Claims (32)

  1. PCT国内申请，权利要求书已公开。
CN201780055279.5A 2017-10-26 2017-10-26 增强现实图像的实现方法、装置、终端设备和存储介质 Active CN110249626B (zh)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/107816 WO2019080047A1 (zh) 2017-10-26 2017-10-26 增强现实图像的实现方法、装置、终端设备和存储介质

Publications (2)

Publication Number Publication Date
CN110249626A true CN110249626A (zh) 2019-09-17
CN110249626B CN110249626B (zh) 2020-07-31

Family

ID=66247764

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201780055279.5A Active CN110249626B (zh) 2017-10-26 2017-10-26 增强现实图像的实现方法、装置、终端设备和存储介质

Country Status (3)

Country Link
US (1) US11074755B2 (zh)
CN (1) CN110249626B (zh)
WO (1) WO2019080047A1 (zh)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110751736A (zh) * 2019-10-11 2020-02-04 彩讯科技股份有限公司 一种ar模型生成方法、装置、终端和存储介质
CN112435312A (zh) * 2020-09-04 2021-03-02 上海哔哩哔哩科技有限公司 运动轨迹的生成方法、装置、计算机设备和可读存储介质
CN112783585A (zh) * 2020-07-21 2021-05-11 华人运通(上海)云计算科技有限公司 界面调整方法、装置、电子设备、车辆及存储介质
CN113450434A (zh) * 2020-03-27 2021-09-28 北京沃东天骏信息技术有限公司 一种生成动态图像的方法和装置
WO2021248921A1 (en) * 2020-06-10 2021-12-16 Mediatek Inc. Video processing method for remapping sample locations in projection-based frame with hemisphere cubemap projection layout to locations on sphere and associated video processing apparatus
WO2023056879A1 (zh) * 2021-10-08 2023-04-13 北京字跳网络技术有限公司 一种模型处理方法、装置、设备及介质
CN116342784A (zh) * 2023-05-25 2023-06-27 湖南马栏山视频先进技术研究院有限公司 大场景水体交互的实时渲染方法

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113426117B (zh) * 2021-06-23 2024-03-01 网易（杭州）网络有限公司 虚拟相机拍摄参数获取方法、装置、电子设备和存储介质
CN113593054B (zh) * 2021-10-08 2022-01-25 泰山信息科技有限公司 一种图形三维旋转和透视方法、装置、设备
CN114640838B (zh) * 2022-03-15 2023-08-25 北京奇艺世纪科技有限公司 画面合成方法、装置、电子设备及可读存储介质

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101881922A (zh) * 2010-05-26 2010-11-10 程亚奇 真三维显示系统
CN103077546A (zh) * 2012-12-27 2013-05-01 江苏太奇通软件有限公司 二维图形的三维透视变换方法
US20140002439A1 (en) * 2012-06-28 2014-01-02 James D. Lynch Alternate Viewpoint Image Enhancement
CN104094318A (zh) * 2011-12-13 2014-10-08 索利德阿尼姆公司 适用于拍摄视频电影的系统
CN104322052A (zh) * 2012-05-09 2015-01-28 恩卡姆技术有限公司 用于实时混合或复合计算机生成的三维对象和电影摄影机馈送视频的系统
US20160163075A1 (en) * 2014-12-05 2016-06-09 Hanwha Techwin Co., Ltd. Device and method of displaying heat map on perspective drawing

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3519253B2 (ja) * 1997-10-28 2004-04-12 株式会社ソニー・コンピュータエンタテインメント 情報処理装置、および情報処理方法
US20070248283A1 (en) * 2006-04-21 2007-10-25 Mack Newton E Method and apparatus for a wide area virtual scene preview system
US9699438B2 (en) * 2010-07-02 2017-07-04 Disney Enterprises, Inc. 3D graphic insertion for live action stereoscopic video
KR101699847B1 (ko) * 2010-12-21 2017-01-25 삼성전자주식회사 ３차원 그래픽 렌더링을 위한 클리핑 장치 및 방법
JP5872923B2 (ja) * 2012-02-22 2016-03-01 株式会社マイクロネット Ａｒ画像処理装置及び方法
US20140375684A1 (en) * 2013-02-17 2014-12-25 Cherif Atia Algreatly Augmented Reality Technology
RU2669680C2 (ru) * 2013-03-21 2018-10-12 Конинклейке Филипс Н.В. Инициализация модели на основе классификации видов
JP5887310B2 (ja) * 2013-07-29 2016-03-16 京セラドキュメントソリューションズ株式会社 表示操作装置
KR20150141426A (ko) * 2014-06-10 2015-12-18 삼성전자주식회사 전자 장치 및 전자 장치에서의 이미지 처리 방법
US20160180441A1 (en) * 2014-12-22 2016-06-23 Amazon Technologies, Inc. Item preview image generation
US9956054B2 (en) * 2015-06-25 2018-05-01 EchoPixel, Inc. Dynamic minimally invasive surgical-aware assistant
KR101666561B1 (ko) * 2015-07-13 2016-10-24 한국과학기술원 증강 공간 내 부분 공간 획득 시스템 및 방법
JP6360509B2 (ja) * 2016-02-25 2018-07-18 任天堂株式会社 情報処理プログラム、情報処理システム、情報処理方法、および情報処理装置
US10134190B2 (en) * 2016-06-14 2018-11-20 Microsoft Technology Licensing, Llc User-height-based rendering system for augmented reality objects
FR3053501B1 (fr) * 2016-06-29 2018-11-09 Safran Identity & Security Procede d'authentification de documents au moyen d'un terminal mobile de telecommunication
EP3291531A1 (en) * 2016-09-06 2018-03-07 Thomson Licensing Methods, devices and systems for automatic zoom when playing an augmented reality scene
US11249304B2 (en) * 2016-12-02 2022-02-15 Disney Enterprises, Inc. Augmented reality camera frustum

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101881922A (zh) * 2010-05-26 2010-11-10 程亚奇 真三维显示系统
CN104094318A (zh) * 2011-12-13 2014-10-08 索利德阿尼姆公司 适用于拍摄视频电影的系统
CN104322052A (zh) * 2012-05-09 2015-01-28 恩卡姆技术有限公司 用于实时混合或复合计算机生成的三维对象和电影摄影机馈送视频的系统
US20140002439A1 (en) * 2012-06-28 2014-01-02 James D. Lynch Alternate Viewpoint Image Enhancement
CN103077546A (zh) * 2012-12-27 2013-05-01 江苏太奇通软件有限公司 二维图形的三维透视变换方法
US20160163075A1 (en) * 2014-12-05 2016-06-09 Hanwha Techwin Co., Ltd. Device and method of displaying heat map on perspective drawing

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110751736A (zh) * 2019-10-11 2020-02-04 彩讯科技股份有限公司 一种ar模型生成方法、装置、终端和存储介质
CN110751736B (zh) * 2019-10-11 2023-06-16 彩讯科技股份有限公司 一种ar模型生成方法、装置、终端和存储介质
CN113450434A (zh) * 2020-03-27 2021-09-28 北京沃东天骏信息技术有限公司 一种生成动态图像的方法和装置
WO2021248921A1 (en) * 2020-06-10 2021-12-16 Mediatek Inc. Video processing method for remapping sample locations in projection-based frame with hemisphere cubemap projection layout to locations on sphere and associated video processing apparatus
US11263722B2 (en) 2020-06-10 2022-03-01 Mediatek Inc. Video processing method for remapping sample locations in projection-based frame with hemisphere cubemap projection layout to locations on sphere and associated video processing apparatus
US11663690B2 (en) 2020-06-10 2023-05-30 Mediatek Inc. Video processing method for remapping sample locations in projection-based frame with projection layout to locations on sphere and associated video processing apparatus
CN112783585A (zh) * 2020-07-21 2021-05-11 华人运通(上海)云计算科技有限公司 界面调整方法、装置、电子设备、车辆及存储介质
CN112435312A (zh) * 2020-09-04 2021-03-02 上海哔哩哔哩科技有限公司 运动轨迹的生成方法、装置、计算机设备和可读存储介质
CN112435312B (zh) * 2020-09-04 2023-04-11 上海哔哩哔哩科技有限公司 运动轨迹的生成方法、装置、计算机设备和可读存储介质
WO2023056879A1 (zh) * 2021-10-08 2023-04-13 北京字跳网络技术有限公司 一种模型处理方法、装置、设备及介质
CN116342784A (zh) * 2023-05-25 2023-06-27 湖南马栏山视频先进技术研究院有限公司 大场景水体交互的实时渲染方法
CN116342784B (zh) * 2023-05-25 2023-07-21 湖南马栏山视频先进技术研究院有限公司 大场景水体交互的实时渲染方法

Also Published As

Publication number Publication date
CN110249626B (zh) 2020-07-31
US11074755B2 (en) 2021-07-27
US20200035034A1 (en) 2020-01-30
WO2019080047A1 (zh) 2019-05-02

Similar Documents

Publication Publication Date Title
CN110249626A (zh) 增强现实图像的实现方法、装置、终端设备和存储介质
JP6643357B2 (ja) 全球状取込方法
US11282264B2 (en) Virtual reality content display method and apparatus
CN107646126B (zh) 用于移动设备的相机姿态估计
US10127722B2 (en) Mobile capture visualization incorporating three-dimensional and two-dimensional imagery
US11272165B2 (en) Image processing method and device
EP3057066B1 (en) Generation of three-dimensional imagery from a two-dimensional image using a depth map
CN110825234A (zh) 一种面向工业场景的投影式增强现实跟踪显示方法和系统
CN110176032A (zh) 一种三维重建方法及装置
CN111161336B (zh) 三维重建方法、三维重建装置和计算机可读存储介质
US9165397B2 (en) Texture blending between view-dependent texture and base texture in a geographic information system
CN111737518A (zh) 基于三维场景模型的图像展示方法、装置及电子设备
EP3533218B1 (en) Simulating depth of field
WO2021146418A1 (en) Structuring visual data
CN114549289A (zh) 图像处理方法、装置、电子设备和计算机存储介质
CN116057577A (zh) 用于增强现实的地图
WO2023056879A1 (zh) 一种模型处理方法、装置、设备及介质
US20220406003A1 (en) Viewpoint path stabilization
WO2018195892A1 (zh) 三维立体水印添加方法、装置及终端
Tschirschwitz et al. Interactive 3D visualisation of architectural models and point clouds using low-cost-systems
US7408545B1 (en) Method and system for rendering concentric mosaics
JP6859763B2 (ja) プログラム、情報処理装置
CN109669602A (zh) 虚拟现实的数据交互方法、装置及系统
CN111612883B (zh) 立方体贴图的处理方法、装置和存储介质
JP2005322097A (ja) 対象物像モデルのアニメーション表示装置、対象物像モデルのアニメーション表示方法および対象物像モデルのアニメーション表示プログラム

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant