CN116248997A - Method and device for comparing pictures of decoration effect picture camera - Google Patents

Method and device for comparing pictures of decoration effect picture camera Download PDF

Info

Publication number
CN116248997A
CN116248997A CN202211562496.2A CN202211562496A CN116248997A CN 116248997 A CN116248997 A CN 116248997A CN 202211562496 A CN202211562496 A CN 202211562496A CN 116248997 A CN116248997 A CN 116248997A
Authority
CN
China
Prior art keywords
camera
picture
decoration
decoration effect
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211562496.2A
Other languages
Chinese (zh)
Inventor
郑宇洁
尤凯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Qunhe Information Technology Co Ltd
Original Assignee
Hangzhou Qunhe Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Qunhe Information Technology Co Ltd filed Critical Hangzhou Qunhe Information Technology Co Ltd
Priority to CN202211562496.2A priority Critical patent/CN116248997A/en
Publication of CN116248997A publication Critical patent/CN116248997A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00Diagnosis, testing or measuring for television systems or their details
    • H04N17/002Diagnosis, testing or measuring for television systems or their details for television cameras
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01CMEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/10Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration
    • G01C21/12Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning
    • G01C21/16Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 by using measurements of speed or acceleration executed aboard the object being navigated; Dead reckoning by integrating acceleration or speed, i.e. inertial navigation

Landscapes

  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Automation & Control Theory (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The invention provides a method and a device for comparing a decoration effect picture with a camera picture. The method comprises the following steps: presenting a panoramic image through a panoramic image display interface and presenting a camera picture through a camera shooting interface in the same display screen; activating a panorama and camera picture linkage display mode in response to user operation; responsive to a user adjusting the camera position and pose, calculating camera position and pose data in real time; and updating the panoramic image according to the position and the gesture of the camera, and displaying the updated panoramic image and the camera picture in a linkage way. The invention realizes the same screen display and linkage of the panoramic image and the real-time image of the camera, and as the user carries the mobile phone to move in the house, the mobile phone screen can be linked to display the real-time image of the camera and the panoramic image corresponding to the real-time image, thereby achieving the effect of 'real-time linkage synchronization of the image shot by the user and the panoramic image', and facilitating the examination of the distinction between the actual house and the design effect.

Description

一种对比装修效果图相机画面的方法及装置A method and device for comparing camera images of decoration renderings

技术领域technical field

本发明属于装修设计技术和虚拟现实技术领域,具体涉及一种对比装修效果图和相机画面的方法及装置。The invention belongs to the field of decoration design technology and virtual reality technology, and in particular relates to a method and device for comparing decoration renderings and camera images.

背景技术Background technique

为查验实际房屋和装修设计效果之间的差别,传统做法是用户携带纸质效果图进入房屋验收,通过人眼观察对比效果图,想象设计效果。传统方式的缺点显著,至少包括:纸质效果图携带不便;无法身临其境地感受设计效果,依赖用户想象;验收问题记录难以留存等等。In order to check the difference between the actual house and the decoration design effect, the traditional method is that the user enters the house with a paper rendering, observes and compares the renderings with human eyes, and imagines the design effect. The disadvantages of the traditional method are obvious, at least including: the paper renderings are inconvenient to carry; the inability to feel the design effect in person, relying on the user's imagination; it is difficult to keep records of acceptance problems, etc.

发明内容Contents of the invention

为克服现有技术中存在的上述缺陷,本发明的目的是提供一种对比装修效果图和相机画面的方法及装置。In order to overcome the above-mentioned defects existing in the prior art, the object of the present invention is to provide a method and device for comparing decoration renderings and camera images.

第一方面,本申请实施例提供一种对比装修效果图和相机画面的方法,包括:In the first aspect, the embodiment of the present application provides a method for comparing the decoration renderings and the camera images, including:

在同一显示屏中通过全景图展示界面呈现装修效果图以及通过相机拍摄界面呈现相机画面;In the same display screen, the decoration renderings are presented through the panorama display interface and the camera image is presented through the camera shooting interface;

响应于用户操作激活装修效果图与相机画面联动显示模式;Activate the linkage display mode of decoration renderings and camera screens in response to user operations;

响应于用户调整相机位置和姿态的操作,实时计算相机位置和姿态数据;In response to the user's operation of adjusting the camera's position and attitude, calculate the camera's position and attitude data in real time;

根据相机的位置和姿态更新装修效果图,联动显示更新后的装修效果图与相机画面。The decoration renderings are updated according to the position and posture of the camera, and the updated decoration renderings and the camera screen are displayed in linkage.

上述方案提供的对比装修效果图和相机画面的方法实现了全景图和相机实时画面的同屏显示和联动,提高了用户查验实际房屋和设计效果区别的效率。The method of comparing the decoration effect map and the camera image provided by the above scheme realizes the same-screen display and linkage of the panorama image and the camera real-time image, and improves the efficiency for users to check the difference between the actual house and the design effect.

在一些可行的实施例中,装修效果图是房屋装修设计效果的全景图。In some feasible embodiments, the decoration effect picture is a panoramic picture of house decoration design effect.

在一些可行的实施例中,所述相机搭载于手持终端设备或者可穿戴智能设备;所述手持终端设备或者可穿戴智能设备还搭载有惯性传感器。In some feasible embodiments, the camera is mounted on a handheld terminal device or a wearable smart device; and the handheld terminal device or wearable smart device is also equipped with an inertial sensor.

在一些可行的实施例中,还包括:In some feasible embodiments, it also includes:

根据用户指令相机进行拍照生成实景照片;According to the user's instruction, the camera takes pictures to generate real-scene photos;

将实景照片和对应的装修效果图生成同屏对比图片。Generate a comparison picture on the same screen with the real-scene photos and the corresponding decoration renderings.

在一些可行的实施例中,还包括:In some feasible embodiments, it also includes:

响应于用户操作,针对同屏对比图片增加标注信息。In response to user operations, add annotation information for the same-screen comparison pictures.

该方案进一步提供了拍照留档功能和标注功能,可成为交付过程的资料。This solution further provides the function of taking pictures and keeping files and marking functions, which can be used as materials in the delivery process.

在一些可行的实施例中,全景图展示界面中还显示缩略户型图;In some feasible embodiments, the thumbnail floor plan is also displayed in the panorama display interface;

缩略户型图设有视角指示图,用于指示全景图的观察视角和位置。The thumbnail floor plan is provided with an angle of view indicator, which is used to indicate the observation angle and position of the panorama.

在一些可行的实施例中,所述根据相机的位置和姿态更新装修效果图包括:In some feasible embodiments, said updating the decoration effect map according to the position and posture of the camera includes:

根据相机的位置和姿态计算更新相机的位置和视角;Calculate and update the position and angle of view of the camera according to the position and attitude of the camera;

将装修效果图的位置和视角更新为相机位置和视角。Update the position and perspective of the decoration renderings to the camera position and perspective.

第二方面,本申请实施例提供一种对比装修效果图和相机画面的装置,包括:In the second aspect, the embodiment of the present application provides a device for comparing decoration renderings and camera images, including:

显示单元,用于在同一显示屏中通过全景图展示界面呈现装修效果图以及通过相机拍摄界面呈现相机画面;The display unit is used to present the decoration renderings through the panorama display interface and the camera image through the camera shooting interface on the same display screen;

显示模式确定单元,用于响应于用户操作激活装修效果图与相机画面联动显示模式;A display mode determination unit, configured to activate the linkage display mode of decoration renderings and camera images in response to user operations;

计算单元,用于响应于用户调整相机位置和姿态的操作,实时计算相机位置和姿态数据;a computing unit, configured to calculate camera position and posture data in real time in response to the user's operation of adjusting the camera position and posture;

联动更新单元,用于根据相机的位置和姿态更新装修效果图,联动显示更新后的装修效果图与相机画面。The linkage updating unit is used for updating the decoration rendering according to the position and posture of the camera, and linkage displaying the updated decoration rendering and the camera screen.

第三方面,本申请实施例提供一种电子设备,包括:处理器、通信接口、存储器和通信总线;其中,所述处理器、所述通信接口以及所述存储器通过所述通信总线完成相互间的通信;所述存储器,用于存放计算机程序;所述处理器,用于执行存储器上所存放的程序时,实现如前述第一方面任一项所述的方法。In the third aspect, the embodiment of the present application provides an electronic device, including: a processor, a communication interface, a memory, and a communication bus; wherein, the processor, the communication interface, and the memory complete the mutual communication through the communication bus communication; the memory is used to store computer programs; and the processor is used to implement the method as described in any one of the first aspect when executing the programs stored in the memory.

第四方面,本申请实施例提供一种计算机可读存储介质,其上存储有指令,当由一个或多个处理器执行时,使得所述处理器执行如前述第一方面任一项所述的方法。In the fourth aspect, the embodiment of the present application provides a computer-readable storage medium, on which instructions are stored, and when executed by one or more processors, the processors perform the operation described in any one of the foregoing first aspects. Methods.

本发明的有益效果在于:The beneficial effects of the present invention are:

本发明实现了全景图和相机实时画面的同屏显示和联动,并且提供拍照留档功能和标注功能,摆脱了需要携带纸质效果图前往房屋验收、依赖“人眼对比、人脑想象”的束缚,提高了用户查验实际房屋和设计效果之间区别的效率;用户可以通过同屏、同视角的画面实时对比,而且可以及时拍照和标注;拍照对比图片可以留存在电子设备,沉淀为交付过程的资料。The present invention realizes the same-screen display and linkage of the panoramic image and the real-time image of the camera, and provides the function of taking photos and keeping files and marking functions, and gets rid of the need to carry paper renderings to the house for inspection and acceptance, and relying on "human eye comparison and human brain imagination" Constraints improve the efficiency for users to check the difference between the actual house and the design effect; users can compare images on the same screen and from the same perspective in real time, and can take pictures and mark them in time; pictures taken and compared can be stored in electronic devices and precipitated into the delivery process data of.

附图说明Description of drawings

图1本申请实施例提供的一种对比装修效果图和相机画面的方法流程示意图;Fig. 1 is a schematic flow chart of a method for comparing decoration renderings and camera images provided in the embodiment of the present application;

图2本申请实施例提供的又一种对比装修效果图和相机画面的方法流程示意图;Fig. 2 is a schematic flow chart of another method for comparing decoration renderings and camera images provided by the embodiment of the present application;

图3本申请实施例提供的对比装修效果图和相机画面的展示效果示意图。Fig. 3 is a schematic diagram showing the comparison of the decoration renderings and the display effect of the camera screen provided by the embodiment of the present application.

具体实施方式Detailed ways

以下结合附图及实施例,对本发明进行进一步详细说明。应当理解,此处所描述的具体实施例仅仅用以解释本发明,并不用于限定本发明。The present invention will be described in further detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

本申请实施例提供一种对比装修效果图和相机画面的方法及装置。具体而言,本申请实施例的对比装修效果图和相机画面的方法可以由装配了相机和惯性传感器的终端执行,该终端可以为智能手机、平板电脑、笔记本电脑等;也可以由终端和服务器协同执行,服务器用于存储,以及根据终端发送的位置和姿态数据实时生成装修效果图,通过通信网络传送给终端予以显示。The embodiment of the present application provides a method and device for comparing a decoration effect drawing with a camera picture. Specifically, the method for comparing decoration renderings and camera images in the embodiment of the present application can be performed by a terminal equipped with a camera and an inertial sensor, and the terminal can be a smart phone, a tablet computer, a notebook computer, etc.; it can also be performed by a terminal and a server Collaborative execution, the server is used for storage, and real-time generation of decoration renderings based on the position and attitude data sent by the terminal, which is transmitted to the terminal for display through the communication network.

当本实施例提供的对比装修效果图和相机画面的方法运行于终端时,终端需首先下载安装相关的应用程序并存储,终端在实际运行前述方法时,用于呈现相关的页面,以及空间、场景等内容,并可以通过图形用户界面与用户进行交互。该终端将图形用户界面提供给用户的方式可以包括多种,例如,可以渲染显示在终端的显示屏上,或者,通过全息投影呈现图形用户界面。终端可以包括触控显示屏和处理器,该触控显示屏用于呈现图形用户界面以及接收用户的页面浏览指令,该图形用户界面包括供用户浏览的页面,该处理器用于运行相关的应用、生成图形用户界面、响应操作指令以及控制图形用户界面在触控显示屏上的显示。When the method for comparing decoration renderings and camera images provided by this embodiment is run on the terminal, the terminal needs to first download and install relevant application programs and store them. When the terminal actually runs the aforementioned method, it is used to present relevant pages, space, Scenes and other content, and can interact with users through a graphical user interface. The terminal may provide the graphical user interface to the user in various manners, for example, rendering and displaying the graphical user interface on the display screen of the terminal, or presenting the graphical user interface through holographic projection. The terminal may include a touch display screen and a processor, the touch display screen is used to present a graphical user interface and receive user page browsing instructions, the graphical user interface includes pages for the user to browse, and the processor is used to run related applications, Generate a graphical user interface, respond to operating instructions, and control the display of the graphical user interface on the touch display.

当本实施例提供的对比装修效果图和相机画面的方法由终端和服务器协同执行时,可以采用以云计算为基础的数据计算处理方式。在此运行模式下,对比装修效果图和相机画面对比展示的应用程序的运行主体和同屏交互展示画面呈现主体是分离的,方法的储存与运行是在云服务器上完成的。而交互展示画面呈现是在终端完成的,终端主要用于装修效果图数据的接收、相机位置和姿态数据发送以及显示画面的呈现,例如,终端可以是靠近用户侧的具有数据传输功能的显示设备,如,智能手机、平板电脑等显示设备,但是进行装修设计图生成、渲染、数据计算处理的设备为云端的服务器。在进行同屏展示时,用户操作客户端向服务器发送操作指令,云服务器根据操作指令运行全景图展示、三维模型计算处理等方面的计算,将展示画面等数据进行编码压缩,通过网络返回终端,最后,通过终端进行解码并输出展示页面对应的全景图画面,从而呈现装修效果图和相机画面同屏对比的展示效果。When the method for comparing the decoration renderings and camera images provided in this embodiment is executed cooperatively by the terminal and the server, a cloud computing-based data computing and processing method can be used. In this operating mode, the operating subject of the application program that compares the decoration renderings and the camera screen is separated from the subject of the same-screen interactive display screen, and the storage and operation of the method are completed on the cloud server. The presentation of the interactive display screen is completed on the terminal. The terminal is mainly used for receiving decoration rendering data, sending camera position and attitude data, and presenting the display screen. For example, the terminal can be a display device with data transmission function near the user side , such as smart phones, tablet computers and other display devices, but the devices for generating, rendering, and data computing and processing of decoration design drawings are cloud servers. When displaying on the same screen, the user operates the client to send an operation command to the server, and the cloud server runs panorama display, 3D model calculation and other calculations according to the operation command, encodes and compresses the data such as the display screen, and returns it to the terminal through the network. Finally, the terminal decodes and outputs the panorama picture corresponding to the display page, so as to present the display effect of the decoration effect picture and the camera picture on the same screen.

基于上述硬件基础,本申请提供如下各方法实施例、装置和设备实施例,以对本申请提供的技术方案做更详尽的说明。需说明的是,以下实施例的描述顺序不作为对实施例优先顺序的限定。Based on the above hardware basis, the present application provides the following method embodiments, device and device embodiments to describe the technical solutions provided in the present application in more detail. It should be noted that the order of description of the following embodiments is not intended to limit the order of priority of the embodiments.

实施例一Embodiment one

如图1所示,本实施例提供一种对比装修效果图和相机画面的方法,包括:As shown in Figure 1, this embodiment provides a method for comparing the decoration renderings and camera images, including:

步骤S1、通过全景图展示界面呈现全景图以及通过相机拍摄界面呈现相机画面。Step S1, presenting a panorama through a panorama display interface and presenting a camera picture through a camera shooting interface.

在一些实施例中,在同一个屏幕中划分全景图展示界面和相机拍摄界面,通过全景图展示界面呈现全景图即装修效果图,以及通过相机拍摄界面呈现相机画面。In some embodiments, the panorama display interface and the camera shooting interface are divided into the same screen, and the panorama image, that is, the decoration rendering, is presented through the panorama display interface, and the camera picture is presented through the camera shooting interface.

全景图展示界面中除了展示装修效果图,还可以进一步设置房屋导览界面,房屋导览界面中展示目标房屋的户型缩略图。户型缩略图可以是三维户型缩略图或二维户型缩略图,以便向用户指示全景图的观察位置和视角。In addition to displaying the decoration renderings in the panorama display interface, a house guide interface can be further set up, and the house guide interface displays a thumbnail of the unit type of the target house. The house type thumbnail may be a 3D house type thumbnail or a 2D house type thumbnail, so as to indicate to the user the observation position and angle of view of the panorama.

户型缩略图中还配置一个视角指示图用于指引,具体用于显示当前全景图对应的视角和位置。视角指示图例如是扇形图,扇形图的扇形角度为预设的显示广角,扇形的朝向对应于虚拟相机的视角,扇形图的位置与虚拟相机在目标房屋的位置相关。In the thumbnail of the house type, there is also an angle indicator map for guidance, which is specifically used to display the angle and position corresponding to the current panorama. The viewing angle indication map is, for example, a fan-shaped graph. The fan-shaped angle of the fan-shaped graph is a preset display wide angle. The orientation of the fan-shaped graph corresponds to the viewing angle of the virtual camera. The position of the fan-shaped graph is related to the position of the virtual camera in the target house.

步骤S2、响应于用户操作激活装修效果图与相机画面联动显示模式。Step S2, in response to the user's operation, activate the linkage display mode of the decoration renderings and the camera screen.

在一些实施例中,用户使用带有相机和惯性传感器的智能手机实时拍摄房屋内的实景。用户还可以采用其他装配了相机和惯性传感器的手持智能终端设备、亦或可穿戴智能设备,例如虚拟现实(Vi rtua l Rea l ity,VR)眼镜,本实施例对此不做限定。In some embodiments, the user uses a smartphone with a camera and an inertial sensor to capture the real scene inside the house in real time. The user may also use other handheld smart terminal devices equipped with cameras and inertial sensors, or wearable smart devices, such as virtual reality (Virtual Reality, VR) glasses, which is not limited in this embodiment.

手机触摸屏上同时显示某一视角下的装修效果图和相机实拍画面。显示装修效果图的界面中可以同时通过一子窗口显示目标房屋的户型缩略图和视角指示器。视角指示器向用户呈现当前装修效果图(全景图)的虚拟相机视角和观察者位置。The touch screen of the mobile phone displays the decoration renderings from a certain angle of view and the real picture taken by the camera at the same time. In the interface displaying the decoration renderings, a thumbnail image of the unit type of the target house and an indicator of the viewing angle can be displayed through a sub-window at the same time. The angle of view indicator presents to the user the virtual camera angle of view and the position of the observer of the current decoration rendering (panorama).

用户根据当前装修效果图,在视角指示器辅助下,行进至全景图的观察位置,并调整手机姿态,将手机相机的拍照视角调整至与全景图的观察者视角相同,通过在触摸屏开启联动开关的操作激活装修效果图与相机画面联动显示模式。According to the current decoration renderings, with the assistance of the angle of view indicator, the user moves to the observation position of the panorama, adjusts the posture of the mobile phone, adjusts the camera angle of the mobile phone to be the same as the observer's angle of view of the panorama, and turns on the linkage switch on the touch screen The operation activates the linkage display mode of the decoration renderings and the camera screen.

在装修效果图与相机画面联动显示模式被激活的状态下,手机相机在真实世界的位置和角度(即三维坐标和姿态角)被记录为初始位置和初始姿态,并且与全景图的位置和角度对齐,从而手机屏幕同时联动显示装修效果图(全景图)和相机实拍画面。In the state where the linkage display mode of the decoration renderings and the camera screen is activated, the position and angle of the mobile phone camera in the real world (that is, the three-dimensional coordinates and attitude angle) are recorded as the initial position and initial attitude, and compared with the position and angle of the panorama Alignment, so that the screen of the mobile phone simultaneously displays the decoration renderings (panorama) and the real picture taken by the camera.

步骤S3、响应于用户调整相机位置和姿态的操作,实时计算相机位置和姿态数据。Step S3, in response to the user's operation of adjusting the camera position and posture, real-time calculation of camera position and posture data.

在一些实施例中,用户使用的手机或者其他智能终端设备携带的惯性传感器可以包括陀螺仪、加速度计和磁场计,可以通过微机电系统(Micro E l ectro Mechanica lSystems,简称为MEMS)集成电路实现。其中,陀螺仪用于输出角速度数据,加速度计用于输出加速度,磁场计用于输出磁场值。In some embodiments, the inertial sensor carried by the mobile phone or other smart terminal equipment used by the user may include a gyroscope, an accelerometer, and a magnetometer, and may be implemented by a micro-electromechanical system (Micro Electro Mechanical Systems, referred to as MEMS) integrated circuit . Among them, the gyroscope is used to output angular velocity data, the accelerometer is used to output acceleration, and the magnetometer is used to output magnetic field value.

根据初始位置和初始姿态结合实时采集的惯性传感器数据,计算相机的位置和姿态。根据惯性传感器数据计算位置和姿态的方法属于现有技术,此处不再赘述。Calculate the position and attitude of the camera based on the initial position and attitude combined with the inertial sensor data collected in real time. The method of calculating the position and attitude according to the inertial sensor data belongs to the prior art, and will not be repeated here.

步骤S4、根据相机的位置和姿态更新全景图。Step S4, updating the panorama according to the position and attitude of the camera.

用户手机开始旋转时启动手机内置的陀螺仪,通过代码调用手机和手机浏览器内置接口获取陀螺仪启动状态下的变化数据,即水平角度(a l pha)、垂直角度(beta)、旋转角度(gamma)三个变量,并将三个数据传递给全景图视角设置模块(在技术实现中通常用(x/y/z)代替,下同)。因为全景图是由图片合成的三维球体,也具备(x/y/z)坐标系,所以全景图内部视角设置模块会使用从陀螺仪获得的视角数据(x/y/z),实现与手机相机视角做同步,从而实现360度视角浏览的同时,可以对比设计方案的效果。展示界面和效果如图3所示。When the user's mobile phone starts to rotate, start the built-in gyroscope in the mobile phone, and use the code to call the built-in interface of the mobile phone and mobile browser to obtain the change data of the gyroscope in the starting state, that is, the horizontal angle (a l pha), vertical angle (beta), rotation angle (gamma ) three variables, and pass the three data to the panorama viewing angle setting module (usually replaced by (x/y/z) in technical implementation, the same below). Because the panorama is a three-dimensional sphere synthesized from pictures, and also has a (x/y/z) coordinate system, the internal viewing angle setting module of the panorama will use the viewing angle data (x/y/z) obtained from the gyroscope to realize the integration with the mobile phone. The camera angle of view is synchronized, so that the effect of the design scheme can be compared while browsing in a 360-degree angle of view. The display interface and effect are shown in Figure 3.

上述方案实现了全景图和相机实时画面的同屏显示和联动,用户在同一个显示屏幕上对比观察全景图和相机实时画面,随着用户携带手机在房屋内移动,手机屏幕会联动显示相机实拍画面以及与其对应的全景图,达到“用户拍摄画面与全景图图像实时联动同步”的效果,便于查验实际房屋和设计效果之间的区别。The above scheme realizes the same-screen display and linkage of the panorama and the real-time camera picture. The user compares and observes the panorama and the real-time camera picture on the same display screen. Take pictures and the corresponding panoramas to achieve the effect of "real-time linkage and synchronization between the user's shooting picture and the panorama image", which is convenient for checking the difference between the actual house and the design effect.

实施例二Embodiment two

在实施例一的基础上,增加了方便用户拍照和标注的步骤。On the basis of the first embodiment, the steps of taking pictures and marking for the convenience of the user are added.

如图2所示,在步骤S4后,还包括:As shown in Figure 2, after step S4, it also includes:

步骤S5、响应于用户的指令进行拍照生成实景照片。Step S5, taking pictures in response to the user's instruction to generate a real-scene photo.

在一些实施例中,通常是当用户发现房屋实际装修细节与设计效果图之间存在显著差异,需要拍照留存以供进一步处理时,用户执行拍照操作。操作指令可以是通过实体按键、触摸屏虚拟按键或者声控等任意形式下达。In some embodiments, usually when the user finds that there is a significant difference between the actual decoration details of the house and the design rendering, and needs to be photographed and saved for further processing, the user performs the photographing operation. Operation instructions can be issued in any form such as physical buttons, virtual buttons on the touch screen, or voice control.

步骤S6、将实景照片和对应的全景图生成一张同屏对比图片。Step S6, generating a same-screen comparison picture from the real-scene photo and the corresponding panorama.

在生成实景照片的同时,将对应的全景图同时截存,以原有版式生成一张同屏对比图片。While generating real photos, the corresponding panoramas are cut and saved at the same time, and a comparison picture on the same screen is generated in the original format.

在一些实施例中,根据用户的设置确定同屏对比图片的版式,例如上下对比或者左右对比,或者其他便于用户进行查看比对的版式。In some embodiments, the layout of the comparison pictures on the same screen is determined according to the user's settings, such as up-down comparison or left-right comparison, or other layouts that are convenient for users to view and compare.

步骤S7、响应于用户的操作,针对同屏对比图片增加标注信息。Step S7 , in response to the user's operation, add annotation information for the comparison picture on the same screen.

即用户可对照片进行标注。That is, users can tag photos.

标注信息例如:“此处石膏线样式与设计图不符”等等。Labeling information such as: "The style of the plaster line here does not match the design drawing" and so on.

通过以上方案,本实施例同时实现了拍照留档功能和标注功能:拍照生成的同屏对比图片可以留存在电子设备,沉淀为交付过程的资料,对比展示的效果如图3所示。Through the above solution, this embodiment realizes the function of taking pictures and keeping files and marking functions at the same time: the same-screen comparison pictures generated by taking pictures can be saved in the electronic device, and precipitated into the data of the delivery process. The effect of comparison and display is shown in Figure 3.

本申请实施例还提供对比装修效果图和相机画面的装置,包括:The embodiment of the present application also provides a device for comparing the decoration renderings and camera images, including:

显示单元,用于在同一显示屏中通过全景图展示界面呈现装修效果图以及通过相机拍摄界面呈现相机画面;The display unit is used to present the decoration renderings through the panorama display interface and the camera image through the camera shooting interface on the same display screen;

显示模式确定单元,用于响应于用户操作激活装修效果图与相机画面联动显示模式;A display mode determination unit, configured to activate the linkage display mode of decoration renderings and camera images in response to user operations;

计算单元,用于响应于用户调整相机位置和姿态的操作,实时计算相机位置和姿态数据;a computing unit, configured to calculate camera position and posture data in real time in response to the user's operation of adjusting the camera position and posture;

联动更新单元,用于根据相机的位置和姿态更新装修效果图,联动显示更新后的装修效果图与相机画面。The linkage updating unit is used for updating the decoration rendering according to the position and posture of the camera, and linkage displaying the updated decoration rendering and the camera screen.

本申请实施例还提供一种电子设备,包括:存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,所述处理器执行所述程序时实现如前述任一实施例所述对比装修效果图和相机画面的方法的步骤。An embodiment of the present application also provides an electronic device, including: a memory, a processor, and a computer program stored on the memory and operable on the processor. Describe the steps of the method for comparing the decoration renderings and camera images.

相应地,本申请实施例还提供一种存储有计算机程序的计算机可读存储介质,所述计算机程序被计算机执行时能够实现上述各实施例提供的对比装修效果图和相机画面的方法步骤或功能。Correspondingly, an embodiment of the present application also provides a computer-readable storage medium storing a computer program. When the computer program is executed by a computer, the method steps or functions of comparing the decoration renderings and camera images provided in the above-mentioned embodiments can be realized. .

作为举例,电子设备包括计算单元,其可以根据存储在只读存储器(ROM)中的计算机程序或者从存储单元加载到随机访问存储器(RAM)中的计算机程序,来执行各种适当的动作和处理。在RAM中,还可存储设备操作所需的各种程序和数据。计算单元、ROM以及RAM通过总线彼此相连。输入/输出(I/O)接口也连接至总线。设备中的多个部件连接至I/O接口,包括:输入单元,例如键盘、鼠标等;输出单元,例如各种类型的显示器、扬声器等;存储单元,例如磁盘、光盘等;以及通信单元,例如网卡、调制解调器、无线通信收发机等。通信单元允许设备通过诸如因特网的计算机网络和/或各种电信网络与其他设备交换信息/数据。By way of example, an electronic device includes a computing unit that can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) or loaded from a storage unit into a random access memory (RAM). . In RAM, various programs and data necessary for device operation are also stored. The computing unit, ROM, and RAM are connected to each other through a bus. Input/output (I/O) interfaces are also connected to the bus. Multiple components in the device are connected to the I/O interface, including: input units, such as keyboards, mice, etc.; output units, such as various types of displays, speakers, etc.; storage units, such as magnetic disks, optical discs, etc.; and communication units, Such as network card, modem, wireless communication transceiver, etc. The communication unit allows the device to exchange information/data with other devices over a computer network such as the Internet and/or various telecommunication networks.

计算单元可以是各种具有处理和计算能力的通用和/或专用处理组件。计算单元的一些示例包括但不限于中央处理单元(CPU)、图形处理单元(GPU)、各种专用的人工智能(AI)计算芯片、各种运行机器学习模型算法的计算单元、数字信号处理器(DSP)、以及任何适当的处理器、控制器、微控制器等。Computing units may be various general and/or special purpose processing components having processing and computing capabilities. Some examples of computing units include, but are not limited to, central processing units (CPUs), graphics processing units (GPUs), various specialized artificial intelligence (AI) computing chips, various computing units that run machine learning model algorithms, digital signal processors (DSP), and any suitable processor, controller, microcontroller, etc.

以上描述的各种实施方式可以在数字电子电路系统、集成电路系统、场可编程门阵列(FPGA)、专用集成电路(ASI C)、专用标准产品(ASSP)、芯片上系统的系统(SOC)、负载可编程逻辑设备(CPLD)、计算机硬件、固件、软件、和/或它们的组合中实现。这些各种实施方式可以包括:实施在一个或者多个计算机程序中,该一个或者多个计算机程序可在包括至少一个可编程处理器的可编程系统上执行和/或解释,该可编程处理器可以是专用或者通用可编程处理器,可以从存储系统、至少一个输入装置、和至少一个输出装置接收数据和指令,并且将数据和指令传输至该存储系统、该至少一个输入装置、和该至少一个输出装置。The various implementations described above can be used in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGA), application-specific integrated circuits (ASI C), application-specific standard products (ASSP), and system-on-chip (SOC) , load programmable logic device (CPLD), computer hardware, firmware, software, and/or their combination. These various embodiments may include being implemented in one or more computer programs executable and/or interpreted on a programmable system including at least one programmable processor, the programmable processor Can be special-purpose or general-purpose programmable processor, can receive data and instruction from storage system, at least one input device, and at least one output device, and transmit data and instruction to this storage system, this at least one input device, and this at least one output device an output device.

值得说明的是,尽管在附图中以特定顺序描述了本申请方法的执行过程,但是,这并非要求或者暗示必须按照该特定顺序来执行,或是必须执行全部所示的步骤才能实现预期结果。可选的,可以省略某些步骤,将多个步骤合并为一个步骤执行,和/或将一个步骤分解为多个步骤执行。It is worth noting that although the execution process of the method of the present application is described in a specific order in the accompanying drawings, this does not require or imply that it must be performed in this specific order, or that all shown steps must be performed to achieve the desired result . Optionally, certain steps may be omitted, multiple steps may be combined into one step for execution, and/or one step may be decomposed into multiple steps for execution.

本领域技术人员应明白,本申请的实施例可提供为方法、装置、或计算机程序产品。因此,本申请可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本申请可采用在一个或多个其中包含有计算机可用计算机程序的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。Those skilled in the art should understand that the embodiments of the present application may be provided as methods, apparatuses, or computer program products. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) having a computer-usable computer program embodied therein.

本申请是参照根据本申请实施例的方法、装置、电子设备和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序命令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序命令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的命令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。The present application is described with reference to flowcharts and/or block diagrams of methods, apparatuses, electronic devices and computer program products according to embodiments of the present application. It should be understood that each procedure and/or block in the flowchart and/or block diagram, and a combination of procedures and/or blocks in the flowchart and/or block diagram can be realized by computer program instructions. These computer program instructions may be provided to a general purpose computer, special purpose computer, embedded processor, or processor of other programmable data processing equipment to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing equipment produce a machine An apparatus for realizing the functions specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.

以上实施例仅用以说明本申请的技术方案,而非对其限制;尽管参照前述实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的精神和范围。The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: it can still apply to the foregoing embodiments Modifications are made to the recorded technical solutions, or equivalent replacements are made to some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims (10)

1. A method of comparing a decorative effect map to a camera view, comprising:
displaying a decoration effect diagram through a panorama display interface and displaying a camera picture through a camera shooting interface in the same display screen;
activating a decoration effect diagram and camera picture linkage display mode in response to user operation;
responsive to a user adjusting the camera position and pose, calculating camera position and pose data in real time;
and updating the decoration effect graph according to the position and the posture of the camera, and displaying the updated decoration effect graph and the camera picture in a linkage way.
2. The method according to claim 1, characterized in that:
the decoration effect diagram is a panoramic view of house decoration design effect.
3. The method according to claim 1, characterized in that:
the camera is carried on the handheld terminal equipment or the wearable intelligent equipment;
the handheld terminal device or the wearable intelligent device is also provided with an inertial sensor.
4. The method according to claim 1, characterized in that:
further comprises:
shooting according to a user command camera to generate a live-action photo;
and generating a same-screen comparison picture from the live-action photo and the corresponding decoration effect picture.
5. The method according to claim 4, wherein:
further comprises:
and responding to the user operation, and adding annotation information for the same-screen comparison picture.
6. The method according to any one of claims 1-5, wherein:
the panorama display interface also displays a thumbnail user pattern;
the thumbnail house type map is provided with a view angle indication map for indicating the view angle and the position of the panorama.
7. The method according to any one of claims 1-5, wherein:
the updating of the decoration effect graph according to the position and the gesture of the camera comprises the following steps:
calculating and updating the position and the view angle of the camera according to the position and the posture of the camera;
and updating the position and the view angle of the decoration effect graph into the position and the view angle of the camera.
8. An apparatus for comparing a decorative effect map with a camera view, comprising:
the display unit is used for displaying a decoration effect diagram through a panorama display interface and a camera picture through a camera shooting interface in the same display screen;
a display mode determining unit for activating a decoration effect map and a camera picture linkage display mode in response to a user operation;
a calculation unit for calculating camera position and posture data in real time in response to an operation of adjusting the camera position and posture by a user;
and the linkage updating unit is used for updating the decoration effect graph according to the position and the gesture of the camera and displaying the updated decoration effect graph and the camera picture in a linkage way.
9. An electronic device, characterized in that: the system comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory are communicated with each other through the communication bus; the memory is used for storing a computer program; the processor is configured to implement the method according to any one of claims 1-7 when executing a program stored on a memory.
10. A computer-readable storage medium having instructions stored thereon, which when executed by one or more processors, cause the processors to perform the method of any of claims 1-7.
CN202211562496.2A 2022-12-07 2022-12-07 Method and device for comparing pictures of decoration effect picture camera Pending CN116248997A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211562496.2A CN116248997A (en) 2022-12-07 2022-12-07 Method and device for comparing pictures of decoration effect picture camera

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211562496.2A CN116248997A (en) 2022-12-07 2022-12-07 Method and device for comparing pictures of decoration effect picture camera

Publications (1)

Publication Number Publication Date
CN116248997A true CN116248997A (en) 2023-06-09

Family

ID=86624939

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211562496.2A Pending CN116248997A (en) 2022-12-07 2022-12-07 Method and device for comparing pictures of decoration effect picture camera

Country Status (1)

Country Link
CN (1) CN116248997A (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111625669A (en) * 2020-05-09 2020-09-04 东易日盛家居装饰集团股份有限公司 Multi-screen linkage home decoration experience method, system, medium and equipment
CN112085852A (en) * 2019-05-28 2020-12-15 贝壳找房(北京)科技有限公司 Method, device and system for displaying three-dimensional models of house before and after decoration on same screen
CN112581618A (en) * 2020-12-23 2021-03-30 深圳前海贾维斯数据咨询有限公司 Three-dimensional building model and real scene comparison method and system in building engineering industry
CN114331194A (en) * 2021-12-30 2022-04-12 深圳前海贾维斯数据咨询有限公司 Building measurement management method and system based on digital twins

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112085852A (en) * 2019-05-28 2020-12-15 贝壳找房(北京)科技有限公司 Method, device and system for displaying three-dimensional models of house before and after decoration on same screen
CN111625669A (en) * 2020-05-09 2020-09-04 东易日盛家居装饰集团股份有限公司 Multi-screen linkage home decoration experience method, system, medium and equipment
CN112581618A (en) * 2020-12-23 2021-03-30 深圳前海贾维斯数据咨询有限公司 Three-dimensional building model and real scene comparison method and system in building engineering industry
CN114331194A (en) * 2021-12-30 2022-04-12 深圳前海贾维斯数据咨询有限公司 Building measurement management method and system based on digital twins

Similar Documents

Publication Publication Date Title
JP7344974B2 (en) Multi-virtual character control method, device, and computer program
WO2018188499A1 (en) Image processing method and device, video processing method and device, virtual reality device and storage medium
US20160217616A1 (en) Method and System for Providing Virtual Display of a Physical Environment
TW201835723A (en) Graphic processing method and device, virtual reality system, computer storage medium
CN115191006B (en) 3D model for displayed 2D elements
CN114514493A (en) Reinforcing apparatus
CN104536579A (en) Interactive three-dimensional scenery and digital image high-speed fusing processing system and method
CN110568923A (en) unity 3D-based virtual reality interaction method, device, equipment and storage medium
CN107248194A (en) A kind of CAE data three-dimensionals based on cloud computing show exchange method
CN111488056B (en) Manipulating virtual objects using tracked physical objects
CN113426117B (en) Shooting parameter acquisition method and device for virtual camera, electronic equipment and storage medium
WO2022022141A1 (en) Image display method and apparatus, and computer device and storage medium
CN115131528B (en) Virtual reality scene determination method, device and system
TWI817335B (en) Stereoscopic image playback apparatus and method of generating stereoscopic images thereof
CN114419226A (en) Panoramic rendering method, apparatus, computer equipment and storage medium
CN117319790A (en) Photography methods, devices, equipment and media based on virtual reality space
CN110889384A (en) Scene switching method and device, electronic device and storage medium
CN113678173B (en) Method and apparatus for drawing-based placement of virtual objects
CN114900621B (en) Special effect video determining method and device, electronic equipment and storage medium
WO2023179442A1 (en) 3d display method and apparatus
EP4485357A2 (en) Image processing method and apparatus, electronic device, and storage medium
US20200169710A1 (en) Immersive display system with adjustable perspective
CN116248997A (en) Method and device for comparing pictures of decoration effect picture camera
CN119678188A (en) Mesh transformation with efficient depth reconstruction and filtering in see-through augmented reality (AR) systems
CN114201028B (en) Augmented reality system and method for anchoring display virtual object thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination