CN116248997A - Method and device for comparing pictures of decoration effect picture camera - Google Patents

Abstract

The invention provides a method and a device for comparing a decoration effect picture with a camera picture. The method comprises the following steps: presenting a panoramic image through a panoramic image display interface and presenting a camera picture through a camera shooting interface in the same display screen; activating a panorama and camera picture linkage display mode in response to user operation; responsive to a user adjusting the camera position and pose, calculating camera position and pose data in real time; and updating the panoramic image according to the position and the gesture of the camera, and displaying the updated panoramic image and the camera picture in a linkage way. The invention realizes the same screen display and linkage of the panoramic image and the real-time image of the camera, and as the user carries the mobile phone to move in the house, the mobile phone screen can be linked to display the real-time image of the camera and the panoramic image corresponding to the real-time image, thereby achieving the effect of 'real-time linkage synchronization of the image shot by the user and the panoramic image', and facilitating the examination of the distinction between the actual house and the design effect.

Description

A method and device for comparing camera images of decoration renderings

technical field

The invention belongs to the field of decoration design technology and virtual reality technology, and in particular relates to a method and device for comparing decoration renderings and camera images.

Background technique

In order to check the difference between the actual house and the decoration design effect, the traditional method is that the user enters the house with a paper rendering, observes and compares the renderings with human eyes, and imagines the design effect. The disadvantages of the traditional method are obvious, at least including: the paper renderings are inconvenient to carry; the inability to feel the design effect in person, relying on the user's imagination; it is difficult to keep records of acceptance problems, etc.

Contents of the invention

In order to overcome the above-mentioned defects existing in the prior art, the object of the present invention is to provide a method and device for comparing decoration renderings and camera images.

In the first aspect, the embodiment of the present application provides a method for comparing the decoration renderings and the camera images, including:

In the same display screen, the decoration renderings are presented through the panorama display interface and the camera image is presented through the camera shooting interface;

Activate the linkage display mode of decoration renderings and camera screens in response to user operations;

In response to the user's operation of adjusting the camera's position and attitude, calculate the camera's position and attitude data in real time;

The decoration renderings are updated according to the position and posture of the camera, and the updated decoration renderings and the camera screen are displayed in linkage.

The method of comparing the decoration effect map and the camera image provided by the above scheme realizes the same-screen display and linkage of the panorama image and the camera real-time image, and improves the efficiency for users to check the difference between the actual house and the design effect.

In some feasible embodiments, the decoration effect picture is a panoramic picture of house decoration design effect.

In some feasible embodiments, the camera is mounted on a handheld terminal device or a wearable smart device; and the handheld terminal device or wearable smart device is also equipped with an inertial sensor.

In some feasible embodiments, it also includes:

According to the user's instruction, the camera takes pictures to generate real-scene photos;

Generate a comparison picture on the same screen with the real-scene photos and the corresponding decoration renderings.

In some feasible embodiments, it also includes:

In response to user operations, add annotation information for the same-screen comparison pictures.

This solution further provides the function of taking pictures and keeping files and marking functions, which can be used as materials in the delivery process.

In some feasible embodiments, the thumbnail floor plan is also displayed in the panorama display interface;

The thumbnail floor plan is provided with an angle of view indicator, which is used to indicate the observation angle and position of the panorama.

In some feasible embodiments, said updating the decoration effect map according to the position and posture of the camera includes:

Calculate and update the position and angle of view of the camera according to the position and attitude of the camera;

Update the position and perspective of the decoration renderings to the camera position and perspective.

In the second aspect, the embodiment of the present application provides a device for comparing decoration renderings and camera images, including:

The display unit is used to present the decoration renderings through the panorama display interface and the camera image through the camera shooting interface on the same display screen;

A display mode determination unit, configured to activate the linkage display mode of decoration renderings and camera images in response to user operations;

a computing unit, configured to calculate camera position and posture data in real time in response to the user's operation of adjusting the camera position and posture;

The linkage updating unit is used for updating the decoration rendering according to the position and posture of the camera, and linkage displaying the updated decoration rendering and the camera screen.

In the third aspect, the embodiment of the present application provides an electronic device, including: a processor, a communication interface, a memory, and a communication bus; wherein, the processor, the communication interface, and the memory complete the mutual communication through the communication bus communication; the memory is used to store computer programs; and the processor is used to implement the method as described in any one of the first aspect when executing the programs stored in the memory.

In the fourth aspect, the embodiment of the present application provides a computer-readable storage medium, on which instructions are stored, and when executed by one or more processors, the processors perform the operation described in any one of the foregoing first aspects. Methods.

The beneficial effects of the present invention are:

The present invention realizes the same-screen display and linkage of the panoramic image and the real-time image of the camera, and provides the function of taking photos and keeping files and marking functions, and gets rid of the need to carry paper renderings to the house for inspection and acceptance, and relying on "human eye comparison and human brain imagination" Constraints improve the efficiency for users to check the difference between the actual house and the design effect; users can compare images on the same screen and from the same perspective in real time, and can take pictures and mark them in time; pictures taken and compared can be stored in electronic devices and precipitated into the delivery process data of.

Description of drawings

Fig. 1 is a schematic flow chart of a method for comparing decoration renderings and camera images provided in the embodiment of the present application;

Fig. 2 is a schematic flow chart of another method for comparing decoration renderings and camera images provided by the embodiment of the present application;

Fig. 3 is a schematic diagram showing the comparison of the decoration renderings and the display effect of the camera screen provided by the embodiment of the present application.

Detailed ways

The present invention will be described in further detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

The embodiment of the present application provides a method and device for comparing a decoration effect drawing with a camera picture. Specifically, the method for comparing decoration renderings and camera images in the embodiment of the present application can be performed by a terminal equipped with a camera and an inertial sensor, and the terminal can be a smart phone, a tablet computer, a notebook computer, etc.; it can also be performed by a terminal and a server Collaborative execution, the server is used for storage, and real-time generation of decoration renderings based on the position and attitude data sent by the terminal, which is transmitted to the terminal for display through the communication network.

When the method for comparing decoration renderings and camera images provided by this embodiment is run on the terminal, the terminal needs to first download and install relevant application programs and store them. When the terminal actually runs the aforementioned method, it is used to present relevant pages, space, Scenes and other content, and can interact with users through a graphical user interface. The terminal may provide the graphical user interface to the user in various manners, for example, rendering and displaying the graphical user interface on the display screen of the terminal, or presenting the graphical user interface through holographic projection. The terminal may include a touch display screen and a processor, the touch display screen is used to present a graphical user interface and receive user page browsing instructions, the graphical user interface includes pages for the user to browse, and the processor is used to run related applications, Generate a graphical user interface, respond to operating instructions, and control the display of the graphical user interface on the touch display.

When the method for comparing the decoration renderings and camera images provided in this embodiment is executed cooperatively by the terminal and the server, a cloud computing-based data computing and processing method can be used. In this operating mode, the operating subject of the application program that compares the decoration renderings and the camera screen is separated from the subject of the same-screen interactive display screen, and the storage and operation of the method are completed on the cloud server. The presentation of the interactive display screen is completed on the terminal. The terminal is mainly used for receiving decoration rendering data, sending camera position and attitude data, and presenting the display screen. For example, the terminal can be a display device with data transmission function near the user side , such as smart phones, tablet computers and other display devices, but the devices for generating, rendering, and data computing and processing of decoration design drawings are cloud servers. When displaying on the same screen, the user operates the client to send an operation command to the server, and the cloud server runs panorama display, 3D model calculation and other calculations according to the operation command, encodes and compresses the data such as the display screen, and returns it to the terminal through the network. Finally, the terminal decodes and outputs the panorama picture corresponding to the display page, so as to present the display effect of the decoration effect picture and the camera picture on the same screen.

Based on the above hardware basis, the present application provides the following method embodiments, device and device embodiments to describe the technical solutions provided in the present application in more detail. It should be noted that the order of description of the following embodiments is not intended to limit the order of priority of the embodiments.

Embodiment one

As shown in Figure 1, this embodiment provides a method for comparing the decoration renderings and camera images, including:

Step S1, presenting a panorama through a panorama display interface and presenting a camera picture through a camera shooting interface.

In some embodiments, the panorama display interface and the camera shooting interface are divided into the same screen, and the panorama image, that is, the decoration rendering, is presented through the panorama display interface, and the camera picture is presented through the camera shooting interface.

In addition to displaying the decoration renderings in the panorama display interface, a house guide interface can be further set up, and the house guide interface displays a thumbnail of the unit type of the target house. The house type thumbnail may be a 3D house type thumbnail or a 2D house type thumbnail, so as to indicate to the user the observation position and angle of view of the panorama.

In the thumbnail of the house type, there is also an angle indicator map for guidance, which is specifically used to display the angle and position corresponding to the current panorama. The viewing angle indication map is, for example, a fan-shaped graph. The fan-shaped angle of the fan-shaped graph is a preset display wide angle. The orientation of the fan-shaped graph corresponds to the viewing angle of the virtual camera. The position of the fan-shaped graph is related to the position of the virtual camera in the target house.

Step S2, in response to the user's operation, activate the linkage display mode of the decoration renderings and the camera screen.

In some embodiments, the user uses a smartphone with a camera and an inertial sensor to capture the real scene inside the house in real time. The user may also use other handheld smart terminal devices equipped with cameras and inertial sensors, or wearable smart devices, such as virtual reality (Virtual Reality, VR) glasses, which is not limited in this embodiment.

The touch screen of the mobile phone displays the decoration renderings from a certain angle of view and the real picture taken by the camera at the same time. In the interface displaying the decoration renderings, a thumbnail image of the unit type of the target house and an indicator of the viewing angle can be displayed through a sub-window at the same time. The angle of view indicator presents to the user the virtual camera angle of view and the position of the observer of the current decoration rendering (panorama).

According to the current decoration renderings, with the assistance of the angle of view indicator, the user moves to the observation position of the panorama, adjusts the posture of the mobile phone, adjusts the camera angle of the mobile phone to be the same as the observer's angle of view of the panorama, and turns on the linkage switch on the touch screen The operation activates the linkage display mode of the decoration renderings and the camera screen.

In the state where the linkage display mode of the decoration renderings and the camera screen is activated, the position and angle of the mobile phone camera in the real world (that is, the three-dimensional coordinates and attitude angle) are recorded as the initial position and initial attitude, and compared with the position and angle of the panorama Alignment, so that the screen of the mobile phone simultaneously displays the decoration renderings (panorama) and the real picture taken by the camera.

Step S3, in response to the user's operation of adjusting the camera position and posture, real-time calculation of camera position and posture data.

In some embodiments, the inertial sensor carried by the mobile phone or other smart terminal equipment used by the user may include a gyroscope, an accelerometer, and a magnetometer, and may be implemented by a micro-electromechanical system (Micro Electro Mechanical Systems, referred to as MEMS) integrated circuit . Among them, the gyroscope is used to output angular velocity data, the accelerometer is used to output acceleration, and the magnetometer is used to output magnetic field value.

Calculate the position and attitude of the camera based on the initial position and attitude combined with the inertial sensor data collected in real time. The method of calculating the position and attitude according to the inertial sensor data belongs to the prior art, and will not be repeated here.

Step S4, updating the panorama according to the position and attitude of the camera.

When the user's mobile phone starts to rotate, start the built-in gyroscope in the mobile phone, and use the code to call the built-in interface of the mobile phone and mobile browser to obtain the change data of the gyroscope in the starting state, that is, the horizontal angle (a l pha), vertical angle (beta), rotation angle (gamma ) three variables, and pass the three data to the panorama viewing angle setting module (usually replaced by (x/y/z) in technical implementation, the same below). Because the panorama is a three-dimensional sphere synthesized from pictures, and also has a (x/y/z) coordinate system, the internal viewing angle setting module of the panorama will use the viewing angle data (x/y/z) obtained from the gyroscope to realize the integration with the mobile phone. The camera angle of view is synchronized, so that the effect of the design scheme can be compared while browsing in a 360-degree angle of view. The display interface and effect are shown in Figure 3.

The above scheme realizes the same-screen display and linkage of the panorama and the real-time camera picture. The user compares and observes the panorama and the real-time camera picture on the same display screen. Take pictures and the corresponding panoramas to achieve the effect of "real-time linkage and synchronization between the user's shooting picture and the panorama image", which is convenient for checking the difference between the actual house and the design effect.

Embodiment two

On the basis of the first embodiment, the steps of taking pictures and marking for the convenience of the user are added.

As shown in Figure 2, after step S4, it also includes:

Step S5, taking pictures in response to the user's instruction to generate a real-scene photo.

In some embodiments, usually when the user finds that there is a significant difference between the actual decoration details of the house and the design rendering, and needs to be photographed and saved for further processing, the user performs the photographing operation. Operation instructions can be issued in any form such as physical buttons, virtual buttons on the touch screen, or voice control.

Step S6, generating a same-screen comparison picture from the real-scene photo and the corresponding panorama.

While generating real photos, the corresponding panoramas are cut and saved at the same time, and a comparison picture on the same screen is generated in the original format.

In some embodiments, the layout of the comparison pictures on the same screen is determined according to the user's settings, such as up-down comparison or left-right comparison, or other layouts that are convenient for users to view and compare.

Step S7 , in response to the user's operation, add annotation information for the comparison picture on the same screen.

That is, users can tag photos.

Labeling information such as: "The style of the plaster line here does not match the design drawing" and so on.

Through the above solution, this embodiment realizes the function of taking pictures and keeping files and marking functions at the same time: the same-screen comparison pictures generated by taking pictures can be saved in the electronic device, and precipitated into the data of the delivery process. The effect of comparison and display is shown in Figure 3.

The embodiment of the present application also provides a device for comparing the decoration renderings and camera images, including:

The display unit is used to present the decoration renderings through the panorama display interface and the camera image through the camera shooting interface on the same display screen;

A display mode determination unit, configured to activate the linkage display mode of decoration renderings and camera images in response to user operations;

a computing unit, configured to calculate camera position and posture data in real time in response to the user's operation of adjusting the camera position and posture;

The linkage updating unit is used for updating the decoration rendering according to the position and posture of the camera, and linkage displaying the updated decoration rendering and the camera screen.

An embodiment of the present application also provides an electronic device, including: a memory, a processor, and a computer program stored on the memory and operable on the processor. Describe the steps of the method for comparing the decoration renderings and camera images.

Correspondingly, an embodiment of the present application also provides a computer-readable storage medium storing a computer program. When the computer program is executed by a computer, the method steps or functions of comparing the decoration renderings and camera images provided in the above-mentioned embodiments can be realized. .

By way of example, an electronic device includes a computing unit that can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) or loaded from a storage unit into a random access memory (RAM). . In RAM, various programs and data necessary for device operation are also stored. The computing unit, ROM, and RAM are connected to each other through a bus. Input/output (I/O) interfaces are also connected to the bus. Multiple components in the device are connected to the I/O interface, including: input units, such as keyboards, mice, etc.; output units, such as various types of displays, speakers, etc.; storage units, such as magnetic disks, optical discs, etc.; and communication units, Such as network card, modem, wireless communication transceiver, etc. The communication unit allows the device to exchange information/data with other devices over a computer network such as the Internet and/or various telecommunication networks.

Computing units may be various general and/or special purpose processing components having processing and computing capabilities. Some examples of computing units include, but are not limited to, central processing units (CPUs), graphics processing units (GPUs), various specialized artificial intelligence (AI) computing chips, various computing units that run machine learning model algorithms, digital signal processors (DSP), and any suitable processor, controller, microcontroller, etc.

The various implementations described above can be used in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGA), application-specific integrated circuits (ASI C), application-specific standard products (ASSP), and system-on-chip (SOC) , load programmable logic device (CPLD), computer hardware, firmware, software, and/or their combination. These various embodiments may include being implemented in one or more computer programs executable and/or interpreted on a programmable system including at least one programmable processor, the programmable processor Can be special-purpose or general-purpose programmable processor, can receive data and instruction from storage system, at least one input device, and at least one output device, and transmit data and instruction to this storage system, this at least one input device, and this at least one output device an output device.

It is worth noting that although the execution process of the method of the present application is described in a specific order in the accompanying drawings, this does not require or imply that it must be performed in this specific order, or that all shown steps must be performed to achieve the desired result . Optionally, certain steps may be omitted, multiple steps may be combined into one step for execution, and/or one step may be decomposed into multiple steps for execution.

Those skilled in the art should understand that the embodiments of the present application may be provided as methods, apparatuses, or computer program products. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) having a computer-usable computer program embodied therein.

The present application is described with reference to flowcharts and/or block diagrams of methods, apparatuses, electronic devices and computer program products according to embodiments of the present application. It should be understood that each procedure and/or block in the flowchart and/or block diagram, and a combination of procedures and/or blocks in the flowchart and/or block diagram can be realized by computer program instructions. These computer program instructions may be provided to a general purpose computer, special purpose computer, embedded processor, or processor of other programmable data processing equipment to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing equipment produce a machine An apparatus for realizing the functions specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.

The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: it can still apply to the foregoing embodiments Modifications are made to the recorded technical solutions, or equivalent replacements are made to some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims (10)

1. A method of comparing a decorative effect map to a camera view, comprising:

displaying a decoration effect diagram through a panorama display interface and displaying a camera picture through a camera shooting interface in the same display screen;

activating a decoration effect diagram and camera picture linkage display mode in response to user operation;

responsive to a user adjusting the camera position and pose, calculating camera position and pose data in real time;

and updating the decoration effect graph according to the position and the posture of the camera, and displaying the updated decoration effect graph and the camera picture in a linkage way.

2. The method according to claim 1, characterized in that:

the decoration effect diagram is a panoramic view of house decoration design effect.

3. The method according to claim 1, characterized in that:

the camera is carried on the handheld terminal equipment or the wearable intelligent equipment;

the handheld terminal device or the wearable intelligent device is also provided with an inertial sensor.

4. The method according to claim 1, characterized in that:

further comprises:

shooting according to a user command camera to generate a live-action photo;

and generating a same-screen comparison picture from the live-action photo and the corresponding decoration effect picture.

5. The method according to claim 4, wherein:

further comprises:

and responding to the user operation, and adding annotation information for the same-screen comparison picture.

6. The method according to any one of claims 1-5, wherein:

the panorama display interface also displays a thumbnail user pattern;

the thumbnail house type map is provided with a view angle indication map for indicating the view angle and the position of the panorama.

7. The method according to any one of claims 1-5, wherein:

the updating of the decoration effect graph according to the position and the gesture of the camera comprises the following steps:

calculating and updating the position and the view angle of the camera according to the position and the posture of the camera;

and updating the position and the view angle of the decoration effect graph into the position and the view angle of the camera.

8. An apparatus for comparing a decorative effect map with a camera view, comprising:

the display unit is used for displaying a decoration effect diagram through a panorama display interface and a camera picture through a camera shooting interface in the same display screen;

a display mode determining unit for activating a decoration effect map and a camera picture linkage display mode in response to a user operation;

a calculation unit for calculating camera position and posture data in real time in response to an operation of adjusting the camera position and posture by a user;

and the linkage updating unit is used for updating the decoration effect graph according to the position and the gesture of the camera and displaying the updated decoration effect graph and the camera picture in a linkage way.

9. An electronic device, characterized in that: the system comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory are communicated with each other through the communication bus; the memory is used for storing a computer program; the processor is configured to implement the method according to any one of claims 1-7 when executing a program stored on a memory.

10. A computer-readable storage medium having instructions stored thereon, which when executed by one or more processors, cause the processors to perform the method of any of claims 1-7.

Images