CN116248997A

CN116248997A - Method and device for comparing pictures of decoration effect picture camera

Info

Publication number: CN116248997A
Application number: CN202211562496.2A
Authority: CN
Inventors: 郑宇洁; 尤凯
Original assignee: Hangzhou Qunhe Information Technology Co Ltd
Current assignee: Hangzhou Qunhe Information Technology Co Ltd
Priority date: 2022-12-07
Filing date: 2022-12-07
Publication date: 2023-06-09

Abstract

The invention provides a method and a device for comparing a decoration effect picture with a camera picture. The method comprises the following steps: presenting a panoramic image through a panoramic image display interface and presenting a camera picture through a camera shooting interface in the same display screen; activating a panorama and camera picture linkage display mode in response to user operation; responsive to a user adjusting the camera position and pose, calculating camera position and pose data in real time; and updating the panoramic image according to the position and the gesture of the camera, and displaying the updated panoramic image and the camera picture in a linkage way. The invention realizes the same screen display and linkage of the panoramic image and the real-time image of the camera, and as the user carries the mobile phone to move in the house, the mobile phone screen can be linked to display the real-time image of the camera and the panoramic image corresponding to the real-time image, thereby achieving the effect of 'real-time linkage synchronization of the image shot by the user and the panoramic image', and facilitating the examination of the distinction between the actual house and the design effect.

Description

Method and device for comparing pictures of decoration effect picture camera

Technical Field

The invention belongs to the technical field of decoration design and virtual reality, and particularly relates to a method and a device for comparing a decoration effect diagram with a camera picture.

Background

In order to examine the difference between the actual house and the decoration design effect, the traditional method is that a user carries a paper effect diagram into the house to check and accept, and the design effect is imagined by observing and comparing the effect diagram through human eyes. The disadvantages of the conventional approach are significant, at least including: the paper effect diagram is inconvenient to carry; the design effect cannot be experienced personally, and the imagination of a user is relied on; acceptance problem records are difficult to keep, etc.

Disclosure of Invention

In order to overcome the above-mentioned drawbacks of the prior art, the present invention is directed to a method and apparatus for comparing a decorative effect map with a camera picture.

In a first aspect, an embodiment of the present application provides a method for comparing a decoration effect map and a camera picture, including:

displaying a decoration effect diagram through a panorama display interface and displaying a camera picture through a camera shooting interface in the same display screen;

activating a decoration effect diagram and camera picture linkage display mode in response to user operation;

responsive to a user adjusting the camera position and pose, calculating camera position and pose data in real time;

and updating the decoration effect graph according to the position and the posture of the camera, and displaying the updated decoration effect graph and the camera picture in a linkage way.

The method for comparing the decoration effect graph and the camera picture provided by the scheme realizes the same-screen display and linkage of the panoramic view and the camera real-time picture, and improves the efficiency of checking the difference between the actual house and the design effect by the user.

In some possible embodiments, the map of decorative effects is a panoramic view of house decorative design effects.

In some possible embodiments, the camera is carried on a handheld terminal device or a wearable smart device; the handheld terminal device or the wearable intelligent device is also provided with an inertial sensor.

In some possible embodiments, further comprising:

shooting according to a user command camera to generate a live-action photo;

and generating a same-screen comparison picture from the live-action photo and the corresponding decoration effect picture.

In some possible embodiments, further comprising:

and responding to the user operation, and adding annotation information for the same-screen comparison picture.

The scheme further provides a photographing and file-reserving function and a labeling function, and can be used as data of a delivery process.

In some possible embodiments, thumbnail user profiles are also displayed in the panorama display interface;

the thumbnail house type map is provided with a view angle indication map for indicating the view angle and the position of the panorama.

In some possible embodiments, the updating the decorative effect map according to the position and the posture of the camera includes:

calculating and updating the position and the view angle of the camera according to the position and the posture of the camera;

and updating the position and the view angle of the decoration effect graph into the position and the view angle of the camera.

In a second aspect, an embodiment of the present application provides an apparatus for comparing a decoration effect map and a camera picture, including:

the display unit is used for displaying a decoration effect diagram through a panorama display interface and a camera picture through a camera shooting interface in the same display screen;

a display mode determining unit for activating a decoration effect map and a camera picture linkage display mode in response to a user operation;

a calculation unit for calculating camera position and posture data in real time in response to an operation of adjusting the camera position and posture by a user;

and the linkage updating unit is used for updating the decoration effect graph according to the position and the gesture of the camera and displaying the updated decoration effect graph and the camera picture in a linkage way.

In a third aspect, an embodiment of the present application provides an electronic device, including: a processor, a communication interface, a memory, and a communication bus; the processor, the communication interface and the memory complete communication with each other through the communication bus; the memory is used for storing a computer program; the processor is configured to implement the method according to any one of the preceding first aspects when executing a program stored on a memory.

In a fourth aspect, embodiments of the present application provide a computer-readable storage medium having instructions stored thereon, which when executed by one or more processors, cause the processors to perform the method of any of the preceding first aspects.

The invention has the beneficial effects that:

the invention realizes the same screen display and linkage of the panoramic image and the real-time image of the camera, provides the photographing and file reserving function and the labeling function, gets rid of the constraint that the paper effect image needs to be carried and goes to the house for acceptance, relies on 'human eye contrast and human brain imagination', and improves the efficiency of the user to examine the distinction between the actual house and the design effect; the user can compare the pictures with the same screen and the same visual angle in real time, and can take a picture and mark in time; the photographed contrast picture can be stored in the electronic device and deposited as data for the rendering process.

Drawings

Fig. 1 is a schematic flow chart of a method for comparing a decoration effect diagram and a camera picture according to an embodiment of the present application;

FIG. 2 is a schematic flow chart of a method for comparing a decoration effect diagram and a camera screen according to an embodiment of the present application;

fig. 3 is a schematic illustration of a display effect of a contrast decoration effect diagram and a camera picture provided in the embodiment of the present application.

Detailed Description

The present invention will be described in further detail with reference to the drawings and examples. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.

The embodiment of the application provides a method and a device for comparing a decoration effect picture with a camera picture. Specifically, the method for comparing the decoration effect graph and the camera picture in the embodiment of the application can be executed by a terminal provided with a camera and an inertial sensor, and the terminal can be a smart phone, a tablet computer, a notebook computer and the like; the method can also be cooperatively executed by the terminal and the server, and the server is used for storing, generating a decoration effect diagram in real time according to the position and posture data sent by the terminal, and transmitting the decoration effect diagram to the terminal for display through a communication network.

When the method for comparing the decoration effect graph and the camera picture provided by the embodiment is operated on the terminal, the terminal needs to download and install the related application program and store the application program first, and the terminal is used for presenting the related page, space, scene and other contents when actually operating the method, and can interact with a user through a graphical user interface. The way in which the terminal provides the graphical user interface to the user may include a variety of ways, for example, the graphical user interface may be rendered for display on a display screen of the terminal, or presented by holographic projection. The terminal may include a touch display screen for presenting a graphical user interface including pages for viewing by a user and receiving page browsing instructions by the user, and a processor for running related applications, generating the graphical user interface, responding to the operating instructions, and controlling the display of the graphical user interface on the touch display screen.

When the method for comparing the decoration effect map and the camera picture provided in the embodiment is cooperatively executed by the terminal and the server, a data calculation processing mode based on cloud computing may be adopted. In the operation mode, an operation main body of an application program for comparing and displaying the decoration effect graph and the camera picture and an operation main body of the picture for displaying the picture in an interaction mode are separated, and the storage and the operation of the method are completed on a cloud server. The interactive display picture presentation is completed at a terminal, and the terminal is mainly used for receiving decoration effect picture data, sending camera position and gesture data and presenting a display picture, for example, the terminal can be a display device with a data transmission function, such as a display device of a smart phone, a tablet personal computer and the like, which is close to a user side, but the device for generating, rendering and calculating the decoration design picture is a cloud server. When the same-screen display is carried out, a user operates the client to send an operation instruction to the server, the cloud server runs calculation in aspects of panoramic image display, three-dimensional model calculation processing and the like according to the operation instruction, data such as display images are encoded and compressed, the data are returned to the terminal through the network, finally, the panoramic image images corresponding to the display pages are decoded and output through the terminal, and therefore the decoration effect image and the display effect of the same-screen comparison of the camera images are displayed.

Based on the hardware basis, the present application provides the following method embodiments, apparatus and device embodiments, so as to more fully describe the technical solutions provided in the present application. It should be noted that the following description order of embodiments is not a limitation of the priority order of embodiments.

Example 1

As shown in fig. 1, the present embodiment provides a method for comparing a decoration effect map and a camera picture, including:

and step S1, presenting a panoramic image through a panoramic image display interface and presenting a camera picture through a camera shooting interface.

In some embodiments, the panorama display interface and the camera shooting interface are divided in the same screen, the panorama, i.e., the repair effect map, is presented through the panorama display interface, and the camera picture is presented through the camera shooting interface.

Besides the decoration effect diagram, a house guide interface can be further arranged in the panorama display interface, and the house thumbnail of the target house is displayed in the house guide interface. The house type thumbnail may be a three-dimensional house type thumbnail or a two-dimensional house type thumbnail in order to indicate the viewing position and viewing angle of the panorama to the user.

And a view angle indication map is also configured in the house type thumbnail and used for guiding, and particularly used for displaying the view angle and the position corresponding to the current panoramic map. The visual angle indication is illustrated by a sector diagram, the sector angle of the sector diagram is a preset display wide angle, the direction of the sector corresponds to the visual angle of the virtual camera, and the position of the sector diagram is related to the position of the virtual camera in the target house.

And S2, responding to the operation of a user to activate a linkage display mode of the decoration effect graph and the camera picture.

In some embodiments, a user captures real-time scenes within a house using a smartphone with a camera and inertial sensor. The user may also employ other handheld smart terminal devices equipped with cameras and inertial sensors, or wearable smart devices, such as virtual reality (Vi rtua l Rea l ity, VR) glasses, which are not limited in this embodiment.

And simultaneously displaying a decoration effect picture and a camera real shot picture under a certain visual angle on the touch screen of the mobile phone. And displaying the house type thumbnail and the visual angle indicator of the target house through a sub-window at the same time in the interface for displaying the decoration effect graph. The view angle indicator presents the virtual camera view angle and the viewer position of the current finishing effect map (panorama) to the user.

And the user moves to the observation position of the panoramic image under the assistance of the visual angle indicator according to the current decoration effect image, adjusts the posture of the mobile phone, adjusts the photographing visual angle of the mobile phone camera to be the same as the visual angle of an observer of the panoramic image, and activates the linkage display mode of the decoration effect image and the camera image through the operation of starting the linkage switch on the touch screen.

In a state where the decoration effect map and camera screen linkage display mode is activated, the position and angle of the mobile phone camera in the real world (i.e., three-dimensional coordinates and attitude angles) are recorded as an initial position and initial attitude and aligned with the position and angle of the panorama, so that the mobile phone screen simultaneously and in linkage displays the decoration effect map (panorama) and the camera real shot screen.

And step S3, responding to the operation of adjusting the position and the gesture of the camera by a user, and calculating the position and the gesture data of the camera in real time.

In some embodiments, inertial sensors carried by a cell phone or other smart terminal device used by a user may include gyroscopes, accelerometers, and magnetometers, which may be implemented by microelectromechanical systems (Micro E l ectro Mechanica l Systems, simply MEMS) integrated circuits. The gyroscope is used for outputting angular velocity data, the accelerometer is used for outputting acceleration, and the magnetic field meter is used for outputting a magnetic field value.

And calculating the position and the posture of the camera according to the initial position and the initial posture and the inertial sensor data acquired in real time. The method of calculating the position and posture from the inertial sensor data belongs to the prior art and will not be described here in detail.

And S4, updating the panoramic image according to the position and the gesture of the camera.

When the mobile phone of the user starts to rotate, a gyroscope built-in the mobile phone is started, and a mobile phone and a built-in interface of a mobile phone browser are called through codes to obtain change data under the starting state of the gyroscope, namely three variables of a horizontal angle (alpha), a vertical angle (beta) and a rotation angle (gamma), and the three data are transmitted to a panorama visual angle setting module (in technical implementation, the gyroscope is usually replaced by (x/y/z), and the gyroscope is the same as the panorama visual angle setting module). Because the panorama is a three-dimensional sphere synthesized by pictures and also has an (x/y/z) coordinate system, the panorama internal view angle setting module can use view angle data (x/y/z) obtained from a gyroscope to realize synchronization with the view angle of a mobile phone camera, so that 360-degree view angle browsing is realized, and meanwhile, the effect of a design scheme can be compared. The presentation interface and effect is shown in figure 3.

The scheme realizes the same-screen display and linkage of the panoramic image and the real-time image of the camera, the user can contrast and observe the panoramic image and the real-time image of the camera on the same display screen, and as the user carries the mobile phone to move in the house, the mobile phone screen can link and display the real-time image of the camera and the corresponding panoramic image, so that the effect of 'real-time linkage synchronization of the user shooting image and the panoramic image' is achieved, and the distinction between the actual house and the design effect is convenient to check.

Example two

On the basis of the first embodiment, the steps of photographing and labeling for the user are added.

As shown in fig. 2, after step S4, the method further includes:

and S5, photographing in response to a user instruction to generate a live-action photo.

In some embodiments, the user performs a photographing operation, typically when the user finds that there is a significant difference between the actual house finishing details and the design effect map, and that photographing is required for further processing. The operation instruction can be issued in any form such as a physical key, a touch screen virtual key or a sound control.

And S6, generating a same-screen comparison picture from the live-action photo and the corresponding panoramic picture.

And simultaneously intercepting the corresponding panoramic pictures when the live-action pictures are generated, and generating a same-screen comparison picture according to the original format.

In some embodiments, the layout of the on-screen comparison picture is determined according to the user's setting, for example, up-down comparison or left-right comparison, or other layout which is convenient for the user to check the comparison.

And S7, adding annotation information for the same-screen comparison picture in response to the operation of the user.

I.e. the user can annotate the photo.

Labeling information such as: "where the gypsum line pattern does not conform to the design drawing" and so forth.

Through above scheme, this embodiment realizes simultaneously that to shoot and stays shelves function and mark function: the same-screen contrast picture generated by photographing can be reserved in the electronic equipment, the sediment is data of the delivery process, and the contrast display effect is shown in figure 3.

The embodiment of the application also provides a device for comparing the decoration effect graph and the camera picture, which comprises:

The embodiment of the application also provides electronic equipment, which comprises: a memory, a processor and a computer program stored on the memory and executable on the processor, which when executed implements the steps of the method of contrasting a decorative effect map and a camera view as in any of the previous embodiments.

Accordingly, the embodiments of the present application further provide a computer readable storage medium storing a computer program, where the computer program when executed by a computer can implement the method steps or functions of comparing the decoration effect map and the camera screen provided in the foregoing embodiments.

By way of example, the electronic device includes a computing unit that can perform various suitable actions and processes in accordance with a computer program stored in a Read Only Memory (ROM) or a computer program loaded from a storage unit into a Random Access Memory (RAM). In the RAM, various programs and data required for the operation of the device may also be stored. The computing unit, ROM and RAM are connected to each other by a bus. An input/output (I/O) interface is also connected to the bus. A plurality of components in a device are connected to an I/O interface, comprising: an input unit such as a keyboard, a mouse, etc.; an output unit such as various types of displays, speakers, and the like; a storage unit such as a magnetic disk, an optical disk, or the like; and communication units such as network cards, modems, wireless communication transceivers, and the like. The communication unit allows the device to exchange information/data with other devices via a computer network, such as the internet, and/or various telecommunication networks.

The computing unit may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of computing units include, but are not limited to, central Processing Units (CPUs), graphics Processing Units (GPUs), various specialized Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital Signal Processors (DSPs), and any suitable processors, controllers, microcontrollers, and the like.

The various embodiments described above may be implemented in digital electronic circuitry, integrated circuit systems, field Programmable Gate Arrays (FPGAs), application specific integrated circuits (asics), application Specific Standard Products (ASSPs), systems On Chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, which may be a special purpose or general-purpose programmable processor, that may receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.

It should be noted that although the method of the present application is illustrated in the accompanying drawings as being performed in a particular order, this is not required to or implied that the steps shown must be performed in the particular order or that all of the steps shown be performed in order to achieve desirable results. Alternatively, some steps may be omitted, multiple steps may be combined into one step to be performed, and/or one step may be decomposed into multiple steps to be performed.

It will be apparent to those skilled in the art that embodiments of the present application may be provided as a method, apparatus, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having a computer-usable computer program embodied therein.

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus, electronic devices, and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program commands may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the commands executed by the processor of the computer or other programmable data processing apparatus produce means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

The above embodiments are only for illustrating the technical solution of the present application, and are not limiting thereof; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the corresponding technical solutions.

Claims

1. A method of comparing a decorative effect map to a camera view, comprising:

2. The method according to claim 1, characterized in that:

the decoration effect diagram is a panoramic view of house decoration design effect.

3. The method according to claim 1, characterized in that:

the camera is carried on the handheld terminal equipment or the wearable intelligent equipment;

the handheld terminal device or the wearable intelligent device is also provided with an inertial sensor.

4. The method according to claim 1, characterized in that:

further comprises:

shooting according to a user command camera to generate a live-action photo;

5. The method according to claim 4, wherein:

further comprises:

6. The method according to any one of claims 1-5, wherein:

the panorama display interface also displays a thumbnail user pattern;

7. The method according to any one of claims 1-5, wherein:

the updating of the decoration effect graph according to the position and the gesture of the camera comprises the following steps:

8. An apparatus for comparing a decorative effect map with a camera view, comprising:

9. An electronic device, characterized in that: the system comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory are communicated with each other through the communication bus; the memory is used for storing a computer program; the processor is configured to implement the method according to any one of claims 1-7 when executing a program stored on a memory.

10. A computer-readable storage medium having instructions stored thereon, which when executed by one or more processors, cause the processors to perform the method of any of claims 1-7.