CN115731349A

CN115731349A - Method and device for displaying house type graph, electronic equipment and storage medium

Info

Publication number: CN115731349A
Application number: CN202211455762.1A
Authority: CN
Inventors: 请求不公布姓名
Original assignee: Beijing Chengshi Wanglin Information Technology Co Ltd
Current assignee: Beijing Chengshi Wanglin Information Technology Co Ltd
Priority date: 2022-11-21
Filing date: 2022-11-21
Publication date: 2023-03-03

Abstract

The embodiment of the invention provides a method and a device for displaying a house type diagram, electronic equipment and a storage medium, wherein the method comprises the following steps: displaying a space house type graph of a target space and a target panoramic graph under a current observation visual angle, wherein the space house type graph comprises a first structural element generated based on a space outline graph, and the space outline graph is constructed according to first image acquisition data and/or second image acquisition data acquired at a first acquisition point of the target space; the target panorama is an image area which at least partially covers a medium corresponding to the first structural element to be edited and is acquired from second image acquisition data acquired at a second acquisition point in the target space; responding to the fact that at least one target medium image exists in the obtained target panoramic image, and correspondingly generating a second structural element corresponding to the target medium image in the space house type image; and updating the space floor type graph corresponding to the display target space according to the second structural element.

Description

Method and device for displaying house type graph, electronic equipment and storage medium

Technical Field

The present invention relates to the field of interface interaction technologies, and in particular, to a method and an apparatus for displaying a house type diagram, an electronic device, and a computer-readable storage medium.

Background

With the development of technologies such as panoramic technology, VR (Virtual Reality), AR (Augmented Reality) and the like, the technologies can be widely applied to the fields of on-line house watching, marketing, exhibition and the like, the realization of the presentation of real environment information by building Virtual scenes, articles and the like by depending on technologies is realized, and the functions of real Reality duplication and field information recording are effectively exerted. The method is characterized in that for a house source house type graph, outline information and spatial distribution conditions of a house can be fully embodied, but for generation of the house type graph, only the positions of doors and windows in a panoramic graph are identified in a pure manual mode, so that doors and windows are added in the house type graph, or the positions of the doors and windows in the panoramic graph are identified in a pure automatic mode, so that certain limitations of automatically adding the doors and windows in the house type graph are realized, the pure manual identification efficiency is low, the pure automatic identification is realized, and the identification is easy to make mistakes for panoramic graph materials with low quality.

Disclosure of Invention

The embodiment of the invention provides a method and a device for displaying a house type graph, electronic equipment and a computer readable storage medium, which are used for solving or partially solving the problems of inaccurate image identification, low identification efficiency and drawing threshold in the process of editing a house type graph of a house source in the related art.

The embodiment of the invention discloses a method for displaying a house type graph, which comprises the following steps:

displaying a spatial house type graph of a target space and a target panoramic graph under a current observation visual angle, wherein the spatial house type graph comprises a first structural element generated based on a house type outline graph, the spatial house type graph is constructed according to first image acquisition data and/or second image acquisition data acquired at a first acquisition point of the target space, and the first acquisition point is any acquisition point of at least one acquisition point of the target space; the target panorama is an image area which at least partially covers a medium corresponding to a first structural element to be edited and is acquired according to second image acquisition data acquired at a second acquisition point in the target space;

responding to the acquired at least one target medium image in the target panoramic image, and generating a second structural element corresponding to the target medium image in the spatial user type image;

and updating and displaying the space floor type graph corresponding to the target space according to the second structural element.

Optionally, the method further comprises:

acquiring a target observation point corresponding to the current observation angle and a target observation area corresponding to the target observation point, wherein the target observation point is a mapping point of the second acquisition point in the spatial household type graph, and the target observation area is a mapping area of the target panoramic image in the spatial household type graph;

and displaying the target observation point and the target observation area in the spatial floor plan.

Optionally, the second acquisition point is an optimal acquisition point of the medium corresponding to the first structural element in at least one acquisition point of the target space, the method further comprising:

selecting an acquisition point closest to a medium corresponding to the first structural element from the at least one acquisition point of the target space as an optimal acquisition point as the second acquisition point; or the like, or, alternatively,

and selecting an acquisition point close to the forward shooting direction of the medium corresponding to the first structural element as an optimal acquisition point from at least one acquisition point in the target space to serve as a second acquisition point.

Optionally, the method further comprises:

acquiring the space house type diagram according to a first space contour diagram, wherein the first space contour diagram is constructed according to first image acquisition data acquired at a first acquisition point of a target space, and the first acquisition point is any acquisition point in at least one acquisition point of the target space; or the like, or, alternatively,

acquiring the space house-type map according to a second space contour map, wherein the second space house-type map is constructed according to second image acquisition data acquired at the first acquisition point of a target space; or the like, or a combination thereof,

and acquiring the space floor plan according to the first space contour map and the second space contour map.

Optionally, the generating, in response to acquiring that at least one target medium image exists in the target panorama, a second structural element corresponding to the target medium image in the spatial user type map includes:

responding to image recognition processing executed on the target panoramic image, and if the obtained recognition result is that the at least one target medium image exists in the target panoramic image, generating a second structural element corresponding to the target medium image in the space user type image; and/or

Responding to marking operation of the at least one target medium image existing in the target panoramic image through manual operation, and if the obtained marking result shows that the at least one target medium image exists in the target panoramic image, correspondingly generating a second structural element corresponding to the target medium image in the space user type image.

and in response to executing image recognition processing or marking operation on the target panoramic image, if the obtained recognition result indicates that the at least one target medium image exists in the target panoramic image, generating a second structural element corresponding to the target medium image in the space user type image, and displaying a target marking element recognized for the at least one target medium image in the target panoramic image.

Optionally, in response to a marking operation on the at least one target medium image in which the target panorama exists by a manual operation, further comprising:

displaying an editing control group aiming at the target mark element, wherein the editing control group at least comprises an endpoint control and a mobile control;

responding to triggering of at least one endpoint control through manual operation, and after the endpoint control completes execution of a first editing operation, acquiring a first display size of the target marking element in the target panoramic image according to an area of the first editing operation;

and/or responding to the trigger of the manual operation on the mobile control, so that after the mobile control completes the execution of the second editing operation, the target display position of the target marking element in the target panorama is obtained according to the position of the second editing operation.

Optionally, the editing control group further includes a switching control, and the method further includes:

and responding to the triggering of at least one switching control through manual operation, so that the switching control switches the currently displayed target mark element into another mark element for representing another medium in the target panorama after the third editing operation is executed.

Optionally, the target display parameters at least include a target display position and a first display size, where the target display position is a panoramic pixel coordinate, and the generating a second structural element corresponding to the target medium image in the spatial user-type diagram includes:

mapping a panoramic pixel coordinate corresponding to a target marking element into a three-dimensional point cloud coordinate, and mapping the first display size into a second display size according to a preset proportional mapping relation;

locating a target contour element corresponding to the three-dimensional point cloud coordinate and a contour position on the target contour element from the space contour map;

and displaying a second structural element corresponding to the target mark element on the contour position of the target contour element of the space contour map.

The embodiment of the invention also discloses a display device of the house type graph, which comprises:

the panoramic view display module is used for displaying a spatial house type view of a target space and a target panoramic view under a current observation visual angle, wherein the spatial house type view comprises a first structural element generated based on a house type outline, the spatial outline is constructed according to first image acquisition data and/or second image acquisition data acquired at a first acquisition point of the target space, and the first acquisition point is any acquisition point of at least one acquisition point of the target space; the target panorama is an image area which at least partially covers a medium corresponding to a first structural element to be edited and is acquired according to second image acquisition data acquired at a second acquisition point in the target space;

the structural element generating module is used for responding to the fact that at least one target medium image exists in the obtained target panoramic image, and generating a second structural element corresponding to the target medium image in the space user type image;

and the family graph updating module is used for updating and displaying the space family graph corresponding to the target space according to the second structural element.

Optionally, the method further comprises:

an observation information obtaining module, configured to obtain a target observation point corresponding to the current observation angle and a target observation area corresponding to the target observation point, where the target observation point is a mapping point of the second acquisition point in the spatial house type map, and the target observation area is a mapping area of the target panorama in the spatial house type map;

and the observation information display module is used for displaying the target observation point and the target observation area in the spatial floor plan.

Optionally, the second acquisition point is an optimal acquisition point of the medium corresponding to the first structural element in at least one acquisition point of the target space, the apparatus further comprising:

an acquisition point determining module, configured to select, as the second acquisition point, an acquisition point closest to a medium corresponding to the first structural element from among the at least one acquisition point in the target space as an optimal acquisition point; or selecting the acquisition point close to the forward shooting direction of the medium corresponding to the first structural element as an optimal acquisition point from at least one acquisition point in the target space as a second acquisition point.

Optionally, the method further comprises:

a first house-type map determining module, configured to obtain the spatial house-type map according to a first spatial contour map, the first spatial contour map being constructed according to first image acquisition data acquired at a first acquisition point of a target space, the first acquisition point being any one of at least one acquisition point of the target space;

the second house-type graph determining module is used for acquiring the spatial house-type graph according to a second spatial profile graph, and the second spatial house-type graph is constructed according to second image acquisition data acquired at the first acquisition point of the target space; or the like, or, alternatively,

and the third house type graph determining module is used for acquiring the spatial house type graph according to the first spatial profile graph and the second spatial profile graph.

Optionally, the structural element generation module is specifically configured to:

Optionally, the structural element generation module is further specifically configured to:

Optionally, the method further comprises:

the control group display module is used for displaying an editing control group aiming at the target mark element, wherein the editing control group at least comprises an endpoint control and a mobile control;

the display size determining module is used for responding to triggering of at least one endpoint control through manual operation, so that after a first editing operation is executed by the endpoint control, a first display size of the target marking element in the target panorama is obtained according to an area of the first editing operation;

and the display position determining module is used for responding to the trigger of the manual operation on the mobile control, so that after the mobile control executes a second editing operation, a target display position of the target marking element in the target panorama is obtained according to the position of the second editing operation.

Optionally, the editing control group further includes a switching control, and the apparatus further includes:

and the mark element switching module is used for responding to the trigger of at least one switching control through manual operation, so that the switching control switches the currently displayed target mark element into another mark element representing another medium in the target panoramic image after the third editing operation is executed.

Optionally, the target display parameter at least includes a target display position and a first display size, the target display position is a panoramic pixel coordinate, and the structural element generation module is specifically configured to:

The embodiment of the invention also discloses electronic equipment which comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory finish mutual communication through the communication bus;

the memory is used for storing a computer program;

the processor is configured to implement the method according to the embodiment of the present invention when executing the program stored in the memory.

Embodiments of the present invention also disclose a computer-readable storage medium having instructions stored thereon, which, when executed by one or more processors, cause the processors to perform the method according to the embodiments of the present invention.

The embodiment of the invention has the following advantages:

in the embodiment of the invention, in the process of manually and/or automatically editing the house type diagram, the terminal can firstly display the space house type diagram of the target space and the target panoramic diagram under the current observation angle, and simultaneously in the process of manually and/or automatically editing the terminal, the terminal can respond to the fact that at least one target medium image exists in the obtained target panoramic diagram, generate a second structural element corresponding to the target medium image in the space house type diagram correspondingly, and automatically update and display the space house type diagram corresponding to the target space according to the second structural element, so that in the process of manually and/or automatically editing the house type diagram, the manual and/or automatic editing is combined, the process of editing the house type diagram is simplified, the flexibility of editing the house type diagram is improved based on the linkage between the mark of the space real scene diagram and the display of the space house type diagram, the manual and/or automatic editing of the house type diagram can be realized by the mark of the real scene content, the process of editing the house type diagram is improved, the editing efficiency of the house type diagram can be effectively improved, the quality of shooting is not too high, and the panoramic material editing rate is not increased.

Drawings

FIG. 1 is a flowchart illustrating steps of a method for displaying a house view according to an embodiment of the present invention;

FIG. 2 is a schematic diagram of data collection provided in an embodiment of the present invention;

FIG. 3 is a schematic diagram of a spatial floor plan and a target panorama provided in an embodiment of the present invention

FIG. 4 is a schematic diagram of a spatial live-action provided in an embodiment of the present invention;

FIG. 5 is a schematic diagram of a spatial live-action provided in an embodiment of the present invention;

FIG. 6 is a block diagram of a display device of a house layout provided in the embodiment of the present invention;

fig. 7 is a block diagram of an electronic device provided in an embodiment of the present invention.

Detailed Description

In order to make the aforementioned objects, features and advantages of the present invention more comprehensible, the present invention is described in detail with reference to the accompanying drawings and the detailed description thereof.

As an example, in an online room-viewing scene, a display mode of a panoramic space and a VR space for an entity space has become one of the main modes of room source display, and through three-dimensional virtual space display, the sense of reality and the stereoscopic impression of a room space can be effectively improved, and a better room-finding experience is brought to a user. In contrast, the accurate and effective drawing of the house type graph can fully show the corresponding house source information for the user because the house type graph can fully embody the outline information and the spatial distribution condition of the house. However, the user-type diagram is drawn in a lack of convenient and efficient editing.

In contrast, one of the core invention points of the present invention is that in the process of manually and/or automatically editing the house type map, the terminal may first display the space house type map of the target space and the target panoramic map at the current observation angle, and meanwhile, in the process of manually and/or automatically editing the terminal, the terminal may respond to the fact that at least one target medium image exists in the obtained target panoramic map, generate a second structural element corresponding to the target medium image in the space house type map, and automatically update and display the space house type map corresponding to the target space according to the second structural element, so that in the process of manually and/or automatically editing the house type map, based on the linkage between the mark of the space real scene map and the display of the space house type map, the manual and/or automatic editing of the house type map may be realized by the mark of the real scene content, which not only simplifies the process of editing the house type map, but also improves the flexibility of editing the house type map based on the real scene, and can effectively improve the editing efficiency of the panoramic editing of materials which are not high in shooting quality.

In order to make those skilled in the art better understand the technical solution of the present invention, some technical features involved in the embodiments of the present invention are explained and illustrated below:

the first image acquisition data may be point cloud data acquired by the electronic terminal on at least one acquisition point of the target space. Optionally, the acquisition point for acquiring the point cloud data may be used as a first acquisition point, and a corresponding point cloud plan may be constructed according to the point cloud data corresponding to at least one first acquisition point, and the basic outline of the target space may be presented through the point cloud plan.

And the second image acquisition data can be a panoramic image acquired by the electronic terminal on the target space at least one acquisition point of the target space. Optionally, the acquisition point for acquiring the panoramic image may be used as a second acquisition point, and then a spatial live view corresponding to the target space may be determined by at least one panoramic image acquired at the second acquisition point, and a spatial structure corresponding to the target space may be presented by the spatial live view, so as to present more real and stereoscopic spatial information for the user, and improve spatial perception of the user on the target space.

The spatial house type graph, which may correspond to the spatial house type of the target space, may include several different structural elements, for example: the door body structural elements, the window body structural elements and the like are used for presenting the space structure corresponding to the target space, and the target space is understood as a single independent entity space.

For the spatial user type graph, the spatial user type graph can be obtained through corresponding editing processing on the basis of a point cloud plane graph of a target space, and can also be obtained through corresponding operation processing on the basis of a panoramic graph of the target space.

The medium may be a spatial structure located in a target space, such as a wall, a door, a window, a water line, and an electric line, where the target space is understood to be a single independent physical space.

The medium image may be an image of a spatial structure located in a spatial live-action image, such as an image of a wall, an image of a door, an image of a window, an image of a water line, and an image of an electric line, which correspond to the spatial structure.

The structural elements may be used to characterize a spatial structure of a target space, and may include wall structural elements, door structural elements, window structural elements, water line structural elements, electrical line structural elements, and other structural elements used to characterize a spatial structure in a target space.

The mark elements may be used as interface elements for marking in the spatial live-action diagram, and different structure elements may correspond to different mark elements, for example, different structure elements, and mark elements of different display styles, so as to be distinguished by different display modes.

Referring to fig. 1, a flowchart illustrating steps of a method for displaying a house type diagram provided in an embodiment of the present invention is shown, which specifically includes the following steps:

step 101, displaying a spatial house type graph of a target space and a target panoramic graph under a current observation visual angle, wherein the spatial house type graph comprises a first structural element generated based on a house type outline graph, the spatial house type graph is constructed according to first image acquisition data and/or second image acquisition data acquired at a first acquisition point of the target space, and the first acquisition point is any acquisition point of at least one acquisition point of the target space; the target panoramic image is an image area which is acquired from second image acquisition data acquired from a second acquisition point in the target space and at least partially covers a medium corresponding to a first structural element to be edited;

the house pattern editing related in the embodiment of the present invention may be a process of editing immediately after data acquisition is performed on a target space, may also be a process of supplementary editing of a space house pattern corresponding to a certain target space in an entire house pattern after the space house pattern of a plurality of target spaces is spliced to obtain the entire house pattern of the entire space, and may also be a process of continuously editing at a breakpoint. For example, a first user may hold an electronic terminal to find a suitable acquisition point in a target space, and perform image acquisition on the target space at the acquisition point to obtain corresponding image data, and then the first user performs manual and/or automatic drawing on a user-type diagram through a terminal based on the acquired image data, or a second user performs manual and/or automatic drawing on the user-type diagram through a terminal based on data acquired by the first user, which is not limited by the present invention.

In the acquisition process, the intelligent terminal can perform positioning through a sensor of the intelligent terminal and output the current position in the target space in real time in a graphical user interface, so that a user can execute a corresponding image acquisition strategy through the real-time position, and similarly, the camera can also execute corresponding operation. In addition, for the electronic terminal, it may include at least two types of sensors, and in the process of performing image acquisition on the target space, the electronic terminal may acquire the point cloud data corresponding to the target space through the laser scanning device on the one hand, and may acquire the panoramic image corresponding to the target space through the panoramic camera on the other hand, so that in the process of image acquisition, a point cloud plan corresponding to the target space may be constructed based on the point cloud data, and a space live view corresponding to the entity space may be constructed through the panoramic image, and the like, which is not limited in this invention.

In an example, referring to fig. 2, a schematic diagram of data acquisition provided in an embodiment of the present invention is shown, assuming that a user performs data acquisition on a target space through three acquisition points in the target space by a terminal, including an acquisition point (1), an acquisition point (2), and an acquisition point (3), where the acquired data may include point cloud data a and a panorama a corresponding to the acquisition point (1), point cloud data B and a panorama B corresponding to the acquisition point (2), and point cloud data C and a panorama C corresponding to the acquisition point (3), so that in an image acquisition process, a point cloud plan corresponding to the target space may be constructed based on the point cloud data, a space live view corresponding to the target space may be constructed by the panorama, and the like.

It should be noted that, when each acquisition point performs data acquisition, and when one acquisition point triggers to perform one-time data acquisition, the terminal may perform corresponding data acquisition operations respectively through the laser scanning device and the image acquisition sensor based on the same acquisition point, so as to obtain different types of data such as point cloud data and image data acquired at the time, so that the terminal performs different data processing operations based on the different types of data. The invention is not limited in this regard.

Further, for the point cloud data corresponding to each point, it may be obtained through the following two methods:

taking the acquisition point (1), the acquisition point (2) and the acquisition point (3) as an example, assuming that the acquisition point (1), the acquisition point (2) and the acquisition point (3) are in a sequential acquisition order, the sequentially acquired data may include point cloud data a and a panorama a corresponding to the acquisition point (1), point cloud data B and a panorama B corresponding to the acquisition point (2) and point cloud data C and a panorama C corresponding to the acquisition point (3), wherein the point cloud data a ' currently acquired at the acquisition point (1) may be directly used as the point cloud data a, the point cloud data B ' currently acquired at the acquisition point (2) may be directly used as the point cloud data B, and the point cloud data C ' currently acquired at the acquisition point (3) may be directly used as the point cloud data C.

Taking the acquisition point (1), the acquisition point (2) and the acquisition point (3) as an example, assuming that the acquisition point (1), the acquisition point (2) and the acquisition point (3) are in a sequential acquisition order, the sequentially acquired data may include point cloud data a and a panorama a corresponding to the acquisition point (1), point cloud data B and a panorama B corresponding to the acquisition point (2) and point cloud data C and a panorama C corresponding to the acquisition point (3), wherein the point cloud data a ' currently acquired at the acquisition point (1) may be directly used as the point cloud data a, the point cloud data B ' and the point cloud data a currently acquired at the acquisition point (2) are subjected to point cloud fusion to acquire the point cloud data B, and the point cloud data C ' and the point cloud data B (and the point cloud data a) currently acquired at the acquisition point (3) are subjected to point cloud fusion to acquire the point cloud data C.

It should be noted that, as shown in fig. 2, the spatial house type graph in the present invention may be obtained from a first spatial profile graph constructed according to point cloud data obtained at a first acquisition point in a target space, specifically, directly map the point cloud data obtained at the first acquisition point onto a two-dimensional plane to obtain a first spatial profile, may directly use the first spatial profile graph as a spatial profile graph, and may also perform manual and/or automatic editing processing on the first spatial profile graph to obtain the spatial profile graph; the second space contour map constructed according to the panoramic image collected at the first collection point of the target space can be obtained, and then the obtained second space contour map can be directly used as the space contour map, and manual and/or automatic editing processing can be further carried out on the second space contour map to obtain a better-quality space contour map.

In addition, the space profile of the present invention can be obtained according to the first space profile and the second space profile. Optionally, the user-type contour line with better quality may be selected as the spatial contour line in the first spatial contour line and the second spatial contour line, or the user-type contour lines of the first spatial contour line and the second spatial contour line may be subjected to fusion processing to obtain a spatial contour line with better user-type contour line quality, or manual and/or automatic editing processing may be performed on the spatial contour line to obtain a spatial contour line with better user-type contour line quality. Wherein the first acquisition Point may be any of acquisition Point (1), acquisition Point (2) and acquisition Point (3) in FIG. 2; exemplarily, taking the acquisition point (1) as a first acquisition point, acquiring the point cloud data a and the panorama a at the acquisition point (1), and then constructing a first spatial contour map according to the point cloud data a, and then directly taking the first spatial contour map as the spatial contour map, or performing manual and/or automatic editing processing on the first spatial contour map to acquire the spatial contour map; the second space contour map can also be constructed according to the panoramic image a, and then the second space contour map can be directly used as the space contour map, and the second space contour map can also be subjected to manual and/or automatic editing processing to obtain the space contour map. In addition, the space profile of the invention can be obtained by the first space profile and the second space profile. Optionally, a better quality user-type contour line can be selected as the spatial contour line from the first spatial contour line constructed according to the point cloud data a and the second spatial contour line constructed according to the panoramic image a, the user-type contour line corresponding to the first spatial contour line constructed according to the point cloud data a and the second spatial contour line constructed according to the panoramic image a can be fused to obtain a better spatial contour line, and manual and/or automatic editing processing can be performed on the processed spatial contour line to obtain a better spatial contour line.

Optionally, the present invention may be applied to an intelligent terminal, where a corresponding application program (for example, a life application program capable of providing on-line house finding, etc.) may be run on the intelligent terminal, and the terminal runs the application program and displays corresponding content (for example, a space live view, etc.) in a graphical user interface, so that a user inputs a corresponding instruction at the terminal to perform manual and/or automatic construction of a user-type view on the acquired image data, which is not limited in this respect.

In the embodiment of the invention, based on the point cloud data and the panorama acquired as described above, in the process of displaying the house type map, the user may further input a corresponding instruction in the terminal so as to facilitate the terminal to manually and/or automatically edit the house type map, specifically, the terminal may display the space house type map corresponding to the target space and the target panorama at the current observation angle in the graphical user interface, so that by displaying the 2D contour map and the 3D live-action map, the target space may be perceived from a global angle based on the space house type map in the editing process, and the target space may be perceived from a local and stereoscopic angle based on the live-action map, thereby reducing an understanding threshold of the user on a field environment, and facilitating subsequent editing of the house type map based on the displayed space live-action map and the space contour.

It should be noted that, for the space house type diagram, the corresponding display forms may also be different on different display interfaces, specifically, when the terminal displays the global editing interface in the graphical user interface, the complete space house type diagram may be displayed in the global editing interface, and in this case, the displayed space house type diagram may include the profile information corresponding to the entity space corresponding to each acquisition point; when the terminal displays the panoramic editing interface in the graphical user interface, a local area of the spatial household map may be displayed in the panoramic editing interface, in which case the displayed spatial household map may include profile information corresponding to an entity space corresponding to a part of the acquisition point, for example, the terminal may display the spatial household map corresponding to the whole house (for example, a household map composed of living rooms, kitchens, bedrooms, bathrooms, etc.) in the global editing interface, and may display a part of the spatial household map corresponding to the spatial real scene map (for example, a household map corresponding to a single spatial structure such as a living room, or a kitchen, or a bedroom, or a bathroom) in the panoramic editing interface, and the spatial household map displayed in the panoramic editing interface may also be a spatial structure diagram for representing a profile map corresponding to a specific function space in the target space, which the present invention is not limited.

In a specific implementation, a terminal may first display a space house type graph in an editing state corresponding to a target space, where the space house type graph may include a plurality of first structural elements, the space house type graph is constructed according to first image acquisition data and/or second image acquisition data acquired at a first acquisition point in the target space, and then may at least display a target panorama corresponding to the target space at a current observation angle in response to an input instruction for acquiring at least one first structural element in the space house type graph, and acquire a target observation point corresponding to the current observation angle and a target observation area corresponding to the target observation point, where the target observation point is a mapping point of the second acquisition point in the space house type graph, and the target observation area is a mapping area of the target panorama in the space house type graph, and then display the target observation point in the space house type graph, or the target observation point and the target observation area.

It should be noted that, in the process of constructing the spatial floor plan, the spatial floor plan may be constructed manually and/or automatically, and after the construction is completed, structural elements for representing different spatial structures of the target space may be included in the spatial floor plan, and meanwhile, the spatial floor plan is supported to be edited, so that the spatial floor plan and the physical spatial structures of the target space can be in one-to-one correspondence, and thus, the accuracy of the house information is improved.

For the target space, the spatial structure of the wall, the door, the window, the water pipeline, the electric wire and the like can be included, for the spatial household type diagram, the structural elements of the wall, the door, the window, the water pipeline and the electric wire can be included, and after the spatial household type diagram of the spatial outline structure which can represent the target space is obtained, the structural elements in the spatial household type diagram can be edited, the spatial household type diagram is filled and corrected to construct the household type diagram matched with the target space on the basis of the spatial household type diagram, and the spatial structure of the target space is completely and accurately presented through the household type diagram. For example, the constructed spatial house type diagram only contains wall structure elements representing the outline of the target space, but does not contain structure elements representing other spatial structures, and in this case, the spatial house type diagram needs to be further enriched, and structure elements representing spatial structures such as door bodies, windows, water pipelines, electric wires and the like are added, so as to ensure that the finally obtained house type diagram can fully embody the information such as the outline, the spatial structure and the like corresponding to the target space; the method can also include structural elements representing other spatial structures, but certain deviation exists, for example, the spatial structure represented by the structural elements is not matched with the actual spatial structure in the target space, or the display positions of the structural elements on the spatial house type diagram are not matched, and for the situation, the structural elements with errors can be corrected, so that the finally obtained house type diagram can fully embody the information such as the outline, the spatial structure and the like corresponding to the target space.

In the process of displaying the space house type diagram, the terminal can place the space house type diagram in an editable state, the space house type diagram can include a plurality of first structural elements, the first structural elements can be wall structural elements, the terminal can detect the first structural elements in the space house type diagram based on the mapping relation between the point cloud data and the panoramic diagram, and judge whether other media (doors, windows and the like) exist on the wall medium corresponding to the first structural elements, and if the media exist, the terminal can select the first structural elements needing to be edited and display a target panoramic diagram corresponding to the first structural elements. For the target panorama, it may be an image area obtained from the panorama acquired according to the second acquisition point of the target space that covers at least the medium corresponding to the first structural element to be edited. After the wall structure element needing to be edited is determined, the terminal can select an optimal acquisition point corresponding to the medium corresponding to the wall structure element from at least one acquisition point of the target space, then acquire a space live-action image corresponding to the optimal acquisition point, extract an image area capable of covering the medium corresponding to the wall structure element from the acquired space live-action image, and then display the image area (namely the displayed target panoramic image), so that structural elements representing other space structures are added to the wall structure element in the space user type image through the live-action content corresponding to the target space local area displayed in the space live-action image, and the space user type image is filled.

For the first structural element, it may be a result obtained after image recognition is performed on a panoramic image (an exemplary target panoramic image) acquired from any one of a plurality of acquisition points (second acquisition point), when the panoramic image is of good quality, automatic recognition may be performed according to the panoramic image, and when an image of a wall medium is recognized in the panoramic image, panoramic pixel coordinates of the wall medium in a corresponding panoramic image may be acquired according to the image of the wall medium, where the panoramic image is taken as exemplary second image acquisition data and acquired at a second acquisition point in a target space. The target panorama is acquired according to the panorama acquired at the second acquisition point.

Having obtained the house-type outline map, it is further necessary to establish a mapping relationship between the panoramic image acquired by the second acquisition point and the spatial outline map, so that the house-type spatial map is generated based on the house-type outline map, and the generated house-type spatial map includes the first structural elements mapped according to the wall images (images of the exemplary first structural elements corresponding to the media) in the panoramic image.

Specifically, firstly, a mapping relation between a panoramic image (an exemplary target panoramic image) acquired by a second acquisition point and three-dimensional point cloud data acquired by a first acquisition point for acquiring a space household image is established to obtain a three-dimensional point cloud coordinate of the panoramic image of the second acquisition point;

and further mapping the three-dimensional point cloud coordinates of the panoramic image of the second acquisition point to a plane of the spatial house type image to obtain a mapping relation between the panoramic image (an exemplary target panoramic image) acquired by the second acquisition point and the spatial house type image.

Specifically, the three-dimensional point cloud coordinates of the panoramic image acquired by the second acquisition point are mapped to the coordinate system of the three-dimensional point cloud data of the target space to obtain the three-dimensional point cloud coordinates of the panoramic image of the second acquisition point, and then the three-dimensional point cloud coordinates of the panoramic image of the second acquisition point are mapped in the spatial floor plan, since the panoramic image comprises an image area of a wall (an exemplary first structural element corresponding medium), the mapping of the wall (the exemplary first structural element corresponding medium) in the spatial floor plan can be correspondingly obtained, after the first structural element is obtained, the first structural element can be highlighted in the spatial floor plan (or displayed differently in a corresponding display mode, and the like), so that the terminal can perform coordinate conversion on the point cloud data and the panoramic image, establish the mapping relation between the panoramic image and the spatial floor plan, and realize editing of the spatial floor plan by marking the spatial floor plan in the subsequent process. Exemplarily, taking the wall medium in the panoramic image acquired by the second acquisition point as an example, and constructing the corresponding space floor plan based on the identification result, the panoramic image b may be acquired according to the acquisition point (2), the panoramic image may acquire the panoramic pixel coordinates of the wall medium in the panoramic image corresponding to the wall medium according to the wall medium image corresponding to the wall medium, and map the panoramic pixel coordinates of the wall medium to the coordinate system of the three-dimensional point cloud image of the target space to obtain the three-dimensional point cloud coordinates. For example, panoramic pixel coordinates corresponding to the outline of the wall may be mapped to three-dimensional point cloud coordinates.

Optionally, according to the mapping relationship between the panoramic pixel coordinates and the spherical coordinates, the panoramic pixel coordinates respectively corresponding to the outlines of the wall body are mapped into a spherical space to obtain corresponding spherical coordinates; and further, according to the relative pose relation between the panoramic camera and the laser scanning equipment and the mapping relation between the spherical coordinates and the three-dimensional point cloud coordinates, mapping the spherical coordinates respectively corresponding to the wall body outline into a three-dimensional point cloud coordinate system. Optionally, when mapping the panoramic Pixel coordinate corresponding to the wall contour to a spherical coordinate, the Pixel coordinate at the upper left corner of the panoramic Pixel coordinate may be used as an origin, assuming that the length and the width of the panoramic image are H and W, respectively, and the Pixel coordinate corresponding to each Pixel is Pixel (x, y), then the longitude Lon and the latitude Lat corresponding to the spherical coordinate after mapping of each panoramic Pixel coordinate are:

Lon＝(x/W-0.5)*360；

Lat＝(0.5–y/H)*180；

further, an origin O1 (0, 0) of the spherical coordinate system is established, and assuming that the radius of the spherical coordinate system is R, the spherical coordinates (X, Y, Z) of each panoramic pixel coordinate after mapping are respectively:

X＝R*cos(Lon)*cos(Lat)；

Y＝R*sin(Lat)；

Z＝R*sin(Lon)*cos(Lat)；

further, when the three-dimensional point cloud coordinate system is mapped from the spherical coordinate system, the corresponding spherical coordinate P = Q (X + X0, Y + Y0, Z + Z0) after rotation and movement transformation can be mapped through the mapping relation when the wall body is scanned by the laser scanning equipment; wherein x0, Y0, and z0 are respectively an origin O2 (x 0, Y0, z 0) of a three-dimensional point cloud coordinate system, rotationY is a rotation angle of the laser scanning device around a Y axis of a world coordinate system, and Q is a quaternion obtained by a system function quaternion.

Optionally, when determining the three-dimensional point cloud coordinates corresponding to the wall contour, the three-dimensional point cloud coordinates corresponding to the specified spatial position in each functional space may be used as reference coordinates, so as to determine the three-dimensional point cloud coordinates corresponding to the wall contour according to the relationship between the spherical coordinates and the reference coordinates. In the embodiment of the present invention, a specific position of the designated space position in the target house is not limited, and optionally, a three-dimensional point cloud coordinate corresponding to a wall contour in each functional space may be used as a reference coordinate, further, the reference coordinate is mapped to a corresponding reference spherical coordinate set, a ray from an origin O1 to a point P in a spherical coordinate system and a focus of the reference spherical coordinate are determined, and the three-dimensional point cloud coordinate corresponding to the focus is used as the three-dimensional point cloud coordinate corresponding to the wall contour. Of course, the spherical coordinates corresponding to the known object in the target house may be used as the reference spherical coordinates, for example, if the spherical coordinates corresponding to the ground are used as the reference spherical coordinates, the focal point of the ray from the origin O1 to the point P and the reference spherical coordinates, that is, the focal point of the plane where the ground is located, may be determined, and the three-dimensional point cloud coordinates corresponding to the focal point may be used as the three-dimensional point cloud coordinates corresponding to the wall contour. Furthermore, the three-dimensional point cloud coordinates can be mapped to the spatial floor plan in a two-dimensional manner, so that the wall structure elements (namely the first structure elements) corresponding to the wall medium image are correspondingly generated and displayed on the spatial floor plan. Similarly, based on the mapping relationship, the terminal may detect the first structural element, determine whether other media (such as a door and a window) exist on the wall medium corresponding to the first structural element, and display the target panorama corresponding to the first structural element when the first structural element needing to be edited is detected.

For the target panorama, it may be an image area of the medium corresponding to at least a part of the first structural element acquired from the panorama acquired from a second acquisition point in the target space, which may be an optimal acquisition point of the medium corresponding to the first structural element among acquisition point (1), acquisition point (2), and acquisition point (3) in fig. 2.

In one example, the best acquisition point among the acquisition point (1), the acquisition point (2) and the acquisition point (3) is the acquisition point closest to the medium corresponding to the first structural element, and as the second acquisition point, for example, for a certain solid wall in the target space, the corresponding distances from the acquisition point (1), the acquisition point (2) and the acquisition point (3) are respectively 2 meters, 3 meters and 5 meters, so that the acquisition point (1) can be used as the best acquisition point relative to the solid wall.

In another example, an acquisition point close to the forward shooting direction of the medium corresponding to the first structural element is taken as an optimal acquisition point among the acquisition point (1), the acquisition point (2) and the acquisition point (3), and as a second acquisition point, for example, assuming that the camera is taken as an origin and the corresponding ray is emitted as a forward shooting direction, if an included angle between a connecting line between the camera and the origin and the ray is smaller for the same solid wall in the target space, the closer the solid wall is to the forward shooting direction is indicated, so that the acquisition point with the smallest included angle can be taken as the optimal acquisition point relative to the solid wall.

Specifically, as described above, a user may perform data acquisition on a target space at least one acquisition point in the target space, each acquisition point corresponds to point cloud data and a panorama, the point cloud data is used to construct a corresponding space floor plan, and the panorama is used to construct a space live view (i.e., a panorama), when the user performs data acquisition on the target space at multiple acquisition points in the same target space, since different acquisition points may correspond to different acquisition perspectives, and there may be overlapping portions in the panoramas acquired by different acquisition points based on the corresponding acquisition perspectives, for example, the acquisition perspectives corresponding to two different acquisition points may both acquire the panoramas corresponding to the same wall, in this case, when editing a wall structure element corresponding to the wall, the terminal may select an optimal acquisition point relative to the wall from the two acquisition points involved, so that after determining a first structure element to be edited in the space floor plan, the terminal may derive the optimal acquisition point relative to the first acquisition point based on a relation between "panorama-first structure element-acquisition point" and may obtain a corresponding panoramic image of the first acquisition point, and then extract the panoramic image corresponding to the first structure element. It can be understood that, based on the above description, in order to fully display an image area corresponding to a structural element that needs to be edited, in the process of editing a spatial household map, the spatial household map may be constructed based on point cloud data a acquired by an acquisition point (1), when editing the structural element in the spatial household map, exemplarily, by using the above method for determining an optimal acquisition point, it is determined that an acquisition point (2) is an optimal acquisition point with respect to a medium corresponding to the structural element, then a panoramic view b corresponding to the acquisition point (2) is called, and an image area at least covering part of the medium corresponding to the structural element is acquired according to the panoramic view b to obtain a target panoramic view for display.

In addition, based on the above scheme, while displaying the target panorama, the terminal may acquire a target observation point corresponding to the current observation angle and a target observation area corresponding to the target observation point, where the target observation point may be a mapping point of the acquisition point (2) in the spatial floor plan, and the target observation area may be a mapping area of the target panorama in the spatial floor plan, and exemplarily, the mapping area may be represented by a sector area centered on the mapping point of the acquisition point (2) in the spatial floor plan; the method comprises the steps of displaying a space house type graph corresponding to a target panoramic graph in a graphical user interface, displaying a target observation point and a target observation area in the space house type graph, displaying a space real scene graph of an image area of a medium corresponding to at least part of a structural element and a space house type graph of a target space in the graphical user interface at the same time, linking the space real scene graph and the space house type graph, improving the richness of information display in the house type graph editing process, achieving linkage between marking of the space real scene graph and displaying of the space house type graph, adopting the space real scene graph to assist in editing the space house type graph, being capable of presenting a marking result in the house type graph editing process intuitively, and improving global perception of marking content of the target space. Optionally, in the process of displaying the space house type diagram and the space live-action diagram, the terminal may further display a point location list corresponding to the observation point in the space house type diagram; and responding to selection operation aiming at the point location identification in the space point location list or the observation point in the space floor plan, determining a second observation point, acquiring a second observation visual angle corresponding to the second observation point, and displaying the second observation point and the second observation area in the space floor plan.

For example, if the spatial household type graph includes an acquisition point (1) and an acquisition point (2) located in a living room, an acquisition point (3) located in a kitchen, an acquisition point (4) located in a bedroom, and an acquisition point (5) located in a bathroom, when a structural element corresponding to a living room area is edited, the terminal may display a spatial real-scene graph corresponding to the living room area on one hand, and may display a spatial household type graph corresponding to the living room area on the other hand, and the spatial household type graph may include an observation point i corresponding to the acquisition point (1) and an observation point ii corresponding to the acquisition point (2). Accordingly, the terminal may construct a space real-scene graph corresponding to the acquisition point based on the image data corresponding to the acquisition point, and the space real-scene graph may be a panoramic graph supporting 360 ° around view, and is limited by the terminal graphical user interface display, and may not completely display the 360 ° panoramic graph in the display process, but only display a partial image region corresponding to a medium capable of covering the first structural element to be edited, and the terminal may display an observation region corresponding to the observation point while displaying the observation point, where the observation region may be a mapping region of the target panoramic graph in the space real-scene graph, and the space real-scene graph displayed by the terminal changes with the switching of the observation angle, and similarly, the observation region in the space outline graph also changes with the switching of the observation angle, so that the linkage between the mark of the space real-scene graph and the display of the space outline graph is realized, and the result of the mark in the user-scene graph editing process can be visually presented based on the linkage of the space outline graph, and the mark content of the target space can be perceived globally.

In an example, referring to fig. 3, which illustrates schematic diagrams of a space floor plan and a target panorama provided in an embodiment of the present invention, while displaying the target panorama 310 corresponding to a current observation angle, a terminal may simultaneously display the space floor plan 320 corresponding to the target panorama 310 in a graphical user interface, and based on a determined target observation point and a target observation area, select a corresponding observation point 330 in the space floor plan 320 and display an observation area 340 (a sector area in the drawing) corresponding to the observation point 330, where as an observation angle of the space real view 310 by a user changes, the observation area 340 may also dynamically change along with the change of the space real view displayed in the graphical user interface, so as to implement linkage of presenting house information content.

Further, the above-mentioned spatial floor plan including the first structural element (exemplary wall) is obtained in an automatic manner, and since the door and window are on the wall, whether the door and window can be further identified in the panorama depends on the quality of the panorama. The following further explains the door and window images in the panoramic image as an exemplary target medium image.

Step 102, responding to the fact that at least one target medium image exists in the obtained target panoramic image, and generating a second structural element corresponding to the target medium image in the space user type image;

when the quality of the panoramic image is good, a target panoramic image with good quality can be obtained according to the panoramic image, image recognition processing can be performed on the target panoramic image, and if the obtained recognition result shows that the target panoramic image has at least one target medium image, a second structural element corresponding to the target medium image is correspondingly generated in the space user type image;

the process of identifying the doors and the windows is similar to that of the wall, and the three-dimensional point cloud coordinate of the panoramic image of the second acquisition point is obtained due to the mapping relation between the three-dimensional point cloud data acquired by the first acquisition point of the acquired space house-type image; meanwhile, the three-dimensional point cloud coordinates of the panoramic image of the second acquisition point are mapped to the plane of the spatial house type image, so that the mapping relation between the panoramic image (an exemplary target panoramic image) acquired by the second acquisition point and the spatial house type image is obtained;

at this time, if a door and window image (an exemplary image of the target medium) is identified in the target panorama, since the target panorama includes data of the door and window image (an exemplary image of the target medium), the door and window image (an exemplary image of the target medium) existing in the spatial user type map may be correspondingly obtained, and mapping in the corresponding spatial user type map is omitted here for brevity.

And when the quality of the panoramic image is not good, only the wall can be identified, and then the door and window images are identified in the target panoramic image only by manual identification.

Specifically, a marking operation of the at least one target medium image existing in the target panorama may be performed through a manual operation, and if the obtained marking result indicates that the at least one target medium image exists in the target panorama, a second structural element corresponding to the target medium image is generated in the spatial user type map.

In the foregoing, the automated identification process is introduced, a wall (for example, a first structural element) corresponding to a target medium image is correspondingly generated on the spatial floor plan, but when a second structural element corresponding to a door or window (for example, a target medium) cannot be further generated in the spatial floor plan, the method needs to be replaced by a manual identification method, the target panoramic image is identified in a manual identification method, and when at least one target medium image exists in the target panoramic image, it indicates that at least one target medium image exists in the target panoramic image, and the spatial floor plan can be edited based on the acquired target medium image. In the embodiment of the present invention, which identifies a target panorama by a machine automatic identification method, provides an explanation of a corresponding implementation method:

in a specific implementation, a target panorama performs a marking operation on the at least one target medium image existing in the target panorama through a manual operation, and if an obtained marking result indicates that the at least one target medium image exists in the target panorama, a second structural element corresponding to the target medium image is correspondingly generated in the space user type graph. Optionally, the artificial image recognition processing may be performed on the target panorama, or may be performed on the terminal, or the server performs the image recognition, and then sends the obtained recognition result to the terminal, and the specific recognition processing method is not described herein.

In a preferred mode, the terminal acquires at least one target medium image in the target panoramic image through the automatic and/or manual identification mode, and when the second structural element corresponding to the target medium image is acquired, the target mark element identified for the at least one target medium image can be displayed in the target panoramic image, and the corresponding target mark element is visually displayed, so that on one hand, a user can conveniently check the target medium image identified by the terminal, on the other hand, the user can conveniently edit the target mark element to mark the target medium image, and further, the user can conveniently mark the space real scene image to display the space user scene image, and the convenience for editing the space user scene image is improved.

For the target mark element, the mark element may be a mark element added to the target medium image in the target panoramic image when the terminal obtains the identification result that at least one target medium image exists in the target panoramic image, and different target medium images may be correspondingly displayed with different mark elements, for example, if the target medium image is a door body medium image, the door body mark element may be displayed; assuming that the target media image is a window media image, a window mark element or the like may be displayed, which is not limited by the present invention.

Optionally, panoramic pixel coordinates of the target medium in a corresponding panoramic image thereof may be acquired according to the target medium image, where the panoramic image is taken as exemplary second image acquisition data and acquired at a second acquisition point in the target space; the panoramic pixel coordinates of the target medium may also be mapped to a coordinate system of a three-dimensional point cloud image of the target space to obtain three-dimensional point cloud coordinates, where the three-dimensional point cloud image is taken as exemplary first image acquisition data and acquired at a first acquisition point of the target space, which is not limited in the present invention.

Optionally, when the user determines that the marking elements in the target panorama need to be manually edited according to the actual situation, the marking elements may also be manually edited through an editing control group provided by the terminal, where the marking elements are used to identify doors and windows (exemplary target medium images) in the target panorama.

By the above-mentioned marking operation of the at least one target medium image existing in the target panorama by the manual operation, the obtained marking result indicates that the at least one target medium image exists in the target panorama, and at this time, according to the mapping relationship between the panorama (exemplary target panorama) acquired by the second acquisition point and the spatial user type map, the second structural element corresponding to the target medium image may be generated in the spatial user type map correspondingly.

Obtaining a three-dimensional point cloud coordinate of a second acquisition point panoramic image due to the mapping relation between the three-dimensional point cloud data acquired by the first acquisition points of the space household image; meanwhile, the three-dimensional point cloud coordinates of the panoramic image of the second acquisition point are mapped to the plane of the spatial house type image, so that the mapping relation between the panoramic image (an exemplary target panoramic image) acquired by the second acquisition point and the spatial house type image is obtained;

at this time, if a door/window image (an exemplary image of the target medium) is identified in the target panorama by a manual identification method, since the target panorama includes data of the door/window image (the exemplary image of the target medium), the door/window image (the exemplary image of the target medium) existing in the spatial user type map may be correspondingly obtained, and mapping in the corresponding spatial user type map is omitted here for brevity.

Specifically, the terminal may further display an editing control group for the target marking element, where the editing control group may include an endpoint control and a mobile control, and in a specific implementation, the terminal may trigger at least one endpoint control through manual operation, and after the endpoint control performs a first editing operation, the terminal may obtain a target display size of the target marking element in the target panorama according to an area of the first editing operation; and/or, through manual operation for triggering the mobile control, after the mobile control completes second editing operation, the terminal may obtain a target display position of the target marking element in the target panorama according to a position of the second editing operation. The marking element may be an element that "covers" a corresponding image area on the space live-action image, and the display size corresponding to the marking element may be determined based on the panoramic pixel coordinates at the upper end, the lower end, the left end, and the right end of the panoramic pixel coordinates, and similarly, the display position corresponding to the marking element in the space live-action image may be determined based on the panoramic pixel coordinates corresponding to the marking element, and further, for the display size and the display position both corresponding to the panoramic pixel coordinates, mapping the marking element into the space floor plan may be implemented based on the display size and the display position, so as to display the structural element corresponding to the marked target medium image on the space floor plan. In addition, the editing control group may further include a switching control, and then, after the switching control completes the third editing operation by triggering at least one switching control through manual operation, the terminal may switch the currently displayed target markup element to another markup element that characterizes another medium in the target panorama.

After the corresponding target mark element is displayed in the live-action space diagram, an editing function of the target mark element is provided, so that the terminal can adjust the target mark element in the space user type diagram in real time through any control in the editing control group to more accurately display the structural element corresponding to the target mark element (for example, structural elements representing other space structures are added on the corresponding wall structural element), and therefore, in the process of editing the house information, linkage between marking of the space live-action diagram and displaying of the space user type diagram is realized, on one hand, marking of live-action content is met, on the other hand, in the marking process, based on linkage of the space user type diagram, a marking result can be visually presented, and global perception of the mark content of the target space can be improved.

In a specific implementation, the display position corresponding to the marker element may be a panoramic pixel coordinate, the panoramic pixel coordinate corresponding to the marker element may be mapped to a three-dimensional point cloud coordinate based on the mapping relationship, then the corresponding second structural element is displayed in the spatial user type diagram, and for the size and the structure identifier of the displayed second structural element, the display size corresponding to the marker element may be mapped, and meanwhile, what kind of second structural element needs to be displayed is determined according to the structure identifier, so that according to the mapping relationship between the constructed spatial user type diagram and the spatial user type diagram, the display of the spatial user type diagram can be realized by marking the corresponding medium in the spatial user type diagram, the flow of editing the user type diagram is greatly simplified, the convenience of editing is improved, the editing efficiency is improved, and the accuracy of the content presented by the user type diagram can be improved by marking in combination with the presented real scene content.

After the second structural element is determined in the above manner, the position of the target medium image correspondingly mapped to the first structural element in the spatial user type map can be identified from the target panoramic map, and the position is taken as the mapping position of the second structural element on the first structural element. Specifically, if the first structural element also has a corresponding media image in the target panorama, the first media image of the first media in the target panorama corresponding to the first structural element and the target media image of the second media in the target panorama corresponding to the second structural element may be identified from the target panorama by means of image identification, and then, based on an image overlap relationship between the first media image and the target media image, a mapping position of the second structural element on the first structural element may be obtained, so as to update the spatial user type map according to the mapping position.

In the above process, the second structure element is generated corresponding to the spatial house type diagram, and the corresponding second structure element is generated on the spatial structure diagram in the panoramic editing interface, and at this time, the global spatial house type diagram is not yet updated.

In an example, referring to fig. 4, a schematic diagram of a spatial real view provided in the embodiment of the present invention is shown, taking manual editing as an example, a terminal may display a corresponding real view editing interface 40 through a graphical user interface, and may display a target panoramic view 410 corresponding to a target space at a current viewing angle and a spatial user-type view 420 in the real view editing interface 40, and display a target observation point and a target observation area at the current viewing angle in the spatial user-type view 420.

A toolbar 430 is also displayed through the graphical user interface, and a window marking control 4301 (an exemplary structure marking control, a window marking that characterizes an entity window), a first type of door body marking control 4302 (an exemplary structure marking control, a door body marking that characterizes an entity door body), and a second type of door body marking control 4303 (an exemplary structure marking control, a door body marking that characterizes an open door body) may be included in the toolbar 430.

When an input instruction to a certain wall structure element 440 (exemplary first structure element) of the spatial user type map 420 representing a wall boundary is obtained, the input instruction may be an input instruction of a selection operation performed by a user on a certain wall structure element 440 in the displayed spatial user type map 420, or may be an input instruction triggered by a machine to automatically recognize that a certain wall structure element 440 in the spatial user type map 420 needs to be edited, the obtained input instruction represents that an editing operation needs to be performed on the wall structure element 440, and at this time, a target panoramic map 410 corresponding to a target space at a current viewing angle needs to be displayed in a matching manner, the spatial user type map 410 may be constructed according to point cloud data acquired at a first acquisition point of the target space, the first acquisition point may be any one acquisition point of at least one acquisition point of the target space, the spatial real-scene map 410 is a panoramic map acquired according to a second acquisition point in the target space, the obtained at least one wall structure element 440 (exemplary first structure element) corresponds to a partial image of the second acquisition point in the target space, and the obtained at least one wall structure element 440 (exemplary first acquisition point image corresponds to a partial image of the wall structure element in the target space.

Specifically, when a user adds a corresponding door body marking element 450 (an exemplary target marking element) in the space live-action drawing through the first-type door body marking control 4302, the terminal may simultaneously display an editing control group 460 (an exemplary editing control group) for the door body marking element 450, and the user may edit the door body marking element 450 through an endpoint control in the editing control group 460 in response to the triggering of the endpoint control, so that after the endpoint control completes a first editing operation on the door body marking element 450, the display size of the door body marking element 450 in the space live-action drawing 410 may be obtained according to an area (shown as a range of a gray line mark) of the first editing operation; the door marking element 450 after the marking operation is performed on the door image is displayed in the space live-action image, which indicates that the door medium image exists in the space live-action image 410. At this time, a door body structural element 470 (an exemplary second structural element, a gray line segment) corresponding to the door body medium image is correspondingly generated in the space floor plan 420; the door body structural element 470 is adopted to adjust the wall body structural element 440 (an exemplary first structural element), for example, the door body structural element 470 is added on the wall body structural element 440 (an exemplary first structural element, a black line segment) to update the space floor plan for display, and by mapping the marked content of the space real scene plan to the space floor plan of the two-dimensional plane, which position of the marked content in the target space is visually presented to the user, the global perception of the user to the target space is improved.

In addition, referring to fig. 5, which shows a schematic diagram of a space live-action diagram provided in the embodiment of the present invention, a terminal may display a corresponding live-action editing interface 50 through a graphical user interface, may display a space live-action diagram 510 and a space outline diagram 520 corresponding to a target space in the live-action editing interface 50, may include a plurality of observation points 5201 and an observation area 5202 corresponding to a current observation point in the space outline diagram, and a user may switch the displayed space live-action diagram through the space points 5201 to implement switching between space live-action diagrams corresponding to the same target space or different target spaces, and as switching of observation angles is performed at the same observation point, the observation area 5202 may dynamically change along with switching of the displayed space live-action diagrams. In addition, in the real-scene editing interface 50, when a plurality of acquisition points exist in the target space, the terminal may further display acquisition point tags 530 corresponding to each acquisition point in the real-scene editing interface 50, such as "living room 1", "living room 2", and "living room 3", so that the user may switch the space real-scene graph through the spatial point locations in the space outline graph 520, and may also switch through the acquisition point tags 530, thereby improving convenience in the user editing process.

And 103, updating and displaying the space floor plan corresponding to the target space according to the second structural element.

In the embodiment of the invention, the relationship between the space live-action diagram and the space house type diagram can be mapped through the data acquired by each acquisition point, before the house type diagram is edited, the terminal can acquire the space live-action diagram and the space house type diagram corresponding to each functional space in a target house, the space house type diagram is constructed by point cloud data corresponding to each functional space, the space live-action diagram comprises a wall body, a door body and/or a window body of each functional space, and the space house type diagram comprises a contour line corresponding to each wall body; aiming at the target space position in each functional space, determining a corresponding first panoramic pixel coordinate from a space live-action picture, and determining a corresponding first three-dimensional point cloud coordinate from point cloud data; mapping the first panoramic pixel coordinate into a second three-dimensional point cloud coordinate under a three-dimensional point cloud coordinate system according to the relative pose relationship between the equipment for acquiring the space live-action picture and the point cloud data, and mapping the first three-dimensional point cloud coordinate into a second panoramic pixel coordinate under the panoramic pixel coordinate system; respectively correcting the position information of the wall, the door and/or the window of each functional space in a space live-action picture and the contour line in the space floor-type picture according to the panoramic pixel coordinate and the three-dimensional point cloud coordinate before and after mapping; according to the corrected space live-action diagram and space floor type diagram, the door bodies and/or the window bodies of the function spaces in the space live-action diagram are/is mapped to the corresponding contour lines in the space floor type diagram, and a space floor type diagram containing the door body contour and the window body contour is obtained; and marking the door body outline and the window body outline which are mapped on the space house type graph, and taking the marked space house type graph as a house type graph corresponding to a target house.

It should be noted that, based on the mapping relationship between the space real view and the space house view constructed above, when the space real view marks spatial structures such as a door body and/or a window body, the corresponding door body and/or window body may be correspondingly displayed on a corresponding contour line in the space house view, in the present invention, the contour line on the space house view may be defined as a wall structure element, and when the spatial structures such as a door body and/or a window body are marked in the space real view, based on the marked mark element in the space real view, the terminal may map the mark element onto the wall structure element and display the door body structure element and/or window body structure element on the wall structure element, so that, in the process of displaying the house view, the display of the house view is realized by marking the related spatial structure in the space real view.

In the embodiment of the invention, in the process of manually and/or automatically editing the house type graph, the terminal can firstly display the space house type graph of the target space and the target panoramic graph under the current observation angle, and meanwhile, in the process of manually and/or automatically editing the terminal, the terminal can respond to the fact that at least one target medium image exists in the obtained target panoramic graph, generate a second structural element corresponding to the target medium image in the space house type graph correspondingly, and automatically update and display the space house type graph corresponding to the target space according to the second structural element, so that in the process of manually and/or automatically editing the house type graph, the manual and/or automatic editing of the house type graph can be realized through the mark of the real scene content based on the linkage between the mark of the space real scene graph and the display of the space house type graph, the flow of editing the house type graph is simplified, the flexibility of editing the house type graph is improved based on the editing of the real scene, the editing efficiency can be effectively improved, and the manual and/or automatic drawing of the house type graph can be realized even if the house type graph is drawn, the target panoramic environment is not understood, and the house type graph can be automatically edited by the terminal according to the relationship between the space house type graph and the house type graph.

It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.

Referring to fig. 6, a block diagram of a structure of a display apparatus of a house type chart provided in an embodiment of the present invention is shown, and specifically, the display apparatus may include the following modules:

a panorama displaying module 601, configured to display a spatial house type map of a target space and a target panorama at a current viewing perspective, where the spatial house type map includes a first structural element generated based on a house type outline map, and the spatial house type map is constructed according to first image acquisition data and/or second image acquisition data acquired at a first acquisition point of the target space, where the first acquisition point is any acquisition point of at least one acquisition point of the target space; the target panoramic image is an image area which is acquired from second image acquisition data acquired from a second acquisition point in the target space and at least partially covers a medium corresponding to a first structural element to be edited;

a structural element generating module 602, configured to generate, in response to that at least one target media image exists in the obtained target panoramic image, a second structural element corresponding to the target media image in the space user type map;

the layout updating module 603 is configured to update and display the spatial layout corresponding to the target space according to the second structural element.

In an alternative embodiment, further comprising:

and the observation information display module is used for displaying the target observation point and the target observation area in the spatial household type graph.

In an optional embodiment, the second acquisition point is an optimal acquisition point of the medium corresponding to the first structural element of the at least one acquisition point of the target space, the apparatus further comprising:

an acquisition point determining module, configured to select, as the second acquisition point, an acquisition point closest to a medium distance corresponding to the first structural element from among the at least one acquisition point in the target space as an optimal acquisition point; or selecting an acquisition point close to the forward shooting direction of the medium corresponding to the first structural element from at least one acquisition point in the target space as an optimal acquisition point as a second acquisition point.

In an alternative embodiment, further comprising:

a first layout determining module, configured to obtain a spatial layout according to a first spatial layout, where the first spatial layout is constructed according to first image acquisition data acquired at a first acquisition point in a target space, and the first acquisition point is any one of at least one acquisition point in the target space;

and the third house type graph determining module is used for acquiring the space house type graph according to the first space contour graph and the second space contour graph.

In an optional embodiment, the structural element generating module 602 is specifically configured to:

responding to image recognition processing executed on the target panoramic image, and if the obtained recognition result is that at least one target medium image exists in the target panoramic image, generating a second structural element corresponding to the target medium image in the space user type image; and/or

In an optional embodiment, the structural element generating module 602 is further specifically configured to:

and responding to image recognition processing or marking operation executed on the target panoramic image, if the obtained recognition result indicates that the at least one target medium image exists in the target panoramic image, generating a second structural element corresponding to the target medium image in the space user type image, and displaying a target marking element recognized for the at least one target medium image in the target panoramic image.

In an alternative embodiment, further comprising:

a display size determining module, configured to, in response to a trigger to at least one endpoint control through manual operation, enable the endpoint control to obtain, according to an area of a first editing operation, a first display size of the target markup element in the target panorama after the endpoint control completes the execution of the first editing operation;

and the display position determining module is used for responding to the trigger of the manual operation on the mobile control, so that after the mobile control completes the execution of the second editing operation, the target display position of the target marking element in the target panoramic image is obtained according to the position of the second editing operation.

In an alternative embodiment, the editing control group further includes a switching control, and the apparatus further includes:

and the mark element switching module is used for responding to the trigger of at least one switching control through manual operation, so that the switching control switches the currently displayed target mark element into another mark element representing another medium in the target panorama after the third editing operation is executed.

In an optional embodiment, the target display parameters at least include a target display position and a first display size, the target display position is a panoramic pixel coordinate, and the structural element generating module 602 is specifically configured to:

For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.

In addition, an embodiment of the present invention further provides an electronic device, including: the display method comprises a processor, a memory and a computer program which is stored on the memory and can run on the processor, wherein when the computer program is executed by the processor, each process of the display method embodiment of the house-type diagram is realized, the same technical effect can be achieved, and the description is omitted for avoiding repetition.

The embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when being executed by a processor, the computer program implements each process of the above-mentioned user-type diagram display method embodiment, and can achieve the same technical effect, and in order to avoid repetition, the details are not repeated here. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.

Fig. 7 is a schematic diagram of a hardware structure of an electronic device for implementing various embodiments of the present invention.

The electronic device 700 includes, but is not limited to: a radio frequency unit 701, a network module 702, an audio output unit 703, an input unit 704, a sensor 705, a display unit 706, a user input unit 707, an interface unit 708, a memory 709, a processor 710, and a power supply 711. Those skilled in the art will appreciate that the electronic device configuration shown in fig. 7 does not constitute a limitation of the electronic device, and that the electronic device may include more or fewer components than shown, or some components may be combined, or a different arrangement of components. In the embodiment of the present invention, the electronic device includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal, a wearable device, a pedometer, and the like.

It should be understood that, in the embodiment of the present invention, the radio frequency unit 701 may be used for receiving and sending signals during a process of sending and receiving information or a call, and specifically, after receiving downlink data from a base station, the downlink data is processed by the processor 710; in addition, uplink data is transmitted to the base station. In general, radio frequency unit 701 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 701 may also communicate with a network and other devices through a wireless communication system.

The electronic device provides the user with wireless broadband internet access via the network module 702, such as assisting the user in sending and receiving e-mails, browsing web pages, and accessing streaming media.

The audio output unit 703 may convert audio data received by the radio frequency unit 701 or the network module 702 or stored in the memory 709 into an audio signal and output as sound. Also, the audio output unit 703 may also provide audio output related to a specific function performed by the electronic apparatus 700 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 703 includes a speaker, a buzzer, a receiver, and the like.

The input unit 704 is used to receive audio or video signals. The input Unit 704 may include a Graphics Processing Unit (GPU) 7041 and a microphone 7042, and the Graphics processor 7041 processes image data of a still picture or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 706. The image frames processed by the graphic processor 7041 may be stored in the memory 709 (or other storage medium) or transmitted via the radio unit 701 or the network module 702. The microphone 7042 may receive sounds and may be capable of processing such sounds into audio data. The processed audio data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 701 in case of the phone call mode.

The electronic device 700 also includes at least one sensor 705, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor that can adjust the brightness of the display panel 7061 according to the brightness of ambient light, and a proximity sensor that can turn off the display panel 7061 and/or a backlight when the electronic device 700 is moved to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of the electronic device (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration identification related functions (such as pedometer, tapping), and the like; the sensors 705 may also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., which are not described in detail herein.

The display unit 706 is used to display information input by the user or information provided to the user. The Display unit 706 may include a Display panel 7061, and the Display panel 7061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.

The user input unit 707 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the electronic device. Specifically, the user input unit 707 includes a touch panel 7071 and other input devices 7072. The touch panel 7071, also referred to as a touch screen, may collect touch operations by a user on or near the touch panel 7071 (e.g., operations by a user on or near the touch panel 7071 using a finger, a stylus, or any other suitable object or attachment). The touch panel 7071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 710, receives a command from the processor 710, and executes the command. In addition, the touch panel 7071 can be implemented by various types such as resistive, capacitive, infrared, and surface acoustic wave. The user input unit 707 may include other input devices 7072 in addition to the touch panel 7071. In particular, the other input devices 7072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described herein again.

Further, the touch panel 7071 may be overlaid on the display panel 7061, and when the touch panel 7071 detects a touch operation on or near the touch panel 7071, the touch operation is transmitted to the processor 710 to determine a type of the touch event, and then the processor 710 provides a corresponding visual output on the display panel 7061 according to the type of the touch event. Although the touch panel 7071 and the display panel 7061 are shown in fig. 7 as two separate components to implement the input and output functions of the electronic device, in some embodiments, the touch panel 7071 and the display panel 7061 may be integrated to implement the input and output functions of the electronic device, which is not limited herein.

The interface unit 708 is an interface through which an external device is connected to the electronic apparatus 700. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 708 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the electronic apparatus 700 or may be used to transmit data between the electronic apparatus 700 and the external device.

The memory 709 may be used to store software programs as well as various data. The memory 709 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 709 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The processor 710 is a control center of the electronic device, connects various parts of the whole electronic device by using various interfaces and lines, performs various functions of the electronic device and processes data by running or executing software programs and/or modules stored in the memory 709 and calling data stored in the memory 709, thereby monitoring the whole electronic device. Processor 710 may include one or more processing units; preferably, the processor 710 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 710.

The electronic device 700 may also include a power supply 711 (e.g., a battery) for providing power to the various components, and preferably, the power supply 711 may be logically coupled to the processor 710 via a power management system, such that functions of managing charging, discharging, and power consumption may be performed via the power management system.

In addition, the electronic device 700 includes some functional modules that are not shown, and are not described in detail herein.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrases "comprising a component of' 8230; \8230;" does not exclude the presence of another like element in a process, method, article, or apparatus that comprises the element.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.

While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.

Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.

It can be clearly understood by those skilled in the art that, for convenience and simplicity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one position, or may be distributed on multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.

The functions may be stored in a computer-readable storage medium if they are implemented in the form of software functional units and sold or used as separate products. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a U disk, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk.

The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims

1. A method for displaying a house-type graph is characterized by comprising the following steps:

displaying a spatial house type graph of a target space and a target panoramic graph under a current observation visual angle, wherein the spatial house type graph comprises a first structural element generated based on a house type outline graph, the spatial house type outline graph is constructed according to first image acquisition data and/or second image acquisition data acquired at a first acquisition point of the target space, and the first acquisition point is any acquisition point in at least one acquisition point of the target space; the target panoramic image is an image area which is acquired from second image acquisition data acquired from a second acquisition point in the target space and at least partially covers a medium corresponding to a first structural element to be edited;

2. The method of claim 1, further comprising:

3. The method of claim 1, wherein the second acquisition point is an optimal acquisition point of the medium corresponding to the first structural element of the at least one acquisition point of the target space, the method further comprising:

4. The method of claim 1, further comprising:

acquiring the space house-type map according to a second space contour map, wherein the second space house-type map is constructed according to second image acquisition data acquired at the first acquisition point of a target space; or the like, or, alternatively,

and acquiring the space floor plan according to the first space contour plan and the second space contour plan.

5. The method according to claim 1, wherein, in response to obtaining that at least one target media image exists in the target panorama, generating a second structural element corresponding to the target media image in the spatial user type map includes:

6. The method of claim 5, wherein the generating a second structural element corresponding to the target media image in the spatial user type map corresponding to the acquiring of the at least one target media image in the target panorama comprises:

7. The method of claim 5, wherein in response to a marking operation by a human operation on the at least one target media image in which the target panorama exists, further comprising:

and/or responding to the trigger of the mobile control through manual operation, so that after the mobile control completes the execution of the second editing operation, the target display position of the target marking element in the target panoramic image is obtained according to the position of the second editing operation.

8. The method of claim 7, wherein the set of editing controls further comprises a toggle control, the method further comprising:

and responding to the trigger of at least one switching control through manual operation, so that the switching control switches the currently displayed target mark element to another mark element for representing another medium in the target panorama after the third editing operation is executed.

9. The method according to claim 5 or 6, wherein the target display parameters at least comprise a target display position and a first display size, the target display position is a panoramic pixel coordinate, and the generating of the second structural element corresponding to the target media image in the spatial user type map comprises:

mapping a panoramic pixel coordinate corresponding to the target marking element into a three-dimensional point cloud coordinate, and mapping the first display size into a second display size according to a preset proportional mapping relation;

10. A display device for house type pictures, comprising:

the panoramic view display module is used for displaying a spatial house-type view of a target space and a target panoramic view under a current observation visual angle, wherein the spatial house-type view comprises first structural elements generated based on a house-type outline, the spatial outline is constructed according to first image acquisition data and/or second image acquisition data acquired at a first acquisition point of the target space, the first acquisition point is any acquisition point of at least one acquisition point of the target space, and the target panoramic view at least partially covers an image area of a medium corresponding to the first structural element to be edited according to second image acquisition data acquired at a second acquisition point of the target space;

11. An electronic device, comprising a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus;

the memory is used for storing a computer program;

the processor, when executing a program stored on the memory, implementing the method of any of claims 1-9.

12. A computer-readable storage medium having stored thereon instructions, which when executed by one or more processors, cause the processors to perform the method of any one of claims 1-9.