CN115761046B

CN115761046B - Editing method and device for house information, electronic equipment and storage medium

Info

Publication number: CN115761046B
Application number: CN202211457827.6A
Authority: CN
Inventors: 请求不公布姓名
Original assignee: Beijing Chengshi Wanglin Information Technology Co Ltd
Current assignee: Beijing Chengshi Wanglin Information Technology Co Ltd
Priority date: 2022-11-21
Filing date: 2022-11-21
Publication date: 2023-11-21
Anticipated expiration: 2042-11-21
Also published as: CN115761046A

Abstract

The embodiment of the invention provides a method and a device for editing house information, electronic equipment and a storage medium, wherein the method comprises the following steps: responding to the input instruction of at least one second structural element in the space family pattern in the editing state, and at least displaying a target panoramic pattern corresponding to the target space under the current observation view angle; in response to obtaining that at least one target medium image exists in the target panoramic image, correspondingly generating a third structural element corresponding to the target medium image in the space account type image; the second structural element is adjusted by adopting the third structural element so as to update the space house type diagram for display, so that the linkage between the marking of the space live-action diagram and the display of the space house type diagram is realized in the editing process of house information, the marking result can be intuitively presented based on the linkage of the space house type diagram, and the global perception of the marking content of the target space can be improved.

Description

Editing method and device for house information, electronic equipment and storage medium

Technical Field

The present invention relates to the field of interface interaction technologies, and in particular, to a method for editing house information, an apparatus for editing house information, an electronic device, and a computer readable storage medium.

Background

With the development of VR (Virtual Reality), AR (Augmented Reality ) and panoramic technologies, a user can view on-line room source information displayed in a three-dimensional display mode, and display a spatial house type map and a spatial real view map of a target space in a three-dimensional effect presentation manner, so that the Reality of room source information display is improved, and the spatial perception of the user on a room can be effectively improved.

In the existing technical scheme, the house type profile is obtained based on the mode that point cloud data of a plurality of shooting points in a target space are combined with the panorama, then the door and window positions of the automatic panorama are combined, so that the door and window is automatically added in the house type profile to obtain a space house type profile, a better result can be obtained by the existing house type profile, but in the process of automatic identification, if the panorama identification effect for assisting door and window identification is insufficient, the effect of door and window identification is poor easily, and the quality of the obtained space house type profile is poor.

Disclosure of Invention

The embodiment of the invention provides a method, a device, electronic equipment and a computer readable storage medium for editing house information, which are used for solving or partially solving the problems that the manual error exists in the process of editing the house information in the related technology, the processing flow is excessively complex and the efficiency is low in the processing process.

The embodiment of the invention discloses a house information editing method, which comprises the following steps:

in response to acquiring an input instruction for at least one second structural element in a spatial user pattern in an editing state, at least displaying a target panorama corresponding to a target space under a current viewing angle, wherein the spatial user pattern comprises a first structural element and a second structural element generated based on a spatial profile and a basic panorama, the spatial profile is constructed according to first image acquisition data and/or second image acquisition data acquired at a first acquisition point of the target space, the first acquisition point is any acquisition point of at least one acquisition point of the target space, the target panorama is a panorama of an image area of a medium corresponding to at least a part of the second structural element, and the second acquisition point is an optimal acquisition point of the medium corresponding to the first structural element in the at least one acquisition point of the target space;

in response to obtaining that at least one target medium image exists in the target panoramic image, correspondingly generating a third structural element corresponding to the target medium image in the space account type image;

And updating the second structural element by adopting the third structural element so as to update the space account type diagram for presentation.

Optionally, the method further comprises:

acquiring a target observation point corresponding to the current observation view angle and a target observation area corresponding to the target observation point, wherein the target observation point is a mapping point of the second acquisition point in the space type graph, and the target observation area is a mapping area of the target panoramic graph in the space type graph;

and displaying the space account type diagram, and displaying the target observation point or the target observation point and the target observation area in the space account type diagram.

Optionally, the method further comprises:

selecting an acquisition point closest to a medium corresponding to a first structural element from at least one acquisition point in the target space as an optimal acquisition point, and taking the acquisition point as the second acquisition point; or (b)

And selecting an acquisition point which is close to the forward shooting direction of the medium corresponding to the first structural element from at least one acquisition point of the target space as an optimal acquisition point, and taking the optimal acquisition point as a second acquisition point.

Optionally, the method further comprises:

acquiring a space profile according to a first space profile, wherein the first space profile is constructed according to first image acquisition data acquired at a first acquisition point of a target space, and the first acquisition point is any one of at least one acquisition point of the target space; or alternatively, the first and second heat exchangers may be,

Acquiring a space profile according to a second space profile, wherein the second space house type graph is constructed according to second image acquisition data acquired at the first acquisition point of the target space; or alternatively, the first and second heat exchangers may be,

and acquiring the space contour map according to the first space contour map and the second space contour map.

Optionally, the responding to the obtaining that at least one target media image exists in the target panoramic image correspondingly generates a third structural element corresponding to the target media image in the spatial house type image includes:

responding to the image recognition processing of the target panorama, if the obtained recognition result is that the target panorama exists the at least one target medium image, correspondingly generating a third structural element corresponding to the target medium image in the spatial type image,

or generating a third structural element corresponding to the target media image in the spatial house type graph, and displaying a target marking element identified for the at least one target media image in the target panorama.

In response to a marking operation of the at least one target medium image existing in the target panoramic image through a manual operation, identifying that the at least one target medium image exists in the target panoramic image, and correspondingly generating a third structural element corresponding to the target medium image in the spatial pattern;

and displaying a target marking element after a marking operation is performed on the at least one target media image in the target panorama.

Optionally, the method further comprises:

displaying a toolbar for adding markup elements, the toolbar including at least one structural markup control;

wherein said identifying the presence of the at least one target media image for the target panorama in response to a marking operation of the at least one target media image for the presence of the target panorama by a manual operation comprises:

in response to a target structure marking control triggered in the structure marking control through manual operation, marking the at least one target media image existing in the target panorama, displaying target marking elements after marking the at least one target media image in the target panorama so as to represent that the at least one target media image is identified to exist in the target panorama.

Optionally, the method further comprises:

displaying an editing control group aiming at the target marking element, wherein the editing control group at least comprises an endpoint control and a mobile control;

responding to the trigger of at least one endpoint control, and after the first editing operation is completed, acquiring a target display size of the target marking element in the target panorama according to the region of the first editing operation by the endpoint control;

and/or responding to the trigger of the mobile control, and after the second editing operation is completed, the mobile control obtains the target display position of the target marking element in the target panorama according to the position of the second editing operation.

Optionally, the editing control group further includes a switch control, and the method further includes:

and responding to the trigger of at least one switching control, and switching the currently displayed target marking element into another marking element representing another medium in the target panorama after the third editing operation is completed by the switching control.

The embodiment of the invention also discloses a device for editing house information, which comprises:

A panorama display module, configured to respond to obtaining an input instruction for at least one second structural element in a spatial family type graph in an editing state, at least display a target panorama corresponding to a target space under a current viewing angle, where the spatial family type graph includes a first structural element and a second structural element generated based on a spatial contour graph and a basic panorama, the spatial contour graph is constructed according to first image acquisition data and/or second image acquisition data obtained at a first acquisition point of the target space, the first acquisition point is any one acquisition point of at least one acquisition point of the target space, the target panorama is a panorama corresponding to an image area of a medium corresponding to at least a covered part of the second structural element in the second image acquisition data obtained according to a second acquisition point in the target space, and the second acquisition point is an optimal acquisition point of the medium corresponding to the first structural element in the at least one acquisition point of the target space;

the structural element generation module is used for correspondingly generating a third structural element corresponding to the target medium image in the space account type image in response to the acquisition of the existence of at least one target medium image in the target panoramic image;

And the structural element adjusting module is used for updating the second structural element by adopting the third structural element so as to update the space account type diagram for display.

Optionally, the method further comprises:

the observation area acquisition module is used for acquiring a target observation point corresponding to the current observation view angle and a target observation area corresponding to the target observation point, wherein the target observation point is a mapping point of the second acquisition point in the space household pattern, and the target observation area is a mapping area of the target panoramic pattern in the space household pattern;

and the house type diagram display module is used for displaying the space house type diagram, and displaying the target observation point or the target observation point and the target observation area in the space house type diagram.

Optionally, the method further comprises:

the acquisition point determining module is used for selecting an acquisition point closest to the medium distance corresponding to the first structural element from at least one acquisition point in the target space as an optimal acquisition point and taking the optimal acquisition point as the second acquisition point; or selecting an acquisition point close to the forward shooting direction of the medium corresponding to the first structural element from at least one acquisition point of the target space as an optimal acquisition point, and taking the acquisition point as a second acquisition point.

Optionally, the method comprises:

the first contour map determining module is used for acquiring the space house type map according to a first space contour map, wherein the first space contour map is constructed according to first image acquisition data acquired at a first acquisition point of a target space, and the first acquisition point is any one of at least one acquisition point of the target space;

the second contour map determining module is used for acquiring the space house type map according to a second space contour map, and the second space house type map is constructed according to second image acquisition data acquired at the first acquisition point of the target space;

and the third profile determining module is used for acquiring the space household pattern according to the first space profile and the second space profile.

Optionally, the structural element generating module is specifically configured to:

Optionally, the method further comprises:

a toolbar display module for displaying a toolbar for adding a markup element, the toolbar including at least one structural markup control;

the structural element generation module is specifically configured to:

Optionally, the method further comprises:

the control group display module is used for displaying an editing control group aiming at the target marking element, wherein the editing control group at least comprises an endpoint control and a mobile control;

the display size determining module is used for responding to the trigger of at least one endpoint control, so that the endpoint control obtains the target display size of the target mark element in the target panorama according to the area of the first editing operation after the first editing operation is completed;

and the display position determining module is used for responding to the trigger of the mobile control, so that the mobile control obtains the target display position of the target mark element in the target panorama according to the position of the second editing operation after the second editing operation is completed.

Optionally, the editing control group further includes a switch control, and the apparatus further includes:

and the marking element switching module is used for responding to the trigger of at least one switching control, so that the switching control switches the currently displayed target marking element into another marking element representing another medium in the target panorama after the third editing operation is completed.

The embodiment of the invention also discloses electronic equipment, which comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory are communicated with each other through the communication bus;

the memory is used for storing a computer program;

the processor is configured to implement the method according to the embodiment of the present invention when executing the program stored in the memory.

Embodiments of the present invention also disclose a computer-readable storage medium having instructions stored thereon, which when executed by one or more processors, cause the processors to perform the method according to the embodiments of the present invention.

The embodiment of the invention has the following advantages:

in the embodiment of the invention, in the process of editing the house type graph, the terminal can respond to the input instruction of at least one second structural element in the space house type graph in an editing state, at least display the target panoramic graph corresponding to the target space under the current observation view angle, the target panoramic graph can be an image area which at least covers part of media corresponding to the second structural element and is acquired in the second image acquisition data acquired according to the second acquisition point in the target space, the second acquisition point is the optimal acquisition point of the media corresponding to the second structural element in the at least one acquisition point in the target space, so that the proper target panoramic graph is found again for auxiliary door and window recognition on the basis of the initially generated space house type graph, thereby carrying out fine adjustment correction on the space house type graph and acquiring the space house type graph with better quality.

Drawings

Fig. 1 is a flowchart showing steps of a method for editing house information provided in an embodiment of the present invention;

FIG. 2 is a schematic diagram of data acquisition provided in an embodiment of the present invention;

FIG. 3 is a schematic view of a spatial layout and a panoramic view provided in an embodiment of the present invention

FIG. 4 is a schematic illustration of a spatial live-action view provided in an embodiment of the invention;

FIG. 5 is a schematic illustration of a spatial live-action view provided in an embodiment of the invention;

fig. 6 is a block diagram showing the structure of an editing apparatus for house information provided in an embodiment of the present invention;

fig. 7 is a block diagram of an electronic device provided in an embodiment of the invention.

Detailed Description

In order that the above-recited objects, features and advantages of the present invention will become more readily apparent, a more particular description of the invention will be rendered by reference to the appended drawings and appended detailed description.

As an example, the spatial house type map is obtained by completely obtaining the house type profile map by combining point cloud data of a plurality of shooting points in the target space with the panorama, and then automatically adding doors and windows in the house type profile map by combining automatic door and window positions for identifying the panorama. However, the quality of the point cloud data and the panoramic data is relatively reliable, but in engineering practice, the acquired point cloud data and panoramic data are not completely reliable, at this time, the generated space type graph needs to be manually or automatically fine-tuned, a proper target panoramic graph is found, and auxiliary door and window recognition is performed again, so that fine-tuning correction is performed on the space type graph, and the space type graph with better quality can be acquired.

In view of the above, one of the core invention points of the present invention is that in the process of editing a house type diagram, a terminal can respond to the input instruction of at least one second structural element in the space house type diagram (initial space house type diagram) in an editing state, at least display a target panoramic diagram corresponding to a target space under the current viewing angle, the target panoramic diagram can be an image area which is acquired according to second image acquisition data acquired by the second acquisition point in the target space and at least covers part of a medium corresponding to the first structural element, the second acquisition point is an optimal acquisition point of the medium corresponding to the first structural element in at least one acquisition point of the target space, so that the space structure corresponding to the target space is marked through the space real-scene diagram, the convenience of the house type diagram editing is improved, the editing process of the user is simplified, meanwhile, in the process of editing the space real-scene diagram, the space type diagram is based on the second image acquisition data, the image area which is acquired by the terminal can be a medium area which at least covers part of the first structural element corresponding to the target space, the second image is acquired by the second image acquisition data, the second image acquisition point is a third image corresponding to the second structural element is better, the space real-scene diagram is updated on the basis of the space real-scene diagram, the second image is updated, the space real-scene diagram is updated on the basis of the space real-scene diagram is more than the space-space structure corresponding to the first structural element, the space structure corresponding to the target real-space is more well, the space real-scene image is more convenient to update, and the space window is easy to update.

In order to enable those skilled in the art to better understand the technical solution of the present invention, the following explains and describes some technical features related to the embodiments of the present invention:

the first image acquisition data may be point cloud data acquired by the electronic terminal on at least one acquisition point of the target space. Optionally, the collection point from which the point cloud data is obtained may be taken as the first collection point, and a corresponding point cloud plan may be constructed according to the point cloud data corresponding to at least one first collection point, and the basic outline of the target space may be presented according to the point cloud plan.

The second image acquisition data may be panoramic image data acquired by the electronic terminal for the target space at least one acquisition point of the target space. Optionally, the collection point for collecting panoramic image data can be used as a second collection point, so that a space live-action diagram corresponding to the target space can be determined through at least one panoramic image data collected at the second collection point, a space structure corresponding to the target space can be presented through the space live-action diagram, more real and three-dimensional space information can be presented for a user, and the space perception of the user on the target space is improved.

A spatial pattern map, which may correspond to a spatial pattern of a target space, may include several different structural elements, such as: door structure elements, window structure elements, etc. for presenting a spatial structure corresponding to a target space, where the target space is understood to be a single, independent, physical space.

For the space house type graph, the space house type graph can be obtained through corresponding editing processing on the basis of the point cloud plan graph of the target space, and also can be obtained through corresponding operation processing on the basis of the panorama graph of the target space.

The medium may be a spatial structure located in a target space, such as a wall, a door, a window, a water line, and an electric wire, where the target space is understood to be a single independent physical space.

The medium image can be an image of a spatial structure in the spatial live-action image, such as an image of a wall body, an image of a door body, an image of a window body, an image of a water pipeline, an image of an electric wire and the like, which correspond to the spatial structure.

Structural elements, which may be used to represent the spatial structure of the target space in the spatial house type graph, may include wall structural elements, door structural elements, window structural elements, water line structural elements, wire structural elements, and the like structural elements used to represent the spatial structure in the target space.

Marking elements, which may be used for interface elements for marking in a spatial reality map, different structural elements may correspond to different marking elements, e.g., different structural elements may correspond to marking elements of different display styles, to distinguish by different display modes.

Referring to fig. 1, a step flowchart of a method for editing house information provided in an embodiment of the present invention may specifically include the following steps:

step 101, in response to obtaining an input instruction for at least one second structural element in a spatial user pattern in an editing state, at least displaying a target panorama corresponding to a target space under a current viewing angle, wherein the spatial user pattern is that the spatial user pattern comprises a first structural element and a second structural element generated based on a spatial profile, the spatial profile is constructed according to first image acquisition data and/or second image acquisition data obtained at a first acquisition point of the target space, the first acquisition point is any one acquisition point of at least one acquisition point of the target space, the target panorama is an image area of a medium corresponding to at least a part of the second structural element in second image acquisition data acquired according to a second acquisition point in the target space, and the second acquisition point is an optimal acquisition point of the medium corresponding to the second structural element in the at least one acquisition point of the target space;

The electronic terminal can be a camera or an intelligent terminal (a terminal is described below), the intelligent terminal can run a corresponding application program (such as an image acquisition program and the like), the intelligent terminal can be positioned through a positioning sensor of the intelligent terminal in the acquisition process, and the position of the current terminal in a target space is output in a graphical user interface in real time, so that a user can execute a corresponding data acquisition strategy through the real-time position, and the camera can execute corresponding operation in the same way. In addition, for the intelligent terminal, the intelligent terminal can comprise at least two sensors, in the process of image acquisition of the target space, the electronic terminal can acquire point cloud data corresponding to the target space through the laser scanning equipment on one hand, and can acquire panoramic images corresponding to the target space through the panoramic camera on the other hand, so that in the image acquisition process, a point cloud plan corresponding to the target space can be constructed based on the point cloud data, a space live-action picture corresponding to the entity space can be constructed through the panoramic images, and the like.

In an example, referring to fig. 2, a schematic diagram of data acquisition provided in an embodiment of the present invention is shown, and it is assumed that a user performs data acquisition on a target space through three acquisition points in the target space, including an acquisition point (1), an acquisition point (2), and an acquisition point (3), where the acquired data may include point cloud data a corresponding to the acquisition point (1) and a panoramic image a, point cloud data B corresponding to the acquisition point (2) and a panoramic image B, and point cloud data C corresponding to the acquisition point (3) and a panoramic image C, so that in an image acquisition process, a point cloud plan corresponding to the target space may be constructed based on the point cloud data, a space live-action image corresponding to the target space may be constructed through a panoramic image, and so on.

It should be noted that, when each acquisition point performs data acquisition, when one acquisition point triggers to perform data acquisition once, the terminal may perform corresponding data acquisition operations through the laser scanning device and the image acquisition sensor respectively based on the same acquisition point, so as to obtain different types of data such as point cloud data and panoramic images acquired at the present time, so that the terminal performs different data processing operations based on the different types of data. The invention is not limited in this regard.

Further, for the point cloud data corresponding to each point, the point cloud data can be obtained by the following two methods:

taking the acquisition point (1), the acquisition point (2) and the acquisition point (3) as examples, assuming that the acquisition point (1), the acquisition point (2) and the acquisition point (3) are in a sequential acquisition sequence, then the sequentially acquired data can comprise point cloud data A corresponding to the acquisition point (1) and a panoramic image a, point cloud data B corresponding to the acquisition point (2) and a panoramic image B, and point cloud data C corresponding to the acquisition point (3) and a panoramic image C, wherein the point cloud data A ' acquired at the current time of the acquisition point (1) can be directly used as the point cloud data A, the point cloud data B ' acquired at the current time of the acquisition point (2) can be directly used as the point cloud data B, and the point cloud data C ' acquired at the current time of the acquisition point (3) can be directly used as the point cloud data C.

Taking the acquisition point (1), the acquisition point (2) and the acquisition point (3) as examples, assuming that the acquisition point (1), the acquisition point (2) and the acquisition point (3) are in a sequential acquisition sequence, then the sequentially acquired data may include the point cloud data a corresponding to the acquisition point (1) and the panorama a, the point cloud data B corresponding to the acquisition point (2) and the panorama B, and the point cloud data C corresponding to the acquisition point (3) and the panorama C, wherein the point cloud data a ' acquired at the acquisition point (1) at the present time may be directly used as the point cloud data a, the point cloud data B ' acquired at the acquisition point (2) at the present time and the point cloud data a are subjected to point cloud fusion to acquire the point cloud data B, and the point cloud data C ' acquired at the acquisition point (3) at the present time and the point cloud data B (and the point cloud data a) are subjected to point cloud fusion to acquire the point cloud data C.

It should be noted that, as shown in fig. 2, the spatial profile in the present invention may be obtained from a first spatial profile constructed according to point cloud data obtained at a first acquisition point in a target space, specifically, the first spatial profile may be obtained by directly mapping the point cloud data obtained at the first acquisition point onto a two-dimensional plane, the first spatial profile may be directly used as the spatial profile, or a manual or automatic editing process may be performed on the first spatial profile to obtain a spatial user profile; the method can also be obtained according to a second space contour map constructed according to the panorama acquired at the first acquisition point of the target space, and then the obtained second space contour map can be directly used as the space contour map, or manual or automatic editing processing can be further performed on the second space contour map to obtain the space contour map.

In addition, the spatial profile of the present invention may be obtained from the first spatial profile and the second spatial profile. Optionally, the space contour line quality can be selected from the first space contour diagram and the second space contour diagram to serve as the space contour diagram, fusion processing can be performed on the space contour lines of the first space contour diagram and the second space contour diagram to obtain a space contour diagram with better quality, the space contour diagram can be directly used as the space contour diagram, and manual or automatic editing processing can be performed on the space contour diagram to obtain the space contour diagram. The first acquisition point may be any one of the acquisition points (1), (2) and (3) in fig. 2; by taking the acquisition point (1) as a first acquisition point, acquiring the point cloud data A and the panorama a at the acquisition point (1), constructing a first space contour map according to the point cloud data A, and then directly taking the first space contour map as the space contour map, or performing manual or automatic editing processing on the first space contour map to acquire the space contour map; the second spatial profile may also be constructed from the panorama a, and then the second spatial profile may be directly used as a spatial profile, or a manual or automated editing process may be performed on the second spatial profile to obtain the spatial profile. In addition, the spatial profile of the invention can be obtained by the first spatial profile and the second spatial profile. Optionally, the space contour line quality can be selected from a first space contour map constructed according to the point cloud data a and a second space contour map constructed according to the panorama image a to serve as the space contour map, fusion processing can be performed on the space contour line corresponding to the first space contour map constructed according to the point cloud data a and the second space contour map constructed according to the panorama image a to obtain a space contour map with better house contour line quality, and then the space contour map can be directly used as the space contour map, or manual or automatic editing processing can be performed on the space contour map to obtain the space contour map.

Further, the foregoing has obtained the house type profile, and further, a mapping relationship between the base panorama and the space profile needs to be established, so that the house type space profile is generated based on the house type profile, and the generated house type space profile includes a first structural element mapped according to a wall image (an image of an exemplary first structural element corresponding to a medium) in the base panorama and a second structural element mapped according to a door and window image (an image of an exemplary second structural element corresponding to a medium).

Specifically, the spatial house type graph may include at least one first structural element and at least one second structural element, where the first structural element and the second structural element may be results obtained after image recognition is performed on a basic panorama obtained from any one of multiple acquisition points, and the basic panorama may be a panorama of a different acquisition point from the target panorama or may be the same as the target panorama.

When the image of the wall body, door and window and other mediums is identified in the basic panoramic image, panoramic pixel coordinates of the wall body, door and window and other mediums in the corresponding basic panoramic image can be obtained according to the image of the wall body, door and window and other mediums, three-dimensional point cloud coordinates are obtained by mapping the panoramic pixel coordinates of the wall body, door and window and other mediums into a coordinate system of three-dimensional point cloud data of a target space, and the three-dimensional point cloud coordinates are mapped in the space house type image, so that a first structural element and a second structural element existing in the space house type image can be correspondingly obtained.

For example, the basic panoramic image b may be obtained according to the acquisition point (2), the image identification may be performed on the basic panoramic image b, when an image of a medium such as a wall or a door or window is identified in the basic panoramic image, panoramic pixel coordinates of the medium such as the wall or the door or window in the corresponding basic panoramic image may be obtained according to the image of the medium such as the wall or the door or the window, and the panoramic pixel coordinates of the medium such as the wall or the door or the window may be mapped to a coordinate system of a three-dimensional point cloud image in the target space to obtain three-dimensional point cloud coordinates. For example, panoramic pixel coordinates corresponding to the contours of the door and window may be mapped to three-dimensional point cloud coordinates.

Optionally, according to the mapping relation between the panoramic pixel coordinates and the spherical coordinates, the panoramic pixel coordinates corresponding to the outlines of the door body and the window body are mapped into the sphere space to obtain the corresponding spherical coordinates; further, according to the relative pose relation between the panoramic camera and the laser scanning device, the spherical coordinates corresponding to the door body outline and the window body outline are mapped into a three-dimensional point cloud coordinate system by combining the mapping relation of the spherical coordinates and the three-dimensional point cloud coordinates. Optionally, when mapping the panoramic Pixel coordinates corresponding to the door outline and the window outline to the spherical coordinates, the Pixel coordinates at the upper left corner of the panoramic Pixel coordinates may be taken as the origin, and assuming that the length and the width of the panoramic image are H and W respectively, and the Pixel coordinates corresponding to each Pixel point are Pixel (x, y), the longitude Lon and the latitude Lat corresponding to the spherical coordinates after mapping each panoramic Pixel coordinate are respectively:

Lon＝(x/W-0.5)*360；

Lat＝(0.5–y/H)*180；

Further, an origin O1 (0, 0) of a spherical coordinate system is established, and assuming that the radius of the spherical coordinate system is R, the spherical coordinates (X, Y, Z) of each panoramic pixel coordinate after mapping are respectively:

X＝R*cos(Lon)*cos(Lat)；

Y＝R*sin(Lat)；

Z＝R*sin(Lon)*cos(Lat)；

further, when mapping from the spherical coordinate system to the three-dimensional point cloud coordinate system, the mapping relationship of the corresponding spherical coordinates p=q (x+x0, y+y0, z+z0) after rotation and movement transformation can be mapped when the laser scanning device scans the door body and the window body; wherein x0, Y0, z0 are the origin O2 (x 0, Y0, z 0) of the three-dimensional point cloud coordinate system, rotation Y is the rotation angle of the laser scanning device around the world coordinate system Y axis, and Q is the quaternion obtained by the system function quaternion.

Optionally, when determining the three-dimensional point cloud coordinates corresponding to the door body contour and the window body contour, the three-dimensional point cloud coordinates corresponding to the designated spatial positions in each functional space may be used as reference coordinates, so as to determine the three-dimensional point cloud coordinates corresponding to the door body contour and the window body contour according to the relationship between the spherical coordinates and the reference coordinates. In the embodiment of the invention, the specific position of the designated spatial position in the target house is not limited, alternatively, three-dimensional point cloud coordinates corresponding to the wall body contour in each functional space can be used as reference coordinates, further, the reference coordinates are mapped into corresponding reference spherical coordinate groups, the ray from the origin O1 to the point P in the spherical coordinate system and the focal point of the reference spherical coordinates are determined, and the three-dimensional point cloud coordinates corresponding to the focal point are used as the three-dimensional point cloud coordinates corresponding to the door body contour or the window body contour. Of course, the spherical coordinates corresponding to the known object in the target house may be used as the reference spherical coordinates, for example, the spherical coordinates corresponding to the ground may be used as the reference spherical coordinates, and then the focal point of the ray from the origin O1 to the point P and the reference spherical coordinates, that is, the focal point of the plane on which the ground is located may be determined, and the three-dimensional point cloud coordinates corresponding to the focal point may be used as the three-dimensional point cloud coordinates corresponding to the door contour or the window contour.

Further, the three-dimensional point cloud coordinates can be mapped to the space contour map in a two-dimensional mode, and therefore the first structural element and the second structural element corresponding to the target medium image are correspondingly generated and displayed on the space contour map.

Based on this, an initial automatically generated spatial profile carrying a first structural element (wall structure) and a second structural element (door and window structure) can be obtained.

Optionally, the invention can be applied to an intelligent terminal, on which a corresponding application program (such as a living application program capable of providing online house finding, etc.) can be run, and the terminal runs the application program and displays corresponding content (such as a space live view diagram, etc.) in a graphical user interface, so that a user browses, marks, etc. the corresponding content.

Furthermore, manual fine adjustment editing can be performed on the automatically generated space house type graph, and because of the automatically generated house type graph, under the condition that the accuracy requirement in the space house type graph is high for the door and window positions, automatic fine adjustment or manual fine adjustment editing is needed to be added so as to acquire the space house type graph with higher accuracy based on the initial space house type graph.

In the embodiment of the invention, if the second structural element of the space type diagram corresponding to the target space needs to be edited and adjusted, and the like, in the process of executing the editing operation on the house information, the terminal can respond to the input instruction of at least one second structural element in the space type diagram in the editing state, and at least display the target panoramic diagram corresponding to the target space under the current observation view angle.

In a specific implementation, in the process of displaying the space account type diagram, because the space account type diagram can be in an editable state, the terminal can respond to the input instruction of at least one second structural element in the space account type diagram in the editable state, at least display a target panoramic diagram corresponding to the target space under the current viewing angle, so as to realize the editing of the structural elements in the space account type diagram through the real scene content corresponding to the target space local area presented in the space real scene diagram.

The input instruction may be an instruction that needs to modify or adjust the second structural element after performing manual verification or machine automatic verification on the automatically generated second structural element in the space type diagram, or may be an input instruction of a selection operation performed by a user through at least one second structural element in the space type diagram in an editing state, or an input instruction that is triggered by a machine automatically identifying that at least one second structural element in the space type diagram in an editing state needs to be edited, where the obtained input instruction indicates that the editing operation needs to be performed on the second structural element, and the invention is not limited to this.

For the spatial pattern, it may include a first structural element and a second structural element, where the first structural element may be a structural element with a higher recognition based on the base panorama, and the second structural element may be a structural element with a lower recognition based on the base panorama.

When the second structural element which needs to be finely tuned is found in the process of verifying the initially generated space type image, the terminal can select an optimal acquisition point corresponding to a medium corresponding to the second structural element from at least one acquisition point of a target space, then acquire the target panoramic image corresponding to the optimal acquisition point, and then display an image area (namely the displayed target panoramic image) of the medium corresponding to the second structural element, which covers part of the target panoramic image, so that the editing of the structural element of the space type image is realized through real scene content corresponding to the target local area displayed in the target panoramic image.

In addition, based on the scheme terminal, when the target panoramic image is displayed, a target observation point corresponding to the current observation view angle and a target observation area corresponding to the target observation point can be obtained, the target observation point can be a mapping point of the acquisition point (2) in the space house type image, the target observation area is a mapping area of the target panoramic image in the space house type image, for example, the mapping area can be presented by taking the mapping point of the acquisition point (2) in the space house type image as a center through a fan-shaped area, then the space house type image corresponding to the target panoramic image is displayed in a graphical user interface, and the target observation point or the target observation point and the target observation area are displayed in the space house type image, so that the space real image including at least an image area covering part of a medium corresponding to a structural element and the space house type image are simultaneously displayed in the graphical user interface, the space real image and the space house type image are linked, the space real image and the space house type image of the space real image are displayed, the space real image and the space real image of the space real image are displayed in the space house type image, the space real image is displayed in the space real image, the space real image and the space real image is displayed in the space real image, the space real image is displayed in the space real image, the space real image and the space real image is displayed in the space real image and the space real image, the space real image and the space real image is the space real image and the space real space image.

In an example, referring to fig. 3, a schematic diagram of a spatial house type graph and a panorama graph provided in an embodiment of the present invention is shown, where a terminal may display, in a graphical user interface, a spatial house type graph 320 corresponding to a target panorama graph 310 at the same time when displaying the target panorama graph 310 corresponding to a current viewing angle, and select, based on a determined target viewpoint and a target viewing area, a corresponding viewpoint 330 in the spatial house type graph 320 and a viewing area 340 (a fan-shaped area in the figure) corresponding to the viewpoint 330, and as a user changes the viewing angle of the spatial real view graph 310, the viewing area 340 may also dynamically change along with a change of the spatial real view displayed in the graphical user interface, so as to implement linkage of presentation of information content of a house.

Step 102, in response to obtaining that at least one target medium image exists in a target panoramic image, correspondingly generating a third structural element corresponding to the target medium image in the spatial user pattern;

and the first structural element and the second structural element corresponding to the target medium image are correspondingly generated on the space house type image through automatic identification processing, and the second structural element is a structural element with lower identification degree in the basic panoramic image, so that the target panoramic image needs to be selected again, and the second structural element needs to be checked again.

After the second structural element automatically generated in the space type diagram is subjected to manual verification or machine automatic verification, if the second structural element is required to be modified or adjusted, the input instruction is triggered, at the moment, the target panoramic diagram can be identified in a machine automatic identification or manual identification mode, when at least one target medium image exists in the target panoramic diagram, the condition that the at least one target medium image exists in the target panoramic diagram is obtained, and fine adjustment editing can be performed on the second structural element in the space type diagram based on the obtained target medium image. Specifically, the following two implementation modes are described for identifying the target panorama in a machine automatic identification or manual identification mode:

in a first implementation manner, at least one target media image may be acquired through a machine automatic identification manner, and when an image identification process is performed on a target panoramic image, if the terminal has at least one target media image in the acquired identification result that is the target panoramic image, a third structural element corresponding to the target media image may be generated corresponding to the spatial house type image, and the second structural element may be updated by the third structural element.

The specific procedure described above for updating the second structural element with the third structural element,

specifically, firstly, establishing a mapping relation between a target panoramic image and three-dimensional point cloud data acquired by a first acquisition point for acquiring a space household pattern image to obtain three-dimensional point cloud coordinates of the target panoramic image;

and further mapping the three-dimensional point cloud coordinates of the target panoramic image into the plane of the space user pattern image to obtain the mapping relation between the target panoramic image and the space user pattern image.

Based on the three-dimensional point cloud coordinates of the target medium image identified in the target panoramic image are mapped into the space user type image to obtain a third structural element.

The thought established by the mapping of the target panorama and the space user pattern is the same as the thought established by the mapping process of the user pattern profile and the basic panorama, and is not repeated here.

Specifically, the target panorama may be an image area obtained according to a panorama acquired at a second acquisition point in the target space, where the second acquisition point covers at least a part of the medium corresponding to the first structural element, and the second acquisition point may be an optimal acquisition point of the acquisition points (1, 2) and (3) in fig. 2, where the optimal acquisition point corresponds to the medium corresponding to the first structural element.

In one example, among the collection points (1, 2) and (3), the collection point closest to the medium corresponding to the first structural element is taken as the optimal collection point, and as the second collection point, for example, for a certain entity wall in the target space, the collection point (1) may be taken as the optimal collection point relative to the entity wall if the distances between the collection point (1), the collection point (2) and the collection point (3) are respectively 2 meters, 3 meters and 5 meters.

In another example, among the collection points (1, 2) and (3), the collection point close to the forward shooting direction of the medium corresponding to the first structural element is the optimal collection point, and as the second collection point, for example, assuming that the camera is used as the origin and the corresponding ray is emitted as the forward shooting direction, for the same entity wall of the face in the target space, the smaller the included angle between the line and the ray between the entity wall and the origin is, the closer the entity wall is to the forward shooting direction is indicated, so that the collection point with the smallest included angle can be used as the optimal collection point relative to the entity wall.

In a preferred mode, the terminal acquires at least one target medium image in the target panoramic image in the automatic identification mode, and the second structural element before the update of the third structural element corresponding to the target medium image is correspondingly generated in the space house type image, and meanwhile, the target marking element identified by the at least one target medium image can be displayed in the target panoramic image, so that on one hand, a user can conveniently view the target medium image identified by the terminal, on the other hand, the user can conveniently edit the target marking element to mark the target medium image, and further, the user can conveniently edit the space house information by marking the space house type image, and the convenience of house type image editing is improved.

For the target marking element, which may be a marking element added by the terminal in the target panorama based on the image recognition result, different target media images may correspond to displaying different marking elements, for example, assuming that the target media image is a door media image, the door marking element may be displayed; the window marking element or the like may be displayed assuming that the target media image is a window media image, to which the present invention is not limited.

In a second implementation manner, the target panorama can be identified by a manual identification manner to obtain at least one target media image existing in the target panorama, then the marking operation of the at least one target media image existing in the target panorama is performed by a manual operation to indicate that the at least one target media image exists in the target panorama, correspondingly, the terminal correspondingly generates a third structural element corresponding to the target media image in the spatial type map, and the target marking element after the marking operation is performed on the at least one target media image is displayed in the target panorama.

The process of generating the third structural element corresponding to the target media image in the spatial user pattern map is also based on the target panoramic map and the spatial user pattern map, which is not repeated here.

In the process of marking by manual operation, the terminal can display a toolbar for adding marking elements, the toolbar can comprise a plurality of structure marking controls corresponding to different marking elements, each structure marking control corresponds to one marking element, each marking element corresponds to one structural element and characterizes different spatial structures, a user can select the corresponding structure marking control to add the corresponding marking element based on the corresponding target medium image of the target medium presented by the live-action graph, and specifically, the terminal determines the target structure marking control in response to the selection operation for the structure marking control, and displays the target marking element corresponding to the target structure marking control in the target panoramic graph.

Specifically, the terminal may perform a marking operation on at least one target media image in which the target panorama exists in response to a target structure marking control triggered in the structure marking control by a manual operation, and display a target marking element after performing the marking operation on the at least one target media image in the target panorama to indicate that the at least one target media image is recognized to exist in the target panorama.

Optionally, the target media image marked by the user at least comprises one of a door body media image, a window body media image, a water line media image and an electric wire media image. Optionally, the terminal may further display the target marking element identified for the at least one target media image in the target panorama. Specifically, the target marking element may be a marking element that a user manually performs identification marking on a related medium presented in the space live-action graph. In addition, the marking element may include marking marks that display different display modes from marking line segments, marking surfaces, stereo marks and the like in the space live-action graph, which is not limited by the present invention. In addition, different marking elements can represent different spatial structures, and marking elements corresponding to different spatial structures can be displayed in different display modes, for example, for a door body, a window body, a water pipeline, an electric wire and the like, yellow, green, red, white and the like can be respectively displayed to distinguish different spatial structures and the like, which is not limited by the invention.

Optionally, the terminal may further display an edit control group for the target marking element, where the edit control group may include an endpoint control and a mobile control, in a specific implementation, the terminal may obtain, by performing a manual operation on triggering of at least one of the endpoint controls, a target display size of the target marking element in the target panorama according to a region of the first editing operation after the endpoint control performs the first editing operation; and/or triggering the mobile control through manual operation, and after the mobile control executes the second editing operation, the terminal can acquire the target display position of the target marking element in the target panoramic image according to the position of the second editing operation.

In addition, the editing control group may further include a switching control, and after the switching control completes the third editing operation, the terminal may switch the currently displayed target marking element to another marking element representing another medium in the target panorama by manually operating a trigger for at least one of the switching controls.

After the corresponding target mark element is displayed in the space live-action diagram, and the editing function of the target mark element is provided, so that the terminal can adjust the target mark element in the space house type diagram in real time through any control in the editing control group, so that the structural element corresponding to the target mark element can be displayed more accurately (such as adding structural elements representing other space structures on the corresponding wall structural element), linkage between the mark of the space live-action diagram and the display of the space house type diagram is realized in the process of editing house information, on one hand, the mark of live-action content is satisfied, on the other hand, in the process of marking, the result of marking can be visually presented based on the linkage of the space house type diagram, and the global perception of the mark content of the target space can be improved.

In the manual editing process, after the terminal displays the corresponding target mark element in the space live-action diagram, an editing control group aiming at the target mark element can be displayed, then the editing operation aiming at any control in the editing control group, which is input by a user, can be responded, and the display effect of the target mark element in the target panoramic diagram is determined according to the editing operation.

Based on the method, the terminal can synchronously add the target structure element corresponding to the target mark element in the wall structure element of the space house type diagram, so that the editing of house information is realized through the linkage between the 2D space house type diagram and the 3D space live-action diagram, the difficulty of information editing is greatly reduced, and the convenience of information editing is improved.

Correspondingly, the manual editing operation identifies that at least one target medium image exists in the target panoramic image, and the terminal correspondingly generates a third structural element corresponding to the target medium image in the spatial house type image.

In a specific implementation, the display position corresponding to the marking element may be panoramic pixel coordinates, the panoramic pixel coordinates corresponding to the marking element may be mapped to three-dimensional point cloud coordinates based on the mapping relationship, then the corresponding second structural element is displayed in the space type graph, and for the size and the structure type of the displayed second structural element, mapping may be performed based on the display size corresponding to the marking element, and meanwhile, what second structural element needs to be displayed is determined according to the structure identification, so that according to the mapping relationship between the constructed space real view graph and the space type graph, the user can edit the space house information by marking the corresponding medium in the space real view graph, thereby greatly simplifying the editing flow of the space type graph, not only improving the editing convenience, but also improving the editing efficiency and improving the accuracy of the display content of the space type graph by marking in combination with the presented real view content.

And step 103, updating the second structural element by adopting the third structural element so as to update the space account type diagram for presentation.

Further, after determining the third structural element, the terminal may update the second structural element with the third structural element, and update the spatial pattern diagram, so as to display the updated spatial pattern diagram. In the updating process, if the second medium corresponding to the target mark element and the third medium corresponding to the third structure element are of the same spatial structure, updating the second structure element to the third structure element in the spatial layout by adopting the target display position and the target display size; and if the second medium corresponding to the target marking element and the third medium corresponding to the third structural element are of different spatial structures, displaying the corresponding third structural element on the second structural element in the spatial house type graph by adopting the target display position and the target display size. For example, assuming that the second structural element is a door structural element and the door structural element does not correspond to the actual spatial structure of the target space, the user may edit the door structural element through the above process, for example, mark the corresponding window medium in the spatial live-action graph to obtain the corresponding window mark element, and then the terminal may replace the door structural element with the window structural element on the spatial house type graph based on the display parameter corresponding to the window mark element; the second structural element is a door body structural element, but the display position of the second structural element does not correspond to the actual space structure of the target space, so that a user can adjust the display parameters corresponding to the door body marking elements corresponding to the door body structural element in the space live-action graph, then the terminal can update the door body structural element on the space house type graph based on the display parameters corresponding to the adjusted door body marking elements, and on the basis of the initial space house type graph, the user can find the proper target panoramic graph again to carry out auxiliary door and window recognition, thereby carrying out fine adjustment correction on the space house type graph and obtaining the space house type graph with better quality.

It should be noted that, for the display size of the target structural element in the space user pattern, a corresponding scaling ratio may be preset, and the target display size may include the display length of the target structural element, and then the scaling ratio and the display length may be used to display the corresponding target structural element on the space map, so as to implement linkage between the space live-action map and the space user pattern, intuitively present the marked content at which position in the target space for the user, and improve the global perception of the user on the target space.

In an example, referring to fig. 4, a schematic diagram of a spatial live-action diagram provided in an embodiment of the present invention is shown, where, taking manual editing as an example, a terminal may display a corresponding live-action editing interface 40 through a graphical user interface, and may display, in the live-action editing interface 40, a target panorama 410 corresponding to a target space at a current viewing angle, and display a spatial user pattern 420, and display, in the spatial user pattern 420, a target viewpoint and a target viewing area of the current viewing angle.

Also displayed through the graphical user interface is a toolbar 430, in which toolbar 430 may include a window markup control 4301 (an exemplary structural markup control, representing a window markup of an entity window), a first type of window markup control 4302 (an exemplary structural markup control, representing a door markup of an entity window), and a second type of window markup control 4303 (an exemplary structural markup control, representing a door markup of an open door).

When an input instruction of a door structure element 440 (an exemplary second structure element) representing a door body of the spatial type map 420 is acquired, the input instruction may be an input instruction of a user through a selection operation performed on a certain door structure element 440 in the displayed spatial type map 420, or may be an input instruction triggered by a machine automatically identifying that the certain door structure element 440 in the spatial type map 420 needs to be edited, the input instruction is acquired and indicates that an editing operation needs to be performed on the door structure element 440, at this time, a target panorama 410 corresponding to a target space under a current viewing angle needs to be displayed in a matching manner, the spatial type map 410 may be constructed according to point cloud data acquired at a first acquisition point in the target space, the first acquisition point may be any one acquisition point in at least one acquisition point of the target space, the spatial real view map 410 is an image corresponding to at least one optimal acquisition point in the target space, and the acquired at least covers at least one door structure element 440 (an exemplary second structure element) in the target space, and the spatial real view map 410 is a target panorama corresponding to at least one optimal acquisition point in the target space.

When a user adds a corresponding door body marking element 450 (an exemplary target marking element) in the space live-action graph through the first type door body marking control 4302, the terminal can simultaneously display an editing control group 460 (an exemplary editing control group) for the door body marking element 450, the user can edit the door body marking element 450 through an endpoint control in the editing control group 460, and after the first editing operation for the door body marking element 450 is performed by the endpoint control, the endpoint control can obtain the display size of the door body marking element 450 in the space live-action graph 410 according to the area (illustrated as the range marked by gray lines) of the first editing operation according to the trigger of the endpoint control; the door marking element 450 after the marking operation is performed on the door image is displayed in the space live-action image, which indicates that the door medium image is recognized to exist in the space live-action image 410. At this time, a gate structure element 470 (an exemplary third structure element, a gray line segment) corresponding to the gate dielectric image is correspondingly generated in the spatial layout 420; the door body structural element 440 (exemplary second structural element) is adjusted using the door body structural element 470. Illustratively, the door body structural element 470 is updated on the door body structural element 440 (exemplary second structural element, black line segment), and the spatial pattern diagram is updated to show the updated spatial pattern diagram.

The space house type map mapped to the two-dimensional plane intuitively presents the marked content at which position in the target space for the user, and improves the global perception of the user on the target space.

In addition, referring to fig. 5, a schematic diagram of a spatial live-action diagram provided in the embodiment of the present invention is shown, where a terminal may display a corresponding live-action editing interface 50 through a graphical user interface, may display a spatial live-action diagram 510 and a spatial house type diagram 520 corresponding to a target space in the live-action editing interface 50, and may include a plurality of observation points 5201 and observation areas 5202 corresponding to current observation points in the spatial house type diagram, and a user may switch the displayed spatial live-action diagram through the spatial points 5201 to implement switching between the spatial live-action diagrams corresponding to the same target space or different target spaces, and as the viewing angle is switched at the same observation point, the observation areas 5202 may dynamically change along with the switching of the displayed spatial live-action diagram. In addition, in the live-action editing interface 50, when a plurality of acquisition points exist in the target space, the terminal can display acquisition point labels 530 corresponding to the acquisition points in the live-action editing interface 50, such as "living room 1", "living room 2", and "living room 3", so that the user can realize the switching of the space live-action map through the space point in the space house type map 520, and can also realize the switching through the acquisition point labels 530, thereby improving the convenience in the user editing process.

In the embodiment of the invention, in the process of editing the house type graph, a terminal can respond to the input instruction of at least one second structural element in the space house type graph in an editing state, at least display a target panoramic graph corresponding to the target space under the current observation view angle, the target panoramic graph can be an image area which is acquired according to at least one part of second structural element corresponding to the second image acquired in second acquisition points in the target space, the second acquisition points are optimal acquisition points of the medium corresponding to the first structural element in at least one acquisition point of the target space, so that the space structure corresponding to the target space is marked through the space real graph based on the presented real graph content, the editing convenience of the house type graph is improved, the editing process of the user is simplified, meanwhile, in the process of editing the house type graph based on the space real graph, the terminal can respond to the acquisition of at least one target medium image in the second image acquisition data acquired in the target panoramic graph, generate a third structural element corresponding to the target medium image in the space house type graph, then update the third structural element can be adopted, and the house type information is updated, so that the house type graph is updated, and the house type information is updated,

Based on the initial space house type diagram, a proper target panoramic diagram is found again to conduct auxiliary door and window recognition again, so that fine adjustment and correction are conducted on the space house type diagram, and the space house type diagram with better quality can be obtained.

It should be noted that, for simplicity of description, the method embodiments are shown as a series of acts, but it should be understood by those skilled in the art that the embodiments are not limited by the order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred embodiments, and that the acts are not necessarily required by the embodiments of the invention.

Referring to fig. 6, a block diagram of a device for editing house information provided in an embodiment of the present invention is shown, and may specifically include the following modules:

a panorama display module 601, configured to display, in response to obtaining an input instruction for at least one second structural element in a spatial family chart in an edited state, at least a target panorama corresponding to a target space under a current viewing angle, where the spatial family chart includes a first structural element and a second structural element generated based on a spatial contour chart and a base panorama, the spatial contour chart is constructed according to first image acquisition data and/or second image acquisition data obtained at a first acquisition point in the target space, the first acquisition point is any one of at least one acquisition point in the target space, the target panorama is a panorama acquired according to a second image acquisition data acquired at a second acquisition point in the target space, and the acquired panorama at least covers a part of an image area of a medium corresponding to the second structural element, and the second acquisition point is an optimal acquisition point in the target space, relative to the medium corresponding to the first structural element;

A structural element generating module 602, configured to correspondingly generate, in response to obtaining that at least one target media image exists in the target panoramic image, a third structural element corresponding to the target media image in the spatial user pattern;

and a structural element adjustment module 603, configured to update the second structural element with the third structural element to update the spatial layout for presentation.

In an alternative embodiment, further comprising:

In an alternative embodiment, the method comprises:

In an alternative embodiment, the structural element generating module 602 is specifically configured to:

In an alternative embodiment, further comprising:

wherein, the structural element generating module 602 is specifically configured to:

In an alternative embodiment, further comprising:

In an alternative embodiment, the editing control group further includes a switch control, and the apparatus further includes:

For the device embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, and reference is made to the description of the method embodiments for relevant points.

In addition, the embodiment of the invention also provides electronic equipment, which comprises: the processor, the memory, store the computer program on the memory and can run on the processor, this computer program is realized each process of the above-mentioned method embodiment of editing of house information when being carried out by the processor, and can reach the same technical result, in order to avoid repetition, will not be repeated here.

The embodiment of the invention also provides a computer readable storage medium, on which a computer program is stored, which when executed by a processor, realizes the processes of the above-mentioned embodiment of the method for editing house information, and can achieve the same technical effects, and in order to avoid repetition, the description is omitted here. Wherein the computer readable storage medium is selected from Read-Only Memory (ROM), random access Memory (Random Access Memory, RAM), magnetic disk or optical disk.

Fig. 7 is a schematic diagram of a hardware structure of an electronic device implementing various embodiments of the present invention.

The electronic device 700 includes, but is not limited to: radio frequency unit 701, network module 702, audio output unit 703, input unit 704, sensor 705, display unit 706, user input unit 707, interface unit 708, memory 709, processor 710, and power supply 711. It will be appreciated by those skilled in the art that the electronic device structure shown in fig. 7 is not limiting of the electronic device and that the electronic device may include more or fewer components than shown, or may combine certain components, or a different arrangement of components. In the embodiment of the invention, the electronic equipment comprises, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal, a wearable device, a pedometer and the like.

It should be understood that, in the embodiment of the present invention, the radio frequency unit 701 may be used for receiving and transmitting signals during the process of receiving and transmitting information or communication, specifically, receiving downlink data from a base station, and then processing the received downlink data by the processor 710; and, the uplink data is transmitted to the base station. Typically, the radio unit 701 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio unit 701 may also communicate with networks and other devices through a wireless communication system.

The electronic device provides wireless broadband internet access to the user via the network module 702, such as helping the user to send and receive e-mail, browse web pages, and access streaming media, etc.

The audio output unit 703 may convert audio data received by the radio frequency unit 701 or the network module 702 or stored in the memory 709 into an audio signal and output as sound. Also, the audio output unit 703 may also provide audio output (e.g., a call signal reception sound, a message reception sound, etc.) related to a specific function performed by the electronic device 700. The audio output unit 703 includes a speaker, a buzzer, a receiver, and the like.

The input unit 704 is used for receiving an audio or video signal. The input unit 704 may include a graphics processor (Graphics Processing Unit, GPU) 7041 and a microphone 7042, the graphics processor 7041 processing image data of still pictures or video obtained by an image capturing apparatus (such as a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 706. The image frames processed by the graphics processor 7041 may be stored in memory 709 (or other storage medium) or transmitted via the radio unit 701 or the network module 702. The microphone 7042 can receive sound, and can process such sound into audio data. The processed audio data may be converted into a format output that can be transmitted to the mobile communication base station via the radio frequency unit 701 in the case of a telephone call mode.

The electronic device 700 also includes at least one sensor 705, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor that can adjust the brightness of the display panel 7061 according to the brightness of ambient light, and a proximity sensor that can turn off the display panel 7061 and/or the backlight when the electronic device 700 is moved to the ear. As one of the motion sensors, the accelerometer sensor can detect the acceleration in all directions (generally three axes), and can detect the gravity and direction when stationary, and can be used for recognizing the gesture of the electronic equipment (such as horizontal and vertical screen switching, related games, magnetometer gesture calibration), vibration recognition related functions (such as pedometer and knocking), and the like; the sensor 705 may also include a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, etc., and will not be described again here.

The display unit 706 is used to display information input by a user or information provided to the user. The display unit 706 may include a display panel 7061, and the display panel 7061 may be configured in the form of a liquid crystal display (Liquid Crystal Display, LCD), an Organic Light-Emitting Diode (OLED), or the like.

The user input unit 707 is operable to receive input numeric or character information and to generate key signal inputs related to user settings and function control of the electronic device. Specifically, the user input unit 707 includes a touch panel 7071 and other input devices 7072. The touch panel 7071, also referred to as a touch screen, may collect touch operations thereon or thereabout by a user (e.g., operations of the user on the touch panel 7071 or thereabout using any suitable object or accessory such as a finger, stylus, etc.). The touch panel 7071 may include two parts, a touch detection device and a touch controller. The touch detection device detects the touch azimuth of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device, converts it into touch point coordinates, and sends the touch point coordinates to the processor 710, and receives and executes commands sent from the processor 710. In addition, the touch panel 7071 may be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. The user input unit 707 may include other input devices 7072 in addition to the touch panel 7071. In particular, other input devices 7072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and so forth, which are not described in detail herein.

Further, the touch panel 7071 may be overlaid on the display panel 7061, and when the touch panel 7071 detects a touch operation thereon or nearby, the touch operation is transmitted to the processor 710 to determine a type of a touch event, and then the processor 710 provides a corresponding visual output on the display panel 7061 according to the type of the touch event. Although in fig. 7, the touch panel 7071 and the display panel 7061 are two independent components for implementing the input and output functions of the electronic device, in some embodiments, the touch panel 7071 and the display panel 7061 may be integrated to implement the input and output functions of the electronic device, which is not limited herein.

The interface unit 708 is an interface to which an external device is connected to the electronic apparatus 700. For example, the external devices may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 708 may be used to receive input (e.g., data information, power, etc.) from an external device and to transmit the received input to one or more elements within the electronic apparatus 700 or may be used to transmit data between the electronic apparatus 700 and an external device.

The memory 709 may be used to store software programs as well as various data. The memory 709 may mainly include a storage program area that may store an operating system, application programs required for at least one function (such as a sound playing function, an image playing function, etc.), and a storage data area; the storage data area may store data (such as audio data, phonebook, etc.) created according to the use of the handset, etc. In addition, memory 709 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The processor 710 is a control center of the electronic device, connects various parts of the entire electronic device using various interfaces and lines, and performs various functions of the electronic device and processes data by running or executing software programs and/or modules stored in the memory 709 and calling data stored in the memory 709, thereby performing overall monitoring of the electronic device. Processor 710 may include one or more processing units; preferably, the processor 710 may integrate an application processor that primarily handles operating systems, user interfaces, applications, etc., with a modem processor that primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 710.

The electronic device 700 may also include a power supply 711 (e.g., a battery) for powering the various components, and the power supply 711 may preferably be logically coupled to the processor 710 via a power management system, such as to perform functions such as managing charge, discharge, and power consumption by the power management system.

In addition, the electronic device 700 includes some functional modules, which are not shown, and will not be described herein.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) comprising instructions for causing a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the method according to the embodiments of the present invention.

The embodiments of the present invention have been described above with reference to the accompanying drawings, but the present invention is not limited to the above-described embodiments, which are merely illustrative and not restrictive, and many forms may be made by those having ordinary skill in the art without departing from the spirit of the present invention and the scope of the claims, which are to be protected by the present invention.

Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.

It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the above-described systems, apparatuses and units may refer to corresponding procedures in the foregoing method embodiments, and are not repeated herein.

In the embodiments provided in the present invention, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of the units is merely a logical function division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.

The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in the embodiments of the present invention may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit.

The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a usb disk, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk, etc.

The foregoing is merely illustrative of the present invention, and the present invention is not limited thereto, and any person skilled in the art will readily recognize that variations or substitutions are within the scope of the present invention. Therefore, the protection scope of the invention is subject to the protection scope of the claims.

Claims

1. A method of editing house information, comprising:

in response to acquiring an input instruction for at least one second structural element in a spatial user pattern in an editing state, at least displaying a target panorama corresponding to a target space under a current viewing angle, wherein the spatial user pattern comprises a first structural element and a second structural element generated based on a spatial profile and a basic panorama, the spatial profile is constructed according to first image acquisition data and/or second image acquisition data acquired at a first acquisition point of the target space, the first acquisition point is any acquisition point of at least one acquisition point of the target space, the target panorama is a panorama of an image area of a medium corresponding to at least a part of the second structural element, and the second acquisition point is an optimal acquisition point of the medium corresponding to the second structural element in the at least one acquisition point of the target space;

responding to the obtained target panoramic image with at least one target medium image, and correspondingly generating a third structural element corresponding to the target medium image in the space family type image;

Updating the second structural element with the third structural element to update the spatial house type graph for presentation;

wherein the medium is a spatial structure located in a target space; the structural elements are used for representing the spatial structure of the target space in the spatial house type graph, and the first structural elements and the second structural elements are respectively used for representing different spatial structures in the target space in the spatial house type graph;

wherein said updating said second structural element with said third structural element comprises:

if the second medium corresponding to the second structural element and the third medium corresponding to the third structural element are of the same spatial structure, updating the second structural element into the third structural element;

and if the second medium corresponding to the second structural element and the third medium corresponding to the third structural element are of different spatial structures, displaying the corresponding third structural element on the second structural element in the spatial house type graph.

2. The method as recited in claim 1, further comprising:

3. The method as recited in claim 1, further comprising:

4. The method as recited in claim 1, further comprising:

5. The method of claim 1, wherein generating, in response to the obtaining that there is at least one target media image in the target panorama, a third structural element corresponding to the target media image in the spatial layout correspondence comprises:

6. The method of claim 1, wherein generating, in response to the obtaining that there is at least one target media image in the target panorama, a third structural element corresponding to the target media image in the spatial layout correspondence comprises:

7. The method as recited in claim 6, further comprising:

8. The method as recited in claim 6, further comprising:

9. The method of claim 8, wherein the set of editing controls further comprises a toggle control, the method further comprising:

10. A house information editing apparatus, comprising:

a panorama display module, configured to respond to obtaining an input instruction for at least one second structural element in a spatial family type graph in an editing state, at least display a target panorama corresponding to a target space under a current viewing angle, where the spatial family type graph includes a first structural element and a second structural element generated based on a spatial contour graph and a basic panorama, the spatial contour graph is constructed according to first image acquisition data and/or second image acquisition data obtained at a first acquisition point of the target space, the first acquisition point is any one acquisition point of at least one acquisition point of the target space, the target panorama is a panorama corresponding to an image area of a medium corresponding to at least a covered part of the second structural element in the second image acquisition data obtained according to a second acquisition point in the target space, and the second acquisition point is an optimal acquisition point of the medium corresponding to the second structural element in the at least one acquisition point of the target space;

A structural element adjustment module, configured to update the second structural element with the third structural element to update the spatial layout for presentation;

wherein, the structural element adjustment module is specifically configured to:

11. An electronic device comprising a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus;

The memory is used for storing a computer program;

the processor being configured to implement the method of any of claims 1-9 when executing a program stored on a memory.

12. A computer-readable storage medium having instructions stored thereon, which when executed by one or more processors, cause the processors to perform the method of any of claims 1-9.