CN114663601A

CN114663601A - Three-dimensional image construction method and device and electronic equipment

Info

Publication number: CN114663601A
Application number: CN202210477786.0A
Authority: CN
Inventors: 李泉
Original assignee: Beijing Youzhuju Network Technology Co Ltd
Current assignee: Beijing Youzhuju Network Technology Co Ltd
Priority date: 2022-04-28
Filing date: 2022-04-28
Publication date: 2022-06-24

Abstract

The embodiment of the disclosure discloses a method for constructing a three-dimensional image, which can be applied to portable terminal equipment with an image acquisition device, wherein the terminal equipment can determine at least two predefined acquisition tracks according to the current position; for each predefined acquisition track, acquiring at least one frame of image according to the acquisition point corresponding to the predefined acquisition track to obtain an image set corresponding to the predefined acquisition track; and constructing a three-dimensional image of the target space based on image sets corresponding to at least two predefined acquisition trajectories respectively. In this way, the at least two image sets obtained may be made to cover the content of more regions in the target space.

Description

Three-dimensional image construction method and device and electronic equipment

Technical Field

The present disclosure relates to the field of internet technologies, and in particular, to a method and an apparatus for constructing a three-dimensional image, and an electronic device.

Background

With the development of science and technology, the two-dimensional images bear less content, so in some scenes, the two-dimensional images can be used for synthesizing three-dimensional images by using image processing technology, and the content borne by the three-dimensional images can be more than that of the two-dimensional images.

In the process of acquiring two-dimensional images to generate three-dimensional images, a camera is generally used to acquire 360-degree two-dimensional images of a certain space, and then the acquired two-dimensional images are used to synthesize three-dimensional images. For example, the camera is typically rotated 360 degrees, and three-dimensional images may be generated using images acquired during the 360 degrees of rotation of the camera.

Disclosure of Invention

This disclosure is provided to introduce concepts in a simplified form that are further described below in the detailed description. This disclosure is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter.

The embodiment of the disclosure provides a method and a device for constructing a three-dimensional image and electronic equipment, which can cover the content of more areas in a target space by using at least two image sets, so that the three-dimensional image of the target space constructed by using the at least two image sets is more accurate.

In a first aspect, an embodiment of the present disclosure provides a method for constructing a three-dimensional image, which is applied to a portable terminal device with an image capturing device, where the method includes: in response to detecting a three-dimensional image construction instruction for a target space, determining at least two predefined acquisition tracks according to the current position of the portable terminal equipment; according to the number of preset images, determining acquisition points corresponding to the predefined acquisition tracks respectively; for each predefined acquisition track, acquiring at least one frame of image according to an acquisition point corresponding to the predefined acquisition track to obtain an image set corresponding to the predefined acquisition track; and constructing the three-dimensional image of the target space based on the image sets respectively corresponding to the at least two predefined acquisition tracks.

In a second aspect, an embodiment of the present disclosure provides a three-dimensional image constructing apparatus applied to a portable terminal device with an image capturing device, where the three-dimensional image constructing apparatus includes: a first determination unit, configured to determine, in response to detecting a three-dimensional image construction instruction for a target space, at least two predefined acquisition trajectories according to a current position of the portable terminal device; the second determining unit is used for determining acquisition points corresponding to the predefined acquisition tracks according to the preset number of the images; the acquisition unit is used for acquiring at least one frame of image according to the acquisition point corresponding to each predefined acquisition track to obtain an image set corresponding to the predefined acquisition track; and the construction unit is used for constructing the three-dimensional image of the target space based on the image sets respectively corresponding to the at least two predefined acquisition tracks.

In a third aspect, an embodiment of the present disclosure provides an electronic device, including: one or more processors; a storage device, configured to store one or more programs, which when executed by the one or more processors, cause the one or more processors to implement the method for constructing a three-dimensional image according to the first aspect.

In a fourth aspect, the disclosed embodiments provide a computer readable medium, on which a computer program is stored, which when executed by a processor, implements the steps of the three-dimensional image construction method as described above in the first aspect.

The three-dimensional image construction method, the three-dimensional image construction device and the electronic equipment provided by the embodiment of the disclosure can be applied to portable terminal equipment with an image acquisition device, and the terminal equipment can determine at least two predefined acquisition tracks according to the current position; for each predefined acquisition track, acquiring at least one frame of image according to the acquisition point corresponding to the predefined acquisition track to obtain an image set corresponding to the predefined acquisition track; and constructing the three-dimensional image of the target space based on the image sets respectively corresponding to the at least two predefined acquisition trajectories. Thus, since one image set corresponds to one predefined acquisition trajectory, the predefined acquisition trajectories corresponding to the image sets are different; each image set comprises at least one image acquired by the terminal device along the corresponding predefined acquisition track, so that the at least two image sets can cover the content of more areas in the target space, and the three-dimensional image of the target space constructed by the at least two image sets can be more accurate.

Drawings

The above and other features, advantages and aspects of various embodiments of the present disclosure will become more apparent by referring to the following detailed description when taken in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numbers refer to the same or similar elements. It should be understood that the drawings are schematic and that elements and features are not necessarily drawn to scale.

FIG. 1 is a flow diagram of one embodiment of a method of constructing a three-dimensional image according to the present disclosure;

FIG. 2 is a schematic illustration of a predefined acquisition trajectory according to some embodiments of a method of constructing a three-dimensional image according to the present disclosure;

3A-3B are terminal capture process diagrams of some embodiments of a method of constructing a three-dimensional image according to the present disclosure;

fig. 4 is a schematic illustration of a terminal device shooting process according to some embodiments of a method of constructing a three-dimensional image according to the present disclosure;

5A-5B are terminal capture process diagrams of further embodiments of methods of constructing three-dimensional images according to the present disclosure;

FIG. 5C is a schematic diagram of a terminal shooting process in a process of constructing a three-dimensional image in the related art;

FIG. 6 is a schematic structural diagram of one embodiment of a three-dimensional image construction apparatus according to the present disclosure;

FIG. 7 is an exemplary system architecture to which the method of constructing a three-dimensional image of one embodiment of the present disclosure may be applied;

fig. 8 is a schematic diagram of a basic structure of an electronic device provided according to an embodiment of the present disclosure.

Detailed Description

Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it is to be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but rather are provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the disclosure are for illustration purposes only and are not intended to limit the scope of the disclosure.

It should be understood that the various steps recited in the method embodiments of the present disclosure may be performed in a different order, and/or performed in parallel. Moreover, method embodiments may include additional steps and/or omit performing the illustrated steps. The scope of the present disclosure is not limited in this respect.

The term "include" and variations thereof as used herein are open-ended, i.e., "including but not limited to". The term "based on" is "based, at least in part, on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Relevant definitions for other terms will be given in the following description.

It should be noted that the terms "first", "second", and the like in the present disclosure are only used for distinguishing different devices, modules or units, and are not used for limiting the order or interdependence relationship of the functions performed by the devices, modules or units.

It is noted that references to "a", "an", and "the" modifications in this disclosure are intended to be illustrative rather than limiting, and that those skilled in the art will recognize that "one or more" may be used unless the context clearly dictates otherwise.

The names of messages or information exchanged between devices in the embodiments of the present disclosure are for illustrative purposes only, and are not intended to limit the scope of the messages or information.

Referring to fig. 1, a flow of an embodiment of a method for constructing a three-dimensional image according to the present disclosure is shown. The method for constructing the three-dimensional image can be applied to portable terminal equipment with an image acquisition device (for example, portable terminal equipment based on an iOS platform, and the image acquisition device can be arranged on the terminal equipment). As shown in fig. 1, the method for constructing a three-dimensional image may include the following steps:

step 101, in response to detecting a three-dimensional image construction instruction for a target space, determining at least two predefined acquisition trajectories according to a current position of a portable terminal device.

As an example, each predefined acquisition trajectory may be understood as a rotational acquisition trajectory, and the rotational angle of each predefined acquisition trajectory may be 360 degrees.

As an example, an execution body (a portable terminal device with an image capturing apparatus) may be placed in the target space, and thus image capturing may be performed on the target space.

As an example, a construction control (e.g., a panoramic image shooting control) may be set on the execution body, and when the terminal device detects a trigger operation for the construction control, a three-dimensional image construction instruction for the target space may be generated.

And here, at least two predefined acquisition tracks are determined, so that a user can conveniently determine to acquire the target space according to the indication of the predefined acquisition tracks, and more accurate image acquisition of the target space can be facilitated.

And 102, determining acquisition points respectively corresponding to the predefined acquisition tracks according to the preset number of the images.

As an example, the preset number of images may be not less than the number of images required to synthesize the target spatial three-dimensional image. The number of images required for synthesizing the three-dimensional image of the target control can be limited according to the actual situation, and the number of images required for synthesizing the three-dimensional image of the target control is not limited, and correspondingly, the specific numerical value of the preset number of images is not limited.

As an example, after determining a preset number of images, acquisition points respectively corresponding to the predefined acquisition trajectories may be determined.

As an example, acquisition points may be understood as some indicative points on a predefined acquisition trajectory, i.e. it may be understood that acquisition points may be used to indicate image acquisition for certain directions on the acquisition trajectory. To facilitate understanding of the predefined acquisition trajectory and the acquisition points, it is explained in conjunction with fig. 2, as shown in fig. 2, the predefined acquisition trajectory 201 may include a plurality of acquisition points (one black circle may represent one acquisition point); and the portable terminal device can focus on the acquisition point on the acquisition track and then complete the image acquisition of the acquisition point. Of course, in some implementation scenarios, the acquisition center of the terminal device may be collinear with the acquisition point, so that image acquisition of the acquisition point may be completed.

In other words, one acquisition point may correspond to one acquisition direction.

As an example, one predefined acquisition trajectory may correspond to at least 4 acquisition points (e.g., as shown in fig. 2, the number of acquisition points for one predefined acquisition trajectory may be 11), which may ensure the accuracy of the generated three-dimensional image of the target.

Step 103, for each predefined acquisition track, acquiring at least one frame of image according to the acquisition point corresponding to the predefined acquisition track to obtain an image set corresponding to the predefined acquisition track.

Here, it is to be understood that one image set may correspond to one predefined acquisition trajectory.

As an example, when the acquisition of at least two predefined acquisition trajectories is completed, then at least two image sets may be obtained. And the predefined acquisition trajectories for each image set are different.

As an example, since one image set corresponds to one predefined capturing trajectory, images from more angles of the target space (the space captured by the portable terminal device with the image capturing device) can be obtained from the image set obtained by capturing images with the portable terminal device with the image capturing device.

And 104, constructing a three-dimensional image of the target space based on the image sets respectively corresponding to the at least two predefined acquisition tracks.

As an example, since each image set corresponds to a different predefined acquisition trajectory, at least two image sets may include images acquired by the terminal device in different acquisition trajectories in the target space, so that the images used for constructing the three-dimensional image may cover images of more regions of the target space, and thus the accuracy of the constructed three-dimensional image of the target space may be improved.

It can be seen that the method for constructing a three-dimensional image provided by the present disclosure can be applied to a portable terminal device with an image acquisition device, and the terminal device can determine at least two predefined acquisition tracks according to a current position; for each predefined acquisition track, acquiring at least one frame of image according to the acquisition point corresponding to the predefined acquisition track to obtain an image set corresponding to the predefined acquisition track; and constructing the three-dimensional image of the target space based on the image sets respectively corresponding to the at least two predefined acquisition trajectories. Thus, since one image set corresponds to one predefined acquisition trajectory, the predefined acquisition trajectories corresponding to the image sets are different; each image set comprises at least one image acquired by the terminal device along the corresponding predefined acquisition track, so that the at least two image sets can cover the content of more areas in the target space, and the three-dimensional image of the target space constructed by the at least two image sets can be more accurate.

In some embodiments, the determining at least two predefined acquisition trajectories according to the current position of the portable terminal device in step 101 may specifically include: establishing a spatial three-dimensional coordinate system by taking the current position of the portable terminal device as a coordinate origin; determining at least two groups of track points with predefined numbers in a three-dimensional coordinate system based on a preset included angle numerical value; and at least two predefined acquisition tracks can be generated according to the determined track points.

Here, the connecting line between each locus point and the coordinate origin in each group forms a predetermined angle with the X0Y plane.

As an example, the preset included angle value may be set according to actual conditions, and the preset included angle value is not limited herein. For example, it may be positive 30 degrees, negative 30 degrees, positive 150 degrees, etc.

As an example, a set of trace points may correspond to a predetermined angle value. For example, the preset included angle includes 30 degrees and 150 degrees. At this time, two sets of track points may be corresponded, where the connection line between each track point in one set of track points and the origin of coordinates forms an angle of 30 degrees with the X0Y plane, and the connection line between each track point in the other set of track points and the origin of coordinates forms an angle of 150 degrees with the X0Y plane.

Here, the predefined number of trace points in each group may be defined according to practical situations, and the specific number of the predefined number in each group is not limited herein. For example, the predefined number may be 40, 50, etc.

As an example, in the process of acquiring an image of a target space by a user, the user is usually located at a position relative to a center of the target space, and then starts to acquire the image of the target space by using an execution subject (that is, after the user is usually located at the position relative to the center of the target space, a three-dimensional image construction instruction is started to be triggered).

At this time, the current position of the portable terminal device can be used as a coordinate origin to establish a spatial three-dimensional coordinate system, then at least two groups of track points with predefined numbers can be determined in the three-dimensional coordinate system based on a preset included angle numerical value, and then a smooth curve can be generated by using the track points, so that at least two predefined acquisition tracks are generated.

By way of example, since the plane X0Y in the established three-dimensional coordinate system is parallel to the horizontal plane, it can be ensured that the established three-dimensional coordinate system does not change the established three-dimensional coordinate system as the user rotates the shooting angle, so that when the user performs image acquisition in the target space, the predefined acquisition track is determined to be completed, and does not change correspondingly as the shooting angle changes.

In some embodiments, at least two predefined acquisition trajectories may also be determined according to a preset included angle value and a preset distance value.

Here, the preset distance value may be understood as a distance from the origin of coordinates. In this way, at least two predefined acquisition trajectories are made circular.

Here, the predefined acquisition trajectory can also be understood as: when the portable terminal device is indicated to form a preset included angle value with the X0Y plane; and rotating the terminal equipment for one circle to acquire images. In order to facilitate understanding of the manner of collecting the target space when the portable terminal device forms the preset included angle value with the plane X0Y, the description may be made with reference to fig. 3A and 3B; fig. 3A can be understood as a schematic diagram of a part of image acquisition performed by a terminal device; as can be seen from fig. 3A, the terminal device 301 may be at an angle of X degrees with respect to the X0Y plane 302, and when the portable terminal device with the image capturing apparatus rotates 360 degrees (for example, 360 degrees may be rotated according to the direction indicated by the arrow in fig. 3A), an image set may be obtained; as further shown in fig. 3B, the angle between the terminal device 301 and the X0Y plane 302 may also be y degrees, and in this case, the portable terminal device with the image capturing apparatus may also be rotated 360 degrees (for example, 360 degrees may be rotated according to the direction indicated by the arrow in fig. 3B) to obtain an image set.

In some embodiments, the predefined number of trace points in each group may be on the same plane, and the plane may be parallel to the X0Y plane.

As an example, a connecting line between the center point of the predefined acquisition trajectory generated from the trajectory points and the origin of coordinates may be a vertical line. In this way, the acquisition track may indicate that the terminal device is at a predefined angle with respect to the X0Y plane, and then the terminal device is rotated to acquire an image.

In some embodiments, step 103 (for each predefined acquisition trajectory, acquiring at least one image according to the acquisition point corresponding to the predefined acquisition trajectory to obtain the image set corresponding to the predefined acquisition trajectory) may specifically include: and in response to detecting that the identification of an acquisition point is in the predefined area of the currently captured image, executing acquisition operation on the currently captured image to obtain an acquisition image corresponding to the acquisition point.

As an example, the currently captured image is captured only when it is determined that the identification of the capture point is within the predefined area of the currently captured image, so that the accuracy of the captured image can be guaranteed. The accuracy of the target space three-dimensional image synthesized by the acquired images can be ensured.

As an example, the size of the predefined area may be set according to actual situations, and the specific size of the predefined area is not limited herein.

As an example, the currently captured image may be understood as: an image capturing device of a portable terminal device captures an image in a current shooting direction.

As an example, a respective identification may be generated for each acquisition point, which may facilitate determining that a currently captured image is to be acquired.

For ease of understanding, fig. 4 may be understood as a display schematic diagram of the currently-captured image, in fig. 4, a square frame 401 may be understood as a predefined area, and a circular frame 402 may be understood as an identification of the capture point. When the circular box 402 is within the square box 401, then the current photographic image may be acquired.

Since one predefined acquisition track may correspond to a plurality of acquisition points, and the acquisition points may be uniformly distributed on the predefined acquisition track, in order to make the angle difference between the acquired images similar, the currently captured image may be acquired when the identification of the acquisition point is within the predefined area of the captured image, so that the angle differences of any adjacent acquired images are similar, and thus the efficiency of synthesizing the target three-dimensional image using the acquired images may be improved. The effect of the finally obtained three-dimensional image of the object can also be made better.

In some embodiments, one acquisition point may correspond to one acquisition direction, so that the image acquisition device may perform image acquisition only when the current acquisition direction matches the acquisition direction corresponding to the acquisition point; therefore, the number of images collected by the image collecting device can be reduced, the energy consumption of the terminal equipment is reduced, the number of images collected by the image collecting device can be reduced, the number of images concentrated by each image is reduced, and the storage space required by the terminal equipment for storing the collected images can be saved.

As an example, since a spatial three-dimensional coordinate system may be established according to the portable terminal device, so that each acquisition point has a corresponding acquisition direction, and the matching of the current acquisition direction and the acquisition direction corresponding to the acquisition point may be understood as: the angle difference of the current collection direction and the collection direction corresponding to the collection point in the three-dimensional coordinate system is within a preset difference range, so that the current collection direction can be represented to be matched with the collection direction corresponding to the collection point. Of course, the specific size of the preset difference range may be limited according to the actual situation, and the specific size of the preset difference range is not limited herein.

In some embodiments, when the executing subject detects that the image capturing device performs image capturing in each of the at least one preset capturing direction (completes capturing in the capturing direction corresponding to each capturing point), it may be characterized that the executing subject has captured at least one image corresponding to the predefined capturing trajectory. At the moment, prompt information for prompting the completion of acquisition can be generated, so that image acquisition can be conveniently and rapidly carried out according to a predefined acquisition track, and the acquisition efficiency in the acquisition process is improved.

In some embodiments, the execution body may also display current acquisition progress information. For example, the total number of acquisition points, and the number of acquisition points for which the image acquisition apparatus has completed acquisition, may be displayed. Therefore, the current acquisition progress can be obtained according to the displayed acquisition progress information, and the acquisition progress can be better known.

In some embodiments, a completion identification may also be added to the acquisition points at which image acquisition is completed.

As an example, completion identification may facilitate a user in distinguishing which acquisition points have acquired while those acquisition points have not. In such a way, the user can conveniently and quickly acquire the data.

Of course, in a specific implementation manner, the pattern of the completed mark may be defined according to an actual situation, and the specific pattern of the completed mark is not limited herein, for example, the color of the mark of the collection point that has completed collection may be changed.

In some embodiments, step 103 (for each predefined acquisition trajectory, acquiring at least one image according to the acquisition point corresponding to the predefined acquisition trajectory to obtain the image set corresponding to the predefined acquisition trajectory) may further include: in response to detecting that the identification of the acquisition point of the next image to be acquired is not displayed in the predefined area of the currently captured image, direction indication information is generated.

Here, the direction prompting information is used for instructing to adjust the acquisition position and/or direction of the image acquisition apparatus so that the identification of the acquisition point is displayed within a predefined area of the currently captured image.

That is, after the acquisition position and/or orientation of the image acquisition device is changed according to the indication of the direction prompt information, the identification of the acquisition point can be displayed in the predefined area of the currently captured image.

As an example, when the identification of an acquisition point is within a predefined area in the currently captured image, it may be characterized that the current acquisition direction matches the acquisition direction corresponding to the acquisition point.

As an example, the display of the direction prompt information may facilitate a user to quickly and conveniently change the acquisition position and/or direction of the image acquisition device, so as to change the identification of the acquisition point to a predefined area of the currently captured image, thereby completing the acquisition of the image corresponding to the acquisition point; therefore, the image acquisition efficiency can be improved, and the user can finish image acquisition more efficiently.

As an example, the direction prompt information may be understood as an indication arrow, so that the user may perform direction adjustment on the execution main body according to the indication of the indication arrow.

In some embodiments, step 103 (for each predefined acquisition trajectory, acquiring at least one image according to the acquisition point corresponding to the predefined acquisition trajectory to obtain the image set corresponding to the predefined acquisition trajectory) may further include: an identification of acquisition points corresponding to the predefined acquisition trajectory may be displayed.

As an example, the mark of the acquisition point corresponding to the predefined acquisition track is displayed, so that the user can conveniently and conveniently know the acquisition direction, and the acquisition efficiency can be improved.

In some implementations, a predefined acquisition trajectory may also be presented, and the identification of acquisition points may be presented on the predefined acquisition trajectory; therefore, the user can conveniently rotate the execution main body to acquire the image, and the acquisition efficiency can be improved.

In some implementation scenarios, the executing subject may directly display the trajectory schematic diagram corresponding to the predefined acquisition trajectory during the process of acquiring at least two image sets obtained by acquiring the acquisition points corresponding to each predefined acquisition trajectory, so that a user may directly rotate the terminal device according to the trajectory schematic diagram corresponding to the predefined acquisition trajectory. Therefore, the operation difficulty of the user for the terminal equipment in the image acquisition process can be simplified, correspondingly, the quality of the image acquired by the image acquisition device can be higher, and the quality of the target space three-dimensional image constructed by the acquired image set can be improved.

In some embodiments, one acquisition point may correspond to at least two acquired images.

As an example, the image acquisition means acquires at least two images at each acquisition point. At least two images collected by each collection point can be compared, and a target image corresponding to each collection point is screened out; an image set may then be obtained from the target images corresponding to the acquisition points.

As an example, each acquisition point corresponds to at least two images, and an image with a better effect can be screened out as a target image corresponding to the acquisition point, so that the quality of the images in the image set can be improved, and the three-dimensional image effect of the target space obtained by using the image set can be better.

As an example, the target image corresponding to each of the at least two acquired images may be screened out according to image parameters such as definition, brightness, contrast, and the like of each of the acquired images. Of course, in the specific embodiment, after at least two images are acquired, the acquired images are screened in many ways, and only reasonable selection is needed according to actual conditions; for the sake of brevity of the description, no further description is provided herein.

In some embodiments, the distance between any two adjacent acquisition points corresponding to the predefined acquisition trajectory is the same.

As an example, one acquisition point corresponds to one acquisition direction, and therefore, the same distance between any two adjacent preset acquisition points corresponding to the predefined acquisition trajectory can be understood as follows: the angular difference between any adjacent acquisition angles may be the same.

As an example, the angle difference between any two adjacent acquisition angles may be the same, so that the terminal device accelerates the construction efficiency of the three-dimensional image in the target space in the construction process of the three-dimensional image in the target space. For example, after the image a is acquired, the terminal device rotates 45 degrees to acquire the image B, and then rotates 45 degrees to acquire the image C … …, so that when the terminal device rotates 360 degrees in total, images of at least 8 acquisition angles can be acquired. Furthermore, the difference between adjacent acquisition angles is the same, which may result in the overlap of images acquired at each of the adjacent acquisition angles being approximately the same. For example, the region 1/8 in captured image a is the same as captured image B, and the region 1/8 in captured image B is the same as captured image C … …. Therefore, the terminal equipment can conveniently cut the image in the process of constructing the three-dimensional image of the target space, and the efficiency of the process of constructing the three-dimensional image of the target space can be improved.

In some embodiments, the at least one predetermined angle value includes a first angle value and a second angle value, and a sum of the first angle value and the second angle value is equal to the predetermined angle value.

Here, the preset angle values include: 180 degrees and 0 degrees.

By way of example, the first included angle value may be positive 30 degrees and the second included angle value may be negative 30 degrees.

Here, an angle value may correspond to an image set, and thus, at least one predetermined angle value corresponds to at least one image set; since the at least one predetermined angle value includes the first angle value and the second angle value, the at least one image set may include the first image set and the second image set, and since the sum of the first angle value and the second angle value may be equal to the predetermined value; therefore, if the angle between the capturing direction of each image in the first image set and the horizontal plane is an elevation angle, the angle between the capturing direction of each image in the second image set and the horizontal plane is a depression angle.

As an example, the first image set may comprise a scene of an upper region of the target space due to the angle of elevation between the acquisition direction of each image in the first image set and the horizontal plane; and the angle between the acquisition direction of each image in the second image set and the horizontal plane is a depression angle, so that the second image set can comprise the scene of the lower region of the target space.

For easy understanding, as shown in fig. 5A-5B, fig. 5A-5B are schematic diagrams of image acquisition of a target space by using a portable terminal device with an image acquisition device, and it can be seen from fig. 5A that when an angle between an acquisition direction and a horizontal plane is an elevation angle, the scene of an upper region in the target space can be conveniently acquired; the area indicated by the dashed arrow 501 in fig. 5A can be understood as the acquisition area of the target space by the terminal device when the angle between the acquisition direction and the horizontal plane is in elevation. As shown in fig. 5B, when the angle between the collecting direction and the horizontal plane is a depression angle, it may be convenient to collect the scene of the middle and lower area of the target space, and the area indicated by the dotted arrow 502 in fig. 5B may be understood as the collecting area of the target space by the terminal device when the angle between the collecting direction and the horizontal plane is an elevation angle.

For facilitating understanding of the related art, as shown in fig. 5C, fig. 5C is a schematic diagram of image acquisition of a target space by using a terminal device in the related art; the region indicated by the dashed arrow 503 in fig. 5C can be understood as the acquisition region of the terminal device for the target space. Therefore, the regions such as the upper and lower boundaries in the target space are not acquired, so that the content contained in the three-dimensional image of the target space constructed by the acquired image set is less, and the quality of the constructed three-dimensional image of the target space is also low.

In some embodiments, the at least two predefined acquisition trajectories include a first predefined acquisition trajectory and a second predefined acquisition trajectory, the first predefined acquisition trajectory and the second predefined acquisition trajectory being mirror symmetric based on the XOY plane.

In some embodiments, the predefined acquisition trajectory of the terminal device in the target space may also be determined by: at least one construction identifier can be displayed, and a predefined acquisition trajectory of the terminal device in the target space can be determined based on the construction identifier trajectory correspondence table and the selected construction identifier in response to detecting a selection operation for the construction identifier.

Here, the build identification may be used to indicate the type of space.

Here, constructing the identification trajectory correspondence table includes constructing a correspondence between the identification and the acquisition trajectory.

By way of example, the types of spaces are numerous (e.g., elongated spaces, square spaces, cylinder-like spaces, cone-like spaces, etc.); the predefined acquisition trajectories corresponding to different spatial types may be different; for example, a rectangular space, a square space, may correspond to 2 predefined acquisition trajectories, while a cylinder-like space and a cone-like space may correspond to 3 predefined acquisition trajectories. For another example, the angle between the acquisition direction indicated by a certain predefined acquisition track of the square space and the horizontal plane is 30 degrees, and the angle between the acquisition direction indicated by a certain predefined acquisition track of the elongated space and the horizontal plane is 45 degrees.

Of course, in a specific embodiment, those construction identifiers may be specifically set to be defined according to an actual situation, and accordingly, what predefined acquisition tracks correspond to different spatial types are specifically provided, and may also be defined according to an actual situation.

As an example, the corresponding relationship between the construction identifier and the predefined acquisition track may be recorded by pre-establishing a construction identifier track correspondence table, so that the predefined acquisition track corresponding to the selected construction identifier may be determined relatively quickly, and thus the efficiency in the three-dimensional image construction process may be improved.

With further reference to fig. 6, as an implementation of the method shown in the above figures, the present disclosure provides an embodiment of an apparatus for constructing a three-dimensional image, which corresponds to the embodiment of the method for constructing a three-dimensional image shown in fig. 1, and which is particularly applicable to various electronic devices.

As shown in fig. 6, the three-dimensional image constructing apparatus of the present embodiment is applied to a portable terminal device with an image capturing apparatus, and includes: a first determining unit 601, configured to determine at least two predefined acquisition trajectories according to a current position of the portable terminal device in response to detecting a three-dimensional image construction instruction for a target space; a second determining unit 602, configured to determine, according to a preset number of images, acquisition points corresponding to each predefined acquisition trajectory; an acquiring unit 603, configured to acquire, for each predefined acquisition trajectory, at least one frame of image according to an acquisition point corresponding to the predefined acquisition trajectory, to obtain an image set corresponding to the predefined acquisition trajectory; a constructing unit 604, configured to construct a three-dimensional image of the target space based on image sets corresponding to at least two predefined acquisition trajectories, respectively.

In some embodiments, the first determining unit 601 is further specifically configured to: establishing a space three-dimensional coordinate system by taking the current position of the portable terminal equipment as a coordinate origin; wherein, the X0Y plane in the three-dimensional coordinate system is parallel to the horizontal plane; determining at least two groups of track points with predefined numbers in the three-dimensional coordinate system, wherein the numerical values of included angles formed between connecting lines between each track point and the coordinate origin in each group and the X0Y surface are the preset numerical values of included angles; and generating the at least two predefined acquisition tracks according to the determined track points.

In some embodiments, the above-mentioned acquisition unit 603 is specifically further configured to: and in response to detecting that the identification of an acquisition point is in the predefined area of the currently captured image, executing acquisition operation on the currently captured image to obtain an acquisition image corresponding to the acquisition point.

In some embodiments, the above-mentioned acquisition unit 603 is specifically further configured to: generating direction indication information in response to detecting that an identification of an acquisition point of a next image to be acquired is not displayed within a predefined area of a currently captured image; the direction prompt information is used for indicating the acquisition position and/or direction of the image acquisition device to be adjusted so that the identification of the acquisition point is displayed in the predefined area of the currently captured image.

In some embodiments, the above-mentioned acquisition unit 603 is specifically further configured to: according to the current shooting direction, determining a predefined acquisition track to be acquired corresponding to the current shooting direction, and displaying the predefined acquisition track; and displaying the acquisition points corresponding to the predefined acquisition track on the predefined acquisition track.

In some embodiments, the above-mentioned acquisition unit 603 is specifically further configured to: and displaying the identification of the acquisition point corresponding to the predefined acquisition track.

In some embodiments, the above-mentioned acquisition unit 603 is specifically further configured to: and adding a finishing identifier to the acquisition point which finishes image acquisition.

In some embodiments, one acquisition point corresponds to at least one acquired image.

In some embodiments, the at least one predetermined angle value comprises a first angle value and a second angle value, the sum of the first angle value and the second angle value being equal to the predetermined angle value; wherein, the preset angle value comprises: 180 degrees and 0 degrees.

In some embodiments, the apparatus for constructing a three-dimensional image may further include a third determining unit 605, configured to determine a predefined acquisition trajectory of the terminal device in the target space by: displaying at least one construction identifier, wherein the construction identifier is used for indicating a space type; and in response to the detection of the selection operation aiming at the construction identification, determining a predefined acquisition track of the terminal equipment in the target space based on a construction identification track corresponding table and the selected construction identification, wherein the construction identification track corresponding table comprises the corresponding relation between the construction identification and the acquisition track.

Referring to fig. 7, fig. 7 illustrates an exemplary system architecture to which a method of constructing a three-dimensional image according to an embodiment of the present disclosure may be applied.

As shown in fig. 7, the system architecture may include

terminal devices

701, 702, 703, a network 704, and a server 705. The network 704 may be the medium used to provide communications links between the

terminal devices

701, 702, 703 and the server 705. Network 704 may include various connection types, such as wired, wireless communication links, or fiber optic cables, to name a few.

The

terminal devices

701, 702, 703 may interact with a server 705 over a network 704 to receive or send messages or the like. The

terminal devices

701, 702, 703 may have various client applications installed thereon, such as a web browser application, a search-type application, and a news-information-type application. The client applications in the

terminal devices

701, 702, and 703 may receive the instruction of the user, and complete corresponding functions according to the instruction of the user, for example, add corresponding information to the information according to the instruction of the user.

The

terminal devices

701, 702, and 703 may be hardware or software. When the

terminal devices

701, 702, and 703 are hardware, they may be various electronic devices having a display screen and supporting web browsing, including but not limited to smart phones, tablet computers, e-book readers, MP3 players (Moving Picture Experts Group Audio Layer III, mpeg compression standard Audio Layer 3), MP4 players (Moving Picture Experts Group Audio Layer IV, mpeg compression standard Audio Layer 4), laptop portable computers, desktop computers, and the like. When the

terminal devices

701, 702, and 703 are software, they can be installed in the electronic devices listed above. It may be implemented as a plurality of software or software modules (e.g., software or software modules used to provide distributed services) or as a single software or software module. And is not particularly limited herein.

The server 705 may be a server providing various services, for example, receiving an information acquisition request sent by the

terminal devices

701, 702, and 703, and acquiring display information corresponding to the information acquisition request in various ways according to the information acquisition request. And the relevant data of the presentation information is sent to the

terminal devices

701, 702, 703.

It should be noted that the information processing method provided by the embodiment of the present disclosure may be executed by a terminal device, and accordingly, the three-dimensional image constructing apparatus may be disposed in the

terminal devices

701, 702, and 703. Furthermore, the information processing method provided by the embodiment of the present disclosure may also be executed by the server 705, and accordingly, an information processing apparatus may be provided in the server 705.

It should be understood that the number of terminal devices, networks, and servers in fig. 7 are merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for implementation.

Referring now to fig. 8, shown is a schematic diagram of an electronic device (e.g., a terminal device or a server of fig. 7) suitable for use in implementing embodiments of the present disclosure. The terminal device in the embodiments of the present disclosure may include, but is not limited to, a mobile terminal such as a mobile phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a vehicle terminal (e.g., a car navigation terminal), and the like, and a stationary terminal such as a digital TV, a desktop computer, and the like. The electronic device shown in fig. 8 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.

As shown in fig. 8, an electronic device may include a processing means (e.g., a central processing unit, a graphics processor, etc.) 801 that may perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM)802 or a program loaded from a storage means 808 into a Random Access Memory (RAM) 803. In the RAM803, various programs and data necessary for the operation of the electronic apparatus 800 are also stored. The processing device 801, the ROM802, and the RAM803 are connected to each other by a bus 804. An input/output (I/O) interface 805 is also connected to bus 804.

Generally, the following devices may be connected to the I/O interface 805: input devices 806 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 807 including, for example, a Liquid Crystal Display (LCD), speakers, vibrators, and the like; storage 808 including, for example, magnetic tape, hard disk, etc.; and a communication device 809. The communication means 809 may allow the electronic device to communicate wirelessly or by wire with other devices to exchange data. While fig. 8 illustrates an electronic device having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided.

In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program carried on a non-transitory computer readable medium, the computer program containing program code for performing the method illustrated by the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network through the communication means 809, or installed from the storage means 808, or installed from the ROM 802. The computer program, when executed by the processing apparatus 801, performs the above-described functions defined in the methods of the embodiments of the present disclosure.

It should be noted that the computer readable medium in the present disclosure can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer readable signal medium may comprise a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.

In some embodiments, the clients, servers may communicate using any currently known or future developed network Protocol, such as HTTP (HyperText Transfer Protocol), and may interconnect with any form or medium of digital data communication (e.g., a communications network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the Internet (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed network.

The computer readable medium may be embodied in the electronic device; or may exist separately without being assembled into the electronic device.

The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: in response to detecting a three-dimensional image construction instruction for a target space, determining at least two predefined acquisition tracks according to the current position of the portable terminal equipment; according to the number of preset images, determining acquisition points corresponding to the predefined acquisition tracks respectively; for each predefined acquisition track, acquiring at least one frame of image according to an acquisition point corresponding to the predefined acquisition track to obtain an image set corresponding to the predefined acquisition track; and constructing the three-dimensional image of the target space based on the image sets respectively corresponding to the at least two predefined acquisition tracks.

Computer program code for carrying out operations for the present disclosure may be written in any combination of one or more programming languages, including but not limited to an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The units described in the embodiments of the present disclosure may be implemented by software or hardware. Wherein the name of a unit does not in some cases constitute a definition of the unit itself, for example, the first determination unit may also be described as "unit for determining at least two predefined acquisition trajectories".

The functions described herein above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), system on a chip (SOCs), Complex Programmable Logic Devices (CPLDs), and the like.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

The foregoing description is only exemplary of the preferred embodiments of the disclosure and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the disclosure herein is not limited to the particular combination of features described above, but also encompasses other embodiments in which any combination of the features described above or their equivalents does not depart from the spirit of the disclosure. For example, the above features and the technical features disclosed in the present disclosure (but not limited to) having similar functions are replaced with each other to form the technical solution.

Further, while operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limitations on the scope of the disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.

Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.

Claims

1. A method for constructing a three-dimensional image, which is applied to a portable terminal device with an image acquisition device, the method comprising:

in response to detecting a three-dimensional image construction instruction for a target space, determining at least two predefined acquisition trajectories according to the current position of the portable terminal device;

according to the number of preset images, determining acquisition points corresponding to the predefined acquisition tracks respectively;

for each predefined acquisition track, acquiring at least one frame of image according to an acquisition point corresponding to the predefined acquisition track to obtain an image set corresponding to the predefined acquisition track;

and constructing a three-dimensional image of the target space based on the image sets respectively corresponding to the at least two predefined acquisition tracks.

2. The method according to claim 1, wherein said determining at least two predefined acquisition trajectories according to the current position of the portable terminal device comprises:

establishing a spatial three-dimensional coordinate system by taking the current position of the portable terminal equipment as a coordinate origin; wherein, the X0Y plane in the three-dimensional coordinate system is parallel to the horizontal plane;

determining at least two groups of track points with predefined numbers in the three-dimensional coordinate system; wherein, the numerical value of an included angle formed between a connecting line between each track point in each group of predefined track points and the coordinate origin and the X0Y surface is the preset included angle;

and generating the at least two predefined acquisition tracks according to the determined track points.

3. The method of claim 1, wherein for each predefined acquisition trajectory, acquiring at least one image frame according to the acquisition point corresponding to the predefined acquisition trajectory to obtain an image set corresponding to the predefined acquisition trajectory comprises:

and in response to detecting that the identification of an acquisition point is in the predefined area of the currently captured image, executing acquisition operation on the currently captured image to obtain an acquisition image corresponding to the acquisition point.

4. The method of claim 1, wherein for each predefined acquisition trajectory, acquiring at least one image frame according to the acquisition point corresponding to the predefined acquisition trajectory to obtain an image set corresponding to the predefined acquisition trajectory comprises:

generating direction indication information in response to detecting that an identification of an acquisition point of a next image to be acquired is not displayed within a predefined area of a currently captured image; wherein the direction prompt information is used for instructing to adjust the acquisition position and/or direction of the image acquisition device so as to display the identification of the acquisition point in the predefined area of the currently captured image.

5. The method of claim 1, wherein for each predefined acquisition trajectory, acquiring at least one image frame according to the acquisition point corresponding to the predefined acquisition trajectory to obtain an image set corresponding to the predefined acquisition trajectory comprises:

and displaying the identification of the acquisition point corresponding to the predefined acquisition track.

6. The method of claim 5, further comprising:

and adding a finishing identifier to the acquisition point which finishes image acquisition.

7. The method of claim 5, wherein one acquisition point corresponds to at least one acquired image.

8. The method of claim 1, wherein the distance between any two adjacent acquisition points on the predefined acquisition trajectory is the same.

9. The method according to claim 1, characterized in that the predefined acquisition trajectory of the terminal device in the target space is determined by:

displaying at least one construction identifier, wherein the construction identifier is used for indicating a space type;

and in response to the detection of the selection operation aiming at the construction identification, determining a predefined acquisition track of the terminal equipment in the target space based on a construction identification track corresponding table and the selected construction identification, wherein the construction identification track corresponding table comprises the corresponding relation between the construction identification and the acquisition track.

10. A three-dimensional image constructing apparatus applied to a portable terminal device with an image capturing device, comprising:

a first determination unit, configured to determine, in response to detecting a three-dimensional image construction instruction for a target space, at least two predefined acquisition trajectories according to a current position of the portable terminal device;

the second determining unit is used for determining acquisition points corresponding to the predefined acquisition tracks according to the preset number of the images;

the acquisition unit is used for acquiring at least one frame of image according to the acquisition point corresponding to each predefined acquisition track to obtain an image set corresponding to the predefined acquisition track;

and the construction unit is used for constructing the three-dimensional image of the target space based on the image sets respectively corresponding to the at least two predefined acquisition tracks.

11. An electronic device, comprising:

one or more processors;

a storage device for storing one or more programs,

when executed by the one or more processors, cause the one or more processors to implement the method of any one of claims 1-9.

12. A computer-readable medium, on which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 1-9.