CN111784826A - Method and system for generating three-dimensional structure schematic diagram based on panoramic image - Google Patents

Method and system for generating three-dimensional structure schematic diagram based on panoramic image Download PDF

Info

Publication number
CN111784826A
CN111784826A CN202010677193.XA CN202010677193A CN111784826A CN 111784826 A CN111784826 A CN 111784826A CN 202010677193 A CN202010677193 A CN 202010677193A CN 111784826 A CN111784826 A CN 111784826A
Authority
CN
China
Prior art keywords
target object
coordinate system
panoramic image
spherical camera
positioning
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010677193.XA
Other languages
Chinese (zh)
Inventor
尹元昌
黄凯文
郭培程
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Mobile Internet Research Institute Co ltd
Original Assignee
Shenzhen Mobile Internet Research Institute Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Mobile Internet Research Institute Co ltd filed Critical Shenzhen Mobile Internet Research Institute Co ltd
Priority to CN202010677193.XA priority Critical patent/CN111784826A/en
Publication of CN111784826A publication Critical patent/CN111784826A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/90Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Software Systems (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Length Measuring Devices By Optical Means (AREA)

Abstract

The invention provides a method and a system for generating a three-dimensional structure schematic diagram based on a panoramic image, which relate to the technical application field of panoramic images and comprise the following steps: s1, shooting a panoramic image of the target scene through the camera equipment and displaying the panoramic image on the operation interface; s2, picking up at least four positioning points of the target object on the operation interface; s3, calculating and acquiring the coordinate position of the positioning point in the space rectangular coordinate system by establishing the space rectangular coordinate system; s4, displaying the position relation of the positioning point coordinates in the space rectangular coordinate system on the display interface; and S5, connecting the positioning points of the target object on the display interface to form a three-dimensional structure schematic diagram. The method and the system for generating the three-dimensional structure schematic diagram based on the panoramic image, which are provided by the invention, utilize the panoramic image to generate the on-site stereodiagram which meets the regulation, are accurate and reliable, and reduce the burden of experimenters.

Description

Method and system for generating three-dimensional structure schematic diagram based on panoramic image
Technical Field
The invention relates to the technical field of panoramic images, in particular to a method and a system for generating a three-dimensional structure schematic diagram based on a panoramic image.
Background
According to the forty-sixth regulation of public security organ criminal case site investigation and inspection rules: on-site survey and inspection personnel should make an on-site azimuth map and an on-site plane schematic diagram, and select and make an on-site plane scale map, an on-site plane expansion map, an on-site perspective map, an on-site section map and the like according to on-site conditions.
When the current field investigation personnel and the inspection personnel go out of the field, the site direction situation is firstly visually observed, a standard schematic sketch is firstly manually drawn by combining with the real-time distance measurement of the field, then after the current field investigation scene leaves, the software such as professional AutoCAD (auto computer aided design) is utilized to make a standard field stereogram and the like, the process is complicated, the professional requirement is high, and the pain point becomes a normal nightmare of the present investigation personnel for more than 20 years.
Because panoramic image data has reliability and difficult tamper property, the panoramic image data is widely applied to site investigation scenes of law enforcement departments such as public security, and how to generate site stereograms by using the existing panoramic images and reduce the burden of experimenters becomes a problem to be solved urgently
Disclosure of Invention
Therefore, the technical problem to be solved by the present invention is to overcome the deficiencies of the prior art, and to provide a method and a system for generating a three-dimensional structure diagram based on a panoramic image, which generate a site stereogram meeting the regulations by using the panoramic image, are accurate and reliable, and reduce the burden of experimenters.
In order to achieve the above object, the present invention provides a method and a system for generating a three-dimensional structure diagram based on a panoramic image, comprising:
s1, shooting a panoramic image of the target scene through the camera equipment and displaying the panoramic image on the operation interface;
s2, picking up at least four positioning points of the target object on the operation interface;
s3, calculating and acquiring the coordinate position of the positioning point in the space rectangular coordinate system by establishing the space rectangular coordinate system;
s4, displaying the position relation of the positioning point coordinates in the space rectangular coordinate system on the display interface;
and S5, connecting the positioning points of the target object on the display interface to form a three-dimensional structure schematic diagram.
Furthermore, the picking number of the positioning points is determined according to the vertex number of the target object and the drawing accuracy.
Further, in step S2, the number of anchor points to be picked up in advance is input to the operation interface, and a three-dimensional graph in which the number of vertices is the input number of anchor points is generated on the operation interface, and then each vertex of the three-dimensional graph is dragged onto a vertex of the target object to pick up an anchor point of the target object.
Further, the image pickup apparatus includes a first dome camera, a second dome camera, and a third dome camera, the three dome cameras are not on the same line, and the target object is on at least overlapping pictures of two of the dome cameras.
Further, in step S3, the method for calculating the positioning points in the spatial rectangular coordinate system is as follows:
s31, establishing a three-dimensional coordinate system XYZ by taking any point in space as a coordinate origin O (0,0,0), and obtaining a sphere center coordinate D of the first spherical camera through field measurement1(a1,b1,c1) Center of sphere coordinate D of second spherical camera2(a2,b2,c2) Setting a site P1Has the coordinate of P1(x,y,z);
S32, determination of D1P1Obtaining a symmetrical equation (1) of the straight line from one direction vector of the straight line;
s33, determination of D2P1Obtaining a symmetrical equation (2) of the straight line from one direction vector of the straight line;
s34, simultaneous equation (1) and equation (2), solving to obtain (x, y, z), which is the positioning point P1Coordinates in a three-dimensional coordinate system XYZ.
Further, in step S32, D is determined1P1One of the direction vectors of the straight line comprises the following steps:
s321, establishing a three-dimensional coordinate system X by taking the sphere center of the first spherical camera as a coordinate origin1Y1Z1
S322, with Z1The shaft is a rotating shaft and rotates Y1D1Z1In the plane ofTo it passes through the anchor point P1The required angle of rotation of (x, y, z) is α1With X1The shaft is a rotating shaft and rotates X1D1Y1The plane is located to the positioning point P where the plane passes1The required rotation angle is β1
S323, obtaining D1P1One of the direction vectors of the straight line is
(cosβ1×sinα1,-sinβ1,cosβ1×cosα1)。
Further, in step S33, D is determined2P1One of the direction vectors of the straight line comprises the following steps:
s331, establishing a three-dimensional coordinate system X by taking the sphere center of the second spherical camera as a coordinate origin2Y2Z2
S332, with Z2The shaft is a rotating shaft and rotates Y2D2Z2The plane is located to the positioning point P where the plane passes1The required rotation angle is α2With X2The shaft is a rotating shaft and rotates X2D2Y2The plane is located to the positioning point P where the plane passes1The required rotation angle is β2
S333, obtaining D2P1One of the direction vectors of the straight line is
(cosβ2×sinα2,-sinβ2,cosβ2×cosα2)。
Further, when the site P is located1When the positioning point P is positioned on the straight line of the connecting line of the centers of the sphere of the first spherical camera and the second spherical camera, the positioning point P is calculated by utilizing the combination of the first spherical camera and the third spherical camera or the combination of the second spherical camera and the third spherical camera1The coordinates of (a).
Further, step S6 is included, in which legend information related to the target object is input and saved in the display interface, where the legend information includes, but is not limited to, feature description, time description, address description, relationship description, and case information description.
The invention also provides a system for generating a three-dimensional structure schematic diagram based on the panoramic image, which comprises the following steps:
an acquisition unit configured to acquire a panoramic image of a target scene photographed by an image pickup apparatus and to display the panoramic image on an operation interface;
the picking unit is used for picking at least four positioning points of the target object on the operation interface;
the computing unit is used for computing and obtaining the coordinates of the positioning points picked up by the picking unit by establishing a space rectangular coordinate system;
the display unit is used for displaying the position relation of the positioning point coordinates obtained by calculation of the calculation unit in the space rectangular coordinate system;
the drawing unit is used for connecting positioning points of the target object in the display unit to form a three-dimensional structure schematic diagram;
and the recording unit is used for inputting and saving the legend information related to the target object in the display interface, wherein the legend information comprises but is not limited to feature description, time description, address description, relation description and case information description.
According to the method and the system for generating the three-dimensional structure schematic diagram based on the panoramic image, the drawn plane schematic diagram meets the drawing regulation of the forty-sixth site stereodiagram of the 'public security organ criminal case site investigation and inspection rule', the site stereodiagram can be quickly drawn from the panoramic image, and the burden of experimenters is reduced. And legend information can be added, so that the recording of the field condition and the consulting of the recording are facilitated.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following further describes the invention in detail according to the embodiments of the present invention with reference to the accompanying drawings.
FIG. 1 is a schematic diagram of a dome camera according to the present invention;
FIG. 2 is a perspective sectional view of a dome camera in accordance with the present invention;
FIG. 3 is a schematic diagram of a three-dimensional coordinate system of the present invention;
FIG. 4 is a flow chart of a method of the present invention;
fig. 5 is a schematic diagram of the system of the present invention.
The reference numerals in the drawings are explained below.
1. A sphere; 2. a lens group; 3. an image sensor; 4. a data processing unit; 5. a storage unit; 6. a power supply module; 100. an acquisition unit; 200. a pickup unit; 300. a calculation unit; 400. a display unit; 500. a drawing unit; 600. and a recording unit.
Detailed Description
The technical solutions of the present invention will be described clearly and completely with reference to the accompanying drawings, and it should be understood that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In the description of the present invention, it should be noted that the terms "front", "upper", "lower", "left", "right", "vertical", "horizontal", and the like indicate orientations or positional relationships based on those shown in the drawings, and are only for convenience of description and simplification of description, but do not indicate or imply that the referred device or element must have a specific orientation, be configured in a specific orientation, and operate, and thus, should not be construed as limiting the present invention.
In the description of the present invention, it should be noted that, unless otherwise explicitly specified or limited, the terms "mounted," "connected," and "connected" are to be construed broadly, e.g., as meaning either a fixed connection, a removable connection, or an integral connection; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood in specific cases to those skilled in the art.
As shown in fig. 1 to 5, a method for generating a three-dimensional structure diagram based on a panoramic image includes:
and S1, shooting a panoramic image of the target scene through the camera equipment and displaying the panoramic image on the operation interface. The camera equipment is a spherical camera specially used for shooting panoramic images, and at least two spherical cameras are needed during shooting. And placing the camera equipment at a position close to the middle of the target scene, and shooting an image of an omnibearing visible object taking the camera equipment as the center in the target scene. And then displaying the shot panoramic image on an operation interface, wherein the operation interface refers to a display screen with stronger data processing capacity, such as a notebook computer or a desktop computer.
And S2, picking up at least four positioning points of the target object on the operation interface. The pick-up of the positioning point can be selected by a mouse or a touch screen.
And S3, calculating and acquiring the coordinate position of the positioning point in the space rectangular coordinate system by establishing the space rectangular coordinate system. The origin of this rectangular spatial coordinate system may be any point in space.
And S4, displaying the position relation of the positioning point coordinates in the space rectangular coordinate system on the display interface. After the positioning point of the target object is picked up in the operation interface, the position of the picked positioning point in the space rectangular coordinate system is displayed on the display interface through the calculation of the system. At the beginning, the target object should be the edge of the target scene, and then the object in the target scene, so that the relationship between the target scene and the target object on the corresponding display interface is convenient to observe.
And S5, connecting the positioning points of the target object on the display interface to form a three-dimensional structure schematic diagram. The two positioning points are connected to form a line segment, the line segments surround a surface, and the three-dimensional structure schematic diagram is formed by the multiple surfaces.
In this embodiment, the number of picked positioning points of different objects is different, and the number of picked positioning points is determined by the number of vertices of a target object and the accuracy of drawing. Under the same target object, the higher the drawing accuracy requirement is, the more the number of positioning points which should be picked up by the target object is, for example, the target object is a desk with supporting legs, if the accuracy requirement is not high, only eight vertexes of a desk top plate of the desk can be picked up, and the drawn three-dimensional structure schematic diagram is a rectangle. If the requirement on the drawing accuracy is high, positioning points of the supporting legs are increased, and the shape of the drawn three-dimensional structure schematic diagram is closer to the shape of a real desk. In the case of consistent accuracy requirements, the fewer vertices of the target object, the fewer anchor points that should be picked up, for example, a pyramid with a triangular bottom surface should pick up fewer anchor points than a cube.
In step S2, the operation steps are as follows: the number of positioning points which should be picked up by the target object is determined according to the number of the vertexes of the target object and the drawing accuracy, then the system generates a three-dimensional graph with the number of the vertexes as the number of the input positioning points on an operation interface, and then each vertex of the three-dimensional graph is dragged to the vertex of the target object through manual operation. When the three-dimensional graph is displayed on the operation interface, the position of the three-dimensional graph in the space rectangular coordinate system is correspondingly displayed in the display interface. When one vertex is dragged, the vertex position of the three-dimensional graph in the display interface changes.
The camera device comprises a first spherical camera, a second spherical camera and a third spherical camera, wherein the three spherical cameras are not on the same straight line, and the target object is at least on the overlapped pictures of two spherical cameras.
The spherical camera includes a sphere 1, and at least three lens groups 2, preferably thirty-six or seventy-two lens groups 2, are mounted on the surface of the sphere 1.
The lens groups 2 are equidistantly and uniformly distributed on the surface of the sphere 1, each lens group 2 has a real focus and an imaging surface, the real focus of each lens group 2 is collected at the center of the sphere 1, and the lens group 2 is used for collecting scenes in the area where the lens group is responsible for and shooting to form images.
The image sensors 3 with the same number as the lens groups 2 are arranged inside the sphere 1 and are in one-to-one correspondence with the lens groups 2, and the image sensors 3 are located at the imaging surfaces of the corresponding lens groups 2 and are used for receiving optical signals of the lens groups 2 and converting the optical signals into electrical signals.
A data processing unit 4, a storage module and a power supply module 6 are also arranged in the sphere 1.
The data processing unit 4 is electrically connected with all the image sensors 3, receives the electric signals transmitted by part or all the image sensors 3, and can control all the lens groups 2 to collect scene image sets in the responsible regions at the same time.
And the storage module is electrically connected with the data processing unit 4 and receives and stores the scene image set output by the data processing unit 4.
And the power module 6 is connected with the lens group 2, the data processing unit 4 and the storage module and is used for supplying power to the lens group 2, the data processing unit 4 and the storage module.
All the spherical cameras shoot the target point at the same time, the shooting time interval of each spherical camera is not more than 100 milliseconds, so that the time uniformity of the panoramic three-dimensional scene formed by all the spherical cameras is improved, and the positioning error caused by the change of multiple factors such as light, object position and the like caused by shooting time error is avoided.
In step S3, the specific method for calculating the positioning points in the spatial rectangular coordinate system is as follows:
and establishing a space coordinate system by taking any point in the space as an origin. In this embodiment, a spatial coordinate system is established with the center point of a triangle surrounded by three spherical cameras as an origin. The method comprises the following specific steps:
s31, establishing a three-dimensional coordinate system XYZ by taking the center point of a triangle surrounded by the three spherical cameras as a coordinate origin O (0,0,0), and obtaining the spherical center coordinate D of the first spherical camera through field measurement1(a1,b1,c1) Center of sphere coordinate D of second spherical camera2(a2,b2,c2) And setting a site P1Has the coordinate of P1(x,y,z)。
S32, determination of D1P1One direction vector of the straight line is obtained, and the symmetrical equation (1) of the straight line is obtained through the direction vector, and the method specifically comprises the following steps:
s321, using the first ballEstablishing three-dimensional coordinate system X by taking spherical center of shape camera as coordinate origin1Y1Z1
S322, with Z1The shaft is a rotating shaft and rotates Y1D1Z1The plane to which the target point P passes1The required angle of rotation of (x, y, z) is α1With X1The shaft is a rotating shaft and rotates X1D1Y1The plane to which the target point P passes1The required rotation angle is β1
S323, obtaining D1P1One of the direction vectors of the straight line is
(cosβ1×sinα1,-sinβ1,cosβ1×cosα1);
And, D1P1The equation of symmetry of the straight line is expressed as:
Figure BDA0002584483630000091
s33, determination of D2P1One direction vector of the straight line is obtained, and a symmetrical equation (2) of the straight line is obtained through the direction vector, and the method specifically comprises the following steps:
s331, establishing a three-dimensional coordinate system X by taking the sphere center of the second spherical camera as a coordinate origin2Y2Z2
S332, with Z2The shaft is a rotating shaft and rotates Y2D2Z2The plane to which the target point P passes1The required rotation angle is α2With X2The shaft is a rotating shaft and rotates X2D2Y2The plane to which the target point P passes1The required rotation angle is β2
S333, obtaining D2P1One of the direction vectors of the straight line is
(cosβ2×sinα2,-sinβ2,cosβ2×cosα2);
And, D2P1The equation of symmetry of the straight line is expressed as:
Figure BDA0002584483630000101
s34, simultaneous equation (1) and equation (2), and solving to obtain (x, y, z), namely the target point P1Coordinates in a three-dimensional coordinate system XYZ.
In the above, X1Axis, X2The axis being parallel to the X-axis, Y1Axis, Y2The axis being parallel to the Y axis, Z1Axis, Z2The axis is parallel to the Z axis.
Similarly, the above-described positioning method cannot position the target point located on the connecting line of the first dome camera and the second dome camera.
For this reason, in the present positioning method, the imaging apparatus is set as three dome cameras, a first dome camera, a second dome camera, and a third dome camera, respectively, and the panoramic three-dimensional imaging system at this time can position the coordinates of any target point in space.
Following to simultaneously require several target points P to the space1、P2、P3The positioning is performed to illustrate how to realize the positioning work of any target point in the space, wherein, P1On the line connecting the centers of the first and second dome cameras, P2On the line connecting the centers of the first and third spherical cameras, P3Is positioned on the straight line connecting the sphere centers of the second spherical camera and the third spherical camera.
Using the combination of the first spherical camera and the third spherical camera or the combination of the second spherical camera and the third spherical camera, and using the positioning method, the target point P can be positioned1The coordinates of (a).
Using the combination of the first spherical camera and the second spherical camera or the combination of the first spherical camera and the third spherical camera, and using the positioning method, the target point P can be positioned2The coordinates of (a).
By using a firstThe combination of the spherical camera and the second spherical camera or the combination of the second spherical camera and the third spherical camera is utilized, and the positioning method is utilized to position the target point P3The coordinates of (a).
Therefore, the problem that when only two spherical cameras are arranged, when the target point is positioned on the spherical center connecting line of the two spherical cameras, the target point cannot be positioned is solved.
The method for generating a three-dimensional structure diagram based on a panoramic image further includes step S6, and after positioning of the target object is completed, the three-dimensional structure diagram corresponding to the target object is displayed in the display interface. And legend information related to the target object can be input in the display interface and then stored, wherein the legend information includes but is not limited to feature description, time description, address description, relationship description, case information description and any other information capable of describing a case or a target area, and the legend form is not limited to text, and can be sound, graphics, symbols or video. So that others can learn and deduce the case in the following and the field personnel can completely record the relevant information of the target object in an iterative mode.
In the panoramic image, coordinate data of positioning points which are enclosed into a target object are calculated, and the coordinates of the camera equipment are measured on the spot, so that the ratio of the side length of the final three-dimensional structure schematic diagram to the side length of the actual object is determined, namely the three-dimensional structure schematic diagram is reduced in real object equal proportion, and the size of the real object can be roughly calculated through the three-dimensional structure schematic diagram. Therefore, the plane sketch map drawn by the drawing method meets the site stereogram drawing regulation of forty-sixth article of public security organ criminal case site investigation and inspection rules, the site stereogram can be quickly drawn from the panoramic image, and the burden of the experimenter is reduced. And legend information can be added, so that the recording of the field condition and the consulting of the recording are facilitated.
The present implementation further provides a system for generating a three-dimensional structure diagram based on a panoramic image, including:
an acquisition unit 100 configured to acquire a panoramic image of a target scene photographed by an image pickup apparatus and to display the panoramic image on an operation interface;
the pick-up unit 200 is used for picking up at least four positioning points of the target object on the operation interface;
the calculating unit 300 is used for calculating and obtaining the coordinates of the positioning points picked up by the picking unit by establishing a space rectangular coordinate system;
the display unit 400 is used for displaying the position relation of the positioning point coordinates obtained by calculation of the calculation unit in the space rectangular coordinate system;
a drawing unit 500 for connecting the positioning points of the target object in the display unit to form a three-dimensional structure diagram;
the recording unit 600 is configured to input and store legend information related to the target object in the display interface, where the legend information includes, but is not limited to, feature description, time description, address description, relationship description, and case information description.
It should be understood that the above examples are only for clarity of illustration and are not intended to limit the embodiments. Other variations and modifications will be apparent to persons skilled in the art in light of the above description. And are neither required nor exhaustive of all embodiments. And obvious variations or modifications therefrom are within the scope of the invention.

Claims (10)

1. A method for generating a three-dimensional structure schematic diagram based on a panoramic image is characterized by comprising the following steps:
s1, shooting a panoramic image of the target scene through the camera equipment and displaying the panoramic image on the operation interface;
s2, picking up at least four positioning points of the target object on the operation interface;
s3, calculating and acquiring the coordinate position of the positioning point in the space rectangular coordinate system by establishing the space rectangular coordinate system;
s4, displaying the position relation of the positioning point coordinates in the space rectangular coordinate system on the display interface;
and S5, connecting the positioning points of the target object on the display interface to form a three-dimensional structure schematic diagram.
2. The method as claimed in claim 1, wherein the number of the picked anchor points is determined according to the number of vertices of the target object and the drawing accuracy.
3. The method of claim 2, wherein in step S2, the number of anchor points to be picked up is input to the operation interface, a three-dimensional graph with the number of vertices as the number of input anchor points is generated on the operation interface, and then the vertices of the three-dimensional graph are dragged to the vertices of the target object to pick up the anchor points of the target object.
4. The method of claim 1, wherein the camera device comprises a first spherical camera, a second spherical camera and a third spherical camera, the three spherical cameras are not in the same line, and the target object is at least on the overlapped pictures of two spherical cameras.
5. The method of claim 4, wherein in step S3, the method for calculating the anchor point in the rectangular spatial coordinate system is as follows:
s31, establishing a three-dimensional coordinate system XYZ by taking any point in space as a coordinate origin O (0,0,0), and obtaining a sphere center coordinate D of the first spherical camera through field measurement1(a1,b1,c1) Center of sphere coordinate D of second spherical camera2(a2,b2,c2) Setting a site P1Has the coordinate of P1(x,y,z);
S32, determination of D1P1One direction vector of the straight line is obtained, and the symmetrical form of the straight line is obtained from the direction vectorEquation (1);
s33, determination of D2P1Obtaining a symmetrical equation (2) of the straight line from one direction vector of the straight line;
s34, simultaneous equation (1) and equation (2), solving to obtain (x, y, z), which is the positioning point P1Coordinates in a three-dimensional coordinate system XYZ.
6. The method of claim 5, wherein in step S32, D is determined1P1One of the direction vectors of the straight line comprises the following steps:
s321, establishing a three-dimensional coordinate system X by taking the sphere center of the first spherical camera as a coordinate origin1Y1Z1
S322, with Z1The shaft is a rotating shaft and rotates Y1D1Z1The plane is located to the positioning point P where the plane passes1The required angle of rotation of (x, y, z) is α1With X1The shaft is a rotating shaft and rotates X1D1Y1The plane is located to the positioning point P where the plane passes1The required rotation angle is β1
S323, obtaining D1P1One of the direction vectors of the straight line is
(cosβ1×sinα1,-sinβ1,cosβ1×cosα1)。
7. The method of claim 5, wherein in step S33, D is determined2P1One of the direction vectors of the straight line comprises the following steps:
s331, establishing a three-dimensional coordinate system X by taking the sphere center of the second spherical camera as a coordinate origin2Y2Z2
S332, with Z2The shaft is a rotating shaft and rotates Y2D2Z2The plane is located to the positioning point P where the plane passes1Required rotationThe moving angle is α2With X2The shaft is a rotating shaft and rotates X2D2Y2The plane is located to the positioning point P where the plane passes1The required rotation angle is β2
S333, obtaining D2P1One of the direction vectors of the straight line is
(cosβ2×sinα2,-sinβ2,cosβ2×cosα2)。
8. The method of claim 5, wherein the P is the location point1When the positioning point P is positioned on the straight line of the connecting line of the centers of the sphere of the first spherical camera and the second spherical camera, the positioning point P is calculated by utilizing the combination of the first spherical camera and the third spherical camera or the combination of the second spherical camera and the third spherical camera1The coordinates of (a).
9. The method for generating a three-dimensional structure diagram based on the panoramic image as claimed in claim 1, further comprising step S6, inputting and saving the legend information related to the target object in the display interface, wherein the legend information includes but is not limited to feature description, time description, address description, relationship description, and case information description.
10. A system for generating a three-dimensional structure diagram based on a panoramic image, comprising:
an acquisition unit configured to acquire a panoramic image of a target scene photographed by an image pickup apparatus and to display the panoramic image on an operation interface;
the picking unit is used for picking at least four positioning points of the target object on the operation interface;
the computing unit is used for computing and obtaining the coordinates of the positioning points picked up by the picking unit by establishing a space rectangular coordinate system;
the display unit is used for displaying the position relation of the positioning point coordinates obtained by calculation of the calculation unit in the space rectangular coordinate system;
the drawing unit is used for connecting positioning points of the target object in the display unit to form a three-dimensional structure schematic diagram;
and the recording unit is used for inputting and saving the legend information related to the target object in the display interface, wherein the legend information comprises but is not limited to feature description, time description, address description, relation description and case information description.
CN202010677193.XA 2020-07-14 2020-07-14 Method and system for generating three-dimensional structure schematic diagram based on panoramic image Pending CN111784826A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010677193.XA CN111784826A (en) 2020-07-14 2020-07-14 Method and system for generating three-dimensional structure schematic diagram based on panoramic image

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010677193.XA CN111784826A (en) 2020-07-14 2020-07-14 Method and system for generating three-dimensional structure schematic diagram based on panoramic image

Publications (1)

Publication Number Publication Date
CN111784826A true CN111784826A (en) 2020-10-16

Family

ID=72768606

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010677193.XA Pending CN111784826A (en) 2020-07-14 2020-07-14 Method and system for generating three-dimensional structure schematic diagram based on panoramic image

Country Status (1)

Country Link
CN (1) CN111784826A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112235558A (en) * 2020-11-17 2021-01-15 深圳移动互联研究院有限公司 Panoramic image-based generation system and panoramic image-based generation method for field elevation

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6064399A (en) * 1998-04-03 2000-05-16 Mgi Software Corporation Method and system for panel alignment in panoramas
KR101169590B1 (en) * 2011-03-07 2012-08-02 숙명여자대학교산학협력단 Method for reconstructuring three-dimensional panorama space with user's sketch in mobil communication terminal
CN104268939A (en) * 2014-09-28 2015-01-07 国家电网公司 Transformer substation virtual-reality management system based on three-dimensional panoramic view and implementation method of transformer substation virtual-reality management system based on three-dimensional panoramic view
CN105704430A (en) * 2014-10-21 2016-06-22 群晖科技股份有限公司 Method and apparatus for managing a monitoring system
CN106441242A (en) * 2016-08-27 2017-02-22 青岛秀山移动测量有限公司 Interactive plotting method based on laser-point cloud and panorama image
CN110782524A (en) * 2019-10-25 2020-02-11 重庆邮电大学 Indoor three-dimensional reconstruction method based on panoramic image
CN111223177A (en) * 2019-12-18 2020-06-02 北京城市网邻信息技术有限公司 Method and device for constructing three-dimensional model of three-dimensional space and storage medium
CN111263134A (en) * 2020-03-07 2020-06-09 深圳移动互联研究院有限公司 Positionable panoramic three-dimensional imaging system and positioning method

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6064399A (en) * 1998-04-03 2000-05-16 Mgi Software Corporation Method and system for panel alignment in panoramas
KR101169590B1 (en) * 2011-03-07 2012-08-02 숙명여자대학교산학협력단 Method for reconstructuring three-dimensional panorama space with user's sketch in mobil communication terminal
CN104268939A (en) * 2014-09-28 2015-01-07 国家电网公司 Transformer substation virtual-reality management system based on three-dimensional panoramic view and implementation method of transformer substation virtual-reality management system based on three-dimensional panoramic view
CN105704430A (en) * 2014-10-21 2016-06-22 群晖科技股份有限公司 Method and apparatus for managing a monitoring system
CN106441242A (en) * 2016-08-27 2017-02-22 青岛秀山移动测量有限公司 Interactive plotting method based on laser-point cloud and panorama image
CN110782524A (en) * 2019-10-25 2020-02-11 重庆邮电大学 Indoor three-dimensional reconstruction method based on panoramic image
CN111223177A (en) * 2019-12-18 2020-06-02 北京城市网邻信息技术有限公司 Method and device for constructing three-dimensional model of three-dimensional space and storage medium
CN111263134A (en) * 2020-03-07 2020-06-09 深圳移动互联研究院有限公司 Positionable panoramic three-dimensional imaging system and positioning method

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112235558A (en) * 2020-11-17 2021-01-15 深圳移动互联研究院有限公司 Panoramic image-based generation system and panoramic image-based generation method for field elevation
CN112235558B (en) * 2020-11-17 2024-04-09 深圳市人机共识科技有限公司 Panoramic image-based field elevation map generation system and generation method

Similar Documents

Publication Publication Date Title
US11748906B2 (en) Gaze point calculation method, apparatus and device
US9972120B2 (en) Systems and methods for geometrically mapping two-dimensional images to three-dimensional surfaces
JP4532982B2 (en) Arrangement information estimation method and information processing apparatus
JP5093053B2 (en) Electronic camera
CN107507274A (en) A kind of quick restoring method of public security criminal-scene three-dimensional live based on cloud computing
JP2000516360A (en) Three-dimensional object modeling apparatus and method
CN107578450B (en) Method and system for calibrating assembly error of panoramic camera
KR101759798B1 (en) Method, device and system for generating an indoor two dimensional plan view image
CN109523635B (en) Three-dimensional human body scanning non-rigid reconstruction and measurement method and device
CN111263134A (en) Positionable panoramic three-dimensional imaging system and positioning method
CN109788270B (en) 3D-360-degree panoramic image generation method and device
TWI501193B (en) Computer graphics using AR technology. Image processing systems and methods
CN110675482B (en) Spherical fibonacci pixel lattice panoramic picture rendering and displaying method of virtual three-dimensional scene
WO2022025283A1 (en) Measurement processing device, method, and program
CN111784826A (en) Method and system for generating three-dimensional structure schematic diagram based on panoramic image
CN111649716A (en) Space point-to-point distance measuring and calculating method based on panoramic image
CN111735414A (en) Area metering system and metering method based on panoramic three-dimensional imaging
CN113225480A (en) Image acquisition method, image acquisition device, electronic equipment and medium
EP3882846B1 (en) Method and device for collecting images of a scene for generating virtual reality data
CN211047088U (en) Positionable panoramic three-dimensional imaging system
CN112785678A (en) Sunshine analysis method and system based on three-dimensional simulation
CN107274449B (en) Space positioning system and method for object by optical photo
JP6073121B2 (en) 3D display device and 3D display system
CN111866488A (en) Editing system and editing method based on panoramic image
CN111833241A (en) Method for generating plane schematic diagram based on panoramic image

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information
CB02 Change of applicant information

Address after: 518000 Room 403, building 4, Shenzhen software industry base, No. 19, 17 and 18, Haitian 1st Road, Binhai community, Yuehai street, Nanshan District, Shenzhen, Guangdong

Applicant after: Shenzhen man machine consensus Technology Co.,Ltd.

Address before: 30A, building 5, building 1-5, Huating, modern city, No. 17, Nanguang Road, Nanshan street, Nanshan District, Shenzhen City, Guangdong Province

Applicant before: Shenzhen Mobile Internet Research Institute Co.,Ltd.