CN110958395A - VR panorama synthesis method and device - Google Patents
VR panorama synthesis method and device Download PDFInfo
- Publication number
- CN110958395A CN110958395A CN201911311445.0A CN201911311445A CN110958395A CN 110958395 A CN110958395 A CN 110958395A CN 201911311445 A CN201911311445 A CN 201911311445A CN 110958395 A CN110958395 A CN 110958395A
- Authority
- CN
- China
- Prior art keywords
- panorama
- pictures
- synthesizing
- rotation
- picture
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/296—Synchronisation thereof; Control thereof
Abstract
The invention provides a method for synthesizing VR panorama, which comprises the following steps: rotating the target object according to a preset rotation rate, and acquiring pictures according to corresponding preset shooting times to form a set of pictures; detecting abnormal conditions of the set of drawings; if the abnormal condition is not detected, outputting a sleeve map, and synthesizing the VR panorama of the target object; the abnormal condition detection comprises picture integrity detection. The VR panorama synthesis method can simply realize VR panorama.
Description
Technical Field
The invention relates to the technical field of imaging, in particular to a VR panorama synthesis method and device.
Background
VR (Virtual Reality) panorama mainly depends on the development of a plurality of key technologies such as three-dimensional real-time graphic display, three-dimensional positioning and tracking, touch and smell sensing technologies, artificial intelligence technologies, high-speed computing and parallel computing technologies, and human behavioral research. Key technologies of VR include dynamic environment modeling technology, real-time three-dimensional graph generation technology, stereoscopic display and sensor technology, application system development tools, and system integration technology.
At present, the general VR panorama browsing method for a static object is obtained by performing appearance scanning on the object and constructing a three-dimensional model of the object through software programming.
Disclosure of Invention
The invention aims to provide a method and a device for synthesizing VR panorama, which can simply realize VR panorama.
In order to achieve the purpose, the invention adopts the following technical scheme:
the invention provides a method for synthesizing VR panorama, which comprises the following steps:
rotating the target object according to a preset rotation rate, and acquiring pictures according to corresponding preset shooting times to form a set of pictures;
detecting abnormal conditions of the set of drawings;
if the abnormal condition is not detected, outputting the set of images and synthesizing the VR panorama of the target object;
the abnormal condition detection comprises picture integrity detection.
Further, the detecting the abnormal condition of the set of drawings comprises:
selecting any one picture from the set of pictures to be set as a first picture, and acquiring the rotation angle of other pictures in the same group relative to the first picture;
determining a minimum rotation angle according to the rotation angle, and carrying out picture integrity detection according to the minimum rotation angle;
and if the set of drawings is not complete, the abnormal condition is determined.
Further, the detecting the integrity of the picture according to the minimum rotation angle includes:
detecting whether the set of pictures contains all pictures which rotate by 360 degrees according to the minimum rotation angle; if yes, the set of drawings is complete.
Further, the minimum rotation angle is determined according to the rotation angle, and the method also comprises the following steps:
and removing one of the repeated pictures in the set of pictures, and/or removing the picture without the target object in the set of pictures.
Further, the detecting the abnormal condition of the set of diagrams further comprises:
if the abnormal condition is detected, determining the remaining rotation angles according to the rotation angles, and selecting the rotation angles from small to large to sequentially perform the same-rotation-rate overlay detection until a complete overlay belonging to the same rotation rate is found;
and outputting the complete set of images and synthesizing the VR panorama of the target object.
Further, the rotation angles are selected from small to large to sequentially perform identical rotation rate set chart detection until a complete set chart belonging to the identical rotation rate is found, and the method comprises the following steps:
and sequentially selecting rotation angles from small to large, detecting whether the set of drawings comprise all pictures which rotate for 360 degrees according to the selected rotation angles, and if so, determining that the complete set of drawings belonging to the same rotation rate are found.
Further, synthesizing the VR panorama of the target object, and then:
determining a corresponding roaming speed according to the preset conversion rate;
and controlling the VR panorama to automatically roam according to the roaming speed.
Further, synthesizing the VR panorama of the target object, and then:
determining the direction and the angle of the VR panorama rotation according to the instruction of a user;
and selecting a corresponding picture for displaying according to the rotating direction and angle.
In a second aspect, the present invention provides an apparatus for synthesizing a VR panorama, comprising: the device comprises an object carrying piece, a rotary supporting piece and camera equipment;
the object carrying piece is rotatably connected with one end of the rotating support piece, and the camera shooting equipment is arranged on one side of the object carrying piece;
the object carrying piece is used for placing a target object to be shot;
the rotary supporting part is used for supporting the object carrying piece and enabling the object carrying piece to rotate according to a preset rotation rate;
the camera device is used for acquiring pictures according to the corresponding preset shooting times.
Further, the device also comprises an operation panel which is electrically connected with the rotating support;
the operation panel is used for providing functions of a switch, rotating speed setting, rotating rate setting and rotating mode selection.
The invention has the beneficial effects that:
according to the invention, through shooting the picture covering 360 degrees and detecting the abnormal condition, the complete set of pictures is ensured, and then the VR panorama is synthesized, so that the VR panorama browsing of the object can be simply realized, 3D modeling and software programming are not needed, and the cost is reduced.
Drawings
Fig. 1 is a schematic flowchart of a method for synthesizing a VR panorama according to an embodiment of the present invention.
Fig. 2 is a schematic structural diagram of a VR panorama synthesis apparatus according to a second embodiment of the present invention.
10. Carrying an object; 20. a rotating support; 30 an operation panel.
Detailed Description
In order to make the technical problems solved, technical solutions adopted and technical effects achieved by the present invention clearer, the technical solutions of the embodiments of the present invention will be described in further detail below with reference to the accompanying drawings, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all embodiments.
Example one
The embodiment provides a method for synthesizing a VR panorama, which can simply and correctly realize VR panorama browsing of an object, does not need 3D modeling or software programming, and reduces cost.
Fig. 1 is a schematic flowchart of a method for synthesizing a VR panorama according to an embodiment of the present invention. The synthesis method specifically comprises the following steps:
and S11, rotating the target object according to the preset rotation rate, and acquiring pictures according to the corresponding preset shooting times to form a set of pictures. The shooting is carried out at the same angle every time, 360-degree shooting can be covered, a group of pictures can be obtained, and a set of pictures can be formed. For example: presetting the rotation rate to be 5 degrees/time, correspondingly shooting 72 times, covering 360 degrees, and obtaining a group of set pictures containing 72 pictures; presetting the rotation rate to be 10 degrees/time, correspondingly shooting 36 times, covering 360 degrees, and obtaining a group of set pictures containing 36 pictures; the preset rotation rate is 15 degrees/time, the corresponding shooting times are 24 times, 360 degrees are covered, and a group of set pictures containing 24 pictures is obtained.
And S12, detecting the abnormal condition of the set of drawings. The abnormal condition detection comprises picture integrity detection.
Preferably, in the process of uploading the pictures, any picture is selected from the set of pictures to be set as the first picture, and then the set of pictures is uploaded.
And then acquiring the rotation angle of other pictures in the same group relative to the first picture. According to the object position of the first picture, the rotation angle of different pictures can be obtained through an OpenCV object contour recognition algorithm.
Preferably, one of the repeated pictures in the set of images is removed after different rotation angles are obtained, and/or the picture without the target object in the set of images is removed. So that no image interfering with the presentation of the object appears in the set of images.
And then determining the minimum rotation angle according to the rotation angles, and finding the picture with the minimum rotation angle difference with the first picture according to the clockwise sequence so as to determine the minimum rotation angle.
And detecting the integrity of the picture according to the minimum rotation angle. Detecting the integrity of the pictures, namely detecting whether the set of pictures contains all pictures which rotate by 360 degrees according to the minimum rotation angle; if yes, the set of drawings is complete, and if not, the set of drawings is incomplete. If the set of drawings is incomplete, the situation is abnormal.
And S13a, if no abnormal condition is detected, outputting the set of images and synthesizing the VR panorama of the target object.
Correspondingly, if the set of drawings is complete, the abnormal condition is not detected, and the complete set of drawings is output.
Preferably, the method further comprises:
s13b, if an abnormal condition is detected, determining the remaining rotation angles according to the rotation angles, and selecting the rotation angles from small to large to sequentially perform identical-rotation-rate overlay detection until a complete overlay belonging to the identical rotation rate is found; and outputting the complete set of images and synthesizing the VR panorama of the target object.
Further, the same-rotation-rate set diagram is detected by sequentially selecting rotation angles from small to large, detecting whether the set diagram comprises all pictures which rotate for 360 degrees according to the selected rotation angles, and if so, determining that the complete set diagram which belongs to the same rotation rate is found.
Specifically, the corotation rate set chart detection is performed according to the result of the picture integrity detection. And if the result is abnormal, continuously finding the pictures with the second small rotation difference value with the first picture according to the clockwise sequence, determining and detecting whether the set of pictures contain all the pictures which rotate by 360 degrees according to the second small rotation angle. If yes, determining to find a complete set of graphs belonging to the same conversion rate.
If not, finding the picture with the third small rotation difference value with the first picture, determining and detecting whether the set of pictures contains all pictures rotated by 360 degrees according to the third small rotation angle. If yes, determining to find a complete set of graphs belonging to the same conversion rate.
If not, continuing to find a picture with a fourth small rotation difference value with the first picture, determining the four small rotation angles, and so on until a complete set of pictures with the same rotation rate are found; and outputting the complete set of graph.
Preferably, the method further comprises:
and S14, determining a corresponding roaming speed according to the preset conversion rate, and controlling the VR panorama to automatically roam according to the roaming speed. And after the overlay is loaded, the object can be displayed according to the roaming speed.
Preferably, the method further comprises:
and S15, determining the rotating direction and angle of the VR panorama according to the instruction of the user, and selecting a corresponding picture for displaying according to the rotating direction and angle. The user can generate an instruction through a mouse or a touch screen, the instruction comprises the force and the direction, and then a proper picture is selected according to the force and the direction to be displayed so as to feed back the instruction of the user.
According to the embodiment, the images covering 360 degrees are shot and abnormal condition detection is carried out, so that the complete set of images is ensured, the VR panorama is synthesized, the VR panorama of the object can be simply browsed, 3D modeling is not needed, software programming is not needed, and the cost is reduced.
Example two
The present embodiment provides an apparatus for synthesizing VR panorama, which is used to perform the VR panorama synthesizing method described in the foregoing embodiments, to solve the same technical problems and achieve the same technical effects.
Fig. 2 is a schematic structural diagram of a VR panorama synthesis apparatus according to a second embodiment of the present invention. This synthetic VR panorama device includes: a carrier 10, a rotary support 20 and a camera device (not shown).
The object carrying member 10 is rotatably connected to one end of the rotary support member 20, and the image pickup apparatus is disposed at one side of the object carrying member 10.
The object carrying piece 10 is used for placing a target object to be shot. Preferably, the shape is circular, and a detachable fixing clip 11 is provided on the object loading member 10 for fixing the target object. The object carrier 10 is further provided with a fixing slot 12 through which the connection with the rotary support 20 is made more secure.
The rotating support 20 is configured to support the object carrying member 10 and rotate the object carrying member 10 according to a preset rotation rate, so that the target object rotates at the same angle each time. The rotary support 20 is driven by a battery or power source.
The camera device is used for acquiring pictures according to the corresponding preset shooting times.
Preferably, the device further comprises an operation panel 30, wherein the operation panel 30 is electrically connected with the rotary support 20. The operation panel 30 is used to provide the functions of a switch, a rotation speed setting (sec/rev), a rotation rate setting (degree/rev), and a rotation mode selection (one revolution/cyclic revolution).
In the embodiment, the target object can be rotated according to the preset rotation rate through the cooperation of the load, the rotating support and the camera equipment, and the picture can be obtained according to the preset shooting times, so that a set of pictures covering 360 degrees can be formed.
The technical principle of the present invention is described above in connection with specific embodiments. The description is made for the purpose of illustrating the principles of the invention and should not be construed in any way as limiting the scope of the invention. Based on the explanations herein, those skilled in the art will be able to conceive of other embodiments of the present invention without inventive effort, which would fall within the scope of the present invention.
Claims (10)
1. A method of synthesizing a VR panorama, comprising:
rotating the target object according to a preset rotation rate, and acquiring pictures according to corresponding preset shooting times to form a set of pictures;
detecting abnormal conditions of the set of drawings;
if the abnormal condition is not detected, outputting the set of images and synthesizing the VR panorama of the target object;
the abnormal condition detection comprises picture integrity detection.
2. The method of synthesizing a VR panorama of claim 1, wherein detecting the abnormal situation for the set of maps comprises:
selecting any one picture from the set of pictures to be set as a first picture, and acquiring the rotation angle of other pictures in the same group relative to the first picture;
determining a minimum rotation angle according to the rotation angle, and carrying out picture integrity detection according to the minimum rotation angle;
and if the set of drawings is not complete, the abnormal condition is determined.
3. The method of synthesizing a VR panorama of claim 2, wherein performing a picture integrity check based on the minimum rotation angle comprises:
detecting whether the set of pictures contains all pictures which rotate by 360 degrees according to the minimum rotation angle; if yes, the set of drawings is complete.
4. The method of synthesizing a VR panorama of claim 2, wherein a minimum rotation angle is determined from the rotation angles, further comprising:
and removing one of the repeated pictures in the set of pictures, and/or removing the picture without the target object in the set of pictures.
5. The method of synthesizing a VR panorama of claim 1, further comprising detecting an abnormal situation in the set of maps, and thereafter:
if the abnormal condition is detected, determining the remaining rotation angles according to the rotation angles, and selecting the rotation angles from small to large to sequentially perform the same-rotation-rate overlay detection until a complete overlay belonging to the same rotation rate is found;
and outputting the complete set of images and synthesizing the VR panorama of the target object.
6. The method of claim 5, wherein selecting rotation angles from small to large to sequentially perform identical rotation rate overlay detection until a complete overlay belonging to identical rotation rates is found comprises:
and sequentially selecting rotation angles from small to large, detecting whether the set of drawings comprise all pictures which rotate for 360 degrees according to the selected rotation angles, and if so, determining that the complete set of drawings belonging to the same rotation rate are found.
7. The method of synthesizing a VR panorama of claim 1, further comprising, after synthesizing the VR panorama of the target object:
determining a corresponding roaming speed according to the preset conversion rate;
and controlling the VR panorama to automatically roam according to the roaming speed.
8. The method of synthesizing a VR panorama of claim 1, further comprising, after synthesizing the VR panorama of the target object:
determining the direction and the angle of the VR panorama rotation according to the instruction of a user;
and selecting a corresponding picture for displaying according to the rotating direction and angle.
9. An apparatus for synthesizing a VR panorama, comprising: the device comprises an object carrying piece, a rotary supporting piece and camera equipment;
the object carrying piece is rotatably connected with one end of the rotating support piece, and the camera shooting equipment is arranged on one side of the object carrying piece;
the object carrying piece is used for placing a target object to be shot;
the rotary supporting part is used for supporting the object carrying piece and enabling the object carrying piece to rotate according to a preset rotation rate;
the camera device is used for acquiring pictures according to the corresponding preset shooting times.
10. The synthetic VR panorama device of claim 9, further comprising an operating panel electrically connected to the rotational support;
the operation panel is used for providing functions of a switch, rotating speed setting, rotating rate setting and rotating mode selection.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911311445.0A CN110958395A (en) | 2019-12-18 | 2019-12-18 | VR panorama synthesis method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911311445.0A CN110958395A (en) | 2019-12-18 | 2019-12-18 | VR panorama synthesis method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110958395A true CN110958395A (en) | 2020-04-03 |
Family
ID=69982522
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911311445.0A Pending CN110958395A (en) | 2019-12-18 | 2019-12-18 | VR panorama synthesis method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110958395A (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105072343A (en) * | 2015-08-13 | 2015-11-18 | 广东申义实业投资有限公司 | Object appearance panorama shooting method and portable shooting system |
| CN105323552A (en) * | 2015-10-26 | 2016-02-10 | 北京时代拓灵科技有限公司 | Method and system for playing panoramic video |
| CN108053494A (en) * | 2017-11-28 | 2018-05-18 | 珠海格力电器股份有限公司 | A kind of group photo photograph generation method and its device, mobile terminal |
-
2019
- 2019-12-18 CN CN201911311445.0A patent/CN110958395A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105072343A (en) * | 2015-08-13 | 2015-11-18 | 广东申义实业投资有限公司 | Object appearance panorama shooting method and portable shooting system |
| CN105323552A (en) * | 2015-10-26 | 2016-02-10 | 北京时代拓灵科技有限公司 | Method and system for playing panoramic video |
| CN108053494A (en) * | 2017-11-28 | 2018-05-18 | 珠海格力电器股份有限公司 | A kind of group photo photograph generation method and its device, mobile terminal |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20200258302A1 (en) | Presenting Image Transition Sequences Between Viewing Locations | |
| US10462383B2 (en) | System and method for acquiring virtual and augmented reality scenes by a user | |
| US11854149B2 (en) | Techniques for capturing and displaying partial motion in virtual or augmented reality scenes | |
| CN103176347B (en) | Panorama sketch image pickup method and filming apparatus and electronic equipment | |
| EP1074943A2 (en) | Image processing method and apparatus | |
| US10078915B2 (en) | Information terminal apparatus, information processing method, and system, configured to correct posture of a virtual object depending on changed posture information | |
| CN109584295A (en) | The method, apparatus and system of automatic marking are carried out to target object in image | |
| US20170046820A1 (en) | Equatorial Stitching of Hemispherical Images in a Spherical Image Capture System | |
| CN108038886B (en) | Binocular camera system calibration method and device and automobile | |
| CN110248079A (en) | A kind of full view image generating system and panorama image generation method | |
| CN102984453A (en) | Method and system of real-time generating hemisphere panoramic video images through single camera | |
| CN104335251A (en) | Information processing device, information processing method, and program | |
| CN108399634B (en) | RGB-D data generation method and device based on cloud computing | |
| WO2021190649A1 (en) | Method and device for collecting images of a scene for generating virtual reality data | |
| CN105741341A (en) | Three-dimensional space environment imaging system and method | |
| CN111010476A (en) | Image display method, device, terminal and readable storage medium | |
| KR20160002531A (en) | 3d image creating method using video photographed with smart device | |
| US9754398B1 (en) | Animation curve reduction for mobile application user interface objects | |
| CN107105219A (en) | Many depth camera compact panoramic scanning equipment | |
| CN110049304A (en) | A kind of method and device thereof of the instantaneous three-dimensional imaging of sparse camera array | |
| CN108648147A (en) | A kind of super-resolution image acquisition method and system of human eye retina's mechanism | |
| Queguiner et al. | Towards mobile diminished reality | |
| TW200947355A (en) | Intelligent multi-direction display system and method | |
| JP2021034885A (en) | Image generation device, image display device, and image processing method | |
| CN103377469A (en) | Terminal and image processing method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200403 |
|
| RJ01 | Rejection of invention patent application after publication |