CN113096008A - Panoramic picture display method, display device and storage medium - Google Patents
Panoramic picture display method, display device and storage medium Download PDFInfo
- Publication number
- CN113096008A CN113096008A CN202110257457.0A CN202110257457A CN113096008A CN 113096008 A CN113096008 A CN 113096008A CN 202110257457 A CN202110257457 A CN 202110257457A CN 113096008 A CN113096008 A CN 113096008A
- Authority
- CN
- China
- Prior art keywords
- panoramic picture
- picture
- view
- panoramic
- pictures
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 49
- 238000012545 processing Methods 0.000 claims abstract description 28
- 238000013507 mapping Methods 0.000 claims description 14
- 238000004590 computer program Methods 0.000 claims description 8
- 238000010276 construction Methods 0.000 claims description 5
- 238000005096 rolling process Methods 0.000 claims description 3
- 238000012216 screening Methods 0.000 claims description 3
- 230000000694 effects Effects 0.000 abstract description 9
- 230000015654 memory Effects 0.000 description 11
- 238000010586 diagram Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 5
- 238000012986 modification Methods 0.000 description 5
- 230000004048 modification Effects 0.000 description 5
- 230000009466 transformation Effects 0.000 description 4
- 238000005259 measurement Methods 0.000 description 3
- 238000009877 rendering Methods 0.000 description 3
- 230000008878 coupling Effects 0.000 description 2
- 238000010168 coupling process Methods 0.000 description 2
- 238000005859 coupling reaction Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 239000012530 fluid Substances 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000013178 mathematical model Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
- 230000002194 synthesizing effect Effects 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
- 230000003936 working memory Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/005—General purpose rendering architectures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/22—Matching criteria, e.g. proximity measures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/04—Texture mapping
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformation in the plane of the image
- G06T3/40—Scaling the whole image or part thereof
- G06T3/4053—Super resolution, i.e. output image resolution higher than sensor resolution
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration by the use of more than one image, e.g. averaging, subtraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/46—Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features
- G06V10/462—Salient features, e.g. scale invariant feature transforms [SIFT]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2200/00—Indexing scheme for image data processing or generation, in general
- G06T2200/32—Indexing scheme for image data processing or generation, in general involving image mosaicing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
Abstract
The disclosure provides a display method, a display device and a storage medium of a panoramic picture, wherein the display method comprises the steps of obtaining the panoramic picture, and dividing the panoramic picture into a plurality of pictures; pasting a plurality of pictures on a preset cubic model to obtain a 3D panoramic picture; and performing projection processing on the 3D panoramic picture to obtain a projection view of the panoramic picture, and automatically playing the projection view. The display device of the panoramic picture comprises a panoramic picture acquisition module, a panoramic picture processing module and a panoramic picture display module. The panoramic picture display method can preview the panoramic picture on the full screen of the mobile phone or automatically play the panoramic picture on the mobile phone, so that the experience of a user for checking the panoramic picture is enhanced, and the overall effect is better.
Description
Technical Field
The present disclosure relates to the field of image processing technologies, and in particular, to a display method, a display apparatus, and a storage medium for a panoramic image.
Background
Panoramic pictures, also known as panoramas, typically refer to photographs taken in conformance with a person's normal effective vision in both eyes (approximately 90 degrees horizontally, 70 degrees vertically) or including beyond binocular vision in residual light (approximately 180 degrees horizontally, 90 degrees vertically), or even a full scene range of 360 degrees. A panoramic picture is a new picture synthesis technology, which is a technology for synthesizing each azimuth picture of a scene into a panoramic picture. Thus, the user can view the pictures of all directions in the scene through one panoramic picture. Displaying panoramic pictures may be performed by any one of a set-top box, a television, a Personal Computer (PC), a server, a workstation, a laptop, a Personal Digital Assistant (PDA), a media player, an imaging device, a Mobile Internet Device (MID), a smart phone, a smart tablet, or a smart Television (TV), to name a few smart devices
As smart phones become more and more, cameras become an essential function of each phone. In the camera, a panoramic shooting function is provided, 180-degree or even 360-degree scenes can be combined into one picture, and when the sea, the sky or the great building is shot, the whole picture can be recorded, so that wide scenes such as the scenes and the horizon can be shot, and the overall effect is good.
However, when a panoramic picture is viewed in a smart phone, a strip-shaped effect is often seen, and when the panoramic picture is displayed, the picture preview is relatively small and cannot be previewed in a full screen manner like a common picture; or to zoom in on a local position of the picture, which however loses the original effect of the panoramic picture.
Accordingly, the present disclosure provides a display method, a display apparatus, and a storage medium of a panoramic picture to solve the above problems.
BRIEF SUMMARY OF THE PRESENT DISCLOSURE
The technical problem to be solved by the present disclosure is that when a panoramic picture is viewed in a smart phone, a strip-shaped effect is often seen, and when the panoramic picture is displayed, either the picture preview is small in appearance, and cannot be previewed in a full screen manner like a common picture; or a local position of the panorama picture is enlarged, but this loses the original effect of the panorama picture, and thus the present disclosure provides a display method, a display apparatus, and a storage medium of the panorama picture for solving the above-mentioned problems.
The technical scheme adopted by the disclosure for solving the technical problem is as follows:
in a first aspect, the present disclosure provides a method for displaying a panoramic picture, including the following steps:
acquiring a panoramic picture, and dividing the panoramic picture into a plurality of pictures;
pasting a plurality of pictures on a preset cubic model to obtain a 3D panoramic picture;
and performing projection processing on the 3D panoramic picture to obtain a projection view of the panoramic picture, and automatically playing the projection view.
In one implementation, preferably, the step of acquiring the panoramic picture and dividing the panoramic picture into a plurality of pictures includes:
taking and storing the pictures through a camera;
screening pictures with the field angle larger than 120 degrees to obtain a panoramic photo;
and dividing the panoramic picture into a plurality of pictures according to the size of the field angle.
In one implementation, preferably, the step of dividing the panoramic picture into several pictures according to the field angle size includes: dividing the panoramic picture with the field angle larger than 180 degrees and smaller than 270 degrees into three pictures, wherein the three pictures sequentially comprise a right picture, a front picture and a left picture; and dividing the panoramic picture with the field angle larger than 270 degrees into four pictures, wherein the four pictures sequentially comprise a right picture, a front picture, a left picture and a rear picture.
In one implementation, preferably, the cube model is constructed through Opengles, and the cube model includes six plane views, including a front view, a rear view, a right view, a left view, a top view, and a bottom view.
In one implementation, preferably, the step of mapping the plurality of pictures onto the cube model to obtain the 3D panoramic picture includes:
pasting the cut right map to a right view of the cube model;
mapping the cut front map to the front view of the cube model
Mapping the cut left map to the left view of the cube model
And pasting the cut back map corresponding map to the back view of the cube model.
In one implementation manner, preferably, the step of automatically playing the projection view specifically includes:
setting the center of the cube model as an observation point;
setting a moving direction, a moving speed and a moving time;
and sequentially rolling the right view, the front view, the left view and the rear view of the panoramic picture according to the moving time from left to right or from right to left of the observation point.
In one implementation, preferably, after the step of performing projection processing on the 3D panoramic picture to obtain a projection view of the panoramic picture, the method may further include:
setting the center of the cube model as an observation point;
setting parameters of an attitude sensor;
and rotating the attitude sensor left and right to sequentially display the projection views of the panoramic picture.
In a second aspect, the present disclosure further provides a display apparatus for panoramic pictures, which includes a panoramic picture acquisition module, a panoramic picture processing module, and a panoramic picture display module. The panoramic picture acquisition module comprises a camera and is used for acquiring a panoramic picture; the panoramic picture processing module comprises an Opengles construction model for constructing a cube model, and the panoramic picture is mapped on the cube model to obtain a 3D panoramic picture and then projection processing is carried out to obtain a projection view of the panoramic picture; the panoramic picture display module is used for displaying or playing the projection view of the panoramic picture.
In one implementation, preferably, the panoramic image display module includes an attitude sensor, the attitude sensor includes one or more of a three-axis gyroscope, a three-axis accelerometer and a three-axis electronic compass, and an embedded ARM processor, and the ARM processor obtains the three-dimensional attitude and orientation data of the panoramic image through temperature compensation.
In a third aspect, the present disclosure also provides a storage medium having a computer program stored thereon, which when executed by a processor implements the steps of any one of the methods described above.
Has the advantages that: according to the display method of the panoramic picture, the 3D panoramic picture is obtained by mapping the panoramic picture on the cube model, then projection processing is carried out on the 3D panoramic picture, a projection view of the panoramic picture is obtained, and by setting the observation point and the attitude sensor parameters, the purpose that the projection view of the panoramic picture can be sequentially checked through rotating the attitude sensor and the projection view of the panoramic picture can be automatically played is achieved.
Further embodiments of the present disclosure are also capable of achieving other advantageous technical effects not listed, which other technical effects may be partially described below, and which would be expected and understood by one of ordinary skill in the art upon reading the present disclosure.
This disclosure is intended in part to introduce a selection of concepts and options in a simplified form that are further described below in the detailed description to assist the reader in understanding the disclosure. This disclosure is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter. All of the above features are to be understood as exemplary only and further features and objects relating to the structure and method may be gleaned from the present disclosure. A more complete appreciation of the features, details, utilities, and advantages of the present disclosure will be provided in the following written description of various embodiments of the present disclosure, illustrated in the accompanying drawings, and defined in the appended claims. Accordingly, many non-limiting interpretation of the disclosure should not be understood without further reading the entire specification, claims and drawings.
Drawings
Fig. 1 is a flowchart illustrating steps of a method for displaying a panoramic image according to the present disclosure;
FIG. 2 is a schematic diagram of a cube model provided by the present disclosure;
FIG. 3 is a schematic diagram of a cube projection graph obtained after unfolding a cube model provided by the present disclosure;
fig. 4 is a flowchart illustrating a detailed step of step S01 of the method for displaying a panoramic picture shown in fig. 1;
fig. 5 is a flowchart of a first embodiment of step S03 of the display method of a panorama picture shown in fig. 1;
fig. 6 is a flowchart of a second embodiment of step S03 of the display method of a panorama picture shown in fig. 1;
fig. 7 is a schematic structural diagram of a display device for panoramic pictures provided by the present disclosure.
Detailed Description
In order to make the objects, technical solutions and advantages of the present disclosure clearer and clearer, the present disclosure is further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are merely illustrative of the disclosure and are not intended to limit the disclosure.
It is to be understood that the embodiments illustrated and described are not limited in application to the details of construction and the arrangement of components set forth in the following description or illustrated in the following drawings. The illustrated embodiments are capable of other embodiments and of being practiced or of being carried out in various ways. Examples are provided by way of explanation of the disclosed embodiments, not limitation. Indeed, it will be apparent to those skilled in the art that various modifications and variations can be made to the embodiments of the present disclosure without departing from the scope or spirit of the disclosure. For instance, features illustrated or described as part of one embodiment, can be used with another embodiment to yield a still further embodiment. Accordingly, the disclosure is intended to cover such modifications and variations as fall within the scope of the appended claims and their equivalents.
Also, it is to be understood that the phraseology and terminology used herein is for the purpose of description and should not be regarded as limiting. The use of "including," "comprising," or "having" and variations thereof herein is meant to encompass the items listed thereafter and equivalents thereof as well as additional items. Unless limited otherwise, the terms "connected," "coupled," and "mounted," and variations thereof herein are used broadly and encompass direct and indirect connections, couplings, and mountings. Further, the terms "connected" and "connected," and variations thereof, are not restricted to physical or mechanical connections or couplings. In this disclosure, "modular" or "module" means that the modular components or members are independent units with consistent mechanical or data connection interfaces, where the same type of modular components or modules may be reused and replaceable in the display device of this disclosure.
As used herein, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. It will be understood that when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may also be present. Further, "connected" or "coupled" as used herein may include wirelessly connected or wirelessly coupled. As used herein, the term "and/or" includes all or any element and all combinations of one or more of the associated listed items.
The present disclosure will now be described in more detail with reference to a few specific embodiments thereof, and with reference to the accompanying drawings. It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict.
Referring to fig. 1 to 7, fig. 1 is a flowchart illustrating steps of a method for displaying a panoramic picture provided by the present disclosure, fig. 2 is a schematic diagram illustrating a cube model provided by the present disclosure, fig. 3 is a schematic diagram illustrating a projected graph of a cube obtained after the cube model provided by the present disclosure is unfolded, fig. 4 is a flowchart illustrating specific steps of step S01 of the method for displaying a panoramic picture shown in fig. 1, fig. 5 is a flowchart illustrating a first embodiment of step S03 of the method for displaying a panoramic picture shown in fig. 1, fig. 6 is a flowchart illustrating a second embodiment of step S03 of the method for displaying a panoramic picture shown in fig. 1, and fig. 7 is a schematic diagram illustrating a structure of a device for displaying a panoramic picture provided by the present disclosure.
Referring to fig. 1, the present disclosure provides a method for displaying a panoramic picture, wherein in a first embodiment, the method comprises the following steps:
s01, acquiring a panoramic picture, and dividing the panoramic picture into a plurality of pictures;
s02, pasting a plurality of pictures on a preset cubic model to obtain a 3D panoramic picture;
s03, performing projection processing on the 3D panoramic picture to obtain a projection view of the panoramic picture, and automatically playing the projection view of the panoramic picture.
Specifically, in step S01, referring to fig. 4, step S01 further includes:
s11, shooting and storing the pictures through the camera;
s12, screening pictures with the field angle larger than 120 degrees to obtain a panoramic photo;
and S13, dividing the panoramic picture into a plurality of pictures according to the size of the field angle.
Firstly, a panoramic picture with a field angle larger than 120 degrees needs to be obtained, and the panoramic picture is obtained by splicing a Camera algorithm and a panoramic algorithm. The panoramic picture can be shot by a camera of the camera, and the panoramic picture is obtained by deforming graphs, matching features, calculating feature homography by using RANSAC algorithm and combining the deformed graphs. Wherein the graphical transformation comprises up and down shifting, partial scaling and warping of the picture; the feature matching comprises identifying key points, extracting vector feature descriptors surrounding each key point, and determining correspondence between picture descriptors according to the key points; RANSAC is an abbreviation for "RANdom SAmple Consensus," which can iteratively estimate parameters of a mathematical model from a set of observed data sets containing "outliers. The RANSAC algorithm can avoid mismatching of feature matching and filter the result. And the graph merging comprises splicing and fusing the pictures by corresponding to the key points. It should be noted that when the camera shoots a panoramic picture, the camera shoots the panoramic picture and performs panoramic algorithm stitching to obtain the panoramic picture. Step S11 may also involve identifying an object through a SIFT algorithm, where SIFT (Scale-invariant feature transform) is a computer vision algorithm used to detect and describe local features in an image, and finds an extreme point in a spatial Scale and extracts its position, Scale, and rotation invariants, and in a feature database with a huge number of parents, the object is easily identified and is only rarely mistakenly recognized.
In step S13, specifically, the panoramic picture with the angle of view greater than 180 degrees and less than 270 degrees is divided into three pictures, which sequentially include a right picture, a front picture, and a left picture, according to the shooting angle of the panoramic picture. Besides, the panoramic picture with the angle of view larger than 270 degrees can be divided into four pictures according to the shooting angle of the panoramic picture, and the four pictures sequentially comprise a right picture, a front picture, a left picture and a rear picture.
In step S02, a cube model is constructed by Opengles, and the cube model includes six plane views, including a front view, a rear view, a right view, a left view, a top view, and a bottom view. OpenGL is an application programming interface, which is a software library that can access the characteristics of graphics hardware devices across platforms, and has the following main application fields: video and graphic picture processing, 2D/3D game engine development, scientific visualization, medical software development, CAD (computer aided technology), virtual reality (AR/VR), AI artificial intelligence and the like. Opengles is a subset of OpenGL, designed for cell phone, PDA, and game host embedded devices. Therefore, through the strong rendering capability of Opengles, excellent selection of graphics processing can be performed in the embedded device, and picture processing, video processing and the like can be performed. It should be noted that Opengles can also implement a preview of Camera.
Referring to fig. 2 and 3 in detail, as shown in fig. 2, the cubic model is obtained by splicing planar views obtained by expanding the cubic model in 11 ways according to mathematical relations, however, planar views obtained by expanding the cubic model in all ways can not obtain the same technical effect. Referring to fig. 3, when the unfolded plane view of the cube model is the structure shown in fig. 4, the subsequent processing and operation can be performed on the plane view.
Further, in step S02, the method further includes: mapping the cut right map to a right view of the cube model, mapping the cut front map to a front view of the cube model, mapping the cut left map to a left view of the cube model, and mapping the cut back map to a back view of the cube model. Generally, a texture is one or more two-dimensional graphics, also called texture maps (texture), representing the surface of an object. When the texture is mapped onto the surface of the object in a specific way, the object can be more truly seen. In the current popular graphics system, texture rendering has become an indispensable rendering method. In understanding texture mapping, a texture can be viewed as a pixel color applied to the surface of an object. In the real world, textures represent the color, pattern, and tactile characteristics of an object.
Further, in step S03, before the projection processing, a model coordinate system where the cube model is located needs to be subjected to model conversion to obtain a world coordinate system, where the coordinate system where the 3D panoramic image is located is the world coordinate system, and coordinate points of the 3D panoramic image are converted into a 2D image according to the world coordinate system and displayed on a screen. The projection process is to convert a 3D panoramic picture in a projection transformation view cone range into a 2D picture, specifically, a coordinate system of a 3D panoramic picture is a world coordinate system, coordinate points in the 3D panoramic picture are converted into coordinate points of the 2D picture and displayed on a display screen, the coordinate points of the world coordinate system are firstly subjected to projection transformation to obtain the coordinate points of a standardized equipment coordinate system, then the coordinate points of the standardized equipment coordinate system are subjected to viewport transformation to obtain the coordinate points of the screen coordinate system, and finally the coordinate points are displayed on a display device to obtain a projection view of the panoramic picture.
Specifically, in step S03, the panoramic picture can be viewed in two ways, namely, by rotating the gesture sensor or automatically playing the projection view of the panoramic picture.
Referring to fig. 5 and 6, in the first way of viewing the panoramic image, the method specifically includes the following steps:
s311, setting the center of the cube model as an observation point;
s312, setting parameters of the attitude sensor;
and S313, rotating the attitude sensor left and right to sequentially display the projection views of the panoramic picture.
In a second manner of viewing panoramic pictures, the method specifically includes the following steps:
s321, setting the center of the cube model as an observation point;
s322, setting a moving direction, a moving speed and a moving time;
s323, sequentially rolling the right view, the front view, the left view and the rear view of the panoramic picture according to the moving time from left to right or from right to left according to the observation point.
In the first viewing mode, the attitude sensor (E.T-ahrs) is a high-performance three-dimensional motion attitude measurement system based on the MEMS technology, and comprises an auxiliary motion sensor such as a three-axis gyroscope, a three-axis accelerometer (namely IMU) and a three-axis electronic compass, calibrated angular velocity, acceleration, magnetic data and the like are output through an embedded low-power ARM processor, motion attitude measurement is carried out through a sensor data algorithm based on quaternion, and zero-drift three-dimensional attitude data expressed by quaternion, Euler angle and the like are output in real time. The attitude sensor can be widely applied to product equipment which needs low-cost and high-dynamic three-dimensional attitude measurement, such as an unmanned aerial vehicle of an aeromodelling, a robot, an antenna holder, concentrated solar energy, ground and underwater equipment, virtual reality, human motion analysis and the like. When the method is used for viewing the panoramic picture, the user can view the panoramic picture from the observation point to the left or to the right in a full screen mode by rotating the attitude sensor, and better user experience is achieved.
In a second manner of viewing the panoramic image, specifically, the panoramic image is played according to the moving time from left to right or from right to left according to the viewpoint, that is, the right view, the front view, the left view and the rear view are sequentially scrolled, or the rear view, the left view, the front view and the right view are sequentially scrolled. Specifically, the moving direction is set from left to right or from right to left, and the moving speed and the moving time may be set according to the requirement of the user. When the method is used for viewing the panoramic picture, a user can automatically view the panoramic picture on the full screen of the smart phone only by setting the related parameters. The method also reduces the steps required for viewing the panoramic photo, can easily look up the panoramic photo, and improves the user experience.
Referring to fig. 7, in another aspect, the present disclosure further provides a display apparatus 100 for panoramic pictures, which includes a panoramic picture obtaining module 10, a panoramic picture processing module 20, and a panoramic picture display module 30. Specifically, the panoramic image obtaining module 10 includes a camera, and is configured to obtain a panoramic image. The panoramic picture can be shot by a camera of the camera, and the panoramic picture is obtained by deforming graphs, matching features, calculating feature homography by using RANSAC algorithm and combining the deformed graphs. The angle of view of the panoramic photograph is greater than 120 degrees.
The panoramic image processing module 20 includes a processor and an Opengles construction model for constructing a cube model, where the Opengles construction model maps the panoramic image to the cube model to obtain a 3D panoramic image, and then performs projection processing to obtain a projection view of the panoramic image.
The panoramic picture display module 30 includes a display screen for displaying or playing the projected view of the panoramic picture. The panoramic picture display module further comprises an attitude sensor, the attitude sensor comprises one or more of a three-axis gyroscope, a three-axis accelerometer and a three-axis electronic compass and an embedded ARM processor, and the ARM processor obtains the three-dimensional attitude and orientation data of the panoramic picture through temperature compensation.
The present disclosure also provides a storage medium on which a computer program is stored, the computer program, when executed by a processor, implementing the steps of the method for displaying a panoramic picture provided by the present disclosure.
In summary, according to the panoramic picture display method provided by the disclosure, the 3D panoramic picture is obtained by mapping the panoramic picture onto the cube model, and then projection processing is performed on the 3D panoramic picture to obtain the projection view of the panoramic picture, and by setting the observation point and the attitude sensor parameters, the projection view of the panoramic picture can be sequentially checked by rotating the attitude sensor, and the projection view of the panoramic picture can be automatically played.
Some embodiments may be implemented, for example, using a machine or tangible computer-readable medium or article which may store an instruction or a set of instructions that, if executed by a machine, may cause the machine to perform a method and/or operations in accordance with the embodiments. Such a machine may include, for example, any suitable processing platform, computing device, processing device, computing system, processing system, computer, processor, or the like, and may be implemented using any suitable combination of hardware and/or software. The machine-readable medium or article may include, for example, any suitable type of memory unit, memory device, memory article, memory medium, storage device, memory article, memory medium and/or storage unit, for example, memory, removable or non-removable media, erasable or non-erasable media, writeable or re-writeable media, digital or analog media, hard disk, floppy disk, compact disk read Only memory (CD-ROM), compact disk recordable (CD-R), compact disk Rewriteable (CD-RW), optical disk, magnetic media, magneto-optical media, removable memory cards or disks, various types of Digital Versatile Disk (DVD), a tape, a cassette, or the like. The instructions may include any suitable type of code, such as source code, compiled code, interpreted code, executable code, static code, dynamic code, encrypted code, and the like, implemented using any suitable high-level, low-level, object-oriented, visual, compiled and/or interpreted programming language.
Unless specifically stated otherwise, it may be appreciated that terms such as "processing," "computing," "calculating," "determining," or the like, refer to the action and/or processes of a computer or computing system, or similar electronic computing device, that manipulates and/or transforms data represented as physical (e.g., electronic) quantities within the computing system's registers and/or memories into other data similarly represented as physical quantities within the computing system memories or registers or other such information storage, transmission or display devices. The embodiments are not limited in this context.
The term "coupled" may be used herein to refer to any type of relationship between the components in question, whether direct or indirect, and may apply to electrical, mechanical, fluid, optical, electromagnetic, electromechanical or other connections. In addition, the terms "first," "second," and the like, are used herein for ease of discussion only, and have no particular temporal or chronological significance unless otherwise stated.
Those skilled in the art will appreciate from the foregoing description that the broad techniques of the embodiments of the present invention can be implemented in a variety of forms. Therefore, while the embodiments of this invention have been described in connection with particular examples thereof, the true scope of the embodiments of the invention should not be so limited since other modifications will become apparent to the skilled practitioner upon a study of the drawings, specification, and following claims.
In addition, some of the present application may be implemented as a computer program product, such as computer program instructions, which when executed by a computer, may invoke or provide methods and/or techniques in accordance with the present application through the operation of the computer. Program instructions which invoke the methods of the present application may be stored on a fixed or removable recording medium and/or transmitted via a data stream on a broadcast or other signal-bearing medium and/or stored within a working memory of a computer device operating in accordance with the program instructions. An embodiment according to the present application comprises an apparatus comprising a memory for storing computer program instructions and a processor for executing the program instructions, wherein the computer program instructions, when executed by the processor, trigger the apparatus to perform a method and/or a solution according to the aforementioned embodiments of the present application.
Finally, it should be noted that: it will be evident to those skilled in the art that the present application is not limited to the details of the foregoing illustrative embodiments, and that the present application may be embodied in other specific forms without departing from the spirit or essential attributes thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the application being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned. Furthermore, it is obvious that the word "comprising" does not exclude other elements or steps, and the singular does not exclude the plural. A plurality of units or means recited in the system claims may also be implemented by one unit or means in software or hardware. The terms first, second, etc. are used to denote names, but not any particular order. The application of the present invention is not limited to the above examples, and modifications may be made to the technical solutions described in the foregoing embodiments, or some technical features may be replaced with equivalents; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (10)
1. A method for displaying a panoramic picture, comprising the steps of:
acquiring a panoramic picture, and dividing the panoramic picture into a plurality of pictures;
pasting a plurality of pictures on a preset cubic model to obtain a 3D panoramic picture;
and performing projection processing on the 3D panoramic picture to obtain a projection view of the panoramic picture, and automatically playing the projection view.
2. The method for displaying the panoramic picture according to claim 1, wherein the step of acquiring the panoramic picture and dividing the panoramic picture into a plurality of pictures comprises:
taking and storing the pictures through a camera;
screening pictures with the field angle larger than 120 degrees to obtain a panoramic photo;
and dividing the panoramic picture into a plurality of pictures according to the size of the field angle.
3. The method for displaying a panoramic picture according to claim 2, wherein the step of dividing the panoramic picture into several pictures according to the size of the field angle comprises:
dividing the panoramic picture with the field angle larger than 180 degrees and smaller than 270 degrees into three pictures, wherein the three pictures sequentially comprise a right picture, a front picture and a left picture; and dividing the panoramic picture with the field angle larger than 270 degrees into four pictures, wherein the four pictures sequentially comprise a right picture, a front picture, a left picture and a rear picture.
4. The method for displaying a panoramic picture according to claim 3, wherein the cube model is constructed by Opengles, and the cube model includes six plane views, including a front view, a rear view, a right view, a left view, a top view, and a bottom view.
5. The method for displaying the panoramic picture according to claim 4, wherein the step of mapping the plurality of pictures onto the cube model to obtain the 3D panoramic picture comprises:
pasting the cut right map to a right view of the cube model;
mapping the cut front map to the front view of the cube model
Mapping the cut left map to the left view of the cube model
And pasting the cut back map corresponding map to the back view of the cube model.
6. The method for displaying a panoramic picture according to claim 5, wherein the step of automatically playing the projection view specifically includes:
setting the center of the cube model as an observation point;
setting a moving direction, a moving speed and a moving time;
and sequentially rolling the right view, the front view, the left view and the rear view of the panoramic picture according to the moving time from left to right or from right to left of the observation point.
7. The method for displaying a panoramic picture according to claim 1, wherein the step of performing projection processing on the 3D panoramic picture to obtain a projection view of the panoramic picture further comprises:
setting the center of the cube model as an observation point;
setting parameters of an attitude sensor;
and rotating the attitude sensor left and right to sequentially display the projection views of the panoramic picture.
8. A display device of a panoramic picture, comprising:
panoramic picture acquisition module: the system comprises a camera, a panoramic picture acquisition unit and a panoramic image acquisition unit, wherein the camera is used for acquiring the panoramic picture;
panoramic picture processing module: the method comprises the steps of constructing an Opengles construction model for constructing a cube model, mapping the panoramic picture on the cube model to obtain a 3D panoramic picture, and then performing projection processing to obtain a projection view of the panoramic picture; and
panoramic picture display module: and the projection view is used for displaying or playing the panoramic picture.
9. The device of claim 8, wherein the panorama display module comprises a gesture sensor, the gesture sensor comprising one or more of a three-axis gyroscope, a three-axis accelerometer, and a three-axis electronic compass, and an embedded ARM processor, the ARM processor obtaining three-dimensional gesture and orientation data of the panorama by temperature compensation.
10. A storage medium, characterized in that the storage medium has stored thereon a computer program which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110257457.0A CN113096008A (en) | 2021-03-09 | 2021-03-09 | Panoramic picture display method, display device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110257457.0A CN113096008A (en) | 2021-03-09 | 2021-03-09 | Panoramic picture display method, display device and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113096008A true CN113096008A (en) | 2021-07-09 |
Family
ID=76666678
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110257457.0A Pending CN113096008A (en) | 2021-03-09 | 2021-03-09 | Panoramic picture display method, display device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113096008A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP7262560B1 (en) | 2021-12-08 | 2023-04-21 | アイチップス・テクノロジー株式会社 | Image processing device, program, and image processing method |
| CN117197319A (en) * | 2023-11-07 | 2023-12-08 | 腾讯科技（深圳）有限公司 | Image generation method, device, electronic equipment and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103106335A (en) * | 2012-12-29 | 2013-05-15 | 北京百度网讯科技有限公司 | Method and device for recording and displaying three-dimensional views through mobile terminal and mobile terminal |
| CN103177472A (en) * | 2012-09-20 | 2013-06-26 | 深圳市金立通信设备有限公司 | System and method for three-dimensional panoramic picture synthesis and display |
| CN103632627A (en) * | 2013-12-12 | 2014-03-12 | 北京清城睿现数字科技研究院有限公司 | Information display method and apparatus and mobile navigation electronic equipment |
| US9582731B1 (en) * | 2014-04-15 | 2017-02-28 | Google Inc. | Detecting spherical images |
| CN108765582A (en) * | 2018-04-28 | 2018-11-06 | 青岛海信电器股份有限公司 | A kind of panoramic pictures display methods and equipment |
| WO2018227424A1 (en) * | 2017-06-14 | 2018-12-20 | 李程 | Head-mounted display, and display screen, head-mounted bracket and video thereof |
| CN111913635A (en) * | 2020-08-14 | 2020-11-10 | 广东申义实业投资有限公司 | Three-dimensional panoramic picture display method and device, mobile terminal and storage medium |
-
2021
- 2021-03-09 CN CN202110257457.0A patent/CN113096008A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103177472A (en) * | 2012-09-20 | 2013-06-26 | 深圳市金立通信设备有限公司 | System and method for three-dimensional panoramic picture synthesis and display |
| CN103106335A (en) * | 2012-12-29 | 2013-05-15 | 北京百度网讯科技有限公司 | Method and device for recording and displaying three-dimensional views through mobile terminal and mobile terminal |
| CN103632627A (en) * | 2013-12-12 | 2014-03-12 | 北京清城睿现数字科技研究院有限公司 | Information display method and apparatus and mobile navigation electronic equipment |
| US9582731B1 (en) * | 2014-04-15 | 2017-02-28 | Google Inc. | Detecting spherical images |
| WO2018227424A1 (en) * | 2017-06-14 | 2018-12-20 | 李程 | Head-mounted display, and display screen, head-mounted bracket and video thereof |
| CN108765582A (en) * | 2018-04-28 | 2018-11-06 | 青岛海信电器股份有限公司 | A kind of panoramic pictures display methods and equipment |
| CN111913635A (en) * | 2020-08-14 | 2020-11-10 | 广东申义实业投资有限公司 | Three-dimensional panoramic picture display method and device, mobile terminal and storage medium |
Non-Patent Citations (3)
| Title |
|---|
| 刘海娜: "基于HTML5的全景漫游技术研究", 《中国优秀硕士学位论文全文数据库（信息科技辑）》 * |
| 赵欣: "Flash 3D虚拟科技馆的设计与开发", 《中国优秀硕士学术论文全文数据库（信息科技辑）》 * |
| 黄小斌: "基于单张全景图的室内深度估计", 《中国优秀硕士学位论文全文数据库（信息科技辑）》 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP7262560B1 (en) | 2021-12-08 | 2023-04-21 | アイチップス・テクノロジー株式会社 | Image processing device, program, and image processing method |
| WO2023105924A1 (en) * | 2021-12-08 | 2023-06-15 | アイチップス・テクノロジー株式会社 | Image processing device, program, and image processing method |
| CN117197319A (en) * | 2023-11-07 | 2023-12-08 | 腾讯科技（深圳）有限公司 | Image generation method, device, electronic equipment and storage medium |
| CN117197319B (en) * | 2023-11-07 | 2024-03-22 | 腾讯科技（深圳）有限公司 | Image generation method, device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107564089B (en) | Three-dimensional image processing method, device, storage medium and computer equipment | |
| Szeliski et al. | Creating full view panoramic image mosaics and environment maps | |
| CN109118582B (en) | Commodity three-dimensional reconstruction system and reconstruction method | |
| JP6775776B2 (en) | Free viewpoint movement display device | |
| Wagner et al. | Real-time panoramic mapping and tracking on mobile phones | |
| US6757446B1 (en) | System and process for image-based relativistic rendering | |
| US7747105B2 (en) | Method for the rotation compensation of spherical images | |
| CN108805917A (en) | Sterically defined method, medium, device and computing device | |
| WO2023280038A1 (en) | Method for constructing three-dimensional real-scene model, and related apparatus | |
| US11044398B2 (en) | Panoramic light field capture, processing, and display | |
| Bradley et al. | Image-based navigation in real environments using panoramas | |
| CN111161398B (en) | Image generation method, device, equipment and storage medium | |
| CN112954292B (en) | Digital museum navigation system and method based on augmented reality | |
| CN113096008A (en) | Panoramic picture display method, display device and storage medium | |
| KR20190011492A (en) | Device for providing content and method of operating the same | |
| WO2022017779A2 (en) | Map for augmented reality | |
| CN114549289A (en) | Image processing method, image processing device, electronic equipment and computer storage medium | |
| JP4710081B2 (en) | Image creating system and image creating method | |
| JP3660108B2 (en) | Image storage method and machine-readable medium | |
| JP2004310686A (en) | Image processing method and device | |
| CN113096221A (en) | Panoramic picture AR display method, display device and storage medium | |
| CN113961068A (en) | Close-distance real object eye movement interaction method based on augmented reality helmet | |
| Marek et al. | Optimization of 3d rendering in mobile devices | |
| CN110827411B (en) | Method, device, equipment and storage medium for displaying augmented reality model of self-adaptive environment | |
| JP2002092597A (en) | Method and device for processing image |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210709 |