CN105915885A - 3D interaction display method and system of fish-eye image - Google Patents
3D interaction display method and system of fish-eye image Download PDFInfo
- Publication number
- CN105915885A CN105915885A CN201610116572.5A CN201610116572A CN105915885A CN 105915885 A CN105915885 A CN 105915885A CN 201610116572 A CN201610116572 A CN 201610116572A CN 105915885 A CN105915885 A CN 105915885A
- Authority
- CN
- China
- Prior art keywords
- model
- eye images
- fish eye
- quadrants
- state
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/388—Volumetric displays, i.e. systems where the image is built up from picture elements distributed through a volume
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/275—Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals
Abstract
The invention discloses a 3D interaction display method and system of a fish-eye image. The method comprises the following steps: performing 3D display on the fish-eye image according to a preselected 3D display model; during the 3D display of the fish-eye image, reading an interaction message for model state updating, and according to information of the interaction message, performing calculation by use of a method of the 3D display model, and performing interaction on the image displayed in a 3D mode; and continuously waiting or processing a new interaction message until withdrawal. According to the invention, interaction operation is enabled to be more smooth and user-friendly, and the experience effect is better. The display effect is more excellent, there are no blind angles, and a user has a vivid visual sense.
Description
Technical field
The present invention relates to panorama Display Technique, especially for the 3D interactive display method of the image of fish eye lens shooting
And system, be applied to virtual reality, scientific research, entertain, the various fields such as monitoring.
Background technology
Fish eye images refers to use the image of fish eye lens shooting, as it is shown in figure 1, the field range comprised is wide, generally
The fish-eye horizontal and vertical visual field equals or exceeds 360 ° x180 °, applies more and more extensive in recent years, example
As virtual reality, scientific research, entertain, monitoring field.
Existing fish eye images is when display, and its distortion is very serious, is not the rectangle of human eye custom, but a circle
Shape, it is therefore desirable to the fish eye images that flake is to be shown is corrected so that it is meet the visual custom of human eye.
The bearing calibration of existing fish eye images, such as spherical imaging model, parabola imaging model, longitude correction model
Deng, the mutual Display Technique of existing flake, it is common that preset several points in fish eye images, obtained by correcting algorithm
Distortionless partial correction image centered by each preset point, they are tiled on screen and watch, and correct
It is shown as a certain rectangular area.
But existing fish eye images corrects the process that Display Technique interacts at the interaction message inputted according to equipment alternately
In, then carry out the shortcoming of this interactive display method of the mode corrected again of fish eye images it is clear that can only see with in advance
A limited number of visual angle centered by putting a little, other information being included in fish eye images is then missed so that field range
Greatly reducing, effect is similar with multiple common camera, and fish eye images does not has as the superiority of a kind of panoramic picture
Have and embodied.Embodiment is that existing mutual correction Display Technique is the most convenient, operation location inaccuracy, aobvious after correction
The effect shown is undesirable, distorts bigger.
Summary of the invention
The present invention is directed to the above-mentioned problems in the prior art, propose the 3D interactive display method of a kind of fish eye images
And system.Fish eye images is changed into the exchange method after 3D model by it, it is achieved fisheye photo and/or video multiple
3D shows and mutual, and positioning action is more accurate, and experience effect is more preferable.
The technical scheme is that
The 3D interactive display method of a kind of fish eye images is provided, comprises the steps:
According to the 3D display model being pre-selected, fish eye images is carried out 3D show；
While fish eye images 3D shows, read interaction message and carry out model state renewal, disappear alternately according to described
The method of the Information Pull 3D display model of breath calculates, and the image showing 3D interacts；
Continue waiting for or process new interaction message, until exiting.
For realizing the object of the invention, also provide for the 3D interactive display system of a kind of fish eye images.
There is advantages that
The 3D interactive display method of fish eye images of the present invention and system, fish eye images is changed into the friendship after 3D model by it
Mutually, the panoramic information that fish eye images is comprised does not has any omission.Interactive operation is more smooth and hommization, experience effect
More preferably.Display effect is more excellent, without dead angle, has direct feel on the spot in person.It realizes fisheye photo and video
Multiple 3D shows and mutual, and positioning action is more accurate, and experience effect is more preferable.
Accompanying drawing explanation
In order to be illustrated more clearly that the technical scheme of the embodiment of the present invention, required attached in embodiment being described below
Figure does simple introduction, it should be apparent that, drawings discussed below is only some embodiments of the present invention, for this
From the point of view of the those of ordinary skill of field, on the premise of not paying creative work, it is also possible to obtain it according to these accompanying drawings
His accompanying drawing.
Fig. 1 is original fish eye images schematic diagram.
Fig. 2 is 3D model coordinate systems and the point of observation schematic diagram of the embodiment of the present invention.
Fig. 3 (a) is the original fish eye images disk plane model schematic of embodiment of the present invention Fig. 1.
Fig. 3 (b) is the original fish eye images rectangle plane model schematic of embodiment of the present invention Fig. 1.
Fig. 4 (a) be the hemisphere/Sphere Measurement Model of the embodiment of the present invention be respectively used to fish eye lens level upwards time shooting flake
Image schematic diagram.
Fig. 4 (b) be the hemisphere/Sphere Measurement Model of the embodiment of the present invention be respectively used to fish eye lens level downward time shooting flake
Image schematic diagram.
Fig. 5 is the cylinder model schematic of the embodiment of the present invention.
Fig. 6 is the coordinate system schematic diagram of the interactive display region of the embodiment of the present invention.
Fig. 7 is the 3D interactive display method schematic diagram of embodiment of the present invention fish eye images.
Fig. 8 is the token state schematic diagram of the record of the embodiment of the present invention.
Fig. 9 is the X/Y plane that is imaged on of the embodiment of the present invention, and rotary shaft is the coordinate axes schematic diagram of Z axis.
Figure 10 is the X/Y plane that is imaged on of the embodiment of the present invention, and rotary shaft is the spinning solution of Z axis planar development image
Flow chart.
Figure 11 is that removing of the embodiment of the present invention is imaged on X/Y plane, and rotary shaft is the rotation of the planar development image outside Z axis
Shifting method flow chart.
Detailed description of the invention
Concrete to 3D interactive display method and the system of the fish eye images of the embodiment of the present invention below in conjunction with Figure of description
Embodiment elaborates.
The present invention utilizes 3D Rendering, such as OpenGL, sets up 3D model, such as ball, hemisphere, cylinder,
Cube, plane etc.；Fish eye images is attached on 3D model as texture image；By interactive operation, change mould
Type size/orientation, viewpoint position, direction of visual lines and visual field size etc.；3D rendering result shows at screen the most at last
On.
As in figure 2 it is shown, 3D model coordinate systems and the definition [Descartes (Descartes) of OpenGL world coordinate system
Right-handed coordinate system] it is consistent, it is simple to use OpenGL technology to carry out 3D and render.Wherein, display window is positioned at
In x/y plane, z-axis positive direction is pointed to outside display window.
For most models, observation place is for check towards Z axis negative direction from Z axis positive direction, as shown in Figure 2.
Fig. 3 (a) disk model is generally used for showing the original fish eye images of Fig. 1.Fig. 3 (b) rectangular model is generally used for exhibition
Show various expanded view, such as 360 ° expansion, 180 ° of expansion, fixed point local expansions etc..The central point position of areal model
(0,0,0) position in coordinate system.
Fig. 4 (a) (b) hemisphere/Sphere Measurement Model be respectively used to fish eye lens level up and down time shooting fish eye images.
The cylinder model supports camera lens level of Fig. 5 upwards, downward both of which.
In order to the image after making 3D render is more suitable for the angle of observer, the embodiment of the present invention achieves a kind of fish-eye image
The 3D interactive display method of picture, it is by interactive operation in viewing area, dynamic adjustment model position and towards.
Wherein, as shown in Figure 6, the upper left corner in region is zero (0,0) to the coordinate system of interactive display region, is to the right
X positive direction, is Y-axis positive direction downwards, and the lower right corner coordinate in region is that (w, h), w is that the width of viewing area is (single
Position: pixel Pixel), h is height (unit: pixel Pixel).
As it is shown in fig. 7, the display of model comprises two main process, top is media stream waterline flow for displaying, under
Portion is interaction message circulation process.Top obtains model state from the flow process of bottom.
The 3D interactive display method of the fish eye images in the embodiment of the present invention, can apply OpenGL or D3D technology
Middle realization.
Below as a example by OpenGL, the 3D interactive display method of the fish eye images of the embodiment of the present invention, including as follows
Step:
According to the 3D display model being pre-selected, fish eye images is carried out 3D show；
While display 3D rendering, read interaction message and carry out model state renewal, according to the information of interaction message
The method utilizing 3D display model calculates, and the image showing 3D interacts；
Continue waiting for or process new interaction message, until exiting.
The step of the embodiment of the present invention is described below in detail: entered according to the 3D display model being pre-selected by fish eye images
Row 3D shows.
First, after fish eye images is processed as texture image, according to 3D display model is pre-selected, obtain correspondence
3D apex coordinate array, texture coordinate array and vertex index array.
Fish eye images can such as crop, directly or through simple process, the black region not having image information, makees
For texture image.
Select concrete 3D display model (such as disk, hemisphere, cylinder, 360 degree of level exhibitions according to system current setting
Open, visual angle planar development, asteroid etc.), obtain correspondence 3D apex coordinate array, texture coordinate array and
Vertex index array.
Then, according to the state of checking of "current" model, use the model conversion of OpenGL, the viewport transform, projection to become
Change power function and the parameters such as modal position, observation place, viewing area are set.
Thereafter, the binded texture power function of OpenGL is used to bind texture image.
Finally, use OpenGL to render function to carry out 3D and render.
The embodiment of the present invention, as a kind of embodiment, illustrates as a example by video:
Image stream data is isolated from video；
It is decoded obtaining two field picture by image stream data；
Using two field picture directly or through after simple process as texture image, the process with fish eye images is identical.
The step of the embodiment of the present invention is described below in detail: while display 3D rendering, reads interaction message and carry out
Model state updates, and calculates according to the method for the Information Pull 3D display model of interaction message, shows 3D
Image interacts.
In order to the image after making expansion is more suitable for the angle of observer, the therefore embodiment of the present invention 3D by fish eye images
Interactive display method, it is achieved regulate modal position in viewing area alternately.
First, analyze the type of interaction message, resolve and become basic operation type.
The type of described interaction message, includes but not limited to that the input type of the computers such as mouse, touch-control, sensor is defeated
The message entered.
By interaction message resolve become basic operation type, as control point move into place from position (x0, y0) (x1,
Y1), or delta times is zoomed in or out centered by (x0, y0).It is a kind of prior art, therefore in the present invention
In embodiment, describe in detail the most one by one.
Then, input message is calculated according to the method for 3D display model, obtains new model state, will be new
Model state be applied to current fish eye images and interact display.
As a kind of embodiment, describe the model described in the embodiment of the present invention in detail below by multiple embodiments
State and the method for 3D display model.
As one preferably embodiment, each 3D model has the display state of correspondence, when switching model,
The state of first keeping records master mould, reapplies new model state, in of short duration switching moment after stress model data
Seamless display can be reached, improve Consumer's Experience effect.
Model state includes but not limited to the world coordinate system matrix (world matrix) of "current" model, model coordinate systems
Matrix (project matrix), observation matrix (view matrix), viewport (viewport).
In embodiments of the present invention, when window viewing area changes, viewport changes accordingly, in the case of other
Viewport keeps constant.As a kind of embodiment, viewport value (viewport) is whole drafting relief area (backbuffer)
Size.
In order to be calculated the result of variations of model state flexibly, in the embodiment of the present invention, as shown in Figure 8, except note
Record initial three state matrixs (world matrix, project matrix, view matrix), be also recorded for each
Model corresponding to the token state of these three matrix, be included in anglec of rotation dx of tri-coordinate axess of X, Y, Z, dy,
Displacement offsetX on dz and three directions, offsetY, offsetZ, point of observation state (eye, at, up,
aspect、fovy、zn、zf).Model state amount is expressed as follows by a structure form:
struct model_state
{
float eye[3]；
float at[3]；
float up[3]；
float fovy；
float aspect；
float zn；
float zf；
Float offsetX, offsetY, offsetZ；
Float dx, dy, dz；
}；
Wherein, eye represents the coordinate of point of observation in a coordinate system, and at represents the position, direction observing sight line, and up represents
Relative to the upwards positive direction of direction of observation, fovy is viewing angle, and aspect is the transverse and longitudinal ratio of viewing angle, and zn is
The distance of projection hither plane, zf is the distance of far plane, and offsetX, offsetY, offsetZ are followed successively by model at coordinate
Being the displacement on three change in coordinate axis direction, dx, dy, dz model successively is relative to the anglec of rotation of three coordinate axess.
Enforcement one:
As a kind of embodiment, when needing to zoom in or out model scale and being original delta times, adjust current
The method of the fovy of model state, 3D display model is:
Fovy=fovy/delta
When i.e. visual angle diminishes, it is seen that scope diminish, in the viewing area of equal size, show that image becomes big；Visual angle
When becoming big, in the viewing area of equal size, image diminishes.
Enforcement two:
As another kind of embodiment, in embodiments of the present invention, when control point is moved, corresponding different model
Different effects can be brought.When model is checked, having the effects such as different translations and rotation, therefore, described 3D shows
The method of representation model is:
Judging according to employing point (x0, y0) after actual viewing area pixel value size one threshold value of setting of rotational steps
Distance D to (x1, y1) calculates as approaching value, and this distance D is with the ratio of viewing area width w
The anglec of rotation of the present embodiment operation z-axis, and result is added on the dz variable of status architecture.
As another kind more preferably embodiment, in the embodiment of the present invention, utilize the side of three kinds of different 3D display models
Method obtains new model state:
A) spinning solution of planar development image；
B) shift method of planar development image；
C) exchange method of ball class stereo-picture；
Three kinds of methods are described below in detail:
Enforcement three:
A) spinning solution of planar development image:
Step A100, if being imaged on X/Y plane, rotary shaft is Z axis, and rotary shaft be positioned at point (x, y) on,
As it is shown in figure 9, venter of relicle therein, operational approach is that control point moves to (x1, y1) from (x0, y0),
(x, moving clockwise or counterclockwise y) is mutual, subsequently into step 3 around point to be one alternately；
111) if the x0 starting point equal to x, i.e. shift position is in Y-axis, step 112 is performed；Otherwise perform
Step 121；
112) if y0 on semiaxis, performs step 113 more than y, i.e. starting point under Y-axis；Otherwise execution step
114；
113) if x1 is more than x0, it is counterclockwise for i.e. obtaining direction of rotation, otherwise is clockwise, subsequently into step 3；
114) if x1 is more than x0, it is clockwise for i.e. obtaining direction of rotation, otherwise is counterclockwise, subsequently into step 3；
121) if the x1 terminating point equal to x, i.e. shift position is in Y-axis, step 122 is performed；Otherwise perform
Step A200；
122) if y1, performs step 123, otherwise performs step on semiaxis more than y, i.e. terminating point under Y-axis
124；
123) if x1 is more than x0, it is counterclockwise for i.e. obtaining direction of rotation, otherwise is clockwise, subsequently into step
Three；
124) if x1 is more than x0, it is clockwise for i.e. obtaining direction of rotation, otherwise is counterclockwise, subsequently into step
Three.
Step A200, otherwise, with (x, y) redefines two coordinate axes X-axis and Y-axis as coordinate axes initial point,
And region is divided into four quadrants, the lower right corner be 1 quadrant, the lower left corner be 2 quadrants, the upper left corner be 3 quadrants, upper right
Angle is 4 quadrants；
Step A300, is calculated k0=(y0-y)/(x0-x), k1=(y1-y)/(x1-x)；
Step A400, according to the comparative result of k0 and k1, carries out new model state between each quadrant by image,
Subsequently into step 3；
Seriality due to signals collecting, it is believed that present case is for move in same quadrant.If k0 is more than k1,
It is then counterclockwise, subsequently into step 3；Otherwise it is clockwise, subsequently into step 3.
Described step A400 comprises the steps:
132) if k0 is more than 0 less than 0 and k1, i.e. move to 1 or 3 quadrants from 2 or 4 quadrants, perform step 133；
Otherwise perform step 139；
133) if x0 is more than y less than x and y0, i.e. start from 2 quadrants mobile, perform step 134, otherwise perform
136；
134) if x1 is more than y more than x and y1,1 quadrant is i.e. moved to, for rotating counterclockwise, subsequently into step
Three；Otherwise perform 135；
135) if x1 is less than y less than x and y1,3 quadrants are i.e. moved to, for turning clockwise, subsequently into step
Three；
136) if x0 is less than y more than x and y0, i.e. start from 4 quadrants mobile, perform step 137；
137) if x1 is more than y more than x and y1,1 quadrant is i.e. moved to, for turning clockwise, subsequently into step
Three；Otherwise perform 138；
138) if x1 is less than y less than x and y1,3 quadrants are i.e. moved to, for rotating counterclockwise, subsequently into step
Three；
139) if k0 is less than 0 more than 0 and k1, then move to 2 or 4 quadrants from 1 or 3 quadrants, perform step 1310；
Otherwise enter step 3；
1310) if x0 is less than y less than x and y0, i.e. start from 3 quadrants mobile, perform step 1311, otherwise hold
Row 1313；
1311) if x1 is less than y more than x and y1,4 quadrants are i.e. moved to, for turning clockwise, subsequently into step
Rapid three；Otherwise perform 1312；
1312) if x1 is more than y less than x and y1,2 quadrants are i.e. moved to, for rotating counterclockwise, subsequently into step
Rapid three；
1313) if x0 is more than y more than x and y0, i.e. start from 1 quadrant mobile, perform step 1314；
1314) if x1 is less than y more than x and y1, i.e. move to 4 quadrants, for rotating counterclockwise, otherwise perform 1315；
1315) if x1 is more than y less than x and y1,2 quadrants are i.e. moved to, for turning clockwise, subsequently into step
Rapid three.
Embodiment four:
B) shift method of planar development image
Only when the full size of image is more than viewing area, just allow image is carried out translation display.As one
Embodiment, translates about permission when the length of image is more than viewing area length, when the height of image is more than aobvious
Upper and lower translation is allowed when showing the height in region.
As a kind of embodiment, the shift method of described planar development image comprises the steps:
B1) ratio of the fovy and the fovy of original state of record current state, and current unfolded image corresponds to
The radian value of original fish eye images, and current display area width；
B2) width high model unit ux corresponding to unit display pixel and uy it are calculated；
B3) displacement of calculated level direction obtains mobile range is (x1-x0) * ux, and is added to model state
Dx variable；
B4) calculate vertical direction displacement obtaining mobile range is (y1-y0) * uy, and is added to model state
Dy variable；
B5) again planar development image is generated according to dx and dy.
Embodiment five:
C) exchange method of ball class stereo-picture
Ball class stereomodel, when control point is moved, the effect brought is to rotate model, and rotation mode is
First rotate Z-direction, then rotate Y-direction, then rotate X-direction.Usually, as a kind of embodiment, can
Not consider the rotation of Z-direction, only rotate Y-direction and X-direction.
Put the difference of position according to the observation, be divided into two kinds of computation schemas:
C1) for point of observation outside model in the case of, if during original state, it was observed that angular range be complete model,
I.e. 180 degree, corresponding display pixel wide is w, and height is h.Then calculating the angle rotated when x direction is moved is:
Dx=dx+180* (x1-x0)/w
Dy=dy+180* (y1-y0)/h
Then can rotate dx and dy in x and y direction and obtain the end-state of model.
C2) for point of observation in model in the case of, if the position of the current observation point heart in a model, then computing formula
For:
Dx=dx+fovy*aspect* (x1-x0)/w
Dy=dy+fovy* (y1-y0)/h
After model rotates, adjust in the translation carrying out modal position according to offsetX, offsetY, offsetZ.
The 3D interactive display method of the fish eye images of the embodiment of the present invention and system, fish eye images is changed into 3D mould by it
Mutual after type, the panoramic information that fish eye images is comprised does not has any omission.Interactive operation is more smooth and hommization,
Experience effect is more preferable.Display effect is more excellent, without dead angle, has direct feel on the spot in person.It realizes fisheye photo
Showing with the multiple 3D of video and mutual, positioning action is more accurate, and experience effect is more preferable.
Those of ordinary skill in the art should further appreciate that, describes in conjunction with the embodiments described herein
The unit of each example and algorithm steps, it is possible to electronic hardware, computer software or the two be implemented in combination in,
In order to clearly demonstrate the interchangeability of hardware and software, the most generally describe according to function
The composition of each example and step.These functions perform with hardware or software mode actually, depend on technical scheme
Application-specific and design constraint.Those of ordinary skill in the art can use not Tongfang to each specifically should being used for
Method realizes described function, but this realization is it is not considered that beyond the scope of this invention.
The method described in conjunction with the embodiments described herein or the step of algorithm can hold track with hardware, processor
Software module, or the combination of the two implements.Software module can be placed in random access memory (RAM), internal memory,
Read only memory (ROM), electrically programmable ROM, electrically erasable ROM, depositor, hard disk, can move
In any other form of storage medium well known in movable magnetic disc, CD-ROM or technical field.
Above-described detailed description of the invention, enters track to the purpose of the present invention, technical scheme and beneficial effect and enters one
Step describes in detail, be it should be understood that the detailed description of the invention that the foregoing is only the present invention, is not used to limit
Determine protection scope of the present invention, all within the spirit and principles in the present invention, any amendment of being made, equivalent,
Improve, should be included within the scope of the present invention.
Claims (15)
1. the 3D interactive display method of a fish eye images, it is characterised in that comprise the steps:
According to the 3D display model being pre-selected, fish eye images is carried out 3D show；
While fish eye images 3D shows, read interaction message and carry out model state renewal, disappear alternately according to described
The method of the Information Pull 3D display model of breath calculates, and the image showing 3D interacts；
Continue waiting for or process new interaction message, until exiting.
The interactive display method of fish eye images the most according to claim 1, it is characterised in that described in carry out 3D
Display, comprises the steps:
After fish eye images is processed as texture image, according to 3D display model is pre-selected, obtain the 3D top of correspondence
Point coordinates array, texture coordinate array and vertex index array；
According to the state of checking of "current" model, use the model conversion of OpenGL, the viewport transform, projective transformation function
The parameters such as function setup modal position, observation place, viewing area；
The binded texture power function using OpenGL has bound texture image；
Use OpenGL to render function to carry out 3D and render.
The interactive display method of fish eye images the most according to claim 1, it is characterised in that described model shape
State updates, and also comprises the steps:
When switching model, the state of first keeping records master mould, reapply new model state after stress model data.
The interactive display method of fish eye images the most according to claim 1, it is characterised in that described model state
Including the world coordinate system matrix world matrix of "current" model, model coordinate systems matrix project matrix, observe square
Battle array view matrix, viewport viewport；And each model is for the token state of described three matrixes, be included in X,
Displacement offsetX on anglec of rotation dx of tri-coordinate axess of Y, Z, dy, dz and three directions, offsetY,
OffsetZ, point of observation state (eye, at, up, aspect, fovy, zn, zf)；By model state amount with a knot
Structure bodily form formula is expressed as follows:
struct model_state
{
float eye[3]；
float at[3]；
float up[3]；
float fovy；
float aspect；
float zn；
float zf；
Float offsetX, offsetY, offsetZ；
Float dx, dy, dz；
}；
Wherein, eye represents the coordinate of point of observation in a coordinate system, and at represents the position, direction observing sight line, and up represents
Relative to the upwards positive direction of direction of observation, fovy is viewing angle, and aspect is the transverse and longitudinal ratio of viewing angle, and zn is
The distance of projection hither plane, zf is the distance of far plane, and offsetX, offsetY, offsetZ are followed successively by model at coordinate
Being the displacement on three change in coordinate axis direction, dx, dy, dz model successively is relative to the anglec of rotation of three coordinate axess；
Viewport value viewport is the size of whole drafting relief area.
The interactive display method of fish eye images the most according to claim 4, it is characterised in that when needs amplify or
Reducing model scale when being original delta times, adjust the fovy of "current" model state, computational methods are:
Fovy=fovy/delta
When i.e. visual angle diminishes, it is seen that scope diminish, in the viewing area of equal size, show that image becomes big；Visual angle
When becoming big, in the viewing area of equal size, image diminishes.
The interactive display method of fish eye images the most according to claim 4, it is characterised in that when control point is moved
Time, judging according to employing point (x0, y0) after actual viewing area pixel value size one threshold value of setting of rotational steps
Distance D to (x1, y1) calculates as approaching value；
The ratio of this distance D and viewing area width w is the anglec of rotation of operation z-axis, and result is added to
On the dz variable of status architecture.
The interactive display method of fish eye images the most according to claim 4, it is characterised in that corresponding different
3D display model, utilizes
The spinning solution of planar development image
And/or
The shift method of planar development image
And/or
The exchange method of ball class stereo-picture
Obtain new model state.
The interactive display method of fish eye images the most according to claim 7, it is characterised in that described planar development
The spinning solution of image, comprises the steps:
If being imaged on X/Y plane, rotary shaft is Z axis, and rotary shaft be positioned at point (x, y) on, operational approach is
Control point moves to (x1, y1) from (x0, y0), be alternately one around point (x, y) clockwise or counterclockwise
Mobile mutual, then wait new interaction message or exit；
Otherwise, so that (x y) redefines two coordinate axes X-axis and Y-axis as coordinate axes initial point, and divided in region
Become four quadrants, the lower right corner be 1 quadrant, the lower left corner be 2 quadrants, the upper left corner be 3 quadrants, the upper right corner be 4 quadrants；
It is calculated k0=(y0-y)/(x0-x), k1=(y1-y)/(x1-x)；
According to the comparative result of k0 and k1, image is carried out between each quadrant new model state, then waits
New interaction message or exit.
The interactive display method of fish eye images the most according to claim 8, it is characterised in that described control point from
(x0, y0) moves to (x1, y1), comprises the steps:
111) if the x0 starting point equal to x, i.e. shift position is in Y-axis, step 112 is performed；Otherwise perform
Step 121；
112) if y0 on semiaxis, performs step 113 more than y, i.e. starting point under Y-axis；Otherwise execution step
114；
113) if x1 is more than x0, it is counterclockwise for i.e. obtaining direction of rotation, otherwise is clockwise, then waits new friendship
Mutually message or exit；
114) if x1 is more than x0, it is clockwise for i.e. obtaining direction of rotation, otherwise is counterclockwise, then waits new friendship
Mutually message or exit；
121) if the x1 terminating point equal to x, i.e. shift position is in Y-axis, step 122 is performed；Otherwise with (x,
Y) two coordinate axes X-axis and Y-axis step are redefined as coordinate axes initial point；
122) if y1, performs step 123, otherwise performs step on semiaxis more than y, i.e. terminating point under Y-axis
124；
123) if x1 is more than x0, it is counterclockwise for i.e. obtaining direction of rotation, otherwise is clockwise, then waits new
Interaction message or exit；
124) if x1 is more than x0, it is clockwise for i.e. obtaining direction of rotation, otherwise is counterclockwise, then waits new
Interaction message or exit.
The interactive display method of fish eye images the most according to claim 9, it is characterised in that described by image
Between each quadrant, carry out new model state, comprise the steps:
132) if k0 is more than 0 less than 0 and k1, i.e. move to 1 or 3 quadrants from 2 or 4 quadrants, perform step 133；
Otherwise perform step 139；
133) if x0 is more than y less than x and y0, i.e. start from 2 quadrants mobile, perform step 134, otherwise perform
136；
134) if x1 is more than y more than x and y1, i.e. move to 1 quadrant, for rotating counterclockwise, then wait new
Interaction message or exit；Otherwise perform 135；
135) if x1 is less than y less than x and y1, i.e. move to 3 quadrants, for turning clockwise, then wait new
Interaction message or exit；
136) if x0 is less than y more than x and y0, i.e. start from 4 quadrants mobile, perform step 137；
137) if x1 is more than y more than x and y1, i.e. move to 1 quadrant, for turning clockwise, then wait new
Interaction message or exit；Otherwise perform 138；
138) if x1 is less than y less than x and y1, i.e. move to 3 quadrants, for rotating counterclockwise, then wait new
Interaction message or exit；
139) if k0 is less than 0 more than 0 and k1, then move to 2 or 4 quadrants from 1 or 3 quadrants, perform step 1310；
Otherwise enter step 3；
1310) if x0 is less than y less than x and y0, i.e. start from 3 quadrants mobile, perform step 1311, otherwise hold
Row 1313；
1311) if x1 is less than y more than x and y1, i.e. move to 4 quadrants, for turning clockwise, then wait new
Interaction message or exit；Otherwise perform 1312；
1312) if x1 is more than y less than x and y1, i.e. move to 2 quadrants, for rotating counterclockwise, then wait new
Interaction message or exit；
1313) if x0 is more than y more than x and y0, i.e. start from 1 quadrant mobile, perform step 1314；
1314) if x1 is less than y more than x and y1, i.e. move to 4 quadrants, for rotating counterclockwise, otherwise perform 1315；
1315) if x1 is more than y less than x and y1, i.e. move to 2 quadrants, for turning clockwise, then wait new
Interaction message or exit.
The interactive display method of 11. fish eye images according to claim 7, it is characterised in that when the length of image
Degree translates about during the length of viewing area, the upper and lower translation when the height of image is more than the height of viewing area；
The shift method of described planar development image, comprises the steps:
The ratio of the fovy and the fovy of original state of record current state, and current unfolded image is corresponding to original
The radian value of fish eye images, and current display area width；
It is calculated width high model unit ux corresponding to unit display pixel and uy；
It is (x1-x0) * ux that the displacement of calculated level direction obtains mobile range, and the dx being added to model state becomes
Amount；
Calculate vertical direction displacement obtaining mobile range is (y1-y0) * uy, and the dy being added to model state becomes
Amount；
Again planar development image is generated according to dx and dy.
The interactive display method of 12. fish eye images according to claim 7, it is characterised in that when point of observation exists
Situation outside model, if during original state, it was observed that angular range be complete model, i.e. 180 degree, corresponding is aobvious
Showing that pixel wide is w, height is h；
The exchange method of the most described ball class stereo-picture is to calculate the angle rotated when x direction is moved:
Dx=dx+180* (x1-x0)/w
Dy=dy+180* (y1-y0)/h
Then can rotate dx and dy in x and y direction and obtain the end-state of model.
The interactive display method of 13. fish eye images according to claim 7, it is characterised in that when point of observation exists
Situation in model, if the position of the current observation point heart in a model；
The exchange method of the most described ball class stereo-picture is computing formula:
Dx=dx+fovy*aspect* (x1-x0)/w
Dy=dy+fovy* (y1-y0)/h
After model rotates, adjust in the translation carrying out modal position according to offsetX, offsetY, offsetZ.
The 3D interactive display system of 14. 1 kinds of fish eye images, it is characterised in that include display module, interactive module；
Wherein:
Described display module, shows for fish eye images is carried out 3D according to the 3D display model being pre-selected；
Described interactive module, for while fish eye images 3D shows, reads interaction message and carries out model state more
Newly, calculating according to the method for the Information Pull 3D display model of described interaction message, the image showing 3D enters
Row is mutual；Then proceed to wait or process new interaction message, until exiting.
The 3D interactive display system of 15. fish eye images according to claim 14, it is characterised in that described friendship
Module mutually, including preserving submodule；
Described preservation submodule, is used for when switching model, the state of first keeping records master mould, stress model data
After reapply new model state.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610116572.5A CN105915885A (en) | 2016-03-02 | 2016-03-02 | 3D interaction display method and system of fish-eye image |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610116572.5A CN105915885A (en) | 2016-03-02 | 2016-03-02 | 3D interaction display method and system of fish-eye image |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105915885A true CN105915885A (en) | 2016-08-31 |
Family
ID=56745076
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610116572.5A Pending CN105915885A (en) | 2016-03-02 | 2016-03-02 | 3D interaction display method and system of fish-eye image |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105915885A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108765582A (en) * | 2018-04-28 | 2018-11-06 | 青岛海信电器股份有限公司 | A kind of panoramic pictures display methods and equipment |
| CN109891465A (en) * | 2016-10-12 | 2019-06-14 | 三星电子株式会社 | Method and apparatus for handling virtual reality image |
| CN111343446A (en) * | 2018-12-19 | 2020-06-26 | 杭州海康威视数字技术股份有限公司 | Video image turning display method and device |
| CN113132708A (en) * | 2021-04-22 | 2021-07-16 | 北京房江湖科技有限公司 | Method and apparatus for acquiring three-dimensional scene image using fisheye camera, device and medium |
| WO2023138504A1 (en) * | 2022-01-21 | 2023-07-27 | 北京字跳网络技术有限公司 | Image rendering method and apparatus, electronic device, and storage medium |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060267997A1 (en) * | 2005-05-24 | 2006-11-30 | Walls Jeffrey J | Systems and methods for rendering graphics in a multi-node rendering system |
| CN101055494A (en) * | 2006-04-13 | 2007-10-17 | 上海虚拟谷数码科技有限公司 | Dummy scene roaming method and system based on spatial index cube panoramic video |
| CN101340598A (en) * | 2008-08-07 | 2009-01-07 | 北京衡准科技有限公司 | Method and apparatus for implementing three-dimensional playing of media |
| CN101789132A (en) * | 2010-01-22 | 2010-07-28 | 苏州领航自动化科技有限公司 | Display method of single-view multiple OpenGL viewports |
| CN101938599A (en) * | 2009-06-30 | 2011-01-05 | 爱国者全景(北京)网络科技发展有限公司 | Method for generating interactive dynamic panoramic image |
| CN102044084A (en) * | 2009-10-22 | 2011-05-04 | 上海杉达学院 | Two-dimensional plane expression method of three-dimensional graph |
| CN102509334A (en) * | 2011-09-21 | 2012-06-20 | 北京捷成世纪科技股份有限公司 | Method for converting virtual 3D (Three-Dimensional) scene into 3D view |
| CN103247072A (en) * | 2013-04-15 | 2013-08-14 | 青岛海信宽带多媒体技术有限公司 | Method and device for realizing three-dimensional rotating interface based on Android system |
| WO2014148394A1 (en) * | 2013-03-19 | 2014-09-25 | 株式会社日立国際電気 | Image display device and image display method |
| CN104581119A (en) * | 2014-12-31 | 2015-04-29 | 青岛歌尔声学科技有限公司 | Display method of 3D images and head-wearing equipment |
| CN104915994A (en) * | 2015-07-06 | 2015-09-16 | 上海玮舟微电子科技有限公司 | 3D view drawing method and system of three-dimensional data |
| CN105208368A (en) * | 2015-09-23 | 2015-12-30 | 北京奇虎科技有限公司 | Method and device for displaying panoramic data |
-
2016
- 2016-03-02 CN CN201610116572.5A patent/CN105915885A/en active Pending
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060267997A1 (en) * | 2005-05-24 | 2006-11-30 | Walls Jeffrey J | Systems and methods for rendering graphics in a multi-node rendering system |
| CN101055494A (en) * | 2006-04-13 | 2007-10-17 | 上海虚拟谷数码科技有限公司 | Dummy scene roaming method and system based on spatial index cube panoramic video |
| CN101340598A (en) * | 2008-08-07 | 2009-01-07 | 北京衡准科技有限公司 | Method and apparatus for implementing three-dimensional playing of media |
| CN101938599A (en) * | 2009-06-30 | 2011-01-05 | 爱国者全景(北京)网络科技发展有限公司 | Method for generating interactive dynamic panoramic image |
| CN102044084A (en) * | 2009-10-22 | 2011-05-04 | 上海杉达学院 | Two-dimensional plane expression method of three-dimensional graph |
| CN101789132A (en) * | 2010-01-22 | 2010-07-28 | 苏州领航自动化科技有限公司 | Display method of single-view multiple OpenGL viewports |
| CN102509334A (en) * | 2011-09-21 | 2012-06-20 | 北京捷成世纪科技股份有限公司 | Method for converting virtual 3D (Three-Dimensional) scene into 3D view |
| WO2014148394A1 (en) * | 2013-03-19 | 2014-09-25 | 株式会社日立国際電気 | Image display device and image display method |
| CN103247072A (en) * | 2013-04-15 | 2013-08-14 | 青岛海信宽带多媒体技术有限公司 | Method and device for realizing three-dimensional rotating interface based on Android system |
| CN104581119A (en) * | 2014-12-31 | 2015-04-29 | 青岛歌尔声学科技有限公司 | Display method of 3D images and head-wearing equipment |
| CN104915994A (en) * | 2015-07-06 | 2015-09-16 | 上海玮舟微电子科技有限公司 | 3D view drawing method and system of three-dimensional data |
| CN105208368A (en) * | 2015-09-23 | 2015-12-30 | 北京奇虎科技有限公司 | Method and device for displaying panoramic data |
Non-Patent Citations (2)
| Title |
|---|
| 崔璟: "基于OpenGL的三维视景的建立", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
| 牛凤枝: "一种基于OpenGL的三维场景再现研究", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109891465A (en) * | 2016-10-12 | 2019-06-14 | 三星电子株式会社 | Method and apparatus for handling virtual reality image |
| CN109891465B (en) * | 2016-10-12 | 2023-12-29 | 三星电子株式会社 | Method and device for processing virtual reality image |
| CN108765582A (en) * | 2018-04-28 | 2018-11-06 | 青岛海信电器股份有限公司 | A kind of panoramic pictures display methods and equipment |
| CN111343446A (en) * | 2018-12-19 | 2020-06-26 | 杭州海康威视数字技术股份有限公司 | Video image turning display method and device |
| CN111343446B (en) * | 2018-12-19 | 2021-11-02 | 杭州海康威视数字技术股份有限公司 | Video image turning display method and device |
| CN113132708A (en) * | 2021-04-22 | 2021-07-16 | 北京房江湖科技有限公司 | Method and apparatus for acquiring three-dimensional scene image using fisheye camera, device and medium |
| CN113132708B (en) * | 2021-04-22 | 2022-02-22 | 贝壳找房(北京)科技有限公司 | Method and apparatus for acquiring three-dimensional scene image using fisheye camera, device and medium |
| WO2023138504A1 (en) * | 2022-01-21 | 2023-07-27 | 北京字跳网络技术有限公司 | Image rendering method and apparatus, electronic device, and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107564089B (en) | Three-dimensional image processing method, device, storage medium and computer equipment | |
| US10957011B2 (en) | System and method of capturing and rendering a stereoscopic panorama using a depth buffer | |
| CN105915885A (en) | 3D interaction display method and system of fish-eye image | |
| CN107146274B (en) | Image data processing system, texture mapping compression method and method for generating panoramic video | |
| CN101968890B (en) | 360-degree full-view simulation system based on spherical display | |
| CN105869110B (en) | The method for customizing and device of method for displaying image and device, abnormal curved surface curtain | |
| CN108898630A (en) | A kind of three-dimensional rebuilding method, device, equipment and storage medium | |
| WO2017113731A1 (en) | 360-degree panoramic displaying method and displaying module, and mobile terminal | |
| CN107330964B (en) | Display method and system of complex three-dimensional object | |
| CN106485772B (en) | Panorama switching method and system | |
| CN106570938A (en) | OPENGL based panoramic monitoring method and system | |
| CN108282694B (en) | Panoramic video rendering method and device and electronic equipment | |
| CA2995665C (en) | Image generating apparatus and image display control apparatus for a panoramic image | |
| CN107341846B (en) | Method and device for displaying large-scale three-dimensional reconstruction scene in real time | |
| CN103077546B (en) | The three-dimensional perspective transform method of X-Y scheme | |
| CN110648274B (en) | Method and device for generating fisheye image | |
| CN107145224B (en) | Human eye sight tracking and device based on three-dimensional sphere Taylor expansion | |
| CN105809729B (en) | A kind of spherical panorama rendering method of virtual scene | |
| CN102411793A (en) | Object display method in three-dimensional scene | |
| CN108230430B (en) | Cloud layer mask image processing method and device | |
| CN109146775A (en) | Two-dimension picture conversion method, device, equipment and storage medium | |
| CN108510433B (en) | Space display method and device and terminal | |
| JP4592917B2 (en) | Image generating apparatus and game apparatus | |
| CN113253843B (en) | Indoor virtual roaming realization method and realization system based on panorama | |
| CN115311133A (en) | Image processing method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160831 |