CN104700383B - A kind of multiple focussing image generating means and multiple focussing image document handling method - Google Patents
A kind of multiple focussing image generating means and multiple focussing image document handling method Download PDFInfo
- Publication number
- CN104700383B CN104700383B CN201510143495.8A CN201510143495A CN104700383B CN 104700383 B CN104700383 B CN 104700383B CN 201510143495 A CN201510143495 A CN 201510143495A CN 104700383 B CN104700383 B CN 104700383B
- Authority
- CN
- China
- Prior art keywords
- image
- multiple focussing
- distance
- imaging
- linear array
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims description 36
- 238000003384 imaging method Methods 0.000 claims abstract description 164
- 210000005252 bulbus oculi Anatomy 0.000 claims description 25
- 230000004927 fusion Effects 0.000 claims description 17
- 230000015572 biosynthetic process Effects 0.000 claims description 16
- 238000012545 processing Methods 0.000 claims description 16
- 238000000605 extraction Methods 0.000 claims description 15
- 238000010276 construction Methods 0.000 abstract description 7
- 238000003672 processing method Methods 0.000 abstract description 4
- 230000009286 beneficial effect Effects 0.000 abstract description 2
- 230000000712 assembly Effects 0.000 abstract 1
- 238000000429 assembly Methods 0.000 abstract 1
- 230000033001 locomotion Effects 0.000 description 53
- 210000001508 eye Anatomy 0.000 description 18
- 239000000203 mixture Substances 0.000 description 8
- 238000012856 packing Methods 0.000 description 7
- 230000008569 process Effects 0.000 description 7
- 230000035945 sensitivity Effects 0.000 description 7
- 239000007787 solid Substances 0.000 description 7
- 101100117236 Drosophila melanogaster speck gene Proteins 0.000 description 6
- 238000010586 diagram Methods 0.000 description 6
- 238000006073 displacement reaction Methods 0.000 description 6
- 238000010606 normalization Methods 0.000 description 6
- 238000004422 calculation algorithm Methods 0.000 description 5
- 239000003086 colorant Substances 0.000 description 4
- 230000008859 change Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 239000004744 fabric Substances 0.000 description 3
- 238000009434 installation Methods 0.000 description 3
- 238000013507 mapping Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000004088 simulation Methods 0.000 description 3
- 230000009466 transformation Effects 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 2
- 230000006835 compression Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000005538 encapsulation Methods 0.000 description 2
- 210000003128 head Anatomy 0.000 description 2
- 238000002955 isolation Methods 0.000 description 2
- 238000009738 saturating Methods 0.000 description 2
- 238000000926 separation method Methods 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 230000007704 transition Effects 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- PCTMTFRHKVHKIS-BMFZQQSSSA-N (1s,3r,4e,6e,8e,10e,12e,14e,16e,18s,19r,20r,21s,25r,27r,30r,31r,33s,35r,37s,38r)-3-[(2r,3s,4s,5s,6r)-4-amino-3,5-dihydroxy-6-methyloxan-2-yl]oxy-19,25,27,30,31,33,35,37-octahydroxy-18,20,21-trimethyl-23-oxo-22,39-dioxabicyclo[33.3.1]nonatriaconta-4,6,8,10 Chemical compound C1C=C2C[C@@H](OS(O)(=O)=O)CC[C@]2(C)[C@@H]2[C@@H]1[C@@H]1CC[C@H]([C@H](C)CCCC(C)C)[C@@]1(C)CC2.O[C@H]1[C@@H](N)[C@H](O)[C@@H](C)O[C@H]1O[C@H]1/C=C/C=C/C=C/C=C/C=C/C=C/C=C/[C@H](C)[C@@H](O)[C@@H](C)[C@H](C)OC(=O)C[C@H](O)C[C@H](O)CC[C@@H](O)[C@H](O)C[C@H](O)C[C@](O)(C[C@H](O)[C@H]2C(O)=O)O[C@H]2C1 PCTMTFRHKVHKIS-BMFZQQSSSA-N 0.000 description 1
- 241000251468 Actinopterygii Species 0.000 description 1
- 125000000174 L-prolyl group Chemical group [H]N1C([H])([H])C([H])([H])C([H])([H])[C@@]1([H])C(*)=O 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000009795 derivation Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000035772 mutation Effects 0.000 description 1
- 238000012634 optical imaging Methods 0.000 description 1
- 239000002245 particle Substances 0.000 description 1
- 230000002688 persistence Effects 0.000 description 1
- 230000000644 propagated effect Effects 0.000 description 1
- 230000000630 rising effect Effects 0.000 description 1
Landscapes
- Studio Devices (AREA)
Abstract
The present invention relates to a kind of multiple focussing image file format and generating means and image file processing method.It is characterized in that：Image file is by the image construction of at least two different image distances, described image image distance or as distance values record is in described image file;Device is made up of one group of imaging lens system, at least two groups monofocal image-forming assemblies, and the monofocal image-forming assembly includes spectroscope, imaging unit, and some light of imaging lens system is distributed to described imaging unit and is imaged by spectroscope;Device is made up of imaging len, zoom lens control device, imaging unit;Device is made up of in the linear array photosensitive unit of same image distance plane in tandem and not one group of imaging len, at least two groups, and the linear array photosensitive unit forms image by rotation sweep;Beneficial effect is：All focusing surface images of far and near different objects can be shot by multiple focussing image generating means, and generate a kind of multiple focussing image file format, image file can so be handled in the later stage.
Description
Present patent application is divisional application.The application number of original bill is：2012105432727；The applying date is：
20121216；Denomination of invention is：" a kind of multiple focussing image file format and generating means and image file processing method ".
Technical field
The present invention relates to a kind of multiple focussing image file format and generating means and image file processing method.
Background technology
Image file format is record and the form for storing image information, and digital picture is stored, handle, propagated,
It must use certain picture format, that is, the pixel of image according to certain mode is carried out tissue and storage, image
Data storage must arrive image file into file.Image file format is determined deposit what type of letter hereof
Breath, how compatible with various application software file is, file how with other exchange files data.
Current picture form has：BMP (Bitmap) form, TIFF (TagImage File Format) form
（Tiff format can add author, copyright, remarks and self-defined information）、GIF(Graphic Interehange Format)
Form（A kind of LZw compressed formats）, jpeg format（Joint Photographic Experts Group, combine picture expert
Group）, PDF (Portable Document Format) form, PNG format etc..
Current video image format has：Microsoft's video：wmv、asf、asx ；Real Player ：rm、 rmvb ；MPEG
Video：mpg、mpeg、mpe ；Mobile video：3gp ；Apple videos：mov ；Sony videos：mp4、m4v ；Other are normal
See video：Avi, dat, mkv, flv, vob etc..Video file is a kind of container encapsulation format, i.e., one receptacle is wrapped in
Different tracks, the form of the container used is related to the scalability of video shelves.
Above-mentioned picture and video image file are two dimensional image pixel sets, i.e., all images of a certain focussing plane
Pixel set, because object far and near distance is different（Object distance is different）, so image distance is also different, put down by the image after optical focus
There is clearly part in face（Focus point）, there is fuzzy part（Non-focusing point）, two dimensional image recording mode can not will be far and near different
The imaging and focusing points of all objects record.
Current 3-D view recording mode has the graphic file of the forms such as STL, DXF, IGS, PLY, obj, 3ds as data
Fabric Interface, formula stereoscopic display is interacted to figure, and such as IGS is a kind of general three-dimensional drawing exchange form, is used for
The digital control processings such as solidedge, Pro/E, the pixel of this kind of image file format is three-dimensional coordinate form, and each pixel
Point is accurate object dimensional coordinate, i.e., object is described with three-dimensional coordinate, picture format proposed by the present invention is to use three-dimensional coordinate
All image pixels of optical focus plane are described, these image slices have clearly focus point, also there is fuzzy non-focusing point,
Had any different with existing three-dimensional modeling picture format.
The content of the invention
Image of the present invention includes picture and video image.
A kind of multiple focussing image file format of the present invention is document No. method or file coding format.
Picture file generally comprises file header structure（FILEHEADER）, information header structure（INFOHEADER）, position
Figure color table（RGBQUAD）, bitmap pixels data, wherein file header structure, the attributive character of information header structure definition file be
Item of information, bitmap color table, bitmap pixels data are the logical places for storing image.
Video image file is made up of file header, index block and data block, and wherein data block includes actual data stream, that is, schemes
Picture and sound sequence data, index block include data block list and their positions hereof, with provide in file data with
Machine access capability, file header includes the general information of file, defines data format, the parameter such as compression algorithm used, by data
The two field picture of stream generation video image file.
A kind of multiple focussing image file format, it is characterized in that：Image file by least two different image distances image construction.
A kind of multiple focussing image file format, it is characterized in that：Image file by least two different image distances image construction,
Described image image distance value is recorded in described image file.
A kind of multiple focussing image file format, it is characterized in that：Image file by least two different image distances image construction,
Picture distance values between described image are recorded in described image file.
A kind of multiple focussing image file format, it is characterized in that：Image file by least two different image distances image construction,
Described image image distance or as distance values record in described image file.
A kind of multiple focussing image file format, it is characterized in that：Focal length numerical value is included in image file.
A kind of multiple focussing image file format, it is characterized in that：Make a summary or index comprising definition values in image file.
A kind of multiple focussing image file format, it is characterized in that：Constituted in image file comprising subregion coordinate and image distance
Index list；Or the index list of subregion coordinate and image distance label composition.
A kind of multiple focussing image file format, it is characterized in that：Image file by least two different image distances image construction,
The image pixel point coordinates of described image is x, y, z by three-dimensional coordinate description, and wherein to describe the pixel of image poly- in image distance by x, y
The position of focal plane, z describes normal direction distance away from reference plane of the pixel in x, y plane determined.
A kind of multiple focussing image video file coded format, packing forms include video track, audio track, it is characterized in that：Envelope
Multiple video tracks are included in dress form, each video track has its image distance label or as spacing label.
The multiple focussing image video file coded format, it is characterized in that：Image clarity values are also included in packing forms
Summary is indexed.
A kind of multiple focussing image generating means, it is characterized in that：Device is imaged by one group of imaging len, at least two groups monofocals
Component is constituted, and the monofocal image-forming assembly includes spectroscope, imaging unit, and spectroscope distributes some light of imaging len
It is imaged to described imaging unit.
A kind of multiple focussing image generating means, it is characterized in that：Device is folded in tandem by one group of imaging len, at least two groups
Plus transparent image unit constitute, the transparent image unit be responsible for different image distances image imaging.
A kind of multiple focussing image generating means, it is characterized in that：Device is made up of imaging len, zoom lens control device, imaging unit,
The zoom lens control device is responsible for being imaged zoom, and zoom lens control device is responsible for providing corresponding image distance numerical value simultaneously, and the zoom lens control device is being taken the photograph
Reciprocating motion state is in during picture, one group of image that a reciprocation period is obtained is a multiple focussing image file.
A kind of multiple focussing image generating means, it is characterized in that：In shooting, the motion of zoom lens control device is at the uniform velocity.
A kind of multiple focussing image generating means, it is characterized in that：In shooting, the motion of zoom lens control device is shake son motion
Mode is sinus wave patters.
A kind of multiple focussing image generating means, it is characterized in that：In shooting, the motion of zoom lens control device is step-by-step system.
A kind of multiple focussing image generating means, it is characterized in that：Device not shading before and after one group of imaging len, at least two groups
Arrange and do not constituted in the linear array photosensitive unit of same image distance plane, the linear array photosensitive unit passes through moving sweep and generates figure
Picture.
A kind of described multiple focussing image generating means, it is characterized in that：The moving sweep mode of linear array photosensitive unit is single
Arm rotation sweep or both arms rotation sweep or cylindric rotation sweep or parallel sweep.
A kind of described multiple focussing image generating means, it is characterized in that：In the light path of linear array photosensitive unit and imaging len
Column distortion correcting lens are set.
A kind of described multiple focussing image generating means, it is characterized in that：Between linear array photosensitive unit and imaging len away from
From adjustable.
The imaging unit or linear array photosensitive unit are CCD or COMS elements.
A kind of described multiple focussing image generating means are applied to camera, video camera, microscope.
A kind of multiple focussing image document handling method, its step is：A, acquisition multiple focussing image file；B, determine prime focus
Face image；C, extraction adjacent focus face image；D, adjacent focus face image and prime focus face image are subjected to resolution chart picture melted
Close processing and form fused images 1；E, extraction another adjacent focus face image；F, by another adjacent focus face image and fused images
1 carries out resolution chart as fusion treatment formation fused images 2；G, extraction time adjacent focus face image；H, by secondary adjacent focus face
Image and fused images 2 carry out resolution chart as fusion treatment formation fused images 3；I, another adjacent focus face figure of extraction
Picture；J, another adjacent focus face image and fused images 3 are carried out to resolution chart as fusion treatment formation fused images 4；K、
Above-mentioned image co-registration processing is repeated until forming final fused images.
A kind of multiple focussing image document handling method, it is characterized in that step D ~ K also includes following sub-step：A, two width
The step of image carries out having adjustment picture size before fusion treatment, that is, adjust after the wherein size of piece image and another piece image
Size fits like a glove；The pixel that b, two images carry out two images during image co-registration processing is to select a selection, i.e. fusion figure
The pixel of picture is that the pixel of two images selects a selection result.
Or, in view of the clear display of prime focus face image, it is characterized in that step D ~ K also includes following sub-step：It is main poly-
Clearly image pixel formation fusion figure is selected in a selection prime focus face image when focal plane image and adjacent focus face image co-registration
As 1；Clearly image pixel formation fused images are selected in a selection image 1 when image 1 and another adjacent focus face image co-registration
2；Select and clearly scheme in the image after a selection fusion when successively being merged the image after fusion and other focusing surface images
As pixel forms final fused images.
A kind of multiple focussing image document handling method, it is characterized in that step D ~ K also includes following sub-step：A, two width
The step of image carries out having adjustment image slices vegetarian refreshments x, y-coordinate before fusion treatment, that is, adjust the image pixel of wherein piece image
Point x, y-coordinate and another piece image image slices vegetarian refreshments x, y-coordinate are completely the same；When b, two images carry out image co-registration processing
The pixel of two images is that to select the pixels of a selection, i.e. fused images be that the pixels of two images selects a selection knot
Really.
A kind of multiple focussing image document handling method, it is characterized in that：It is the figure for extracting a certain image distance during progress image display
As currently being shown, the triggering mode of display control is at least one of following manner：Control button triggering mode, control button
Mouse drag triggering mode, mouse coordinates triggering mode, mouse coordinates and button triggering mode, touch screen triggering mode, touch screen are touched
Moving coordinates and touch screen triggering mode, eyeball focus triggering mode.
The step of image of a certain image distance of extraction, also includes：The step of judging image definition；Or retrieval
The step of inquiry definition values are made a summary or index and determine definition values highest, or the rope that determination is made up of subregion coordinate and image distance
The step of drawing image distance in list；Or the step of determine image distance label in the index list that is made up of subregion coordinate and image distance label.
A kind of multiple focussing image document handling method, its step is：S1, by camera obtain eyeball image, pass through identification
Tracking software judges the focus of eyeball, and determines to pay close attention to point coordinates；S2, according to the coordinate of focus in multiple focussing image file
Clearly image is currently shown in middle extraction focus region.
Further, also include paying close attention to point coordinates in multiple focussing image definition is indexed or is made a summary according to eyeball in step S2
Focus region clearly correspondence image, i.e., the image of a certain image distance value are searched, and regard the corresponding image as current figure
As being shown in display interface.
Current image fusion technology has：Chinese patent bulletin 200910104632.1 discloses one kind using Fisher classification
With the multi-focus image fusing method of wavelet transformation；Chinese patent is announced 200910147247.5 image processing equipments, imaging and set
Standby, image processing method and program；Chinese patent bulletin 201010527509.3 is a kind of based on wavelet transformation and domain features
Multi-focus image fusing method；Chinese patent announces 200710064739.9 a kind of image combining methods and device；Chinese patent
Announce 200810017326.X and be based on imaging mechanism and nonsubsampled contourlet transform multi-focus image fusing method.
The beneficial effects of the invention are as follows：The all poly- of far and near different objects can be shot by multiple focussing image generating means
Focal plane image, and a kind of multiple focussing image file format is generated, image file can so be handled in the later stage, such as taken
Go out the focusedimage of jobbie, or fusion treatment is carried out to image, generate the picture rich in detail that a kind of far and near object is focused on, or
Person according to the focal length of camera device, the image distance of object, the distance and the relative distance of object of the picture distance computation object of focusing surface,
Or the stereo-picture of generation object.Shooting activity can be solved using the embodiment of spectroscope and linear array multi-focus imaging heap many
The problem of focusedimage.Multiple focussing image is browsed based on eye tracking device, it is possible to achieve human eye focus is to real world
Simulation, i.e., multi-focus display device realizes that zoom is shown, forms a kind of brand-new image-watching mode, including picture and video.
Brief description of the drawings
Fig. 1 is the graph of a relation that image distance changes with object distance when lens imaging is focused on.
Fig. 2 is that multiple focussing image generating means of the present invention use spectroscopical embodiment.
Fig. 3 is the embodiment that multiple focussing image generating means of the present invention use transparent image unit.
Fig. 4 is image pixel coordinates describing mode in transparent image unit in Fig. 3.
Fig. 5 is that multiple focussing image generating means of the present invention use the reciprocating embodiment of imaging unit.
Fig. 6 is that multiple focussing image generating means of the present invention are arranged on wedge inclined-plane using linear array photosensitive unit and followed tiltedly
The embodiment that face moves back and forth scanning imagery in x-axis direction.
Fig. 7 is the embodiment party that multiple focussing image generating means of the present invention use both arms linear array photosensitive unit rotating scan imaging
Case.
Fig. 8 is the view in both arms linear array photosensitive unit z-axis direction in Fig. 7.
Fig. 9 is both arms linear array photosensitive unit z-axis direction isometric plan in Fig. 7.
Figure 10 is the implementation that multiple focussing image generating means of the present invention use single armed linear array photosensitive unit rotating scan imaging
Scheme.
Figure 11 is the view in single armed linear array photosensitive unit z-axis direction in Figure 10.
Figure 12 is single armed linear array photosensitive unit z-axis direction isometric plan in Figure 10.
Figure 13 is that multiple focussing image generating means of the present invention are arranged in the different cylinder knot of diameter using linear array photosensitive unit
The embodiment of rotating scan imaging on structure.
Figure 14 is image file format attribute list of the present invention.
Figure 15 is file format structure figure of the present invention.
Figure 16 is step scanning signal voltage u, time t, z-axis displacement relation figure.
Figure 17 is that the step of imaging unit of the present invention synthesizes multiple focussing image file is schemed.
Figure 18 is that the step of linear array photosensitive unit of the present invention generates multiple focussing image file is schemed.
Figure 19 is a kind of method of image co-registration of the present invention.
A kind of image viewer or video player surface chart that Figure 20 provides for the present invention.
The step of Figure 21 is multiple focussing image file generated 3-D view of the present invention.
Figure 22 is linear array motion encoder Image Coding principle.
Figure 23 is space three-dimensional image image-forming principle.
Figure 24 is the multiple focussing image viewing mode schematic diagram based on human eye focus.
Figure 25 is the schematic diagram that multiple focussing image file sets up definition summary or index.
Figure 26 is a kind of image clearly region summary or concordance list for using image distance label for mark.
Figure 27 is the step of Figure 26 sets up image distance label k values in image clearly region summary or concordance list.
Embodiment
The present invention is further described with reference to the accompanying drawings and examples.
Fig. 1 is the graph of a relation that image distance changes with object distance when lens imaging is focused on.Lens imaging formula（Also known as Gauss imaging is public
Formula）Form is：1/f=1/u+1/v
Wherein f is focal length, convex just recessed negative；U is object distance；V is image distance, real weakened body resistance negative.
Fortran is：V=f*u/ (u-f), the areas imaging of real image is image distance f ~ 2f, and corresponding object distance is ∞ ~ 2f
V u is differentiated for：V'=-f^2* (u-f) ^ (- 2), it can be deduced that：Derivative absolute value closer to 2f is bigger, i.e.,
Slope is bigger, i.e. the rate of change of image distance is bigger；Derivative absolute value closer to f is smaller, i.e., slope is smaller, i.e. the rate of change of image distance
It is smaller.
Illustrate, to obtain the picture rich in detail of different object distances object, the imaging unit near 2f wants intensive arrangement,
Imaging unit near f can be with sparse arrangement；Or the intensive arrangement in crucial image distance position；Or imaging unit be arranged in f ~ 2f it
Between a certain section form multi-focus imaging heap, the distance between imaging unit is adjustable, between multi-focus imaging heap and imaging len
Apart from adjustable.
Diagram also illustrates simultaneously, as needed, as long as the imaging unit of arrangement limited quantity is obtained with different object distances
The picture rich in detail of object.
If arranging imaging unit in f ~ 2f universes, total focus image is formed.
If using full shot, such as fish eye lens, panorama total focus image can be formed.
For imaging lens group, such as zoom system, pancreatic system, areas imaging f ~ 2f of the present invention is the imaging region of zoom system, pancreatic system.
Optical imaging concept of the present invention is located at ∞ ~ 2f with object, and areas imaging illustrates exemplified by being located at f ~ 2f simple lens, right
It is located at 2f ~ f in object, areas imaging is then 2f ~ ∞, such as microscope, motion picture projection screen, so imaging of the present invention
Scope f ~ 2f is no longer appropriate for, and can be stated with imaging region, so areas imaging of the present invention f ~ 2f conceptual understandings are into
As region, multi-focus imaging heap is located at imaging region.
The multi-focus imaging heap is applied to camera, video camera, microscope.
In fact, the object of camera, shot by camera is general in the position much larger than 2f, so imaging region is general
F position is located adjacent to, microscopical imaging is general in the position much larger than object lens 2f, so being crucial image distance in practical application
The intensive arrangement imaging unit in position, preferably embodiment be using certain image distance direction thickness multi-focus imaging heap as into
As unit, applied to required imaging region.
Fig. 2 is that multiple focussing image generating means of the present invention use spectroscopical embodiment.201、202、203、204、205
It is the object of different distance, 206 be imaging len, and 207,210,211,214,215 be the imaging unit for being arranged in different image distances,
208th, 209,212,213 be spectroscope, and spectroscopical effect is a part of light of transmission, reflects a part of light, so can be light
Line is divided into two projecting directions.Here illustrated exemplified by choosing the object of 5 different distances, by the picture for adjusting imaging unit
Away from, make imaging unit 207 be located at object 201 focusing surface, imaging unit 210 be located at object 202 focusing surface, imaging unit
211 are located at the focusing surface of object 203, and imaging unit 214 is located at the focusing surface of object 204, and imaging unit 215 is located at object 205
Focusing surface, spectroscope 208 is responsible for a part of light distributing to imaging unit 207, and spectroscope 209 is responsible for a part of light
Imaging unit 210 is distributed to, spectroscope 212 is responsible for a part of light distributing to imaging unit 211, and spectroscope 213 is responsible for will
A part of light distributes to imaging unit 214, and so each imaging unit can obtain the clear figure of respective focusing surface object
Picture.
Fig. 3 is the embodiment that multiple focussing image generating means of the present invention use transparent image unit.301st, 302,303 are
The object of different distance, 304 be imaging len, 305,306, the 307 transparent image units being superimposed for arrangement, at least 2
It is individual to arrange in the transparent image unit composition three-dimensional imaging unit being superimposed, figure with the three of 3 transparent image unit compositions
Tie up exemplified by imaging unit, by adjusting the image distance of three-dimensional imaging unit, transparent image unit 305 is located at the focusing surface of object 301,
Transparent image unit 306 is located at the focusing surface of object 302, and transparent image unit 307 is located at the focusing surface of object 303, so existed
The picture rich in detail of different distance object is formed in three-dimensional imaging unit.
Further, the intensive arrangement of the transparent image unit, such as the distance between transparent image unit be equal to it is transparent into
As the distance of unit pixel, three-dimensional imaging heap or three-dimensional imaging unit are thus formed, in three-dimensional imaging heap or three-dimensional imaging list
In member, any pixel point can be by x, y, and z coordinate description is determined, can thus be recorded all in lens imaging space
Pixel, the image progress plane that any image distance plane can be intercepted in image repetition shows that any image distance of interception is put down
The image appearance form in face is the image of a certain image distance.Alternatively, it is also possible to which all pixels point progress space diagram is shown.
Fig. 4 is image pixel coordinates describing mode in transparent image unit in Fig. 3.During p1 is transparent image unit 305
A certain pixel, the coordinate of pixel is（x1,y1,z1）, wherein x1, y1 is that image slices vegetarian refreshments is sat in the two dimension of the plane of delineation
Mark, the two-dimensional coordinate is the expression packaged type of image pixel positions in conventional images file format, and z1 is pixel in z-axis
The location presentation in direction, can be the distance of exhausted degree distance, such as p1 pixels range Imaging lens centre, or distance focal point away from
From or relative distance, the relative distance between such as transparent image unit.During similarly p2 is transparent image unit 306
A certain pixel, the coordinate of pixel is（x2,y2,z2）, p3 is a certain pixel in transparent image unit 307, pixel
Coordinate be（x3,y3,z3）.
The distance that the arrangement of transparent image unit is superimposed can be equidistant or Unequal distance, such as the location arrangements close to 2f
It is intensive, it is sparse close to f location arrangements；Or the intensive arrangement in crucial image distance position；Or transparent image unit is arranged in certain between f ~ 2f
One section forms multi-focus imaging heap, and multi-focus imaging the distance between heap and imaging len is adjustable.
Fig. 5 is that multiple focussing image generating means of the present invention use the reciprocating embodiment of imaging unit.401 be thing
Body, 402 be imaging len, and 403 be the focal position of telefocus position, i.e. farthest object, and 404 be near focus position,
That is the focal position of most near objects, 405 be kinematic driving unit, that is, images servomechanism installation.Device is during shooting, by transporting
Dynamic drive device driving imaging unit is moved back and forth along the z-axis direction, and a period of motion forms a complete image form bag, institute
Picture format bag is stated including at least 2 focusing surface picture frames.
The motion mode of kinematic driving unit has：1st, rectilinear motion mode, i.e. imaging unit in z-axis direction, f ~ 2f it
Between at the uniform velocity to move back and forth；2nd, movement of pendulum mode, i.e. imaging unit are shaken in z-axis direction between f ~ 2f with sine wave
Flowing mode is moved back and forth, and amplitude is focal length f, and the vibrations cycle is T, then image distance v can be expressed as：v=0.5*f*sin(2∏
T/T), v is to time derivation：V'=f* (∏/T) * cos (2 ∏ t/T), parameter v and v' are encoded for picture format, and ∏ is circle
Frequency；3rd, step motion mode, i.e., have the motion mode that moment is static, i.e., imaging unit is in z-axis direction, between f ~ 2f halfway
At least 2 quiescent time sections, Duan Weiyi picture frame period of quiescent time during moving back and forth.
The motion mode of kinematic driving unit is controlled by moving sweep signal, and moving sweep signal is corresponding according to motion mode
Ground is divided into：1st, linear scan signal, you can to drive imaging unit to be moved back and forth along the z-axis direction with even speed；2nd, just
String ripple scanning signal, you can moved back and forth along the z-axis direction with sine wave vibration mode with driving imaging unit；3rd, ladder is swept
Retouch signal, you can to drive imaging unit to move back and forth along the z-axis direction, at least 2 quiescent time sections in motion process,
The picture frame period FT of quiescent time Duan Weiyi, Figure 16 is step scanning signal voltage u, time t, z-axis displacement relation figure, z1,
Z2, z3 are respectively 3 rest points of the imaging unit in z-axis, and quiescent time section is the picture frame period of FT, i.e., one, and 3 static
Corresponding voltage value u1, u2, u3, i.e. magnitude of voltage u1, u2, u3 keep constant to point in FT quiescent times section respectively.U-z figures can be seen that
Imaging unit is moved with scanning voltage value, that is, the displacement occurred is by magnitude of voltage control.
According to the persistence of vision of human eye, general minimum 24Hz, if the scan frequency for choosing kinematic driving unit is
24Hz, i.e. cycle about 0.04 second, imaging unit picture frame period is necessarily less than 0.04 second, is such as chosen 1/500 second, then a motion
The image of the different image distances of 20 frames can be accommodated in cycle, multi-focus live image can be thus formed.
For movement of pendulum mode, it is contemplated that the intrinsic frequency of vibrations object, by adjusting the attached of imaging unit during implementation
Plus the elasticity of quality and fixing device makes intrinsic frequency consistent with driving scanning signal frequency.
The motion mode is that moving sweep mode, i.e. imaging unit are reciprocal back and forth in lens imaging region by motion mode
Scanning motion.
Camera apparatus for shooting one group of image, can be only completed one using imaging unit in shooting process is shot
Moving sweep cycle, shooting process records the coordinate (x, y, z) of all image slices vegetarian refreshments, forms multiple focussing image file.
Fig. 6 is that multiple focussing image generating means of the present invention are arranged on wedge inclined-plane using linear array photosensitive unit and followed tiltedly
The embodiment that face moves back and forth scanning imagery in x-axis direction.601st, 602,603 be different distance object, 604 is saturating for imaging
Mirror, 605 be that linear array photosensitive unit is disposed with wedge inclined-plane, wedge inclined-plane 605, and 606 be one of linear array photosensitive unit, linear array sense
Light unit is made up of a photoelectric chip, this linear array photosensitive unit scanning imagery that current scanline instrument is used, two phases
Upright projection distance of the adjacent line battle array photosensitive unit in z-axis direction is h, and h values can be used as image distance value parameter, linear array photosensitive unit cloth
Put between z-axis projector distance f ~ 2f, can be equidistant placement or Unequal distance arrangement, such as location arrangements close to 2f are intensive, lean on
Nearly f location arrangements are sparse.Device is in shooting, and wedge inclined-plane 605 is moved back and forth in x projecting directions, so different image distances
Linear array photosensitive unit pass through x scanning directions, obtain the focusing surface image of different image distances.Wedge inclined-plane 605 x projecting directions with
The mode at the uniform velocity moved back and forth, or movement of pendulum mode, i.e. wedge inclined-plane 605 are in x projecting directions with sine wave vibrations side
Formula is moved back and forth.
The motion mode is moving sweep mode, i.e., linear array photosensitive unit by motion mode in lens imaging region back and forth
Shuttle-scanning is moved.
The scanning motion of the linear array photosensitive unit is the reciprocal fortune of parallel sweep, i.e. linear array photosensitive unit in x-axis direction
Dynamic rail mark is parallel to each other.
The construction of linear array photosensitive unit is to arrange sensitivity speck photoelectric chip in a straight line, and photoelectric chip is generally CCD
Or COMS, meanwhile, each sensitivity speck is also responsible for the three primary colours separation of pixel, and prior art has：Color filter isolation technics, three
CCD colors isolation technics, list CCD colors separation scanning technique.The pixel signal that the sensitivity speck of linear array photosensitive unit is obtained is simulation
Signal, so also have the process that analog signal is converted into data signal, i.e. A/D conversions.Linear array photosensitive unit is a kind of one-dimensional
Imaging sensor, existing one-dimensional image sensor is used for traditional scanner.
Fig. 7 is the embodiment party that multiple focussing image generating means of the present invention use both arms linear array photosensitive unit rotating scan imaging
Case.701st, 702,703 be different distance object, 704 be imaging len, and 705,706,707,708,709,710 be both arms line
Battle array photosensitive unit, 711 be rotating shaft, and the central point of both arms linear array photosensitive unit is connected in rotating shaft 711.When device is imaged, both arms
Linear array photosensitive unit 705,706,707,708,709,710 is with the focusing surface of the different image distances of the rotary scanning of rotating shaft 711, generation difference
The image of image distance focusing surface.
The motion mode of the present embodiment is that both arms linear array photosensitive unit rotates to form focusing surface in lens imaging region
Moving sweep mode.
Fig. 8 is the view in both arms linear array photosensitive unit z-axis direction in Fig. 7.Both arms linear array photosensitive unit can be evenly arranged
Uneven it can also arrange.Or the intensive arrangement in crucial image distance position.It is double or both arms linear array photosensitive unit is arranged in a certain section of f ~ 2f
The distance between arm linear array photosensitive unit is adjustable, and the distance between both arms linear array photosensitive unit and imaging len are adjustable, i.e. both arms
Linear array photosensitive unit can move back and forth in z-axis direction to be adjusted.
Fig. 9 is both arms linear array photosensitive unit z-axis direction isometric plan in Fig. 7.Both arms linear array photosensitive unit be arranged in f ~
Can be equidistant placement or Unequal distance arrangement between 2f, such as location arrangements close to 2f are intensive, sparse close to f location arrangements.Or
The crucial intensive arrangement in image distance position.Or both arms linear array photosensitive unit is arranged in a certain section of f ~ 2f and forms linear array multi-focus imaging heap,
The distance between both arms linear array photosensitive unit is adjustable, and the distance between both arms linear array photosensitive unit and imaging len are adjustable, i.e. line
Battle array multi-focus imaging heap can move back and forth in z-axis direction to be adjusted.
Figure 10 is the implementation that multiple focussing image generating means of the present invention use single armed linear array photosensitive unit rotating scan imaging
Scheme.1001st, 1002,1003 be different distance object, 1004 be imaging len, 1005,1006,1007,1008,1009,
1010 be single armed linear array photosensitive unit, and 1011 be rotating shaft, and one end of single armed linear array photosensitive unit is connected in rotating shaft 1011.Device
During shooting, single armed linear array photosensitive unit 1005,1006,1007,1008,1009,1010 is with the different pictures of the rotary scanning of rotating shaft 1011
Away from focusing surface, generate the image of different image distance focusing surfaces.
The motion mode of the present embodiment is that single armed linear array photosensitive unit rotates to form focusing surface in lens imaging region
Moving sweep mode.
Figure 11 is the view in single armed linear array photosensitive unit z-axis direction in Figure 10.Single armed linear array photosensitive unit can uniform cloth
Put and uneven can also arrange；Or the intensive arrangement in crucial image distance position；Or single armed linear array photosensitive unit is arranged in a certain section of f ~ 2f
Form linear array multi-focus imaging heap, the distance between single armed linear array photosensitive unit is adjustable, and single armed linear array photosensitive unit and imaging are saturating
The distance between mirror is adjustable, i.e., linear array multi-focus imaging heap can move back and forth in z-axis direction is adjusted.
Figure 12 is single armed linear array photosensitive unit z-axis direction isometric plan in Figure 10.Single armed linear array photosensitive unit is arranged in f
Can be equidistant placement or Unequal distance arrangement between ~ 2f, such as location arrangements close to 2f are intensive, sparse close to f location arrangements；
Or the intensive arrangement in crucial image distance position；Or single armed linear array photosensitive unit is arranged in a certain section of f ~ 2f and forms the imaging of linear array multi-focus
Heap, the distance between single armed linear array photosensitive unit is adjustable, and the distance between single armed linear array photosensitive unit and imaging len are adjustable, i.e.,
Linear array multi-focus imaging heap can move back and forth in z-axis direction to be adjusted.
Figure 13 is that multiple focussing image generating means of the present invention are arranged in the different cylinder knot of diameter using linear array photosensitive unit
The embodiment of rotating scan imaging on structure.1301st, 1302,1303 be linear array photosensitive unit, and 1304 be rotating shaft, and 1305 be column
Distortion correcting lens, linear array photosensitive unit is arranged on the circumference of different radii and front and rear not shading, and the radial distance of arrangement is f
Between ~ 2f, the image of different image distance focusing surfaces is generated in the circular-rotation scanning of different radii by linear array photosensitive unit.
The motion mode of the present embodiment is that linear array photosensitive unit rotates to form focusing cylindrical in lens imaging region column
Moving sweep mode.
Linear array photosensitive unit can radially be equally spaced or be not equally spaced radially in the mode of radial arrangement, such as
Location arrangements close to 2f are intensive, sparse close to f location arrangements.Or linear array photosensitive unit is in the intensive arrangement in crucial image distance position.
Or linear array photosensitive unit is arranged in a certain section of formation linear array multi-focus imaging heap between f ~ 2f, linear array photosensitive unit radial direction spacing
Adjustable, the distance between rotating shaft and imaging len are adjustable, i.e. rotating shaft 1304 can move back and forth regulation in z-axis direction, in other words
Linear array multi-focus imaging heap can move back and forth regulation in z-axis direction.
In fact, the object of camera, shot by camera is general in the position much larger than 2f, so imaging region is general
F position is located adjacent to, microscopical imaging is general in the position much larger than object lens 2f, so being crucial image distance in practical application
The intensive arrangement imaging unit in position, preferably embodiment are made using the linear array multi-focus imaging heap of certain image distance direction thickness
For imaging unit, applied to required imaging region.
The present embodiment is cylindric scanning embodiment, it is contemplated that cylindric scanning can produce column image fault, can
Column image fault is corrected to set column distortion correcting lens 1305 in the light path of imaging len, can be specifically arranged on
In light path between imaging len and linear array photosensitive unit.
Figure 14 is image file format attribute list of the present invention.Have in traditional images file format properties table：Width, height,
Horizontal resolution, vertical resolution, bit depth, frame number, equipment, focal length, color are represented, ISO speed, the time, address etc., Figure 14
The image of several different focusing surfaces is included in the image file format of example, is formed by different focusing surface package images, except tradition figure
As increase focuses on interplanar distance, image distance parameter outside attribute.
It is as spacing to focus on interplanar distance.
The image of the different focusing surfaces be imaging len imaging region space in a certain cross-sectional image.
In Figure 14, it is equidistant, i.e. 2mm to focus on interplanar distance, and it can be Unequal distance to focus on interplanar distance, as close to 2f
Location arrangements are intensive, sparse close to f location arrangements.Or the intensive arrangement in crucial image distance position.
In addition, what focusing interplanar distance and image distance were not required in multiple focussing image file format of the present invention, different image distances
Image can arrange and be bundled in multiple focussing image file, the image of different image distances is only distinguished with arrangement sequence number.
In addition, packing processing can also be carried out using existing software for the image of different image distances in multiple focussing image,
A file bag being made up of different image distance images is formed, the different image distance images are ranked up volume according to image distance value size
Number, the numbering can as different image distance images filename.
Figure 15 is file format structure figure of the present invention.File is by file header, information header, image distance value, bitmap color table, bitmap
Pixel data is constituted, and the image of several different focusing surfaces is encapsulated in file, respectively 1 ~ n, image distance value can be absolute image distance value,
Can also can also include focal length value in the spacing in adjacent focus face, information header.
In addition, image distance value and as spacing is not required in multiple focussing image file format of the present invention, different image distances
Image, which can be arranged, to be bundled in multiple focussing image file, and the image of different image distances is only distinguished with arrangement sequence number.
Further, image clarity values are made a summary or indexed in increase multiple focussing image in described information head.
Or the index list constituted in described information head comprising subregion coordinate and image distance；Or subregion coordinate and image distance set of tags
Into index list.
In addition, packing processing can also be carried out using existing software for the image of different image distances in multiple focussing image,
A file bag being made up of different image distance images is formed, the different image distance images are ranked up volume according to image distance value size
Number, the file header or information header of each self-corresponding image file of the numbering write-in.
Figure 17 is that the step of imaging unit of the present invention synthesizes multiple focussing image file is schemed.The image file that imaging unit is obtained
Coded treatment is carried out by image distance encoder, multiple focussing image file is generated, the coding parameter of image distance encoder comes from image distance data,
Image distance data can be absolute image distance, or relative relative distance between image distance such as imaging unit.In addition, image distance numerical value is in this hair
It is not required in bright multiple focussing image file format, the image of different image distances, which can sort, is bundled to multiple focussing image file
In, the image of different image distances is only distinguished with arrangement sequence number.Of course it is not excluded being carried out with existing software to the image of different image distances
Sequence packing.
Spectroscopical embodiment and Fig. 3 multi-focus of the present invention are used for Fig. 2 multiple focussing image generating means of the present invention
The embodiment that video generation device uses transparent image unit.The imaging unit spacing distance of the two embodiments is predetermined
Or determination, i.e. image distance data be to determine value, extract image distance data determination value and pass through image distance encoder and write package file shape
Into multiple focussing image file format.
The reciprocating embodiment of imaging unit is used for Fig. 5 multiple focussing image generating means of the present invention.This side
The image distance numerical value of case is determined that the motion mode of kinematic driving unit is controlled by moving sweep signal by kinematic driving unit, motion
Scanning signal is accordingly divided into according to motion mode：1st, linear scan signal, you can to drive imaging unit along the z-axis direction with equal
Uniform velocity is moved back and forth, and the position of image distance can be expressed as：V=β * (U/T) * t, v are instant image distance, and β is fixed coefficient, U
For scanning voltage peak value, T is the scan period, and t is a certain time at moment；2nd, sinusoidal scanning signal, you can to drive imaging single
Member is moved back and forth with sine wave vibration mode along the z-axis direction, and the position of image distance can be expressed as：v=0.5*f*sin(2∏
T/T), v is instant image distance, and amplitude is focal length f, and the vibrations cycle is T, and t is a certain time at moment；3rd, step scanning signal, you can
To drive imaging unit to move back and forth along the z-axis direction, at least 2 quiescent time sections in motion process, quiescent time section
It is step scanning signal voltage u, time t, z-axis displacement relation figure, z1, z2, z3 difference for picture frame period a FT, Figure 16
It is 3 rest points of the imaging unit in z-axis, quiescent time section is the picture frame period of FT, i.e., one, and 3 rest points are corresponded to respectively
Magnitude of voltage u1, u2, u3, i.e. magnitude of voltage u1, u2, u3 FT quiescent times section keep it is constant, u-z figure it can be seen that imaging unit with
Scanning voltage value is moved, that is, the displacement occurred is by magnitude of voltage control.The linear scan signal or sinusoidal scanning signal or
Step scanning signal passes through modulus calculation（A/D is changed）Generate image distance value, image distance value or as distance values are write by image distance encoder
Enter package file formation multiple focussing image file format.
Multiple focussing image file generated step is：1st, the image file of at least two imaging units is obtained；2nd, image distance is obtained
It is worth or as distance values；3rd, by image distance value or as distance values write-in package file is multiple focussing image file, or multiple focussing image is compiled
Code formatted file.
Multi-focus video image file generation step is：1st, the video image file of at least two imaging units is obtained；2、
Obtain the image distance of the video image file or as spacing；3rd, by image distance value or as distance values write package file, image distance value or
As distance values are the labels of video image file.
Figure 18 is that the step of linear array photosensitive unit of the present invention generates multiple focussing image file is schemed.1st, linear array photosensitive unit is moved
Scanning generation respective image pixel, image pixel is brightness value and color value；2nd, linear array sense is demarcated by linear array motion encoder
The coordinate of the image slices vegetarian refreshments of light unit scanning generation；3rd, by image slices vegetarian refreshments and its Coordinate generation linear array two field picture；4th, pass through
The distance values of linear array photosensitive unit or image distance value write-in package file are formed multiple focussing image file format by image distance encoder.Separately
Outside, image distance numerical value is not required in multiple focussing image file format of the present invention, and the image of different image distances can arrange packing
Into multiple focussing image file, the image of different image distances is only distinguished with arrangement sequence number.Of course it is not excluded with existing software to not
Image with image distance is ranked up packing.
The function of linear array motion encoder is that the coordinate of the pixel obtained to linear array photosensitive unit carries out demarcation sequence, shape
Into view data, the i.e. each point of linear array photosensitive unit starting point to terminate spot scan obtain image slices vegetarian refreshments pixel value and
The data of respective coordinates mapping.
It is arranged on wedge inclined-plane and follows using linear array photosensitive unit for Fig. 6 multiple focussing image generating means of the present invention
The embodiment that inclined-plane moves back and forth scanning imagery in x-axis direction.Linear array motion encoder is rectilinear scanning motion encoder, by
The image pixel coordinates of straight line linear array motion encoder calibration line array element scanning generation.For example on a certain linear array photosensitive unit
A certain pixel p, coordinate is expressed as（x,y,z）, y determines that z is by linear array photosensitive unit in z-axis direction by the physical location of p points
Position determines that x can be described as x=A*（t/T）, A is largest motion displacement of the wedge inclined-plane in x-axis direction（There are positive and negative values, table
Show the direction of motion）, T is reciprocation period, and t is a certain time at moment.
The implementation of both arms linear array photosensitive unit rotating scan imaging is used for Fig. 7 multiple focussing image generating means of the present invention
The embodiment that scheme and Figure 10 multiple focussing image generating means of the present invention use single armed linear array photosensitive unit rotating scan imaging.
Linear array motion encoder is rotary scanning motion encoder, and generation is scanned by rotation linear array motion encoder calibration line array element
Image pixel coordinates.Such as a certain pixel p on a certain linear array photosensitive unit, polar coordinates are expressed as（R, ω t, z）, r is p points
To the radial distance of spindle central, ω is angular velocity of rotation, and z is determined by linear array photosensitive unit in the position in z-axis direction, and t is certain
One time at moment.
The different cylinder of diameter is arranged in using linear array photosensitive unit for Figure 13 multiple focussing image generating means of the present invention
The embodiment of upper rotating scan imaging.Linear array motion encoder is garden column rotary scanning motion encoder, and by garden, column is revolved
Turn the image pixel coordinates of scanning motion encoder calibration line array element scanning generation.Such as on a certain linear array photosensitive unit certain
One pixel p, polar coordinates are expressed as（R, ω t, y）, r is the radius of turn of linear array photosensitive unit, and ω is angular velocity of rotation, and y is p
The y-axis coordinate of point, t is a certain time at moment.
Figure 19 is a kind of method of image co-registration of the present invention.Here by taking the image of 2 focusing surfaces as an example, multiple focussing image lattice
Encapsulate 2 images in formula file, 1901 be that A is clear area in image, image, and b is fuzzy region, and 1902 be another
Image, a is fuzzy region, and B is clear area, and 1903 be adjustment picture size step, i.e., enter image 1901 and image 1902
Row normalized, makes the pixel value of two images consistent, and 1904 images are the normalized image of 1902 images, 1904 figures
As pixel value and 1901 image pixel values unanimously, 1905 be image co-registration process step, the i.e. image pixel to 1901 and 1904
Image pixel carry out select a selection, a selection picture rich in detail pixel is selected here, image 1906, the picture of image 1906 is finally obtained
Element composition is A and B, i.e. full width clearly image.
Focal length value is included in the multiple focussing image file format of the present invention, image distance value can be calculated by imaging formula
Go out different focusing surfaces（Or point）The distance of the object distance of object, i.e. different objects.Imaging formula is：1/f=1/u+1/v, if it is known that
F and v can just calculate u=f*v/ (v-f), and its step is：1st, multiple focussing image file is obtained；2nd, enter line definition identification, obtain
Take the image distance of clear area pixel；3rd, object distance u=f*v/ (v-f) is calculated according to image distance v and focal length f；4th, multiple focussing image is obtained
The object distance of each object or object parts is distance in file.
A kind of image viewer or video player surface chart that Figure 20 provides for the present invention.Image viewer or video are broadcast
Put device and include menu bar, picture browsing or video playback window, image distance adjusting knob, normalization button, image co-registration button, solid
Change button, picture size can be normalized for normalization button, to make the picture size of different image distances consistent, figure
As fusion button can carry out fusion treatment to shown image, clearly image is obtained everywhere, three-dimensional button can be right
Multiple focussing image file carries out processing generation stereo-picture, and it is current that image distance regulation button can select the image of different image distances to carry out
Display.
Because multiple focussing image file is made up of the graphical arrangement of different image distances, that is, divide image distance layer composition, can only during display
Select a certain layer to carry out plane to show.
Further, multiple focussing image is browsed based on eye tracking device, it is possible to achieve human eye focus is to real world
Simulation, system is by eye tracking device, computer installation（Image processing apparatus）Composition, computer installation installs multiple focussing image
Software is shown, the software provides browser window, and browser image distance adjusts button and controlled by the signal of eye tracking device, eyeball
Tracks of device is responsible for parsing the focus of eyeball, and multiple focussing image shows that software has and judges that focus area image definition is walked
Suddenly, by choosing focus area image, clearly image is used as current display to multiple focussing image display software.
As another embodiment, mouse coordinates are guided as eyeball focus, and its step is：1st, mouse is extracted to sit
Mark；2nd, the concern point coordinates of image display interfaces is determined according to mouse coordinates；3rd, using focus region clearly image as work as
Preceding display, that is, correspond to the image of image distance as current display.Mouse coordinates are guided as eyeball focus two kinds of triggering modes：
Mouse coordinates are directly triggered, or are triggered according to mouse coordinates by mousebutton, such as press left button.
Still another embodiment, that is, touch screen image display control triggering mode, and touch-screen is touch screen, including single-point touch screen and
Multipoint touch screen, its image display processing step is：1st, extract touch screen and touch point coordinates；2nd, point coordinates is touched according to touch screen to determine to scheme
As the concern point coordinates of display interface；3rd, using focus region, clearly image as current display, that is, corresponds to the image of image distance
It is used as current display.Of course it is not excluded directly touching the display control triggering mode of touch screen.
A kind of multiple focussing image document handling method, it is characterized in that：It is the figure for extracting a certain image distance during progress image display
As currently being shown, the triggering mode of display control is at least one of following manner：Control button triggering mode, control button
Mouse drag triggering mode, mouse coordinates triggering mode, mouse coordinates and button triggering mode, touch screen triggering mode, touch screen are touched
Moving coordinates and touch screen triggering mode, eyeball focus triggering mode.
The step of image of a certain image distance of extraction, also includes：The step of judging image definition；Or retrieval
The step of inquiry definition values are made a summary or index and determine definition values highest, or the rope that determination is made up of subregion coordinate and image distance
The step of drawing image distance in list；Or the step of determine image distance label in the index list that is made up of subregion coordinate and image distance label.
Image display processing step is a kind of method of multiple focussing image file process.
The step of Figure 21 is multiple focussing image file generated 3-D view of the present invention.1st, multiple focussing image file is obtained；2、
Pixel resolution of image judges, i.e., carry out definition judgment to the image of different image distances in multiple focussing image file；3rd, obtain clear
Clear degree image pixel and three-dimensional coordinate, pixel point coordinates x, y for the image of same image distance are known, coordinate z numerical value
It is identical, is also known；4th, generate space three-dimensional image, space three-dimensional image be it is in kind by imaging len f ~ 2f it
Between the space real image that is formed, space real image and in kind symmetrical into geometric center with lens centre point, material object is located between 2f ~ ∞；
5th, space three-dimensional image normalization is handled, and is same size by the image unification of all different image distances, such as：Normalization coefficient β, figure
The image distance of picture 1 is v1, and the image distance of image 2 is v2, then β=(v2-f)/(v1-f), and the size of image 1 is unified to image 2, image 1
The size * β=size of image 2；5th, solid threedimensional image is generated, after normalized, space three-dimensional image coordinate is converted into reality
Body three-dimensional coordinate, i.e., the image mapping point of true coordinate in kind.
Unlimited arrangements are unable in imaging len imaging region f ~ 2f in view of imaging unit or linear array photosensitive unit, also
It is to say that the quantity arranged is limited, the step of generating solid threedimensional image is：A, acquisition multiple focussing image file；B, extraction figure
As 1 data go forward side by side line definition judge, while obtaining the pixel and three-dimensional coordinate of clear part；C, the extraction data of image 2 are gone forward side by side
Line definition judges, while obtain the pixel and three-dimensional coordinate of clear part, at the same calculate normalization coefficient β 1 to Fig. 1=（Picture
Away from 1-f）/ (image distance 2-f)；D, extract image n data go forward side by side line definition judgement, while obtaining the pixel and three-dimensional of clear part
Coordinate, while calculating normalization coefficient β n=(image distance 1-f)/(the image distance n-f) to Fig. 1；What is obtained in E, obtaining step B ~ C is clear
Pixel and three-dimensional coordinate the generation space three-dimensional image of clear part；F, the coordinate of image 2 is multiplied by factor beta 1, image n coordinates are multiplied by
Factor beta n, calculates generation solid threedimensional image.
Figure 22 is linear array motion encoder Image Coding principle.2201 be a certain sensitivity speck of linear array photosensitive unit, and it is moved
The position of moment is p, Ke Yiyong in track（x,x,z）Cartesian coordinate is described, or（R, ω t, y）Polar coordinates are described；2203 are
The row data of image, i.e., the data of one scan line；2202 be a pixel number evidence in 2203 row data, 2202 pixels
It is the pixel value of p points that data are corresponding, and pixel value is brightness and the colourity of pixel, is typically represented with the brightness of three primary colours；2204
For the read cycle of a pixel Data Data；2205 be the line-scanning period of image；2206 be that linear array photosensitive unit is a certain
The movement locus of sensitivity speck 2201.So, all sensitivity specks of linear array photosensitive unit are by moving the image pixel value of acquisition
And coordinate is mapped to video data block, linear array two field picture is formed.Certainly, the pixel letter that the sensitivity speck of linear array photosensitive unit is obtained
Number it is analog signal, so also have the process that analog signal is converted into data signal, i.e. A/D conversions.
It is regular motion, i.e. uniform motion or vibrations or uniform rotation in view of linear array motion, is opened to reduce system
Pin, can only use the line-scanning period, line-scanning period signal rising edge starts pixel and read without using pixel read cycle
Extract operation, line-scanning period signal trailing edge closes pixel read operation, is read so as to complete an image line scanning.If
Linear array motion is uniform motion or uniform rotation, then pixel number is according to uniformly arranging, if linear array motion is vibration mode,
Then pixel number is according to being sinusoidal arrangement, pixel can be reduced into linear array by function algorithm.
Figure 23 is space three-dimensional image image-forming principle.ABCD is object, passes through imaging len formation A1B1C1D1 spaces three
Image is tieed up, f is imaging len focal length, and F is imaging len focus, and v1 is A1D1 image distances, and v2 is B1C1 image distances, and A2B2C2D2 is place
Manage in the solid threedimensional image of generation, figure and ignore flat focus coordinate, only study longitudinal depth coordinate.According to imaging formula 1/f=
1/u+1/v can be drawn the following conclusions：Positioned at ∞ ~ 2f real world objects optical imagery by imaging len " non-linear pressure
Contracting " is in f ~ 2f space, and the physical size and coordinate of real world objects are linear, and " non-linear compression " algorithm obeys imaging
Formula, can such as will by imaging formula algorithm with the flat focus coordinate and longitudinal coordinate of computational entity 3-D view
A1B1C1D1 space three-dimensional images calculate A2B2C2D2 solid threedimensional images, in fact can be converted into D1C1 sections of any point chis
Very little solid threedimensional image, it will be assumed that be transformed into A1D1 sizes, i.e. A1D1=A2D2, passes through trigonometric function relation：B1C1/
A1D1=（v2-f）/ (v1-f), so by coordinate of the B1C1 coordinate transformation for B2C2.
Mathematically it can be understood as：The linear three-dimensional coordinate of real world by 1/f=1/u+1/v Algorithm mappings to f ~
The non-linear three-dimensional matrix in 2f spaces, image distance v domain of definition is（F, 2f】, i.e., { v ︳ f ＜ v≤2f }.
Figure 24 is the multiple focussing image viewing mode schematic diagram based on human eye focus.2401 be camera, and 2402 be aobvious
Show interface, 2403 be eyeball, and p points are eyeball focus, and coordinate is (x, y), by camera 2401 and recognition and tracking software sharing
Eye tracking device, display interface 2402 is the display interface that multiple focussing image shows software, and multiple focussing image shows that software can
With the image of different image distances in any display multiple focussing image file as needed, and it regard required image as present image
Shown in display interface, its course of work is：1st, eyeball image is obtained by camera, eyeball is judged by recognition and tracking software
Focus p, and determine its coordinate (x, y)；2nd, p (x, y) is located to the image of all different image distances in multiple focussing image file
The image in point region carries out definition judgment, and determines wherein one in p points region definition highest correspondence image distance image, i.e. p
Put region clearly parent image；3rd, using p points region, clearly parent image is used as display interface present image.
Further, in order to improve image switch speed, multiple focussing image is entered into line definition with virtual grid and demarcated, and will
Calibration value formation index or summary record are determined in multiple focussing image file, so can be by indexing or making a summary after focus
Required image is shown immediately.So, the course of work is：1st, eyeball image is obtained by camera, sentenced by recognition and tracking software
The focus p of disconnected eyeball, and determine its coordinate (x, y)；2nd, it is corresponding in determining to index or make a summary according to the coordinate (x, y) of p points
Image, i.e., the image of a certain image distance value；3rd, the corresponding image is shown as present image in display interface.
For video image, video track of the multiple focussing image video file coded format comprising encapsulation, audio track, video track
There is its image distance label or as spacing label, further addition image clearly calibrations index or summary, its course of work is：1、
Eyeball image is obtained by camera, the focus p of eyeball is judged by recognition and tracking software, and determine its coordinate (x, y)；2nd, root
Corresponding video track, i.e., the video track of a certain image distance label in index or summary are determined according to the coordinate (x, y) of p points；3rd, will be described
Corresponding video track is shown as current video in display interface.
Further, the step of having extraction before the focus p for carrying out eyeball is shown and showing other adjacent image distance images, its
Purpose is to solve the mutation sense that image switching is produced to human eye, while human eye can also be allowed to feel zoom visual impression.
Existing eye tracking technology has：Chinese patent announces 03133764.3 intelligent control method for visual tracking, China
Visual tracking method and system of the patent announcement 200710090883.X based on particle filter, Chinese patent bulletin
200810121650.6 the Web page text individuation search method based on eye tracking, Chinese patent bulletin 200910096060.7
English text automatic abstracting method based on eye tracking.
A kind of multiple focussing image display device, it is characterized in that：Device is made up of eye tracking device and image display device,
Eye tracking device is by camera and recognition and tracking software sharing, and camera is responsible for obtaining eyeball image, and recognition and tracking software is born
Blame and the eyeball image that camera is obtained is identified tracking to determine that eyeball pays close attention to point coordinates, image display device includes poly
Jiao shows software, and multi-focus shows that software is paid close attention to coordinate extraction respective image according to the eyeball of determination and currently shown.
Figure 25 is the schematic diagram that multiple focussing image file sets up definition summary or index.Because system frequently inserts image
Definition judgment can increase overhead, in order to improve image switch speed, increase clear scale in multiple focussing image file
Definite value is made a summary or indexed, and 2501 be a certain image distance image in multiple focussing image file, and 2502 be clearly area in 2501 images
Domain, similarly, 2504 be clearly region in 2503 images, and 2506 be clearly region in 2505 images.Concrete processing procedure is：
1st, subregion is carried out with virtual grid to all images in multiple focussing image；2nd, definition judgment formation definition is carried out to each subregion
Value；3rd, definition values formation is made a summary or indexed；3rd, will summary or index be added in multiple focussing image file, or will summary or
Index is encapsulated into video file.
Definition values are that the definition of image is judged, and form numerical expression.Definition values are images in other words
The numerical expression of definition.
The step of image is shown be：1st, the image zonule to be shown is selected, area coordinate is determined；2nd, retrieval and inquisition is clear
Angle value is made a summary or indexed and determines the zonule definition values highest correspondence image distance image；3rd, the correspondence image distance figure is extracted
As currently being shown.
Figure 26 is a kind of image clearly region summary or concordance list for using image distance label for mark.First to multi-focus figure
The image of all different image distances carries out virtual grid subregion as in, compares to form x, y in summary or concordance list by definition,
K arrays, wherein x, y are the grid coordinates in image clearly region, and k is the image distance tag identifier of a certain image distance image, is determined by k values
This grid（That is the grid of image clearly）Be which correspondence image distance image, such as x3, y3, ki array representations in grid coordinates x3,
Y3 area images clearly image be ki mark corresponding image distance image.
Certainly, image distance label can directly replace with image distance value, i.e., the image of different image distances is identified with image distance value.
The step of image is shown be：1st, the image zonule to be shown is selected, grid coordinates x, y is determined；2nd, by grid
Image distance label k is uniquely determined in the index list of coordinate and image distance label composition；3rd, correspondence image distance is determined by image distance label k
Image currently shown.
Figure 27 is the step of Figure 26 sets up image distance label k values in image clearly region summary or concordance list.1st, poly is obtained
Burnt image file；2nd, assignment image distance label k values, i.e., be identified to the image of different image distances all in multiple focussing image file
Numbering；3rd, grid subregion is carried out to image, with x, y-coordinate determines grid in the position of display interface, the image side of different image distances
Lattice subregion is consistent in the position coordinates x, y of display interface；4th, grid subregion definition is compared, i.e., to different image distance image phases
Same x, the grid subregion of y-coordinate enters line definition comparison, chooses the corresponding image k values of definition highest grid, this grid
Array is x, y, k
In addition, definition is not necessarily uniformly in grid subregion, the situation for having transition, for there is the grid of transition can be with
Abandon processing.
Certainly, image distance label k values can directly replace with image distance value, i.e., the image of different image distances is identified with image distance value.
In view of subregion not necessarily use grid subregion, a kind of multiple focussing image file format, it is characterized in that：Image file
In the index list that is constituted comprising subregion coordinate and image distance；Or the index list of subregion coordinate and image distance label composition.
The image distance label is i.e. according to image slices away from the numbering or mark carried out to image.
Claims (8)
1. a kind of multiple focussing image generating means, it is characterized in that：Device not shading before and after one group of imaging len, at least two groups is arranged
Arrange and do not constituted in the linear array photosensitive unit of same image distance plane, the linear array photosensitive unit generates image by moving sweep,
The linear array photosensitive unit generates the image of different image distances, the image formation multiple focussing image file of different image distances respectively.
2. a kind of multiple focussing image generating means according to claim 1, it is characterized in that：The fortune of the linear array photosensitive unit
Dynamic scan mode is single-arm rotating scanning or both arms rotation sweep or cylindric rotation sweep or parallel sweep.
3. a kind of multiple focussing image document handling method of multiple focussing image generating means according to claim 1 or 2, its
Step is：1st, subregion is carried out with virtual grid to all images in multiple focussing image；2nd, definition judgment is carried out to each subregion
Form definition values；3rd, definition values formation is made a summary or indexed；4th, summary or index are added in multiple focussing image file,
Or summary or index are encapsulated into video file.
4. a kind of multiple focussing image document handling method of multiple focussing image generating means according to claim 3, it is walked
Suddenly it is：1st, the image zonule to be shown is selected, area coordinate is determined；2nd, retrieval and inquisition definition values are made a summary or indexed and true
The fixed zonule definition values highest correspondence image distance image；3rd, the correspondence image distance image is extracted currently to be shown.
5. a kind of multiple focussing image document handling method of multiple focussing image generating means according to claim 4, it is special
Levying is：It is that the image for extracting a certain image distance is currently shown that the triggering mode of display control is at least during progress image display
One of following manner：Control button triggering mode, mouse coordinates triggering mode, touch screen triggering mode, eyeball focus triggering side
Formula.
6. a kind of multiple focussing image document handling method of multiple focussing image generating means according to claim 5, it is walked
Suddenly it is：S1, by camera obtain eyeball image, the focus of eyeball is judged by recognition and tracking software, and determine focus seat
Mark；S2, according to the coordinate of focus in multiple focussing image file extracting focus region, clearly image is currently shown.
7. a kind of multiple focussing image document handling method of multiple focussing image generating means according to claim 1 or 2, its
Step is：A, acquisition multiple focussing image file；B, determine prime focus face image；C, extraction adjacent focus face image；D, will be adjacent
Focusing surface image and prime focus face image carry out resolution chart as fusion treatment formation fused images 1；E, extraction are another adjacent poly-
Focal plane image；F, another adjacent focus face image and fused images 1 are carried out to resolution chart as fusion treatment formation fused images
2；G, extraction time adjacent focus face image；H, secondary adjacent focus face image and fused images 2 carried out at definition image co-registration
Reason forms fused images 3；I, another adjacent focus face image of extraction；J, by another adjacent focus face image and fused images
3 carry out resolution chart as fusion treatment formation fused images 4；K, the above-mentioned image co-registration processing of repetition finally merge figure until being formed
Picture.
8. a kind of multiple focussing image document handling method of multiple focussing image generating means according to claim 7, it is special
Levy is that step D ~ K also includes following sub-step：The step of a, two images carry out having adjustment picture size before fusion treatment, that is, adjust
Fitted like a glove after the size of whole wherein piece image with another width picture size；B, two images are carried out two during image co-registration processing
The pixel of width image is that to select the pixels of a selection, i.e. fused images be that the pixels of two images selects a selection result.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510143495.8A CN104700383B (en) | 2012-12-16 | 2012-12-16 | A kind of multiple focussing image generating means and multiple focussing image document handling method |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510143495.8A CN104700383B (en) | 2012-12-16 | 2012-12-16 | A kind of multiple focussing image generating means and multiple focussing image document handling method |
| CN201210543272.7A CN103034987B (en) | 2012-12-16 | 2012-12-16 | A kind of multiple focussing image file format and generating apparatus and image file processing method |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210543272.7A Division CN103034987B (en) | 2012-12-16 | 2012-12-16 | A kind of multiple focussing image file format and generating apparatus and image file processing method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104700383A CN104700383A (en) | 2015-06-10 |
| CN104700383B true CN104700383B (en) | 2017-09-15 |
Family
ID=53347471
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510143495.8A Active CN104700383B (en) | 2012-12-16 | 2012-12-16 | A kind of multiple focussing image generating means and multiple focussing image document handling method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104700383B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20180048877A1 (en) * | 2016-08-10 | 2018-02-15 | Mediatek Inc. | File format for indication of video content |
| CN112241940B (en) * | 2020-09-28 | 2023-12-19 | 北京科技大学 | Fusion method and device for multiple multi-focus images |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102282836A (en) * | 2009-01-19 | 2011-12-14 | 索尼公司 | Display control device, method of control of display, and program |
| CN102521814A (en) * | 2011-10-20 | 2012-06-27 | 华南理工大学 | Wireless sensor network image fusion method based on multi-focus fusion and image splicing |
| CN202957905U (en) * | 2012-12-16 | 2013-05-29 | 吴凡 | Multi-focus image generating device and multi-focus image displaying device |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101220413B1 (en) * | 2010-10-15 | 2013-01-09 | 중앙대학교 산학협력단 | Apparatus and method for enhancing image quality of image captured by using multiple color-filter aperture |
-
2012
- 2012-12-16 CN CN201510143495.8A patent/CN104700383B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102282836A (en) * | 2009-01-19 | 2011-12-14 | 索尼公司 | Display control device, method of control of display, and program |
| CN102521814A (en) * | 2011-10-20 | 2012-06-27 | 华南理工大学 | Wireless sensor network image fusion method based on multi-focus fusion and image splicing |
| CN202957905U (en) * | 2012-12-16 | 2013-05-29 | 吴凡 | Multi-focus image generating device and multi-focus image displaying device |
Non-Patent Citations (1)
| Title |
|---|
| 《基于成像机理的小波包变换多聚焦图像融合》;那彦等;《应用光学》;20041231;第25卷(第2期);第51-54页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104700383A (en) | 2015-06-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Naemura et al. | Real-time video-based modeling and rendering of 3D scenes | |
| US6084979A (en) | Method for creating virtual reality | |
| Capel | Image mosaicing | |
| CN103221975B (en) | Three-dimensional imaging system | |
| Rademacher et al. | Multiple-center-of-projection images | |
| CN103034987B (en) | A kind of multiple focussing image file format and generating apparatus and image file processing method | |
| CN1215443C (en) | Layer representation of three-D body and method and device for drawing said body by utilizing it | |
| CN100449572C (en) | Motion control for image rendering | |
| US20130321575A1 (en) | High definition bubbles for rendering free viewpoint video | |
| US20110057941A1 (en) | System and method for inserting content into an image sequence | |
| CN108038911B (en) | Holographic imaging control method based on AR technology | |
| Lin et al. | Deep multi depth panoramas for view synthesis | |
| Park et al. | View image generation in perspective and orthographic projection geometry based on integral imaging | |
| CN1922544A (en) | Method and apparatus for providing a combined image | |
| CN110431847A (en) | Virtual reality projection, filling, area-of-interest and viewport relative trajectory and the method and device for supporting viewport roll signal are derived in ISO base media file format | |
| CN109241841A (en) | The acquisition methods and device of video human movement | |
| JP2004505391A (en) | Multidimensional image system for digital image input and output | |
| CN104700383B (en) | A kind of multiple focussing image generating means and multiple focussing image document handling method | |
| CN202957905U (en) | Multi-focus image generating device and multi-focus image displaying device | |
| CN104700382B (en) | A kind of multiple focussing image document handling method | |
| Wen et al. | Nonlinear mapping method for the generation of an elemental image array in a photorealistic pseudoscopic free 3D display | |
| JPH10111951A (en) | Method and device for image processing and storage medium | |
| Drobnitzky et al. | Survey and systematization of 3D object detection models and methods | |
| JP2001283201A (en) | Method for creating three-dimensional image data and method for creating optional viewpoint image using three-dimensional image data | |
| Park et al. | Arbitrary view generation from multiple cameras |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB03 | Change of inventor or designer information |
Inventor after: Cang Zhi Inventor after: Wu Fan Inventor before: Wu Fan |
|
| CB03 | Change of inventor or designer information | ||
| CB03 | Change of inventor or designer information |
Inventor after: Cang Zhi Inventor after: Shao Ziqiang Inventor after: Wang Huiyan Inventor after: Lu Qingsheng Inventor after: Wu Fan Inventor before: Cang Zhi Inventor before: Wu Fan |
|
| CB03 | Change of inventor or designer information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP02 | Change in the address of a patent holder |
Address after: 225321 No. 108 Mingzhu Avenue, Yongan Town, Taizhou port, Jiangsu Patentee after: Wu Fan Address before: 226001 Jiangsu Province, Nantong City Chongchuan District Beiyuan Village No. 3 building 14 room 404 Patentee before: Wu Fan |
|
| CP02 | Change in the address of a patent holder | ||
| CP02 | Change in the address of a patent holder |
Address after: 226001 No. 58 Chongchuan Road, Nantong City, Jiangsu Province, Science and Technology Park 1-109 Patentee after: Wu Fan Address before: 225321 No. 108 Pearl Avenue, Yonganzhou Town, Gaogang District, Taizhou City, Jiangsu Province Patentee before: Wu Fan |
|
| CP02 | Change in the address of a patent holder | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20220316 Address after: 226000 Room 501, building 7, Wuzhou City Plaza, No. 25, Zhongxiu Middle Road, Zhongxiu street, Chongchuan District, Nantong City, Jiangsu Province Patentee after: Nantong zhongkuo Information Technology Co.,Ltd. Address before: 226001 No. 58 Chongchuan Road, Nantong City, Jiangsu Province, Science and Technology Park 1-109 Patentee before: Wu Fan |
|
| TR01 | Transfer of patent right |