CN104700382B - A kind of multiple focussing image document handling method - Google Patents
A kind of multiple focussing image document handling method Download PDFInfo
- Publication number
- CN104700382B CN104700382B CN201510143494.3A CN201510143494A CN104700382B CN 104700382 B CN104700382 B CN 104700382B CN 201510143494 A CN201510143494 A CN 201510143494A CN 104700382 B CN104700382 B CN 104700382B
- Authority
- CN
- China
- Prior art keywords
- image
- distance
- focus
- multiple focussing
- imaging
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000000034 method Methods 0.000 title claims description 32
- 210000005252 bulbus oculi Anatomy 0.000 claims description 33
- 238000003491 array Methods 0.000 claims description 2
- 239000000284 extract Substances 0.000 claims description 2
- 238000003384 imaging method Methods 0.000 abstract description 156
- 238000010276 construction Methods 0.000 abstract description 7
- 238000003672 processing method Methods 0.000 abstract description 4
- 230000000694 effects Effects 0.000 abstract description 3
- 230000033001 locomotion Effects 0.000 description 54
- 210000001508 eye Anatomy 0.000 description 18
- 238000012545 processing Methods 0.000 description 14
- 230000004927 fusion Effects 0.000 description 13
- 238000000605 extraction Methods 0.000 description 12
- 238000002156 mixing Methods 0.000 description 11
- 230000008569 process Effects 0.000 description 7
- 230000035945 sensitivity Effects 0.000 description 7
- 239000007787 solid Substances 0.000 description 7
- 101100117236 Drosophila melanogaster speck gene Proteins 0.000 description 6
- 238000010586 diagram Methods 0.000 description 6
- 238000006073 displacement reaction Methods 0.000 description 6
- 239000000203 mixture Substances 0.000 description 6
- 238000010606 normalization Methods 0.000 description 6
- 238000012856 packing Methods 0.000 description 6
- 238000004422 calculation algorithm Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 4
- 230000008859 change Effects 0.000 description 3
- 239000004744 fabric Substances 0.000 description 3
- 238000009434 installation Methods 0.000 description 3
- 238000013507 mapping Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000000926 separation method Methods 0.000 description 3
- 238000004088 simulation Methods 0.000 description 3
- 230000009466 transformation Effects 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 2
- 239000003086 colorant Substances 0.000 description 2
- 230000006835 compression Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 238000005538 encapsulation Methods 0.000 description 2
- 210000003128 head Anatomy 0.000 description 2
- 238000009738 saturating Methods 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 230000007704 transition Effects 0.000 description 2
- PCTMTFRHKVHKIS-BMFZQQSSSA-N (1s,3r,4e,6e,8e,10e,12e,14e,16e,18s,19r,20r,21s,25r,27r,30r,31r,33s,35r,37s,38r)-3-[(2r,3s,4s,5s,6r)-4-amino-3,5-dihydroxy-6-methyloxan-2-yl]oxy-19,25,27,30,31,33,35,37-octahydroxy-18,20,21-trimethyl-23-oxo-22,39-dioxabicyclo[33.3.1]nonatriaconta-4,6,8,10 Chemical compound C1C=C2C[C@@H](OS(O)(=O)=O)CC[C@]2(C)[C@@H]2[C@@H]1[C@@H]1CC[C@H]([C@H](C)CCCC(C)C)[C@@]1(C)CC2.O[C@H]1[C@@H](N)[C@H](O)[C@@H](C)O[C@H]1O[C@H]1/C=C/C=C/C=C/C=C/C=C/C=C/C=C/[C@H](C)[C@@H](O)[C@@H](C)[C@H](C)OC(=O)C[C@H](O)C[C@H](O)CC[C@@H](O)[C@H](O)C[C@H](O)C[C@](O)(C[C@H](O)[C@H]2C(O)=O)O[C@H]2C1 PCTMTFRHKVHKIS-BMFZQQSSSA-N 0.000 description 1
- 241000251468 Actinopterygii Species 0.000 description 1
- 125000000174 L-prolyl group Chemical group [H]N1C([H])([H])C([H])([H])C([H])([H])[C@@]1([H])C(*)=O 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 239000000571 coke Substances 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000009795 derivation Methods 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 238000002955 isolation Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000035772 mutation Effects 0.000 description 1
- 238000012634 optical imaging Methods 0.000 description 1
- 239000002245 particle Substances 0.000 description 1
- 230000002688 persistence Effects 0.000 description 1
- 230000000644 propagated effect Effects 0.000 description 1
- 230000000630 rising effect Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Landscapes
- Studio Devices (AREA)
Abstract
The present invention relates to a kind of multiple focussing image file format and generating means and image file processing methods.It is characterized in that：Image file is by the image construction of at least two different image distances, described image image distance or as distance values are recorded in described image file;Device is made of one group of imaging lens system, at least two groups monofocal image-forming assembly, and the monofocal image-forming assembly includes spectroscope, imaging unit, and some light of imaging lens system is distributed to the imaging unit and is imaged by spectroscope;Device is made of imaging len, zoom lens control device, imaging unit;Device is made of in the linear array photosensitive unit of same image distance plane in tandem and not one group of imaging len, at least two groups, and the linear array photosensitive unit forms image by rotation sweep;Advantageous effect is：All focusing surface images of far and near different objects can be shot by multiple focussing image generating means, and generate a kind of multiple focussing image file format, image file can be handled in the later stage in this way.
Description
Present patent application is divisional application.The application number of original bill is：2012105432727；The applying date is：
20121216；Denomination of invention is：" a kind of multiple focussing image file format and generating means and image file processing method ".
Technical field
The present invention relates to a kind of multiple focussing image file format and generating means and image file processing methods.
Background technology
Image file format is the format of record and storage image information, is stored, handled, propagated to digital picture,
Certain picture format must be used, that is, the pixel of image is carried out tissue and storage according to certain mode, image
Data storage must arrive image file at file.Image file format determines store what type of letter hereof
Breath, how compatible with various application software file is, file how with other exchange files data.
Picture format has at present：BMP (Bitmap) format, TIFF (TagImage File Format) format
（Author, copyright, remarks and self-defined information can be added in tiff format）、GIF(Graphic Interehange Format)
Format（A kind of LZw compressed formats）, jpeg format（Joint Photographic Experts Group combine picture expert
Group）, PDF (Portable Document Format) format, PNG format etc..
Video image format has at present：Microsoft's video：wmv、asf、asx ；Real Player ：rm、 rmvb ；MPEG
Video：mpg、mpeg、mpe ；Mobile video：3gp ；Apple videos：mov ；Sony videos：mp4、m4v ；Other are often
See video：Avi, dat, mkv, flv, vob etc..Video file is a kind of container encapsulation format, i.e. a receptacle is wrapped in
Different tracks, the format of the container used are related to the scalability of video shelves.
Above-mentioned picture and video image file are two dimensional image pixel sets, i.e., all images of a certain focussing plane
Pixel set, since object far and near distance is different（Object distance is different）, so image distance is also different, it is flat by the image after optical focus
There is clearly part in face（Focus point）, there is fuzzy part（Non-focusing point）, two dimensional image recording mode cannot will be far and near different
The imaging and focusing points of all objects record.
3-D view recording mode has the graphic file of the formats such as STL, DXF, IGS, PLY, obj, 3ds as data at present
Fabric Interface interacts formula stereoscopic display to figure, if IGS is a kind of general three-dimensional drawing exchange format, is used for
The digital control processings such as solidedge, Pro/E, the pixel of this kind of image file format are three-dimensional coordinate formats, and each pixel
Point is accurate object dimensional coordinate, i.e., describes object with three-dimensional coordinate, picture format proposed by the present invention is to use three-dimensional coordinate
All image pixels of optical focus plane are described, these image slices are known as clearly focus point, also there is fuzzy non-focusing point,
It has any different with existing three-dimensional modeling picture format.
Invention content
Image of the present invention includes picture and video image.
A kind of multiple focussing image file format, that is, document No. method of the present invention or file coding format.
Picture file generally comprises file header structure（FILEHEADER）, information header structure（INFOHEADER）, position
Figure color table（RGBQUAD）, bitmap pixels data, wherein file header structure, information header structure definition file attributive character be
Item of information, bitmap color table, bitmap pixels data are to store the logical place of image.
Video image file is made of file header, index block and data block, and wherein data block includes actual data stream, that is, is schemed
Picture and sound sequence data, index block include data block list and their positions hereof, with provide in file data with
Machine access capability, file header include the general information of file, define data format, the parameters such as compression algorithm used, by data
Stream generates the frame image of video image file.
A kind of multiple focussing image file format, it is characterized in that：Image file by least two different image distances image construction.
A kind of multiple focussing image file format, it is characterized in that：Image file by least two different image distances image construction,
Described image image distance value is recorded in described image file.
A kind of multiple focussing image file format, it is characterized in that：Image file by least two different image distances image construction,
Being recorded in described image file as distance values between described image.
A kind of multiple focussing image file format, it is characterized in that：Image file by least two different image distances image construction,
Described image image distance or as distance values are recorded in described image file.
A kind of multiple focussing image file format, it is characterized in that：Include focal length numerical value in image file.
A kind of multiple focussing image file format, it is characterized in that：It makes a summary or indexes comprising definition values in image file.
A kind of multiple focussing image file format, it is characterized in that：It is formed comprising subregion coordinate and image distance in image file
Index list；Or the index list of subregion coordinate and image distance label composition.
A kind of multiple focussing image file format, it is characterized in that：Image file by least two different image distances image construction,
The image pixel point coordinates of described image is x, y, z by three-dimensional coordinate description, and wherein it is poly- in image distance to describe the pixel of image by x, y
The position of focal plane, z describe pixel x, y plane determined distance of the normal direction away from reference plane.
A kind of multiple focussing image video file coded format, packing forms include video track, audio track, it is characterized in that：Envelope
Include multiple video tracks in dress form, each video track has its image distance label or as spacing label.
The multiple focussing image video file coded format, it is characterized in that：Also include image clarity values in packing forms
Abstract or index.
A kind of multiple focussing image generating means, it is characterized in that：Device is imaged by one group of imaging len, at least two groups monofocal
Component is constituted, and the monofocal image-forming assembly includes spectroscope, imaging unit, and spectroscope distributes some light of imaging len
It is imaged to the imaging unit.
A kind of multiple focussing image generating means, it is characterized in that：Device is folded in tandem by one group of imaging len, at least two groups
The transparent image unit added is constituted, and the transparent image unit is responsible for the image imaging of different image distances.
A kind of multiple focussing image generating means, it is characterized in that：Device is made of imaging len, zoom lens control device, imaging unit,
The zoom lens control device is responsible for being imaged zoom, and zoom lens control device is responsible for providing corresponding image distance numerical value simultaneously, and the zoom lens control device is being taken the photograph
Reciprocating motion state is in when picture, one group of image that a reciprocation period obtains is a multiple focussing image file.
A kind of multiple focussing image generating means, it is characterized in that：The movement of zoom lens control device is at the uniform velocity when shooting.
A kind of multiple focussing image generating means, it is characterized in that：The movement of zoom lens control device is shake son movement when shooting
Mode, that is, sinus wave patters.
A kind of multiple focussing image generating means, it is characterized in that：The movement of zoom lens control device is step-by-step system when shooting.
A kind of multiple focussing image generating means, it is characterized in that：Device is by not shading before and after one group of imaging len, at least two groups
It arranges and is not constituted in the linear array photosensitive unit of same image distance plane, the linear array photosensitive unit passes through moving sweep and generates figure
Picture.
A kind of multiple focussing image generating means, it is characterized in that：The moving sweep mode of linear array photosensitive unit is single
Arm rotation sweep or both arms rotation sweep or cylindric rotation sweep or parallel sweep.
A kind of multiple focussing image generating means, it is characterized in that：In the light path of linear array photosensitive unit and imaging len
Column is set and is distorted correcting lens.
A kind of multiple focussing image generating means, it is characterized in that：Between linear array photosensitive unit and imaging len away from
From adjustable.
The imaging unit or linear array photosensitive unit are CCD or COMS elements.
A kind of multiple focussing image generating means are applied to camera, video camera, microscope.
A kind of multiple focussing image document handling method, step are：A, multiple focussing image file is obtained；B, prime focus is determined
Face image；C, extraction adjacent focus face image；D, adjacent focus face image and prime focus face image resolution chart picture is carried out to melt
It closes processing and forms blending image 1；E, another adjacent focus face image is extracted；F, by another adjacent focus face image and blending image
1 carries out resolution chart as fusion treatment forms blending image 2；G, time adjacent focus face image is extracted；H, by secondary adjacent focus face
Image and blending image 2 carry out resolution chart as fusion treatment forms blending image 3；I, another secondary adjacent focus face figure is extracted
Picture；J, another secondary adjacent focus face image and blending image 3 are subjected to resolution chart as fusion treatment forms blending image 4；K、
Above-mentioned image co-registration processing is repeated until forming final blending image.
A kind of multiple focussing image document handling method, it is characterized in that step D ~ K further includes following sub-step：A, two width
Image has the step of adjustment picture size before carrying out fusion treatment, that is, adjusts after the wherein size of piece image and another piece image
Size fits like a glove；B, the pixel that two images carry out two images when image co-registration processing is to select a selection, i.e. fusion figure
The pixel of picture is that the pixel of two images selects a selection result.
Or, in view of the clear display of prime focus face image, it is characterized in that step D ~ K further includes following sub-step：It is main poly-
Clearly image pixel is selected in a selection prime focus face image when focal plane image and adjacent focus face image co-registration forms fusion figure
As 1；Clearly image pixel is selected in a selection image 1 when image 1 and another adjacent focus face image co-registration forms blending image
2；Successively by after fusion image and other focusing surface images merged when select a selection fusion after image in clearly scheme
As pixel forms final blending image.
A kind of multiple focussing image document handling method, it is characterized in that step D ~ K further includes following sub-step：A, two width
Image has the step of adjustment image slices vegetarian refreshments x, y-coordinate before carrying out fusion treatment, that is, adjusts the image pixel of wherein piece image
Image slices vegetarian refreshments x, the y-coordinate of point x, y-coordinate and another piece image are completely the same；B, when two images carry out image co-registration processing
The pixel of two images is to select a selection, i.e. the pixel of blending image is that the pixel of two images selects a selection knot
Fruit.
A kind of multiple focussing image document handling method, it is characterized in that：It is the figure for extracting a certain image distance when performing image display
As currently being shown, the triggering mode of display control is at least such as one of under type：Control button triggering mode, control button
Mouse drag triggering mode, mouse coordinates triggering mode, mouse coordinates and button triggering mode, touch screen triggering mode, touch screen touch
Moving coordinates and touch screen triggering mode, eyeball focus triggering mode.
The step of image of a certain image distance of the extraction further includes：The step of image definition is judged；Or retrieval
The step of inquiry definition values make a summary or index and determine definition values highest, or determine the rope being made of subregion coordinate and image distance
The step of drawing image distance in list；Or the step of determining image distance label in the index list being made of subregion coordinate and image distance label.
A kind of multiple focussing image document handling method, step are：S1, eyeball image is obtained by camera, passes through identification
Tracking software judges the focus of eyeball, and determines concern point coordinates；S2, according to the coordinate of focus in multiple focussing image file
Clearly image is currently shown in middle extraction focus region.
Further, further include that point coordinates is paid close attention in multiple focussing image clarity indexes or makes a summary according to eyeball in step S2
Focus region clearly correspondence image, i.e., the image of a certain image distance value are searched, and is schemed using the corresponding image as current
As being shown in display interface.
Image fusion technology has at present：Chinese patent bulletin 200910104632.1 discloses a kind of utilization Fisher classification
With the multi-focus image fusing method of wavelet transformation；Chinese patent announces 200910147247.5 image processing equipments, imaging is set
Standby, image processing method and program；Chinese patent bulletin 201010527509.3 is a kind of based on wavelet transformation and domain features
Multi-focus image fusing method；A kind of 200710064739.9 image combining method of Chinese patent bulletin and device；Chinese patent
It announces 200810017326.X and is based on imaging mechanism and nonsubsampled contourlet transform multi-focus image fusing method.
The beneficial effects of the invention are as follows：The all poly- of far and near different objects can be shot by multiple focussing image generating means
Focal plane image, and a kind of multiple focussing image file format is generated, image file can be handled in the later stage in this way, for example take
Go out the focusedimage of jobbie, or fusion treatment is carried out to image, generates a kind of clear image that far and near object focuses, or
Person according to the focal length of photographic device, the image distance of object, focusing surface as the distance of distance computation object and the relative distance of object,
Or generate the stereo-picture of object.It is more that the embodiment for being imaged heap using spectroscope and linear array multi-focus can solve shooting activity
The problem of focusedimage.Multiple focussing image is browsed based on eye tracking device, human eye focus may be implemented to real world
Simulation, i.e. multi-focus display device realize that zoom is shown, form a kind of completely new image-watching mode, including picture and video.
Description of the drawings
Fig. 1 is the relational graph that image distance changes with object distance when lens imaging focuses.
Fig. 2 is that multiple focussing image generating means of the present invention use spectroscopical embodiment.
Fig. 3 is the embodiment that multiple focussing image generating means of the present invention use transparent image unit.
Fig. 4 is image pixel coordinates describing mode in transparent image unit in Fig. 3.
Fig. 5 is the embodiment that multiple focussing image generating means of the present invention use imaging unit to move back and forth.
Fig. 6 is that multiple focussing image generating means of the present invention are arranged on wedge inclined-plane using linear array photosensitive unit and are followed tiltedly
The embodiment that face moves back and forth scanning imagery in x-axis direction.
Fig. 7 is the embodiment party that multiple focussing image generating means of the present invention use both arms linear array photosensitive unit rotating scan imaging
Case.
Fig. 8 is the view in both arms linear array photosensitive unit z-axis direction in Fig. 7.
Fig. 9 is both arms linear array photosensitive unit z-axis direction isometric plan in Fig. 7.
Figure 10 is the implementation that multiple focussing image generating means of the present invention use single armed linear array photosensitive unit rotating scan imaging
Scheme.
Figure 11 is the view in single armed linear array photosensitive unit z-axis direction in Figure 10.
Figure 12 is single armed linear array photosensitive unit z-axis direction isometric plan in Figure 10.
Figure 13 is that multiple focussing image generating means of the present invention are arranged in the different cylinder knot of diameter using linear array photosensitive unit
The embodiment of rotating scan imaging on structure.
Figure 14 is image file format attribute list of the present invention.
Figure 15 is file format structure figure of the present invention.
Figure 16 is step scanning signal voltage u, time t, z-axis displacement relation figure.
Figure 17 is that the step of imaging unit of the present invention synthesizes multiple focussing image file is schemed.
Figure 18 is that the step of linear array photosensitive unit of the present invention generates multiple focussing image file is schemed.
Figure 19 is a kind of method of image co-registration of the present invention.
Figure 20 is a kind of image viewer provided by the invention or video player surface chart.
The step of Figure 21 is multiple focussing image file generated 3-D view of the present invention.
Figure 22 is linear array motion encoder image coding principle.
Figure 23 is space three-dimensional image image-forming principle.
Figure 24 is that the multiple focussing image based on human eye focus watches mode schematic diagram.
Figure 25 is the schematic diagram that multiple focussing image file establishes clarity abstract or index.
Figure 26 is to use image distance label for a kind of image clearly region of mark abstract or concordance list.
Figure 27 is the step of Figure 26 establishes image distance label k values in image clearly region abstract or concordance list.
Specific implementation mode
Present invention will be further explained below with reference to the attached drawings and examples.
Fig. 1 is the relational graph that image distance changes with object distance when lens imaging focuses.Lens imaging formula（Also known as Gauss is imaged public
Formula）Form is：1/f=1/u+1/v
Wherein f is focal length, convex just recessed negative；U is object distance；V is image distance, real weakened body resistance negative.
Fortran is：The areas imaging of v=f*u/ (u-f), real image are image distance f ~ 2f, and corresponding object distance is ∞ ~ 2f
V to u differentiate for：V'=-f^2* (u-f) ^ (- 2), it can be deduced that：Derivative absolute value closer to 2f is bigger, i.e.,
Slope is bigger, i.e. the change rate of image distance is bigger；Derivative absolute value closer to f is smaller, i.e., slope is smaller, i.e. the change rate of image distance
It is smaller.
It illustrating, to obtain the clear image of different object distances object, the imaging unit near 2f wants intensive arrangement,
Imaging unit near f sparse can be arranged；Or the intensive arrangement in crucial image distance position；Or imaging unit be arranged in f ~ 2f it
Between a certain section form multi-focus and be imaged heap, the distance between imaging unit is adjustable, and multi-focus is imaged between heap and imaging len
Apart from adjustable.
Diagram also illustrates simultaneously, as needed, as long as the imaging unit of arrangement limited quantity is obtained with different object distances
The clear image of object.
If arranging imaging unit in f ~ 2f universes, total focus image is formed.
If using full shot, such as fish eye lens can form panorama total focus image.
For imaging lens group, such as zoom system, pancreatic system, areas imaging f ~ 2f of the present invention is the imaging region of zoom system, pancreatic system.
Optical imaging concept of the present invention is located at ∞ ~ 2f with object, and areas imaging illustrates for being located at the simple lens of f ~ 2f, right
It is located at 2f ~ f in object, areas imaging is then 2f ~ ∞, such as microscope, the screen of motion picture projection, so imaging of the present invention
Range f ~ 2f is no longer appropriate for, and can be stated with imaging region, thus areas imaging f ~ 2f conceptual understandings of the present invention be at
As region, multi-focus imaging heap is located at imaging region.
The multi-focus imaging heap is applied to camera, video camera, microscope.
In fact, the object of camera, shot by camera is generally in the position much larger than 2f, so imaging region is general
It is located adjacent to the position of f, microscopical imaging is generally in the position much larger than object lens 2f, so being crucial image distance in practical application
The intensive arrangement imaging unit in position, preferable embodiment be using certain image distance direction thickness multi-focus imaging heap be used as at
As unit, it is applied to required imaging region.
Fig. 2 is that multiple focussing image generating means of the present invention use spectroscopical embodiment.201、202、203、204、205
It is the object of different distance, 206 be imaging len, and 207,210,211,214,215 be the imaging unit for being arranged in different image distances,
208,209,212,213 be spectroscope, and spectroscopical effect is a part of light of transmission, reflects a part of light, in this way can be light
Line is divided into two projecting directions.Here to illustrate for choosing the object of 5 different distances, by the picture for adjusting imaging unit
Away from making imaging unit 207 be located at the focusing surface of object 201, imaging unit 210 is located at the focusing surface of object 202, imaging unit
211 are located at the focusing surface of object 203, and imaging unit 214 is located at the focusing surface of object 204, and imaging unit 215 is located at object 205
Focusing surface, spectroscope 208 is responsible for a part of light distributing to imaging unit 207, and spectroscope 209 is responsible for a part of light
Imaging unit 210 is distributed to, spectroscope 212 is responsible for a part of light distributing to imaging unit 211, and spectroscope 213 is responsible for will
A part of light distributes to imaging unit 214, and imaging unit each in this way can obtain the clear figure of respective focusing surface object
Picture.
Fig. 3 is the embodiment that multiple focussing image generating means of the present invention use transparent image unit.301,302,303 are
The object of different distance, 304 be imaging len, and 305,306,307 be to arrange the transparent image unit being superimposed, at least 2
It is a to arrange the transparent image unit composition three-dimensional imaging unit being superimposed, three formed with 3 transparent image units in figure
For tieing up imaging unit, by adjusting the image distance of three-dimensional imaging unit, transparent image unit 305 is located at the focusing surface of object 301,
Transparent image unit 306 is located at the focusing surface of object 302, and transparent image unit 307 is located at the focusing surface of object 303, exists in this way
The clear image of different distance object is formed in three-dimensional imaging unit.
Further, the distance between described transparent image unit intensive arrangement, such as transparent image unit be equal to it is transparent at
As the distance of unit pixel, three-dimensional imaging heap or three-dimensional imaging unit are thus formed, in three-dimensional imaging heap or three-dimensional imaging list
In member, any pixel point can be by x, and y, z coordinate description determines, can thus record all in lens imaging space
Pixel, the image progress plane that any image distance plane can be intercepted in image repetition show that any image distance of interception is flat
The image appearance form in face is the image of a certain image distance.Alternatively, it is also possible to which all pixels point progress space diagram is shown.
Fig. 4 is image pixel coordinates describing mode in transparent image unit in Fig. 3.P1 is in transparent image unit 305
The coordinate of a certain pixel, pixel is（x1,y1,z1）, wherein x1, y1 are that image slices vegetarian refreshments is sat in the two dimension of the plane of delineation
Mark, the two-dimensional coordinate is the expression packaged type of image pixel positions in conventional images file format, and z1 is pixel in z-axis
The location presentation in direction can be exhausted degree distance, as p1 pixel range Imagings lens centre distance or distance focal point away from
From can also be relative distance, such as the relative distance between transparent image unit.Similarly p2 is in transparent image unit 306
The coordinate of a certain pixel, pixel is（x2,y2,z2）, p3 is a certain pixel in transparent image unit 307, pixel
Coordinate be（x3,y3,z3）.
The distance that the arrangement of transparent image unit is superimposed can be equidistant or Unequal distance, such as close to the location arrangements of 2f
It is intensive, it is sparse close to f location arrangements；Or the intensive arrangement in crucial image distance position；Or transparent image unit is arranged in certain between f ~ 2f
One section forms multi-focus and is imaged heap, and it is adjustable that multi-focus is imaged the distance between heap and imaging len.
Fig. 5 is the embodiment that multiple focussing image generating means of the present invention use imaging unit to move back and forth.401 be object
Body, 402 be imaging len, and 403 be telefocus position, i.e. the focal position of farthest object, and 404 be near focus position,
That is the focal position of most near objects, 405 be kinematic driving unit, that is, images servomechanism installation.Device is during camera shooting, by transporting
Dynamic driving device driving imaging unit moves back and forth along the z-axis direction, and a period of motion forms a complete image format packet, institute
It states picture format packet and includes at least 2 focusing surface picture frames.
The motion mode of kinematic driving unit has：1, rectilinear motion mode, i.e. imaging unit in z-axis direction, f ~ 2f it
Between at the uniform velocity to move back and forth；2, movement of pendulum mode, i.e. imaging unit are shaken between f ~ 2f with sine wave in z-axis direction
Flowing mode moves back and forth, and amplitude is focal length f, and the vibrations period is T, then image distance v can be expressed as：v=0.5*f*sin(2∏
T/T), v is to time derivation：V'=f* (∏/T) * cos (2 ∏ t/T), parameter v and v' are encoded for picture format, and ∏ is circle
Frequency；3, step motion mode has the motion mode that moment is static halfway, i.e., imaging unit is in z-axis direction, between f ~ 2f
At least 2 quiescent time sections, Duan Weiyi picture frame period of quiescent time during moving back and forth.
The motion mode of kinematic driving unit is controlled by moving sweep signal, and moving sweep signal is corresponding according to motion mode
Ground is divided into：1, linear scan signal, you can to drive imaging unit to be moved back and forth along the z-axis direction with even speed；2, just
String wave scanning signal, you can to drive imaging unit to be moved back and forth along the z-axis direction with sine wave vibration mode；3, ladder is swept
Retouch signal, you can to drive imaging unit to move back and forth along the z-axis direction, at least 2 quiescent time sections in motion process,
The picture frame period FT of quiescent time Duan Weiyi, Figure 16 are step scanning signal voltage u, time t, z-axis displacement relation figure, z1,
Z2, z3 are respectively 3 rest points of the imaging unit in z-axis, and quiescent time section is FT, i.e. a picture frame period, 3 static
Corresponding voltage value u1, u2, u3, i.e. voltage value u1, u2, u3 are remained unchanged point in FT quiescent times section respectively.U-z figures can be seen that
Imaging unit is moved with scanning voltage value, that is, the displacement occurred is controlled by voltage value.
According to the persistence of vision of human eye, general minimum 24Hz, if the scan frequency for choosing kinematic driving unit is
24Hz, i.e. period about 0.04 second, imaging unit picture frame period is necessarily less than 0.04 second, is such as chosen 1/500 second, then a movement
The image that 20 frame difference image distances can be accommodated in period, can thus form multi-focus live image.
For movement of pendulum mode, it is contemplated that shake the intrinsic frequency of object, when implementation, which passes through, adjusts the attached of imaging unit
The elasticity of quality and fixing device is added to keep intrinsic frequency consistent with driving scanning signal frequency.
The motion mode, that is, moving sweep mode, i.e. imaging unit are reciprocal back and forth in lens imaging region by motion mode
Scanning motion.
For shooting the camera apparatus of one group of image, imaging unit in shooting shooting process may be used and be only completed one
Moving sweep period, shooting process record the coordinate (x, y, z) of all image slices vegetarian refreshments, form multiple focussing image file.
Fig. 6 is that multiple focussing image generating means of the present invention are arranged on wedge inclined-plane using linear array photosensitive unit and are followed tiltedly
The embodiment that face moves back and forth scanning imagery in x-axis direction.601,602,603 be different distance object, 604 is saturating for imaging
Mirror, 605 be wedge inclined-plane, and linear array photosensitive unit is disposed on wedge inclined-plane 605, and 606 be one of linear array photosensitive unit, linear array sense
Light unit is made of a photoelectric chip, this linear array photosensitive unit scanning imagery that current scanline instrument uses, two phases
Upright projection distance of the adjacent line battle array photosensitive unit in z-axis direction is h, and h values can be used as image distance value parameter, linear array photosensitive unit cloth
It sets between z-axis projector distance f ~ 2f, can be equidistant placement or Unequal distance arrangement, the location arrangements of such as close 2f are intensive, lean on
Nearly f location arrangements are sparse.When shooting, wedge inclined-plane 605 moves back and forth device in x projecting directions, image distances different in this way
Linear array photosensitive unit scanned by the directions x, obtain the focusing surface image of different image distances.Wedge inclined-plane 605 x projecting directions with
The mode or movement of pendulum mode at the uniform velocity moved back and forth, i.e. wedge inclined-plane 605 are in x projecting directions with sine wave vibrations side
Formula moves back and forth.
The motion mode, that is, moving sweep mode, i.e. linear array photosensitive unit by motion mode lens imaging region back and forth
Shuttle-scanning moves.
The scanning motion of the linear array photosensitive unit is parallel sweep, i.e. reciprocal fortune of the linear array photosensitive unit in x-axis direction
Dynamic rail mark is mutually parallel.
The construction of linear array photosensitive unit is to arrange sensitivity speck photoelectric chip in a straight line, and photoelectric chip is generally CCD
Or COMS, meanwhile, each sensitivity speck is also responsible for the three primary colours separation of pixel, and the prior art has：Color filter isolation technics, three
CCD color separations technology, list CCD color separation scanning techniques.The pixel signal that the sensitivity speck of linear array photosensitive unit obtains is simulation
Signal, so also have the process for converting analog signal to digital signal, i.e. A/D conversions.Linear array photosensitive unit is a kind of one-dimensional
Imaging sensor, existing one-dimensional image sensor are used for traditional scanner.
Fig. 7 is the embodiment party that multiple focussing image generating means of the present invention use both arms linear array photosensitive unit rotating scan imaging
Case.701,702,703 be different distance object, 704 be imaging len, and 705,706,707,708,709,710 be both arms line
Battle array photosensitive unit, 711 be shaft, and the central point of both arms linear array photosensitive unit is connected in shaft 711.When device images, both arms
Linear array photosensitive unit 705,706,707,708,709,710 generates different with the focusing surface of 711 rotary scanning difference image distance of shaft
The image of image distance focusing surface.
The motion mode of the present embodiment is that both arms linear array photosensitive unit rotates to form focusing surface in lens imaging region
Moving sweep mode.
Fig. 8 is the view in both arms linear array photosensitive unit z-axis direction in Fig. 7.Both arms linear array photosensitive unit can be evenly arranged
It can not also be evenly arranged.Or the intensive arrangement in crucial image distance position.Or both arms linear array photosensitive unit is arranged in a certain section of f ~ 2f, it is double
The distance between arm linear array photosensitive unit is adjustable, and the distance between both arms linear array photosensitive unit and imaging len are adjustable, i.e. both arms
Linear array photosensitive unit can move back and forth in z-axis direction to be adjusted.
Fig. 9 is both arms linear array photosensitive unit z-axis direction isometric plan in Fig. 7.Both arms linear array photosensitive unit be arranged in f ~
Can be equidistant placement or Unequal distance arrangement, such as intensive close to the location arrangements of 2f, close f location arrangements are sparse between 2f.Or
The crucial intensive arrangement in image distance position.Or both arms linear array photosensitive unit is arranged in a certain section of f ~ 2f and forms linear array multi-focus imaging heap,
The distance between both arms linear array photosensitive unit is adjustable, and the distance between both arms linear array photosensitive unit and imaging len are adjustable, i.e. line
Battle array multi-focus imaging heap can move back and forth in z-axis direction to be adjusted.
Figure 10 is the implementation that multiple focussing image generating means of the present invention use single armed linear array photosensitive unit rotating scan imaging
Scheme.1001,1002,1003 be different distance object, 1004 be imaging len, 1005,1006,1007,1008,1009,
1010 be single armed linear array photosensitive unit, and 1011 be shaft, and one end of single armed linear array photosensitive unit is connected in shaft 1011.Device
When camera shooting, single armed linear array photosensitive unit 1005,1006,1007,1008,1009,1010 is with 1011 rotary scanning difference picture of shaft
Away from focusing surface, generate the image of different image distance focusing surfaces.
The motion mode of the present embodiment is that single armed linear array photosensitive unit rotates to form focusing surface in lens imaging region
Moving sweep mode.
Figure 11 is the view in single armed linear array photosensitive unit z-axis direction in Figure 10.Single armed linear array photosensitive unit can uniform cloth
Setting can not also be evenly arranged；Or the intensive arrangement in crucial image distance position；Or single armed linear array photosensitive unit is arranged in a certain section of f ~ 2f
It forms linear array multi-focus and is imaged heap, the distance between single armed linear array photosensitive unit is adjustable, and single armed linear array photosensitive unit and imaging are saturating
The distance between mirror is adjustable, i.e., linear array multi-focus imaging heap can move back and forth in z-axis direction is adjusted.
Figure 12 is single armed linear array photosensitive unit z-axis direction isometric plan in Figure 10.Single armed linear array photosensitive unit is arranged in f
Can be equidistant placement or Unequal distance arrangement, such as intensive close to the location arrangements of 2f, close f location arrangements are sparse between ~ 2f；
Or the intensive arrangement in crucial image distance position；Or single armed linear array photosensitive unit is arranged in a certain section of f ~ 2f and forms the imaging of linear array multi-focus
Heap, the distance between single armed linear array photosensitive unit is adjustable, and the distance between single armed linear array photosensitive unit and imaging len are adjustable, i.e.,
Linear array multi-focus imaging heap can move back and forth in z-axis direction to be adjusted.
Figure 13 is that multiple focussing image generating means of the present invention are arranged in the different cylinder knot of diameter using linear array photosensitive unit
The embodiment of rotating scan imaging on structure.1301,1302,1303 be linear array photosensitive unit, and 1304 be shaft, and 1305 be column
Correcting lens are distorted, linear array photosensitive unit is arranged on the circumference of different radii and front and back not shading, and the radial distance of arrangement is f
Between ~ 2f, the image of different image distance focusing surfaces is generated in the circular-rotation scanning of different radii by linear array photosensitive unit.
The motion mode of the present embodiment is that linear array photosensitive unit rotates to form focusing cylindrical in lens imaging region column
Moving sweep mode.
Linear array photosensitive unit can be that radial direction is equally spaced or radial direction is not equally spaced in the mode of radial arrangement, such as
Location arrangements close to 2f are intensive, sparse close to f location arrangements.Or linear array photosensitive unit is in the crucial intensive arrangement in image distance position.
Or linear array photosensitive unit is arranged in a certain section of formation linear array multi-focus imaging heap between f ~ 2f, linear array photosensitive unit radial spacing
Adjustable, the distance between shaft and imaging len are adjustable, i.e., shaft 1304 can move back and forth adjusting in z-axis direction, in other words
Linear array multi-focus imaging heap can move back and forth adjusting in z-axis direction.
In fact, the object of camera, shot by camera is generally in the position much larger than 2f, so imaging region is general
It is located adjacent to the position of f, microscopical imaging is generally in the position much larger than object lens 2f, so being crucial image distance in practical application
The intensive arrangement imaging unit in position, preferable embodiment are made using the linear array multi-focus imaging heap of certain image distance direction thickness
For imaging unit, it is applied to required imaging region.
The present embodiment, that is, cylindric scanning embodiment, it is contemplated that cylindric scanning will produce column image fault, can
Column image fault is corrected so that column distortion correcting lens 1305 to be arranged in the light path of imaging len, can be specifically arranged
In light path between imaging len and linear array photosensitive unit.
Figure 14 is image file format attribute list of the present invention.Have in traditional images file format properties table：Width, height,
Horizontal resolution, vertical resolution, bit depth, frame number, equipment, focal length, color expression, ISO speed, time, address etc., Figure 14
The image for including several different focusing surfaces in the image file format of example, is formed by different focusing surface package images, except tradition figure
Interplanar distance, image distance parameter are focused as increasing outside attribute.
It is as spacing to focus interplanar distance.
A certain cross-sectional image in the imaging region space of image, that is, imaging len of the difference focusing surface.
In Figure 14 examples, it is equidistant, i.e. 2mm to focus interplanar distance, and it can be Unequal distance to focus interplanar distance, as close to 2f
Location arrangements are intensive, sparse close to f location arrangements.Or the intensive arrangement in crucial image distance position.
In addition, focusing interplanar distance and image distance are not required in multiple focussing image file format of the present invention, different image distances
Image can arrange and be bundled in multiple focussing image file, the image of different image distances is only distinguished with arrangement serial number.
In addition, packing processing can also be carried out using existing software for the image of different image distances in multiple focussing image,
A file packet being made of different image distance images is formed, the difference image distance image is ranked up volume according to image distance value size
Number, the number can be as the filename of different image distance images.
Figure 15 is file format structure figure of the present invention.File is by file header, information header, image distance value, bitmap color table, bitmap
Pixel data forms, and the image of several different focusing surfaces is encapsulated in file, and respectively 1 ~ n, image distance value can be absolute image distance value,
It can also be the spacing in adjacent focus face, can also include focal length value in information header.
In addition, image distance value and as spacing is not required in multiple focussing image file format of the present invention, different image distances
Image, which can arrange, to be bundled in multiple focussing image file, and the image of different image distances is only distinguished with arrangement serial number.
Further, increase image clarity values abstract or index in multiple focussing image in described information head.
Or the index list formed comprising subregion coordinate and image distance in described information head；Or subregion coordinate and image distance set of tags
At index list.
In addition, packing processing can also be carried out using existing software for the image of different image distances in multiple focussing image,
A file packet being made of different image distance images is formed, the difference image distance image is ranked up volume according to image distance value size
Number, the file header or information header of corresponding image file is written in the number.
Figure 17 is that the step of imaging unit of the present invention synthesizes multiple focussing image file is schemed.The image file that imaging unit obtains
Coded treatment is carried out by image distance encoder, generates multiple focussing image file, the coding parameter of image distance encoder comes from image distance data,
Image distance data can be absolute image distance, or opposite relative distance between image distance such as imaging unit.In addition, image distance numerical value is in this hair
It is not required in bright multiple focussing image file format, the image of different image distances, which can sort, is bundled to multiple focussing image file
In, the image of different image distances is only distinguished with arrangement serial number.Of course it is not excluded being carried out to the image of different image distances with existing software
Sequence is packaged.
Spectroscopical embodiment and Fig. 3 multi-focus of the present invention are used for Fig. 2 multiple focussing image generating means of the present invention
The embodiment that video generation device uses transparent image unit.The imaging unit spacing distance of the two embodiments is predetermined
Or determine, i.e. image distance data are to determine value, extraction image distance data determination value passes through image distance encoder write-in package file shape
At multiple focussing image file format.
The embodiment that imaging unit moves back and forth is used for Fig. 5 multiple focussing image generating means of the present invention.This side
The image distance numerical value of case is determined that the motion mode of kinematic driving unit is controlled by moving sweep signal by kinematic driving unit, movement
Scanning signal is accordingly divided into according to motion mode：1, linear scan signal, you can to drive imaging unit along the z-axis direction with equal
Uniform velocity moves back and forth, and the position of image distance can be expressed as：V=β * (U/T) * t, v are instant image distance, and β is fixed coefficient, U
For scanning voltage peak value, T is the scan period, and t is a certain time；2, sinusoidal scanning signal, you can single with driving imaging
Member is moved back and forth with sine wave vibration mode along the z-axis direction, and the position of image distance can be expressed as：v=0.5*f*sin(2∏
T/T), v is instant image distance, and amplitude is focal length f, and the vibrations period is T, and t is a certain time；3, step scanning signal, you can
To drive imaging unit to move back and forth along the z-axis direction, at least 2 quiescent time sections, quiescent time section in motion process
It is step scanning signal voltage u, time t, z-axis displacement relation figure, z1, z2, z3 difference for picture frame period a FT, Figure 16
It is imaging unit in 3 rest points of z-axis, quiescent time section is FT, i.e. a picture frame period, 3 rest points correspond to respectively
Voltage value u1, u2, u3, i.e. voltage value u1, u2, u3 FT quiescent times section remain unchanged, u-z figure it can be seen that imaging unit with
Scanning voltage value moves, that is, the displacement occurred is controlled by voltage value.The linear scan signal or sinusoidal scanning signal or
Step scanning signal passes through modulus calculation（A/D is converted）Generate image distance value, image distance value or as distance values are write by image distance encoder
Enter package file and forms multiple focussing image file format.
Multiple focussing image file generated step is：1, the image file of at least two imaging units is obtained；2, image distance is obtained
It is worth or as distance values；3, package file, that is, multiple focussing image file is written by image distance value or as distance values or multiple focussing image is compiled
Code formatted file.
Multi-focus video image file generation step is：1, the video image file of at least two imaging units is obtained；2、
Obtain the image distance of the video image file or as spacing；3, by image distance value or as distance values be written package file, image distance value or
As distance values are the labels of video image file.
Figure 18 is that the step of linear array photosensitive unit of the present invention generates multiple focussing image file is schemed.1, linear array photosensitive unit moves
Scanning generates respective image pixel, image pixel, that is, brightness value and color value；2, linear array sense is demarcated by linear array motion encoder
The coordinate for the image slices vegetarian refreshments that light unit scanning generates；3, by image slices vegetarian refreshments and its Coordinate generation linear array frame image；4, pass through
The distance values of linear array photosensitive unit or image distance value write-in package file are formed multiple focussing image file format by image distance encoder.Separately
Outside, image distance numerical value is not required in multiple focussing image file format of the present invention, and the image of different image distances can arrange packing
Into multiple focussing image file, the image of different image distances is only distinguished with arrangement serial number.Of course it is not excluded with existing software to not
Image with image distance is ranked up packing.
The function of linear array motion encoder is that the coordinate of the pixel obtained to linear array photosensitive unit carries out calibration sequence, shape
At image data, i.e., each point of linear array photosensitive unit in starting point to the pixel value for terminating the image slices vegetarian refreshments that spot scan obtains and
The data of respective coordinates mapping.
Fig. 6 multiple focussing image generating means of the present invention are arranged on wedge inclined-plane and are followed using linear array photosensitive unit
The embodiment that inclined-plane moves back and forth scanning imagery in x-axis direction.Linear array motion encoder is rectilinear scanning motion encoder, by
The image pixel coordinates that the scanning of straight line linear array motion encoder calibration line array element generates.Such as on a certain linear array photosensitive unit
A certain pixel p, coordinate are expressed as（x,y,z）, y determines that z is by linear array photosensitive unit in z-axis direction by the physical location of p points
Position determines that x can be described as x=A*（t/T）, A is largest motion displacement of the wedge inclined-plane in x-axis direction（There are positive and negative values, table
Show the direction of motion）, T is reciprocation period, and t is a certain time.
Fig. 7 multiple focussing image generating means of the present invention are used with the implementation of both arms linear array photosensitive unit rotating scan imaging
The embodiment that scheme and Figure 10 multiple focussing image generating means of the present invention use single armed linear array photosensitive unit rotating scan imaging.
Linear array motion encoder is rotary scanning motion encoder, is generated by the scanning of rotation linear array motion encoder calibration line array element
Image pixel coordinates.Such as a certain pixel p on a certain linear array photosensitive unit, polar coordinates are expressed as（R, ω t, z）, r is p points
To the radial distance of spindle central, ω is angular velocity of rotation, and z is determined by linear array photosensitive unit in the position in z-axis direction, and t is certain
One time.
The different cylinder of diameter is arranged in using linear array photosensitive unit for Figure 13 multiple focussing image generating means of the present invention
The embodiment of upper rotating scan imaging.Linear array motion encoder is garden column rotary scanning motion encoder, is revolved by garden column
Turn the image pixel coordinates that the scanning of scanning motion encoder calibration line array element generates.Such as certain on a certain linear array photosensitive unit
One pixel p, polar coordinates are expressed as（R, ω t, y）, r is the radius of turn of linear array photosensitive unit, and ω is angular velocity of rotation, y p
The y-axis coordinate of point, t are a certain time.
Figure 19 is a kind of method of image co-registration of the present invention.Here by taking the image of 2 focusing surfaces as an example, multiple focussing image lattice
2 images are encapsulated in formula file, 1901 be an image, and A is clear area in image, and b is fuzzy region, and 1902 be another
Image, a are fuzzy region, and B is clear area, and 1903 be adjustment picture size step, i.e., by image 1901 and image 1902 into
Row normalized keeps the pixel value of two images consistent, and 1904 images are the normalized image of 1902 images, 1904 figures
Picture pixel value and 1901 image pixel values are consistent, and 1905 be image co-registration processing step, the i.e. image pixel to 1901 and 1904
Image pixel carry out selecting a selection, select a selection clear image pixel here, finally obtain image 1906, the picture of image 1906
Element composition is A and B, i.e. full width clearly image.
Include focal length value in the multiple focussing image file format of the present invention, image distance value can be calculated by imaging formula
Go out different focusing surfaces（Or point）The object distance of object, the i.e. distance of different objects.Imaging formula is：1/f=1/u+1/v, if it is known that
F and v can calculate u=f*v/ (v-f), and step is：1, multiple focussing image file is obtained；2, it identifies, obtains into line definition
Take the image distance of clear area pixel；3, object distance u=f*v/ (v-f) is calculated according to image distance v and focal length f；4, multiple focussing image is obtained
Object distance, that is, distance of each object or object parts in file.
Figure 20 is a kind of image viewer provided by the invention or video player surface chart.Image viewer or video are broadcast
It includes menu bar, picture browsing or video playback window, image distance adjusting knob, normalization button, image co-registration button, solid to put device
Change button, picture size can be normalized in normalization button, to keep the picture size of different image distances consistent, figure
As fusion button can obtain everywhere clearly image, three-dimensional button can be right to shown image progress fusion treatment
Multiple focussing image file carries out processing and generates stereo-picture, and it is current that image distance regulation button can select the image of different image distances to carry out
Display.
Since multiple focussing image file is made of the graphical arrangement of different image distances, that is, image distance layer is divided to form, when display can only
It selects a certain layer to carry out plane to show.
Further, it is based on eye tracking device and browses multiple focussing image, human eye focus may be implemented to real world
Simulation, system is by eye tracking device, computer installation（Image processing apparatus）Composition, computer installation install multiple focussing image
Show that software, the software provide browser window, browser image distance regulation button is controlled by the signal of eye tracking device, eyeball
Tracks of device is responsible for parsing the focus of eyeball, and multiple focussing image shows that software has and judges that focus area image clarity walks
Suddenly, by choosing focus area image, clearly image is used as current display to multiple focussing image display software.
As another embodiment, mouse coordinates are guided as eyeball focus, and step is：1, extraction mouse is sat
Mark；2, the concern point coordinates of image display interfaces is determined according to mouse coordinates；3, using focus region clearly image as working as
Preceding display corresponds to the image of image distance as current display.There are two types of triggering modes as the guide of eyeball focus for mouse coordinates：
Mouse coordinates directly trigger, or are triggered by mousebutton according to mouse coordinates, such as press left button.
Still another embodiment, that is, touch screen image display control triggering mode, touch screen, that is, touch screen, including single-point touch screen and
Multipoint touch screen, image display processing step are：1, extraction touch screen touches point coordinates；2, point coordinates is touched according to touch screen and determines figure
As the concern point coordinates of display interface；3, using focus region, clearly image corresponds to the image of image distance as current display
As current display.Of course it is not excluded directly touching the display control triggering mode of touch screen.
A kind of multiple focussing image document handling method, it is characterized in that：It is the figure for extracting a certain image distance when performing image display
As currently being shown, the triggering mode of display control is at least such as one of under type：Control button triggering mode, control button
Mouse drag triggering mode, mouse coordinates triggering mode, mouse coordinates and button triggering mode, touch screen triggering mode, touch screen touch
Moving coordinates and touch screen triggering mode, eyeball focus triggering mode.
The step of image of a certain image distance of the extraction further includes：The step of image definition is judged；Or retrieval
The step of inquiry definition values make a summary or index and determine definition values highest, or determine the rope being made of subregion coordinate and image distance
The step of drawing image distance in list；Or the step of determining image distance label in the index list being made of subregion coordinate and image distance label.
A kind of method of image display processing step, that is, multiple focussing image file process.
The step of Figure 21 is multiple focussing image file generated 3-D view of the present invention.1, multiple focussing image file is obtained；2、
Pixel resolution of image judges, i.e., carries out definition judgment to the image of different image distances in multiple focussing image file；3, it obtains clear
Clear degree image pixel and three-dimensional coordinate, pixel point coordinates x, y for the image of same image distance are known, the numerical value of coordinate z
It is identical, is also known；4, generate space three-dimensional image, space three-dimensional image be it is in kind by imaging len f ~ 2f it
Between the space real image that is formed, space real image and in kind symmetrical at geometric center with lens centre point, material object is between 2f ~ ∞；
5, space three-dimensional image normalization is handled, and the image of all different image distances is unified for same size, such as：Normalization coefficient β, figure
The image distance of picture 1 is v1, and 2 image distance of image is v2, then β=(v2-f)/(v1-f), and the size of image 1 is unified to image 2, image 1
Size * β=2 size of image；5, solid threedimensional image is generated, after normalized, space three-dimensional image coordinate is converted into reality
Body three-dimensional coordinate, i.e., the image mapping point of true coordinate in kind.
In view of imaging unit or linear array photosensitive unit are unable to unlimited arrangements in imaging len imaging region f ~ 2f, also
Being the step of saying that the quantity of arrangement is limited, generate solid threedimensional image is：A, multiple focussing image file is obtained；B, extraction figure
As 1 data line definition of going forward side by side judges, while the pixel and three-dimensional coordinate of clear part are obtained；C, extraction 2 data of image are gone forward side by side
Line definition judges, while obtaining the pixel and three-dimensional coordinate of clear part, at the same calculate the normalization coefficient β 1 to Fig. 1=（Picture
Away from 1-f）/ (image distance 2-f)；D, extraction image n data are gone forward side by side line definition judgement, while obtaining the pixel and three-dimensional of clear part
Coordinate, while calculating normalization coefficient β n=(image distance 1-f)/(the image distance n-f) to Fig. 1；E, it is obtained in obtaining step B ~ C clear
The pixel and three-dimensional coordinate of clear part generate space three-dimensional image；F, 2 coordinate of image is multiplied by factor beta 1, image n coordinates are multiplied by
Factor beta n is calculated and is generated solid threedimensional image.
Figure 22 is linear array motion encoder image coding principle.2201 be a certain sensitivity speck of linear array photosensitive unit, movement
The position of moment is p, Ke Yiyong in track（x,x,z）Cartesian coordinate describes, or（R, ω t, y）Polar coordinates describe；2203 are
The row data of image, i.e., the data of one scan line；2202 be a pixel number evidence in 2203 row data, 2202 pixels
It is the pixel value of p points, the brightness of pixel value, that is, pixel and coloration that data are corresponding, is generally indicated with the brightness of three primary colours；2204
For the read cycle of a pixel Data Data；2205 be the line-scanning period of image；2206 is a certain for linear array photosensitive unit
The movement locus of sensitivity speck 2201.In this way, all sensitivity specks of linear array photosensitive unit are by moving the image pixel value of acquisition
And coordinate is mapped to video data block, forms linear array frame image.Certainly, the pixel letter that the sensitivity speck of linear array photosensitive unit obtains
Number it is analog signal, so also have the process for converting analog signal to digital signal, i.e. A/D conversions.
In view of linear array movement is regular motion, i.e. uniform motion or vibrations or uniform rotation, opened to reduce system
Pin can not use pixel read cycle, only use the line-scanning period, and line-scanning period signal rising edge starts pixel and reads
Extract operation, line-scanning period signal failing edge close pixel read operation, are read to complete an image line scanning.If
Linear array movement is uniform motion or uniform rotation, then pixel number is according to being evenly arranged, if linear array movement is vibration mode,
Then pixel can be reduced to linear array by pixel number according to being sinusoidal arrangement by function algorithm.
Figure 23 is space three-dimensional image image-forming principle.ABCD is object, and the spaces A1B1C1D1 three are formed by imaging len
Image is tieed up, f is imaging len focal length, and F is imaging len focus, and v1 is A1D1 image distances, and v2 is B1C1 image distances, and A2B2C2D2 is place
The solid threedimensional image generated is managed, ignores flat focus coordinate in figure, only studies longitudinal depth coordinate.According to imaging formula 1/f=
1/u+1/v can be drawn the following conclusions：Positioned at ∞ ~ 2f real world objects optical imagery by imaging len " non-linear pressure
Contracting " is in the space of f ~ 2f, and the physical size and coordinate of real world objects are linear, and " non-linear compression " algorithm obeys imaging
Formula can such as will by imaging formula algorithm with the flat focus coordinate and longitudinal coordinate of computational entity 3-D view
A1B1C1D1 space three-dimensional images calculate A2B2C2D2 solid threedimensional images, in fact can be converted into D1C1 sections of any point rulers
Very little solid threedimensional image, it will be assumed that be transformed into A1D1 sizes, i.e. A1D1=A2D2, pass through trigonometric function relationship：B1C1/
A1D1=（v2-f）The coordinate transformation of B1C1 is in this way the coordinate of B2C2 by/(v1-f).
Mathematically it can be understood as：The linear three-dimensional coordinate of real world by 1/f=1/u+1/v Algorithm mappings to f ~
The non-linear three-dimensional matrix in the spaces 2f, the domain of image distance v are（F, 2f】, i.e., { v ︳ f ＜ v≤2f }.
Figure 24 is that the multiple focussing image based on human eye focus watches mode schematic diagram.2401 be camera, and 2402 be aobvious
Show interface, 2403 be eyeball, and p points are eyeball focus, and coordinate is (x, y), by camera 2401 and recognition and tracking software sharing
Eye tracking device, display interface 2402 are the display interface that multiple focussing image shows software, and multiple focussing image shows that software can
Arbitrarily to show the image of different image distances in multiple focussing image file as needed, and using required image as present image
It is shown in display interface, the course of work is：1, eyeball image is obtained by camera, eyeball is judged by recognition and tracking software
Focus p, and determine its coordinate (x, y)；2, p (x, y) is located to the image of all difference image distances in multiple focussing image file
The image in point region carries out definition judgment, and determines wherein one in the highest corresponding image distance image of p points region clarity, i.e. p
Put region clearly parent image；3, using p points region clearly parent image as display interface present image.
Further, in order to improve image switch speed, multiple focussing image is demarcated with virtual grid into line definition, and will
Calibration value forms index or summary record in multiple focussing image file, can be by indexing or making a summary after focus determining in this way
Required image is shown immediately.In this way, the course of work is：1, eyeball image is obtained by camera, is sentenced by recognition and tracking software
The focus p of disconnected eyeball, and determine its coordinate (x, y)；2, it is determined according to the coordinate (x, y) of p points corresponding in index or abstract
Image, i.e., the image of a certain image distance value；3, it is shown in display interface using the corresponding image as present image.
For video image, multiple focussing image video file coded format includes the video track of encapsulation, audio track, video track
There is its image distance label or as spacing label, further adds image clearly calibrations index or abstract, the course of work are：1、
Eyeball image is obtained by camera, the focus p of eyeball is judged by recognition and tracking software, and determine its coordinate (x, y)；2, root
Corresponding video track in index or abstract, i.e., the video track of a certain image distance label are determined according to the coordinate (x, y) of p points；It 3, will be described
Corresponding video track is shown as current video in display interface.
Further, the step of having extraction before the focus p for carrying out eyeball is shown and showing other adjacent image distance images,
Purpose is to solve image to switch the mutation sense for generating human eye, while human eye can also be allowed to feel zoom visual impression.
Existing eye tracking technology has：Chinese patent announces 03133764.3 intelligent control method for visual tracking, China
Visual tracking method and system of the patent announcement 200710090883.X based on particle filter, Chinese patent bulletin
200810121650.6 the Web page text individuation search method based on eye tracking, Chinese patent bulletin 200910096060.7
English text automatic abstracting method based on eye tracking.
A kind of multiple focussing image display device, it is characterized in that：Device is made of eye tracking device and image display device,
Eye tracking device is by camera and recognition and tracking software sharing, and camera is responsible for obtaining eyeball image, and recognition and tracking software is negative
Tracking is identified to the eyeball image that camera obtains to determine that eyeball pays close attention to point coordinates in duty, and image display device includes poly
Coke shows that software, multi-focus show that software is currently shown according to determining eyeball concern coordinate extraction respective image.
Figure 25 is the schematic diagram that multiple focussing image file establishes clarity abstract or index.Since system is frequently inserted into image
Definition judgment can increase overhead, in order to improve image switch speed, increase clear scale in multiple focussing image file
Definite value is made a summary or index, and 2501 be a certain image distance image in multiple focussing image file, and 2502 be clearly area in 2501 images
Domain, similarly, 2504 be clearly region in 2503 images, and 2506 be clearly region in 2505 images.Concrete processing procedure is：
1, subregion is carried out with virtual grid to all images in multiple focussing image；2, definition judgment is carried out to each subregion and forms clarity
Value；3, definition values are formed into abstract or index；3, will abstract or index be added in multiple focussing image file, or will abstract or
Index is encapsulated into video file.
Definition values judge the clarity of image, and form numerical expression.Definition values are images in other words
The numerical expression of clarity.
Image show the step of be：1, image zonule to be shown is selected, determines area coordinate；2, retrieval and inquisition is clear
Angle value makes a summary or indexes and determine the highest corresponding image distance image of the zonule definition values；3, the corresponding image distance figure is extracted
As currently being shown.
Figure 26 is to use image distance label for a kind of image clearly region of mark abstract or concordance list.First to multi-focus figure
The image of all different image distances carries out virtual grid subregion as in, compares to form x, y in abstract or concordance list by clarity,
K arrays, wherein x, y are the grid coordinates in image clearly region, and k is the image distance tag identifier of a certain image distance image, is determined by k values
This grid（That is the grid of image clearly）The image which corresponds to image distance, such as x3, y3, ki array representations in grid coordinates x3,
Y3 area images clearly image be ki mark correspondence image distance image.
Certainly, image distance label can directly replace with image distance value, i.e., the image of different image distances is identified with image distance value.
Image show the step of be：1, image zonule to be shown is selected, determines grid coordinates x, y；2, by grid
Image distance label k is uniquely determined in the index list of coordinate and image distance label composition；3, corresponding image distance is determined by image distance label k
Image currently shown.
Figure 27 is the step of Figure 26 establishes image distance label k values in image clearly region abstract or concordance list.1, poly is obtained
Burnt image file；2, assignment image distance label k values are identified the image of different image distances all in multiple focussing image file
Number；3, grid subregion is carried out to image, with x, y-coordinate determines grid in the position of display interface, the image side of different image distances
In the position coordinates x of display interface, y is consistent lattice subregion；4, grid subregion clarity compares, i.e., to different image distance image phases
The grid subregion of same x, y-coordinate are compared into line definition, choose the corresponding image k values of the highest grid of clarity, this grid
Array is x, y, k
In addition, clarity is not necessarily uniformly in grid subregion, there is the case where transition, for there is the grid of transition can be with
It abandons handling.
Certainly, image distance label k values can directly replace with image distance value, i.e., the image of different image distances is identified with image distance value.
In view of subregion not necessarily use grid subregion, a kind of multiple focussing image file format, it is characterized in that：Image file
In the index list that is formed comprising subregion coordinate and image distance；Or the index list of subregion coordinate and image distance label composition.
The image distance label is i.e. according to image slices away from the number or mark carried out to image.
Claims (3)
1. a kind of multiple focussing image document handling method, step are：
（1）Subregion is carried out with virtual grid to all images in multiple focussing image, with x, y-coordinate determines grid in display interface
Position；
（2）Definition judgment is carried out to each subregion and forms definition values, i.e., x identical to different image distance images, the grid point of y-coordinate
Area is compared into line definition, chooses the corresponding image k values of the highest grid of clarity, the array of this grid is x, y, k；
（3）Definition values are formed into abstract or index, i.e., compare to form x in abstract or concordance list by clarity, y, k arrays,
Wherein x, y are the grid coordinates in image clearly region, and k is the image distance tag identifier of a certain image distance image, this grid is determined by k values
It is the image which corresponds to image distance；
（4）Abstract or index are added in multiple focussing image file, or abstract or index are encapsulated into video file；
It is to extract the image of a certain image distance currently to be shown when performing image display, the triggering mode of display control is at least such as
One of under type：Control button triggering mode, mouse coordinates triggering mode, touch screen triggering mode, eyeball focus triggering mode：
Mouse coordinates triggering mode step is：
1. extracting mouse coordinates；
2. determining the concern point coordinates of image display interfaces according to mouse coordinates；
3. using focus region, clearly image corresponds to the image of image distance as current display as current display；
Touch screen triggering mode step is：
1. extracting touch screen touches point coordinates；
2. touching the concern point coordinates that point coordinates determines image display interfaces according to touch screen；
3. using focus region, clearly image corresponds to the image of image distance as current display as current display.
2. a kind of multiple focussing image document handling method according to claim 1, using eyeball focus triggering mode, also
Including：
S1, eyeball image is obtained by camera, the focus of eyeball is judged by recognition and tracking software, and determine that focus is sat
Mark；S2, in multiple focussing image file extracting focus region according to the coordinate of focus, clearly image is currently shown：
Eyeball focus triggering mode step is：
1. obtaining eyeball image by camera, judge the focus p of eyeball by recognition and tracking software, and determination its coordinate (x,
y)；
2. the image for being located at p (x, y) points region to the image of all difference image distances in multiple focussing image file is sentenced into line definition
It is disconnected, and determine wherein one in the highest corresponding image distance image of p points region clarity, i.e. p points region clearly parent image；
3. using p points region clearly parent image as display interface present image；
Or：
1. obtaining eyeball image by camera, judge the focus p of eyeball by recognition and tracking software, and determination its coordinate (x,
y)；
2. determining corresponding image in index or abstract, i.e., the image of a certain image distance value according to the coordinate (x, y) of p points；
3. being shown in display interface using the corresponding image as present image；
Or：
1. obtaining eyeball image by camera, judge the focus p of eyeball by recognition and tracking software, and determination its coordinate (x,
y)；
2. determining corresponding video track in index or abstract, i.e., the video track of a certain image distance label according to the coordinate (x, y) of p points；
3. being shown in display interface using the corresponding video track as current video.
3. a kind of multiple focussing image document handling method according to claim 1 or 2, characterized in that further include step：
A, image zonule to be shown is selected, area coordinate is determined, that is, determines grid coordinates x, y；
B, retrieval and inquisition definition values make a summary or index and determine the highest corresponding image distance image of the zonule definition values,
Image distance label k is uniquely determined in the index list being made of grid coordinates and image distance label；
C, it extracts the corresponding image distance image currently to be shown, i.e., determines that the image of corresponding image distance carries out by image distance label k
Current display.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510143494.3A CN104700382B (en) | 2012-12-16 | 2012-12-16 | A kind of multiple focussing image document handling method |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210543272.7A CN103034987B (en) | 2012-12-16 | 2012-12-16 | A kind of multiple focussing image file format and generating apparatus and image file processing method |
| CN201510143494.3A CN104700382B (en) | 2012-12-16 | 2012-12-16 | A kind of multiple focussing image document handling method |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210543272.7A Division CN103034987B (en) | 2012-12-16 | 2012-12-16 | A kind of multiple focussing image file format and generating apparatus and image file processing method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104700382A CN104700382A (en) | 2015-06-10 |
| CN104700382B true CN104700382B (en) | 2018-08-28 |
Family
ID=53347470
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510143494.3A Expired - Fee Related CN104700382B (en) | 2012-12-16 | 2012-12-16 | A kind of multiple focussing image document handling method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104700382B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR102415501B1 (en) * | 2015-08-07 | 2022-07-01 | 삼성전자주식회사 | Method for assuming parameter of 3d display device and 3d display device thereof |
| CN116883461B (en) * | 2023-05-18 | 2024-03-01 | 珠海移科智能科技有限公司 | Method for acquiring clear document image and terminal device thereof |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1402191A (en) * | 2002-09-19 | 2003-03-12 | 上海交通大学 | Multiple focussing image fusion method based on block dividing |
| CN101968883A (en) * | 2010-10-28 | 2011-02-09 | 西北工业大学 | Method for fusing multi-focus images based on wavelet transform and neighborhood characteristics |
| CN102063713A (en) * | 2010-11-11 | 2011-05-18 | 西北工业大学 | Neighborhood normalized gradient and neighborhood standard deviation-based multi-focus image fusion method |
| CN102221881A (en) * | 2011-05-20 | 2011-10-19 | 北京航空航天大学 | Man-machine interaction method based on analysis of interest regions by bionic agent and vision tracking |
| CN102509280A (en) * | 2011-11-10 | 2012-06-20 | 重庆大学 | Multi-focus image fusion method |
| CN102819403A (en) * | 2012-08-28 | 2012-12-12 | 广东欧珀移动通信有限公司 | Terminal equipment and man-machine interaction method thereof |
-
2012
- 2012-12-16 CN CN201510143494.3A patent/CN104700382B/en not_active Expired - Fee Related
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1402191A (en) * | 2002-09-19 | 2003-03-12 | 上海交通大学 | Multiple focussing image fusion method based on block dividing |
| CN101968883A (en) * | 2010-10-28 | 2011-02-09 | 西北工业大学 | Method for fusing multi-focus images based on wavelet transform and neighborhood characteristics |
| CN102063713A (en) * | 2010-11-11 | 2011-05-18 | 西北工业大学 | Neighborhood normalized gradient and neighborhood standard deviation-based multi-focus image fusion method |
| CN102221881A (en) * | 2011-05-20 | 2011-10-19 | 北京航空航天大学 | Man-machine interaction method based on analysis of interest regions by bionic agent and vision tracking |
| CN102509280A (en) * | 2011-11-10 | 2012-06-20 | 重庆大学 | Multi-focus image fusion method |
| CN102819403A (en) * | 2012-08-28 | 2012-12-12 | 广东欧珀移动通信有限公司 | Terminal equipment and man-machine interaction method thereof |
Non-Patent Citations (3)
| Title |
|---|
| 一种新的基于清晰度的多聚焦图像融合规则;黄卉 等;《计算机工程与应用》;20051231;第41卷(第14期);全文 * |
| 含噪声图像的多聚焦融合算法;王昕;《光学精密工程》;20111231;第19卷(第12期);全文 * |
| 基于区域锐度的多聚焦图像融合;张素兰 等;《计算机工程》;20090228;第35卷(第4期);221-222 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104700382A (en) | 2015-06-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103034987B (en) | A kind of multiple focussing image file format and generating apparatus and image file processing method | |
| CN104115074B (en) | hologram processing method and system | |
| CN110495166A (en) | Spherical video editing | |
| EP0797171B1 (en) | Image processing method and apparatus | |
| CN108038911B (en) | Holographic imaging control method based on AR technology | |
| JPH05501184A (en) | Method and apparatus for changing the content of continuous images | |
| CN110431847A (en) | Virtual reality projection, filling, area-of-interest and viewport relative trajectory and the method and device for supporting viewport roll signal are derived in ISO base media file format | |
| CN109241841A (en) | The acquisition methods and device of video human movement | |
| US20040212625A1 (en) | Apparatus and method for synthesizing high-dimensional texture | |
| CN104700382B (en) | A kind of multiple focussing image document handling method | |
| CN202957905U (en) | Multi-focus image generating device and multi-focus image displaying device | |
| CN104700383B (en) | A kind of multiple focussing image generating means and multiple focussing image document handling method | |
| Chan et al. | S-PIFu: Integrating parametric human models with PIFu for single-view clothed human reconstruction | |
| Drobnitzky et al. | Survey and systematization of 3D object detection models and methods | |
| JP2001283201A (en) | Method for creating three-dimensional image data and method for creating optional viewpoint image using three-dimensional image data | |
| JPH09138850A (en) | Surface shape reconstitution device | |
| Takacs et al. | Hyper 360—towards a unified tool set supporting next generation VR film and TV productions | |
| BR et al. | Machine Learning Application for Evidence Image Enhancement | |
| Li et al. | Temporal-dense dynamic 3-d reconstruction with low frame rate cameras | |
| Xu et al. | Homogeneous light field model for interactive control of viewing parameters of integral imaging displays | |
| Mao et al. | Improved smart pseudoscopic-to-orthoscopic conversion algorithm for integral imaging with pixel information averaging | |
| WO2020012071A1 (en) | A method, an apparatus and a computer program product for volumetric video coding | |
| Yang et al. | Mmwave radar and vision fusion for semantic 3D reconstruction | |
| JP7505681B2 (en) | Method for recording video data and method for playing video data | |
| Oliva-García et al. | Free view point generation based on depth maps computed by a single camera |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20220323 Address after: 226000 Room 501, building 7, Wuzhou City Plaza, No. 25, Zhongxiu Middle Road, Zhongxiu street, Chongchuan District, Nantong City, Jiangsu Province Patentee after: Nantong zhongkuo Information Technology Co.,Ltd. Address before: 226001 room 404, building 14, No. 3, Beiyuan new village, Chongchuan District, Nantong City, Jiangsu Province Patentee before: Wu Fan |
|
| TR01 | Transfer of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20180828 |