CN103417181A - Endoscopic method for light field video camera - Google Patents
Endoscopic method for light field video camera Download PDFInfo
- Publication number
- CN103417181A CN103417181A CN2013103315668A CN201310331566A CN103417181A CN 103417181 A CN103417181 A CN 103417181A CN 2013103315668 A CN2013103315668 A CN 2013103315668A CN 201310331566 A CN201310331566 A CN 201310331566A CN 103417181 A CN103417181 A CN 103417181A
- Authority
- CN
- China
- Prior art keywords
- video camera
- light field
- light
- endoscope
- focusing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Endoscopes (AREA)
Abstract
The invention provides an endoscopic method for a light field video camera. The endoscopic method comprises the steps that core parts of industrial or medical endoscopic equipment are replaced by the light field video camera, and the field video camera is used for shooting first and then completing endoscopic work by using the focus function. In the later period, focus observation of anew visual angles is conducted on a video, every corner in a scene from the endoscopic video is restored in a high definition mode, and a user can observe in any visual angles. Meanwhile, under the condition that the problem that an endoscopic probe goes deep into a detected object so that the endoscopic probe can not move is solved, the software of the light field video camera is used for achieving refocusing by using the focus function, every corner is displayed clearly, and the purpose that in the process of operations and the like, under the condition that the endoscopic probe is not moved any more, the visual angles are focused and changed by the software, and all directions in the endoscopic scene are seen clearly is achieved. According to the endoscopic method for the light field video camera, the light field video camera is added in the field of industrial and medical endoscopes, the endoscopic equipment can be made to completely collect light fields, imaging in later period is made to be more clear and accurate, and files can be compressed and stored.
Description
Technical field
The present invention relates to the product of a kind of endoscope and the combination of light field video camera, be specifically related to peep method in a kind of light field video camera, especially can solve conventional endoscope and focus on unclear, image blur, from positive crevice projection angle, observe, can't observe the small items of certain space structure, under high-resolution and large-numerical aperture condition, the depth of field is very little, easily lose objects, just once take and allow video typing problem.Spy on frequently and once take and repeatedly change visual angle from the clear observation of all angles in this.
Background technology
Conventional endoscope, obtain the large depth of field, need to reduce aperture, and the number of photons that so each exposure enters is limited, and signal to noise ratio reduces, and noise occurs; For the balance signal to noise ratio, need large aperture, the depth of field is little, and focusing is difficult, blurred background; Dark environment, for the balance signal to noise ratio, need prolonging exposure time, and the shake of hands causes video fuzzy, needs spider.
At present, known industry or medical endoscope be by display screen, built-in power, CCD chip (1/3 color video camera), mirror shank diameter, the compositions such as probe lighting source.Spy upon head in inciting somebody to action and go deep into measured object inside or contact with measured object, with the detection of carrying out conventional lossless detection and can't touching non-visible section site surface defect.But, capture video of current industry or medical endoscope has just been finalized the design, and optical field acquisition is insufficient, can not automatic focus, to such an extent as to imaging is fuzzyyer, the size of the degree of depth of object to be detected and object to be detected defect profile is unintelligible, easily cause erroneous judgement or misjudgement.
1936, Gershun proposed the light field concept, and light field is exactly the propagation of light radiation each position all directions in space, 1992, Adelson was applied to computer vision by the light field theory, proposed all-optical field theoretical (plenoptic theory), 1996, Levoy proposes light field and plays up theory (light field rendering), light field is carried out to parametrization, and proposed imaging formula, 2005, Ng invention First hand-held light field camera, 2006, Levoy developed light field microscope.
Summary of the invention
Can not automatic focus in order to overcome existing industry or medical endoscope, the invention provides a kind of novel endoscope, comprise industry and medical endoscope, this endoscope can not only demonstrate picture clearly according to the variation of environment and the variation automatic focus of depth of probe, color and luster is true to nature, resolution is high, and avoided image to amplify being easy to distortion etc. and solved the video that conventional endoscope takes observing from positive crevice projection angle, can't observe the small items of certain space structure by transformation angle, the video that this endoscope takes can be reorientated observation from various visual angles.Solve under high-resolution and large-numerical aperture condition, the depth of field is very little, and the problems such as easy lose objects, in the situation that testee inside and no longer mobile is goed deep into by endoscope, can be used software on display screen, from different visual angles, see narrow and small object clearly.
The technical solution adopted for the present invention to solve the technical problems is: in a kind of light field video camera, peep method, mainly utilize focusing function after the first shooting of light field video camera to peep in completing, spy upon head in solution in the situation that go deep into testee inside and can't move and rotate or inconvenience is mobile and rotation, utilize the focusing of again focusing of the software system of this endoscope, transformation angle, clear each corner that represents scene, in completing, peep, or after video capture, to video focusing again, locating new visual angle is observed, core algorithm comprises seizure and the conversion storage of light field, the seizure of light field refers to that a light in scene can mean with camera lens and De Liangge plane, focussing plane place, capture device can record each light of scene, if focus point has dropped on focussing plane just, this point is exactly clearly so, take shooting point as the centre of sphere, with the light of this light ray parallel be all clearly, if focus point has dropped on the inboard of focussing plane or the outside, this point is exactly unsharp so, with the light of this light ray parallel be all unsharp, focusing on process software is exactly that the one group light identical focus is adjusted on the focussing plane at convergent point place, the storage conversion is exactly to utilize Fourier transformation transform of spatial domain to be turned to the conversion storage mode of frequency domain, with digital mode record.
Further, this endoscope comprises built-in display screen, CCD chip (1/3 color video camera), eyepiece, light field video camera, object lens and power supply, by display screen, 1/3 color video camera, light field video camera, optical fiber, in spy upon head and connect successively.The light field video camera is connected with 1/3 color video camera on one side, with the interior optical fiber of spying upon in head, be connected on one side, make light field pass through the light field video camera before imaging, optical fiber is placed in flood lighting light source hand hose line, flood lighting light source hand hose line one end is connected with the light field video camera, the other end with in spy upon the head be connected, when the interior head of spying upon deeply is detected thing when inner, scene is passed to the light field video camera by optical fiber, the light field video camera presents real-time video image clearly by its own focusing function, import 1/3 color video camera into, and stored and shown, its high-quality imaging mainly depends on micro lens array and the imageing sensor of the light field video camera of equipment, the light field video camera resemble a microcam by scene after image processor is processed, be presented on the display screen of endoscope, inside peep in process on optics photoreceptors video image converged at after the light field video camera, the summation of all light is recorded as to the point on photograph, show image, this one is an array of microscopes that is covered with 90,000 miniature eyeglasses with the video camera of special lens array, after each little lens array receives light, before being sent to the CCD chip, the light data is changed, in digital mode, write down, the light field induction apparatus of this number, can collect the color that enters all light of video camera, intensity and direction, the resolution of video camera micro lens is 1,100 ten thousand rays, can capture 1,100 ten thousand bundle light, the video camera micro lens is followed the trail of the drop point of every light on the image of different distance, this endoscope records the data of all direction light beams, can the later stage select as required focusing in computer, the last imaging effect of video also can be finished dealing with on computers, can also do afterwards and adjust with additive method after several years, adjust different visual angle, visual angle, can observe from different angles.
Further, light field is from the interior object lens of spying upon head, image transmission optical fibre, eyepiece, the light field video camera, in the passage of ccd video camera, transmit, after utilizing the focusing of light field video camera, be presented at again on display screen, make clear picture, by the light field endoscopic applications in industry or medical science endoscope, utilize light field endoscope to realize focusing, zoom function, imaging clearly is true to nature, and enlarging function is arranged, can observe the fine structures such as mucosa, this endoscope is in the situation that low light and image high-speed mobile, still can accurately focus and take video clearly, catch a large amount of light data and selected focus, more flexible while taking pictures, whether fuzzy the video of no matter taking is, as long as in the focal range of endoscope, focusing can choose at random after having clapped, because in endoscope just all is recorded in all optical information in focal range when taking pictures, can first take rear focusing to video, can allow the interior any scenery of scene all become the shooting focus, need not pay close attention to too much depth of field problem, also can change the visual angle of watching video, can also be by the switching back and forth between 2D and 3D pattern of a photograph frame of video.
Further, this endoscope one is confrontational, lower lens opening size and the depth of field, with little lens array quota UV light, demonstrate the depth of field of each image, then by small inferior image projection to photoreceptors, it is clear that the dim aperture around all focusing images becomes, the increase luminosity that bring the large aperture of maintenance conventional endoscope, the situation that reduces shooting time and seediness, need not sacrifice the depth of field and and image definition.
Further, application by the light field technology, when inside peeping, only need composition to get final product, do not need focusing---because this can be focused on computers interior peeping after having taken, this will change in present peeps custom, and this class endoscope candid photograph is effective, whether fuzzy the video of no matter capturing is, as long as in the focal range of endoscope, focusing can choose at random patting after having taken the photograph, because in endoscope just all is recorded in all optical information in focal range when taking pictures, this light field endoscope can be used for light field and describes, synthetic aperture imaging, multi-viewpoint three-dimensional shows.
Further, the limitation of traditional endoscope is, captured video can only have a focus, because this endoscope adopts the imaging technique different from traditional digital endoscope, light field endoscope does not have focusing system complicated on digital camera, and overall volume is less, operates also fairly simple; Owing to need not selecting focusing, the speed of shooting is also faster simultaneously, and the later stage can be processed video with Lytro software.
Principle of the present invention is:
The invention provides in a kind of novel light field video camera and peep method, comprising: the core component of endoscope device in industrial endoscope and medical science etc. is replaced with to the light field video camera, utilize the light field video camera first to take rear focusing and peep in completing.Later stage can focus again to video, from interior spy on frequently each corner of reduction scene, high-resolution shows, allows the observation that the user can visual angle, also can compress and storage file simultaneously.Solve simultaneously, go deep in the irremovable situation of testee at the interior head of spying upon, utilize the software focus function adjustable visual angle of light field video camera, show clearly each corner.Belong to industrial endoscope and light field video camera in conjunction with field, to peep field in a kind of rear focus function of first taking pictures the light field video camera is applied to, enlarge and improve the technical field of industrial endoscope, also enlarged the range of application of light field video camera simultaneously, give the application example of light field camera and a reality of light field video camera, mainly solve industry and medical science endoscope can not image blur under narrow and small wet environment etc. problem, this invention adds industry and medical science endoscope field to the light field video camera, can make interior endoscope device gather fully light field, the later stage imaging is more clear accurately.Such as the face to the burglar focuses etc. again.Even, after the several years of taking pictures, you just can obtain the desirable video of the different visual angles of wanting yourself in a flash, endoscope can remove heaviness, power consumption and expensive focusing system, and you peep and take pictures in can completing quickly.Now consumer use in to spy on camera frequently be all sensitive surface-chemical film or the electronic induction device that uses plane, carry out record position, the optical density of color and scioptics.This invention endoscope is also that so its advanced part is to record the angle of incident illumination, and the file recorded is no longer only picture one by one, but the mini data base of the three-dimensional information of a recording light is called light field.Use specifically developed software can use this toy data base to make many different videos, the time that also can change shutter is adjusted video.
The invention has the beneficial effects as follows:
1, the present invention can be when accurately testing the measured object scene, conveniently image is presented on the screen of TV monitor, interior spy upon the head do not move or irremovable situation under, utilize focusing software to see each inner corner clearly, can make the most of the advantage in spying upon an irremovable operation interior, more clear than video image that common fibre optic endoscopes becomes, color and luster is true to nature, and resolution is higher.
2, the invention belongs to industrial endoscope and light field endoscope in conjunction with field, a kind ofly to utilize the rear focusing of first taking pictures of light field endoscope to be applied to industrial endoscope and medical science endoscope field, enlarge and improve the technical field of industrial endoscope, also enlarged the range of application of light field endoscope simultaneously, give the application example of light field video camera and a reality of light field camera, mainly solve industry and the medical science endoscope problem of can not automatically focusing under narrow and small wet environment, the present invention adds light field endoscope industry or medical science endoscope to peep video mirror in making to focus in real time, imaging is more clear accurately, also can change visual angle in the shooting later stage and carry out detailed observation.
3, the present invention includes: add the light field video camera in the light field passage of industrial endoscope and medical science endoscope, utilize the change viewpoint of light field video camera software to peep in completing clearly.Allow really the endoscope probe automatic focusing, focusing in real time, automatic rotation, high-resolution shows, allows that the user can be real-time from different view, also can after shooting, carry out the detailed observation of different visual angles, also can compress and storage file simultaneously.
4, the present invention is a kind of expanding unit that combines industrial endoscope and light field camera, light field video camera, from conventional endoscope, only to catch single light plane different, all light in this light field endoscope energy FOV of acquisition, namely in space the light of any transmission direction in position a little, catch whole light field datas by moment.Its characteristics are mainly to comprise the real-time visual angle focus function of light field video camera being applied to the fields such as industry and medical science endoscope, by after outside image automatic focus by a series of optical systems, clearly pass to tester's eyes, imaging is fidelity very, and definition is very high.
The accompanying drawing explanation
The structure chart that Fig. 1 is industry of the present invention or medical endoscope;
The three-dimensional cutaway view that Fig. 2 is industry of the present invention or medical endoscope, wherein, 2-1 is display screen; 2-2 is eyepiece, and 2-3 is optical axis and light cone, and 2-4 is illumination optical fiber; 2-5 is rod-like mirror, and 2-6 is viewing directional angle 30 degree prisms, and 2-7 is CCD chip (1/3) video camera; 2-8 is the light field video camera; 2-9 is outer telescop, and 2-10 is the scope pipe, and 2-11 is object lens; 2-12 is minus lens, and 2-13 is screening glass.
Fig. 3 is endoscope structure; 3-1 is CCD chip (1/3) video camera, and 3-2 is eyepiece, and 3-3 is for being the light field video camera; 3-4 is optical axis; 3-5 is light cone, and 3-6 is inner sleeve, and 3-7 is trocar sheath; 3-8 is image transmission optical fibre; 3-9 is cover glass, and 3-10 is lighting fiber, and 3-11 is objective lens.
Fig. 4 is optical fiber structure figure, the hexagonal array that Fig. 4 (a) is optical fiber, the mechanical passage that 4b-1 is cross section of optic fibre; the lighting window that 4b-2 is cross section of optic fibre, the object lens window that 4b-3 is cross section of optic fibre, the lighting window that 4b-4 is cross section of optic fibre; 4c-1 is CCD video line in optical fiber; 4c-2 is interior soft tube, and 4c-3 is outer jointing jacket, and 4c-4 is Transmission Fibers; 4c-5 is lighting fiber; 4c-6 is objective lens, and 4c-7 is the illumination eyeglass, and 4c-8 is mechanical passage.
Fig. 5 is the depth of field schematic diagram that light field video camera function is taken, and 5-1 is background, and 5-2 is focusing, and 5-3 is prospect, and 5-4 is front blur circle, and 5-5 is rear blur circle, and 5-6 is focal plane, and 5-7 is aperture.
Fig. 6 is for removing to mean arbitrary light with two planes, arbitrary the light that Fig. 6 (a) is space all available F (x, y, u, v) means, the focal length that 6-1 is the light field video camera, and 6-2 is front blur circle, 6-3 is rear blur circle.
Fig. 7 is the light-field capture schematic diagram, and Fig. 7 (a) is depicted as with camera lens and De Liangge plane, light field sensor place and means a light in scene, corresponds to storage and the image in the middle of each frame of camera micro lens array.Fig. 7 (b) be depicted as one group of light that light in scene can focus on current focussing plane current one-tenth clearly as, this group light approaches parallel in scene.Fig. 7 (c) is depicted as one group of light that can not focus on focussing plane at the unsharp picture of current one-tenth, and this group light is also parallel, and only it is not over against photocentre.
Fig. 8 is light field video camera and light field sensor schematic diagram, 1 hexagonal array that is the micro lens array, 2 is the arrangement of micro lens array on the light field sensor, 3 is the light field sensor, 4 is the connection diagram of micro lens array on the light field sensor, and 5 is that main lens links schematic diagram with micro lens on the light field sensor.
Fig. 9, for the focusing of twice different visual angles that in the video to after taking, a two field picture carries out, (a) is the frame original image in video, (b), for once focusing, (c) is another focusing.Circled is focal position.
Figure 10 is for to be focused to two frame group images in the video of taking, the once focusing that the image that (a) and (b) are the former frame in taking carries out, (c), (d) once focus for the rear two field picture in taking.
The specific embodiment
Below in conjunction with drawings and Examples, the present invention is further described.
In Fig. 1; in shell, built-in display screen etc. forms display module; CCD chip (1/3 color video camera), eyepiece hood and eyepiece, light field video camera etc. form the optical field imaging processing module; light beam and light cone, image transmission optical fibre etc. form the light field transport module; spy upon head module in the formation such as object lens, cover glass, each module once connects.Optical fiber is placed in flood lighting light source hand hose line, inside spy upon head at flood lighting light source hand hose line one end, the built-in power power supply, when probe deeply is detected thing inside, scene is passed to light field endoscope by optical fiber, light field endoscope by its own focusing function present clearly as, import CCD chip (1/3 color video camera) into, stored and shown.Its imaging mainly depends on the light field video camera sensor of shank head end equipment, and the light field video camera resembles a microcam scene is presented on the display screen of TV monitor through focusing on after the focusing processor is processed.Mainly utilize focusing function after the first shooting of light field video camera to peep in completing, spy upon head in solution in the situation that go deep into testee inside and can't move and rotate or inconvenience is mobile and rotation, utilize the focusing of again focusing of the software system of this endoscope, transformation angle, clear each corner that represents scene, peep in completing, or after video capture, to video focusing again, locate new visual angle and observed.Core algorithm comprises seizure and the conversion storage of light field, the seizure of light field refers to that a light in scene can mean with camera lens and De Liangge plane, focussing plane place, capture device can record each light of scene, if focus point has dropped on focussing plane just, this point is exactly clearly so, with the shooting point position centre of sphere, with the light of this light ray parallel be all clearly, if focus point has dropped on the inboard of focussing plane or the outside, this point is exactly unsharp so, with the light of this light ray parallel be all unsharp, focusing on process software is exactly that the one group light identical focus is adjusted on the focussing plane at convergent point place, as shown in drawings.The storage conversion is exactly to utilize Fourier transformation transform of spatial domain to be turned to the conversion storage mode of frequency domain, record (as shown in drawings) in digital mode, than the clear picture of common photoconduction fiberendoscope, color and luster is true to nature, resolution is higher, and can watch for many people simultaneously.
The light filed acquisition means: the image planes place at common imaging technique adds a microlens array, the scene image of the corresponding same position different visual angles of light of each lenticule record.Refer to that logical video camera captures the slightly differentiated image in a series of visual angles necessarily arranging of space simultaneously, thereby again tick light field data.The light field video camera adds the light field sensor by the micro lens array, the USB power panel, and lithium battery main processor circuit plate, displacement is controlled sensor, and LCD display, show and the radio circuit plate forms.This light field video camera is an array of microscopes that is covered with 90,000 miniature eyeglasses, after each little lens array receives light, before being sent to the CCD chip, separate out focused ray and the light data is changed, with digital mode record, the light field induction apparatus of this number, can collect " color, intensity and the direction " that enter all light of video camera, the resolution of video camera micro lens is 1,100 ten thousand rays (ray), that is to say and can capture 1,100 ten thousand bundle light, the effect of taking nearly thing and distant view under this endoscope condition not good at light is marvellous.The built-in chip type software operation " has enlarged light field ", follows the trail of the drop point of every light on the image of different distance, through number, again to defocused, just can take perfect video.
The present invention is concrete: the light field four-dimensional function, play up theory according to the light field of Levoy, and carry any light of intensity and directional information in space, can mean with 2 parallel plane parameters, light and two Plane intersects, in 2 points, form four-dimensional function L (u, v, x, y), for the pixel X in each space, the variation of u has all covered full shot, retain spatial resolution x, but do not recorded direction value u.Classical theory of radiation shows, comes from the weight integration of all radiation on camera lens in any the radiation as on plane, as shown in Equation 1:
Wherein: L
F(x, y, u, v) is the light field parameter of F distance outside the distance objective plane, and cos Θ is the decay factor due to the optics vignetting effect.
Further, CCD chip (1/3 color video camera) is connected with eyepiece with eyepiece hood, then is connected with the light field video camera, and centre is connected into light beam and light cone, then with inner sleeve and image transmission optical fibre with in spy upon head object lens be connected.
Further, light is by the passage of optical fiber and light field endoscope, is presented on display screen after utilizing the automatic focus of light field endoscope to process again, make clear picture, in industry or medical science endoscope, utilize light field endoscope to realize focusing, zoom function, blur-free imaging the light field endoscopic applications.
Aperture larger (the F value is less), the light passed through is more, and the depth of field is less, and stressing main requires the accurate shutter of focusing faster, and the light of coming in is just fewer, and it is more that shutter more just advances light.
The video that this endoscope takes has axial resolution and longitudinal resolution, and the later stage, self-service processing motility was larger, and the depth of field is larger, does not need accurate focusing.
Fig. 1 is modular structure figure of the present invention.
The three-dimensional cutaway view that Fig. 2 is a kind of industry of the present invention or medical light field endoscope, wherein, 2-1 is display screen; 2-2 is eyepiece, and 2-3 is optical axis and light cone, and 2-4 is illumination optical fiber; 2-5 is rod-like mirror, and 2-6 is viewing directional angle 30 degree prisms, and 2-7 is CCD chip (1/3) video camera; 2-8 is the light field video camera; 2-9 is outer telescop, and 2-10 is the scope pipe, and 2-11 is object lens; 2-12 is minus lens, and 2-13 is screening glass.Each parts connect successively by figure.
Fig. 3 is endoscope structure, and 3-1 is CCD chip (1/3) video camera, and 3-2 is eyepiece, and 3-3 is the light field video camera; 3-4 is optical axis, and 3-5 is light cone, and 3-6 is inner sleeve, and 3-7 is trocar sheath; 3-8 is image transmission optical fibre, and 3-9 is cover glass, and 3-10 is lighting fiber, and 3-11 is objective lens.
Fig. 4 is optical fiber structure figure, the hexagonal array that Fig. 4 (a) is optical fiber, the mechanical passage that in Fig. 4 (b), 4b-1 is cross section of optic fibre, the lighting window that in Fig. 4 (b), 4b-2 is cross section of optic fibre, the object lens window that in Fig. 4 (b), 4b-3 is cross section of optic fibre, the lighting window that in Fig. 4 (b), 4b-4 is cross section of optic fibre, in Fig. 4 (c), 4c-1 is CCD video line in optical fiber, in Fig. 4 (c), 4c-2 is interior soft tube, in Fig. 4 (c), 4c-3 is outer jointing jacket, in Fig. 4 (c), 4c-4 is Transmission Fibers, in Fig. 4 (c), 4c-5 is lighting fiber, in Fig. 4 (c), 4c-6 is objective lens, in Fig. 4 (c), 4c-7 is the illumination eyeglass, in Fig. 4 (c), 4c-8 is mechanical passage.
Fig. 5 is the depth of field schematic diagram that light field video camera function is taken, and 5-1 is background, and 5-2 is focusing, and 5-3 is prospect, and 5-4 is front blur circle, and 5-5 is rear blur circle, and 5-6 is focal plane, and 5-7 is aperture.
Figure 6 shows that with two planes and remove to mean any light, arbitrary the light that Fig. 6 (a) is depicted as space is available F (x all, y, u, v) mean, in Fig. 6 (b), 6-1 is depicted as the focal length of light field video camera, and in Fig. 6 (b), 6-2 is depicted as front blur circle, and in Fig. 6 (b), 6-3 is depicted as rear blur circle.
Fig. 7 is the light-field capture schematic diagram, and Fig. 7 (a) is depicted as with camera lens and De Liangge plane, light field sensor place and means a light in scene, corresponds to storage and the image in the middle of each frame of camera micro lens array.Fig. 7 (b) be depicted as one group of light that light in scene can focus on current focussing plane current one-tenth clearly as, this group light approaches parallel in scene.Fig. 7 (c) is depicted as one group of light that can not focus on focussing plane at the unsharp picture of current one-tenth, and this group light is also parallel, and only it is not over against photocentre.
Fig. 8 is light field video camera and light field sensor schematic diagram, Fig. 8 (a) is depicted as the hexagonal array of micro lens array, Fig. 8 (b) is depicted as the arrangement of micro lens array on the light field sensor, Fig. 8 (b)--1 is depicted as the single exposure of figure micro lens, 8 (b)--2 are depicted as the one other exposure of micro lens, Fig. 8 (b)--3 are depicted as the connection diagram of micro lens array on the light field sensor, and Fig. 8 (c) is depicted as the link schematic diagram of micro lens on the light field sensor.Fig. 8 (c)--1 is depicted as micro lens, Fig. 8 (c)--and 2 are depicted as the light field sensor of link micro lens, and Fig. 8 (c)--3 are depicted as the optical axis of micro lens.
Figure 9 shows that Fig. 9 (a) is depicted as the frame original image in video to the focusing of twice different visual angles that in the video after taking, a two field picture carries out, Fig. 9 (b) is depicted as once focusing, and Fig. 9 (c) is depicted as another focusing.Circled is focal position.
Figure 10 shows that and focused for two frame group images in the video to taking, Figure 10 (a), Figure 10 (b) are depicted as the once focusing that the image for the former frame in taking carries out, and Figure 10 (c), Figure 10 (d) once focus for the rear two field picture in taking.Circled is focal position.
The part that the present invention does not elaborate belongs to those skilled in the art's known technology.
The above is only the preferred embodiment of the present invention; it should be pointed out that for those skilled in the art, under the premise without departing from the principles of the invention; can also make some improvements and modifications, these improvements and modifications also should be considered as protection scope of the present invention.
Claims (6)
1. peep method in a light field video camera, it is characterized in that: mainly utilize focusing function after the first shooting of light field video camera to peep in completing, spy upon head in solution in the situation that go deep into testee inside and can't move and rotate or inconvenience is mobile and rotation, utilize the focusing of again focusing of the software system of this endoscope, transformation angle, clear each corner that represents scene, in completing, peep, or after video capture, to video focusing again, locating new visual angle is observed, core algorithm comprises seizure and the conversion storage of light field, the seizure of light field refers to that a light in scene can mean with camera lens and De Liangge plane, focussing plane place, capture device can record each light of scene, if focus point has dropped on focussing plane just, this point is exactly clearly so, and take shooting point as the centre of sphere, with the light of this light ray parallel be all clearly, if focus point has dropped on the inboard of focussing plane or the outside, this point is exactly unsharp so, with the light of this light ray parallel be all unsharp, focusing on process software is exactly that the one group light identical focus is adjusted on the focussing plane at convergent point place, the storage conversion is exactly to utilize Fourier transformation transform of spatial domain to be turned to the conversion storage mode of frequency domain, and with digital mode record.
2. peep method in a kind of light field video camera according to claim 1, it is characterized in that: this endoscope comprises built-in display screen, 1/3 color video camera, eyepiece, the light field video camera, object lens and power supply, by display screen, 1/3 color video camera, the light field video camera, optical fiber, inside spying upon head connects successively, the light field video camera is connected with 1/3 color video camera on one side, with the interior optical fiber of spying upon in head, be connected on one side, make light field pass through the light field video camera before imaging, optical fiber is placed in flood lighting light source hand hose line, flood lighting light source hand hose line one end is connected with the light field video camera, the other end with in spy upon the head be connected, when the interior head of spying upon deeply is detected thing when inner, scene is passed to the light field video camera by optical fiber, the light field video camera presents real-time video image clearly by its own focusing function, import 1/3 color video camera into, and stored and shown, its high-quality imaging mainly depends on micro lens array and the imageing sensor of the light field video camera of equipment, the light field video camera resemble a microcam by scene after image processor is processed, be presented on the display screen of endoscope, inside peep in process on optics photoreceptors video image converged at after the light field video camera, the summation of all light is recorded as to the point on photograph, show image, this one is an array of microscopes that is covered with 90,000 miniature eyeglasses with the video camera of special lens array, after each little lens array receives light, before being sent to the CCD chip, the light data is changed, in digital mode, write down, the light field induction apparatus of this number, can collect the color that enters all light of video camera, intensity and direction, the resolution of video camera micro lens is 1,100 ten thousand rays, can capture 1,100 ten thousand bundle light, the video camera micro lens is followed the trail of the drop point of every light on the image of different distance, this endoscope records the data of all direction light beams, can the later stage select as required focusing in computer, the last imaging effect of video also can be finished dealing with on computers, can also do afterwards and adjust with additive method after several years, adjust different visual angle, visual angle, can observe from different angles.
3. peep method in a kind of light field video camera according to claim 1, it is characterized in that: light field is at interior object lens in spying upon head, image transmission optical fibre, eyepiece, the light field video camera, in the passage of ccd video camera, transmit, after mainly utilizing the light field video camera to focus on, be presented at again on display screen, make clear picture, by the light field endoscopic applications in industry or medical science endoscope, utilize light field endoscope to realize focusing, zoom function, imaging clearly is true to nature, and enlarging function is arranged, can observe the fine structures such as mucosa, this endoscope is in the situation that low light and image high-speed mobile, still can accurately focus and take video clearly, catch a large amount of light data and selected focus, more flexible during shooting, whether fuzzy the video of no matter taking is, as long as in the focal range of endoscope, focusing can choose at random after having clapped or in shooting process, because in endoscope just all is recorded in all optical information in focal range when taking pictures, can first take rear focusing to video, can allow the interior any scenery of scene all become the shooting focus, also enlarged the depth of field simultaneously, also can change the visual angle of watching video.
4. peep method in a kind of light field video camera according to claim 1, it is characterized in that: this endoscope one is confrontational, reduce the requirement of lens opening size and the depth of field, with little lens array quota UV light, demonstrate the depth of field of each image, again by small inferior image projection to photoreceptors, allow all focusing images dim aperture on every side become clear, the increase luminosity that bring the large aperture of maintenance conventional endoscope, the situation that reduces shooting time and seediness, need not sacrifice the depth of field and and image definition.
5. peep method in a kind of light field video camera according to claim 1, it is characterized in that: by the application of light field technology, when inside peeping, only need composition to get final product, do not need focusing---because this can be focused on computers interior peeping after having taken, this will change in present peeps custom, and this class endoscope candid photograph is effective, whether fuzzy the video of no matter capturing is, as long as in the focal range of endoscope, focusing can choose at random patting after having taken the photograph, because in endoscope just all is recorded in all optical information in focal range when taking pictures, this light field endoscope can be used for light field and describes, synthetic aperture imaging, multi-viewpoint three-dimensional shows.
6. peep method in a kind of light field video camera according to claim 1, it is characterized in that: the limitation of traditional endoscope is, captured video can only have a focus, because this endoscope adopts the imaging technique different from traditional digital endoscope, light field endoscope does not have focusing system complicated on digital camera, overall volume is less, operates also fairly simple; Simultaneously, owing to need not selecting focusing, the speed of shooting is also faster, and the later stage can be with softwares such as Lytro to the video processing of focusing.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310331566.8A CN103417181B (en) | 2013-08-01 | 2013-08-01 | A kind of endoscopic method for light field video camera |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310331566.8A CN103417181B (en) | 2013-08-01 | 2013-08-01 | A kind of endoscopic method for light field video camera |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103417181A true CN103417181A (en) | 2013-12-04 |
| CN103417181B CN103417181B (en) | 2015-12-09 |
Family
ID=49642965
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310331566.8A Expired - Fee Related CN103417181B (en) | 2013-08-01 | 2013-08-01 | A kind of endoscopic method for light field video camera |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103417181B (en) |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104284133A (en) * | 2013-07-08 | 2015-01-14 | 阿瓦亚公司 | System and method for whiteboard collaboration |
| CN105652431A (en) * | 2016-03-30 | 2016-06-08 | 中国科学院合肥物质科学研究院 | Radiation-resistant and radiation-protective combined periscope type light path structure |
| CN105676451A (en) * | 2016-03-30 | 2016-06-15 | 中国科学院合肥物质科学研究院 | Radiation resistance and radiation prevention combined imaging light path structure |
| CN106111356A (en) * | 2016-06-29 | 2016-11-16 | 四川南格尔生物科技有限公司 | A kind of detection device and detection method |
| CN106878592A (en) * | 2015-12-14 | 2017-06-20 | 宏达国际电子股份有限公司 | Multifocal section of image capture device |
| CN107195245A (en) * | 2017-05-22 | 2017-09-22 | 茆胜 | Miniscope and light-cone QCD sum rules structure and its manufacture method |
| CN109343573A (en) * | 2018-10-31 | 2019-02-15 | 云南兆讯科技有限责任公司 | Power equipment inspection figure image collection processing system based on light field technique for taking |
| CN110022750A (en) * | 2016-12-09 | 2019-07-16 | 索尼公司 | Image processing equipment, image processing method and optical element |
| US10388323B2 (en) | 2015-03-17 | 2019-08-20 | Interdigital Ce Patent Holdings | Method and apparatus for displaying light field video data |
| CN110623626A (en) * | 2019-09-24 | 2019-12-31 | 东南大学苏州医疗器械研究院 | Two-dimensional-three-dimensional imaging converter for two-dimensional laparoscope |
| CN110623625A (en) * | 2019-09-24 | 2019-12-31 | 东南大学苏州医疗器械研究院 | Three-dimensional imaging converter for two-dimensional laparoscope |
| US10868945B2 (en) | 2019-04-08 | 2020-12-15 | Omnivision Technologies, Inc. | Light-field camera and method using wafer-level integration process |
| US11051680B1 (en) | 2019-12-11 | 2021-07-06 | Industrial Technology Research Institute | Endoscope stereo imaging device |
| CN113784217A (en) * | 2021-09-13 | 2021-12-10 | 天津智融创新科技发展有限公司 | Video playing method, device, equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101065955A (en) * | 2004-10-01 | 2007-10-31 | 利兰·斯坦福青年大学托管委员会 | Imaging arrangements and methods therefor |
| US20080131019A1 (en) * | 2006-12-01 | 2008-06-05 | Yi-Ren Ng | Interactive Refocusing of Electronic Images |
| US20090041448A1 (en) * | 2007-08-06 | 2009-02-12 | Georgiev Todor G | Method and Apparatus for Radiance Capture by Multiplexing in the Frequency Domain |
| CN102439979A (en) * | 2009-04-22 | 2012-05-02 | 雷特利克斯股份有限公司 | Digital imaging system, plenoptic optical device and image data processing method |
-
2013
- 2013-08-01 CN CN201310331566.8A patent/CN103417181B/en not_active Expired - Fee Related
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101065955A (en) * | 2004-10-01 | 2007-10-31 | 利兰·斯坦福青年大学托管委员会 | Imaging arrangements and methods therefor |
| US20080131019A1 (en) * | 2006-12-01 | 2008-06-05 | Yi-Ren Ng | Interactive Refocusing of Electronic Images |
| US20090041448A1 (en) * | 2007-08-06 | 2009-02-12 | Georgiev Todor G | Method and Apparatus for Radiance Capture by Multiplexing in the Frequency Domain |
| CN102439979A (en) * | 2009-04-22 | 2012-05-02 | 雷特利克斯股份有限公司 | Digital imaging system, plenoptic optical device and image data processing method |
Non-Patent Citations (2)
| Title |
|---|
| YANG GONG等: "Impinging Flame Characteristics in an Opposed Multiburner Gasifier", 《INDUSTRIAL & ENGINEERING CHEMISTRY RESEARCH》, vol. 8, no. 52, 25 January 2013 (2013-01-25) * |
| 陈婧: "先拍照再对焦:相机的3.0革命", 《IT经理世界》, no. 355, 5 January 2013 (2013-01-05) * |
Cited By (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104284133A (en) * | 2013-07-08 | 2015-01-14 | 阿瓦亚公司 | System and method for whiteboard collaboration |
| US10388323B2 (en) | 2015-03-17 | 2019-08-20 | Interdigital Ce Patent Holdings | Method and apparatus for displaying light field video data |
| CN106878592B (en) * | 2015-12-14 | 2019-09-17 | 宏达国际电子股份有限公司 | Multifocal section of image capture device |
| CN106878592A (en) * | 2015-12-14 | 2017-06-20 | 宏达国际电子股份有限公司 | Multifocal section of image capture device |
| CN105676451A (en) * | 2016-03-30 | 2016-06-15 | 中国科学院合肥物质科学研究院 | Radiation resistance and radiation prevention combined imaging light path structure |
| CN105652431B (en) * | 2016-03-30 | 2017-12-29 | 中国科学院合肥物质科学研究院 | The periscopic light channel structure that a kind of radioresistance is combined with radiation proof |
| CN105676451B (en) * | 2016-03-30 | 2017-12-29 | 中国科学院合肥物质科学研究院 | The imaging optical path structure that a kind of radioresistance is combined with radiation proof |
| CN105652431A (en) * | 2016-03-30 | 2016-06-08 | 中国科学院合肥物质科学研究院 | Radiation-resistant and radiation-protective combined periscope type light path structure |
| CN106111356A (en) * | 2016-06-29 | 2016-11-16 | 四川南格尔生物科技有限公司 | A kind of detection device and detection method |
| CN106111356B (en) * | 2016-06-29 | 2019-03-19 | 四川南格尔生物科技有限公司 | A kind of detection device and detection method |
| CN110022750B (en) * | 2016-12-09 | 2022-04-15 | 索尼公司 | Image processing apparatus, image processing method, and optical element |
| CN110022750A (en) * | 2016-12-09 | 2019-07-16 | 索尼公司 | Image processing equipment, image processing method and optical element |
| CN107195245A (en) * | 2017-05-22 | 2017-09-22 | 茆胜 | Miniscope and light-cone QCD sum rules structure and its manufacture method |
| CN109343573A (en) * | 2018-10-31 | 2019-02-15 | 云南兆讯科技有限责任公司 | Power equipment inspection figure image collection processing system based on light field technique for taking |
| US10868945B2 (en) | 2019-04-08 | 2020-12-15 | Omnivision Technologies, Inc. | Light-field camera and method using wafer-level integration process |
| CN110623625A (en) * | 2019-09-24 | 2019-12-31 | 东南大学苏州医疗器械研究院 | Three-dimensional imaging converter for two-dimensional laparoscope |
| CN110623626A (en) * | 2019-09-24 | 2019-12-31 | 东南大学苏州医疗器械研究院 | Two-dimensional-three-dimensional imaging converter for two-dimensional laparoscope |
| US11051680B1 (en) | 2019-12-11 | 2021-07-06 | Industrial Technology Research Institute | Endoscope stereo imaging device |
| CN113784217A (en) * | 2021-09-13 | 2021-12-10 | 天津智融创新科技发展有限公司 | Video playing method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103417181B (en) | 2015-12-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103417181B (en) | A kind of endoscopic method for light field video camera | |
| CN101836432B (en) | Imaging device and image recording and playback system | |
| TWI419551B (en) | Solid-state panoramic image capture apparatus | |
| CN105245867B (en) | Image pick-up device, system and control method and image processing apparatus | |
| CN111308690B (en) | Optical field electronic endoscopic equipment and imaging method thereof | |
| US20090059364A1 (en) | Systems and methods for electronic and virtual ocular devices | |
| CN107991838A (en) | Self-adaptation three-dimensional stereo imaging system | |
| US6233035B1 (en) | Image recording apparatus and image reproducing apparatus | |
| CN106338819A (en) | Digital viewing full-view-field AR (augmented reality) multimedia telescope | |
| CN108490593A (en) | Zoom lens and photographic device including the zoom lens | |
| JP6418770B2 (en) | Image processing apparatus, imaging apparatus, image processing method, program, and storage medium | |
| Kagawa et al. | A three‐dimensional multifunctional compound‐eye endoscopic system with extended depth of field | |
| JP5484453B2 (en) | Optical devices with multiple operating modes | |
| CN100458559C (en) | Stereoscopic digital camera and imaging display method | |
| CN104048765A (en) | Infrared imaging device based on coding bore diameters | |
| CN206584106U (en) | A kind of video is micro-, photography large visual field optical system | |
| CN102103262A (en) | Video display ocular lens | |
| CN201955548U (en) | Video display eyepiece | |
| JP2018152748A (en) | Imaging/display device of stereoscopic image and head mount device | |
| JPH1132251A (en) | Image-processing unit | |
| US20050254817A1 (en) | Autostereoscopic electronic camera | |
| JP2003287687A (en) | Three-dimensional transmission microscope system and image display method | |
| JP2018063309A (en) | Microscope device | |
| JPH01197716A (en) | Enlargement photographing mechanism for electronic endoscope | |
| Chen et al. | Real Time Focusing and Directional Light Projection Method for Medical Endoscope Video |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20151209 Termination date: 20200801 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |