CN103417181B - A kind of endoscopic method for light field video camera - Google Patents
A kind of endoscopic method for light field video camera Download PDFInfo
- Publication number
- CN103417181B CN103417181B CN201310331566.8A CN201310331566A CN103417181B CN 103417181 B CN103417181 B CN 103417181B CN 201310331566 A CN201310331566 A CN 201310331566A CN 103417181 B CN103417181 B CN 103417181B
- Authority
- CN
- China
- Prior art keywords
- video camera
- light field
- light
- endoscope
- focusing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Landscapes
- Endoscopes (AREA)
Abstract
The invention provides and a kind ofly peep method based in light field video camera, comprising: the core component of interior to industry and medical science etc. endoscope device is replaced with light field video camera, utilize light field video camera first take rear focus function complete in peep.Later stage can observe the focusing that video carry out again visual angle, spies on high definition reduction frequently and each corner of scene from interior, allows user can the observation of visual angle.Solve under interior pry head gos deep into the irremovable situation of testee simultaneously, the software focus function of light field video camera is utilized to realize again focusing, show each corner clearly, can solve in the processes such as operation, interior pry head no longer movement when, to be focused transformation angle by software, in seeing clearly, peep all directions of scene.This invention adds industry and medical endoscopes field light field video camera, interior endoscope device can be made to gather light field fully, make later stage imaging more accurately clear, and also can compress and storage file.
Description
Technical field
The present invention relates to the product of a kind of endoscope and light field video camera combination, be specifically related to a kind of endoscopic method for light field video camera, especially can solve conventional endoscope and focus on unclear, image blur, observe from positive crevice projection angle, cannot observe the small items of certain space structure, under high-resolution and large-numerical aperture condition, the depth of field is very little, easy lose objects, once takes the video sizing problem that just allows.Spy in this frequently once to take and repeatedly change visual angle from the clear observation of all angles.
Background technology
Conventional endoscope, obtains the large depth of field, needs to reduce aperture, and to expose the number of photons entered limited so at every turn, and noise, appears in signal to noise ratio reduction; In order to balance signal to noise ratio, need large aperture, the depth of field is little, and focusing is difficult, blurred background; Dark environment, in order to balance signal to noise ratio, need prolonging exposure time, the shake of hands causes video blur, needs spider.
At present, known industry or medical endoscope by display screen, built-in power, CCD chip (1/3 color video camera), mirror shank diameter, composition such as probe lighting source etc.Interior pry head goed deep into measured object inside or contact with measured object, to carry out conventional lossless detection and the detection of non-visible section bit table planar defect cannot be touched.But, current industry or medical endoscope capture video have just been shaped, and optical field acquisition is insufficient, can not automatic focus, to such an extent as to imaging is fuzzyyer, the size of the degree of depth of object to be detected and object to be detected defect profile is unintelligible, easily cause erroneous judgement or misjudgement.
1936, Gershun proposed light field concept, and light field is exactly the propagation of light radiation each position all directions in space, 1992, light field theory was applied to computer vision by Adelson, proposed all-optical field theory (plenoptictheory), 1996, Levoy proposes light field and plays up theory (lightfieldrendering), light field is carried out parametrization, and proposes imaging formula, 2005, Ng invention First hand-held light-field camera, 2006, Levoy developed light field microscope.
Summary of the invention
Can not automatic focus in order to overcome existing industry or medical endoscope, the invention provides a kind of novel endoscope, comprise industry and medical endoscope, this endoscope the change automatic focus of change environmentally and depth of probe can not only demonstrate picture clearly, color and luster is true to nature, resolution is high, and avoid the video that Nonlinear magnify is easy to distortion etc. and solves conventional endoscope shooting and observe from positive crevice projection angle, cannot observe the small items of certain space structure by transformation angle, the video of this endoscope shooting can reorientate observation from various visual angles.Under solving high-resolution and large-numerical aperture condition, the depth of field is very little, the problems such as easy lose objects, when endoscope gos deep into testee inside and be no longer mobile, can use software on a display screen, see narrow and small object clearly from different visual angles.
The technical solution adopted for the present invention to solve the technical problems is: a kind of endoscopic method for light field video camera, after mainly utilizing the first shooting of light field video camera, focusing function is peeped in completing, in solving pry head when go deep into testee inside cannot move and rotate or inconvenience is mobile and rotate, the software system of this endoscope is utilized again to focus focusing, transformation angle, clear each corner representing scene, peep in completing, or after video capture, to video again focusing, locate new visual angle to observe, core algorithm comprises seizure and the conversion storage of light field, the seizure of light field refers to that a light in scene can represent by two planes at camera lens and focussing plane place, capture device can record each light of scene, if focus point has dropped on focussing plane just, so this point is exactly clearly, take shooting point as the centre of sphere, all clearly with the light of this light ray parallel, if focus point has dropped on the inner side of focussing plane or outside, so this point is exactly unsharp, all unsharp with the light of this light ray parallel, focusing on process software is exactly that identical for focus one group of light is adjusted on the focussing plane at convergent point place, storing conversion is exactly utilize Fourier transformation that transform of spatial domain is turned to the conversion storage mode of frequency domain, with the mode record of number.
Further, this endoscope comprises built-in display screen, CCD chip (1/3 color video camera), eyepiece, light field video camera, object lens and power supply, is connected successively by display screen, 1/3 color video camera, light field video camera, optical fiber, interior pry head.Light field video camera is while be connected with 1/3 color video camera, while with the Fiber connection in interior pry head, light field is made to pass through light field video camera before imaging, optical fiber is placed in flood lighting light source hand hose line, flood lighting light source hand hose line one end is connected with light field video camera, the other end is connected with interior pry head, when interior pry head is deeply detected thing inside, scene is passed to light field video camera by optical fiber, light field video camera presents real-time video image clearly by its oneself focusing function, import 1/3 color video camera into, and carry out storing and showing, its high-quality imaging depends on micro lens arrays and the imageing sensor of the light field video camera of equipment, light field video camera resembles a microcam by scene after image processor process, be presented on the display screen of endoscope, inside peep in process and video image is converged on the optics photoreceptors after light field video camera, the summation of all light is recorded as the point on photograph, show image, this portion is an array of microscopes being covered with 90,000 miniature eyeglasses with the video camera of special lens array, after each little lens array receives light, before being sent to CCD chip, light data is changed, write down with digital manner, the light field induction apparatus of this number, the color entering all light of video camera can be collected, intensity and direction, the resolution of video camera micro lens is 1,100 ten thousand rays, 1,100 ten thousand bundle light can be captured, video camera micro lens follows the trail of the drop point of every bar light on the image of different distance, this endoscope records the data of all directions light beam, later stage can select focusing as required in computer, the last imaging effect of video also can process on computers, can also make of additive method after several years and adjust afterwards, the visual angle that adjustment visual angle is different, can from different angle views.
Further, light field is from the object lens interior pry head, image transmission optical fibre, eyepiece, light field video camera, transmit in the passage of ccd video camera, show again on a display screen after utilizing the focusing of light field video camera, make clear picture, by light field endoscopic applications in industry or medical endoscopes, light field endoscope is utilized to realize focusing, zoom function, imaging clearly is true to nature, and have enlarging function, the fine structures such as mucosa can be observed, this endoscope is when low light and image high-speed mobile, still accurately can focus and take video clearly, catch a large amount of light data and selected focus, more flexible when taking pictures, whether the video blur no matter taken, as long as in the focal range of endoscope, focusing can choose at random after having clapped, because in endoscope is just all recorded in optical information all in focal range when taking pictures, rear focusing can be first taken to video, the any scenery in scene can be allowed all to become shooting focus, depth of field problem need not be paid close attention to too much, also can change the visual angle of viewing video, a photograph frame of video can also be switched between 2 d and 3 d modes back and forth.
Further, this endoscope one is confrontational, lower lens opening size and the depth of field, with little lens array quota UV light, demonstrate the depth of field of each image, then by small secondary image projection on photoreceptors, it is clear that the dim aperture around all focused image becomes, the increase luminosity keeping the large aperture of conventional endoscope to bring, the situation reducing shooting time and seediness, need not sacrifice the depth of field and and image definition.
Further, by the application of light field technology, only composition is needed when inside peeping, do not need focusing---because this can interior peep taken after focus on computers, this will change present in peep custom, and this kind of endoscope captures effective, whether the video blur no matter captured, as long as in the focal range of endoscope, focusing can pat taken the photograph after choose at random, because in endoscope is just all recorded in optical information all in focal range when taking pictures, this light field endoscope can be used for light field and describes, synthetic aperture imaging, multi-viewpoint three-dimensional shows.
Further, the limitation of traditional endoscope is, captured video can only have a focus, because this endoscope adopts the imaging technique different from traditional digital endoscope, light field endoscope does not have focusing system complicated on digital camera, and overall volume is less, operates also fairly simple; Simultaneously owing to need not select focusing, the speed of shooting is also faster, and the later stage can process video with Lytro software.
Principle of the present invention is:
The invention provides a kind of novel endoscopic method for light field video camera, comprising: the core component of endoscope device in industrial endoscope and medical science etc. is replaced with light field video camera, utilize light field video camera first take rear focusing complete in peep.Later stage can focus again to video, reduces each corner of scene from interior spying on frequently, high-resolution display, allows user can the observation of visual angle, also can compress and storage file simultaneously.Solve simultaneously, under interior pry head gos deep into the irremovable situation of testee, utilize the software focus function adjustable visual angle of light field video camera, show each corner clearly.Belong to industrial endoscope and light field video camera in conjunction with field, be a kind of focus function after first the taking pictures of light field video camera is applied in peep field, expand and improve the technical field of industrial endoscope, have also been enlarged the range of application of light field video camera simultaneously, to light-field camera and the actual application example of light field video camera one, mainly solving industry and medical endoscopes can not the problem such as image blur under narrow and small wet environment, this invention adds industry and medical endoscopes field light field video camera, interior endoscope device can be made to gather light field fully, later stage imaging is more accurately clear.Such as the face of burglar is focused again.Even after the several years of taking pictures, you just can obtain the desirable video of the different visual angles wanted yourself in a flash, and endoscope can remove the focusing system of heaviness, power consumption and costliness, and you peep in can completing quickly and take pictures.Peeping video camera in present consumer uses is all the sensitive surface-chemical film or the electronic induction device that use plane, carrys out record position, the optical density of color and scioptics.This invention endoscope is also like this, and its advanced part is the angle that can record incident illumination, and the file recorded is no longer only picture one by one, but the mini data base of the three-dimensional information of a recording light, be called light field.Use specifically developed software that this toy data base can be used to make many different videos, the time that also can change shutter adjusts video.
The invention has the beneficial effects as follows:
1, the present invention can while accurately testing measured object scene, conveniently image is presented on the screen of TV monitor, not move or in irremovable situation at interior pry head, focusing software is utilized to see each inner corner clearly, can make the most of the advantage in an interior pry irremovable operation, more clear than video image that common fibre optic endoscopes becomes, color and luster is true to nature, and resolution is higher.
2, the invention belongs to industrial endoscope and light field endoscope in conjunction with field, a kind ofly utilize first taking pictures to focus afterwards and being applied to industrial endoscope and medical endoscopes field of light field endoscope, expand and improve the technical field of industrial endoscope, have also been enlarged the range of application of light field endoscope simultaneously, to light field video camera and the actual application example of light-field camera one, mainly solve industry and medical endoscopes can not auto-focusing problem under narrow and small wet environment, the present invention light field endoscope add industry or medical endoscopes make in peep video mirror and focus in real time, imaging is more accurately clear, also detailed observation can be carried out in phase change visual angle after the picture is taken.
3, the present invention includes: in the light field passage of industrial endoscope and medical endoscopes, add light field video camera, utilize the change viewpoint of light field video camera software to complete clearly and peep.Allow endoscope probe automatic focusing really, focus in real time, automatic rotation, high-resolution display, allow user can be real-time from different view, also can carry out the detailed observation of different visual angles after the picture is taken, also can compress and storage file simultaneously.
4, the present invention is a kind of expanding unit combining industrial endoscope and light-field camera, light field video camera, only to catch single light plane different from conventional endoscope, all light in this light field endoscope energy FOV of acquisition, namely in space the light of a little any transmission direction in position, by catching whole light field data instantaneously.Its feature mainly comprises fields such as the real-time visual angle focus function of light field video camera being applied to industry and medical endoscopes, by after the image automatic focus of outside by a series of optical system, clearly pass to the eyes of tester, imaging is fidelity very, and definition is very high.
Accompanying drawing explanation
Fig. 1 is the structure chart of the present invention's industry or medical endoscope;
Fig. 2 is the three-dimensional cutaway view of the present invention's industry or medical endoscope, and wherein, 2-1 is display screen; 2-2 is eyepiece, and 2-3 is optical axis and light cone, and 2-4 is illumination optical fiber; 2-5 is rod-like mirror, and 2-6 is viewing directional angle 30 degree of prisms, and 2-7 is CCD chip (1/3) video camera; 2-8 is light field video camera; 2-9 is outer telescop, and 2-10 is scope pipe, and 2-11 is object lens; 2-12 is minus lens, and 2-13 is screening glass.
Fig. 3 is endoscope structure; 3-1 is CCD chip (1/3) video camera, and 3-2 is eyepiece, and 3-3 is for being light field video camera; 3-4 is optical axis; 3-5 is light cone, and 3-6 is inner sleeve, and 3-7 is trocar sheath; 3-8 is image transmission optical fibre; 3-9 is cover glass, and 3-10 is lighting fiber, and 3-11 is objective lens.
Fig. 4 is optical fiber structure figure, the hexagonal array that Fig. 4 (a) is optical fiber, and 4b-1 is the mechanical passage of cross section of optic fibre; 4b-2 is the lighting window of cross section of optic fibre, and 4b-3 is the object lens window of cross section of optic fibre, and 4b-4 is the lighting window of cross section of optic fibre; 4c-1 is CCD video line in optical fiber; 4c-2 is interior soft tube, and 4c-3 is outer jointing jacket, and 4c-4 is Transmission Fibers; 4c-5 is lighting fiber; 4c-6 is objective lens, and 4c-7 is illumination eyeglass, and 4c-8 is mechanical passage.
Fig. 5 is the depth of field schematic diagram that light field video camera can be taken, and 5-1 is background, and 5-2 is focusing, and 5-3 is prospect, and 5-4 is front blur circle, and 5-5 is rear blur circle, and 5-6 is focal plane, and 5-7 is aperture.
Fig. 6 goes to represent arbitrary light by two planes, and arbitrary the light that Fig. 6 (a) is space all can use F (x, y, u, v) to represent, 6-1 is the focal length of light field video camera, and 6-2 is front blur circle, and 6-3 is rear blur circle.
Fig. 7 is light-field capture schematic diagram, and Fig. 7 (a) is depicted as the light represented by two planes at camera lens and light field sensor place in scene, correspond to camera micro lens arrays storage and in each frame between image.One group of light that Fig. 7 (b) light be depicted as in scene can focus on present convergence plane current one-tenth clearly as, this group light in scene close to parallel.Fig. 7 (c) is depicted as and can not focuses on one group of light on focussing plane at the unsharp picture of current one-tenth, and this group light is also parallel, and only it is not just to photocentre.
Fig. 8 is light field video camera and light field sensor schematic diagram, 1 is the hexagonal array of micro lens arrays, 2 is the arrangement of micro lens arrays on light field sensor, 3 is light field sensor, 4 is the connection diagram of micro lens arrays on light field sensor, and 5 is main lens with micro lens on light field sensor links schematic diagram.
Fig. 9 be to shooting after video in the focusing of twice different visual angles carried out of a two field picture, (a) is the frame original image in video, and (b), for once to focus, (c) is another focusing.Circled is focal position.
Figure 10 focuses to two frame group images in the video taken, and (a) and (b) are the once focusing carried out the image of the former frame in shooting, and (c), (d) once focus to the rear two field picture in shooting.
Detailed description of the invention
Below in conjunction with drawings and Examples, the present invention is further described.
In FIG; in shell, built-in display screen etc. form display module; CCD chip (1/3 color video camera), eyepiece hood and eyepiece, light field video camera etc. form optical field imaging processing module; light beam and light cone, image transmission optical fibre etc. form light field transport module; pry head module in object lens, cover glass etc. are formed, each module once connects.Optical fiber is placed in flood lighting light source hand hose line, interior pry head is in flood lighting light source hand hose line one end, built-in power is powered, when being deeply detected thing inside when popping one's head in, scene is passed to light field endoscope by optical fiber, light field endoscope by its oneself focusing function present clearly as, import CCD chip (1/3 color video camera) into, carry out storing and showing.Its imaging depends on the light field video camera sensor of shank head end equipment, and light field video camera resembles a microcam and scene is presented on the display screen of TV monitor after focusing on the process of focusing processor.After mainly utilizing the first shooting of light field video camera, focusing function is peeped in completing, in solving pry head when go deep into testee inside cannot move and rotate or inconvenience is mobile and rotate, the software system of this endoscope is utilized again to focus focusing, transformation angle, clear each corner representing scene, peeps in completing, or after video capture, to video again focusing, locate new visual angle and observe.Core algorithm comprises seizure and the conversion storage of light field, the seizure of light field refers to that a light in scene can represent by two planes at camera lens and focussing plane place, capture device can record each light of scene, if focus point has dropped on focussing plane just, so this point is exactly clearly, with the shooting point position centre of sphere, all clearly with the light of this light ray parallel, if focus point has dropped on the inner side of focussing plane or outside, so this point is exactly unsharp, all unsharp with the light of this light ray parallel, focusing on process software is exactly that identical for focus one group of light is adjusted on the focussing plane at convergent point place, as shown in drawings.Storing conversion is exactly utilize Fourier transformation that transform of spatial domain is turned to the conversion storage mode of frequency domain, with the mode record (as shown in drawings) of number, than the clear picture of common optical fibers scope, color and luster is true to nature, resolution is higher, and can watch for many people simultaneously.
Light filed acquisition means: add a microlens array at an image planes place of common imaging technique, the scene image of the corresponding same position different visual angles of light of each lenticule record.Refer to that logical video camera captures the slightly differentiated image in a series of visual angle in certain arrangement in space simultaneously, thus again tick light field data.Light field video camera adds light field sensor by micro lens arrays, USB power source plate, lithium battery main processor circuit plate, variable pitch contro l sensor, LCD display, display and radio circuit plate composition.This light field video camera is an array of microscopes being covered with 90,000 miniature eyeglasses, after each little lens array receives light, before being sent to CCD chip, separate out focused ray and light data is changed, with digital manner record, the light field induction apparatus of this number, can collect in " color, intensity and the direction " that enter all light of video camera, the resolution of video camera micro lens is 1,100 ten thousand rays (ray), that is can capture 1,100 ten thousand bundle light, the effect that nearly thing and distant view are taken under the condition that light is not good by this endoscope is marvellous.Built-in chip type software operation " expands light field ", follows the trail of the drop point of every bar light on the image of different distance, through number again to defocused, just can take perfect video.
The present invention is concrete: light field four-dimensional function, and the light field according to Levoy plays up theory, carries any light of intensity and directional information in space, can represent with 2 parallel plane parameters, light and two Plane intersects, in 2 points, form four-dimensional function L (u, v, x, y), the change for the pixel X in each space, u is covered with full shot, remain spatial resolution x, but do not record direction value u.Classical theory of radiation shows, comes from the weight integration of all radiation on camera lens in the radiation as any in plane, as shown in Equation 1:
Wherein: L
f(x, y, u, v) is the light field parameter of the outer F distance of distance objective plane, and cos Θ is the decay factor due to optics vignetting effect.
Further, CCD chip (1/3 color video camera) is connected with eyepiece with eyepiece hood, then is connected with light field video camera, and centre is connected into light beam and light cone, then is connected with the object lens of image transmission optical fibre with interior pry head with inner sleeve.
Further, light, by the passage of optical fiber and light field endoscope, shows on a display screen after utilizing the automatic focus process of light field endoscope again, make clear picture, by light field endoscopic applications in industry or medical endoscopes, light field endoscope is utilized to realize focusing, zoom function, blur-free imaging.
Aperture larger (F value is less), the light passed through is more, and the depth of field is less, stressing main, and require that the accurate shutter of focusing is faster, the light of coming in is fewer, and shutter is slower, and just to enter light more.
The video of this endoscope shooting has axial resolution and longitudinal resolution, and later stage self-service process motility is comparatively large, and the depth of field is comparatively large, does not need accurate focusing.
Fig. 1 is function structure chart of the present invention.
Fig. 2 is the three-dimensional cutaway view of a kind of industry of the present invention or medical light field endoscope, and wherein, 2-1 is display screen; 2-2 is eyepiece, and 2-3 is optical axis and light cone, and 2-4 is illumination optical fiber; 2-5 is rod-like mirror, and 2-6 is viewing directional angle 30 degree of prisms, and 2-7 is CCD chip (1/3) video camera; 2-8 is light field video camera; 2-9 is outer telescop, and 2-10 is scope pipe, and 2-11 is object lens; 2-12 is minus lens, and 2-13 is screening glass.Each parts connect successively by figure.
Fig. 3 is endoscope structure; 3-1 is CCD chip (1/3) video camera, and 3-2 is eyepiece, and 3-3 is light field video camera; 3-4 is optical axis; 3-5 is light cone, and 3-6 is inner sleeve, and 3-7 is trocar sheath; 3-8 is image transmission optical fibre; 3-9 is cover glass, and 3-10 is lighting fiber, and 3-11 is objective lens.
Fig. 4 is optical fiber structure figure, the hexagonal array that Fig. 4 (a) is optical fiber, in Fig. 4 (b), 4b-1 is the mechanical passage of cross section of optic fibre, in Fig. 4 (b), 4b-2 is the lighting window of cross section of optic fibre, in Fig. 4 (b), 4b-3 is the object lens window of cross section of optic fibre, in Fig. 4 (b), 4b-4 is the lighting window of cross section of optic fibre, in Fig. 4 (c), 4c-1 is CCD video line in optical fiber, in Fig. 4 (c), 4c-2 is interior soft tube, in Fig. 4 (c), 4c-3 is outer jointing jacket, in Fig. 4 (c), 4c-4 is Transmission Fibers, in Fig. 4 (c), 4c-5 is lighting fiber, in Fig. 4 (c), 4c-6 is objective lens, in Fig. 4 (c), 4c-7 is illumination eyeglass, in Fig. 4 (c), 4c-8 is mechanical passage.
Fig. 5 is the depth of field schematic diagram that light field video camera can be taken, and 5-1 is background, and 5-2 is focusing, and 5-3 is prospect, and 5-4 is front blur circle, and 5-5 is rear blur circle, and 5-6 is focal plane, and 5-7 is aperture.
Figure 6 shows that and remove to represent any light by two planes, arbitrary the light that Fig. 6 (a) is depicted as space all can use F (x, y, u, v) represent, in Fig. 6 (b), 6-1 is depicted as the focal length of light field video camera, and in Fig. 6 (b), 6-2 is depicted as front blur circle, and in Fig. 6 (b), 6-3 is depicted as rear blur circle.
Fig. 7 is light-field capture schematic diagram, and Fig. 7 (a) is depicted as the light represented by two planes at camera lens and light field sensor place in scene, correspond to camera micro lens arrays storage and in each frame between image.One group of light that Fig. 7 (b) light be depicted as in scene can focus on present convergence plane current one-tenth clearly as, this group light in scene close to parallel.Fig. 7 (c) is depicted as and can not focuses on one group of light on focussing plane at the unsharp picture of current one-tenth, and this group light is also parallel, and only it is not just to photocentre.
Fig. 8 is light field video camera and light field sensor schematic diagram, Fig. 8 (a) is depicted as the hexagonal array of micro lens arrays, Fig. 8 (b) is depicted as the arrangement of micro lens arrays on light field sensor, Fig. 8 (b)--1 single exposure being depicted as figure micro lens, 8 (b)--2 one other exposure being depicted as micro lens, Fig. 8 (b)--3 are depicted as the connection diagram of micro lens arrays on light field sensor, and Fig. 8 (c) is depicted as the link schematic diagram of micro lens on light field sensor.Fig. 8 (c)--1 is depicted as micro lens, Fig. 8 (c)--2 is depicted as the light field sensor of link micro lens, Fig. 8 (c)--3 optical axises being depicted as micro lens.
Figure 9 shows that the focusing of twice different visual angles that a two field picture carries out in the video after to shooting, Fig. 9 (a) is depicted as the frame original image in video, Fig. 9 (b) is depicted as once focusing, and Fig. 9 (c) is depicted as another focusing.Circled is focal position.
Figure 10 shows that as focusing to two frame group images in the video taken, Figure 10 (a), Figure 10 (b) are depicted as the once focusing for carrying out the image of the former frame in shooting, and Figure 10 (c), Figure 10 (d) once focus to the rear two field picture in shooting.Circled is focal position.
The part that the present invention does not elaborate belongs to those skilled in the art's known technology.
The above is only the preferred embodiment of the present invention; it should be pointed out that for those skilled in the art, under the premise without departing from the principles of the invention; can also make some improvements and modifications, these improvements and modifications also should be considered as protection scope of the present invention.
Claims (1)
1. the endoscopic method for light field video camera of an industrial endoscope, it is characterized in that: after in the method, endoscope mainly utilizes the first shooting of light field video camera, focusing function is peeped in completing, in solving pry head when go deep into testee inside cannot move and rotate or inconvenience is mobile and rotate, the software system of this endoscope is utilized again to focus focusing, transformation angle, clear each corner representing scene, peep in completing, or after video capture, to video again focusing, locate new visual angle to observe, core algorithm comprises seizure and the conversion storage of light field, focusing on process software is exactly that identical for focus one group of light is adjusted on the focussing plane at convergent point place, it is exactly utilize Fourier transformation that transform of spatial domain is turned to the conversion storage mode of frequency domain that conversion stores, and with the mode record of number,
This endoscope comprises built-in display screen, 1/3 color video camera, eyepiece, light field video camera, object lens and power supply, display screen, 1/3 color video camera, light field video camera, optical fiber, interior pry head connects successively, light field video camera is while be connected with 1/3 color video camera, while with the Fiber connection in interior pry head, light field is made to pass through light field video camera before imaging, optical fiber is placed in flood lighting light source hand hose line, flood lighting light source hand hose line one end is connected with light field video camera, the other end is connected with interior pry head, when interior pry head is deeply detected thing inside, scene is passed to light field video camera by optical fiber, light field video camera presents real-time video image clearly by himself focusing function, import 1/3 color video camera into, and carry out storing and showing, its high-quality imaging depends on micro lens arrays and the imageing sensor of the light field video camera of equipment, light field video camera resembles a microcam by scene after image processor process, be presented on the display screen of endoscope, inside peep in process and video image is converged on the optics photoreceptors after light field video camera, the summation of all light is recorded as the point on photograph, show image, this portion is an array of microscopes being covered with 90,000 miniature eyeglasses with the video camera of special lens array, after each little lens array receives light, before being sent to CCD chip, light data is changed, write down with digital manner, the light field induction apparatus of this number, the color entering all light of video camera can be collected, intensity and direction, the resolution of video camera micro lens is 1,100 ten thousand rays, 1,100 ten thousand bundle light can be captured, video camera micro lens follows the trail of the drop point of every bar light on the image of different distance, this endoscope records the data of all directions light beam, later stage can select focusing as required in computer, the last imaging effect of video also can process on computers, can also make of additive method after several years and adjust afterwards, adjust different visual angles, can from different angle views,
The object lens of light field in interior pry head, image transmission optical fibre, eyepiece, light field video camera, transmit in the passage of ccd video camera, show again on a display screen after mainly utilizing light field video camera to focus on, make clear picture, light field endoscope is utilized to realize focusing, zoom function, imaging clearly is true to nature, and have enlarging function, mucosa fine structure can be observed, this endoscope is when low light and image high-speed mobile, still accurately can focus and take video clearly, catch a large amount of light data and selected focus, more flexible during shooting, whether the video blur no matter taken, as long as in the focal range of endoscope, focusing can choose at random after having clapped or in shooting process, because in endoscope is just all recorded in optical information all in focal range when taking pictures, rear focusing can be first taken to video, the any scenery in scene can be allowed all to become shooting focus, have also been enlarged the depth of field simultaneously, also the visual angle of viewing video can be changed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310331566.8A CN103417181B (en) | 2013-08-01 | 2013-08-01 | A kind of endoscopic method for light field video camera |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310331566.8A CN103417181B (en) | 2013-08-01 | 2013-08-01 | A kind of endoscopic method for light field video camera |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103417181A CN103417181A (en) | 2013-12-04 |
| CN103417181B true CN103417181B (en) | 2015-12-09 |
Family
ID=49642965
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310331566.8A Expired - Fee Related CN103417181B (en) | 2013-08-01 | 2013-08-01 | A kind of endoscopic method for light field video camera |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103417181B (en) |
Families Citing this family (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8982177B2 (en) * | 2013-07-08 | 2015-03-17 | Avaya Inc. | System and method for whiteboard collaboration |
| EP3070942B1 (en) | 2015-03-17 | 2023-11-22 | InterDigital CE Patent Holdings | Method and apparatus for displaying light field video data |
| US9781316B2 (en) * | 2015-12-14 | 2017-10-03 | Htc Corporation | Multi-focal length range image capturing device |
| CN105652431B (en) * | 2016-03-30 | 2017-12-29 | 中国科学院合肥物质科学研究院 | The periscopic light channel structure that a kind of radioresistance is combined with radiation proof |
| CN105676451B (en) * | 2016-03-30 | 2017-12-29 | 中国科学院合肥物质科学研究院 | The imaging optical path structure that a kind of radioresistance is combined with radiation proof |
| CN106111356B (en) * | 2016-06-29 | 2019-03-19 | 四川南格尔生物科技有限公司 | A kind of detection device and detection method |
| JP7031118B2 (en) * | 2016-12-09 | 2022-03-08 | ソニーグループ株式会社 | Image processing device and image processing method |
| CN107195245B (en) * | 2017-05-22 | 2020-07-14 | 茆胜 | Micro display and light cone coupling structure and manufacturing method thereof |
| CN109343573A (en) * | 2018-10-31 | 2019-02-15 | 云南兆讯科技有限责任公司 | Power equipment inspection figure image collection processing system based on light field technique for taking |
| US10868945B2 (en) | 2019-04-08 | 2020-12-15 | Omnivision Technologies, Inc. | Light-field camera and method using wafer-level integration process |
| CN110623625A (en) * | 2019-09-24 | 2019-12-31 | 东南大学苏州医疗器械研究院 | Three-dimensional imaging converter for two-dimensional laparoscope |
| CN110623626A (en) * | 2019-09-24 | 2019-12-31 | 东南大学苏州医疗器械研究院 | Two-dimensional-three-dimensional imaging converter for two-dimensional laparoscope |
| TWI718805B (en) | 2019-12-11 | 2021-02-11 | 財團法人工業技術研究院 | Endoscope stereo imaging device |
| CN113784217A (en) * | 2021-09-13 | 2021-12-10 | 天津智融创新科技发展有限公司 | Video playing method, device, equipment and storage medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101065955A (en) * | 2004-10-01 | 2007-10-31 | 利兰·斯坦福青年大学托管委员会 | Imaging arrangements and methods therefor |
| CN102439979A (en) * | 2009-04-22 | 2012-05-02 | 雷特利克斯股份有限公司 | Digital imaging system, plenoptic optical device and image data processing method |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8559705B2 (en) * | 2006-12-01 | 2013-10-15 | Lytro, Inc. | Interactive refocusing of electronic images |
| US8019215B2 (en) * | 2007-08-06 | 2011-09-13 | Adobe Systems Incorporated | Method and apparatus for radiance capture by multiplexing in the frequency domain |
-
2013
- 2013-08-01 CN CN201310331566.8A patent/CN103417181B/en not_active Expired - Fee Related
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101065955A (en) * | 2004-10-01 | 2007-10-31 | 利兰·斯坦福青年大学托管委员会 | Imaging arrangements and methods therefor |
| CN102439979A (en) * | 2009-04-22 | 2012-05-02 | 雷特利克斯股份有限公司 | Digital imaging system, plenoptic optical device and image data processing method |
Non-Patent Citations (2)
| Title |
|---|
| Impinging Flame Characteristics in an Opposed Multiburner Gasifier;Yang Gong等;《Industrial & Engineering Chemistry Research》;20130125;第8卷(第52期);第3007页第2栏第2-3段，第3012段第1栏第4段-第2栏第2段，图5-6 * |
| 先拍照再对焦:相机的3.0革命;陈婧;《IT经理世界》;20130105(第355期);第124页第2栏第2段-第125页第1栏第2段 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103417181A (en) | 2013-12-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103417181B (en) | A kind of endoscopic method for light field video camera | |
| CN101836432B (en) | Imaging device and image recording and playback system | |
| CN104238070B (en) | The binocular viewing device improved | |
| CN104427225B (en) | The control method of picture pick-up device and picture pick-up device | |
| CN108254858A (en) | Optical system and filming apparatus | |
| CN107991838A (en) | Self-adaptation three-dimensional stereo imaging system | |
| WO2016091031A1 (en) | Optical invisible device | |
| CN105245867A (en) | Image pickup apparatus,system and controlling method, and image processing device | |
| CN106338819A (en) | Digital viewing full-view-field AR (augmented reality) multimedia telescope | |
| CN108490593A (en) | Zoom lens and photographic device including the zoom lens | |
| JP5484453B2 (en) | Optical devices with multiple operating modes | |
| Kagawa et al. | A three‐dimensional multifunctional compound‐eye endoscopic system with extended depth of field | |
| CN100458559C (en) | Stereoscopic digital camera and imaging display method | |
| CN206584106U (en) | A kind of video is micro-, photography large visual field optical system | |
| CN110673313B (en) | Zoom fisheye lens system and design method | |
| WO2015173528A1 (en) | Method for displaying, on an augmented reality hmd, the image from a camera and data from other sensors | |
| CN202093234U (en) | Miniature microscope for digital microscopic image collection device | |
| Chen et al. | Real Time Focusing and Directional Light Projection Method for Medical Endoscope Video | |
| JPH01197716A (en) | Enlargement photographing mechanism for electronic endoscope | |
| US20140204233A1 (en) | Monocular telescope capable of capturing and recording images | |
| CN218848452U (en) | Glimmer night vision device | |
| CN106249382B (en) | A kind of video is micro-, large visual field optical system of photographing | |
| CN206440887U (en) | A kind of number is found a view full filed AR multimedia telescopes | |
| RU223158U1 (en) | Wide-angle video camera with mirror lens | |
| RU2242777C2 (en) | Pseudo binocular night goggles |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20151209 Termination date: 20200801 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |