KR101789677B1 - Observing device for telemedicine, Image processing device including the same and System having the same - Google Patents

Abstract

The present invention relates to a telemedicine-enabled image data processing system capable of attaching and detaching a head part and having a focal length controlled by a structure of a head part and a telemedicine processing system including the same, And a main body unit coupled to the head unit and including a light acquisition unit for acquiring light reflected from the inside of the object and generating an optical signal, and a function for receiving the optical signal and generating image data, And the head part can be separated from the main body part.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a telemedicine device,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing apparatus and a system including the same, and more particularly, to an image processing apparatus and a system including the same, And more particularly to an image data processing system capable of performing image processing.

The observer is a device that enables the user to observe the inside of the object by photographing the inside of the object through a tube of the observer inserted into the object. In addition to the use of a rigid or flexible tube inserted into the inside of a building or inside a machine, observation tubes may be used in the form of a needle, a rubber tube, or a plastic tip in the interior of a human or animal. Especially, when the observer is used in the human body, it is possible to examine the inside of the human body (bronchial, esophagus, thoracic cavity, heart, stomach, intestine, abdominal cavity, bladder, anus, nasal cavity, It can be useful for diagnosis of diseases.

Since the tube is inserted into the interior of the object, contamination of the tube or its vicinity is a problem. In particular, when the tube is inserted into the human body in the operating room, a high level of cleanliness is required. However, conventional observation is complicated because of its complicated structure and design.

Therefore, the observation surface needs to have a structure that is easy to clean, sterilize or disinfect. In this connection, Korean Patent No. 0449349 (entitled "Endoscope having an Improved Flexible Insertion Tube", hereinafter referred to as "Prior Art 1") discloses a flexible insertion tube having a flexible insertion tube made of a tubular biocompatible elastic envelope In the endoscope, the insertion tube further includes a vapor barrier between the outer shell and the inner communicator such that the vapor is prevented from entering the inner space through the shell from the ambient atmosphere by the vapor barrier, Wherein the flexible endoscope is configured to react with the material to prevent generation of harmful substances in the elastic skin.

On the other hand, the IT market has changed very rapidly in recent years, and news of new smart devices and smart technology related news are poured in each day. Especially, as the development of sensor technology and wireless communication technology, the healthcare market is rapidly changing, such as the self-management of health by using smart devices or the development of remote monitoring system or telemedicine system. In connection with telemedicine, Korean Patent No. 1512068 (titled "Telemedicine Service System and Method, hereinafter referred to as Prior Art 2") discloses a telemedicine service method in which telemedicine services are provided through a camera of a portable terminal A step of acquiring a medical image for the acquired image, a step for acquiring a patient condition including a plurality of document information having a hierarchical relationship with the acquired image, a step of recognizing a telemedicine service type from the acquired image, The method comprising: generating analysis result data by performing an analysis corresponding to a service type; broadcasting the generated analysis result data through at least one service server coupled through a network by matching the collected patient state; , A result for data broadcast through each of the interworking service servers And displaying the collected information on the portable terminal. The inquiry information may include at least one of a plurality of predetermined questions for each of the service types selected by the user or the recognized remote service type by operating the portable terminal A telemedicine service server communicating with the portable terminal and interworking with a plurality of service servers specialized for a plurality of medical service types, selects one of the data from the result data retrieved through the service server And simultaneously displaying an evaluation history of the corresponding data collected through the interworking service servers on the portable terminal, wherein the evaluation history indicates that the telemedicine service server has satisfied the satisfaction with the data provided for each service server After the telemedicine service is completed or during service Wherein the data collected by the service server is stored and managed in correspondence with the corresponding service server as a history of the collected data collected from the user and the data collected by the service server is managed by the medical service data specialized according to the symptom corresponding to the recognized service type , And the specialized medical service data includes data related to medical service data recommending a pouch product to treat an intestinal tract, nursing care for managing wounds, nutrition, exercise, lifestyle recommendation contents related to cancer, and medical consultation A remote medical service method is disclosed.

Korean Patent No. 0449349 Korea Patent No. 1512068

SUMMARY OF THE INVENTION The present invention has been made in view of the above problems, and it is an object of the present invention to solve the above problems. The third problem that it is difficult to apply to various fields, the prior art 1 is an invention for improving the disinfection and disinfection problem, or a case where an image acquired by an endoscope is confirmed at a place requiring cleanliness such as an operating room, The fifth problem that the image acquired by the endoscope can not be shared by a plurality of people, the sixth problem that the user can not receive any feedback by the prior art 1, and the prior art 2 are different from the prior art 1 Although the user has the advantage of being able to receive telemedicine, the use of the camera of the handheld terminal makes it possible to perform telemedicine To try to solve the problem that Article 7 ceased.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are not intended to limit the invention to the precise form disclosed. There will be.

According to an aspect of the present invention, there is provided a head unit including a light acquiring unit that acquires light reflected from the inside of the object and generates an optical signal, And a main body having a function of receiving the optical signal and generating image data, wherein the head part can be separated from the main body part.

According to an embodiment of the present invention, the head unit may include a function of adjusting a focal length.

According to an embodiment of the present invention, the head unit may include a structure for converting a rotational motion into a linear motion, and the focal length may be adjusted by the structure.

According to an embodiment of the present invention, the main body may include an image sensor that receives the optical signal and generates an image signal.

According to an embodiment of the present invention, the main body further includes an image processor for processing the image signal to generate the image data.

According to an embodiment of the present invention, the head further includes a lens and a plurality of optical fibers, and a tube inserted into the object to transmit the reflected light to the light acquiring unit .

According to an embodiment of the present invention, the lens may be a fish-eye lens or a wide-angle lens.

According to an embodiment of the present invention, the image processor may include an image corrector receiving the image signal and correcting the distorted image.

According to an embodiment of the present invention, the main body may include a display unit for displaying the image data.

According to an embodiment of the present invention, the display unit may be a fixed or detachable display unit.

According to an embodiment of the present invention, the display unit may be a folding display unit.

According to an embodiment of the present invention, the main body may include a communication unit for transmitting the image data to an external device.

According to an embodiment of the present invention, the main body further includes a memory unit storing the image data as a recording file according to a user's recording request.

According to an embodiment of the present invention, the user can download the recording file to a USB flash drive or a memory card connected to the communication unit.

According to an embodiment of the present invention, the main body may include a light source for generating light to be irradiated inside the object.

The present invention also provides an observation light system comprising the observation light and a terminal receiving the image data from the communication unit through wired or wireless communication means.

According to an embodiment of the present invention, the wireless communication means may be an infrared (IR) communication, a radio frequency (RF) communication, a wireless LAN, a Wi-Fi, a WiBro, , Bluetooth, directivity and short range wireless communication (NFC).

According to an embodiment of the present invention, the observation scene and the terminal share the image data through mirroring by the wired or wireless communication means.

According to an embodiment of the present invention, the main body further includes a mounting portion on which the terminal is mounted.

In addition, the present invention provides a method for controlling the mirroring by the first terminal sharing the image data and mirroring by the first terminal and the second communication means through mirroring by the observation light, the observation progressing first communication means And a second terminal sharing the image data through the second terminal.

Further, the present invention provides an observation light system comprising a server for receiving and storing the observation image and the image data from the communication unit.

In addition, according to an embodiment of the present invention, the image forming apparatus may further include a terminal for receiving the image data from the server through wired or wireless communication means.

According to an embodiment of the present invention, a remote doctor analyzes image data transmitted to the server or the terminal, and provides analysis results to a user of the observation terminal.

According to an embodiment of the present invention, the virtual doctor may analyze the image data transmitted to the server or the terminal, and provide analysis results to the user of the observation field.

According to an embodiment of the present invention, the server or the terminal authenticates the identity of the user.

According to an embodiment of the present invention, the server or the terminal authenticates the ID of the observation point.

Further, the present invention provides a method for observing an interior of an object using the observation light, comprising the steps of: generating light to be irradiated inside the object; Receiving light reflected from the inside of the object to generate an optical signal, receiving the optical signal generated by the image sensor to generate an image signal, processing the image signal generated by the image processor unit to generate image data And displaying the generated image data. The present invention also provides a method for observing an inside of an object using the object to be observed.

Further, according to an embodiment of the present invention, the step of processing the image signal generated by the image processor section to generate image data may include the steps of receiving an image signal in which the image correction section has been generated, Generating the correction image, and generating the image data regarding the correction image by the image data generation unit.

Further, according to an embodiment of the present invention, the step of correcting the distorted image by the image correcting unit to generate the corrected image includes the step of performing the geometric correction of the distorted image using the distortion correcting algorithm by the image correcting unit .

According to an embodiment of the present invention, the distortion correction algorithm may further include at least one of a focal length, a principal point, a radial distortion coefficient, and a tangential distortion coefficient And the like.

Further, according to an embodiment of the present invention, the step of correcting the distorted image by the image correcting unit to generate the corrected image may further include, after the step of performing the geometric correction of the distorted image using the distortion correcting algorithm, Further comprising the steps of: extracting vanishing point coordinates from the distorted image; calculating a correction coefficient constituting a projection algorithm from the vanishing point coordinates of the image correcting unit; and generating the corrected image using the image correcting unit projection algorithm, The projection algorithm is characterized by being expressed by Equation (1).

Also, according to an embodiment of the present invention, the correction coefficient may be expressed by Equation (2).

Disclosure of Invention Technical Problem [10] The present invention has a first effect that a head part and a body part can be easily cleaned, sterilized or disinfected because the head part can be attached and detached, a second effect that a user can adjust a focal distance, A fourth effect that the problem of contamination of the display unit can be solved and the convenience can be improved because the image can be confirmed by the terminal connected by the observation and progress wireless communication means, A fifth effect that an image can be shared or recorded in real time in real time, a sixth effect that a user can receive feedback related to the obtained image based on the image acquired by the observation, The seventh effect that telemedicine based on the internal image of the patient can be performed, The eighth effect that the acquired image is stored in the server and is easily accessible to the acquired image, and the eighth effect that the acquired image is stored in the server, It has a tenth effect that it can be applied to data analysis or comparison of treatment prognosis.

It should be understood that the effects of the present invention are not limited to the above effects and include all effects that can be deduced from the detailed description of the present invention or the composition of the invention described in the claims.

1 is a block diagram showing one embodiment of an observation scope of the present invention.
Fig. 2 is a schematic diagram showing a distorted image before applying the projection algorithm; Fig.
3 is a structural view showing an embodiment of an observation light system according to the present invention.
4 is a structural view showing an embodiment of an observation light system according to the present invention.
5 is a structural view showing an embodiment of an observation light system according to the present invention.
6 is a perspective view showing an embodiment of a viewing mirror according to the present invention.
FIG. 7 is a perspective view showing an embodiment of the observation mirror according to the present invention. FIG.
8 is an oblique sectional view showing an embodiment of the observation mirror according to the present invention.
Fig. 9 is a perspective view showing a head part of an observation scope according to the present invention as an embodiment. Fig.
Fig. 10 is a perspective view showing a rocker of the observation scope according to the present invention as an embodiment. Fig.
11 is a perspective view showing a head part of an observation mirror according to the present invention as an embodiment.
12 is a perspective view showing a head part of an observation mirror according to the present invention as an embodiment;

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described with reference to the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

Throughout the specification, when a part is referred to as being "connected" (connected, connected, coupled) with another part, it is not only the case where it is "directly connected" "Is included. Also, when an element is referred to as "comprising ", it means that it can include other elements, not excluding other elements unless specifically stated otherwise.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. The singular expressions include plural expressions unless the context clearly dictates otherwise. In this specification, the terms "comprises" or "having" and the like refer to the presence of stated features, integers, steps, operations, elements, components, or combinations thereof, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

The observation light (1) of the present invention is an apparatus for photographing the interior of an object. The object is irradiated with light, and then light reflected from the inside of the object is acquired to generate image data. Here, the interior of the object may be the body part of the patient, the body part of the animal, the inner wall of the building, the inside of the pipe, or the inside of the pipe, and is not limited thereto. The observation light 1 includes a head portion 10 and a body portion 20. The head portion 10 includes a light acquisition portion 110 and a light emission portion 120 and a tube 180. [ As shown in FIG. The main body unit 20 coupled to the head unit 10 has a function of receiving image signals transmitted from the head unit 10 and generating image data. The image sensor 210, the image processor unit 220, A memory unit 230, a display unit 240, a communication unit 250, and a light source unit 260. Fig. 1 is a block diagram showing an embodiment of the observation light 1, so that not only the configuration of the observation light 1 but also the method of observing the inside of the object using the observation light 1 can be grasped at a glance. Hereinafter, referring to FIG. 1, each component constituting the observation light 1 will be described in detail, and a method of observing the inside of the object using the observation light 1 may be grasped.

The tube 180 is inserted into the interior of the object so that the user can observe the interior of the object by inserting the tube 180 inside the object in observing the interior of the object with the viewing mirror 1. The tube 180 may be of a needle type, a rigid type (e.g., a straight metal tube or an insertion portion of a goniulid), a soft type (e.g., rubber, But is not limited to, the tube 180 of the intermediate type (hard or soft between the rigid type and the soft type) of the hard type and the soft type. The tube 180 includes a lens and a plurality of optical fibers. When the tube 180 is inserted into the object, the light generated by the light source unit 260, which will be described later, (Hereinafter referred to as a light emission line) and the lens, and reaches the inside of the object, and the light reflected from the inside of the object again passes through the lens of the tube 180 and the other of the plurality of optical fibers And is processed in a predetermined manner inside the observation light 1. The lens may be, but is not limited to, a standard lens, a telephoto lens, a microlens, a wide-angle lens, and a fisheye lens.

The light source unit 260 generates light to be irradiated inside the object. The light source unit 260 may include a lamp using a laser emitting diode (LED) or a laser diode (LD) as a light source, but the light source is not limited thereto. The light source unit 260 may further include a color conversion plate formed of glass or a ceramic material to emit a UV-Blue laser beam as white light when a laser diode (Laser Emitting Diode) However, the configuration of the light source unit 260 is not limited to these.

The light emitting unit 120 is coupled to the light source unit 260 and irradiates the light generated by the light source unit 260 to the interior of the object. The light generated by the light source unit 260 is irradiated to the inside of the object through the light emitting line connected to the light emitting unit 120. Specifically, the light generated by the light source unit 260 is transmitted to the light emitting unit 260 coupled to the light source unit 260, and the light emitted from the light source unit 260 is incident on the light source unit 260. That is, The light emitting unit 120, the light emitting unit connected to the light emitting unit 120, the lens, and the object.

The light acquiring unit 110 acquires light reflected from the inside of the object. 1, the light reflected from the inside of the object reaches the head portion 10 simply by arrows. Specifically, the light reflected from the inside of the object passes through the lens, the photographing line, (110). ≪ / RTI > The light acquiring unit 110 acquires light reflected from the inside of the object and generates an optical signal and transmits the optical signal to an image sensor 210 described later.

The tube 180, the light emitting portion 120 and the light obtaining portion 110 which are components of the head portion 10 have been described so far. Of the constituent elements of the main body portion 20, only the light source portion 260 The attachment and detachment of the head unit 10 will be described before the image sensor 210 of the main body unit 20 is explained.

The user uses the observation light 1 in which the head portion 10 and the body portion 20 are combined in observing the inside of the object using the observation light 1, 20). ≪ / RTI > Conventional techniques have conventionally been difficult to separate the head portion 10 from the main body portion 20. This is because the conventional techniques are generally such that the optical fiber (imaging line) of the tube 180 extends to the image processor portion 220 of the main body portion 20. However, in the present invention, the light emitting unit 120 connected to the light emitting line can be coupled to the light source unit 260 or can be separated from the light source unit 260, The head unit 10 including the light emitting line, the light emitting unit 120, the photographing line, and the light obtaining unit 110 includes the main body unit 20 including the light source unit 260 ). ≪ / RTI > The observation light 1 includes a connecting portion 30 connecting the head portion 10 and the main body portion 20 in addition to the head portion 10 and the main body portion 20 and the structure of the connecting portion 30 Thereby enabling the head portion 10 to be separated and engaged. The connecting portion 30 is a simple structure in which the head portion 10 is detached when the head portion 10 is pulled out from the main body portion 20 and the head portion 10 is engaged when the head portion 10 is pushed toward the main body portion 20 The connecting portion 30 can be separated from the main body portion 20 by the separating and coupling of the head portion 10, It is preferable to have a structure in which the head part 10 is fixed when the head part 10 is coupled to the main body part 20. It is also possible to use various structures, Will be described in the following embodiments.

The head portion 10 has a function of adjusting a focal length which means a distance from the lens of the tube 180 to the image sensor 210 of the main body portion 20 do. The user can couple various types of head portions 10 to the body portion 20 and various types of tubes 180 can be coupled to other components of the head portion 10, May be used as a component of the tube 180. Therefore, since the focal length may vary depending on at least one of the shape of the head portion 10, the shape of the tube 180, and the type of the lens, the observation lens 1 needs to have the function of adjusting the focal length have. As described above, when the connecting portion 30 pulls the head portion 10 from the main body portion 20, the head portion 10 is separated. When the head portion 10 is pushed toward the main body portion 20, It is possible to move the head part 10 forward or backward in the process of separating or coupling the head part 10, so that when the head part 10 is pulled forward, the focal length becomes longer, The focal distance can be shortened by pushing the lens 10 backward. Also, irrespective of the structure of the connecting portion 30, the focal length can be adjusted by a predetermined structure equipped with the head portion 10, and this structure can perform a rotational motion, such as a rack and pinion gear, , But the present invention is not limited thereto. One example of the structure for converting the rotational motion into the linear motion will be described in the following embodiments.

The image sensor 210 receives an optical signal from the light acquisition unit 110 as shown in FIG. 1, and generates an image signal that is an electrical signal. The image sensor 210 may be a Complementary Metal Oxide Semiconductor (CMOS) or a Charge Coupled Device (CCD), but is not limited thereto. The image sensor 210 may have pixels corresponding to VGA, SVGA, or SXGA, as needed, but is not limited thereto.

The image processor 220 processes image signals generated by the image sensor 210 as shown in FIG. 1 to generate image data. Specifically, the image processor 220 may include at least one of a signal converter 221, an image corrector 222, and an image data generator 223.

When the image sensor 210 generates an analog image signal, the signal converter 221 converts the analog image signal into a digital image signal. In addition, if necessary, noise can be removed and converted into a digital image signal, or a color coordinate system such as YUV or RGB can be converted.

The image correcting unit 222 receives the image signal from the image sensor 210 or the signal converting unit 221 and then corrects the distorted image to generate a corrected image. Not only can the image correction unit 222 perform normal color correction or gamma correction, but also can perform a geometric correction of the distorted image using the distortion correction algorithm and use the projection algorithm to calculate the perspective effect of the distorted image Can be removed. The order of correction is preferably to remove the perspective effect after performing the geometric correction.

Geometric correction and removal of perspective effects are particularly effective when using fisheye lenses or wide-angle lenses. The fisheye lens and the wide angle lens have a shorter focal length than the standard lens. The fisheye lens allows a wide range of image acquisition with a lens having a field angle of at least 120 degrees, and the wide angle lens has an angle of view of 60 to 120 degrees It is not as good as a fisheye lens, but it also enables wide image acquisition. However, a fisheye lens or a wide-angle lens has a wide angle of view, distorting objects and exaggerating perspective. Therefore, when the inside of a subject is observed using a fisheye lens or a wide-angle lens, the inside of the subject is distorted and a perspective is generated about the periphery of the area of interest, making it difficult to determine the accurate state of the inside of the subject.

Let us first look at geometric correction. The actual lens is incomplete and there is distortion, because it is much easier to make a spherical lens than an ideal mathematically parabolic lens, and it is not easy to align the lens and image sensor 210 perfectly. The distortion of the lens has radial distortion and tangential distortion. Radiation distortion is a distortion caused by the shape of the lens, and generally refers to a phenomenon in which the position of a pixel is convexly distorted in the vicinity of the edge of the image sensor 210. This convexity phenomenon is called "barrel distortion" and may cause fish effect. Tangent distortion occurs during manufacturing of the viewing mirror 1 due to distortion caused by the image sensor 210 and the lens being not parallel. The distortion correction algorithm may be represented by a function that includes at least one of focal length, principal point, radial distortion coefficient, and tangential distortion coefficient, 222 can correct for geometric distortions such as radial distortion and tangential distortion using a distortion correction algorithm. Geometric correction is a well-known theory, and one of ordinary skill in the art would appreciate without further elaboration.

Next, we will look at removing the perspective effect. Fig. 2 shows an embodiment of a distorted image, in which geometric correction has been completed, but a rectangle in which each side is warped due to the perspective effect is shown. The reason why the rectangle image is formed with each of the sides is that when the rectangle is photographed by the camera, the portion near the distance from the camera is large in the rectangle and the portion far from the camera is small and the perspective is generated. (1) Even if the inside of the object is photographed, if an image in which the perspective is applied to the inside of the object is acquired, it is difficult to grasp the exact form of the inside of the object. Therefore, it is necessary to remove the perspective effect of the distorted image. In the first step, the image correction unit 222 extracts the vanishing point coordinates from the distorted image. In FIG. 2, the first vanishing point P1 (X _P1 , Y _P1 ) and the second vanishing point P2 (X _P2 , Y _P2 ) where the straight line AD and the straight line BC meet are extracted. In FIG. 2, the first vanishing point P1 is located on the x-axis and the second vanishing point P2 is located on the y-axis. As a second step, the image correction unit 222 calculates correction coefficients constituting the projection algorithm from the vanishing point coordinates. To do this, a projection matrix [P] is first generated as shown in Equation 3 below.

&Quot; (3) "

(a and b are correction coefficients, and are the same hereinafter).

The projection matrix [P] of Equation (3) is a matrix generated by multiplying the original matrix [A] by the matrix [B], and is a matrix for converting the three-dimensional space image into a two-dimensional plane image. The correction coefficients a and b are parameters necessary to extract the distorted image coordinates (x, y) from the corrected image coordinates (X, Y).

If an arbitrary point on the three-dimensional plane is transformed through the projection matrix [P], the following equation (4) can be obtained.

&Quot; (4) "

In order to express the third and fourth columns of Equation (4) as a basic vector form, the equation (4) can be expressed as Equation (5) by dividing the equation (4) by (ax + by + 1).

&Quot; (5) "

Here, x / (ax + by + 1) and y / (ax + by + 1) can be replaced by X and Y, respectively, as shown in the last line of Equation (5). That is, [X, Y, 0, 1] is a point on a two-dimensional transformed through a projection matrix [P], where an arbitrary point [x, y, z, 1] on a three- Is a basic vector for calculating the correction coefficients a and b. In FIG. 2, since the first vanishing point P1 (X _P1 , Y _P1 ) and the second vanishing point P2 (X _P2 , Y _P2 ) are represented by points on the x and y axes, , 0] and the y-axis unit vector [0, 1, 0, 0] through the projection matrix [P]

&Quot; (6) "

In order to express the third and fourth columns of Equation 6 in the basic vector form, the first row of Equation 6 is divided by a, and the second row is divided by b.

&Quot; (7) "

(Where X _P1 is the x coordinate of the first vanishing point when the first vanishing point is located on the x axis and Y _P2 is the y coordinate of the second vanishing point when the second vanishing point is located on the y axis,

From Equation (7), the following Equation (2) can be obtained.

&Quot; (2) "

Meanwhile, the equation (5) can be summarized as the following equation (8).

&Quot; (8) "

Then, by solving the simultaneous equations of Equation (8), a projection algorithm such as Equation (1) can be generated.

[Equation 1]

(x, y: distorted image coordinates, X, Y: corrected image coordinates, a, b: correction coefficient)

The projection algorithm expressed by Equation (1) can be used by substituting 1 / X _P1 , 1 / Y _P2 calculated in Equation (2) instead of the correction coefficients a and b. The distortion image coordinates (x, y) can be extracted from the corrected image coordinates (X, Y) by using the equation (1), and the pixels of the distorted image can be arranged in the pixels of the corrected image. This is a method of inversely mapping a correction image in advance and assuming a pixel of the corrected image to match with the pixel of the distorted image. In this way, the image correcting unit 222 generates a corrected image by an inverse mapping method using Equation (1). The user can adjust the correction coefficients a and b to cause the image correction unit 222 to generate a new correction image if the perspective effect is not removed as much as the expected correction effect on the generated correction image.

The image data generation unit 223 generates image data with respect to the correction image generated by the image correction unit 222. [ The image data generator 223 scales the corrected image according to the size of the display unit 240 to be described later and generates an image data by scaling the image with an encoder for compressing and encoding the scaled corrected image as necessary It is also possible to compress one image data.

The memory unit 230 is an area in which image data is stored by the image processor unit 220 as shown in FIG. The memory unit 230 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD memory, XD memory, etc.) A random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEROM), a programmable read-only memory (PROM) , A magnetic disk, and an optical disk, but is not limited thereto. Also, if the user wishes to record an image photographed by the observer 1, the image data may be stored as a recording file in the memory unit 230 according to the user's recording request. The distortion correction algorithm or the projection algorithm described above may be stored in the memory unit 230 to refer to the algorithm stored in the memory unit 230 when the image correction unit 222 corrects the distorted image, 222 can store the projection algorithm to which the calculated correction coefficient is applied in the memory unit 230 by calculating the correction coefficient when removing the perspective effect of the distorted image.

The display unit 240 displays the image data generated by the image processor 220 as shown in FIG. The display unit 240 may be a liquid crystal display (LCD), an organic light emitting diode (OLED), an electroluminescent display (ELD), a plasma display panel (PDP) But is not limited to, a display device selected from a field emission display (FED) and an electrophoretic display (EPD). The display unit 240 may be a fixed display unit 240 having a display device fixed to the main body 20 or a removable display unit 240 capable of detaching the display device. In the case of the removable display unit 240, the main body unit 20 may be provided with a mount (not shown) on which the display device is mounted. In addition, the display unit 240 may be a foldable display unit 240 having a cover to cover the screen of the display unit when the cover is folded and a screen of the display unit to be visible when the cover is folded.

The communication unit 250 transmits the image data generated by the image processor 220 to an external device as shown in FIG. 1, thereby enabling remote medical treatment described later. The communication unit 250 may transmit image data to an external device by wire, and may include a USB port or a memory card slot, but the present invention is not limited thereto. In addition, the communication unit 250 may transmit image data to an external device wirelessly. In this case, the communication unit 250 may transmit the image data to the external device through infrared communication, radio frequency (RF) communication, wireless LAN, Wi- But is not limited to, one or more of wireless communication means such as communication (UWB), Bluetooth, directivity and short range wireless communication (NFC). When image data is stored as a recording file according to a user's recording request, the user connects a USB flash drive to a USB port of the communication unit 250 or connects a memory card to a memory card slot of the communication unit 250 The recording file can be downloaded.

The image processor 220 includes a memory unit 230, a display unit 240, and a display unit 240 in a direct memory access (DMA) mode, including a direct memory access (DMA) controller (not shown) The communication unit 250, and the image processor unit 220, respectively.

The observation light system of the present invention comprises an observation light source (1) and a terminal, and Figs. 3 to 5 show an embodiment of an observation light source system. Hereinafter, each component constituting the observation light system will be described in detail with reference to FIGS. 3 to 5. FIG.

As described above, the observation light 1 is an apparatus for generating image data by irradiating light inside the object and then receiving light reflected from the inside of the object, and includes a head portion 10 and a main body portion 20 .

The terminal is a device connected to the observation light 1 through wired or wireless communication means. The wired communication means may be a predetermined cable and the wireless communication means may be an infrared (IR) communication, a radio frequency (RF) communication, a wireless LAN, a Wi-Fi, a WiBro, Bluetooth, head-end, and short-range wireless communication (NFC), but does not preclude other wired or wireless communication means. The terminal may be a wired terminal or a wireless terminal, and Fig. 3 shows a wired terminal and a wireless terminal connected to the observation point 1 through wireless communication means. The wired terminal may be a personal computer (PC) and / or a notebook, and is not limited thereto. The wireless terminal may be a Personal Communication System (PCS), a Global System for Mobile communications (GSM) terminal, a Personal Digital Cellular (PDC), a Personal Handyphone System (PHS) Assistant, PDA), a smart phone, a telematics and a wireless data communication terminal, and a portable Internet terminal. In addition, the glasses worn by a doctor also include a wireless communication module, It is not limited in any way to the wireless terminal, and so on. When the main body 20 of the observation light 1 includes the communication unit 250, the terminal receives image data from the communication unit 250 via wired or wireless communication means. The main body portion 20 of the observation light 1 also includes a stationary portion (not shown) on which the terminal is stationary and is provided with a wired or wireless communication means The image data can be transferred through the network.

The observation light 1 and the terminal can share a plurality of functions through mirroring by the wired or wireless communication means. For example, when the main body 20 of the observation light 1 includes the display unit 240, a screen displayed on the display unit 240 may be output to the terminal through streaming.

Since the terminal may refer to a plurality of terminals in the observation light system, the observation light system may include the observation light 1, the first terminal, and the second terminal. The first terminal and the first terminal can share a plurality of functions through mirroring by the first communication means and the first terminal and the second terminal can perform mirroring by the second communication means A plurality of functions can be shared. For example, when the main body 20 of the observer 1 includes the display unit 240, the screen displayed on the display unit 240 may be output to the first terminal through streaming And a screen output from the first terminal may be output to the second terminal through streaming. The first communication means may be the wired or wireless communication means and the second communication means may be the wired or wireless communication means. The first terminal may be the wired terminal or the wireless terminal, A wired terminal or the wireless terminal. 4 shows a first wireless terminal connected to the observation light 1 through wireless communication means and a second wireless terminal connected to the first wireless terminal through wireless communication means. Mirroring between the first terminal and the second terminal may be accomplished by the second terminal transmitting a request for function sharing to the first terminal and responding by the first terminal receiving the request, . In particular, the first terminal and the second terminal can share more functions than the first terminal and the first terminal, and it is possible to use not only the above screen but also audio, sketch, file, camera, Chat, and so on.

When the terminal is located at a distance from the observer 1 in the observer system, the terminal can acquire the observation light 1 and the WCDMA, HSDPA, CDMA2000, WiBro, WiMax, LTE, LTE-Advanced and Wi- Wi-Fi, etc.), but it does not exclude other wireless communication means. 5 shows a state in which terminals located at a distance from the observation light 1 and the observation light 1 are connected. There may be one or more gateways (e.g., gateways configured on a wired / wireless router, gateways on an Internet provider, etc.) or one or more access points (e.g., wireless repeaters, base stations, etc.) , And there may be one or more repeaters for reproducing the attenuated digital signal when the observer 1 transmits image data in a digital signal.

The observation light system of the present invention may comprise an observation light 1 and a server, and Fig. 5 shows an embodiment of such an observation light system. In this observation light system, the observation light 1 and the server on the wired or wireless network are connected, so that the image data transmitted from the communication unit 250 of the observation light 1 can be stored in the server. The image data stored in the server can be used by a patient, a doctor, or other persons through a predetermined means. In this respect, the observation image system transmits image data from a server other than the observation image 1 and the server through a wired or wireless communication means And a receiving terminal. The terminal may be a wired terminal or a wireless terminal. As shown in FIG. 5, the observation light system may include one or more gateways (for example, a gateway set in a wired / wireless router, a gateway of an Internet provider, etc.) between the observation light 1 and a server connected through the Internet There may be more than one access point (e.g., a wireless repeater, a base station, etc.), and there may be one or more repeaters that reproduce the attenuated digital signal when the observer 1 transmits image data to the digital signal.

Also, in such an observation system, telemedicine can be performed. A remote doctor, who is a doctor located remotely from the observation field 1, analyzes the image data transmitted to the server or terminal and provides the analysis result and / or the related prescription to the user of the observation field 1, The virtual physician, which is an installed image data analyzing program, may analyze the image data transmitted to the server or the terminal and provide the analysis result and / or the related prescription to the user of the observation field (1). In this case, the server or the terminal can authenticate the user ID of the observer (1) so that the analysis result and / or the related prescription can be transmitted to the terminal owned by the observer (1) Authenticate the identity so that the result of the analysis and / or the associated prescription may be communicated to a terminal owned by the observer (1).

Also, in this observation system, when a large amount of image data is accumulated in a server or a terminal, accumulated image data can be used for big data analysis or comparison of treatment outcome, Quot;). ≪ / RTI > In this case, the server or the terminal can authenticate the user ID of the observer (1) so that the result of the big data analysis or the comparison of the treatment outcome can be transmitted to the terminal owned by the observer (1) (1) may allow the user of the observer (1) to transmit the results of the big data analysis or the comparison of the treatment prognosis.

Hereinafter, examples of the observation light 1 of the present invention described above with reference to Fig. 1 will be described in detail. The parts which have not been clarified in the foregoing can be clearly understood through the following examples.

[Example]

<Overall Structure of Observation Light (1)> [

An observation light 1 as shown in Figs. 6 to 8 was produced. The manufactured observation light 1 is in the form of a pistol as a whole, so that the user can connect and grasp the tube 180 and use it. The manufactured observation light 1 can be divided into a head part 10, a main body part 20 and a connecting part 30. The outer shape of the manufactured observation light 1 is shown in Figs. 6 and 7, And the inside of the observation light 1 which has been observed. The observation light 1 having the head unit 10 and the body unit 20 shown in Fig. 6 coupled thereto can separate the head unit 10 and the body unit 20 as shown in Fig. 7 .

The head portion 10 includes the light-receiving portion 110, the light-emitting portion 120, the tube 180, the tube holder 130, the turn slider 150, the fixing portion And a turn guide 140 positioned between the tube holder 130 and the turn slider 150, although not shown in FIGS. 6 to 8. 6 to 8, the tube holder 130 includes the tube holder protrusion 131, the turn guide 140 includes the guide surface 141, and the turn slider 150 includes the turn slider groove 151). The tube holder 130 includes a hole as shown in FIG. 7, and the user inserts the tube 180 into the hole as shown in FIG. 8 to use the observation light 1 . The fixing part 160 is a fixed part without rotating, and the remaining part of the remaining part will be described later.

The main body unit 20 includes the image sensor 210, the image processor unit 220, the light source unit 260, the display unit 240 shown in FIG. 7, the housing unit 270, the handle unit 280 And a memory unit 230 and a communication unit 250 although not shown in FIGS. The housing unit 270 houses the image sensor 210, the image processor unit 220, the memory unit 230, the communication unit 250, and the light source unit 260. The handle portion 280 is a portion gripped by the user, and the remaining portion is described above.

7, the connection unit 30 includes a pin 310 formed at one side of the head unit 10 and a locker 320 formed at one side of the main unit 20. The connection unit 30 includes a head unit 10, And the main body 20 are connected to each other. 6 to 8, the locker 320 includes a locker groove 321, a locker outer wall 322, and a locker inner wall 323.

&Lt; Dismounting of the head part 10 >

The attachment and detachment of the head portion 10 shown in Figs. 6 and 7 is possible by a structure in which the pin 310 of the connection portion 30 and the locker 320 are separated or engaged. 9 and 10 show the structure of the connecting portion 30 in detail, and a portion unnecessary for the explanation of the detachment of the head portion 10 is not shown. The user can insert the pin 310 into the locker groove 321 and rotate the locker 320 clockwise or counterclockwise to engage the head portion 10 and the body portion 20. [ 9, when the user inserts the pin 310 into the locker groove 321, the fixing member groove 170 is engaged with the locker outer wall 322. In this state, when the user still moves the head part 10 forward and backward So that the head portion 10 can be separated from the main body portion 20. When the user rotates the locker 320 clockwise or counterclockwise in this state, the pin 310 inserted into the locker groove 321 is blocked by the locker inner wall 323 shown in FIG. 10, The main body 20 can not be separated from the main body 20. In this state, the user rotates the locker 320 clockwise or counterclockwise to align the locker groove 321 and the pin 310, and by pulling the head portion 10 forward, (20).

<Focal length adjustment>

The focal length can be adjusted by a structure for converting the rotational motion of the head portion 10 into a linear motion. The structure of the head portion 10 is shown in detail in FIGS. 11 and 12, Are not shown. 11 and 12, the head portion 10 includes a tube holder 130 having a narrow tip and a wide rear end, including a tube holder projection 131, and a guide surface 141, and the tube holder 130 And a turn slider 150 including a turn slider groove 151 engaging with the tube holder protrusion 131 and surrounding a part of the turn guide 140, It is equipped. When the user rotates the turn slider 150 in the counterclockwise direction, the tube holder 130 rotates counterclockwise and moves backward while the turn slider groove 151 applies a force to the tube holder protrusion 131 The tube holder projection 131 moves along the guide surface 141), the focal length becomes shorter. On the contrary, when the user rotates the turn slider 150 in the clockwise direction, the tube holder 130 rotates clockwise as the turn slider groove 151 applies force to the tube holder protrusion 131 The tube holder projection 131 moves along the guide surface 141), the focal length becomes longer. Here, the turn guide 140 and the fixing portion 160 not shown in Figs. 11 and 12 do not move. That is, the rotational movement of the turn slider 150 is converted into the linear motion of the tube holder 130, and the focal distance is adjusted.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it should be understood that various changes and modifications will be apparent to those skilled in the art. Obviously, the invention is not limited to the embodiments described above. Accordingly, the scope of protection of the present invention should be construed according to the following claims, and all technical ideas which fall within the scope of equivalence by alteration, substitution, substitution, and the like within the scope of the present invention, Range. In addition, it should be clarified that some configurations of the drawings are intended to explain the configuration more clearly and are provided in an exaggerated or reduced size than the actual configuration.

1: Observation light
10:
110:
120: light emitting portion
130: tube holder
131: projection of the tube holder
140: Turn guide
141: guide surface
150: turn slider
151: Turn slider groove
160:
170: Higher government home
180: tube
20:
210: Image sensor
220: image processor unit
221: Signal conversion section
222: image correction unit
223: Image data generation unit
230: memory unit
240:
250:
260: Light source
270:
280: Handle portion
30: Connection
310: pin
320: Rocker
321: Locker home
322: Locker outer wall
323: Locker inner wall

Claims (32)

In the observation light (1) for photographing the inside of the object,
A head part (10) including a light acquisition part (110) for acquiring light reflected from the inside of the object and generating an optical signal; And
An image sensor 210 coupled to the head unit 10 and configured to receive an optical signal from the light acquisition unit 110 to generate an image signal and an image sensor 210 to process the image signal generated by the image sensor 210, A main body unit 20 including an image processor unit 220 for generating an image;
, &Lt; / RTI &gt;
The head portion 10 may be detached from the main body portion 20,
The image processor 220 may further include an image corrector 222 to perform geometric correction of a distorted image using a distortion correction algorithm after receiving an image signal from the image sensor 210 Observations.
The method according to claim 1,
Characterized in that the head part (10) has a function of adjusting a focal length.
The method of claim 2,
Characterized in that the head part (10) has a structure for converting a rotational motion into a linear motion, and the focal length is adjusted by the structure.
delete delete The method according to claim 1,
The head portion (10)
Further comprising a lens (180) including a lens and a plurality of optical fibers, the tube (180) being inserted into the object and transmitting the reflected light to the light acquiring unit (110).
The method of claim 6,
Wherein the lens is a fish-eye lens or a wide-angle lens.
delete The method according to claim 1,
The main body part (20)
And a display unit (240) for displaying the image data.
The method of claim 9,
Wherein the display unit (240) is a fixed or detachable display unit (240).
The method of claim 9,
Wherein the display unit (240) is a foldable display unit (240).
The method according to claim 1,
The main body part (20)
And a communication unit (250) for transmitting the image data to an external device.
The method of claim 12,
The main body part (20)
Further comprising a memory unit (230) storing the image data as a recording file according to a user's recording request.
14. The method of claim 13,
The user can download the recording file to a USB flash drive or a memory card connected to the communication unit 250. [
The method according to claim 1,
The main body part (20)
And a light source unit (260) for generating light to be irradiated inside the object.
The observation light (1) of claim 12; And
A terminal for receiving the image data from the communication unit 250 through wired or wireless communication means;
And a second light source.
18. The method of claim 16,
The wireless communication means may be an infrared (IR) communication, a radio frequency (RF) communication, a wireless LAN, a Wi-Fi, a WiBro, an ultra wideband (UWB), a Bluetooth, Or more. &Lt; / RTI &gt;
18. The method of claim 16,
Wherein the observation light (1) and the terminal share the image data through mirroring by the wired or wireless communication means.
18. The method of claim 16,
The main body part (20)
Further comprising a mounting portion on which the terminal is mounted.
(1) of claim 1;
A first terminal sharing the image data through the observation light (1) and mirroring by a first communication means; And
A second terminal sharing the image data through mirroring by the first terminal and the second communication means;
And a second light source.
The observation light (1) of claim 12; And
A server for receiving and storing the image data from the communication unit 250;
And a second light source.
23. The method of claim 21,
A terminal for receiving the image data from the server through wired or wireless communication means;
Further comprising: a light source;
23. The method of claim 22,
Wherein the remote doctor analyzes the image data transmitted to the server or the terminal and provides the analysis result to the user of the observer (1).
23. The method of claim 22,
Wherein the virtual doctor analyzes the image data transmitted to the server or the terminal and provides the analysis result to the user of the observation light (1).
The method of claim 23 or 24,
Wherein the server or the terminal authenticates the identity of the user.
The method of claim 23 or 24,
Wherein the server or the terminal authenticates the identity of the observer (1).
A method for observing the inside of an object using the object (1) of claim 1,
(I) generating light to be irradiated inside the object;
(II) irradiating light generated in the step (I) inside the object;
(III) obtaining the light reflected from the inside of the object by the light acquisition unit 110 to generate the optical signal;
(IV) receiving the optical signal generated in the step (III) by the image sensor 210 to generate an image signal;
(V) the image processor 220 processes the image signal generated in the step (IV) to generate the image data; And
(VI) displaying the image data generated in the step (V);
And observing the inside of the object using the observation object.
28. The method of claim 27,
The step (V)
(V-1) image correcting unit 222 receiving the image signal;
(V-2) the image correcting unit 222 corrects the distorted image to generate a corrected image; And
(V-3) generating image data related to the corrected image by the image data generating unit 223;
And observing the interior of the object using the observation object.
29. The method of claim 28,
The step (V-2)
(V-2-1) The image correcting unit 222 performs a geometric correction of a distorted image using a distortion correction algorithm;
And observing the inside of the object using the observation object.
29. The method of claim 29,
Wherein the distortion correction algorithm includes at least one of a focal length, a principal point, a radial distortion coefficient, and a tangential distortion coefficient. How to observe the interior of the object.
29. The method of claim 29,
In the step (V-2), after the step (V-2-1)
(V-2-2) extracting vanishing point coordinates from the distorted image by the image correcting unit 222;
(V-2-3) calculating the correction coefficient constituting the projection algorithm from the vanishing point coordinates by the image correction unit 222; And
(V-2-4) The image correction unit 222 generates a correction image using the projection algorithm;
Further comprising:
Wherein the projection algorithm is expressed by the following equation (1): &quot; (1) &quot;
[Equation 1]

(x, y: distorted image coordinates, X, Y: corrected image coordinates, a, b: correction coefficient)
32. The method of claim 31,
Wherein the correction coefficient is expressed by the following equation (2): &quot; (2) &quot;
&Quot; (2) &quot;

(X _P1 : x coordinate of the first vanishing point when the first vanishing point is located on the x axis, Y _P2 : y coordinate of the second vanishing point when the second vanishing point is positioned on the y axis)

Images