WO2017176021A1 - Observation scope for remote medical examination, and image processing device and sysyem comprising same - Google Patents

Abstract

The present invention relates to: an observation scope, which has a detachable head part and a focal length to be adjusted by the structure of the head part; and a remote medical examination-enabled image data processing system comprising the same, and provides the observation scope for photographing the inside of an object, the observation scope comprising: the head part including a light acquisition unit for generating an optical signal by acquiring light reflected from the inside of the object; and a main body part coupled to the head part and having a function of receiving the optical signal so as to generate image data, wherein the head part can be separated from the main body part.

Description

Observation mirror for telemedicine and image processing device and system including same

The present invention relates to an observation mirror for remote medical care and an image processing apparatus and system including the same, and more particularly, to a detachable head part and a telescope for including a viewing mirror whose focal length is adjusted by the structure of the head part. Relates to a possible image data processing system.

The observation mirror is a device that allows the user to observe the inside of the object by photographing the inside of the object through a tube of the observation mirror inserted into the inside of the object. Observation mirrors may be used by inserting a rigid or ductile tube into the interior wall of a building or a mechanical device, as well as by inserting a needle, rubber or plastic tip tube into a human or animal. In particular, when the sight glasses are used in the human body, the inside of the human body (bronchi, esophagus, chest cavity, heart, stomach, intestine, abdominal cavity, bladder, anus, nasal cavity, eardrum, etc.) can be examined without laparotomy or incision. It can be useful for the diagnosis of diseases.

Observation mirrors cause contamination of the tube and its vicinity because the tube is inserted inside the object. In particular, when the tube is inserted into the inside of the human body in the operating room, a high level of cleanliness is required. However, conventional observation glasses are very difficult to sterilize or disinfect because of their complicated structure and design.

Therefore, the observation mirror needs to have a structure that is easy to clean, sterilize or disinfect. In this regard, the Republic of Korea Patent No. 0449349 (name of the invention: an endoscope having an improved flexible insertion tube, hereinafter referred to as the prior art 1) is a flexible insertion tube consisting of a tubular biocompatible elastic shell surrounding the inner space. In an endoscope, the insertion tube further comprises a vapor barrier between the shell and the internal communicator, whereby the vapor barrier prevents the ingress of steam from the ambient air through the shell and into the interior space, and also the vapor in the interior space. A flexible endoscope with a flexible insertion tube is disclosed that prevents reacting with the material to produce a material that is harmful to the elastic sheath.

In the meantime, the IT market is changing rapidly, and news is pouring news of new smart devices and news about smart technology every day. In particular, with the development of sensor technology and wireless communication technology, the healthcare market is rapidly changing, such as the user's own health management using smart devices or the development of a remote monitoring system or a remote medical system. In relation to telemedicine, Republic of Korea Patent No. 1512068 (name of the invention: a telemedicine service system and method, hereinafter referred to as prior art 2) in the telemedicine service method, through the camera of the portable terminal to the remote care service target Acquiring an image of the patient, acquiring a patient state including a plurality of questionnaire information having a hierarchical relationship to the acquired image, recognizing a telemedicine service type from the acquired image, Performing analysis corresponding to a service type to generate analysis result data; matching the collected patient state to the generated analysis result data and broadcasting it through at least one service server linked through a network; , The result of the data broadcast through the linked service server Searching for and collecting the same and displaying the collected information on the portable terminal, wherein the questionnaire information includes a plurality of preset questions for each medical service type selected by the user or the recognized remote medical service type by operating the portable terminal. A remote medical service server including an answer inputted in response to the mobile terminal and communicating with the portable terminal and interworking with a plurality of service servers specialized for a plurality of medical service types, if any one data is selected from the result data retrieved through the service server. And simultaneously displaying, on the portable terminal, an evaluation history of the corresponding data collected through each of the linked service servers, and the evaluation history includes a satisfaction level of data provided by each teleservice service server for each service server. After completing telemedicine service or during service The data quality collected and collected by the user is mapped and stored and managed corresponding to the corresponding service server, and the collected data for each service server is specialized medical service data according to symptoms corresponding to the recognized service type. The specialized medical service data includes medical service data recommending a pouch product to treat the stoma, nursing care for wounds and nutrition, exercise, lifestyle recommendations, and medical counseling related to cancer. A telemedicine service method is disclosed.

The technical problem to be achieved by the present invention is the first problem that the prior art 1 has a limit on the degree of sterilization and disinfection, the second problem that the prior art 1 can not adjust the focal length, the prior art 1 using only a flexible tube The third problem that it is difficult to apply to various fields, the prior art 1 is a fourth invention that there is still a problem of contamination of the endoscope when the invention to improve the sterilization and disinfection problem or when confirming the image obtained by the endoscope in a place requiring cleanness such as an operating room Problem, prior art 1 has a fifth problem that several people can not share the image obtained by the endoscope, sixth problem that the user can not receive any feedback by the prior art 1 and prior art 2 is different from the prior art 1 Although the user has the advantage of receiving remote medical treatment, the remote medical treatment for the wounded part using the camera of the portable terminal To try to solve the problem that Article 7 ceased.

The technical problem to be achieved by the present invention is not limited to the technical problem mentioned above, and other technical problems not mentioned above may be clearly understood by those skilled in the art from the following description. There will be.

In order to solve the above problems, the present invention, in the observation mirror for photographing the interior of the object, the head portion and the head portion including a light acquisition unit for obtaining the light reflected from the interior of the object to generate an optical signal And a main body having a function of receiving an optical signal and generating image data, wherein the head portion is detachable from the main body.

In addition, according to an embodiment of the present invention, the head portion may be characterized by having a function of adjusting the focal length.

In addition, according to an embodiment of the present invention, the head portion may have a structure for converting a rotational motion into a linear motion, and the focal length may be adjusted by the structure.

In addition, according to an embodiment of the present invention, the main body may include an image sensor for receiving the optical signal to generate an image signal.

In addition, according to an embodiment of the present invention, the main body may further include an image processor for processing the image signal to generate the image data.

In addition, according to an embodiment of the present invention, the head portion comprises a lens and a plurality of optical fibers, and further comprising a tube which is inserted into the inside of the object to transfer the reflected light to the light acquisition unit Can be.

In addition, according to an embodiment of the present invention, the lens may be characterized in that the fisheye lens or a wide-angle lens.

In addition, according to an embodiment of the present invention, the image processor may be characterized in that it comprises an image correction unit for receiving the image signal to correct the distortion image.

In addition, according to an embodiment of the present invention, the main body may include a display unit for displaying the image data.

In addition, according to an embodiment of the present invention, the display unit may be a fixed or removable display unit.

In addition, according to an embodiment of the present invention, the display unit may be a foldable display unit.

In addition, according to an embodiment of the present invention, the main body may include a communication unit for transmitting the image data to an external device.

In addition, according to an embodiment of the present invention, the main body may further include a memory unit in which the image data is stored as a recording file according to a recording request of a user.

In addition, according to an embodiment of the present invention, the user may download the recorded file to a USB flash drive or a memory card connected to the communication unit.

In addition, according to an embodiment of the present invention, the body portion may be characterized in that it comprises a light source for generating light to be irradiated to the inside of the object.

The present invention also provides an observation mirror system comprising a terminal receiving the image data from the observation mirror and the communication unit through a wired or wireless communication means.

In addition, according to an embodiment of the present invention, the wireless communication means is infrared (IR) communication, radio frequency (RF) communication, wireless LAN, Wi-Fi (Wi-Fi), WiBro (UWB), ultra-wideband communication (UWB) It may be characterized in that one or more of, Bluetooth, direct wireless and Near Field Communication (NFC).

In addition, according to an embodiment of the present invention, the observation mirror and the terminal may be characterized in that sharing the image data through the mirroring (mirroring) by the wired or wireless communication means.

In addition, according to an embodiment of the present invention, the main body may further include a mounting portion on which the terminal is mounted.

The present invention also provides a first terminal for sharing the image data through mirroring by the observation mirror, the observation mirror and the first communication means, and mirroring by the first terminal and the second communication means. It provides a observation system comprising a second terminal for sharing the image data through.

In addition, the present invention provides an observation mirror system comprising a server for receiving and storing the image data from the observation mirror and the communication unit.

In addition, according to an embodiment of the present invention, it may be characterized in that it further comprises a terminal for receiving the image data from the server through a wired or wireless communication means.

In addition, according to an embodiment of the present invention, the remote doctor may be characterized by analyzing the image data transmitted to the server or the terminal to provide an analysis result to the user of the observation mirror.

According to an embodiment of the present invention, the virtual doctor may analyze the image data transmitted to the server or the terminal and provide the analysis result to the user of the observation mirror.

In addition, according to an embodiment of the present invention, the server or the terminal may be characterized in that the authentication of the user ID.

In addition, according to an embodiment of the present invention, the server or the terminal may be characterized in that to authenticate the ID of the observation mirror.

In addition, the present invention is a method for observing the interior of the object using the observation mirror, the step of generating light to be irradiated to the inside of the object, the step of irradiating the generated light inside the object, the light acquisition unit Acquiring the light reflected from the inside of the object to generate an optical signal, receiving an optical signal generated by the image sensor, generating an image signal, and processing the generated image signal by the image processor to generate image data And a display unit provides a method for observing the inside of the object using an observation mirror, characterized in that comprises the step of displaying the generated image data.

According to an embodiment of the present invention, the generating of the image data by processing the generated image signal by the image processor unit includes: receiving the generated image signal by the image correction unit, and correcting the distortion image by the image correction unit It may be characterized in that it comprises a step of generating a correction image and the image data generation unit for generating the image data related to the correction image.

According to an embodiment of the present invention, the step of generating the corrected image by correcting the distorted image by the image compensating includes performing a geometrical correction of the distorted image by using the distortion correcting algorithm. It can be characterized.

In addition, according to an embodiment of the present invention, the distortion correction algorithm is one or more of the focal length (prical length), the principal point (principal point), the radial distortion coefficient (radial distortion coefficient) and the tangential distortion coefficient (tangential distortion coefficient) It may be characterized by including.

According to an embodiment of the present invention, the step of generating the corrected image by correcting the distorted image by the image correction unit, after performing the geometric correction of the distorted image using the distortion correction algorithm, Extracting the vanishing point coordinates from the distorted image by the image correction unit, calculating the correction coefficients constituting the projection algorithm from the vanishing point coordinates, and generating the corrected image by the image correction unit using the projection algorithm, The projection algorithm may be represented by Equation 1.

In addition, according to an embodiment of the present invention, the correction coefficient may be represented by Equation 2.

The present invention is the first effect that the detachable head portion is easy to clean, sterilize or disinfect the head portion or the body portion, the second effect that the user can adjust the focal length to obtain the image quality desired by the user, various forms The third effect that can be applied to various fields using the tube of the, the image can be confirmed by the terminal connected by the observation mirror and the wireless communication means, so the problem of contamination of the display part is solved and the fourth effect that the convenience is improved The fifth effect of sharing or recording an image in real time and obtaining it in the future, based on the image obtained by the observation mirror, the user may receive feedback related to the sixth effect, in particular with respect to the sixth effect and / or the user and / or The seventh effect that telemedicine is possible based on the image of the inside of the patient's body, the image obtained by the observation mirror Eighth effect that can be confirmed remotely, the ninth effect that the image obtained by the observation mirror is stored on the server and easy access to the acquired image, and the accumulated image data when the image obtained by the observation mirror is accumulated on the server It has a tenth effect that it can be applied to data analysis or treatment prognosis.

According to the embodiments of the present invention, the effects of the present invention are not limited to the above-described effects, but should be understood to include all the effects deduced from the configuration of the invention described in the detailed description or claims of the present invention.

1 is a block diagram showing an embodiment of the inventor's observation mirror.

2 is a schematic diagram showing a distortion image before applying a projection algorithm.

Figure 3 is a structural diagram showing an embodiment of the present observation system.

Figure 4 is a structural diagram showing one embodiment of the present observation system.

Figure 5 is a structural diagram showing an embodiment of the present observation system.

6 is a perspective view showing an embodiment of the inventor's observation mirror.

7 is a perspective view showing an embodiment of the inventor's observation mirror.

8 is a perspective cross-sectional view showing an embodiment of the inventor's observation mirror.

Fig. 9 is a perspective view showing the head portion of the observation mirror according to the present invention as an example.

10 is a perspective view showing a locker of the observation mirror according to the present invention as an example.

Fig. 11 is a perspective view showing the head portion of the observation mirror according to the present invention as an example.

12 is a perspective view showing a head portion of the observation mirror according to the present invention as an example.

The best mode of the embodiment of the observation mirror of the present invention includes a head portion and a head portion including an optical acquisition portion for acquiring light reflected from the interior of the object and generating an optical signal in the observation mirror for photographing the interior of the object. And a main body having a function of receiving an optical signal and generating image data, wherein the head can be separated from the main body.

Hereinafter, with reference to the accompanying drawings will be described the present invention. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and like reference numerals designate like parts throughout the specification.

Throughout the specification, when a part is said to be "connected (connected, contacted, coupled)" with another part, it is not only "directly connected" but also "indirectly connected" with another member in between. "Includes the case. In addition, when a part is said to "include" a certain component, this means that it may further include other components, without excluding the other components unless otherwise stated.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. As used herein, the terms "comprise" or "have" are intended to indicate that there is a feature, number, step, action, component, part, or combination thereof described on the specification, and one or more other features. It is to be understood that the present invention does not exclude the possibility of the presence or the addition of numbers, steps, operations, components, components, or a combination thereof.

The observation mirror 1 of the present invention is an apparatus for photographing the inside of an object, and irradiates light into the inside of the object, and then acquires light reflected from the inside of the object to generate image data. Here, the interior of the subject may be a body part of a patient, a body part of an animal, an inner wall of a building, an inside of a pipe, or an inside of a vehicle, but the present invention is not limited thereto. Observation mirror 1 comprises a head portion 10 and the body portion 20, the head portion 10 includes a light acquisition portion 110, the light emitting portion 120 or tube 180 It may further include. The main body 20 coupled to the head portion 10 has a function of receiving an optical signal transmitted from the head portion 10 and generating image data, and includes an image sensor 210 and an image processor 220. , One or more of a memory unit 230, a display unit 240, a communication unit 250, and a light source unit 260. FIG. 1 shows an embodiment of the observation mirror 1 in a block diagram, so that not only the configuration of the observation mirror 1 but also a method of observing the inside of the object using the observation mirror 1 can be grasped at a glance. Hereinafter, referring to FIG. 1, each component of the observation mirror 1 will be described in detail, and through this, a method of observing the inside of the object using the observation mirror 1 will also be understood.

The tube 180 is inserted into the inside of the object, and the user may observe the image of the inside of the object by inserting the tube 180 into the inside of the object in observing the inside of the object with the observation mirror 1. Tube 180 is a needle type that can be inserted into the skin of the target, a rigid type (for example, a straight metal tube or an insertion portion of the otoscope), a soft type (for example, made of rubber and freely Bend) or an intermediate type of rigid type and flexible type (hard or soft intermediate between the hard type and flexible type), but is not limited thereto. The tube 180 includes a lens and a plurality of optical fibers, and when the tube 180 is inserted into the inside of the object, the light generated by the light source unit 260, which will be described later, is a part of the plurality of optical fibers of the tube 180 (hereinafter, The light that passes through the lens and reaches the inside of the object, and the light reflected from the inside of the object is again the lens of the tube 180 and the plurality of optical fibers (hereinafter, referred to as a photographing line). Is processed in a predetermined manner inside the observation mirror (1). The lens may be one or more of a standard lens, a telephoto lens, a micro lens, a wide angle lens, and a fisheye lens, but is not limited thereto.

The light source unit 260 generates light to be irradiated inside the object. The light source unit 260 may include a lamp using a laser emitting diode (LED) or a laser diode (LD) as a light source, but the light source is not limited thereto. In addition, the light source unit 260 further includes a color conversion plate made of glass or ceramic material when the laser emitting diode (LED) lamp emits a UV-Blue band laser to convert the UV-Blue band laser into white light. It is possible to convert, but the configuration of the light source unit 260 is not limited to these.

The light emitting unit 120 is coupled to the light source unit 260 to irradiate the light generated by the light source unit 260 to the inside of the object. The light generated by the light source unit 260 is irradiated to the inside of the object through a light emitting line connected to the light emitter 120. That is, although FIG. 1 simply shows an arrow that light generated by the light source unit 260 is irradiated to the inside of the object, specifically, light generated by the light source unit 260 is a light emitting unit coupled to the light source unit 260. 120, the light emitting line connected to the light emitting unit 120, the lens, and may be sequentially delivered to the inside of the object.

The light acquisition unit 110 acquires the light reflected from the inside of the object. FIG. 1 shows an arrow indicating that the light reflected from the inside of the object reaches the head portion 10. Specifically, the light reflected from the inside of the object is a light acquisition unit connected to a lens, a shooting line, and a shooting line. Can be delivered sequentially to (110). The light acquisition unit 110 that acquires light reflected from the inside of the object generates an optical signal and transmits the light signal to the image sensor 210 which will be described later.

The tube 180, the light emitting unit 120, and the light acquisition unit 110, which are components of the head unit 10, have been described so far, and only the light source unit 260 is described among the components of the main body 20. However, before describing the image sensor 210 of the main body 20, the detachment of the head 10 will be described.

When the user observes the inside of the object by using the observation mirror 1, the user uses the observation mirror 1 in which the head portion 10 and the main body portion 20 are combined, but the head portion 10 is the main body portion ( 20). Prior arts typically did not facilitate separating the head portion 10 from the body portion 20. This is because in the conventional arts, the optical fiber (photography line) of the tube 180 extends to the image processor 220 of the main body 20. However, in the present invention, the light emitting unit 120 connected to the light emitting line may be coupled to the light source unit 260 or separated from the light source unit 260, and the light acquisition unit 110 connected to the photographing line may be an image sensor 210 or an image. Since the head unit 10 is spaced apart from the processor 220, the head unit 10 including the light emitting line, the light emitting unit 120, the photographing line, and the light acquisition unit 110 may include a main body unit 20 including the light source unit 260. Can be separated from). Secondly, the observation mirror 1 includes a connection part 30 for connecting the head part 10 and the main body part 20 in addition to the head part 10 and the main body part 20, and has a structure of the connecting part 30. Enables the detachment and coupling of the head portion 10. The connection part 30 has a simple structure in which the head part 10 is separated by pulling the head part 10 from the main body part 20, and the head part 10 is coupled by pushing the head part 10 toward the main body part 20. Although this may have a structure, since the head part 10 may be separated from the main body part 20 while the user uses the observation mirror 1, the connection part 30 may be separated and coupled to the head part 10. Although it is possible to have a structure in which the head portion 10 is fixed when the head portion 10 is coupled to the main body portion 20, such a structure may be various, one example of which will be described later. It will be described in the embodiment.

Head portion 10 has a function of adjusting the focal length (focal length), the focal length (focal length) means the distance from the lens of the tube 180 to the image sensor 210 of the body portion 20. do. The user may combine various types of head portions 10 to the main body portion 20, various types of tubes 180 may be coupled to other components of the head portion 10, and various types Can be used as a component of the tube 180. Therefore, since the focal length may vary depending on one or more factors among the shape of the head portion 10, the shape of the tube 180, and the type of lens, the observation mirror 1 needs to have a function of adjusting the focal length. have. As described above, when the connecting portion 30 pulls the head portion 10 from the main body portion 20, the head portion 10 is separated and the head portion 10 is pushed toward the main body portion 20. In the case of having a simple structure that is coupled, since the head portion 10 can be moved forward and backward in the process of separating or combining the head portion 10, when the head portion 10 is pulled forward, the focal length becomes long, and the head portion Pushing back (10) may shorten the focal length. In addition, regardless of the structure of the connection portion 30, the focal length can be adjusted by a predetermined structure provided with the head portion 10, this structure is a linear motion of the rotational motion, such as rack and pinion gear It may be a structure for converting to, but is not limited thereto. One example of a structure for converting a rotational motion into a linear motion will be described in the following embodiments.

As shown in FIG. 1, the image sensor 210 receives an optical signal from the light acquisition unit 110 and generates an image signal which is an electrical signal. The image sensor 210 may be a complementary metal oxide semiconductor (CMOS) or a charge coupled device (CCD), but is not limited thereto. The image sensor 210 may have pixels corresponding to VGA, SVGA, or SXGA as necessary, but is not limited thereto.

The image processor 220 generates image data by processing the image signal generated by the image sensor 210 as shown in FIG. 1. In detail, the image processor 220 may include at least one of a signal converter 221, an image compensator 222, and an image data generator 223.

The signal converter 221 converts the analog image signal into a digital image signal when the image sensor 210 generates an analog image signal. In addition, after removing noise, a digital image signal may be converted, and color coordinate systems such as YUV and RGB may be converted.

The image compensator 222 receives an image signal from the image sensor 210 or the signal converter 221 and then corrects the distortion image to generate a corrected image. The image correction unit 222 may not only perform normal color correction or gamma correction, but also perform geometric correction of the distorted image using the distortion correction algorithm, and use the projection algorithm to correct the perspective effect of the distorted image. Can be removed The order of correction is preferably to remove the perspective effect after performing the geometric correction.

Geometric correction and perspective removal are particularly effective correction methods when using fisheye or wide-angle lenses. Fish-eye and wide-angle lenses have shorter focal lengths than standard lenses. Fish-eye lenses have a lens angle of at least 120 degrees, enabling wide-area images. Wide-angle lenses have a 60 to 120 degree angle of view. The lens is not as good as the fisheye lens, but it also enables wider image acquisition. However, fisheye lenses and wide-angle lenses have wide angles of view, distorting objects and exaggerating perspective. Therefore, when observing the inside of the object using a fisheye lens or a wide-angle lens, the inside of the object is distorted, a perspective occurs to the periphery of the region of interest, and it is difficult to determine the exact state of the inside of the object.

First, the geometric correction is discussed. The actual lens cannot be perfect and there is distortion, because it is much easier to make a spherical lens than a mathematically ideal parabolic lens, and it is not easy to perfectly align the lens with the image sensor 210. There are largely radial distortion and tangential distortion of the lens. Radiation distortion is a distortion caused by the shape of the lens generally refers to a phenomenon in which the position of the pixel is convexly distorted near the edge of the image sensor 210. These convex phenomena are also called 'keg distortion' and can also cause fisheye effects. Tangential distortion is a distortion that occurs because the image sensor 210 and the lens are not parallel to each other occurs in the manufacturing process of the observation mirror (1). The distortion correction algorithm can be represented by a function including one or more of focal length, principal point, radial distortion coefficient, and tangential distortion coefficient, 222 may correct geometric distortions such as radial distortion or tangential distortion using a distortion correction algorithm. Geometric correction is a well known theory and will be understood by those skilled in the art of image processing without further detailed description.

Next, we will look at removing perspective effects. Figure 2 shows an embodiment of the distortion image, but the geometric correction is completed, but each side due to the perspective effect shows a curved rectangle. This is because a rectangular image with each side bent is created when a rectangle is photographed with a camera, because a part near the camera is larger in the rectangle and a part farther from the camera appears in a small distance, creating a perspective. (1) Even when photographing the interior of the object, it is difficult to grasp the exact shape of the interior of the object if the image with the perspective applied to the interior of the object is acquired. Therefore, it is necessary to remove the perspective effect of the distorted image. As a first step, the image compensator 222 extracts vanishing point coordinates from the distorted image. In FIG. 2, the first vanishing point P1 (X _P1 , Y _P1 ) where the straight line AB extends to meet and the second vanishing point P2 (X _P2 , Y _P2 ) where the straight line AD extends from the straight line BC are extracted. In FIG. 2, it is assumed that the first vanishing point P1 is located on the x axis, and the second vanishing point P2 is located on the y axis. In the second step, the image correction unit 222 calculates a correction coefficient constituting the projection algorithm from the vanishing point coordinates. To this end, first, a projection matrix [P] is generated as in Equation 3 below.

[Equation 3]

(a and b are correction coefficients and are as follows.)

The projection matrix [P] of Equation 3 is a matrix generated by multiplying the original matrix [A] by the matrix [B] and converts the spatial image on the three-dimensional image into a planar image on the two-dimensional image. The correction coefficients a and b are parameters required for extracting the distortion image coordinates (x, y) from the correction image coordinates (X, Y).

If any point on the three-dimensional image is converted through the projection matrix [P], it can be expressed as Equation 4 below.

[Equation 4]

In order to express the third column and the fourth column of Equation 4 in the basic vector format, Equation 4 may be expressed as Equation 5 below by dividing Equation (ax + by + 1).

[Equation 5]

Here, as shown in the last line of Equation 5, x / (ax + by + 1) and y / (ax + by + 1) may be represented by replacing with X and Y, respectively. That is, [X, Y, 0, 1] are two-dimensional points in which any point [x, y, z, 1] is transformed through the projection matrix [P], where four columns of each matrix are The base vector for calculating the correction coefficients a and b. Meanwhile, in FIG. 2, since the first vanishing point P1 (X _P1 , Y _P1 ) and the second vanishing point P2 (X _P2 , Y _P2 ) are represented as points on the x and y axes, respectively, the unit vectors on the x axis [1, 0, 0 , 0] and the unit vector [0, 1, 0, 0] on the y-axis can be expressed by Equation 6 below through the projection matrix [P].

[Equation 6]

In order to represent columns 3 and 4 of Equation 6 in a basic vector format, dividing one row of Equation 6 by a and dividing two rows by b may be expressed as in Equation 7 below.

[Equation 7]

(X _P1 is the x coordinate of the first vanishing point when the first vanishing point is positioned on the x axis, and Y _P2 is the y coordinate of the second vanishing point when the second vanishing point is positioned on the y axis, as follows.

And the relationship of the following formula (2) can be obtained from (7).

[Equation 2]

Meanwhile, Equation 5 may be summarized as shown in Equation 8 below.

[Equation 8]

And solving the system of equations (8) can generate a projection algorithm, such as the following equation (1).

[Equation 1]

(x, y: distortion image coordinate, X, Y: correction image coordinate, a, b: correction coefficient)

The projection algorithm represented by Equation 1 can be used by substituting 1 / X _P1 and 1 / Y _P2 calculated by Equation 2 instead of the correction coefficients a and b. By using Equation 1, the distortion image coordinates (x, y) may be extracted from the correction image coordinates (X, Y), and the pixels of the distortion image may be disposed in the pixels of the correction image. This method assumes a corrected image in advance by an inverse mapping method and finds which pixel of the distorted image matches the corrected image. The image correction unit 222 generates a correction image by an inverse mapping method using Equation 1. If the perspective effect is not removed as expected in the generated correction image, the user may adjust the correction coefficients a and b to cause the image correction unit 222 to generate a new correction image.

The image data generator 223 generates image data with respect to the corrected image generated by the image compensator 222. The image data generation unit 223 may generate image data by scaling the corrected image according to the size of the display unit 240 to be described later, and generate and scale the encoder by compressing and encoding the scaled corrected image as necessary. One image data can also be compressed.

The memory unit 230 is an area in which image data is stored by the image processor 220 as shown in FIG. 1. The memory unit 230 may include a flash memory type, a hard disk type, a multimedia card micro type, and a card type memory (for example, SD memory and XD memory). Random Access Memory (RAM), Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEROM), Programmable Read-Only Memory (PROM), Magnetic Memory It may be one or more of a magnetic disk and an optical disk, but is not limited thereto. In addition, when the user wants to record an image taken by the observation mirror 1, the image data may be stored in the memory unit 230 as a recording file according to the user's recording request. In addition, the above-described distortion correction algorithm or projection algorithm may be stored in the memory unit 230 to refer to the algorithm stored in the memory unit 230 when the image correction unit 222 corrects the distortion image. In particular, the memory unit 230 may store a projection algorithm to which the correction coefficient is calculated by calculating a correction coefficient when removing the perspective effect of the distorted image.

The display unit 240 displays image data generated by the image processor 220 as shown in FIG. 1. The display unit 240 includes a liquid crystal display (LCD), an organic light emitting diode (OLED), an electroluminescent display (ELD), a plasma display panel (PDP), The display device may include one display device selected from a field emission display (FED) and an electrophoretic display (EPD), but is not limited thereto. The display unit 240 may be a fixed display unit 240 in which the display device is fixed to the main body unit 20, or may be a removable display unit 240 in which the display device can be detached. In the case of the removable display unit 240, a mounting unit (not shown) on which the display device is mounted may be provided on the main body unit 20. In addition, the display unit 240 may include a folding display unit 240 having a cover to cover the screen of the display device when the cover is folded and to open the cover to show the screen of the display device.

The communication unit 250 transfers the image data generated by the image processor 220 to an external device as shown in FIG. 1, and thus, remote medical treatment described below is possible. The communication unit 250 may transfer image data to an external device by wire, and may include a USB port or a memory card slot for this purpose, but is not limited thereto. In addition, the communication unit 250 may transmit the image data to an external device wirelessly, in this case, infrared (IR) communication, radio frequency (RF) communication, wireless LAN, Wi-Fi (Wi-Fi), WiBro (WiBro), ultra-wideband One or more wireless communication means of communication (UWB), Bluetooth, direct wireless and near field communication (NFC) may be used, but is not limited thereto. When the image data is stored as a recording file according to the user's recording request, the user connects the USB flash drive to the USB port of the communication unit 250 or connects the memory card to the memory card slot of the communication unit 250. You can download the recorded file.

The image processor 220 includes a direct memory access (DMA) controller (not shown) for fast storage and reading of image data, and includes a memory unit 230 and a display unit 240 in a direct memory access (DMA) manner. The image data may be received between the communication unit 250 and the image processor unit 220.

The observation system of the present invention comprises an observation mirror 1 and a terminal, and FIGS. 3 to 5 illustrate one embodiment of the observation system. Hereinafter, each component constituting the observation mirror system will be described in detail with reference to FIGS. 3 to 5.

As described above, the observation mirror 1 is an apparatus for generating image data by irradiating light into the inside of the object and then obtaining light reflected from the inside of the object. The observation mirror 1 includes a head part 10 and a main body part 20. It is done by

The terminal is a device connected to the observation mirror 1 through a wired or wireless communication means. The wired communication means may be a predetermined cable, the wireless communication means may be infrared (IR) communication, radio frequency (RF) communication, wireless LAN, Wi-Fi (Wi-Fi), WiBro, ultra-wideband communication (UWB), It may be one or more of Bluetooth, direct and near field communication (NFC), but does not exclude other wired or wireless communication means. The terminal may be a wired terminal or a wireless terminal, and FIG. 3 shows a wired terminal and a wireless terminal connected through the observation mirror 1 and a wireless communication means. The wired terminal may be a personal computer (PC) and / or a notebook, but the following is not limited thereto. Wireless terminals include Personal Communication System (PCS), GSM (Global System for Mobile communications) terminals, Personal Digital Cellular (PDC) terminals, PHS (Personal Handyphone System) terminals, and personal digital assistants. It can be one or more of an assistant, a PDA), a smart phone, a telematics and a wireless data communication terminal, and a portable internet terminal, and the glasses worn by a doctor are also equipped with a wireless communication module to display image data. Since it can be transmitted, the wireless terminal is not limited to any form, as follows. When the main body 20 of the observation mirror 1 includes the communication unit 250, the terminal receives image data from the communication unit 250 through a wired or wireless communication means. In addition, the main body 20 of the observation mirror 1 includes a mounting portion (not shown) on which the terminal is mounted, and the wired or wireless communication means from the observation mirror 1 to the terminal in a state where the terminal is mounted on the mounting portion. Image data transfer through can be made.

The observation mirror 1 and the terminal may share a plurality of functions through mirroring by the wired or wireless communication means. For example, when the main body 20 of the observation mirror 1 includes the display unit 240, the screen displayed on the display unit 240 may be output to the terminal through streaming.

Since the terminal may mean a plurality of terminals in the observation mirror system, the observation mirror system may include the observation mirror 1, the first terminal, and the second terminal. The observation mirror 1 and the first terminal can share a plurality of functions through mirroring by the first communication means, and the first terminal and the second terminal share the mirroring by the second communication means. Multiple functions can be shared through. For example, when the main body 20 of the observation mirror 1 includes the display unit 240, the screen displayed on the display unit 240 may be output to the first terminal through streaming. The screen output from the first terminal may be identically output to the second terminal through streaming. The first communication means may be the wired or wireless communication means, the second communication means may be the wired or wireless communication means, the first terminal may be the wired terminal or the wireless terminal, and the second terminal may also be It may be a wired terminal or the wireless terminal. 4 shows a first wireless terminal connected with the observation mirror 1 through a wireless communication means, and a second wireless terminal connected with the first wireless terminal via a wireless communication means. Mirroring between the first terminal and the second terminal may be performed by the second terminal sending a request for function sharing to the first terminal and the first terminal receiving the request responds, but is not limited thereto. . In particular, the first terminal and the second terminal may share more functions than the observation mirror 1 and the first terminal. Chat and share.

In the observation system, when the terminal is located far from the observation mirror (1), the terminal is connected to the observation mirror (1) and WCDMA, HSDPA, CDMA2000, WiBro, WiMax, LTE, LTE-Advanced and Wi-Fi ( One or more of the Wi-Fi) may be connected via the Internet to connect using a wireless communication means, of course, does not exclude other wireless communication means. 5 is a view illustrating a state in which a terminal located at a distance from the observation mirror 1 and the observation mirror 1 is connected. There may be one or more gateways (for example, a gateway configured on a wire / wireless router, a gateway of an Internet provider, etc.) or one or more access points (for example, a wireless repeater, a base station, etc.) between the observation mirror 1 and the terminal. When the observation mirror 1 transmits the image data as a digital signal, there may be one or more repeaters for reproducing the attenuated digital signal.

The observation mirror system of the present invention may comprise an observation mirror 1 and a server, and FIG. 5 shows one embodiment of such an observation mirror system. In this observation system, the observation mirror 1 is connected to a server on a wired or wireless network, and image data transmitted from the communication unit 250 of the observation mirror 1 may be stored in the server. The image data stored in the server can be used by a patient, doctor, or other person through a predetermined means. In this respect, the observation system transmits image data from the server in addition to the observation mirror 1 and the server through a wired or wireless communication means. It may be made further comprising a receiving terminal. The terminal may be a wired terminal or a wireless terminal. As shown in FIG. 5, one or more gateways (for example, a gateway set in a wire / wireless router, a gateway of an Internet provider, etc.) between the observation mirror 1 and a server connected through the Internet, or the like. There may be one or more access points (eg, a wireless repeater, a base station, etc.), and when the observation mirror 1 transmits image data as a digital signal, there may be one or more repeaters for reproducing attenuated digital signals.

Also in this observation system, telemedicine can be made. A remote doctor who is a doctor located at a distance from the observation mirror 1 analyzes the image data transmitted to the server or the terminal, and provides the analysis result and / or a related prescription to the user of the observation mirror 1, or to the server or the terminal. The virtual doctor who is an installed image data analysis program may analyze the image data transmitted to the server or the terminal and provide the analysis result and / or a prescription related thereto to the user of the observation mirror 1. In this case, the server or the terminal may authenticate the ID of the observer 1 so that the analysis result and / or a prescription thereof may be transmitted to the terminal owned by the observer 1 and the The ID may be authenticated so that the analysis result and / or the prescription related thereto may be delivered to the terminal owned by the observer 1.

Also, in such an observation system, when a large amount of image data is accumulated in a server or a terminal, the accumulated image data may be used for big data analysis or treatment prognosis, and the results of big data analysis or treatment prognosis may be observed. May be provided to the user. In this case, the server or the terminal may authenticate the ID of the observer (1) so that the big data analysis result or the treatment prognosis comparison result may be delivered to the terminal owned by the observer (1), and the observer (1) By authenticating the ID of the observation device (1) may be a big data analysis results or treatment prognosis comparison results to the terminal owned by the user.

Hereinafter, an embodiment of the observation mirror 1 of the present invention described above with reference to Figure 1 will be described in detail. Parts that were not clear above may be clearly understood through the following examples.

EXAMPLE

<Overall structure of observation mirror 1>

An observation mirror 1 as shown in Figs. 6 to 8 was prepared. The manufactured observation mirror 1 has a pistol shape as a whole, so that the user can connect and grip the tube 180 to use it. The manufactured observation mirror 1 may be divided into a head portion 10, a main body portion 20, and a connection portion 30. The appearance of the manufactured observation mirror 1 is illustrated in FIGS. 6 and 7, and manufactured in FIG. 8. The inside of the observed observation mirror 1 is shown. As shown in FIG. 7, the observation mirror 1 in which the head part 10 and the main body 20 shown in FIG. 6 are coupled is configured to separate the head part 10 and the main body part 20. .

The head unit 10 includes the light acquisition unit 110 shown in FIG. 8, the light emitting unit 120, the tube 180, the tube holder 130 shown in FIG. 7, the turn slider 150, and the fixing unit ( 160, the fixing groove 170, and although not shown in FIGS. 6 to 8, the turn guide 140 includes a turn guide 140 positioned between the tube holder 130 and the turn slider 150. 6 to 8, the tube holder 130 includes a tube holder protrusion 131, the turn guide 140 includes a guide surface 141, and the turn slider 150 includes a turn slider groove ( 151). The tube holder 130 includes a hole as shown in FIG. 7, and the user inserts the tube 180 into the hole as shown in FIG. 8 to use the observation mirror 1. Can be. The fixing part 160 is a part which is fixed without being rotated, and a part which is not described above among the remaining parts will be described later.

The main body 20 includes an image sensor 210, an image processor 220, a light source 260, a display 240, a housing 270, and a handle 280 of FIG. 7. 6 to 8, but not shown, includes a memory 230 and a communication unit 250. The housing unit 270 accommodates the image sensor 210, the image processor unit 220, the memory unit 230, the communication unit 250, the light source unit 260, and the like. The handle part 280 is a part grasped by the user, and the remaining part has been described above.

The connection part 30 includes a pin 310 formed at one side of the head part 10 and a locker 320 formed at one side of the main body part 20, as shown in FIG. 7, and the head part 10. And the main body 20. 6 to 8, the locker 320 includes a locker groove 321, a locker outer wall 322, and a locker inner wall 323.

Desorption of the Head 10

6 and 7 can be attached and detached by a structure in which the pin 310 and the locker 320 of the connecting portion 30 are separated or combined. 9 and 10 show the structure of the connecting portion 30 in detail, and the parts unnecessary for explaining the detachment of the head portion 10 are not shown. The user inserts the pin 310 into the locker groove 321 and rotates the locker 320 clockwise or counterclockwise to couple the head portion 10 to the main body portion 20. In FIG. 9, when the user inserts the pin 310 into the locker groove 321, the fixing part groove 170 is engaged with the locker outer wall 322, and the user still moves the head 10 back and forth in this state. The head portion 10 can be separated from the main body portion 20. When the user rotates the locker 320 clockwise or counterclockwise in this state, the pin 310 inserted into the locker groove 321 is blocked by the locker inner wall 323 shown in FIG. Is in a state where it cannot be separated from the main body 20. In this state, the user rotates the locker 320 clockwise or counterclockwise to align the locker groove 321 with the pin 310 and pulls the head portion 10 forward to move the head portion 10 to the main body. It can be separated from the portion 20.

<Focal length adjustment>

The focal length can be adjusted by a structure that converts the rotational movement of the head portion 10 into a linear movement, and the structure of such a head portion 10 is shown in detail in FIGS. 11 and 12, and description of the focal length adjustment The unnecessary part is not shown. 11 and 12, the head portion 10 includes a tube holder protrusion 131, a tube holder 130 having a narrow front end and a wide rear end, a guide surface 141, and a tube holder 130. A structure including a turn guide (140) surrounding a portion of the), a turn slider groove (151) engaged with the tube holder protrusion (131), and a turn slider (150) surrounding a portion of the turn guide (140). Equipped. When the user rotates the turn slider 150 counterclockwise, while the turn slider groove 151 applies a force to the tube holder protrusion 131, the tube holder 130 rotates counterclockwise and moves backwards (where The tube holder protrusion 131 moves along the guide surface 141.), and the focal length is shortened. On the contrary, if the user rotates the turn slider 150 in the clockwise direction, while the turn slider groove 151 exerts a force on the tube holder protrusion 131, the tube holder 130 rotates in the clockwise direction and moves forward (where The tube holder protrusion 131 moves along the guide surface 141.), and the focal length becomes long. Here, the turn guide 140 and the fixing part 160, which is not shown in FIGS. 11 and 12, do not move. That is, the focal length is adjusted while the rotational movement of the turn slider 150 is converted into the linear movement of the tube holder 130.

Although the present invention has been described with reference to the accompanying drawings, it is merely one example of various embodiments including the gist of the present invention, which can be easily implemented by those skilled in the art. It is clear that the present invention is not limited to the above-described embodiment only. Therefore, the protection scope of the present invention should be interpreted by the following claims, and all technical ideas within the scope equivalent to the change, substitution, substitution, etc. within the scope not departing from the gist of the present invention shall be the right of the present invention. It will be included in the scope. In addition, some of the components of the drawings are intended to more clearly describe the configuration, and it is clear that the exaggerated or reduced size is provided.

<Description of the code>

1: observation mirror

  10: head part

     110: light acquisition unit

     120: light emitting unit

     130: tube holder

         131: tube holder projection

     140: turn guide

         141: guide surface

     150: turn slider

         151: Turn Slider Home

     160: fixed part

     170: fixing part groove

     180: tube

  20: main body

     210: image sensor

     220: image processor unit

         221: signal conversion unit

         222: Image Supplement

         223: image data generation unit

     230: memory section

     240: display unit

     250: communication unit

     260: light source

     270: housing part

     280: handle portion

  30: connection

     310: pin

     320: locker

         321: Locker Home

         322: locker outer wall

         323: locker inner wall

Claims (20)

1. In the observation mirror 1 which photographs the inside of the object,

   A head part 10 including a light acquiring part 110 for acquiring light reflected from the inside of the object to generate an optical signal; And

   A main body unit 20 coupled to the head unit 10 and having a function of receiving the optical signal to generate image data;

   It is made, including

   The head portion 10 may be separated from the body portion 20, and the observation mirror, characterized in that it has a function to adjust the focal length (focal length)
2. The method according to claim 1,

   The head portion (10) has a structure for converting the rotational movement into a linear movement, the observation mirror, characterized in that the focal length (focal length) is adjusted by the structure.
3. The method according to claim 1,

   The main body 20,

   And an image sensor (210) for receiving the optical signal to generate an image signal, and an image processor (220) for processing the image signal to generate the image data.
4. The method according to claim 3,

   The image processor unit 220,

   And an image compensator (222) for receiving the image signal and correcting the distorted image.
5. The method according to claim 1,

   The head portion 10,

   And a tube (180) including a lens and a plurality of optical fibers and inserted into the object to transmit the reflected light to the light acquisition unit (110).
6. The method according to claim 1,

   The main body 20,

   And a display unit 240 for displaying the image data.
7. The method according to claim 6,

   The display unit 240 is a observation, characterized in that the fixed, removable or folding display unit 240.
8. The method according to claim 1,

   The main body 20,

   The communication unit 250 for transmitting the image data to an external device and a memory unit 230 for storing the image data as a recording file in accordance with the recording request of the user, the user is the communication file 250 ), Which can be downloaded to a USB flash drive or a memory card.
9. The method according to claim 1,

   The main body 20,

   And a light source unit 260 for generating light to be irradiated to the inside of the object.
10. An observation mirror (1) of claim 8; And

    A terminal receiving the image data from the communication unit 250 through a wired or wireless communication means; And the observation mirror (1) and the terminal share the image data through mirroring by the wired or wireless communication means.
11. The method according to claim 10,

    The main body 20,

    Observation system characterized in that it further comprises a mounting portion on which the terminal is mounted.
12. The observation mirror 1 of claim 1;

    A first terminal for sharing said image data through mirroring by said observation mirror (1) and first communication means; And

    A second terminal for sharing the image data through mirroring by the first terminal and a second communication means;

    Observation system, characterized in that comprises a.
13. An observation mirror (1) of claim 8;

    Server for receiving and storing the image data from the communication unit 250; And

    A terminal receiving the image data from the server through a wired or wireless communication means; It comprises a, the observation system, characterized in that the remote doctor analyzes the image data transmitted to the server or the terminal to provide the analysis results to the user of the observation mirror (1).
14. The method according to claim 13,

    Observation system, characterized in that the virtual doctor analyzes the image data transmitted to the server or the terminal and provides the analysis results to the user of the observation mirror (1).
15. The method according to claim 13 or 14,

    The server or the terminal observation system, characterized in that to authenticate the ID of the user or the ID of the observation mirror (1).
16. In the method of observing the inside of the object using the observation mirror (1) of claim 1,

    (I) generating a light to be irradiated to the inside of the object by the light source unit 260;

    (II) radiating the light generated in the step (I) to the inside of the object;

    (III) the optical acquisition unit (110) acquiring the light reflected from the inside of the object to generate the optical signal;

    (IV) the image sensor 210 generating an image signal by receiving the optical signal generated in the step (III);

    (V) an image processor 220 generating the image data by processing the image signal generated in step (IV); And

    (VI) the display unit 240 displaying the image data generated in the step (V);

    Method for observing the inside of the object using an observation mirror comprising a.
17. The method according to claim 16,

    Step (V),

    (V-1) the image correction unit 222 receiving the image signal;

    (V-2) the image correction unit 222 correcting the distortion image to generate a correction image; And

    (V-3) the image data generating unit 223 generating image data regarding the corrected image;

    Method for observing the inside of the object using an observation mirror, characterized in that comprising a.
18. The method according to claim 17,

    The (V-2) step,

    (V-2-1) the image correction unit 222 further includes performing a geometric correction of the distorted image using a distortion correction algorithm, wherein the distortion correction algorithm includes a focal length and a principal. A method for observing an interior of a subject using an observation mirror, characterized in that it comprises at least one of a point, a radial distortion coefficient and a tangential distortion coefficient.
19. The method according to claim 18,

    The (V-2) step, after the (V-2-1) step,

    (V-2-2) the image correction unit 222 extracting vanishing point coordinates from the distorted image;

    (V-2-3) calculating, by the image correction unit 222, a correction coefficient constituting a projection algorithm from the vanishing point coordinates; And

    (V-2-4) the image compensating unit 222 generating a correction image using the projection algorithm;

    More,

    The projection algorithm is a method for observing the inside of the object using an observation mirror, characterized in that represented by the following equation (1).

    [Equation 1]

    

     (x, y: distortion image coordinate, X, Y: correction image coordinate, a, b: correction coefficient)
20. The method according to claim 19,

    The correction coefficient is a method for observing the inside of the object using an observation mirror, characterized in that represented by the following formula (2).

    [Equation 2]

    

    (X _P1 : x coordinate of the first vanishing point when the first vanishing point is located on the x axis, Y _P2 : y coordinate of the second vanishing point when the second vanishing point is located on the y axis)

Images