WO2017176021A1 - Scope d'observation pour examen médical à distance, et dispositif de traitement d'image et système le comprenant - Google Patents

Scope d'observation pour examen médical à distance, et dispositif de traitement d'image et système le comprenant Download PDF

Info

Publication number
WO2017176021A1
WO2017176021A1 PCT/KR2017/003648 KR2017003648W WO2017176021A1 WO 2017176021 A1 WO2017176021 A1 WO 2017176021A1 KR 2017003648 W KR2017003648 W KR 2017003648W WO 2017176021 A1 WO2017176021 A1 WO 2017176021A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
unit
observation mirror
image data
terminal
Prior art date
Application number
PCT/KR2017/003648
Other languages
English (en)
Korean (ko)
Inventor
고철웅
장인훈
Original Assignee
한국생산기술연구원
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 한국생산기술연구원 filed Critical 한국생산기술연구원
Publication of WO2017176021A1 publication Critical patent/WO2017176021A1/fr

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00163—Optical arrangements
    • A61B1/00188—Optical arrangements with focusing or zooming features
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
    • A61B1/042—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances characterised by a proximal camera, e.g. a CCD camera
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/0002—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network
    • A61B5/0004—Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network characterised by the type of physiological signal transmitted
    • A61B5/0013—Medical image data

Definitions

  • the present invention relates to an observation mirror for remote medical care and an image processing apparatus and system including the same, and more particularly, to a detachable head part and a telescope for including a viewing mirror whose focal length is adjusted by the structure of the head part. Relates to a possible image data processing system.
  • the observation mirror is a device that allows the user to observe the inside of the object by photographing the inside of the object through a tube of the observation mirror inserted into the inside of the object.
  • Observation mirrors may be used by inserting a rigid or ductile tube into the interior wall of a building or a mechanical device, as well as by inserting a needle, rubber or plastic tip tube into a human or animal.
  • the inside of the human body bronchi, esophagus, chest cavity, heart, stomach, intestine, abdominal cavity, bladder, anus, nasal cavity, eardrum, etc.
  • it can be useful for the diagnosis of diseases.
  • Observation mirrors cause contamination of the tube and its vicinity because the tube is inserted inside the object.
  • a high level of cleanliness is required.
  • conventional observation glasses are very difficult to sterilize or disinfect because of their complicated structure and design.
  • the observation mirror needs to have a structure that is easy to clean, sterilize or disinfect.
  • the Republic of Korea Patent No. 0449349 name of the invention: an endoscope having an improved flexible insertion tube, hereinafter referred to as the prior art 1
  • the insertion tube further comprises a vapor barrier between the shell and the internal communicator, whereby the vapor barrier prevents the ingress of steam from the ambient air through the shell and into the interior space, and also the vapor in the interior space.
  • a flexible endoscope with a flexible insertion tube is disclosed that prevents reacting with the material to produce a material that is harmful to the elastic sheath.
  • 1512068 (name of the invention: a telemedicine service system and method, hereinafter referred to as prior art 2) in the telemedicine service method, through the camera of the portable terminal to the remote care service target Acquiring an image of the patient, acquiring a patient state including a plurality of questionnaire information having a hierarchical relationship to the acquired image, recognizing a telemedicine service type from the acquired image, Performing analysis corresponding to a service type to generate analysis result data; matching the collected patient state to the generated analysis result data and broadcasting it through at least one service server linked through a network; , The result of the data broadcast through the linked service server Searching for and collecting the same and displaying the collected information on the portable terminal, wherein the questionnaire information includes a plurality of preset questions for each medical service type selected by the user or the recognized remote medical service type by operating the portable terminal.
  • a remote medical service server including an answer inputted in response to the mobile terminal and communicating with the portable terminal and interworking with a plurality of service servers specialized for a plurality of medical service types, if any one data is selected from the result data retrieved through the service server. And simultaneously displaying, on the portable terminal, an evaluation history of the corresponding data collected through each of the linked service servers, and the evaluation history includes a satisfaction level of data provided by each teleservice service server for each service server.
  • the data quality collected and collected by the user is mapped and stored and managed corresponding to the corresponding service server, and the collected data for each service server is specialized medical service data according to symptoms corresponding to the recognized service type.
  • the specialized medical service data includes medical service data recommending a pouch product to treat the stoma, nursing care for wounds and nutrition, exercise, lifestyle recommendations, and medical counseling related to cancer.
  • a telemedicine service method is disclosed.
  • the technical problem to be achieved by the present invention is the first problem that the prior art 1 has a limit on the degree of sterilization and disinfection, the second problem that the prior art 1 can not adjust the focal length, the prior art 1 using only a flexible tube
  • the prior art 1 is a fourth invention that there is still a problem of contamination of the endoscope when the invention to improve the sterilization and disinfection problem or when confirming the image obtained by the endoscope in a place requiring cleanness such as an operating room
  • prior art 1 has a fifth problem that several people can not share the image obtained by the endoscope
  • sixth problem that the user can not receive any feedback by the prior art 1 and prior art 2 is different from the prior art 1
  • the user has the advantage of receiving remote medical treatment, the remote medical treatment for the wounded part using the camera of the portable terminal To try to solve the problem that Article 7 ceased.
  • the present invention in the observation mirror for photographing the interior of the object, the head portion and the head portion including a light acquisition unit for obtaining the light reflected from the interior of the object to generate an optical signal And a main body having a function of receiving an optical signal and generating image data, wherein the head portion is detachable from the main body.
  • the head portion may be characterized by having a function of adjusting the focal length.
  • the head portion may have a structure for converting a rotational motion into a linear motion, and the focal length may be adjusted by the structure.
  • the main body may include an image sensor for receiving the optical signal to generate an image signal.
  • the main body may further include an image processor for processing the image signal to generate the image data.
  • the head portion comprises a lens and a plurality of optical fibers, and further comprising a tube which is inserted into the inside of the object to transfer the reflected light to the light acquisition unit Can be.
  • the lens may be characterized in that the fisheye lens or a wide-angle lens.
  • the image processor may be characterized in that it comprises an image correction unit for receiving the image signal to correct the distortion image.
  • the main body may include a display unit for displaying the image data.
  • the display unit may be a fixed or removable display unit.
  • the display unit may be a foldable display unit.
  • the main body may include a communication unit for transmitting the image data to an external device.
  • the main body may further include a memory unit in which the image data is stored as a recording file according to a recording request of a user.
  • the user may download the recorded file to a USB flash drive or a memory card connected to the communication unit.
  • the body portion may be characterized in that it comprises a light source for generating light to be irradiated to the inside of the object.
  • the present invention also provides an observation mirror system comprising a terminal receiving the image data from the observation mirror and the communication unit through a wired or wireless communication means.
  • the wireless communication means is infrared (IR) communication, radio frequency (RF) communication, wireless LAN, Wi-Fi (Wi-Fi), WiBro (UWB), ultra-wideband communication (UWB) It may be characterized in that one or more of, Bluetooth, direct wireless and Near Field Communication (NFC).
  • IR infrared
  • RF radio frequency
  • Wi-Fi Wi-Fi
  • WiBro WiBro
  • UWB ultra-wideband communication
  • NFC Near Field Communication
  • the observation mirror and the terminal may be characterized in that sharing the image data through the mirroring (mirroring) by the wired or wireless communication means.
  • the main body may further include a mounting portion on which the terminal is mounted.
  • the present invention also provides a first terminal for sharing the image data through mirroring by the observation mirror, the observation mirror and the first communication means, and mirroring by the first terminal and the second communication means. It provides a observation system comprising a second terminal for sharing the image data through.
  • the present invention provides an observation mirror system comprising a server for receiving and storing the image data from the observation mirror and the communication unit.
  • it may be characterized in that it further comprises a terminal for receiving the image data from the server through a wired or wireless communication means.
  • the remote doctor may be characterized by analyzing the image data transmitted to the server or the terminal to provide an analysis result to the user of the observation mirror.
  • the virtual doctor may analyze the image data transmitted to the server or the terminal and provide the analysis result to the user of the observation mirror.
  • the server or the terminal may be characterized in that the authentication of the user ID.
  • the server or the terminal may be characterized in that to authenticate the ID of the observation mirror.
  • the present invention is a method for observing the interior of the object using the observation mirror, the step of generating light to be irradiated to the inside of the object, the step of irradiating the generated light inside the object, the light acquisition unit Acquiring the light reflected from the inside of the object to generate an optical signal, receiving an optical signal generated by the image sensor, generating an image signal, and processing the generated image signal by the image processor to generate image data
  • a display unit provides a method for observing the inside of the object using an observation mirror, characterized in that comprises the step of displaying the generated image data.
  • the generating of the image data by processing the generated image signal by the image processor unit includes: receiving the generated image signal by the image correction unit, and correcting the distortion image by the image correction unit It may be characterized in that it comprises a step of generating a correction image and the image data generation unit for generating the image data related to the correction image.
  • the step of generating the corrected image by correcting the distorted image by the image compensating includes performing a geometrical correction of the distorted image by using the distortion correcting algorithm. It can be characterized.
  • the distortion correction algorithm is one or more of the focal length (prical length), the principal point (principal point), the radial distortion coefficient (radial distortion coefficient) and the tangential distortion coefficient (tangential distortion coefficient) It may be characterized by including.
  • the step of generating the corrected image by correcting the distorted image by the image correction unit after performing the geometric correction of the distorted image using the distortion correction algorithm, Extracting the vanishing point coordinates from the distorted image by the image correction unit, calculating the correction coefficients constituting the projection algorithm from the vanishing point coordinates, and generating the corrected image by the image correction unit using the projection algorithm
  • the projection algorithm may be represented by Equation 1.
  • the correction coefficient may be represented by Equation 2.
  • the present invention is the first effect that the detachable head portion is easy to clean, sterilize or disinfect the head portion or the body portion, the second effect that the user can adjust the focal length to obtain the image quality desired by the user, various forms
  • the third effect that can be applied to various fields using the tube of the, the image can be confirmed by the terminal connected by the observation mirror and the wireless communication means, so the problem of contamination of the display part is solved and the fourth effect that the convenience is improved
  • the seventh effect that telemedicine is possible based on the image of the inside of the patient's body, the image obtained by the observation mirror Eighth effect that can be confirmed remotely, the ninth effect that the image obtained by the observation mirror is stored on the server and easy access to the acquired image, and the accumulated image data when the image obtained by the observation mirror is
  • the effects of the present invention are not limited to the above-described effects, but should be understood to include all the effects deduced from the configuration of the invention described in the detailed description or claims of the present invention.
  • 1 is a block diagram showing an embodiment of the inventor's observation mirror.
  • FIG. 2 is a schematic diagram showing a distortion image before applying a projection algorithm.
  • Figure 3 is a structural diagram showing an embodiment of the present observation system.
  • Figure 4 is a structural diagram showing one embodiment of the present observation system.
  • Figure 5 is a structural diagram showing an embodiment of the present observation system.
  • FIG. 6 is a perspective view showing an embodiment of the inventor's observation mirror.
  • FIG. 7 is a perspective view showing an embodiment of the inventor's observation mirror.
  • FIG. 8 is a perspective cross-sectional view showing an embodiment of the inventor's observation mirror.
  • Fig. 9 is a perspective view showing the head portion of the observation mirror according to the present invention as an example.
  • FIG. 10 is a perspective view showing a locker of the observation mirror according to the present invention as an example.
  • Fig. 11 is a perspective view showing the head portion of the observation mirror according to the present invention as an example.
  • FIG. 12 is a perspective view showing a head portion of the observation mirror according to the present invention as an example.
  • the best mode of the embodiment of the observation mirror of the present invention includes a head portion and a head portion including an optical acquisition portion for acquiring light reflected from the interior of the object and generating an optical signal in the observation mirror for photographing the interior of the object. And a main body having a function of receiving an optical signal and generating image data, wherein the head can be separated from the main body.
  • the observation mirror 1 of the present invention is an apparatus for photographing the inside of an object, and irradiates light into the inside of the object, and then acquires light reflected from the inside of the object to generate image data.
  • the interior of the subject may be a body part of a patient, a body part of an animal, an inner wall of a building, an inside of a pipe, or an inside of a vehicle, but the present invention is not limited thereto.
  • Observation mirror 1 comprises a head portion 10 and the body portion 20, the head portion 10 includes a light acquisition portion 110, the light emitting portion 120 or tube 180 It may further include.
  • the main body 20 coupled to the head portion 10 has a function of receiving an optical signal transmitted from the head portion 10 and generating image data, and includes an image sensor 210 and an image processor 220. , One or more of a memory unit 230, a display unit 240, a communication unit 250, and a light source unit 260.
  • FIG. 1 shows an embodiment of the observation mirror 1 in a block diagram, so that not only the configuration of the observation mirror 1 but also a method of observing the inside of the object using the observation mirror 1 can be grasped at a glance.
  • each component of the observation mirror 1 will be described in detail, and through this, a method of observing the inside of the object using the observation mirror 1 will also be understood.
  • Tube 180 is inserted into the inside of the object, and the user may observe the image of the inside of the object by inserting the tube 180 into the inside of the object in observing the inside of the object with the observation mirror 1.
  • Tube 180 is a needle type that can be inserted into the skin of the target, a rigid type (for example, a straight metal tube or an insertion portion of the otoscope), a soft type (for example, made of rubber and freely Bend) or an intermediate type of rigid type and flexible type (hard or soft intermediate between the hard type and flexible type), but is not limited thereto.
  • the tube 180 includes a lens and a plurality of optical fibers, and when the tube 180 is inserted into the inside of the object, the light generated by the light source unit 260, which will be described later, is a part of the plurality of optical fibers of the tube 180 (hereinafter, The light that passes through the lens and reaches the inside of the object, and the light reflected from the inside of the object is again the lens of the tube 180 and the plurality of optical fibers (hereinafter, referred to as a photographing line). Is processed in a predetermined manner inside the observation mirror (1).
  • the lens may be one or more of a standard lens, a telephoto lens, a micro lens, a wide angle lens, and a fisheye lens, but is not limited thereto.
  • the light source unit 260 generates light to be irradiated inside the object.
  • the light source unit 260 may include a lamp using a laser emitting diode (LED) or a laser diode (LD) as a light source, but the light source is not limited thereto.
  • the light source unit 260 further includes a color conversion plate made of glass or ceramic material when the laser emitting diode (LED) lamp emits a UV-Blue band laser to convert the UV-Blue band laser into white light. It is possible to convert, but the configuration of the light source unit 260 is not limited to these.
  • the light emitting unit 120 is coupled to the light source unit 260 to irradiate the light generated by the light source unit 260 to the inside of the object.
  • the light generated by the light source unit 260 is irradiated to the inside of the object through a light emitting line connected to the light emitter 120. That is, although FIG. 1 simply shows an arrow that light generated by the light source unit 260 is irradiated to the inside of the object, specifically, light generated by the light source unit 260 is a light emitting unit coupled to the light source unit 260. 120, the light emitting line connected to the light emitting unit 120, the lens, and may be sequentially delivered to the inside of the object.
  • the light acquisition unit 110 acquires the light reflected from the inside of the object.
  • FIG. 1 shows an arrow indicating that the light reflected from the inside of the object reaches the head portion 10.
  • the light reflected from the inside of the object is a light acquisition unit connected to a lens, a shooting line, and a shooting line. Can be delivered sequentially to (110).
  • the light acquisition unit 110 that acquires light reflected from the inside of the object generates an optical signal and transmits the light signal to the image sensor 210 which will be described later.
  • the tube 180, the light emitting unit 120, and the light acquisition unit 110, which are components of the head unit 10, have been described so far, and only the light source unit 260 is described among the components of the main body 20. However, before describing the image sensor 210 of the main body 20, the detachment of the head 10 will be described.
  • the user When the user observes the inside of the object by using the observation mirror 1, the user uses the observation mirror 1 in which the head portion 10 and the main body portion 20 are combined, but the head portion 10 is the main body portion ( 20).
  • Prior arts typically did not facilitate separating the head portion 10 from the body portion 20.
  • the optical fiber (photography line) of the tube 180 extends to the image processor 220 of the main body 20.
  • the light emitting unit 120 connected to the light emitting line may be coupled to the light source unit 260 or separated from the light source unit 260, and the light acquisition unit 110 connected to the photographing line may be an image sensor 210 or an image.
  • the head unit 10 Since the head unit 10 is spaced apart from the processor 220, the head unit 10 including the light emitting line, the light emitting unit 120, the photographing line, and the light acquisition unit 110 may include a main body unit 20 including the light source unit 260. Can be separated from).
  • the observation mirror 1 includes a connection part 30 for connecting the head part 10 and the main body part 20 in addition to the head part 10 and the main body part 20, and has a structure of the connecting part 30. Enables the detachment and coupling of the head portion 10.
  • the connection part 30 has a simple structure in which the head part 10 is separated by pulling the head part 10 from the main body part 20, and the head part 10 is coupled by pushing the head part 10 toward the main body part 20.
  • the head part 10 may be separated from the main body part 20 while the user uses the observation mirror 1, the connection part 30 may be separated and coupled to the head part 10.
  • the head portion 10 is fixed when the head portion 10 is coupled to the main body portion 20
  • such a structure may be various, one example of which will be described later. It will be described in the embodiment.
  • Head portion 10 has a function of adjusting the focal length (focal length), the focal length (focal length) means the distance from the lens of the tube 180 to the image sensor 210 of the body portion 20. do.
  • the user may combine various types of head portions 10 to the main body portion 20, various types of tubes 180 may be coupled to other components of the head portion 10, and various types Can be used as a component of the tube 180. Therefore, since the focal length may vary depending on one or more factors among the shape of the head portion 10, the shape of the tube 180, and the type of lens, the observation mirror 1 needs to have a function of adjusting the focal length. have.
  • the connecting portion 30 pulls the head portion 10 from the main body portion 20, the head portion 10 is separated and the head portion 10 is pushed toward the main body portion 20.
  • the focal length becomes long, and the head portion Pushing back (10) may shorten the focal length.
  • this structure is a linear motion of the rotational motion, such as rack and pinion gear It may be a structure for converting to, but is not limited thereto.
  • One example of a structure for converting a rotational motion into a linear motion will be described in the following embodiments.
  • the image sensor 210 receives an optical signal from the light acquisition unit 110 and generates an image signal which is an electrical signal.
  • the image sensor 210 may be a complementary metal oxide semiconductor (CMOS) or a charge coupled device (CCD), but is not limited thereto.
  • CMOS complementary metal oxide semiconductor
  • CCD charge coupled device
  • the image sensor 210 may have pixels corresponding to VGA, SVGA, or SXGA as necessary, but is not limited thereto.
  • the image processor 220 generates image data by processing the image signal generated by the image sensor 210 as shown in FIG. 1.
  • the image processor 220 may include at least one of a signal converter 221, an image compensator 222, and an image data generator 223.
  • the signal converter 221 converts the analog image signal into a digital image signal when the image sensor 210 generates an analog image signal.
  • a digital image signal may be converted, and color coordinate systems such as YUV and RGB may be converted.
  • the image compensator 222 receives an image signal from the image sensor 210 or the signal converter 221 and then corrects the distortion image to generate a corrected image.
  • the image correction unit 222 may not only perform normal color correction or gamma correction, but also perform geometric correction of the distorted image using the distortion correction algorithm, and use the projection algorithm to correct the perspective effect of the distorted image. Can be removed
  • the order of correction is preferably to remove the perspective effect after performing the geometric correction.
  • Geometric correction and perspective removal are particularly effective correction methods when using fisheye or wide-angle lenses.
  • Fish-eye and wide-angle lenses have shorter focal lengths than standard lenses.
  • Fish-eye lenses have a lens angle of at least 120 degrees, enabling wide-area images.
  • Wide-angle lenses have a 60 to 120 degree angle of view. The lens is not as good as the fisheye lens, but it also enables wider image acquisition.
  • fisheye lenses and wide-angle lenses have wide angles of view, distorting objects and exaggerating perspective. Therefore, when observing the inside of the object using a fisheye lens or a wide-angle lens, the inside of the object is distorted, a perspective occurs to the periphery of the region of interest, and it is difficult to determine the exact state of the inside of the object.
  • Radiation distortion is a distortion caused by the shape of the lens generally refers to a phenomenon in which the position of the pixel is convexly distorted near the edge of the image sensor 210. These convex phenomena are also called 'keg distortion' and can also cause fisheye effects.
  • Tangential distortion is a distortion that occurs because the image sensor 210 and the lens are not parallel to each other occurs in the manufacturing process of the observation mirror (1).
  • the distortion correction algorithm can be represented by a function including one or more of focal length, principal point, radial distortion coefficient, and tangential distortion coefficient, 222 may correct geometric distortions such as radial distortion or tangential distortion using a distortion correction algorithm.
  • Geometric correction is a well known theory and will be understood by those skilled in the art of image processing without further detailed description.
  • Figure 2 shows an embodiment of the distortion image, but the geometric correction is completed, but each side due to the perspective effect shows a curved rectangle. This is because a rectangular image with each side bent is created when a rectangle is photographed with a camera, because a part near the camera is larger in the rectangle and a part farther from the camera appears in a small distance, creating a perspective.
  • the image compensator 222 extracts vanishing point coordinates from the distorted image. In FIG.
  • the first vanishing point P1 (X P1 , Y P1 ) where the straight line AB extends to meet and the second vanishing point P2 (X P2 , Y P2 ) where the straight line AD extends from the straight line BC are extracted.
  • the image correction unit 222 calculates a correction coefficient constituting the projection algorithm from the vanishing point coordinates.
  • a projection matrix [P] is generated as in Equation 3 below.
  • the projection matrix [P] of Equation 3 is a matrix generated by multiplying the original matrix [A] by the matrix [B] and converts the spatial image on the three-dimensional image into a planar image on the two-dimensional image.
  • the correction coefficients a and b are parameters required for extracting the distortion image coordinates (x, y) from the correction image coordinates (X, Y).
  • Equation 4 If any point on the three-dimensional image is converted through the projection matrix [P], it can be expressed as Equation 4 below.
  • Equation 4 may be expressed as Equation 5 below by dividing Equation (ax + by + 1).
  • x / (ax + by + 1) and y / (ax + by + 1) may be represented by replacing with X and Y, respectively. That is, [X, Y, 0, 1] are two-dimensional points in which any point [x, y, z, 1] is transformed through the projection matrix [P], where four columns of each matrix are The base vector for calculating the correction coefficients a and b. Meanwhile, in FIG.
  • Equation 7 In order to represent columns 3 and 4 of Equation 6 in a basic vector format, dividing one row of Equation 6 by a and dividing two rows by b may be expressed as in Equation 7 below.
  • X P1 is the x coordinate of the first vanishing point when the first vanishing point is positioned on the x axis
  • Y P2 is the y coordinate of the second vanishing point when the second vanishing point is positioned on the y axis
  • Equation 5 may be summarized as shown in Equation 8 below.
  • the projection algorithm represented by Equation 1 can be used by substituting 1 / X P1 and 1 / Y P2 calculated by Equation 2 instead of the correction coefficients a and b.
  • the distortion image coordinates (x, y) may be extracted from the correction image coordinates (X, Y), and the pixels of the distortion image may be disposed in the pixels of the correction image.
  • This method assumes a corrected image in advance by an inverse mapping method and finds which pixel of the distorted image matches the corrected image.
  • the image correction unit 222 generates a correction image by an inverse mapping method using Equation 1. If the perspective effect is not removed as expected in the generated correction image, the user may adjust the correction coefficients a and b to cause the image correction unit 222 to generate a new correction image.
  • the image data generator 223 generates image data with respect to the corrected image generated by the image compensator 222.
  • the image data generation unit 223 may generate image data by scaling the corrected image according to the size of the display unit 240 to be described later, and generate and scale the encoder by compressing and encoding the scaled corrected image as necessary.
  • One image data can also be compressed.
  • the memory unit 230 is an area in which image data is stored by the image processor 220 as shown in FIG. 1.
  • the memory unit 230 may include a flash memory type, a hard disk type, a multimedia card micro type, and a card type memory (for example, SD memory and XD memory).
  • the image data may be stored in the memory unit 230 as a recording file according to the user's recording request.
  • the above-described distortion correction algorithm or projection algorithm may be stored in the memory unit 230 to refer to the algorithm stored in the memory unit 230 when the image correction unit 222 corrects the distortion image.
  • the memory unit 230 may store a projection algorithm to which the correction coefficient is calculated by calculating a correction coefficient when removing the perspective effect of the distorted image.
  • the display unit 240 displays image data generated by the image processor 220 as shown in FIG. 1.
  • the display unit 240 includes a liquid crystal display (LCD), an organic light emitting diode (OLED), an electroluminescent display (ELD), a plasma display panel (PDP),
  • the display device may include one display device selected from a field emission display (FED) and an electrophoretic display (EPD), but is not limited thereto.
  • the display unit 240 may be a fixed display unit 240 in which the display device is fixed to the main body unit 20, or may be a removable display unit 240 in which the display device can be detached. In the case of the removable display unit 240, a mounting unit (not shown) on which the display device is mounted may be provided on the main body unit 20.
  • the display unit 240 may include a folding display unit 240 having a cover to cover the screen of the display device when the cover is folded and to open the cover to show the screen of the display device.
  • the communication unit 250 transfers the image data generated by the image processor 220 to an external device as shown in FIG. 1, and thus, remote medical treatment described below is possible.
  • the communication unit 250 may transfer image data to an external device by wire, and may include a USB port or a memory card slot for this purpose, but is not limited thereto.
  • the communication unit 250 may transmit the image data to an external device wirelessly, in this case, infrared (IR) communication, radio frequency (RF) communication, wireless LAN, Wi-Fi (Wi-Fi), WiBro (WiBro), ultra-wideband One or more wireless communication means of communication (UWB), Bluetooth, direct wireless and near field communication (NFC) may be used, but is not limited thereto.
  • IR infrared
  • RF radio frequency
  • UWB Wi-Fi
  • WiBro WiBro
  • NFC ultra-wideband
  • the image data is stored as a recording file according to the user's recording request, the user connects the USB flash drive to the USB port of the communication unit 250 or connects the memory
  • the image processor 220 includes a direct memory access (DMA) controller (not shown) for fast storage and reading of image data, and includes a memory unit 230 and a display unit 240 in a direct memory access (DMA) manner.
  • the image data may be received between the communication unit 250 and the image processor unit 220.
  • DMA direct memory access
  • the observation system of the present invention comprises an observation mirror 1 and a terminal, and FIGS. 3 to 5 illustrate one embodiment of the observation system.
  • FIGS. 3 to 5 illustrate one embodiment of the observation system.
  • each component constituting the observation mirror system will be described in detail with reference to FIGS. 3 to 5.
  • the observation mirror 1 is an apparatus for generating image data by irradiating light into the inside of the object and then obtaining light reflected from the inside of the object.
  • the observation mirror 1 includes a head part 10 and a main body part 20. It is done by
  • the terminal is a device connected to the observation mirror 1 through a wired or wireless communication means.
  • the wired communication means may be a predetermined cable
  • the wireless communication means may be infrared (IR) communication, radio frequency (RF) communication, wireless LAN, Wi-Fi (Wi-Fi), WiBro, ultra-wideband communication (UWB), It may be one or more of Bluetooth, direct and near field communication (NFC), but does not exclude other wired or wireless communication means.
  • the terminal may be a wired terminal or a wireless terminal, and FIG. 3 shows a wired terminal and a wireless terminal connected through the observation mirror 1 and a wireless communication means.
  • the wired terminal may be a personal computer (PC) and / or a notebook, but the following is not limited thereto.
  • Wireless terminals include Personal Communication System (PCS), GSM (Global System for Mobile communications) terminals, Personal Digital Cellular (PDC) terminals, PHS (Personal Handyphone System) terminals, and personal digital assistants. It can be one or more of an assistant, a PDA), a smart phone, a telematics and a wireless data communication terminal, and a portable internet terminal, and the glasses worn by a doctor are also equipped with a wireless communication module to display image data. Since it can be transmitted, the wireless terminal is not limited to any form, as follows. When the main body 20 of the observation mirror 1 includes the communication unit 250, the terminal receives image data from the communication unit 250 through a wired or wireless communication means.
  • PCS Personal Communication System
  • GSM Global System for Mobile communications
  • PDC Personal Digital Cellular
  • PHS Personal Handyphone System
  • the main body 20 of the observation mirror 1 includes a mounting portion (not shown) on which the terminal is mounted, and the wired or wireless communication means from the observation mirror 1 to the terminal in a state where the terminal is mounted on the mounting portion. Image data transfer through can be made.
  • the observation mirror 1 and the terminal may share a plurality of functions through mirroring by the wired or wireless communication means.
  • the main body 20 of the observation mirror 1 includes the display unit 240
  • the screen displayed on the display unit 240 may be output to the terminal through streaming.
  • the observation mirror system may include the observation mirror 1, the first terminal, and the second terminal.
  • the observation mirror 1 and the first terminal can share a plurality of functions through mirroring by the first communication means, and the first terminal and the second terminal share the mirroring by the second communication means. Multiple functions can be shared through.
  • the main body 20 of the observation mirror 1 includes the display unit 240
  • the screen displayed on the display unit 240 may be output to the first terminal through streaming.
  • the screen output from the first terminal may be identically output to the second terminal through streaming.
  • the first communication means may be the wired or wireless communication means
  • the second communication means may be the wired or wireless communication means
  • the first terminal may be the wired terminal or the wireless terminal
  • the second terminal may also be It may be a wired terminal or the wireless terminal.
  • 4 shows a first wireless terminal connected with the observation mirror 1 through a wireless communication means, and a second wireless terminal connected with the first wireless terminal via a wireless communication means. Mirroring between the first terminal and the second terminal may be performed by the second terminal sending a request for function sharing to the first terminal and the first terminal receiving the request responds, but is not limited thereto. .
  • the first terminal and the second terminal may share more functions than the observation mirror 1 and the first terminal. Chat and share.
  • Wi-Fi Wi-Fi
  • WCDMA, HSDPA, CDMA2000, WiBro, WiMax, LTE, LTE-Advanced and Wi-Fi may be connected via the Internet to connect using a wireless communication means, of course, does not exclude other wireless communication means.
  • 5 is a view illustrating a state in which a terminal located at a distance from the observation mirror 1 and the observation mirror 1 is connected.
  • gateways for example, a gateway configured on a wire / wireless router, a gateway of an Internet provider, etc.
  • access points for example, a wireless repeater, a base station, etc.
  • the observation mirror system of the present invention may comprise an observation mirror 1 and a server, and FIG. 5 shows one embodiment of such an observation mirror system.
  • the observation mirror 1 is connected to a server on a wired or wireless network, and image data transmitted from the communication unit 250 of the observation mirror 1 may be stored in the server.
  • the image data stored in the server can be used by a patient, doctor, or other person through a predetermined means.
  • the observation system transmits image data from the server in addition to the observation mirror 1 and the server through a wired or wireless communication means. It may be made further comprising a receiving terminal.
  • the terminal may be a wired terminal or a wireless terminal. As shown in FIG.
  • one or more gateways for example, a gateway set in a wire / wireless router, a gateway of an Internet provider, etc.
  • There may be one or more access points eg, a wireless repeater, a base station, etc.
  • the observation mirror 1 transmits image data as a digital signal there may be one or more repeaters for reproducing attenuated digital signals.
  • a remote doctor who is a doctor located at a distance from the observation mirror 1 analyzes the image data transmitted to the server or the terminal, and provides the analysis result and / or a related prescription to the user of the observation mirror 1, or to the server or the terminal.
  • the virtual doctor who is an installed image data analysis program may analyze the image data transmitted to the server or the terminal and provide the analysis result and / or a prescription related thereto to the user of the observation mirror 1.
  • the server or the terminal may authenticate the ID of the observer 1 so that the analysis result and / or a prescription thereof may be transmitted to the terminal owned by the observer 1 and the The ID may be authenticated so that the analysis result and / or the prescription related thereto may be delivered to the terminal owned by the observer 1.
  • the server or the terminal may authenticate the ID of the observer (1) so that the big data analysis result or the treatment prognosis comparison result may be delivered to the terminal owned by the observer (1), and the observer (1) By authenticating the ID of the observation device (1) may be a big data analysis results or treatment prognosis comparison results to the terminal owned by the user.
  • the manufactured observation mirror 1 has a pistol shape as a whole, so that the user can connect and grip the tube 180 to use it.
  • the manufactured observation mirror 1 may be divided into a head portion 10, a main body portion 20, and a connection portion 30.
  • the appearance of the manufactured observation mirror 1 is illustrated in FIGS. 6 and 7, and manufactured in FIG. 8.
  • the inside of the observed observation mirror 1 is shown.
  • the observation mirror 1 in which the head part 10 and the main body 20 shown in FIG. 6 are coupled is configured to separate the head part 10 and the main body part 20. .
  • the head unit 10 includes the light acquisition unit 110 shown in FIG. 8, the light emitting unit 120, the tube 180, the tube holder 130 shown in FIG. 7, the turn slider 150, and the fixing unit ( 160, the fixing groove 170, and although not shown in FIGS. 6 to 8, the turn guide 140 includes a turn guide 140 positioned between the tube holder 130 and the turn slider 150.
  • the tube holder 130 includes a tube holder protrusion 131
  • the turn guide 140 includes a guide surface 141
  • the turn slider 150 includes a turn slider groove ( 151).
  • the tube holder 130 includes a hole as shown in FIG. 7, and the user inserts the tube 180 into the hole as shown in FIG. 8 to use the observation mirror 1.
  • the fixing part 160 is a part which is fixed without being rotated, and a part which is not described above among the remaining parts will be described later.
  • the main body 20 includes an image sensor 210, an image processor 220, a light source 260, a display 240, a housing 270, and a handle 280 of FIG. 7. 6 to 8, but not shown, includes a memory 230 and a communication unit 250.
  • the housing unit 270 accommodates the image sensor 210, the image processor unit 220, the memory unit 230, the communication unit 250, the light source unit 260, and the like.
  • the handle part 280 is a part grasped by the user, and the remaining part has been described above.
  • the connection part 30 includes a pin 310 formed at one side of the head part 10 and a locker 320 formed at one side of the main body part 20, as shown in FIG. 7, and the head part 10.
  • the locker 320 includes a locker groove 321, a locker outer wall 322, and a locker inner wall 323.
  • 6 and 7 can be attached and detached by a structure in which the pin 310 and the locker 320 of the connecting portion 30 are separated or combined.
  • 9 and 10 show the structure of the connecting portion 30 in detail, and the parts unnecessary for explaining the detachment of the head portion 10 are not shown.
  • the user inserts the pin 310 into the locker groove 321 and rotates the locker 320 clockwise or counterclockwise to couple the head portion 10 to the main body portion 20.
  • the fixing part groove 170 is engaged with the locker outer wall 322, and the user still moves the head 10 back and forth in this state.
  • the head portion 10 can be separated from the main body portion 20.
  • the pin 310 inserted into the locker groove 321 is blocked by the locker inner wall 323 shown in FIG. Is in a state where it cannot be separated from the main body 20.
  • the user rotates the locker 320 clockwise or counterclockwise to align the locker groove 321 with the pin 310 and pulls the head portion 10 forward to move the head portion 10 to the main body. It can be separated from the portion 20.
  • the focal length can be adjusted by a structure that converts the rotational movement of the head portion 10 into a linear movement, and the structure of such a head portion 10 is shown in detail in FIGS. 11 and 12, and description of the focal length adjustment The unnecessary part is not shown.
  • the head portion 10 includes a tube holder protrusion 131, a tube holder 130 having a narrow front end and a wide rear end, a guide surface 141, and a tube holder 130.
  • a structure including a turn guide (140) surrounding a portion of the), a turn slider groove (151) engaged with the tube holder protrusion (131), and a turn slider (150) surrounding a portion of the turn guide (140). Equipped.
  • the tube holder 130 rotates counterclockwise and moves backwards (where The tube holder protrusion 131 moves along the guide surface 141.), and the focal length is shortened.
  • the turn guide 140 and the fixing part 160 which is not shown in FIGS. 11 and 12, do not move. That is, the focal length is adjusted while the rotational movement of the turn slider 150 is converted into the linear movement of the tube holder 130.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Surgery (AREA)
  • Engineering & Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Pathology (AREA)
  • Veterinary Medicine (AREA)
  • Public Health (AREA)
  • Biophysics (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Physics & Mathematics (AREA)
  • Animal Behavior & Ethology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Radiology & Medical Imaging (AREA)
  • Optics & Photonics (AREA)
  • Physiology (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Endoscopes (AREA)
  • Studio Devices (AREA)

Abstract

La présente invention concerne : un scope d'observation, qui comporte une partie de tête détachable et une distance focale pouvant être ajustée par la structure de la partie de tête ; et un système de traitement de données d'image activé par un examen médical à distance comprenant celui-ci, le scope d'observation étant destiné à photographier l'intérieur d'un objet. Le scope d'observation comprend : la partie de tête, qui comprend une unité d'acquisition de lumière pour générer un signal optique par acquisition de la lumière réfléchie depuis l'intérieur de l'objet ; et une partie de corps principal couplée à la partie de tête, et ayant une fonction de réception du signal optique de façon à générer des données d'image, la partie de tête pouvant être séparée de la partie de corps principal.
PCT/KR2017/003648 2016-04-06 2017-04-03 Scope d'observation pour examen médical à distance, et dispositif de traitement d'image et système le comprenant WO2017176021A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020160042376A KR101789677B1 (ko) 2016-04-06 2016-04-06 원격진료를 위한 관찰경과 이를 포함하는 영상처리장치 및 시스템
KR10-2016-0042376 2016-04-06

Publications (1)

Publication Number Publication Date
WO2017176021A1 true WO2017176021A1 (fr) 2017-10-12

Family

ID=60001570

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2017/003648 WO2017176021A1 (fr) 2016-04-06 2017-04-03 Scope d'observation pour examen médical à distance, et dispositif de traitement d'image et système le comprenant

Country Status (2)

Country Link
KR (1) KR101789677B1 (fr)
WO (1) WO2017176021A1 (fr)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000139819A (ja) * 1998-09-01 2000-05-23 Olympus Optical Co Ltd 内視鏡
KR20040047258A (ko) * 2002-11-29 2004-06-05 아람휴비스(주) 다용도 멀티 스코프 및 그 사용 방법
KR20040049036A (ko) * 2002-12-03 2004-06-11 김영철 영상촬영수단을 구비하는 의료기구
KR101023937B1 (ko) * 2010-10-19 2011-03-21 주식회사메드스타 스코프 탈착식 의료용 영상 진단장치 및 그 스코프 탈착식 의료용 영상 진단장치를 이용한 영상 진단방법
KR101444485B1 (ko) * 2006-11-16 2014-09-24 스트리커 코포레이션 무선 내시경 카메라

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000139819A (ja) * 1998-09-01 2000-05-23 Olympus Optical Co Ltd 内視鏡
KR20040047258A (ko) * 2002-11-29 2004-06-05 아람휴비스(주) 다용도 멀티 스코프 및 그 사용 방법
KR20040049036A (ko) * 2002-12-03 2004-06-11 김영철 영상촬영수단을 구비하는 의료기구
KR101444485B1 (ko) * 2006-11-16 2014-09-24 스트리커 코포레이션 무선 내시경 카메라
KR101023937B1 (ko) * 2010-10-19 2011-03-21 주식회사메드스타 스코프 탈착식 의료용 영상 진단장치 및 그 스코프 탈착식 의료용 영상 진단장치를 이용한 영상 진단방법

Also Published As

Publication number Publication date
KR101789677B1 (ko) 2017-10-25
KR20170114811A (ko) 2017-10-16

Similar Documents

Publication Publication Date Title
CN104756093B (zh) 用于移动或网络装置的可互换的无线感测装置
US7057639B2 (en) Intra-oral camera with integral display
JP6329715B1 (ja) 内視鏡システムおよび内視鏡
US20240069327A1 (en) Circuit board assembly for a multiple viewing elements endoscope using cmos sensors
US20070038020A1 (en) Endoscope apparatus
WO2016072586A1 (fr) Appareil et procédé de traitement d'images médicales
EP3682790A1 (fr) Système d'endoscope
KR20150074459A (ko) 사용자단말기 및 사용자단말기의 제어방법
WO2010058927A2 (fr) Dispositif pour photographier un visage
WO2016006765A1 (fr) Dispositif à rayons x
WO2005062253A1 (fr) Correction par rotation axiale pour images in vivo
WO2017176021A1 (fr) Scope d'observation pour examen médical à distance, et dispositif de traitement d'image et système le comprenant
JP7264051B2 (ja) 画像処理装置および画像処理方法
JP6368886B1 (ja) 内視鏡システム
WO2012015093A1 (fr) Procédé et dispositif de diagnostic à distance
US10149600B2 (en) Medical signal processing device and medical observation system
WO2019031894A1 (fr) Dispositif électronique à fonction de stabilisateur
WO2014101306A1 (fr) Système et procédé de commande de transmission sans fil basés sur un télescope
JP6444506B2 (ja) 画像表示制御装置、表示装置、及び、画像表示システム
US9832411B2 (en) Transmission system and processing device
WO2015070491A1 (fr) Systeme et procede de commande de transmission sans fil utilisant des jumelles
CN102309309A (zh) 具可拆屏幕的便携检耳镜
WO2012015094A1 (fr) Procédé et dispositif électronique de diagnostic à distance
WO2018026127A1 (fr) Injecteur de médicament pour télémédecine, et dispositif de traitement d'image et système le comprenant
US11528395B2 (en) Camera head

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17779321

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 17779321

Country of ref document: EP

Kind code of ref document: A1