TWI759965B - A method for inspection based on a inspection module that can cooperate with a portable electronic device - Google Patents

Abstract

A method for inspection based on a inspection module that can cooperate with a portable electronic device, wherein the inspection module includes an independent casing, two color camera lenses arranged on the independent casing and exposed on one side, and a A thermal image lens on one side of the two color camera lenses and a communication interface for information connection with a portable electronic device are exposed on the independent casing. During implementation, the two color camera lenses are used to obtain at least two different color wound images when photographing a wound by the difference of the photographic distance, and at the same time, the thermal imaging lens is made to photograph the wound to obtain at least one wound surface temperature distribution. image, and then transmit the color wound images and the temperature distribution image of the wound surface to the portable electronic device through the communication interface for evaluation of the treatment of the wound.

Description

A method for inspection based on a inspection module that can cooperate with a portable electronic device

The present invention relates to a detection method and a detection module applied thereto, in particular to a detection method based on a detection module that can be matched with a portable electronic device and a detection module applied thereto.

In the prior art, when measuring the wound area, a wound measuring ruler is often used to detect the size of the wound in an intuitive manner, and when detecting the depth of the wound, the detection is usually performed by using a cotton swab to probe into the wound. However, the conventional wound inspection methods are all subjectively judged by medical staff, and the inspection results will vary due to the different habits and methods of the inspectors, resulting in the inability to accurately quantify the wound status of the injured.

In view of this, many manufacturers are currently working to develop a systematic way to detect wound status. However, most of the existing systematic injury inspection devices are implemented in the form of special equipment. When medical personnel conduct injury inspection, medical personnel are bound to use the special equipment for inspection. Once the number of injured persons is large and the hospital cannot provide enough equipment, the wound inspection time will be delayed, making it impossible for the injured to receive inspection and classification in the first place.

The main purpose of the present invention is to solve the problem that the conventional injury inspection system is implemented in the form of special equipment, and when the number of injured persons is large, it is easy to cause the injured persons to be unable to perform inspection and classification at the first time.

In order to achieve the above object, the present invention provides a flaw detection module matched with a portable electronic device, comprising an independent casing, two color camera lenses, a thermal imaging lens and a communication interface. The two color camera lenses are installed on the independent housing and are simultaneously exposed on one side of the independent housing. The two color camera lenses are arranged separately and define an imaginary axis at the midpoint between the two color camera lenses. The virtual axis The extension does not touch the two color camera lenses. The two color camera lenses can generate at least two different color wound images when photographing a wound due to the difference in the shooting distance. The thermal imaging lens is arranged on the side of the independent casing where the two color camera lenses are exposed, and is located at On the imaginary axis, the thermal imaging lens captures the wound to generate at least one temperature distribution image of the wound surface. The communication interface is informationally connected with a portable electronic device, and the communication interface transmits the color wound images and the temperature distribution image of the wound surface to the portable electronic device for evaluation of the wound treatment.

In one embodiment, the inspection module transmits data to the portable electronic device via the communication interface based on a transmission rule, and the basic transmission sequence of the transmission rule is one of the color wounds generated by one of the two color camera lenses The image, one of the color wound image and the temperature distribution image of the wound surface generated by the other of the two color camera lenses are transmitted cyclically.

In one embodiment, the communication interface is a connector implemented with the USB communication protocol.

In addition to the foregoing, the present invention also provides a method for rapid injury detection, comprising the steps of: Step 1: use the aforementioned inspection module to approach a wound, and drive the inspection module, so that the two-color camera lens and a thermal imaging lens belonging to the inspection module are respectively photographed on the wound to obtain at least two colors wound image and a wound surface temperature distribution image; Step 2: receiving the color wound images and the temperature distribution image on the wound surface with a portable electronic device that is information-connected to the wound inspection module; and Step 3: Make a computing module belonging to the portable electronic device perform wound analysis based on the color wound images and the temperature distribution image of the wound surface, generate a wound treatment data and display it on a screen belonging to the portable electronic device .

In one embodiment, the third step further includes a sub-step of: distinguishing the wound components contained in the wound based on the plurality of wound feature blocks generated by the wound analysis, and generating a wound component distribution map.

In one embodiment, the third step further includes a sub-step: obtaining a wound depth information based on the two-color wound image and a certain set of standard parameters of the two-color camera lens.

In one embodiment, the third step further includes a sub-step: superimposing the color wound images, performing color gamut analysis on the superimposed images to obtain a clustered area of wound pixels, and using the two color camera lenses. The calibration parameters and the wound pixel cluster area are used to obtain an actual wound size information.

In one embodiment, the inspection module is connected with the portable electronic device in a wired manner.

As disclosed in the foregoing summary of the invention, compared with the conventional technology, the present invention has the following features: the inspection module of the present invention only needs to be combined with an electronic device with a computing function, so that the wound can be inspected, and the inspection model can be greatly improved. The flexibility of the group.

The detailed description and technical content of the present invention are described as follows in conjunction with the drawings:

Please refer to FIG. 1 to FIG. 4 and FIG. 6 , the present invention provides a trauma detection module 10 matched with a portable electronic device. The trauma detection module 10 is used for rapid detection of human body trauma wounds. The portable electronic device 30 is an electronic device that can provide computing functions, such as a smart phone or a tablet computer.

Continuing from the above, the inspection module 10 includes an independent casing 11 , two color camera lenses 12 and 13 , a thermal imaging lens 14 , and a communication interface 15 . Specifically, the independent casing 11 can be assembled with the portable electronic device 30 , so that the inspection module 10 can be used together with the portable electronic device 30 . The two color camera lenses 12 and 13 are disposed on the independent casing 11 and exposed on one side of the independent casing 11 . More specifically, the two color camera lenses 12 and 13 are disposed on the independent casing 11 and are not connected to the portable electronic device. 30 contacts the side, so that the two color camera lenses 12 and 13 will not be shielded by the portable electronic device 30 when the independent casing 11 is implemented in combination with the portable electronic device 30 . The two color camera lenses 12 and 13 are spaced apart and define a midpoint 121. The two color camera lenses 12 and 13 define an imaginary axis 122 on the midpoint 121. The extension of the imaginary axis 122 does not contact the two color cameras. Lenses 12, 13. When the two color camera lenses 12 and 13 are photographing a wound 60 , the two color camera lenses 12 and 13 have different distances from the wound 60 (ie, different shooting distances), so that the two color camera lenses 12 and 13 can At least two different color wound images 123 , 131 are generated by the difference in camera distance. In addition, the thermal imaging lens 14 is disposed on the side of the independent housing 11 where the two color camera lenses 12 and 13 are located and is located on the imaginary axis 122. The thermal imaging lens 14 is actually an infrared thermal imaging lens. The imaging lens 14 generates at least one wound surface temperature distribution image 141 by sensing an infrared light reflected by the wound 60 during imaging using the principle of infrared imaging.

In addition, the communication interface 15 is informationally connected with the two color camera lenses 12, 13 and the thermal imaging lens 14, and at the same time, the communication interface 15 is informationally connected with the portable electronic device 30, and the communication interface 15 receives the two color camera lenses 12, The color wound images 123, 131 from 13 and the wound surface temperature distribution image 141 from the thermal imaging lens 14, and the color wound images 123, 131 and the wound surface temperature distribution map The image 141 is transmitted to the portable electronic device 30 so that the portable electronic device 30 can perform the assessment treatment of the wound 60 . For example, after the communication interface 15 transmits the color wound images 123 and 131 to the portable electronic device 30 , the portable electronic device 30 can calculate the current wound size of the wound 60 based on the color wound images 123 and 131 . Area size, color, distribution, depth distribution and other related information, and then determine the type of the wound 60, and when the communication interface 15 transmits the wound surface temperature distribution image 141 to the portable electronic device 30, make the portable electronic device 30. The device 30 can calculate the current inflammation state of the wound 60 based on the wound surface temperature distribution image 141 , and enable the portable electronic device 30 to provide dressing suggestions based on the type and inflammation state of the wound 60 .

As can be seen from the above, the inspection module 10 of the present invention is an independent device, and the independent device can be used in combination with different portable electronic devices 30 at will. Compared with the conventional one, the inspection module 10 of the present invention only needs to be matched with The electronic device with the computing function can inspect the wound, which greatly improves the flexibility of the inspection module 10 . Furthermore, after the two color camera lenses 12, 13 and the thermal imaging lens 14 of the present invention capture the image of the wound 60, the two color camera lenses 12, 13 and the thermal imaging lens 14 do not perform operations on the images but transmit the images to The portable electronic device 30 performs subsequent judgments, that is, the portable electronic device 30 of the present invention does not actually perform the computing function, but only records the captured color wound images 123 and 131 and the wound surface temperature distribution image. 141 is transmitted to the portable electronic device 30, whereby the inspection module 10 of the present invention can specifically reduce the workload and improve the operation efficiency.

In one embodiment, the inspection module 10 transmits data to the portable electronic device 30 via the communication interface 15 based on a transmission rule 101 , and the basic transmission sequence of the transmission rule 101 is one of the two color camera lenses 12 and 13 One of the color wound images 123, 131 generated, one of the color wound images 123, 131 generated by the other of the two color camera lenses 12, 13, and the wound surface temperature distribution image 141, and according to This loop passes. For example, the basic transmission sequence of the transmission rule 101 may be the color wound image 123 generated by the color camera lens 12 , the color wound image 131 generated by the color camera lens 13 , and the temperature distribution map of the wound surface. Like 141, and loop in the aforementioned order. In addition, when the inspection module 10 transmits data based on the transmission rule 101, the inspection module 10 can set the amount of data transmitted per second, for example, the inspection module 10 can transmit 30 images per second for the portable electronic device 30 . In another embodiment, the inspection module 10 can be connected with the portable electronic device 30 in a wired manner. Specifically, when the communication interface 15 can be a connector implemented by the USB communication protocol, the inspection The damage module 10 can be connected with the portable electronic device 30 through the USB connector.

In addition to the above, please refer to FIG. 1 , FIG. 3 and FIG. 4 , the present invention also provides a method 90 for rapid injury detection, including steps: Step 1 91: Use the aforementioned inspection module 10 to approach the wound 60, and drive the inspection module 10, so that the two color camera lenses 12, 13 and the thermal imaging lens 14 to which the inspection module 10 belongs are respectively photographing the wound 60 to obtain the at least two color wound images 123, 131 and the wound surface temperature distribution image 141; Step 2 92 : Receive the color wound images 123 , 131 and the wound surface temperature distribution image 141 through the portable electronic device 30 that is informationally connected to the wound inspection module 10 ; and Step 3 93 : Make a computing module 31 belonging to the portable electronic device 30 perform wound analysis with the color wound images 123 , 131 and the wound surface temperature distribution image 141 to generate a wound treatment data 311 and display it on the on a screen 32 to which the portable electronic device 30 belongs.

Specifically, at the beginning of implementation, the inspection module 10 is informationally connected to the portable electronic device 30. For example, the inspection module 10 can be connected to information in a wired manner using the USB connector. Group 10 can also be connected wirelessly using Bluetooth pairing. Next, enter step 1 91 , use the inspection module 10 to approach the wound 60 and drive the inspection module 10 to make the two color camera lenses 12 and 13 and the thermal imaging lens 14 capture the wound 60 respectively. , the two color camera lenses 12 , 13 generate the color wound images 123 , 131 based on the wound 60 , and the thermal imaging lens 14 generates the wound surface temperature distribution image 141 . Next, in the second step 92, the inspection module 10 transmits the color wound images 123, 131 and the wound surface temperature distribution image 141 to the portable electronic device 30, so that the portable electronic device 30 receives the aforementioned images , and go to step 393. After the computing module 31 of the portable electronic device 30 obtains the color wound images 123, 131 and the wound surface temperature distribution image 141, the computing module 31 performs wound analysis based on the aforementioned images. For example, the The computing module 31 can calculate the relevant data such as the area, shape, color and depth of the wound 60 based on the color wound images 123 and 131, and then determine the type of the wound 60, such as whether the wound 60 is contaminated and whether the wound 60 is contaminated or not. The degree of damage to the skin tissue of the wound 60 and the like. Meanwhile, the computing module 31 also calculates the current temperature of the wound 60 based on the temperature distribution image 141 of the wound surface to determine the degree of inflammation of the wound 60 . Further, the computing module 31 generates the wound treatment data 311 based on the type of the wound 60 and the degree of inflammation of the wound 60 and displays it on the screen 32. For example, the wound treatment data 311 may be a dressing suggestion, the The computing module 31 can determine the most suitable type of dressing for the wound 60 currently based on the wound 60 inspection type.

Continuing from the above, in the present invention, after the images captured by the wound 60 are captured by the two color camera lenses 12 and 13 and the thermal imaging lens 14 respectively, the computing module 31 can first analyze the two color wound images 123 and 131 to obtain the images. The basic classification of the wound 60 is preliminarily performed, and the computing module 31 then analyzes the temperature distribution image 141 of the wound surface to make a further judgment on the wound 60. Compared with the conventional method, the computing module 31 of the present invention The two color wound images 123 and 131 and the wound surface temperature distribution image 141 must be calculated one by one, thereby reducing the calculation burden of the calculation module 31 .

In one embodiment, please refer to FIG. 1, FIG. 4 to FIG. 6, the step 3 93 further includes a sub-step 931: based on the plurality of wound feature blocks 312 generated by the wound analysis, the wound components included in the wound 60 are distinguished, And produce an injury component distribution map 313 . Further, the operation module 31 generates the wound feature blocks 312 after completing the wound analysis based on the aforementioned images, and the wound feature blocks 312 respectively represent the injury conditions of different regions in the wound 60 , that is, each of the wound feature blocks 312 Data such as depth, temperature, and color of the wound feature block 312 may vary. That is to say, the operation module 31 can represent the wound components contained in the wound 60 through the wound feature blocks 312 . Further, the computing module 31 generates the injury component distribution map 313 based on the wound components included in the wound 60 , and then the computing module 31 can generate the wound treatment data 311 based on the injury component distribution map 313 .

In addition, please refer to FIG. 1 , FIG. 4 and FIG. 7 , in one embodiment, the third step 93 may include a sub-step 932 : based on the two color wound images 123 , 131 and the two color camera lenses 12 , 13 A parameter group is selected to obtain a wound depth information. In detail, the two color camera lenses 12 and 13 can be calibrated and calibrated before shooting. For example, the two color camera lenses 12 and 13 can be calibrated using a square drawing. After that, the computing module 31 is based on the The calibration parameter set is obtained from certain calibration parameters generated by the two color camera lenses 12 and 13 during calibration and correction. and the calibration parameter group can include the respective internal parameters (such as focal length, imaging origin, etc.) of the two color camera lenses 12 and 13, as well as translation matrices, rotation matrices, common focal length and parallel distance, etc. . Next, after receiving the two-color wound images 123 and 131 , the arithmetic module 31 performs image correction based on the calibration parameter set. At the same time, the arithmetic processing module can further utilize the triangle ranging principle and SGBM (Semi-Global The Block Matching algorithm performs stereo matching on the two color wound images 123 and 131 to obtain the wound depth information.

In addition, please refer to FIG. 1 , FIG. 4 , and FIG. 8 , in one embodiment, the step 3 93 may further include a sub-step 933 : superimposing the color wound images 123 and 131 , and performing the process on the superimposed images. Color gamut analysis is performed to obtain a wound pixel cluster area, and an actual wound size information is obtained by using the calibration parameters of the two color camera lenses 12 and 13 and the wound pixel cluster area. Specifically, the computing module 31 obtains the color wound images 123 and 131 and then superimposes the color wound images 123 and 131 , and then determines the distribution position of the wound 60 based on the superimposed images and determines the distribution position of the wound 60 based on the superimposed images. Color gamut analysis in color spaces such as RGB, YUV, and HSV. The operation module 31 separates the uninjured skin and the wound 60 based on the result of the color gamut analysis, and then obtains the wound pixel cluster area, wherein the wound pixel cluster area is used to describe the wound in the colored wounds Distribution on images 123, 131. Next, the computing module 31 obtains actual wound size information by using the calibration parameters of the two color camera lenses 12 and 13 and the number of pixels in the wound pixel cluster area.

On the other hand, in an embodiment, please refer to FIG. 1 , FIG. 4 , FIG. 9 and FIG. 10 , in step 3 93 , the computing module 31 can be informationally connected with a memory module 40 , the computing module 31 transmits the wound analysis result to the memory module 40, and causes the memory module 40 to store the wound analysis result and generate a historical wound data 41, so that the operation module 31 can extract the historical wound data 41 in the future as the judgment parameter of the wound treatment data 311 . In one embodiment, the memory module 40 may be a cloud database. In another embodiment, the computing module 31 can further receive a wounded data 51 and associate the wounded data 51 with the wound analysis result, so that the memory module 40 can store the wound analysis based on different wounded data 51 As a result, the injured person data 51 may include the name, age and gender of a wounded person 50 .

To sum up, the above is only a preferred embodiment of the present invention, and should not limit the scope of implementation of the present invention, that is, all equivalent changes and modifications made according to the scope of the patent application of the present invention should still belong to the present invention. patent coverage.

10: Triage module

101: Transmission Rules

11: Independent shell

12: Color camera lens

121: Midpoint

122: Imaginary axis

123: Color Wound Image

13: Color camera lens

131: Color Wound Images

14: Thermal imaging lens

141: Image of temperature distribution on wound surface

15: Communication interface

30: Portable Electronic Devices

31: Operation module

311: Wound Management Information

312: Wound Feature Block

313: Distribution map of injury components

32: Screen

40: Memory Module

41: Historical wound information

50: The Wounded

51: Information on the injured

60: wound

90: Method

91: Step 1

92: Step Two

93: Step Three

931: Substep

932: Substep

933: Substep

FIG. 1 is a schematic structural diagram of a flaw detection module according to an embodiment of the present invention. FIG. 2 is a schematic diagram of the transmission rule of the inspection module according to an embodiment of the present invention. FIG. 3 is a schematic diagram (1) of the steps of a rapid inspection method according to an embodiment of the present invention. FIG. 4 is a structural unit diagram (1) of an embodiment of the present invention. FIG. 5 is a schematic diagram (2) of the steps of a rapid inspection method according to an embodiment of the present invention. FIG. 6 is a schematic diagram of the distribution of injury components according to an embodiment of the present invention. FIG. 7 is a schematic diagram (3) of steps of a method for rapid injury detection according to an embodiment of the present invention. FIG. 8 is a schematic diagram (4) of steps of a method for rapid injury detection according to an embodiment of the present invention. FIG. 9 is a structural unit diagram (2) of an embodiment of the present invention. FIG. 10 is a structural unit diagram (3) of an embodiment of the present invention.

10: Triage module

11: Independent shell

12: Color camera lens

121: Midpoint

122: Imaginary axis

13: Color camera lens

14: Thermal imaging lens

15: Communication interface

30: Portable Electronic Devices

Claims (7)

A flaw detection module matched with a portable electronic device, comprising: an independent casing, which is an independent device relative to a portable electronic device and is externally hung on the portable electronic device; two color camera lenses are arranged on the independent casing and are simultaneously exposed on the The independent casing is not in contact with the portable electronic device. The two color camera lenses are arranged separately and define an imaginary axis at the midpoint between the two color camera lenses. The extension of the imaginary axis does not touch the two color cameras. a camera lens, the two color camera lenses can generate at least two different color wound images when photographing a wound by the difference of the photographic distance; a thermal imaging lens is arranged on the independent casing to reveal a part of the two color camera lenses side, and located on the imaginary axis, the thermal imaging lens shoots the wound to generate at least one image of temperature distribution on the surface of the wound; and a communication interface, which is connected with the portable electronic device in a wired connection; wherein the injury inspection model The group transmits data to the portable electronic device through the communication interface based on a transmission rule to make the portable electronic device perform the treatment evaluation of the wound, and the transmission order of the transmission rule is one of the two color camera lenses. One of the color wound image, one of the color wound image generated by the other of the two color camera lenses, and the temperature distribution image of the wound surface, and these are transmitted cyclically. The inspection module matched with the portable electronic device as claimed in claim 1, wherein the communication interface is a connector implemented with a USB communication protocol. A method for rapid injury inspection, comprising the following steps: Step 1: Using the injury inspection module as set forth in any one of request items 1 to 2 to approach a wound, and drive the injury inspection module to make the inspection module to which the injury inspection module belongs. Two color camera lenses and a thermal imaging lens respectively photograph the wound to obtain at least two color wound images and a wound surface temperature distribution image; Step 2: receiving the color wound images and the temperature distribution images of the wound surface with a portable electronic device that is informationally connected to the inspection module, and the inspection module is connected to the portable electronic device through a wired connection. The inspection module transmits data to the portable electronic device according to a transmission rule, and the transmission order of the transmission rule is one of the color wound images generated by one of the two color camera lenses, and the other of the two color camera lenses. One of the generated color wound images and the temperature distribution image on the wound surface are transmitted cyclically; and step 3: make a computing module belonging to the portable electronic device use the color wound images with the wound image The wound surface temperature distribution image is used for wound analysis, and a wound treatment data is generated and displayed on a screen to which the portable electronic device belongs. The method for rapid wound detection according to claim 3, wherein the step 3 further comprises a sub-step: distinguish the wound components contained in the wound based on the plurality of wound feature blocks generated by the wound analysis, and generate a Injury composition distribution map. The method for rapid wound detection according to claim 3 or 4, wherein step 3 further comprises a sub-step: obtaining a wound depth based on the two-color wound image and a certain set of standard parameters of the two-color camera lens News. The method for rapid wound detection according to claim 3 or 4, wherein step 3 further comprises a sub-step: superimposing the color wound images, and performing color gamut analysis on the superimposed images to obtain a wound In the pixel cluster area, an actual wound size information is obtained by using the calibration parameters of the two color camera lenses and the wound pixel cluster area. The method for rapid wound detection according to claim 6, wherein the step 3 further includes a sub-step: obtaining a wound depth information based on the two-color wound image and a certain set of standard parameters of the two-color camera lens.

Images