CN112515698B - Auscultation system and control method thereof - Google Patents
Auscultation system and control method thereof Download PDFInfo
- Publication number
- CN112515698B CN112515698B CN202011328075.4A CN202011328075A CN112515698B CN 112515698 B CN112515698 B CN 112515698B CN 202011328075 A CN202011328075 A CN 202011328075A CN 112515698 B CN112515698 B CN 112515698B
- Authority
- CN
- China
- Prior art keywords
- target
- range
- quality
- signal
- sound
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B7/00—Instruments for auscultation
- A61B7/02—Stethoscopes
- A61B7/04—Electric stethoscopes
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B7/00—Instruments for auscultation
- A61B7/003—Detecting lung or respiration noise
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/13—Edge detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
- G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
- G06T7/74—Determining position or orientation of objects or cameras using feature-based methods involving reference images or patches
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R1/00—Details of transducers, loudspeakers or microphones
- H04R1/46—Special adaptations for use as contact microphones, e.g. on musical instrument, on stethoscope
Abstract
The invention provides an auscultation system and a control method thereof. The auscultation system comprises a radio, a quality sensor and an application program. The radio is used for receiving sound to output a sound signal. The quality sensor detects the quality of the radio to output a quality signal. The application program is applicable to the electronic device. After the application program is executed by the electronic device, the electronic device is used for executing a positioning program according to the image signal and the volume profile data and outputting a position guide; the electronic device executes an adjustment procedure according to the quality signal and the target quality range, and outputs a quality index.
Description
Technical Field
The present invention relates to an auscultation system, and more particularly, to an electronic auscultation system.
Background
The conventional stethoscope is composed of a stethoscope head, a stethoscope receiver, and a sound-transmitting tube connecting the stethoscope head and the stethoscope receiver. When using a conventional stethoscope, the physician must be directly confronted with the patient to perform auscultation. Considering the structure of the conventional stethoscope, doctors cannot wear isolation clothes during auscultation when facing patients with high infection. This results in high exposure of the physician to infection risk.
Recent remote medical treatment has been emerging to enable a physician to understand the physical condition of a patient without touching the patient. One such application is electronic stethoscopes. Telemedicine, however, means that the physician is in a different location than the patient. Therefore, how to complete the auscultation process without direct contact with the patient is a problem that physicians must face when performing auscultation using an electronic stethoscope.
Disclosure of Invention
In view of the above, the present invention provides an electronic auscultation system capable of providing feedback. According to some embodiments, an auscultation system includes an auscultation device and an application program. The auscultation device comprises a radio and a quality sensor. The radio is used for receiving a sound to output a sound signal. The quality sensor is used for detecting a quality of the radio receiver to output a quality signal. The application program is suitable for an electronic device. After the application program is executed by the electronic device, the electronic device is used for executing a positioning program according to the image signal and profile data, and the profile data comprises a target position range; outputting a position guide until a position of the radio receiver is substantially within the target position range; executing an adjustment procedure according to the quality signal and a target quality range; outputting a quality index until the quality signal is substantially within the target quality range.
According to some embodiments, an auscultation system includes an auscultation device and a non-transitory computer readable recording medium. The auscultation device comprises a radio and a quality sensor. The radio is used for receiving a sound to output a sound signal. The quality sensor is used for detecting a quality of the radio receiver to output a quality signal. The transient computer readable recording medium is used for storing an application program. The application program is used for executing the following steps: receiving an image signal; executing a positioning program according to the image signal and profile data, wherein the profile data comprises a target position range; outputting a position guide until a position of the radio receiver is substantially within the target position range; executing an adjustment procedure according to the quality signal and a target quality range; outputting a quality index until the quality signal is substantially within the target quality range.
According to some embodiments, a method for controlling an auscultation system comprises: receiving a sound signal; receiving a quality signal; receiving an image signal; executing a positioning program according to the image signal and the overall data, and outputting a position guide until the position of a radio receiver is substantially within a target position range; and executing an adjusting procedure according to the quality signal and the target quality range, and outputting a quality index until the quality signal is substantially in the target quality range.
In summary, according to some embodiments, the auscultation system provides adjustment guidance for the position and quality of the sound receiver. Through interaction with the user, the auscultation system can measure the sound signals meeting the quality requirement.
Drawings
FIG. 1 is a block diagram of an auscultation system according to some embodiments;
FIG. 2 is a block diagram of an auscultation system including a pressure sensor according to some embodiments;
FIG. 3 is a block diagram of an auscultation system including an audio sensor according to some embodiments;
FIG. 4 is a block diagram of an auscultation system according to other embodiments;
FIG. 5 is a flow diagram of an auscultation system according to some embodiments;
FIG. 6 is a flow chart of a pressure regulation procedure of an auscultation system according to some embodiments;
FIG. 7 is a flow diagram of a tuning procedure of an auscultation system according to some embodiments;
FIG. 8A is a schematic diagram of a wave pattern of an acoustic signal according to some embodiments;
FIG. 8B is a schematic diagram of a wave pattern of a target sound signal according to some embodiments;
FIG. 8C is a schematic diagram of waveforms of an interfering sound signal according to some embodiments;
FIG. 9A is a schematic diagram of a frequency spectrum of a target sound signal according to the embodiment of FIG. 8B;
FIG. 9B is a schematic diagram of a frequency spectrum of the disturbing sound signal according to the embodiment of FIG. 8C;
FIG. 10 is a flow diagram of an auscultation system according to other embodiments;
FIG. 11A is a schematic diagram of a position of a radio according to some embodiments;
FIG. 11B is a schematic diagram of waveforms of the acoustic signal at location L11 according to the embodiment of FIG. 11A;
FIG. 11C is a schematic diagram of a waveform of the acoustic signal at location L12 according to the embodiment of FIG. 11A;
FIG. 11D is a schematic diagram of a waveform of the acoustic signal at location L13 according to the embodiment of FIG. 11A;
FIG. 11E is a schematic diagram of a waveform of the acoustic signal at location L14 according to the embodiment of FIG. 11A;
FIG. 11F is a graph of the relationship between the location and the volume of the target sound signal according to the embodiment of FIG. 11A;
FIG. 12A is a schematic diagram of a position of a radio according to other embodiments;
FIG. 12B is a schematic diagram of waveforms of the acoustic signal at location L21 according to the embodiment of FIG. 12A;
FIG. 12C is a schematic diagram of a waveform of the acoustic signal at location L22 according to the embodiment of FIG. 12A;
FIG. 12D is a schematic diagram of a waveform of the acoustic signal at location L23 according to the embodiment of FIG. 12A;
FIG. 12E is a schematic diagram of waveforms of the acoustic signal at location L24 according to the embodiment of FIG. 12A;
FIG. 12F is a graph of the relationship between the location and the volume of the interfering sound signal according to the embodiment of FIG. 12A;
FIG. 13 is a diagram illustrating a auscultation system in use during a localization procedure according to some embodiments; FIG. 14A is a schematic diagram of a wave pattern of a pressure signal according to some embodiments; and
fig. 14B is a schematic diagram of waveforms of the sound signal according to the embodiment of fig. 14A.
Reference numerals:
auscultation system
11 auscultation device
111 radio
112 quality sensor
1121 pressure sensor
1122 audio sensor
12 application program
13 electronic device
131 image acquisition module
132 memory
133 prompt module
134 processor
14 non-transitory computer readable recording medium
3: position guidance
Target position Range
L11, L12, L13, L14, L21, L22, L23, L24 position
S101-S111 step
S201-S206 step
S301-S306 steps
S401-S414 steps
Detailed Description
Referring to fig. 1, fig. 1 is a block diagram of an auscultation system according to some embodiments. According to some embodiments, an auscultation system 1 includes an auscultation device 11 and an application 12. The auscultation device 11 includes a radio 111 and a quality sensor 112. The application 12 is adapted to the electronic device 13. The electronic device 13 includes an image capturing module 131, a memory 132, a prompting module 133, and a processor 134.
The auscultation system 1 is a system comprising an auscultation device 11, such as but not limited to a stand-alone device or a system incorporating an electronic device 13 such as a computer, a mobile phone, a tablet computer or an embedded circuit. According to some embodiments, the auscultation system 1 comprises the electronic device 13 itself and the auscultation device 11 connected with the electronic device 13 in a wired or wireless manner.
The radio receiver 111 is a device adapted to receive sound. According to some embodiments, the sound is generated by the organism without autonomous conscious control, and is not limited to the sound generated by general physiological conditions or pathological conditions. Such as but not limited to heart sounds, lung sounds, or gastrointestinal sounds. According to some embodiments, the sound receiver 111 can receive sound through direct contact with a human body.
The quality sensor 112 is used to measure the quality of the radio receiver 111. The quality is a parameter used to evaluate and adjust the quality of the reception of sound. According to some embodiments, the quality sensor 112 may be a pressure sensor 1121 or an audio sensor 1122.
Referring to fig. 2, fig. 2 is a block diagram of a auscultation system including a pressure sensor according to some embodiments. According to some embodiments, an auscultation system 1 includes an auscultation device 11 and an application 12. The auscultation device 11 includes a radio 111 and a pressure sensor 1121. The application 12 is adapted to the electronic device 13. The electronic device 13 includes an image capturing module 131, a memory 132, a prompt module 133, and a processor 134. According to some embodiments, the quality is pressure. The pressure sensor 1121 is used to detect the pressure applied to the sound receiver 111, so as to know the pressure applied to the sound receiver 111 by the user of the auscultation system 1. The pressure sensor 1121 is a device capable of converting pressure into a pressure signal, such as but not limited to a strain gauge, a piezoelectric sensor, or a capacitance type pressure sensor 1121. According to some embodiments, the pressure sensor 1121 is disposed directly on the outer surface or the inner surface of the sound receiver 111. The pressure applied to the sound receiver 111 refers to the pressure applied directly or indirectly to the sound receiver 111 by the user. The pressure signal is a voltage or current signal obtained by converting the pressure applied to the sound receiver 111 by the pressure sensor 1121.
Referring to fig. 3, fig. 3 is a block diagram of an auscultation system including an audio sensor according to some embodiments. According to some embodiments, an auscultation system 1 includes an auscultation device 11 and an application 12. The auscultation device 11 includes a radio 111 and an audio sensor 1122. The application 12 is adapted to the electronic device 13. The electronic device 13 includes an image capturing module 131, a memory 132, a prompt module 133, and a processor 134. According to some embodiments, the quality is sound. The audio sensor 1122 is used for converting the sound received by the sound receiver 111, so as to obtain the volume of the sound measured by the sound receiver 111 of the auscultation system 1. The audio sensor 1122 is a device capable of converting sound into an acoustic signal, such as but not limited to a capacitive sensor or a piezoelectric sensor. According to some embodiments, the audio sensor is directly disposed in the sound receiver 111. The sound signal refers to a voltage or current signal obtained by converting the sound received by the sound receiver 111 by the sound sensor 1122.
The application 12 may be, but is not limited to, a program applied to a computer, a mobile phone, a tablet computer, or an embedded circuit. According to some embodiments, the application 12 is a program adapted to be executed on an electronic device 13. According to some embodiments, the application 12 is a program burned on a chip. According to some embodiments, the application 12 is stored on a non-transitory computer readable medium 14. Referring to fig. 4, fig. 4 is a block diagram of an auscultation system according to other embodiments. An auscultation system 1 includes an auscultation device 11 and a non-transitory computer readable recording medium 14. The auscultation device 11 comprises a radio 111 and a quality sensor 112. The non-transitory computer readable medium 14 is used for storing the application 12. According to some embodiments, the non-transitory computer readable medium 14 can be, but is not limited to, a memory, an optical disc, a flash drive, a hard disk, a cloud storage space, and the like. For example, the electronic device 13 is a mobile phone, the Application 12 is a mobile phone Application (App), and the cloud storage space is an App store.
The electronic device 13 may be, but is not limited to, a computer, a mobile phone, a tablet computer, or an embedded circuit. According to some embodiments, the electronic device 13 may be a stand-alone consumer electronic product. According to some embodiments, the electronic device 13 may be a circuit board including the image capturing module 131, the memory 132, the prompting module 133, and the processor 134, and the circuit board is an internal component of a stand-alone device.
The image capturing module 131 is a device that can convert the light signal in the viewing area into an image signal, such as but not limited to a visible light sensing module or a non-visible light sensing module. According to some embodiments, the image capturing module 131 may include a depth sensor, such that the viewing area captured by the image capturing module 131 is not limited to a two-dimensional space or a three-dimensional space. According to some embodiments, the image capturing module 131 captures a viewing area including the radio 111 to output an image signal. The processor 134 determines the relative positions of the radio 111 and other identifiable features in the viewing area based on the image signal.
The memory 132 may be a non-volatile memory such as, but not limited to, a read-only memory, a flash memory, a hard disk, or a tape. According to some embodiments, the memory 132 is used to store the application 12. According to some embodiments, the memory 132 is used to store profile data and target quality ranges.
The profile data is reference data for assisting in determining the target position range 4 in the positioning process of the radio receiver 111. The target location range 4 refers to the range of locations to which the radio receiver 111 is expected to move. According to some embodiments, the target location range 4 may be a point or a general area range. According to some embodiments, the target location range 4 may be at least one value or at least one value that can be calculated through other parameters. The positioning procedure refers to a process of moving the radio receiver 111 to the target position range 4. According to some embodiments, the volume profile data may be image data. For example, but not limited to, the external contour of a human or animal body, and an internal organ layout. According to some embodiments, the volume profile data may be coordinate data. For example, but not limited to, the relative spatial coordinates of the internal organ with respect to the body surface features, the relative spatial coordinates of the target position range 4 with respect to the body surface features, and the like. According to some embodiments, the volume profile data may be a computational formula. For example, but not limited to, an algorithm for calculating the relative position of the internal organs through the spatial positions of the plurality of body surface features, an algorithm for calculating the relative position of the target position range 4 through the spatial positions of the plurality of body surface features, and the like. The target quality range refers to the range of quality that the radio 111 is expected to achieve.
The target quality range may be a specific upper or lower limit or a generalized range of values. According to some embodiments, the target quality range is a volume range of the sound signal. According to some embodiments, the target quality range is a range of values of the pressure signal. In the past studies of the inventors, it was found that in the case of performing auscultation using a conventional stethoscope, the intensity of the volume of respiratory sounds sufficient for clear recognition by human ears is about 60 to 75 db. When the pressure is applied to the stethoscope head, the stethoscope head is more closely attached to the skin of the person to be tested, and the sound quality and volume of the test are improved. Studies have shown that initial pressure values of about 40-60 mmhg should be applied to the stethoscope head to achieve 60-75 db of breath sound. Thus, according to some embodiments, the target pressure range is 40 to 60 mmhg.
The prompting module 133 prompts the information in a sensory-cognizable manner, such as, but not limited to, visual, auditory, tactile, and the like. The prompting module 133 can be, but is not limited to, a display screen, a speaker, a vibrating element, etc.
According to some embodiments, the processor 134 calculates the moving direction of the sound receiver 111 and generates the position guide 3 according to the relative position relationship between the sound receiver 111 and the surrounding images in the viewing area and the relative position relationship between the surrounding images in the volume profile data and the target position range 4. For example, the image signal of the finder area shows the positional relationship of the sound receiver 111 placed on the chest with respect to the upper body contour. The reference image of the contour data shows the relative position relationship between the upper body contour and the lung contour. The processor 134 compares the image signal with the reference image to calculate the relative position relationship of the radio 111 to the lung contour. The processor 134 controls the prompt module 133 to output the location guide 3 to instruct the adjustment of the sound receiver 111 to the target location range 4 of the corresponding lung. According to some embodiments, the processor 134 calculates the moving direction of the sound receiver 111 and generates the position guide 3 according to the relative position relationship between the sound receiver 111 and the surrounding images in the viewing area and the reference formula of the target position range 4 estimated by the surrounding image features in the volume data. For example, the image signal of the finder area shows the positional relationship of the sound receiver 111 placed on the chest with respect to the upper body contour. The reference formula for the volume data indicates that the heart is located in the middle of the two thoracic links. The processor 134 identifies the positions of the two breasts according to the image signal, and then calculates the position of the heart according to a reference formula. The processor 134 controls the prompt module 133 to output the position guide 3 to instruct to adjust the sound receiver 111 to the target position range 4 corresponding to the heart.
According to some embodiments, the processor 134 performs an adjustment procedure according to the quality signal and the target quality range, and controls the prompt module 133 to output the quality index until the quality signal is substantially within the target quality range. The quality index may be a command with the current quality or a target quality range or a command with how to adjust to a target quality range, for example a command with target pressure information or a command with increase or decrease pressure information. The format of the quality index may be, but is not limited to, a data format of numerical values, text, images, animation, audio, vibration frequency, and the like.
According to some embodiments, the processor 134 derives a quality adjustment for the radio 111 based on the difference between the quality signal and the quality target range and generates a quality metric. For example, the pressure signal indicates that the sound receiver 111 is subjected to the pressure exerted thereon by the user. The target pressure range indicates the range of pressures that the sound receiver 111 should withstand. The processor 134 compares the pressure signal to the target pressure range and calculates the difference therebetween. The processor 134 controls the prompt module 133 to output the pressure indication to adjust the pressure applied to the sound receiver 111 to the target pressure range meeting the quality target.
Referring to fig. 5, fig. 5 is a flow chart of an auscultation system according to some embodiments. According to some embodiments, the processor 134 reads the profile data and the target location range 4 stored in the memory 132 (S101). The image capturing module 131 captures the viewing area and outputs an image signal (S102). The processor 134 executes a positioning procedure according to the contour data and the image signal (S103). According to some embodiments, when the processor 134 determines that the viewing area does not include the recognizable image feature, the control prompt module 133 outputs a guidance for adjusting the viewing area until the viewing area includes the recognizable image feature. According to some embodiments, when the processor 134 determines that the viewing area includes the recognizable image features but does not include the radio 111 (S104), the control prompt module 133 outputs the position guide 3 to request the user to move the radio 111 to the target position range 4 (S105). According to some embodiments, when the processor 134 determines that the view area includes the recognizable image features and the sound receiver 111 but the position of the sound receiver 111 is not within the target position range 4 (S104), the control prompt module 133 outputs the position guide 3 to request the user to move the sound receiver 111 to the target position range 4 (S105). After the prompt module 133 outputs the position guide 3, the image capturing module 131 captures the viewing area (S102) to continue the positioning process. When the processor 134 determines that the viewing area includes the recognizable image features and the sound receiver 111 is located in the target position range 4 (S104), the processor 134 reads the target quality range stored in the memory 132 (S106). The quality sensor 112 detects the quality of the radio receiver 111 and outputs a quality signal, and the processor 134 receives the quality signal (S107). The processor 134 executes an adjustment procedure according to the target quality range and the quality signal (S108). When the processor 134 determines that the magnitude of the quality signal is higher or lower than the target quality range (S109), the control prompt module 133 outputs a quality indicator requesting adjustment of the radio 111 (S110). After the prompt module 133 outputs the quality index, the processor 134 receives the quality signal of the quality sensor 112 (S107) to continue the adjustment process. When the processor 134 determines that the quality signal is within the target quality range (S109), the processor 134 records the audio signal output by the audio receiver 111 (S111). After the recording of the sound signal is completed (S111), the auscultation system 1 continues the auscultation process of the next measurement point (S101). The foregoing steps need not be performed in a sequential manner. For example, the steps S101 and S102 are exchanged in sequence; the steps S106 and S107 are reversed.
According to some embodiments, the quality sensor 112 may be a pressure sensor 1121. Referring to fig. 6, fig. 6 is a flowchart of a pressure regulating procedure of an auscultation system according to some embodiments. According to some embodiments, the processor 134 reads the target pressure range stored in the memory 132 (S201). The pressure sensor 1121 detects the pressure applied to the radio receiver 111 and outputs a pressure signal, and the processor 134 receives the pressure signal (S202). The processor 134 executes a pressure regulating process according to the target pressure range and the pressure signal (S203). When the processor 134 determines that the pressure borne by the sound receiver 111 is less than the lower limit of the target pressure range (S204), the control prompt module 133 generates a pressure guide requiring pressure increase (S205); when the processor 134 determines that the pressure applied to the sound receiver 111 is greater than the upper limit of the target pressure range (S204), the control prompt module 133 generates a pressure guidance requesting to reduce the pressure (S205). After the prompting module 133 outputs the pressure guide, the processor 134 receives the pressure signal of the pressure sensor 1121 (S202) to continue the pressure regulating procedure. When the processor 134 determines that the pressure signal is within the target pressure range (S204), the processor 134 records the sound signal output by the sound receiver 111 (S206). The foregoing steps need not be performed in a sequential manner. For example, the steps S201 and S202 are reversed.
According to some embodiments, the quality sensor 112 may be an audio sensor 1122. Referring to fig. 7, fig. 7 is a flow chart of a tuning procedure of an auscultation system according to some embodiments. According to some embodiments, the processor 134 reads the target volume range stored in the memory 132 (S301). The audio sensor 1122 converts the sound received by the radio receiver 111 into an audio signal, and the processor 134 receives the audio signal (S302). The processor 134 executes a tuning program according to the target volume range and the sound signal (S303). Because the volume of the sound signal is related to the contact degree between the radio receiver 111 and the body of the user. Therefore, when the processor 134 determines that the sound received by the sound receiver 111 is less than the lower limit of the target volume range (S304), the control prompt module 133 generates a volume guidance requesting to increase the pressure (S305). After the prompt module 133 outputs the volume guidance, the processor 134 receives the sound signal of the audio sensor 1122 (S302) to continue the tuning process. When the processor 134 determines that the sound signal is within the target volume range (S304), the processor 134 records the sound signal output from the radio receiver 111 (S306). The foregoing steps need not be performed in a sequential manner. For example, the steps S301 and S302 are reversed.
According to some embodiments, before performing the tuning process (S303), the processor 134 performs a filtering process on the sound signal to obtain a filtered audio signal. The processor 134 performs a tuning procedure according to the target volume range and the filtered audio (S303) and the following steps. Referring to fig. 8A, fig. 8A is a schematic diagram of waveforms of an acoustic signal according to some embodiments. The horizontal axis of fig. 8A is presentation time; the vertical axis represents sound volume. According to some embodiments, the auscultation system 1 is applied for lung sound measurement. When the auscultation system 1 is placed in the thoracic position, the measured sound signal is as shown in fig. 8A. The sound signal can be distinguished into a target sound signal and an interference sound signal. Referring to fig. 8B, fig. 8B is a schematic diagram of waveforms of a target sound signal according to some embodiments. Fig. 8B shows the lung sound signal, which is the target sound signal to be measured. Referring to fig. 8C, fig. 8C is a schematic diagram of waveforms of an interfering sound signal according to some embodiments. Fig. 8C shows a heart sound signal, i.e., an interfering sound signal mixed in the sound signal rather than the target sound signal. Referring to fig. 9A and 9B, fig. 9A is a schematic diagram of a frequency spectrum of a target audio signal according to the embodiment of fig. 8B; fig. 9B is a schematic diagram of a frequency spectrum of the disturbing sound signal according to the embodiment of fig. 8C. The horizontal axes of fig. 9A and 9B represent the rendering frequency; the vertical axis represents sound volume. Fig. 9A is a frequency spectrum diagram obtained by fourier transforming the lung sound signal of fig. 8B; the spectrogram of fig. 9B is obtained by fourier transforming the heart sound signal of fig. 8C. Comparing fig. 9A and 9B, it can be seen that the lung sound signal and the heart sound signal have different spectral energy distributions. According to some embodiments, the processor 134 performs a filtering process on the sound signal by using a signal filter to obtain a filtered audio signal, i.e. the target sound signal or the interfering sound signal. According to some embodiments, the target volume range may be a volume range to which the target sound signal is to be raised or a volume range to which the interfering sound signal is to be lowered. According to some embodiments, the processor 134 divides the target sound signal of the filtered audio signal by the interfering sound signal of the filtered audio signal to enhance the signal-to-noise ratio of the signal, and performs a tuning procedure according to the divided filtered audio signal.
According to some embodiments, during the tuning process, when the volume of the sound signal is higher or lower than the target volume range and a predetermined time elapses, the processor 134 corrects the target location range 4 and controls the prompt module 133 to output the location guide 3. According to some embodiments, during tuning, when the intensity of the pressure signal is higher or lower than the target pressure range and a predetermined time has elapsed, the processor 134 corrects the target position range 4 and controls the prompt module 133 to output the position guide 3. The target position range 4 may be a point or a general area range. The predetermined time may be a user-defined value, a value generated according to an algorithm, or a value predetermined by a manufacturer or supplier when the manufacturer or supplier leaves the factory. According to other embodiments, the preset time is used to measure whether the execution time of the tuning program is too long. For example, the user may not be able to achieve the sound signal within the target volume range by increasing or decreasing the pressure applied to the sound receiver 111 after a long trial.
Referring to fig. 10, fig. 10 is a flow chart of a auscultation system according to other embodiments. According to some embodiments, the processor 134 reads the profile data and the target location range 4 stored in the memory 132 (S401). The image capturing module 131 captures the viewing area and outputs an image signal (S402). The processor 134 executes a positioning procedure according to the contour data and the image signal (S403). According to some embodiments, when the processor 134 determines that the view area includes the recognizable image features and the sound receiver 111 but the position of the sound receiver 111 is not within the target position range 4 (S404), the control prompt module 133 outputs the position guide 3 to request the user to move the sound receiver 111 to the target position range 4 (S405). After the prompt module 133 outputs the position guide 3, the image capturing module 131 captures the viewing area (S402) to continue the positioning process. When the processor 134 determines that the viewing area includes the recognizable image feature and the sound receiver 111 is located in the target position range 4 (S404), the processor 134 reads the target volume range stored in the memory 132 (S406). The audio sensor 1122 converts the sound received by the radio receiver 111 into an audio signal, and the processor 134 receives the audio signal (S407). The processor 134 performs a filtering process on the sound signal to obtain a filtered audio signal (S408). The processor 134 executes a tuning procedure according to the target volume range and the filtered audio and starts timing (S409). When the processor 134 determines that the magnitude of the quality signal is higher or lower than the target quality range (S410), it continues to determine whether the execution time of the tuning program exceeds the preset time (S411). If the execution time does not exceed the preset time, the processor 134 controls the prompt module 133 to output a pressure guidance for adjusting the pressure applied to the sound receiver 111 (S412). After the prompt module 133 outputs the pressure guide, the processor 134 receives the sound signal of the audio sensor 1122 (S407) to continue the tuning process. If the execution time exceeds the preset time, the processor 134 modifies the target location range 4 (S413) and re-executes the positioning procedure, instructing the user to move the radio receiver 111 to another location. When the processor 134 determines that the sound signal is within the target volume range (S410), the processor 134 records the sound signal output from the radio receiver 111 (S414). After the recording of the sound signal is completed (S414), the auscultation system 1 continues the auscultation process of the next measurement point (S401). The foregoing steps need not be performed in a sequential manner. For example, step S401 and step S402 are exchanged in sequence; the steps S406 and S407 are reversed. According to some embodiments, step S413 may be omitted. The target position range 4 is, for example, a general area range. Therefore, when the execution time of the tuning program exceeds the preset time, the processor 134 does not correct the target position range 4. Thereafter, the processor 134 controls the prompt module 133 to output the position guide 3, requesting the user to change the position of the radio receiver 111 within the general area of the original target position range 4.
Referring to fig. 11A, fig. 11A is a schematic diagram of a position of a radio according to some embodiments. FIG. 11A presents four positions of the radio 111 relative to the upper body contour: position L11, position L12, position L13, and position L14. Fig. 11A also shows the relative positions of the upper body contour and the lung contour. The sound signals measured at the positions L11, L12, L13 and L14 by the auscultation system 1 correspond to the waveform diagrams of fig. 11B to 11E in sequence. It is assumed that the lung sound is a target sound signal (a high-frequency signal of a dark color) and the heart sound is an interfering sound signal (a low-frequency signal of a light color), and that the main generation position of the lung sound is located in the right upper lung lobe. When the radio receiver 111 is moved from the position L11 to the position L14, an increase in the amplitude of the high frequency lung sound signal is observed in fig. 11B and 11E.
According to some embodiments, please refer to fig. 11F together, fig. 11F is a graph illustrating the relationship between the position and the volume of the target sound signal according to the embodiment of fig. 11A. The horizontal axis of FIG. 11F shows the position of the radio 111 in FIG. 11A; the vertical axis represents sound volume. In this embodiment, the target volume range is a volume range to which the target sound signal is to be boosted. When the sound receiver 111 is located at the position L11, the volume of the target sound signal measured by the sound receiver 111 at the position is lower than the lower limit of the target volume range (S410), and the processor 134 controls the prompt module 133 to prompt the position guide 3. If the user moves the radio receiver 111 from the position L11 to the position L12, the volume of the target audio signal measured by the radio receiver 111 at the position is still lower than the lower limit of the target volume range (S410), so the processor 134 controls the prompt module 133 to prompt the location guide 3. If the user moves the sound receiver 111 from the position L12 to the position L13, the volume of the target audio signal measured by the sound receiver 111 at the position is still lower than the lower limit of the target volume range (S410), thereby instructing the user to move the sound receiver 111. When the user moves the radio receiver 111 from the position L13 to the position L14, the volume of the target audio signal measured by the radio receiver 111 at the position is within the target volume range (S410), and thus the processor 134 records the target audio signal (S414).
Referring to fig. 12A, fig. 12A is a schematic diagram of a position of a radio according to other embodiments. Fig. 12A presents four positions of the radio 111 relative to the upper body contour: position L21, position L22, position L23, and position L24. The sound signals measured by the auscultation system 1 at the positions L21, L22, L23 and L24 correspond to the waveform diagrams of fig. 12B to 12E in sequence. It is assumed that the lung sound is a target sound signal (a high-frequency signal of a dark color) and the heart sound is an interfering sound signal (a low-frequency signal of a light color), and that the main generation position of the lung sound is located in the lower left lung lobe. When the radio receiver 111 moves from the position L21 to the position L24, the amplitude of the low frequency heart sound signal decreases in fig. 9B and 12E.
According to some embodiments, please refer to fig. 12F together, and fig. 12F is a graph illustrating the relationship between the position and the volume of the interfering sound signal according to the embodiment of fig. 12A. The horizontal axis of FIG. 12F shows the position of the radio 111 in FIG. 12A; the vertical axis represents sound volume. In the present embodiment, the target volume range is a volume range to which the interfering sound signal is to be reduced. When the sound receiver 111 is located at the position L21, the sound volume of the interfering sound signal measured by the sound receiver 111 at the position is higher than the upper limit of the target sound volume range (S410), and the processor 134 controls the prompt module 133 to prompt the position guide 3. If the user moves the sound receiver 111 from the position L21 to the position L22, the volume of the interfering sound signal measured by the sound receiver 111 at the position is still higher than the upper limit of the target volume range (S410), so the processor 134 controls the prompt module 133 to prompt the location guide 3. If the user moves the sound receiver 111 from the position L22 to the position L23, the volume of the interfering sound signal measured by the sound receiver 111 at the position is still higher than the upper limit of the target volume range (S410), thereby instructing the user to move the sound receiver 111. When the user moves the sound receiver 111 from the position L23 to the position L24, the volume of the interfering sound signal measured by the sound receiver 111 at the position is within the target volume range (S410), and thus the processor 134 records the target sound signal (S414).
According to some embodiments, the memory 132 is used for storing the sound signals, the target sound signals or the interference sound signals corresponding to different positions of the radio 111. According to some embodiments, the processor 134 determines the highest energy of the target sound signal among the sound signals corresponding to all the positions recorded in the memory 132, and records the sound signal or the target sound signal of the sound signal. According to some embodiments, the processor 134 determines the lowest interfering sound signal energy among the sound signals corresponding to all the spatial positions recorded in the memory 132, and records the sound signal or the target sound signal of the sound signal. For example, referring to fig. 12F, when the user still cannot find the position where the volume of the interfering sound signal is within the target volume range after moving the position of the radio 111 for a long time or for multiple times (e.g., position L24), the processor 134 records the sound signal with the relatively lowest volume of the interfering sound signal or the target sound signal of the sound signal (e.g., position L23).
According to some embodiments, the processor 134 calculates the energy of the target sound signal measured by each measurement point according to the target sound signal corresponding to the plurality of positions stored in the memory 132, so as to obtain the relation between the spatial positions of the measurement points and the signal energy, i.e. the energy distribution of the target sound signal. In other embodiments, the processor 134 calculates the energy of the interference sound signal measured by each measurement point according to the interference sound signal corresponding to the plurality of positions stored in the memory 132, so as to obtain the relation between the spatial position of the measurement points and the signal energy, i.e. the energy distribution of the interference sound signal. In both embodiments, the processor 134 can determine the optimal moving direction according to the energy gradient, and prompt the user to move the radio 111 toward the direction with the highest energy of the target audio signal or the lowest energy of the interfering audio signal.
Referring to fig. 13, fig. 13 is a schematic diagram illustrating a auscultation system in a use state of a positioning procedure according to some embodiments. According to some embodiments, the prompt module 133 is a screen. The screen displays an image of the position of the radio receiver 111 and a projected image generated according to the position guide 3 or the quality guide. According to some embodiments, as shown in fig. 13, the screen displays the image of the viewing area and the radio 111 therein; the screen prompts the information of how to move to the target position range 4 in a mode of projecting images by arrows; the screen presents the information of the target position range 4 in a dot projection image mode. The user moves the radio receiver 111 to the target position range 4 in accordance with the position guide 3 to perform sound signal measurement of the target position range 4.
According to some embodiments, the pressure signal detected by the pressure sensor 1121 may be applied to assist in diagnosis. The pathological features of partial breath sounds only occur in certain phases of the respiratory cycle. For example, crackle (Crackles) refers to the production of sounds like the rupture of alveoli when inhaling, representing a pathological meaning of alveolar dropsy. Referring to fig. 14A, fig. 14A is a schematic diagram of a waveform of a pressure signal according to some embodiments. The horizontal axis of fig. 14A represents measurement time; the vertical axis represents the pressure detected by the pressure sensor 1121. When the subject breathes, the pressure experienced by the radio 111 fluctuates as a result of the breathing causing the thoracic cavity to fluctuate. When inhaling, the chest abduction causes a pressure increase as measured by the pressure sensor 1121; when exhaling, the chest compressions cause the pressure measured by the pressure sensor 1121 to decrease. Referring to fig. 14B, fig. 14B is a schematic diagram illustrating waveforms of the sound signal according to the embodiment of fig. 14A. The horizontal axis of fig. 14B is presentation measurement time; the vertical axis is the volume at which the sound signal is presented. The sound signal generates a continuous large amplitude signal at a particular phase. By comparing fig. 14A and 14B together, it can be confirmed that the large amplitude signal is generated in the inspiration period. Consider that in a remote medical situation, a physician cannot observe the involuntary breathing movements of a patient even using video visits. Therefore, according to some embodiments, the auscultation system 1 provides information on the respiratory state of a specific sound signal by outputting the pressure signal and the sound signal to assist a physician in determining the cause of a pathology.
According to some embodiments, the auscultation system 1 comprises a wireless transmission module. And uploading the sound signal, the pressure signal, the information derived from the pressure signal or the information derived from the pressure signal to a cloud-end data system. The cloud data system can integrate information such as blood pressure, electrocardiogram and blood sugar to assist doctors in diagnosis.
According to some embodiments, the control method of the auscultation system 1 performs the following steps: a sound signal is received. A quality signal is received. An image signal is received. According to the image signal and the volume profile data, a positioning program is executed, and the prompt module 133 is controlled to output the position guide 3 until the position of the radio 111 is substantially within the target position range 4. The adjustment procedure is executed according to the quality signal and the target quality range, and the prompt module 133 is controlled to output the quality index until the quality signal is substantially within the target quality range.
According to some embodiments, the application 12 is a software that can be applied to the electronic device 13. The electronic device 13 may be, but is not limited to, a computer, a mobile phone, a tablet computer, or an embedded circuit. According to some embodiments, the application 12 is a software burned into the chip.
Claims (7)
1. An auscultation system, comprising:
an auscultation device, comprising:
a radio for receiving a sound to output a sound signal; and
a quality sensor for detecting a quality of the radio to output a quality signal; and
an application program, suitable for an electronic device, after the application program is executed by the electronic device, the electronic device is used for receiving an image signal:
executing a positioning program according to the image signal and profile data, wherein the profile data comprises a target position range;
outputting a position guide until a position of the radio receiver is substantially within the target position range, wherein the position guide is an instruction with the target position range or an instruction on how to move to the target position range;
executing an adjustment procedure according to the quality signal and a target quality range; and
outputting a quality index until the quality signal is substantially within the target quality range, wherein in the adjusting process, when the quality signal is higher or lower than the target quality range and a preset time elapses, the electronic device outputs the position index until the position of the radio receiver is changed, or when the quality signal is higher or lower than the target quality range and a preset time elapses, the electronic device corrects the target position range and outputs the position index until the position of the radio receiver is substantially within the corrected target position range, wherein the quality index is an instruction with the current quality or an instruction of the target quality range or an instruction of how to adjust to the target quality range;
the quality sensor comprises an audio sensor, the audio sensor is used for converting sounds received by the audio receiver to obtain the volume size of the sounds measured by the audio receiver, the target quality range comprises a target volume range, the adjusting program comprises a tuning program, and the electronic device is used for executing the tuning program according to the volume of the sound signal and the target volume range and outputting a volume guide until the volume of the sound signal is substantially within the target volume range;
the electronic device is used for executing the pressure regulating program according to the pressure signal and the target pressure range and outputting a pressure guide until the pressure signal is substantially within the target pressure range.
2. The auscultation system of claim 1, wherein the electronic device performs a filtering process on the sound signal to obtain a filtered audio signal before the electronic device performs the tuning process, the electronic device is configured to perform the tuning process according to the filtered audio signal and the target volume range and output the volume guide until the filtered audio signal is substantially within the target volume range.
3. The auscultation system of claim 2, wherein the electronic device further comprises a memory, the memory storing a plurality of the locations at which the sound signal is output by the radio, and the sound signal or filtered audio signal corresponding to each of the locations.
4. The auscultation system of claim 3, wherein the electronic device generates the location guide including a location moving direction according to the energy distribution of the filtered audio signals in the corresponding locations accessed by the memory.
5. The auscultation system of claim 1, wherein the electronic device further comprises a prompt module, the prompt module is a screen, the location guide is a projected image, and the electronic device controls the screen to display the image signal and the projected image.
6. An auscultation system, comprising:
an auscultation device, comprising:
a radio for receiving a sound to output a sound signal; and
a quality sensor for detecting a quality of the radio to output a quality signal; and
a non-transitory computer readable recording medium storing an application program, the application program being adapted for an electronic device, the application program being configured to:
receiving an image signal;
executing a positioning program according to the image signal and profile data, wherein the profile data comprises a target position range;
outputting a position guide until a position of the radio receiver is substantially within the target position range;
executing an adjusting program according to the quality signal and a target quality range, wherein in the adjusting process, when the quality signal is higher than or lower than the target quality range and a preset time elapses, the electronic device outputs the position guide until the position of the radio receiver is changed, or when the quality signal is higher than or lower than the target quality range and a preset time elapses, the electronic device corrects the target position range and outputs the position guide until the position of the radio receiver is substantially located in the corrected target position range, wherein the position guide is an instruction with the target position range or an instruction with how to move to the target position range; and
outputting a quality index until the quality signal is substantially within the target quality range, wherein the quality index is a command with a current quality or a target quality range or a command with how to adjust to the target quality range;
the sound receiver comprises a quality sensor, the quality sensor comprises an audio sensor, the audio sensor is used for converting the sound received by the sound receiver so as to obtain the sound volume measured by the sound receiver, the target quality range comprises a target volume range, the adjusting program comprises a tuning program, and the application program is used for executing the tuning program according to the sound volume and the target volume range and outputting a volume guide until the sound volume is substantially within the target volume range;
the electronic device is used for executing the pressure regulating program according to the pressure signal and the target pressure range and outputting a pressure guide until the pressure signal is substantially positioned in the target pressure range.
7. A method for controlling an auscultation system, comprising:
receiving a sound signal;
receiving a quality signal;
receiving an image signal;
executing a positioning program according to the image signal and profile data, and outputting a position guide until the position of a radio receiver is substantially within a target position range, wherein the position guide is an instruction with the target position range or an instruction on how to move to the target position range; and
executing an adjusting program according to the quality signal and the target quality range, and outputting a quality index until the quality signal is substantially within the target quality range, wherein in the adjusting process, when the quality signal is higher or lower than the target quality range and a preset time elapses, the position index is output until the position of the radio receiver is changed, or when the quality signal is higher or lower than the target quality range and a preset time elapses, the target position range is corrected, and the position index is output until the position of the radio receiver is substantially within the corrected target position range, wherein the quality index is an instruction with current quality or an instruction of the target quality range or an instruction of how to adjust to the target quality range;
the quality signal is the volume of a sound signal, the target quality range comprises a target volume range, the quality guide is a volume guide, and the adjusting program comprises a tuning program which is used for executing the tuning program according to the volume of the sound signal and the target volume range and outputting the volume guide until the volume of the sound signal is substantially within the target volume range;
the pressure sensor is used for detecting the pressure born by the radio to output a pressure signal, the target quality range comprises a target pressure range, the adjusting program comprises a pressure adjusting program, the pressure adjusting program is used for executing the pressure adjusting program according to the pressure signal and the target pressure range, and a pressure guide is output until the pressure signal is substantially positioned in the target pressure range.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011328075.4A CN112515698B (en) | 2020-11-24 | 2020-11-24 | Auscultation system and control method thereof |
| TW109144688A TWI768598B (en) | 2020-11-24 | 2020-12-17 | Stethoscope system and control method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011328075.4A CN112515698B (en) | 2020-11-24 | 2020-11-24 | Auscultation system and control method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112515698A CN112515698A (en) | 2021-03-19 |
| CN112515698B true CN112515698B (en) | 2023-03-28 |
Family
ID=74992898
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011328075.4A Active CN112515698B (en) | 2020-11-24 | 2020-11-24 | Auscultation system and control method thereof |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN112515698B (en) |
| TW (1) | TWI768598B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116916813A (en) * | 2021-10-12 | 2023-10-20 | 杏泽科技股份有限公司 | Method for collecting and presenting physiological signal data and position information, server and system for realizing method |
| WO2023136175A1 (en) * | 2022-01-12 | 2023-07-20 | ソニーグループ株式会社 | Information acquisition device and information processing system |
Family Cites Families (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4849424B2 (en) * | 2000-05-19 | 2012-01-11 | 医療法人鉄蕉会 | Auscultation system |
| WO2007046504A1 (en) * | 2005-10-21 | 2007-04-26 | Yamaguchi University | Stethoscope heart sound signal processing method and stethoscope device |
| JP5709750B2 (en) * | 2008-09-10 | 2015-04-30 | コーニンクレッカ フィリップス エヌ ヴェ | Sound source localization method and system |
| US20140276150A1 (en) * | 2013-03-15 | 2014-09-18 | Ying Sun | Apparatus for Acoustic Measurements of Physiological Signals with Automated Interface Controls |
| CN205054260U (en) * | 2015-10-16 | 2016-03-02 | 南阳市第二人民医院 | Auscultator for cardiology |
| CN206548527U (en) * | 2016-08-25 | 2017-10-13 | 赵选枝 | A kind of pocket combination is visited and examines device |
| CN107077531B (en) * | 2016-11-30 | 2021-04-30 | 达闼机器人有限公司 | Stethoscope data processing method and device, electronic equipment and cloud server |
| US11348688B2 (en) * | 2018-03-06 | 2022-05-31 | Advinow, Inc. | Systems and methods for audio medical instrument patient measurements |
| CN108710108A (en) * | 2018-06-20 | 2018-10-26 | 上海掌门科技有限公司 | A kind of auscultation apparatus and its automatic positioning method |
| CN109077751A (en) * | 2018-06-28 | 2018-12-25 | 上海掌门科技有限公司 | For auscultating the method and apparatus of target auscultation |
| WO2020137212A1 (en) * | 2018-12-26 | 2020-07-02 | 富士フイルム株式会社 | Stethoscope and electronic stethoscope device |
-
2020
- 2020-11-24 CN CN202011328075.4A patent/CN112515698B/en active Active
- 2020-12-17 TW TW109144688A patent/TWI768598B/en active
Also Published As
| Publication number | Publication date |
|---|---|
| CN112515698A (en) | 2021-03-19 |
| TWI768598B (en) | 2022-06-21 |
| TW202220619A (en) | 2022-06-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| RU2506041C2 (en) | Device for displaying information about blood pressure system of displaying information about blood pressure, method of displaying information about blood pressure and information carrier with recorded programme of displaying information about blood pressure | |
| CN112515698B (en) | Auscultation system and control method thereof | |
| RU2334462C2 (en) | Method for tracking time changes in indices of blood vessels elasticity and device for bioinformation take-out | |
| JP5098721B2 (en) | Blood pressure measurement device, blood pressure derivation program, and blood pressure derivation method | |
| JP6692420B2 (en) | Auxiliary device for blood pressure measurement and blood pressure measurement device | |
| CN112804941A (en) | Apparatus and method for detecting physiological events | |
| CN109906052B (en) | Device comprising a blood pressure sensor and method for controlling the device | |
| US20240099597A1 (en) | Tactile Blood Pressure Imager | |
| WO2015122193A1 (en) | Blood pressure estimation device, blood pressure estimation method, blood pressure measurement device and recording medium | |
| WO2021171226A2 (en) | Method and apparatus for edema detection | |
| WO2015137412A1 (en) | Living-body sensor, living-body-data collection terminal, living-body-data collection system, and living-body-data collection method | |
| US20210315542A1 (en) | Physiological information measurement apparatus and physiological information system | |
| JP6766710B2 (en) | Blood pressure measuring device, method and program | |
| CN102202567A (en) | Error detection method and apparatus of electronicsphygmomanometer and electronicsphygmomanometer | |
| WO2022056159A1 (en) | Ultrasound probe with pressure measurement capability | |
| JP2018153259A (en) | Biological information measuring device, method, and program | |
| CN105615859B (en) | Blood pressure measurement auxiliary device, blood pressure measurement equipment and design method thereof | |
| US20180125377A1 (en) | Blood pressure measurement device, blood pressure measurement method, and recording medium | |
| CN116867426A (en) | Method and system for measuring blood pressure | |
| EP3400872B2 (en) | Portable device for monitoring vascular access status | |
| WO2021193170A1 (en) | Patient monitor, physiological information display method and program | |
| JP7193080B2 (en) | Information processing device, system, information processing method, and program | |
| JP7065592B2 (en) | Ultrasonic probe, ultrasonic measurement system | |
| WO2023181824A1 (en) | Heart sound acquisition device, heart sound acquisition system, heart sound acquisition method, and program | |
| CN109805904B (en) | Pulse condition diagnosis device with skin compensation function and traditional Chinese medicine robot |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |