JP7168255B2 - Human body part mapping system and image data generation application - Google Patents

Description

The present invention relates to a system for generating image data, and more particularly to a human body part mapping system and an image data generation application that can associate information such as the date and time of collection and the position of a patient's body with images collected by a camera .

[Conventional technology]
A conventional auscultatory device detects a patient's auscultatory sound to recognize the patient's health condition.

[Related technology]
Incidentally, as related prior art documents, Japanese Unexamined Patent Application Publication No. 2008-113939 “Body Sound Auscultation Device” (Patent Document 1), Japanese National Publication of International Patent Application No. 2008-528124 “Analysis of Auscultatory Sound Using Voice Recognition” (Patent Document 2) ), Japanese Patent Publication No. 2018-504722 "Personal Safety/Security Mobile Application Responding to Changes in Heart Rate" (Patent Document 3), International Publication No. 2017/145930 "Information Processing Apparatus for Medical Examination Apparatus" (Patent Document 4) There is

Patent Literature 1 describes a device that monitors body sounds of a patient and determines the patient's condition from the monitored data.
US Pat. No. 6,200,000 describes a method of speech recognition of auscultatory sounds to generate speech recognition coefficients, and mapping the coefficients to a set of disease regions defined in a multidimensional space.

Patent Literature 3 describes an application that uses a heartbeat monitor to detect out of normal range, drives a camera, microphone, etc., carried by the user, and notifies the person in charge of the protected person of the obtained data by sending it. It is
Japanese Patent Application Laid-Open No. 2002-200002 describes a processing device that displays a schematic diagram of a three-dimensional image of a human body and shooting viewpoint markers that indicate the shooting direction and shooting range, and changes the states of the schematic diagram and the shooting viewpoint markers.

JP-A-2008-113939 Japanese Patent Publication No. 2008-528124 Japanese Patent Application Publication No. 2018-504722 WO2017/145930

However, although the conventional auscultatory sound processing apparatus recognizes the patient's health condition based on the auscultated sound, it does not efficiently identify the collected auscultatory sound data and promote its use. There was a problem that it was not

Patent Documents 1 to 4 do not describe generating an auscultation sound data file in which information such as the date and time of collection and the position of the patient's body are associated with the auscultation sound data.

The present invention has been made in view of the above-mentioned actual situation, and promotes the use of image data by generating an image data file in which information such as the date and time of collection and the position of the patient's body is associated with image data collected by a camera . It is an object of the present invention to provide a human body part mapping system and an image data generation application.

The present invention, which solves the above-described problems of the prior art, is a human body part mapping that generates an image data file for image data of a still image or a moving image photographed by specifying the parts and positions of the patient's human body. A terminal device used in a system that, when recording an image , displays a diagram simulating a human body on the display unit. , the image data file is generated by generating a file name including recording date/time data, patient site data, body position data, and input patient ID data.

According to the present invention, in the above terminal device, the file name of the image data file includes device type data, terminal individual serial ID data, and a check digit.

The present invention provides a human body part mapping system comprising the above terminal device, a camera that acquires image data and transmits it to the terminal device, and a collection server that collects image data files generated by the terminal device. characterized by

According to the present invention, in the above-described human body part mapping system, the collection server extracts, from the file name of the collected image data file, recording date and time data, patient part data, human body position data, and patient ID. data is read and displayed on the display unit.

The present invention is an application that operates on a terminal device used in a human body region mapping system. Once identified, a file name including recording date and time data, patient part data, human body position data, and input patient ID data is generated in the recorded image data, and an image data file is created. It is characterized by functioning to generate

According to the present invention, in image data of a still image or a moving image captured by specifying the part and position of the patient's human body, a diagram simulating the human body is displayed on the display unit when the image is recorded . Then, when the part and position of the human body to be photographed are specified, the recorded image data includes data on the date and time of recording , data on the part of the patient, data on the position of the human body, and data on the input patient ID. Since the terminal device generates a file name and generates an image data file, it is possible to identify the patient, the date and time of collection, and the position of the collection site by the file name of the image data, which has the effect of promoting the use of the image data.

It is a schematic block diagram of this system. 1 is a configuration block diagram of a digital stethoscope; FIG. 3 is a configuration block diagram of a terminal device; FIG. It is a figure of the schematic screen which shows the process in a terminal device. It is a processing flow chart in a terminal device. FIG. 4 is a diagram of a display screen of an auscultatory sound collection server;

An embodiment of the present invention will be described with reference to the drawings.
[Outline of Embodiment]
The auscultation site mapping system (this system) according to the embodiment of the present invention displays a schematic diagram of the human body on a terminal device such as a tablet or a smartphone, and displays the position of the site collected by the stethoscope, the date and time of collection, and the patient ID (identification). number), a doctor's comment, etc., a file name containing the information is generated for the collected auscultatory sound data, and an auscultatory sound data file having that file name is generated. can identify the patient, the date and time of collection, the position of the collection site, etc. by the file name, and can promote the use of the auscultatory sound data.

The auscultation sound data generation application (application) (this application) according to the embodiment of the present invention operates on the terminal device used in this system, and is used to generate the auscultation sound collection date and time, patient ID, and auscultation sound. Input the position of the collected part, etc., generate a file name from that information, and generate a file of the auscultation sound data as the file name of the collected auscultation sound data, which can promote the use of the auscultation sound data. is.

[This system: Fig. 1]
The system will be described with reference to FIG. FIG. 1 is a schematic configuration diagram of this system.
As shown in FIG. 1, this system includes a digital stethoscope 1, a terminal device 2 such as a tablet or smart phone, an auscultatory sound collection server 3, and a network 4.

[Each part of this system]
Each part of this system will be specifically described with reference to the drawings. FIG. 2 is a configuration block diagram of a digital stethoscope, and FIG. 3 is a configuration block diagram of a terminal device.
[Digital stethoscope 1: Figure 2]
As shown in FIG. 2, the digital stethoscope 1 includes an input section 11 for inputting an auscultatory sound, and a first conversion section 12 for converting an analog sound signal of the input auscultatory sound into digital sound data (auscultatory sound data). a transmitter 13 for transmitting auscultatory sound data to the terminal device 2; a second converter 14 for converting the auscultatory sound data into an analog sound signal; and an amplifier 15 for amplifying and outputting the analog sound signal. ing. Although not shown, a speaker is connected to the amplifier 15 so that the doctor can hear the auscultatory sound.

[Terminal device 2: FIG. 3]
The terminal device 2 is a terminal device, such as a tablet or a smartphone, on which this application operates.
As shown in FIG. 3, the terminal device 2 includes a receiving section 21 that receives auscultatory sound data from the transmitting section 13 of the digital stethoscope 1, and an auscultatory sound data file that is generated by recording auscultatory sound data by operating this application. a storage unit 23 for storing auscultation sound data files; a transmission unit 24 for transmitting auscultation sound data to the auscultation sound collection server 3; a display unit 25 for displaying a schematic diagram simulating a human body; and an input unit 26 for specifying (mapping) the part of the. A touch panel is used for the display unit 25 and the input unit 26 .

In the terminal device 2, the application is stored in the storage unit 23 and the application is operated by the control unit 22 to realize characteristic processing.
The auscultation sound data file generated by the control unit 22 is provided from the transmission unit 24 to the auscultation sound collection server 3 via the network 4 . A specific method of generating the auscultatory sound data file will be described later.

[Auscultation sound collection server 3: Fig. 1]
The auscultation sound collection server 3 is a computer device connected to the network 4, stores auscultation sound data files provided from the terminal device 2, and analyzes the auscultation sound data files.

Specifically, as shown in FIG. 1, the auscultatory sound collection server 3 includes a control section 31, a storage section 32, and an interface section 33, and a display section 34 and an input section 35 are connected.
The control unit 31 reads and executes the processing program stored in the storage unit 32 and displays the processing result on the display unit 34 . A display example on the display unit 34 will be described later.
Also, the interface unit 33 is connected to the network 4 , the display unit 34 and the input unit 35 .

[Network 4]
The network 4 connects the terminal device 2 and the auscultation sound collection server 3 . The network 4 may be closed or open. In the case of an open network, the auscultation sound data files flowing through network 4 are encrypted.
The terminal device 2 and the network 4 are connected by, for example, a wireless LAN (Local Area Network/Wi-Fi), and the digital stethoscope 1 and the terminal device 2 are connected by short-range wireless communication for digital devices. .

[Processing in terminal device 2: FIGS. 4 and 5]
Processing in the terminal device 2 will be described with reference to FIGS. FIG. 4 is a diagram of a schematic screen showing processing in the terminal device, and FIG. 5 is a processing flow diagram in the terminal device.
When this application is started, the control unit 22 displays a schematic diagram simulating a human body on the display unit 25 as shown in FIG. 4(a) (S1).
Before recording auscultation sound data, the patient ID and the device type of the stethoscope are set. This setting may be made after recording.

Then, as shown in FIG. 4(b), the part to be auscultated with the stethoscope is specified on the screen (S2). When a position is specified (mapped) on the screen (S3) and recording of the auscultatory sound is started (S4), the control section 22 converts the specified position into data of the body parts and positions (S5). .

Further, it is determined whether or not an instruction to end the recording of the auscultatory sound has been input (S6). Date and time data of time (data of date and time when recording started), patient ID data, device type data, terminal individual serial ID data, patient part data, human body position data (coordinates data), a check digit, etc., to generate an auscultatory sound data file (S7).
A doctor's comment of up to 10 double-byte characters can be added to the file name.

A specific auscultatory sound data format will be described.
The basic information is represented by 41 bytes, with 1 byte added as a check digit to make 42 bytes, and 10 characters of text can be included as an extension. The text part can be omitted.

First, the first 14 bytes are the recording date and time, the next 8 bytes are the patient ID, the next 3 bytes are the manufacturer type, model, and revision, the next 5 bytes are the terminal individual serial ID, the next 1 byte is the ventral side, The dorsal side indicates unspecified, the next 2 bytes indicate the site head, chest, abdomen, right upper extremity, left upper extremity, both lower extremities, unspecified, the next 4 bytes indicate the X coordinate, and the next 4 bytes indicate The Y coordinate is indicated, the next 1 byte indicates the check digit, and then up to 10 characters of double-byte text can be added.
Although the seven check (7DR) method is used as the check digit, other methods may be used.

[Processing in auscultation sound collection server: Fig. 6]
The auscultatory sound collection server 3 receives the auscultatory sound data file provided from the terminal device 2 from the interface unit 33 connected to the network 4 and stores it in the storage unit 32 . The auscultatory sound collection server 3 also includes a display section 34 and an input section 35 .

Then, as shown in FIG. 6, when the control unit 31 of the auscultation sound collection server 3 reads the auscultation sound data file from the storage unit 32, the file name is identified and a schematic diagram indicating the measurement site and position is displayed on the display unit 34. , date and time, patient ID, face, body part, remarks, etc. are displayed, and auscultatory sound data can be reproduced.
Note that the remarks are comments entered by the doctor.

Also, the control unit 31 of the auscultation sound collection server 3 analyzes the auscultation sound data file stored in the storage unit 32 .
In the auscultation sound data file, since the date and time of recording, the patient ID, the part of the patient's body, and the position can be identified from the file name, the attribute of the auscultation sound data can be determined only by the file name, and the use of classification, analysis, etc. is possible. It is easy and can promote utilization of auscultatory sound data.
Further, the control unit 31 of the auscultation sound collection server 3 displays a schematic diagram on the display unit 34, and displays the parts and positions of the human body for a plurality of recorded auscultation sound data of the patient. is selected, the data on the right side of FIG. 6 may be displayed and the auscultatory sound may be reproduced.

[Application example]
In this system, the file generation of the auscultatory sound data has been described, but the system may be applied to the generation of data files of human body sounds other than the auscultatory sound (breathing sound, for example, heartbeat sound, pulse sound, etc.).
Furthermore, instead of the auscultation sounds, this application generates image data files by specifying the recording date and time, patient ID, model, patient's body part, and position for the data of still images and videos taken by the camera. It can be applied to That is, using a file name generating technique, the image data file is generated by giving the file name to the image data.

[Effects of Embodiment]
According to this system, a schematic diagram of the human body is displayed on a terminal device 2 such as a tablet or a smartphone. When the information is input, an auscultation sound data file is generated with the information as the file name for the collected auscultation sound data. This has the effect of being able to identify and promote the use of auscultatory sound data.

In addition, this application operates on the terminal device 2, and inputs the collection date and time of the auscultatory sound collected by the digital stethoscope 1, the patient ID, the position of the part where the auscultatory sound was collected, etc., and uses that information to create a file. Auscultation sound data is generated as a file name of the collected auscultation sound data, and the auscultation sound data can be associated with the recording date and time, patient ID, etc., and the auscultation sound data can be effectively used. effective.

The present invention provides an auscultation site mapping system and an auscultation system capable of generating an auscultatory sound data file in which information such as the date and time of collection and the position of the patient's body is associated with the auscultatory sound data collected by a stethoscope, thereby promoting the use of the auscultatory sound data. Suitable for sound data generation applications.

REFERENCE SIGNS LIST 1 digital stethoscope 2 terminal device 3 auscultatory sound collection server 4 network 11 input unit 12 first conversion unit 13 transmission unit 14 second conversion unit 15 Amplifier 21 Receiver 22 Controller 23 Storage 24 Transmitter 25 Display 26 Input 31 Control 32 Storage 33 Interface 34 display unit, 35 input unit

Claims (5)

A terminal device used in a human body part mapping system for generating the image data file for image data of a still image or a moving image captured by specifying a part and position of a patient's human body ,
When the image is recorded , a diagram simulating the human body is displayed on the display unit, and when the part and position of the human body to be photographed are specified, the recorded image data includes data on the date and time of recording and the patient's position. 1. A terminal device that generates an image data file by generating a file name including data on a part, data on the position of a human body, and data on an input patient ID. 2. The terminal device according to claim 1, wherein the file name of the image data file includes device type data, terminal individual serial ID data, and check digit. a terminal device according to claim 1 or 2;
a camera that acquires image data and transmits it to the terminal device;
and a collection server for collecting image data files generated by the terminal device. The collection server reads the recording date and time data, the patient's part data, the human body position data, and the patient ID data from the file name of the collected image data file, and displays them on the display unit. 4. The human body part mapping system according to claim 3. An application that operates on a terminal device used in a human body part mapping system,
When recording an image , a diagram simulating the human body is displayed on the display unit, and when the part and position of the human body to be photographed are specified, the recorded image data includes data on the date and time of the recording and the part of the patient. data, position data of the human body, and input patient ID data, and generate a file name to generate an image data file .

Images