JP5951244B2 - Information terminal device, telemetry system, information terminal device control method, control program, and recording medium - Google Patents

Description

  The present invention relates to an information terminal device, a telemetry system, a control method for an information terminal device, a control program, and a recording medium for examining a patient at a remote place.

  In recent years, with the development of communication technology, measurement results of a measurement subject measured by a measurement device, a video of the measurement subject, and the like can be transmitted to a remote device via a network. .

  This has realized a telemetry system that enables home medical care and home-visit nursing. For example, in a telemetry system, the patient's (measured person) 's condition is measured on the spot, and the measurement results (vital information such as auscultation sound, blood pressure, body temperature) are measured remotely (examiner, doctor, etc.) ) Device. As a result, the doctor can examine a patient at a remote place while in the hospital. On the other hand, patients and caregivers in the field can measure vital information under the guidance of a doctor without having special knowledge. As described above, various proposals have been made to realize a telemetry system for examining a remote patient using a communication information terminal device.

  For example, Patent Document 1 discloses an interactive medical examination system in which both doctors and patients use mobile terminals to exchange information used for medical examination in real time and perform face-to-face medical examination. . The information exchanged includes, for example, voice (inquiries, instructions, etc.), medical data (body temperature, pulse, heart sound, blood pressure, ECG, etc.), image information (patient facial expressions, etc.) A more advanced examination can be performed using the terminal.

  For example, Patent Document 2 discloses an auscultation system in which auscultation sound signals of auscultation sounds collected from a patient are filed and transmitted to a remote unit by a computer. This makes it possible to realize nursing outside the medical facility such as home-visit medical care and home nursing (care) without degrading the quality of medical care.

JP 2006-042662 A (published February 16, 2006) JP 2001-333899 A (published December 4, 2001)

  However, the above conventional configuration causes the following problems.

  In the telemetry system, it is assumed that a person to be measured measures his / her vital information using a measuring device (such as a stethoscope). In this case, the examiner at the remote location instructs the measurement site to the measurement subject.

  In the technique of Patent Document 1, a method is employed in which a examiner confirms a person to be measured with an image and guides the position of a stethoscope to the target measurement site by voice. However, the person to be measured cannot visually confirm the correct measurement site, and has to search for the measurement site according to the sound transmitted one by one. Therefore, there is a problem that the measurement subject cannot efficiently grasp the correct measurement site.

  In the technique of Patent Document 2, the measurement site is indicated by a pseudo image. However, when the person to be measured specifies the measurement site of his / her body, there is a problem that it is difficult to understand intuitively.

  The present invention has been made in view of the above-mentioned problems, and the purpose of the present invention is to enable the measurer to easily grasp the measurement site when the subject himself / herself performs measurement. An information terminal device, a telemetry system, an information terminal device control method, a control program, and a recording medium are realized.

  In order to solve the above-mentioned problem, the information terminal device according to the present invention is a first information terminal device that communicates with the second information terminal device and constructs a telemetry system for measuring the subject. A still image with information provided by the second information terminal device, wherein a mark indicating at least a measurement site to be measured is added to the measurement subject image representing the affected area of the measurement subject. A mirror image generating unit that generates a mirror image by reversing left and right, and an arrangement determining unit that determines to arrange the mirror image generated by the mirror image generating unit on the display screen of the display unit. It is characterized by.

  According to the above configuration, the first information terminal device is a stationary with information in which a mark representing the measurement site is added to any of the measurement subject's body on the measurement subject image from the second information terminal device. Receive images. And the mirror image production | generation means of a 1st information terminal device inverts the said still image with information for every mark of a measurement site | part, and produces | generates a mirror image. As a result, a mirror image that reflects the body of the subject to be measured is displayed on the display unit that is horizontally reversed along with the mark of the measurement site.

  Therefore, in the telemetry system, in the second information terminal device, on the display unit viewed by the user observing the person to be measured, the person-to-be-measured image and the still image with information are all displayed as normal images. On the other hand, a mirror image is displayed on the display unit viewed by the measurement subject. That is, the user of the second information terminal device normally observes the subject via the subject image in the same state as when a person other than the subject observes the subject in person. Can do. On the other hand, the person being measured can observe his / her state through the mirror image in the same state as when the subject is reflected in the mirror.

  For this reason, the measurement subject who is the user of the first information terminal device can immediately intuitively determine the measurement site designated by the user of the second information terminal device with the same feeling as if he / she sees himself / herself reflected in the mirror. Can grasp.

  From the above, it is possible to realize a highly convenient telemetry system that enables the measurer to easily grasp the measurement site when the subject himself / herself performs measurement as the measurer.

  The mirror image generation means generates a mirror image image by horizontally inverting the measurement subject image obtained by photographing the affected area of the measurement subject, and the arrangement determination means displays the mirror image image, the mirror image image, and the mirror image on the display screen. May be arranged side by side.

  Note that a configuration in which the arrangement determining unit arranges the still image with information and the mirror image side by side also falls within the scope of the present invention.

  Further, the first information terminal device includes a reversal control unit that controls whether or not a reversal process of the display object arranged on the display screen is necessary, and the reversal control unit includes a normal image mirror image input by a user. According to the switching instruction, it is determined whether or not the inversion process is necessary, and the arrangement determining unit arranges either the subject image that is a normal image or the mirror image according to the determination of the inversion control unit. can do.

  This enables the measurer to easily grasp the measurement site even when the subject himself / herself becomes a measurer or when another measurer performs measurement on the subject. An even more convenient telemetry system can be realized.

  Alternatively, the first information terminal device includes a first display unit for displaying a mirror image of at least one of the mirror image and a mirror image obtained by horizontally inverting the measurement subject image obtained by imaging the affected area of the measurement subject. A second display unit for displaying a normal image of at least one of the still image with information and the video of the person to be measured, and a video signal of the display screen whose arrangement is determined by the arrangement determination unit on the display unit Display control means for outputting, wherein the display control means outputs a video signal of the display screen on which the mirror image is arranged to the first display unit and also outputs a video signal of the display screen on which the normal image is arranged. It can output to the said 2nd display part.

  This enables the measurer to easily grasp the measurement site even when the subject himself / herself becomes a measurer or when another measurer performs measurement on the subject. An even more convenient telemetry system can be realized.

  Alternatively, the display unit is a multi-image directional liquid crystal display in which screens having different contents can be viewed on a single screen from different directions, and the arrangement determining unit images the mirror image and the affected area of the subject. A first display screen on which at least one of the mirror image images obtained by horizontally inverting the subject image, and a first image on which at least one of the still image with information and the subject image is disposed. Display control means for generating two display screens and outputting a video signal obtained by synthesizing the first display screen and the second display screen generated by the arrangement determining means to the display unit.

  This enables the measurer to easily grasp the measurement site even when the subject himself / herself becomes a measurer or when another measurer performs measurement on the subject. An even more convenient telemetry system can be realized.

  Alternatively, the mirror image generation means generates a mirror image by reversing the measurement subject video obtained by photographing the affected area of the measurement subject, and generates a superimposed mirror image that overlaps the mirror image and the mirror image. Superimposing means may be further provided.

  The arrangement determination means may further arrange a GUI component for inputting the normal image mirror image switching instruction on the display screen.

  This enables the measurer to easily grasp the measurement site even when the subject himself / herself becomes a measurer or when another measurer performs measurement on the subject. An even more convenient telemetry system can be realized.

  Alternatively, the display unit is a touch panel capable of accepting a user's contact operation, and the inversion control unit is inverted according to a normal image mirror image switching instruction based on the contact operation received via the touch panel. The necessity of processing may be determined.

  This enables the measurer to easily grasp the measurement site even when the subject himself / herself becomes a measurer or when another measurer performs measurement on the subject. An even more convenient telemetry system can be realized.

  In order to solve the above-described problem, the second information terminal device of the present invention communicates with the first information terminal device and constructs a telemetry system for measuring the subject to be measured. A device that adds information to the measured person image representing the affected area of the measured person, including at least a mark indicating the measurement site to be measured, input by the user, And a still image output unit for outputting the still image with information generated by the combining unit to the first information terminal device.

  According to the above configuration, the second information terminal device edits a still image that shows the current state of the measurement subject according to an instruction of the measurement instructor who is the user of the second information terminal device. It is possible to generate a still image with information in which a mark representing the measurement site is added to any body of the measurement subject on the measurement subject image.

  Accordingly, the first information terminal device that has received the information-added still image can horizontally flip the information-added still image for each measurement site mark to generate a mirror image and display it on the display unit. .

  For this reason, the measurement subject who is the user of the first information terminal device can immediately intuitively determine the measurement site designated by the user of the second information terminal device with the same feeling as if he / she sees himself / herself reflected in the mirror. Can grasp.

  From the above, it is possible to realize a highly convenient telemetry system that enables the measurer to easily grasp the measurement site when the subject himself / herself performs measurement as the measurer.

  Furthermore, the second information terminal device includes a still image acquisition means for extracting the measured person image from a measured person image obtained by photographing the affected area of the measured person provided from the first information terminal apparatus. It may be.

  Further, the second information terminal device includes a reversal necessity determination unit that determines whether or not the input information input by the user should be displayed in reverse with the measurement subject image, and the reversal necessity Non-inverted information output means for outputting, as non-inverted information, input information determined to be inversion-free by the determining means, and the synthesizing means outputs the input information determined to be inverted by the inversion necessity determining means to the input information It is preferable to synthesize to the measurement subject image.

  Further, the inversion necessity determination unit may determine text information representing a character string input to the measurement subject image as input information that does not require inversion.

  Alternatively, the inversion necessity determination unit determines that the input information is not necessary when the input information input to the measurement subject image is determined to be a character as a result of the character recognition process. May be.

  Alternatively, the inversion necessity determination means determines that the input information input after the gesture meaning inversion not necessary is input and the input information input after the gesture meaning inversion is input. May be determined as requiring reversal.

  Alternatively, on the display unit of the second information terminal device, a first input tool for inputting input information that does not need to be inverted together with the measurement subject image, and a second input for inputting input information that needs to be inverted The tool is displayed in a selectable manner, and the inversion necessity determination means determines that the input information input when the first input tool is selected is not necessary to be inverted, and the second input tool is selected. It may be determined that the input information input when the user is in need of inversion.

  A telemetry system constructed by including the above-described first information terminal device and the above-described second information terminal device also falls within the scope of the present invention.

  In order to solve the above-described problem, the first information terminal device control method of the present invention communicates with the second information terminal device and constructs a telemetry system for measuring a subject. The information terminal device control method according to claim 1, wherein at least a mark indicating a measurement site to be measured is provided on the measurement subject image representing the affected area of the measurement subject provided from the second information terminal device. Mirror image generation step for generating a mirror image by flipping the added still image with information left and right, and determining to arrange the mirror image generated in the mirror image generation step on the display screen of the display unit And an arrangement determining step.

  In order to solve the above-described problem, the second information terminal device control method of the present invention communicates with the first information terminal device to construct a telemetry system that performs measurement on the person being measured. The method of controlling the information terminal device according to claim 1, wherein input information including at least a mark indicating a measurement site to be measured, which is input by the user, is added to the measurement subject image representing the affected area of the measurement subject. A combining step of generating a still image with information, and a still image output step of outputting the still image with information generated in the combining step to the first information terminal device. It is a feature.

  The first information terminal device and the second information terminal device may be realized by a computer. In this case, the information terminal device is operated by the computer by operating the computer as each means. The control program for the first information terminal device, the control program for the second information terminal device, and the computer-readable recording medium that records at least one of them are also included in the scope of the present invention. enter.

  In order to solve the above-mentioned problem, the information terminal device according to the present invention is a first information terminal device that communicates with the second information terminal device and constructs a telemetry system for measuring the subject. A still image with information provided by the second information terminal device, wherein a mark indicating at least a measurement site to be measured is added to the measurement subject image representing the affected area of the measurement subject. A mirror image generating unit that generates a mirror image by reversing left and right, and an arrangement determining unit that determines to arrange the mirror image generated by the mirror image generating unit on the display screen of the display unit. It is characterized by.

  In order to solve the above-described problem, the second information terminal device of the present invention communicates with the first information terminal device and constructs a telemetry system for measuring the subject to be measured. A device that adds information to the measured person image representing the affected area of the measured person, including at least a mark indicating the measurement site to be measured, input by the user, And a still image output unit for outputting the still image with information generated by the combining unit to the first information terminal device.

  In order to solve the above-described problem, the first information terminal device control method of the present invention communicates with the second information terminal device and constructs a telemetry system for measuring a subject. The information terminal device control method according to claim 1, wherein at least a mark indicating a measurement site to be measured is provided on the measurement subject image representing the affected area of the measurement subject provided from the second information terminal device. Mirror image generation step for generating a mirror image by flipping the added still image with information left and right, and determining to arrange the mirror image generated in the mirror image generation step on the display screen of the display unit And an arrangement determining step.

  In order to solve the above-described problem, the second information terminal device control method of the present invention communicates with the first information terminal device to construct a telemetry system that performs measurement on the person being measured. The method of controlling the information terminal device according to claim 1, wherein input information including at least a mark indicating a measurement site to be measured, which is input by the user, is added to the measurement subject image representing the affected area of the measurement subject. A combining step of generating a still image with information, and a still image output step of outputting the still image with information generated in the combining step to the first information terminal device. It is a feature.

  Therefore, it is possible to realize an information terminal device that enables the measurer to easily grasp the measurement site.

It is a functional block diagram which shows the principal part structure of the patient side information terminal device in one Embodiment of this invention. It is a figure which shows the outline | summary of the auscultation system (telemetry system) in one Embodiment of this invention. It is a block diagram which shows the hardware constitutions of the patient side information terminal device in one Embodiment of this invention. It is a block diagram which shows the hardware constitutions of the doctor side information terminal device in one Embodiment of this invention. It is a functional block diagram which shows the principal part structure of the doctor side information terminal device in one Embodiment of this invention. It is a flowchart which shows the flow of a process of the auscultation system in one Embodiment of this invention. (A) is a figure which shows the specific example of the patient area | region for displaying a patient displayed on the display part of the doctor side information terminal device in one Embodiment of this invention, (b) and (c) It is a figure which shows the specific example of a patient area | region displayed on the display part of a patient side information terminal device. It is a flowchart which shows the flow of a process of the patient side information terminal device in one Embodiment of this invention. (A) is a figure which shows the specific example of the patient area | region for displaying a patient displayed on the display part of the doctor side information terminal device in one Embodiment of this invention, (b) and (c) It is a figure which shows the specific example of a patient area | region displayed on the display part of a patient side information terminal device. It is a flowchart which shows the flow of a process of the patient side information terminal device in one Embodiment of this invention. (A) And (b) is a figure which shows the specific example of the patient area | region displayed on the touchscreen of a patient side information terminal device. It is a figure which shows the specific example of a patient area | region displayed on the structure of the patient side information terminal device in one Embodiment of this invention, and each display part 13a, 13b of a patient side information terminal device. It is a flowchart which shows the flow of a process of the patient side information terminal device in one Embodiment of this invention. It is a figure which shows the specific example of a patient area | region displayed on the structure of the patient side information terminal device in one Embodiment of this invention, and the display part of a patient side information terminal device. (A) is a figure which shows the specific example of the patient area | region for displaying a patient displayed on the display part of the doctor side information terminal device in one Embodiment of this invention, (b) and (c) It is a figure which shows the specific example of a patient area | region displayed on the display part of a patient side information terminal device. It is a flowchart which shows the flow of a process of the patient side information terminal device in one Embodiment of this invention. It is a flowchart which shows the flow of a process of the doctor side information terminal device in one Embodiment of this invention. (A) is a figure which shows the specific example of the patient area | region for displaying a patient displayed on the display part of the doctor side information terminal device in one Embodiment of this invention, (b) and (c) It is a figure which shows the specific example of a patient area | region displayed on the display part of a patient side information terminal device. It is a figure explaining the functional structure in the doctor side information terminal device in one Embodiment of this invention using a specific example. It is a flowchart which shows the flow of a process of the doctor side information terminal device in one Embodiment of this invention. (A) is a figure which shows the specific example of the patient area | region for displaying a patient displayed on the display part of the doctor side information terminal device in one Embodiment of this invention, (b) and (c) It is a figure which shows the specific example of a patient area | region displayed on the display part of a patient side information terminal device.

Embodiment 1
The embodiment of the present invention is described below with reference to FIGS.

  In the embodiment described below, a case where the telemetry system of the present invention is realized as an auscultation system will be described as an example. In the auscultation system, a doctor at a remote location confirms the auscultation sound of a patient at a measurement site, and the doctor examines the patient's condition.

[Outline of auscultation system]
FIG. 2 is a diagram showing an outline of the auscultation system in the embodiment of the present invention. As shown in FIG. 2, the auscultation system 100 includes a patient side information terminal device 1, a doctor side information terminal device 2, a measuring device 3, and a server device 5.

  In the auscultation system 100 in the present embodiment, a patient P who is a measurement subject and a measurement person at the measurement site 6 and a doctor D at a remote place 7 are information terminal devices ( 1, 2). The patient P measures his own auscultatory sound using the measuring device 3 at the measurement site 6 under the guidance of the doctor D.

  In the present embodiment, the measuring device 3 is a stethoscope that collects a body sound emitted by the patient P. Hereinafter, the measuring device 3 is referred to as a stethoscope 3. The stethoscope 3 is realized by, for example, an electronic stethoscope that can wirelessly communicate with the patient-side information terminal device 1.

  Note that a measurement assistant U who assists the measurement of the patient P may be present at the measurement site 6. The measurement assistant U is, for example, a medical worker such as an advanced nurse (NP) or a family caring for a patient. The measurement assistant U can operate the stethoscope 3 and the patient side information terminal device 1. The measurement assistant U does not have advanced knowledge, skills and authority as a doctor, or is a non-specialized medical treatment, but immediately at the measurement site 6 under the guidance of a specialist doctor D. Moreover, you may have the skill to perform a simple diagnosis and treatment. Further, the measurement assistant U may simply operate the stethoscope 3 and the patient side information terminal device 1 to perform measurement.

  Electronic data (hereinafter referred to as measurement data) of the auscultation sound collected by the stethoscope 3 is taken in by the patient side information terminal device 1 and transferred from the patient side information terminal device 1 to the doctor side information terminal device 2, the network 4 and the server. It is transmitted via the device 5.

  In addition to the stethoscope 3, the measuring device may be realized by, for example, a sphygmomanometer, a thermometer, an echo device, or the like. The biological signal acquired by each measuring device is D / A converted and processed as measurement data in the patient side information terminal device 1.

  The patient side information terminal device 1 is an information terminal device of a patient P provided at the measurement site 6. The patient-side information terminal device 1 is realized by, for example, a desktop personal computer that can be connected to the network 4. Although details will be described later, the patient-side information terminal device 1 is provided with an imaging unit such as a digital video camera. A state of the patient P at the time of medical examination is photographed by this imaging unit.

  The captured patient video (live view image) is transmitted to the doctor-side information terminal device 2 via the server device 5 in real time. The patient-side information terminal device 1 also has a function of receiving and displaying data (mainly still images) transmitted from the doctor-side information terminal device 2 via the server device 5 and the network 4. The function for displaying this still image will be described in detail later.

  The doctor side information terminal device 2 has a function of displaying the patient video transmitted by the patient side information terminal device 1 in real time. Further, the doctor-side information terminal device 2 has a function of extracting a still image from the patient video and editing the still image. Specifically, the editing function is a function of inputting a mark or a character to a specific place (such as a measurement site of a patient) on a still image by using a pointing device, for example. Further, the doctor-side information terminal device 2 has a function of transmitting a still image (hereinafter, a still image with information) to which the input information such as the mark and characters are added to the patient-side information terminal device 1.

  The server device 5 is provided at an arbitrary position that can be connected to the network 4. The server device 5 has a server function that enables exchange of information between the doctor-side information terminal device 2 and a specific patient-side information terminal device 1 permitted to communicate with the doctor-side information terminal device 2. .

  Moreover, in this embodiment, the server apparatus 5 may hold | maintain the database which memorize | stored the information (electronic medical records etc.) of patients registered beforehand. This database is preferably managed so that only a specific doctor side information terminal device 2 having authority can access. The server device 5 is not an essential component in the auscultation system 100 of the present invention. For example, the doctor-side information terminal device 2 manages information on the patient-side information terminal device 1 and the patient P who is the owner, and the patient-side information terminal device 1 and the doctor-side information terminal device 2 have a private network. A form in which communication is performed via the auscultation system 100 also falls within the category of the auscultation system 100 of the present invention.

  As described above, in the auscultation system 100 of the present invention, the doctor-side information terminal device 2 has a function of editing the patient video and supplying the patient-side information terminal device 1 with a still image with information clearly indicating the measurement site. It is characterized by that. The patient-side information terminal device 1 has a function of displaying the still image with information in an appropriate state so that the patient P who is also a measurer can easily grasp the measurement site. Each function of each device will be described in detail below with reference to the drawings.

[Hardware configuration of patient side information terminal device]
FIG. 3 is a block diagram showing a hardware configuration of the patient side information terminal device 1 in the present embodiment. In addition, the example shown in FIG. 3 shows an example of the hardware configuration of the patient side information terminal device 1 of the present invention, and does not limit the configuration of the patient side information terminal device 1.

  As shown in FIG. 3, the patient side information terminal device 1 includes a main body 1a, a communication unit 11, a voice input / output unit 12, that is, a voice input unit 12a and a voice output unit 12b, a display unit 13, an operation unit 14, and imaging. The configuration includes the portion 16. Although not shown in FIG. 3, the main body 1 a accommodates the control unit 10, the storage unit 15, and the short-range communication unit 17.

  The control unit 10 performs overall control of each unit included in the patient-side information terminal device 1, and is realized by, for example, a CPU (central processing unit).

  The communication unit 11 communicates with an external device via a communication network. The communication unit 11 transmits / receives data to / from the server device 5 or the doctor side information terminal device 2 via the network 4, for example. Further, when the patient-side information terminal device 1 has a call function such as a telephone, the communication unit 11 transmits / receives voice call data and the like to / from other devices via the telephone line network. . Specifically, the communication unit 11 transmits the patient video to the doctor-side information terminal device 2 via the server device 5 or the doctor-side information terminal device 2 indicates the voice data and measurement site of the doctor. Receive still images with information.

  The voice input / output unit 12 includes a voice input unit 12a and a voice output unit 12b. The voice input unit 12a receives a voice input generated outside the patient-side information terminal device 1, and is realized by a microphone or the like. The voice input via the voice input unit 12a may be voice-recognized and converted into an instruction signal for the patient-side information terminal device 1. The audio output unit 12b outputs audio data processed by the patient side information terminal device 1 as audio, and is realized by a speaker, a headphone terminal, headphones, and the like. The voice input / output unit 12 allows the patient P and the measurement assistant U to perform voice communication with the doctor D in the remote place 7.

  The display unit 13 displays various types of information handled by the patient-side information terminal device 1 and includes, for example, a display device such as an LCD (liquid crystal display). The information displayed by the display unit 13 is, for example, a live view image (patient video) captured by the imaging unit 16, a still image with information transmitted from the doctor-side information terminal device 2, or a user (patient P and the measurement assistant U) are GUI (Graphical User Interface) parts for operating the patient-side information terminal device 1 or the measurement results (vital) measured by various measuring devices such as the stethoscope 3 Information).

  In the present embodiment, the patient image and the still image with information displayed on the display unit 13 are reversed left and right so that the patient's appearance is shown as a mirror image. The patient P can sense vital information using the stethoscope 3 while looking at the mirror image displayed on the display unit 13.

  The operation unit 14 is used by the user to directly input an instruction signal to the patient side information terminal device 1. For example, the operation unit 14 is realized by an appropriate input mechanism such as a button, switch, key, or jog dial provided on the main body 1a, a keyboard, or a mouse. For example, the user can input an instruction to the patient-side information terminal device 1 by operating the operation unit 14 realized by a mouse or a keyboard and operating a GUI component displayed on the display unit 13. it can. The operation unit 14 may be formed integrally with the display unit 13 and realized as a touch panel.

  The storage unit 15 includes (1) a basic control program executed by the control unit 10 of the patient side information terminal device 1, (2) an OS program executed by the control unit 10, and (3) the control unit 10 includes the patient side information terminal device. 1 stores an application program for executing various functions of 1 and various data to be read when the application program is executed. Alternatively, (5) the control unit 10 stores data used for calculation and calculation results in the course of executing various functions.

  For example, the above data (1) to (4) are stored in a nonvolatile storage device such as a ROM (read only memory), a flash memory, an EPROM (Erasable Programmable ROM), an EEPROM (Electrically EPROM), an HDD (Hard Disc Drive), etc. Is stored in the storage unit 15 realized by the above. For example, the data (5) is stored in the storage unit 15 realized by a volatile storage device such as a RAM (Random Access Memory). Which data is to be stored in which storage device is appropriately determined based on the purpose of use, convenience, cost, physical restrictions, etc. of the patient side information terminal device 1.

  For example, patient information such as the age, sex, name, and past history of the patient P, measurement data collected by the stethoscope 3, a moving image of the patient, a still image, and the like are stored in the storage unit 15 in a nonvolatile manner. Or the patient image | video etc. which were image | photographed in real time are memorize | stored in the memory | storage part 15 temporarily.

  The imaging unit 16 captures a still image or a moving image, and includes an appropriate imaging mechanism including a lens and an imaging element. For example, the imaging unit 16 is implemented by a CCD (Charge Coupled Devices) camera or a CMOS (Complementary Metal-Oxide-Semiconductor) camera, but other imaging devices may be used as the imaging unit 16. It is preferable that at least one imaging unit 16 is installed at a position where the patient's body can be imaged from the front. The patient video imaged and acquired by the imaging unit 16 is supplied from the patient side information terminal device 1 to the doctor side information terminal device 2 via the server device 5 in real time. Thereby, the doctor D using the doctor side information terminal device 2 can confirm how the patient P is sensing the vital state through the patient video.

  The short-range communication unit 17 communicates with a measuring device such as a stethoscope 3 using a short-range communication means. The short-range communication means of the short-range communication unit 17 may be realized by wire, but is preferably realized by radio. For example, in the present embodiment, the stethoscope 3 transmits the auscultatory sound data (measurement data) collected from the measurement subject by the stethoscope 3 to the patient side information terminal device 1 through the short-range wireless communication means. The short-range communication unit 17 receives the measurement data from the stethoscope 3. As the short-range wireless communication means, an appropriate means such as infrared communication such as IrDA or IrSS, short-range wireless communication technology such as Bluetooth (registered trademark) communication, WiFi communication, or a non-contact IC card such as Felica is used. It is possible. An antenna and a signal demodulator for receiving the signal by the short-range communication unit 17 may be accommodated in the main body 1a.

[Hardware configuration of doctor side information terminal device]
FIG. 4 is a block diagram showing a hardware configuration of the doctor side information terminal device 2 in the present embodiment. In addition, the example shown in FIG. 4 shows an example of the hardware configuration of the doctor side information terminal device 2 of the present invention, and does not limit the configuration of the doctor side information terminal device 2.

  As shown in FIG. 4, the doctor-side information terminal device 2 includes a main body 2a, a communication unit 41, a voice input / output unit 42, that is, a voice input unit 42a and a voice output unit 42b, a display unit 43, and an operation unit 44. It has a configuration. Although not shown in FIG. 4, the control unit 40 and the storage unit 45 are accommodated in the main body 2a.

  Since the hardware configuration of the doctor-side information terminal device 2 is substantially the same as that of the patient-side information terminal device 1, the overlapping contents will not be repeated here.

  The communication unit 41 receives a patient image from the patient-side information terminal device 1, receives voice data of the patient P or the measurement assistant U, or receives measurement data of the patient P collected by the stethoscope 3. The information-added still image generated by the doctor-side information terminal device 2 is transmitted to the patient-side information terminal device 1.

  The display unit 43 displays various information handled by the doctor-side information terminal device 2. The information displayed by the display unit 43 is, for example, a live view image (patient video) received from the patient side information terminal device 1, or a still image of the patient being edited by the doctor side information terminal device 2 (stationary with information) Image), a GUI component for the user (doctor D) to operate the doctor-side information terminal device 2, or measurement data (vital information) of the measurement subject.

  In particular, in this embodiment, the doctor-side information terminal device 2 adds the comment to one frame (still image) of the patient video or adds a mark to the measurement site, and the still image It has a function to add information. Therefore, the display unit 43 further includes GUI parts (such as a pen-type cursor) for the doctor D to input information to the still image, and input information (measurement site) added to the still image by the doctor D. May be displayed. Further, the waveform data of the auscultatory sound collected by the stethoscope 3 may be displayed on the display unit 43 so that the doctor D can grasp the condition of the patient P in detail. It is preferable that the waveform data is transmitted from the patient side information terminal device 1 almost in real time. Thereby, the doctor D can confirm whether the measurement of the patient P is performed normally. If there is a problem with the measurement method, the still image extracted from the patient video can be edited, the correct measurement site can be marked with a pen or a mouse, and returned to the patient side information terminal device 1 immediately. The measurement data such as the waveform data can be used by the doctor D for diagnosis of the patient P.

  Similar to the operation unit 14 of the patient-side information terminal device 1, the operation unit 44 may be realized by an appropriate input mechanism provided on the main body 2a, a keyboard, a mouse, or the like, but is further traced with a pen or the like. It is preferable to be realized by a tablet that can input the shape to the doctor-side information terminal device 2. By using the operation unit 44 realized by a tablet, the doctor D can easily add a mark or a character to a still image and edit it with a simple operation. Note that a mark may be added to the still image using the operation unit 44 as a mouse, or a character may be added to the still image using the operation unit 44 as a keyboard.

[Functional configuration of patient-side information terminal device]
FIG. 1 is a functional block diagram showing the main configuration of a patient side information terminal device 1 in the present embodiment.

  As shown in FIG. 1, the control unit 10 of the patient side information terminal device 1 is configured to include at least a display control unit 23 and a video processing unit 20 as functional blocks. In the present embodiment, the video processing unit 20 includes at least the arrangement determination unit 30 and the mirror image generation unit 31. The control unit 10 may further include an input / output control unit 21, a measurement data processing unit 22, and an operation receiving unit 24 as necessary. The video processing unit 20 may further include an image superimposing unit 32 and an inversion control unit 33 as necessary.

  Each functional block of the control unit 10 described above is stored in a storage device (storage unit 15) realized by a CPU (central processing unit) or the like using a ROM (read only memory), an NVRAM (non-volatile random access memory), or the like. This can be realized by reading the program stored in a RAM (random access memory) or the like and executing it.

  The input / output control unit 21 performs D / A conversion of the audio signal input / output by the audio input / output unit 12. For example, an audio signal input from the audio input unit 12a (microphone) is D / A converted and sent as audio data to the network 4 via the communication unit 11. In the present embodiment, the transmission destination is the server device 5, but the voice data is transferred to the doctor-side information terminal device 2 by the server device 5. On the other hand, the input / output control unit 21 outputs the voice data of the doctor D received from the doctor-side information terminal device 2 via the communication unit 11 to the voice output unit 12b.

  The measurement data processing unit 22 processes measurement data output from a measurement device such as the stethoscope 3 received via the short-range communication unit 17. Specifically, the measurement data processing unit 22 performs format conversion so that the measurement data is displayed on the display unit 13 of its own device, or is transmitted to the doctor-side information terminal device 2 via the communication unit 11. And so on.

  Note that the measurement data processing unit 22 may perform D / A conversion of the measurement signal as necessary when acquiring a biological signal from the measurement device of the stethoscope 3. For example, the measurement data processing unit 22 processes a sound signal acquired from the stethoscope 3 into continuous waveform data, and enables storage and transmission as electronic data. In addition, the measurement data processing unit 22 processes the signal acquired from the sphygmomanometer into single data indicating the blood pressure numerical value, and enables storage and transmission as electronic data. In addition, the measurement data processing unit 22 processes the video signal acquired from the echo device into moving image data, and enables storage and transmission as electronic data. As described above, the patient-side information terminal device 1 may have a function of performing D / A conversion that satisfies an appropriate accuracy according to the hardware performance of each measurement device. When the short-range communication unit 17 can receive the measurement data from the stethoscope 3 as a digital signal, the function of performing D / A conversion may not be provided.

  The measurement data processed by the measurement data processing unit 22 is transmitted to the server device 5 (whether supplied to the communication unit 11) or displayed on the display unit 13 (supplied to the video processing unit 20) by a data sending unit (not shown). Is determined and distributed. Normally, the data transmission unit of the measurement data processing unit 22 distributes the measurement data to each unit so that the measurement data is displayed on the display unit 13 while being transmitted to the server device 5.

  The video processing unit 20 processes display target data handled by the patient-side information terminal device 1 and generates a screen to be displayed on the display unit 13. In the present embodiment, the video processing unit 20 includes an arrangement determination unit 30 and a mirror image generation unit 31.

  The mirror image generation unit 31 executes a process of horizontally flipping the patient video imaged by the imaging unit 16 and the still image with information received from the doctor-side information terminal device 2. The mirror image generation unit 31 generates a mirror image by reversing the patient image horizontally, and generates a mirror image by reversing the still image with information left and right. The mirror image generated by the mirror image generation unit 31 is stored in the storage unit 15 as data different from the original patient image, that is, the normal image. Similarly, the mirror image is also stored in the storage unit 15 as data different from the original still image with information, that is, a normal image.

  The arrangement determining unit 30 designs the arrangement of display target data on the screen of the display unit 13. The display target data handled by the placement determination unit 30 is, for example, not limited to this, GUI parts, patient video (normal image video), the mirror image, the still image with information (normal image), the mirror image, and Measurement data.

  The display control unit 23 outputs video data processed by the video processing unit 20 or screen data including an image to the display unit 13 as a video signal.

  The operation receiving unit 24 receives an instruction signal input to the patient side information terminal device 1 when the operation unit 14 is operated. When an instruction signal input event occurs, the operation reception unit 24 supplies the content of the instruction signal corresponding to the event to each unit of the control unit 10.

[Functional configuration of doctor side information terminal device]
FIG. 5 is a functional block diagram showing a main configuration of the doctor-side information terminal device 2 in the present embodiment.

  As shown in FIG. 5, the control unit 40 of the doctor-side information terminal device 2 includes, as functional blocks, at least a video reception unit 55, a video processing unit 50, a display control unit 53, an operation reception unit 54, and an input information processing unit. 56 is provided. In the present embodiment, the video processing unit 50 includes a still image acquisition unit 65, an image superimposition unit 66, and an arrangement determination unit 67. The input information processing unit 56 includes at least an input information generation unit 60 and a still image output unit 61. The control unit 40 may further include an input / output control unit 51 and a measurement data receiving unit 52 as necessary. Further, the input information processing unit 56 may further include an inversion necessity determination unit 62 and a non-inversion information output unit 63 as necessary.

  Each functional block of the control unit 40 described above is stored in a storage device (storage unit 45) realized by a CPU (central processing unit) or the like using a ROM (read only memory), an NVRAM (non-volatile random access memory), or the like. This can be realized by reading the program stored in a RAM (random access memory) or the like and executing it.

  Among the functional configurations of the doctor-side information terminal device 2, those that are substantially the same as the functional configuration of the patient-side information terminal device 1 will not be described repeatedly here.

  In this embodiment, the input / output control unit 51 outputs the audio signal of the doctor D input from the audio input unit 42a to the communication unit 41 as audio data. On the other hand, the input / output control unit 51 outputs the audio data of the patient P or the measurement assistant U received via the communication unit 41 as an audio signal to the audio output unit 42b.

  The measurement data receiving unit 52 acquires measurement data received via the communication unit 41. The acquired measurement data is supplied to the video processing unit 20 and processed by the video processing unit 20 so as to be displayed on the display unit 43.

  The video receiving unit 55 acquires a patient video received via the communication unit 41. The acquired patient video is supplied to the video processing unit 20 by the video receiving unit 55 in real time. Thereby, the supplied patient image is processed by the image processing unit 20 so as to be displayed on the display unit 43 in real time.

  The input information processing unit 56 processes the input information input by the doctor D input via the operation unit 44. In the present embodiment, the input information processing unit 56 includes at least an input information generation unit 60 and a still image output unit 61.

  The input information generation unit 60 forms the input information input from the operation unit 44 into an object that can be handled by the video processing unit 50. For example, it is assumed that input information (a mark) is input to a patient image or a still image via a pen and a tablet. The input information generation unit 60 specifies the shape (and color) of the mark from the pen handwriting drawn by the doctor D indicated by the input signal input via the tablet. Further, the position on the still image where the mark is detected is specified. Then, the input information generation unit 60 forms the input information into a format that specifies the shape and position of the mark. The input information generation unit 60 hands over the input information to the video processing unit 50 and requests to add the input information to the still image.

  As a response to the request, the still image output unit 61 receives a still image with information in which the input information is added to the still image from the video processing unit 50. The still image output unit 61 outputs the still image with information to the communication unit 41. Thereby, the still image with information is supplied to the patient-side information terminal device 1 via the network 4.

  The video processing unit 50 processes display target data handled by the doctor-side information terminal device 2. The video processing unit 50 generates a screen to be displayed on the display unit 43. When an image (one frame of patient video) displayed on the display unit 43 is edited, the video processing unit 50 performs the editing operation. Therefore, the editing process is performed on the image. The video processing unit 50 includes a still image acquisition unit 65, an image superimposition unit 66, and an arrangement determination unit 67.

  The still image acquisition unit 65 captures one frame as a still image from a patient video that is a live view image. In the present embodiment, for example, the doctor D is output to the display unit 43 at the timing of editing the patient video (input information is input) using the operation unit 44 (for example, a pen and a tablet). The frame may be acquired as a still image. Alternatively, the frame output to the display unit 43 may be acquired as a still image at the timing when the doctor D clicks the capture button (GUI component) using the operation unit 44 (for example, a mouse). Input information (such as a mark and characters) input by the doctor D is reflected on the still image acquired by the still image acquisition unit 65.

  The image superimposing unit 66 superimposes the input information input by the doctor D via the operation unit 44 on the still image acquired by the still image acquiring unit 65 and combines the input information. For example, it is assumed that the doctor D circles the measurement site of the patient P on the still image using a pen. This circular object is formed by the input information generation unit 60 as input information. The image superimposing unit 66 superimposes the input information (circle) at a specified position on the still image in accordance with a request from the input information generating unit 60. In this way, the image superimposing unit 66 combines the input information with the still image to generate a still image with information. In the above example, the still image with information is an image showing the measurement site of the body of the patient P with a circle mark as drawn by the doctor D. The image superimposing unit 66 returns the generated still image with information to the still image output unit 61 of the input information processing unit 56.

  The arrangement determining unit 67 designs the arrangement of display target data on the screen of the display unit 43. The display target data handled by the arrangement determining unit 67 is, for example, not limited to this, but a GUI part (particularly, a GUI part for still image editing), a patient video (normal image video), a still image with information (normal image). And measurement data.

  The display control unit 53 outputs video data processed by the video processing unit 50 or screen data including an image to the display unit 43 as a video signal.

  The operation receiving unit 54 receives an instruction signal input to the doctor-side information terminal device 2 when the operation unit 44 is operated.

[Process flow of auscultation system]
FIG. 6 is a flowchart showing a process flow of the auscultation system 100 according to the embodiment of the present invention.

  When communication is established between the patient-side information terminal device 1 at the measurement site 6 and the doctor-side information terminal device 2 at the remote place 7, medical treatment for the patient P by the doctor D is started.

  First, the imaging unit 16 of the patient side information terminal device 1 is activated. The imaging unit 16 images the patient P and acquires a live view image (patient video) of the patient P (S101). When measuring with a stethoscope, it is preferable to photograph the upper body. In the case of measurement with a sphygmomanometer, it is preferable to photograph the arm.

  The patient video is processed by the video processing unit 20 into a communicable data format and output to the communication unit 11. The communication part 11 transmits the said patient image | video to the doctor side information terminal device 2 (S102).

  On the other hand, the communication unit 41 of the doctor-side information terminal device 2 receives the patient video from the patient-side information terminal device 1. The received patient image is processed by the image receiving unit 55 and the image processing unit 50. The display control unit 53 outputs a video signal corresponding to a screen for displaying a patient video to the display unit 43 to display the patient video (S103). Thereby, the doctor D comes to be able to visually recognize the state of the patient P in real time.

  Subsequently, when the doctor D inputs an instruction to capture a patient's still image through the operation unit 44 while watching the patient image (YES in S104), the still image acquisition unit 65 at that timing, An image is acquired (S105). And the said still image is displayed on the display part 43 as shown, for example in FIG. The doctor D can use the pen to mark, paint, and input characters to the still image.

  Here, it is assumed that the doctor D enters a mark representing the measurement site at an arbitrary position on the still image, for example, as shown in FIG. When an information input event occurs as described above (YES in S106), the input information processing unit 56 and the video processing unit 50 superimpose the input information on the still image to generate a still image with information (S107). ). Here, the still image with information is an image in which a mark representing the measurement site is superimposed on the position filled in by the doctor D on the still image showing the patient.

  When the doctor D finishes editing the still image, for example, the doctor D clicks a GUI part such as a transmission button and instructs the patient-side information terminal device 1 to transmit the still image with information with the edited content. be able to. In response to this instruction, the communication unit 41 transmits the still image with information to the patient side information terminal device 1 (S108).

  On the other hand, the communication part 11 of the patient side information terminal device 1 receives the still image with information (S109). Then, the mirror image generation unit 31 of the video processing unit 20 generates a mirror image obtained by inverting the left and right of the still image with information (S110).

  The display control unit 23 displays the mirror image generated by the mirror image generation unit 31 on the display unit 13 (S111). For example, as shown in FIG. 4, the still image with information created in the doctor-side information terminal device 2 includes a mark of the measurement site on the lower right. As shown in FIG. 3, the mirror image obtained by reversing the left and right includes a mark of the measurement site on the lower left. The mirror image including the mark of the measurement site in the lower left appears to the patient P the same as his / her appearance in the mirror.

  Accordingly, the patient P intuitively understands that he / she must identify the measurement site in his / her body and apply the stethoscope 3 to the patient's body immediately while looking at the mirror image. can do.

  Note that the mirror image generation unit 31 of the video processing unit 20 may generate a mirror image that is obtained by inverting the patient video acquired by the imaging unit 16 (S112). The arrangement determining unit 30 may arrange the mirror image on the screen and display it on the display unit 13 together with the mirror image. The process of S112 may be executed at any timing after S101.

  According to the above-described configuration and method, the doctor-side information terminal device 2 represents a measurement site on one of the patient's bodies by editing a still image showing the current state of the patient according to an instruction from the doctor D. A still image with information to which a mark is added can be generated. On the other hand, the patient-side information terminal device 1 that has received the still image with information can invert the still image with information for each measurement site mark to generate a mirror image and display it on the display unit 13. .

  Thus, in the auscultation system 100, the patient image and the still image with information are all normal images on the display unit 43 viewed by the doctor D, while the mirror image is displayed on the display unit 13 viewed by the patient P. Is done. That is, at the remote place 7, the doctor D can observe the patient P in the same state as when the doctor D usually performs a face-to-face diagnosis with the patient P. On the other hand, at the measurement site 6, the patient P can observe his / her own state in the same state as when his / her appearance is reflected in the mirror.

  For this reason, the doctor D can designate an appropriate measurement site with the same sensation as normal medical practice, whereas the patient P has the same sensation as seeing herself in the mirror, The specified measurement site can be grasped immediately and intuitively.

  From the above, when the measurement subject (patient P) himself performs measurement as a measurement person, it is possible to realize a highly convenient auscultation system 100 that enables the measurement person to easily grasp the measurement site. It becomes possible.

[Modification of Embodiment 1]
In the present embodiment, it has been described that the display control unit 23 may display a mirror image (a horizontally reversed image of a live view image) together with a mirror image (a horizontally reversed image of a still image with information). Here, the mirror image and the mirror image may be displayed side by side on the display unit 13 or may be displayed on the display unit 13 in a superimposed manner.

  For example, the arrangement determining unit 30 may generate a screen by arranging a mirror image and a mirror image side by side. Alternatively, the video processing unit 20 may include an image superimposing unit 32, and the image superimposing unit 32 may generate a superimposed image in which the mirror image and the mirror image are superimposed. For example, the image superimposing unit 32 may superimpose a semi-transparent mirror image on the mirror image. The patient P can move his body or move the imaging unit 16 so that his / her appearance in the mirror image matches the mirror image. Then, the patient P can easily find the correct measurement site by confirming the coincident superimposed image and applying the stethoscope 3 so as to overlap the mark on the mirror image.

<< Embodiment 2 >>
Another embodiment relating to the telemetry system of the present invention will be described below with reference to FIGS. 1, 5, 7 and 8. FIG. For convenience of explanation, members having the same functions as those in the drawings described in the above-described embodiments are denoted by the same reference numerals and description thereof is omitted.

[Problems to be solved by this embodiment]
In the present embodiment, in the auscultation system 100, it is assumed that a medical specialist (measurement assistant U) such as a nurse accompanies the measurement site 6 where the patient P is present. Specifically, when measurement is possible by the patient P himself / herself depending on the condition of the patient P, the patient P himself / herself performs the measurement, and the patient P is in a bad condition and difficult to perform the measurement himself / herself, In the case of the patient P who is unfamiliar with the operation, it is assumed that the measurement assistant U performs the measurement.

  According to the first embodiment described above, the patient P and the measurement assistant U can see the screen of the display unit 13 of the same patient-side information terminal device 1 and stethoscope at the target measurement site under the guidance of the doctor D. 3 is assigned to measure vital information. The doctor D gives an instruction to the patient P or the measurement assistant U by, for example, writing an instruction on a still image of the patient image while monitoring the patient P with an image, as in the first embodiment. That is, the measurement site to which the stethoscope 3 is to be applied is indicated on the still image and instructed.

  However, the appearance of the patient P is displayed as a mirror image on the display unit 13 of the patient-side information terminal device 1. Therefore, when the patient P measures, the convenience is high for the patient P. However, when the measurement assistant U facing the patient P performs the measurement, it is inconvenient to grasp the measurement site displayed in the mirror image.

  In the present embodiment, in view of the above inconveniences, the measurement person can easily grasp the measurement site regardless of whether the person to be measured is a measurement person or another measurement person performs measurement. The purpose is to realize a more convenient telemetry system.

[Functional configuration of doctor side information terminal device]
The functional configuration of the doctor-side information terminal device 2 in the present embodiment is as shown in FIG.

  However, the present embodiment is different from the doctor-side information terminal device 2 of the first embodiment in the following points. That is, the arrangement determining unit 67 of the video processing unit 50 determines to arrange the patient video (normal image) and the captured still image (normal image) side by side.

  (A) of FIG. 7 is a figure which shows the specific example of the patient area | region 43r for displaying a patient displayed on the display part 43 of this embodiment. As shown in FIG. 7A, the arrangement determining unit 67 arranges the patient video 430 and the still image with information 431 before and after editing or during editing in the patient area 43r. When the doctor D captures a still image from the patient video 430, for example, the doctor D may perform an operation of dragging the patient video 430 with the mouse and dropping it onto the area of the information-added still image 431.

[Functional configuration of patient-side information terminal device]
The functional configuration of the patient side information terminal device 1 in this embodiment is as shown in FIG.

  However, in the present embodiment, the following points are different from the patient side information terminal device 1 of the first embodiment.

  That is, the arrangement determining unit 30 of the video processing unit 20 determines to arrange the live view image and the still image supplied from the doctor-side information terminal device 2 side by side. Furthermore, the arrangement determination unit 30 determines to arrange GUI parts for allowing the user to perform an operation of switching between a normal image and a mirror image for both the live view image and the still image.

  (B) and (c) of FIG. 7 are diagrams showing a specific example of a patient region 13r for displaying a patient, which is displayed on the display unit 13 of the present embodiment. FIG. 7B is a diagram illustrating an example in which a mirror image is displayed for the patient P, and FIG. 7C is an example in which a normal image is displayed for the measurement assistant U. FIG.

  For the patient P, the arrangement determining unit 30 arranges the mirror image image 130 and the mirror image 131 side by side in the patient region 13r as shown in FIG. Furthermore, in this embodiment, the arrangement determination unit 30 arranges the GUI component 132 for performing an operation of switching from a mirror image to a normal image. When the measurement assistant U wants to switch from the mirror image to the normal image, for example, it is conceivable to operate the mouse and click the option button of the measurement assistant in the GUI component 132.

  As shown in (c) of FIG. 7, the arrangement determining unit 30 displays a patient image 133 (normal image) and a still image with information 134 (normal image) in the patient region 13 r as shown in FIG. Place them side by side. Furthermore, in this embodiment, the arrangement determination unit 30 arranges the GUI component 135 for performing an operation of switching from a normal image to a mirror image. When the patient P wants to switch from the normal image to the mirror image, the patient's option button in the GUI part 135 may be clicked.

  Further, in the present embodiment, the video processing unit 20 is configured to always include the inversion control unit 33.

  The inversion control unit 33 determines and controls the necessity of inversion processing (mirror image display) for an object to be displayed. In the present embodiment, the inversion control unit 33 controls which of the normal image and the mirror image is to be displayed according to the normal image mirror image switching instruction input via the operation unit 14. For example, when the option button for the measurement assistant is clicked in the state of the patient region 13r shown in FIG. 7B, the inversion control unit 33 determines that the mirror image should be switched to the normal image. Then, the inversion control unit 33 instructs the arrangement determining unit 30 to switch the mirror image to the normal image.

  On the other hand, when the patient option button is clicked in the state of the patient region 13r shown in FIG. 7C, it is determined that the normal image should be switched to the mirror image. Then, the inversion control unit 33 instructs the arrangement determining unit 30 to switch the normal image to the mirror image.

[Processing flow of patient-side information terminal device]
FIG. 8 is a flowchart showing a process flow of the patient side information terminal device 1 according to the embodiment of the present invention.

  When the medical treatment is started, the imaging unit 16 captures the patient P and acquires a patient video (S201). Then, the mirror image generation unit 31 generates a mirror image of the patient video (S202).

  On the other hand, the communication part 11 transmits the said patient image | video to the doctor side information terminal device 2 (S203). Subsequently, the still image with information generated based on the patient video is received from the doctor-side information terminal device 2 (S204). When a still image with information is received, the mirror image generation unit 31 generates a mirror image of the still image with information (S205).

  The placement determining unit 30 places the generated mirror image 130, the mirror image 131, and the GUI component 132 for switching operation in the patient region 13r (S206).

  The display control unit 23 displays a screen including the patient region 13r on the display unit 13 (S207). The display content at this time is, for example, as shown in FIG.

  Here, when the operation receiving unit 24 detects an input of a switching operation to a normal image (YES in S208), the arrangement determining unit 30 displays a patient video (normal image video) 133 and a still image with information (video). The image 134 and the GUI part 135 for switching operation are arranged in the patient area 13r (S209).

  The display control unit 23 displays a screen including the patient region 13r on the display unit 13 (S210). The display content at this time is, for example, as shown in FIG.

  Here, when the operation receiving unit 24 detects an input of a switching operation to a mirror image (YES in S211), the arrangement determining unit 30 returns to S206, and thereafter repeats the same operation.

  According to the above-described configuration and method, the patient-side information terminal device 1 that has received the still image with information to which the mark representing the measurement site is added flips the still image with information for each mark of the measurement site, and mirror image An image can be generated and displayed on the display unit 13. In addition, mirror image images can be displayed side by side.

  On the other hand, the patient-side information terminal device 1 can further display the original patient image (normal image) and the original still image with information (normal image) on the display unit 13 side by side.

  The patient-side information terminal device 1 can arbitrarily switch between a normal image and a mirror image according to a user's normal image mirror image switching instruction under the control of the reversal control unit 33.

  Thus, in the auscultation system 100, the patient image and the still image with information are all normal images on the display unit 43 viewed by the doctor D, while the mirror image and the mirror image are displayed on the display unit 13 viewed by the patient P. An image is displayed. That is, at the remote place 7, the doctor D can observe the patient P in the same state as when the doctor D usually performs a face-to-face diagnosis with the patient P. On the other hand, at the measurement site 6, the patient P can observe his / her own state in the same state as when his / her appearance is reflected in the mirror.

  Furthermore, when the measurement assistant U performs measurement at the measurement site 6, the display on the display unit 13 of the patient side information terminal device 1 can be easily switched to a normal image.

  For this reason, when the patient P performs the measurement, the patient P can immediately and intuitively grasp the designated measurement site with the same feeling as when he / she sees himself / herself reflected in the mirror. . On the other hand, when the measurement assistant U performs the measurement, the measurement assistant U immediately grasps the appropriate measurement site intuitively with the same feeling as in the case of performing the medical treatment face-to-face with the normal image. Can do.

  From the above, even when the person being measured (patient P) is a measurement person and performs measurement, even when another measurement person (measurement assistant U) performs measurement, the measurement person can easily select the measurement site. It becomes possible to realize an even more convenient auscultation system 100 that can be grasped.

  In the above example, the patient-side information terminal device 1 can be easily switched by user action using a GUI component (software button) for the operation of switching between a normal image and a mirror image. It is not limited to. It is good also as a structure which can switch a normal image and a mirror image by operating the button physically installed in the main body 1a, the display part 13, or the operation part 14 of the patient side information terminal device 1. FIG.

<< Embodiment 3 >>
Another embodiment relating to the telemetry system of the present invention will be described below with reference to FIGS. 1, 5, and 9 to 11. For convenience of explanation, members having the same functions as those in the drawings described in the above-described embodiments are denoted by the same reference numerals and description thereof is omitted.

[Functional configuration of doctor side information terminal device]
The functional configuration of the doctor-side information terminal device 2 in the present embodiment is as shown in FIG.

  However, in the present embodiment, the following points are different from the doctor-side information terminal device 2 of each of the above-described embodiments. That is, the image superimposing unit 66 of the video processing unit 50 generates a superimposed image by superimposing the patient video (normal image) and the captured still image (normal image), and the arrangement determining unit 67 arranges the superimposed image. Decide what to do.

  (A) of FIG. 9 is a figure which shows the specific example of the patient area | region 43r displayed on the display part 43 of this embodiment. As illustrated in FIG. 9A, the image superimposing unit 66 superimposes the patient video 430 and the information-added still image 431. For example, the image superimposing unit 66 may superimpose the semi-transparent patient video 430 on the still image with information 431.

  In the doctor-side information terminal device 2, the doctor D needs to accurately mark the measurement site of the patient. Therefore, while the doctor D is editing a still image, the arrangement determining unit 67 may determine to display the live view image and the still image side by side.

[Functional configuration of patient-side information terminal device]
The functional configuration of the patient side information terminal device 1 in this embodiment is as shown in FIG.

  However, in this embodiment, the following points are different from the patient-side information terminal device 1 of each of the above-described embodiments.

  That is, in the present embodiment, the video processing unit 20 is configured to include the image superimposing unit 32 and the inversion control unit 33 without fail.

  The image superimposing unit 32 superimposes the mirror image 130 and the mirror image 131 to generate a superimposed mirror image. Alternatively, the image superimposing unit 32 superimposes the patient video 133 and the information-added still image 134 to generate a superimposed normal image video.

  The arrangement determining unit 30 determines to switch and arrange the superimposed mirror image image or the superimposed normal image image according to the instruction of the inversion control unit 33.

  (B) and (c) of FIG. 9 are diagrams showing specific examples of a patient region 13r for displaying a patient, which is displayed on the display unit 13 of the present embodiment. FIG. 9B is a diagram illustrating an example in which a mirror image is displayed for the patient P, and FIG. 9C is an example in which a normal image is displayed for the measurement assistant U. FIG.

  For the patient P, as shown in FIG. 9B, the arrangement determining unit 30 includes a superimposed mirror image image 136 in which the mirror image image 130 and the mirror image 131 are superimposed on the patient region 13r, and a GUI component 132. Deploy.

  For the measurement assistant U, as shown in FIG. 9C, the arrangement determining unit 30 superimposes the patient image 133 (normal image) and the still image with information 134 (normal image) on the patient region 13r. The superimposed normal image 137 is arranged.

[Processing flow of patient-side information terminal device]
FIG. 10 is a flowchart showing the flow of processing of the patient side information terminal device 1 in the embodiment of the present invention.

  S301 to S305 are the same as S201 to S205 in FIG.

  The image superimposing unit 32 generates the superimposed mirror image video 136 by superimposing the generated mirror image video 130 and the mirror image 131 (S306).

  The placement determining unit 30 places the generated superimposed mirror image 136 and the GUI component 132 for switching operation in the patient region 13r (S307).

  The display control unit 23 displays a screen including the patient region 13r on the display unit 13 (S307). The display content at this time is, for example, as shown in FIG.

  Here, when the operation receiving unit 24 detects an input of a switching operation to a normal image (YES in S308), the image superimposing unit 32 displays a patient video (normal image video) 133 and a still image with information (video image). ) 134 and the superimposed normal image video 137 is generated (S309).

  The placement determining unit 30 places the superimposed normal image 137 and the switching GUI component 135 in the patient region 13r (S310).

  The display control unit 23 displays a screen including the patient region 13r on the display unit 13 (S310). The display content at this time is, for example, as shown in FIG.

  Here, when the operation reception unit 24 detects an input of a switching operation to a mirror image (YES in S311), the arrangement determination unit 30 returns to S306, and thereafter repeats the same operation. The image superimposing unit 32 preferably has a configuration in which once the superimposed mirror image video 136 and the superimposed normal image video 137 are generated, these are stored in the storage unit 15. According to the above configuration, it is only necessary to read out necessary data from the storage unit 15, and it is possible to omit the operation of S306 or S309 each time a switching operation is performed.

  According to the above configuration and method, the patient P can check the superimposed mirror image image 136 and grasp the measurement site. The patient P may move the body or move the imaging unit 16 so that his / her appearance in the mirror image matches the mirror image. The patient P can easily find the correct measurement site by checking the superimposed mirror image image 136 when the patient's figure matches the mirror image and applying the stethoscope 3 so as to overlap the mark on the mirror image. It becomes possible.

  On the other hand, the measurement assistant U confirms the superimposed normal image 137 when the patient's figure matches the still image with information, and applies the stethoscope 3 so as to overlap the mark on the still image with information. It is possible to easily find the correct measurement site.

  From the above, even when the person being measured (patient P) is a measurement person and performs measurement, even when another measurement person (measurement assistant U) performs measurement, the measurement person can easily select the measurement site. It becomes possible to realize an even more convenient auscultation system 100 that can be grasped.

[Modifications of Embodiments 2 and 3]
In the second and third embodiments, the configuration in which the display control unit 23 displays the GUI parts for the normal image mirror image switching operation and receives the switching instruction has been described. However, the configuration of the patient side information terminal device 1 of the present invention is not limited to this.

  Even when the display unit 13 and the operation unit 14 are configured as a touch panel, the operation reception unit 24 detects a specific touch operation performed on the touch panel and receives a normal image mirror image switching instruction. Good.

  (A) and (b) of Drawing 11 are figures showing the example of patient field 13r displayed on the touch panel. In the example illustrated in FIG. 11, the operation reception unit 24 receives a normal image mirror image switching instruction based on a touch operation on the touch panel (for example, an operation of sliding a finger on the patient region 13r, a flick, a wipe, a tap, or the like). Therefore, as shown in FIG. 11, the display control unit 23 may not display the GUI component for the normal image mirror image switching operation.

<< Embodiment 4 >>
Another embodiment relating to the telemetry system of the present invention will be described below with reference to FIGS. 1, 5, 12, and 13. For convenience of explanation, members having the same functions as those in the drawings described in the above-described embodiments are denoted by the same reference numerals and description thereof is omitted.

  In addition, the function structure of the doctor side information terminal device 2 in this embodiment is as showing in FIG. The doctor side information terminal device 2 in the present embodiment may include the functional configuration of the doctor side information terminal device 2 in any of the above embodiments.

[Configuration of patient-side information terminal device]
The hardware configuration and functional configuration of the patient side information terminal device 1 in this embodiment are substantially the same as those shown in FIG.

  However, in this embodiment, the following points are different from the patient-side information terminal device 1 of each of the above-described embodiments.

  That is, the patient-side information terminal device 1 is provided with a patient display unit 13a for viewing by the patient P and a measurement assistant display unit 13b for viewing by the measurement assistant U, instead of including one display unit 13. It is the structure provided with.

  The video processing unit 20 is configured to generate a patient screen on which a mirror image is arranged and a measurement assistant screen on which a normal image is arranged. The display control unit 23 is configured to output the video signal of the patient screen to the patient display unit 13a and output the video signal of the measurement assistant screen to the measurement assistant display unit 13b.

  In the present embodiment, the image processing unit 20 is not necessarily provided with the image superimposing unit 32 and the inversion control unit 33.

  FIG. 12 is a diagram illustrating a configuration of the patient-side information terminal device 1 according to the present embodiment and a specific example of the patient region 13r displayed on the display units 13a and 13b according to the present embodiment.

  The arrangement determining unit 30 of the video processing unit 20 generates a patient screen in which the mirror image 130 and the mirror image 131 are arranged in the patient region 13r, and arranges the patient image 133 and the still image with information 134 in the patient region 13r. Generate a screen for the measurement assistant. Each of the generated screens is supplied from the video processing unit 20 to the display control unit 23.

  The display control unit 23 outputs the video signal of the patient screen on which the mirror image is arranged to the patient display unit 13a, and the video signal of the measurement assistant screen on which the normal image is arranged to the measurement assistant display unit 13b. Output.

  As a result, as shown in FIG. 12, a mirror image is displayed on the patient region 13r displayed on the patient display unit 13a, and a normal image is displayed on the patient region 13r displayed on the measurement assistant display unit 13b. Is done.

[Processing flow of patient-side information terminal device]
FIG. 13 is a flowchart showing a process flow of the patient side information terminal device 1 according to the embodiment of the present invention.

  S401 to S405 are the same as S201 to S205 in FIG.

  The arrangement determination unit 30 generates a patient screen on which the mirror image 130 and the mirror image 131 are arranged (S406). Further, the arrangement determining unit 30 generates a measurement assistant screen on which the patient video 133 and the information-added still image 134 are arranged (S407). The arrangement determining unit 30 may execute either S406 or S407 first. The patient screen and the measurement assistant screen are supplied to the display control unit 23.

  Subsequently, if the screen data supplied from the video processing unit 20 is a patient screen (YES in S408), the display control unit 23 outputs the video signal to the patient display unit 13a. Then, a patient screen on which a mirror image is arranged is displayed on the patient display unit 13a (S409). On the other hand, if the screen data is a measurement assistant screen (NO in S408), the display control unit 23 outputs the video signal to the measurement assistant display unit 13b. The measurement assistant display unit 13b displays a measurement assistant screen on which a normal image is arranged (S410).

  According to the above configuration and method, the patient P can easily grasp the measurement site by confirming the mirror image 131 displayed on the patient display unit 13a. That is, the patient P can search for a measurement site of his / her body in the same state as when the patient P is reflected in the mirror. On the other hand, at the same time, the measurement assistant U can easily grasp the measurement site by checking the information-added still image 134 displayed on the measurement assistant display unit 13b. That is, the measurement assistant U can search for the measurement site of the patient P in the same state as in the case where the patient P is examined face-to-face. In this case, a normal image mirror image switching operation by an operation of a GUI component or a touch operation becomes unnecessary.

  From the above, even when the person being measured (patient P) is a measurement person and performs measurement, even when another measurement person (measurement assistant U) performs measurement, the measurement person can easily select the measurement site. It becomes possible to realize an even more convenient auscultation system 100 that can be grasped.

[Modification of Embodiment 4]
In the present embodiment, the configuration in which the arrangement determining unit 30 determines to arrange the live view image and the still image side by side has been described. However, the present invention is not limited to this, and when the video processing unit 20 includes the image superimposing unit 32, the image superimposing unit 32 may generate the superimposed mirror image video 136 and the superimposed normal image video 137. And the arrangement | positioning determination part 30 may produce | generate the patient's screen which has arrange | positioned the superimposition mirror image image | video 136, and the screen for measurement assistants which has arrange | positioned the superimposition normal image image | video 137. FIG.

<< Embodiment 5 >>
Another embodiment of the telemetry system of the present invention will be described as follows based on FIGS. 1, 5, 13, and 14. FIG. For convenience of explanation, members having the same functions as those in the drawings described in the above-described embodiments are denoted by the same reference numerals and description thereof is omitted.

  In addition, the function structure of the doctor side information terminal device 2 in this embodiment is as showing in FIG. The doctor side information terminal device 2 in the present embodiment may include the functional configuration of the doctor side information terminal device 2 in any of the above embodiments.

[Configuration of patient-side information terminal device]
The hardware configuration and functional configuration of the patient side information terminal device 1 in this embodiment are substantially the same as those shown in FIG.

  However, in this embodiment, the following points are different from the patient-side information terminal device 1 of each of the above-described embodiments.

  That is, the display unit 13 included in the patient side information terminal device 1 of the present embodiment is realized by a display device including a dual view liquid crystal. According to the configuration of the dual view liquid crystal, the light emitted from one liquid crystal screen can be controlled to be emitted only in a specific viewing direction for each place of the screen.

  Similarly to the fourth embodiment, the video processing unit 20 is configured to generate a patient screen on which a mirror image is arranged and a measurement assistant screen on which a normal image is arranged. The display control unit 23 is configured to combine the patient screen and the measurement assistant screen into one screen so as to match the configuration of the dual view liquid crystal.

  In the present embodiment, the image processing unit 20 is not necessarily provided with the image superimposing unit 32 and the inversion control unit 33.

  FIG. 14 is a diagram illustrating a configuration of the patient side information terminal device 1 of the present embodiment and a specific example of a patient region 13r displayed on the display unit 13 of the present embodiment.

  The video processing unit 20 generates a mirror image patient screen in which at least the mirror image 131 is arranged in the patient region 13r, and at the same time, a normal image measurement assistant in which the still image with information 134 is arranged in the patient region 13r. Generate a screen. Each of the generated screens is supplied from the video processing unit 20 to the display control unit 23.

  The display control unit 23 outputs to the display unit 13 a one-screen video signal in which the patient screen on which the mirror image is arranged and the measurement assistant screen on which the normal image is arranged. The display control unit 23 adjusts the pixels of the patient screen to specific pixels on the screen of the display unit 13 and the pixels of the measurement assistant screen to the remaining pixels so as to conform to the configuration of the dual view liquid crystal. Place and synthesize.

  When the combined video signal is output to the display unit 13 of the dual view liquid crystal, as shown in FIG. 14, only the mirror patient screen is seen by the patient P who observes the screen from a certain angle. The measurement assistant U who observes from other angles can see only a normal image measurement assistant screen.

[Processing flow of patient-side information terminal device]
The process flow of the patient side information terminal device 1 in this embodiment will be described with reference to FIG.

  Steps S401 to S407 are the same as in the fourth embodiment.

  Instead of performing S408, the display control unit 23 outputs a video signal obtained by synthesizing the patient screen and the measurement assistant screen to the display unit 13 (S408 ').

Then, instead of performing S409 and S410, the display control unit 23 displays a composite screen including the patient screen and the measurement assistant screen on the display unit 13 (S409 ′).
According to the above configuration and method, the patient P can easily grasp the measurement site by confirming the mirror image 131 displayed on the display unit 13 from a specific angle. That is, the patient P can search for a measurement site of his / her body in the same state as when the patient P is reflected in the mirror. On the other hand, at the same time, the measurement assistant U can easily grasp the measurement site by confirming the still image with information 134 displayed on the display unit 13 from an angle different from the above angle. That is, the measurement assistant U can search for the measurement site of the patient P in the same state as in the case where the patient P is examined face-to-face. In this case, a normal image mirror image switching operation by an operation of a GUI component or a touch operation becomes unnecessary. Furthermore, only one display device (display unit 13) needs to be installed, and the installation area of the patient side information terminal device 1 can be reduced.

  From the above, even when the person being measured (patient P) is a measurement person and performs measurement, even when another measurement person (measurement assistant U) performs measurement, the measurement person can easily select the measurement site. It becomes possible to realize an even more convenient auscultation system 100 that can be grasped.

[Modification of Embodiment 5]
In the present embodiment, a screen in which the arrangement determining unit 30 arranges the live view image and the still image side by side may be displayed on the display unit 13. Further, a superimposed video in which the live view image and the still image are superimposed by the image superimposing unit 32 may be displayed on the display unit 13.

Embodiment 6
Another embodiment relating to the telemetry system of the present invention will be described below with reference to FIGS. 1, 5, and 15 to 17. For convenience of explanation, members having the same functions as those in the drawings described in the above-described embodiments are denoted by the same reference numerals and description thereof is omitted.

[Problems to be solved by this embodiment]
In the auscultation system 100 of the present invention, the doctor D uses the doctor-side information terminal device 2 to perform marking indicating the measurement site on the patient's still image, and displays the still image with information to which the marking is added as the patient-side information. It can be transmitted to the terminal device 1. Since this still image with information is reversed left and right in the patient-side information terminal device 1 and shown as a mirror image, the patient P can easily and intuitively grasp the measurement site. As a result, the doctor D can easily instruct the measurer of a desired measurement site while in the remote place 7, and can perform medical care efficiently.

  In the present embodiment, it is assumed that the doctor D writes characters and the like on the patient's still image using the doctor-side information terminal device 2. For example, it is assumed that a note on how to apply the stethoscope 3 is described.

  According to the above-described embodiments, the input information input by the doctor D is reflected on the still image and displayed as a mirror image on the patient side information terminal device 1 as a still image with information. For this reason, if the characters are reversed, the inconvenient input information is also reversed, and conversely, it is difficult for the patient P to recognize the input information (character symbols, etc.).

  In the present embodiment, in view of the above inconveniences, even when the subject himself / herself becomes a measurement person and performs measurement, the measurement person easily grasps the measurement site and easily grasps other necessary information. It is an object of the present invention to realize a telemetry system that is more convenient.

[Functional configuration of doctor side information terminal device]
The functional configuration of the doctor-side information terminal device 2 in the present embodiment is as shown in FIG.

  However, in the present embodiment, the following points are different from the doctor-side information terminal device 2 of each of the above-described embodiments.

  That is, the input information processing unit 56 always includes an inversion necessity determination unit 62 and a non-inversion information output unit 63.

  In addition, the input information processing unit 56 is configured to accept not only a handwritten marking object with a pen but also text information input with a keyboard or the like as input information.

  The inversion necessity determination unit 62 determines, for each piece of input information added to the still image by the doctor D, whether or not the input information should be inverted together with the still image.

  In the present embodiment, the reversal necessity determination unit 62 determines that reversal is not necessary for text information input via a keyboard (operation unit 44) and reverses other input information (such as a handwritten mark). Judgment is necessary.

  The non-inverted information output unit 63 is configured to form the input information determined to be inversion unnecessary by the inversion necessity determination unit 62 into a format that can be recognized by the patient-side information terminal device 1 and output it as non-inverted information. The non-inverted information output by the non-inverted information output unit 63 is transmitted to the patient side information terminal device 1 as data different from the still image with information by the communication unit 41. In the present embodiment, the non-inversion information is text information input by the doctor D.

  In addition, as a method for the operation receiving unit 54 to receive text information, for example, when text is input in a predetermined area on a still image, the operation receiving unit 54 may receive text information. . Alternatively, the doctor D can input text in an arbitrary area on the still image, and the operation reception unit 54 may receive the text information together with the position information where the text on the still image is input. Further, the operation receiving unit 54 may receive the attribute information (font information, color information, etc.) of the input text together with the text information.

  In addition, when the arrangement determining unit 67 of the video processing unit 50 generates a screen (and a GUI component) for receiving still image editing, the input text and the upper body of the patient on the still image do not overlap. The screen may be composed of two layers. Then, for example, the upper layer is defined as a layer for receiving (displaying) text input, and the upper body of the patient is defined as the lower layer, so that the inversion necessity determination unit 62 determines the text information that does not need to be inverted and the inversion required. Can be discriminated from still images.

  (A) of FIG. 15 is a figure which shows the specific example of the patient area | region 43r for displaying a patient displayed on the display part 43 of this embodiment. As shown in FIG. 15A, the arrangement determining unit 67 arranges the patient video 430 and the still image with information 431 being edited side by side in the patient area 43r.

  For example, the doctor D can write a mark representing a specific part on a still image using a tablet and a pen, as in the previous embodiments. In the present embodiment, as shown in FIG. 15, a comment can be input as text information in a predetermined (or arbitrary) region of a still image using, for example, a keyboard.

  The inversion necessity determination unit 62 determines that the mark of the measurement site (the handwritten circle appearing in the still image with information 431 in FIG. 15) of the input information generated by the input information generation unit 60 is the object to be inverted. To do. On the other hand, the character string input to the predetermined area is determined as text information that does not need to be inverted.

  The round object determined to be inverted is transferred from the inversion necessity determination unit 62 to the image superimposing unit 66. The image superimposing unit 66 generates a still image with information by combining the circular object and the still image. The generated still image with information is output from the still image output unit 61 to the communication unit 41. On the other hand, the text information determined not to be inverted is output to the communication unit 41 by the non-inverted information output unit 63 as non-inverted information that is data different from the still image with information.

  The still image with information and the non-inverted information (text information) are transmitted to the patient-side information terminal device 1 by the communication unit 41 via the network 4 and the server device 5, respectively.

[Functional configuration of patient-side information terminal device]
The functional configuration of the patient side information terminal device 1 in this embodiment is as shown in FIG.

  However, in the present embodiment, the following points are different from the patient side information terminal device 1 of the first embodiment.

  That is, the video processing unit 20 includes an image superimposing unit 32 and an inversion control unit 33 in addition to the arrangement determining unit 30 and the mirror image generating unit 31.

  The inversion control unit 33 determines and controls the necessity of inversion display for an object to be displayed. In the present embodiment, the inversion control unit 33 determines whether or not the display target object supplied from the doctor-side information terminal device 2 should be displayed horizontally reversed. Specifically, the inversion control unit 33 determines that inversion for a still image with information is necessary at the time of mirror image display, and for text information, inversion is not necessary regardless of mirror image display or normal image display. Judge.

  In accordance with an instruction from the inversion control unit 33, the mirror image generation unit 31 generates a mirror image by reversing only the still image with information when the mirror image is displayed.

  In the present embodiment, the image superimposing unit 32 superimposes text information on a still image with information received separately or superimposes the text information on the mirror image according to an instruction from the inversion control unit 33. It is.

  At the time of mirror image display, the arrangement determining unit 30 generates a screen by arranging the mirror image on which the text information that has not been inverted is superimposed. When displaying a normal image, a still image with information on which the text information is superimposed as a normal image is arranged to generate a screen. In the present embodiment, the arrangement determining unit 30 may further arrange a GUI component for allowing the user to perform an operation of switching between a normal image and a mirror image.

  FIGS. 15B and 15C are diagrams illustrating specific examples of a patient region 13r displayed on the display unit 13 of the present embodiment for displaying a patient. FIG. 15B is a diagram illustrating an example in which a mirror image is displayed for the patient P, and FIG. 15C is an example in which a normal image is displayed for the measurement assistant U. FIG.

  For the patient P, the arrangement determining unit 30 arranges the mirror image image 130 and the mirror image 131 side by side in the patient region 13r as shown in FIG. Further, in the present embodiment, the arrangement determining unit 30 arranges the GUI component 132. However, the arrangement determining unit 30 arranges the text information as it is without inverting it.

  For the measurement assistant U, as shown in FIG. 15C, the arrangement determining unit 30 displays a patient image 133 (normal image) and a still image with information 134 (normal image) in the patient region 13r. Place them side by side. Further, in the present embodiment, the arrangement determining unit 30 arranges the GUI component 135. The arrangement determining unit 30 similarly arranges the text information as it is.

[Processing flow of patient-side information terminal device]
FIG. 16 is a flowchart showing the flow of processing of the patient side information terminal device 1 in the embodiment of the present invention.

  When the medical treatment is started, the imaging unit 16 captures the patient P and acquires a patient video (S501). Then, the mirror image generation unit 31 generates a mirror image of the patient image (S502).

  On the other hand, the communication part 11 transmits the said patient image | video to the doctor side information terminal device 2 (S503). Subsequently, the still image with information and the text information generated based on the patient video are received from the doctor-side information terminal device 2 (S504). When the still image with information is received, the mirror image generation unit 31 generates a mirror image of the still image with information (S505). Then, the image superimposing unit 32 directly superimposes the received text information on the generated mirror image (S506).

  The arrangement determining unit 30 arranges the generated mirror image 130, the mirror image 131 on which the text information is overlaid, and the GUI part 132 for switching operation in the patient area 13r (S507).

  The display control unit 23 displays a screen including the patient region 13r on the display unit 13 (S507). The display content at this time is, for example, as shown in FIG.

  If the operation accepting unit 24 detects an input of a switching operation to a normal image (YES in S508), the image superimposing unit 32 adds the received text to the still image with information received in S504. The information is superimposed as it is (S509).

  Then, the arrangement determining unit 30 arranges a patient video (normal image) 133, a still image with information (video image) 134 on which the text information is superimposed, and a GUI component 135 for switching operation in the patient region 13r. (S510).

  The display control unit 23 displays a screen including the patient region 13r on the display unit 13 (S510). The display content at this time is, for example, as shown in FIG.

  Here, when the operation receiving unit 24 detects an input of a switching operation to a mirror image (YES in S511), the arrangement determining unit 30 returns to S507, and thereafter repeats the same operation.

[Processing flow of doctor side information terminal device]
FIG. 17 is a flowchart showing a process flow of the doctor-side information terminal device 2 in the embodiment of the present invention.

  When medical treatment is started and a patient video is transmitted from the patient-side information terminal device 1, the video receiver 55 receives the patient video via the communication unit 41. Then, the video signal of the screen processed by the video processing unit 50 is output from the display control unit 53, whereby the patient video is displayed on the display unit 43 (S601).

  Subsequently, when the doctor D inputs an instruction to capture a patient's still image via the operation unit 44 while watching the patient image (YES in S602), the still image acquisition unit 65 at that timing, An image is acquired (S603). The captured still image is displayed on the display unit 43 as a still image to be edited (S603). The doctor D can mark, paint, or input characters with respect to the still image using a pen and a tablet or a keyboard.

  Here, it is assumed that the doctor D edits the still image using the operation unit 44. That is, it is assumed that input information is input. When an information input event occurs in this way (YES in S604), the input information generation unit 60 acquires the input information that has been input. Then, the reversal necessity determination unit 62 performs the reversal necessity determination on the input information (S605).

  If the input information is text information input in a predetermined (arbitrary) region (or layer) for inputting text (YES in S605), the inversion necessity determination unit 62 does not need to invert the text information. Is determined. The non-inverted information output unit 63 outputs the text information to the communication unit 41 according to the determination (S606).

  On the other hand, if the input information is a mark or the like and is not text information (NO in S605), the inversion necessity determination unit 62 determines that the input information is inversion necessary. The image superimposing unit 66 superimposes the input information on the still image acquired in S603 according to the determination (S607).

  The still image output unit 61 outputs the still image with information on which the input information is superimposed to the communication unit 41 (S608).

  If the input information is further received before the communication unit 41 transmits the text information and the still image with information (NO in S609), the input information processing unit 56 and the video processing unit 50 are , The processing after S604 may be repeated.

  On the other hand, for example, when the doctor D clicks the “edit completed / send” button and the information input is completed (YES in S609), the communication unit 41 outputs the text information finally output. And the still image with information is individually transmitted to the patient side information terminal device 1 (S610).

  According to the above configuration and method, the input information input by the doctor D in the doctor-side information terminal device 2 includes information to be reversed at the time of mirror image display and information that is not reversed regardless of the mirror image display in the patient-side information terminal device 1. The information is divided so as to be identifiable and supplied to the patient side information terminal device 1.

  Since the information to be inverted at the time of mirror image display is reflected in the still image as the still image with information, the patient side information terminal device 1 converts the information to be inverted by making the still image with information a mirror image. The mirror image can be displayed so that the patient P can see it correctly.

  On the other hand, the patient-side information terminal device 1 makes it difficult to read text information transmitted separately from the information-added still image when it is reversed. Can be displayed so that it looks right to the user.

  Thereby, the patient P can check the mark such as the measurement site in the same state as that seen in the mirror together with his / her appearance, and can check the characters in a readable state as usual. .

  From the above, when the measurement subject (patient P) himself performs measurement as a measurement person, the auscultation system 100 with higher convenience that enables the measurement person to easily grasp the measurement site is realized. It becomes possible.

<< Embodiment 7 >>
Another embodiment relating to the telemetry system of the present invention will be described below with reference to FIGS. 1, 5, and 16 to 19. For convenience of explanation, members having the same functions as those in the drawings described in the above-described embodiments are denoted by the same reference numerals and description thereof is omitted.

[Functional configuration of doctor side information terminal device]
The functional configuration of the doctor-side information terminal device 2 in the present embodiment is as shown in FIG.

  However, in the present embodiment, the following points are different from the doctor-side information terminal device 2 of each of the above-described embodiments.

  That is, the inversion necessity determination unit 62 of the input information processing unit 56 performs a character recognition process on the input information generated by the input information generation unit 60 in response to the input of the doctor D. Then, the inversion necessity determination unit 62 identifies, as a result of the character recognition process, an object recognized as a character in the input information as a text object, and an object not recognized as a character as a non-text object. Then, it is determined that inversion is not necessary for the text object, and it is determined that inversion is necessary for the non-text object.

  (A) of FIG. 18 is a figure which shows the specific example of the patient area | region 43r displayed on the display part 43 of this embodiment. As shown in FIG. 18A, the arrangement determining unit 67 arranges the patient video 430 and the still image with information 431 before and after editing or during editing in the patient area 43r.

  In FIG. 18A, doctor D uses a pen and a tablet to input a circle mark indicating the measurement site, a comment on the notes at the time of measurement, and an arrow indicating the relationship between the mark and the comment. An example of input is shown as information.

  FIG. 19 is a diagram illustrating a functional configuration of the doctor-side information terminal device 2 according to the present embodiment using a specific example.

  As illustrated in FIG. 19, the input information generation unit 60 generates input information input by the doctor D using a pen and a tablet based on the input signal received by the operation reception unit 54. In the above example, the input information generation unit 60 generates a circle mark, an arrow, and a comment.

  The inversion necessity determination unit 62 performs character recognition processing on each piece of input information generated by the input information generation unit 60 to determine whether the input information is a text object or a non-text object. In the example illustrated in FIG. 19, the inversion necessity determination unit 62 determines that a comment (“put here for 3 seconds”) is a text object, that is, inversion unnecessary. Further, the inversion necessity determination unit 62 determines that the circle mark and the arrow are non-text objects, that is, the inversion necessity.

  The text object (comment) determined not to be inverted is supplied to the non-inverted information output unit 63. As shown in FIG. 19, the non-inverted information output unit 63 outputs the text object to the communication unit 41 as non-inverted information together with position information indicating where to place the text object on the still image.

  On the other hand, the non-text object (marker and arrow) determined to be reversed is delivered to the image superimposing unit 66 together with the position information. The image superimposing unit 66 superimposes the non-text object on a still image acquired in advance according to each position information. Thereby, a still image with information to which a non-text object is added is generated. The still image with information is returned to the still image output unit 61.

  As illustrated in FIG. 19, the still image output unit 61 outputs the still image with information received from the image superimposing unit 66 to the communication unit 41.

  With the above configuration, the comment input by the doctor D is transmitted to the patient-side information terminal device 1 as non-inverted information, and the mark and arrow input by the doctor D are superimposed on the still image, and the patient as the still image with information is displayed. It is transmitted to the side information terminal device 1.

[Functional configuration of patient-side information terminal device]
The functional configuration of the patient side information terminal device 1 in this embodiment is as shown in FIG. The functional configuration of the patient side information terminal device 1 in the present embodiment is substantially the same as the functional configuration of the patient side information terminal device 1 in the sixth embodiment.

  In the present embodiment, specifically, the inversion control unit 33 determines that inversion for a still image with information is necessary at the time of mirror image display, and for a text object recognized as a character, a mirror image display, a normal image Regardless of display, it is determined that inversion is unnecessary.

  (B) and (c) of FIG. 18 are diagrams illustrating specific examples of a patient region 13r for displaying a patient, which is displayed on the display unit 13 of the present embodiment. 18B is a diagram showing an example in which a mirror image is displayed for the patient P, and FIG. 18C is an example in which a normal image is displayed for the measurement assistant U. FIG.

  For the patient P, the arrangement determining unit 30 arranges the mirror image 130 and the mirror image 131 side by side in the patient region 13r as shown in FIG. Further, in the present embodiment, the arrangement determining unit 30 arranges the GUI component 132. However, the arrangement determining unit 30 arranges the text object (comment: “apply for 3 seconds”) as it is without being inverted.

  For the measurement assistant U, as shown in FIG. 18C, the arrangement determining unit 30 displays a patient image 133 (normal image) and a still image with information 134 (normal image) in the patient region 13r. Place them side by side. Further, in the present embodiment, the arrangement determining unit 30 arranges the GUI component 135. The arrangement determining unit 30 similarly arranges the text object (comment: “apply for 3 seconds”) as it is.

  In addition, the flow of the process of the patient side information terminal device 1 in the embodiment of the present invention is as shown in FIG. The patient-side information terminal device 1 receives a text object (comment: “applies for 3 seconds here”) instead of the text information shown in FIG. 16 and displays it superimposed on a mirror image or a normal image.

  In addition, the flow of a process of the doctor side information terminal device 2 in embodiment of this invention is as showing in FIG. The doctor-side information terminal device 2 determines whether the object is a text object or a non-text object, instead of determining the text information shown in FIG. Then, the text object is transmitted to the patient side information terminal device 1 separately from the still image with information instead of the text information.

  According to the above-described configuration and method, the text object can be separated from the still image with information as information that does not invert the text object regardless of whether it is a mirror image display, whether it is a handwritten character or a character typed via the keyboard. It can be supplied to the patient side information terminal device 1. It is always preferable not to reverse the characters regardless of the mirror image display.

  The patient P can check the mark such as the measurement site in the same state as that seen with a mirror together with his / her appearance, and can check the character in a readable state as usual.

  Even if the doctor D is not restricted or conscious of the input method, he / she can edit the still image without inverting the input character.

  From the above, when the measurement subject (patient P) himself performs measurement as a measurement person, the auscultation system 100 with higher convenience that enables the measurement person to easily grasp the measurement site is realized. It becomes possible.

<< Embodiment 8 >>
Another embodiment relating to the telemetry system of the present invention will be described below with reference to FIGS. 1, 5, 16, and 18 to 20. For convenience of explanation, members having the same functions as those in the drawings described in the above-described embodiments are denoted by the same reference numerals and description thereof is omitted.

[Functional configuration of doctor side information terminal device]
The functional configuration of the doctor-side information terminal device 2 in the present embodiment is as shown in FIG.

  However, in the present embodiment, the following points are different from the doctor-side information terminal device 2 of each of the above-described embodiments.

  That is, the operation reception part 54 can identify the gesture input via the tablet. For example, when a gesture that draws a circle clockwise is input or a gesture that draws a circle counterclockwise is input as a gesture of a cue to which input information is input, the “clockwise input cue gesture” and “ A “counterclockwise input cue gesture” can be identified.

  Then, whether the inversion necessity determination unit 62 of the input information processing unit 56 has been input following the “clockwise input signal gesture” with respect to the input information input subsequent to the input signal gesture input by the doctor D, The necessity of inversion is determined according to whether the input is continued after the “counterclockwise input signal gesture”. In the present embodiment, as an example, the inversion necessity determination unit 62 determines that the input information input subsequent to the “clockwise input signal gesture” is necessary to invert, and continues to the “counterclockwise input signal gesture”. It is determined that the inputted input information is not inverted.

  For example, in the example illustrated in FIG. 18A, the doctor D performs a gesture of drawing a circle in a clockwise direction on a region other than the still image, and then, on the still image, a circle mark or Just fill in the arrow. In addition, the doctor D may enter a comment on the still image after inputting a gesture for drawing a circle around the left to an area other than the still image.

  In this way, as shown in FIG. 19, the inversion necessity determination unit 62 identifies the circle mark and the arrow that are input after the “clockwise input signal gesture” as the inversion required object. Further, the comment input subsequent to the “counterclockwise input signal gesture” is identified as an inversion unnecessary object.

  The inversion required object is combined with the still image and supplied to the patient side information terminal device 1 as a still image with information, and the inversion unnecessary object is supplied to the patient side information terminal device 1 as non-inversion information together with the position information.

[Functional configuration of patient-side information terminal device]
The functional configuration of the patient side information terminal device 1 in this embodiment is as shown in FIG. The functional configuration of the patient side information terminal device 1 in the present embodiment is substantially the same as the functional configuration of the patient side information terminal device 1 in the sixth and seventh embodiments.

  In the present embodiment, specifically, the inversion control unit 33 determines that inversion for a still image with information is necessary when displaying a mirror image, and the inversion input following the “counterclockwise input cue gesture”. It is determined that the unnecessary object does not need to be inverted regardless of the mirror image display or the normal image display.

  In addition, the flow of the process of the patient side information terminal device 1 in the embodiment of the present invention is as shown in FIG. The patient side information terminal device 1 receives an inversion unnecessary object (comment: “applies for 3 seconds here”) instead of the text information shown in FIG. 16 and displays it on a mirror image or a normal image.

[Processing flow of doctor side information terminal device]
FIG. 20 is a flowchart showing a process flow of the doctor-side information terminal device 2 according to the embodiment of the present invention.

  S701 to S703 are the same as S601 to S603 in FIG. Physician D can mark, paint, and input characters using the pen and tablet or keyboard (operation unit 44) on the still image acquired in S703. It is.

  Here, it is assumed that the doctor D edits a still image after inputting an information input gesture using the operation unit 44. Here, it is assumed that after inputting the “counterclockwise input signal gesture”, a handwritten character “putting here for 3 seconds” is input.

  When the information input gesture is input and the input information is input to the still image (YES in S704), the inversion necessity determination unit 62 determines that the information input gesture is “counterclockwise input signal gesture”, that is, It is determined whether the gesture does not need to be reversed or a “clockwise input signal gesture”, that is, whether the gesture needs to be reversed (S705). If the input gesture is a “counterclockwise input signal gesture”, the input information input immediately after this gesture is identified as an inversion unnecessary object (YES in S705).

  Then, the non-inverted information output unit 63 outputs the identified inversion-unnecessary object (comment: “this 3 seconds hit”) to the communication unit 41 as non-inverted information different from the still image with information (S706). ).

  Alternatively, after S703, the doctor D uses the operation unit 44 to input a “clockwise input signal gesture” and then inputs a circle mark indicating the measurement site (YES in S704).

  If the input gesture is a “clockwise input cue gesture”, the inversion necessity determination unit 62 determines that the input information input immediately after the gesture is an inversion required object (NO in S705).

  In accordance with the determination, the image superimposing unit 66 superimposes the inversion required object on the still image acquired in S703 (S707).

  The still image output unit 61 outputs the still image with information on which the inversion required object (circle mark) is superimposed to the communication unit 41 (S708).

  In addition, before the communication unit 41 transmits the inversion unnecessary object and the still image with information, when the input information is received (NO in S709), the input information processing unit 56 and the video processing unit 50 are received. May repeat the processing from S704.

  On the other hand, for example, when the doctor D clicks the “edit completed / send” button and the information input is completed (YES in S709), the communication unit 41 outputs the final output, which is not inverted. The object and the still image with information are individually transmitted to the patient side information terminal device 1 (S710).

  According to the above-described configuration and method, the doctor D in the doctor-side information terminal device 2 inputs the input information after inputting the information input gesture, according to the type of the information input gesture, the inversion unnecessary object, the inversion required object, Identified. Then, the doctor-side information terminal device 2 can identify in the patient-side information terminal device 1 information that should be reversed at the time of mirror image display (reversal required object) and information that is not reversed regardless of the mirror image display (reversal unnecessary object). And can be supplied to the patient-side information terminal device 1.

  Since the information to be inverted at the time of mirror image display is reflected in the still image as the still image with information, the patient side information terminal device 1 converts the information to be inverted by making the still image with information a mirror image. The mirror image can be displayed so that the patient P can see it correctly.

  On the other hand, the patient-side information terminal device 1 superimposes the non-inverted object transmitted separately from the information-added still image on the mirror image without being reversed even when the mirror image is displayed, so that the patient can receive the patient as intended by the doctor D. P can be displayed so that it can be seen.

  Thereby, the doctor D can input the input information that the user does not want to invert and the input information that he / she wants to invert, regardless of the type of characters, graphics, and the like.

  From the above, when the measurement subject (patient P) himself performs measurement as a measurement person, the auscultation system 100 with higher convenience that enables the measurement person to easily grasp the measurement site is realized. It becomes possible.

Embodiment 9
Another embodiment relating to the telemetry system of the present invention will be described below with reference to FIGS. 1, 5, 19, and 21. FIG. For convenience of explanation, members having the same functions as those in the drawings described in the above-described embodiments are denoted by the same reference numerals and description thereof is omitted.

[Functional configuration of doctor side information terminal device]
The functional configuration of the doctor-side information terminal device 2 in the present embodiment is as shown in FIG.

  However, in the present embodiment, the following points are different from the doctor-side information terminal device 2 of each of the above-described embodiments.

  That is, the arrangement determining unit 67 arranges and displays GUI parts for inputting input information, that is, palettes, depending on necessity of inversion in the patient area 43r on the display unit 43 or other arbitrary areas. Then, when the input information is input, the operation reception unit 54 can identify whether the pallet that requires reversal is selected or whether the pallet that does not require reversal is selected.

  The reversal necessity determination unit 62 of the input information processing unit 56 selects whether the input information input by the doctor D is input when the reversal-necessary palette is selected or a reversal-free palette is selected. The necessity of inversion is determined according to whether it has been input sometimes.

  (A) of FIG. 21 is a figure which shows the specific example of the patient area | region 43r displayed on the display part 43 of this embodiment. As shown in FIG. 21A, the arrangement determining unit 67 arranges the patient video 430 and the still image with information 431 before and after editing or during editing in the patient area 43r. Furthermore, in the present embodiment, the arrangement determining unit 67 arranges a reversal required palette 432 for inputting reversal required input information and a reversal unnecessary pallet 433 for inputting reversal unnecessary input information.

  For example, in the example shown in FIG. 21A, the doctor D only needs to enter a circle mark or an arrow on the still image after selecting the inversion required palette 432. In addition, the doctor D may enter a comment on the still image after selecting the inversion unnecessary palette 433.

  In this way, as shown in FIG. 19, the inversion necessity determination unit 62 identifies the circular mark and the arrow input during selection of the inversion required palette 432 as the inversion required objects. In addition, a comment input during the selection of the inversion unnecessary palette 433 is identified as an inversion unnecessary object.

  The inversion required object is combined with the still image and supplied to the patient side information terminal device 1 as a still image with information, and the inversion unnecessary object is supplied to the patient side information terminal device 1 as non-inversion information together with the position information.

  In addition, the flow of the process of the doctor side information terminal device 2 in this embodiment is as showing in FIG. When the operation accepting unit 54 of the doctor-side information terminal device 2 accepts selection of a pallet in S704, the inversion necessity determination unit 62 determines whether or not the input information is inversion according to the selected pallet in S705. To do.

[Functional configuration of patient-side information terminal device]
The functional configuration of the patient side information terminal device 1 in this embodiment is as shown in FIG. The functional configuration of the patient side information terminal device 1 in the present embodiment is substantially the same as the functional configuration of the patient side information terminal device 1 in the sixth to eighth embodiments.

  In the present embodiment, specifically, the inversion control unit 33 determines that inversion for a still image with information is necessary when displaying a mirror image, and for inversion unnecessary objects input during selection of the inversion unnecessary palette 433. Regardless of the mirror image display or the normal image display, it is determined that the inversion is not necessary.

  FIGS. 21B and 21C are diagrams illustrating specific examples of a patient region 13r displayed on the display unit 13 of the present embodiment for displaying a patient. FIG. 21B is a diagram showing an example in which a mirror image is displayed for the patient P, and FIG. 21C is an example in which a normal image is displayed for the measurement assistant U. FIG.

  For the patient P, the arrangement determining unit 30 arranges the mirror image 130 and the mirror image 131 side by side in the patient region 13r as shown in FIG. Further, in the present embodiment, the arrangement determining unit 30 arranges the GUI component 132. However, the arrangement determining unit 30 arranges the input information (comment: “☆ hitting here for 3 seconds”) input from the inversion unnecessary palette 433 as it is without being inverted.

  For the measurement assistant U, as shown in FIG. 21C, the arrangement determining unit 30 displays the patient image 133 (normal image) and the still image with information 134 (normal image) in the patient region 13r. Place them side by side. Further, in the present embodiment, the arrangement determining unit 30 arranges the GUI component 135. Similarly, the arrangement determining unit 30 also arranges the input information (comment: “☆ hit this 3 seconds”) input from the inversion unnecessary palette 433 as it is.

  In addition, the flow of the process of the patient side information terminal device 1 in this embodiment is as showing in FIG. The patient side information terminal device 1 receives an inversion unnecessary object (comment: “applies for 3 seconds here”) instead of the text information shown in FIG. 16 and displays it on a mirror image or a normal image.

  According to the above-described configuration and method, the input information input by the doctor D after selecting the palette in the doctor-side information terminal device 2 includes the inversion unnecessary object and the inversion required according to the type of the palette selected at that time. Identified as an object. Then, the doctor-side information terminal device 2 can identify in the patient-side information terminal device 1 information that should be reversed at the time of mirror image display (reversal required object) and information that is not reversed regardless of the mirror image display (reversal unnecessary object). And can be supplied to the patient-side information terminal device 1.

  Since the information to be inverted at the time of mirror image display is reflected in the still image as the still image with information, the patient side information terminal device 1 converts the information to be inverted by making the still image with information a mirror image. The mirror image can be displayed so that the patient P can see it correctly.

  On the other hand, the patient-side information terminal device 1 superimposes the non-inverted object transmitted separately from the information-added still image on the mirror image without being reversed even when the mirror image is displayed, so that the patient can receive the patient as intended by the doctor D. P can be displayed so that it can be seen.

  Thereby, the doctor D can input the input information that the user does not want to invert and the input information that he / she wants to invert, regardless of the type of characters, graphics, and the like.

  From the above, when the measurement subject (patient P) himself performs measurement as a measurement person, the auscultation system 100 with higher convenience that enables the measurement person to easily grasp the measurement site is realized. It becomes possible.

[Modifications of Embodiments 2 to 9]
In each of the above-described embodiments (particularly, Embodiments 2 to 9), the live view image and the still image are displayed side by side in both the patient region 13r of the patient side information terminal device 1 and the patient region 43r of the doctor side information terminal device 2. Or it was the structure which displayed it superimposed.

  However, the present invention is not limited to this configuration, and the live view image and the still image are superimposed on the patient area 13r of the patient side information terminal device 1, while the live view is displayed on the patient area 43r of the doctor side information terminal device 2. The configuration may be such that an image and a still image are displayed side by side.

  According to the said structure, the patient P can grasp | ascertain own measurement site | part more rapidly by seeing his own real-time figure and the still image on which the measurement site | part was displayed overlapping. On the other hand, the doctor D can accurately and easily input various input information (measurement site) to the still image while grasping the current state of the patient P.

  Moreover, the arrangement | positioning determination part 30 of the patient side information terminal device 1 may be the structure which arranges a mirror image and a still image with information of a normal image side by side.

[Modifications of Embodiments 1 to 9]
In each of the above-described embodiments, a configuration is used in which a live-action video and an image of a patient photographed by the imaging unit 16 are used. However, the present invention is not limited to such a configuration, and the patient side information terminal device 1 or the doctor side information terminal device 2 generates a simulated image representing the patient's body shape as a model from the above-described photographed image or photographed image. The information terminal device 2 may generate a still image with information by adding input information to the simulated image.

  The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope shown in the claims, and embodiments obtained by appropriately combining technical means disclosed in different embodiments. Is also included in the technical scope of the present invention.

[Modification of Embodiment 1]
For example, the doctor side information terminal device 2 of the first embodiment is configured like the doctor side information terminal device 2 described in the sixth to ninth embodiments. In this case, the patient-side information terminal device 1 according to the first embodiment can receive an inversion unnecessary object (including text information, a text object, etc.) separately from the still image with information. Therefore, also in the first embodiment, the patient-side information terminal device 1 displays a still image with information as a mirror image, while displaying a normal image as it is without performing mirror image generation processing for an object that is not inverted. It can be configured.

[Example of software implementation]
Finally, each block of the patient side information terminal device 1 and the doctor side information terminal device 2, particularly each unit of the video processing unit 20, each unit of the input information processing unit 56, and each unit of the video processing unit 50, Or may be realized by software using a CPU as follows.

  That is, the patient-side information terminal device 1 and the doctor-side information terminal device 2 include a CPU (central processing unit) that executes instructions of a control program that realizes each function, a ROM (read only memory) that stores the program, and the program A random access memory (RAM) for expanding the program, a storage device (recording medium) such as a memory for storing the program and various data, and the like. An object of the present invention is to program the program code (execution format program, intermediate code program, source program) of the control program of the patient side information terminal device 1 or the doctor side information terminal device 2 which is software for realizing the functions described above. Is supplied to the patient-side information terminal device 1 or the doctor-side information terminal device 2, and the computer (or CPU or MPU) reads and executes the program code recorded on the recording medium. Can also be achieved.

  Examples of the recording medium include a tape system such as a magnetic tape and a cassette tape, a magnetic disk such as a floppy (registered trademark) disk / hard disk, and an optical disk such as a CD-ROM / MO / MD / DVD / CD-R. Card system such as IC card, IC card (including memory card) / optical card, or semiconductor memory system such as mask ROM / EPROM / EEPROM / flash ROM.

  Moreover, the patient side information terminal device 1 and the doctor side information terminal device 2 may be configured to be connectable to a communication network, and the program code may be supplied via the communication network. The communication network is not particularly limited. For example, the Internet, intranet, extranet, LAN, ISDN, VAN, CATV communication network, virtual private network, telephone line network, mobile communication network, satellite communication. A net or the like is available. Further, the transmission medium constituting the communication network is not particularly limited. For example, even in the case of wired such as IEEE 1394, USB, power line carrier, cable TV line, telephone line, ADSL line, etc., infrared rays such as IrDA and remote control, Bluetooth ( (Registered Trademark), 802.11 wireless, HDR (High Data Rate), mobile phone network, satellite line, terrestrial digital network, and the like can also be used. The present invention can also be realized in the form of a computer data signal embedded in a carrier wave in which the program code is embodied by electronic transmission.

  In the present invention, a remote measurement instructor instructs a measurement site to a measurement person and a measurement person, and the measurement result obtained at the measurement site where the measurement person and the measurement person exist is measured at a remote place. The present invention can be widely applied to a telemetry system in which an instructor can receive and execute a process using the measurement result. In particular, according to the present invention, a doctor instructs a measurement site from a remote location, and uses a measurement result obtained at a measurement site where a patient and a measurement assistant are present, so that the doctor can examine the patient from a remote location. It is suitably used for a medical examination system.

1 Patient-side information terminal device (information terminal device)
1a Body 2 Doctor side information terminal device (information terminal device)
2a Body 3 Stethoscope (measuring device)
4 Network 5 Server device 6 Measurement site 7 Remote location 10 Control unit 11 Communication unit 12 Audio input / output unit 12a Audio input unit 12b Audio output unit 13 Display unit (touch panel)
13a Patient display (first display / display)
13b Measurement assistant display unit (second display unit / display unit)
13r Patient area 14 Operation unit (touch panel / pen and tablet / mouse / keyboard)
DESCRIPTION OF SYMBOLS 15 Memory | storage part 16 Image pick-up part 17 Short-distance communication part 20 Image | video processing part (video processing means)
21 Input / output control unit (input / output control means)
22 Measurement data processing unit (Measurement data processing means)
23 Display control unit (display control means)
24 Operation reception part (operation reception means)
30 Placement determination unit (placement determination means)
31 Mirror image generation unit (mirror image generation means)
32 Image superimposing unit (image superimposing means)
33 Inversion control unit (inversion control means)
40 control unit 41 communication unit 42 audio input / output unit 42a audio input unit 42b audio output unit 43 display unit 43r patient area 44 operation unit 45 storage unit 50 video processing unit (video processing means)
51 Input / output control unit (input / output control means)
52 Measurement data receiver (Measurement data receiver)
53 Display control unit (display control means)
54 Operation reception part (operation reception means)
55 Video receiver (video receiver)
56 Input information processing unit (input information processing means)
60 Input information generation unit (input information generation means)
61 Still image output unit (still image output means)
62 Inversion necessity determination unit (reverse necessity determination means)
63 Non-inverted information output unit (non-inverted information output means)
65 Still image acquisition unit (still image acquisition means)
66 Image superimposing unit (compositing means / image superimposing means)
67 Placement determination unit (placement determination means)
100 Auscultation system (telemetry system / remote examination system)
130 Mirror image 131 Mirror image 132 GUI component 133 Patient image 134 Still image with information 135 GUI component 136 Superimposed mirror image 137 Superimposed normal image 430 Patient image 431 Still image with information 432 Reversal required palette (second input tool)
433 Inverted palette (first input tool)
D Doctor (Measurer / Processor)
P Patient (Measuring person / Measuring person)
U Measurement assistant (measurer)

Claims (19)

A first information terminal device that communicates with a second information terminal device and constructs a telemetry system that performs measurement on a measured person,
A still image with information provided from the second information terminal device, in which at least a mark indicating a measurement site to be measured is added to the measurement subject image representing the affected area of the measurement subject, is reversed horizontally Mirror image generation means for generating a mirror image,
A reversing control means for determining whether or not a reversing process of a display object arranged on the display screen of the display unit is necessary;
An arrangement determining unit that determines to arrange the mirror image generated by the mirror image generating unit on the display screen according to the determination of the inversion control unit ;
The inversion control means determines that inversion is necessary when the display object provided from the second information terminal device is the still image with information, and displays the information separately from the still image with information. Determine that the display object provided as the object does not need to be flipped,
The arrangement determining means arranges the mirror image with respect to the still image with information determined to be inverted and arranges the display object determined to be unnecessary as it is . 1. Information terminal device. The mirror image generation means includes
A mirror image is generated by horizontally flipping the subject image of the subject's affected area,
The arrangement determining means is
The first information terminal device according to claim 1, wherein the mirror image and the mirror image are arranged side by side on the display screen.   A first display unit for displaying a mirror image of at least one of the mirror image and a mirror image obtained by reversing a subject image obtained by photographing the affected part of the subject;
  A second display unit for displaying a normal image of at least one of the still image with information and the subject video;
  Display control means for outputting a video signal of the display screen whose arrangement is determined by the arrangement determination means to a display unit,
  The display control means outputs a video signal of the display screen on which the mirror image is arranged to the first display unit, and outputs a video signal of the display screen on which the normal image is arranged to the second display unit. The 1st information terminal device according to claim 1 or 2 characterized by things.   The display unit is a multi-image directional liquid crystal display in which screens having different contents can be viewed on one screen from different directions,
  The arrangement determining means includes a first display screen on which at least one of the mirror image and a mirror image obtained by reversing the subject image obtained by photographing the affected part of the subject, and the still image with information And a second display screen on which a normal image of at least one of the measurement subject images is arranged,
  4. The display control unit according to claim 1, further comprising a display control unit that outputs a video signal obtained by combining the first display screen and the second display screen generated by the arrangement determination unit to the display unit. The 1st information terminal device given in any 1 paragraph.   The mirror image generation means generates a mirror image by reversing the measurement subject video obtained by photographing the affected area of the measurement subject,
  2. The first information terminal device according to claim 1, further comprising image superimposing means for generating a superimposed mirror image image obtained by superimposing the mirror image and the mirror image. A first information terminal device that communicates with a second information terminal device and constructs a telemetry system that performs measurement on a measured person,
A still image with information provided from the second information terminal device, in which at least a mark indicating a measurement site to be measured is added to the measurement subject image representing the affected area of the measurement subject, is reversed horizontally Mirror image generation means for generating a mirror image,
An arrangement determining unit that determines to arrange the mirror image generated by the mirror image generating unit on the display screen of the display unit ;
The mirror image generation means generates a mirror image by reversing the measurement subject video obtained by photographing the affected area of the measurement subject,
A first information terminal device further comprising image superimposing means for generating a superimposed mirror image image obtained by superimposing the mirror image and the mirror image .   A second information terminal device that communicates with the first information terminal device and constructs a telemetry system that performs measurement on the measurement subject.
  A composition for generating a still image with information by adding input information including at least a mark indicating a measurement site to be measured, which is input by the user, to the measurement subject image representing the affected area of the measurement subject. Means,
  A still image output means for outputting the still image with information generated by the combining means to the first information terminal device;
  Reversal necessity determination means for determining whether or not the input information input by the user should be displayed in reverse with the measurement subject image;
  Non-inversion information output means for outputting, as non-inversion information, input information determined to be inversion-free by the inversion necessity determination means,
  The second information terminal device, wherein the synthesizing unit synthesizes the input information determined to be inverted by the inversion necessity determination unit with the measurement subject image.   8. The apparatus according to claim 7, further comprising a still image acquisition unit configured to extract the measurement subject image from a measurement subject image obtained by photographing the affected area of the measurement subject provided from the first information terminal device. The 2nd information terminal device of description.   The inversion necessity determination means includes
  9. The second information terminal device according to claim 7, wherein text information representing a character string input to the measurement subject image is determined as input information that does not need to be inverted.   The inversion necessity determination means includes
  9. The input information input to the measurement subject image is determined to be inversion unnecessary when it is determined that the input information is a character as a result of character recognition processing. 2nd information terminal device of description.   The inversion necessity determination means includes
  It is determined that the input information input after the gesture meaning non-reversal is input is determined as needless reversal, and the input information input after the gesture indicating the need for reversal is determined as reversal required The second information terminal device according to claim 7 or 8.   On the display unit, together with the measurement subject image, a first input tool for inputting input information that is not required to be inverted and a second input tool for inputting input information that is not required to be inverted are displayed in a selectable manner.
  The inversion necessity determination means determines that the input information input when the first input tool is selected is not necessary to invert, and the input information input when the second input tool is selected. The second information terminal device according to claim 7 or 8, wherein it is determined that the reversal is necessary.   The first information terminal device according to any one of claims 1 to 6,
  A telemetry system comprising: the second information terminal device according to any one of claims 7 to 12.   The first information terminal device includes:
  Providing the second information terminal device with a video image of the person to be measured at least of the upper body of the person to be measured;
  The second information terminal device is
  A still image with information in which a mark indicating a measurement site to which a stethoscope is applied is added to any position of the upper half of the measurement subject included in the measurement subject image extracted from the measurement subject image. The telemetry system according to claim 13, wherein the telemetry system is provided to an information terminal device.   A telemetry system that performs measurement on a measurement subject by communication between a first information terminal device and a second information terminal device,
  The first information terminal device includes:
    A still image with information provided from the second information terminal device, in which at least a mark indicating a measurement site to be measured is added to the measurement subject image representing the affected area of the measurement subject, is reversed horizontally Mirror image generation means for generating a mirror image,
    An arrangement determining unit that determines to arrange the mirror image generated by the mirror image generating unit on the display screen of the display unit;
  The second information terminal device is
    A composition for generating a still image with information by adding input information including at least a mark indicating a measurement site to be measured, which is input by the user, to the measurement subject image representing the affected area of the measurement subject. Means,
    A still image output means for outputting the still image with information generated by the combining means to the first information terminal device;
  The first information terminal device provides the second information terminal device with a measurement subject image obtained by photographing at least the upper body of the measurement subject,
  In the second information terminal device, a mark indicating a measurement site to which a stethoscope is applied is added to any position of the upper half of the measurement subject included in the measurement subject image extracted from the measurement subject video. A telemetry system for providing a still image with information to the first information terminal device.   A control method for a first information terminal device that communicates with a second information terminal device and constructs a telemetry system for measuring a subject.
  A still image with information provided from the second information terminal device, in which at least a mark indicating a measurement site to be measured is added to the measurement subject image representing the affected area of the measurement subject, is reversed horizontally A mirror image generation step for generating a mirror image,
  A reversal control step for determining whether or not a reversing process of a display object placed on the display screen of the display unit of the first information terminal device is necessary;
  An arrangement determining step for deciding to arrange the mirror image generated in the mirror image generation step on the display screen according to the determination in the inversion control step;
  In the inversion control step, when the display object provided from the second information terminal device is the still image with information, it is determined that inversion is necessary, and a display different from the still image with information is displayed. Determine that the display object provided as the object does not need to be flipped,
  In the arrangement determining step, the mirror image is arranged with respect to the still image with information determined to be inverted, and the display object determined to be unnecessary is arranged as it is. The control method of 1 information terminal device.   A method for controlling a second information terminal device that communicates with a first information terminal device and constructs a telemetry system that performs measurement on a measurement subject.
  A composition for generating a still image with information by adding input information including at least a mark indicating a measurement site to be measured, which is input by the user, to the measurement subject image representing the affected area of the measurement subject. Steps,
  A still image output step of outputting the still image with information generated in the combining step to the first information terminal device;
  A reversal necessity determination step for determining whether or not the input information input by the user should be displayed in reverse with the measurement subject image;
  A non-inversion information output step for outputting the input information determined to be inversion unnecessary in the inversion necessity determination step as non-inversion information,
  In the synthesizing step, the second information terminal device control method, wherein the input information determined to be necessary for reversal in the reversal necessity determination step is synthesized with the measurement subject image.   The control program for functioning a computer as each means of the information terminal device of any one of Claim 1-12.   The computer-readable recording medium which recorded the control program of Claim 18.

Images