JP2016200968A - Information processor, information processing system, image management device, image management system, information processing method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve the convenience of an image of a subject photographed by a digital camera in a medical site by reducing operation inputs about registration of an electronic medical chart.SOLUTION: A photographing device 102-1 acquires a subject image obtained by photographing a subject with the identification information of the subject acquired, and associates the subject image with the identification information to store the subject image in a storage part. An image based on the subject image is displayed in a display part. Also, first setting is performed by registering the subject image as electronic medical chart information of the subject in accordance with the acquisition of the subject image. Here, second setting is performed by not registering the subject image as electronic medical chart information of the subject in accordance with an operation input to a thumbnail of the subject image subjected to the first setting. Both the subject images subjected to the first and second setting are outputted to an image management server 105.SELECTED DRAWING: Figure 1

Description

  The disclosure of the present specification relates to an information processing apparatus, an information processing system, an image management apparatus, an image management system, an information processing method, and a program for managing an image obtained by a so-called digital camera.

  An image obtained by photographing a wound, pressure ulcer, etc. of a subject with a camera that receives visible light, a so-called digital camera, is used for follow-up observation and grasping of the subject's condition.

JP 2013-235560 A

  Since an image of a subject photographed with a so-called digital camera is used to record a medical condition of the subject, registration in an electronic medical record is desirable. However, when a large number of images are taken, there is a problem that if all of them are registered in the electronic medical record, a lot of unnecessary information is included. On the other hand, if the captured image remains unoutput in the digital camera, even if a doctor tries to obtain detailed information on the subject after a while, it takes time to acquire and use such images. There was a problem that it took.

  Therefore, an information processing apparatus according to one embodiment of the present invention is a portable information processing apparatus, which includes an imaging unit that images a subject, an information acquisition unit that acquires identification information of the subject, In a state where the identification information is acquired by the information acquisition unit, an image acquisition unit that acquires a subject image obtained by imaging the subject by the imaging unit, and acquisition of the subject image by the image acquisition unit And storage control means for associating the subject image with the identification information acquired by the information acquisition means and storing it in the storage unit, and display control for displaying an image based on the subject image on the display unit And the first setting for registering the subject image as the electronic medical record information of the subject in accordance with the acquisition of the subject image by the means and the image acquisition unit, and the first setting. The image is based on the subject image. A setting means for setting the second setting not to register the subject image as the electronic medical record information of the subject in response to an operation input to the image displayed on the display unit, and the first or second setting Output means for outputting the subject image to the outside.

According to the information processing apparatus according to one embodiment of the present invention, registration / non-registration can be set in the electronic medical record.
In particular, in a portable information processing apparatus in which a photographing unit and a unit for setting registration / non-registration to an electronic medical record are integrated, it is normal that a large number of images are not photographed. Thus, the captured image can be set to be registered in the basic electronic medical chart, and can be canceled by an operation input, so that the trouble of the operation input can be reduced and the usability in the medical field can be improved.

It is a block diagram for demonstrating the medical assistance system which concerns on embodiment of this invention. It is a flowchart which shows the flow of the process of the medical assistance which concerns on embodiment of this invention. It is a figure which shows the example of the imaging device used with the medical assistance system which concerns on embodiment. It is a figure which shows the image used with the imaging device which concerns on embodiment, and its incidental information. It is a figure which shows the display screen displayed on the display part of the portable image registration apparatus which concerns on embodiment. It is a flowchart which shows the flow of the notification process of the new arrival image in a portable image registration apparatus. It is the figure which expanded a part of display screen of a portable image registration apparatus. It is a flowchart which shows the flow of the process which switches the imaging device of the image made into a display target on the display screen of a portable image registration apparatus. It is the figure which expanded other one part of the display screen of a portable image registration apparatus. It is a figure which shows the other example of the display screen displayed on the display part of the portable image registration apparatus which concerns on embodiment. It is a figure which shows the transition of the display in the display screen of a portable image registration apparatus. It is a figure which shows the display screen displayed with the apparatus which manages electronic medical chart information. It is a figure which shows the display screen displayed with an image viewer apparatus. It is a figure which shows the other example of the display screen displayed with an image viewer apparatus. It is a flowchart which shows the flow of a process of the portable information processing apparatus (mobile terminal device) which has an imaging | photography part based on embodiment. It is a figure which shows the example of the login screen of a portable terminal device. It is a figure which shows the example of the input screen of examinee ID of a portable terminal device. It is a figure which shows the example of the display screen of the examinee information of a portable terminal device. It is a figure which shows the example of the imaging | photography screen of a portable terminal device. It is a figure which shows the example of the screen which displays the image of a portable terminal device as a list. It is a flowchart which shows the flow of the process with respect to the image of a portable terminal device. It is a figure which shows the example of the screen which operates the image of a portable terminal device.

  A medical support system according to an embodiment of the present invention includes an apparatus 101 that manages electronic medical record information, a plurality of imaging apparatuses 102-1 to 102-N, and a display unit for captured images, as shown in FIG. Each of the portable image registration device 103 and the image viewer device 104 is connected to the image management server 105 and the communication network 106 so as to communicate with each other.

  A plurality of photographing apparatuses 102-1 to 102-N and a portable image registration apparatus 103 are examples of the information processing apparatus according to the embodiment.

  An information processing apparatus according to one embodiment is, for example, an imaging apparatus 102-1, and is a portable information processing apparatus that performs imaging and associates the captured image with identification information of a subject. For example, the processing according to the embodiment is realized by a so-called smartphone and a software application executed on the smartphone.

  An information processing apparatus according to another embodiment is, for example, a portable image registration apparatus 103 that receives a subject image photographed by the photographing device 102 and identifies the subject image and the subject identification information. Is an information processing apparatus that performs an association with. For example, the processing according to the embodiment is realized by a so-called personal computer and a software application executed on the personal computer.

  Hereinafter, (1) an outline of the photographing apparatus 102-1 which is an example of a portable information processing apparatus according to one of the embodiments, and (2) a portable image which is an example of the information processing apparatus according to one of the embodiments. Outline of the registration apparatus 103, (3) Outline of the image management server 105 used together with the photographing apparatus 102-1 or the portable image registration apparatus 103, and (4) Detailed description of the embodiment by the portable image registration apparatus 103 (FIGS. 14) and (5) Detailed description of the embodiment by the photographing apparatus 102-1 (FIGS. 15 to 22) will be given in this order.

<(1) Overview of Imaging Device 102-1>
The imaging apparatus 102-1 which is an example of the information processing apparatus according to the embodiment is an information processing apparatus capable of setting whether or not to register a captured subject image in electronic medical record information. The photographing apparatus 102-1 includes a camera, an information acquisition unit, an image acquisition unit, a storage control unit, a display control unit, a setting unit, and an output unit. In addition, the photographing apparatus 102-1 includes a display unit, a memory, a wireless communication module, and a CPU that integrally controls the operation of the photographing apparatus 102-1. The information acquisition unit, the image acquisition unit, the storage control unit, the display control unit, and the setting unit may be realized by a software program. In this case, the imaging device 102-1 further includes a RAM. The software program stored in the memory is expanded in the RAM, and instructions included in the software program are sequentially executed by the CPU. Thereby, the CPU controls the camera, the display unit, the memory, and the wireless communication module, the functions corresponding to the above-described units are realized, and the processing according to the embodiment of the present invention is executed.

  The camera is for photographing a subject, an image sensor array that detects visible light and converts it into an electrical signal, and an electrical that obtains digital data of the subject image based on the electrical signal obtained by the image sensor array. Circuit.

  The information acquisition unit acquires the identification information of the subject. For example, from the image obtained by photographing the barcode attached to the wristband wound around the arm of the subject by the camera, the barcode is analyzed and converted into numerical information, and the numerical information is converted to an external server. Send to. The external server transmits subject identification information and other subject information corresponding to the numerical information to the imaging apparatus 102-1. The information acquisition unit acquires the subject identification information by receiving the subject information from the external server.

  The image acquisition unit acquires a subject image obtained by photographing the subject with a camera in a state where the identification information is acquired by the information acquisition unit. For example, the shutter of the camera is released in response to pressing a button displayed in response to acquisition of identification information, and the digital data of the subject image output from the electric circuit of the camera is received by the image acquisition unit. To be acquired.

  In response to the acquisition of the subject image by the image acquisition unit, the storage control unit associates the subject image and the identification information of the subject and stores them in the storage unit in the imaging apparatus 102-1. Here, the association processing includes the ID information of the subject image in the identification information, or includes the identification information itself or the ID of the identification information in the header of the subject image. The process to be stored in Note that processing by this other method may be used, and the point is that the other information may be referred to from one information. Of course, mutual reference may be possible.

  The display control unit displays an image based on the subject image on the display unit of the imaging apparatus 102-1. The image displayed on the display unit may be the subject image itself, or may be a reduced image such as a thumbnail generated in accordance with the size of the display unit of the imaging apparatus 102-1, It may be an image obtained by extracting a partial region of the subject image.

  The imaging apparatus 102-1 further includes a setting unit that is set as a first setting for registering the subject image as the electronic medical record information of the subject in accordance with the acquisition of the subject image by the image obtaining unit. The setting unit is configured to display the subject image in response to an operation input on the image that is the first setting and is displayed on the display unit. The second setting is not registered as electronic medical record information. The first setting and the second setting are defined by incidental information associated with the subject image. For example, the incidental information is an Integer type variable indicating setting information. When the variable is 1 indicating the first setting, the subject image is the first setting registered in the electronic medical record, and the variable is 2 indicating the second setting Is interpreted as a second setting in which the subject image is not registered in the electronic medical record. The setting unit sets the setting information as the first setting when the subject image is acquired by the camera. That is, by default, the setting is registered in the electronic medical record. In order to switch the setting information to the second setting, a specific operation input is required.

  From another point of view, in the photographing apparatus 102-1, the photographed image is set to be registered in the basic electronic medical chart, and the setting can be canceled by an operation input. By doing in this way, the trouble of the operation input regarding imaging | photography of a subject can be reduced, and the usability of the imaging device in a medical field can be improved. In particular, in a portable device in which a camera and a setting unit for setting registration / non-registration to the electronic medical record are integrated, it is normal that a large amount of images are not taken. If the setting is registered, the operation time can be reduced.

  The output unit outputs the subject image that is the first or second setting to the outside through, for example, a wireless communication module. In one embodiment, the output unit transmits the subject image that is the first setting to the device 101 that manages the electronic medical record information, and the subject image that is the second setting is transmitted to the image management server 105. (Image management device) or other storage device on the communication network 106. In this way, only the necessary subject images can be registered in the electronic medical chart, while other subject images are also stored in a device accessible via the communication network 106. The examiner image can be easily used.

  In another embodiment, the output unit outputs all subject images to the image management server 105 regardless of the setting, and only the subject image that is the first setting of the image management server 105 stores the electronic medical record information. It transmits to the device 101 to be managed. At this time, the image management server 105 restricts transmission to the apparatus 101 that manages the electronic medical record information of the subject image, which is the second setting. By doing in this way, the subject image image | photographed with the imaging device 102-1 can be managed centrally by the image management server 105. FIG.

<(2) Overview of portable image registration apparatus 103>
An overview of the portable image registration apparatus 103, which is an example of the information processing apparatus according to the embodiment, will be described. The portable image registration device 103 has a receiving unit that receives a subject image from the imaging device 102 instead of the camera and the image acquisition unit, as compared with the imaging device 102-1. Further, the function of the setting unit is different from that of the photographing apparatus 102-1 described above.

  The receiving unit of the portable image registration device 103 receives from the imaging device 102 a subject image obtained by imaging the subject with the imaging device 102. Here, the photographing apparatus 102 is a digital camera such as a single lens reflex camera provided with a wireless communication module, for example. The storage control unit of the portable image registration device 103 stores the subject image received by the receiving unit and the identification information of the subject in a memory in association with each other.

  The setting unit of the portable image registration apparatus 103 does not set the default setting as the first setting, but does not set it. Then, every time the operation input is repeated, the setting state of the subject image is switched in the order of the first setting, the second setting, the non-setting,.

  The setting unit sets the subject image to an unset state in response to acquisition of the subject image by the receiving unit. An image based on the subject image is displayed on the display unit by the display control unit. In this state, the subject image is set as the first setting for registering the subject image as the electronic medical record information of the subject in response to an operation input on the image displayed on the display unit. Further, in this state, a second setting is made in which the subject image is not registered as the electronic medical record information of the subject in response to an operation input on the image displayed on the display unit. When the portable image registration device 103 is used, it can be assumed that the photographing device 102 is a camera specialized for the photographing function. With such a camera, there is a possibility that a large number of subject images may be acquired for one subject, helping the ease of using the imaging function. If all the subject images are registered in the electronic medical record as they are, there is a problem that confirmation becomes troublesome and management becomes complicated as the data increases. Therefore, when the portable image registration device 103 is used, the subject image received from the imaging device 102 is set to an unset state by default. A subject image registered in the electronic medical record is selected from among them according to an operation input. When the operation input is further performed on the setting registered in the electronic medical record, that is, on the subject image on which the first setting is made, the second setting is further made on the subject image, Registration will not be performed.

  Here, in another embodiment, the default setting may be the second setting, and the first setting may be set according to the operation input.

<(3) Overview of Image Management Server 105>
The image management server 105 used together with the imaging device 102-1 or the portable image registration device 103 outputs a subject image receiving unit, a determination unit that determines whether or not to register in the electronic medical record, and the subject image. And an output control unit that controls output from the output unit. The image management server 105 integrates a memory for storing a subject image and other information, a communication module that performs communication using the communication network 106, input / output control of the memory, and communication control and other controls by the communication module. CPU and RAM which perform automatically. For example, the receiving unit and the output unit are realized by a communication module. The determination unit and the output control unit are realized by a CPU and a software program stored in the memory. The software program is expanded in the RAM, and is sequentially executed by the CPU, whereby the processing according to the embodiment is realized.

  The receiving unit receives the subject image from the imaging device 102-1 or the portable image registration device 103. The determination unit determines whether or not to register the subject image as the electronic medical record information of the subject in response to reception of the subject image by the receiving unit. The determination is performed based on incidental information associated with the subject image, for example.

  The output control unit receives the subject image determined to be registered as the electronic medical record information of the subject by the determination unit in response to reception of the subject image by the receiving unit, and outputs the subject medical image by the output unit. The information is managed by the device 101 that manages the information. Further, the output control unit limits the output to the apparatus of the subject image that is not determined to be registered as the electronic medical record information of the subject by the determination unit.

  In this way, the image management server 105 is assigned to the device 101 that manages the electronic medical record information based on the incidental information of the subject image transmitted from the imaging device 102-1 or the portable image registration device 103. It can be determined whether or not a subject image should be transmitted.

<(4) Detailed Description of Embodiment by Portable Image Registration Device 103>
Here, the flow of processing of the medical support system according to the embodiment will be described with reference to the flowchart of FIG. explain. Hereinafter, the subject image that has been first set to be registered as the electronic medical record information of the subject may be referred to as “exposed subject image” or “exposed image”. In addition, the subject image that is set as the second setting that is not registered as the electronic medical record information of the subject may be referred to as a “semi-publicized” subject image or “semi-publicized image”. The first setting is “public” in the sense that it is registered in the electronic medical record, and the second setting is not registered in the electronic medical record, but is stored in the image management server 105 and can be viewed. May be referred to as “semi-public” in the sense of

  The photographer takes a plurality of images such as a still image and a moving image of the examinee (subject) using the photographing apparatus 102 (step S201).

  The image of the examinee (subject) photographed by the photographing apparatus is automatically transmitted to the portable image registration apparatus 103 by the communication module provided in the photographing apparatus 102 as an image file every time photographing is performed (step S202). ). An example of the imaging device 102 and the communication module is a single-lens reflex digital camera 301 and a WFT device 302 connected to the digital camera 301 shown in FIG. 3, for example. The WFT device 302 is connected to the digital camera 301 by USB, for example, and transmits a subject image to an external device using a wireless LAN. An example of the image file of the subject image to be transmitted is shown in FIG. The imaging device 102 transmits one image or a plurality of images for each examinee (subject). As examination data of the examinee (subject), there are an image 401 and accompanying information 402 of the image. The image 401 includes at least one video data obtained by photographing the examinee, and there are still images and moving images as video formats. In the case of a still image, for example, the image is stored in a JPEG file format, and the moving image is stored and transmitted in the MP4 file format. The supplementary information 402 of the image includes attribute information of the image 401 and information related to the inspection, and includes identification information of the image, the number of images, disclosure, designation of semi-disclosure (setting information indicating a disclosure state), size, format, Shooting date / time, shooting location, photographer information, registration date / time to image management server 105, comment, examiner ID, information such as name / gender / date of birth, examination item, examination item (general / surgery / decubitus)・ Others), inspection date, inspection comments, etc. The image attribute information is set for each image when there are a plurality of images. The accompanying information 402 of these images is stored in an XML file format.

  In the portable image registration device 103, the received plurality of captured images are displayed. FIG. 5 is a view showing a display screen of the portable image registration apparatus 103. Such a display screen is realized by the display control unit of the portable image registration apparatus 103 (information processing apparatus). The display screen includes an imaging device area 501, thumbnail area 502, preview area 506, disclosure setting area 507, ID input area 508, search button 509, examinee area 510, examination item input area 511, date and time setting area 512, date and time input. There are an area 513, a comment area 514, a registration button 515, a new arrival notification area 516, a rotation button 517, and a discard button 518.

  In the thumbnail area 502, thumbnails of a plurality of images shot by the shooting apparatus specified in 501 are displayed. In the example illustrated in FIG. 5, thumbnail images 503, 504, and 505 of the subject images corresponding to the three photographed subject images received from the digital camera 301 are displayed in the thumbnail area 502. These thumbnails 503 to 505 are generated as reduced images of the corresponding subject images, for example, by an image acquisition unit.

  The imaging device area 501 indicates that the image is captured by “EOS7D” as the imaging device 102. In the embodiment, a drop-down list is displayed by clicking or touching the imaging device area 501. When another imaging device is in the system, an image received from another imaging device can be confirmed by selecting one of the other imaging devices.

  Thumbnail 503, thumbnail 504, and thumbnail 505 indicate that the image of the hand, the image of the leg, and the moving image of the leg have been transmitted to the portable image registration device 103 in order from the left of the three images from the oldest shooting. Show.

  When the subject image corresponding to the thumbnail is a moving image, a mark indicating the moving image is displayed. In the example shown in FIG. 5, a thumbnail corresponding to the moving image is displayed on the thumbnail 505.

  As shown in FIG. 7, when the mouse is hovered over the thumbnail of the image 701 designated to be public or semi-public, an enlarged preview area 702 is displayed on the thumbnail, and an image enlarged in the enlarged preview area 702 is displayed 703 ( 506) in the preview area.

  In the public setting area 507, when the portable image registration device 103 performs setting of public and semi-public for each subject image in the thumbnail area 502, the number set as the public image and the semi-public image is displayed. It is an area to do.

  An ID input area 508 is an area in which the examinee ID is input. A search button 509 is a button for instructing the start of a search with the ID input in the ID input area 508. A device that manages the electronic medical record information when the portable image registration device 103 sends the ID to the device 101 that manages the electronic medical record information to make an inquiry, and the device 101 that manages the electronic medical record information has the ID. 101 returns examinee information corresponding to the ID. The recipient information includes various upper portions of the examinee including identification information of the examinee (subject).

  In the examinee area 510, examinee information corresponding to the retrieved examinee ID is displayed.

Clicking or touching the inspection item input area 511 displays a list of inspection data inspection items. When registering a plurality of subject images as examination data, one of the examination items “general”, “surgery”, “decubitus”, and “others” is selected in accordance with an operation input from the user.
When the date setting area 512 is clicked or touched, options of “specify date and time” and “use the shooting date and time of the digital camera” are displayed.

  When “specify date and time” is selected in the operation input for the date and time setting area 512, the date and time are displayed in the date and time input area 513. When “Use digital camera shooting date and time” is selected in the operation input to the date and time setting area 512, the image with the oldest shooting date and time among the subject images, that is, the uppermost left of the thumbnail area 502 is displayed. The date and time when the subject image corresponding to the thumbnail was taken is displayed.

  Comments can be added to the comment area 514 when a plurality of subject images are registered as examination data.

  In response to pressing of the registration button 515, a plurality of subject images and accompanying information of the subject images are transmitted to the image management server 105 as examination data of one unit of the examinee.

  The new arrival notification area 516 is a new arrival display icon for notifying that the subject image has been transmitted from the imaging apparatus 102. When the subject image is transmitted from the imaging device 102 to the portable image registration device 103, the icon changes to a shape for notifying a new arrival to notify the new arrival.

  A flow in the case where there is a subject image photographed by a photographing device different from the photographing device displayed in the photographing device region 501 in step S203 will be described with reference to FIG. In step S601, the portable image registration apparatus 103 determines whether there is an image captured by another imaging apparatus. Such a determination can be made based on, for example, whether or not there is a subject image received from the imaging apparatus and not yet displayed in the thumbnail area 502.

  When it is determined that there is a subject photographed by another photographing apparatus, the display of the new arrival notification area 516 changes from FIG. 5 as shown in FIG. 9, and there is an image photographed by another photographing apparatus. Show to user. (Step S602).

  A flow for switching to an image captured by another imaging apparatus displayed on the portable image registration apparatus 103 when there is an image captured by another imaging apparatus in step S203 will be described with reference to FIG. To do.

  It is assumed that the thumbnail of the received subject image is displayed in the thumbnail area 502 (S809). In this situation, for example, the portable image registration device 103 determines whether or not the photographing device area 901 in FIG. 9 has been clicked or touched (S801). If it is determined that the photographing device area 901 has been clicked or touched, information indicating the number of images photographed by another photographing device is displayed as a list 902 together with information on the photographing device (step S802). The portable image registration device 103 selects a photographing device from the displayed list, for example, in response to an operation input from the user (step S803).

  As shown in FIG. 10, the display is switched to the image display transmitted from the other photographing apparatus (step S803). In the example of this embodiment, the photographing apparatus is switched to “EOSKISS” (1001), and thumbnails of two images (1002, 1003) and two moving images (1003, 1004) transmitted from EOSKISS are displayed.

  As described above, a plurality of images transmitted from another imaging device to the portable image registration device 103 can be displayed for each imaging device by selecting one of the plurality of imaging devices.

  The information acquisition unit of the portable image registration apparatus 103 acquires the examinee ID input through the ID input area 508. In response to the search button 509 being pressed in this state, the portable image registration apparatus 103 receives information on the examinee associated with the examinee ID from the electronic medical record. The display control unit displays the information of the examinee in the examinee area 510 (S204).

  The portable image registration device 103 rotates the subject image in the portable image registration device in response to the rotation button 517 being pressed. In addition, when the discard button 518 is pressed, the subject image before registration associated with the examinee ID can be deleted from the medical support system.

  The portable image registration device 103 sets the disclosure of the plurality of images transmitted to each imaging device and the semi-disclosure for the image of the selected imaging device.

  In the present embodiment, the public setting is not set in the initial state, and the setting unit sets the subject image as a public image in response to clicking or touching the thumbnail of the subject image. To do. At this time, the display control unit displays the thumbnail in a display form indicating that the first setting (public setting) is set. In the example shown in FIG. 11, the public mark 1101 is superimposed on the thumbnail. The public mark 1101 may be displayed outside the thumbnail frame.

  In this state, in response to further clicking or touching the thumbnail of the subject image, the setting unit sets the subject image as a semi-public image. At this time, the display control unit displays the thumbnail in a display form indicating that the second setting (semi-public setting) is set. In the example shown in FIG. 11, the semi-public mark 1102 (1102) is superimposed and displayed on the thumbnail.

  In response to further clicking or touching the thumbnail of the subject image, the setting unit sets the subject image as unset public setting. At this time, the display control unit displays the thumbnail in a display form indicating that it has not been set. In the example shown in FIG. 11, the public mark 1101 and the semi-public mark 1102 are not displayed on the thumbnail (step S205).

  In the portable image registration apparatus 103, a plurality of subject images and supplementary information of the images are received for the subject images that are publicly or semi-publically set in response to the registration button 515 being pressed. To the image management server 105 as one unit of inspection data. The transmitted subject image is an image that is set to be public or semi-public, and the incidental information of the image is data illustrated in FIG. 4 (step S206).

  At the time of registration, an examination item (for example, surgery, pressure sore, general or other distinction) input in the examination item input area 511, a date and time setting area 512, and a date and time input in the date and time input area 513 are designated. In addition, a comment can be attached to a comment or inspection data unit input to the comment area 514. The comment is used, for example, to give an explanation of the examination site when imaging is close to the affected part and it is difficult to identify the site.

  For example, the image management server 105 associates a plurality of subject images exemplified in FIG. 4 with the accompanying information, and uses the associated plurality of images and the accompanying information as a unit of examination data for the examinee. The data is stored in the memory 105 (step S207).

  The image management server 105 creates a summary of examination data, for example, a study ID that can uniquely identify examination data, the number of published and semi-published images, and thumbnails of the subject images that are set to be published, and transmits them to the electronic medical chart ( Step S208).

  As shown in FIG. 12, the apparatus 101 for managing electronic medical record information has an image display function for displaying a summary of examination data sent from the image management server for each examinee and thumbnails. In the example illustrated in FIG. 12, the image display function button 1201 indicates that there are two public images and one semi-public image. When the button 1201 is pressed, two public images are displayed in the display area 1202, indicating that one image that is not displayed on the electronic medical record is registered as a semi-public in the medical support system ( Step S209).

[Display semi-public images]
For example, doctors and assistant technicians take a large number of images with various angles of view and exposure, etc., assuming imaging mistakes and other uses in imaging during surgery. In the registration to the electronic medical record, for example, in the case of three images, it is sufficient that there are about one or two images. Accordingly, it is assumed that two images are registered as public images, and the remaining one image is registered semi-publicly.

A doctor who operates an electronic medical record may want to use an image that is an intraoperative image and is not disclosed or registered on the electronic medical record, for example, as a material for a conference presentation. As indicated by 1201 in FIG. 12, one image that is not displayed on the electronic medical record is registered as a semi-public in the medical support system. Here, the doctor activates the image viewer device 104 by clicking 1203 in FIG. 12 to confirm the image. (Step S210)
In the image viewer device 104, a past examination data list 1301 of the examinee is displayed as illustrated in FIG.

  The inspection data designated to start the image viewer on the electronic medical record is highlighted (1302), and two public images and one semi-public image included in the selected inspection data are displayed in a list. (1303).

  Of the examinee data included in the examination data, 1304 lists information on the examinee, information on examination data, and information on individual images in 1305.

[Image comparison display]
The image viewer device 104 has a function of displaying two images in parallel and comparing the images.
When switching from the normal display to the comparison display button is pressed in 1306, the viewer display screen is divided into left and right as shown in FIGS.

When the left 1402 area is selected and a desired image is selected from the inspection data list, the image is displayed in the left 1402 area. If the right 1403 area is selected and another desired image is selected from the inspection data list, the two images are compared and displayed in the left 1402 and right 1403 areas.
This is useful when performing follow-up observation or the like in comparison with images in past examination data.

<(5) Detailed Description of Embodiment by Imaging Device 102-1>
In another embodiment, the imaging device 102-1 is a portable terminal device that includes a function of an image registration device having a display unit for a captured image and a function of an image viewer device.

  Here, the flow of the medical support system according to another embodiment will be described with reference to FIG.

  In the mobile terminal device (imaging device 102-1), the display screen shown in FIG. 16 is displayed. On the display screen, a user ID input area 1601, a password input area 1602, and a login button 1603 are displayed by the display control unit. In the example shown in FIG. 16, the user ID is input in the user ID input area 1601, the password is input in the password input area 1602, the user authentication of the mobile terminal device is performed by pressing the login button 1603, and the memory of the mobile terminal device is stored. The stored program is activated (step S1501). In response to this, the display control unit displays a screen for acquiring the identification information of the subject shown in FIG.

  Illustrated in FIG. On this screen, a first icon 1707 for setting the identification information acquisition method, a second icon 1702, and a skip button 1705 for skipping the input of the examinee ID are displayed. By clicking or touching the first icon 1706, a first display mode in which the user manually inputs the examinee ID is executed. By clicking or touching the second icon 1702, a second display mode for reading a barcode or the like attached to the wristband wound around the wrist of the subject is executed.

  In the display in the first display mode, a examinee ID input area 1701 for inputting the examinee ID is displayed, and the user can input the examinee ID through the area. The information acquisition unit acquires the input information as identification information of the examinee (subject).

  In the display in the second display mode, a barcode display area 1704 is displayed. In the barcode display area 1704, a moving image photographed by the camera of the photographing apparatus 102-1 is displayed in real time. When the positional relationship between the imaging device 102-1 and the subject is appropriately set so that the barcode of the subject falls within the region, the information acquisition unit acquires identification information based on the image of the barcode ( Step S1502). The skip button 1705 is a button used when the function of the portable image registration apparatus 103 in the photographing apparatus 102-1 is not used, and functions as a normal photographing apparatus when pressed. In this case, the photographed subject image is transmitted to the external portable image registration device 103.

  In response to the acquisition of the ID information (identification information) of the examinee (subject) by the information acquisition unit, the display control unit displays a screen for displaying the information of the examinee.

  If the examinee ID is input by manual ID input or barcode reading, the examinee information associated with the examinee ID is obtained from the electronic medical record, and the examinee information 1803 is displayed as illustrated in FIG. . As a result, it is possible to confirm whether or not the person is a correct examinee (step S1503).

  By pressing a shooting start button 1801, a shooting mode is entered and shooting is started. (Step S1504) At this time, the screen for photographing shown in FIG. 19 is displayed.

  On the screen for shooting, a still image button 1901 for starting a still image shooting function, a moving image button 1903 for starting a moving image shooting function, a shooting button 1902 for triggering still image shooting, and a moving image shooting are triggered. A shooting button 1904 for finishing shooting and an end button 1905 for finishing shooting are displayed.

  As shown in FIG. 19, when the still image button 1901 is pressed and the still image mode is selected, a still image is shot by the shooting unit when the still image shooting button 1902 is pressed. When the moving image button 1903 is pressed and the moving image mode is selected, the moving image shooting is switched between execution and cancellation each time the moving image shooting button 1904 is pressed, whereby a moving image of a desired period is shot. With such a display screen, a plurality of still images and moving images can be taken continuously. The image acquisition unit controls the imaging unit in response to pressing of the imaging button, and acquires the subject image.

  In response to the end button 1905 being pressed, the shooting mode ends. The display control unit displays a screen for previewing the captured image on the display unit. With this screen, it is possible to preview thumbnails of a plurality of subject images photographed as illustrated in FIG.

  The preview screen includes a comment input area 2001 and a thumbnail area 2004 as exemplified in FIG. A comment is input to the comment input area 2001 in response to an input from the user. Comments can be attached in units of inspection data with all preview images as one inspection data. A plurality of thumbnails are displayed in the thumbnail area 2004 (step S1505).

  Here, the setting unit sets a first setting for registering the subject image as the electronic medical record information of the subject according to the acquisition of the subject image. That is, the default setting is “public” when the subject image is taken. The change of the public setting and the operation input for the thumbnail of the subject image that is the first setting are performed. In response to the operation input, the setting unit sets the second setting for not registering the subject image as the electronic medical record information of the subject.

  In the embodiment, only the thumbnail corresponding to the subject image for which the semi-public setting is set is displayed in a display form indicating that the second setting is set. In the example shown in FIG. 20, the semi-public mark 2002 is displayed superimposed on the thumbnail.

  On the other hand, the thumbnail corresponding to the subject image having the first setting is displayed in a display form indicating that the first setting has been made. In the example shown in FIG. 20, the semi-public mark 2002 and the public mark 1101 shown in FIG. 11 are not attached to the thumbnail corresponding to the subject image that is the first setting.

  In another embodiment, in consideration of easy understanding, a mark indicating that the first setting is superimposed on the thumbnail corresponding to the subject image that is the first setting is superimposed and displayed. Also good.

  Hereinafter, the processing flow in the detailed display mode will be described with reference to FIG.

  In step S2100, it is determined whether a thumbnail displayed in the thumbnail area 2004 has been clicked or touched. If it is determined that the thumbnail displayed in the thumbnail area 2004 has been clicked or touched, the process proceeds to the detailed display mode of the subject image corresponding to the thumbnail (step S2101).

  FIG. 22 shows a display screen in the detailed display mode. This display screen includes an image area 2205, a disclosure state setting box 2201, a discard button 2203, a rotation button 2204, and a return button 2202. In the image area 2205, a subject image corresponding to the thumbnail that has been subjected to the operation input in step S2101 is displayed. The displayed image may not be the subject image itself, but may be a reduced image of the subject image.

  In step S2102, for example, the CPU determines whether or not there is an operation input to the setting box 2201. In the example shown in FIG. 22, a setting box 2201 is a check box, and can be switched between a checked state and a non-checked state by an operation input. If checked, semi-public, if not checked, public setting.

  If it is determined that an operation input has been made, the setting unit switches the setting for the subject image in step S2103. When there is an operation input to be checked when the setting box 2201 is not checked, the setting is switched from the first setting to the second setting. When there is an operation input for removing the check in the checked state, the second setting is switched to the first setting (step S2103).

  In step S2104, the CPU determines whether the rotation button 2204 has been pressed. If it is determined that the rotation button 2204 has been pressed, the CPU rotates the subject image by 90 degrees in step S2105.

  In step S2106, the CPU determines whether the discard button 2203 has been pressed. If it is determined that the discard button 2203 has been pressed, the CPU deletes the subject image in step S2107.

  In step S2108, the CPU ends the detail display mode.

  In step S2109, the CPU determines whether the return button 2202 has been pressed. If it is determined that the return button 2202 has been pressed, the process advances to step S2108, and the display control unit ends the display of the display screen shown in FIG. 20 and displays the display screen shown in FIG. 20 again.

  When the semi-public setting is performed by the above-described processing, the semi-public designation is clearly indicated on the thumbnail as indicated by 2002 in FIG. In the detailed display mode, the subject image can be deleted from the portable terminal device. In addition, the subject image can be rotated.

  The detailed mode is ended by a return button 2202 (step S2102).

  When the registration button 2003 in FIG. 20 is pressed, all the plurality of displayed images and image data are transmitted to the image management server as one examination data unit of the examinee.

  The operation flow after pressing the registration button is the same as in the above-described embodiment.

  In another embodiment, when the image viewer activation button 1802 shown in FIG. 18 is pressed in step S1503, the image viewer is activated on the portable terminal capable of displaying the examination data list of the examinee indicated by the examinee information.

  In another embodiment, when the skip button 1705 shown in FIG. 17 is pressed, normal operation for transmitting an image to the portable image registration device 103 is performed because it operates in the same manner as an imaging device that does not specify a examinee ID. It will operate as the device 102. The operation flow after registering a plurality of subject images is the same as in the above embodiment.

  As described above, in the above-described embodiment, the imaging devices 102-1 to 102-1 have a transmission unit that transmits the captured image of the examinee to the portable image registration device 103. In addition, the portable image registration apparatus 103 includes an information acquisition unit that acquires the subject ID (identification information) of the subject by the imaging apparatuses 102-1 to 102 -N, and disclosure or quasi of the images captured by the imaging apparatuses 102-1 to 102 -N. It has a setting part which sets public. And it has the output part which outputs the image of the examinee imaged by the imaging devices 102-1 to N to the image management server 105.

  The image management server 105 includes a memory that associates the image and the supplementary information transmitted from the portable image registration device 103 and stores them as examination data of the examinee. In addition, the image processing apparatus includes a transmission unit that transmits a summary of the examination data of the examinee and an image set to be public among images included in the examination data of the examinee or a thumbnail of the image to the apparatus 101 that manages the electronic medical record information.

  The apparatus 101 for managing electronic medical record information includes a display control unit that displays a summary of examination data of the examinee and thumbnails of images that are publicly set out of images included in the examination data of the examinee on the display unit. Further, the image viewer control unit causes the image viewer device 104 to display an image through the image management server 105 regarding the summary of the examination data of the examinee transmitted from the image management server 105.

  Note that the portable image registration apparatus 103 may further include a notification unit that notifies which of the plurality of photographing apparatuses 102-1 to 102-N has transmitted the image.

  A portable terminal device that combines the functions of the portable image registration device 103 and the imaging device 102 is also included in the information processing apparatus according to the embodiment of the present invention. Here, the information acquisition unit of the mobile terminal device acquires the examinee ID (identification information of the subject) by reading a barcode or inputting a keyboard.

  In a medical field, a medical worker may take a lot of image data of a subject with a digital camera. On the other hand, some images should be recorded in the electronic medical record from a clinical viewpoint. At this time, for a large amount of image data after shooting for a while, the user manually selects an image to be recorded on the electronic medical record and an image that is not so, and stores it in another system, for example. From the viewpoint of input errors and the like. According to the above-described embodiment, even when the user takes many images of the subject, it is possible to ensure the usability of the remaining images while registering only necessary images in the electronic medical record.

  In other embodiments, in the information processing apparatus that is the imaging apparatus 102-1 or the portable image registration apparatus 103, the setting unit changes the default setting state based on the number of captured subject images. Also good. For example, when N subject images are taken for a subject, the setting unit compares the N and the threshold value Nt, and if N ≧ Nt, the setting unit By default, the person image is not set or is set to the second setting. If N <Nt, the setting unit uniformly sets the N subject images as the first setting. The threshold value Nt may be appropriately set for each hospital or system, for example, according to a user operation input. By doing in this way, the work burden which sets the subject image registered into an electronic medical record can be reduced.

  Here, let us consider a case where a subject image is photographed for a subject by the first imaging device 102 as the first, second, third,... In this case, in a state where the number N (t1) of images taken at a certain time t1 does not exceed the threshold value Nt, the setting unit responds to the fact that N (t1) subject images are taken or received by the receiving unit. The subject image is set as the first setting. When the time advances and the number of shots N (t) exceeds the threshold value Nt for the first time, the setting unit changes the N (t) subject images uniformly to the second setting or not. Thereafter, the N (t) + 1-th and subsequent subject images are set to the second setting or not set in accordance with the photographing or reception. By doing in this way, the work burden which sets the subject image registered into an electronic medical record can be reduced.

  Here, it is assumed that imaging of the subject image by the imaging device and transmission of the subject image to the device 101 or the image management server 105 managing the electronic medical record information are performed in parallel. In such a case, each time a subject image is registered in the apparatus 101 that manages the electronic medical record information, the threshold Nt is decremented by one to automatically add many subject images to the electronic medical record. You can avoid being registered. Even in this case, it is possible to set the first setting for registering a larger number of subject images than the threshold value Nt in the electronic medical record by an operation input.

  If the patient image is once transmitted to the device 101 that manages the electronic medical record information when an erroneous registration or a better subject image can be taken, the transmitted subject image is transferred to another subject. There may be a case where it is desired to replace the person image. In order to cope with such a situation, the output unit can output a replacement instruction or a deletion instruction for the subject image registered in the electronic medical record. The output destination of the replacement instruction or the deletion instruction is the device 101 that manages the electronic medical chart information when the output unit transmits the subject image directly to the electronic medical chart. On the other hand, when the output unit once transmits the subject image to the image management server 105, the output destination of the replacement instruction or the deletion instruction is the image management server 105. When a replacement instruction or a deletion instruction is output to the image management server 105, the image management server 105 transmits the instruction to the device 101 that manages the electronic medical record information. In any case, when receiving the replacement instruction or the deletion instruction, the apparatus 101 that manages the electronic medical chart information executes the instruction.

  Here, the replacement instruction or the deletion instruction includes identification information indicating a subject image to be replaced or a subject to be deleted. Thereby, the apparatus 101 which manages electronic medical chart information can specify the subject image to be replaced or to be deleted. Further, the replacement instruction includes identification information of the replacement subject image. Alternatively, a replacement subject image may be attached. Thereby, the apparatus 101 that manages the electronic medical record information can specify which subject image to be replaced with the subject image to be replaced.

  In another embodiment, when a subject image is transmitted to the device 101 that manages electronic medical record information via the image management server 105, transmission of the subject image to the device 101 that manages electronic medical record information for a certain period of time. To reserve. As a result, if a replacement instruction or a deletion instruction is issued within the retention time, it is possible to reduce transmission of an erroneous subject image to the device 101 that manages the electronic medical record information, resulting in an error in the electronic medical record. Registration can be reduced.

  In the image management server 105, a reservation time is set. When a subject image, which is the first setting for a subject, is received, counting by the time counter is started. The image management server 105 transmits the subject image to the device 101 that manages the electronic medical record information in response to the set retention time being determined by the time counter. From another point of view, the output control unit of the image management server 105 receives the subject image for a subject, and the subject image that is the first setting until the retention time elapses. The transmission to the device 101 that manages the electronic medical record information is restricted.

  For example, the reservation time Tsus is set for each subject. As an example, it is assumed that a first subject image for a subject is received by the image management server 105 at a first time Tr, and then at least one second subject image is received. . In this case, the first subject image and the at least one second subject image are output by the output unit at a time (Tr + Tsus), that is, a time elapsed by the retention time Tsus from the first time Tr. Is done. In another aspect, the first subject image received at the first time Tr and the second subject received thereafter until the retention time Tsus elapses from the first time Tr. Image output is limited.

  Here, the above-described second subject image may not be received by the image management server 105 from the first time Tr until the retention time Tsus elapses. Considering such a case, the completion notification indicating that the imaging of the subject has been completed is output by the output unit of the imaging device 102-1 or the portable image registration device 103. Even when the reservation time Tsus has elapsed from the first time Tr, if the image management server 105 has not received a completion notification, the output unit of the image management server 105 will output the first and second The transmission to the apparatus 101 that manages the electronic medical record information of the subject image is restricted.

  The technical idea of providing such reservation time and completion notification may be applied not only to the image management server 105 but also to the imaging device 102-1 and the portable image registration device 103. In this case, even if the subject image is received or acquired and the first setting is made, the imaging apparatus 102-1 completes the imaging for the time Ts that is the first setting or the subject. Until the retention time Tri elapses from the time Tf, the output of the subject image is limited. The completion of shooting may be determined by the CPU of the information processing apparatus having completed shooting in response to, for example, pressing of the registration button 515 in FIG. 5 or the registration button 2003 in FIG.

  The information processing apparatus such as the imaging apparatus 102-1 and the portable image registration apparatus 103 and the image management server 105 in the above-described embodiment are single apparatuses. In another embodiment, the functions of the photographing apparatus 102-1, the portable image registration apparatus 103, and the image management server 105 are realized by an information processing system or an image management system including a plurality of information processing apparatuses. In this case, each of the plurality of information processing apparatuses has a communication circuit, and can communicate with each other by the communication circuit. The plurality of information processing apparatuses need only be able to communicate at a predetermined communication rate, and do not need to exist in the same hospital facility or in the same country.

  In the embodiment of the present invention, a software program for realizing the functions of the above-described embodiments is supplied to a system or apparatus, and the computer of the system or apparatus reads and executes the supplied program code. Including the form.

  Therefore, in order to realize the processing according to the embodiment on a computer, the program code installed in the computer is one embodiment of the present invention. Further, based on instructions included in the read program, the OS or the like running on the computer performs part or all of the actual processing, and the functions of the above-described embodiments are also realized by the processing. obtain.

  Embodiments appropriately combining the above-described embodiments are also included in the embodiments of the present invention.

Claims (16)

A portable information processing apparatus,
Photographing means for photographing the subject;
Information acquisition means for acquiring identification information of the subject;
In a state where identification information is acquired by the information acquisition means, an image acquisition means for acquiring a subject image obtained by imaging the subject by the imaging means;
A storage control unit for storing the subject image and the identification information acquired by the information acquisition unit in association with each other in accordance with the acquisition of the subject image by the image acquisition unit;
Display control means for displaying an image based on the subject image on a display unit;
In response to the acquisition of the subject image by the image acquisition means, the first setting for registering the subject image as the electronic medical record information of the subject is the first setting. A setting unit configured as a second setting that does not register the subject image as the electronic medical record information of the subject in response to an operation input on the image that is based on the subject image and displayed on the display unit;
Output means for outputting the subject image which is the first or second setting to the outside;
An information processing apparatus comprising: Information acquisition means for acquiring identification information of the subject;
Receiving means for receiving from the imaging device a subject image obtained by imaging the subject with an imaging device;
Storage control means for storing in the storage unit in association with the subject image and the identification information acquired by the information acquisition means;
Display control means for displaying an image based on the subject image on a display unit;
In response to reception of the subject image by the receiving means, the subject image is set as one of the second setting not set or not registered as electronic medical record information of the subject. Setting means for setting a first setting for registering the subject image as electronic medical record information of the subject in response to an operation input to the image based on the subject image and displayed on the display unit When,
Output means for outputting the subject image which is the first or second setting to the outside;
An information processing apparatus comprising:   The output means outputs the subject image that is the first setting to a device that manages electronic medical record information, and the subject image that is the second setting to an external device. The information processing apparatus according to claim 1, wherein the information processing apparatus outputs the information processing apparatus.   The information processing apparatus according to claim 1, wherein the output unit outputs a subject image that is the first or second setting to an image management apparatus.   The information processing apparatus according to claim 4, wherein the subject image that is the first setting is output to an apparatus that manages electronic medical record information by the image management apparatus.   The display control means displays an image based on the subject image having the first setting in a display form indicating the first setting. 6. The information processing apparatus according to any one of 5 above.   The display control means displays an image based on the subject image having the second setting in a display form indicating the second setting. The information processing apparatus according to any one of 6.   The display control means displays an image based on the subject image that has not been set in a display form that indicates that the subject image has not been set. The information processing apparatus according to item. Receiving means for receiving an image of the subject from the imaging device or the information processing device;
Determining means for determining whether or not to register the image as the electronic medical record information of the subject based on information received by the receiving means based on the information associated with the image;
In response to the reception of the image by the receiving means, the determination means outputs an image determined to be registered as the electronic medical record information of the subject to a device that manages the electronic medical record information, and the determination means Output control means for restricting output to the apparatus of an image that is not determined to be registered as electronic medical record information of the subject,
An image management apparatus comprising: Photographing means for photographing the subject;
Information acquisition means for acquiring identification information of the subject;
In a state where identification information is acquired by the information acquisition means, an image acquisition means for acquiring a subject image obtained by imaging the subject by the imaging means;
A storage control unit for storing the subject image and the identification information acquired by the information acquisition unit in association with each other in accordance with the acquisition of the subject image by the image acquisition unit;
Display control means for displaying an image based on the subject image on a display unit;
In response to the acquisition of the subject image by the image acquisition means, the first setting for registering the subject image as the electronic medical record information of the subject is the first setting. A setting unit configured as a second setting that does not register the subject image as the electronic medical record information of the subject in response to an operation input on the image that is based on the subject image and displayed on the display unit;
Output means for outputting the subject image which is the first or second setting to the outside;
An information processing system comprising: Information acquisition means for acquiring identification information of the subject;
Receiving means for receiving from the imaging device a subject image obtained by imaging the subject with an imaging device;
Storage control means for storing in the storage unit in association with the subject image and the identification information acquired by the information acquisition means;
Display control means for displaying an image based on the subject image on a display unit;
In response to reception of the subject image by the receiving means, the subject image is set as one of the second setting not set or not registered as electronic medical record information of the subject. Setting means for setting a first setting for registering the subject image as electronic medical record information of the subject in response to an operation input to the image based on the subject image and displayed on the display unit When,
Output means for outputting the subject image which is the first or second setting to the outside;
An information processing system comprising: Receiving means for receiving an image of the subject from the imaging device or the information processing device;
Determining means for determining whether or not to register the image as the electronic medical record information of the subject based on information received by the receiving means based on the information associated with the image;
In response to the reception of the image by the receiving means, the determination means outputs an image determined to be registered as the electronic medical record information of the subject to a device that manages the electronic medical record information, and the determination means Output control means for restricting output to the apparatus of an image that is not determined to be registered as electronic medical record information of the subject,
An image management system comprising: Taking a picture of the subject;
Obtaining identification information of the subject;
In a state where the identification information is acquired, obtaining a subject image obtained by photographing the subject by the photographing means;
Storing the subject image and the identification information in association with each other in accordance with the acquisition of the subject image;
Displaying an image based on the subject image on a display unit;
Based on the acquisition of the subject image, the first setting for registering the subject image as electronic medical record information of the subject is based on the subject image that is the first setting. In response to an operation input on the image displayed on the display unit, the step of setting the subject image as a second setting not to register the subject image as electronic medical record information of the subject;
Outputting the subject image which is the first or second setting to the outside;
An information processing method characterized by comprising: Obtaining identification information of the subject;
Receiving from the imaging device a subject image obtained by imaging the subject with an imaging device;
Storing the subject image and the identification information in association with the storage unit;
Displaying an image based on the subject image on a display unit;
In response to reception of the subject image, the subject image is set as one of a second setting in which the subject image is not set or is not registered as the electronic medical record information of the subject. A first setting for registering the subject image as the electronic medical record information of the subject in response to an operation input to the image that is based on the subject image and displayed on the display unit;
Outputting the subject image which is the first or second setting to the outside;
An information processing method characterized by comprising: Receiving an image of the subject from the imaging device or the information processing device;
Determining whether to register the image as electronic medical record information of the subject based on information received in response to receiving the image;
Outputting an image determined to be registered as electronic medical record information of the subject in response to receiving the image to an apparatus that manages the electronic medical record information;
Limiting output to the device of images not determined to be registered as electronic medical record information of the subject;
An information processing method characterized by comprising:   A program for causing a computer to execute the information processing method according to any one of claims 13 to 15.

Images