JP6787370B2 - Information processing equipment, information processing methods and programs - Google Patents

Description

This technology is an information processing device capable of sharing the same pathological image with another information processing device and allowing the user to observe it, an information processing system having the information processing device, and information processing in the information processing device. Regarding methods and programs.

Conventionally, in order to support a remote conference between a plurality of users, a system (for example, a video conference system) in which a common screen is shared between terminals of each user as a shared information resource has been known.

For example, Patent Document 1 below discloses an information and communication service system in which a user terminal holds a meeting while taking out pre-registered contents as needed. In this system, the server receives video and audio transmitted in real time from a plurality of terminals, synthesizes them, and distributes them to each terminal.

Further, Patent Documents 2 and 3 below describe a content distribution system in which content is duplicated and distributed and stored in a plurality of servers.

Further, in Patent Document 4 below, the content provided to the viewer whose date and time is fixed is downloaded in advance from the server by the playback device in an encrypted state, and when the viewing date and time comes, the key is given from the server. Is received, and the content is decrypted and reproduced by the key.

Also, in the field of pathological diagnosis, a common pathological diagnosis image is shared between terminals of a plurality of users (for example, a doctor) to hold a remote conference, and diagnosis is performed while exchanging opinions between the terminals. The efficiency of diagnosis is being improved.

In connection with this, Patent Document 5 below discloses a server / client system in which a server distributes a plurality of tile images constituting a pathological image to a client, and the client synthesizes and browses the tile images. ing.

Japanese Patent No. 3795772 Japanese Unexamined Patent Publication No. 2003-115873 Japanese Unexamined Patent Publication No. 2003-085070 Japanese Unexamined Patent Publication No. 2010-119142 U.S. Pat. No. 7,542,596

However, when constructing a pathological image sharing system, in a tree-type system in which distribution data is concentrated in one place as described in Patent Document 1, the pathological image data taken by each terminal (hospital) is in the cloud. It takes a long time to upload because it needs to be aggregated to the server of. In addition, if the content is concentrated in one place, it becomes a bottleneck and it is not possible to demonstrate scaleability such as holding multiple meetings at the same time.

In a normal content sharing system, the scalability problem can be solved by the techniques described in Patent Documents 2 and 3. However, since the extremely high resolution pathological image data has a very large capacity, it takes a very long time to duplicate the data between a plurality of servers as in the case of the above upload.

Further, in the technique described in Patent Document 4, the load on the server is reduced by reducing the data communication during the meeting, but when the communication target is the pathological image data, it takes a very long time to download in advance. It will take. Moreover, in pathological diagnosis, since only a small part of the very large pathological image data is used, most of the downloaded data is not used. Therefore, the above-mentioned pre-download is very inefficient from the viewpoint of effective use of network bandwidth.

In view of the above circumstances, the purpose of this technology is to shorten the time required to prepare for holding a remote conference by sharing pathological image data, and to process the remote conference efficiently and smoothly. To provide information processing systems, information processing methods and programs.

In order to achieve the above object, the information processing device according to one embodiment of the present technology includes a communication unit, a display unit, and a control unit. The control unit obtains range designation information for designating a display range in a pathological image composed of a plurality of partial images and location information indicating a location of the plurality of partial images which may differ for each partial image. , The communication unit can be controlled to receive from another information processing device. Further, the control unit is the communication unit so as to transmit the request information requesting the transmission of the partial image belonging to the display range to the location indicated by the location information based on the received range designation information. Can be controlled. Further, the control unit can control the communication unit so as to receive the partial image transmitted from the location in response to the request information. Further, the control unit can control the display unit so as to display the received partial image.

As a result, the information processing device can receive each partial image of the pathological image from an arbitrary location that can be different for each partial image, so that the pathology with other information processing devices is compared with the case where they are concentrated in one place. The time required to prepare for a remote conference using images can be shortened. In addition, since the information processing device does not have to judge the display range in the pathological image by itself, the remote conference using the pathological image can proceed efficiently and smoothly by receiving and displaying the partial image according to the range designation information. Can be made to.

The information processing device may further include a storage unit. In this case, the control unit determines whether or not the partial image belonging to the display range is stored in the storage unit, and if the partial image is stored in the storage unit, the request information is stored in the storage unit. The display unit may be controllable so as to display the partial image without transmitting to the location.

As a result, the information processing device does not need to access the location when the partial image is stored in the storage unit, so that the amount of communication on the network is reduced and the remote conference using the pathological image is more efficient. Can proceed well.

Prior to receiving the range designation information and the location information, the control unit uses the image designation information for designating a pathological image that can be used in a remote conference held with the other information processing apparatus, and the image designation information. The temporary location information indicating the current location of the specified pathological image and the diagnosis history information indicating the past diagnosis history of the specified pathological image are received in advance from the above other information processing apparatus. The communication unit may be controllable. Further, the control unit indicates, among the plurality of partial images constituting the pathological image designated by the received image designation information, the partial image associated with the received diagnosis history information by the temporary location information. The communication unit may be controllable so as to receive from the location where the image is located. Further, the control unit may be able to control the storage unit so as to store the received partial image.

As a result, the information processing device can download a specific partial image that is likely to be used in the remote conference in advance and store it in the storage unit, thereby reducing the amount of communication during the remote conference and pathology. It is possible to proceed with a remote conference using images more efficiently.

The control unit may be able to control the communication unit so as to receive the display history information indicating the past display range or display position in the designated pathological image as the diagnosis history information.

As a result, the information processing apparatus can pre-download a partial image that is likely to be displayed in the remote conference as in the past, and proceed with the remote conference more efficiently.

The control unit may be able to control the communication unit so as to receive the annotation information attached to the predetermined position in the designated pathological image as the diagnosis history information.

As a result, the information processing apparatus can advance the remote conference more efficiently by downloading in advance a partial image with annotation information that is likely to be noticed in the remote conference as in the past.

There may be a plurality of the above pathological images for each of a plurality of sections collected from one living tissue and stained with different colors. In this case, the control unit receives a partial image of the first pathological image showing the section stained with the first color and exists at a predetermined position to which the annotation information is attached, and also receives the partial image of the second color. The communication unit may be controllable so as to receive a partial image existing at the same position as the predetermined position in the second pathological image showing the section stained with.

As a result, the information processing apparatus can use not only a partial image of the first pathological image to which the annotation information is attached, but also a second pathological image relating to a section in which the biological tissue to be imaged is common to the first pathological image and the staining is different. Partial images of can also be downloaded in advance.

A plurality of the pathological images may be present at each of the different resolutions by capturing the sections collected from one living tissue at a plurality of different resolutions. In this case, the control unit receives a partial image of the first pathological image captured at the first resolution and exists at a predetermined position to which the annotation information is attached, and is captured at the second resolution. Of the second pathological image, the communication unit may be controllable so as to receive a partial image existing at the same position as the predetermined position.

As a result, the information processing apparatus can use not only the partial image of the first pathological image to which the annotation information is attached, but also the portion of the second pathological image in which the biological tissue to be imaged is common to the first pathological image and the resolution is different. Images can also be downloaded in advance.

The control unit may be able to control the communication unit so as to receive the range designation information from the other information processing device via the first server device. In this case, the location may indicate a second server device different from the first server device.

As a result, since the pathological image and the range designation information are managed by separate servers, it is possible to prevent the concentration of the load on a specific server from hindering the progress of the remote conference.

The information processing system according to another form of the present technology includes a server device and an information processing device. The server device has a first communication unit and a first control unit. The first control unit is a range designation information that specifies a display range in a pathological image composed of a plurality of partial images, and a location that indicates a location of the plurality of partial images that may differ for each partial image. The first communication unit can be controlled so as to transmit information. The information processing device has a second communication unit, a display unit, and a second control unit. The second control unit receives the range designation information and the location information from the server device, and requests transmission of a partial image belonging to the display range based on the received range designation information. The second communication unit can be controlled so as to transmit the information to the location indicated by the location information and receive the partial image transmitted from the location in response to the request information. Further, the second control unit can control the display unit so as to display the received partial image.

The information processing method according to another form of the present technology includes range designation information for designating a display range in a pathological image composed of a plurality of partial images and a location where the plurality of partial images may differ from each other. It includes receiving location information indicating a location from another information processing device. Based on the received range designation information, the request information requesting the transmission of the partial image belonging to the display range is transmitted to the location indicated by the location information. The partial image transmitted from the location is received in response to the request information, and the received partial image is displayed.

A program according to another embodiment of the present technology causes an information processing apparatus to execute a first receiving step, a transmitting step, a second receiving step, and a display step. In the first receiving step, range designation information for designating a display range in a pathological image composed of a plurality of partial images and a location indicating the location of the plurality of partial images which may differ for each partial image are indicated. Information is received from another information processing device. In the transmission step, the request information requesting the transmission of the partial image belonging to the display range is transmitted to the location indicated by the location information based on the received range designation information. In the second reception step, the partial image transmitted from the location is received in response to the request information. In the display step, the received partial image is displayed.

As described above, according to the present technology, it is possible to shorten the time required for preparation for holding a remote conference by sharing pathological image data, and to efficiently and smoothly proceed with the remote conference.

It is a figure which shows the structure of the remote conference system which concerns on 1st Embodiment of this technology. It is a block diagram which shows the hardware structure of the PC in the said system. It is a figure which shows the image pyramid structure for demonstrating the display principle of the pathological image handled by the said system. It is a figure which showed the procedure when the image group of the pathological image handled by the said system is generated. It is a flowchart which showed the process flow of the PC which is a moderator when a pathological image is displayed by the said system. It is a flowchart which showed the process flow of the PC which is an audience when the pathological image is displayed by the said system. It is a figure which shows the structure of the remote conference system which concerns on 2nd Embodiment of this technology. It is a figure which showed the appearance that the tile to be downloaded in advance is specified based on the past operation history information in the system which concerns on 2nd Embodiment. It is a figure which showed the appearance that the tile to be downloaded in advance is specified based on the past operation history information in the system which concerns on 2nd Embodiment. It is a figure which showed the appearance that the tile to be downloaded in advance is specified based on the past operation history information in the system which concerns on 2nd Embodiment. It is a figure which showed the appearance that the tile to be downloaded in advance is specified based on the past annotation information in the system which concerns on 2nd Embodiment. It is a figure which showed how the pathological slide is generated from a plurality of sections of a living tissue. It is a flowchart which showed an example of the process flow of the PC and the server when the pathological image is downloaded in advance in the system which concerns on 2nd Embodiment. It is a flowchart which showed other example of the processing flow of PC and a server at the time of downloading a pathological image in advance in the system which concerns on 2nd Embodiment. It is a flowchart which showed the process flow of the PC which is an audience when the pathological image is displayed by the system which concerns on 2nd Embodiment. It is a figure which showed the structure of the remote conference system which concerns on 3rd Embodiment. It is a figure which showed the structure of the remote conference system which concerns on 4th Embodiment. It is a figure which showed the structure of the remote conferencing system which concerns on 5th Embodiment. It is a flowchart which showed the processing flow of the PC in 5th Embodiment. It is a figure which showed the structure of the remote conference system which concerns on 6th Embodiment. It is a figure which showed the structure of the remote conference system which concerns on 7th Embodiment.

Hereinafter, embodiments of the present technology will be described with reference to the drawings.

<First Embodiment>
First, a first embodiment of the present technology will be described.

[System overview]
FIG. 1 is a diagram showing a configuration of a remote conference system using a pathological image according to the present embodiment. This system makes a diagnosis by sharing a common pathological diagnosis image (pathological image) between PCs of multiple users (for example, a doctor), holding a remote conference, and exchanging opinions between the PCs to make a diagnosis. It is a system for improving the efficiency of.

As shown in the figure, this system has a server 200, a plurality of PCs 100, and a scanner 300, and they can communicate with each other via the Internet 150.

The pathological image data captured by the scanner 300 is uploaded to the server 200 via the Internet 150 and stored. Although the details will be described later, the pathological image is an image of a section of a living tissue or the like housed on a glass slide. The pathological image data is not stored only in the server 200, but may be stored in any PC 100.

In this system, one of the plurality of PC100s functions as a "moderator" in a remote conference, and the other functions as an "audience", and a pathological image designated by the PC100 as a moderator is displayed by the PC100 as an audience.

Although the details will be described later, the PC100 as the moderator has information (range designation information) for designating the display range in the pathological image to be diagnosed in the remote conference and the pathological image data based on the data list created in advance. Information (URL; Uniform Resource Locator) indicating the location of the above is transmitted to the server 200. The server 200 transmits the range designation information and the URL to the PC 100 as an audience. That is, the PC 100 as the moderator transmits the range designation information and the URL to the PC 100 as the audience via the server 200.

The PC100 as an audience receives and displays an image (partial image) of the range specified by the range designation information among the pathological images from the URL. As a result, the pathological image is shared by each PC 100, and the pathological diagnosis by those users becomes possible.

[PC hardware configuration]

FIG. 2 is a block diagram showing the hardware configuration of the PC100.

The PC 100 includes a CPU (Central Processing Unit) 11, a ROM 12 (Read Only Memory), a RAM (Random Access Memory) 13, an input / output interface 15, and a bus 14 that connects them to each other.

A display unit 16, an input unit 17, a storage unit 18, a communication unit 19, a drive unit 20, and the like are connected to the input / output interface 15.

The display unit 16 is a display device using, for example, a liquid crystal, EL (Electro-Luminescence), or the like.

The input unit 17 is, for example, a pointing device, a keyboard, a touch panel, a microphone, or other operating device. When the input unit 17 includes a touch panel, the touch panel can be integrated with the display unit 16.

The storage unit 18 is a non-volatile storage device, for example, an HDD (Hard Disk Drive), a flash memory, or other solid-state memory. In addition to being able to store the pathological image data, the storage unit also stores an application program executed to receive and display the pathological image data in this system.

The drive unit 20 is a device capable of driving a removable recording medium 21, such as an optical recording medium, a floppy disk, a magnetic recording tape, or a flash memory. On the other hand, the storage unit 18 is often used as a device pre-mounted on the PC 100 that mainly drives a recording medium that is not removable.

The communication unit 19 is a modem, router, or other communication device for communicating with another device, which can be connected to a LAN (Local Area Network), WAN (Wide Area Network), or the like. The communication unit 19 may communicate using either wired or wireless. The communication unit 19 is often used separately from the PC 100.

The hardware configuration of the server 200 is also the same as the hardware configuration of the PC 100, and includes blocks necessary for functioning as a computer, such as a control unit, a storage unit, and a communication unit.

Next, a pathological image that can be stored in the storage unit 18 of the server 200 or the PC 100 and its display principle will be described. FIG. 3 is a diagram showing an image pyramid structure for explaining the display principle.

The image pyramid structure 50 in the present embodiment is an image group (overall image group) generated by a plurality of different resolutions for one pathological image obtained from the same observation object 40 (see FIG. 4) by an optical microscope. Is. The largest size image is placed at the bottom of the image pyramid structure 50, and the smallest size image is placed at the top. The resolution of the largest size image is, for example, 50x50 (Kpixel: kilopixel) or 30x40 (Kpixel). The smallest size image is, for example, 256 x 256 (pixel) or 256 x 512 (pixel).

That is, when the same display unit 16 displays these images at 100%, for example (displays each with the same number of physical dots as the number of pixels of those images), the largest size image is displayed the largest and the largest. Small size images are displayed the smallest. Here, in FIG. 2, the display range of the display unit 16 is shown as D.

FIG. 4 is a diagram for explaining a procedure when an image group of the image pyramid structure 50 is generated.

First, a digital image of an original image (giant image) obtained at a predetermined observation magnification by an optical microscope (not shown) is prepared. This original image corresponds to the largest size image, which is the bottom image of the image pyramid structure 50 shown in FIG. 3, that is, the image having the highest resolution. Therefore, as the bottom image of the image pyramid structure 50, an image of an optical microscope obtained by observing at a relatively high magnification is used.

In the field of pathology in general, a thinly cut section from an organ, tissue, cell, or a part thereof of a living body is an observation object 40. Then, the scanner 300 having the function of an optical microscope reads the observation object 40 housed in the glass slide, and the digital image obtained thereby is stored in the scanner 300 or other storage device.

As shown in FIG. 4, the scanner 300 or a general-purpose computer (not shown) generates a plurality of images whose resolutions are gradually reduced from the largest size images obtained as described above, and obtains these, for example, a predetermined size. The unit of "tile" (partial image) is stored. The size of one tile is, for example, 256 × 256 (pixel). Identification information (ID or number) that identifies the tile is added to each tile.

The image group generated in this way forms the image pyramid structure 50, and the image pyramid structure 50 is stored in the storage unit 18 of the PC 100 or the storage unit of the server 200. Actually, the PC 100 and the server 200 may store the images having a plurality of different resolutions in association with each other and the resolution information. The PC 100 may perform the generation and storage of the image pyramid structure 50.

The entire image group forming these image pyramid structures 50 may be generated by a known compression method, or may be generated by, for example, a known compression method when generating thumbnail images.

When the user of each PC100 browses the pathological image stored in the storage unit 18 of the PC100 on a stand-alone basis instead of the scene of the remote conference, the PC100 responds to the user's operation input from the input unit 17. , A desired image is extracted from the image pyramid structure 50 and displayed on the display unit 16. At that time, the PC 100 displays an image of an arbitrary portion selected by the user among the images having an arbitrary resolution selected by the user. The user can obtain the feeling of actually observing the observation object 40 while changing the observation magnification. That is, in this case, the PC 100 functions as a virtual microscope. The virtual observation magnification here actually corresponds to the above resolution.

[System operation]
Next, the operation of the system configured as described above will be described. In the following, the description will be made with the CPU 11 of the PC 100 as the main operating subject, but these operations are executed in cooperation with other blocks and software (applications) of each device.

FIG. 5 is a flowchart showing the processing flow of the moderator PC100 when the pathological image is displayed in the present embodiment, and FIG. 6 is a flowchart showing the processing flow of the audience PC100 in that case. Is.

As shown in FIG. 5, the CPU 11 of the PC100, which is the moderator, waits for the operation input for specifying the display range in the specific pathological image from the user (step 51), and when there is the operation input, the display is displayed. Specify the range (step 52).

Subsequently, the CPU 11 specifies, based on the specified display range, the tiles used for the display process, that is, the tiles (partial images) in which all or part of the display range is included, among the pathological images. Step 53).

Subsequently, the CPU 11 transmits a request for the specified tile data to the server 200 (step 54). On the other hand, the CPU transmits the display range information and the URL of the specified tile data to the server 200 (step 55).

Subsequently, the CPU 11 receives the tile data transmitted from the server 200 in response to the request (step 56), and displays it on the display unit (step 57).

On the other hand, as shown in FIG. 6, the CPU 11 of the audience PC100 receives the display range information and the URL transmitted from the moderator PC100 via the server 200 (step 61).

Subsequently, the CPU 11 identifies the tiles required for the display processing of the display range in the pathological image based on the display range information (step 62).

Subsequently, the CPU 11 transmits the request for the specified tile to the server 200 based on the received URL (step 63).

Subsequently, the CPU 11 receives the tile transmitted in response to the request (step 64) and displays it on the display unit 16 (step 65).

<Second Embodiment>
Next, a second embodiment of the present technology will be described.

FIG. 7 is a diagram showing a configuration of a remote conference system according to the present embodiment.

In the first embodiment described above, an example is shown in which the pathological image is stored in the server 200 and downloaded to the PC 100 on the day of the remote conference. However, as shown in the figure, if the date of the remote conference and the pathological image used there are determined in advance, the PC 100 can also download the pathological image to the storage unit 18 before the conference is held. .. The download may be performed in tile units instead of the entire pathological image unit.

In the tile-based pre-download as described above, tiles that are likely to be used in a remote conference may be downloaded. The tiles that are likely to be used are, for example, tiles that have been used for pathological diagnosis in the past. The tiles used for such past pathological diagnosis are specified by, for example, the following criteria.

That is, the PC 100 is based on the display operation history of how the doctor who made the diagnosis in the past viewed the pathological image at what magnification (resolution) while moving the coordinates or the display range. Specifies the tile used in the diagnosis.

8, 9 and 10 are diagrams showing examples of tiles designated based on the operation history information.

As shown in FIG. 8, when the operation history in the pathological image I is shown as the coordinate movement path 71 by the line, the tile 70 (the tile to which the line belongs) that the line crosses is designated. When the operation history is indicated by points (specific coordinates), tiles including the coordinates are specified.

Further, as shown in FIG. 9, in the same case as in FIG. 8, a rectangular tile 70 including the above line may be designated.

Further, as shown in FIG. 10, when the operation history in the pathological image I is shown as the display range 72 of the rectangle, the tile 70 in which all or part of the rectangle is included is designated.

Further, in the past diagnosis, when the pathological image is annotated with some diagnostic note (annotation) by the doctor, the PC100 designates the tile with the annotation. Here, the annotation is information formed in the form of, for example, a symbol, a diagram, a text, a voice, an image, a link (for example, a URL) or the like based on a user's input on a PC on which a pathological image is displayed.

For example, as shown in FIG. 11, among the tiles constituting the pathological image I, the tile 70 with the annotation 73 is designated as a cross mark. When the annotation is attached as a line, a rectangle, or a circle, the tiles that the line crosses or the tiles included in the rectangle or the circle are specified as in FIGS. 8 to 10.

FIG. 12 is a diagram showing a state of creating a slide (pathology slide) containing a section for taking a pathology image.

As shown in the figure, in the pathology slide 80, the observation object (section) 40 is cut out from the pathology piece (living tissue) S taken out by surgery or the like to a thickness of about 2 to 3 micrometers, and the slide is formed. It is created by placing it on a glass 81 and covering it with a cover glass 82.

Therefore, the sections cut out continuously have almost the same tissue shape and medical characteristics such as cells. That is, as shown in the figure, the diagnostic information attached to the pathological slide 80A of the section 40A is also useful information for the pathological slide 80B of the adjacent section 40B.

Here, the different sections 40A and 40B may be stained with different colors because they perform different tests. Therefore, when there are a plurality of pathological images of continuous sections that have been stained differently, the PC 100 specifies annotated tiles in one pathological image and at the same coordinates at the annotated positions. Specifies the tiles of other pathological images that are present.

Further, as described above, the user can view one pathological image by changing the observation magnification (resolution). Therefore, when a certain pathological image is annotated, the annotation is also useful information for the pathological image of the same observation target having a magnification (resolution) different from that of the pathological image. Therefore, when a certain pathological image is annotated, the PC100 designates the annotated tile of the pathological image and attaches the above annotation among the pathological images of the same observation target with different resolutions. Also specify tiles that contain the same coordinates as the coordinates.

FIG. 13 is a flowchart showing the processing flow of the PC 100 and the server 200 in the pre-download of the pathological image.

As shown in the figure, first, the pathological image data used in the remote conference and the list of participants in the remote conference are transmitted from the PC 100 of the organizer of the remote conference to the server 200 and registered (step 131). .. This process is executed, for example, by selecting a desired pathological image and user from a list of all pathological image data existing in the server 200 and all users.

Subsequently, the server 200 transmits a conference holding notification to each participant's PC 100 (step 132).

Subsequently, the participant's PC 100 determines whether or not the storage unit 18 such as an HDD having a capacity for downloading the pathological image in advance exists in the PC 100 (step 133).

If there is a downloadable HDD (Yes), the participant's PC 100 receives a list of pathological image data used in the teleconferencing from the server 200 (step 134). At this time, the past diagnosis history information regarding the pathological image data and the URL of the pathological image data (tile) at that time are also received.

Subsequently, the PC 100 designates tiles according to the above-mentioned criteria based on the list of received pathological image data and the above-mentioned diagnosis history information, and downloads the designated tiles from the server 200 (step 135).

Then, when the holding time of the remote conference arrives, the participant's PC100 can participate in the conference by connecting to the server 200 (step 136).

In the example of FIG. 13, the list of data used in the conference is determined when the organizer registers the pathological image data in the server 200. However, in reality, the organizer deletes unnecessary data or adds data that other participants want to use between the time the event notification is sent and the time the meeting is held. So, it is possible that the list will be updated.

Therefore, as shown in the flowchart of FIG. 14, it is conceivable to poll the list to keep it up to date.

That is, as shown in the figure, the PC 100 determines whether or not the conference holding time has arrived after executing the same processing as in steps 131 to 135 in FIG. 13 in steps 141 to 145 (steps 141 to 145). Step 146).

Subsequently, when the meeting holding time has not yet arrived (No), the server 200 is accessed to determine whether or not the list of used pathological image data has been updated (step 147).

Then, when the list is updated (Yes), the PC 100 newly receives the list from the server 200, and repeats the process of step 144 or less.

Here, instead of the processes of steps 146 and 147, the PC 100 may newly receive the list when the server 200 notifies the PC 100 of each participant of the update of the list.

Further, the tile pre-download destination does not have to be the storage unit 18 of the PC 100. For example, it may be downloaded to a nearby storage device connected to the PC 100 via a network, or when there are a plurality of servers 200, it may be downloaded to the server 200 as close as possible to the PC 100.

FIG. 15 is a flowchart showing a processing flow of the audience PC100 when the pathological image is displayed by the system according to the present embodiment.

As shown in the figure, the CPU 11 of the PC 100 performs the same processing as steps 61 and 62 of FIG. 6 of the first embodiment (steps 151 and 152), and then the specified tile is present in the storage unit 18. It is determined whether or not to do (pre-downloaded) (step 153).

If the tile does not exist in the storage unit 18 (No), the CPU 11 transmits a request for the tile to the server 200 (step 154) and receives the tile (step 155).

When the tile exists in the storage unit 18 (Yes), the CPU 11 reads the tile from the storage unit 18 (step 155).

Then, the CPU 11 displays the received or read tile on the display unit 16 (step 157).

By such advance download as described above, unnecessary communication on the day of the remote conference is reduced, so that the load on the server 200 when the number of PC100s in the audience increases is reduced, and unnecessary packets flow on the network. Is avoided.

<Third Embodiment>
Next, a third embodiment of the present technology will be described.

FIG. 16 is a diagram showing a configuration of a remote conference system according to the present embodiment.

In each of the above embodiments, both the display range information and the tile data of the pathological image are stored in the server 200. However, both do not necessarily have to be processed by the same server. Therefore, as shown in the figure, in the present embodiment, the tile data server 200A for storing the tile data and the control data server 200B for processing the display range information are separately provided. The control data server 200B also manages the past diagnosis history information described in the second embodiment, the tile data list, the participant list, and the like (hereinafter, these data are collectively referred to as control data). ..

As a result, the server is optimized for control data having a small data capacity but requiring responsiveness and tile data having a large data capacity and requiring throughput.

Further, the server 200B that handles the control data does not exist, and the control data may be exchanged by P2P communication between the plurality of PCs 100.

<Fourth Embodiment>
Next, a fourth embodiment of the present technology will be described.

FIG. 17 is a diagram showing a configuration of a remote conference system according to the present embodiment.

As shown in the figure, when connecting the in-hospital networks 170 between multiple hospitals and holding a remote conference, if the pathological image data used in the conference is collected in one place, the upload and download costs will be high. Become.

On the other hand, the pathological image data used in the remote conference is originally photographed by the scanner 300 of each hospital and stored in the in-hospital server 200A. Therefore, as shown in the figure, in the present embodiment, the in-hospital server 200A in each hospital is used as a substitute for the tile data server 200A in the third embodiment. In this case as well, the control data server 200B exists on the Internet 150.

With such a configuration, the work of uploading tile data to the server on the Internet 150 becomes unnecessary.

<Fifth Embodiment>
Next, a fifth embodiment of the present technology will be described.

FIG. 18 is a diagram showing a configuration of a remote conference system according to the present embodiment.

In the fourth embodiment, the in-hospital server must deliver tile data to remote conference participants, and depending on the size of the network bandwidth and the number of PC100s, a problem may occur in terms of server load. ..

Therefore, in the present embodiment, as shown in the figure, the tile data to be downloaded is uploaded to the cloud server 200C in advance. As a result, the load on the in-hospital server 200D is reduced.

FIG. 19 is a flowchart showing a flow of display processing of the PC 100 in the present embodiment.

As shown in the figure, when the CPU 11 of the PC 100 specifies the tile to be used in the same manner as in the processes of FIGS. 6 and 15 (steps 191 and 192), the CPU 11 of the specified tile is sent to the cloud server 200C. Submit the request (step 193).

Subsequently, the CPU 11 determines whether or not the tile to be requested has been successfully received (step 194).

If the reception of the tile fails (No), the CPU 11 transmits a request for the tile to the hospital server 200D (step 196) and receives the tile (step 197). Then, the received tile is displayed (step 197).

By such processing, the amount of work for uploading tile data to the server 200C is suppressed, and the load on the in-hospital server 200D is also reduced.

<Sixth Embodiment>
Next, a sixth embodiment of the present technology will be described.

FIG. 20 is a diagram showing a configuration of a remote conference system according to the present embodiment.

In each of the above-described embodiments, the number of tile servers is one, but as shown in the figure, in the present embodiment, a plurality of tile servers that deliver the same tile data are provided (tile server 200A-1). , 200A-2). For example, the tile server 200A-1 is a primary server, and the tile server 200B-1 is a secondary server.

As a result, the optimum server is determined for each PC 100 as a client, and it becomes possible to cope with the increase in the number of PC 100s. The following can be considered as the server determination algorithm at this time.
-Statically assign a server to each client in advance.
-The client (PC100) selects the server with the smallest RTT.
-The client (PC100) selects the server with the maximum bandwidth.
-The primary server (tile server 200A-1) is determined in consideration of the overall load.
-Perform a round robin.
-Collect server load information on a regular basis (eg once every 10 seconds).

<7th Embodiment>
Next, a seventh embodiment of the present technology will be described.

FIG. 21 is a diagram showing a configuration of a remote conference system according to the present embodiment.

As shown in the figure, in the in-hospital system in the in-hospital network 170, the tile data for which the diagnosis has been completed is evacuated from the in-hospital network 170 to the cloud server 200C via the Internet 150.

Then, when a reservation for an in-hospital meeting using the saved data is made in the in-hospital system, the tile data saved in the cloud server 200C is returned to the in-hospital server 200D at that time.

[Modification example]
The present technology is not limited to the above-described embodiment, and can be variously modified without departing from the gist of the present disclosure.

The configurations of the first to seventh embodiments described above can be combined in any way as long as they do not contradict each other. For example, the pre-download process in the second embodiment may be realized in a configuration in which the server is separately provided for the tile data server and the control data server as described in the third embodiment.

[Other]
The present technology can also adopt the following configurations.
(1) Communication unit and
Display and
Other information processing of the range specification information that specifies the display range in the pathological image composed of a plurality of partial images and the location information indicating the location of the plurality of partial images that may differ for each partial image. Received from the device
Based on the received range designation information, the request information requesting the transmission of the partial image belonging to the display range is transmitted to the location indicated by the location information.
A control unit capable of controlling the communication unit so as to receive the partial image transmitted from the location in response to the request information, and controlling the display unit so as to display the received partial image. An information processing device equipped with and.
(2) The information processing device according to (1) above.
Further equipped with a storage unit
The control unit determines whether or not the partial image belonging to the display range is stored in the storage unit, and if the partial image is stored in the storage unit, the request information is stored in the location. An information processing device capable of controlling the display unit so as to display the partial image without transmitting to.
(3) The information processing device according to (1) or (2) above.
The control unit
Prior to receiving the range designation information and the location information, the image designation information for designating a pathological image that can be used in a remote conference held with the other information processing apparatus, and the designated pathological image. The temporary location information indicating the location at the time of the present time and the diagnosis history information indicating the past diagnosis history of the specified pathological image are received in advance from the other information processing apparatus.
Of the plurality of partial images constituting the pathological image designated by the received image designation information, the partial image associated with the received diagnosis history information is obtained from the location indicated by the temporary location information. The communication unit can be controlled to receive,
An information processing device capable of controlling the storage unit so as to store the received partial image.
(4) The information processing device according to (3) above.
The control unit is an information processing device capable of controlling the communication unit so as to receive display history information indicating a past display range or display position in the designated pathological image as the diagnosis history information.
(5) The information processing device according to (3) above.
The control unit is an information processing device capable of controlling the communication unit so as to receive annotation information attached to a predetermined position in the designated pathological image as the diagnosis history information.
(6) The information processing device according to (5) above.
There are a plurality of the pathological images for each of a plurality of sections collected from one living tissue and stained with different colors.
The control unit receives a partial image of the first pathological image showing the section stained with the first color and exists at a predetermined position to which the annotation information is attached, and stains with the second color. An information processing device capable of controlling the communication unit so as to receive a partial image existing at the same position as the predetermined position in the second pathological image showing the cut section.
(7) The information processing device according to (5) above.
The pathological image is obtained by capturing a section collected from one living tissue at a plurality of different resolutions, so that a plurality of sections exist at each different resolution.
The control unit receives a partial image of the first pathological image captured at the first resolution and exists at a predetermined position to which the annotation information is attached, and a second image captured at the second resolution. An information processing device capable of controlling the communication unit so as to receive a partial image existing at the same position as the predetermined position among the pathological images of the above.
(8) The information processing device according to any one of (1) to (7) above.
The control unit can control the communication unit so as to receive the range designation information from the other information processing device via the first server device.
The location is an information processing device indicating a second server device different from the first server device.

11 ... CPU
16 ... Display unit 18 ... Storage unit 19 ... Communication unit 40 ... Observed object 70 ... Tile 71 ... Coordinate movement path 72 ... Display range 73 ... Annotation 100 ... PC
150 ... Internet 170 ... Hospital network 200 ... Server 300 ... Scanner

Claims (11)

Of the one or more partial images that make up the first pathological image, the annotated first partial image is designated.
Of one or more partial images constituting the second pathological image associated with the first pathological image, the same coordinates as the position of the first partial image annotated in the first pathological image. Specify the second partial image that exists in
It includes a control unit that receives the designated first partial image and the second partial image from another information processing device .
When there is a partial image surrounded by the plurality of the annotated first partial images in the first pathological image, the control unit uses the enclosed partial image as the first partial image. An information processing device that designates a partial image existing at the same coordinates as the position of the enclosed partial image in the second pathological image as the second partial image . The information processing device according to claim 1.
The first pathological image and the second pathological image are information processing devices in which the same biological tissue is imaged. The information processing device according to claim 2.
The living tissue is an information processing device that is at least one of a living body organ, tissue, or cell. The information processing device according to claim 1.
The first pathological image and the second pathological image are information processing devices in which sections of the same biological tissue are captured. The information processing device according to claim 1.
The first pathological image is an image obtained by capturing a first section collected from one living tissue.
The second pathological image is an information processing apparatus in which a second section different from the first section collected from the living tissue is imaged. The information processing device according to claim 5.
An information processing device in which the first section and the second section are dyed in different colors. The information processing device according to claim 1.
The first pathological image and the second pathological image are information processing devices having different resolutions. The information processing device according to claim 1.
The first pathological image and the second pathological image are information processing devices that are images of different resolutions of sections collected from one living tissue. The information processing device according to claim 1.
The annotation is an information processing device in the form of at least one of symbols, diagrams, texts, sounds, images, or links. Of the one or more partial images that make up the first pathological image, the annotated first partial image is designated.
When there is a partial image surrounded by the plurality of annotated first partial images in the first pathological image, the enclosed partial image is designated as the first partial image.
Of one or more partial images constituting the second pathological image associated with the first pathological image, the same coordinates as the position of the first partial image annotated in the first pathological image. Specify the second partial image that exists in
In the second pathological image, a partial image existing at the same coordinates as the position of the enclosed partial image is designated as the second partial image.
An information processing method for receiving the designated first partial image and the second partial image from the other information processing apparatus. For information processing equipment
A step of designating an annotated first partial image among one or more partial images constituting the first pathological image, and
When there is a partial image surrounded by the plurality of annotated first partial images in the first pathological image, the step of designating the enclosed partial image as the first partial image ,
Of the one or more partial images constituting the second pathological image associated with the first pathological image, the second portion existing at the same coordinates as the position of the annotated first partial image. Steps to specify the image and
A step of designating a partial image existing at the same coordinates as the position of the enclosed partial image in the second pathological image as the second partial image, and
A program that executes a step of receiving the designated first partial image and the second partial image from the other information processing apparatus.