WO2021169230A1

WO2021169230A1 - Method and apparatus for displaying pathological section image, and electronic device and storage medium

Info

Publication number: WO2021169230A1
Application number: PCT/CN2020/113096
Authority: WO
Inventors: 郭晶晶; 段琦; 张少霆
Original assignee: 上海商汤智能科技有限公司
Priority date: 2020-02-28
Filing date: 2020-09-02
Publication date: 2021-09-02
Also published as: KR20210110813A; TW202133190A; JP2022524707A; CN111354444A; TWI776348B

Abstract

A method and apparatus for displaying a pathological section image, and an electronic device and a storage medium. The method comprises: receiving a display request sent by a client (S11); determining, according to the number of layers and coordinate information, an image block, which includes an image area requested to be displayed, in a pathological section image (S12); and returning the image block to the client (S13).

Description

Pathological slice image display method and device, electronic equipment and storage medium

Cross-references to related applications

This application is based on a Chinese patent application with an application number of 202010131227.5 and an application date of February 28, 2020, and claims the priority of the Chinese patent application. The entire content of the Chinese patent application is hereby incorporated by reference into this application.

Technical field

This application relates to the field of image technology, and in particular to a method and device for displaying pathological slice images, electronic equipment and storage media.

Background technique

The pathology system usually adopts the browser/server (Browser/Server, B/S) architecture, and the user uses the browser to view the pathological slice image, that is, the whole slide image (WSI). Pathological slice images are usually divided into 10 layers according to different magnifications. For example, the magnification of the top layer is 1× (that is, 1 times), the resolution is 6000×5000, and the magnification of the bottom layer is 40× (that is, 40 Times), the resolution is 60000×50000. The size of a single pathological slice image obtained by scanning is usually several hundred megabytes (Mbyte, MB), or even more than 1 gigabyte (Gbyte, GB). In related technologies, when displaying pathological slice images, there are huge challenges for terminals, servers, and bandwidth.

Summary of the invention

The embodiments of the present application provide a method and device for displaying pathological slice images, electronic equipment, and storage media.

The embodiment of the present application provides a method for displaying pathological slice images, including:

Receiving a display request sent by the client, where the display request carries the number of layers of the pathological slice image requested to be displayed and the coordinate information of the image area requested to be displayed;

Determine, according to the number of layers and the coordinate information, an image block in the pathological slice image that includes the image area requested to be displayed, wherein the pathological slice image includes at least one image block;

Return the image block to the client.

According to the method for displaying the pathological slice image provided by the embodiment of the present application, the pathological slice image can be displayed based on the image block of the pathological slice image, and the amount of transmitted data can be reduced, so that the display speed of the pathological slice image can be accelerated.

In some embodiments of the present application, before the receiving the display request sent by the client, the method further includes:

For pathological slice images belonging to any number of layers, dividing the pathological slice image into multiple image blocks according to a preset image block size;

Determining the number of rows and the number of columns of any image block of the plurality of image blocks in the array formed by the plurality of image blocks;

A correspondence relationship between the number of layers, the number of rows and the number of columns of any image block in the array formed by the plurality of image blocks, and the any image block is established.

In the embodiment of the present application, by dividing the pathological slice image into multiple image blocks, the subsequent processing of the pathological slice image display request can be processed based on the image blocks of the pathological slice image, thereby improving the pathological slice image. Display the processing speed of the request, thereby helping to improve the response speed of the browser.

In some embodiments of the present application, the establishment of the number of layers, the number of rows and the number of columns of any image block in the array formed by the plurality of image blocks is the same as the number of any image block. Correspondence between, including:

Name any image block according to the number of layers, the number of rows and the number of columns of any image block in the array formed by the plurality of image blocks.

According to the embodiment of the present application, the number of layers of the pathological slice image, the number of rows and the number of columns of any image block in the array formed by the multiple image blocks can be quickly established. The corresponding relationship between the image blocks can improve the search speed and convenience of the image blocks.

In some embodiments of the present application, the coordinate information includes the coordinates of four vertices of the image area requested to be displayed;

The determining, according to the number of layers and the coordinate information, the image block in the pathological slice image that contains the image area requested to be displayed includes:

Determining the number of rows and columns of the image block according to the ratio of the coordinates of the four vertices to the preset size of the image block;

According to the number of layers, the number of rows and columns of the image block, and the corresponding relationship, the image block is determined.

According to the embodiment of the present application, it is possible to quickly and accurately determine the image block in the pathological slice image that contains the image area requested to be displayed.

Sending a display request to the server, where the display request carries the number of layers of the pathological slice image requested to be displayed and the coordinate information of the image area requested to be displayed;

Receiving an image block returned by the server based on the display request, where the image block is an image block in the pathological slice image that includes the image area requested to be displayed;

Display the part of the image block that belongs to the range of the image area requested to be displayed.

An embodiment of the present application provides a pathological slice image display device, including:

The first receiving module is configured to receive a display request sent by the client, where the display request carries the number of layers of the pathological slice image requested to be displayed and the coordinate information of the image area requested to be displayed;

The first determining module is configured to determine, according to the number of layers and the coordinate information, an image block in the pathological slice image that includes the image area requested to be displayed, wherein the pathological slice image includes at least one image block;

The return module is configured to return the image block to the client.

A sending module configured to send a display request to the server, where the display request carries the number of layers of the pathological slice image requested to be displayed and the coordinate information of the image area requested to be displayed;

A second receiving module configured to receive an image block returned by the server based on the display request, where the image block is an image block in the pathological slice image that includes the image area requested to be displayed;

The display module is configured to display the part of the image block that belongs to the range of the image area requested to be displayed.

An embodiment of the present application provides an electronic device, including: one or more processors; a memory configured to store executable instructions; wherein the one or more processors are configured to call the executable instructions stored in the memory To perform the above method.

An embodiment of the present application provides a computer-readable storage medium having computer program instructions stored on the computer-readable storage medium, and the computer program instructions implement the foregoing method when executed by a processor.

The embodiment of the present application provides a computer program, including computer readable code, and when the computer readable code runs in an electronic device, a processor in the electronic device executes the above method.

In this embodiment of the application, by receiving the display request sent by the client, according to the number of layers of the pathological slice image and the coordinate information of the image area requested to be displayed, it is determined that the pathological slice image contains the requested display The image block of the image area of, wherein the pathological slice image includes at least one image block, and the image block is returned to the client, so that the pathological slice image can be displayed based on the image block of the pathological slice image, Reduce the amount of data transmitted, which can speed up the display of pathological slice images.

It should be understood that the above general description and the following detailed description are only exemplary and explanatory, rather than limiting the application. According to the following detailed description of exemplary embodiments with reference to the accompanying drawings, other features and aspects of the present application will become clear.

Description of the drawings

The drawings here are incorporated into the specification and constitute a part of the specification. These drawings show embodiments that conform to the application and are used together with the specification to illustrate the technical solution of the application.

FIG. 1 is a schematic diagram of a system architecture of a method for displaying pathological slice images provided by an embodiment of the present application;

FIG. 2 is an implementation flowchart of a method for displaying pathological slice images provided by an embodiment of the present application;

3A to 3D are schematic diagrams of dividing the pathological slice image into multiple image blocks in the pathological slice image display method provided by the embodiment of the present application;

FIG. 4 is a schematic diagram of a region of interest (a user perspective range) of a user in the method for displaying pathological slice images provided by an embodiment of the present application;

FIG. 5 is another implementation flowchart of the pathological slice image display method provided by the embodiment of the present application;

Fig. 6 is a schematic diagram of a pathological slice image display device provided by an embodiment of the present application;

FIG. 7 is another schematic diagram of a pathological slice image display device provided by an embodiment of the present application;

FIG. 8 is a schematic diagram of an electronic device provided by an embodiment of the present application;

Fig. 9 is another schematic diagram of an electronic device provided by an embodiment of the present application.

Detailed ways

Hereinafter, various exemplary embodiments, features, and aspects of the present application will be described in detail with reference to the accompanying drawings. The same reference numerals in the drawings indicate elements with the same or similar functions. Although various aspects of the embodiments are shown in the drawings, unless otherwise noted, the drawings are not necessarily drawn to scale.

The dedicated word "exemplary" here means "serving as an example, embodiment, or illustration." Any embodiment described herein as "exemplary" need not be construed as being superior or better than other embodiments.

The term "and/or" in this article is only an association relationship describing the associated objects, which means that there can be three relationships, for example, A and/or B, which can mean: A alone exists, A and B exist at the same time, exist alone B these three situations. In addition, the term "at least one" in this document means any one of a plurality of or any combination of at least two of the plurality, for example, including at least one of A, B, and C, may mean including A, Any one or more elements selected in the set formed by B and C.

In addition, in order to better explain the present application, numerous details are given in the following embodiments. Those skilled in the art should understand that this application can also be implemented without certain details. In some examples, the methods, means, elements, and circuits well-known to those skilled in the art have not been described in detail in order to highlight the gist of the present application.

Before describing the embodiments of the present application in detail, the defects in the related technology will be described first.

In related technologies, the pathology system usually adopts the B/S architecture, and the user uses the browser on the client to view the pathological slice image. Pathological slice images are usually divided into 10 layers according to different magnifications. For example, the magnification of the top layer is 1× (that is, 1 times), the resolution is 6000×5000, and the magnification of the bottom layer is 40× (that is, 40 Times), the resolution is 60000×50000. The size of a single pathological slice image obtained by scanning is usually several hundred megabytes (Mbyte, MB), or even more than 1 gigabyte (Gbyte, GB). The user usually browses the pathological slice images according to the magnification from small to large, and when the browser displays the pathological slice images, usually according to the number of layers browsed and the user’s current perspective, the slice images are dynamically extracted from the server, with pictures The stream is transmitted to the client, and the extracted slice image is displayed in the browser of the client.

In the related technology, the slice image is dynamically extracted. First, locate the layer number to be browsed, then perform the area coordinate conversion according to the user's current perspective, and finally extract the image content of the corresponding layer number according to the converted coordinate information. When the user's current perspective is constantly changing, the server continuously repeats the coordinate conversion image extraction operation. In the case of high user concurrency, it is easy to cause the browser to display slowly, freeze, or even crash, which reduces the user's use Experience.

Based on the above problems, an embodiment of the present application provides a method for displaying slice images according to the area where the user's perspective is located, which can display pathological slice images based on the image blocks of the pathological slice image, reduce the amount of transmitted data, and speed up the pathological slice. The display speed of the image.

Referring to FIG. 1, FIG. 1 is a schematic diagram of the system architecture of the method for displaying pathological slice images provided by an embodiment of the present application. As shown in FIG. 1, the system architecture includes a client 100, a server 200, and a network 300. As an exemplary application, the client 100 can connect to the server 200 through the network 300. The browser of the client 100 can display the pathological slice images obtained from the server 200. The client 100 can be a laptop, tablet, desktop computer, or a dedicated computer. Terminals with screen display functions such as message devices. The network 300 may be a wide area network or a local area network, or a combination of the two, and uses wireless links to implement data transmission. The server 200 may be an independent physical server, a server cluster or a distributed system composed of multiple physical servers, or a cloud server based on cloud technology. Cloud technology refers to a hosting technology that unifies a series of resources such as hardware, software, and network within a wide area network or a local area network to realize the calculation, storage, processing, and sharing of data.

The server 200 may be based on the pathological slice image display method provided by the embodiment of the present application, by receiving the display request sent by the client 100, according to the number of layers of the pathological slice image requested to be displayed and the coordinates of the image area requested to be displayed carried in the display request Information, determine the image block of the image area requested to be displayed in the pathological slice image, and return the determined image block to the client 100, and the browser of the client 100 displays the received image block to reduce transmission Therefore, the speed of displaying pathological slice images in the browser can be accelerated, and the experience of viewing pathological slice images of the user of the client terminal 100 can be improved.

Fig. 2 is an implementation flow chart of a method for displaying pathological slice images provided by an embodiment of the present application. The method for displaying pathological slice images is applied to the server side of the system architecture shown in FIG. 1. The execution body of the pathological slice image display method may be a pathological slice image display device, and the pathological slice image display device may be deployed on a server on the server side, that is, the execution body of the pathological slice image display method may be It is the server side. For example, the display method of the pathological slice image may be executed by a server or other processing equipment. In some embodiments of the present application, the display method of the pathological slice image may be implemented by a processor invoking a computer-readable instruction stored in a memory. As shown in FIG. 2, the display method of the pathological slice image includes step S11 to step S13.

Step S11: Receive a display request sent by the client, where the display request carries the number of layers of the pathological slice image requested to be displayed and the coordinate information of the image area requested to be displayed.

In the embodiment of the present application, the user can select the pathological slice image that he wants to view in the browser of the client, and can select the region of interest in the pathological slice image for viewing. The browser can determine the number of layers of the pathological slice image requested to be displayed and the coordinate information of the image area requested to be displayed according to the pathological slice image and area selected by the user.

In some embodiments of the present application, before the receiving the display request sent by the client, the method further includes: for pathological slice images belonging to any number of layers, dividing the pathological slice image according to a preset image block size Divide into a plurality of image blocks; determine the number of rows and columns of any one of the plurality of image blocks in the array formed by the plurality of image blocks; establish the number of layers, the number of any one Correspondence between the number of rows and the number of columns of an image block in the array formed by the plurality of image blocks and any one of the image blocks.

For example, the preset image block size is 256×256.

3A to 3D are schematic diagrams of dividing the pathological slice image into multiple image blocks in the method for displaying the pathological slice image provided by the embodiment of the present application. In the example shown in FIGS. 3A to 3D, there are 4 layers of pathological slice images, which are the 3rd layer (the topmost layer), the 2nd layer, the 1st layer, and the 0th layer (the bottommost layer). In the examples shown in Figures 3A to 3D, the topmost pathological slice image is not divided; the pathological slice image of the second layer is divided into 4 image blocks, that is, the pathological slice image of the second layer is divided , Obtain a 2×2 image block array; divide the pathological slice image of the first layer into 12 image blocks, that is, divide the pathological slice image of the first layer to obtain a 4×3 image block array; The pathological slice image is divided into 48 image blocks, that is, the pathological slice image at the bottom is divided to obtain an 8×6 image block array. For example, for image block A in the bottommost pathological slice image shown in Figure 3D, the correspondence between the 0th layer, the second row, and the second column and the image block A can be established; for the bottommost pathological slice image For image block B, the corresponding relationship between layer 0, row 3, column 4 and image block B can be established.

In this implementation manner, by dividing the pathological slice image into multiple image blocks, the subsequent processing of the pathological slice image display request can be processed based on the image blocks of the pathological slice image, thereby improving the display of the pathological slice image. The processing speed of the request, which helps to improve the response speed of the browser.

In the embodiment of the present application, it is not limited to dividing the pathological slice image according to the preset image block size, and the pathological slice image may also be divided in other ways. For example, when dividing, the connected layers can be converted by a multiple of 2. For example, the pathological slice image of the top layer (the third layer) is not divided, and the pathological slice image of the second layer is divided to obtain 2×2 Divide the pathological slice image of the first layer into 16 image blocks, that is, divide the pathological slice image of the first layer to obtain a 4×4 image block array; divide the pathological slice image of the bottom layer It is 64 image blocks, that is, the pathological slice image at the bottom is divided to obtain an 8×8 image block array. This determines the size and range of each divided image block. For another example, the pathological slice image can be equally divided into N image blocks, where N is the preset number of image blocks. For another example, the pathological slice image can be divided so that the size of each image block obtained by the division is within a preset interval. In the embodiment of the present application, the sizes of different image blocks may be the same or different.

In some embodiments of the present application, the establishment of the number of layers, the number of rows and the number of columns of any image block in the array formed by the plurality of image blocks is the same as the number of any image block. The correspondence relationship may include: according to the number of layers, and the number of rows and columns of any image block in the array formed by the plurality of image blocks, performing the calculation on any image block name.

For example, image blocks can be named according to [number of layers]_[row]_[column]. For example, the image block A in the pathological slice image at the bottom level shown in FIG. 3D can be named [0]_[2]_[2], and the image block B in the pathological slice image at the bottom level can be named [0] _[3]_[4].

In some embodiments of the present application, after each divided image block is determined, all the image blocks are generated into a file of a preset format, such as a file in the .jpg format, and then each file in the .jpg format is determined according to [ The layer number]_[row]_[column] rule names each image block.

In this implementation, according to the number of layers of the pathological slice image, and the number of rows and columns of any image block in the array formed by the plurality of image blocks, the Named, so that the number of layers of the pathological slice image, the number of rows and the number of columns of any image block in the array formed by the multiple image blocks, and the number of any image can be quickly established The corresponding relationship between the blocks can improve the search speed and convenience of image blocks.

The dashed frame 31 to the dashed frame 34 in FIGS. 3A to 3D are the image areas requested to be displayed. FIG. 4 is a schematic diagram of a region of interest (a user's viewing angle range) of a user in the method for displaying pathological slice images provided by an embodiment of the present application. As shown in FIG. 4, the user's viewing angle range is a part of the pathological slice image, such as the image corresponding to the dashed frame 401 in FIG. Obtain the image corresponding to the dashed frame 401 in the pathological slice image according to the user's perspective, and only need to load the image corresponding to the dashed frame 401. The image information of other parts does not need to be loaded. When the user changes the perspective, the server does not need to re-coordinate. Time-consuming processing steps such as conversion and dynamic extraction of image information, only need to return the user's view area image to the client browser, which greatly accelerates the display speed of pathological slice images, shortens the response time of the flowmeter, and allows users to concurrently In the case of high volume, it can also be displayed quickly, thereby improving the user experience of pathological slice image display and achieving a smoother interactive experience.

In the embodiment of the present application, the client can display the pathological slice image through the browser. For different clients, the screen or browser parameters may be different, and accordingly, the size of the display area may also be different. Therefore, the size of the image area requested to be displayed may also be different.

Step S12: Determine, according to the number of layers and the coordinate information, an image block in the pathological slice image that contains the image area requested to be displayed.

Wherein, the pathological slice image includes at least one image block. In the embodiment of the present application, the image block includes the image area requested to be displayed, which means that the image block includes part or all of the image area requested to be displayed. That is, the pathological slice image contains the image block of the image area requested to be displayed, which may refer to the image block in the pathological slice image that has an overlapping area with the image area requested to be displayed. For example, in the pathological slice image of the second layer shown in FIG. 3B, the image blocks containing the image area requested to be displayed are the upper image block a2 and the image block b2; in the pathological slice image of the first layer shown in FIG. 3C , The image block containing the image area requested to be displayed includes image block a3 to image block d3; in the pathological slice image of the 0th layer shown in Figure 3D, the image block containing the image area requested to be displayed includes image block a4 to image Block h4, that is, the image block in row 5 and column 3, the image block in row 5 and column 4, the image block in row 5 and column 5, the image block in row 5 and column 6, and the image block in row 4 and column 3 The image block in row 4 and column 4, the image block in row 4 and column 5, and the image block in row 4 and column 6.

In some embodiments of the present application, the coordinate information of the image area requested to be displayed includes the coordinates of the four vertices of the image area requested to be displayed; and the pathology is determined according to the number of layers and the coordinate information. Slicing the image block of the image area requested to be displayed in the slice image includes: determining the number of rows and columns of the image block according to the ratio of the coordinates of the four vertices to the preset size of the image block; The number of layers, the number of rows and columns of the image block, and the corresponding relationship determine the image block.

For example, the coordinates of the upper left vertex of the requested image area are (x ₁ , y ₁ ), the coordinates of the upper right vertex are (x ₂ , y ₂ ), and the coordinates of the lower left vertex are (x ₃ , y ₃ ), The coordinates of the vertex at the lower right corner are (x ₄ , y ₄ ), and the preset image block size is 256×256. The number of rows of the image block in the upper left corner of the image area requested to be displayed in the pathological slice image is

The number of columns is

The number of rows of the image block in the upper right corner of the image area requested to be displayed in the pathological slice image is

The number of columns is

The number of rows of the image block in the lower left corner of the image area requested to be displayed in the pathological slice image is

The number of columns is

The number of rows of the image block in the lower right corner of the image area requested to be displayed in the pathological slice image is

The number of columns is

in,

Indicates rounding up. Determine the image blocks between the image block in the upper left corner, the image block in the upper right corner, the image block in the lower left corner, and the image block in the lower right corner respectively as the image blocks in the pathological slice image that contain the image area requested to be displayed . For example, if the number of layers is 0, the image block a4 in the upper left corner is the image block in row 5 and column 3, the image block d4 in the upper right corner is the image block in row 5 and column 6, and the image block e4 in the lower left corner is the image block in the fourth column. The image block in row 3 and column, the image block h4 in the lower right corner is the image block in row 4, column 6 and the image blocks a4 to h4 between image blocks a4, d4, e4 and h4 are determined as the The pathological slice image contains the image block of the image area requested to be displayed.

Step S13: Return the image block to the client.

In this embodiment of the application, by receiving the display request sent by the client, it is determined that the pathological slice image contains the request according to the number of layers of the pathological slice image carried in the display request and the coordinate information of the image area requested to be displayed The image block of the displayed image area, wherein the pathological slice image includes at least one image block, and the image block is returned to the client, so that the pathological slice image can be displayed based on the image block of the pathological slice image In this way, the display speed of pathological slice images can be accelerated, and a smoother interactive experience can be achieved even in the case of high user concurrency. In the embodiment of this application, the server only needs to return the image block containing the image area requested to be displayed to the client, instead of returning the entire pathological slice image to the client, reducing the amount of data transmitted, and the client only needs to The image block containing the image area requested to be displayed is received and processed, so that the transmission and display pressure of the server and client browsers can be reduced.

Fig. 5 is another implementation flow chart of the method for displaying pathological slice images provided by an embodiment of the present application. The method for displaying pathological slice images is applied to the client of the system architecture shown in FIG. 1. The execution subject of the pathological slice image display method may be a pathological slice image display device. For example, the display method of the pathological slice image may be executed by a terminal device or other processing device. Among them, the terminal device can be a user equipment (UE), a mobile device, a user terminal, a terminal, a cellular phone, a cordless phone, a personal digital assistant (Personal Digital Assistant, PDA), a handheld device, a computing device, a vehicle-mounted device, or a portable device. Wearable equipment, etc. In some embodiments of the present application, the display method of the pathological slice image may be implemented by a processor invoking a computer-readable instruction stored in a memory. As shown in FIG. 5, the display method of the pathological slice image includes step S41 to step S43.

Step S41: Send a display request to the server.

Wherein, the display request carries the number of layers of the pathological slice image requested to be displayed and the coordinate information of the image area requested to be displayed.

Step S42: Receive an image block returned by the server based on the display request, where the image block is an image block in the pathological slice image that includes the image area requested to be displayed.

In the embodiment of the present application, after receiving the display request, the server can determine that the pathological slice image contains all the pathological slice images according to the number of layers of the pathological slice image carried in the display request and the coordinate information of the image area requested to be displayed. The image block of the image area requested for display, wherein the pathological slice image includes at least one image block.

Step S43: Display the part of the image block that belongs to the range of the image area requested to be displayed.

In some embodiments of the present application, when the browser displays the image block, it determines the part of the image block within the range of the image area requested to be displayed according to the image block, and then compares the determined image block The part within the range of the image area requested to be displayed in the display.

In the embodiment of the present application, by sending a display request to the server, receiving the image block containing the image area requested to be displayed in the pathological slice image returned by the server based on the display request, and displaying the image The part of the block that belongs to the range of the image area requested to be displayed can thereby display the pathological slice image based on the image block of the pathological slice image, reduce the amount of transmitted data, and accelerate the display speed of the pathological slice image.

It can be understood that the various method embodiments mentioned in this application can be combined with each other to form a combined embodiment without violating the principle logic.

Those skilled in the art can understand that in the above-mentioned methods of the specific implementation, the writing order of the steps does not mean a strict execution order but constitutes any limitation on the implementation process. The execution order of each step should be based on its function and possible inherent Logic is determined.

In addition, the embodiments of the present application also provide display devices, electronic equipment, computer-readable storage media, and programs for pathological slice images. All of the above can be used to implement any of the pathological slice image display methods provided in the embodiments of the present application, and the corresponding technical solutions And description and refer to the corresponding record in the method section.

Fig. 6 is a schematic diagram of a pathological slice image display device provided by an embodiment of the present application. As shown in FIG. 6, the device for displaying pathological slice images includes: a first receiving module 51 configured to receive a display request sent by a client, where the display request carries the number of layers of the pathological slice image requested to be displayed and the request The coordinate information of the displayed image area; the first determining module 52 is configured to determine, according to the number of layers and the coordinate information, the image block containing the image area requested to be displayed in the pathological slice image, wherein the The pathological slice image includes at least one image block; the returning module 53 is configured to return the image block to the client.

In some embodiments of the present application, the device further includes: a dividing module configured to divide the pathological slice image into a plurality of image blocks according to a preset image block size for pathological slice images belonging to any number of layers A second determining module, configured to determine the number of rows and columns of any image block of the plurality of image blocks in the array formed by the plurality of image blocks; the establishment module, configured to establish the layer The corresponding relationship between the number of rows and the number of columns of any image block in the array formed by the plurality of image blocks and the any image block.

In some embodiments of the present application, the establishing module may also be configured to: according to the number of layers, the number of rows and the number of columns of any image block in the array formed by the plurality of image blocks, Name any image block.

In some embodiments of the present application, the coordinate information includes the coordinates of the four vertices of the image area requested to be displayed; the determining module 52 may also be configured to: according to the coordinates of the four vertices and the preset The ratio of the size of the image block to determine the number of rows and the number of columns of the image block; the image block is determined according to the number of layers, the number of rows and columns of the image block, and the corresponding relationship.

In this embodiment of the application, by receiving the display request sent by the client, it is determined that the pathological slice image contains the request according to the number of layers of the pathological slice image carried in the display request and the coordinate information of the image area requested to be displayed The image block of the displayed image area, wherein the pathological slice image includes at least one image block, and the image block is returned to the client, so that the pathological slice image can be displayed based on the image block of the pathological slice image , To reduce the amount of data transmitted, which can speed up the display of pathological slice images.

Fig. 7 is another schematic diagram of a pathological slice image display device provided by an embodiment of the present application. As shown in FIG. 7, the device for displaying pathological slice images includes: a sending module 61 configured to send a display request to the server, where the display request carries the number of layers of the pathological slice image requested to be displayed and the image requested to be displayed The coordinate information of the area; the second receiving module 62 is configured to receive the image block returned by the server based on the display request; the display module 63 is configured to display the range of the image area that belongs to the requested display in the image block The inner part.

In some embodiments, the functions or modules included in the apparatus provided in the embodiments of the present application may be configured to execute the methods described in the above method embodiments, and for implementation, refer to the description of the above method embodiments.

An embodiment of the present application also provides a computer-readable storage medium on which computer program instructions are stored, and the computer program instructions implement the above-mentioned method when executed by a processor. Wherein, the computer-readable storage medium may be a non-volatile computer-readable storage medium, or may be a volatile computer-readable storage medium.

The embodiments of the present application also provide a computer program product, including computer-readable code. When the computer-readable code runs on the device, the processor in the device is configured to implement the pathological slice image display provided in any of the above embodiments. Method of instruction.

The embodiments of the present application also provide another computer program product configured to store computer-readable instructions, which when executed, cause the computer to perform the operations of the pathological slice image display method provided by any of the foregoing embodiments.

An embodiment of the present application further provides an electronic device, including: one or more processors; a memory configured to store executable instructions; wherein, the one or more processors are configured to call the executable stored in the memory Instructions to perform the above method.

The electronic device can be provided as a terminal, server or other form of device.

FIG. 8 is a schematic diagram of an electronic device provided by an embodiment of the present application. For example, the electronic device 800 may be a mobile phone, a computer, a digital broadcasting terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, and other terminals.

8, the electronic device 800 may include one or more of the following components: a processing component 802, a memory 804, a power component 806, a multimedia component 808, an audio component 810, and an input/output (Input/Output, I/O) interface 812 , The sensor component 814, and the communication component 816.

The processing component 802 generally controls the overall operations of the electronic device 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the foregoing method. In addition, the processing component 802 may include one or more modules to facilitate the interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.

The memory 804 is configured to store various types of data to support operations in the electronic device 800. Examples of such data include instructions of any application or method configured to operate on the electronic device 800, contact data, phone book data, messages, pictures, videos, etc. The memory 804 can be implemented by any type of volatile or non-volatile storage device or their combination, such as static random access memory (Static Random Access Memory, SRAM), electrically erasable programmable read-only memory (Electrically Erasable). Programmable Read Only Memory, EEPROM, Erasable Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (Read Only Memory, ROM) , Magnetic memory, flash memory, magnetic disk or optical disk.

The power supply component 806 provides power for various components of the electronic device 800. The power supply component 806 may include a power management system, one or more power supplies, and other components associated with the generation, management, and distribution of power for the electronic device 800.

The multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and the user. In some embodiments, the screen may include a liquid crystal display (Liquid Crystal Display, LCD) and a touch panel (TouchPanel, TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, sliding, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure related to the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and/or a rear camera. When the electronic device 800 is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have focal length and optical zoom capabilities.

The audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a microphone (Microphone, MIC). When the electronic device 800 is in an operation mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal. The received audio signal may be stored in the memory 804 or transmitted via the communication component 816. In some embodiments, the audio component 810 further includes a speaker configured to output audio signals.

The I/O interface 812 provides an interface between the processing component 802 and a peripheral interface module. The above-mentioned peripheral interface module may be a keyboard, a click wheel, a button, and the like. These buttons may include, but are not limited to: home button, volume button, start button, and lock button.

The sensor component 814 includes one or more sensors configured to provide the electronic device 800 with various aspects of state evaluation. For example, the sensor component 814 can detect the on/off status of the electronic device 800 and the relative positioning of the components. For example, the component is the display and the keypad of the electronic device 800. The sensor component 814 can also detect the electronic device 800 or the electronic device 800. The position of the component changes, the presence or absence of contact between the user and the electronic device 800, the orientation or acceleration/deceleration of the electronic device 800, and the temperature change of the electronic device 800. The sensor component 814 may include a proximity sensor configured to detect the presence of nearby objects when there is no physical contact. The sensor component 814 may also include a light sensor, such as a complementary metal oxide semiconductor (Complementary Metal Oxide Semiconductor, CMOS) or a charge coupled device (Charge Coupled Device, CCD) image sensor, which can be used in imaging applications. In some embodiments, the sensor component 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 816 is configured to facilitate wired or wireless communication between the electronic device 800 and other devices. The electronic device 800 can access a wireless network based on a communication standard, such as Wi-Fi, 2G, 3G, 4G/LTE, 5G, or a combination thereof. In some embodiments of the present application, the communication component 816 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In some embodiments of the present application, the communication component 816 further includes a Near Field Communication (NFC) module to facilitate short-range communication. For example, the NFC module can be based on Radio Frequency Identification (RFID) technology, Infrared Data Association (Infrared Data Association, IrDA) technology, Ultra Wide Band (UWB) technology, Bluetooth (Bluetooth, BT) technology and other technologies. Technology to achieve.

In some embodiments of the present application, the electronic device 800 may be used by one or more application specific integrated circuits (ASIC), digital signal processors (Digital Signal Process, DSP), and digital signal processing equipment (Digital Signal Process). Device, DSPD), Programmable Logic Device (PLD), Field Programmable Gate Array (Field Programmable Gate Array, FPGA), controller, microcontroller, microprocessor or other electronic components, configured to execute The above method.

In some embodiments of the present application, there is also provided a non-volatile computer-readable storage medium, such as the memory 804 including computer program instructions, which can be executed by the processor 820 of the electronic device 800 to complete the foregoing method.

Fig. 9 is another schematic diagram of an electronic device provided by an embodiment of the present application. For example, the electronic device 1900 may be provided as a server. 9, the electronic device 1900 includes a processing component 1922, and may also include one or more processors, and a memory resource represented by the memory 1932, configured to store instructions executable by the processing component 1922, such as application programs. The application program stored in the memory 1932 may include one or more modules each corresponding to a set of instructions. In addition, the processing component 1922 is configured to execute instructions to perform the above-described methods.

The electronic device 1900 may also include a power supply component 1926 configured to perform power management of the electronic device 1900, a wired or wireless network interface 1950 configured to connect the electronic device 1900 to a network, and an input output (I/O) interface 1958 . The electronic device 1900 can operate based on an operating system stored in the memory 1932, such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM or the like.

In some embodiments of the present application, there is also provided a non-volatile computer-readable storage medium, such as the memory 1932 including computer program instructions, which can be executed by the processing component 1922 of the electronic device 1900 to complete the above method.

This application can be a system, method and/or computer program product. The computer program product may include a computer-readable storage medium loaded with computer-readable program instructions configured to enable a processor to implement various aspects of the present application.

The computer-readable storage medium may be a tangible device that holds and stores instructions used by the instruction execution device. The computer-readable storage medium may be, for example, but not limited to: an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. The computer-readable storage medium may include: portable computer disk, hard disk, random access memory (Random Access Memory, RAM), ROM, erasable programmable read-only memory (EPROM or flash memory), SRAM, portable compact disk read-only memory (Compact Disk-Read Only Memory, CD-ROM), Digital Video Disc (DVD), memory sticks, floppy disks, mechanical coding devices, such as punch cards with instructions stored on them or protrusions in the grooves Structure, and any suitable combination of the above. The computer-readable storage medium used here is not interpreted as the instantaneous signal itself, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (for example, light pulses through fiber optic cables), or through wires Transmission of electrical signals.

The computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to various computing/processing devices, or downloaded to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, optical fiber transmission, wireless transmission, routers, firewalls, switches, gateway computers, and/or edge servers. The network adapter card or network interface in each computing/processing device receives computer-readable program instructions from the network, and forwards the computer-readable program instructions for storage in the computer-readable storage medium in each computing/processing device .

The computer program instructions configured to perform the operations of this application may be assembly instructions, instruction set architecture (Instruction Set Architecture, ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, state setting data, or one or more Source code or object code written in any combination of two programming languages, including object-oriented programming languages, such as Smalltalk, C++, etc., and conventional procedural programming languages, such as "C" language or similar programming languages. Computer-readable program instructions can be executed entirely on the user's computer, partly on the user's computer, executed as a stand-alone software package, partly on the user's computer and partly executed on a remote computer, or entirely on the remote computer or server implement. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network (including a local area network or a wide area network), or may be connected to an external computer (for example, using an Internet service provider to connect through the Internet). In some embodiments, electronic circuits, such as programmable logic circuits, FPGAs, or programmable logic arrays (Programmable Logic Array, PLA), can be customized by using the status information of computer-readable program instructions. Read the program instructions to realize all aspects of this application.

Here, various aspects of the present application are described with reference to the flowcharts and/or schematic diagrams of the methods, devices (systems) and computer program products according to the embodiments of the present application. It should be understood that each block of the flowcharts and/or schematic diagrams and combinations of blocks in the flowcharts and/or schematic diagrams can be implemented by computer-readable program instructions.

These computer-readable program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine that makes these instructions when executed by the processor of the computer or other programmable data processing device , A device that implements the functions/actions specified in one or more blocks in the flowcharts and/or schematic diagrams is produced. It is also possible to store these computer-readable program instructions in a computer-readable storage medium. These instructions make computers, programmable data processing apparatuses, and/or other devices work in a specific manner, so that the computer-readable medium storing the instructions includes An article of manufacture, which includes instructions for implementing various aspects of the functions/actions specified in one or more blocks in the flowcharts and/or schematic diagrams.

It is also possible to load computer-readable program instructions onto a computer, other programmable data processing device, or other equipment, so that a series of operation steps are executed on the computer, other programmable data processing device, or other equipment to produce a computer-implemented process , So that the instructions executed on the computer, other programmable data processing apparatus, or other equipment realize the functions/actions specified in one or more blocks in the flowcharts and/or schematic diagrams.

The flowcharts and schematic diagrams in the accompanying drawings show the possible implementation architecture, functions, and operations of the system, method, and computer program product according to multiple embodiments of the present application. In this regard, each block in the flowchart or schematic diagram may represent a module, program segment, or part of an instruction. Executable instructions. In some alternative implementations, the functions marked in the block may also occur in a different order from the order marked in the drawings. For example, two consecutive blocks can actually be executed substantially in parallel, or they can sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the schematic diagram and/or flowchart, and the combination of the blocks in the schematic diagram and/or flowchart, can be implemented by a dedicated hardware-based system that performs the specified functions or actions. Or it can be realized by a combination of dedicated hardware and computer instructions.

The computer program product can be implemented by hardware, software or a combination thereof. In an implementation manner of the embodiments of the present application, the computer program product may be embodied as a computer storage medium. In another implementation manner, the computer program product may be embodied as a software product, such as a software development kit (SDK) and many more.

The embodiments of the present application have been described above, and the above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Without departing from the scope and spirit of the illustrated embodiments, many modifications and changes are obvious to those of ordinary skill in the art. The choice of terms used herein is intended to best explain the principles, practical applications, or improvements to related technologies of the various embodiments, or to enable other ordinary skilled in the art to understand the various embodiments disclosed herein.

Industrial applicability

This application relates to a method and device for displaying pathological slice images, electronic equipment and storage media. The method includes: receiving a display request sent by a client, wherein the display request carries the number of layers of the pathological slice image requested to be displayed and the coordinate information of the image area requested to be displayed; according to the number of layers and the coordinate information, Determine the image block in the pathological slice image that includes the image area requested for display, wherein the pathological slice image includes at least one image block; and return the image block to the client. In this way, it is possible to display the pathological slice image based on the image block of the pathological slice image, reduce the amount of transmitted data, and thereby speed up the display of the pathological slice image.

Claims

A display method of pathological slice images, including:

Receiving a display request sent by the client, where the display request carries the number of layers of the pathological slice image requested to be displayed and the coordinate information of the image area requested to be displayed;

Determine, according to the number of layers and the coordinate information, an image block in the pathological slice image that includes the image area requested to be displayed, wherein the pathological slice image includes at least one image block;

Return the image block to the client.
The method according to claim 1, wherein, before the receiving the display request sent by the client, the method further comprises:

For pathological slice images belonging to any number of layers, dividing the pathological slice image into multiple image blocks according to a preset image block size;

Determining the number of rows and the number of columns of any image block of the plurality of image blocks in the array formed by the plurality of image blocks;

A correspondence relationship between the number of layers, the number of rows and the number of columns of any image block in the array formed by the plurality of image blocks, and the any image block is established.
The method according to claim 2, wherein said establishing the number of layers, the number of rows and the number of columns of any one of the image blocks in the array formed by the plurality of image blocks are the same as those of the any The correspondence between an image block includes:

Name any image block according to the number of layers, the number of rows and the number of columns of any image block in the array formed by the plurality of image blocks.
The method according to claim 2 or 3, wherein the coordinate information includes the coordinates of four vertices of the image area requested to be displayed;

The determining, according to the number of layers and the coordinate information, the image block in the pathological slice image that contains the image area requested to be displayed includes:

Determining the number of rows and columns of the image block according to the ratio of the coordinates of the four vertices to the preset size of the image block;

According to the number of layers, the number of rows and columns of the image block, and the corresponding relationship, the image block is determined.
A display method of pathological slice images, including:

Sending a display request to the server, where the display request carries the number of layers of the pathological slice image requested to be displayed and the coordinate information of the image area requested to be displayed;

Receiving an image block returned by the server based on the display request, where the image block is an image block in the pathological slice image that includes the image area requested to be displayed;

Display the part of the image block that belongs to the range of the image area requested to be displayed.
A display device for pathological slice images, including:

The first receiving module is configured to receive a display request sent by the client, where the display request carries the number of layers of the pathological slice image requested to be displayed and the coordinate information of the image area requested to be displayed;

The first determining module is configured to determine, according to the number of layers and the coordinate information, an image block in the pathological slice image that includes the image area requested to be displayed, wherein the pathological slice image includes at least one image block;

The return module is configured to return the image block to the client.
The device according to claim 6, wherein the device further comprises:

The dividing module is configured to divide the pathological slice image into a plurality of image blocks according to a preset image block size for a pathological slice image belonging to any number of layers;

The second determining module is configured to determine the number of rows and the number of columns of any image block of the plurality of image blocks in the array formed by the plurality of image blocks;

The establishment module is configured to establish the corresponding relationship between the number of layers, the number of rows and the number of columns of any image block in the array formed by the plurality of image blocks, and the any image block .
The device according to claim 7, wherein the establishing module is further configured to:

Name any image block according to the number of layers, the number of rows and the number of columns of any image block in the array formed by the plurality of image blocks.
The device according to claim 7 or 8, wherein the coordinate information includes the coordinates of four vertices of the image area requested to be displayed;

The first determining module is also configured to:

Determining the number of rows and columns of the image block according to the ratio of the coordinates of the four vertices to the preset size of the image block;

According to the number of layers, the number of rows and columns of the image block, and the corresponding relationship, the image block is determined.
A display device for pathological slice images, including:

A sending module configured to send a display request to the server, where the display request carries the number of layers of the pathological slice image requested to be displayed and the coordinate information of the image area requested to be displayed;

The second receiving module is configured to receive an image block returned by the server based on the display request, where the image block is an image block in the pathological slice image that includes the image area requested to be displayed;

The display module is configured to display the part of the image block that belongs to the range of the image area requested to be displayed.
An electronic device including:

One or more processors;

A memory configured to store executable instructions;

Wherein, the one or more processors are configured to call the executable instructions stored in the memory to execute the method according to any one of claims 1 to 4 or claim 5.
A computer-readable storage medium having computer program instructions stored on the computer-readable storage medium. method.
A computer program comprising computer readable code. When the computer readable code runs in an electronic device, a processor in the electronic device executes claims 1 to 4 or executes any one of claims 1 to 4 Methods.