US20180211356A1 - Image Display System - Google Patents
Image Display System Download PDFInfo
- Publication number
- US20180211356A1 US20180211356A1 US15/878,104 US201815878104A US2018211356A1 US 20180211356 A1 US20180211356 A1 US 20180211356A1 US 201815878104 A US201815878104 A US 201815878104A US 2018211356 A1 US2018211356 A1 US 2018211356A1
- Authority
- US
- United States
- Prior art keywords
- server
- image data
- hardware processor
- pieces
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T1/00—General purpose image data processing
- G06T1/20—Processor architectures; Processor configuration, e.g. pipelining
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2200/00—Indexing scheme for image data processing or generation, in general
- G06T2200/28—Indexing scheme for image data processing or generation, in general involving image processing hardware
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2210/00—Indexing scheme for image generation or computer graphics
- G06T2210/41—Medical
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/02—Handling of images in compressed format, e.g. JPEG, MPEG
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2360/00—Aspects of the architecture of display systems
- G09G2360/10—Display system comprising arrangements, such as a coprocessor, specific for motion video images
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2370/00—Aspects of data communication
- G09G2370/02—Networking aspects
- G09G2370/022—Centralised management of display operation, e.g. in a server instead of locally
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2370/00—Aspects of data communication
- G09G2370/02—Networking aspects
- G09G2370/025—LAN communication management
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2380/00—Specific applications
- G09G2380/08—Biomedical applications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
- G09G3/2092—Details of a display terminals using a flat panel, the details relating to the control arrangement of the display terminal and to the interfaces thereto
- G09G3/2096—Details of the interface to the display terminal specific for a flat panel
Definitions
- the present invention relates to an image display system which includes a server that stores image data and a client terminal that is connected to the server and displays an image based on the image data.
- an image display system which includes a server that is connected to an imaging apparatus such as a CR (Computed Radiography), a CT (Computed Tomography) and an MRI (Magnetic Resonance Imaging), and stores and manages image data of medical images obtained by imaging using these apparatuses, and a client terminal that is connected to the server via a network and is capable of displaying the medical images based on the image data as needed.
- an imaging apparatus such as a CR (Computed Radiography), a CT (Computed Tomography) and an MRI (Magnetic Resonance Imaging)
- a client terminal that is connected to the server via a network and is capable of displaying the medical images based on the image data as needed.
- the client terminal is required to have an appropriate processing capacity.
- an expensive device such as a PC needs to be used for the client terminal and the introduction cost of the system is high.
- the present invention has been made in consideration of the above problems, and an object of the present invention is to enable introduction of an image display system at a low cost and achieve easy maintenance and management of the image display system after the introduction, the image display system executing rendering so as to switch the rendering between rendering by a server and rendering by a client terminal.
- FIG. 1 is a schematic configuration view of an image display system in an embodiment of the present invention
- FIG. 2 is a block diagram showing a functional configuration example of a server included in the image display system of FIG. 1 ;
- FIG. 3 is a block diagram showing a functional configuration example of a client terminal included in the image display system of FIG. 1 ;
- FIG. 4 is a ladder chart showing image display processing in the embodiment.
- FIG. 1 is a schematic configuration view of the image display system 1 in the embodiment.
- the image display system 1 in the embodiment is configured by including a server 2 and a client terminal 3 .
- the server 2 is included in a medical image management system (Picture Archiving and Communication System: PACS).
- the server 2 is connected to a modality not shown in the drawings (for example, a CR (Computed Radiography), a CT (Computed Tomography), an MRI (Magnetic Resonance Imaging) or the like), and can receive, from the modality, image data of a medical image which was obtained by imaging of a patient with the modality.
- the server 2 can store the received image data and manage the image data for each patient.
- the client terminal 3 is for displaying the medical image, and used by a user such as a doctor, a nurse and a home care worker at a facility such as a hospital, a clinic, a home care facility and a home of a patient under home care.
- the client terminal 3 is connected to the server 2 via a communication network N, and the client terminal 3 and the server 2 can communicate with each other.
- FIG. 1 shows the image display system 1 in which only a single client terminal 3 is connected, a plurality of client terminals 3 may be connected in the image display system 1 .
- the details of the client terminal 3 will be described later.
- FIG. 2 is a block diagram showing an example of the functional configuration of the server 2 .
- the server 2 is configured by including a control section 21 , a communication section 22 , a RAM 23 , a storage section 24 and such like, and the sections 21 to 24 are connected to each other via a bus 25 .
- the server 2 may be a cloud server provided in a cloud environment.
- the sever 2 may be provided with a display section and an operation section not shown in the drawings so as to configure an image management apparatus which can perform display of medical images and various types of image processing around the server 2 .
- the control section 21 is configured by including a CPU (Central Processing Unit) and such like, and integrally controls the processing operations of the sections in the server 2 . Specifically, according to various signals (for example, a transmission request signal of an image or data and such like) from the client terminal 3 which are received by the communication section 22 , the CPU reads out various processing programs stored in the storage section 24 and loads the programs into the RAM 23 , and performs various types of processing in cooperation with the programs.
- various signals for example, a transmission request signal of an image or data and such like
- the communication section 22 is configured by including a network interface or the like, and performs data transmission/reception with external equipment which is connected via a communication network N such as LAN (Local Area Network), WAN (Wide Area Network) and the internet.
- a communication network N such as LAN (Local Area Network), WAN (Wide Area Network) and the internet.
- the RAM 23 forms a working area for temporarily storing various programs which were read from the storage section 24 , input or output data, parameters and such like in various types of processing which are executed and controlled by the control section 21 .
- the storage section 24 is configured by including an HDD (Hard Disk Drive), a semiconductor nonvolatile memory and such like, and stores various processing programs and parameters, files and such like which are necessary for executing the programs. Specifically, the storage section 24 stores a webserver program for executing a function as a webserver which provides various web screens to a web browser, a web application program for operating on the webserver and providing a medical image to a user of the client terminal 3 via the web browser, and such like.
- HDD Hard Disk Drive
- the storage section 24 stores a webserver program for executing a function as a webserver which provides various web screens to a web browser, a web application program for operating on the webserver and providing a medical image to a user of the client terminal 3 via the web browser, and such like.
- the storage section 24 has a database for managing raw data (image data) of a medical image which was transmitted from the modality not shown in the drawings.
- Predetermined accompanying information such as a patient name, an examination type and date is attached to the raw data to enable identification of each raw data, for example.
- the raw data which is treated by the image display system 1 in the embodiment includes raw data that is formed of a single piece of image data for a single image and raw data that is formed of a plurality of pieces of image data for a dynamic image (a plurality of images which are seen as a series of moving image by being displayed continuously).
- the server 2 configured in such a way operates as in the following manner by software processing in cooperation between the control section 21 and a program stored in the storage section 24 .
- control section 21 has a function of rendering raw data of a medical image which is stored in the storage section 24 to generate an initial display image and transmitting the generated initial display image to the client terminal 3 .
- the initial display image means an image which was obtained by converting the raw data obtained by photography with the modality into a format with a small data amount in order to enable rapid transmission and view.
- the control section 21 also has a function of compressing the raw data of the medical image on the basis of an image transmission condition which was received from the client terminal 3 and transmitting the raw data which is compressed or not processed to the client terminal 3 in a background process.
- a preferable compression format of data is lossless compression such as ZIP and JPEG 2000 in which the original data completely matches the data after the compression/decompression.
- the transmission of raw data and the rendering of raw data are executed in parallel with each other from a viewpoint of shortening the time until the image is displayed on the client terminal 3 .
- the execution periods of respective processing are not especially defined, and at least parts of the execution periods may overlap each other or the transmission of raw data may be executed after the rendering of raw data was executed.
- the execution periods are not especially defined as long as at least parts of the execution periods overlap each other.
- transmission of the first piece of data may be executed when rendering is performed for the pieces of data following the first piece of data.
- FIG. 3 is a block diagram showing an example of the functional configuration of the client terminal 3 .
- the client terminal 3 is configured by including a control section 31 , a display section 32 , an operation section 33 , a communication section 34 , a RAM 35 and such like, and the sections 31 to 35 are connected to each other via a bus 36 .
- a zero client terminal is used as the client terminal 3 .
- the zero client indicates a client which uses a terminal that does not include an OS or a local storage and does not leave any data (trace) on the client terminal in an application which is delivered from a server to a client.
- an application which is achieved on a browser by HTML5+JavaScript (registered trademark).
- a mobile terminal which can be carried is used as the client terminal 3 .
- the control section 31 is configured by including a CPU for the zero client and such like, and integrally controls the processing operations of the sections in the client terminal 3 . Specifically, according to operation signals which were input from the operation section 33 , the control section 31 reads out and executes web application programs which are stored in the storage section 24 of the server 2 , and thereby transmits various display signals to the display section 32 .
- the display section 32 is configured by including a monitor such as an LCD, and displays various screens in accordance with instructions of display signals which were input from the control section 31 .
- the display section 32 displays, for example, a list of raw data of medical images stored in the server 2 and a medical image based on the selected raw data (initial display image, client display image) on the basis of display data of various web screens received from the server 2 .
- the operation section 33 is configured by including a keyboard which includes various keys and a pointing device such as a mouse or a touch panel which is layered on the display section 32 .
- the operation section 33 outputs an operation signal which was input according to a key operation to the keyboard, a mouse operation or the position of a touch operation to the touch panel to the control section 31 .
- the communication section 34 is configured by including a network interface or the like, and performs data transmission/reception with external equipment which is connected via a communication network N such as LAN, WAN and the internet.
- the communication section 34 may perform wireless communication by using a mobile phone line or the like to perform data transmission/reception with external equipment which is connected via a communication network N.
- the client terminal 3 which is configured in such a way performs the following operation by the processing in the control section 31 .
- control section 31 of the client terminal 3 has a function of displaying the initial display image which was received from the server 2 on the display section 32 .
- the control section 31 has a function of pooling the received raw data in a memory of a browser.
- the client terminal 3 has a function of generating a client display image by rendering the pooled raw data and displaying the generated client display image on the display section 32 .
- FIG. 4 is a ladder chart showing image display processing which is executed in the image display system 1 when a medical image is displayed on the client terminal 3 .
- the client terminal 3 transmits, to the server 2 , a transmission request signal of an initial display image corresponding to the input instruction (step S 1 ).
- the “instruction to display a medical image” specifically means that the user specifies a desired patient name and/or examination type from a list screen which is displayed on the display section 32 and displays a list of patient names, examination types and such like.
- one raw data is specified from among the plurality of raw data which is stored in the storage section 24 in the server 2 .
- the server 2 When the server 2 receives the transmission request signal of the initial display image from the client terminal 3 , the server 2 reads out the corresponding raw data from the storage section 24 , performs rendering of the raw data and generates an initial display image (step S 2 ).
- the server 2 transmits the initial display image to the client terminal 3 (step S 3 ).
- the client terminal 3 When the client terminal 3 receives the initial display image from the server 2 , the client terminal 3 displays the received image on the display section 32 (step S 4 ). As described above, since the initial display image has the data amount smaller than the data amount of the original raw data and can be transmitted faster than the raw data, initial display on the client terminal 3 can be performed rapidly.
- the client terminal 3 When the client terminal 3 displays the initial display image, the client terminal 3 transmits a transmission request signal of raw data to the server 2 (step S 7 ).
- the client terminal 3 confirms its own browser environment during a period from the processing of step S 1 to the processing of step S 4 (step S 5 ), and determines a transmission condition of the raw data and a pooling condition in the client terminal 3 on the basis of the confirmed contents (step S 6 ).
- the capacity of a memory which is usable on a browser the processing speed of the CPU of the control section 31 , the communication speed of the network N and such like are confirmed as the browser environment, for example.
- the transmission condition is, for example, whether to compress the raw data, the compression format in a case of performing the compression, the transmission speed from the server 2 to the client terminal 3 , and such like.
- the image processing capacity of the client terminal 3 is determined to be relatively high, it is determined to perform compression of the raw data. In a case where the image processing capacity of the client terminal 3 is low but the communication speed of the communication network N is high, it is determined to transmit the raw data without performing compression. In such a way, since the raw data is transmitted in consideration of the browser environment, the zero client can be adopted.
- the determined transmission condition may be transmitted to the server 2 as soon as the transmission condition is determined, or may be transmitted together with the transmission request of the raw data.
- steps S 5 and S 6 are performed on the client terminal 3 , these processing may be performed by the server 2 .
- the server 2 When the server 2 receives the transmission request signal of the raw data, the server 2 confirms the transmission condition and the pooling condition which were received from the client terminal 3 , and performs compression of the raw data as needed (step S 8 ).
- the raw data is transmitted to the client terminal 3 in a background process (step S 9 ).
- the raw data is transmitted in parallel with the initial display on the client terminal 3 .
- the server 2 For the raw data in the middle of transmission (transmission is not completed), the server 2 performs rendering.
- the client terminal 3 While the raw data is received, the client terminal 3 performs display notifying the user of the degree of progress of the data reception or the completion of the data reception as in a progress bar on the display section 32 , for example.
- the client terminal 3 sequentially decompresses the raw data in a case where the raw data transmitted from the server 2 is compressed, and the client terminal 3 pools the data in the memory (step S 10 ).
- the client terminal 3 performs rendering of the raw data and generates the client display image (step S 11 ).
- the rendering which has been performed by the server 2 is stopped. By doing this, the load on the server 2 can be reduced.
- the generated client display image is displayed on the display section 32 .
- the client terminal 3 can perform image processing such as enlargement, reduction and processing regarding gradation, for example, without sending back the data to the server 2 each time.
- the zero client is used for the client terminal 3 . Since the zero client does not include a CPU and a local storage nor mounts OS, the zero client can be introduced at a low cost. In addition, the high security can be maintained and the maintenance can also be made easily.
- the initial display image for which rendering was performed on the server 2 is first displayed rapidly, and thereafter, there is displayed the client display image obtained by rendering the raw data on the client terminal 3 .
- the client display image obtained by rendering the raw data on the client terminal 3 .
- the zero client is limited in the memory which can be used.
- the server 2 or the client terminal 3 confirms the browser environment of the client terminal 3 , and the server 2 determines the transmission condition of image data to the client terminal 3 and the pooling condition of image data in the client terminal 3 on the basis of the confirmation result.
- raw data can be transmitted even to the client terminal 3 having a limitation.
- rendering of raw data is executed by being automatically switched from the server 2 to the client terminal 3 on the basis of end of transmission of the raw data from the server 2 to the client terminal 3 , whereas, in the image display system 1 in the embodiment, the switching is performed manually.
- the server 2 and the client terminal 3 in the embodiment are different from those in the first embodiment in a part of the functions.
- the client terminal 3 in the embodiment can select which of the server 2 and the client terminal 3 performs the rendering of raw data after the completion of the reception of the raw data on the basis of the operation to the operation section 33 , and can transmit the selection result to the server 2 .
- the timing to perform the selection is arbitrary.
- the client terminal 3 executes rendering of the received raw data only when the rendering by the client terminal is selected.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- General Engineering & Computer Science (AREA)
- Controls And Circuits For Display Device (AREA)
- Apparatus For Radiation Diagnosis (AREA)
- Digital Computer Display Output (AREA)
- Information Transfer Between Computers (AREA)
- Computer Hardware Design (AREA)
Abstract
An image display system, including: a server and a client terminal, wherein the server includes a server-side hardware processor which performs rendering to generate an initial display image, transmits the initial display image and the image data to the client terminal, at least when rendering is performed to a plurality of pieces of image data, the server executes rendering and transmission of image data so that at least parts of execution periods overlap, the server-side hardware processor executes rendering until end of the transmission, the client terminal is a zero client terminal and includes a client-side hardware processor which displays the received initial display image, and performs rendering of the received image data to generate and display a client display image, and the client terminal executes rendering by switching from the server-side hardware processor to the client-side hardware processor based on end of the transmission.
Description
- The present invention relates to an image display system which includes a server that stores image data and a client terminal that is connected to the server and displays an image based on the image data.
- There has been conventionally known an image display system which includes a server that is connected to an imaging apparatus such as a CR (Computed Radiography), a CT (Computed Tomography) and an MRI (Magnetic Resonance Imaging), and stores and manages image data of medical images obtained by imaging using these apparatuses, and a client terminal that is connected to the server via a network and is capable of displaying the medical images based on the image data as needed.
- In order to view the medical images based on the medical image data which is stored in the server on the client terminal, rendering needs to be performed by the server or the client terminal. Formerly, the rendering has been performed by any of the server and the client terminal. However, in recent years, there has been proposed an image display system which executes rendering by switching between the rendering by the server and the rendering by the client terminal as needed (see Japanese Patent Application Laid-Open Publication No. 2015-534160).
- However, in the above-mentioned image display system which executes rendering by switching between the rendering by the server and the rendering by the client terminal as needed, the client terminal is required to have an appropriate processing capacity. Thus, there has been a problem that an expensive device such as a PC needs to be used for the client terminal and the introduction cost of the system is high.
- There has been also a problem that security measures and various types of maintenance are continuously required for individual client terminals as well as the server and thus the maintenance and the management are troublesome.
- The present invention has been made in consideration of the above problems, and an object of the present invention is to enable introduction of an image display system at a low cost and achieve easy maintenance and management of the image display system after the introduction, the image display system executing rendering so as to switch the rendering between rendering by a server and rendering by a client terminal.
- To achieve at least one of the abovementioned objects, according to an aspect of the present invention, an image display system reflecting one aspect of the present invention includes a server which stores a single or a plurality of pieces of image data; and a client terminal which is connected to the server via a network and has a display that displays an image based on the single or the plurality of pieces of image data, wherein the server includes a server-side hardware processor which performs rendering of the image data to generate a single or a plurality of initial display images, transmits the single or the plurality of initial display images to the client terminal and transmits the single or the plurality of pieces of image data to the client terminal, at least when the rendering is performed to the plurality of pieces of image data to generate the plurality of initial display images, the server executes the rendering of the plurality of pieces of image data and transmission of the plurality of pieces of image data so that at least parts of execution periods of the rendering and the transmission overlap each other, the server-side hardware processor executes the rendering of the single or the plurality of pieces of image data during a period until the server-side hardware processor finishes the transmission of the image data, the client terminal is a zero client terminal, the client terminal includes a client-side hardware processor which displays the initial display image or the initial display images received from the server on the display, and performs the rendering of the single or the plurality of pieces of image data received from the server to generate a client display image and displays the generated client display image on the display, and the client terminal executes the rendering of the single or the plurality of pieces of image data by switching the rendering from the server-side hardware processor to the client-side hardware processor based on end of the transmission of the single or the plurality of pieces of image data by the server-side hardware processor.
- The advantages and features provided by one or more embodiments of the invention will become more fully understood from the detailed description given hereinafter and the appended drawings which are given by way of illustration only, and thus are not intended as a definition of the limits of the present invention, and wherein:
-
FIG. 1 is a schematic configuration view of an image display system in an embodiment of the present invention; -
FIG. 2 is a block diagram showing a functional configuration example of a server included in the image display system ofFIG. 1 ; -
FIG. 3 is a block diagram showing a functional configuration example of a client terminal included in the image display system ofFIG. 1 ; and -
FIG. 4 is a ladder chart showing image display processing in the embodiment. - Hereinafter, a first embodiment of the present invention will be described in detail with reference to the drawings. However, the scope of the invention is not limited to the disclosed embodiments or illustrated examples.
- First, the configuration of an
image display system 1 in an embodiment will be described. -
FIG. 1 is a schematic configuration view of theimage display system 1 in the embodiment. - As shown in
FIG. 1 , theimage display system 1 in the embodiment is configured by including aserver 2 and aclient terminal 3. - The
server 2 is included in a medical image management system (Picture Archiving and Communication System: PACS). Theserver 2 is connected to a modality not shown in the drawings (for example, a CR (Computed Radiography), a CT (Computed Tomography), an MRI (Magnetic Resonance Imaging) or the like), and can receive, from the modality, image data of a medical image which was obtained by imaging of a patient with the modality. Theserver 2 can store the received image data and manage the image data for each patient. - The details of the
server 2 will be described later. - The
client terminal 3 is for displaying the medical image, and used by a user such as a doctor, a nurse and a home care worker at a facility such as a hospital, a clinic, a home care facility and a home of a patient under home care. Theclient terminal 3 is connected to theserver 2 via a communication network N, and theclient terminal 3 and theserver 2 can communicate with each other. ThoughFIG. 1 shows theimage display system 1 in which only asingle client terminal 3 is connected, a plurality ofclient terminals 3 may be connected in theimage display system 1. - The details of the
client terminal 3 will be described later. - Next, the details of the
server 2 will be described. -
FIG. 2 is a block diagram showing an example of the functional configuration of theserver 2. - As shown in
FIG. 2 , theserver 2 is configured by including acontrol section 21, acommunication section 22, aRAM 23, astorage section 24 and such like, and thesections 21 to 24 are connected to each other via abus 25. - The
server 2 may be a cloud server provided in a cloud environment. - The
sever 2 may be provided with a display section and an operation section not shown in the drawings so as to configure an image management apparatus which can perform display of medical images and various types of image processing around theserver 2. - The
control section 21 is configured by including a CPU (Central Processing Unit) and such like, and integrally controls the processing operations of the sections in theserver 2. Specifically, according to various signals (for example, a transmission request signal of an image or data and such like) from theclient terminal 3 which are received by thecommunication section 22, the CPU reads out various processing programs stored in thestorage section 24 and loads the programs into theRAM 23, and performs various types of processing in cooperation with the programs. - The
communication section 22 is configured by including a network interface or the like, and performs data transmission/reception with external equipment which is connected via a communication network N such as LAN (Local Area Network), WAN (Wide Area Network) and the internet. - The
RAM 23 forms a working area for temporarily storing various programs which were read from thestorage section 24, input or output data, parameters and such like in various types of processing which are executed and controlled by thecontrol section 21. - The
storage section 24 is configured by including an HDD (Hard Disk Drive), a semiconductor nonvolatile memory and such like, and stores various processing programs and parameters, files and such like which are necessary for executing the programs. Specifically, thestorage section 24 stores a webserver program for executing a function as a webserver which provides various web screens to a web browser, a web application program for operating on the webserver and providing a medical image to a user of theclient terminal 3 via the web browser, and such like. - The
storage section 24 has a database for managing raw data (image data) of a medical image which was transmitted from the modality not shown in the drawings. Predetermined accompanying information such as a patient name, an examination type and date is attached to the raw data to enable identification of each raw data, for example. - The raw data which is treated by the
image display system 1 in the embodiment includes raw data that is formed of a single piece of image data for a single image and raw data that is formed of a plurality of pieces of image data for a dynamic image (a plurality of images which are seen as a series of moving image by being displayed continuously). - The
server 2 configured in such a way operates as in the following manner by software processing in cooperation between thecontrol section 21 and a program stored in thestorage section 24. - For example, the
control section 21 has a function of rendering raw data of a medical image which is stored in thestorage section 24 to generate an initial display image and transmitting the generated initial display image to theclient terminal 3. The initial display image means an image which was obtained by converting the raw data obtained by photography with the modality into a format with a small data amount in order to enable rapid transmission and view. - The
control section 21 also has a function of compressing the raw data of the medical image on the basis of an image transmission condition which was received from theclient terminal 3 and transmitting the raw data which is compressed or not processed to theclient terminal 3 in a background process. A preferable compression format of data is lossless compression such as ZIP and JPEG 2000 in which the original data completely matches the data after the compression/decompression. - It is preferable that the transmission of raw data and the rendering of raw data are executed in parallel with each other from a viewpoint of shortening the time until the image is displayed on the
client terminal 3. However, in a case where the raw data is formed of a single piece of data, the execution periods of respective processing are not especially defined, and at least parts of the execution periods may overlap each other or the transmission of raw data may be executed after the rendering of raw data was executed. - On the other hand, in a case where the raw data is formed of a plurality of pieces of data, the execution periods are not especially defined as long as at least parts of the execution periods overlap each other. For example, after rendering was executed for the first piece of data among the plurality of pieces of data included in the raw data, transmission of the first piece of data may be executed when rendering is performed for the pieces of data following the first piece of data.
- Next, the details of the
client terminal 3 will be described. -
FIG. 3 is a block diagram showing an example of the functional configuration of theclient terminal 3. - As shown in
FIG. 3 , theclient terminal 3 is configured by including acontrol section 31, adisplay section 32, anoperation section 33, acommunication section 34, aRAM 35 and such like, and thesections 31 to 35 are connected to each other via abus 36. - In the embodiment, a zero client terminal is used as the
client terminal 3. The zero client indicates a client which uses a terminal that does not include an OS or a local storage and does not leave any data (trace) on the client terminal in an application which is delivered from a server to a client. As a general means for achieving the zero client, there is an application which is achieved on a browser by HTML5+JavaScript (registered trademark). - It is preferable that a mobile terminal which can be carried is used as the
client terminal 3. - The
control section 31 is configured by including a CPU for the zero client and such like, and integrally controls the processing operations of the sections in theclient terminal 3. Specifically, according to operation signals which were input from theoperation section 33, thecontrol section 31 reads out and executes web application programs which are stored in thestorage section 24 of theserver 2, and thereby transmits various display signals to thedisplay section 32. - The
display section 32 is configured by including a monitor such as an LCD, and displays various screens in accordance with instructions of display signals which were input from thecontrol section 31. Thedisplay section 32 displays, for example, a list of raw data of medical images stored in theserver 2 and a medical image based on the selected raw data (initial display image, client display image) on the basis of display data of various web screens received from theserver 2. - The
operation section 33 is configured by including a keyboard which includes various keys and a pointing device such as a mouse or a touch panel which is layered on thedisplay section 32. Theoperation section 33 outputs an operation signal which was input according to a key operation to the keyboard, a mouse operation or the position of a touch operation to the touch panel to thecontrol section 31. - The
communication section 34 is configured by including a network interface or the like, and performs data transmission/reception with external equipment which is connected via a communication network N such as LAN, WAN and the internet. Thecommunication section 34 may perform wireless communication by using a mobile phone line or the like to perform data transmission/reception with external equipment which is connected via a communication network N. - The
client terminal 3 which is configured in such a way performs the following operation by the processing in thecontrol section 31. - For example, the
control section 31 of theclient terminal 3 has a function of displaying the initial display image which was received from theserver 2 on thedisplay section 32. - The
control section 31 has a function of pooling the received raw data in a memory of a browser. - The
client terminal 3 has a function of generating a client display image by rendering the pooled raw data and displaying the generated client display image on thedisplay section 32. - Next, the operation of the
image display system 1 will be described. -
FIG. 4 is a ladder chart showing image display processing which is executed in theimage display system 1 when a medical image is displayed on theclient terminal 3. - First, when the user inputs an instruction to display a predetermined medical image on the
display section 32 via theoperation section 33 of theclient terminal 3, theclient terminal 3 transmits, to theserver 2, a transmission request signal of an initial display image corresponding to the input instruction (step S1). - The “instruction to display a medical image” specifically means that the user specifies a desired patient name and/or examination type from a list screen which is displayed on the
display section 32 and displays a list of patient names, examination types and such like. Thus, one raw data is specified from among the plurality of raw data which is stored in thestorage section 24 in theserver 2. - When the
server 2 receives the transmission request signal of the initial display image from theclient terminal 3, theserver 2 reads out the corresponding raw data from thestorage section 24, performs rendering of the raw data and generates an initial display image (step S2). - When the rendering is finished, the
server 2 transmits the initial display image to the client terminal 3 (step S3). - When the
client terminal 3 receives the initial display image from theserver 2, theclient terminal 3 displays the received image on the display section 32 (step S4). As described above, since the initial display image has the data amount smaller than the data amount of the original raw data and can be transmitted faster than the raw data, initial display on theclient terminal 3 can be performed rapidly. - When the
client terminal 3 displays the initial display image, theclient terminal 3 transmits a transmission request signal of raw data to the server 2 (step S7). - The
client terminal 3 confirms its own browser environment during a period from the processing of step S1 to the processing of step S4 (step S5), and determines a transmission condition of the raw data and a pooling condition in theclient terminal 3 on the basis of the confirmed contents (step S6). - Specifically, the capacity of a memory which is usable on a browser, the processing speed of the CPU of the
control section 31, the communication speed of the network N and such like are confirmed as the browser environment, for example. - The transmission condition is, for example, whether to compress the raw data, the compression format in a case of performing the compression, the transmission speed from the
server 2 to theclient terminal 3, and such like. - For example, in a case where the image processing capacity of the
client terminal 3 is determined to be relatively high, it is determined to perform compression of the raw data. In a case where the image processing capacity of theclient terminal 3 is low but the communication speed of the communication network N is high, it is determined to transmit the raw data without performing compression. In such a way, since the raw data is transmitted in consideration of the browser environment, the zero client can be adopted. - The determined transmission condition may be transmitted to the
server 2 as soon as the transmission condition is determined, or may be transmitted together with the transmission request of the raw data. - Here, though the processing in steps S5 and S6 are performed on the
client terminal 3, these processing may be performed by theserver 2. - When the
server 2 receives the transmission request signal of the raw data, theserver 2 confirms the transmission condition and the pooling condition which were received from theclient terminal 3, and performs compression of the raw data as needed (step S8). The raw data is transmitted to theclient terminal 3 in a background process (step S9). Thus, the raw data is transmitted in parallel with the initial display on theclient terminal 3. Thus, it is possible to shorten the time from the initial display to the completion of transmission of the raw data. - For the raw data in the middle of transmission (transmission is not completed), the
server 2 performs rendering. - While the raw data is received, the
client terminal 3 performs display notifying the user of the degree of progress of the data reception or the completion of the data reception as in a progress bar on thedisplay section 32, for example. - The
client terminal 3 sequentially decompresses the raw data in a case where the raw data transmitted from theserver 2 is compressed, and theclient terminal 3 pools the data in the memory (step S10). When the reception and decompression of the raw data are completed, theclient terminal 3 performs rendering of the raw data and generates the client display image (step S11). At this time, the rendering which has been performed by theserver 2 is stopped. By doing this, the load on theserver 2 can be reduced. - When the rendering of the raw data is finished, the generated client display image is displayed on the
display section 32. After end of transmission of the raw data which is the original of the client display image to theclient terminal 3, theclient terminal 3 can perform image processing such as enlargement, reduction and processing regarding gradation, for example, without sending back the data to theserver 2 each time. - As described above, in the
image display system 1 in the embodiment, the zero client is used for theclient terminal 3. Since the zero client does not include a CPU and a local storage nor mounts OS, the zero client can be introduced at a low cost. In addition, the high security can be maintained and the maintenance can also be made easily. - In the
image display system 1, the initial display image for which rendering was performed on theserver 2 is first displayed rapidly, and thereafter, there is displayed the client display image obtained by rendering the raw data on theclient terminal 3. Thus, it is possible to prevent the situation that the image cannot be viewed for a long time after the instruction of display of the image on theclient terminal 3. - Compared with a case of using a PC or the like as the client terminal, in some cases, the zero client is limited in the memory which can be used. However, in the
image display system 1, theserver 2 or theclient terminal 3 confirms the browser environment of theclient terminal 3, and theserver 2 determines the transmission condition of image data to theclient terminal 3 and the pooling condition of image data in theclient terminal 3 on the basis of the confirmation result. Thus, raw data can be transmitted even to theclient terminal 3 having a limitation. - Next, a second embodiment of the present invention will be described. Explanation is omitted for the same configurations and operations as those in the first embodiment.
- In the
image display system 1 in the first embodiment, rendering of raw data is executed by being automatically switched from theserver 2 to theclient terminal 3 on the basis of end of transmission of the raw data from theserver 2 to theclient terminal 3, whereas, in theimage display system 1 in the embodiment, the switching is performed manually. Thus, theserver 2 and theclient terminal 3 in the embodiment are different from those in the first embodiment in a part of the functions. - Specifically, the
client terminal 3 in the embodiment can select which of theserver 2 and theclient terminal 3 performs the rendering of raw data after the completion of the reception of the raw data on the basis of the operation to theoperation section 33, and can transmit the selection result to theserver 2. The timing to perform the selection is arbitrary. - Thus, the
client terminal 3 executes rendering of the received raw data only when the rendering by the client terminal is selected. - On the other hand, when the selection result received from the
client terminal 3 is rendering by theserver 2, rendering on theserver 2 is continuously executed, and when the selection result is rendering by theclient terminal 3, theserver 2 ends the rendering which has been performed. - Although embodiments of the present invention have been described and illustrated in detail, the disclosed embodiments are made for purposes of illustration and example only and not limitation. The scope of the present invention should be interpreted by terms of the appended claims.
- The entire disclosure of Japanese Patent Application No. 2017-9407 filed on Jan. 23, 2017 is incorporated herein by reference in its entirety.
Claims (7)
1. An image display system, comprising:
a server which stores a single or a plurality of pieces of image data; and
a client terminal which is connected to the server via a network and has a display that displays an image based on the single or the plurality of pieces of image data, wherein
the server includes a server-side hardware processor which performs rendering of the image data to generate a single or a plurality of initial display images, transmits the single or the plurality of initial display images to the client terminal and transmits the single or the plurality of pieces of image data to the client terminal,
at least when the rendering is performed to the plurality of pieces of image data to generate the plurality of initial display images, the server executes the rendering of the plurality of pieces of image data and transmission of the plurality of pieces of image data so that at least parts of execution periods of the rendering and the transmission overlap each other,
the server-side hardware processor executes the rendering of the single or the plurality of pieces of image data during a period until the server-side hardware processor finishes the transmission of the image data,
the client terminal is a zero client terminal,
the client terminal includes a client-side hardware processor which displays the initial display image or the initial display images received from the server on the display, and performs the rendering of the single or the plurality of pieces of image data received from the server to generate a client display image and displays the generated client display image on the display, and
the client terminal executes the rendering of the single or the plurality of pieces of image data by switching the rendering from the server-side hardware processor to the client-side hardware processor based on end of the transmission of the single or the plurality of pieces of image data by the server-side hardware processor.
2. The image display system according to claim 1 , wherein the client terminal receives the single or the plurality of pieces of image data in a background process.
3. The image display system according to claim 1 , wherein the client terminal automatically switches the rendering of the single or the plurality of pieces of image data from the server-side hardware processor to the client-side hardware processor based on the end of the transmission of the single or the plurality of pieces of image data by the server-side hardware processor.
4. The image display system according to claim 1 , wherein the client-side hardware processor selects switching between the client-side hardware processor and the server-side hardware processor according to user's operation based on the end of the transmission of the single or the plurality of pieces of image data by the server-side hardware processor.
5. The image display system according to claim 1 , wherein
the client-side hardware processor confirms a browser environment of the client terminal, determines a transmission condition of the single or the plurality of pieces of image data from the server to the client terminal based on a confirmation result and transmits a determination result to the server, and
the server-side hardware processor transmits the single or the plurality of pieces of image data in a manner corresponding to the determination result which is received from the client-side hardware processor.
6. The image display system according to claim 1 , wherein
the server-side hardware processor compresses the single or the plurality of pieces of image data before the transmission of the single or the plurality of pieces of image data according to a determination result which is received from the client-side hardware processor, and
the client-side hardware processor decompresses the compressed single or the plurality of pieces of image data when the image data is received.
7. The image display system according to claim 1 , wherein the client-side hardware processor notifies a reception state of the single or the plurality of pieces of image data from the server.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/506,757 US11282159B2 (en) | 2017-01-23 | 2019-07-09 | Image display system that executes rendering by switching the rendering between rendering by a server and rendering by a client terminal |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2017009407A JP6809249B2 (en) | 2017-01-23 | 2017-01-23 | Image display system |
JP2017-009407 | 2017-01-23 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/506,757 Continuation US11282159B2 (en) | 2017-01-23 | 2019-07-09 | Image display system that executes rendering by switching the rendering between rendering by a server and rendering by a client terminal |
Publications (1)
Publication Number | Publication Date |
---|---|
US20180211356A1 true US20180211356A1 (en) | 2018-07-26 |
Family
ID=62907034
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/878,104 Abandoned US20180211356A1 (en) | 2017-01-23 | 2018-01-23 | Image Display System |
US16/506,757 Active US11282159B2 (en) | 2017-01-23 | 2019-07-09 | Image display system that executes rendering by switching the rendering between rendering by a server and rendering by a client terminal |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/506,757 Active US11282159B2 (en) | 2017-01-23 | 2019-07-09 | Image display system that executes rendering by switching the rendering between rendering by a server and rendering by a client terminal |
Country Status (2)
Country | Link |
---|---|
US (2) | US20180211356A1 (en) |
JP (1) | JP6809249B2 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11367000B2 (en) | 2019-08-14 | 2022-06-21 | Canon Medical Systems Corporation | Data compression apparatus, data compression method, and learning apparatus |
US11615880B2 (en) | 2019-08-22 | 2023-03-28 | Canon Medical Systems Corporation | Medical data processing apparatus, medical data processing method, and medical image diagnostic apparatus |
Family Cites Families (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR100405060B1 (en) * | 2000-08-24 | 2003-11-07 | 휴먼드림 주식회사 | Enlarged Digital Image Providing Method and Apparatus Using Data Communication Networks |
JP2004252005A (en) * | 2003-02-18 | 2004-09-09 | Morisawa:Kk | Data providing system, data providing method, and computer program |
US7890573B2 (en) * | 2005-11-18 | 2011-02-15 | Toshiba Medical Visualization Systems Europe, Limited | Server-client architecture in medical imaging |
US8754900B2 (en) * | 2010-06-17 | 2014-06-17 | Thinci, Inc. | Processing of graphics data of a server system for transmission |
US9373152B2 (en) | 2010-06-17 | 2016-06-21 | Thinci, Inc. | Processing of graphics data of a server system for transmission including multiple rendering passes |
US8410994B1 (en) * | 2010-08-23 | 2013-04-02 | Matrox Graphics Inc. | System and method for remote graphics display |
US20120092351A1 (en) * | 2010-10-19 | 2012-04-19 | Apple Inc. | Facilitating atomic switching of graphics-processing units |
US8907966B2 (en) * | 2011-03-30 | 2014-12-09 | Mckesson Financial Holdings | Methods, apparatuses and computer program products for providing adaptive rendering quality degradation |
US20120317184A1 (en) * | 2011-06-07 | 2012-12-13 | Syed Mohammad Amir Husain | Zero Client Device With Integrated Global Position System Capability |
US9240030B2 (en) | 2011-06-09 | 2016-01-19 | Google Inc. | Method and mechanism for performing both server-side and client-side rendering of visual data |
JP6086656B2 (en) * | 2012-04-19 | 2017-03-01 | オリンパス株式会社 | Server system, program, and processing method |
CA2884301A1 (en) | 2012-09-10 | 2014-03-13 | Calgary Scientific Inc. | Client-side image rendering in a client-server image viewing architecture |
US20140143298A1 (en) | 2012-11-21 | 2014-05-22 | General Electric Company | Zero footprint dicom image viewer |
US9307234B1 (en) * | 2014-07-23 | 2016-04-05 | American Express Travel Related Services Company, Inc. | Interactive latency control with lossless image optimization |
-
2017
- 2017-01-23 JP JP2017009407A patent/JP6809249B2/en active Active
-
2018
- 2018-01-23 US US15/878,104 patent/US20180211356A1/en not_active Abandoned
-
2019
- 2019-07-09 US US16/506,757 patent/US11282159B2/en active Active
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11367000B2 (en) | 2019-08-14 | 2022-06-21 | Canon Medical Systems Corporation | Data compression apparatus, data compression method, and learning apparatus |
US11797848B2 (en) | 2019-08-14 | 2023-10-24 | Canon Medical Systems Corporation | Data compression apparatus, data compression method, and learning apparatus |
US11615880B2 (en) | 2019-08-22 | 2023-03-28 | Canon Medical Systems Corporation | Medical data processing apparatus, medical data processing method, and medical image diagnostic apparatus |
Also Published As
Publication number | Publication date |
---|---|
JP2018120279A (en) | 2018-08-02 |
US11282159B2 (en) | 2022-03-22 |
JP6809249B2 (en) | 2021-01-06 |
US20190333184A1 (en) | 2019-10-31 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9741084B2 (en) | Method and system for providing remote access to data for display on a mobile device | |
JP6278348B2 (en) | Medical image display program, medical image display method, medical image display apparatus, and medical image display system | |
US11282159B2 (en) | Image display system that executes rendering by switching the rendering between rendering by a server and rendering by a client terminal | |
CN104718770A (en) | Client-side image rendering in a client-server image viewing architecture | |
JP2004261597A (en) | Medical system architecture and operating method therefor | |
CN105814903A (en) | Architecture for distributed server-side and client-side image data rendering | |
JP5478929B2 (en) | Medical image processing device | |
CN108010571A (en) | Method, system, equipment and the storage medium that a kind of medical image is shown | |
US20190392940A1 (en) | Medical image display system | |
US10235968B2 (en) | Medical image display apparatus, medical image adjustment method and recording medium | |
US9407922B2 (en) | System and method of managing medical image | |
JP2005287927A (en) | Image processor, image processing method and medical image system | |
JP2010134540A (en) | Remote image reading system and remote image reading method | |
JP2021047899A (en) | Image display system | |
US20120242666A1 (en) | Apparatus and method for displaying image | |
JP2003210414A (en) | Medical image processor, medical image processing method, program, and recording medium | |
JP6662317B2 (en) | Medical cooperation system | |
US20140059027A1 (en) | Server device, client device, medical image processing system, and medical image processing method | |
US20230377722A1 (en) | Medical image display system, medical image display terminal, and recording medium | |
JP2010113455A (en) | Image processing apparatus and image processing program | |
US20180046760A1 (en) | Data management device and image display system | |
US20230245760A1 (en) | Display apparatus, image management server, and recording medium | |
US20190103183A1 (en) | Medical diagnostic device and medical diagnostic program | |
US11663759B1 (en) | System and method for processing multi-dimensional and time-overlapping imaging data in real time with cloud computing | |
US20240038369A1 (en) | Systems and Methods for Transferring Multi-Frame Image Data |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: KONICA MINOLTA, INC., JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:KURAHASHI, AKIRA;REEL/FRAME:044712/0947 Effective date: 20180115 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO PAY ISSUE FEE |