US20190206544A1 - Input apparatus and information processing system - Google Patents

Input apparatus and information processing system Download PDF

Info

Publication number
US20190206544A1
US20190206544A1 US16/235,843 US201816235843A US2019206544A1 US 20190206544 A1 US20190206544 A1 US 20190206544A1 US 201816235843 A US201816235843 A US 201816235843A US 2019206544 A1 US2019206544 A1 US 2019206544A1
Authority
US
United States
Prior art keywords
medical image
display
input
touch panel
displayed
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US16/235,843
Inventor
Shigeatsu Yoshioka
Hidaka Uchida
Yoichi Mizutani
Seiji Miyama
Toru Mitome
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Corp
Original Assignee
Sony Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Corp filed Critical Sony Corp
Priority to US16/235,843 priority Critical patent/US20190206544A1/en
Publication of US20190206544A1 publication Critical patent/US20190206544A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00—ICT specially adapted for the handling or processing of medical images
    • G16H30/40—ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00—ICT specially adapted for the handling or processing of medical images
    • G16H30/20—ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842—Selection of displayed objects or displayed text elements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25—Integrating or interfacing systems involving database management systems
    • G06F16/252—Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
    • G06F17/212—
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048—Indexing scheme relating to G06F3/048
    • G06F2203/04803—Split screen, i.e. subdividing the display area or the window area into separate subareas
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/10—Text processing
    • G06F40/103—Formatting, i.e. changing of presentation of documents
    • G06F40/106—Display of layout of documents; Previewing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2200/00—Indexing scheme for image data processing or generation, in general
    • G06T2200/24—Indexing scheme for image data processing or generation, in general involving graphical user interfaces [GUIs]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing

Definitions

  • This technology relates to an input apparatus configured to operate a viewer, which is used to observe a medical image.
  • a client viewer reads an image (tile image), which is divided into tiles and stored in an image server, based on a navigation operation instruction from a user.
  • the client viewer displays the read image.
  • a user merely selects a portion, which he wishes to browse.
  • a system is capable of recognizing and displaying the corresponding tile image.
  • Japanese Patent Application Laid-open No. 2006-519443 discloses the following technology.
  • a client viewer requests for image data at a certain resolution.
  • the image data is in a virtual slide image file.
  • a server system obtains a compressed block of image data, which includes image data of which resolution is close to the requested resolution.
  • the server system sends the data block to the client.
  • the client zooms in/out the image data, and presents the image at the requested resolution.
  • a general-purpose computer is mostly used as a viewer computer.
  • a keyboard or a mouse is used as an input apparatus when observing a medical image.
  • User-friendliness when observing a medical image is poor.
  • a touch panel After a keyboard and a mouse, a touch panel is used when observing a medical image, but it still has problems.
  • a user inputs information in a touch panel based on an absolute position. In this case, it is necessary to prepare a touch panel, of which resolution is the same as the resolution of a high-resolution window that is used to observe a medical image. This is not realistic.
  • a user inputs information in a touch panel based on a relative position. In this case, for example, it is necessary to repeat a small movement little by little in order to input an instruction to move a pointer for a long distance. It takes a lot of trouble with input.
  • an input apparatus and an information processing system each of which is capable of improving user-friendliness of a viewer that is used to observe a medical image.
  • an input apparatus including: a touch panel configured to receive input operation of at least selecting a medical image, the medical image being displayed on a display area of a display apparatus; and an operation input unit configured to receive spatial operation of the medical image as continuous input, the medical image being displayed on the display area.
  • operation to the input apparatus is mainly divided into two kinds of input operation, i.e., operation of selecting a medical image and spatial operation of a displayed medical image.
  • a device suitable for the operation of selecting a medical image is used, and the device receives input operation.
  • Another device suitable for the spatial operation is used, and the device receives input operation.
  • one operation of selecting a medical image is to select a target medical image from a list by using a GUI.
  • the list is a group of candidates to be displayed on the display area of the display apparatus.
  • Another operation of selecting a medical image is to drag and drop a selected medical image in a display area, on which the selected medical image is to be displayed, and to display the selected medical image.
  • operation using a touch panel is suitable for the operation of selecting a medical image.
  • spatial operation of a medical image is, for example, operation of zooming in/out, moving, and rotating the display area of a medical image, which is displayed on the display area of the display apparatus.
  • an example of continuous input operation is operation of keeping on pressing a button.
  • Another example of continuous input operation is operation of keeping on tilting an analog stick in one direction.
  • zooming in the display area of the medical image continuously the button is continuously pressed.
  • moving the display area in one direction continuously the analog stick is continuously tilted in one direction.
  • the spatial operation is continuous operation.
  • a button or an analog stick is suitable for spatial operation.
  • the input apparatus in which the operation input unit is configured to receive an instruction to change a display area of the medical image as the spatial operation of the medical image, the medical image being displayed on the display area, the instruction being at least one of instructions to zoom in/out, move, and rotate the medical image.
  • the spatial operation of the medical image is operation to change the display area of the medical image displayed on the display area.
  • the spatial operation of the medical image is at least one of zooming in/out operation, moving operation, and rotating operation.
  • zooming in/out operation moving operation
  • rotating operation As described above, such operation is suitable to input information by using a button or an analog stick. It is possible to improve user-friendliness of zooming in/out operation, moving operation, and rotating operation by using such devices.
  • the input apparatus further including: a display unit spatially corresponding to the touch panel; and a controller configured to display a set on the display unit, the set being a group of at least one medical image, to display a low-resolution window on the display unit, the low-resolution window being a low-resolution image of a display area on the display apparatus, to send an instruction to the display apparatus to call up a medical image on the display area of the display apparatus, the medical image being selected from the displayed set by a user via the touch panel, and to display an image on the low-resolution window, the image being a low-resolution image of the medical image.
  • the resolution of the display of the touch panel is low. Because of this, it is not possible to display the display area of the display apparatus, of which definition is high in order to observe a medical image, on the display of the touch panel as it is. Because of this, it is not possible to input an absolute position of the display of the display apparatus, in the touch panel as it is. In view of this, a low-resolution image of the display area on the display apparatus is obtained. The entire screen of the display apparatus is displayed on the touch panel. As a result, it is possible to input an absolute position of the display of the display apparatus, on the touch panel. Because of this, it is possible to avoid the trouble of having to input operation little by little repeatedly in a case of relative position input.
  • the input apparatus in which the controller is configured to display, on the display unit, a thumbnailed medical image in the set, to detect that a user flicks and taps the thumbnail displayed on the touch panel to thereby select the thumbnailed medical image, and to display a medical image on the display unit, the medical image corresponding to the thumbnailed medical image.
  • the thumbnailed medical images are displayed on the display of the touch panel.
  • a user flicks and taps one of the thumbnails, to thereby select an image.
  • it is possible to further improve user-friendliness of the input apparatus.
  • the input apparatus further including: a case accommodating the touch panel, the operation input unit, and the display unit, in which the touch panel is arranged on one main surface side of the case, and the input apparatus further comprises a touch pad, the touch pad being configured to receive at least selection of the medical image, the touch pad being arranged on a second main surface of the case, the second main surface being opposite to a first main surface, the touch panel being arranged on the first main surface.
  • a touch panel and in addition a touch pad are used to receive input operation of selecting a medical image. Because of this, the number of received operation is smaller than the number of operation input received only by a touch panel. Because of this, it is not necessary to make input operation complicated in order to distinguish one operation from another. Each operation may be made simple. It is possible to further improve user-friendliness of operation input.
  • the input apparatus in which the controller is configured to recognize handwritten data, the data input in at least one of the touch panel and the touch pad, and to reflect the recognized data in display on the display apparatus.
  • certain handwritten data is input in the touch panel or the touch pad. Then, the controller recognizes the data. The data is reflected in display on the display apparatus. Because of this, a user is capable of inputting an instruction with an effort smaller than the effort in a case of firstly selecting an instruction from a menu. As a result, it is possible to further improve user-friendliness of the input apparatus.
  • the input apparatus in which the controller is configured to recognize the data as a numerical value, and to divide the display area into a number, the number corresponding to the recognized numerical value.
  • a user traces a number shape on the touch panel or the touch pad. Then, the controller recognizes the handwritten data as a numerical value. Then, the controller divides the display area. Because of this, a user is capable of inputting an instruction to divide a display area with an effort smaller than the effort in a case of firstly selecting an instruction to divide a display from a menu and inputting the number of division. Because of this, it is possible to further improve user-friendliness of the input apparatus.
  • an information processing system including: a display apparatus including a display area, a medical image being displayed on the display area; and an input apparatus including a touch panel configured to receive input operation of at least selecting a medical image, the medical image being displayed on the display area, and an operation input unit configured to receive spatial operation of the medical image as continuous input, the medical image being displayed on the display area.
  • FIG. 1 is a diagram schematically showing an environment in which this technology is used
  • FIG. 2 is a diagram briefly showing the flow of information using a touch panel of an input apparatus 100 of this technology
  • FIG. 3 is a block diagram showing the hardware configuration of a viewer computer 200 of this technology
  • FIG. 4 is a block diagram showing the hardware configuration of the input apparatus 100 of this technology
  • FIG. 5 is a diagram showing the hardware configuration of an input apparatus 101 and the hardware configuration of an input apparatus 102 ;
  • FIG. 6 is a diagram showing an example in a case where a touch panel TP and a touch pad TD share operation input.
  • FIG. 7 is a flowchart showing the flow of operation of selecting a medical image by using the input apparatus 100 , observing the selected medical image, and adding an annotation to the observed medical image.
  • This technology relates to an input apparatus.
  • the input apparatus is connected to a viewer computer via a wireless LAN or the like and is used. A viewer runs in the viewer computer.
  • the viewer is software, and is used to observe medical images.
  • the input apparatus roughly divides input operation into two kinds of input operation, i.e., discrete input operation and continuous input operation.
  • the input apparatus uses an input device suitable for the discrete input operation and another input device suitable for the continuous input operation. With this configuration, information may be input easily.
  • An observer of a medical image may easily select a medical image to be observed by using the input apparatus, and may easily operate the input apparatus when he observes the selected medical image in detail.
  • the above-mentioned “discrete input operation” is, for example, the following operation using a touch panel. That is, an observer touches an object displayed on a touch panel, and drags the object to a predetermined position.
  • the “continuous input operation” is, for example, the following operation using a button or an analog stick. That is, an observer keeps on pressing a button, and keeps on tilting an analog stick in one direction.
  • FIG. 1 is a diagram schematically showing an environment in which this technology is used.
  • a user who observes a medical image, has an input apparatus 100 of this technology on hand. Further, the input apparatus 100 communicates with a viewer computer 200 via wireless communication.
  • the viewer computer 200 includes a display unit 26 . Medical images are displayed on the display unit 26 .
  • the input apparatus 100 includes a touch panel TP at the center of the front surface.
  • the input apparatus 100 further includes buttons BT and analog sticks AS on both sides of the touch panel TP.
  • medical images are displayed on four divided windows LW (display areas) on the display unit 26 .
  • Symbols of four divided windows WD are displayed on the right portion of the touch panel TP of the input apparatus 100 .
  • the four divided windows WD correspond to the four divided windows LW, respectively.
  • the windows LW on the display unit 26 correspond to the windows WD on the touch panel TP one to one.
  • the upper right window LW corresponds to the upper right window WD.
  • a list of thumbnails of the medical images is displayed on the left portion of the touch panel TP.
  • a user operates the input apparatus 100 , which he has with his hand, and selects a medical image to be observed from the list of the medical images on the left portion of the touch panel TP. Then, the user drags and drops the selected medical image on one of the symbols of the four windows WD on the right portion of the touch panel TP.
  • Information on the selected medical image and information on the window LW, on which the selected medical image is to be displayed, are transmitted to the viewer computer 200 via wireless communication.
  • the viewer computer 200 displays the selected medical image on the selected window LW in response to the transmitted information.
  • buttons BT and the analog sticks AS of the input apparatus 100 When a user observes a medical image displayed on the window LW, he inputs operation of zooming in/out, moving, and rotating an image, for example. The user inputs such operation by using the buttons BT and the analog sticks AS of the input apparatus 100 .
  • the four divided windows LW and the four divided windows WD are described above. This is merely an example. Alternatively, an undivided window LW and an undivided window WD may be used. Alternatively, two, three, or five or more divided windows LW, and two, three, or five or more divided windows WD may be used.
  • the list of the thumbnails of the medical images is displayed on the left portion of the touch panel, and the symbol windows WD are displayed on the right portion.
  • the display position is not limited to this example.
  • the list of the thumbnails of the medical images may be displayed on the right portion and the symbol windows WD may be displayed on the left portion. Because of this, a left-handed user may easily drag and drop a medical image.
  • FIG. 2 is a diagram briefly showing the flow of information using the touch panel of the input apparatus 100 of this technology.
  • FIG. 2 is based on the premise that a server computer 300 stores medical images.
  • the input apparatus 100 displays the list of the thumbnails of the medical images and the symbol windows WD on the touch panel TP as UIs (User Interfaces).
  • UIs User Interfaces
  • a user selects a target medical image and a window LW, on which the medical image is to be displayed, by using the UIs.
  • the input apparatus 100 analyzes the input based on the selection.
  • the input apparatus 100 transmits information on the selected medical image and on the selected window LW to the viewer of the viewer computer 200 .
  • the viewer sends an image request to the server computer 300 based on the information on the selected medical image.
  • a server program of the server computer 300 retrieves a medical image in response to the received image request.
  • the server program of the server computer 300 replies image content to a viewer of the viewer computer 200 .
  • the viewer displays a medical image, which is the received image content, on the window LW selected by the user.
  • touch input in an absolute position is not adopted. It is necessary to operate a pointer in a relative position by using a touch panel, of which resolution is lower than the display resolution of a display. In this case, for example, if an area, in which a user is capable of moving a mouse, is narrow, it is necessary to move the mouse little by little repeatedly in order to move a pointer by a necessary amount. As is this example, it is necessary to wipe a touch panel little by little repeatedly to thereby move a pointer, which is troublesome and problematic.
  • Low-resolution symbols of the viewer windows are displayed on the touch panel.
  • examples of a method of creating a symbol include the following methods.
  • a window displayed on the high-definition display unit 26 may be downconverted to thereby obtain a low-resolution symbol.
  • a window displayed on the high-definition display unit 26 may be replaced by a low-resolution icon, which symbolizes the window LW displayed on a high-definition window.
  • a touch pad may be provided in addition to a touch panel in order to improve user-friendliness in a case where a user inputs operation by using a touch panel.
  • the touch panel TP is provided on the front surface of the input apparatus 100
  • a touch pad is provided on the back surface of the input apparatus 100 .
  • the touch panel TP on the front surface and the touch pad on the back surface share operation input in a touch panel.
  • the number of the kinds of operation input in each of the touch panel TP and the touch pad is made small. Operation input in each of the touch panel TP and the touch pad is made simple. As a result, user-friendliness may be improved.
  • touch panel TP and the touch pad may share operation input in a touch panel as follows.
  • the touch panel on the front surface may be used for operation, which may raise no problem even if a finger that touches an operation target partially hides the operation target displayed on the touch panel.
  • the touch pad on the back surface may be used for operation, which may raise a problem if a finger that touches an operation target hides the operation target displayed on the touch panel.
  • a dedicated apparatus or a general-purpose computer may be used as a viewer computer as long as the viewer computer is capable of executing a viewer.
  • the hardware configuration in a case where a general-purpose computer is used will be described.
  • FIG. 3 is a block diagram showing the hardware configuration of the viewer computer 200 of this technology.
  • the viewer computer 200 includes a CPU (Central Processing Unit) 21 , a ROM (Read Only Memory) 22 , a RAM (Random Access Memory) 23 , and an input unit 24 .
  • the CPU 21 executes arithmetic control.
  • the RAM 23 is a work memory for the CPU 21 . Instructions are input in the input unit 24 depending on operation by a user.
  • the viewer computer 200 further includes an interface unit 25 , the display unit 26 , storage 27 , a network interface unit 28 , and a bus 29 connecting them each other.
  • the network interface unit 28 may be connected to the input apparatus of this technology via a wired LAN, a wireless LAN, Bluetooth (registered trademark), or the like.
  • a liquid crystal display, an EL (Electro Luminescence) display, a plasma display, or the like may be used as the display unit 26 for displaying an image.
  • a high-definition display of which resolution is enough high to observe a medical image, is used for a liquid crystal display or the like.
  • a magnetic disk such as a HDD (Hard Disk Drive), a semiconductor memory, an optical disk, or the like may be used as the storage 27 .
  • the CPU 21 expands a program, which corresponds to an instruction supplied from the input unit 24 out of a plurality of programs stored in the ROM 22 , in the RAM 23 .
  • the CPU 21 appropriately controls the display unit 26 and the storage 27 based on the expanded program.
  • FIG. 4 is a block diagram showing the hardware configuration of the input apparatus 100 of this technology.
  • the input apparatus 100 includes a controller 11 , an input I/F unit 12 , a wireless LAN unit 13 , a display I/F unit 14 , a touch screen controller 15 , the touch panel TP, and a touch pad TD on the back surface.
  • the controller 11 controls the entire input apparatus 100 . Input in the buttons BT and the analog sticks AS is transmitted to the controller 11 via the input I/F unit 12 . The controller 11 analyzes the transmitted information. The controller 11 sends an analysis result to the viewer computer 200 via the wireless LAN unit 13 .
  • the controller 11 receives information on a high-resolution window from the viewer computer 200 via the wireless LAN unit 13 .
  • the high-resolution window is displayed on the display unit 26 of the viewer computer 200 .
  • the controller 11 creates a low-resolution window based on the information on the high-resolution window.
  • the low-resolution window is obtained by making the high-resolution window to have low resolution.
  • the controller 11 displays the low-resolution window on the touch panel TP via the display I/F unit 14 .
  • the controller 11 receives thumbnails of medical images from the viewer computer 200 via the wireless LAN unit 13 .
  • the controller 11 creates a tray, i.e., a set of medical images of each patient.
  • the controller 11 displays the tray on the touch panel TP.
  • the controller 11 receives operation input in the touch panel TP and the touch pad TD on the back surface via the touch screen controller 15 .
  • the controller 11 analyzes the received input. Further, the controller 11 updates an image displayed on the touch panel TP based on the analysis result.
  • the controller 11 sends the analysis result to the viewer computer 200 via the wireless LAN unit 13 .
  • the input I/F unit 12 receives input in the buttons BT and the analog sticks AS.
  • the input I/F unit 12 transmits the input to the controller 11 .
  • the wireless LAN unit 13 wirelessly communicates with the network interface unit 28 of the viewer computer 200 . As a result, communication between the controller 11 and the viewer computer 200 is established. Any wireless standard may be employed as long as wireless communication is established.
  • the display I/F unit 14 controls display on the windows on the touch panel TP.
  • the display I/F unit 14 displays the list of the thumbnails of the medical images and the low-resolution windows WD or the symbol windows WD, which are transmitted from the controller 11 , on the touch panel.
  • the touch screen controller 15 receives touch input in the touch screen of the the touch panel TP on the front surface of the input apparatus 100 and in the touch pad TD on the back surface of the input apparatus 100 .
  • the touch screen controller 15 supplies the touch input to the controller 11 .
  • the input apparatus 100 includes both the buttons BT and the analog sticks AS, and the touch panel TP and the touch pad TD.
  • the separate input apparatuses include the input apparatus 101 only including the buttons BT and the analog sticks AS, and the input apparatus 102 only including the touch panel TP and the touch pad TD.
  • FIG. 5 is a diagram showing the hardware configuration of the input apparatus 101 and the hardware configuration of the input apparatus 102 .
  • the hardware configuration of the input apparatus 101 and the hardware configuration of the input apparatus 102 have the following characteristics. Since the input apparatuses are separate, there are two separated main bodies. The one controller 11 of the input apparatus 100 is divided into two controllers 11 a and 11 b.
  • the one wireless LAN unit 13 of the input apparatus 100 is divided into a Bluetooth (registered trademark) unit 13 a of the input apparatus 101 , and a wireless LAN unit 13 b of the input apparatus 102 .
  • the Bluetooth (registered trademark) unit is provided based on the premise that the input apparatus 101 wirelessly communicates with the viewer computer 200 via Bluetooth (registered trademark).
  • any wireless standard may be employed as long as wireless communication is executed.
  • each block of FIG. 5 is the same as the function of each block of the all-in-one input apparatus 100 .
  • the function of each block of FIG. 5 is obtained by dividing each function of the all-in-one input apparatus 100 . Overlapped description will be omitted.
  • FIG. 6 is a diagram showing an example in a case where the touch panel TP and the touch pad TD share operation input.
  • the sharing of operation input described below is actually an example. Operation input, which is assigned to the touch panel TP in this example, may be assigned to the touch pad TD. Operation input, which is assigned to the touch pad TD in this example, may be assigned to the touch panel TP. Alternatively, a different sharing method may be employed.
  • a display DP 0 on the upper part of FIG. 6 is actually displayed on the touch panel TP.
  • Thumbnails SN of medical images are arrayed in a list.
  • the lists are sorted for each tray TR.
  • the lists for each tray TR are displayed on the left portion of the display DP 0 .
  • the four windows WD are displayed on the right portion.
  • An image IM which is a part of a medical image, is displayed on the window WD.
  • the display DP 0 is divided into objects controlled by using the touch panel TP, and objects controlled by using the touch pad TD. Displays DP 1 and DP 2 on the lower part of FIG. 6 show this situation. Note that the displays DP 1 and DP 2 are prepared for explaining this situation. That is, the displays DP 1 and DP 2 are not displayed on the touch panel actually.
  • a user operates the thumbnails SN of medical images displayed on the left portion of the display DP 1 , and the images IM displayed on the right portion, by using the touch panel TP. Further, a user operates the trays TR, each of which stores a set of the thumbnails SN, displayed on the left portion of the display DP 2 , and the windows WD displayed on the right portion, by using the touch pad TD.
  • a user directly flicks and taps one of a plurality of thumbnails displayed on the left portion of the display DP 1 with his finger or the like, to thereby select a medical image to be observed. Further, a user directly drags and drops the thumbnail of the selected image on one of the positions of the four images IM on the right portion of the display DP 1 . As a result, the user selects the position, on which the image IM is displayed. Further, a user directly drags the image IM displayed on the right portion of the display DP 1 . As a result, the user changes the position, on which the image IM is displayed.
  • a user wipes the left area of the touch pad TD, which is on the back surface of the input apparatus 100 , in the lateral direction.
  • the user selects the tray TR, which includes a set of medical images to be observed and displayed on the left portion of the display DP 2 .
  • a user traces a number shape on the right area of the touch pad TD.
  • the user instructs to divide the window WD into the windows WD, the number of which corresponds to the traced number.
  • the right portion of the display DP 2 shows the following situation.
  • a user traces (hereinafter, referred to as gestures) the “4” shape.
  • the user instructs to divide each of the windows WD, LW into “4” windows.
  • the controller 11 analyzes the operation input, and recognizes “4”.
  • the controller 11 divides the window WD into four windows WD. As described above, the controller 11 recognizes a handwritten letter input in the touch panel TP and the touch pad TD. The controller 11 behaves depending on the recognized letter.
  • the touch panel TP and the touch pad TD share input operation. As a result, the number of the kinds of operation input in each device is decreased. Operation is made simple. As a result, overall user-friendliness may be improved.
  • FIG. 7 is a flowchart showing the flow of operation of selecting a medical image by using the input apparatus 100 , observing the selected medical image, and adding an annotation to the observed medical image.
  • a user inputs gesture of “4” in the touch pad TD, which is on the back surface of the input apparatus 100 , in order to divide the window LW into four.
  • the window LW is used to observe a medical image.
  • the touch pad TD transmits the input to the controller 11 via the touch screen controller 15 .
  • the controller 11 changes the number of the windows WD, which are displayed on the touch panel TP, to “four” via the display I/F unit 14 (Step S 1 ). Further, the instruction to divide the window LW into four is transmitted to the viewer of the viewer computer 200 via the wireless LAN unit 13 . The window LW on the viewer is also divided into four.
  • Step S 2 a user flicks and taps the thumbnail SN portion on the left portion of the display DP 0 of the touch panel TP, in order to select medical images, which are to be displayed on the four windows LW and are to be observed (Step S 2 ).
  • an appropriate tray TR which includes a set of medical images, is already selected. It is not necessary to select a tray TR here.
  • Step S 3 a user drags and drops the thumbnail SN, which shows the selected medical image, on the window WD corresponding to the predetermined window LW, on the touch panel TP.
  • This operation is to select the window LW, on which the selected medical image is displayed (Step S 3 ).
  • This operation is transmitted to the controller 11 via the touch screen controller 15 .
  • the controller 11 analyzes the input.
  • the controller 11 analyzes the input, to thereby obtain information that which medical image is displayed on which window WD. So the controller 11 sends the information to the viewer computer 200 via the wireless LAN unit 13 .
  • the viewer computer 200 changes an image displayed on the display unit 26 based on the received information.
  • the viewer computer 200 displays the selected medical image on the window LW corresponding to the selected window WD.
  • the controller 11 obtains the medical image, which is displayed on the window LW, from the viewer computer 200 .
  • the controller 11 creates a low-resolution image of the obtained image.
  • the controller 11 displays the low-resolution image on the window WD, which corresponds to the window LW on which the medical image is displayed, via the display I/F unit.
  • Step S 4 A user repeats the operation of Steps S 2 and S 3 until medical images to be observed are displayed on all the the four windows LW (Step S 4 ).
  • a user taps a title bar of the window WD on the touch panel TP and selects an active window, in order to select one of the four windows LW and to display an image on the selected window LW (Step S 5 ).
  • Information that which window WD is activated is transmitted to the viewer of the viewer computer 200 .
  • the target window LW is activated. Operation on the window LW is allowed.
  • Step S 6 a user presses the button BT of the input apparatus 100 , in order to zoom in/out the medical image, which is displayed on the selected active window LW (Step S 6 ).
  • the zoom in/out instruction input via the buttons BT is transmitted to the viewer of the viewer computer 200 .
  • the image displayed on the display unit 26 is changed.
  • the controller 11 changes the image displayed on the touch panel TP.
  • Step S 7 a user tilts the analog stick AS, in order to change the display area of the medical image displayed on the selected window LW. Similar to Step S 6 , the image displayed on the the active window LW on the display unit 26 is changed. In addition, the image displayed on the the active window WD on the touch panel TP is changed.
  • Step S 8 a user taps or drags a predetermined position on the touch panel TP, in order to add an annotation to the predetermined position of a medical image. Because of this operation, information on a position, on which an annotation is added, is transmitted to the viewer of the viewer computer 200 . As a result, it is possible to add an annotation to an appropriate position.
  • a user activates the four windows LW in turn, and executes the operation of Steps S 5 to S 8 (Step S 9 ).
  • Described above is an example of operation of selecting a medical image by operating the input apparatus 100 , observing the selected medical image, and adding an annotation to the observed medical image.
  • An input apparatus comprising:
  • a touch panel configured to receive input operation of at least selecting a medical image, the medical image being displayed on a display area of a display apparatus
  • an operation input unit configured to receive spatial operation of the medical image as continuous input, the medical image being displayed on the display area.
  • the operation input unit is configured to receive an instruction to change a display area of the medical image as the spatial operation of the medical image, the medical image being displayed on the display area, the instruction being at least one of instructions to zoom in/out, move, and rotate the medical image.
  • a display unit spatially corresponding to the touch panel
  • the controller is configured
  • the touch panel is arranged on one main surface side of the case, and
  • the input apparatus further comprises a touch pad, the touch pad being configured to receive at least selection of the medical image, the touch pad being arranged on a second main surface of the case, the second main surface being opposite to a first main surface, the touch panel being arranged on the first main surface.
  • the controller is configured
  • the controller is configured
  • a display apparatus including a display area, a medical image being displayed on the display area;
  • an input apparatus including

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Medical Informatics (AREA)
  • General Health & Medical Sciences (AREA)
  • Radiology & Medical Imaging (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Epidemiology (AREA)
  • Primary Health Care (AREA)
  • Public Health (AREA)
  • Human Computer Interaction (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • User Interface Of Digital Computer (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)

Abstract

Provided is an input apparatus, including: a touch panel configured to receive input operation of at least selecting a medical image, the medical image being displayed on a display area of a display apparatus; and an operation input unit configured to receive spatial operation of the medical image as continuous input, the medical image being displayed on the display area.

Description

    CROSS REFERENCE TO RELATED APPLICATIONS
  • The present application is a Continuation of application Ser. No. 13/901,750, filed May 24, 2013, and claims the benefit of Japanese Priority Patent Application JP 2012-149725 filed Jul. 3, 2012, the entire contents of which are incorporated herein by reference.
    • BACKGROUND
  • This technology relates to an input apparatus configured to operate a viewer, which is used to observe a medical image.
  • According to a browsing method in the past, a client viewer reads an image (tile image), which is divided into tiles and stored in an image server, based on a navigation operation instruction from a user. The client viewer displays the read image. A user merely selects a portion, which he wishes to browse. As a result, a system is capable of recognizing and displaying the corresponding tile image.
  • Further, for example, Japanese Patent Application Laid-open No. 2006-519443 discloses the following technology. First, a client viewer requests for image data at a certain resolution. The image data is in a virtual slide image file. Next, a server system obtains a compressed block of image data, which includes image data of which resolution is close to the requested resolution. The server system sends the data block to the client. Next, the client zooms in/out the image data, and presents the image at the requested resolution.
    • SUMMARY
  • According to Japanese Patent Application Laid-open No. 2006-519443 and in general, in a case of observing a medical image by using a viewer, a general-purpose computer is mostly used as a viewer computer. In this case, a keyboard or a mouse is used as an input apparatus when observing a medical image. User-friendliness when observing a medical image is poor.
  • After a keyboard and a mouse, a touch panel is used when observing a medical image, but it still has problems. First, let's say that a user inputs information in a touch panel based on an absolute position. In this case, it is necessary to prepare a touch panel, of which resolution is the same as the resolution of a high-resolution window that is used to observe a medical image. This is not realistic. Further, let's say that a user inputs information in a touch panel based on a relative position. In this case, for example, it is necessary to repeat a small movement little by little in order to input an instruction to move a pointer for a long distance. It takes a lot of trouble with input.
  • In view of the above-mentioned circumstances, it is desirable to provide an input apparatus and an information processing system, each of which is capable of improving user-friendliness of a viewer that is used to observe a medical image.
  • (1) According to an embodiment of this technology, there is provided an input apparatus, including: a touch panel configured to receive input operation of at least selecting a medical image, the medical image being displayed on a display area of a display apparatus; and an operation input unit configured to receive spatial operation of the medical image as continuous input, the medical image being displayed on the display area.
  • According to this technology, operation to the input apparatus is mainly divided into two kinds of input operation, i.e., operation of selecting a medical image and spatial operation of a displayed medical image. A device suitable for the operation of selecting a medical image is used, and the device receives input operation. Another device suitable for the spatial operation is used, and the device receives input operation. As a result, user-friendliness of the input apparatus may be improved.
  • Here, one operation of selecting a medical image is to select a target medical image from a list by using a GUI. The list is a group of candidates to be displayed on the display area of the display apparatus. Another operation of selecting a medical image is to drag and drop a selected medical image in a display area, on which the selected medical image is to be displayed, and to display the selected medical image. As described above, operation using a touch panel is suitable for the operation of selecting a medical image.
  • Further, spatial operation of a medical image is, for example, operation of zooming in/out, moving, and rotating the display area of a medical image, which is displayed on the display area of the display apparatus. Further, an example of continuous input operation is operation of keeping on pressing a button. Another example of continuous input operation is operation of keeping on tilting an analog stick in one direction. In a case of zooming in the display area of the medical image continuously, the button is continuously pressed. In a case of moving the display area in one direction continuously, the analog stick is continuously tilted in one direction. As described above, the spatial operation is continuous operation. As described above, a button or an analog stick is suitable for spatial operation.
  • (2) According to an embodiment of this technology, there is provided the input apparatus, in which the operation input unit is configured to receive an instruction to change a display area of the medical image as the spatial operation of the medical image, the medical image being displayed on the display area, the instruction being at least one of instructions to zoom in/out, move, and rotate the medical image.
  • According to this technology, the spatial operation of the medical image is operation to change the display area of the medical image displayed on the display area. Specifically, the spatial operation of the medical image is at least one of zooming in/out operation, moving operation, and rotating operation. As described above, such operation is suitable to input information by using a button or an analog stick. It is possible to improve user-friendliness of zooming in/out operation, moving operation, and rotating operation by using such devices.
  • (3) According to an embodiment of this technology, there is provided the input apparatus further including: a display unit spatially corresponding to the touch panel; and a controller configured to display a set on the display unit, the set being a group of at least one medical image, to display a low-resolution window on the display unit, the low-resolution window being a low-resolution image of a display area on the display apparatus, to send an instruction to the display apparatus to call up a medical image on the display area of the display apparatus, the medical image being selected from the displayed set by a user via the touch panel, and to display an image on the low-resolution window, the image being a low-resolution image of the medical image.
  • According to this technology, the resolution of the display of the touch panel is low. Because of this, it is not possible to display the display area of the display apparatus, of which definition is high in order to observe a medical image, on the display of the touch panel as it is. Because of this, it is not possible to input an absolute position of the display of the display apparatus, in the touch panel as it is. In view of this, a low-resolution image of the display area on the display apparatus is obtained. The entire screen of the display apparatus is displayed on the touch panel. As a result, it is possible to input an absolute position of the display of the display apparatus, on the touch panel. Because of this, it is possible to avoid the trouble of having to input operation little by little repeatedly in a case of relative position input.
  • (4) According to an embodiment of this technology, there is provided the input apparatus, in which the controller is configured to display, on the display unit, a thumbnailed medical image in the set, to detect that a user flicks and taps the thumbnail displayed on the touch panel to thereby select the thumbnailed medical image, and to display a medical image on the display unit, the medical image corresponding to the thumbnailed medical image.
  • According to this technology, the thumbnailed medical images are displayed on the display of the touch panel. A user flicks and taps one of the thumbnails, to thereby select an image. As a result, it is possible to further improve user-friendliness of the input apparatus.
  • (5) According to an embodiment of this technology, there is provided the input apparatus further including: a case accommodating the touch panel, the operation input unit, and the display unit, in which the touch panel is arranged on one main surface side of the case, and the input apparatus further comprises a touch pad, the touch pad being configured to receive at least selection of the medical image, the touch pad being arranged on a second main surface of the case, the second main surface being opposite to a first main surface, the touch panel being arranged on the first main surface.
  • According to this technology, a touch panel and in addition a touch pad are used to receive input operation of selecting a medical image. Because of this, the number of received operation is smaller than the number of operation input received only by a touch panel. Because of this, it is not necessary to make input operation complicated in order to distinguish one operation from another. Each operation may be made simple. It is possible to further improve user-friendliness of operation input.
  • (6) According to an embodiment of this technology, there is provided the input apparatus in which the controller is configured to recognize handwritten data, the data input in at least one of the touch panel and the touch pad, and to reflect the recognized data in display on the display apparatus.
  • According to this technology, certain handwritten data is input in the touch panel or the touch pad. Then, the controller recognizes the data. The data is reflected in display on the display apparatus. Because of this, a user is capable of inputting an instruction with an effort smaller than the effort in a case of firstly selecting an instruction from a menu. As a result, it is possible to further improve user-friendliness of the input apparatus.
  • (7) According to an embodiment of this technology, there is provided the input apparatus in which the controller is configured to recognize the data as a numerical value, and to divide the display area into a number, the number corresponding to the recognized numerical value.
  • According to this technology, a user traces a number shape on the touch panel or the touch pad. Then, the controller recognizes the handwritten data as a numerical value. Then, the controller divides the display area. Because of this, a user is capable of inputting an instruction to divide a display area with an effort smaller than the effort in a case of firstly selecting an instruction to divide a display from a menu and inputting the number of division. Because of this, it is possible to further improve user-friendliness of the input apparatus.
  • (8) According to an embodiment of this technology, there is provided an information processing system, including: a display apparatus including a display area, a medical image being displayed on the display area; and an input apparatus including a touch panel configured to receive input operation of at least selecting a medical image, the medical image being displayed on the display area, and an operation input unit configured to receive spatial operation of the medical image as continuous input, the medical image being displayed on the display area.
  • As described above, according to this technology, it is possible to improve user-friendliness of a viewer, which is used to observe a medical image.
  • These and other objects, features and advantages of the present disclosure will become more apparent in light of the following detailed description of best mode embodiments thereof, as illustrated in the accompanying drawings.
    • BRIEF DESCRIPTION OF DRAWINGS
  • FIG. 1 is a diagram schematically showing an environment in which this technology is used;
  • FIG. 2 is a diagram briefly showing the flow of information using a touch panel of an input apparatus 100 of this technology;
  • FIG. 3 is a block diagram showing the hardware configuration of a viewer computer 200 of this technology;
  • FIG. 4 is a block diagram showing the hardware configuration of the input apparatus 100 of this technology;
  • FIG. 5 is a diagram showing the hardware configuration of an input apparatus 101 and the hardware configuration of an input apparatus 102;
  • FIG. 6 is a diagram showing an example in a case where a touch panel TP and a touch pad TD share operation input; and
  • FIG. 7 is a flowchart showing the flow of operation of selecting a medical image by using the input apparatus 100, observing the selected medical image, and adding an annotation to the observed medical image.
    •  DETAILED DESCRIPTION OF EMBODIMENTS
  • Hereinafter, an embodiment of the present disclosure will be described with reference to the drawings.
  • [Outline of this Technology]
  • This technology relates to an input apparatus. The input apparatus is connected to a viewer computer via a wireless LAN or the like and is used. A viewer runs in the viewer computer. The viewer is software, and is used to observe medical images. The input apparatus roughly divides input operation into two kinds of input operation, i.e., discrete input operation and continuous input operation. The input apparatus uses an input device suitable for the discrete input operation and another input device suitable for the continuous input operation. With this configuration, information may be input easily. An observer of a medical image may easily select a medical image to be observed by using the input apparatus, and may easily operate the input apparatus when he observes the selected medical image in detail.
  • Note that the above-mentioned “discrete input operation” is, for example, the following operation using a touch panel. That is, an observer touches an object displayed on a touch panel, and drags the object to a predetermined position. Further, the “continuous input operation” is, for example, the following operation using a button or an analog stick. That is, an observer keeps on pressing a button, and keeps on tilting an analog stick in one direction.
  • FIG. 1 is a diagram schematically showing an environment in which this technology is used. A user, who observes a medical image, has an input apparatus 100 of this technology on hand. Further, the input apparatus 100 communicates with a viewer computer 200 via wireless communication. The viewer computer 200 includes a display unit 26. Medical images are displayed on the display unit 26. The input apparatus 100 includes a touch panel TP at the center of the front surface. The input apparatus 100 further includes buttons BT and analog sticks AS on both sides of the touch panel TP.
  • In FIG. 1, medical images are displayed on four divided windows LW (display areas) on the display unit 26. Symbols of four divided windows WD are displayed on the right portion of the touch panel TP of the input apparatus 100. The four divided windows WD correspond to the four divided windows LW, respectively. The windows LW on the display unit 26 correspond to the windows WD on the touch panel TP one to one. For example, the upper right window LW corresponds to the upper right window WD. Note that a list of thumbnails of the medical images is displayed on the left portion of the touch panel TP.
  • A user operates the input apparatus 100, which he has with his hand, and selects a medical image to be observed from the list of the medical images on the left portion of the touch panel TP. Then, the user drags and drops the selected medical image on one of the symbols of the four windows WD on the right portion of the touch panel TP. Information on the selected medical image and information on the window LW, on which the selected medical image is to be displayed, are transmitted to the viewer computer 200 via wireless communication. The viewer computer 200 displays the selected medical image on the selected window LW in response to the transmitted information.
  • When a user observes a medical image displayed on the window LW, he inputs operation of zooming in/out, moving, and rotating an image, for example. The user inputs such operation by using the buttons BT and the analog sticks AS of the input apparatus 100.
  • Note that the four divided windows LW and the four divided windows WD are described above. This is merely an example. Alternatively, an undivided window LW and an undivided window WD may be used. Alternatively, two, three, or five or more divided windows LW, and two, three, or five or more divided windows WD may be used.
  • Further, in the above-mentioned example, the list of the thumbnails of the medical images is displayed on the left portion of the touch panel, and the symbol windows WD are displayed on the right portion. However, the display position is not limited to this example. For example, the list of the thumbnails of the medical images may be displayed on the right portion and the symbol windows WD may be displayed on the left portion. Because of this, a left-handed user may easily drag and drop a medical image.
  • FIG. 2 is a diagram briefly showing the flow of information using the touch panel of the input apparatus 100 of this technology. Note that FIG. 2 is based on the premise that a server computer 300 stores medical images. First, the input apparatus 100 displays the list of the thumbnails of the medical images and the symbol windows WD on the touch panel TP as UIs (User Interfaces). A user selects a target medical image and a window LW, on which the medical image is to be displayed, by using the UIs. The input apparatus 100 analyzes the input based on the selection. The input apparatus 100 transmits information on the selected medical image and on the selected window LW to the viewer of the viewer computer 200.
  • The viewer sends an image request to the server computer 300 based on the information on the selected medical image. A server program of the server computer 300 retrieves a medical image in response to the received image request. The server program of the server computer 300 replies image content to a viewer of the viewer computer 200. The viewer displays a medical image, which is the received image content, on the window LW selected by the user.
  • The flow from operation of the touch panel to display of a medical image on the window LW of the viewer has been described above.
    • Problems of Related Technology and Solutions
  • Here, problems of a related technology and solutions of this technology will be briefly described again.
  • (1) In the past, if a user observes a medical image by using a viewer of a viewer computer, the user uses one of a touch panel, a button, and an analog stick to input operation. Operation input by using a touch panel is suitable to select a medical image and to operate a window of the viewer. However, operation input by using a touch panel is not suitable to zoom in/out, move, and rotate (hereinafter, referred to as viewing operation) a medical image displayed on a window for a long time. To the contrary, a button and an analog stick are suitable for such viewing operation. However, a button and an analog stick are not really suitable to select a medical image and to operate a window.
  • As described above, a tradeoff relation is established between a touch panel, and a button and an analog stick. In view of this, this technology provides both the touch panel, and the button and analog stick. Operation suitable for each device is allocated to the device. As a result, operation input may be optimized.
  • (2) Further, in the past, if touch operation is input in an absolute position of a touch panel, it is necessary to use a touch panel, of which resolution is the same as the display resolution of a display. However, in general, the extremely high-definition display unit 26 is used to observe a medical image. It is not realistic to use a touch panel, of which resolution is the same as the resolution of the extremely high-definition display unit 26.
  • In view of this, touch input in an absolute position is not adopted. It is necessary to operate a pointer in a relative position by using a touch panel, of which resolution is lower than the display resolution of a display. In this case, for example, if an area, in which a user is capable of moving a mouse, is narrow, it is necessary to move the mouse little by little repeatedly in order to move a pointer by a necessary amount. As is this example, it is necessary to wipe a touch panel little by little repeatedly to thereby move a pointer, which is troublesome and problematic.
  • In view of this, according to this technology, symbols of viewer windows, which are displayed on the high-definition display unit 26, are displayed on the low-resolution touch panel. As a result, a user is capable of inputting operation in an absolute position of the low-resolution touch panel.
  • Low-resolution symbols of the viewer windows are displayed on the touch panel. As a result, it is possible to input operation in an absolute position of the low-resolution touch panel. Because of this, since it is possible to input operation in an absolute position, it is possible to avoid the trouble of having to input operation little by little repeatedly in a case of input such as relative input using an operation surface having a limited area.
  • Note that examples of a method of creating a symbol include the following methods. A window displayed on the high-definition display unit 26 may be downconverted to thereby obtain a low-resolution symbol. Alternatively, a window displayed on the high-definition display unit 26 may be replaced by a low-resolution icon, which symbolizes the window LW displayed on a high-definition window.
  • (3) The following is not a problem of a related technology. A touch pad may be provided in addition to a touch panel in order to improve user-friendliness in a case where a user inputs operation by using a touch panel. For example, the touch panel TP is provided on the front surface of the input apparatus 100, and a touch pad is provided on the back surface of the input apparatus 100.
  • With this structure, the touch panel TP on the front surface and the touch pad on the back surface share operation input in a touch panel. The number of the kinds of operation input in each of the touch panel TP and the touch pad is made small. Operation input in each of the touch panel TP and the touch pad is made simple. As a result, user-friendliness may be improved.
  • Note that the touch panel TP and the touch pad may share operation input in a touch panel as follows. The touch panel on the front surface may be used for operation, which may raise no problem even if a finger that touches an operation target partially hides the operation target displayed on the touch panel. Further, the touch pad on the back surface may be used for operation, which may raise a problem if a finger that touches an operation target hides the operation target displayed on the touch panel.
  • [Configuration of Viewer Computer 200]
  • Next, the hardware configuration of the viewer computer 200 will be described. A dedicated apparatus or a general-purpose computer may be used as a viewer computer as long as the viewer computer is capable of executing a viewer. Here, the hardware configuration in a case where a general-purpose computer is used will be described.
  • FIG. 3 is a block diagram showing the hardware configuration of the viewer computer 200 of this technology.
  • The viewer computer 200 includes a CPU (Central Processing Unit) 21, a ROM (Read Only Memory) 22, a RAM (Random Access Memory) 23, and an input unit 24. The CPU 21 executes arithmetic control. The RAM 23 is a work memory for the CPU 21. Instructions are input in the input unit 24 depending on operation by a user. The viewer computer 200 further includes an interface unit 25, the display unit 26, storage 27, a network interface unit 28, and a bus 29 connecting them each other.
  • Programs for executing various processes are stored in the ROM 22. The network interface unit 28 may be connected to the input apparatus of this technology via a wired LAN, a wireless LAN, Bluetooth (registered trademark), or the like.
  • A liquid crystal display, an EL (Electro Luminescence) display, a plasma display, or the like may be used as the display unit 26 for displaying an image. Note that a high-definition display, of which resolution is enough high to observe a medical image, is used for a liquid crystal display or the like. A magnetic disk such as a HDD (Hard Disk Drive), a semiconductor memory, an optical disk, or the like may be used as the storage 27.
  • The CPU 21 expands a program, which corresponds to an instruction supplied from the input unit 24 out of a plurality of programs stored in the ROM 22, in the RAM 23. The CPU 21 appropriately controls the display unit 26 and the storage 27 based on the expanded program.
  • [Configuration of Input Apparatus 100 (No. 1)]
  • Next, the hardware configuration of the input apparatus 100 will be described. FIG. 4 is a block diagram showing the hardware configuration of the input apparatus 100 of this technology.
  • The input apparatus 100 includes a controller 11, an input I/F unit 12, a wireless LAN unit 13, a display I/F unit 14, a touch screen controller 15, the touch panel TP, and a touch pad TD on the back surface.
  • The controller 11 controls the entire input apparatus 100. Input in the buttons BT and the analog sticks AS is transmitted to the controller 11 via the input I/F unit 12. The controller 11 analyzes the transmitted information. The controller 11 sends an analysis result to the viewer computer 200 via the wireless LAN unit 13.
  • Further, the controller 11 receives information on a high-resolution window from the viewer computer 200 via the wireless LAN unit 13. The high-resolution window is displayed on the display unit 26 of the viewer computer 200. The controller 11 creates a low-resolution window based on the information on the high-resolution window. The low-resolution window is obtained by making the high-resolution window to have low resolution. The controller 11 displays the low-resolution window on the touch panel TP via the display I/F unit 14.
  • Similarly, the controller 11 receives thumbnails of medical images from the viewer computer 200 via the wireless LAN unit 13. The controller 11 creates a tray, i.e., a set of medical images of each patient. The controller 11 displays the tray on the touch panel TP. Further, the controller 11 receives operation input in the touch panel TP and the touch pad TD on the back surface via the touch screen controller 15. The controller 11 analyzes the received input. Further, the controller 11 updates an image displayed on the touch panel TP based on the analysis result. The controller 11 sends the analysis result to the viewer computer 200 via the wireless LAN unit 13.
  • The input I/F unit 12 receives input in the buttons BT and the analog sticks AS. The input I/F unit 12 transmits the input to the controller 11.
  • The wireless LAN unit 13 wirelessly communicates with the network interface unit 28 of the viewer computer 200. As a result, communication between the controller 11 and the viewer computer 200 is established. Any wireless standard may be employed as long as wireless communication is established.
  • The display I/F unit 14 controls display on the windows on the touch panel TP. The display I/F unit 14 displays the list of the thumbnails of the medical images and the low-resolution windows WD or the symbol windows WD, which are transmitted from the controller 11, on the touch panel.
  • The touch screen controller 15 receives touch input in the touch screen of the the touch panel TP on the front surface of the input apparatus 100 and in the touch pad TD on the back surface of the input apparatus 100. The touch screen controller 15 supplies the touch input to the controller 11.
  • [Configuration of Input Apparatus 100 (No. 2)]
  • Next, the hardware configuration of an input apparatus 101 and the hardware configuration of an input apparatus 102 will be described. In the above description, the input apparatus 100 includes both the buttons BT and the analog sticks AS, and the touch panel TP and the touch pad TD. To the contrary, here, separate input apparatuses will be described. The separate input apparatuses include the input apparatus 101 only including the buttons BT and the analog sticks AS, and the input apparatus 102 only including the touch panel TP and the touch pad TD.
  • FIG. 5 is a diagram showing the hardware configuration of the input apparatus 101 and the hardware configuration of the input apparatus 102.
  • The hardware configuration of the input apparatus 101 and the hardware configuration of the input apparatus 102 have the following characteristics. Since the input apparatuses are separate, there are two separated main bodies. The one controller 11 of the input apparatus 100 is divided into two controllers 11 a and 11 b.
  • Further, the one wireless LAN unit 13 of the input apparatus 100 is divided into a Bluetooth (registered trademark) unit 13 a of the input apparatus 101, and a wireless LAN unit 13 b of the input apparatus 102. Note that, here, for example, the Bluetooth (registered trademark) unit is provided based on the premise that the input apparatus 101 wirelessly communicates with the viewer computer 200 via Bluetooth (registered trademark). Alternatively, any wireless standard may be employed as long as wireless communication is executed.
  • Note that the function of each block of FIG. 5 is the same as the function of each block of the all-in-one input apparatus 100. Alternatively, the function of each block of FIG. 5 is obtained by dividing each function of the all-in-one input apparatus 100. Overlapped description will be omitted.
  • [Operation Input Shared by Touch Panel and Touch Pad]
  • The touch panel TP and the touch pad TD on the back surface of the input apparatus 100 share operation input. Next, an example of this situation will be described. FIG. 6 is a diagram showing an example in a case where the touch panel TP and the touch pad TD share operation input. The sharing of operation input described below is actually an example. Operation input, which is assigned to the touch panel TP in this example, may be assigned to the touch pad TD. Operation input, which is assigned to the touch pad TD in this example, may be assigned to the touch panel TP. Alternatively, a different sharing method may be employed.
  • First, a display DP0 on the upper part of FIG. 6 is actually displayed on the touch panel TP. Thumbnails SN of medical images are arrayed in a list. The lists are sorted for each tray TR. The lists for each tray TR are displayed on the left portion of the display DP0. Further, the four windows WD are displayed on the right portion. An image IM, which is a part of a medical image, is displayed on the window WD.
  • The display DP0 is divided into objects controlled by using the touch panel TP, and objects controlled by using the touch pad TD. Displays DP1 and DP2 on the lower part of FIG. 6 show this situation. Note that the displays DP1 and DP2 are prepared for explaining this situation. That is, the displays DP1 and DP2 are not displayed on the touch panel actually.
  • A user operates the thumbnails SN of medical images displayed on the left portion of the display DP1, and the images IM displayed on the right portion, by using the touch panel TP. Further, a user operates the trays TR, each of which stores a set of the thumbnails SN, displayed on the left portion of the display DP2, and the windows WD displayed on the right portion, by using the touch pad TD.
  • A user directly flicks and taps one of a plurality of thumbnails displayed on the left portion of the display DP1 with his finger or the like, to thereby select a medical image to be observed. Further, a user directly drags and drops the thumbnail of the selected image on one of the positions of the four images IM on the right portion of the display DP1. As a result, the user selects the position, on which the image IM is displayed. Further, a user directly drags the image IM displayed on the right portion of the display DP1. As a result, the user changes the position, on which the image IM is displayed.
  • Further, a user wipes the left area of the touch pad TD, which is on the back surface of the input apparatus 100, in the lateral direction. As a result, the user selects the tray TR, which includes a set of medical images to be observed and displayed on the left portion of the display DP2.
  • Further, a user traces a number shape on the right area of the touch pad TD. As a result, the user instructs to divide the window WD into the windows WD, the number of which corresponds to the traced number. The right portion of the display DP2 shows the following situation. A user traces (hereinafter, referred to as gestures) the “4” shape. As a result, the user instructs to divide each of the windows WD, LW into “4” windows. The controller 11 analyzes the operation input, and recognizes “4”. The controller 11 divides the window WD into four windows WD. As described above, the controller 11 recognizes a handwritten letter input in the touch panel TP and the touch pad TD. The controller 11 behaves depending on the recognized letter.
  • As described above, the touch panel TP and the touch pad TD share input operation. As a result, the number of the kinds of operation input in each device is decreased. Operation is made simple. As a result, overall user-friendliness may be improved.
  • [Operation Example of Input Apparatus 100]
  • Next, an example of the following operation will be described. A medical image is selected by using the input apparatus 100. The selected medical image is observed. An annotation is added to the observed medical image. FIG. 7 is a flowchart showing the flow of operation of selecting a medical image by using the input apparatus 100, observing the selected medical image, and adding an annotation to the observed medical image.
  • First, a user inputs gesture of “4” in the touch pad TD, which is on the back surface of the input apparatus 100, in order to divide the window LW into four. The window LW is used to observe a medical image. The touch pad TD transmits the input to the controller 11 via the touch screen controller 15.
  • The controller 11 changes the number of the windows WD, which are displayed on the touch panel TP, to “four” via the display I/F unit 14 (Step S1). Further, the instruction to divide the window LW into four is transmitted to the viewer of the viewer computer 200 via the wireless LAN unit 13. The window LW on the viewer is also divided into four.
  • Next, a user flicks and taps the thumbnail SN portion on the left portion of the display DP0 of the touch panel TP, in order to select medical images, which are to be displayed on the four windows LW and are to be observed (Step S2). Note that, here, to make description simple, an appropriate tray TR, which includes a set of medical images, is already selected. It is not necessary to select a tray TR here.
  • Next, a user drags and drops the thumbnail SN, which shows the selected medical image, on the window WD corresponding to the predetermined window LW, on the touch panel TP. This operation is to select the window LW, on which the selected medical image is displayed (Step S3). This operation is transmitted to the controller 11 via the touch screen controller 15. The controller 11 analyzes the input.
  • The controller 11 analyzes the input, to thereby obtain information that which medical image is displayed on which window WD. So the controller 11 sends the information to the viewer computer 200 via the wireless LAN unit 13. The viewer computer 200 changes an image displayed on the display unit 26 based on the received information. The viewer computer 200 displays the selected medical image on the window LW corresponding to the selected window WD.
  • The controller 11 obtains the medical image, which is displayed on the window LW, from the viewer computer 200. The controller 11 creates a low-resolution image of the obtained image. The controller 11 displays the low-resolution image on the window WD, which corresponds to the window LW on which the medical image is displayed, via the display I/F unit.
  • A user repeats the operation of Steps S2 and S3 until medical images to be observed are displayed on all the the four windows LW (Step S4).
  • Next, a user taps a title bar of the window WD on the touch panel TP and selects an active window, in order to select one of the four windows LW and to display an image on the selected window LW (Step S5). Information that which window WD is activated is transmitted to the viewer of the viewer computer 200. The target window LW is activated. Operation on the window LW is allowed.
  • Next, a user presses the button BT of the input apparatus 100, in order to zoom in/out the medical image, which is displayed on the selected active window LW (Step S6). The zoom in/out instruction input via the buttons BT is transmitted to the viewer of the viewer computer 200. The image displayed on the display unit 26 is changed. In addition, the controller 11 changes the image displayed on the touch panel TP.
  • Next, a user tilts the analog stick AS, in order to change the display area of the medical image displayed on the selected window LW (Step S7). Similar to Step S6, the image displayed on the the active window LW on the display unit 26 is changed. In addition, the image displayed on the the active window WD on the touch panel TP is changed.
  • Next, a user taps or drags a predetermined position on the touch panel TP, in order to add an annotation to the predetermined position of a medical image (Step S8). Because of this operation, information on a position, on which an annotation is added, is transmitted to the viewer of the viewer computer 200. As a result, it is possible to add an annotation to an appropriate position.
  • A user activates the four windows LW in turn, and executes the operation of Steps S5 to S8 (Step S9).
  • Described above is an example of operation of selecting a medical image by operating the input apparatus 100, observing the selected medical image, and adding an annotation to the observed medical image.
  • [Other Configurations of this Technology]
  • Note that this technology may adopt the following configurations.
  • (1) An input apparatus, comprising:
  • a touch panel configured to receive input operation of at least selecting a medical image, the medical image being displayed on a display area of a display apparatus; and
  • an operation input unit configured to receive spatial operation of the medical image as continuous input, the medical image being displayed on the display area.
  • (2) The input apparatus according to (1), wherein
  • the operation input unit is configured to receive an instruction to change a display area of the medical image as the spatial operation of the medical image, the medical image being displayed on the display area, the instruction being at least one of instructions to zoom in/out, move, and rotate the medical image.
  • (3) The input apparatus according to (1) or (2), further comprising:
  • a display unit spatially corresponding to the touch panel; and
  • a controller configured
      • to display a set on the display unit, the set being a group of at least one medical image,
      • to display a low-resolution window on the display unit, the low-resolution window being a low-resolution image of a display area on the display apparatus,
      • to send an instruction to the display apparatus to call up a medical image on the display area of the display apparatus, the medical image being selected from the displayed set by a user via the touch panel, and
      • to display an image on the low-resolution window, the image being a low-resolution image of the medical image.
        (4) The input apparatus according to (3), wherein
  • the controller is configured
      • to display, on the display unit, a thumbnailed medical image in the set,
      • to detect that a user flicks and taps the thumbnail displayed on the touch panel to thereby select the thumbnailed medical image, and
      • to display a medical image on the display unit, the medical image corresponding to the thumbnailed medical image.
        (5) The input apparatus according to (3) or (4), further comprising:
  • a case accommodating the touch panel, the operation input unit, and the display unit, wherein
  • the touch panel is arranged on one main surface side of the case, and
  • the input apparatus further comprises a touch pad, the touch pad being configured to receive at least selection of the medical image, the touch pad being arranged on a second main surface of the case, the second main surface being opposite to a first main surface, the touch panel being arranged on the first main surface.
  • (6) The input apparatus according to (5), wherein
  • the controller is configured
      • to recognize handwritten data, the data input in at least one of the touch panel and the touch pad, and
      • to reflect the recognized data in display on the display apparatus.
        (7) The input apparatus according to (6), wherein
  • the controller is configured
      • to recognize the data as a numerical value, and
      • to divide the display area into a number, the number corresponding to the recognized numerical value.
        (8) An information processing system, comprising:
  • a display apparatus including a display area, a medical image being displayed on the display area; and
  • an input apparatus including
      • a touch panel configured to receive input operation of at least selecting a medical image, the medical image being displayed on the display area, and
      • an operation input unit configured to receive spatial operation of the medical image as continuous input, the medical image being displayed on the display area.
  • [Supplementary Note]
  • It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and alterations may occur depending on design requirements and other factors insofar as they are within the scope of the appended claims or the equivalents thereof.
  • The present disclosure contains subject matter related to that disclosed in Japanese Priority Patent Application JP 2012-149725 filed in the Japan Patent Office on Jul. 3, 2012, the entire content of which is hereby incorporated by reference.

Claims (8)

What is claimed is:
1. An input apparatus, comprising:
a touch panel configured to receive input operation of at least selecting a medical image, the medical image being displayed on a display area of a display apparatus; and
an operation input unit configured to receive spatial operation of the medical image as continuous input, the medical image being displayed on the display area.
2. The input apparatus according to claim 1, wherein
the operation input unit is configured to receive an instruction to change a display area of the medical image as the spatial operation of the medical image, the medical image being displayed on the display area, the instruction being at least one of instructions to zoom in/out, move, and rotate the medical image.
3. The input apparatus according to claim 2, further comprising:
a display unit spatially corresponding to the touch panel; and
a controller configured
to display a set on the display unit, the set being a group of at least one medical image,
to display a low-resolution window on the display unit, the low-resolution window being a low-resolution image of a display area on the display apparatus,
to send an instruction to the display apparatus to call up a medical image on the display area of the display apparatus, the medical image being selected from the displayed set by a user via the touch panel, and
to display an image on the low-resolution window, the image being a low-resolution image of the medical image.
4. The input apparatus according to claim 3, wherein
the controller is configured
to display, on the display unit, a thumbnailed medical image in the set,
to detect that a user flicks and taps the thumbnail displayed on the touch panel to thereby select the thumbnailed medical image, and
to display a medical image on the display unit, the medical image corresponding to the thumbnailed medical image.
5. The input apparatus according to claim 3, further comprising:
a case accommodating the touch panel, the operation input unit, and the display unit, wherein
the touch panel is arranged on one main surface side of the case, and
the input apparatus further comprises a touch pad, the touch pad being configured to receive at least selection of the medical image, the touch pad being arranged on a second main surface of the case, the second main surface being opposite to a first main surface, the touch panel being arranged on the first main surface.
6. The input apparatus according to claim 5, wherein
the controller is configured
to recognize handwritten data, the data input in at least one of the touch panel and the touch pad, and
to reflect the recognized data in display on the display apparatus.
7. The input apparatus according to claim 6, wherein
the controller is configured
to recognize the data as a numerical value, and
to divide the display area into a number, the number corresponding to the recognized numerical value.
8. An information processing system, comprising:
a display apparatus including a display area, a medical image being displayed on the display area; and
an input apparatus including
a touch panel configured to receive input operation of at least selecting a medical image, the medical image being displayed on the display area, and
an operation input unit configured to receive spatial operation of the medical image as continuous input, the medical image being displayed on the display area.
US16/235,843 2012-07-03 2018-12-28 Input apparatus and information processing system Abandoned US20190206544A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US16/235,843 US20190206544A1 (en) 2012-07-03 2018-12-28 Input apparatus and information processing system

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP2012-149725 2012-07-03
JP2012149725A JP2014012040A (en) 2012-07-03 2012-07-03 Input apparatus and information processing system
US13/901,750 US10185804B2 (en) 2012-07-03 2013-05-24 Input apparatus and information processing system
US16/235,843 US20190206544A1 (en) 2012-07-03 2018-12-28 Input apparatus and information processing system

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US13/901,750 Continuation US10185804B2 (en) 2012-07-03 2013-05-24 Input apparatus and information processing system

Publications (1)

Publication Number Publication Date
US20190206544A1 true US20190206544A1 (en) 2019-07-04

Family

ID=49879522

Family Applications (2)

Application Number Title Priority Date Filing Date
US13/901,750 Active 2033-10-21 US10185804B2 (en) 2012-07-03 2013-05-24 Input apparatus and information processing system
US16/235,843 Abandoned US20190206544A1 (en) 2012-07-03 2018-12-28 Input apparatus and information processing system

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US13/901,750 Active 2033-10-21 US10185804B2 (en) 2012-07-03 2013-05-24 Input apparatus and information processing system

Country Status (3)

Country Link
US (2) US10185804B2 (en)
JP (1) JP2014012040A (en)
CN (1) CN103529977A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110335284A (en) * 2019-07-11 2019-10-15 上海昌岛医疗科技有限公司 A kind of method of the removal background of pathological image

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109106392A (en) 2014-06-11 2019-01-01 佳能株式会社 Image display device, display control unit and display control method
JP6431292B2 (en) 2014-06-11 2018-11-28 キヤノン株式会社 MEDICAL IMAGE DISPLAY DEVICE, ITS CONTROL METHOD, CONTROL DEVICE, PROGRAM
JP6440386B2 (en) * 2014-06-11 2018-12-19 キヤノン株式会社 Information processing apparatus and program
JP7232759B2 (en) 2016-11-25 2023-03-03 ホロジック， インコーポレイテッド Healthcare information manipulation and visualization controller
US10663711B2 (en) 2017-01-04 2020-05-26 Corista, LLC Virtual slide stage (VSS) method for viewing whole slide images
JP7130953B2 (en) * 2017-12-25 2022-09-06 コニカミノルタ株式会社 Medical image display system and medical image display device
JP7458328B2 (en) 2018-05-21 2024-03-29 コリスタ・エルエルシー Multi-sample whole-slide image processing via multi-resolution registration
TWI776013B (en) * 2019-01-25 2022-09-01 佳世達科技股份有限公司 Operating method for touch display device
CN109885234A (en) * 2019-02-25 2019-06-14 宁波江丰生物信息技术有限公司 A kind of slice reading method based on mobile phone
CA3231719A1 (en) * 2021-09-07 2023-03-16 Sumitomo Pharma Co., Ltd. Biological information recording device and biological information recording program

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060274928A1 (en) * 2005-06-02 2006-12-07 Jeffrey Collins System and method of computer-aided detection
US20080150911A1 (en) * 2008-01-21 2008-06-26 Sony Computer Entertainment America Inc. Hand-held device with touchscreen and digital tactile pixels
US20090043195A1 (en) * 2004-10-12 2009-02-12 Koninklijke Philips Electronics, N.V. Ultrasound Touchscreen User Interface and Display
US20120064946A1 (en) * 2010-09-09 2012-03-15 Microsoft Corporation Resizable filmstrip view of images
US20120183191A1 (en) * 2009-09-30 2012-07-19 Fujifilm Corporation Medical image display apparatus, medical image display method, and medical image display program
US20120238363A1 (en) * 2011-03-16 2012-09-20 Nintendo Co., Ltd. Information processing system, information processing apparatus, storage medium having information processing program stored therein, and image display method

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1994015272A1 (en) * 1992-12-22 1994-07-07 Morgan Michael W Pen-based electronic teaching system
US6424332B1 (en) * 1999-01-29 2002-07-23 Hunter Innovations, Inc. Image comparison apparatus and method
US7738688B2 (en) 2000-05-03 2010-06-15 Aperio Technologies, Inc. System and method for viewing virtual slides
US7333092B2 (en) * 2002-02-25 2008-02-19 Apple Computer, Inc. Touch pad for handheld device
US7578786B2 (en) * 2003-04-01 2009-08-25 Boston Scientific Scimed, Inc. Video endoscope
US20040267122A1 (en) * 2003-06-27 2004-12-30 Desikachari Nadadur Medical image user interface
JP2006350649A (en) * 2005-06-15 2006-12-28 Nintendo Co Ltd Program and information processing device
US20090054755A1 (en) * 2006-03-02 2009-02-26 Takao Shiibashi Medical imaging system
JP5129478B2 (en) * 2006-03-24 2013-01-30 株式会社デンソーアイティーラボラトリ Screen display device
JP2010057902A (en) * 2008-08-06 2010-03-18 Toshiba Corp Report generation support apparatus, report generation support system, and medical image referring apparatus
US8150463B2 (en) * 2008-12-08 2012-04-03 At&T Intellectual Property I, L.P. Method and apparatus for presenting a user interface
KR20110111031A (en) * 2010-04-02 2011-10-10 삼성전자주식회사 Composite touch screen pannel
KR20120002008A (en) * 2010-06-30 2012-01-05 삼성전자주식회사 Composite touch screen pannel
US8624837B1 (en) * 2011-03-28 2014-01-07 Google Inc. Methods and apparatus related to a scratch pad region of a computing device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090043195A1 (en) * 2004-10-12 2009-02-12 Koninklijke Philips Electronics, N.V. Ultrasound Touchscreen User Interface and Display
US20060274928A1 (en) * 2005-06-02 2006-12-07 Jeffrey Collins System and method of computer-aided detection
US20080150911A1 (en) * 2008-01-21 2008-06-26 Sony Computer Entertainment America Inc. Hand-held device with touchscreen and digital tactile pixels
US20120183191A1 (en) * 2009-09-30 2012-07-19 Fujifilm Corporation Medical image display apparatus, medical image display method, and medical image display program
US20120064946A1 (en) * 2010-09-09 2012-03-15 Microsoft Corporation Resizable filmstrip view of images
US20120238363A1 (en) * 2011-03-16 2012-09-20 Nintendo Co., Ltd. Information processing system, information processing apparatus, storage medium having information processing program stored therein, and image display method

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110335284A (en) * 2019-07-11 2019-10-15 上海昌岛医疗科技有限公司 A kind of method of the removal background of pathological image

Also Published As

Publication number Publication date
JP2014012040A (en) 2014-01-23
CN103529977A (en) 2014-01-22
US20140013280A1 (en) 2014-01-09
US10185804B2 (en) 2019-01-22

Similar Documents

Publication Publication Date Title
US20190206544A1 (en) Input apparatus and information processing system
US9569010B2 (en) Gesture-based human machine interface
US9477381B2 (en) User interface for toolbar navigation
WO2021184375A1 (en) Method for execution of hand gesture commands, apparatus, system, and storage medium
US10599317B2 (en) Information processing apparatus
US20110304557A1 (en) Indirect User Interaction with Desktop using Touch-Sensitive Control Surface
US8723821B2 (en) Electronic apparatus and input control method
KR102199356B1 (en) Multi-touch display pannel and method of controlling the same
US10180714B1 (en) Two-handed multi-stroke marking menus for multi-touch devices
US20120218308A1 (en) Electronic apparatus with touch screen and display control method thereof
US20110267267A1 (en) Information processing apparatus, information processing method, and program therefor
US9513795B2 (en) System and method for graphic object management in a large-display area computing device
JP2009151638A (en) Information processor and control method thereof
US20130002714A1 (en) Display control apparatus and method for controlling display
JP2013033462A (en) Operation method and control system for multi-touch control
US20130021367A1 (en) Methods of controlling window display on an electronic device using combinations of event generators
US10838570B2 (en) Multi-touch GUI featuring directional compression and expansion of graphical content
Uddin Improving Multi-Touch Interactions Using Hands as Landmarks
US20150100912A1 (en) Portable electronic device and method for controlling the same
EP3321843A1 (en) A centralized traffic control system, and a method in relation with the system
Kang et al. UFO-Zoom: A new coupled map navigation technique using hand trajectories in the air
US10895978B2 (en) Numerical controller
EP2738669A1 (en) System and method for graphic object management in a large display area computing device
Nishimoto Multi-User Interface for Scalable Resolution Touch Walls

Legal Events

Date Code Title Description
STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: ADVISORY ACTION MAILED

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION