JP2006108911A - Unit and method for image processing - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To improve operability and visibility even if operating by viewing a shared screen or an information terminal when performing the menu operation of the shared screen from the information terminal. <P>SOLUTION: An image processing unit, or the like is provided. The image processing unit comprises: a menu display instruction means for operating a cursor on the shared screen of a display 101 from the information terminal 103 to provide coordinates instructions for displaying a menu and a menu display instruction; a display means for displaying the menu on the display 101; a menu storage means for storing the information of the menu displayed on the display 101 and the display 101 of the information terminal 103; a menu conversion means for converting the menu stored by the menu storage means to that for information terminal display; a coordinates conversion means for converting the coordinates of a cursor position on the shared screen and the menu of the terminal display means; and a display means for displaying the converted menu at the information terminal. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a display device and an information terminal, the display device displays a shared screen that can be operated from the information terminal, the information terminal relates to an image processing device / method for displaying the shared screen, and a storage medium storing a program Is.

  With the development of networks in recent years, electronic conference systems using computer systems have become widespread. Particularly, in an electronic conference system using a large screen display device, the large screen display device is used as a shared display device for conference participants. In addition to its use as a simple display device, it is also increasingly used as an electronic drawing device such as an electronic whiteboard. Such an electronic conference system has a configuration in which a large screen display device is connected to one PC, and conference participants share and edit information displayed on the screen. As an input terminal for the shared screen, a wired or wireless mouse, keyboard, tablet, digitizer capable of inputting coordinates directly on the shared screen, or the like is used.

  On the other hand, information terminal devices such as notebook type personal computers (PCs) and PDAs (Personal Digital Assistants) have become widespread, and electronic conferencing systems combining the two can be seen.

  Many of these information terminals have a wireless or wired interface, many of which have a display device, and have a liquid crystal display screen. As a data input method, a coordinate input device such as a mouse, a pen such as a tablet, A keyboard or the like is provided, so that it can also be used as an input terminal for operating the shared screen of the electronic conference system.

  As a method of using the information terminal as an input terminal of the shared screen, there is a method of providing a coordinate designation area for designating the position of the cursor on the shared screen on the terminal.

  A screen displayed on the shared display device may be displayed in the coordinate designation area. Since both are displayed in the same manner, it is possible to perform operations while viewing either the shared screen or the information terminal.

  In the “electronic board system” disclosed in Japanese Patent Laid-Open No. 8-171455, information written between each other and information displayed between the shared screen and the information terminal can be transmitted and received so that the same contents can be displayed. Thus, there has been a proposal to improve workability.

  Using the input device of the information terminal connected to such a shared screen display device, the moving coordinates of the mouse cursor, mouse click information, operation command information, etc. are sent from the information terminal to the shared screen display device and on the shared screen display device side. By generating an event in the shared screen display device according to the event information sent from the information terminal, it becomes possible to operate the shared screen display device from the remote terminal, which is effective in a meeting or a presentation.

JP-A-8-171455

  However, if what is displayed on the shared display device is small, for example, a context menu displayed by pressing a right click or the like will be displayed as an icon or character from a conference participant sitting away from the screen in the conference room. The display was sometimes difficult to see. The same context menu is also displayed on the display on the information terminal side, but the shared screen display device needs to be large enough to be viewed by the conference participants, so the display device of the information terminal is small. Therefore, in order to display the same screen, the information terminal must display a reduced screen, and the context menu display becomes relatively small, so that it can be operated regardless of which display screen is viewed. There was a problem that it was difficult to cause an error and easy to operate.

  In the case of the above problem, there is a method of preventing erroneous operation by enlarging the display of the context menu itself and improving the visibility. However, since it is a shared display device, hiding a part of the shared screen by a menu displayed by one operator is not preferable because it hinders viewing by other participants. Furthermore, as an advanced form of this device, a form in which a shared screen is operated simultaneously from a plurality of terminals is conceivable, but in that case, it is assumed that a plurality of operators simultaneously display a context menu. Has the same problem as the above, in which the shared screen is hidden by the number of menus corresponding to the number of people.

  The present invention has been made in view of the above-described problems. In the case where the menu operation of the shared screen is performed from the information terminal, the operability can be improved regardless of whether the shared screen or the information terminal is viewed. An object of the present invention is to provide an image processing apparatus and method, and an arrangement program for improving visibility.

  To achieve the above object, the display device is connected to an information terminal, the display device displays a shared screen operable from the information terminal, and the information terminal has terminal display means for displaying the shared screen. In the image processing apparatus, a menu display instruction means for performing a coordinate operation for displaying a menu and a menu display instruction by operating a cursor on the shared screen from the information terminal, and a display means for displaying the menu on the display device Menu storage means for storing information on the menu displayed on the display device and the display device of the information terminal, menu conversion means for converting the menu stored in the menu storage means for information terminal display, and a shared screen And coordinate conversion means for performing coordinate conversion of the cursor position on the menu of the terminal display means, and the converted menu To provide an image processing apparatus or the like, characterized in that it comprises a display means for displaying the serial data terminal.

  ADVANTAGE OF THE INVENTION According to this invention, visibility and operativity can be improved by displaying the menu from which display contents, such as a magnitude | size and an icon image, differ from a shared screen according to the display device of an information terminal. Also, by performing coordinate conversion on the menu, the same operation as on the shared screen can be performed without impairing the operational feeling on the information terminal.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. FIG. 1 is a schematic diagram showing the overall configuration of a conference system including an image processing apparatus according to a first embodiment of the present invention.
Referring to FIG. 1, the conference system includes a display device 101 that is a relatively large display for displaying a shared screen, an image processing device 102 that is connected to the display device 101 and includes a personal computer, and a network 104 such as a LAN. Is connected to the image processing apparatus 102 via an information terminal 103 including a PDA (Personal Digital Assistant) and a notebook PC. The information terminal 103 is a terminal used by the conference participants for the shared screen operation, and there may be a plurality of information terminals.

FIG. 2 is a block diagram showing a configuration example of the image processing apparatus and the information terminal according to the first embodiment of the present invention.
The image processing apparatus 102 includes a CPU, an MPU, and the like. The image processing apparatus 102 includes a control unit 201 that controls each unit of the image processing apparatus 102, a ROM (Read Only Memory), a RAM (Random Access Memory), and the like. From a non-volatile memory such as a flash memory and a RAM for storing the menu information 202 which is the configuration information of the menu to be displayed on the display device and the display device information 203 indicating the display capability of the information terminal, and an external storage device such as an HDD A storage unit 204, a menu conversion unit 205 that converts the menu information 202 for information terminal display, a coordinate conversion unit 206 that performs coordinate conversion of the cursor position on the menu of the shared screen and the terminal display means, and an information terminal The network interface unit 207 controls communication with the network 103.

  In this figure, an information terminal 103 includes a control unit 208 that controls each unit of the information terminal, a display unit 209 that displays a shared screen, a coordinate instruction for displaying a menu by operating a cursor on the shared screen, and a menu. A menu display instruction unit 210 for instructing menu display, a network interface unit 211 for controlling communication with the image processing apparatus 102, and an input unit 212 including a mouse, a tablet, a touch panel, and the like. In the present embodiment, a tablet is arranged on display unit 209 and the same area as menu display instruction unit 210 is used.

  FIG. 16 is a table showing an example of a device information table stored in the storage unit 203 according to the first embodiment. The stored information includes a device ID, an ID for identifying each device on the network, an IP address here, and a display device displayable resolution (x, y) for displaying a shared screen of the information terminal. Stored in association with display device information. The device information may be acquired from a device information acquisition unit (not shown) in the image processing apparatus 102 or may be acquired by transmitting the device information from the information terminal 103.

FIG. 8 is a diagram showing an example of a screen display of the display device according to the first embodiment of the present invention. In the figure, reference numeral 801 denotes a shared screen of a display device connected to the image processing device.
On the shared screen 801, a menu 802 displayed from the terminal A is displayed. In the figure, SX and SY are vertical and horizontal resolutions of the shared screen, respectively. In the figure, X and Y are the vertical and horizontal resolutions of the menu 802, respectively.

FIG. 9 is a diagram showing an example of a screen display of the information terminal according to the first embodiment of the present invention. In the figure, reference numeral 901 denotes a shared screen displayed on the information terminal.
The screen 901 is also an area for specifying coordinates when performing a cursor operation on the shared screen 801. The cursor on the shared screen 801 moves in conjunction with the cursor movement operation on the screen 901. The upper left coordinates of the shared screen 801 correspond to the upper left coordinates of the screen 901, and the lower right coordinates of the shared screen 801 correspond to the lower right coordinates of the screen 901. Since coordinates are absolutely specified, it is desirable that the aspect ratios of the shared screen 801 and the screen 901 are the same in order to provide a natural feeling of operation. In this embodiment, the aspect ratio of the shared screen and the terminal screen is 4: 3, which is the same.

  On the screen 901, a menu 902 that is displayed when a display instruction is given by clicking the cursor on the information terminal is displayed. In the figure, CX and CY are vertical and horizontal resolutions of the screen of the information terminal, respectively. Therefore, the screen 901 is displayed in the size of the vertical CX / SX and horizontal CY / SX displayed on the shared screen 801.

  Therefore, if the resolution of the shared screen 801 is 1600 × 1200 (Pixel) and the resolution of the information terminal screen 902 is 800 × 600 (Pixel), the size of the menu 902 is 1 / 2X and 1 / 2Y.

  The upper left coordinates of the menu 802 correspond to the upper left coordinates of the menu 902, and the lower right coordinates of the menu 802 correspond to the lower right coordinates of the menu 902.

  10A and 10B are diagrams illustrating screen display examples of the information terminal when the menu conversion process is performed in the state of FIGS. A menu 1002 is displayed on the screen 1001 of the information terminal. Although the resolution of the screen 1001 is the same as that of the screen 901 in FIG. 9, the menu 1002 has been enlarged two times in the vertical and horizontal directions by the menu conversion unit 205, so the size of the menu 1002 is vertical and horizontal X and Y.

  The upper left coordinates of the menu 802 correspond to the upper left coordinates of the menu 802, the lower right coordinates of the menu 802 correspond to the lower right coordinates of the menu 1002, and the coordinate correspondence on the shared screen and the menu is different. In this figure, since the menu is displayed in double size, the cursor position on the menu 1002 is converted to a relative position on the shared screen 802 with the upper left corner of the menu as the origin. This is illustrated in FIG. 10-2. The cursor coordinates on the menu 1002 are (2X ′, 2Y ′) when the upper left corner of the menu is the origin, and are multiplied by 1/2 on the menu 802 and displayed as (X ′, Y ′).

  FIG. 11 is a diagram illustrating another screen display example of the information terminal when the menu conversion process is performed in the states of FIGS. 8 and 9. A menu 1102 is displayed on the screen 1101 of the information terminal. Although the resolution of the screen 1101 is the same as that of the screen 901 in FIG. 9, the menu 1102 is enlarged by the menu conversion unit 205 to double the vertical and horizontal four times. Similar to FIGS. 10-1 and 10-2, the coordinates on the menu are converted to 1/2 in the vertical direction and 1/4 in the horizontal direction and displayed on the shared screen 801.

  The size of the menu displayed on the information terminal side may be determined by calculating the reciprocal of the ratio between the resolution of the display device of the information terminal and the resolution of the shared screen. The display device resolution of the terminal A in FIG. 16 is 800 × 600 (Pixel), and the shared screen resolution is 1600 × 1200. Since each of the vertical and horizontal sizes is ½, only the menu display of the information terminal is 1 / (½) times (= 2 times). Since the resolution of the terminal C is 400 × 300 and is ¼ in both the vertical and horizontal directions, display is 1 / (¼) times (= 4 times). By using such a calculation means, the menu is easily displayed even on a device with a small resolution, and the menu operation is facilitated.

  FIG. 4 is a flowchart showing a menu display control processing procedure of the image processing apparatus according to the first embodiment of the present invention. FIG. 5 is a flowchart showing the menu display control processing procedure of the information terminal according to the first embodiment of the present invention.

  In FIG. 5, operation event acquisition wait is performed in step S501. The operation event is an event such as movement of the mouse cursor, mouse button down, mouse button up, and other commands, and includes coordinate information as necessary. An operation event is generated by an operation such as tapping on the tablet of the information terminal. In step S502, the operation event is transmitted to the image processing apparatus via the network.

  In FIG. 4, the operation event from the information terminal is waited in step S401, and the operation event transmitted from step S501 is received. In step S402, it is determined whether or not to perform coordinate conversion. Since the conversion is performed only when the coordinates are on the menu, when the operation event is received, if the menu is already displayed and the designated coordinates are included on the menu, the process proceeds to step S403. The coordinate information is naturally included in the operation event when the cursor is moved, but the coordinate may also be included in the event when the mouse button is clicked. It is added to the determination condition of S402. In step S403, coordinate conversion is performed. As shown in FIG. 10-2, the coordinate conversion is performed so that the upper left coordinates on the menu are the origin and the relative positions on the menu from the origin are equal. In step S404, it is determined whether the operation event is a menu display event. If the event is a menu display event, first, in step S405, a menu image to be displayed on the shared screen is generated and displayed on the shared screen. Next, in step S406, a menu for displaying on the information terminal as a reply to the operation event is generated. When generating a menu, the size of the menu may be determined using a fixed ratio, or may be calculated based on device information. In step S407, the generated reply menu image is transmitted to the information terminal, and the process returns to step S401. If it is determined in step S404 that the event is not a menu display event, the process advances to step S408 to determine whether the event is a cursor movement event. If it is determined that the event is a cursor movement event, in step S409, the cursor on the shared screen is moved and displayed. In step S410, only when the coordinate conversion is performed in step S403, the inverse conversion of the conversion is performed, the cursor coordinates are converted to the correct relative position on the terminal menu, and the cursor coordinates are transmitted to the information terminal in step S411. In step S412, general events other than the menu display event and the cursor movement event are processed.

  When a reply is made to the information terminal in step S407 and step S411, the process proceeds to the process on the information terminal side in FIG. 5 and is received in step S503. The process of step S503 is a process of an event received from the image processing apparatus.

  In step S504, it is determined whether the reply event received in step S503 is a menu image. If it is a menu image, it is displayed on the display device of the information terminal in step S505. Here, only the menu image is received, but an image of the entire shared screen including the menu image may be used. If it is determined in step S504 that the received event is not an image, it is determined in step S506 whether or not it is a cursor coordinate. If it is a cursor coordinate, the cursor is displayed. If the received event is not a cursor coordinate even in the menu image, other processing is performed in step S508, and the operation event waiting state and the event reception waiting state are returned again.

  As described above, according to the first embodiment, visibility can be improved by displaying a menu having a different size from the shared screen in accordance with the display device of the information terminal. Also, by performing coordinate conversion on the menu, the same operation as on the shared screen can be performed without impairing the operational feeling on the information terminal.

(Second Embodiment)
The configuration shown in FIG. 1 is also used in the second embodiment described in detail below. FIG. 3 is a block diagram showing a configuration example of an image processing apparatus and an information terminal according to the second embodiment of the present invention.
The image processing apparatus 302 includes a CPU, an MPU, and the like. The image processing apparatus 302 includes a control unit 303 that controls each unit of the image processing apparatus 302, a ROM (Read Only Memory), a RAM (Random Access Memory), and the like. Interface for controlling communication between the information terminal 307 and a storage unit 305 including a non-volatile memory such as a flash memory and a RAM for storing menu information 304 displayed on the display device, and an external storage device such as an HDD. Part 306.

  In this figure, an information terminal 302 includes a control unit 308 that controls each unit of the information terminal, a menu conversion unit 309 that converts menu information 304 for information terminal display, and a cursor position on a menu of the shared screen and the display unit 311. A coordinate conversion unit 310 that performs coordinate conversion, a display unit 311 that displays a shared screen, a menu display instruction unit 312 that performs a coordinate operation to display a menu by operating a cursor on the shared screen, and a menu display command , A network interface unit 312 that controls communication with the image processing apparatus 302, and an input unit 314 including a mouse, a tablet, a touch panel, and the like. In the present embodiment, a tablet is arranged on the display unit 311 and the same area as the menu display instruction unit 312 is used.

FIG. 12 is a diagram showing an example of a screen display of the display device according to the second embodiment of the present invention. In the figure, reference numeral 1201 denotes a shared screen of a display device connected to the image processing device.
On the shared screen 1201, a menu 1202 displayed from the information terminal A, a menu 1203 displayed from another information terminal B, and a menu 1203 displayed from another information terminal C are displayed. The cursor 1205 is operated from the terminal A, the cursor 1206 is operated from the terminal B, and the cursor 1207 is operated from the terminal C. In the figure, SX and SY are vertical and horizontal resolutions of the shared screen, respectively. In the figure, X and Y are the vertical and horizontal resolutions of the menu 1202, respectively.

FIG. 13 is a diagram showing an example of a screen display of the information terminal A in the second embodiment of the present invention. In the figure, reference numeral 1301 denotes a shared screen displayed on the information terminal A.
A screen 1301 is also an area for specifying coordinates when a cursor operation is performed on the shared screen 1201.
The cursor on the shared screen 1201 moves in conjunction with the cursor movement operation on the screen 1301. The upper left coordinates of the shared screen 1201 and the upper left coordinates of the screen 1302 correspond to the lower right coordinates of the shared screen 1201 and the lower right coordinates of the screen 1301.
On the screen 1301, a menu 1302 is displayed which is displayed when a display instruction is issued by clicking the cursor on the information terminal. In the figure, CX and CY are vertical and horizontal resolutions of the screen of the information terminal, respectively. Therefore, the screen 1301 is displayed in the size of the vertical CX / SX and horizontal CY / SX of the display of the shared screen 1201.

  FIG. 14 is a diagram illustrating a screen display example of the information terminal B that has performed the menu conversion process in the states of FIGS. 12 and 13. A menu 1402 is displayed on the screen 1401 of the information terminal B. The resolution of the screen 1401 is the same as that of the screen 1301 in FIG. 13, but the menu 1402 has been enlarged two times vertically and horizontally by the menu conversion unit 309, so the size of the menu 1402 is vertical and horizontal X, Y.

  FIG. 15 is a diagram illustrating a screen display example of the information terminal C that has performed the menu conversion process in the states of FIGS. 12 and 13. A menu 1502 is displayed on the screen 1501 of the information terminal C. The resolution of the screen 1501 is the same as that of the screen 1301 in FIG. 13, but the menu 1502 is enlarged by the menu conversion unit 309 to be doubled vertically and quadrupled horizontally. As in FIG. 14, the coordinates on the menu are converted into vertical ½ and horizontal ¼ and displayed on the shared screen 1201. The menu 1502 displays an icon 1503 for easy visual recognition. The coordinate conversion on the menu between the shared screen and the information terminal screen in FIGS. 13 to 15 is the same as in the first embodiment.

  FIG. 6 is a flowchart showing a menu display control processing procedure of the image processing apparatus according to the second embodiment of the present invention. FIG. 7 is a flowchart showing the menu display control processing procedure of the information terminal according to the second embodiment of the present invention.

  In FIG. 6, operation event acquisition wait is performed in step S701. The operation event is an event such as movement of the mouse cursor, mouse button down, mouse button up, and other commands, and includes coordinate information as necessary. An operation event is generated by an operation such as tapping on the tablet of the information terminal.

  In step S702, it is determined whether coordinate correction is to be performed. If the menu is being displayed and coordinates are included in the operation event, the process proceeds to step S703, and if coordinate correction is to be performed, coordinate correction processing is performed in step S704. The coordinate correction process is a process that corrects the specified coordinates outside the menu while the menu is displayed to the coordinates in the menu area, or invalidates the coordinates specified outside the menu while the menu is displayed. It is. This process can prevent erroneous operation during menu display. If the designated coordinates are on the menu in step S705, the process proceeds to step S706 to convert the coordinates. Coordinate conversion is performed in the same manner as in the first embodiment so that the upper left coordinate on the menu is the origin and the relative position on the menu from the origin is equal. In step S707, the cursor is displayed on the display device of the information terminal. In step S708, it is determined whether the event is a menu non-display event. If the event is a menu non-display event, menu non-display processing is performed on the display device of the information terminal in step S709. In step S710, the operation event is transmitted to the image processing apparatus via the network.

  In FIG. 6, an operation event from the information terminal is waited in step S601, and the operation event transmitted from step S710 is received.

  In step S602, it is determined whether the operation event is a menu display event. If it is a menu display event, a menu image to be displayed on the shared screen is generated in step S603 and displayed on the shared screen. A menu image is generated based on the menu information 304. In the menu information, information of the icon 1503 and the like are stored, but on the shared screen, the icon is not displayed so as to make the menu display area small in order to avoid the screen being hidden by the menu. In step S604, menu information to be displayed on the information terminal as a reply to the operation event is transmitted, and the process returns to step S601.

  If it is determined in step S602 that the event is not a menu display event, the process advances to step S605 to determine whether the event is a cursor movement event. If it is determined that the event is a cursor movement event, in step S606, the cursor is moved and displayed on the shared screen. In step S608, general events other than the menu display event and the cursor movement event are processed.

  In step S712, it is determined whether the reply event received in step S711 is menu information. If it is menu information, a menu is generated in step S713. Here, the size of the menu, the presence / absence of icon display, and the like may be determined from the resolution of the display device of the information terminal, the number of displayable colors, the processing capability, and the like. Therefore, menu display according to the information terminal is possible regardless of the content transmitted from the image processing apparatus. In step S714, the generated menu is displayed. If the received event is not menu coordinates even in the menu information, other processing is performed in step S715, and the operation event waiting and event reception waiting states are returned again.

  As described above, according to the second embodiment, when a plurality of information terminals are operated, a menu having a different display content such as a size and an icon image is displayed depending on the display device of the information terminal. By doing so, visibility and operability can be improved. Also, by performing coordinate conversion on the menu, the same operation as on the shared screen can be performed without impairing the operational feeling on the information terminal. In addition, since the cursor can be displayed when the cursor is moved without waiting for a response from the image processing apparatus, the response at the time of the cursor operation can be improved as compared with the case where the coordinate conversion process is performed by the image processing apparatus.

It is the schematic which shows the whole structure of the conference system containing the image processing apparatus which concerns on 1st Embodiment. It is a block diagram which shows the structural example of the image processing apparatus and information terminal which concern on 1st Embodiment. It is a block diagram which shows the structural example of the image processing apparatus and information terminal which concern on 2nd Embodiment. It is the flowchart which showed the menu display control processing procedure of the image processing apparatus. It is the flowchart which showed the menu display control processing procedure of the information terminal. It is the flowchart which showed the menu display control processing procedure of the image processing apparatus. It is the flowchart which showed the menu display control processing procedure of the information terminal. It is the figure which showed an example of the screen display of a display apparatus. It is the figure which showed an example of the screen display of an information terminal. It is a figure which shows the example of a screen display of the information terminal at the time of performing a menu conversion process. It is a figure which shows a menu at the time of performing coordinate conversion on a menu. It is a figure which shows the example of a screen display of the information terminal at the time of performing a menu conversion process. It is the figure which showed an example of the screen display of a display apparatus. It is the figure which showed an example of the screen display of an information terminal. It is a figure which shows the example of a screen display of the information terminal which performed the menu conversion process. It is a figure which shows the example of a screen display of the information terminal which performed the menu conversion process. It is a figure which shows the device information table memorize | stored in a memory | storage part.

Explanation of symbols

101: display device 102: image processing device 103: information terminal 104: network 201: control unit 202: menu information 203: device information 204: storage unit 205: menu conversion unit 206: coordinate conversion unit 207, 211: network interface unit 208 : Control unit 209: Display unit 210: Menu display instruction unit 212: Coordinate input device 301: Display device 302: Image processing device 303: Control unit 304: Menu information 305: Storage unit 306, 313: Network interface unit 307: Information terminal 308: Control unit 309: Menu conversion unit 310: Coordinate conversion unit 311: Display unit 312: Menu display instruction unit 313: Display unit 314: Coordinate input device

Claims (21)

In an image processing apparatus connected to a display device and an information terminal, the display device displays a shared screen operable from the information terminal, and the information terminal includes terminal display means for displaying the shared screen.
A menu display instruction means for performing a cursor operation on the shared screen from the information terminal and performing a coordinate instruction for displaying a menu and a menu display instruction;
Display means for displaying a menu on the display device;
Menu storage means for storing menu information to be displayed on the display device and the display device of the information terminal;
Menu conversion means for converting the menu stored by the menu storage means for information terminal display;
Coordinate conversion means for performing coordinate conversion of the cursor position on the menu of the shared screen and the terminal display means;
Display means for displaying the converted menu on the information terminal;
An image processing apparatus comprising: The image processing apparatus includes:
Device information acquisition means for acquiring display device information indicating the display capability of the information terminal;
Device information storage means for storing device information;
With
The image processing apparatus according to claim 1, wherein the menu conversion unit converts a menu based on the device information.   The image processing apparatus according to claim 1, wherein the device information includes a resolution having a vertical width and a horizontal width that can be displayed by the information terminal.   The image processing apparatus according to claim 1, wherein the coordinate conversion unit includes a unit that invalidates a coordinate instruction other than on the menu while the menu is displayed.   5. The coordinate conversion means according to claim 1, further comprising means for correcting a coordinate instruction other than on the menu while the menu is displayed to a coordinate instruction in the menu area. Image processing apparatus. In an image processing method connected to a display device and an information terminal, the display device displays a shared screen operable from the information terminal, and the information terminal includes a terminal display step of displaying the shared screen.
A menu display instruction step for performing a cursor operation on the shared screen from the information terminal and performing a coordinate instruction for displaying a menu and a menu display instruction;
A display step of displaying a menu on the display device;
A menu storage step for storing information on a menu to be displayed on the display device and the display device of the information terminal;
A menu conversion step for converting the menu stored in the menu storage step for information terminal display;
A coordinate conversion step for performing coordinate conversion of the cursor position on the menu of the shared screen and the terminal display step;
A display step of displaying the converted menu on the information terminal;
An image processing method comprising: The image processing method includes:
A device information acquisition step for acquiring display device information indicating the display capability of the information terminal;
A device information storage step for storing device information;
With
The image processing method according to claim 6, wherein the menu conversion step converts a menu based on the device information.   The image processing method according to claim 6 or 7, wherein the device information includes a resolution having a vertical width and a horizontal width that can be displayed by the information terminal.   9. The image processing method according to claim 6, wherein the coordinate conversion step includes a step of invalidating a coordinate instruction other than on the menu while the menu is displayed.   The coordinate conversion step includes a step of correcting a coordinate instruction other than on the menu while the menu is displayed to a coordinate instruction in the menu area. Image processing method. A program connected to a display device and an information terminal, wherein the display device displays a shared screen that can be operated from the information terminal, and the information terminal is a program for controlling an image processing device having terminal display means for displaying the shared screen. And
On the computer,
A menu display instruction procedure for operating a cursor on the shared screen from the information terminal and performing a coordinate instruction for displaying a menu and a menu display instruction;
A display procedure for displaying a menu on the display device;
A menu storage procedure for storing information of a menu to be displayed on the display device and the display device of the information terminal;
A menu conversion procedure for converting the menu stored by the menu storage procedure for information terminal display;
A coordinate conversion procedure for performing coordinate conversion of the cursor position on the menu of the shared screen and the terminal display procedure;
A display procedure for displaying the converted menu on the information terminal;
A computer-readable storage medium characterized by storing a program for executing the program. The image processing apparatus includes:
Device information acquisition means for acquiring display device information indicating the display capability of the information terminal;
Device information storage means for storing device information;
With
12. The computer-readable storage medium according to claim 11, wherein the menu conversion procedure converts a menu based on the device information.   The computer-readable storage medium according to claim 11 or 12, wherein the device information includes a resolution having a vertical width and a horizontal width that can be displayed by the information terminal.   The computer-readable storage according to any one of claims 11 to 13, wherein the coordinate conversion procedure includes a procedure of invalidating a coordinate instruction other than on the menu while the menu is displayed. Medium.   The coordinate conversion procedure includes a procedure of correcting a coordinate instruction other than on the menu while the menu is displayed to a coordinate instruction in the menu area. Computer-readable storage media. In a program connected to a display device and an information terminal, the display device displays a shared screen operable from the information terminal, and the information terminal controls an image processing device having terminal display means for displaying the shared screen.
On the computer,
A menu display instruction step for performing a cursor operation on the shared screen from the information terminal and performing a coordinate instruction for displaying a menu and a menu display instruction;
A display step of displaying a menu on the display device;
A menu storing step for storing information of a menu to be displayed on the display device and the display device of the information terminal;
A menu conversion step for converting the menu stored in the menu storage step for information terminal display;
A coordinate conversion step for performing coordinate conversion of the cursor position on the menu of the shared screen and the terminal display step;
A display step of displaying the converted menu on the information terminal;
A program characterized by having executed. The image processing step includes
A device information acquisition step for acquiring display device information indicating the display capability of the information terminal;
A device information storage step for storing device information;
With
The program according to claim 16, wherein the menu conversion step converts a menu based on the device information.   The program according to claim 16 or 17, wherein the device information is configured with a resolution having a vertical width and a horizontal width that can be displayed by the information terminal.   The program according to any one of claims 16 to 18, wherein the coordinate conversion step includes a step of invalidating a coordinate instruction other than on the menu while the menu is displayed.   The coordinate conversion step includes a step of correcting a coordinate instruction other than on the menu while the menu is displayed to a coordinate instruction in the menu area. Program. The storage medium according to any one of claims 11 to 15,
As the storage medium, a flexible disk, a hard disk, a magneto-optical disk, an optical disk, a CD-ROM, a CD-R, a DVD-ROM, a DVD-R, a magnetic tape storing a program that can be read by a server computer and a client computer A computer-readable storage medium using a non-volatile memory card, ROM, or the like.

Images