JP4869172B2 - Information processing apparatus and computer-readable recording medium - Google Patents

Description

  The present invention relates to an information processing apparatus including an input device that can input information by operating a screen display, such as a touch panel and a mouse.

  In an information processing apparatus using such an input / output device, for example, a sensor for detecting contact (or pressing) on the screen from the outside is provided on a display screen for displaying information. When the operator of the information processing apparatus presses a corresponding part such as a button displayed on the screen, the coordinates of the pressed part are detected through the sensor, and an operation instruction is given to the information processing apparatus.

  As this kind of invention, an information processing apparatus as disclosed in JP-A-9-26832 is known. The information processing apparatus includes a high-resolution and large main LCD, a main CPU that controls the main LCD, a small and low-resolution sub-LCD, a touch panel on the sub-LCD, and a sub-CPU that controls the sub-LCD. ing. In the present invention, by combining a small, low-resolution sub-LCD and a touch panel on the sub-LCD, it is not necessary to install a touch panel on the main LCD, and a decrease in contrast of the main LCD and a deterioration in display function are prevented. Furthermore, in work that does not require high resolution, only the sub LCD and the sub processor are operated to reduce power consumption.

  Another conventional information processing apparatus can use both a touch panel and another pointing device such as a mouse as a pointing device. This information processing apparatus has a configuration in which a mouse cursor is displayed on the screen when it is detected that the operator is operating the mouse, and the mouse cursor is not displayed when it is detected that the touch panel is operated. It has been.

  The reason why the mouse cursor is not displayed when the touch panel is operated is that the operator can directly specify desired coordinates on the screen with a finger or a pen.

  For this reason, when a demonstration or presentation is performed on the information processing apparatus by a touch panel operation, the viewer cannot follow the operation of the operator, and it is difficult to understand what operation the operator is performing.

  Such an information processing apparatus is generally a notebook personal computer, a pen input personal computer, a small information terminal such as a PDA, and the like, and its display screen area is generally small. For this reason, other external display devices such as a liquid crystal projector and a large-screen CRT are often connected with a cable, and demonstrations and presentations are often given to viewers using the external display device. In this case, due to limitations on the performance of the video controller built in the information processing device, the video controller is used for display control on the external display device, and the same contents as those displayed on the external display device are used. Some items cannot be displayed on the screen. Therefore, the operator has to operate the touch panel in a state where no information is displayed on the screen of the information processing apparatus, and it is difficult to point to the correct coordinates on the screen by the touch panel operation.

Other information processing apparatuses incorporate two video controllers, one of which controls the display on the touch panel screen, and the other controls the display on the external display apparatus. Display different contents on one screen. In such an information processing apparatus, menus, buttons, icons, or the like that are displayed on the external display device and not displayed on the touch panel cannot be specified on the touch panel.

  In any case, the viewer is required to have a mechanism for pointing the touched coordinates so that the operation can be understood regardless of whether information is displayed on the touch panel.

  On the other hand, even if information is not displayed on the touch panel screen, the operator can easily point to an appropriate coordinate or operate a menu, button, icon, or the like displayed only on the external display device. There has been a demand for a method of controlling an information processing apparatus using a touch panel that can be used.

  Further, in an information processing apparatus that does not include a touch panel as described above, for example, only a mouse is a pointing device, a mouse cursor is always displayed on the screen.

  However, in demonstrations and presentations for viewers, the operator frequently moves the mouse cursor to a desired menu, button, icon, etc., so that the operation by the operator is similar to the information processing apparatus having the touch panel described above. It was difficult for viewers to grasp.

  Therefore, even in an information processing apparatus using a pointing device that is not a touch panel, there has been a demand for a mechanism that makes it easy for viewers to understand the contents operated by the operator.

  The present invention has been made in view of the problems of the prior art, and records an information processing apparatus, a display control method, and a program for executing the control that make it easy for the viewer to understand the operation of the operator. The recording medium is provided.

  Also, an information processing device that makes it easy for the viewer to understand the operation of the operator using the external display device connected to the information processing device, and also allows the operator to understand the operation of the operator easily and easily. A display control method and a recording medium recording a program for executing the control are provided.

  Furthermore, the present invention makes it easy for the viewer to understand the operation contents of the operator, and also allows the operator himself to confirm the operation, and makes it easy to perform the information processing provided with an input / output device such as a touch panel as a pointing device. An apparatus, a display control method, and a recording medium recording a program for executing the control are provided.

  In order to solve the above problems, the present invention employs the following means. That is, the present invention provides an operation screen unit capable of displaying information and detecting a contact operation on the surface thereof, a first display control unit for controlling display of information on the operation screen unit, and a contact operation. The information processing apparatus includes an operation mode selection unit for selecting any one of two or more operation modes of the operation screen unit. The following operation modes are selected by this operation mode selection unit.

In the first operation mode, the first function corresponding to this operation is provided for the contact operation through the operation screen unit. This contact operation is, for example, an operation of selecting a display portion such as a menu, a button, or an icon displayed on the operation screen unit by contact. Also, the first function corresponding to this operation means that a specific application program is started by selecting a menu, for example.

  On the other hand, in the second operation mode, for the contact operation through the operation screen unit, instead of providing the first function corresponding to the operation, or in conjunction with providing the first function, the contact operation is performed. A second function of displaying a sign for indicating the detection of contact at the position is provided.

  In this invention, you may further provide the connection part for connecting the display apparatus which can display information other than said operation screen part. The first display control unit controls display of information on the display device connected to the connection unit and display of information on the operation screen unit. Also in this case, the second operation mode can be applied to the contact operation through the operation screen unit, instead of providing the first function corresponding to the contact operation, or together with providing the first function. A second function of displaying a sign for indicating detection of contact at least one of the contact position and the display position of the display device determined based on the contact operation is provided.

  Here, the display position of the display device determined based on this contact operation refers to the position on the screen of the display device corresponding to the operation screen unit. For example, the relative position on the screen of the display device based on the position determined as the absolute coordinate of the display device corresponding to the absolute coordinate on the operation screen or the relative movement amount by the operation on the operation screen This position is determined by the amount of movement.

  In the present invention, the first display control unit may control to display information exclusively on either the display device or the operation screen unit. That is, display may be performed only on one of the display device and the operation screen unit.

  In the present invention, a second display control unit may be further provided. That is, the first display control unit controls the display of the first information on the operation screen unit, and the second display control unit controls the display of the second information on the display device. Thereby, for example, information with different contents may be displayed between the operation screen unit and the display device.

  In this invention, it may replace with the operation mode selection part for selecting the operation mode of the operation screen part with respect to contact operation, and may provide the control part for determining the mode of operation through an operation screen part. This control unit determines which of the following two or more modes of operation is performed for the contact operation on the operation screen unit.

  That is, for the operation of the first aspect, the first function corresponding to this operation is provided, and for the operation of the second aspect, instead of providing the first function, or Along with the provision of the first function, a second function of displaying a sign for indicating detection of contact at the contact position is provided.

  The present invention is an information processing apparatus capable of connecting a display unit for displaying information and a pointing device for instructing coordinates on the display unit, and an operator instructing coordinates using the pointing device And a display control unit that displays a sign indicating that the instruction has been made at each coordinate in the display unit that has been instructed.

  The display control unit may display the sign for a predetermined time and then delete it. When the elapsed time from the previous coordinate instruction to the subsequent coordinate instruction is longer than the predetermined time (time during which the sign is displayed), the display control unit deletes the sign displayed by the previous coordinate instruction and A sign may be displayed at the designated coordinates.

  The present invention may be an information processing apparatus including the above-described display unit and further including a connection unit to which another display device to which display coordinates corresponding to the coordinates of the display unit are set is connected. The display control unit controls display of information on at least one of the display unit and the other display device, and can display a sign on at least one of the display unit and the other display device on which the information is displayed. That's fine.

  According to the present invention, an operation screen unit capable of displaying information and detecting a touch operation on the surface is set in either the first operation mode or the second operation mode, and the operation screen unit or other display device Information is displayed on at least one of them, a contact operation through the operation screen unit is detected, and the first operation mode provides a first function corresponding to this operation for the contact operation through the operation screen unit, In the second operation mode, instead of providing the first function corresponding to the operation or providing the first function with respect to the contact operation through the operation screen unit, the contact position and the contact are provided. A program for displaying a marker for indicating contact detection at least one of the display positions of the display device determined based on the operation may be recorded on a computer-readable recording medium.

  The present invention provides a computer capable of connecting a display unit and a pointing device to a procedure for detecting an input operation of an operator who designates coordinates on the display unit using the pointing device, and each of the display units to which the above instruction is given. A program that executes a procedure for displaying a sign indicating that the instruction has been made at coordinates may be recorded on a computer-readable recording medium.

  The program executes a first operation mode for providing a first function for causing a computer to execute a normal process corresponding to an input operation of an operator using the pointing device, and a process different from the first operation mode. A procedure for selecting any of the second operation modes that provide the second function to be executed may be further executed, and a procedure for displaying a sign based on the selection of the second operation modes may be executed.

This program may cause the computer to further execute a procedure of deleting the mark after displaying it for a predetermined time. In addition, the program calculates to the computer a procedure for calculating the elapsed time from the previous coordinate instruction to the subsequent coordinate instruction, and if this elapsed time is longer than the predetermined time (the time during which the sign is displayed), A procedure of deleting the sign displayed by the coordinate instruction and displaying the sign at the coordinate indicated later may be further executed.
The program further includes a procedure for controlling a computer to display information on at least one of display units provided with the computer or display units corresponding to the coordinates of the display unit connected to the computer. It may be executed to execute a procedure for displaying the indicator on at least one of the display unit or the other display device on which information is displayed.

As described above, according to the present invention, instead of providing a function corresponding to the operation of the information processing apparatus, or along with providing a function corresponding to this operation, the detection of contact at this contact position is indicated. Since the sign is displayed, the operation of the operator can be easily understood by the viewer in the demonstration and the presentation.
In addition, in a demonstration or presentation using an external display device connected to the information processing apparatus, it is easy for the viewer to understand the operation of the operator, and the operator can also easily and easily operate his / her own operation. .

Preferred embodiments of the present invention will be described below with reference to the drawings.
(Embodiment 1) An information processing apparatus according to Embodiment 1 of the present invention will be described below with reference to FIGS. 1 to 7 and FIGS.

FIG. 1 is an external configuration diagram of an information processing apparatus and an external display apparatus according to the present embodiment, FIG. 2 is a functional block diagram of the information processing apparatus according to the present embodiment, and FIG. 3 is a functional block of FIG. 4 to 7 are screen display examples of the information processing apparatus according to the present embodiment, and FIGS. 14 to 18 are flowcharts showing a processing procedure of a program executed by the CPU 1 of FIG. It is.
<Configuration> FIG. 1 shows an external configuration diagram of an information processing apparatus according to the present embodiment. This information processing apparatus includes a main body 7 including a CPU, a memory, a hard disk, a keyboard, and the like, and a touch panel 4 (corresponding to an operation screen unit) provided with a sensor in a display unit. This information processing apparatus can be connected to an external display device (projection device) 5 through an external connection terminal 7, and information displayed on the touch panel 4 can be projected onto a screen (screen) 5a.

  FIG. 2 shows a functional block diagram of this information processing apparatus. As shown in FIG. 2, the information processing apparatus displays a CPU 1 (corresponding to a control unit) that executes a program, a memory 2 that stores the program, and output information of the CPU 1, and gives instructions to the CPU 1. A touch panel 4 serving as a user interface for input, and a display control unit 3 (corresponding to a first display control unit) that generates image information from the output of the CPU 1 and controls display on the touch panel 4 and the external display device 5. An external connection terminal 7 for connecting the external display device 5 to the display control unit 3 (corresponding to a connection unit) and an input mode switching key 6 for switching an input mode using the touch panel 4 (corresponding to an operation mode selection unit) And. The program executed by the CPU 1 includes an OS 11 (operating system), an input device driver 12, and a display device driver 13. The input device driver 12 and the display device driver 13 correspond to a program for displaying a sign for indicating contact detection.

  The CPU 1 executes the OS 11, the input device driver 12, the display device driver 13, and various information processing programs, and provides a function as an information processing device to the user.

  In the memory 2, an OS 11, an input device driver 12, a display device driver 13, and the like are expanded and held. The touch panel 4 is controlled by the display control unit 3 to display information on a program executed by the CPU 1, such as menus, buttons, icons, messages, and the like on the screen. Further, when the user presses a display portion such as a menu, a button, or an icon displayed on the screen by the touch panel pen 20 (hereinafter referred to as the pen 20), the touch panel 4 detects the coordinates of the pressed position, and sends it to the CPU 1. Interrupt and notify.

  The external display device 5 can be connected to the information processing device via the external connection terminal 7 and, like the touch panel 4, is controlled by the display control unit 3 to display output information of a program executed by the CPU 1. In the state where the external display device 5 is not connected, the output information of the program executed by the CPU 1 is displayed only on the touch panel 4.

  The display control unit 3 receives information from the CPU 1, expands it into display data on the screen, for example, data in a bitmap format such as menus, buttons, icons, and messages, and displays the data on the touch panel 4 and the external display device 5. .

The input mode switching key 6 is used for switching an operation mode when the user operates by touching the touch panel 4, that is, an operation mode for input by the touch panel 4. The instruction by the input mode switching key 6 is stored in the memory 2 and is referred to by the OS 11, the input device driver 12, and the display device driver 13.

  In a state where the input mode switching key 6 is not pressed (first operation mode), when the user presses a display portion such as a menu, a button, or an icon on the touch panel 4 with the pen 20, the input device driver 12 presses the touch panel 4. An event (hereinafter referred to as a pressing event) that occurs with the detection is detected. The OS 11 is notified of the pressing event and the coordinates of the pressing position by the input device driver 12. Furthermore, the OS 11 notifies these to a predetermined application program.

  As a result, in the first operation mode, the information processing apparatus according to the present embodiment has a function corresponding to the operation (corresponding to the first function) with respect to the contact operation (press) through the touch panel 4 of the user. provide.

  In a state where the input mode switching key 6 is pressed (set to the second operation mode), when the user presses a display portion such as a menu, a button, or an icon on the touch panel 4 with the pen 20, the input device driver 12 A pressing event is detected, and display coordinates for displaying a mark 21 (corresponding to a sign) on the screen are notified to the OS 11. As a result, the OS 11 instructs the display device driver 13 to display the mark 21 at this display coordinate. On the other hand, the pressing event itself is discarded by the input device driver 12 without being notified to the OS 11.

  As a result, as shown in FIG. 4, the information processing apparatus according to the present embodiment has a function corresponding to the touch operation through the screen 4a of the touch panel 4 by the pen 20 in the second operation mode. Instead of providing the above, the mark 21 for indicating the detection of contact is displayed at the contact position on the touch panel 4 and the corresponding position on the screen 5a of the external display device 5 (corresponding to the second function).

  The input device driver 12 detects a touch operation on the touch panel 4. That is, when the user presses the touch panel 4 using the pen 20, the input device driver 12 detects an event (press event) and a press position by the press operation, and notifies the OS 11 of this in the first operation mode. To do. On the other hand, in the second operation mode, the input device driver 12 discards the pressing event and notifies the OS 11 of an instruction for displaying the mark 21.

The display device driver 13 receives display information to be displayed on the touch panel 4 and the external display device 5 from the OS 11 and transmits the display information to the display control unit 3.
<Operation> FIG. 14 is a flowchart showing the processing of the input device driver 12 executed by the CPU 1 of the information processing apparatus of this embodiment. The operation of the information processing apparatus will be described below according to this flowchart.

  A register Time that holds the time when the mark 21 was last displayed is set in advance. This Time is set to Null when the displayed mark 21 is deleted or during initialization processing. That is, the value of Time is cleared.

  First, initialize Time to Null. (Step S101, hereinafter abbreviated as S101) It is determined whether Time is Null (S102). If Time is not Null, the difference between the current time and Time is compared with a predetermined value T0 (S103).

If the difference is larger than T0 as a result of comparison, the displayed mark 21 is deleted (S104), and input to the touch panel 4 is checked (S105). Ti in the process of S102
If me is determined to be Null, or if the difference between the current time and Time is determined to be T0 or less in the process of S103, the process proceeds to a check process for input to the touch panel 4 in S105.

  When the user presses the screen 4a of the touch panel 4 using the pen 20 (S106), the input device driver 12 detects the pressing operation (this is referred to as generation of a pressing event), and further calculates the coordinates of the pressing position. (S107). If there is no input to the touch panel 4, the processing relating to the time value check and the mark 21 erasing in S 102 to S 104 is repeated.

  Next, after calculating the coordinates of the pressed position in S107, the input device driver 12 determines whether or not the input mode switching key 6 is in a pressed state (S108). When this is pressed, the input device driver 12 determines that the operation mode is the second operation mode, and does not notify the OS 11 of the occurrence of an event that the user pressed the screen 4a of the touch panel 4. That is, instead of notifying the occurrence of the pressing event, the input device driver 12 generates a pressing event at a position on the touch panel 4 that is being pressed by the user or a position on the screen 5a of the external display device 5 corresponding thereto. The OS 11 is instructed to display the mark 21 indicating occurrence (corresponding to a sign for indicating contact detection) (S109).

  As a result, a command for displaying the mark 21 at the corresponding position is issued from the OS 11 to the display device driver 13, and the mark 21 is displayed by the display control unit 3 through the display device driver 13.

  After displaying this mark 21, the current time is set in Time (S10a). On the other hand, if the input mode switching key 6 is not being pressed (released), the input device driver 12 determines that the operation mode is the first operation mode, and coordinates information on the position on the touch panel 4 that the user is pressing. And the information (pressing event) which shows having detected pressing operation is notified to OS11 (S10b). Thereafter, Time is set to Null (S10c).

  First, when the mark 21 is displayed, the OS 11 first deletes it. Further, the OS 11 notifies the predetermined application program of the notified information. Thereby, the function of the original application program (or the function as the information processing apparatus) is provided.

  When the user presses the input mode switching key 6 as described above, the touch panel 4 and the external display device are marked with a mark 21 indicating that the pressing operation has been detected at the pressing position for a predetermined time. 5 (second function), the function as the information processing apparatus (first function) is not provided. On the other hand, in a state where the user has released the input mode switching key 6, the function (first function) of the information processing apparatus corresponding to the pressing operation on the touch panel 4 is provided.

For this reason, when performing a demonstration or a presentation using this information processing apparatus, the operator stops the progress of the demonstration or the like by clearly depressing the input mode switching key 6 and clearly indicates the pressing position on the touch panel 4. be able to. As a result, the viewer can easily follow the operation during the demonstration.
<Modification><Providing a Function for Information Processing Device (Providing a First Function) and Displaying a Mark for Displaying Contact Detection (Providing a Second Function)> In the first embodiment, the user ( In a state in which the operator) has pressed the input mode switching key 6, a mark 21 indicating that the pressing operation has been detected at the pressing position is displayed for a predetermined time on the screen 4 a of the touch panel 4 and the external display device. The information processing apparatus has been described in which the original function is not provided only by being displayed on the screen 5a. Instead, when the user presses the input mode switching key 6, a mark 21 indicating that the pressing operation has been detected at the pressing position is displayed for a predetermined time on the screen 4 a of the touch panel 4 with respect to the pressing operation on the touch panel 4. May be displayed on the screen 5a of the external display device 5, and an original function as an information processing device may be provided.

  A display example of the screen at this time is shown in FIG. On the screen 4a (5a) before the operation, the mark 21 indicates the previous pressing position. When the user presses the position on the touch panel 4 using the pen 20, the mark 21 moves to the pressed position, and the OK button at the pressed position functions effectively. A flowchart showing the processing in this case is shown in FIG.

  The process shown in FIG. 15 is the same as that in FIG. 14 except for the process of S109a. That is, when the input mode switching key 6 is being pressed, the input device driver 12 determines that the operation mode is the second operation mode, and the occurrence of an event due to the user pressing the screen 4a of the touch panel 4 in S109a and the pressing The coordinate information of the position on the touch panel 4 and an instruction to display the mark 21 (corresponding to a sign for indicating contact detection) on the screen 4a of the touch panel 4 and the screen 5a of the external display device 5 Notify

  Further, the OS 11 notifies the predetermined application program of the notified press event and coordinate information. Thereby, the function of the original application program (or the function as the information processing apparatus) is provided (corresponding to the first function). Further, the OS 11 issues a command to display the mark 21 at the corresponding position to the display device driver 13, and the mark 21 is displayed by the display control unit 3 through the display device driver 13 (corresponding to the second function).

  As a result, in an application program demonstration or the like, when the input mode switching key 6 is being pressed, the screen 4a of the touch panel 4 and the screen 5a of the external display device 5 are moved along with the progress of the application program according to the operation on the touch panel 4. A mark 21 indicating the pressed position is displayed. For this reason, viewers such as demonstrations can easily follow the operation of the operator.

In the above embodiment, the first operation mode and the second operation mode are switched depending on whether or not the input mode switching key 6 is being pressed. This may be switched based on the mode of operation on the touch panel 4 by the pen 20. Hereinafter, a process for identifying the operation of the first mode and the operation of the second mode by the time interval and the position interval will be described.
<Process for Identifying Operation Mode by Time Interval> First, FIG. 6 shows an example of processing for switching between the operation of the first mode and the operation of the second mode by the time interval of operation. In FIG. 6, when the user operates the screen 4 a of the touch panel 4 using the pen 20, the mark 21 is displayed at the pressed position. The mark 21 is displayed for a predetermined time exemplified by the hourglass 22. If the mark 21 is pressed again during the period in which the mark 21 is displayed, the pressing becomes effective (corresponding to the operation of the first mode), and the function of the information processing apparatus is provided.

  On the other hand, since the display of the mark 21 disappears after a predetermined time has passed since the first pressing, even if the pen 21 is pressed again (corresponding to the operation of the second mode), only the mark 21 is displayed. No function as a device is provided. The process of the input device driver 12 executed by the CPU 1 in this case is shown in the flowchart of FIG. Further, FIG. 17 shows a program process for erasing the mark 21 displayed by the process of FIG. 16 after a predetermined time.

In the process of FIG. 16, first, a variable CurrentTime that stores the current time and a variable OldTime that stores the previous time are initialized (S110). Here, the variable CurrentTime is a local variable referred to only by the program shown in FIG. On the other hand, OldTime is a global variable that is also referred to by other programs.

When the user presses the screen 4a of the touch panel 4 using the pen 20 (S111), the input device driver 12 detects the pressing operation, and first sets the current time to CurrentTime (S112). Next, the input device driver 12 calculates the coordinates of the pressed position (S113).

Next, the input device driver 12 stores the time of the previously detected input operation (stored in OLdTime).
It is determined whether or not a predetermined time n has elapsed from the time of the input operation detected this time (stored in CurrentTime) (S114).

  Here, when the predetermined time n has elapsed, the input device driver 12 determines that the operation mode is the second operation mode, and does not notify the OS 11 of the occurrence of the event that the user pressed the screen 4a of the touch panel 4. That is, instead of notifying the occurrence of the pressing event, the input device driver 12 generates the pressing event at the position on the touch panel that the user is pressing and the position on the screen 5a of the external display device 5 corresponding thereto. The OS 11 is instructed to display the mark 21 (corresponding to a sign for indicating contact detection) (S115). As a result, a command for displaying the mark 21 at the corresponding position is issued from the OS 11 to the display device driver 13, and the mark 21 is displayed by the display control unit 3 through the display device driver 13. The mark 21 is erased after being displayed for a predetermined time as described later.

  On the other hand, when the predetermined time n has not elapsed, the input device driver 12 determines that the operation mode is the first operation mode, and has detected that the coordinate information and the pressing operation of the position on the touch panel that the user is pressing are detected. The information shown is notified to the OS 11 (S116).

  First, when the mark 21 is displayed, the OS 11 first deletes it. Further, the OS 11 notifies the predetermined application program of the notified information. Thereby, the function of the original application program (or the function as the information processing apparatus) is provided.

Further, when no pressing operation is detected for a predetermined time since the previous pressing operation, a program for executing the processing shown in FIG. 17 is started from a timer built in the OS 11 and the mark 21 is deleted. When started, this program first records the current time in a local variable LocalTime (S210). Next, it is determined whether or not a predetermined time n has elapsed from the time of the previously detected input operation (stored in the global variable OLdTime) to the current time (stored in LocalTime) (S211). If the predetermined time has not elapsed, the process is terminated. If the predetermined time has elapsed, the OS 11 is instructed to delete the mark 21 on the screen (S212). Further, a time for starting this program next time is set (S213), and the process is terminated. As described above, this program is periodically started by the start from the timer, and the above processing is repeated.

  As described above, in response to a pressing operation on the touch panel 4 by a user at a predetermined time interval, a mark 21 indicating that an event of the pressing operation is detected at the pressing position of the touch panel 4 and the external display device 5 for a predetermined time. It is only displayed on the screen 5a (second function), and the function as the information processing apparatus (first function) is not provided. On the other hand, the function (first function) of the information processing apparatus corresponding to the pressing operation to the touch panel 4 within a predetermined time interval by the user is provided.

For this reason, when performing a demonstration, a presentation, etc. using this information processing apparatus, by adjusting the time interval of the pressing operation on the touch panel 4, the operator stops the progress of the demonstration and the like and presses the touch panel 4. The position can be specified. As a result, the viewer can easily follow the operation during the demonstration.
<Process for Identifying Operation Mode by Position Interval> In the above modification, the processing of the information processing apparatus that switches between the operation of the first mode and the operation of the second mode by the time interval of the pressing operation on the touch panel 4 will be described. did. Instead of this time interval, it may be switched according to the interval between the coordinates of two points pressed continuously. An example of the operation at this time is shown in FIG.

  In FIG. 7, when the user operates the screen 4 a of the touch panel 4 using the pen 20, a mark 21 is displayed at the pressed position. When a position within a predetermined distance from the mark 21 (a range indicated by a dotted line 23 in FIG. 7) is pressed again, the pressing becomes effective (corresponding to the operation of the first mode), and the function of the information processing apparatus is Provided. On the other hand, even if the position away from the first pressing position by a predetermined distance or more is pressed again by the pen 20 (corresponding to the operation of the second mode), the mark 21 is only moved and displayed at that position, A function as an information processing apparatus is not provided. The process of the input device driver 12 executed by the CPU 1 in this case is shown in the flowchart of FIG.

  First, the input device driver 12 initializes a variable CurrentCord for holding the coordinates of the current pressing position and a variable OldCord for holding the coordinates of the previous pressing position (S120).

Next, the user operates the touch panel 4 (S121). Thereafter, the input device driver 12 detects the coordinates of the pressed position and stores it in CurrentCord (S12).
3).

Next, the input device driver 12 determines the coordinates (OldCord) of the pressed position operated by the user last time.
) And the current coordinate (CurrentCord), and it is determined whether or not a predetermined distance (d) is away from the previous operation position (S124).

  When the input device driver 12 is away from a predetermined distance (d) from the previous pressing position, the input device driver 12 determines that the operation is in the second mode, and causes the OS 11 to generate an event due to the user pressing the screen 4a of the touch panel 4. Do not notify. That is, instead of notifying the occurrence of the pressing event, the input device driver 12 marks the position on the screen 4a of the touch panel 4 pressed by the user and the position on the screen 5a of the external display device 5 corresponding thereto. The OS 11 is instructed to display 21 (corresponding to a sign for indicating contact detection) (S125).

  On the other hand, if it is within a predetermined distance (d) from the previous pressing position, the input device driver 12 determines that the operation is the operation of the first aspect, and the coordinate information of the position on the touch panel 4 that the user is pressing. The OS 11 is notified of a pressing event indicating that a pressing operation has been detected (S126).

  Even if the user repeatedly presses the touch panel 4 away from the predetermined distance (d) as described above, the mark 21 indicating that the pressing operation is detected at the pressed position is displayed on the screen 4a of the touch panel 4 and the external display device 5. The function as an information processing apparatus is not provided. On the other hand, when the user presses the touch panel 4 a plurality of times within a predetermined distance (d), the function of the information processing apparatus corresponding to the operation is provided.

Therefore, as in the first embodiment, when performing a demonstration or a presentation using the information processing apparatus, the operator stops the progress of the demonstration by adjusting the position of the pressing operation on the touch panel 4. The pressing position on the touch panel 4 can be clearly indicated. As a result, the viewer can easily follow the operation during the demonstration.
<Other Modifications> In this embodiment, in the second operation mode, the input device driver 12, the OS 11, and the display device driver 13 display the mark 21 at the position pressed by the pen 20, but these are the OS 11 and the input Any one or a combination of one or more of the device driver 12 and the display device driver 13 may be performed.

  In addition, these processes are performed in the middle of other programs, for example, the OS 11 and individual application programs (this is called middleware, for example, a window system for converting a character user interface OS into a graphical user interface). Alternatively, it may be performed in an individual application program.

  When this processing is performed by middleware such as a window system, the functions of this embodiment are uniformly realized by all application programs that use this window system and the like, as in the information processing apparatus of this embodiment. On the other hand, even if the above processing is realized by an individual application program, the function is realized only by the application program.

  In the first embodiment, an example in which the touch panel 4 is pressed and operated with the pen 20 has been shown, but the embodiment of the present invention is not limited thereto. For example, you may use the touch panel 4 operated with a human finger.

In the above modification, the time interval of pressing on the touch panel 4 or the interval of pressing positions is used to identify the mode of operation, but the implementation of the present invention is not limited to these. For example, the length of one pressing time for pressing the touch panel 4, a pressing operation to the same position continuously several times (an operation similar to a double click and a triple click with a mouse), and a locus for operating the screen 4a with the pen 20 The operation of the first aspect or the operation of the second aspect may be identified by (for example, whether a closed curve is included) or the like.
(Embodiment 2) An information processing apparatus according to Embodiment 2 of the present invention will be described with reference to FIGS. 8 to 13 show display examples of the screen 4a of the touch panel 4 and the screen 5a of the external display device 5 provided in the information processing apparatus.

  The configuration of the information processing apparatus and the program processing according to the second embodiment are the same as those of the first embodiment, and will be described with reference to FIGS. 2 and 14 to 18 as necessary. As described above, the configuration of this information processing apparatus is shown in FIG. 2 as in the first embodiment. However, the display control unit 3 in FIG. 2 according to the second embodiment assumes that the information cannot be displayed on the touch panel 4 when the external display device 5 is connected. For this reason, the user presses and operates the screen 4a of the touch panel 4 on which no information is displayed as shown in FIGS.

  FIG. 8 shows an example (corresponding to the second operation mode) in which the user operates by pressing the input mode switching key 6. In this state, when the user presses the screen 4 a of the touch panel 4 using the pen 20, a mark 21 (corresponding to a sign) is displayed at a corresponding position on the screen 5 a of the external display device 5. Furthermore, the mark 21 is erased when a predetermined time elapses from the pressing.

On the other hand, this information processing device provides the original function when the user input mode switching key 6 is released and operated (corresponding to the first operation mode). This process can be shown in the flowchart of FIG. 14 as in the first embodiment. As described above, the user looks at the mark 21 displayed on the screen 5a of the external display device 5, confirms the position of the screen 4a of the corresponding touch panel 4, and then operates a desired menu, button, icon, or the like. be able to.
<Modification> FIG. 9 shows an example of a display screen that provides a function as an information processing apparatus and displays a pressed position of the touch panel 4. That is, when the user presses the input mode switching key 6 (second operation mode), the mark 21 is displayed at the previous pressing position on the screen 5 a of the external display device 5. In this state, when the user newly presses the screen 4 a of the touch panel 4 with the pen 20, the mark 21 moves to the position of the screen 5 a of the external display device 5 corresponding to the position, and the function (indicator corresponding to the position of the mark 21 is indicated. Corresponding to the function indicated by).

  On the other hand, when the user does not press the input mode switching key 6 (first operation mode), the mark 21 is not displayed on the screen 5 a of the external display device 5. When the user presses the screen 4a of the touch panel 4 with the pen 20 in this state, the function of the information processing apparatus corresponding to the operation is provided. This process can be shown in the flowchart of FIG. 15 as in the first embodiment.

  FIG. 10 shows an example in which the operation mode is identified by the time interval of the pressing operation. That is, when the user presses the screen 4a of the touch panel 4, the mark 21 is displayed. The mark 21 disappears after a predetermined time. When the user performs a pressing operation again while the mark 21 is displayed, the operation becomes valid (operation of the first mode), and the original function as the information processing apparatus is provided.

  On the other hand, even if the pressing operation is performed again after the mark 21 disappears (operation in the second mode), only the mark 21 is displayed again, and the function as the information processing apparatus corresponding to this operation is not provided. This processing can be shown by the flowcharts of FIGS. 16 and 17 as in the case of the first embodiment.

  In this way, when performing a demonstration or a presentation using this information processing apparatus, the operator stops the progress of the demonstration or the like by adjusting the time interval of the pressing operation on the touch panel 4, and The pressing position can be specified. As a result, the viewer can easily follow the operation during the demonstration. In addition, the user adjusts the time interval of the pressing operation, sees the mark 21 displayed on the screen 5a of the external display device 5, confirms the position on the screen 4a of the corresponding touch panel 4, and then selects a desired one. Menus, buttons or icons can be operated.

  FIG. 11 shows an example in which the mode of operation is identified by the distance of the pressed position. That is, when the user presses the screen 4 a of the touch panel 4, the mark 21 is displayed at a corresponding position on the screen 5 a of the external display device 5. Next, when an area within a predetermined distance from the pressing position (area indicated by a circle 24 in FIG. 11) is pressed again, the original function of the information processing apparatus corresponding to the pressing operation is provided (operation of the first mode). .

  On the other hand, even if the position away from the display position of the mark 21 by a predetermined distance or more is pressed again (operation of the second mode), the mark 21 only moves to that position, and the information processing apparatus corresponding to this operation No functionality is provided.

This process can be shown in the flowchart of FIG. 18 as in the first embodiment. As described above, the user looks at the mark 21 displayed on the screen 5a of the external display device 5 by adjusting the distance between successive pressing positions, and confirms the position on the screen 4a of the corresponding touch panel 4. Thereafter, a desired menu, button, icon or the like can be operated.
(Embodiment 3) An information processing apparatus according to Embodiment 3 of the present invention will be described with reference to FIG. 3, FIG. 12, and FIG. FIG. 3 is a functional block diagram of this information processing apparatus, and FIGS. 12 and 13 show examples of display on the screen 4a of the touch panel 4 and the screen 5a of the external display device 5. FIG.

  As shown in FIG. 3, the information processing apparatus includes two display control units 3a and 3b. Other configurations are the same as those of the first embodiment, and the same configurations are denoted by the same reference numerals as those in FIG. 2 and description thereof is omitted.

  As shown in FIG. 3, the display control unit 3 a (corresponding to the first display control unit) controls the display on the touch panel 4, while the display control unit 3 b (corresponding to the second display control unit) is directed to the external display device 5. Control the display of. Therefore, in the information processing apparatus according to the present embodiment, different information, for example, different menus, buttons, icons, messages, or the like can be displayed on the touch panel 4 and the external display device 5.

  FIG. 12 shows an example in which the display of the mark 21 is switched between the screen 4 a of the touch panel 4 and the screen 5 a of the external display device 5 according to the pressed state of the input mode switching key 6. That is, in a state where the input mode switching key 6 is not pressed (corresponding to the first operation mode), the mark 21 is displayed on the screen 4 a of the touch panel 4. In this state, menus, buttons, icons, etc. on the touch panel 4 can be operated.

  On the other hand, when the input mode switching key 6 is pressed (corresponding to the second operation mode), a mark 21 is placed at a position on the screen 5a of the external display device 5 corresponding to the previous pressed position on the screen 4a of the touch panel 4. Is displayed. In this state, as shown in FIG. 13, the operation of the pen 20 on the screen 4 a of the touch panel 4 is displayed as it is on the screen 5 a of the external display device 5. That is, the movement of the mark 21 on the screen 5 a of the external display device 5 can be controlled by operating the touch panel 4.

The mark 21 is moved in a one-to-one correspondence between the coordinates of the touch panel 4 and the coordinates of the external display device 5. As a result, a menu, button, or icon displayed only on the screen 5a of the external display device 5 different from the touch panel 4 is operated to provide a function of a corresponding application program (corresponding to a function indicated by a sign). It becomes possible to receive.
<Modification> In the third embodiment, the movement of the mark 21 displayed on the screen 5a of the external display device 5 is performed in a one-to-one correspondence between the coordinates of the touch panel 4 and the coordinates of the external display device 5. Instead, the movement of the mark 21 displayed on the screen 5a of the external display device 5 is controlled by sliding the pen 20 on the touch panel 4 and relatively calculating the displacement (movement distance and direction). May be.
(Embodiment 4) The input device driver 12 and the display device driver 13 described in Embodiment 1 or the middleware such as the window system described in <Other Modifications> is recorded on a computer-readable recording medium. Is executed by the computer and executed together with the OS 11 and various application programs provided in the computer, the information processing apparatus according to the present embodiment can be realized.

That is, in the implementation of the present invention, the operation mode of the information processing apparatus using the operation screen unit (for example, the touch panel 4) capable of displaying information and detecting the touch operation on the surface is set as the first operation mode or the first operation mode. Two operation modes are set, information is displayed on at least one of the operation screen unit or the other external display device 5, a contact operation through the operation screen unit is detected, and the first operation mode is the operation screen unit The first function corresponding to this operation is provided for the contact operation through the second operation mode, and the second operation mode is the first function corresponding to this operation for the contact operation through the operation screen unit. In addition to providing the first function or providing the first function, at least one of the contact position and the display position of the external display device 5 determined based on the contact operation is a sign for indicating contact detection Display Recording the program on a computer-readable recording medium may be executed by loading it into the computer. Therefore, it is not always necessary to record the entire OS 11 or the entire window system on the recording medium.

  Here, the computer-readable recording medium refers to a recording medium in which information such as data and programs is accumulated by electrical, magnetic, optical, mechanical, or chemical action and can be read from a computer. Examples of such a recording medium include a floppy disk, a magneto-optical disk, a CD-ROM, a CD-R / W, a DVD, a DAT, an 8 mm tape, and a memory card. This program can be stored in a hard disk or memory of a computer and distributed to other computers through a communication line. As a result, the input device driver 12 and the display device driver 13 or a computer that has received middleware such as the window system can function as the information processing apparatus of the present embodiment.

As an information processing apparatus according to an embodiment of the present invention, a general computer hardware configuration in which a program of the present invention recorded on a hard disk is expanded in a memory and a CPU executes the program is shown, but the present invention is not limited thereto. It is not something. For example, the present invention can be implemented with a hardware configuration of a computer configured to record the program of the present invention in a ROM instead of a hard disk and cause the CPU to execute the program.
(Fifth Embodiment) In the first to third embodiments, the information processing apparatus using the touch panel 4 as a pointing device has been described. However, the present invention is not necessarily limited thereto. For example, even in an information processing apparatus using a mouse as a pointing device, an operator's coordinate instruction using the mouse, for example, a coordinate instruction input by a button click, is detected and the mark 21 of the present invention is displayed at the coordinate position. Good. FIG. 19 shows a functional block diagram when the mouse 8 is used as the pointing device and the CRT 9 is used as the display device. In FIG. 19, other configurations are the same as those in FIG. 1, and the same components are denoted by the same reference numerals and description thereof is omitted. In this case, the input driver 12 detects a button click of the mouse 8 instead of the touch operation on the touch panel. Other processes are the same as those in the flowcharts of FIGS. Note that a larger external display device may be connected to the configuration of FIG.

  In the present embodiment, the mark 21 is not a mouse cursor that follows the movement of the mouse 8, but a mark that clearly indicates the position where the button of the mouse 8 is pressed (called click) (corresponding to a sign).

Thus, the viewer can follow the operation of the operator, and can easily understand the operation method of the information processing apparatus and the application program.

The external appearance block diagram of the information processing apparatus which concerns on embodiment of this invention. The functional block diagram of the information processing apparatus which concerns on embodiment of this invention. The functional block diagram of the information processing apparatus which concerns on Embodiment 3 of this invention. 4 is a screen display example of the information processing apparatus according to the first embodiment. 4 is a screen display example of the information processing apparatus according to the first embodiment. 4 is a screen display example of the information processing apparatus according to the first embodiment. 4 is a screen display example of the information processing apparatus according to the first embodiment. 10 is a screen display example of the information processing apparatus according to the second embodiment. 10 is a screen display example of the information processing apparatus according to the second embodiment. 10 is a screen display example of the information processing apparatus according to the second embodiment. 10 is a screen display example of the information processing apparatus according to the second embodiment. 10 is a screen display example of the information processing apparatus according to the third embodiment. 10 is a screen display example of the information processing apparatus according to the third embodiment. The flowchart which shows the process sequence of the program run by CPU1. The flowchart which shows the process sequence of the program run by CPU1. The flowchart which shows the process sequence of the program run by CPU1. The flowchart which shows the program processing procedure which erases the mark started by a timer. The flowchart which shows the process sequence of the program run by CPU1. The functional block diagram of the information processing apparatus which concerns on Embodiment 5 of this invention.

Explanation of symbols

1 CPU
3 Display control unit 4 Touch panel 5 External display device 6 Input mode switching key 7 External connection terminal 11 OS
12 Input device driver 13 Display device driver 21 Mark

Claims (10)

An operation screen capable of displaying information and detecting a touch operation on the surface;
A connection unit for connecting a display device capable of displaying information in addition to the operation screen unit,
A display control unit that controls to display different information on the operation screen unit and the display device ;
An operation mode selection unit for selecting any one of two or more operation modes for the contact operation;
The first operation mode is a first function which is a function of the predetermined application program by detecting the coordinates of the pressing position of the pressing operation on the operation screen unit and notifying the detected coordinates to the predetermined application program. Provide
In the second operation mode, for the contact operation through the operation screen unit, instead of providing the first function corresponding to the contact operation, or together with providing the first function, the operation screen An information processing apparatus that provides a second function of displaying a sign for indicating detection of contact at a display position of the display apparatus determined based on a pressing operation on a unit.   The information processing apparatus according to claim 1, wherein the display control unit deletes the sign after displaying the sign for a predetermined time.   When the elapsed time from the previous coordinate instruction to the subsequent coordinate instruction is longer than the predetermined time, the display control unit erases the sign displayed by the previous coordinate instruction and displays the sign at the later designated coordinate. The information processing apparatus according to claim 2. An operation screen capable of displaying information and detecting a touch operation on the surface;
A connection unit for connecting a display device capable of displaying information in addition to the operation screen unit,
A display control unit that controls to display different information on the operation screen unit and the display device ;
A control unit for determining a mode of operation through the operation screen unit,
For the contact operation of the first aspect in which the pressing operation on the operation screen unit is performed again within a predetermined time after the pressing operation on the operation screen unit is performed, the pressing position of the pressing operation on the operation screen unit is changed. The coordinates are detected, and the detected coordinates are notified to a predetermined application program, thereby providing a first function that is a function of the predetermined application program and being determined based on a pressing operation on the operation screen unit. Providing a second function of displaying a sign for indicating detection of contact at a display position of the display device;
The display control unit performs the second operation for the contact operation according to the second aspect in which, after performing the pressing operation on the operation screen unit, the pressing operation on the operation screen unit is not performed again within a predetermined time. An information processing device that provides functions.   The information processing apparatus according to claim 4, wherein the display control unit deletes the sign after displaying the sign for a predetermined time.   When the elapsed time from the previous coordinate instruction to the subsequent coordinate instruction is longer than the predetermined time, the display control unit erases the sign displayed by the previous coordinate instruction and displays the sign at the later designated coordinate. The information processing apparatus according to claim 5. An information processing device using an operation screen capable of displaying information and detecting a touch operation on the surface is set to any one of two or more operation modes,
Control so that different information is displayed on the operation screen unit and the display device ,
Detecting a contact operation through the operation screen,
The first operation mode is a first function which is a function of the predetermined application program by detecting the coordinates of the pressing position of the pressing operation on the operation screen unit and notifying the detected coordinates to the predetermined application program. Provide
In the second operation mode, for the contact operation through the operation screen unit, instead of providing the first function corresponding to the contact operation, or together with providing the first function, the operation screen A computer-readable recording medium having recorded thereon a program for providing a second function of displaying a sign for indicating contact detection at a display position of the display device determined based on a pressing operation on a unit. Control so that different information is displayed on the operation screen unit and display device that can detect contact operation on the surface,
Detecting a contact operation through the operation screen,
Determine the mode of operation through the operation screen,
For the operation of the first aspect in which the pressing operation on the operation screen unit is performed again within a predetermined time after the pressing operation on the operation screen unit, the coordinates of the pressing position of the pressing operation on the operation screen unit And detecting the detected coordinates to a predetermined application program to provide a first function that is a function of the predetermined application program, and to be determined based on a pressing operation on the operation screen unit Providing a second function of displaying a sign for indicating detection of contact at a display position of the display device;
A program that provides the second function for the contact operation of the second mode in which the pressing operation on the operation screen unit is not performed again within a predetermined time after the pressing operation on the operation screen unit is performed. A recorded computer-readable recording medium. An operation screen capable of displaying information and detecting a touch operation on the surface;
A connection unit for connecting a display device capable of displaying information in addition to the operation screen unit,
A display control unit that controls to display different information on the operation screen unit and the display device ;
A control unit for determining a mode of operation through the operation screen unit,
For the contact operation of the first aspect in which the pressing position of the pressing operation on the operation screen portion is within a predetermined distance from the pressing position of the pressing operation on the operation screen portion, the pressing operation on the operation screen portion is By detecting the coordinates of the pressed position and notifying the detected coordinates to a predetermined application program, the first function as a function of the predetermined application program is provided, and based on the pressing operation on the operation screen unit Providing a second function of displaying a sign for indicating detection of contact at the determined display position of the display device;
The display control unit performs the second operation for the contact operation of the second mode in which the pressing position of the pressing operation on the operation screen unit is a predetermined distance or more from the pressing position of the pressing operation on the operation screen unit. An information processing apparatus that provides two functions. Control so that different information is displayed on the operation screen unit and display device that can detect contact operation on the surface,
Detecting a contact operation through the operation screen,
Determine the mode of operation through the operation screen,
For the contact operation of the first aspect in which the pressing position of the pressing operation on the operation screen portion is within a predetermined distance from the pressing position of the pressing operation on the operation screen portion, the pressing operation on the operation screen portion is By detecting the coordinates of the pressed position and notifying the detected coordinates to a predetermined application program, the first function as a function of the predetermined application program is provided, and based on the pressing operation on the operation screen unit Providing a second function of displaying a sign for indicating detection of contact at the determined display position of the display device;
The second function is provided with respect to the contact operation of the second aspect in which the pressing position of the pressing operation on the operation screen unit is a predetermined distance or more from the pressing position of the pressing operation on the operation screen unit. A computer-readable recording medium on which a program is recorded.

Images