JP2007207281A - Information input/output device, information input/output control method, recording medium, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an information input/output device which enables an operator at any location to start processing performed by a computer such as display or erasure of a tool bar, e.g. <P>SOLUTION: The device is provided with a panel 104 and a coordinate control part 107 which detects a touched point on the panel and generates a signal concerning the detected point. The coordinate control part 107 generates a coordinate signal which shows the coordinates of the touched point when detecting that one point on the panel 104 is touched, and generates a coordinate signal which shows control set in advance according to the number of touched points when detecting that two or more points on the panel 104 are touched. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an information input / output device, an information input / output control method, a recording medium, and a program.

  Currently, touch panel type information input / output devices that operate a computer by touching the touch panel with a finger or a dedicated pen are widely used. Also, in recent years, in classes such as school classes and corporate meetings, it has become widespread to explain the contents of classes and meetings by displaying pre-created documents and data, internet screens, and video playback screens on large monitors. I'm starting.

  In the information input / output device described above, when the touch panel panel is integrated with the monitor, the speaker operates the computer by pointing to the screen displayed on the monitor, and switches the screen or processes the screen. be able to. For this reason, operating a computer with a large monitor using the touch panel method makes it easy to see what part of the screen displayed on the monitor is currently being explained. Has the advantage that the explanation is easy to understand because it is updated in conjunction with the contents of the explanation smoothly.

  By the way, general-purpose computer software has a function of displaying a toolbar. The toolbar is advantageous in that processing items and functions performed by the computer can be easily selected from the screen currently displayed on the monitor. On the other hand, the toolbar uses a part of the screen for display, and has a drawback of reducing the space for displaying the screen.

  As conventional techniques for solving the above-described drawbacks, for example, there are inventions described in Patent Document 1 and Patent Document 2. In the invention described in Patent Document 1, a button for scrolling and displaying a button for selecting a function is provided on the toolbar itself, and the number of buttons (that can be displayed by one toolbar in a space for displaying one toolbar is larger). All buttons) can be displayed.

  Furthermore, the invention described in Patent Document 1 is provided with a button for changing the display position of the toolbar to the corner of the window on the toolbar, and moving the toolbar initially displayed at the top of the screen of the application to the corner of the window. Is no longer narrowed by the toolbar display.

  In the invention described in Patent Document 2, a toolbar is displayed as a three-dimensional figure, and a button for selecting a function is provided on each surface of the three-dimensional toolbar. Then, the toolbar displayed three-dimensionally is rotated, and a toolbar that can select more function buttons using the display area for one toolbar is configured. In the invention described in Patent Document 2, a toolbar is displayed at the top of the application screen.

Japanese Patent Laid-Open No. 10-091384 Japanese Patent Laid-Open No. 11-119965

  However, the screens used for explanations for a large number of listeners such as classes and conferences are generally large enough that the speakers cannot point to the entire area while standing at a certain position (hereinafter referred to as the screen). Such a screen is called a large screen). For this reason, a speaker who explains the content displayed on the large screen moves according to the explanation and points to the screen.

  In the above-mentioned large screen, if the toolbar is displayed at a fixed position such as the top of the screen or the corner of the window as in the prior art, the speaker needs to move to the position of the toolbar each time the toolbar is used. is there. The frequent movement of the presenter not only increases the load on the presenter, but also makes it difficult for the person receiving the explanation to concentrate on the explanation and gives an unpleasant impression.

  In addition, the large screen is generally large in the vertical direction, and the upper end portion is often set to a height higher than the height of the speaker. For this reason, when the tool bar is displayed at a fixed position as in the prior art, depending on the display position, there is a possibility that a speaker may not reach the tool bar and it is difficult to operate the tool bar.

  Furthermore, the above-described conventional techniques are all based on the assumption that a toolbar is displayed. However, the toolbar can generally be displayed and deleted, and the display and deletion of the toolbar by touch panel input is switched by the speaker touching the position set on the screen. . For this reason, on a large screen, even when displaying or deleting a toolbar, it was necessary to move from the current position of the speaker to a position set for switching between displaying and deleting the toolbar.

  In addition, as a proposal for solving the above-described problems, only in the touch panel method, a processing function by a computer is assigned to one of input operations such as click and double click, and a specific function is started from an arbitrary position. Conceivable. However, the relationship between operations such as clicking, double-clicking, and right-clicking, and the program is common to all operating systems (OS). For this reason, it is not preferable to assign an operation common to the operation with the mouse to another process only on the touch panel because it may affect other programs.

  The present invention has been made in view of the above, and an information input / output device and an information input / output capable of starting a process performed by a computer, for example, displaying or erasing a toolbar, at an arbitrary position A first object is to provide a control method, a recording medium, and a program.

  The present invention also provides an information input / output device, an information input / output control method, a recording medium, and a program that do not affect other programs in achieving the first object. Objective.

  Furthermore, the present invention further prevents an inconvenience that may occur in a large-screen touch panel, and can improve the operability of the large-screen touch panel, an information input / output device, an information input / output control method, A third object is to provide a recording medium and a program.

  In order to solve the above-described problems and achieve the object, an information input / output device according to claim 1 is a touch panel, touch point detecting means for detecting a touched point on the touch panel, and the touch. Signal generating means for generating a signal related to a point detected by the point detecting means, and the signal generating means detects that one point on the touch panel is touched within a predetermined time. If the touch point detecting means detects that two or more points on the touch panel are touched within a predetermined time, a coordinate signal indicating the coordinates of the touched point is generated. A control signal indicating computer control that is set in advance according to the number of points that are made is generated.

  According to the first aspect of the present invention, when it is detected that two or more points are touched within a predetermined time, a control preset according to the number of touched points is shown. A control signal can be generated. Therefore, an operation of touching two or more points within a predetermined time can be an operation for generating a control signal peculiar to touch-type coordinate input.

  In the information input / output device according to the second aspect of the present invention, when two or more touches on the touch panel are detected by the touch point detection unit, the touch points between the touched points based on the detection result are detected. An interval length calculation unit that calculates an interval length that is a length reflecting the interval, and the signal generation unit performs the control when the interval length calculated by the interval length calculation unit is equal to or greater than a predetermined length. It is characterized in that no signal is generated.

  According to the second aspect of the present invention, the interval length, which is the length reflecting the interval between the touched points, is compared with a predetermined length, and the control signal is generated according to the comparison result. Can be eliminated.

  The information input / output device according to a third aspect of the present invention is the information input / output device according to the present invention, wherein the interval length calculation unit calculates x coordinates of all the points that may have been touched based on the detection result of the touch point detection unit. Each of the difference between the maximum value and the minimum value and the difference between the maximum value and the minimum value of the y coordinate is calculated as an interval length, and the control signal generation unit is configured to calculate the difference between the maximum value and the minimum value of the x coordinate, y The control signal is not generated when at least one of the difference between the maximum value and the minimum value of the coordinates is equal to or longer than a predetermined length.

  According to the third aspect of the present invention, the maximum distance in the x direction between the touched points and the maximum distance in the y direction are compared with a predetermined length, and a control signal is generated according to the comparison result. Can be eliminated.

  In the information input / output device according to claim 4, when the control signal is output to a computer having a display screen, at least one of the control signals displays a toolbar on the display screen with respect to the computer. It is characterized by making it.

  According to the fourth aspect of the present invention, the tool bar can be displayed on the display screen from an arbitrary screen.

  The information input / output device according to the invention described in claim 5 further obtains touch candidate points for obtaining points that may have been touched when two or more points are touched within a predetermined time on the touch panel. And the control signal causes the tool bar to be displayed in an area of the display screen corresponding to an area surrounded by a straight line passing through the touch candidate points.

  According to the invention described in claim 5, when two or more points are touched within a predetermined time, a touch candidate point that may have been touched is obtained, and is surrounded by a straight line passing through the touch candidate point. Toolbar can be displayed in the area.

  The information input / output device according to claim 6, wherein the control signal uses the tool bar as an x-coordinate of an average value of a maximum value and a minimum value of x coordinates of the touch candidate points, and the touch The display corresponding to a plurality of touch detection points determined using an average value of the maximum value and the minimum value of the y coordinates among the candidate points as a y coordinate, or a point at a distance equal to or less than a predetermined distance from the plurality of touch detection points. It is characterized by being displayed at points on the screen.

  According to the sixth aspect of the present invention, when two or more points are touched within a predetermined time, a touch candidate point that may have been touched is obtained and surrounded by a straight line passing through the touch candidate point. A toolbar can be displayed in the approximate center of the area to be displayed or in the vicinity thereof.

  An information input / output device according to a seventh aspect of the invention is characterized in that the control signal is a signal in which computer control is associated with at least one of two to ten touches.

  According to the seventh aspect of the present invention, it is possible to assign at least one of 2 to 10 points that can be simultaneously touched by a human using a hand to a control signal.

  The information input / output device according to an eighth aspect of the present invention is the information input / output device, in which the signal generating unit is touched within a predetermined time by the touch point detecting unit within a predetermined area on the touch panel. The control signal is generated only when it is detected.

  According to the eighth aspect of the present invention, it is possible to generate a control signal by touching two or more points only within a preset area on the touch panel.

  In the information input / output device according to the ninth aspect, when the touch point detection unit detects that two or more points on the touch panel are touched within a predetermined time, all the detected points are detected. The touch on the touch panel is not detected until the detachment is detected.

  According to the ninth aspect of the present invention, a point that is still touched when only a part of the touches of two or more touched points is detached is a newly touched point. Misrecognition can be prevented.

  An information input / output control method according to claim 10 includes a touch point detection step of detecting a touched point on the touch panel, and one point on the touch panel within a predetermined time in the touch point detection step. When a touch signal is detected, a coordinate signal indicating the coordinates of the touched point is generated, and it is detected that two or more points on the touch panel are touched within a predetermined time. A signal generation step of generating a control signal indicating control preset according to the number of touched points.

  According to the tenth aspect of the present invention, when it is detected that two or more points are touched within a predetermined time, control preset according to the number of touched points is shown. A control signal can be generated. Therefore, an operation of touching two or more points within a predetermined time can be an operation for generating a control signal peculiar to touch-type coordinate input.

  In the information input / output control method according to claim 11, when two or more touches on the touch panel are detected in the touch point detection step, the touched points are detected based on the detection result. An interval length calculating step of calculating an interval length that is a length reflecting the interval of the signal, wherein the signal generating step is performed when the interval length calculated in the interval length calculating step is equal to or greater than a predetermined length. The control signal is not generated.

  According to the eleventh aspect of the invention, the predetermined length is compared with the interval length, which is the length reflecting the interval between the touched points, and the control signal is generated according to the comparison result. Can be eliminated.

  In the information input / output control method according to a twelfth aspect of the present invention, the interval length calculation step is based on a result of detection performed in the touch point detection step, out of all points that may have been touched. Each of the difference between the maximum value and the minimum value of the x coordinate and the difference between the maximum value and the minimum value of the y coordinate is calculated as an interval length, and the control signal generating step includes: The control signal is not generated when at least one of the difference between the maximum value and the minimum value of the y coordinate is equal to or longer than a predetermined length.

  According to the twelfth aspect of the present invention, the maximum distance between the touched points in the x direction and the maximum distance in the y direction are compared with a predetermined length, and a control signal is generated according to the comparison result. Can be eliminated.

  In the information input / output control method according to the thirteenth aspect of the present invention, when the control signal is output to a computer having a display screen, at least one of the control signals provides a toolbar on the display screen to the computer. It is characterized by being displayed.

  According to the invention of the thirteenth aspect, the tool bar can be displayed on the display screen from an arbitrary screen.

  The information input / output control method according to the fourteenth aspect of the present invention is the touch candidate point for obtaining a point that may be touched when two or more points are touched within a predetermined time on the touch panel. An acquisition step, wherein the control signal causes the toolbar to be displayed in an area on the display screen corresponding to an area surrounded by a straight line passing through the touch candidate points.

  According to the invention described in claim 14, when two or more points are touched within a predetermined time, a touch candidate point that may have been touched is obtained, and is surrounded by a straight line passing through the touch candidate point. Toolbar can be displayed in the area.

  In the information input / output control method according to claim 15, the control signal uses the tool bar as an x-coordinate of an average value of a maximum value and a minimum value of the x-coordinates of the touch candidate points, and The touch detection points corresponding to a plurality of touch detection points determined using an average value of the maximum value and the minimum value of the y coordinates as the y coordinates, or points at a distance equal to or less than a predetermined distance from the plurality of touch detection points. It is characterized by being displayed at points on the display screen.

  According to the fifteenth aspect of the present invention, when two or more points are touched within a predetermined time, a touch candidate point that may have been touched is obtained, and is surrounded by a straight line passing through the touch candidate point. A toolbar can be displayed in the approximate center of the area to be displayed or in the vicinity thereof.

  The information input / output control method according to claim 16 is characterized in that the control signal is a signal in which control by a computer is associated with at least one of two to ten touches. .

  According to the sixteenth aspect of the present invention, at least one of two to ten points that can be simultaneously touched by a human using a hand can be assigned to the control signal.

  In the information input / output control method according to claim 17, in the signal generation step, two or more points touch within a predetermined time in a predetermined area on the touch panel in the touch point detection step. The control signal is generated only when it is detected that the operation has been performed.

  According to the seventeenth aspect of the present invention, the control signal can be generated by touching two or more points only within a preset area on the touch panel.

  In the information input / output control method according to claim 18, in the touch point detection step, when it is detected that two or more points on the touch panel are touched within a predetermined time, all the detected points are detected. The touch on the touch panel is not detected until the detachment of the point is detected.

  According to the eighteenth aspect of the present invention, when only a part of the touches of two or more touched points are detached, a point that is still touched is a newly touched point. Misrecognition can be prevented.

  According to a nineteenth aspect of the present invention, there is provided a recording medium comprising: a touch point detecting step for detecting a touched point on a predetermined area set in advance; and one point on the predetermined area in the touch point detecting step. When it is detected that the touch is made within a predetermined time, a coordinate signal indicating the coordinates of the touched point is generated, and two or more points on the predetermined area are touched within the predetermined time. And a signal generation step of generating a control signal indicating control by a computer set in advance in accordance with the number of touched points when the event is detected. And

  According to the nineteenth aspect of the present invention, when it is detected that two or more points are touched within a predetermined time, the computer is preset according to the number of touched points. A control signal indicating the control can be generated. Therefore, an operation of touching two or more points within a predetermined time can be an operation for generating a control signal peculiar to touch-type coordinate input.

  The program according to the invention of claim 20 is a touch point detection procedure for detecting a point touched on a touch panel by a computer, and one point on the touch panel is within a predetermined time in the touch point detection procedure. When it is detected that a touch is made, a coordinate signal indicating the coordinates of the touched point is generated, and it is detected that two or more points on the touch panel are touched within a predetermined time And a signal generation procedure for generating a control signal indicating control by a computer set in advance according to the number of touched points.

  According to the twentieth aspect of the present invention, when it is detected by the computer that two or more points are touched within a predetermined time, the number of touched points is preset according to the number of touched points. A control signal indicating the control can be generated. Therefore, an operation of touching two or more points within a predetermined time can be an operation for generating a control signal peculiar to touch-type coordinate input.

  According to the invention of claim 1, the operation of touching two or more points within a predetermined time is an operation for generating a control signal peculiar to touch-type coordinate input, and a speaker (operator) For example, it is possible to provide an information input / output device that can execute a process performed by a computer such as displaying or erasing a toolbar at any position on the panel without affecting other programs. .

  According to the second aspect of the present invention, it is possible to prevent a simultaneous input by a plurality of operators that may occur particularly in a large-screen panel from being erroneously detected as a regular simultaneous input, and a large screen with higher operability. The information input / output device can be provided.

  According to the invention described in claim 3, whether the simultaneous input is made by one operator by setting the predetermined length as an interval of a touch point when a person touches the panel with a finger of one hand. It can be judged more reliably than no. Therefore, it is possible to more reliably prevent simultaneous input by a plurality of operators that may occur particularly in a large-screen panel from being erroneously detected as regular simultaneous input, and a large-screen information input / output device with higher operability. There is an effect that it can be provided.

  According to the invention described in claim 4, even when there is no button for calling the toolbar on the displayed screen, the toolbar is displayed from any position on the display screen without leaving the displayed screen. Can do. Therefore, the invention according to claim 4 has an effect that an information input / output device with higher operability can be provided.

  According to the fifth aspect of the present invention, since the toolbar can be displayed in the area of the display screen that can be operated by the operator at present, the operator who displayed the toolbar can operate the toolbar without moving. . For this reason, the invention described in claim 5 has an effect that it is possible to provide a large-screen information input / output device with higher operability.

  According to the sixth aspect of the present invention, the tool bar can be displayed in the area of the display screen that can be operated more reliably by the operator at present, and therefore the operator who displayed the tool bar operates the tool bar without moving. be able to. For this reason, the invention described in claim 6 has an effect that it is possible to provide a large-screen information input / output device with higher operability.

  According to the seventh aspect of the present invention, the number of simultaneous touch points assigned to the control signal can be limited to a number that can be simultaneously touched by a human using a hand. Therefore, there is an effect that it is possible to provide an information input / output device that can be operated more efficiently without setting unnecessary data.

  According to the invention described in claim 8, a large-screen information input / output device that prevents a simultaneous touch made in a set area from being invalidated by a touch made in another area and has a higher operability. There is an effect that can be provided.

  According to the ninth aspect of the invention, when only a part of the points is detached, the remaining touch points are prevented from being erroneously detected as new touch points, and an information input / output device with higher operability is provided. There is an effect that it can be provided.

  According to the tenth aspect of the present invention, an operation of touching two or more points within a predetermined time is an operation for generating a control signal peculiar to touch-type coordinate input, and the operator can arbitrarily select a touch panel. In this position, for example, it is possible to provide an information input / output control method capable of executing processing performed by a computer such as displaying and erasing a toolbar without affecting other programs.

  According to the eleventh aspect of the present invention, it is possible to prevent a simultaneous input by a plurality of operators that may occur particularly in a large-screen touch panel from being erroneously detected as a regular simultaneous input, and a large screen with higher operability. An information input / output control method for controlling the information input / output device can be provided.

  According to the twelfth aspect of the present invention, whether or not simultaneous input is made by one operator by setting the predetermined length as an interval of a touch point when a human touches the touch panel with a finger of one hand. It can be judged more reliably than no. Therefore, a large-screen information input / output device with higher operability can be more reliably prevented from being erroneously detected as a simultaneous simultaneous input by a plurality of operators that may occur particularly in a large-screen touch panel. The information input / output control method to be controlled can be provided.

  According to the invention described in claim 13, even when there is no button for calling the toolbar on the displayed screen, the toolbar is displayed from any position on the display screen without leaving the displayed screen. Can do. Therefore, the invention described in claim 13 has an effect that an information input / output control method with higher operability can be provided.

  According to the fourteenth aspect of the present invention, since the toolbar can be displayed in the area of the display screen that can be operated by the operator at present, the operator who displayed the toolbar can operate the toolbar without moving. . For this reason, the invention described in claim 14 has the effect of providing an information input / output control method for controlling a large-screen information input / output device with higher operability.

  According to the fifteenth aspect of the present invention, since the tool bar can be displayed in the area of the display screen that can be operated more reliably by the operator at present, the operator who displayed the tool bar operates the tool bar without moving. be able to. For this reason, the invention described in claim 15 has an effect that it is possible to provide an information input / output control method for controlling a large screen information input / output device with higher operability.

  According to the sixteenth aspect of the present invention, the number of simultaneous touch points assigned to the control signal can be limited to a number that can be simultaneously touched by a human using a hand. Therefore, there is an effect that it is possible to provide an information input / output control method that can be operated more efficiently without setting unnecessary data.

  According to the invention of claim 17, a large-screen information input / output device that prevents simultaneous touches made in a set area from being invalidated by touches made in another area and has a higher operability. It is possible to provide an information input / output control method for controlling the information.

  According to the invention described in claim 18, when only a part of the points is detached, the remaining touch points are prevented from being erroneously detected as new touch points, and the information input / output control method has higher operability. There is an effect that can be provided.

  According to the nineteenth aspect of the present invention, the operation of touching two or more points within a predetermined time is an operation for generating a control signal specific to touch-type coordinate input, and the operator can arbitrarily select the touch panel. A computer-readable recording of a program that causes a computer to execute an information input / output control method that can execute a process performed by the computer, such as displaying or erasing a toolbar, without affecting other programs. Advantageous recording medium can be provided.

  According to the twentieth aspect, the operation of touching two or more points within a predetermined time is an operation for generating a control signal peculiar to touch-type coordinate input, and the operator can arbitrarily select the touch panel. To provide a program for causing a computer to execute an information input / output control method that can execute a process performed by a computer, such as displaying or erasing a toolbar, without affecting other programs. There is an effect that can be.

  Exemplary embodiments of an information input / output device, an information input / output control method, a recording medium, and a program according to the present invention will be described below in detail as Embodiments 1 to 3 with reference to the accompanying drawings.

[First Embodiment]
In the first embodiment, the configuration of the present invention is described using an information input / output device as an example. The information input / output device of Embodiment 1 has a relatively large display, and displays data recorded on a recording medium such as a hard disk of a computer, a flexible disk, a CD (Compact Disc), and a DVD (Digital Versatile Disc). The displayed information can be edited as a so-called electronic blackboard system. The information input / output device of Embodiment 1 can input information with a touch panel. Further, the information input / output device described in the first embodiment includes a configuration common to the embodiments described below.

  1 is an external view of the information input / output device according to the first embodiment. The illustrated information input / output device includes a display unit 101 and a computer that controls the display unit 101. In the first embodiment, a general-purpose personal computer (personal computer) 102 is used as a computer. The information input / output device is provided with a program that records an information input / output control method to be described later. This program is executed by the personal computer 102.

  The display unit 101 includes a display screen 104, a frame body 103 that supports the display screen 104, and a support base 105 that supports the display screen 104 and the frame body 103. A coordinate input device, which will be described later, is attached to the display screen 104, and the display screen 104 and the coordinate input device constitute a touch panel in which the display screen 104 and a panel that defines a region where coordinates are input are integrated. ing.

  The personal computer 102 receives coordinate data detected by a touch panel (hereinafter simply referred to as a touch panel) composed of a display screen 104 and a coordinate input device, and receives the coordinate data received by the coordinate input unit 106. A coordinate signal generated by the coordinate control unit 107, a coordinate control unit 107 that generates coordinates based on the number of points input to the touch panel indicated by the coordinate data; Alternatively, a screen control unit 108 that controls the display screen 104 based on a control signal, and an image memory 109 in which image data is expanded in R, G, B format are provided. The image data developed in the image memory 109 is output to the display screen 104 by a video output unit (not shown).

  In the embodiment of the present invention, a point (coordinate) input by the operator touching the display screen 104 forming a touch panel with a finger or a pen is referred to as a touch, and the input point is referred to as a touch point. Further, touching a plurality of points within a predetermined time is hereinafter referred to as simultaneous touch, and a plurality of points touched at the same time is referred to as simultaneous touch points. The information input / output device of the first embodiment detects a touch point every about 20 ms. Therefore, in the first embodiment, when a plurality of points are touched during one detection time of 20 ms, this touch is regarded as a simultaneous touch. However, in the first embodiment, it is assumed that there are always two simultaneous touch points for simplicity of explanation.

  The coordinate input unit 106 is configured to use USB (Universal Serial Bus) or RS232C (Recommended Standard 232-C), and outputs touch detection data from the touch panel to the coordinate control unit 107. Since the detection data is used to calculate coordinates in the coordinate control unit 107, the detection data is referred to as coordinate data.

  The coordinate control unit 107 determines whether or not simultaneous touching has been performed based on the input coordinate data. That is, when coordinate data of only one point is input within a predetermined time, it is determined that only one point on the touch panel has been touched. Then, the coordinates of one touched point are obtained by calculation and output to the screen control unit 108 as coordinate signals.

  Here, a touch panel common to the embodiment of the present invention and calculation for obtaining coordinates will be described. FIG. 2 is a diagram schematically showing a touch panel 200 configured by the coordinate input device and the display screen 104. The touch panel 200 includes a display screen 104 that also functions as a panel, a light reflecting film 201 provided on three sides of the display screen 104, and optical units 202a and 202b. The light reflecting film 201 and the optical units 202a and 202b in the touch panel constitute a coordinate input device.

  The optical units 202a and 202b have the same configuration, and both have a light source (not shown) that irradiates a fan-shaped laser beam that forms a plane parallel to the display screen 104 over the entire area of the display screen 104, and the irradiated laser beam. For example, a light receiving unit (not shown) using a CCD (Charged Coupled Device) element. The light reflecting film 201 is a recursive reflecting film that reflects the reflected light so that it passes again through the optical axis l when, for example, the light passing through the optical axis l is reflected.

  When the point p on the display screen 104 is touched, the laser light emitted from the light source is blocked by the finger or pen touching the point p. As a result, only the reflected light of the laser light passing through the touch point p reflected by the light reflection film 201 is not received by the light receiving unit, and the optical axis of the light passing through the touch point can be determined from the light receiving state of the light receiving element. Furthermore, by providing the two optical units 202a and 202b, two optical axes passing through the touch point p can be specified.

At this time, the coordinate control unit 107 determines the coordinates (x, y) of the touch point p as the angles θL, θR between the line parallel to the side s to which the optical units 202a, 202b are attached on the touch panel and the specified optical axis. The distance W between the optical units 202a and 202b (for example, the distance between the light source of the optical unit 202a and the light source of 202b) is calculated by the following equation. The calculated coordinates (x, y) are output to the screen control unit 108.
x = W · tan θR ÷ (tan θL + tan θR) (1)
y = W · tan θL · tan θR ÷ (tan θL + tan θR) (2)

  The coordinates (x, y) are set on the display screen 104 according to the resolution of the display screen 104. In the display screen 104 according to the first embodiment, pixels of 1024 dots are arranged in the x-axis direction, and pixels of 708 dots are arranged in the y-axis direction. For the x coordinate, for example, the position of the light source of the optical unit 202a is set as the origin, the maximum value set as the x coordinate is set as the pixel position of the 1024th dot, and the interval between the origin and the maximum value is divided equally. Is set. Similarly, the y coordinate is set by setting the maximum value of the y coordinate to the position of the pixel of the 708th dot and equally dividing the interval between the origin and the maximum value.

  By the way, the display screen 104 on which input is performed with the touch panel is assigned functions such as click and double click at specific coordinates in advance. The screen control unit 108 determines whether or not the obtained coordinates correspond to the coordinates to which the function is assigned on the display screen 104. If the coordinates correspond to the coordinates to which the function is assigned, a click or double click operation is executed.

  Further, when the screen control unit 108 determines that the coordinates input from the coordinate control unit 107 do not correspond to the coordinates to which the function is assigned on the display screen 104, the screen control unit 108 obtains the image data of the image memory. A point is written in the coordinates and output to the display screen 104. As a result, when coordinates to which no function is assigned are continuously input from the coordinate control unit 107 to the screen control unit 108, a line is drawn on the display screen 104.

  Further, the coordinate control unit 107 determines that two points on the touch panel are touched at the same time, that is, when the coordinate data of the coordinates of the two points is input within a predetermined time, the number of touched points (implementation) In the first mode, a control signal indicating computer control preset in accordance with 2 points) is generated and output to the screen control unit 108. In the first embodiment, this control signal is a control signal that instructs the screen control unit 108 to display a toolbar. Upon receiving the control signal, the screen control unit 108 activates a program for displaying the toolbar and causes the display screen 104 to display the toolbar.

  According to the first embodiment described above, in the information input / output device operated using the touch panel, the same touch is generated at any point on the display screen 104 and the same control signal as the double click is generated. For the operation. Therefore, by assigning the control signal for displaying the toolbar to the simultaneous touch, the toolbar can be displayed without affecting other programs. Then, displaying the toolbar makes it possible to directly execute the functions in the toolbar from the currently displayed screen. For this reason, Embodiment 1 can be said to eliminate the need to close the currently displayed screen once and operate the toolbar display from other screens, for example, and further improve the operability of the information input / output device.

  Furthermore, the information input / output device of the first embodiment performs the processing described below in order to display the toolbar at a position relatively close to the point touched simultaneously. That is, when simultaneous touch is detected, the coordinate control unit 107 acquires touch candidate points that may be touched. The control signal is a signal to be displayed in an area surrounded by a straight line passing through the touch candidate point on the display screen 104.

  FIG. 3 is a diagram for explaining a procedure for acquiring touch candidate points. When simultaneous touching is performed, the coordinate control unit 107 detects the point pa (x1, y1) and the point pb (x2, y2) from the data detected by the optical unit 202a (FIG. 1) and the optical unit 202b (FIG. 1). , Point pc (x3, y3) and point pd (x4, y4) cannot be determined as to which two points are touched simultaneously. At this time, the coordinate control unit 107 may have simultaneously touched the point pa (x1, y1), the point pb (x2, y2), the point pc (x3, y3), and the point pd (x4, y4). The coordinates of all points are calculated as touch candidate points. In the first embodiment, the above-described equations (1) and (2) are also used in calculating the touch candidate points.

  Here, the derivation | leading-out of Formula (1) and (2) mentioned above is demonstrated in detail. In order to explain the coordinate detection principle of the coordinate input device used in this embodiment, the basic configuration of the information input / output device shown in FIG. 3 will be described with reference to FIGS. FIG. 4 shows an optical coordinate input device that projects a fan-shaped light beam onto a plane parallel to the display screen 104. Such a coordinate input / output device is also referred to as an optical thin film type coordinate input device (hereinafter simply referred to as a coordinate input device). The coordinate input device has a coordinate input area 403 which is a coordinate input surface formed by a light flux film projected in a fan shape. Then, by inserting an instruction unit 404 that functions as a light blocking unit such as an operator's fingertip, pen, or pointing rod into the coordinate input area 403 to block the light flux in the coordinate input area 403, a CCD (Charge Coupled Device) or the like The indicated position is detected based on the image forming position of the light receiving element, and characters and the like can be input.

  A coordinate input area 403 that is an internal space of the coordinate input member 402 having a rectangular housing structure has a two-dimensional shape that forms a plane (or a substantially plane) on the display screen 104 that electronically displays an image. overlapping. Consider a case where the coordinate input area 403 is touched by an instruction unit 404 that functions as a light blocking unit such as an operator's fingertip, pen, or indicator bar made of an optically opaque material. The purpose of this coordinate input device is to detect the coordinates of the instruction means 404 at this time.

  Light receiving / emitting means 405 is attached to both upper ends (or both lower ends) of the coordinate input area 403. In the information input / output device described above, the optical units 202 a and 202 b correspond to the light emitting / receiving means 405. A light beam bundle (probe light) of L1, L2, L3,..., Ln is irradiated from the light emitting / receiving means 405 toward the coordinate input area 403. Actually, it is a fan-shaped plate-like light wave (light flux film) that travels along a plane parallel to the coordinate input plane extending from the point light source 406.

  A retroreflective member (retroreflective means, corresponding to the light reflecting film 201 of the information input / output device described above) 407 is attached to the peripheral part of the coordinate input area 403 with the retroreflective surface facing the center of the coordinate input area 403. Has been. The retroreflective member 407 is a member having a characteristic of reflecting incident light in the same direction regardless of the incident angle. For example, when attention is paid to one probe light 408 among the fan-shaped plate-like light waves emitted from the light receiving and emitting means 405, the probe light 408 is reflected by the retroreflective member 407 and receives the same optical path as retroreflected light 409 again. It proceeds so as to return toward the light emitting means 405. The light receiving / emitting means 405 is provided with a light receiving means, which will be described later, and can determine whether or not the recursive light has returned to the light receiving means for each of the probe lights L1 to Ln.

  Consider a case where the operator touches the position P with a finger (instruction means 404). At this time, the probe light 410 is blocked by the finger at the position P and does not reach the retroreflective member 407. Therefore, the return light of the probe light 410 does not reach the light emitting / receiving means 405, and it is indicated on the extension line (straight line L) of the probe light 410 by detecting that the return light corresponding to the probe light 410 is not received. It can be detected that the means 404 has been inserted.

  Similarly, the probe light 411 is also irradiated from the light emitting / receiving means 405 installed on the upper right side of FIG. 4 to detect that the recursive light corresponding to the probe light 411 is not received, thereby extending the probe light 411 ( It can be detected that the pointing means 404 is inserted on the straight line R). If the straight line L and the straight line R can be obtained, the coordinates at which the instruction unit 404 is inserted can be obtained by calculating the intersection coordinates of the P points by calculation based on the principle of triangulation.

  Next, the structure of the light receiving / emitting means 405 and the mechanism for detecting which probe light is blocked among the probe lights L1 to Ln will be described. FIG. 5 is a diagram showing an outline of the internal structure of the light emitting / receiving unit 405, and is a diagram of the light emitting / receiving unit 405 attached to the coordinate input surface of FIG. 4 as viewed from a direction perpendicular to the coordinate input area 403. is there. Here, for the sake of simplicity, description will be made on a two-dimensional plane parallel to the coordinate input area 403.

  The light receiving / emitting means 405 is generally composed of a point light source 406, a condenser lens 502 and a CCD, and a light receiving element 503 functioning as a light receiving means. The point light source 406 emits light in a fan shape in a direction opposite to the light receiving element 503 when viewed from a light source (illustrated later) that is a light emitting unit. The fan-shaped light emitted from the point light source 406 is considered to be a set of probe lights traveling in the directions of arrows 504 and 505 and other directions.

  The probe light traveling in the direction of the arrow 504 is reflected by the retroreflecting member 407 in the direction of the arrow 506, passes through the condenser lens 502, and reaches the position 507 on the light receiving element 503. Further, the probe light traveling in the direction of the arrow 505 is reflected by the retroreflecting member 407 in the direction of the arrow 508 and reaches the position 509 on the light receiving element 503 through the condenser lens 502. Thus, the light emitted from the point light source 406, reflected by the retroreflecting member 407, and returned through the same path reaches each different position on the light receiving element 503 by the action of the condenser lens 502. Therefore, when a certain probe light is blocked by inserting the instruction means 404 at a certain position in the coordinate input area 403, the light does not reach a point on the light receiving element 503 corresponding to the probe light. Therefore, by examining the light intensity distribution on the light receiving element 503, it is possible to know which probe light is blocked.

  FIG. 6 is a diagram for explaining the above-described operation in detail. In FIG. 6, it is assumed that the light receiving element 503 is installed on the focal plane (focal length f) of the condenser lens 502. The light emitted from the point light source 406 toward the right side in FIG. 6 is reflected by the retroreflecting member 407 and returns along the same path. Therefore, the light is condensed again at the position of the point light source 406. The center of the condenser lens 502 is installed so as to coincide with the point light source position. Since the retroreflected light returning from the retroreflective member 407 passes through the center of the condensing lens 502, it travels along a symmetrical path behind the lens (on the light receiving element side).

At this time, the light intensity distribution on the light receiving element 503 is considered. If the instruction means 404 is not inserted, the light intensity distribution on the light receiving element 503 is substantially constant. However, when the instruction means 404 that blocks light is inserted at the position P as shown in FIG. The probe light is blocked, a region having a low light intensity is generated at the position Dn on the light receiving element 503, and a dip appears in the shape of the light intensity distribution from the light receiving element 503. The position Dn at which this dip appears corresponds to the emission / incidence angle θn of the blocked probe light, and θn can be known by detecting Dn. That is, θn is a function of Dn,
θn = arctan (Dn / f) ……………………………… (3)
It can be expressed as. Here, θn is replaced with θnL and Dn is replaced with DnL in the light receiving and emitting means 405 at the upper left of FIG.

Further, the angle θL formed by the instruction unit 404 and the coordinate input area 403 is expressed by the following equation (3) based on the conversion coefficient g of the geometric relative positional relationship between the light emitting / receiving means 405 and the coordinate input area 403 shown in FIG. As a function of DnL calculated by
θL = g (θnL) ………………………… (4)
However, θnL = arctan (DnL / f)
It can be expressed as.

Similarly, for the light receiving / emitting means 405 on the upper right in FIG. 4, the symbol L in the above equations (3) and (4) is replaced with the symbol R, and the geometry of the right light receiving / emitting means 405 and the coordinate input area 403 is changed. By the relative relative relationship conversion coefficient h,
θR = h (θnR) ……………………………… (5)
However, θnR = arctan (DnR / f)
It can be expressed as.

  Here, if the mounting interval of the light emitting / receiving means 405 on the coordinate input area 403 is w shown in FIG. 7 and the origin coordinates are as shown in FIG. The two-dimensional coordinates (x, y) are expressed by the above-described equations (1) and (2). That is, since x and y can be expressed as a function of DnL and DnR, the dark spot positions DnL and DnR on the light receiving element 503 on the left and right light emitting and receiving means 405 are detected, and the geometry of the light receiving and emitting means 405 is detected. By considering the target arrangement, it is possible to detect the two-dimensional coordinates of the point P indicated by the indication means 404.

  Next, an example in which the optical system described above is installed in the coordinate input area 403, for example, the surface of the display will be shown. FIG. 8 shows an example in which one of the left and right light emitting / receiving means 405 described in FIGS. 4 and 5 is installed on the display surface of the information input / output device.

  800 in FIG. 8 shows a cross section of the display surface, which is viewed in the direction from the negative to the positive y-axis shown in FIG. That is, FIG. 8 mainly shows the xz direction, but the portion surrounded by a two-dot chain line also shows a configuration in which the same object is viewed from another direction (xy direction, yz direction). ing. The display surface 800 shown in FIG. 8 has a configuration using a plasma display panel (PDP).

  Next, the light emitting means of the light emitting / receiving means 405 will be described. As the light source 801 which is a light emitting means, a light source capable of narrowing a spot to some extent such as an LD (Laser Diode: semiconductor laser) is used.

  Light emitted from the light source 801 perpendicular to the display surface 800 is collimated only in the x direction by the condenser lens 802. This is because the collimated light is later folded by the half mirror 803 and then distributed as parallel light in a direction perpendicular to the display surface 800. After exiting the condenser lens 802, the condenser lens 802 is condensed with respect to the y direction in the figure by two condenser lenses 804 and 805 whose curvature distribution is orthogonal.

  Due to the action of these condenser lens groups (lenses 801, 804, 805), a linearly condensed region is formed behind the condenser lens 805. Here, a slit 806 narrow in the y direction and elongated in the x direction is inserted. That is, the linear secondary light source 406a is formed at the slit position. The light emitted from the secondary light source 406 a is folded back by the half mirror 803, and does not spread in the vertical direction of the display surface 800 but is parallel light and spreads in a fan shape around the secondary light source 406 a in the direction parallel to the display surface 800. However, it proceeds along the display surface 800.

  The advanced light is reflected by the retroreflecting member 407 installed at the peripheral edge of the display, and returns in the direction of the half mirror 803 (arrow C) through the same path. The light transmitted through the half mirror 803 travels parallel to the display surface 800 and enters the light receiving element 503 through the condenser lens 502.

  At this time, the secondary light source 406a and the condenser lens 502 are both disposed at a distance D with respect to the half mirror 803 and have a conjugate positional relationship. Therefore, the secondary light source 406a corresponds to the point light source 406 in FIG. 6, and the condenser lens 502 corresponds to the lens 502 in FIG.

  FIG. 9 shows a configuration block diagram of a control circuit for the light source 801 and the light receiving element 503. This control circuit performs light emission control of the light source 801 and calculation of output from the light receiving element 503. As shown in the figure, a control circuit is connected to a central processing unit (CPU) 901, a ROM (Read Only Memory) 902 for storing programs and data, a RAM (Random Access Memory) 903, and a computer. An interface driver 904, an A / D (Analog / Digital) converter 905, an LD driver 906, and a hard disk 907 for storing various program codes (control programs) are connected by a bus. Here, the CPU 901, the ROM 902, and the RAM 903 constitute a microcomputer as a computer.

  Also, in such a microcomputer, a storage medium 909 storing various program codes (control programs), that is, a flexible disk, a hard disk, an optical disk (CD-ROM, CD-R, CD-R / W, DVD-). ROM, DVD-RAM, etc.), magneto-optical disk (MO), program reading device 908 such as a flexible disk drive device, a CD-ROM drive device, an MO drive device, etc. Is connected.

  As a circuit for calculating the output from the light receiving element 503, an analog processing circuit 911 is connected to the output terminal of the light receiving element 503 as shown in the figure. The reflected light incident on the light receiving element 503 is converted into analog image data having a voltage value corresponding to the intensity of the light in the light receiving element 503, and is output as an analog signal. The analog signal is processed by the analog processing circuit 911, converted to a digital signal by an A / D (Analog / Digital) converter 905, and passed to the CPU 901. Thereafter, the CPU 901 calculates the two-dimensional coordinates of the instruction unit 404.

  This control circuit may be incorporated in the same housing as one of the light receiving / emitting means 405, or may be incorporated in a part of the display forming the coordinate input area 403 as a separate housing. In addition, it is preferable to provide an output terminal for outputting coordinate data calculated to a computer or the like via the interface driver 904.

  Various program codes (control program) stored in the hard disk 907 or various program codes (control program) stored in the storage medium 909 are written in the RAM 903 in response to power-on to the coordinate input device, Program code (control program) will be executed.

  In addition, the coordinate control unit 107 according to the first embodiment generates a control signal for displaying the tool bar and calculates the coordinates (multiple touch detection points) of one point p0 based on the touch candidate points. In the first embodiment, the multiple touch detection points are calculated by the following method.

First, the coordinate control unit 107 has the maximum value among the coordinates of the point pa (x1, y1), the point pb (x2, y2), the point pc (x3, y3), and the point pd (x4, y4). The coordinates (x _max ), the x coordinate having the minimum value (x _min ), the y coordinate having the maximum value (y _max ), and the y coordinate having the minimum value (y _min ) are obtained. The coordinates of the multiple touch detection point p0 (x0, y0) are
x0 = ( _xmax + _xmin ) / 2 (6)
_{y0 = (y max + y min} ) ÷ 2 ... (7)
Calculate as

  The coordinate control unit 107 outputs the calculated multiple touch detection point p0 (x0, y0) to the screen control unit 108 together with a control signal. When the control signal is input, the screen control unit 108 displays a toolbar at a plurality of touch detection points p 0 on the display screen 104. Further, the display position of the tool bar is not limited to the multiple touch detection point p0. For example, the display position on the display screen 104 is not more than a predetermined distance from the multiple touch detection point as p0 'shown in FIG. It may be a point.

  By the way, a general touch panel is set to ignore simultaneous touches in order to prevent malfunctioning when touches are simultaneously made by a plurality of operators. In the information input / output device according to the first embodiment that uses the simultaneous touch for generation of the control signal, the point touched based on the detection result when the simultaneous touch is detected in order to prevent malfunction due to the touch of a plurality of operators. An interval length that is a length reflecting the interval between each other is calculated. And when the calculated space | interval length is more than predetermined length, a simultaneous touch and the touch made | formed simultaneously by the some operator are identified by not producing | generating a control signal.

In the first embodiment, the interval length Lx in the x direction and the interval length Ly in the y direction are calculated based on the aforementioned x _max , x _min , y _max , and y _min . That is, the coordinate control unit 107 calculates the interval length Lx and the interval length Ly by the following equations (8) and (9) when detecting a plurality of touch points. The information input / output device of the first embodiment is set by a program so as not to generate a control signal when at least one of the interval length Lx and the interval length Ly is equal to or longer than a predetermined length (specific length). .
Lx = x _max −x _min (8)
Ly = y _max −y _min (9)

  The length of the specific length compared with the interval length Lx and the interval length Ly is set to a general interval between touch points when a human touches the touch panel with one hand. By setting the specific length to about the touch point of touch with one hand, it is possible to determine that the point touched at the same time is the simultaneous touch point touched with one hand by one operator.

  FIG. 10 is a diagram for explaining the operation procedure of the information input / output device described above, and shows the touch panel 200 of the information input / output device and the toolbar 1001 displayed on the display screen 104 of the touch panel 200. . The operator simultaneously touches the display screen 104 with two fingers of the hand on the side not holding the pen, for example. The coordinate input device detects the simultaneous touch point and transmits the coordinate data to the coordinate input unit 106.

  The coordinate data is transmitted to the coordinate control unit 107 via the coordinate input unit 106. When the coordinate control unit 107 determines that simultaneous touches have been made based on the coordinate data, the screen control unit displays a plurality of touch detection points or points (near points) within a predetermined distance from the plurality of touch detection points together with the control signal. It outputs to 108. The screen control unit 108 displays the tool bar 1001 at a plurality of touch detection points or points in the vicinity of the plurality of touch detection points based on the control signal.

  The tool bar 1001 shown in FIG. 10 is a kind of electronic blackboard system, for example, functions specific to the multimedia board (hereinafter referred to as MB software), overwriting pen, enlarged display, etc., and items that the operator wants to function. By touching the button 1002 (touching one point), a program for executing a function corresponding to the touched button is started.

  As described above, in the first embodiment, when the simultaneous touch is performed, the tool bar is displayed at a position where the operator can operate without moving from the position touched at the same time by displaying the tool bar at a plurality of touch detection points. be able to. For this reason, in the information input / output device of the first embodiment, the operator can display the toolbar at an arbitrary position on the display screen 104 and can operate the toolbar without moving.

  When the toolbar is displayed by simultaneous touch, if only one of the fingers touched at the same time moves away from the displayed toolbar, the coordinate control unit 107 may determine that a single point touch has been made on the toolbar. . At this time, if the touch point of the one-point touch is close to any of the buttons 1002, the screen control unit 108 executes processing for the function corresponding to the button close to the touch point.

  In order to prevent the processing from being executed when one of the two fingers touched at the same time is separated, in Embodiment 1, when the coordinate control unit 107 detects the simultaneous touch, all the detected The next touch on the touch panel is not detected until it is detected that the finger is separated from the touch point (detached).

  Further, the control program of the first embodiment further includes a program for editing the toolbar 1001, and the user can edit the function registered in the toolbar according to the needs. Next, the toolbar editing procedure will be described.

  11A, 11B, and 11C are diagrams for explaining a procedure for editing a toolbar, and are diagrams showing a toolbar editing screen that is a screen for editing a toolbar displayed by simultaneous touch. It is. The illustrated toolbar editing screen is opened by a predetermined operation set in advance, for example, by clicking an “edit” button on the toolbar displayed by simultaneous touch.

  The toolbar editing screen shown in FIG. 11 has three screens: a simultaneous touch function setting screen (FIG. 11A), a simultaneous touch function registration screen (FIG. 11B), and a file search screen (FIG. 11C). Consists of. The simultaneous touch function setting screen is the first screen displayed on the toolbar editing screen. Then, the currently registered function is displayed on the tool bar, and the displayed function is deleted and newly set.

  The illustrated toolbar editing screen shows five pointers 1101 indicating item numbers and items to be edited, five name display fields 1103 indicating function names, buttons 1102 indicating respective functions, and settings for determining settings. A key 1112, a delete key 1113 for deleting a setting, a front key 1114 for selecting an item to be edited, a back key 1115, an OK key 1116, and a cancel key 1117 are displayed.

  For example, when the operator clicks the pointer 1101 to select an item, a black circle is displayed on the pointer. The selected item can be scrolled up and down by clicking the forward key 1114 and the backward key 1115. When the setting key 1112 is clicked and the OK key 1116 is clicked, a simultaneous touch function registration screen is displayed.

  The simultaneous touch function registration screen has a name display field 1121 for displaying a function name, a file name display field 1122 for displaying a file storing a program for executing the function, and a selection for selecting a button indicating the function. A key 1123, a preview field 1124 for displaying a button selected by the selection key, a reference key 1125 for displaying the button in the preview field 1124, an OK key 1126, and a cancel key 1127 are displayed.

  When the name and button of the function to be registered are determined on the simultaneous touch function registration screen, the operator clicks the OK key 1126 to display the file search screen. The file search screen includes a search destination column 1131 for displaying a search destination of a file in which the program is stored, a file type column 1134 for displaying a type of a file to be searched, a file name column 1133 for displaying a file name, and a search. A key 1135 for opening the opened file, a display field 1132 for displaying the contents of the opened file, and a cancel key 1136 are displayed.

  The operator selects and displays a search destination in the search destination column 1131. Then, the file name to be searched and the file type are selected. When the file search is completed and the file is in the personal computer 102, the file is opened, and it can be confirmed that the personal computer 102 has a program for executing the function displayed in the name display field 1121. .

  FIGS. 12 and 13 are flowcharts for explaining the information input / output control method performed by the information input / output device described above. Both of the information input / output control methods shown in the flowchart are programmed by the personal computer 102. Therefore, it is executed. FIG. 12 is a flowchart for explaining a coordinate input control method, and FIG. 13 is a flowchart for explaining a toolbar display control method.

  In the flowchart shown in FIG. 12, the personal computer 102 first determines whether coordinates (coordinate data) have been input via the coordinate input unit 106 (step S1201). As a result of this determination, if it is determined that no coordinates are input (step S1201: No), the process waits until the coordinates are input.

  If it is determined in step S1201 that coordinates have been input (step S1201: Yes), it is determined whether or not a touch has been made (step S1202). This determination is made in order to determine whether the finger at the touch point whose coordinates are detected last time is present without being detached, and when the touch is made this time. As a result of the determination, if a touch has been made (step S1202: Yes), it is determined whether or not the input coordinate is one point (step S1203).

  If it is determined in step S1203 that the coordinate is one point (step S1203: Yes), processing when one touch point is detected is executed (step S1204). Then, the coordinates of the touch point are notified to the screen control unit 108 (step S1205), and it is determined whether or not the coordinate data has been input again (step S1201).

  If it is determined in step S1203 that the input coordinate is not one point (step S1203: No), a touch candidate point is acquired based on the coordinate data, and it is determined whether there are two or more touch candidate points. (Step S1206). In the first embodiment, as described above, the number of simultaneous touch points is limited to two. Therefore, when there are two or more touch candidate points (step S1206: Yes), it is determined that the detection is invalid and the following is performed. Prepare for input of coordinates (step S1201).

  If it is determined in step S1206 that the number of touch candidate points is not greater than 2 (step S1206: No), the coordinate control unit 107 calculates the interval length Lx and the interval length Ly (step S1208). Then, it is determined whether or not the calculated interval length Lx and interval length Ly are longer than the specific length (step S1209). As a result of the determination, if the interval length Lx and the interval length Ly are longer than the specific length (step S1209: Yes), it is detected that a plurality of touches may be one-point touches made by a plurality of operators. Is prepared for the input of the next coordinate (step S1201).

  If it is determined in step S1202 that the coordinates are not input by touch (step S1202: No), it is determined whether or not the finger is detached from the touch point (step S1212). If it is determined that detachment has been performed (step S1212: Yes), it is determined whether or not the detected touch point is one (step S1213). If the result of this determination is that there is one touch point (step S1213: Yes), the screen controller 108 is notified of detachment (step S1214).

  In step S1213, when the detected touch point is not one point (step S1213: No), it is determined whether simultaneous touch is detected (step S1215). If a simultaneous touch is detected (step S1215: Yes), the screen control unit 108 activates the toolbar control program to display the toolbar on the display screen 104 (step S1216). If no detachment is detected in step S1212 (step S1212: No), it is determined whether or not the input coordinate is one point (step S1217).

  If the result of determination in step S1217 is that the coordinate is not one point (step S1217: No), it is determined whether one touch point has been detected (step S1218). As a result of the determination, if one point touch is not detected (step S1218: No), it is prepared for the input of the next coordinate data (step S1201). On the other hand, when one touch point is detected in the determination in step S1218 (step S1218: Yes), it is considered that another point is touched while one point is being touched. At this time, the coordinate control unit 107 notifies the screen control unit 108 that the previously input point has been touched (step S1219).

  If it is determined in step S1217 that the coordinates of one point have been detected (step S1217: Yes), it is determined whether one touch point has been detected (step S1220). If one touch point is detected as a result of the determination (step S1220: Yes), the coordinates of the touch point are calculated (step S1221). Further, when one touch point is not detected (step S1220: No), one point is detached from the touch of another point or the simultaneous touch while the touch is being made. As a thing, the coordinates are ignored and the next coordinates are prepared for input (step S1201).

  Next, a procedure for controlling the displayed toolbar will be described with reference to FIG. The procedure described in FIG. 13 is mainly performed by the screen control unit 108 of the personal computer 102. In the flowchart described in FIG. 13, first, a toolbar is displayed according to the procedure of the flowchart described in FIG. 12 (step S1301). Then, it is determined whether or not the coordinate input from the coordinate control unit 107 has been notified (step S1302). If the coordinate is not notified as a result of the determination (step S1302: No), it waits until notified.

  When the coordinates are notified to the screen control unit 108 (step S1302: Yes), it is determined whether or not the touch made at the notified coordinates has been detached (step S1303). If it is not detached (step S1303: No), it is determined whether or not the toolbar is on the notified coordinate (step S1304). If it is on the toolbar (step S1304: Yes), the coordinate is displayed. The corresponding toolbar button is inverted and displayed (step S1305). And it waits for the notification of the next coordinate again.

  On the other hand, when the notified coordinate is not on the toolbar (step S1304: No), the screen control unit 108 determines whether the toolbar is highlighted (step S1309). If the toolbar is highlighted (step S1309: Yes), the highlighted toolbar is displayed normally (step S1310) and waits for notification of the next coordinate. If the tool bar is not highlighted (step S1309: No), it waits for notification of the next coordinate without changing the tool bar display.

  If it is determined in step S1303 that the detachment has been made (step S1303: Yes), the screen control unit 108 determines whether the toolbar is highlighted (step S1306). If it is being highlighted (step S1306: Yes), the function indicated by the highlighted button is activated (step S1307). Further, after the displayed toolbar is deleted (step S1308), it waits for the notification of the next coordinate. If the display is not reversed (step S1306: No), the displayed toolbar is deleted without activating the function (step S1308), and the process is terminated.

  In the first embodiment, the information input / output control method of the present invention is applied to the entire display screen 104 of the information input / output device. However, for example, as shown in FIG. 14, the information input / output control method of the present invention can be applied only to a partial area (effective range) 1401 of the display screen 104. The effective range 1401 can be set by determining the outer periphery of the rectangle indicated by 1401 by a general drag operation or the like.

  When the information input / output control method of the present invention is applied only in the effective range 1401, the tool bar can be displayed by simultaneous touching only near the position where the operator normally stands. Outside of the effective range, even if a listener or the like touches the display screen 104, it is possible to prevent the simultaneous touch input by the operator from being erroneously determined as a touch and invalid. The effective range 1401 shown in FIG. 14 is set when the operator stands on the front side of the display screen 104, and when the operator stands on the left or right side of the display screen 104, Only the right side can be considered as the effective range.

  In the first embodiment, the simultaneous touch is limited to touching two points at the same time, but the present invention can also be applied to any number of 2 to 10 points touched simultaneously. FIG. 15 is a diagram for explaining detection of three touch points as an example of detecting two or more touch points. In FIGS. 15A to 15C, the actually touched points are indicated by darker dots, and the touch candidate points are indicated by white dots. In addition, the straight line shown in the figure connects the detected point and the sensor that detects the point, and a sensor is arranged at the point where the straight line gathers at one point. That is, in each of the configurations of FIGS. 15A to 15C, one sensor is provided at the end of the long side, as in FIG.

  When two sensors detect touch points in three directions, respectively, as shown in FIG. 15A, the touch panel detects six touch points in addition to the actually touched three points. Further, as shown in (b), when one of the two sensors detects a touch point in two directions, the other sensor detects a touch point in three directions. Furthermore, as shown in (c), when one of the two sensors detects a touch point only in one direction, the other sensor detects the touch point in three directions.

  That is, in the touch panel of this embodiment, when three points are touched at the same time, one sensor always detects a three-point touch and can input the fact that the three-point touch has been made to the information input / output device. . Similarly, when four points are touched simultaneously, at least one sensor detects touch points in four directions, and when five points are touched simultaneously, at least one sensor sets touch points in five directions. To detect. Furthermore, according to the present embodiment, it is possible to detect up to 10 simultaneous touches.

  Further, the information input / output device of the present invention can assign different functions to a plurality of points (eg, three points, three points, four points, and five points) of 2 to 10 points. The function assigned to each point is not limited to the display of the tool bar, but may be any control as long as the control is executed by the computer, such as normal termination of the computer or network connection. Furthermore, the correspondence between the number of touch points and the function assigned to the number of touch points can be set in advance by the user.

  FIGS. 16A, 16 </ b> B, and 16 </ b> C are diagrams showing a function setting screen for setting the correspondence between the number of touch points and the function assigned to the number of touch points. The function setting screen includes three screens: a multi-point touch function setting screen (FIG. 16A), a simultaneous touch function registration screen (FIG. 16B), and a file search screen (FIG. 16C). The multipoint touch function setting screen is a screen that is first displayed on the function setting screen. Then, eight pointers 1601, eight function name display fields 1604 corresponding to the pointers, a setting key 1605, a delete key 1606, an OK key 1607, and a cancel key 1608 are displayed.

  On the multi-point touch function setting screen, the operator clicks and selects a pointer 1601 corresponding to the number of touch points for which a function is to be set. By clicking an OK key 1607, the simultaneous touch function registration screen is opened. The simultaneous touch function registration screen refers to the name display field 1609 for displaying the name of the set function, the file name display field 1610 for displaying the name of the file in which the program necessary for executing the function is stored, and the file. A reference key 1611, an OK key 1612, and a cancel key 1613 are displayed.

  When the name of the function to be registered and the file name are determined on the multipoint touch function setting screen, the operator clicks the OK key 1612 to display the file search screen. The file search screen includes a search destination column 1614 for displaying a search destination of a file in which the program is stored, a file type column 1617 for displaying a type of a file to be searched, a file name column 1616 for displaying a file name, and a search. A key 1618 for opening the opened file, a display field 1615 for displaying the contents of the opened file, and a cancel key 1619 are displayed.

  The operator selects and displays a file search destination in the search destination column 1614. Then, the file name to be searched and the file type are selected. When the file search is completed and the file is in the personal computer 102, the file is opened, and it can be confirmed that the personal computer 102 has a program for executing the function displayed in the display field 1615. At this time, the operator returns to the multipoint touch function setting screen, displays the selected function in the function name display field 1004 corresponding to the item selected by the pointer, and clicks the setting key 1605. With the above operation, different functions can be set for each of the plurality of touch points.

  In the first embodiment, a personal computer which is a general-purpose computer is used as the control device of the information input / output device. However, the present invention is not limited to the one using a personal computer, and the information input / output device has a dedicated configuration including a computer that can execute a program of an information input / output control method for controlling the information input / output device. It may be controlled. Further, for example, the coordinates are calculated by executing a calculation based on the coordinate data which is the detection data of the optical unit with a dedicated configuration. The information input / output device may be controlled by combining a dedicated configuration and a general-purpose personal computer, such as inputting the calculated coordinates to the personal computer.

[Second Embodiment]
Next, a second embodiment of the present invention will be described. Note that, in the information input / output device of the second embodiment, the same components as those of the information input / output device described in the first embodiment are denoted by the same reference numerals, and the description thereof is partially omitted.

  In the second embodiment, the program provided in the information input / output device described in the first embodiment further includes a procedure for editing the toolbar. FIGS. 17A and 17B are diagrams for explaining a procedure for editing a toolbar. FIG. 17A shows a toolbar selection screen, and FIG. 17B shows a toolbar setting screen.

  The toolbar selection screen includes five pointers 1701, five toolbar name display fields 1702 corresponding to the pointers 1701, a toolbar viewer 1703, a setting key 1704, a delete key 1705, a forward key 1706, a backward key 1707, and an OK key. 1708 and a cancel key 1709 are displayed. On the toolbar selection screen, the operator clicks the pointer 1701 to select the registration number of the toolbar. An arbitrary name is input and displayed in the toolbar name display field 1702 of the selected numbered toolbar.

  The toolbar shown in FIG. 17 can be edited according to the user, such as “Standard Toolbar”, “Presentation Toolbar”, “Electronic Blackboard Toolbar”, “Electronic Conference Toolbar”, and “Mito Sato Toolbar”. . For example, when editing the “Sato Mitsuru” toolbar, the operator clicks the fifth pointer 1701 and then clicks the OK key 1708. By clicking, the toolbar setting screen is displayed.

  The toolbar setting screen is a registration item display field 1711 for displaying a plurality of registered buttons 1710 and the names of functions corresponding to the buttons, a selection of a plurality of buttons 1710 that can be registered and the names of functions corresponding to the buttons. An item display field 1714, an add key 1712, a delete key 1713, an OK key 1715, and a cancel key 1716 are displayed.

  On the toolbar setting screen, the operator clicks and selects an arbitrary button in the selection item display field 1714 and clicks an add key 1712 to select a button and a function corresponding to the button, and a registration item display field 1711. Can be added to. By the addition, the function corresponding to the selected button is registered in “Sato Mitsuru Toolbar”, and the display of the button is added on the toolbar. Further, the operator can delete an already registered button and function from registration by clicking and selecting an arbitrary button in the registration item display field 1711 and clicking a delete key 1713.

  The display state of the toolbar set by the above registration is displayed in the toolbar viewer 1703 on the toolbar selection screen. The operator confirms the set toolbar by looking at the display of the toolbar viewer 1703 and clicks an OK key 1708 to complete the setting of the “Sato Mitsuru” toolbar.

  According to the second embodiment described above, the toolbar can be easily edited and customized according to the use of the toolbar and the needs of the user. For this reason, in addition to the effects obtained in the first embodiment, the second embodiment can further improve the operability of the information input / output device by enhancing the usability of the displayed toolbar.

[Third Embodiment]
Next, a third embodiment of the present invention will be described. Note that, among the information input / output devices of the third embodiment, the same components as those of the information input / output devices described in the first and second embodiments are denoted by the same reference numerals, and the description thereof is partially omitted.

  In the third embodiment, the program provided in the information input / output device described in the first embodiment further deletes the toolbar from the display screen when two or more points on the touch panel are touched at the same time, or It includes a procedure for changing the display form. Furthermore, the third embodiment includes a procedure in which the program of the information input / output device switches the length direction of the displayed toolbar to either vertical or horizontal based on the drag direction of the toolbar.

  That is, the information input / output device of the first embodiment displays the toolbar by simultaneously touching the display screen, and deletes the toolbar after executing the function set in the toolbar (FIG. 13, step S1308). In the information input / output device of the third embodiment, the toolbar is displayed by simultaneously touching without displaying the toolbar on the display screen, and the toolbar displayed by simultaneously touching with the toolbar displayed is erased. You can change the display to just control buttons.

  18A to 18F are diagrams for explaining the procedure for changing the display form of the toolbar according to the third embodiment, and the length direction of the toolbar when the toolbar display form is restored to the original or It is a figure for demonstrating the procedure switched to a side. The toolbar shown in FIG. 18 includes a control button 1801 and a function button 1802.

  As shown in FIG. 18A, when the display screen is simultaneously touched while the toolbar is displayed, the screen control unit deletes the toolbar function buttons 1802 and displays only the control buttons 1801 (buttons). ). In this case, it is assumed that the simultaneous touching can be performed on the toolbar button regardless of the point on the display screen (including on the toolbar).

  Further, when the operator drags (drags) the buttoned toolbar, the screen control unit 108 obtains the drag direction based on the coordinates input from the coordinate control unit 107. When the control button 1801 is dragged in the horizontal direction, the function buttons 1802 are displayed as a horizontal toolbar extending in the horizontal direction as shown in FIGS. Further, when the control button 1801 is dragged in the vertical direction, as shown in FIGS. 18E and 18F, a vertical toolbar in which the function button 1802 extends in the vertical direction is displayed.

  FIGS. 19A and 19B are diagrams for specifically explaining a method of calculating the drag direction of the tool bar. After the drag operation and detachment by the operator, the screen control unit 108 calculates the drag start coordinates (x1, y1) where the drag has started and the drag end coordinates (x2, y2) where the drag has ended. Then, the moved length (movement length) of the touch point from the calculated drag start coordinate (x1, y1) to the drag end coordinate (x2, y2) is calculated separately for the x direction and the y direction. The movement length Δx in the x direction is calculated by x2−x1, and the movement length Δy in the y direction is calculated as y2−y1.

  The drag direction is calculated by comparing the movement lengths Δx and Δy with Δy / Δx (drag angle) in the operation direction angle calculation diagram shown in FIG. The data represented by the operation direction angle calculation diagram is stored on a program provided in the information input / output device of the third embodiment. In the illustrated operation direction angle calculation diagram, the drag angle is determined in increments of 10 degrees, but the angle unit for determining the drag angle can be arbitrarily set.

  The operation direction angle calculated by the information input / output device of Embodiment 3 is expressed using an approximate value of the drag angle. For example, when the detected Δx and Δy both have negative values and the drag angle is 0.9000, the screen control unit 108 displays Δx−, Δy−, Δy / Δx = 0 in the operation direction angle calculation diagram. The operation direction angle of 230 degrees which is an operation direction angle of 839 is adopted as the operation direction angle.

The relationship between the operation direction angle and the display form of the toolbar corresponding to the operation direction angle will be described below.
Operating direction angle: 0 ° to 44 ° Vertical tool bar Operating direction angle: 45 ° to 134 ° Horizontal tool bar Operating direction angle: 135 ° to 224 ° Vertical tool bar Operating direction angle: 225 ° to 314 ° Horizontal tool bar operating direction angle: 315 ° -359 ° Vertical toolbar

  FIGS. 20A to 20D are diagrams for explaining that the displayed toolbar is erased by simultaneously touching the toolbar in a displayed state. As shown in FIGS. 20A and 20B, the toolbar may be erased immediately by simultaneous touching. In addition, as shown in (c) and (d), when touching simultaneously with only the toolbar control button 1801 displayed, a message for allowing the operator to confirm that the toolbar is to be deleted is displayed. Good.

  When simultaneous touching is performed with the toolbar displayed, whether the toolbar is buttoned or deleted, and whether or not a message is displayed upon deletion is determined by the operator on the program for controlling the information input device. Can be set.

  FIG. 21 is a flowchart for explaining the information input / output control method of the third embodiment described above. The information input / output control method shown in FIG. 21 is executed by the personal computer 102 of the information input / output device according to a program.

  In the flowchart shown in FIG. 21, the personal computer 102 first determines whether or not coordinate data has been input via the coordinate input unit 106 (step S2101). If no coordinate data is input as a result of the determination (step S2101: No), the process waits until coordinate data is input.

  When coordinate data is input (step S2101: Yes), the personal computer 102 determines whether or not the coordinate data indicates simultaneous touch in the coordinate control unit (step S2102). If it is determined that the simultaneous touch has been made (step S2102: Yes), it is determined whether or not the toolbar is already displayed (step S2103). If the toolbar has already been displayed (step S2103: Yes), it is determined whether the toolbar is set to be buttoned (step S2104).

  If the result of determination in step S2104 is that the toolbar has been set to be buttoned (step S2104: Yes), the toolbar is buttoned and prepared for the next coordinate data input. If the setting for converting the toolbar into a button is not made (step S2104: No), the toolbar is deleted to prepare for the next input of coordinate data.

  In step S2102, if the coordinate data does not indicate simultaneous touch (step S2102: No), it is determined whether the coordinate data indicates a drag operation in consideration of previously input coordinate data. (Step S2107). If it is a drag operation (step S2107: Yes), it is determined whether or not this drag operation is performed on the toolbar (step S2108).

  If a drag operation has been performed on the toolbar (step S2108: Yes), it is determined whether the toolbar is buttoned (step S2109). If the toolbar is buttoned (step S2109: Yes), the drag angle is calculated by the procedure described in FIG. 19 to obtain the operation direction angle (step S910). Then, it is determined whether to display the vertical toolbar according to the calculated operation direction operation angle (step S2111). As a result of the determination, if the vertical display toolbar is to be displayed (step S2111: Yes), the vertical display toolbar is displayed (step S2113). If the vertical toolbar is not displayed (step S2111: NO), the horizontal display toolbar is displayed (step S2112).

  Further, the coordinate data input in step S2107 does not indicate a drag operation (step S2107: No), the drag operation is not performed on the toolbar (step S2108: No), and the toolbar is not buttoned (step S2109). : No), the personal computer 102 returns to step S2101 to prepare for the input of the next coordinate data.

  According to the third embodiment described above, in addition to the effects obtained in the first embodiment, the toolbar displayed by the operator simultaneously touching the display screen can be erased or converted into a button. For this reason, the operator can delete the toolbar or turn it into a button without moving from a position where the tool cannot be reached.

  In the third embodiment, the tool bar can be easily switched to either the vertical tool bar or the horizontal tool bar according to the position of the operator on the display screen or the image displayed on the display screen. Therefore, it can be said that the third embodiment can further improve the operability of the information input / output device.

  In the first to third embodiments described above, a light reflection type coordinate input device is used for the information input / output device of the present invention. However, the present invention is not limited to such a configuration, and can be applied to other coordinate input devices. Next, another configuration of the coordinate input apparatus to which the present invention can be applied will be exemplified and described.

  Note that the coordinate input / output device described below includes the same configuration as the coordinate input / output device used in the above-described embodiment. In the figure used for explanation, the same reference numerals are used for the same components as those of the coordinate input / output device shown in FIGS. 4 to 9 (the diagram showing the basic configuration of the coordinate input device used in the first to third embodiments). A part of the explanation will be omitted.

"Retroreflective member on the pen"
First, as another coordinate input device applicable to the present invention, a light reflection type seating table input device will be described with reference to FIGS. FIG. 22 is a perspective view showing instruction means 2201 used in the coordinate input device. FIG. 23 is a front view showing an example in which one point in the coordinate input area 2303 of the coordinate input device 2300 is indicated by the instruction means 2201.

  As shown in FIG. 22, a retroreflective member 2202 is provided in the vicinity of the tip of the instruction means 2201 used for pointing to one point in the coordinate input area 2303 of the coordinate input device 2300. The retroreflective member 2202 is formed by arranging a large number of conical corner cubes, for example, and has a characteristic of reflecting incident light toward a predetermined position regardless of the incident angle.

For example, as shown in FIG. 23, the probe light L _n projected from the left side light receiving and emitting means 405 is reflected by the retroreflective member 2202 and is again received as the retroreflected light L _n ′ that follows the same optical path. Light is received by the light emitting means 405. Therefore, as shown in FIG. 23, in the coordinate input device 2300, it is not necessary to provide the retroreflective member 407 in the coordinate input region 2303 unlike the coordinate input device used in the first to third embodiments. The instruction unit 2201 has a pen-like shape, and is preferably made of a material such as rubber or plastic rather than a glossy metal.

  The vicinity of the tip provided with the retroreflective member 2202 of such an instruction means 2201 is inserted into an appropriate position (x, y) of the coordinate input area 2303 of the coordinate input device 2300, and light is emitted from, for example, the left light receiving / emitting means 405 When the probe light Ln in the fan-shaped light flux film is reflected by the retroreflecting member 2202 of the indicating unit 2201, the retroreflected light Ln ′ is received by the light receiving element 503 of the light receiving / emitting unit 405. When the light receiving element 503 receives the retroreflected light Ln ′ in this way, a predetermined position Dn on the light receiving element 503 corresponding to the retroreflected light Ln ′ becomes a region with a high light intensity (bright point).

  That is, as shown in FIG. 24, on the light receiving element 503, a region having a high light intensity is generated at the position Dn, and a peak appears in the shape of the light intensity distribution from the light receiving element 503. The position Dn at which this peak appears corresponds to the outgoing / incident angle θn of the reflected probe light, and θn can be known by detecting Dn. That is, in the case of such a light reflection type coordinate input device 2300 as well, as in the case of the coordinate input device described above, the position coordinates of the instruction means 2201 are calculated by the triangulation method based on the peak appearing in the light intensity waveform. Will be.

"Optical scanning with polygon mirror"
The present invention can also be applied to a coordinate input device that performs optical scanning with a polygon mirror. Next, the configuration of a coordinate input device that performs optical scanning with a polygon mirror will be described with reference to FIGS. In the description of FIGS. 25 to 29, the same components as those described above are denoted by the same reference numerals, and the description thereof is partially omitted. The coordinate input device described here is a modification of the optical unit of the coordinate input device used in the above-described embodiment.

  More specifically, in Embodiments 1 to 3 of the present invention, a sector-shaped light beam is projected to form a coordinate input area. In contrast, a coordinate input device that performs optical scanning with a polygon mirror has a rotational scanning system such as a polygon mirror, and forms a coordinate input area by projecting a light beam emitted from a light source radially by the rotational scanning system. The light emitting / receiving means 2500 is used.

  FIG. 25 is a plan view schematically showing the light emitting / receiving unit 2500. As shown in FIG. 25, the light receiving and emitting means 2500 has a drive circuit (not shown) and an LD (Laser Diode) 2501, a half mirror 2502, and a polygon mirror 2503 which are light sources that emit laser light. A light projecting means 2500 a constituted by a condensing lens 2504 and a light receiving element 2505 are provided. The light receiving element 2505 is configured by a PD (Photo Diode) provided at a distance f from the condenser lens 2504 (f is a focal length of the condenser lens 2504).

  The light emitting / receiving means 2500 sequentially reflects the laser light emitted from the LD 2501 radially by the polygon mirror 2503 that is driven to rotate at a predetermined angular velocity ωt by a pulse motor (not shown) after being turned back by the half mirror 2502. Therefore, the light emitting / receiving unit 2500 repeatedly projects the beam light radially. That is, a coordinate input area (not shown) is formed by the light beams projected radially from the two light emitting / receiving units 2500.

  On the other hand, the beam light reflected and incident on the light receiving / emitting means 2500 is reflected by the polygon mirror 2503 and reaches the half mirror 2502. The reflected beam light that has reached the half mirror 2502 passes through the half mirror 2502, reaches the light receiving element 2505, and is converted into an electrical signal.

  Here, a case where the light emitting / receiving unit 2500 shown in FIG. 25 is applied to a coordinate input device instead of the light emitting / receiving unit 405 will be described. As shown in FIG. 26, when the pointing means 404 is inserted at a certain position in the coordinate input area 403 and the light beam is blocked, the light beam is not reflected by the retroreflecting member 407. The element 503 is not reached. As described above, when the beam light in which the instruction unit 404 is inserted at a certain position in the coordinate input area 403 is blocked, a dip appears in the shape of the light intensity distribution from the light receiving element 503.

The electrical connection and the like of each part are known in the art and will not be described in detail. However, as shown in FIG. 27, when the instruction unit 404 is not inserted in the coordinate input area 403, the light intensity is “ I = I ₁ ”, but if the pointing means 404 is inserted in the coordinate input area 403 and the return light does not return to the light receiving element 2505, the light intensity indicates“ I = I ₀ ”. Thus, the portion where the light intensity is “I = I ₀ ” is a dip. In FIG. 27, time t = t ₀ is the reference position for the rotation of the polygon mirror 2503 and is the time when the rotationally scanned beam light reaches a predetermined angle.

Therefore, if the time t when the light intensity becomes “I = I ₀ ” is t ₁ , the emission angle θ of the beam light blocked by the instruction means 404 inserted in the coordinate input area 403 is
θ = ω (t ₁ −t ₀ ) = ωΔt
Is calculated as In other words, the emission angle θ (θnL, θnR) of the light beam blocked by the instruction unit 404 inserted in the coordinate input area 403 in the light receiving / emitting means 2500 provided on the left and right sides is calculated, and the emission angle θ (θnL) is calculated. , ΘnR), the position coordinates where the pointing means 404 is inserted are detected by the triangulation method.

  Next, a case where the light emitting / receiving unit 2500 is applied to the coordinate input device 2300 instead of the light emitting / receiving unit 405 will be considered. As shown in FIG. 28, when the instruction unit 2301 is inserted at a certain position in the coordinate input area 2303, a predetermined beam light is retroreflected by the retroreflecting member 407 of the instruction unit 2301, and the light beam is received and emitted. The light receiving element 503 (FIG. 24) of the means 2500 is reached. As described above, when the instruction unit 2301 is inserted at a certain position in the coordinate input area 2303 and the light beam is retroreflected, a peak appears in the shape of the intensity distribution of the light from the light receiving element.

The electrical connection and the like of each part are well known in the art and will not be described in detail. However, as shown in FIG. 29, when the instruction means 2301 is not inserted in the coordinate input area 2303, the light intensity is “ I = I ₀ ”, but when the pointing means 2301 is inserted in the coordinate input area 2303 and the return light reaches the light receiving element 503, the light intensity indicates“ I = I ₁ ”. Thus, the portion where the light intensity is “I = I ₁ ” is a peak. In FIG. 29, time t = t ₀ is the reference position for rotation of the polygon mirror 2503, and is the time when the rotationally scanned beam light reaches a predetermined angle.

Therefore, if the time t when the light intensity becomes “I = I ₁ ” is t ₁ , the emission angle θ of the beam light retroreflected by the instruction means 2301 inserted in the coordinate input area 2303 is
θ = ω (t ₁ −t ₀ ) = ωΔt
Is calculated as That is, the emission angle θ (θnL, θnR) of the beam light retroreflected by the instruction unit 2301 inserted in the coordinate input area 2303 in the light receiving / emitting unit 2500 provided on the left and right sides is calculated, and the emission angle θ ( The position coordinates where the instruction means 2301 is inserted are detected by the triangulation method based on (θnL, θnR).

"Imaging method"
The present invention can also be applied to an imaging type coordinate input device. Next, the configuration of an image pickup type coordinate input device will be described with reference to FIGS. In the description of FIGS. 30 and 31, the same components as those described above are denoted by the same reference numerals, and the description thereof is partially omitted. Note that the coordinate input device described here is a modification of the coordinate detection method of the coordinate input device used in the above-described embodiment, in which image information in the coordinate input region is captured by the imaging camera and captured. A so-called camera imaging type coordinate input device that detects position coordinates based on a part of the information is applied.

  FIG. 30 is a front view schematically showing the configuration of the coordinate input device 3000. At both upper ends of the coordinate input area 3001 of the coordinate input device 3000, imaging cameras 3002 as imaging means are provided at a distance w. The imaging camera 3002 is provided with a light receiving element 3003 which is a CCD and an imaging optical lens 3004 with a distance f. These imaging cameras 3002 have an imaging angle of view of about 90 degrees, and are installed so that the coordinate input area 3001 is an imaging range. The imaging camera 3002 is installed at a predetermined distance from the display surface 800 that forms the coordinate input surface, and its optical axis is parallel to the display surface 800.

  In addition, a background plate 3005 is provided at a position that covers the entire imaging field of view without interfering with the imaging field angle of the imaging camera 3002 on the peripheral edge except the upper part of the coordinate input area 3001. The background plate 3005 is provided substantially perpendicular to the display surface 800 with its surface facing the center of the coordinate input area 3001. The background plate 3005 is, for example, uniform black.

  The relationship between the signal of the imaging camera 3002 and the instruction unit 3006 is shown in FIG. As shown in FIG. 31, when the instruction unit 3006 is inserted into the coordinate input area 3001, the instruction unit 3006 is photographed by the imaging camera 3002, and an image of the instruction unit 3006 is formed on the light receiving element 3003 of the imaging camera 3002. The When the background plate 3005 is black and the finger is used as the instruction unit 3006 as in the coordinate input device 3000, the instruction unit 3006 has a higher reflectance than the background plate 3005. A portion corresponding to the instruction unit 3006 of the element 3003 is a region having a high light intensity (bright point).

The electrical connection of each part is well known in the art and will not be described in detail. However, as shown in FIG. 31, when the instruction unit 3006 is inserted in the coordinate input area 3001, the light receiving element 3003 A peak appears in the shape of the light intensity distribution. The position Dn at which this peak appears corresponds to the apparent angle θn of the pointing means 3006 from the principal point of the imaging optical lens 3004, and θn is a function of Dn,
θn = arctan (Dn / f)
It can be expressed as. That is, in the case of such a camera imaging type coordinate input device 3000, as in the case of the coordinate input device described above, the position coordinates of the instruction unit 3006 are calculated by the triangulation method based on the peak appearing in the light intensity waveform. Will be. As the instruction unit 3006, a dedicated pen with a light emitting element that emits light can be used.

"Method using light emitting / receiving element array"
The present invention can also be applied to a coordinate input device using a light emitting / receiving element array. Next, the configuration of a coordinate input device using a light emitting / receiving element array will be described with reference to FIGS. In the description of FIGS. 32 and 33, the same components as those described above are denoted by the same reference numerals, and the description thereof is partially omitted. Note that the coordinate input device described here is a modification of the method of the coordinate input device used in the above-described embodiment, and does not detect coordinates by triangulation, but directly coordinates of two orthogonal axes. A so-called LED array type coordinate input device for detection is applied.

  FIG. 32 is a front view schematically showing the configuration of the coordinate input device 3200. As shown in FIG. 32, the coordinate input device 3200 includes a light emitting element array 3202 in which light emitting diodes (LEDs) 3201 which are Xm light emitting means are arranged at regular intervals in the horizontal direction, and one to one. A light receiving element array 3204 in which phototransistors 3203 as Xm light receiving means corresponding to each other are arranged to face each other at regular intervals, a light emitting element array 3205 in which Yn LEDs 3201 are arranged at regular intervals in the vertical direction, and one-to-one. And a light receiving element array 3206 in which Yn phototransistors 3203 corresponding to the above are arranged to face each other at a constant interval.

  A space surrounded by the light emitting element array 3202, the light receiving element array 3204, the light emitting element array 3205, and the light receiving element array 3206 is used as a coordinate input area 3207. That is, in the coordinate input area 3207, m optical paths formed in the horizontal direction and n optical paths formed in the vertical direction can intersect in a matrix. Note that the coordinate input area 3207 is a size corresponding to the size of the display surface 800 and is formed in a horizontally long rectangular shape, and is an area that enables input of characters, figures, and the like by handwriting.

  When an instruction means 3208 such as a finger is inserted at a position where the coordinate input area 3207 is present, a predetermined optical path is blocked by the instruction means 3208. Therefore, the phototransistor 3203 and the light receiving element of the light receiving element array 3204 in the blocking light path. The amount of light received by the phototransistor 3203 in the column 3206 decreases.

The electrical connection and the like of each part are known in the art and will not be described in detail. However, as shown in FIG. 33, when the instruction unit 3208 is not inserted in the coordinate input area 3207, each phototransistor 3203 is connected. The light intensity of the phototransistor 3203 in the cutoff optical path is “I = i ₁ ”. However, when the instruction means 3208 is inserted into the coordinate input area 3207 and the optical path is blocked, the light intensity of the phototransistor 3203 in the cutoff optical path is “I = i ₁ ”. i ₀ ″. A portion where the light intensity is “I = i ₀ ” is called a dip. In FIG. 33, the horizontal axis corresponds to the position of the phototransistor 3203, and actually represents the scanning time for sequentially reading the light output of the phototransistor 3203.

Then, the dip position corresponding to the position of the phototransistor 3203 of the light receiving element array 3204 and the phototransistor 3203 of the light receiving element array 3206 where the received light intensity is decreased is detected, and the coordinate position indicated by the instruction means 3208 is determined. calculate. Actually, the time t ₁ until the dip position from the reference position t = t ₀ is detected and the waveform shown in FIG. 33 are taken into the memory, and the memory address corresponding to the dip position with respect to the data in the memory As a result, the position of the dip is detected.

  Note that all the coordinate input devices described in this specification are provided in a PDP which is a display device. However, the present invention is not limited to such a configuration, and a CRT (Cathode Ray Tube), an LCD (Liquid Crystal Display), a front projection projector, a rear projection projector, or the like may be applied as a display device. Good. Further, the display device is not limited to these, and although not particularly illustrated, the display device may be provided on a blackboard, a whiteboard, or the like that functions as a writing board.

It is the figure which showed the external appearance of the information input / output device common to embodiment of this invention. It is a figure for demonstrating the part of the touchscreen of the structure shown in FIG. It is a figure for demonstrating the acquisition procedure of the touch candidate point in Embodiment 1 of this invention. 2 is a diagram for describing a basic configuration of an information input / output device according to Embodiment 1. FIG. FIG. 6 is another diagram for explaining a basic configuration of the information input / output device of the first embodiment. FIG. 6 is another diagram for explaining a basic configuration of the information input / output device of the first embodiment. FIG. 6 is another diagram for explaining a basic configuration of the information input / output device of the first embodiment. FIG. 6 is another diagram for explaining a basic configuration of the information input / output device of the first embodiment. FIG. 6 is another diagram for explaining a basic configuration of the information input / output device of the first embodiment. FIG. 6 is a diagram for explaining an operation procedure of the information input / output device of the first embodiment. FIG. 10 is a diagram for describing a procedure for editing a toolbar according to the first embodiment; 3 is a flowchart for explaining a coordinate input control method according to the first embodiment; 4 is a flowchart for illustrating a method for controlling toolbar display according to the first embodiment. FIG. 10 is a diagram for describing another configuration example of the first embodiment. It is another figure for demonstrating the acquisition procedure of the touch candidate point in Embodiment 1 of this invention. FIG. 10 is a diagram for explaining still another configuration example of the first embodiment, and is a diagram illustrating a function setting screen for setting a correspondence between the number of touch points and a function assigned to the number of touch points. It is a figure for demonstrating the procedure which edits the toolbar of Embodiment 2 of this invention. It is a figure for demonstrating the procedure to change the display form of the toolbar of Embodiment 3 of this invention. FIG. 10 is a diagram for specifically explaining a method of calculating a drag direction of a toolbar according to the third embodiment. FIG. 10 is a diagram for explaining that a displayed toolbar is erased by simultaneously touching in a state where the toolbar according to the third embodiment is displayed. 12 is a flowchart for illustrating an information input / output control method according to the third embodiment. It is a figure for demonstrating the structure of the coordinate input device applicable to the information input / output device of this invention. It is another figure for demonstrating the structure of the coordinate input device applicable to the information input / output device of this invention. It is another figure for demonstrating the structure of the coordinate input device applicable to the information input / output device of this invention. It is another figure for demonstrating the structure of the coordinate input device applicable to the information input / output device of this invention. It is another figure for demonstrating the structure of the coordinate input device applicable to the information input / output device of this invention. It is another figure for demonstrating the structure of the coordinate input device applicable to the information input / output device of this invention. It is another figure for demonstrating the structure of the coordinate input device applicable to the information input / output device of this invention. It is another figure for demonstrating the structure of the coordinate input device applicable to the information input / output device of this invention. It is another figure for demonstrating the structure of the coordinate input device applicable to the information input / output device of this invention. It is another figure for demonstrating the structure of the coordinate input device applicable to the information input / output device of this invention. It is another figure for demonstrating the structure of the coordinate input device applicable to the information input / output device of this invention. It is another figure for demonstrating the structure of the coordinate input device applicable to the information input / output device of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 101 Display part 102 Personal computer 103 Frame 104 Display screen 105 Support stand 106 Coordinate input part 107 Coordinate control part 108 Screen control part 109 Image memory 200 Touch panel 201 Light reflection film 202a, 202b Optical unit 402 Coordinate input member 403 Coordinate input area 404 Instruction Means 405 Light emitting / receiving means 406 Point light source 406a Secondary light source 407 Retroreflective member 408, 410, 411 Probe light 409 Retroreflected light 502 Lens 503 Light receiving element 801 Light source 802, 804, 805 Condensing lens 803 Half mirror 806 Slit 904 Interface Driver 905 Converter 906 Driver 907 Hard disk 909 Storage medium 911 Analog processing circuit 1001 Toolbar 1002 Buttons 1101, 1601, 17 01 Pointer 1102, 1710 Button 1103 Name display field 1112, 1704 Setting key 1113, 1606, 1705, 1713 Delete key 1114, 1706 Previous key 1115, 1707 Back key 1116, 1126, 1502, 1607, 1612, 1708, 1715
OK key 1117, 1127, 1136, 1503, 1608, 1613, 1619, 1709, 1816 Cancel key 1121, 1609 Name display field 1122, 1610 File name display field 1123 Selection key 1124 Preview field 1125, 1611 Reference key 1131, 1614 Search destination Field 1132, 1615 Display field 1133, 1616 File name field 1134, 1617 File type field 1702 Toolbar name display field 1703 Toolbar viewer 1711 Registration item display field 1712 Additional key 1714 Selection item display field 1801 Control button 1802 Function button

Claims (20)

A touch panel;
Touch point detecting means for detecting a touched point on the touch panel;
Signal generating means for generating a signal related to the point detected by the touch point detecting means,
The signal generating means generates a coordinate signal indicating the coordinates of the touched point when the touch point detecting means detects that a point on the touch panel is touched within a predetermined time, and When the touch point detecting means detects that two or more points on the touch panel are touched within a predetermined time, a control signal indicating control preset according to the number of touched points is provided. An information input / output device characterized by generating.   When two or more touches on the touch panel are detected by the touch point detection unit, an interval length calculation unit that calculates an interval length that is a length reflecting the interval between touched points based on the detection result 2. The information input according to claim 1, wherein the signal generation unit does not generate the control signal when the interval length calculated by the interval length calculation unit is equal to or longer than a predetermined length. Output device.   The interval length calculation means is based on the detection result of the touch point detection means, the difference between the maximum value and the minimum value of the x coordinate of all the points that may have been touched, the maximum value of the y coordinate, Each difference between the minimum value and the minimum value is calculated as an interval length, and the control signal generation means is configured to determine at least one of a difference between the maximum value and the minimum value of the x coordinate and a difference between the maximum value and the minimum value of the y coordinate. The information input / output device according to claim 2, wherein the control signal is not generated when the length is equal to or greater than the length of the information input / output device.   4. When the control signal is output to a computer having a display screen, at least one of the control signals causes the computer to display a toolbar on the display screen. Information input / output device described in 1.   Touch candidate point obtaining means for obtaining a point that may have been touched when two or more points are touched within a predetermined time on the touch panel, and the control signal indicates the tool bar and the touch candidate point. 5. The information input / output device according to claim 4, wherein the information input / output device is displayed in an area of the display screen corresponding to an area surrounded by a straight line passing through.   The control signal uses the tool bar to set an average value of the maximum value and the minimum value of the x coordinates of the touch candidate points as an x coordinate, and the maximum value and the minimum value of the y coordinates of the touch candidate points. 5. The plurality of touch detection points determined as the y-coordinate or the points on the display screen corresponding to points that are a predetermined distance or less from the plurality of touch detection points are displayed. Or the information input / output device according to 5;   The information input / output device according to claim 1, wherein the control signal is a signal in which computer control is associated with at least one of touches of 2 to 10 points. .   The signal generation means generates the control signal only when the touch point detection means detects that two or more points are touched within a predetermined time within a preset area on the touch panel. The information input / output device according to any one of claims 1 to 7.   When the touch point detecting means detects that two or more points on the touch panel are touched within a predetermined time, the touch point detecting means does not detect a touch on the touch panel until all the detected points are detached. The information input / output device according to claim 1, wherein the information input / output device is a device. A touch point detection step of detecting a touched point on the touch panel;
In the touch point detecting step, when it is detected that one point on the touch panel is touched within a predetermined time, a coordinate signal indicating the coordinates of the touched point is generated, and 2 on the touch panel is generated. A signal generation step of generating a control signal indicating control preset according to the number of touched points when it is detected that more than a point has been touched within a predetermined time; and
An information input / output control method comprising:   When two or more touches on the touch panel are detected in the touch point detection step, an interval length calculation step of calculating an interval length that is a length reflecting the interval between touched points based on the detection result The information input according to claim 10, wherein the signal generation step does not generate the control signal when the interval length calculated in the interval length calculation step is equal to or greater than a predetermined length. Output control method.   The interval length calculation step is based on the result of the detection performed in the touch point detection step, the difference between the maximum value and the minimum value of the x coordinate of all the points that may have been touched, the y coordinate Each difference between the maximum value and the minimum value is calculated as an interval length, and the control signal generation step includes at least a difference between the maximum value and the minimum value of the x coordinate and a difference between the maximum value and the minimum value of the y coordinate. 12. The information input / output control method according to claim 11, wherein the control signal is not generated when one of the predetermined lengths is longer than a predetermined length.   13. When the control signal is output to a computer having a display screen, at least one of the control signals causes the computer to display a tool bar on the display screen. Information input / output control method described in 1.   A touch candidate point obtaining step for obtaining a point that may have been touched when two or more points are touched within a predetermined time on the touch panel, and the control signal includes the tool bar and the touch candidate point. 14. The information input / output control method according to claim 13, wherein the information is displayed in an area on the display screen corresponding to an area surrounded by a straight line passing through.   The control signal uses the tool bar to set an average value of the maximum value and the minimum value of the x coordinates of the touch candidate points as an x coordinate, and the maximum value and the minimum value of the y coordinates of the touch candidate points. The average value is displayed on a plurality of touch detection points determined as y-coordinates or on a point on the display screen corresponding to a point at a distance equal to or less than a predetermined distance from the plurality of touch detection points. Or the information input / output control method according to 14.   16. The information input / output according to claim 10, wherein the control signal is a signal in which control by a computer is associated with at least one of touches of 2 to 10 points. Control method.   The signal generation step generates the control signal only when it is detected in the touch point detection step that two or more points are touched within a predetermined time within a preset area on the touch panel. The information input / output control method according to any one of claims 10 to 16.   In the touch point detection step, when it is detected that two or more points on the touch panel are touched within a predetermined time, a touch on the touch panel is not detected until detachment of all detected points is detected. The information input / output control method according to claim 10, wherein: A computer-readable recording medium storing a program for causing a computer to execute an information input / output device control method,
A touch point detection step of detecting a touched point on a predetermined area set in advance;
In the touch point detection step, when it is detected that one point on the predetermined area is touched within a predetermined time, a coordinate signal indicating the coordinates of the touched point is generated, A signal generation step of generating a control signal indicating control by a computer set in advance according to the number of touched points when it is detected that two or more points are touched within a predetermined time And a computer-readable recording medium characterized by recording an information input / output control method. On the computer,
A touch point detection procedure for detecting a touched point on the touch panel;
In the touch point detection procedure, when it is detected that one point on the touch panel is touched within a predetermined time, a coordinate signal indicating the coordinates of the touched point is generated, and 2 on the touch panel is generated. A signal generation procedure for generating a control signal indicating control by a computer set in advance according to the number of touched points when it is detected that more than a point has been touched within a predetermined time; and An information input / output control method including the program is executed.

Images