JP5537458B2 - Image display device capable of touch input, control device for display device, and computer program - Google Patents

Description

  The present invention relates to an image display device capable of touch input, in which a display device and an input device are integrated, and in particular, an image display device that switches images in units of pages by touching and sliding on the image with a plurality of fingers or the like. The present invention relates to a display device control device and a computer program therefor.

  As an image display device capable of touch input, there are a large-screen display device and a so-called electronic blackboard that detects that a user touches the display device and draws an image or performs some processing. The electronic blackboard is useful for summarizing the opinions of attendees according to the discussion and finding a preferable solution to the problem at a meeting or the like. Various types of electronic blackboards have been put to practical use. In particular, an electronic blackboard device configured as a computer system by combining a display device having a large display screen and an input device for detecting two-dimensional position coordinates such as a touch panel is used.

  In general, the electronic blackboard device sequentially reads position coordinates and movement amount information designated by a pen or a finger, and displays an input locus on a display device based on the read information. Thereby, the electronic blackboard device realizes operations as an electronic blackboard such as handwritten input.

  The advantage of the electronic blackboard is that images can be displayed or written in a plurality of screens. Each unit displayed in such an image is an analogy from a book or the like and is called a “page”.

  In an electronic blackboard that can display images of a plurality of pages, the problem is how to easily switch pages. The simplest method is to provide a page switching button on the screen. However, this method has a problem that it becomes difficult to press the button depending on the position of the user, particularly when the screen is enlarged.

  Therefore, there has been considered a method of switching screens by touching and sliding, for example, a finger on the screen instead of just a button. In this case, in a simple method, this operation is the same as the drawing operation. For this reason, in order to distinguish between the two, Patent Document 1 listed below is when the screen is touched with a plurality of fingers or the like (so-called “multi-touch”), and the plurality of touch positions are slid by a predetermined value or more in the same direction. In addition, a device for switching the screen is proposed.

  As a further development of this concept, there are methods disclosed in Patent Document 2 and Patent Document 3 described later. In the method disclosed in Patent Document 2, the page is turned when an operation of touching and sliding is performed, and the number of pages to be turned at a time is changed by the number of touching fingers (the number of touch points). In the method disclosed in Patent Document 3, image scrolling, page turning, cursor movement, and the like are performed according to the number of fingers touching the display surface and the movement thereof.

JP-A-11-102274 JP-A-8-76926 Japanese Patent Laid-Open No. 9-23004

  According to what is disclosed in Patent Documents 1 to 3, the page can be turned by a simple operation of touching and sliding. However, there are still problems to be solved. It means that pages may be accidentally turned during normal input. In particular, when inputting using a fingertip, a finger different from the finger being used touches the screen and is detected as a multi-touch slide input, resulting in unintended page turning. There is a risk. Therefore, there is a demand for a mechanism that can prevent the occurrence of unintended page turning even if such an erroneous input occurs. On the other hand, a mechanism is required that allows the user to easily understand what kind of input can be used to turn pages.

  Therefore, the object of the present invention is to allow the user to intuitively understand how to perform switching in units of pages on a screen using multi-touch, and to prevent inconvenience of display even if there is an erroneous operation in such a case. An image display device capable of touch input is provided.

  Another object of the present invention is to provide an image display device capable of touch input, in which the user can intuitively understand how to perform switching in units of pages on a screen using multi-touch, and the switching operation is easy. It is to be.

  An image display device capable of touch input according to a first aspect of the present invention has a display surface, displays an image in page units on the display surface, and specifies a position on the display surface. Touch detection means for detecting the position and the number of inputs, and when a plurality of touch inputs are detected by the touch detection means and these positions move in the same direction on the display surface, they are displayed on the display surface. Scrolling means for scrolling the image to be moved along with the movement of the positions of the plurality of touch inputs, and detecting that the number of touch inputs has decreased after detecting the plurality of touch inputs by the touch detection means from the output of the touch detection means. Depending on whether the movement amount of the touch input is less than or equal to the first threshold value, the process of restoring the image on the display surface to the state before scrolling and the image on the display surface are transferred to a plurality of touch inputs. According to the direction and a first page switching means for performing a process of switching one page selectively.

  When a so-called multi-touch that touches the display surface with a plurality of fingers is detected by the touch detection means and the position moves in the same direction, the scroll means scrolls the screen in that direction. Therefore, the user can intuitively understand that the screen can be scrolled by a multi-touch slide operation. On the other hand, when the number of multi-touches decreases after sliding with multi-touch to the first threshold value or less, the scroll up to that point returns to the state before scrolling. Even if you accidentally touch and slide the display surface with multiple fingers, you can immediately notice and release your finger to return to the original screen. When the multi-touch is slid beyond the first threshold and then released, the screen is switched for one page according to the sliding direction. Therefore, it is possible to switch the screen page by a simple operation such as a multi-touch slide operation.

  As a result, it is easy for the user to understand that switching in units of pages can be easily performed on a screen using multi-touch, and in such a case, it is possible to prevent inconvenience of display even if there is an erroneous operation, and touch-inputable images A display device can be provided.

  Preferably, in the image display device capable of touch input, when the image is scrolled by the scroll means, the movement amount of the plurality of touch inputs is larger than a second threshold value larger than the first threshold value. In response to the increase, the second page switching means for switching the image on the display surface by one page according to the movement direction of the plurality of touch inputs is included.

  When the slide operation by multi-touch is performed until the first threshold value is exceeded and the second threshold value is exceeded, the image display is automatically switched according to the sliding direction. The image display can be switched without interrupting the multi-touch slide operation.

  More preferably, the first page switching means operates in response to detecting that all of the plurality of touch inputs are lost.

  When a simple operation of releasing all the multi-touch fingers from the display surface is performed, it is determined whether to switch the image for one page or to restore the original state. The user can control whether or not to switch images without performing complicated operations.

  More preferably, the scroll amount by the scroll means is determined according to the amount of movement of the positions of the plurality of touch inputs along the scroll direction by the scroll means.

  A control device for a display device according to a second aspect of the present invention has a display surface, displays an image received from the outside on the display surface, and specifies a position on the display surface for touch input And a display device control device that is used together with a display device that detects the number and outputs it to the outside. The control device of this display device displays an image displayed on the display surface when it is detected that a plurality of touch inputs are detected by the display device and their positions move in the same direction on the display surface. Means for generating an image that is scrolled along with the movement of the position of the plurality of touch inputs and giving the image to the display device, and the display device indicating that the number of touch inputs has decreased after the display device detects the plurality of touch inputs. Generating page image data so as to return the image on the display surface to the state before scrolling according to whether or not the movement amount of the touch input is equal to or less than a first threshold value, A process of generating page image data is selectively performed so that an image on the display surface is switched by one page in accordance with a moving direction of a plurality of touch inputs. And a page switching means for transmitting the data to the display device.

  The computer program according to the third aspect of the present invention has a display surface, displays an image received from the outside on the display surface, and specifies the position and the number of touch inputs that specify the position on the display surface. In a computer connected to a display device that detects and outputs to the outside, it is detected that a plurality of touch inputs are detected by the display device, and their positions move in the same direction on the display surface. A scroll unit that generates an image that is scrolled from the image displayed on the display surface along with the movement of the positions of the plurality of touch inputs and gives the display device, and after the plurality of touch inputs are detected by the display device , Detecting that the number of touch inputs has decreased from the output of the display device, and scrolling the image on the display surface according to whether or not the amount of touch input movement is equal to or less than the first threshold Selects processing to generate page image data so as to return to the previous state, and processing to generate page image data so that the image on the display surface is switched by one page according to the movement direction of a plurality of touch inputs. It is made to function as a page switching means for transmitting the generated page image data to the display device.

  An image display device capable of touch input according to a fourth aspect of the present invention has a display surface, displays an image in units of pages on the display surface, and specifies a position on the display surface. Touch detection means for detecting the position and the number of inputs, and when a plurality of touch inputs are detected by the touch detection means and these positions move in the same direction on the display surface, they are displayed on the display surface. Scroll means for scrolling the image with the movement of the positions of the plurality of touch inputs, and when the scroll means is scrolling the image, the amount of movement of the plurality of touch inputs is greater than the threshold value. In response, the page switching means for switching the image on the display screen for one page according to the moving direction of the plurality of touch inputs, and the scrolling of the image by the scroll means. When the number of touch inputs is reduced before the page is switched by the page switching unit, it is detected from the output of the touch detection unit, and the scrolling of the image by the scroll unit is returned to the state before scrolling. Means.

  When a plurality of touch positions are detected by the touch detection means and these positions move in the same direction, the scroll means moves the screen along the movement direction of the touch position. Therefore, it can be intuitively understood that the pages can be switched by so-called multi-touch. Further, when a plurality of touch positions move in the same direction as they exceed the threshold value, the screen display is switched according to the movement direction of the touch position during scrolling. The screen can be switched by a simple operation called so-called multi-touch. In addition, for that purpose, it is only necessary to continue to move the touch position without releasing the multi-touch finger or the like from the display surface. If the number of touch inputs decreases before the page is switched, the scroll returns to the previous state, so that it can be easily returned to the original state even if there is an operation.

  As a result, it is possible to provide an image display device capable of touch input, in which it is easy for the user to switch between pages by multi-touch input, and the screen can be easily switched in pages.

  The control device of the display device according to the fifth aspect of the present invention has a display surface, displays an image received from the outside on the display surface, and specifies a position on the display surface. And a display device control device that is used together with a display device that detects the number and outputs it to the outside. The control device detects a plurality of touch inputs detected by the display device, and displays a plurality of images displayed on the display surface when their positions move in the same direction on the display surface. A scroll unit that generates a scrolled image along with the movement of the position of the touch input and gives it to the display device, and a plurality of touch inputs are detected by the touch detection unit, and those positions move in the same direction on the display surface. Sometimes, scroll means for scrolling an image displayed on the display surface with movement of a plurality of touch input positions, and when the image is scrolled by the scroll means, the amount of movement of the plurality of touch inputs is In response to becoming larger than the threshold value, the page cut is performed to switch the image on the display screen by one page according to the movement direction of the plurality of touch inputs. In response to the movement amount of the plurality of touch inputs becoming larger than the threshold value, the image on the display surface is Page switching means for switching one page according to the moving direction, and touch detection means that the number of a plurality of touch inputs is reduced before the page is switched by the page switching means when the scrolling of the image is performed by the scrolling means. And return means for detecting the scrolling of the image by the scroll means to the state before scrolling.

  A computer program according to a sixth aspect of the present invention has a display surface, displays an image received from the outside on the display surface, and specifies the position and the number of touch inputs that specify the position on the display surface. In a computer connected to a display device that detects and outputs to the outside, it is detected that a plurality of touch inputs are detected by the display device, and their positions move in the same direction on the display surface. A plurality of touch inputs are detected by a scroll means that generates an image that is scrolled along with the movement of the positions of the plurality of touch inputs and gives the image to the display device, and the touch detection means. And when those positions move in the same direction on the display surface, the image displayed on the display surface is scrolled along with the movement of the positions of multiple touch inputs. In response to the movement amount of the plurality of touch inputs being larger than the threshold value when the scroll means and the scrolling of the image by the scroll means are performed, the image on the display surface is displayed as the plurality of touch inputs. In response to the movement amount of the plurality of touch inputs being larger than the threshold value when the page switching means for switching one page according to the moving direction of the image and the scrolling of the image by the scroll means are displayed. A page switching unit that switches the image on the screen by one page according to the moving direction of the plurality of touch inputs, and a plurality of touches before the page switching by the page switching unit when the image is scrolled by the scroll unit. The decrease in the number of inputs is detected from the output of the touch detection means, and the scroll of the image by the scroll means is scrolled. To function as a return means for returning the Lumpur previous state.

  As described above, according to the present invention, the user can intuitively understand that switching in units of pages can be easily performed on a screen using multi-touch, and in such a case, even if there is an erroneous operation, the display of Inconvenience can be prevented. Furthermore, the image can be switched for one page by a simple operation such as a multi-touch slide operation. There is no need to interrupt the multi-touch slide operation.

It is a block diagram which shows the outline | summary of a structure of the electronic blackboard apparatus which concerns on embodiment of this invention. It is a figure which shows an example of the detection method of a touch input. It is a figure which shows an example of a display screen. It is a flowchart which shows the control structure of the program which implement | achieves the page switching by multitouch in the electronic blackboard apparatus which concerns on one embodiment of this invention. In one embodiment of the present invention, it is a diagram showing an operation of sliding with multi-touch. In one embodiment of the present invention, after sliding in the multi-touch distance D _1, it is a diagram showing an operation releasing the finger. In one embodiment of the present invention, after the sliding distance greater D ₂ than the distance D ₁ in a multi-touch is a diagram showing an operation removing the finger. In one embodiment of the present invention, by a distance D ₂ in a multi-touch slide is displayed when the finger is released from a diagram showing a screen page switching language. In one embodiment of the present invention, it is a diagram showing a screen when the slide in a multi-touch distance D _3. FIG. 10 is a diagram illustrating a screen when a slide operation is continued even after the screen is switched for one page from the screen illustrated in FIG. 9.

  In the following embodiments, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

  In the following, “touch” means that the input position detection device is in a state in which the position can be detected. When touching and pressing the detection device, touching without pressing, and contact Including the case of close proximity without. As will be described later, the input position detection device is not limited to the contact type, and a non-contact type device can also be used. In the case of a non-contact type detection device, “touch” means a state in which the input position is close to the detection device up to a detectable distance.

[Constitution]
Referring to FIG. 1, an electronic blackboard device 100 according to an embodiment of the present invention includes an arithmetic processing unit (hereinafter referred to as a CPU) 102, a read-only memory (hereinafter referred to as a ROM) 104, a rewritable memory (hereinafter referred to as a CPU). , RAM) 106, recording unit 108, interface unit (hereinafter referred to as IF unit) 110, touch detection unit 112, display unit 114, display control unit 116, video memory (hereinafter referred to as VRAM) 118, and bus 120. The CPU 102 controls the electronic blackboard device 100 as a whole.

  The ROM 104 is a nonvolatile storage device, and stores programs and data necessary for controlling the operation of the electronic blackboard device 100. The RAM 106 is a volatile storage device. The recording unit 108 is a non-volatile storage device that retains data even when power is cut off, and is, for example, a hard disk drive, a flash memory, or the like. The recording unit 108 may be configured to be detachable. The CPU 102 reads a program from the ROM 104 onto the RAM 106 via the bus 120 and executes the program using a part of the RAM 106 as a work area. CPU102 controls each part which comprises the electronic blackboard apparatus 100 according to the program stored in ROM104.

  Connected to the bus 120 are a CPU 102, a ROM 104, a RAM 106, a recording unit 108, an IF unit 110, a touch detection unit 112, a display control unit 116, and a VRAM 118. Data (including control information) is exchanged between the units via the bus 120.

  The IF unit 110 connects to the outside such as a network, and transmits / receives image data to / from a computer connected to the network. Image data received from the outside via the IF unit 110 is recorded in the recording unit 108.

  The display unit 114 is a display panel (liquid crystal panel or the like) for displaying an image. The display control unit 116 includes a drive unit for driving the display unit 114, reads out image data stored in the VRAM 118 at a predetermined timing, generates a signal for display as an image on the display unit 114, and displays it. Output to the unit 114. The image data to be displayed is read from the recording unit 108 by the CPU 102 and transmitted to the VRAM 118.

  The touch detection unit 112 is a touch panel, for example, and detects a touch operation by the user. At this time, when there are a plurality of touch positions of the user, the touch detection unit 112 sequentially outputs the coordinates for each of the touch positions. As a result, by monitoring the output of the touch detection unit 112, the number of touch locations and their coordinates can be known sequentially. Detection of a touch operation when a touch panel is used for the touch detection unit 112 will be described with reference to FIG.

  FIG. 2 shows an infrared cut-off detection type touch panel (touch detection unit 112). The touch panel is arranged in a row so as to face the LED rows 200 and 202, and the light emitting diode rows (hereinafter referred to as LED rows) 200 and 202 arranged in a row on two adjacent sides of the rectangular writing surface. The two photodiode arrays (hereinafter referred to as PD arrays) 210 and 212 are provided. Infrared light is emitted from each LED of the LED rows 200 and 202, and each PD of the PD rows 210 and 212 facing each other detects the infrared light. In FIG. 2, infrared rays are indicated by upward and leftward arrows from the LEDs of the LED rows 200 and 202.

  The touch panel includes, for example, a microcomputer (hereinafter referred to as a microcomputer) (an element including a CPU, a memory, an input / output circuit, etc.), and controls the light emission of each LED. Each PD outputs a voltage corresponding to the intensity of the received light. The output voltage of the PD is amplified by an amplifier. Further, since signals are simultaneously output from a plurality of PDs in each of the PD columns 210 and 212, the output signals are temporarily stored in a buffer and then output as serial signals according to the arrangement order of the PDs and transmitted to the microcomputer. The The order of the serial signals output from the PD column 210 represents the X coordinate. The order of the serial signals output from the PD column 212 represents the Y coordinate.

  When the user touches one point on the touch panel with the touch pen 220, infrared rays are blocked by the pen tip of the touch pen 220. Therefore, the output voltage of the PD that has received the infrared light before being cut off decreases. Since the signal portion from the PD corresponding to the touched position (XY coordinate) is decreased, the microcomputer detects the portion where the signal level of the two received serial signals is lowered and obtains the touched position coordinate. . The microcomputer transmits the determined position coordinates to the CPU 102. Since the process of detecting the touch position is repeated at a predetermined detection cycle, if the same point is touched for a longer time than the detection cycle, the same coordinate data is repeatedly output. Even if the touch detection unit 112 is touched with a finger without using the touch pen 220, the touched position can be similarly detected.

  Since the touched position detection technique described above is well known, further description will not be repeated. The touch detection unit 112 may be a touch panel (capacitance method, surface acoustic wave method, resistance film method, or the like) other than the infrared blocking method. In the capacitance method, the position can be detected without contact as long as the sensor is close to the sensor.

  A screen as shown in FIG. 3 is displayed on the display unit 114. The display screen of the display unit 114 is divided into a drawing area 230 and a function button area 240. The drawing area 230 is an area where the user can draw by a touch operation. That is, the touched point and the XY coordinates of the movement locus thereof are transmitted from the touch detection unit 112 to the CPU 102 as described above. The CPU 102 writes a predetermined value to the corresponding memory address on the VRAM 118 according to the received coordinate data. Although the pixel value of the image data on the VRAM 118 may be changed, here, the VRAM 118 includes an area for storing drawing data (hereinafter also referred to as an overlay area) in addition to the area for storing the image data. And In this case, for example, the data of the memory address in which the overlay area is not drawn is set to “0”, and the CPU 102 writes “1” to the memory address corresponding to the drawing position. The display control unit 116 superimposes the image data and the drawing data (overlay area data) and displays them on the display unit 114. That is, the drawing data is displayed (displays a preset color) at a point where there is drawing data (for example, a pixel in which “1” is recorded in the overlay region), and the point where there is no drawing data (eg, “0” in the overlay region). The image data is displayed in the pixel where “is recorded”.

  In the function button area 240, function buttons 242 to which specific functions are assigned are displayed. A page operation area 250 is displayed below the drawing area 230. In this area, a page feed button 252, a page return button 254, and a page number display field 256 are displayed. When touched, the page feed button 252 is a button for sending the displayed page (image data) to the right side and displaying the next page. When touched, the page return button 254 is a button for sending the displayed page to the left and displaying the previous page. The page number display field 256 displays the number of the currently displayed page among a plurality of pages to be displayed.

  When the user touches the page feed button 252, the coordinate data of the touched position is transmitted from the touch detection unit 112 to the CPU 102, and the CPU 102 receives the received coordinate data as the position within the area where the page feed button 252 is displayed. It is determined that Then, the CPU 102 transmits image data of the next page to the VRAM 118 and transmits a page feed command to the display control unit 116. In response to this, the display control unit 116 generates a signal for displaying an image in the middle of page feed from the image data corresponding to the currently displayed page on the VRAM 118 and the image data corresponding to the next page. Generate and output to the display unit 114. As a result, an image in the middle of page turning is displayed on the display unit 114. In the middle of page feed, only the frame of the currently displayed image may be displayed on the display screen of the display unit 114.

  Functions assigned to the function buttons 242 include, for example, a drawing function by touch operation (selectable pen type), a function to open a file (image data) stored in the recording unit 108, and an eraser for deleting drawing in a predetermined area. A function, a function of storing the displayed image data in the recording unit 108, a function of printing the displayed image data, and the like. Each function button 242 is displayed as an icon.

  The program for realizing the page switching function of the electronic blackboard apparatus 100 according to the present embodiment using the hardware shown in FIG. 1 by being executed by the CPU 102 shown in FIG. 1 has the following control structure. Have.

  Referring to FIG. 4, this program monitors the output of touch detection unit 112, and proceeds to the next flow of control in response to the detection output of the user's touch from touch detection unit 112. Again, based on the output of the touch detection unit 112, a step 302 in which a new finger touch position is detected and the control proceeds to the next, and based on the results of steps 300 and 302, two or more touches by the user And step 304 for determining whether or not the multi-touch is performed with a finger. The touch detection unit 112 used in the present embodiment has a function of outputting coordinate data corresponding to the number of touches in response to a touch by the user. Therefore, such a determination can be made based on the output of the touch detection unit 112.

  The program further includes a step 306 of storing the touch position detected in steps 300 and 302 in the RAM 106 (see FIG. 1) when the determination in step 304 is affirmative. Since multi-touch is detected, the number of coordinate values corresponding to the number of detected touches is stored here. In the subsequent processing, finger coordinate data is detected for each detected touch position, and these are stored as an array in the RAM 106 as a series of data.

This program further continues to step 308, where step 308 detects the current finger position from the output of the touch detection unit 112, and the detection output of any one of the multi-touches is based on the detection result in step 308. Step 310 for determining whether or not there is no finger (that is, even one finger has been released from the touch detection unit 112), and the X coordinate of the last detected finger position and step when the determination in Step 310 is affirmative Comparing the X coordinate of the first finger position recorded at 306 to determine whether the absolute value of the difference between the two is greater than a threshold value _DTH1 . In the present embodiment, since the page moving direction is performed along the horizontal direction of the drawing area 230 (FIG. 3), the X coordinates of the finger positions are compared in this way.

If the determination in step 330 is affirmative, in step 332, the page displayed in the drawing area 230 is changed according to the moving direction of the finger. That is, if the finger movement direction is the left direction in FIG. 3, the next page of the current page is displayed in the drawing area 230, and if it is rightward, the previous page of the current page is displayed in the drawing area 230. On the other hand, when the determination in step 330 is negative, in step 334, the scroll of the image displayed in the drawing area 230 is released. In this embodiment, as will be described later, when a finger is slid left and right in a multi-touch state, the image scrolls to the left and right accordingly. Therefore, if the slid length is equal to or less than the threshold value _DTH1 , it is necessary to return the screen display to the original state. In step 334, the display of the drawing area 230 is returned from the scrolled image to the state where the original page is displayed. After the processing of step 332 and step 334, the flow of control returns to step 300 and waits until the next touch position is detected.

When the determination in step 310 is negative, that is, when it is determined that all the positions of the multi-touch are maintained, in step 312, the finger positions detected in step 308 are all recorded in step 306. It is determined whether the left direction is seen from the finger position. If the determination is affirmative, in step 314, the amount of movement (absolute value of the X coordinate difference) is calculated, and it is determined whether or not the value is greater than a threshold value _DTH2 . In the present embodiment, threshold value D _{TH2 at} this time is larger than threshold value D _TH1 in step 330. In this embodiment, the movement amount is an average value of all the movement amounts of the multi-touch finger position.

  If the determination in step 314 is affirmative, the screen displayed in the drawing area 230 in step 316 is the image of the previous page. That is, if the current image is the second page, the image of the first page is displayed in the drawing area 230 by the processing in step 316. Control flow returns to step 300. On the other hand, if the determination in step 314 is negative, in step 318, the screen displayed in the drawing area 230 is scrolled to the left by the same length as the movement amount of the finger position in step 314. At this time, if the previous page exists, the left end of the page is displayed on the right side of the drawing area 230. Control flow proceeds to step 308.

If the determination in step 312 is negative, it is determined in step 320 whether or not the finger position detected in step 308 is in the right direction as viewed from the finger position recorded in step 306. If the determination is affirmative, in step 322, the movement amount (absolute value of the X coordinate difference) is calculated, and it is determined whether or not the value is larger than the threshold value _DTH3 . The threshold value at this time is equal to the threshold value _DTH2 in step 314.

  If the determination in step 322 is affirmative, the screen displayed in the drawing area 230 in step 324 is set as the next one-page image. That is, if the current page is the second page, the image of the third page is displayed in the drawing area 230. Control flow returns to step 300. On the other hand, if the determination in step 322 is negative, in step 326, the screen displayed in the drawing area 230 is scrolled rightward by the same length as the movement amount of the finger position calculated in step 322. At this time, if the next page exists, the right end of the page is displayed on the left side of the drawing area 230. Control flow proceeds to step 308.

  If the determination in step 320 is negative, that is, if there is no change in the X coordinate of the finger position, control proceeds to step 328. In step 328, processing predetermined according to the X-coordinate and Y-coordinate values of the finger position or the history thereof is executed. The processing performed in step 328 includes, for example, when a specific button is pressed by multi-touch, when a plurality of specific buttons are multi-touched, so-called pinch out that widens the finger interval, so-called pinch in that narrows the finger interval, etc. There is a display update operation associated with. In step 328, such processing is performed. Since the processing content in step 328 is not related to the present invention, detailed description thereof will not be given here for the sake of clarity. After step 328, control flow returns to step 308.

  The above is the control structure of the routine that realizes the multi-touch process.

  On the other hand, when it is determined in step 304 that the detected finger position is one place and it is not multi-touch, the processing from step 336 is executed. In step 336, it is determined whether the finger has left the drawing area 230 of the touch detection unit 112.

  If the determination in step 336 is affirmative, in step 338, based on the finger position at the start of the touch detected in step 300 and the finger position immediately before it is detected in step 304 that the finger has been released, Processing is executed. For example, the processing when the function button 242, the page feed button 252, and the page return button 254 shown in FIG. 4 are pressed corresponds to this. Thereafter, the flow of control returns to step 300, and the output of the touch detection unit 112 is monitored until the next touch is detected.

When the determination in step 336 is negative, it means that only one finger position is continuously detected. In this case, in step 340, it is detected whether or not the detected finger position is inside the drawing area 230. If the determination is affirmative Jode step 340, at step 342, the finger position, the drawing in accordance with drawing setting at that time is performed. Control flow returns to step 302. If the determination in step 340 is negative, there is no need to draw, so control returns directly to step 302.

[Operation]
The electronic blackboard device 100 operates as follows. In the following description, the operation of the electronic blackboard apparatus 100 relating mainly to page turning will be described. A detailed description of the operation of parts not particularly related to the present invention will not be given here.

Referring to FIG. 5, it is assumed that the third page of the document is displayed on the screen of display unit 114. Here, it is assumed that the user 380 touches the display surface of the display unit 114 with two fingers and slides rightward as indicated by an arrow 382. The sliding amount is assumed than the threshold _{D TH1} is a small distance _{D 1.}

With reference to FIG. 4, the flow of control of the program at this time will be described. In step 300, the first finger position is detected, and in step 302, the next finger position is subsequently detected. Since multi-touch here, the determination in step 304 is YES. The two finger positions when touched for the first time in step 306 are stored in the RAM 106. In step 308, the current finger position is detected again. If the user continues to slide as shown in FIG. 5, the determination in step 310 is negative. Accordingly, in step 312, it is determined whether or not the two finger positions have moved leftward. Here, the two finger positions are both moving in the right direction. Therefore, the determination is negative. As a result, control proceeds to step 320. In step 320, it is determined whether or not the finger position has moved to the right. In the state shown in FIG. 5, this determination is affirmative. Therefore, in step 322, it is determined whether or not the finger movement amount is larger than the threshold value _DTH1 . At the beginning of the repetition, the movement amount is smaller than the threshold value _DTH1 . Therefore, the determination is negative. As a result, in step 326, the screen is scrolled to the right by the amount equal to the finger movement amount (average of the movement amounts of the two finger positions). Thereafter, the control returns to step 308, and the next iterative process is started.

As the user continues to slide, the above-described processing is repeated many times. As a result, if the distance D ₁ which has moved the finger is less than the threshold D _TH1, the display of the display unit 114 is as shown in FIG. Referring to FIG. 6, assume that user 380 has touched the display surface and then slid by distance D ₁ (≦ D _TH1 ). Screen is scrolled in the same only the right direction as the distance D _1. As a result, the right end portion 396 of the image of the next page is displayed at the left end of the screen.

It is assumed that, at a position 392 where the user has slid by the distance D ₁ (≦ D _TH1 ), the slide is interrupted as indicated by an arrow 390 and the finger is released from the display surface. In this case, the determination at step 310 in FIG. 5 is affirmative, and the control proceeds to step 330. Since the distance D ₁ ≦ D _TH1, the determination in step 330 is negative and the scroll is released in step 394. As a result, the screen returns to the state shown in FIG.

On the other hand, referring to FIG. 7, the user 380 interrupts the slide as indicated by an arrow 412 at a position 416 where the user 380 has slid by a distance D ₂ (where D _TH1 <D ₂ ≦ D _TH2 ), and the finger is displayed on the display surface. Shall be separated from Just before releasing the finger, the right edge 418 of the screen of the next page is displayed at the left edge of the screen, as in the case of FIG. The width of the right end portion 418 is approximately equal to the distance _{D 2.} When the finger is removed, the determination at step 310 in FIG. 5 is affirmative, and control proceeds to steps 330 and 332 below. In step 332, processing for advancing the screen by one page in the right direction is performed. That is, as shown by an arrow 420 in FIG. 7, the image of the next page is scrolled rightward by one page, and the next page is displayed on the display unit 114 as shown in FIG. In the example shown in FIGS. 7 and 8, the screen is the third page before the screen is moved and the fourth page after the screen is moved.

  Thereafter, referring to FIG. 4, the control proceeds to step 300, where CPU 102 performs a process of monitoring the output of touch detection unit 112 until the user next touches the screen.

Here, the user is different from the FIG. 6, by a distance D ₂ be slid without stop slides further assumed that continued to slide rightward. In this case, the determination in step 310 is affirmative, and control proceeds to steps 312, 320, and 322. 9, while the distance _{D 3} that is slid satisfies _{D 3} ≦ _{D TH2,} the determination of step 322 is negative. Thus a state in which the distance D ₃ only screen is scrolled to the right at step 326. In the example shown in FIG. 9, the right end 444 of the next screen is displayed at the left end of the screen. The width of the right end portion 444 is substantially equal to the distance _{D 3.} Control returns to step 308 and the next iteration begins.

Further, the user 380 continues to slide to the right in this state, the distance D ₃ is assumed to become larger than the threshold D _TH2. The determination at step 322 is affirmative, and the screen is advanced to the right by one page at step 324. That is, as shown in FIG. 10, the screen of the fourth page is displayed on the display unit 114. Control returns from step 324 to step 300 to detect the touch position of the next user. If the user 380 continues to slide rightward as indicated by the arrow 460, the user's slide is detected as a new touch in step 300. Therefore, the operations described above are repeated with the touch position of the user 380 at the time when the page is switched through the processing of steps 300, 302, and 304 as the head position.

  The above description is for when the user slides in the right direction. However, since it is clear from the above description that the same operation is performed in the left direction, detailed description thereof will not be repeated.

  Note that when a vertical slide, pinch-out, pinch-in, or the like is performed by multi-touch, control is performed in steps 310, 312, 320, and 328 in FIG. A corresponding process is executed. When any operation is performed by single touch, control proceeds from step 304 to step 336. Until the finger is released, if it is an operation in the drawing area 230, drawing is performed at the finger position by the processing from step 340 to step 342. If the operation is outside the drawing area 230, nothing is performed in the present embodiment.

  When the finger is released with a single touch, control proceeds from step 304 336 to step 338. In step 338, based on the finger position detected first and the finger position immediately before the finger is released, processing corresponding to them is performed. For example, when the user touches and releases a finger on one of the function buttons 242, a predetermined process corresponding to the function button 242 is executed in step 338.

As described above, according to the electronic blackboard device 100 according to the present embodiment, when the user performs multi-touch and slides horizontally on the screen, the electronic blackboard device 100 operates as follows. During the slide, the screen is scrolled according to the slide amount. After moving a distance D _1, when the finger is released, if the distance D ₁ is less than or equal to the threshold D _TH1, it releases the scroll, return the screen to the state before the slide. If the distance _{D 1} is greater than the threshold _{D TH1,} move one page to screen. In the above embodiment, the next page is displayed when sliding to the right, and the previous page is displayed when sliding to the left.

If the user over a greater distance than the threshold D _TH1 described above has a slide switch pages long slide distance D ₁ is D _TH2 or less is not the sole, the scroll of the screen according to the sliding amount is performed. If the distance _{D 1} is greater than the threshold _{D TH2,} performed automatically switching the pages. Thereafter, the slide is continuously performed, and the same operation as that when a new slide is started is executed.

  According to the present embodiment, when sliding with multi-touch, the screen is scrolled. Therefore, the user can intuitively understand that the screen can be scrolled by multi-touch. When the multi-touch finger is released during multi-touch slide, the scroll is canceled and the original screen is restored if the slide amount is small. Even if you accidentally perform a multi-touch slide operation while writing to the screen, the screen will return to normal as soon as you release your finger. Less is. On the other hand, if the finger is released after sliding a certain distance, switching to the next page (page feed) is performed next, so page feed can be realized by an intuitive operation such as a multi-touch slide operation. Furthermore, when the slide is continued without releasing the finger, the page is automatically moved in a state where the slide is continued, and the slide can be further continued. Therefore, it is possible to obtain an effect that a continuous page feed operation is simplified.

  In the above embodiment, in step 310 of FIG. 4, it is determined that the slide is finished when even one of the multi-touch fingers leaves the input screen. However, the present invention is not limited to such an embodiment. It may be determined that the slide is finished only after all fingers are removed. That is, if multi-touch is performed at the start of the slide, the slide can be continued even after non-multi-touch so that the same effect as in the above embodiment can be obtained.

  In the above embodiment, it is determined whether or not multi-touch is performed in step 304 in FIG. 5. When it is not determined that multi-touch is performed, processing different from page switching or scrolling such as drawing is executed. However, the present invention is not limited to such an embodiment. For example, page switching or scrolling is performed only when multi-touch with three or more fingers. When touching with two or less fingers, other than page switching or scrolling even if multi-touch with two fingers is used. Processing such as drawing may be executed. In general, when N is an integer greater than 1, the above-described page switching or scrolling process is performed only when multi-touch with N fingers, and when touching with N-1 or less fingers, drawing or the like is performed. Processing other than switching or scrolling processing may be executed.

Furthermore, method of calculating the distances D ₁ is not limited to the use of average values of the movement amounts of a plurality of finger position as in the above embodiment. For example, the movement amount may be calculated from only one finger position detected first. Further, the threshold values _DTH1 and _DTH2 may be changed according to the moving speed of the finger position during sliding.

  In the above embodiment, it is assumed that the slide and the page turn are along the horizontal direction (X-axis direction) of the screen. However, it is obvious that the present invention is not limited to such an embodiment. For example, the direction of sliding and page turning may be the vertical direction (Y-axis direction). A slide that considers both the X-axis direction and the Y-axis direction may be used. That is, the present invention can be applied to an embodiment in which sliding in the licking direction is possible. In this case, the first and second threshold values may be determined separately for both the X-axis direction and the Y-axis direction, or may be the same regardless of the direction. Further, it may be determined whether to turn the page based on the length of the slide locus (distance between the start point and the end point) without decomposing the slide length into components in the X-axis direction or the Y-axis direction.

  In the above embodiment, the case of drawing or sliding on the screen with a finger has been described, but the present invention is not limited to such an embodiment. For example, a dedicated pen may be used. Any touch position detection method on the touch panel may be used as long as it can detect that a plurality of positions are touched.

  The embodiment disclosed herein is merely an example, and the present invention is not limited to the above-described embodiment. The scope of the present invention is indicated by each claim of the claims after taking into account the description of the detailed description of the invention, and all modifications within the meaning and scope equivalent to the wording described therein are included. Including.

100 electronic blackboard device 102 arithmetic processing unit (CPU)
104 Read-only memory (ROM)
106 Rewritable memory (RAM)
108 Recording unit 110 Interface unit (IF unit)
112 Touch detection unit 114 Display unit 116 Display control unit 118 Video memory (VRAM)
120 Bus 200, 202 LED row 210, 212 PD row 220 Touch pen 230 Drawing area 240 Function button area 242 Function button 250 Page operation area 252 Page forward button 254 Page return button 256 Page number display field 380 User

Claims (9)

A touch detection unit that has a display surface, displays an image in page units on the display surface in units of pages, and detects the position and the number of touch inputs that specify the position on the display surface;
When a plurality of touch inputs are detected by the touch detection means and their positions move in the same direction on the display surface, an image displayed on the display surface is displayed as the position of the plurality of touch inputs. Scroll means for scrolling with movement;
Drawing means for drawing at a position on the display surface specified by the position of the touch input detected by the touch detection means;
After detecting a plurality of touch inputs by the touch detection means and detecting from the output of the touch detection means that the number of touch inputs has decreased while maintaining at least one touch, the amount of movement of the touch input is Depending on whether or not it is equal to or less than a first threshold value, the process of returning the image on the display surface to the state before scrolling, and the image on the display surface are 1 First page switching means for selectively performing processing for switching pages,
An image display device capable of touch input, wherein the value of the first threshold value changes in accordance with a moving speed of image scrolling by the scroll means. Further, in response to the movement amount of the plurality of touch inputs being greater than a second threshold value that is greater than the first threshold value when the image is scrolled by the scroll means. The image display device capable of touch input according to claim 1, further comprising second page switching means for switching an image on the display surface by one page in accordance with a moving direction of the plurality of touch inputs.   The image display device capable of touch input according to claim 2, wherein the value of the second threshold value changes in accordance with a moving speed of image scrolling by the scroll unit. The touch input is possible according to any one of claims 1 to 3 , wherein a scroll amount by the scroll means is determined according to a movement amount of the positions of the plurality of touch inputs along a scroll direction by the scroll means. Image display device. It is used with a display device that has a display surface, displays an image received from the outside on the display surface, detects the position and number of touch inputs that specify the position on the display surface, and outputs the position to the outside A control device for a display device,
When it is detected that a plurality of touch inputs are detected by the display device and their positions move in the same direction on the display surface, an image displayed on the display surface is displayed as the plurality of touches. Scroll means for generating an image scrolled with the movement of the input position and giving it to the display device;
Drawing means for drawing at a position on the display surface specified by the position of the touch input detected by the display device;
After detecting a plurality of touch inputs by the display device and detecting from the output of the display device that the number of touch inputs has decreased while maintaining at least one touch, the amount of movement of the touch input is first. Processing for generating page image data so as to return the image on the display surface to a state before scrolling according to whether or not the threshold value is less than or equal to the threshold value, and the image on the display surface is the plurality of touch inputs And a page switching means for selectively generating the page image data so as to be switched for one page in accordance with the moving direction of the page, and transmitting the generated page image data to the display device,
The control device of the display device, wherein the value of the first threshold value changes according to a moving speed of image scrolling by the scroll means. Connected to a display device that has a display surface, displays an image received from the outside on the display surface, detects the position and number of touch inputs that specify the position on the display surface, and outputs the position to the outside Computer,
When it is detected that a plurality of touch inputs are detected by the display device and their positions move in the same direction on the display surface, an image displayed on the display surface is displayed as the plurality of touches. Scroll means for generating an image scrolled with the movement of the input position and giving it to the display device;
Drawing means for drawing at a position on the display surface specified by the position of the touch input detected by the display device;
After detecting a plurality of touch inputs by the display device and detecting from the output of the display device that the number of touch inputs has decreased while maintaining at least one touch, the amount of movement of the touch input is first. Processing for generating page image data so as to return the image on the display surface to a state before scrolling according to whether or not the threshold value is less than or equal to the threshold value, and the image on the display surface is the plurality of touch inputs Selectively generating page image data so that one page can be switched according to the moving direction of the image, and functioning as page switching means for transmitting the generated page image data to the display device,
The computer program according to claim 1, wherein the first threshold value changes in accordance with a moving speed of image scrolling by the scroll means. A touch detection unit that has a display surface, displays an image in page units on the display surface in units of pages, and detects the position and the number of touch inputs that specify the position on the display surface;
When a plurality of touch inputs are detected by the touch detection means and their positions move in the same direction on the display surface, an image displayed on the display surface is displayed as the position of the plurality of touch inputs. Scroll means for scrolling with movement;
In response to the movement amount of the plurality of touch inputs being greater than a threshold value when the scrolling of the image is being performed by the scroll means, the image on the display surface is displayed as the plurality of touch inputs. Page switching means for switching one page according to the moving direction of
Drawing means for drawing at a position on the display surface specified by the position of the touch input detected by the touch detection means;
When the image is scrolled by the scroll means, at least one touch is maintained and the touch detection is performed when the number of the plurality of touch inputs is reduced before the page is switched by the page switching means. detected from the output means a result, and a returning means for returning the scrolling of an image by the scroll means to the state before the scroll,
An image display device capable of touch input, wherein the threshold value changes according to a moving speed of image scrolling by the scroll means. It is used with a display device that has a display surface, displays an image received from the outside on the display surface, detects the position and number of touch inputs that specify the position on the display surface, and outputs the position to the outside A control device for a display device,
When it is detected that a plurality of touch inputs are detected by the display device and their positions move in the same direction on the display surface, an image displayed on the display surface is displayed as the plurality of touches. Scroll means for generating an image scrolled with the movement of the input position and giving it to the display device;
In response to the movement amount of the plurality of touch inputs being greater than a threshold value when the scrolling of the image is being performed by the scroll means, the image on the display surface is displayed as the plurality of touch inputs. Page switching means for switching one page according to the moving direction of
Drawing means for drawing at a position on the display surface specified by the position of the touch input detected by the display device;
When the image is scrolled by the scroll means, at least one touch is maintained and the display device indicates that the number of the plurality of touch inputs has decreased before the page is switched by the page switching means. detected from the output result, and a returning means for returning the scrolling of an image by the scroll means to the state before the scroll,
The control device of the display device, wherein the threshold value changes in accordance with a moving speed of image scrolling by the scroll means. Connected to a display device that has a display surface, displays an image received from the outside on the display surface, detects the position and number of touch inputs that specify the position on the display surface, and outputs the position to the outside Computer,
When it is detected that a plurality of touch inputs are detected by the display device and their positions move in the same direction on the display surface, an image displayed on the display surface is displayed as the plurality of touches. Scroll means for generating an image scrolled with the movement of the input position and giving it to the display device;
In response to the movement amount of the plurality of touch inputs being greater than a threshold value when the scrolling of the image is being performed by the scroll means, the image on the display surface is displayed as the plurality of touch inputs. Page switching means for switching one page according to the moving direction of
Drawing means for drawing at a position on the display surface specified by the position of the touch input detected by the display device;
When the image is scrolled by the scroll means, at least one touch is maintained and the display device indicates that the number of the plurality of touch inputs has decreased before the page is switched by the page switching means. detected from the output result, to function as a return means for returning the scrolling of an image by the scroll means to the state before the scroll,
The computer program according to claim 1, wherein the threshold value changes in accordance with a moving speed of image scrolling by the scroll means.

Images