JP2013238963A - Interactive display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an interactive display device that enables a simple mode change-over without losing an input area in a normal mode and without leading to a complication of a device.SOLUTION: An image display part 10 displays an image to a display surface. A position detection part 12 detects a position of an object on the display surface. In the normal mode, normal process means 14 draws a line in accordance with a trajectory of the object or moves a displayed icon in accordance with a movement of the object. Mode change-over means 18 determines, in the normal mode, whether or not an attribute of the detected object coincides with a predetermined condition, and changes over to a special mode when the attribute thereof coincides with the predetermined condition. In the special mode, in accordance with a position of the object, special process means 16 performs an adjustment for the image or the detection position, or performs adjustments for both of them. For example, the special process means 16 performs a position calibration.

Description

  The present invention relates to an interactively operable display device, and more particularly to mode switching thereof.

  Display devices that can be operated interactively have been put into practical use. An example of such an apparatus is shown in FIG. The projector 4 displays an image on the display surface 2 under the control of the PC 6. A sensor 8 for detecting the position of a pen or a finger on the display surface 2 is provided at the top of the display surface 2. When a pen or finger is detected by the sensor 8, the PC 6 receives this and performs processing based on the detected position, and performs processing such as drawing through the projector 4. For example, a line or the like is drawn corresponding to the locus of movement of the pen or finger. In this way, an interactive display device is realized.

  In such an apparatus, if there is a gap between the detection position by the sensor 8 and the drawing position by the projector 4, interactive operation becomes difficult. Therefore, a process for aligning the two (referred to as position calibration) is performed. In the position calibration mode, for example, the cross mark is displayed on the projector, and the center of the cross mark is touched with a pen or a finger to perform the alignment process. In order to perform position calibration, it is necessary to switch from the normal mode to the position calibration mode.

  There are a method of switching the mode by operating the PC 6 and a method of providing a physical button on the sensor 8 for instructing the start of position calibration. There is also a method of providing an area for starting position calibration on the display surface 2 (Patent Document 1).

JP2011-126225A

  However, in the method of switching the mode by operating the PC 6, it is troublesome to move to the PC 6 to enter the position calibration mode and return to the display surface 2 again to execute the position calibration. In particular, when the display surface 2 becomes larger, the distance from the PC 6 becomes longer.

  Further, the method of providing a physical button on the sensor 8 has a problem that the device is complicated and the cost is increased.

  Although the method described in Patent Document 1 solves the above-described problem, a part of the area is occupied for switching to the position calibration mode. There was a problem of just making it smaller.

  The above problems generally occur not only when switching to position calibration but also when switching from the normal mode to the special mode.

  An object of the present invention is to solve the above-described problems and to provide an interactive display device capable of easily switching modes without compromising equipment without impairing the input area in the normal mode. And

(1) (2) An interactive display device according to the present invention includes an image display unit that displays an image on a display surface, a position detection unit for detecting the position of an object on the display surface, and a normal mode. In the special mode, normal processing means for controlling the image display unit and processing the image corresponding to the position of the object detected by the position detection unit. Special processing means for performing adjustment or both, and mode switching means for shifting to the special mode when the attribute of the object detected by the position detection unit matches a predetermined condition in the normal mode. .

  Therefore, the mode can be easily switched without compromising the device without impairing the input area in the normal mode.

(3) The interactive display device according to the present invention is characterized in that, in the special mode, at least the display position of the image and the detection position of the object are calibrated.

  Therefore, calibration can be easily performed.

(4) The interactive display device according to the present invention is characterized in that the mode switching means shifts to a special mode when an object having a size exceeding a predetermined value is detected.

  Therefore, for example, it is possible to shift to the special mode by using an object (such as a palm) that is not normally used.

(5) The interactive display device according to the present invention is characterized in that the mode switching means shifts to the special mode when two or more objects having a size exceeding a predetermined value are detected.

  Therefore, it is possible to shift to the special mode by using an object (such as a finger) in a form that is not normally used.

(6) In the interactive display device according to the present invention, when the mode switching means detects an object having a size exceeding a predetermined value continuously for a predetermined time or more, when detected intermittently for a predetermined number of times, It is characterized in that it shifts to a special mode when it moves along a predetermined trajectory or when a predetermined shape change occurs.

  Therefore, the transition to the special mode can be realized based on these attributes.

(7) The interactive display device according to the present invention displays, as the image, a predetermined condition or action for shifting to the special mode when the mode switching unit detects an object having a size exceeding a predetermined value. It is characterized by controlling as follows.

  Therefore, the operator can be notified of the transition to the special mode.

(8) The interactive display method according to the present invention displays an image on a display surface, detects the position of the object on the display surface, and corresponds to the detected position of the object in the normal mode. When the image is processed, the adjustment related to the image and / or the detection position is performed in the special mode, and the attribute of the detected object matches the predetermined condition in the normal mode. It is characterized by shifting to the special mode.

  Therefore, the mode can be easily switched without compromising the device without impairing the input area in the normal mode.

  The “image display unit” refers to a device having a function of displaying an image on a display surface, and includes a projector, a display, and the like. In the embodiment, the projector 24 corresponds to this.

  The “position detection unit” refers to a unit having a function of detecting the position of an object on the display surface. In the embodiment, the sensor unit 28 and the reflective member 30 having recursion correspond to this.

  In the embodiment, “normal processing means” corresponds to step S9 in the flowchart of FIG.

  In the embodiment, “special processing means” corresponds to step S8 in the flowchart of FIG.

  In the embodiment, “mode switching means” corresponds to step S5 in the flowchart of FIG.

  The “program” is a concept that includes not only a program that can be directly executed by the CPU, but also a source format program, a compressed program, an encrypted program, and the like.

It is a functional block diagram of the interactive display apparatus by one Embodiment of this invention. It is a figure which shows the external appearance of an interactive display apparatus. It is a figure for demonstrating the principle of a position detection. Hardware configuration. FIG. 6 is a diagram for explaining drawing by movement of a finger 60; It is a figure which shows the structure of the detection data transmitted from the sensor unit 28 to OC26. It is an example of detection data. It is a figure for showing drag operation and scroll operation. It is a figure for demonstrating the switch to a calibration. It is a flowchart of a control program. It is an example of detection data. It is a figure which shows special mode determination start conditions and special mode switching conditions. It is an example in the case of displaying special mode determination start on the screen. It is a figure which shows the conventional interactive display apparatus.

1. Functional Block Diagram of Interactive Display Device FIG. 1 shows a functional block diagram of an interactive display device according to an embodiment of the present invention. The image display unit 10 displays an image on the display surface. The position detection unit 12 detects the position of the object on the display surface.

  In the normal mode, the normal processing unit 14 performs processing on the image displayed on the display surface according to the position of the target detected by the position detection unit 12. For example, a line is drawn according to the trajectory of the object, or a displayed icon is moved according to the movement of the object.

  In the normal mode, the mode switching means 18 determines whether or not the detected attribute of the object matches a predetermined condition, and switches to the special mode if it matches.

In the special mode, the special processing means 16 performs adjustment relating to the image and / or adjustment relating to the detection position in accordance with the position of the object. For example, position calibration is performed.

2. Appearance of Interactive Display Device and Sensor Unit FIG. 2 shows the appearance of an interactive display device according to an embodiment. The front surface of the display board 20 is a display surface 22. The projector 24 displays an image on the display surface 22 under the control of the PC 26.

  A sensor unit 28 is provided on the top of the display board 20. The sensor unit 28 includes a sensor 27 including an infrared light emitting unit 27a and an infrared light receiving unit 27b, and a sensor 29 including an infrared light emitting unit 29a and an infrared light receiving unit 29b. The infrared light emitting unit 27 a (29 a) irradiates infrared light toward all directions of the display surface 22. The infrared light receiving unit 27 b (29 b) receives infrared reflected light from all directions of the display surface 22.

  In addition, retroreflective members 30 are provided at the left and right ends and the lower end of the display board 20. The retroreflective member 30 is configured to reflect incident infrared light in the same direction.

  Therefore, as shown in FIG. 3, when the object 32 is present on the display surface 22, infrared light from the infrared light emitting unit 27a is blocked by the object 32 and is not received by the infrared light receiving unit 27b (FIG. 3). 3 α). On the other hand, in the portion where the object 32 does not exist, the infrared light is reflected by the retroreflective member 30 and received by the infrared light receiving unit 27b (see β in FIG. 3).

The sensor unit 28 is provided with a coordinate position detection circuit for the object 32. The coordinate position detection circuit determines the coordinate position of the object 32 on the display surface 22 and the size of the object based on the detection angle φ1 of the object 32 by the sensor 27 and the detection angle φ2 of the object 32 by the sensor 29. Calculate and output.

3. Hardware Configuration FIG. 4 shows a hardware configuration of the interactive display device. A memory 42, a projector 24, a CD-ROM drive 46, a hard disk 48, and a sensor unit 28 are connected to the CPU 40.

  An operating system 52 such as WINDOWS (trademark) and a control program 54 are recorded on the hard disk 48. The control program 54 performs its function in cooperation with the OS 52.

The OS 52 and the control program 54 are the ones recorded on the CD-ROM 50 and installed on the hard disk 48 via the CD-ROM drive 46.

4). Processing of Control Program 54 In the normal mode, the control program 54 performs the following processing. For example, when drawing processing is performed, the following processing is performed.

  As shown in FIG. 5, the operator places his / her finger 60 at a position where drawing on the display surface 22 is desired to start. Detection data as shown in FIG. 6 is transmitted from the sensor unit 28 to the PC 26 at predetermined intervals. That is, the detection time t, the number n of detected objects, the information of the detected object 1 (X coordinate, Y coordinate, size)... The information of the detected object n (X coordinate, Y coordinate, size) are transmitted as detection data. . In this embodiment, coordinates with the upper left corner of the display surface 22 being 0, 0 are used. The size of the object is the diameter of the detected object converted into a circle.

  For example, as shown in FIG. 5, when the operator touches the finger 60, detection data as shown in FIG. 7A is received.

  Next, as shown in FIG. 5, it is assumed that the operator moves in the direction of the arrow 62 while placing the finger 60 against the display surface 22. As a result, the detection data sent from the sensor unit 28 changes as shown in FIG. 7B... FIG.

  Receiving these detection data, the PC 26 controls the projector 24 to draw a line at a corresponding position on the display surface 22. Accordingly, a line is drawn at a location traced by the finger 60 (location indicated by the arrow 62) in FIG.

  In order to perform such a drawing process, the drawing icon displayed on the display surface 22 is touched with a finger to bring it into a drawing process state.

  When not in the drawing processing state, for example, an icon can be moved like an operation with a normal mouse. For example, as shown in FIG. 8A, the icon 64 can be moved (drag operation) by touching the displayed icon 64 with the finger 60 and moving the finger 60 in the direction of the arrow 66 as it is.

  Further, as shown in FIG. 8B, the screen display can be scrolled by placing the palm on the display surface 22 and moving the palm in the direction of the arrow 68.

  As described above, the PC 26 determines whether it is a drag process or a scroll process based on whether the size of an object such as the finger 60 exceeds a predetermined value, and executes the process. Yes.

  In this embodiment, during the normal mode processing as exemplified above, it is possible to switch to the calibration which is the special mode. In this embodiment, in the normal mode, as shown in FIG. 9A, it is possible to switch to the calibration as the special mode by tapping the display surface 22 twice with the palms of both hands.

  FIG. 10 shows a flowchart of the control program 54 at that time. First, the CPU 40 receives detection data from the sensor unit 28 (step S1). Here, it is assumed that the operator does not touch the display surface 22 and no object is detected. The detection data at this time is as shown in FIG. 11A, for example.

  Next, the CPU 40 looks at the state of the special mode determination flag recorded in the memory 42, and determines whether or not the special mode is being determined (step S2). Normally, since the special mode determination flag is “0” (no special mode determination is in progress), the process proceeds to step S3.

  In step S <b> 3, the CPU 40 determines whether the acquired detection data matches the special mode determination start condition. In this embodiment, special mode determination start conditions as shown in FIG. 12A are recorded on the hard disk 48. Here, the condition is that the number of detected objects is “2” and the detection size is “50 mm” or more. Since the acquired detection data has the contents as shown in FIG. 11A, this condition is not met. Therefore, the CPU 40 executes the normal mode (step S9).

  Subsequently, the CPU 40 takes in the next detection data from the sensor unit 28 (step S1). Here, for example, it is assumed that the operator is hitting the display surface 22 with the palms of both hands at the same time as shown in FIG. 9A. The detection data at this time is as shown in FIG. 11B. The CPU 40 determines whether or not the detected data matches the special mode determination start condition (step S3). Here, since the number of detected objects is “2” and the sizes of both are 50 mm or more, the condition is satisfied. Therefore, the CPU 40 sets the special mode determining flag to “1” (step S4).

  Next, the CPU 40 determines whether or not the detection data satisfies the condition for switching to the special mode (step S5). In this embodiment, the switching condition to the special mode as shown in FIG. According to this condition, the state that the number of detected objects is “2” and the detection size is “50 mm” needs to be repeated “2” times. That is, it is necessary that the state where the number of detected objects is “2” and the detected size is “50 mm” is once canceled and the state where the number of detected objects is “2” and the detected size is “50 mm” again appears. In other words, this represents an operation of tapping the display surface 22 twice with the palms of both hands.

  Here, since the number of detected objects is “2” and the detection size is “50 mm” only appears once, the special mode switching condition is not satisfied. Therefore, the CPU 40 proceeds to step S6 and determines whether or not a predetermined time has elapsed since the start of the special mode determination. If the predetermined time has not elapsed, the CPU 40 executes the normal mode (step S9).

  Subsequently, the CPU 40 takes in the next detection data from the sensor unit 28 (step S1). Here, it is assumed that detection data as shown in FIG. 11C is obtained. The CPU 40 looks at the state of the special mode determination flag to determine whether the special mode is being determined (step S2). Here, since the special mode determination flag is “1”, the CPU 40 proceeds to step S5 to determine whether the condition for switching to the special mode is satisfied. Since there is no repetition twice, the CPU 40 determines that the condition is not satisfied and executes the normal mode (step S9).

  Subsequently, the CPU 40 takes in the next detection data from the sensor unit 28 (step S1). Here, it is assumed that the operator once removed the palms of both hands from the display surface 22. Therefore, the detection data is as shown in FIG. 11D. The CPU 40 determines whether or not the condition for switching to the special mode is satisfied in step S5 through step S2 (step S5). Here, since there is no repetition twice, the CPU 40 determines that the condition is not satisfied and executes the normal mode (step S9).

  Subsequently, the CPU 40 takes in the next detection data from the sensor unit 28 (step S1). Here, it is assumed that the operator hits the display surface 22 with the palms of both hands again. The detection data at this time is as shown in FIG. 11E. The CPU 40 determines whether or not the condition for switching to the special mode is satisfied in step S5 through step S2 (step S5). Here, since the state of the detected object number “2” and the size “50 mm or more” is repeated twice, the special mode switching condition of FIG. 12B is satisfied. If the condition is not satisfied even after a predetermined time (such as 3 seconds) has elapsed since the start of the special mode determination, the special mode determination flag is set to “0” (step S7).

  When the special mode switching condition is satisfied within the predetermined time, the CPU 40 executes calibration (step S8). That is, the CPU 40 causes the projector 24 to display a calibration screen as shown in FIG. 9B.

  The operator touches the center point P of each cross. The CPU 40 performs calibration so that the coordinates of the center point P of the cross displayed by the projector 24 match the coordinates of the touch point sent from the sensor unit 28. Specifically, the conversion table for updating the coordinates from the sensor unit 28 to the coordinates of the center point P of the displayed cross is updated.

When the calibration is completed as described above, the CPU 40 sets the special mode determination flag to “0” (step S7). Then, the normal mode is executed (step S9). When this normal mode is executed, the updated conversion table is used.

5. Other embodiments
(1) In the above embodiment, whether or not to switch to the special mode is determined based on the combination of the attributes of the size, number, and number of repetitions of the object. However, these attributes may be used alone or in combination as a condition for switching to the special mode.

  Furthermore, the movement trajectory of the target object, the shape change of the target object, the continuous detection time of the target object, and the like may be used as attributes alone or in combination with the above.

(2) In the above-described embodiment, the calibration for position alignment has been described as an example of the special mode. However, calibration such as density adjustment, contrast adjustment, and image size adjustment may be executed.

(3) In the above embodiment, the calibration has been described as an example of the special mode. However, the present invention can also be applied to switching to a special drawing mode, application switching, and the like.

(4) In the above-described embodiment, the operator is not notified that the special mode determination flag is “1”. However, it may be displayed on the screen so as to overlap the image being displayed. For example, a display such as “During special mode determination” can be performed. Further, as shown in FIG. 13, an action for satisfying the special mode transition condition may be displayed, such as “Please touch the palm for 10 seconds as it is and shift to the calibration mode”. Good. In addition, the remaining number of seconds may be displayed. Further, this may be notified by voice.

(5) In the above embodiment, an apparatus for projecting by a projector has been described. However, the present invention can also be applied to an apparatus using a display. Further, the position is detected using an infrared light emitter, a light receiver, and a reflecting member. However, a transparent electrode or the like may be disposed on the display surface 22 to perform position detection.

(6) In the above embodiment, the sensor unit 28 calculates and outputs the position of the object. However, it is also possible to receive the data from the sensor unit 28 and calculate the position on the PC 26 side.

Claims (8)

An image display unit for displaying an image on the display surface;
A position detector for detecting the position of the object on the display surface;
In a normal mode, normal processing means for controlling the image display unit and performing processing on the image corresponding to the position of the object detected by the position detection unit;
Special processing means for performing adjustment relating to the image and / or adjustment relating to the detection position in the special mode;
In the normal mode, when the attribute of the object detected by the position detection unit matches a predetermined condition, mode switching means for shifting to the special mode,
An interactive display device comprising: A program for controlling an interactive display device comprising an image display unit for displaying an image on a display surface and a position detection unit for detecting the position of an object on the display surface, the computer comprising: In a normal mode, normal processing means for controlling the image display unit and performing processing on the image corresponding to the position of the object detected by the position detection unit;
Special processing means for performing adjustment relating to the image and / or adjustment relating to the detection position in the special mode;
A program for functioning as a mode switching means for shifting to a special mode when the attribute of the object detected by the position detection unit matches a predetermined condition in the normal mode. In the apparatus of claim 1 or the program of claim 2,
In the special mode, at least the display position of the image and the detection position of the object are calibrated. In the apparatus or program in any one of Claims 1-3,
The mode switching unit shifts to a special mode when an object having a size exceeding a predetermined value is detected. In the apparatus or program in any one of Claims 1-4,
The mode switching means shifts to a special mode when two or more objects having a size exceeding a predetermined value are detected. In the apparatus or program in any one of Claims 1-5,
The mode switching unit is configured to detect an object having a size exceeding a predetermined value continuously for a predetermined time, detect it intermittently a predetermined number of times, move on a predetermined trajectory, or An apparatus or program that shifts to a special mode when a shape change occurs. In the apparatus or program in any one of Claims 4-6,
The mode switching means controls to display a predetermined condition or action for shifting to a special mode as the image when an object having a size exceeding a predetermined value is detected. . Display the image on the display surface,
Detecting the position of the object on the display surface;
In the normal mode, processing is performed on the image corresponding to the position of the detected object,
In the special mode, the adjustment for the image and / or the detection position is performed,
An interactive display method characterized in that, in the normal mode, when the detected attribute of the object matches a predetermined condition, the mode is shifted to a special mode.

Images