JP2007080187A - Operation input device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an operation input device with which required processing is simple even when specifying the input operation position of a user based on an image input from a photographing means, and further, the operation position can be more accurately specified. <P>SOLUTION: Various selection buttons 5 are projected from the back on a semitransparent screen 3 by a projector 4, and the semitransparent screen 3 is photographed from the back by a camera 6. Based on the luminance of the photographed image of the camera 6, a CPU 10 calculates a touch area where the user touches the semitransparent screen 3 and a hand area corresponding to the part of the hand of the user. Within the calculated hand area, the CPU determines the center of gravity of the hand area in the area to project an image by the projector 4 and similarly determines the center of gravity of the hand area in the area of a difference between a photographing area of the camera 6 and a button projecting area. The CPU 10 calculates a distal end direction vector from these centers of gravity and in this distal end direction vector, the touch area positioned in the most distal end is selected as the operating position of the user. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an operation input device that detects an input operation performed when a user operates a device using a captured image.

  2. Description of the Related Art Conventionally, as an operation input device that detects an input operation to an in-vehicle device such as a car navigation system performed by a user, for example, a touch operation input device that detects a touch operation on a screen disposed in a vehicle as an input operation by a touch sensor Is used. As this touch operation input device, for example, an absolute position detection type that detects an input operation position on the screen as an absolute position, or a relative position detection that detects an operation amount and an operation direction at the time of an input operation on the screen as a relative position There is a formula.

  However, since this touch operation input device detects a touch operation on the screen by the user with the touch sensor, there is a problem that the touch sensor deteriorates at a contact portion touched by the user's finger or the like. Therefore, in order to improve the durability of the operation input device, there has been a demand for an operation input device having a configuration capable of detecting a user input operation without using this type of touch sensor.

Therefore, for example, there is a camera photographing operation input device that projects various selection buttons on the screen, shoots the screen with a camera, and detects the operation of the selection button on the screen by the user based on the photographed image from the camera. It is disclosed in documents 1-3. If this type of camera-shooting operation input device is used, the user does not need to perform operations such as touching the sensor with a finger or the like. Durability is ensured.
JP-A-2-132510 JP 2002-157079 A JP-A-4-271423

  However, in the technique of Patent Document 1, when the operation input device specifies the operation position of the input operation by the user, the binarization processing, thinning processing, and image end point detection of the image data (image signal) captured by the camera Since complicated and multi-step image processing such as processing is required, the operation position specifying processing becomes complicated. Therefore, it may take time for the operation position to be specified after the input operation is performed, and there is a delay between the input operation and the operation input device actually operating, and a smooth operation feeling cannot be secured. There is. Further, with respect to Patent Document 2, image processing such as pixel conversion of image data, trend analysis of pixel change, and determination of property movement transition is required, and thus the same problem as Patent Document 1 occurs.

  Next, Patent Literature 3 takes a straight line between a tip point indicating the indicated target object and a reference point serving as a reference position for performing the pointing operation, and detects a position at the tip on the straight line as the indicated target object. It is. However, since this technique requires calibration of the reference point, the operation position designation processing becomes complicated as in Patent Documents 1 and 2. Further, if this kind of calibration is necessary, a troublesome work is imposed on the user, and there is a demand for making this kind of work unnecessary in order to improve the usability of the operation input device. In particular, when this technology is used for in-vehicle equipment, it is harsh to impose calibration on the driver each time, and is not suitable for practical use.

  In some cases, input operations are detected at a plurality of locations at the same time, and a plurality of selection buttons may be selected at the same time. When simultaneous input occurs during an input operation, an operation position that is not intended by the user is determined as an input position, and unnecessary processing may be executed. It is also necessary to take some measures for simultaneous input.

  An object of the present invention is to specify a user's input operation position on the basis of an image input from a photographing unit, so that the processing required at that time is simple, and the operation position can be specified more accurately. To provide an operation input device.

  According to the present invention, a translucent screen, a projection unit that projects a display object on the translucent screen from the back side, an imaging unit that captures the translucent screen from the back side, and image data acquired by the imaging unit The operation position on the display surface is detected based on the brightness of the image displayed on the translucent screen, and when a plurality of the operation positions are detected, the user selects the operation position with the highest characteristic value obtained from the brightness. The operation position detection means for detecting as an intended operation position, the operation position detected by the operation position detection means, and the coordinate position of the display object projected by the projection means are compared, and it is confirmed that these positions match. The gist of the invention is that it includes execution means for executing a process according to the display object according to the condition.

  According to this configuration, on the translucent screen, various display objects (for example, selection buttons or the like) that are selected and operated when operating various devices are displayed by the projection unit. Examples of the display object include an apparatus power-on button, an operation mode selection button, and a power-off button. In order to operate the device, the user performs an input operation of touching a desired display object on the translucent screen with a finger or the like.

  By the way, the back surface of the translucent screen is always photographed by the photographing means, and the image data is transferred to the operation position detecting means. Here, when the display object on the translucent screen is input, the light emitted from the projection means is reflected by the user's finger or hand, and the reflected light reaches the translucent screen. Since the finger (hand) is closer to the translucent screen, the luminance is higher. Therefore, the operation position detecting means detects the portion where the brightness is increased as the operation position by the user, using the image data acquired from the photographing means. Then, the operation position detected by the operation position detection means and the coordinate position of the display object projected by the projection means are compared by the execution means, and when these two positions match, the display object at the operation position is selected. The processing is executed by the execution means.

  Therefore, in the present invention, the input operation position by the user is determined by a simple method of judging the input operation position by looking at the change in luminance generated on the translucent screen when the user selects and operates the display body of the translucent screen. It becomes possible to recognize. For this reason, in some cases, it is possible to shorten the processing time required from the time when the input operation is performed until the operation position is specified, and it is difficult to cause a time from the input operation until the operation input device is actually operated. Thus, it is possible to ensure a smooth operation feeling.

  Further, when the user touches the semi-transparent screen to perform an input operation, a part unintended by the user touches the semi-transparent screen and the input operation may be performed simultaneously at a plurality of locations. However, even when the user touches the semi-transparent screen at a plurality of operation positions in this way, the characteristic value (for example, the position in the operation direction, the contact area when touching the semi-transparent screen, etc.) regarding the brightness of each operation position is most A high one is detected as an input position intended by the user. Therefore, even if simultaneous input occurs, it is difficult to detect an operation position not intended by the user as the input position.

  According to this invention, the operation position detecting means detects an area where the luminance is equal to or higher than a threshold as a contact area where the user is touching the display surface, and the user performs a selection operation on the display object. The gist is to detect, as the operation position, the contact region located at the forefront of the operation direction with respect to the operation direction.

  According to this configuration, when the user performs an input operation by touching the translucent screen, for example, the semi-transparent screen is touched at the most advanced part of the hand (for example, the tip of the index finger). Other parts may also touch the translucent screen at the same time. However, even if such simultaneous input occurs, the contact area located at the forefront of the operation direction among the plurality of contact areas is recognized as the contact area of the part that the user has performed as the input operation. Therefore, since there is a high probability that an object positioned at the forefront of the operation direction is an operation position that the user intends to input, the operation position can be more accurately selected.

  According to this invention, the operation position detection means has a luminance equal to or higher than a second threshold value that is lower than the threshold value in each of the first area and the second area that are the partitioned areas of the translucent screen, and Recognizing a region having a value lower than the threshold as an image of the operation region, each of a first operation region image displayed in the first region and a second operation region image displayed in the second region The gist is to calculate the center of gravity of the image, and to calculate, as the operation direction, a tip direction vector that passes through the center of gravity and extends from the center of gravity of the second operation part image to the center of gravity of the first operation part image.

  According to this configuration, since the tip direction vector is appropriately calculated according to the operation direction of the operation part at the time of the input operation at that time, for example, compared to the case where the tip direction vector is fixed value data, The accuracy of the direction vector is improved. Therefore, even if simultaneous input occurs when the user performs input, it is difficult to recognize an incorrect contact area that the user does not intend as a contact area of a part that the user has performed as an input operation, which is further effective in preventing erroneous input. There is.

  According to this invention, the first area is a projection area of the display object by the projection means, and the second area is a difference area between the imaging area of the imaging means and the projection area. The gist.

  According to this configuration, if the first area is the display area of the display body and the second area is the difference area between the imaging area and the display area, for example, the first area is an area closer to the center of the translucent screen, and the second area is It becomes a peripheral area surrounding the periphery of the first area. If there is such a positional relationship, it is unlikely that the two points necessary for calculating the tip direction vector will be located in the same region, and a preferable region distribution is obtained when calculating the tip direction vector.

  According to this invention, the operation position detecting means designates a contact area located at the forefront from the plurality of contact areas by mapping the contact area to the tip direction vector. .

  According to this configuration, when there are a plurality of contact areas, in order to map the contact areas to the tip direction vector and compare the positions of the contact areas, when selecting the most advanced one from the plurality of contact areas This is also more effective in preventing erroneous input.

  According to the present invention, even when the user's input operation position is specified based on the image input from the photographing means, the processing required at that time is simple, and the operation position can be specified more accurately. .

As shown in FIG. 1, the operation input device 1 is a device that functions as an operation panel when operating various devices. For example, when operating an in-vehicle device such as a car navigation system, an audio device, and an air conditioner of the vehicle 2. Input operation. The operation input device 1 displays various selection buttons 5 on the translucent screen 3 from the back side with the projector 4 (see FIG. 2), and photographs the translucent screen 3 with the camera 6 (see FIG. 2) from the back side. the change in luminance K that changes when the select button 5 has been selected with a finger tip of the user determined from the captured image, to identify the operating position P _x on the translucent screen 3. The projector 4 corresponds to the projection means, the selection button 5 corresponds to the display object, and the camera 6 corresponds to the photographing means.

  As shown in FIG. 2, a center cluster 7 is disposed in the front part of the vehicle driver's seat, and a translucent screen 3 is attached to the center part of the center cluster 7. The translucent screen 3 has, for example, a rectangular flat plate shape and is composed of a sheet of diffusible plastic material that exhibits image performance.

  A projector 4 is attached to the back surface 3a of the translucent screen 3 in a state of being fixed to the vehicle body. The projector 4 is a device that synthesizes the light that has passed through the RGB filters and projects an image. For example, a liquid crystal projector is used, and various selection buttons 5 for operating vehicle equipment are provided from the back surface 3 a of the translucent screen 3. Project. Thereby, the surface of the translucent screen 3 becomes the display surface 3b, and the characters of the various selection buttons 5 are displayed on the display surface 3b in a face-up state.

  Similarly, a camera 6 is fixed to the vehicle body in parallel with the projector 4 on the back surface 3 a of the translucent screen 3. The camera 6 is a CMOS (Complementary Metal Oxide Semiconductor) camera or the like that can capture an image with visible light, and images the back surface 3 a of the translucent screen 3. In this example, since it is determined whether or not there is an input operation on the translucent screen 3 by looking at the change in luminance in the image acquired by the camera 6, it is sufficient if the change in luminance is seen in the captured image acquired by the camera 6. Therefore, the number of pixels of the camera 6 may be about several hundred thousand pixels, for example.

  As shown in FIG. 3, an operation position detection control circuit 8 that performs overall control of the operation input device 1 and an in-vehicle device control circuit 9 that operates the in-vehicle device are attached to the vehicle body. The operation position detection control circuit 8 includes a CPU (Central processing Unit) 10 that controls the main control of the circuit 8, a ROM (Read-Only Memory) 11 that stores various program groups and data groups, and operations of the CPU 10 during program execution. A RAM (Random Access Memory) 12 serving as an area and an interface 13 serving as an input / output port for various data are provided. These devices are connected to each other through a bus 14 in the operation position detection control circuit 8. The CPU 10 constitutes an operation position detection unit and an execution unit.

The ROM 11 stores an operation position detection program Ppr that detects an input operation performed by the user on the translucent screen 3 to operate the vehicle device. The operation position detection program Ppr drives the projector 4 to display the selection button 5 on the translucent screen 3, and when the user selects the selection button 5 on the translucent screen 3, the image is displayed by the camera 6. photographed, it is a program that detects the user's operation position P _x based on the image data D _a.

The CPU 10 starts activation when an engine switch (not shown) is operated to the accessory position or the ignition position, starts up the operation position detection program Ppr, and instructs the projector 4 to start activation and display data D via the interface 13. _b is output. The projector 4 begins to start and undergo activation start command from the operating position detecting control circuit 8, a display screen based on display data D _b input from the operation position detecting control circuit 8 (selection button 5) a translucent screen 3 Project to.

The CPU 10 outputs an activation start command to the camera 6 via the interface 13 in the same manner as outputting the activation start command to the projector 4. When the camera 6 receives an activation start command from the operation position detection control circuit 8, the camera 6 starts activation, images the translucent screen 3 from the back surface 3 _a , and outputs the image data _Da to the operation position detection control circuit 8. . Each time the camera 6 receives an activation start command from the CPU 10, it takes an image in a time range of several tens to several hundreds μs, and continuously receives an activation start signal, thereby outputting a continuous image to the operation position detection control circuit 8. To do.

CPU10 captures the image data D _a after removal of the noise in the noise removing circuit 13a in the interface 13, and calculates the luminance K on the translucent screen 3 based on the image data D _a. Here, when the user touches the translucent screen 3 with a finger or the like, the light projected from the projector 4 is reflected by the finger or hand as shown in FIG. 3, and the reflected light is diffused, so that the finger is translucent. The closer to the screen 3, the higher the luminance K of the image input by the camera 6 (the light is brighter). Therefore, CPU 10 derives a operation position P _x of the input operation by the user partial luminance K is high on the translucent screen 3. CPU10 determines whether or not the select button 5 by looking at the operation position P _x is operated, when the selection button 5 is operated, so as to execute the processing corresponding to the selected button 5 on the vehicle equipment The operation request signal S is output to the vehicle-mounted device control circuit 9.

  When the operation request signal S is input from the operation position detection control circuit 8, the in-vehicle device control circuit 9 operates the in-vehicle device according to the operation request signal S. For example, when the power on button of the car navigation system is operated on the translucent screen 3, the car navigation system is activated. When the destination input button is operated under the activation of the car navigation system, the car navigation system is activated. Switch to the destination input mode.

Next, details of the procedure for detecting the operation position P _x.
As shown in FIGS. 3 and 4, the coordinate position (x, y) of each dot representing the selection button 5 on the translucent screen 3 is the display size of the selection button 5, the installation position and the installation angle of the projector 4. It depends on the display position of the selection button 5 based on the above. Accordingly, the coordinate position to the operating position detecting program Ppr (x, y) if incorporates coordinate position data relating to, CPU 10 is when projecting the display data D _b to the projector 4, the selection buttons 5,5 ... translucent It is possible to recognize which coordinate position (x, y) is located on the screen 3.

The camera 6 is taken back 3a of the translucent screen 3, the CPU 10 obtains the captured image, CPU 10 is luminance K in a translucent screen 3 of the image is the first threshold value _{K a} than (K ≧ _{K a} is satisfied ) Is determined. The first threshold value K _a is, if the luminance K is this value or more, the user is set to the possible values determined that touches the translucent screen 3. Therefore, CPU 10 is an area where luminance K is a first threshold value K _a more user determines the contact area 15 touching the translucent screen 3.

Further, CPU 10 together with the brightness determining using a threshold _{K a,} determine the area where luminance K is in a range to be the second threshold value _{K b} or less than the first threshold value _{K a (K b ≦ K <} K a is satisfied) To do. The second threshold value K _b is a threshold value set as a value lower than the first threshold value K _a as shown in FIG. 5, and if the luminance K is within the range of K _b ≦ K <K _a , that portion Is set to a value that can be determined to be the hand of the user performing the input operation. CPU10 is an area where luminance K is in a range to be the second threshold value K _b or less than the first threshold value K _a, to determine the hand region 16 the user's hand is positioned.

  Here, as shown in FIG. 4, when the user operates the selection button 5 with, for example, the index finger, if a part of the hand other than the index finger touches the translucent screen 3 at the same time, a plurality of contact areas 15 are detected. It will be. In this way, if the input operation is performed at a plurality of locations at the same time, the selection button 5 not intended by the user is input, and therefore, in such a situation, the plurality of contact areas 15a and 15b. It is necessary to select the contact area 15a corresponding to the index finger.

Therefore, the CPU 10 sorts the contact area 15 by the following procedure. First, as a precondition, in advance CPU10 is aware of the region where the projector 4 is projecting a selection button 5 of the back face 3a of the translucent screen 3 as a button projection region E _1. The projector 4 because it projects the various selection buttons 5 top center side of the translucent screen 3, this region has a button projection region E ₁ in this embodiment. Further, in this embodiment the entire back surface of the translucent screen 3 has an imaging region of the camera 6, CPU 10 is aware portion of the difference between the camera shooting area button projection area E ₁ as the difference area E _2. Incidentally, the button projection region E ₁ corresponds to the first region, the area of difference E ₂ corresponds to the second region.

Subsequently, the CPU 10 calculates the operation direction of the hand when the user operates the translucent screen 3 (hereinafter referred to as the tip direction vector B). As calculation processing of this distal direction vector B, CPU 10 will divide the hand area 16 calculated earlier in the button projection region E ₁ and the difference area E _2, in the first hand region 16a is a hand region of the button projection region E ₁ calculating the center of gravity _{G 1,} it calculates a second hand region 16b Oite centroid _{G 2} is a hand region of the difference area _{E 2.} The centroids G ₁ and G ₂ are calculated as pixel unit values of the translucent screen 3, the centroid coordinates are (x _g , y _g ), and the number of pixels of the hand region 16 a (16 b) obtained from the image data D _a is n. If the x coordinate value of each pixel is x _k and the y coordinate value of each pixel is y _k , the following equation is obtained.

即ち、上式からも分かるように、ｘ座標値及びｙ座標値の各々において和をとり、これら和をそれぞれ画素数で割ることによってｘ座標値及びｙ座標値の平均値を算出し、以上によって求まったｘ座標平均値とｙ座標平均値を重心座標としている。なお、第１手領域１６ａが第１操作部位画像に相当し、第２手領域１６ｂが第２操作部位画像に相当する。

That is, as can be seen from the above formula, the sum of the x-coordinate value and the y-coordinate value is calculated and the average of the x-coordinate value and the y-coordinate value is calculated by dividing the sum by the number of pixels. The obtained x-coordinate average value and y-coordinate average value are used as the barycentric coordinates. The first hand region 16a corresponds to the first operation part image, and the second hand region 16b corresponds to the second operation part image.

Then, CPU 10, as well as through the center of gravity _{G 1} and the center of gravity _{G 2,} calculates a vector from the center of gravity _{G 2} of the difference area _{E 2} to the center of gravity _{G 1} of the button projection area _{E 1} as distal direction vector B. That is, if coordinates of two points is known, since the vector can be calculated if subtracting the coordinates, the distal direction vector B by subtracting the center of gravity G ₂ from the center of gravity G ₁ in this example (= G ₁ -G ₂ ) is calculated.

After calculating the tip direction vector B, the CPU 10 replaces the contact regions 15a, 15b... With the tip direction vector B by mapping the contact regions 15a, 15b. As a procedure of taking a mapping, each hand area 16a, in the same procedure as when calculating the center of gravity _G 1, _{G 2} at 16b, CPU 10 each of the contact area 15a, the center of gravity G _s1, G _s2 at 15b ..., taking ... . Subsequently, the CPU 10 calculates the coordinates of the feet of the perpendicular line drawn from these centroids G _s1 , G _s2 ,... To the tip direction vector B as the contact points P _s1 , P _s2 . These contact points P _s1 , P _s2 ... _Are also calculated as pixel unit values of the translucent screen 3. The CPU 10 selects a contact point (P _{s1 in} this example) positioned at the forefront with respect to the tip direction vector B from the contact points P _s1 , P _s2 ... As the operation position P _x intended by the user. The coordinate position on the tip direction vector B corresponds to the characteristic value.

The CPU 10 compares the selected operation position P _x with the coordinate position (x, y) of the selection button 5 displayed on the translucent screen 3. By the way, since one selection button 5 is composed of a plurality of dots, the CPU 10 selects the selection button 5 selected by the user if the operation position P _x overlaps any one of these coordinate positions (x, y). And the operation request signal S corresponding to the selection button 5 is output to the on-vehicle equipment control circuit 9. When the operation request signal S is input from the operation position detection control circuit 8, the in-vehicle device control circuit 9 operates the in-vehicle device based on the operation request signal S.

Therefore, in this example, when the user operates the selection button 5 of the translucent screen 3, a change in the luminance K occurs in the translucent screen 3. in simple method of determining the position P _x, it is possible to recognize the operation position P _x on the translucent screen 3 by the user. As described above, if the processing performed by the CPU 10 after the input operation is performed until the operation position P _x is specified, the time required for the operation position determination can be shortened accordingly. It is difficult for a time until the vehicle-mounted device is activated, and a smooth operation feeling is ensured.

Further, when the user touches the translucent screen 3 to perform an input operation, a finger or a hand that is not intended by the user may touch the translucent screen 3 and the contact area 15 may be generated at a plurality of locations. Meanwhile, in order to perform with the tip of the index finger when the user operates the selection button 5, by sorting these contact areas 15a, 15b ... what is most advanced position in the distal direction vector B of the operation position P _x For example, it is highly probable that the operation position P _x is intended by the user. Therefore, it is possible to select the operating position P _x of the user more accurately.

According to the configuration of the present embodiment, the following effects can be obtained.
(1) in a simple manner of seeing a change in luminance K occurring on the translucent screen 3, it is possible to recognize the operation position P _x when the user operates the selection button 5. Therefore, it becomes easier to process up to identify the operating position P _x from being performed the input operation of the selection button 5, a short time of processing time required for determination operation position, ensuring smooth operation feeling, CPU 10 processes Effects such as burden reduction can be obtained. Further, even if the user touches the semi-transparent screen 3 at a plurality of places when selecting the selection button 5, the user's intention is that of the plurality of contact areas 15a, 15b,. _Is selected as the operation position Px. Accordingly, the user can in selecting the selection buttons 5 or touching the translucent screen 3 at an unintended point, selecting an operating position P _x of the user more accurately.

(2) Since the user operates the selection button 5 using the tip of the index finger, when there are a plurality of contact areas 15, the tip direction vector B is at the foremost position of the contact areas 15 a, 15 b. If a certain object is selected as the operation position P _x , it is highly probable that the operation position P _x is intended by the user. Therefore, since this example designates it as the operation position P _x intended by the user, the user's operation position P _x can be more accurately selected.

(3) Since the tip direction vector B is calculated every time the operation position _Px is designated, the accuracy of the vector value is improved as compared with, for example, the case where this vector is fixed value data. Therefore, when selecting the operating position P _x with the distal direction vector B, a user is less likely to screen the contact area 15 that did not take place as the input operation as a operation position P _x, is highly effective in erroneous input prevention .

(4) A region having _two centroids G ₁ and G ₂ is a button projection region E ₁ which is a region closer to the upper center of the translucent screen 3, and a difference region E ₂ between the button projection region E ₁ and the camera photographing region. It is. Accordingly, when the user operates the selection button 5 of the translucent screen 3, the hand is easily reflected in two areas. For example, the hand is reflected in only one area and the two centers of gravity G ₁ and G ₂ are displayed. It is hard to be in a situation that cannot be calculated.

  (5) When a plurality of contact areas 15a, 15b,... Are generated, the contact areas 15a, 15b,. Therefore, the accuracy when selecting the contact region 15a, 15b... Which is located at the forefront with respect to the tip direction vector B is further improved, which further contributes to the effect of preventing erroneous input.

In addition, this embodiment is not limited to the said structure, You may change into the following aspects.
An infrared light source is provided side by side on the projector 4 and an infrared paint is applied to the difference area E ₂ portion of the back surface of the translucent screen 3 so that the image of the button projection area E ₁ is obtained with visible light, and the difference area E ₂ These images may be acquired by infrared rays. At this time, the camera 6 must be capable of receiving not only visible light but also infrared light. In this case, since the types of light used in the button projection area E ₁ and the difference area E ₂ are different, the area division becomes clear and the centroids G ₁ and G ₂ can be calculated with high accuracy.

- a plurality of contact regions 15a, if the 15b ... exists, how to choose them what the user intends, but is not limited to the method of selecting those at the forefront of the front end direction vector B as operation position P _x. For example, the contact area may be calculated in each of the contact regions 15a, 15b... And the contact area having the largest contact area may be calculated as the operation position P _x intended by the user.

The tip direction vector B is not limited to being obtained every time the operation position Px is calculated, and may be fixed value data when the direction in which the user exists can be specified.
- the first region is not limited to the button projection region E _1, the second region is not limited to a camera imaging region and a button projection area difference region E ₂ taken the difference between E _1, free to change Also good.

  The operation input device 1 of this example is not limited to being used on a vehicle, and may be used as an input panel of, for example, a video device, an audio, a digital camera, a telephone, a personal computer, a printer, or the like.

Next, technical ideas that can be grasped from the above-described embodiment and other examples will be described below together with their effects.
(1) In any one of Claims 2-5, the said front-end | tip direction vector is fixed value data. In this case, since it is not necessary to obtain the tip direction vector by calculation one by one, it is possible to reduce the processing burden on the operation position detection means when calculating the operation position on the screen.

  (2) In any one of Claims 3-5, an infrared light source is provided in the back surface of the semi-transparent screen, and an infrared transmitting material is provided in a region corresponding to the second region in the back surface of the semi-transparent screen. The operation position detecting means determines an area received by visible light as the first area, and determines an area received by infrared light as the second area. In this case, since the types of light received by the first region and the second region are different, the first region, the second region, and each region can be clearly distinguished and recognized. Is less likely to occur.

The perspective view which shows the vehicle interior in one Embodiment. The perspective view of the vehicle interior of the state which decomposed | disassembled the semi-transparent screen of the operation input device. The block diagram which shows schematic structure of an operation input apparatus. Explanatory drawing which looked at the translucent screen for demonstrating the selection method of an operation position from the back. The uniaxial coordinate figure which shows the relationship between the 1st threshold value used at the time of brightness | luminance determination, and a 2nd threshold value.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Operation input apparatus, 3 ... Translucent screen, 3a ... Back surface, 3b ... Display surface, 4 ... Projector as projection means, 5 ... Selection button as display thing, 6 ... Camera as imaging means, 10 ... Operation position CPU constituting the detecting means and execution means, 15 (15a~15f) ... contact region, 16a ... first hand region as the first operation region image, 16b ... second hand region of the second operating region image, _{D a} ... image data, K ... luminance, P _x ... operation position, (x, y) ... coordinate position, K _a ... first threshold value, K _b ... second threshold value, B ... tip direction vector as operation direction, E ₁ ... Button projection area as the first area, E ₂ ... difference area as the second area, G ₁ , G ₂ ... centroid.

Claims (5)

A translucent screen,
Projection means for projecting a display object from the back side onto the translucent screen;
Photographing means for photographing the translucent screen from the back side;
Using the image data acquired by the photographing means, the operation position on the display surface is detected based on the luminance of the image displayed on the translucent screen, and when a plurality of the operation positions are detected, the characteristic value obtained from the luminance An operation position detecting means for detecting the highest operation position as an operation position intended by the user;
The operation position detected by the operation position detection unit is compared with the coordinate position of the display object projected by the projection unit, and the process according to the display object is executed on condition that these positions match. And an operation input device.   The operation position detection means detects an area where the luminance is equal to or greater than a threshold as a contact area where the user touches the display surface, and the operation position detection unit performs the operation with respect to an operation direction when the user selects the display object. The operation input device according to claim 1, wherein the contact area located at the forefront of the operation direction is detected as the operation position.   The operation position detecting means has a value that is greater than or equal to a second threshold value that is lower than the threshold value and lower than the threshold value in each of the first region and the second region that are partitioned areas of the translucent screen. And the center of gravity of the image is calculated for each of the first operation part image displayed in the first area and the second operation part image displayed in the second area. 3. The operation input device according to claim 2, wherein a tip direction vector passing through the center of gravity and extending from the center of gravity of the second operation part image toward the center of gravity of the first operation part image is calculated as the operation direction. .   4. The first area is a projection area of the display object by the projection unit, and the second area is a difference area between the imaging area of the imaging unit and the projection area. The operation input device described in 1. 5. The operation position detecting means designates a contact area located at the forefront from a plurality of the contact areas by mapping the contact area to the tip direction vector. The operation input device described.

Images