JP6004474B2 - Equipment control device - Google Patents

Description

  The present invention extracts a form defined by at least one of a shape and a motion of the operation object from a video obtained by photographing an operation object such as an operator's hand with a photographing unit, and is based on the form of the operation object The present invention relates to a device control apparatus that controls a predetermined operation level of a device such as a volume level of an audio device in accordance with operation information.

  Conventionally, an audio output level setting device described in Patent Document 1 is known. In this audio output level setting device, when a setting change operation is performed to a volume exceeding a preset audio output level range (threshold), confirmation is made as to whether or not the volume setting change operation is appropriate. The volume setting is changed only when a response is obtained within a predetermined time. According to such an audio output level setting device, it is possible to prevent the volume output level of the device from being accidentally increased more than necessary during the volume setting operation.

JP 2005-184474 A

  However, in the above-described conventional audio output level setting device, when the setting change operation is performed to a volume exceeding the range of the preset audio output level, the operator determines whether the setting change operation is appropriate. And a special process or operation of the operator's response operation within a predetermined time for the confirmation is necessary, so when setting the volume beyond the volume output level range (threshold), smooth The volume setting cannot be changed.

  By the way, in recent years, it has been considered to adjust the operation level of the device such as the volume level of the audio device in accordance with the shape and movement of the operator's hand without using a touch panel or operation buttons. In this case, the operation level of the device can be adjusted according to the shape and movement of the operator's hand without searching for a target operation part on the touch panel or searching for a target operation button from a plurality of operation buttons. Therefore, the adjustment (change) of the operation level (volume level, etc.) of the device can be performed more smoothly.

  When such a method for adjusting the operation level of the device according to the shape and movement of the operator's hand is applied to the conventional audio output level setting device, the conventional audio output level setting device When a setting change operation is performed to a volume that exceeds the output level range (threshold), the operator confirms whether or not the setting change operation is appropriate, and the operator within a predetermined time for the confirmation. Since a special process or operation called a response operation is required, it is possible to adjust the operation level of the device according to the shape and movement of the operator's hand, that is, it is possible to smoothly adjust the operation level. Features are offset.

  The present invention has been made in view of such circumstances, and when the operation level of the device is controlled according to the form determined by at least one of the shape and movement of the operation object, the operation level of the device is erroneously set to a predetermined threshold value. It is an object of the present invention to provide a device control apparatus that enables a smooth adjustment of an operation level that exceeds the threshold while preventing the threshold from being exceeded.

  The device control apparatus according to the present invention provides a predetermined device according to operation information based on a form defined by at least one of a shape and a motion of the operation object extracted from a video obtained by imaging the operation object by an imaging unit. A device control apparatus for controlling an operation level, wherein the device is in accordance with first operation information based on a predetermined first form of the operation object in a state where the operation level of the device does not reach a predetermined threshold. First operation level control means for changing the operation level toward the threshold, and the operation level changing according to the first operation information reaches the threshold, and the device of the device according to the first operation information The first operation is performed according to second operation information based on a predetermined second form different from the first form of the operation object without changing an operation level. In the same direction as the direction of change in accordance with the information, a configuration and a second operating level control means for changing the operation level of the device.

  According to such a configuration, when the predetermined operation level of the device is controlled, the first operation information based on the first form of the operation object in a state where the predetermined operation level of the device has not reached the predetermined threshold value. In accordance with the operation level of the device changes toward the threshold value and the operation level of the device reaches the predetermined threshold value, the first operation information based on the first form is not used, but the operation object The operation level of the device changes in the same direction as the change direction according to the first operation information according to the second operation information based on the second form different from the first form.

  The device control apparatus according to the present invention provides a predetermined device according to operation information based on a form defined by at least one of a shape and a motion of the operation object extracted from a video obtained by imaging the operation object by an imaging unit. An apparatus control apparatus for controlling an operation level, wherein the operation level state determining means for determining whether or not the operation level of the apparatus has reached a predetermined threshold, and the operation level of the apparatus by the operation level determining means When it is determined that has not reached the predetermined threshold value, the first operation level of the device is changed toward the threshold value according to the first operation information based on the first predetermined form of the operation object. When the operation level control means and the operation level determination means determine that the operation level of the device has reached a predetermined threshold, the first operation is performed. The change according to the first operation information according to the second operation information based on the predetermined second form different from the first form of the operation object without changing the operation level of the device according to the information And a second operation level control means for changing the operation level of the device in the same direction.

  According to such a configuration, when the predetermined operation level of the device is controlled, when it is determined that the predetermined operation level of the device has not reached the predetermined threshold, the operation object is based on the first form. When the operation level of the device changes toward the threshold value according to the first operation information, and it is determined that the operation level of the device has reached the threshold value, the operation level is not the first operation information based on the first form. The operation level of the device changes in the same direction as the change direction according to the first operation information according to the second operation information based on the second form different from the first form of the object.

  In the device control apparatus according to the present invention, the first operation level control unit increases the operation level of the device toward the threshold according to the first operation information, and the second operation level control unit includes the first operation level control unit. The operation level of the device can be increased according to the second operation information without increasing the operation level of the device according to one operation information.

  According to such a configuration, when the predetermined operation level of the device is controlled, the first operation information based on the first form of the operation object in a state where the predetermined operation level of the device has not reached the predetermined threshold value. The operation level of the device rises toward the threshold value according to the state, and the operation level of the device has reached the predetermined threshold value, instead of the first operation information based on the first form, the first of the operation object. The operation level of the device further increases according to second operation information based on a second form different from the first form.

  In the device control apparatus according to the present invention, the second form of the operation object may be more complicated than the first form.

  According to such a configuration, since the second form of the operation object is more complicated than the first form, the form (at least one of shape and movement) of the operation object is erroneously changed to the second form. The possibility is reduced, and it is possible to more reliably prevent the operation level from being erroneously changed in a state where the operation level of the device has reached a predetermined threshold value.

  The second form of the operation object may include a part of the first form.

  With such a configuration, the operation object form (first form) for changing the operation level in a state where the operation level of the device has not reached the threshold value, and the state in which the operation level of the device has reached the threshold value Since the form of the operation object for changing the operation level (second form) is not completely different from the adjustment of the operation level of the device in a state where the threshold is not reached, the state in which the threshold is reached It is possible to smoothly shift to the adjustment of the operation level of the device.

  In the device control apparatus according to the present invention, the operation object is an operator's hand, and each of the first form and the second form is determined by at least one of the shape and movement of the operator's hand. Can be configured.

  With such a configuration, when controlling the predetermined operation level of the device, in a state where the predetermined operation level of the device does not reach the predetermined threshold and in a state where the operation level reaches the threshold, The operation level of the device can be changed in the form of the hand (first form, second form) determined by at least one of the shape and movement of the hand.

  In the device control apparatus according to the present invention, the first form is a form in which only the index finger of the operator's hand is raised, and the second form is a form in which only the index finger of the operator's hand is raised. The movement may be changed to a shape in which the index finger and the middle finger are raised.

  With such a configuration, in a state where the predetermined operation level of the device does not reach the predetermined threshold, the operator can change the operation level of the device toward the threshold by raising the index finger. In a state in which the operation level of the device has reached the predetermined threshold, the operator changes the direction by raising the index finger by moving the hand from a shape in which the index finger is raised to a shape in which the index finger and the middle finger are raised. The operation level of the device can be changed in the same direction.

  In the device control apparatus according to the present invention, the device may be an audio device, and may be configured to control a volume level as the operation level of the audio device.

  With such a configuration, when the volume level of the audio device is controlled, the audio device according to the first operation information based on the first form of the operation object when the volume level of the audio device does not reach the predetermined threshold value. When the volume level of the audio device increases toward the threshold value and the volume level of the audio device reaches the threshold value, the volume level of the operation object is not the first operation information based on the first mode. The volume level of the audio device increases according to second operation information based on a different second form.

  According to the device control apparatus according to the present invention, depending on the first form of the operation object that changes the operation level of the device in a state where the operation level of the device has not reached the threshold, Since the operation level cannot be changed, it is possible to prevent the operation level of the device changing in the first form of the operation object from accidentally exceeding the threshold value. Further, in a state where the operation level of the device reaches the threshold value, the operation object is different from the first form in the first form in that the form of the operation object (determined by at least one of shape and movement). Since the operation level of the device can be changed in the same direction as the change direction according to the first mode by the second mode common to the mode, the operation level exceeding the threshold is smoothly changed (adjustment). can do.

It is a block diagram which shows the structure of the vehicle equipment system containing the apparatus control apparatus which concerns on embodiment of this invention. It is a figure which shows the example of installation of the camera (photographing means) of the operation input apparatus in the vehicle equipment system shown in FIG. It is a figure which expands and shows an example of the imaging | photography area | region of the camera of an operation input device. It is a flowchart which shows the flow of the process which concerns on the production | generation of the operation information based on the form (determined by at least one of a shape and a movement) of an operator's hand performed by the operation input device (operation processing unit). It is a figure which shows an example of input operation by the operator's hand performed in the imaging | photography area | region of the camera in an operation input device. It is a figure which shows another example of input operation by the operator's hand performed in the imaging | photography area | region of the camera in an operation input device. It is a flowchart which shows the flow of the process for adjusting the volume level of an audio equipment (an AV unit is included) according to the operation information from an operation input device. It is a figure which shows an example of input operation by the operator's hand for raising a volume level in the state where the volume level has not reached the threshold value "18". It is a figure which shows an example of input operation by the operator's hand for raising a volume level in the state where the volume level reached the threshold value "18".

  Embodiments of the present invention will be described with reference to the drawings.

  An in-vehicle device system including a device control device according to an embodiment of the present invention is configured as shown in FIG.

  In FIG. 1, this in-vehicle device system 100 includes a processing unit 11 configured by a computer unit (for example, including a CPU). Connected to the processing unit 11 are an AV unit 17 capable of reproducing various sound sources and video sources (for example, CD, DVD, etc.) and a navigation unit 18 for performing navigation processing such as route guidance for the host vehicle. The processing unit 11 is connected to an output circuit 15 to which a speaker 16 is connected. Under the control of the processing unit 11, an audio signal based on the processing of the AV unit 17 and the navigation unit 18 is output to the output circuit 15. The sound corresponding to the audio signal is output from the speaker 16. Further, the processing unit 11 includes a storage unit 14 (for example, a hard disk) in which various information such as music information and map information used in the AV unit 17 and the navigation unit 18 is stored, an LCD, and the like. A display unit 13 for displaying various information such as, a touch panel and operation buttons on the display unit 13, an operation unit 12 used for inputting instructions and various information for processing, and an operation input device 20. Is connected.

  The operation input device 20 includes a camera 211 and an operation processing unit 212. For example, as shown in FIG. 2, the camera 211 is installed in the vicinity of the display unit 13 that can be visually recognized in the rear seat, and the camera 211 is shown in FIG. 3 in front of the display screen of the display unit 13. Thus, an imaging region Ec of the camera 211 that expands in a weight shape is set. The operation processing unit 212 represents the hand represented by at least one of the shape and movement of the operator's hand from an image obtained by photographing the operator's hand (operation object) in the imaging region Ec with the camera 211. , The operation information is generated based on the shape of the hand, and the operation information is output to the processing unit 11. The details of the process for generating the operation information by the operation processing unit 212 will be described later.

  In the storage unit 14, operation information that can be provided to the processing unit 11 from the operation input device 20 (operation processing unit 212) and information on processing to be performed by the processing unit 11 are associated with the operation information. It is remembered. When the processing unit 11 acquires the operation information from the operation input device 20, the processing unit 11 executes a process specified by the information stored in the storage unit 14 in association with the operation information. The operation information stored in the storage unit 14 includes, for example, operation information corresponding to processing for adjusting the volume level of an audio device configured by the functions of the AV unit 17, the output circuit 15, the speaker 16, and the processing unit 11. (Details will be described later).

  Further, the processing unit 11 executes processing according to the operation of the operation unit 12 in addition to processing according to the operation information from the operation input device 20, and displays various types of information obtained during various processes in the display unit 13. Can be displayed.

  The operation processing unit 212 of the operation input device 20 generates and outputs operation information according to the procedure shown in FIG.

  In FIG. 4, the operation processing unit 212 that inputs the image of the imaging region Ec (see FIGS. 2 and 3) obtained by the imaging of the camera 211 determines whether an object other than the background is reflected in the image. (S11) If an object is reflected (YES in S11), it is determined whether or not the object is a human hand (operation object) (S12). When it is determined that the object reflected in the video is a human hand (YES in S12), the operation processing unit 212 determines that the hand is in a form (a shape and a motion) defined in advance in association with the operation information. It is determined whether or not it is determined at least on one side (S13). If it is determined that the hand is in a defined form (YES in S13), the operation processing unit 212 generates and outputs operation information corresponding to (based on) the form of the hand (S14).

  In this way, the operation processing unit 212 (operation input device 20) extracts the hand form (determined by at least one of shape and movement) from the video obtained by photographing with the camera 211 (S11, S12, S13), operation information based on the extracted hand form is output to the processing unit 11 (S14). Accordingly, for example, as shown in FIG. 5, when the operator raises the index finger of the hand HND within the shooting range Ec of the camera 211, the shape (form) of the hand HND with the index finger raised from the image obtained by the camera 211. Is extracted, and operation information based on the shape of the hand HND with the index finger raised is output from the operation input device 20. Further, for example, as shown in FIG. 6, when the operator raises the index finger and middle finger of the hand HND within the shooting range Ec of the camera 211, the hand HND with the index finger and middle finger raised from the image obtained by the camera 211 is displayed. The shape (form) is extracted, and operation information based on the shape of the hand HND with the index and middle fingers raised is output from the operation input device 20.

  It should be noted that the operation processing unit 212 does not include an object other than the background in the video obtained by the camera 211 (NO in S11), and if the object (detected object) is not a human hand (NO in S12). , And the case where the hand of the person reflected in the video is not in a form (defined in at least one of shape and movement) previously associated with the operation information (NO in S13) Does not output operation information.

  In the operation input device 20, the form of the human hand extracted from the video is the form of the hand HND with the index finger raised (first form) as shown in FIG. If there is no particular change, the first operation information is output, and the shape of the person's hand changes from the shape of the hand HND with the index finger shown in FIG. 5 to the shape of the hand HND with the index finger and middle finger shown in FIG. For example, when the movement (second form) is continued within a predetermined time, the second operation information is output. The storage unit 14 stores information about processing for increasing the volume level of the audio device by one unit level in association with the first operation information. Similarly, the storage unit 14 associates with the second operation information. In addition, information about processing for increasing the volume level of the audio device by one unit level is stored.

  The processing unit 11 executes processing for increasing the volume level of the audio device according to the procedure shown in FIG.

  In FIG. 7, the processing unit 11 is in a monitoring state (S21) of the operation information output from the operation input device 20, and when the operation information is acquired from the operation input device 20 (YES in S21), the operation information is the volume level. It is determined whether or not the operation information is for increasing (up) the value (S22). If the operation information from the operation input device 20 is operation information for increasing the volume level (YES in S22), the processing unit 11 determines that the current volume level is equal to or higher than a predetermined threshold “18”. It is determined whether or not (S23).

  When the current volume level is not equal to or higher than the threshold “18”, that is, the threshold “18” is not reached (NO in S23), the processing unit 11 indicates that the operation information from the operation input device 20 is the hand HND with the index finger raised. It is determined whether or not the first operation information is based on the first form (first form: see FIG. 5) (S26). When the operation information from the operation input device 20 is the first operation information (YES in S26), the processing unit 11 increases the volume level of the audio device determined for the first operation information by one unit level. The process for making it perform is performed (S27). As a result, the volume level of the audio device increases by one unit level.

  Thereafter, in a state where the volume level does not reach the threshold “18”, the processing unit 11 performs the first operation based on the shape of the hand HND with the index finger raised from the operation input device 20 (first form: see FIG. 5). Every time the operation information is acquired, a process of increasing the volume level of the audio device by one unit level toward the threshold “18” is executed (S21 YES, S22 YES, NO in S23, YES in S26, S27: first operation) Level control means). As a result, for example, as shown in FIG. 8, the operator places the hand HND with the index finger in the imaging area Ec of the camera 211 (first operation information output), and the hand HND is outside the imaging area Ec. Is repeated (see the hatched rectangle), the volume level of the audio device increases by one unit level toward the threshold value “18” each time the hand HND with the index finger placed in the shooting area Ec. To do.

  As described above, the volume level increases by one unit level and reaches the threshold “18”. In this state where the volume level has reached the threshold value “18” (YES in S23), the processing unit 11 acquires operation information for increasing the audio level from the operation input device 20 (YES in S21, S22). YES), the operation information is based on the continuous movement (second form) from the shape of the hand HND with the index finger raised (see FIG. 5) to the shape of the hand HND with the index finger and middle finger raised (see FIG. 6). It is determined whether or not the second operation information (S25). If the operation information is not the second operation information (NO in S25), for example, even if the operation information is the first operation information based on the shape of the hand HND with the index finger raised (see FIG. 5), the processing unit 11 Does not perform processing related to the increase in volume level. For this reason, when the volume level reaches the threshold value “18”, the volume level is increased even if the hand HND with the index finger placed in the shooting area Ec of the camera 211 (see FIG. 5) as described above. do not do.

  On the other hand, if the operation information from the operation input device 20 is the second operation information (YES in S25), the processing unit 11 sets the volume level of the audio device defined for the second operation information to one unit. Processing for increasing the level is performed (S27). As a result, the volume level of the audio device is further increased by one unit level from the threshold “18”.

  Thereafter, in a state in which the volume level has reached “18”, the processing unit 11 uses the operation input device 20 to change the shape of the hand HND with the index finger and middle finger from the shape of the hand HND with the index finger raised (see FIG. 5). Each time the second operation information based on the continuous movement (see FIG. 6) (see FIG. 6) is acquired, the volume level of the audio device is the same as the direction of change according to the first operation information described above. A process of changing in the direction, that is, increasing is executed (S21 YES, YES at S22, YES at S23, YES at S25, S27: second operation level control means). As a result, for example, as shown in FIG. 9, the operator forms the hand HND with the index finger and middle finger raised (see FIG. 5) from the shape of the hand HND with the index finger raised in the imaging region Ec of the camera 211 (see FIG. 5). 6), the volume level of the audio device further increases by one unit level from the threshold value “18” every time the shape of the hand becomes an index finger and a middle finger.

  If the operation information from the operation input device 20 is not operation information for increasing the volume level of the audio device (NO in S22), the processing unit 11 executes a process associated with the operation information ( S24).

  According to the device control apparatus for controlling the volume level of the audio device as described above, the shape of the hand HND with the index finger raised to change the sound level in a state where the sound level of the audio device does not reach the threshold “18” (first 1 (see FIG. 5), the sound level cannot be raised when the voice level reaches the threshold value “18”. Therefore, the volume level rises in the form of the hand HND with the index finger raised (first form). Can be prevented from accidentally exceeding the threshold “18”. When the volume level reaches the threshold value “18”, the shape of the hand (which is determined by at least one of shape and movement) is different from the shape of the hand HND with the index finger raised. By the continuous movement (second form) from the shape of the hand HND with the index finger raised (see FIG. 5) to the shape of the hand HND with the index finger and middle finger (see FIG. 6) in common with the raised hand shape Since the volume level can be increased, the volume level exceeding the threshold “18” can be increased smoothly.

  The form of the hand represented by the continuous movement from the shape of the hand HND with the index finger raised to increase the volume level to the shape of the hand HND with the index finger and the middle finger raised in a state where the volume level reaches the threshold “18” (Second form) is a hand form (first form) expressed in the form of a hand HND with an index finger raised to increase the sound volume level in a state where the sound volume level does not reach the threshold value “18”. More complex. For this reason, when the volume level is increased, the hand is represented by a continuous movement from the shape of the hand HND with the complicated index finger raised to the shape of the hand HND with the index finger and middle finger raised. It is difficult to be in the form (second form), and it is possible to more reliably prevent the sound volume level from being erroneously increased in a state where the sound volume level has reached the threshold value “18”.

  Further, in the state where the volume level reaches the threshold value “18”, the hand is represented by a continuous movement from the shape of the hand HND with the index finger raised to increase the volume level to the shape of the hand HND with the index finger and middle finger raised. In the form (second form), the form of the hand expressed in the form of a hand HND with the index finger raised to raise the volume level in a state where the volume level has not reached the threshold value “18” is partially included Contains. For this reason, in a state where the volume level does not reach the threshold value “18”, the first form expressed in the form of a hand HND with the index finger raised to increase the volume level, and the volume level is set to the threshold value “18”. In the reached state, the second form represented by the continuous movement from the shape of the hand HND with the index finger raised to increase the volume level to the shape of the hand HND with the index finger and middle finger raised is completely different from Must not. Therefore, it is possible to smoothly shift from the adjustment for increasing the volume level of the audio device in a state where the threshold value “18” has not been reached to the adjustment for increasing the volume level when the threshold value “18” has been reached. .

  In the device control apparatus described above, for example, as shown in FIG. 8, the operator places the hand HND with the index finger in the shooting area Ec of the camera 211 (first operation information output), and the hand. The operation input device 20 repeatedly extracts (recognizes) the shape of the hand HND with the index finger raised by repeatedly moving the HND outside the imaging area Ec (see the hatched rectangle). In a state where the raised hand HND is continued in the shooting area Ec of the camera 211, the HND of the hand with the index finger raised from the image obtained from the camera 211 in a predetermined cycle (for example, 500 milliseconds) by the operation processing unit 212. The shape may be extracted (recognized). In this case, if the state in which the hand HND with the index finger raised is maintained in the imaging region Ec of the camera 211 is maintained, the first based on the shape of the hand HND with the index finger raised from the operation input device 20. Operation information is repeatedly output at a predetermined cycle.

  In addition, the first form of the hand for raising the volume level in a state where the volume level does not reach the threshold value “18” is not limited to the shape of the hand HND with the index finger raised, Any one represented at least on one side may be used. Further, the second form of the hand for raising the volume level in a state where the volume level reaches the threshold value “18” is also the form of the hand HND with the index finger and the middle finger raised from the form of the hand HND with the index finger raised. It is not limited to the continuous movement of the hand, and may be anything represented by at least one of the hand shape and the movement.

  The operation object recognized by the operation input device 20 is not limited to a human hand, and is not particularly limited as long as it can represent at least two different forms (at least one of shape and movement).

  In the device control apparatus described above, the volume level of the audio device is increased. However, not only the operation level of the device but also the operation level of the device may be decreased. In this case, in a state where the motion level is high and has not reached the threshold, the motion level is lowered toward the threshold according to the first operation information based on the first form of the operation object, and the motion level has reached the threshold. In the state, the action level is further lowered from the threshold according to the second operation information based on the second form different from the first form of the operation object.

  In the device control apparatus described above, the operation level of the device to be controlled is the volume level of the audio device, but is not limited to this. For example, the scale of the map displayed on the display unit 13 by the navigation unit 18 may be controlled as the operation level of the device. In this case, in a state in which the reduced scale has not reached the predetermined threshold, the reduced scale of the map is large according to the first operation information based on the first form of the hand (operation object) output from the operation input device 20 or In a state of being small (wide display, detailed display) and the scale of reduction reaching the threshold value, according to the second operation information based on the second form different from the first form of the hand output from the operation input device 20 The scale of the map is increased or decreased (wide display, detailed display).

  Note that the processing unit 11 may be configured to include all or part of the functions of the operation processing unit 212 of the operation input device 20 (corresponding to processing according to the procedure illustrated in FIG. 4). The operation processing unit 212 of the operation input device 20 may be configured to include all or a part of the mechanism (corresponding to the processing according to the procedure shown in FIG.

  As described above, when the device control apparatus according to the present invention controls the operation level of the device according to the form determined by at least one of the shape and the movement of the operation object, the device operation level is erroneously set to a predetermined threshold value. From an image obtained by photographing an operation object such as an operator's hand with a photographing means. A device control apparatus that extracts a form defined by at least one of the shape and movement of the operation object and controls a predetermined operation level of the apparatus, such as a volume level of an audio device, according to operation information based on the operation object form Useful.

DESCRIPTION OF SYMBOLS 11 Processing unit 12 Operation part 13 Display part 14 Storage part 15 Output circuit 16 Speaker 17 AV unit 18 Navigation unit 20 Operation input device 100 In-vehicle apparatus system 211 Camera 212 Operation processing unit

Claims (8)

An apparatus control device that controls a predetermined operation level of an apparatus according to operation information based on a form defined by at least one of a shape and a motion of the operation object extracted from a video obtained by imaging the operation object by an imaging unit. There,
In a state where the operation level of the device does not reach a predetermined threshold value, the operation level of the device is changed toward the threshold value according to first operation information based on a first predetermined form of the operation object. First operation level control means;
In a state where the operation level that changes according to the first operation information reaches the threshold value, it is different from the first form of the operation object in advance without changing the operation level of the device according to the first operation information. A device having second operation level control means for changing the operation level of the device in the same direction as the change direction according to the first operation information in accordance with the second operation information based on the defined second form; Control device. An apparatus control device that controls a predetermined operation level of an apparatus according to operation information based on a form defined by at least one of a shape and a motion of the operation object extracted from a video obtained by imaging the operation object by an imaging unit. There,
Operation level state determination means for determining whether or not the operation level of the device has reached a predetermined threshold;
When it is determined by the operation level determination means that the operation level of the device does not reach a predetermined threshold value, the device of the device according to first operation information based on a first predetermined form of the operation object. First action level control means for changing the action level toward the threshold;
When the operation level determination unit determines that the operation level of the device has reached a predetermined threshold, the operation object of the operation object is changed without changing the operation level of the device according to the first operation information. A second operation for changing the operation level of the device in the same direction as the change direction according to the first operation information in accordance with second operation information based on a predetermined second mode different from the first mode. A device control apparatus having level control means. The first operation level control means increases the operation level of the device toward the threshold according to the first operation information,
The second operation level control means increases the operation level of the device according to the second operation information without increasing the operation level of the device according to the first operation information. Equipment control equipment. Wherein the second mode of operation object device control apparatus according to any one of claims 1 to 3 wherein the complex is than the first embodiment.
  The device control apparatus according to claim 1, wherein the second form of the operation object includes the first form in part. The operation object is an operator's hand,
The device control device according to claim 1, wherein each of the first form and the second form is determined by at least one of a shape and a movement of an operator's hand. In the first form, only the index finger of the operator's hand is raised,
The device control apparatus according to claim 6, wherein the second form is a movement that changes from a shape in which only the index finger of the operator's hand is raised to a shape in which the index and middle fingers are raised. The device is an audio device,
The device control apparatus according to claim 3, wherein a volume level as the operation level of the audio device is controlled.

Images