JP2018073290A - Apparatus control device, apparatus control method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an improved apparatus control device, apparatus control method and program, capable of using a rough adjustment and a fine adjustment according to the case, in an adjusting operation in which an indicated value to be adjusted is continuously changed.SOLUTION: An apparatus control device for controlling an apparatus by an adjusting operation comprises: an extraction unit which extracts a distance between at least two feature points for change rate calculation in a region of a body and a magnitude of movement of at least one feature point for the change rate calculation in the region of the body, from an image obtained by photographing the region of the body; a change rate calculation unit which calculates a change rate of an indicated value to be adjusted by the adjusting operation on the basis of the distance; a change amount calculation unit for calculating a change amount of the indicated value, on the basis of the magnitude of the movement and the change rate; and an apparatus control unit for controlling the apparatus on the basis of the change amount.SELECTED DRAWING: Figure 1

Description

  The present disclosure relates to a device control apparatus, a device control method, and a program.

  In recent years, with the increase in functionality and complexity of in-vehicle devices mounted on automobiles, the operation of in-vehicle devices has also been diversified. Such in-vehicle device operations include audio device volume control, air conditioner air volume operation, scrolling operation on the interface screen of the in-vehicle device, window enlargement / reduction operation on the interface screen, list scrolling. There is an operation. Continuous indication values to be adjusted such as volume adjusted by volume operation, air volume adjusted by air volume operation, scroll bar position adjusted by scroll operation, window size adjusted by enlargement / reduction operation, etc. The in-vehicle device is controlled by the adjustment operation to be changed.

  On the other hand, a driver of a car is in a situation where he / she does not turn his eyes to watch the direction of travel while driving. Therefore, the driver of the automobile is placed in a situation where it is impossible or difficult to smoothly operate the highly functional and complicated on-vehicle equipment while driving.

  In order for a driver of an automobile to smoothly operate an in-vehicle device while gazing at the front while driving, a shape gesture which is a gesture represented by a hand shape and a direction gesture which is a gesture indicating a moving direction, A technique capable of more efficiently and stably inputting is known (see Patent Document 1).

JP 2005-135439 A

  In order to smoothly perform the operation of continuously changing the indication value adjusted by the operation in highly functional and complicated in-vehicle equipment, rough adjustment of the indication value and fine adjustment of the indication value according to the situation It is necessary to use properly. However, in the technique described in Patent Document 1, there is a problem that rough adjustment and fine adjustment cannot be properly used even by a shape gesture and a direction gesture. In addition, there is a problem that the resolution of the operation cannot be sufficiently ensured due to the restriction of the range of motion of the body of the driver who performs the shape gesture and the direction gesture.

  An object of the present disclosure is to provide an improved device control apparatus, device control method, and program capable of selectively using rough adjustment and fine adjustment in an adjustment operation for continuously changing an instruction value to be adjusted. is there.

  An apparatus control apparatus according to an aspect of the present disclosure is an apparatus control apparatus that controls an apparatus by an adjustment operation, and includes at least two change rate calculation feature points of the body part from an image obtained by imaging the body part. Based on the distance, the extraction unit that extracts the magnitude of the movement of at least one change amount calculation feature point of the body part, and the change rate of the indication value adjusted by the adjustment operation is calculated based on the distance A change rate calculating unit that calculates a change amount of the instruction value based on the magnitude of the motion and the change rate, and a device control unit that controls the device based on the change amount And a configuration comprising:

  An apparatus control method according to an aspect of the present disclosure is an apparatus control method for controlling an apparatus by an adjustment operation, and includes at least two change rate calculation feature points of the body part from an image obtained by imaging the body part. Extracting the distance between and the magnitude of the movement of at least one variation calculation feature point of the body part, and calculating the rate of change of the instruction value adjusted by the adjustment operation based on the distance, A configuration is adopted in which a change amount of the instruction value is calculated based on the magnitude of movement and the change rate, and the device is controlled based on the change amount.

  A program according to an aspect of the present disclosure is a program for controlling a device by an adjustment operation, and includes at least two changes in the body part from an image obtained by imaging the body part in a computer included in the device control apparatus The distance between the feature points for rate calculation and the magnitude of movement of at least one change amount calculation feature point of the body part are extracted, and the change in the instruction value adjusted by the adjustment operation based on the distance is extracted. A configuration is adopted in which a rate is calculated, a change amount of the instruction value is calculated based on the magnitude of the movement and the change rate, and the device is controlled based on the change amount.

  According to the present disclosure, it is possible to provide a device control apparatus that can selectively use rough adjustment and fine adjustment in an adjustment operation for continuously changing an instruction value to be adjusted.

It is an example of the block diagram of the apparatus control apparatus which concerns on 1st Embodiment. It is a flowchart which shows an example of operation | movement of the apparatus control apparatus which concerns on 1st Embodiment. It is a figure showing the state before operation of the apparatus in 1st Embodiment. It is a figure showing the state after operation of the apparatus in 1st Embodiment. It is a figure showing the state before operation of the apparatus in 1st Embodiment. It is a figure showing the state after operation of the apparatus in 1st Embodiment. It is a figure showing the transition of the state of the apparatus in 1st Embodiment. It is a figure showing the state before operation of the apparatus in 2nd Embodiment. It is a figure showing the state after operation of the apparatus in 2nd Embodiment. It is a figure showing the state before operation of the apparatus in 2nd Embodiment. It is a figure showing the state after operation of the apparatus in 2nd Embodiment. It is a figure showing the state before operation of the apparatus in 3rd Embodiment. It is a figure showing the state after operation of the apparatus in 3rd Embodiment. It is a figure showing the state before operation of the apparatus in 3rd Embodiment. It is a figure showing the state after operation of the apparatus in 3rd Embodiment. It is a figure which shows an example of the hardware constitutions of a computer.

  Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings.

(First embodiment)
FIG. 1 is an example of a configuration diagram of a device control apparatus 1 according to the first embodiment. The device control apparatus 1 includes an imaging unit 2, a control unit 3, and a display unit 4. The device control apparatus 1 is provided, for example, inside a vehicle and controls the device by an adjustment operation. The device to be controlled is, for example, an audio device or an air conditioner device mounted on the vehicle. The adjustment operation is an operation for adjusting by continuously changing instruction values such as the volume of the audio device, the air volume of the air conditioner device, and the temperature.

  The imaging unit 2 images a body part. In one example, the body part is the hand. In one example, the imaging unit 2 images a body part via a passive detector that detects reflection of light, electromagnetic waves, sound waves, and the like from an external light source such as sunlight. The passive detector is, for example, a CCD sensor or a MOS sensor that can receive visible light.

  In another example, the imaging unit 2 irradiates electromagnetic waves (including light), sound waves, and the like, and images a body part via an active detector that detects reflection with respect to the irradiation. The active detector is, for example, an infrared light receiving element (IR sensor), a TOF (Time Of Flight) sensor, a millimeter wave radar, a microwave radar, or LiDAR (Light Detection and Ranging, Laser Imaging Detection and Ranging). The IR sensor is, for example, a CCD sensor or a MOS sensor that can receive infrared light.

  The control unit 3 includes a central processing unit (CPU), a read only memory (ROM), a random access memory (RAM), and the like. For example, the CPU reads out a program corresponding to the processing content from the ROM, expands it in the RAM, and performs centralized control of the operation of each block of the device control apparatus 1 in cooperation with the expanded program. The control unit 3 functions as a gesture identification unit 5, a change rate calculation unit 6, a change amount calculation unit 7, a device control unit 8, and a display generation unit 9.

  The display unit 4 displays useful information to the occupant when the occupant (for example, a driver) operates the device controlled by the adjustment operation with the gesture via the device control device 1. In one example, the display unit 4 is a liquid crystal display arranged on a dashboard. Useful information includes, for example, gesture information necessary for operating the device, instruction value information adjusted by the adjustment operation, change rate information, and change amount information. In one example, the indicated value is the air volume or temperature of the air conditioner device. In another example, the indication value is a volume of the audio device.

  The gesture identifying unit 5 identifies a gesture by the occupant from the posture and movement of the body part in the image captured by the imaging unit 2. In one example, the identified gesture is, for example, a gesture for turning a rotary knob or a gesture for sliding a slider. For example, the gesture identifying unit 5 performs image processing on an image captured by the image capturing unit 2, extracts feature points of hands and fingers, and tracks their movements to identify a gesture. Next, the gesture identifying unit 5 extracts the distance between the change rate calculating feature points and the magnitude of the movement of the change amount calculating feature points for controlling the device associated with the identified gesture.

  Furthermore, the gesture identification unit 5 functions as an extraction unit that measures the distance between at least two change rate calculating feature points of the body part. Here, the change rate calculation feature point is a feature point used when the change rate calculation unit 6 calculates the change rate. In one example, the change rate calculating feature point is a finger joint or a fingertip.

  Furthermore, the gesture identification unit 5 functions as an extraction unit that measures the magnitude of movement of at least one change amount calculation feature point of the body part. Here, the feature point for calculating the change amount is a feature point used when the change amount calculation unit 7 calculates the change amount. The change amount calculation feature point may be the same as or different from the change rate calculation feature point. In one example, the change amount calculation feature point is a finger joint or a fingertip.

  The change rate calculation unit 6 calculates the change rate of the instruction value based on the distance between the change rate calculation feature points measured by the gesture identification unit 5. For example, the change rate is a change in the instruction value per unit amount of the magnitude of the movement.

  The change amount calculation unit 7 calculates the change amount of the instruction value based on the magnitude of the movement of the change amount calculation feature point measured by the gesture identification unit 5 and the change rate calculated by the change rate calculation unit 6.

  The device control unit 8 controls the device based on the change amount calculated by the change amount calculation unit 7. For example, the device control unit 8 controls the device by changing the instruction value by the change amount calculated by the change amount calculation unit 7.

  The display generation unit 9 displays a display screen indicating at least one of the change rate calculated by the change rate calculation unit 6, the change amount calculated by the change amount calculation unit 7, and the size of the instruction value, and the device control apparatus 1. It is generated as useful information when an occupant (for example, a driver) operates the device. In one example, the display generation unit 9 generates, as a display screen, a screen that includes an indicator that includes a scale indicating the rate of change and a bar that is movable in the horizontal direction and that indicates the size of the indicated value according to the position in the horizontal direction. .

  FIG. 2 is a flowchart showing an example of the operation of the device control apparatus 1 according to the first embodiment. This process is realized, for example, by reading and executing a program stored in the ROM by the CPU of the device control apparatus 1 when the engine of the host vehicle is started.

  In step S1, the control unit 3 sets a default value of the instruction value. For example, when the instruction value is the volume of the audio device, the control unit 3 sets the volume to a predetermined initial value.

  In step S2, the control unit 3 generates a display screen to be displayed on the display unit 4 (processing as the display generation unit 9), and the display unit 4 displays the generated display screen. In one example, the display screen includes a scale that visualizes the current value of the instruction value and the amount of change in the instruction value when the gesture is moved. Details of the scale will be described later with reference to FIGS. 3A to 9B.

  In step S <b> 3, the control unit 3 acquires a captured image from the imaging unit 2. In step S4, the control unit 3 determines whether or not a gesture has been identified from the acquired captured image (processing as the gesture identification unit 5). If the gesture identification unit 5 can identify a plurality of gestures, it also determines which of the plurality of gestures has been identified.

  If no gesture has been identified (step S4: No), the process returns to step S3. On the other hand, when the gesture is identified (step S4: Yes), the process proceeds to step S5. In step S5, the control unit 3 calculates the change rate of the instruction value from the image obtained by capturing the gesture based on the distance between at least two change rate calculation feature points of the body part (change rate calculation unit). 6). Here, the change rate calculating feature point is determined according to the type of gesture identified by the gesture identifying unit 5.

  In step S6, the control unit 3 updates the display screen displayed on the display unit 4 based on the calculated rate of change (processing as the display generation unit 9), and the display unit 4 displays the updated display. Display the screen. In one example, the display generation unit 9 updates the scale included in the display screen. When the gesture is identified in step S4, the scale is updated in step S6 almost simultaneously, so that the user can intuitively understand that the change rate has been updated by the user's own gesture.

  In step S <b> 7, the control unit 3 calculates the change amount of the instruction value from the image obtained by imaging the gesture based on the magnitude and change rate of the movement of at least one change amount calculation feature point of the body part ( Process as change amount calculation unit 7). Here, the feature point for calculating the amount of change is determined according to the type of gesture identified by the gesture identifying unit 5.

  In step S8, the control unit 3 changes the instruction value by the change amount calculated by the change amount calculation unit 7 (processing as the device control unit 8). Next, in step S9, the control unit 3 controls the device based on the updated instruction value (processing as the device control unit 8). Here, the device to be controlled and the instruction value are determined according to the type of gesture identified by the gesture identification unit 5.

  In step S10, the control unit 3 updates the display of the instruction value (processing as the display generation unit 9). In one example, the display generation unit 9 updates the position of the bar indicating the size of the instruction value at the horizontal position included in the display screen. When the gesture is identified in step S4, the position of the bar is updated in step S10 almost simultaneously, so that the user can intuitively understand that the instruction value has been updated by his / her gesture.

  Note that the order of steps in the flowchart shown in FIG. 2 is merely an example, and it is not necessary that the steps be executed in the order shown in FIG. For example, step S5 and step S7 may be executed in parallel, and step S6 may be executed immediately before S10.

FIG. 3A is a diagram illustrating a state before the operation of the device in the first exemplary embodiment. FIG. 3B is a diagram illustrating a state after the operation of the device in the first exemplary embodiment. Hand H ₁ is performing a gesture to turn the rotary knob. Imaging unit 2 images the posture and movement of the hand H _1. Then, the gesture recognition unit 5 identifies the image capturing section 2 is captured, the hand H ₁ is a gesture to turn the rotary knob. Then, the gesture identification unit 5 measures, for example, a distance between two points (at least two change rate calculation feature points) of the second joint P ₁ of the index finger of the hand H ₁ and the first joint Q ₁ of the thumb. .

The change rate calculation unit 6 calculates the change rate of the instruction value based on the distance between the two points P ₁ and Q ₁ measured by the gesture identification unit 5. As a result of the display generator 9 updating the display screen of the scale, the scale interval is updated to the interval d ₁ as shown in FIGS. 3A and 3B.

The change amount calculation unit 7 is, for example, the magnitude of the rotation amount R (the magnitude of the movement) around the center of gravity of the two points (at least one change amount calculation feature point) of the second joint P ₁ and the first joint Q _1. is) is calculated, based on the magnitude of the rotation amount R, moves the bar B ₁ on the scale. Next, the change amount calculation unit 7 obtains a change amount (= 8 scales) based on, for example, the movement amount of the bar B ₁ and the scale interval d ₁ , and the device control unit 8 sets the instruction value by 8 scales. Change. As a result, for example, when the device to be adjusted is an audio device and the indicated value is a volume, the volume is increased by 8 divisions.

FIG. 4A is a diagram illustrating a state before the operation of the device in the first exemplary embodiment. FIG. 4B is a diagram illustrating a state after the operation of the device in the first exemplary embodiment. The hand H ₁ is making a gesture of turning the rotary knob, but the distance between the two points of the second joint P ₁ and the first joint Q ₁ is smaller than in FIGS. 3A and 3B. Accordingly, in the display of the scale change rate calculating section 6 updates the spacing d ₂ of the scale is greater than distance d ₁ as shown in FIGS. 3A and 3B.

When the second joint P ₁ and the first joint Q ₁ rotate about the center of gravity of the two points by the same rotation amount R as the rotation amount R shown in FIG. 3B, as shown in FIG. 4B, the bar B on the scale ₁ moves by the same movement amount as that shown in FIG. 3B. However, since the interval d ₂ is greater than distance d _1, the change amount of the change amount calculating section 7 obtains (= 4 graduation) is smaller than the variation shown in FIG. 3B (= 8 graduation). Therefore, the instruction value is also smaller than that shown in FIG. 3B.

Thus, in a gesture turning the knob, and a distance between the second joint P ₁ and the first two points of the joint Q ₁ is increased, to adjust the volume more loosely becomes easier, between two points When the distance is reduced, it becomes easier to fine-tune the volume.

  FIG. 5 is a diagram illustrating a state transition of the device according to the first embodiment. The states shown in the upper left, upper right, lower left, and lower right of FIG. 5 correspond to the states shown in FIGS. 3A, 3B, 4A, and 4B, respectively. In addition to the transition from the state shown in FIG. 3A (FIG. 4A) to the state shown in FIG. 3B (FIG. 4B) described above, any one of the ones shown in FIG. 3A, FIG. 3B, FIG. 4A, and FIG. A transition can be made from a state to any other state. Thus, the occupant can continuously perform rough adjustment and fine adjustment of the instruction value, and can also perform rough adjustment and fine adjustment selection and instruction value adjustment at the same time.

(Second Embodiment)
In the present embodiment, an example of a gesture different from the first embodiment is shown.

FIG. 6A is a diagram illustrating a state before the operation of the device in the second exemplary embodiment. FIG. 6B is a diagram illustrating a state after the operation of the device in the second exemplary embodiment. Hand H ₂ is performing a gesture to slide the slider. Imaging unit 2 images the posture and movement of the hand H _2. Then, the gesture recognition unit 5, the image capturing section 2 is captured, identifies that the hand H ₂ is a gesture to slide the slider. The gesture recognition unit 5, for example, to measure the distance between two points of the hand H fingertip P ₂ of the index finger ₂ and thumb fingertip Q ₂ (at least two change rate calculation feature point).

The change rate calculation unit 6 calculates the change rate of the instruction value based on the distance between the two points P ₂ and Q ₂ measured by the gesture identification unit 5. Results display generation unit 9 updates the display screen of the scale, as shown in FIGS. 6A and 6B, spacing the scale is updated to the distance d _3.

Change amount calculation unit 7, for example, the center of gravity movement amount the size of the L of the two points of the index finger of the fingertip P ₂ and thumb fingertip Q ₂ (at least one variation calculation feature point) the (size of the motion) calculated, based on the magnitude of the movement amount L, moving the bar B ₂ on the scale. Next, the change amount calculation unit 7 obtains a change amount (= 8 scales) based on, for example, the amount of movement of the bar B ₂ and the scale interval d ₃ , and the device control unit 8 sets the instruction value by 8 scales. Change. As a result, for example, when the device to be adjusted is an air conditioner and the indicated value is the air volume, the air volume is increased by 8 scales.

FIG. 7A is a diagram illustrating a state before the operation of the device in the second exemplary embodiment. FIG. 7B is a diagram illustrating a state after the operation of the device in the second exemplary embodiment. Hand H ₂ is doing a gesture for sliding the slider, compared to FIGS. 6A and 6B, a small distance between the two points of the index finger of the fingertip P ₂ and thumb fingertip Q _2. Accordingly, in the display of the scale change rate calculating section 6 updates, distance d ₄ of the scale is larger than the interval d ₃ shown in FIGS. 6A and 6B.

When the center of gravity of the two points of the index finger of the fingertip P ₂ and thumb fingertip Q ₂ is rotated by the same amount of movement L and the moving amount L shown in FIG. 6B, as shown in FIG. 7B, the bar B ₂ on scale The movement amount is the same as the movement amount shown in FIG. 6B. However, since the interval d ₄ is greater than distance d _3, the change amount of the change amount calculating section 7 obtains (= 4 graduation) is smaller than the variation shown in FIG. 6B (8 graduation). Therefore, the instruction value is also smaller than that shown in FIG. 6B.

Thus, in a gesture for sliding the slider, when the distance between the two points of the index finger of the fingertip P ₂ and thumb fingertip Q ₂ is increased, it becomes easier to adjust the air volume more broadly, two points If the distance between them is reduced, it becomes easier to finely adjust the air volume. Further, as in the first embodiment, in the second embodiment, the transition from any one state shown in FIGS. 6A, 6B, 7A, and 7B to any other one state is performed. can do. Thus, the occupant can continuously perform rough adjustment and fine adjustment of the instruction value, and can also perform rough adjustment and fine adjustment selection and instruction value adjustment at the same time.

(Third embodiment)
In the present embodiment, an example of a gesture different from both the first embodiment and the second embodiment is shown.

FIG. 8A is a diagram illustrating a state before an operation of a device according to the third embodiment. FIG. 8B is a diagram illustrating a state after the operation of the device in the third exemplary embodiment. Hand H ₃ is performing gesture turn different, rotating knob from the first embodiment. Imaging unit 2 images the posture and movement of the hand H _3. Then, the gesture recognition unit 5 identifies the image capturing section 2 is captured, the hand H ₃ is a gesture to turn the rotary knob. The gesture recognition unit 5, for example, to measure the distance between two points of the hand H of ₃ pinky fingertip P ₃ and the thumb fingertip Q ₃ (at least two change rate calculation feature point).

The change rate calculation unit 6 calculates the change rate of the instruction value based on the distance between the two points P ₃ and Q ₃ measured by the gesture identification unit 5. Results display generation unit 9 updates the display screen of the scale, as shown in FIGS. 8A and 8B, intervals of scale is updated to the distance d _5.

For example, the change amount calculation unit 7 determines the magnitude of the rotation amount R (the magnitude of the movement) around the center of gravity of two points (at least one change amount calculation feature point) of the little fingertip P ₃ and the thumb fingertip Q _3. is) is calculated, based on the magnitude of the rotation amount R, moves the bar B ₃ on the scale. Next, the change amount calculation unit 7 obtains a change amount (= 8 scales) based on, for example, the amount of movement of the bar B ₃ and the scale interval d ₅ , and the device control unit 8 sets the instruction value by 8 scales. Change. As a result, for example, when the device to be adjusted is an air conditioner and the indicated value is a temperature, the temperature is increased by 8 scales.

FIG. 9A is a diagram illustrating a state before an operation of a device according to the third embodiment. FIG. 9B is a diagram illustrating a state after the operation of the device in the third exemplary embodiment. Hand H ₃ is doing a gesture to turn the rotary knob, as compared to FIGS. 8A and 8B, a small distance between the two points of the fingertip Q ₃ pinky fingertip P ₃ and the thumb. Accordingly, in the display of the scale change rate calculating section 6 updates, distance d ₆ of the scale is greater than distance d ₅ shown in FIGS. 8A and 8B.

The center of gravity of the fingertip P ₃ and the thumb fingertip Q ₃ pinky two points, is rotated by the same rotation rate R and the rotation amount R shown in FIG. 8B, as shown in FIG. 9B, the bar on the scale B ₃ moves by the same movement amount as that shown in FIG. 8B. However, since the interval d ₆ is larger than the distance d _5, the change amount of the change amount calculating section 7 obtains (= 4 graduation) is smaller than the variation shown in FIG. 8B (= 8 graduation). Therefore, the instruction value is also smaller than that shown in FIG. 8B.

Thus, in a gesture turning the knob, increasing the distance between the two points of the fingertip Q ₃ pinky fingertip P ₃ and the thumb, to adjust the temperature more loosely it becomes easier, between two points If the distance is reduced, it becomes easier to fine-tune the temperature. Further, as in the first embodiment and the second embodiment, in the third embodiment, any one of the states shown in FIGS. 8A, 8B, 9A, and 9B is arbitrarily selected. Transition to one other state is possible. Thus, the occupant can continuously perform rough adjustment and fine adjustment of the instruction value, and can also perform rough adjustment and fine adjustment selection and instruction value adjustment at the same time.

  As described above, the device control apparatus 1 according to the first to third embodiments is a device control apparatus 1 that controls a device by an adjustment operation, and is based on an image obtained by imaging a body part. An extraction unit (gesture identification unit 5) for extracting a distance between at least two change rate calculation feature points of the body part and a movement of at least one change amount calculation feature point of the body part; A change rate calculation unit 6 that calculates a change rate of the instruction value adjusted by the adjustment operation, a change amount calculation unit 7 that calculates a change amount of the instruction value based on the magnitude and the change rate of the movement, A configuration is provided that includes a device control unit 8 that controls a device based on the amount of change.

  According to the device control apparatus 1 according to the first to third embodiments, rough adjustment and fine adjustment can be used properly in an operation of continuously changing the instruction value.

  FIG. 10 is a diagram illustrating an example of a hardware configuration of a computer. The function of each part in each embodiment and each modification described above is realized by a program executed by the computer 2100.

  As shown in FIG. 10, the computer 2100 includes an input device 2101 such as an input button and a touch pad, an output device 2102 such as a display and a speaker, a CPU (Central Processing Unit) 2103, a ROM (Read Only Memory) 2104, and a RAM (Random Access Memory) 2105 is provided. The computer 2100 also reads information from a recording medium such as a hard disk device, a storage device 2106 such as an SSD (Solid State Drive), a DVD-ROM (Digital Versatile Disk Read Only Memory), or a USB (Universal Serial Bus) memory. 2107, a transmission / reception device 2108 that performs communication via a network is provided. Each unit described above is connected by a bus 2109.

  Then, the reading device 2107 reads the program from a recording medium on which a program for realizing the functions of the above-described units is recorded, and stores the program in the storage device 2106. Alternatively, the transmission / reception device 2108 communicates with the server device connected to the network, and causes the storage device 2106 to store a program for realizing the function of each unit downloaded from the server device.

  Then, the CPU 2103 copies the program stored in the storage device 2106 to the RAM 2105, and sequentially reads out and executes the instructions included in the program from the RAM 2105, thereby realizing the functions of the above-described units. Further, when executing the program, the RAM 2105 or the storage device 2106 stores information obtained by various processes described in each embodiment, and is used as appropriate.

(Other embodiments)
In the first to third embodiments, when the distance between at least two change rate calculation feature points is large, the instruction value is roughly adjusted so that the change rate calculation feature points When the distance is small, the indicated value is finely adjusted. Instead, the indication value is roughly adjusted when the distance between the at least two change rate calculating feature points is small, and the indication value is finely adjusted when the distance between the change rate calculating feature points is large. The

  In the first to third embodiments, the change rate of the instruction value is indicated by the interval of the scale included in the display image. Alternatively, an embodiment in which the change rate of the instruction value is indicated by the color or size of the object included in the display image is also conceivable.

  In the first to third embodiments, the instruction value is indicated by the horizontal position of the bar that moves in the horizontal direction included in the display image. Instead of this, an embodiment in which the instruction value is indicated by the rotation angle of the rotating bar included in the display image is also conceivable. Furthermore, instead of this, an embodiment in which the instruction value is indicated by the size of a circle included in the display image is also conceivable.

  The device control apparatus 1 according to the present disclosure is suitable for being installed together with a device such as an in-vehicle device and used for operating the device.

DESCRIPTION OF SYMBOLS 1 Device control apparatus 2 Imaging part 3 Control part 4 Display part 5 Gesture identification part 6 Change rate calculation part 7 Change amount calculation part 8 Equipment control part 9 Display production | generation part

Claims (10)

A device control device for controlling a device by adjusting operation,
A distance between at least two change rate calculation feature points of the body part and a magnitude of movement of at least one change amount calculation feature point of the body part are extracted from an image obtained by imaging the body part. An extractor;
Based on the distance, a change rate calculation unit that calculates a change rate of an instruction value adjusted by the adjustment operation;
A change amount calculation unit that calculates a change amount of the instruction value based on the magnitude of the movement and the change rate;
A device control unit for controlling the device based on the amount of change;
A device control apparatus comprising:   The extraction unit identifies a gesture from the posture and movement of the body part, and extracts the distance and the magnitude of the movement for controlling a device associated with the identified gesture. Device control apparatus of description.   The at least two change rate calculating feature points are the first joint of the thumb and the second joint of the index finger in the right hand or the left hand, and the magnitude of the movement of the at least one change amount calculating feature point is the first The device control device according to claim 1, wherein the device control device has a rotation angle around a center of gravity of a joint and the second joint.   The at least two change rate calculation feature points are a fingertip of a thumb and an index finger in a right hand or a left hand, and a magnitude of movement of the at least one change amount calculation feature point is the fingertip of the thumb and the index finger. The device control apparatus according to claim 1, wherein the device control apparatus is a movement amount along a predetermined direction of the center of gravity of the fingertip.   The at least two change rate calculation feature points are the fingertips of the thumb and the little finger in the right hand or the left hand, and the magnitude of the movement of the at least one change amount calculation feature points is the fingertip of the thumb and the little finger. The device control device according to claim 1, wherein the device control device has a rotation angle around the center of gravity of the fingertip.   The device control apparatus according to claim 1, further comprising a display unit that displays at least one of the instruction value, the change amount, and the change rate.   The device control apparatus according to claim 1, wherein the device is an air conditioner, and the indicated value is a temperature or an air volume.   The apparatus control apparatus according to claim 1, wherein the apparatus is an audio apparatus, and the instruction value is a volume. A device control method for controlling a device by an adjustment operation,
Extracting the distance between at least two change rate calculation feature points of the body part and the magnitude of movement of at least one change amount calculation feature point of the body part from an image of the body part ,
Based on the distance, calculate a change rate of the instruction value adjusted by the adjustment operation,
Based on the magnitude of the movement and the rate of change, the amount of change in the indicated value is calculated,
Controlling the device based on the amount of change;
Device control method. A program for controlling a device by an adjustment operation, the computer provided in the device control device,
Extracting the distance between at least two change rate calculation feature points of the body part and the magnitude of movement of at least one change amount calculation feature point of the body part from an image of the body part ,
Based on the distance, calculate a change rate of the instruction value adjusted by the adjustment operation,
Based on the magnitude of the movement and the rate of change, the amount of change in the indicated value is calculated,
Controlling the device based on the amount of change;
A program that makes things happen.

Images