JP5770251B2 - Operation control device - Google Patents

Description

  The present invention relates to an operation system for various devices such as a television receiver, and more particularly to an operation control device and an operation display method capable of performing intuitively easy-to-understand operations with simple operation means.

  In recent years, a television receiver is generally operated by a remote control device for controlling functions from a remote location, that is, a so-called remote controller. Although the remote control is a convenient device that can operate the television receiver from a remote location, the operator feels stressed if it is not at hand or is in a state where the remote control cannot be used, such as running out of batteries.

  As an improvement measure, a method of operating a device by detecting the shape and movement of the operator's hand has been proposed. For example, in the remote operation device disclosed in Japanese Patent Application Laid-Open No. 2004-356819, an operation menu is displayed on the display device when a specific movement of the operator photographed by the camera is detected, and then the operator can change the shape of the hand, The device can be operated by recognizing the direction.

  In Japanese Patent Laid-Open No. 2000-149025, the three-dimensional coordinates of a point indicating the characteristics of the movement of a person's limb are measured, and the three-dimensional position / posture of the person using the feature points other than the hand among the extracted feature points. And an operator coordinate system in which each coordinate axis is uniquely determined according to the operator posture with the estimated three-dimensional position of the operator as a reference point, and feature points of the operator's limbs are defined in the operator coordinate system. A gesture recognition device is disclosed that extracts a feature quantity that does not depend on the position / posture of an operator by converting to, and matches a time-series change with a gesture model to estimate a gesture performed by a person. According to this gesture recognition device, it becomes possible to recognize a gesture at high speed even in a situation where the operator changes the position / posture.

JP 2004-356819 A JP 2000-149025 A

  However, in the invention disclosed in the above-mentioned patent document, when recognizing a gesture from a moving image obtained by capturing an operator, an operation in which the operator performs a gesture and an operation in which the operator returns to the original system after performing the gesture. There is a problem that is difficult to distinguish. For example, when the operator points the right direction with his hand and then returns his hand to the original position, the returned movement may be recognized as an operation pointing to the left direction. As described above, in the conventional invention, when the operator performs a gesture, there is a problem that a motion that is not intended as an operation is recognized.

  In view of such a problem, the present invention presents a region where the operator can perform an effective operation and simultaneously provides real-time feedback in order to clarify which part of the operator's movement is accepted as an input to the apparatus. To give.

  Specifically, the present invention is an operation control device that detects an operator's movement by photographing and performs an operation on a display screen according to the movement, and sets an area in which an operation can be controlled in the imaging screen. A detection area setting unit, an operation controllable area set by the detection area setting unit, and a movement of the operator is displayed on a display screen, and a motion is detected in the operation controllable area. In such a case, a control unit for performing operation display on the display screen is provided corresponding to the movement.

  In particular, the control unit displays a menu showing information related to a plurality of contents on the display screen, one selectable display area of the information related to the plurality of contents, and the operation control Overlapping areas that can be displayed.

  Further, the control unit displays a menu showing information related to a plurality of contents on the display screen, and displays a display area of the menu and an area where the operation control is possible.

  In addition, the control unit displays a plurality of regions in which the operation can be controlled, and displays different operations for each of the plurality of regions corresponding to the movement of the operator.

  Further, the control unit displays different operation displays corresponding to the direction and amount of the movement among the movements detected in the region where the operation control is possible.

  Further, the present invention is an operation display method for performing an operation display on a display screen according to an operator's movement, wherein the operable region, the step of displaying the operator's movement on the display screen, And a step of performing an operation display on the display screen in response to the movement of the operator within the operable region.

  In particular, the step of displaying on the display screen displays a menu in which information related to a plurality of contents is displayed on the display screen, and one selectable display area of the information related to the plurality of contents Then, the regions where the operation can be performed are overlapped and displayed.

  In the step of displaying on the display screen, a menu showing information related to a plurality of contents is displayed on the display screen, and the display area of the menu is overlapped with the operable area. indicate.

  Further, the step of displaying on the display screen displays a plurality of the operable regions, and the step of performing the operation display on the display screen corresponds to the movement of the operator for each of the plurality of regions. Display different operations.

  The step of performing the operation display on the display screen performs different operation display corresponding to the direction and amount of the movement among the movements of the operator in the region where the operation is possible.

  According to the present invention, the operator can operate the operation control device with a simple operation by recognizing an effective operation area.

It is a block diagram which shows the structure of the operation control apparatus of this invention in Example 1. FIG. 4 is an operation example of the operation control device of the present invention in Embodiment 1. 2 is an example of a captured image of an imaging unit in Embodiment 1. FIG. 7 is an example of a display screen when a moving object is outside a moving object detection region in the first embodiment. 3 is a processing flow of the operation control apparatus of the present invention in Embodiment 1. 3 is an example of a display screen in the first embodiment. It is a display screen example different from Example 1 in Example 2. FIG. It is an example of a display screen different from Example 1 and 2 in Example 3. FIG. It is an example of a display screen different from Example 1 thru | or 3 in Example 4. FIG. It is a processing flow of the operation control apparatus of this invention in Example 4. FIG. 10 is an example of the movement of an operator's hand in Example 5. 10 is an example of a display screen in the fifth embodiment. It is a processing flow of the operation control apparatus of this invention in Example 5. FIG. 10 is an example of a movement of an operator's hand in Example 6. 12 is an example of a display screen in Example 6. It is a processing flow of the operation control apparatus of this invention in Example 6. FIG. FIG. 16 is a relationship diagram between the movements of the hands of two operators and an imaging unit in Example 7. 10 is an example of a captured image of an imaging unit in Embodiment 7. FIG. 10 is an example of a display screen in Example 7. 18 is a processing flow of the operation control device of the present invention in Example 7. FIG. 10 is a relationship diagram between an operator and an imaging unit according to an eighth embodiment. It is a processing flow of the operation control apparatus of this invention in Example 8. FIG.

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 1 is a block diagram showing the configuration of the operation control apparatus of the present invention. 100 is an operation control device, 102 is an imaging unit such as a camera, 200 is a motion detection unit that detects a moving object such as a hand from a moving image of an operator or the like imaged by the imaging unit, and 201 is a moving object detected by the motion detection unit. Is a motion analysis unit that analyzes the movement direction and amount of movement, 202 is a detection region setting unit that sets a region to be used for control of the operation control apparatus 100 in the shooting screen of the imaging unit 102, and 203 is an analysis by the motion analysis unit 201. A system control unit that controls the operation control apparatus 100 based on the result and the setting area in the detection area setting unit 202, 204 is a video processing unit that generates video data to be displayed on the screen from the control result of the system control unit 203, and 101 is video processing. It is a display part which displays the video data produced | generated by the part. The display unit 101 includes a display device such as a liquid crystal display or a plasma display, and includes a display panel, a panel control circuit, and a panel control driver.

  An operation example of the operation control apparatus of the present invention is shown in FIG. The same elements as those in FIG. Reference numeral 106 denotes an operator of the operation control apparatus 100, and reference numeral 107 denotes a hand trajectory when the operator 106 moves his / her hand as an operation. The operation of the operator 106 is captured by the imaging unit 102.

  Reference numeral 110 denotes an area in which operation control set by the detection area setting unit 202 is possible, and reference numerals 111 and 112 denote movements of the operator's hand detected by the movement detection unit.

  Reference numeral 103 denotes an example of a content menu to be selected for viewing and the like, and reference numeral 104 denotes a content A that is focused and can be selected. In the content menu 103, a representative image of the content or information related to the content is displayed side by side. Reference numeral 105 denotes the direction in which the focus of the content menu 103 moves. By moving the hand to the left or right, the focused content in the content menu 103 moves.

  The display in the display screen 101 is performed by controlling the video processing unit 204 by the system control unit 203.

  An example of a captured image of the imaging unit 102 is shown in FIG. Reference numeral 300 denotes an entire screen imaged by the imaging unit 102, 311 denotes a moving object detection region set by the detection region setting unit 202, 306 denotes an operator, and 311 and 312 denote hands when the operator 306's hand is in the detection region 310. The positions and trajectories 313 and 314 indicate the position and trajectory of the hand when the hand of the operator 306 is outside the detection area 310.

  Reference numeral 110 denotes a moving object detection area set by the detection area setting unit 202 on the display screen, and corresponds to the moving object detection area 310 in the captured image. By displaying the moving object detection area 110, the operator 106 can recognize the position where the hand should move.

  111 is an image of the position of the operator's hand, which is a moving object. The hand position 311 and its locus 312 imaged by the imaging unit 102 are detected by the motion detection unit 200 and imaged by the video processing unit 204. It is displayed on the display unit 101. The moving object image 111 may have any shape as long as it is easy for the operator to understand. Reference numeral 112 denotes a trajectory of the hand when the operator 106 moves the hand analyzed by the motion analysis unit 201. FIG. 4 shows an example of a display screen when the moving object is outside the moving object detection region. The same components as those in FIG. 2 are denoted by the same reference numerals, and description thereof is omitted. 401 is an image of the position of the operator's hand, which corresponds to the operator's hand 313 in FIG. 3 and is outside the moving object detection area 311. When the image 401 is outside the moving object detection area 110, the moving object image is displayed on the screen, but the operation trajectory analysis is not performed and the operation control apparatus 100 is not controlled.

  Next, the processing flow of the operation control apparatus 100 will be described with reference to FIGS. When the operation control apparatus is started, in step 501, the motion detection unit 200 detects a moving object from image data captured by the imaging unit 102. If no moving object is detected in step 501, the moving object detection process is repeated. If a moving object is detected, the system control unit 203 and the video processing unit 204 detect the position of the detected moving object in step 502, for example, the image of FIG. 111 is displayed. In step 503, the system control unit 203 determines whether the position of the detected moving object is within or outside the moving object detection region 310 set by the detection region setting unit 202. If the position of the moving object is out of the region, the process returns to step 501 for detecting the moving object. If the position of the moving object is within the region, in step 504, the motion analysis unit 201 analyzes the locus of the moving object and detects the moving direction and the moving amount of the moving object. In step 505, the system control unit 203 determines whether the moving amount of the moving object is equal to or greater than a preset threshold value. If it is below the threshold value, the process returns to the moving object detection in step 501. If it is equal to or greater than the threshold value, in step 506, the system control unit 203 generates a control command corresponding to the moving amount and moving direction of the moving object, and displays the screen display according to the control command using the video processing unit 204. Let the unit 101 perform this. For example, in the content menu 103 as shown in FIG. 2, when the moving object moves to the left, the content menu is moved to the left.

  FIG. 6 shows a display screen example. The same components as those in FIG. 2 are denoted by the same reference numerals, and description thereof is omitted. FIG. 6A is an example of a display screen of the initial position of the moving object, 601 is an image indicating the position of the moving object, and 602 and 603 are the contents A and B displayed on the content menu 103. In FIG. 6A, the content A 602 is located at the focus position 104. FIG. 6B is an example of a display screen when the moving object moves to the left, 604 is an image showing the locus of the moving object, and 605 is an image showing the position of the moving object after the movement. FIG. 6C is a display screen example in which the content menu is moved to the left in response to the moving object moving to the left. As a result of moving the content menu to the left, the content B 603 is arranged at the focus position 104, and the content A 602 is moved to the left of the focus position 104. Further, FIG. 6D is an example of a display screen in which the moving object further moves leftward and moves out of the moving object detection area 110. Reference numeral 606 denotes a locus of the moving object, and 607 denotes an image showing the position of the moving object after movement. Since the moving object trajectory 606 is outside the moving object detection area 110, no operation control is performed, and the content menu 103 remains as shown in FIG.

  The example in which the content menu 103 is moved to the left has been described above. However, if the hand is moved to the right, the content menu 103 is moved to the right.

  According to this example, a limited area is set as a moving object detection area, and an operator performs an action that crosses the moving object detection area, and an unintended movement such as a return action is performed outside the action detection area. Thus, an operation intended by the operator can be easily performed without recognizing an unintended movement.

  FIG. 7 is an example of a display screen different from the first embodiment of the operation control apparatus of the present invention. The same components as those in FIG. 2 are denoted by the same reference numerals, and description thereof is omitted. Reference numeral 701 denotes a focus position, and reference numerals 705 and 706 denote moving directions of the content menu 103. Reference numeral 702 denotes a moving object detection area, which is arranged at a position overlapping the content focus position 701. Reference numeral 703 denotes an image of the position of the moving object, and reference numeral 704 denotes a locus of the moving object. The system configuration is the same as that in FIG. 1, and the processing flow and the movement in the display screen are the same as those in FIGS.

  According to this example, since the motion detection area 702 overlaps with the focus position 701, the operator can obtain a sense of moving the content by the movement of the hand, and a more intuitive operation is possible. .

  FIG. 8 is a display screen example different from the first and second embodiments of the operation control apparatus of the present invention. The same components as those in FIG. 2 are denoted by the same reference numerals, and description thereof is omitted. 900 denotes a content menu, 901 denotes a focus position, and 906 and 907 denote moving directions of the content menu. Reference numeral 902 denotes a moving object detection area, which is arranged at a position overlapping the content menu 900. 904 is an image of the position of the moving object, and 905 is a locus of the moving object. The system configuration is the same as that in FIG. 1, and the processing flow and the movement in the display screen are the same as those in FIGS.

  According to this example, since the motion detection area 902 overlaps with the content menu 900, the operator can obtain a sense that the content is moved by hand movement, and more intuitive operation is possible. .

  FIG. 9 is a display screen example different from those in the first to third embodiments of the operation control apparatus of the present invention. The same components as those in FIGS. 2 and 7 are denoted by the same reference numerals, and description thereof is omitted. Reference numeral 801 denotes a second moving object detection area where 702 is the first moving object detection area, 802 is an image of the position of the moving object, and 803 is a locus of the moving object.

  Next, the processing flow of the operation control apparatus of this example will be described with reference to FIG. The same components as those in FIG. After the position of the moving object is displayed in step 502, in step 510, either the first moving object detection area 702 or the second moving object detection area 801 in which the position of the moving object is set by the detection area setting unit 202 by the system control unit 203. It is judged whether it is in the range. If there is no moving object position, the process returns to step 501 for moving object detection. If the position of the moving object is in either range, in step 504, the trajectory of the moving object is analyzed. If the moving amount of the moving object is greater than or equal to the threshold value in step 505, the system control unit 203 determines in step 511 whether the position of the moving object is within the first moving object detection region 702. If the position of the moving object is within the first moving object detection region 702, a control command is generated in step 506, and for example, a screen display for moving a content menu is displayed. If the position of the moving object is outside the moving object detection area 702, it is in the second moving object detection area, and therefore, in step 512, another control command different from step 506 is generated. In this example, control commands are assigned to change the volume.

  According to this example, by providing a plurality of moving object detection areas and assigning control targets to each, a plurality of controls can be performed with the same hand operation. In this example, the two motion detection areas are used. However, the moving object detection areas may be further increased as necessary for the operation.

  FIG. 11 shows an example of the movement of the operator's hand. Reference numeral 151 denotes a trajectory of the operation of moving the hand left and right in the x-axis direction, and 150 denotes a trajectory of the operation of moving the hand up and down in the y-axis direction. The operator operates the operation control device by moving his / her hand up / down and left / right.

  FIG. 12 is a display screen example of the operation control apparatus of the present invention corresponding to FIG. The same components as those in FIGS. 2 and 7 are denoted by the same reference numerals, and description thereof is omitted. 160 is an image of the position of the moving object, 161 is the locus of the moving object, and 162 is a display showing the control items that can be operated along with the operation direction.

  Next, the processing flow of the operation control apparatus of this example will be described with reference to FIG. The same components as those in FIG. After analyzing the trajectory of the moving object in step 504, in step 520, the system control unit 203 determines whether the amount of movement in the x direction is greater than or equal to a threshold value. If the amount of movement in the x-axis direction is greater than or equal to the threshold value, in step 506, a control command corresponding to movement in the x-axis direction is generated, and for example, a screen display for moving a content menu is displayed. If the movement amount in the x-axis direction is equal to or smaller than the threshold value, in step 521, the system control unit 203 determines whether the movement amount in the y-axis direction is equal to or larger than the threshold value. If the amount of movement in the y-axis direction is greater than or equal to the threshold, a control command corresponding to the movement in the y-axis direction is generated in step 522, and for example, the content at the focus position 701 is selected / reproduced.

  According to this example, more control is possible by dividing the motion of the moving body into different controls in the x-axis direction and the y-axis direction. Further, a greater amount of control is possible by combining with control using a plurality of moving object detection regions as shown in FIG.

  FIG. 14 shows an example of the movement of the operator's hand. 350 is a trajectory of the movement of the operator to move the hand left and right in the x-axis direction, 351 is a trajectory of the movement of moving the hand up and down in the y-axis direction, and 352 is a trajectory of the movement of moving the hand back and forth in the z-axis direction. Yes. The operator operates the operation control device by moving his / her hand up / down, left / right, and front / rear.

  FIG. 15 is a display screen example of the operation control device of the present invention corresponding to FIG. The same components as those in FIGS. 2 and 7 are denoted by the same reference numerals, and description thereof is omitted. In this example, a 3D camera or the like that can measure the distance between the imaging unit 102 and the imaging object is used as the imaging unit 102. Reference numeral 451 denotes an image of the position of the moving object, and reference numeral 452 denotes a display example showing an operation method. For example, when the operator puts his / her hand forward according to the operation method 452, the operation control apparatus 100 determines that the moving object has approached and reproduces the content at the focus position 701.

  Next, the processing flow of the operation control apparatus of this example will be described with reference to FIG. The same components as those in FIG. 5 and FIG. If the amount of movement in the x-axis direction is greater than or equal to the threshold value in step 520, in step 506, a control command corresponding to the movement in the x-axis direction is generated, and for example, a screen display for moving a content menu is displayed. If the amount of movement in the x-axis direction is equal to or smaller than the threshold value in step 520, in step 530, the system control unit 203 determines whether the amount of movement in the z-axis direction is equal to or larger than the threshold value. If the amount of movement in the z-axis direction is equal to or greater than the threshold value, in step 522, a control command corresponding to the movement in the z-axis direction is generated, and for example, the content at the focus position 701 is selected / reproduced.

  According to this example, more control is possible by assigning the motion of the moving body to different controls in the x-axis direction, the y-axis direction, and further in the z-axis direction. Further, a greater amount of control is possible by combining with control using a plurality of moving object detection regions as shown in FIG.

  FIG. 17 shows a relationship diagram between the movements of the hands of the two operators and the imaging unit 102. The same components as those in FIG. 2 are denoted by the same reference numerals, and description thereof is omitted. The imaging unit 102 is a 3D camera or the like that can measure the distance between the imaging unit 102 and the imaging target. Reference numeral 650 denotes a second operator, which is farther from the imaging unit 102 than the operator 106. Reference numeral 651 denotes a trajectory of the hand movement of the operator 106, and reference numeral 652 denotes a trajectory of the hand movement of the second operator 650. The operator 106 and the second operator 650 move their hands at the same time.

  FIG. 18 is an example of a captured image of the imaging unit 102. The same components as those in FIG. 3 are denoted by the same reference numerals, and description thereof is omitted. 751 indicates a captured image of the operator 106, 752 indicates a captured image of the hand of the operator 106, and 753 indicates a trajectory of the hand motion of the operator 106. Reference numeral 754 indicates a captured image of the operator 650, 755 indicates a captured image of the hand of the operator 650, and 756 indicates a trajectory of the hand of the operator 650.

  Here, distance data from the imaging unit 102 is not clearly shown, but each image data also has distance data. In this example, the moving object closest to the imaging unit 102 is extracted from the captured image data and displayed. FIG. 19 shows an example of the display screen. The same components as those in FIG. 2 are denoted by the same reference numerals, and description thereof is omitted. Reference numeral 851 denotes an image of the position of the hand of the operator 106, and reference numeral 852 denotes a locus of hand movement. Although two moving objects are detected in the imaging unit 102, only the image 851 indicating the position of the hand of the operator 106 that is the closest moving object is displayed in the display screen example of FIG. In addition, only the movement of the operator 106 is effective.

  Next, the processing flow of the operation control apparatus 100 of this example is demonstrated using FIG. The same components as those in FIGS. 5 and 16 are denoted by the same reference numerals, and description thereof is omitted. When a moving object is detected in step 501, in step 540, the system control unit 203 determines whether the distance to the moving object is closer than a reference value. The reference value is determined in advance as a range in which the operation control apparatus 100 can be operated. In this way, unnecessary moving object detection can be avoided. If it is farther than the reference value in step 540, the process returns to step 501 for moving object detection. If it is closer than the reference value, in step 541, the system control unit 203 determines whether or not it is within the reference value of the size of the moving object provided in advance. If the size of the moving object is out of the reference value, the process returns to step 501 for detecting the moving object. By doing so, it is possible to prevent malfunctions when an operation such as a person crossing in front of the operator is performed. If the size of the moving object is within the reference value, in step 542, the system control unit 203 and the video processing unit 204 display the position of the moving object as the shortest distance.

  According to this example, even when there are a plurality of operators and there are a plurality of moving bodies, the true operator's hand can be identified and recognized as an operable moving body.

  FIG. 21 shows a relationship diagram between the operator and the imaging unit. The same components as those in FIG. 2 are denoted by the same reference numerals, and description thereof is omitted. The imaging unit 102 is a 3D camera or the like that can measure the distance between the imaging unit 102 and the imaging target. 251 is the hand of the operator 106, 252 is the position of the hand 251 detected by the imaging unit 102, 253 is the distance to the hand 252 detected by the imaging unit 102, 254 is the operator detected by the imaging unit 102 The position of 106, 255 is the distance to the operator 106 detected by the imaging unit 102, and 256 is the difference between the distance 255 to the operator 106 and the distance 253 to the operator's hand 251.

  Next, the processing flow of the operation control apparatus 100 of this example is demonstrated using FIG. The same components as those in FIGS. 5 and 16 are denoted by the same reference numerals, and description thereof is omitted. In step 550, the operator 106 is detected. The operator 106 can detect the image data of the imaging unit 102. For example, if a method of recognizing an image or a method of detecting the size of an object within a certain distance in a captured image is used. Good. By detecting the operator 106, the distance 255 to the operator can be known. Next, in step 501, the moving hand 252 is detected. In step 502, the position of the moving object is displayed, and then the process proceeds to step 551. In step 551, the difference between the distance 255 to the operator and the distance 253 to the moving object is taken and compared with a reference value. Here, the reference value is set in consideration of an approximate distance that the operator 106 reaches for the operation. If the difference is equal to or greater than a certain reference value, the operator 106 is officially identified as a moving object, assuming that the hand has been extended for the purpose of operation, and the process proceeds to step 504. If the difference is equal to or less than a certain reference value, it is determined that the operator 106 is a hand that has been moved without the purpose of operation, and this is not specified as an official moving object.

  According to this example, it is possible to detect a movement of a hand or the like for the purpose of an operator's operation and prevent malfunctions caused by a movement of a hand or the like that is not intended for the operation.

DESCRIPTION OF SYMBOLS 100 ... Operation control apparatus, 101 ... Display part, 102 ... Imaging part, 103 ... Content selection menu, 104 ... Focus position, 106 ... Operator, 111 ... Moving body operation Area, 200 ... motion detection unit, 201 ... motion analysis unit, 202 ... system control unit, 203 ... detection range setting unit, 204 ... video processing unit

Claims (6)

Detecting a movement of the operator's hand by photography by the 3D camera, according to the movement of the hand, and an operation control apparatus for I-line operations for the display screen,
A detection area setting unit for setting an area where operation control is possible within the imaging screen;
A display unit that displays on the display screen a region in which the operation control set in the detection region setting unit is possible, the operator's hand, and a menu in which a plurality of selection items are arranged;
On the display screen, the operator's hand at the shortest distance from the 3D camera is displayed, and when the displayed operator's hand moves within an area where the operation can be controlled, the operator of corresponding to the movement direction and the movement amount of the movement of the hand, the operation control device, characterized in that it comprises a control unit for displaying and moving the menu on the display screen. The operation control apparatus according to claim 1, wherein the control unit displays one selectable display area of the plurality of selection items and the area where the operation control can be performed in an overlapping manner. . The operation control apparatus according to claim 1, wherein the control unit displays a display area of the menu so as to overlap an area where the operation can be controlled . An operation control device that detects the movement of the operator's hand and the body of the operator by shooting with a 3D camera, and performs an operation on a display screen according to the movement of the hand,
A detection area setting unit for setting an area where operation control is possible within the imaging screen;
A display unit that displays on the display screen a region in which the operation control set in the detection region setting unit is possible, the operator's hand, and a menu in which a plurality of selection items are arranged;
On the display screen, the operator's hand that has been put forward by a predetermined distance from the operator's body is displayed, and the displayed operator's hand moves within a region where the operation control is possible. If the, corresponding to the moving direction and the moving amount of the motion of the hand of the operator, the control unit for displaying and moving the menu on the display screen, operation control further comprising a Equipment . The operation control apparatus according to claim 4, wherein the control unit displays one selectable display area of the plurality of selection items and the area where the operation control is possible in an overlapping manner. . The operation control apparatus according to claim 4, wherein the control unit displays a display area of the menu so as to overlap an area where the operation control is possible.

Images