TW201642084A - Display control device and image display device - Google Patents

Abstract

Provided is a display control device, comprising: an entry direction acquisition unit (5) which, when a display position of a pointer which moves in accordance with a user operation overlaps with a display position of a movable region which guides the movement of the pointer, acquires a direction at which the pointer has entered the movable region; a verification unit (6) which acquires display information based on the acquired entry direction; a guide generating unit (8) which generates guide regions which guide the pointer and the movable region on the basis of the acquired display information; and a display control unit (3) which carries out a control which displays the pointer, the movable region, and the guide regions.

Description

Display control device and image display device

The present invention relates to a technique of controlling display content according to a gesture operation of a user.

In recent years, the display device mounted on the head, that is, the head mounted display device (hereinafter referred to as a head mounted display) has progressed in miniaturization, and a user has been developed to install the head mounted display. A product that can be moved when the device is installed. In general, the display screen operation of the head mounted display device is performed by operating a button disposed on the head mounted display device or a touch panel and a button connected to the controller of the head mounted display device. The operation of any display screen requires the user to attach a finger to the head mounted display device or the grip controller.

As an operation method that does not take away the user's finger freedom, there is a technique of using the image capturing unit to take a picture of the user's finger to recognize the shape of the finger and execute an instruction according to the gesture operation based on the recognized finger. As a method of executing an instruction according to a gesture operation of a finger, there is a method of specifying an instruction to a user's finger shape, and a method in which a finger is held on the operation screen for a certain period of time to recognize an intention of execution of the instruction. Further, in Patent Document 1, it is disclosed that a user operates to generate a stereoscopic image data, and a virtual operation screen is formed and displayed based on a shape and a position of a user image and a position read by the three-dimensional image capturing unit, to display The three-dimensional image capturing unit reads the action of the user facing the displayed virtual operation screen, The determination operation is an image recognition device that outputs a predetermined signal during operation.

However, in the execution of the gesture operation according to the finger, there is a problem that the user needs to memorize the instruction assigned to the shape of the finger in advance. In addition, in the method in which the finger is stationary to recognize the intention of execution of the instruction, there is a problem that it is difficult for the finger to be stationary in space for a certain period of time. Further, in the image recognition device of Patent Document 1, there is a problem that the size of the device is increased due to the necessity of the three-dimensional image capturing unit, and the CPU load is increased due to the calculation in the depth direction.

In view of the above problems, for example, Patent Document 2 discloses a display device that analyzes an image signal of an image taken by a sensor to detect a user's finger, and displays an index of the action in conjunction with the detected finger in the virtual image display area. With the operation of the finger, when the index moves to the vicinity of the boundary between the virtual image display area and the area other than the virtual image display area, the mode is switched to the command reception mode, and an instruction assigned to the vicinity of the boundary is displayed. Thereby, the user can switch to the command receiving mode only by moving the finger.

[Previous Technical Literature]

[Patent Literature]

Patent Document 1: JP-A-2011-175617

Patent Document 2: JP-A-2014-106698

However, in the technique disclosed in Patent Document 2, the index cannot be placed in the vicinity of the boundary between the virtual image display region and the virtual image display region, and there is a problem that the index is limited. In addition, there is an instruction to memorize the assignment to the boundary in the command receiving mode, and even more The problem that the displayed command is separated from the position of the indicator and it is difficult to execute the command smoothly.

The present invention has been made to solve the above problems, and an object thereof is to perform command execution only by moving an index in a space, and to execute a command without setting restrictions on display positions of display information such as indicators and images.

The display control device according to the present invention includes: an incident direction acquiring means that, when the display position of the index that moves in accordance with the user operation overlaps with the display position of the movable region that induces the movement of the index, the index is incident on the movable region a direction; a comparison unit obtains display information according to an incident direction obtained by the incident direction acquiring unit; and a guidance generating unit that generates a guiding region that induces the index and the movable region according to the display information obtained by the comparing unit; and displays The control unit performs control for displaying the index, the movable area, and the guidance area generated by the guidance generating unit.

According to the present invention, the instruction can be executed only by moving the index in the space, and the instruction is not set on the display position of the information displayed on the display screen, and the command is smoothly executed.

1‧‧‧ input unit

2‧‧‧Location Information Acquisition Unit

3‧‧‧Display control unit

4‧‧‧Overlapping unit

5‧‧‧Injection direction acquisition unit

6‧‧‧Control unit

7‧‧‧Instruction database storage unit

8‧‧‧Guidance generating unit

9‧‧‧ linkage processing unit

10‧‧‧Contact judgment unit

11‧‧‧Command Execution Unit

12, 12a‧‧‧Determining unit

13, 13a‧‧‧ guidance display release unit

14‧‧‧Display unit

15‧‧‧ indicator position judgment unit

16‧‧‧Display information storage unit

31‧‧‧ indicator display control unit

32, 32a‧‧‧ movable area display control unit

33, 33a‧‧‧ guidance display control unit

100, 100a‧‧‧ display control device

101‧‧‧ processor

102‧‧‧ memory

200‧‧‧ head-mounted display device

Fig. 1 is an explanatory view showing an overview of a display control device according to the first embodiment.

Fig. 2 is a schematic view showing the configuration of a display control device according to the first embodiment.

Figure 3 is a diagram showing the command data of the display control device according to the first embodiment. An explanatory diagram of the composition of the library.

Fig. 4 is a view showing the hardware configuration of the display control device according to the first embodiment.

Fig. 5 is a flow chart showing the operation of the display control device according to the first embodiment.

Fig. 6 is a schematic view showing a display example of the display control device according to the first embodiment.

Fig. 7 is an explanatory view showing the efficiency of the display control device according to the first embodiment.

Fig. 8 is an explanatory view showing the efficiency of the display control device according to the first embodiment.

Fig. 9 is an explanatory view showing the efficiency of the display control device according to the first embodiment.

Fig. 10 is an explanatory view showing the efficiency of the display control device according to the first embodiment.

Fig. 11 is a view showing a display example when the display control device according to the first embodiment is applied to the list display.

Fig. 12 is a view showing a state in which the movable region of the display control device according to the first embodiment is formed in an octagonal shape.

Fig. 13 is a schematic diagram showing a display example when the display control device according to the first embodiment is applied to mobile display.

Fig. 14 is an explanatory view showing an overview of the display control device according to the second embodiment.

Figure 15 is a diagram showing the configuration of a display control device according to the second embodiment. schematic diagram.

Figure 16 is a flow chart showing the operation of the display control device according to the second embodiment.

Fig. 17 is a view showing a display example when the display control device according to the second embodiment is applied to numerical input.

DETAILED DESCRIPTION OF THE INVENTION The present invention is described with respect to the embodiments of the present invention in accordance with the accompanying drawings.

Embodiment 1

First, an outline of the control contents of the display control device 100 will be described with reference to Fig. 1 . Fig. 1 is a schematic diagram showing a display example in which display control device 100 according to the first embodiment performs display control. In the first diagram, the display control device 100 is applied to a head mounted display device (HMD) 200 to operate according to the operation of the user's hand 201 in the space (hereinafter referred to as a gesture operation). The screen of the head mounted display device 200 is The example is explained. In addition, the display control device 100 is not limited to the gesture operation, and can also be applied to the touch panel operation and the mouse operation.

First, as shown in FIG. 1(a), the user moves the hand 201 in the space to perform an operation for moving the index of the screen displayed on the head mounted display device 200. The image capturing operation of the user is performed by the image capturing unit 202 or the like, and the image signal of the obtained image is input to the display control device 100. Although the example in which the image capturing unit 202 takes an image is shown in the first (a) diagram, a plurality of image capturing units may be provided. In addition, as long as the user's gesture operation can be detected, no matter what detection method is available. Further, a configuration in which a plurality of detection methods are combined may be employed.

A display example of the screen of the head mounted display device 200 is shown in the first 1(b) and 1(c). In the initial screen shown in Fig. 1(b), the index 301 and the movable area 302 are arranged. The indicator 301 is an indication display that follows the movement of the user's gesture operation, and the movable area 302 is an area in which the instruction execution is triggered. In the first (b) diagram, the index 301 is moved to the direction of the movable area 302, and when the index 301 is incident on the movable area, the screen shown in the first (c) is displayed.

In the screen of the first (c) diagram, the index 301, the induced region 303 for inducing the movable region 302, the lead frame 304 indicating the periphery of the induced region 303, and the command regions 305 and 306 provided along the lead frame 304 are indicated. . When the user sees the screen of FIG. 1(c), a gesture operation is performed to move the index 301 to the intended command areas 305 and 306. The index 301 moves in conjunction with the movable area 302, and when the movable area 302 moves into the command area 305, an instruction to set to the command area 305 is executed.

Next, the configuration of the display control device 100 according to the first embodiment for realizing the display control described above will be described. Fig. 2 is a schematic view showing the configuration of the display control device 100 according to the first embodiment. The display control device 100 includes an input unit 1, a position information acquisition unit 2, a display control unit 3, an overlap determination unit 4, an incident direction acquisition unit 5, a comparison unit 6, an instruction database storage unit 7, a guidance generation unit 8, and a linkage processing. The unit 9, the contact determination unit 10, the instruction execution unit 11, the release determination unit 12, the guidance display release unit 13, and the display unit 14 are constituted.

The input unit 1 acquires a signal of a video of a user's gesture operation taken by the image capturing unit 202. The position information acquisition unit 2 detects the user's hand 201 from the input information received by the input unit 1, and acquires the position information of the detected hand 201 as the position information of the indicator. In addition, the location information acquisition unit 2 The position information displayed on the movable area of the display unit 14 is obtained by referring to the display information of the display unit 14. In the initial screen, the movable area is placed at a predetermined position.

The position information acquired by the position information acquisition unit 2 is, for example, a coordinate value indicating the display position on the display unit 14. The coordinate value of the entire screen of the head-mounted display device of the display unit 14 is obtained in advance to obtain the coordinate value at which the index is located and the coordinate value at which the movable region is located. The display control unit 3 performs display control of the display index and the movable area on the display unit 14 based on the position information of the index acquired by the position information acquisition unit 2 and the position information of the movable area. In addition, the details of the display control unit 3 will be described later.

The overlap determination unit 4 refers to the position information of the index acquired by the position information acquisition unit 2 and the position information of the movable area, and determines whether or not the index overlaps with the movable area. When the determination index overlaps with the movable area, the incident direction acquisition unit 5 refers to a buffer (not shown) that temporarily stores the history information of the position information acquired by the position information acquisition unit 2, and acquires the indicator from the movable state. The direction of incidence of the incident in the direction of the region. In the example shown in FIG. 1(c), the direction of incidence of the index 301 in the movable region 302 is indicated by an arrow A, and the index 301 is incident on the movable region 302 so as to face downward from the upper side of the paper.

The comparison unit 6 compares the incident direction acquired by the incident direction acquiring unit 5 with the command data stored in the command database storage unit 7 to obtain command information in response to the incident direction. The command information acquisition information indicating the display content of the command, the designated position of the command area, the designated position of the canceled area, and the extended area in a specific direction. Here, the canceled area is, for example, a line segment The cancellation boundary of the composition. The indicator exits from the induction area to the outside of the induction area by canceling the boundary described above, thereby canceling the instruction execution processing.

The instruction database storage unit 7 is a storage area for storing the instruction database. Fig. 3 is a view showing an example of the configuration of a command data stored in the display control device 100 according to the first embodiment. Fig. 3(a) shows the setting contents of the command database, and Fig. 3(b) is a schematic view showing a display example under the display control based on the setting contents of Fig. 3(a). The command database is composed of, for example, "command", "angle with respect to the incident direction of the index", and "extension processing of the movable region". "Command" indicates the display content of the command, "OK" and "NG" indicate the command area for executing the "OK" command and the "NG" command, respectively, and "Cancel" indicates the cancel area for the configuration cancel command execution process.

The "angle with respect to the incident direction of the index" indicates the designated position of the command area. In the third figure (b), when the direction of the index is indicated by the arrow A, the "OK" command area is arranged to be opposite to the incident direction. In the angular direction region 401 of 0°", the "NG" command region is disposed in the angular direction region 402 with respect to the incident direction "90°", and the "cancellation" region is disposed in the angular direction with respect to the incident direction "180°". In the area 403, the "cancel" area is arranged to the area 404 in the angular direction of "-90°" with respect to the incident direction. The area where the "OK" command and the "NG" command are designated as the command area will be described below.

The "extension processing of the movable area" indicates whether or not the movable area is extended in a specific direction. In the third (a) diagram, the movable area is extended only in the direction in which the "OK" command area is designated. Comparing the movable area 302 in the initial screen shown in FIG. 1(b) with the movable area 302a shown in the third (b), the movable area 302a The direction in which the "OK" command area is designated, that is, the direction from the upper side of the paper surface toward the lower side is displayed.

The guidance generating unit 8 generates the guidance information of the index based on the instruction information acquired by the comparison unit 6. The induced information generated is the guidance display, the command area, and the cancellation area. The induced information generated is output to the display control unit 3. When the overlap determination unit 4 determines that the index overlaps with the movable area, the interlock processing unit 9 outputs an instruction to move the display index in conjunction with the movement of the movable area to the display control unit 3.

The contact judging unit 10 judges the contact between the lead frame of the inducing area displayed by the display unit 14 and the periphery of the movable area. Further, the contact between the lead frame of the designated command area and the periphery of the movable area is judged. In a case where the contact judging unit 10 judges that the periphery of the movable area contacts a part of the lead frame of the designated instruction area (hereinafter referred to as a lead frame of the designated instruction area), the instruction execution unit 11 controls the designation to the above-mentioned instruction area. Execution of instructions. The cancellation determination unit 12 determines whether or not the indicator is out of the induction region. The guidance display canceling unit 13 outputs an instruction to release the display of the guidance-inducing area and the guide frame, display of the command area, and extension display of the movable area to the display control unit 3. The display unit 14 is constituted by a screen of a head mounted display device, a touch panel, a display, and the like, and is displayed on the screen according to the control of the display control unit 3.

Fig. 4 is a view showing a hardware configuration of the display control device 100 according to the first embodiment. The input unit 1, the position information acquisition unit 2, the display control unit 3, the overlap determination unit 4, the incident direction acquisition unit 5, the comparison unit 6, the guidance generation unit 8, the linkage processing unit 9, and the contact determination unit 10 of the display control device 100 , instruction execution unit 11, release determination unit 12, navigation display The releasing unit 13 and the display unit 14 are realized by the processor 101 executing a program stored in the memory 102. The command database storage unit 7 constitutes a memory 102. Further, a configuration in which a plurality of processors 101 and a plurality of memories 102 cooperate to perform the above functions may be employed.

Next, the display control unit 3 will be described with reference to Fig. 2 . The display control unit 3 is composed of an index display control unit 31, a movable area display control unit 32, and a guidance display control unit 33. The index display control unit 31 performs control of displaying the index at the designated position based on the position information acquired by the position information acquiring unit 2. The movable area display control unit 32 performs control for displaying the movable area at the designated position based on the position information acquired by the position information acquiring unit 2. Further, control for displaying the movable region in a specific direction is performed in accordance with the comparison result of the comparison unit 6.

The index display control unit 31 and the movable area display control unit 32 perform display control of the display of the interlocking index and the movable area based on the movement of the display of the index and the movement of the movable area, which are input from the interlocking processing unit 9. For example, when the interlocking instruction is input from the interlocking processing unit 9, the position information display index and the movable area are displayed at the designated position based only on the index. The guidance display control unit 33 performs control of the display guidance area, the guidance frame, the instruction area, and the cancellation area at the designated position based on the guidance information generated by the guidance generation unit 8. Further, when an instruction to cancel the display of the release index and the movable area is input from the interlock processing unit 9, the release index is interlocked with the display of the movable area.

When the display of the guidance area and the guide frame, the display of the command area, and the release instruction of the extended display of the movable area are input from the guidance display release unit 13, the index display control unit 31, the movable area display control unit 32, and the guide The lead display control unit 33 performs control for releasing the display of the guidance area and the guide frame, the display of the command area, and the extended display of the movable area.

Next, the operation of the display control device 100 will be described with reference to FIG. Fig. 5 is a flow chart showing the operation of the display control device 100 according to the first embodiment. The operation of the display control device 100 is divided into three processes (1) guidance display processing, (2) instruction execution processing, and (3) guidance non-display processing. In the three processes, the input unit 1, the position information acquisition unit 2, the display control unit 3, and the overlap determination unit 4 are always operating units, and the indicator display control unit 31 and the movable area display control unit 32 of the display control unit 3 are A means for controlling the display index and the movable area based on the position information acquired by the position information acquisition unit 2. Thereby, the indicator and the movable area are displayed on the display unit 14.

(1) Guided display processing

First, the guidance display processing will be described with reference to the processing of steps ST1 to ST9 of the flowchart of Fig. 5. The overlap determination unit 4 refers to the index acquired by the position information acquisition unit 2 and the position information of the movable region, and determines whether or not the index overlaps with the movable region (step ST1). If the index does not overlap with the movable area (step ST1; NO), the process returns to step ST1. On the other hand, if the index overlaps with the movable area (step ST1; YES), the incident direction acquiring means 5 refers to the history record of the index position information acquired by the position information acquiring means 2 accumulated in the buffer to obtain the index from the movable area. The incident direction of the incident direction (step ST2).

The comparison unit 6 performs a comparison between the incident direction of the index obtained in step ST2 and the instruction database stored in the instruction database storage unit 7, The command information in response to the incident direction is obtained (step ST3). The guidance generating unit 8 generates a guidance area, an instruction area, and a cancel area based on the instruction information acquired in step ST3 (step ST4).

The movable area display control unit 32 of the display control unit 3 refers to the information indicating the extension of the movable area of the command information acquired in step ST3, and determines whether or not the information indicating the extension of the movable area in the specific direction is described (step ST5). If there is information indicating that the movable area extends in a specific direction (step ST5; YES), the movable area display control unit 32 performs display control for extending the movable area in the specific direction (step ST6). On the other hand, if the information indicating the extension of the movable area in the specific direction is not described (step ST5; NO), the process proceeds to step ST7. The guidance display control unit 33 displays the guidance area and the guidance frame on the display unit 14 based on the guidance area, the instruction area, and the cancellation area generated in step ST4 (hereinafter, in the case of indicating both the induction area and the lead frame) The display area is referred to as a guide area, the command area, and the display area of the cancel area (step ST7).

The interlock processing unit 9 refers to the determination result of the overlap determination unit 4, and if the determination index overlaps with the movable area (step ST1; YES), the index display control unit 31 and the movable area display control unit 32 instruct the display of the index and the movable area (steps). ST8). The index display control unit 31 and the movable area display control unit 32 perform display control for interlocking the display with the display of the movable area in accordance with the instruction of step ST8 (step ST9).

(2) Instruction execution processing

Next, the instruction execution processing will be described with reference to the processing of steps ST10 to ST16 of the flowchart of FIG. 5. Further, in the above-described instruction execution processing, the indicator display control unit 31 of the display control unit 3 and the movable area display control sheet The element 32 performs display control for moving the index in conjunction with the movable area based on the position information acquired by the position information acquisition unit 2, and the index and the movable area of the interlocking movement are displayed on the display unit 14. In the process of the subsequent step ST9, the contact determination unit 10 performs the position information of the movable area in which the display control is performed by the movable area display control unit 32 and the position information of the guide frame in which the guidance display control unit 33 performs display control, and whether or not the surrounding area of the movable area is performed. The judgment of the contact with the guide frame is made (step ST10). If there is no contact with the guide frame around the movable area (step ST10; NO), the process returns to step ST9.

On the other hand, if the periphery of the movable area is in contact with the lead frame (step ST10; YES), the contact determination unit 10 further determines whether or not the periphery of the movable area touches the lead frame of the designated command area among the lead frames ( Step ST11). If the periphery of the movable area comes into contact with the lead frame of the designated command area (step ST11; YES), the instruction execution unit 11 executes an instruction designated to the guided lead frame (step ST12). When the instruction is executed in step ST12, the guidance display release unit 13 outputs the guidance display release instruction to the index display control unit 31, the movable area display control unit 32, and the guidance display control unit 33 (step ST13). The guidance display release instruction is specifically a display of the guidance area, the command area, and a release instruction for extending the display of the movable area, and an instruction to release the index in conjunction with the display of the movable area.

The guidance display control unit 33 performs display control for not displaying the guidance area and the command area based on the guidance release instruction corresponding to the guidance display release instruction and the command area input in step ST13 (step ST14). The movable area display control unit 32 advances based on the release instruction of the movable area extension display corresponding to the guidance display release instruction input in step ST13. The display control of moving the movable area back to the size before the extension is performed (step ST15). Further, the indicator display control unit 31 and the movable area display control unit 32 perform display of the release index in association with the display of the movable area based on the instruction to cancel the display of the target display release instruction and the display of the movable area in step ST13. Control (step ST16). After that, the process returns to step ST1, and the above processing is repeated.

(3) Guide does not display processing

Finally, the guidance non-display processing will be described with reference to the processing of steps ST17 to ST20 of the flowchart of FIG. 5 and the processing of steps ST13 to ST16. The guidance non-display processing is a process performed in the case where it is determined that the movable area does not touch the lead frame of the designated command area in the determination processing of the above-described step ST11 (step ST11; NO), and the movable area is contacted to not specified. Processing in the case of the guide frame of the command area.

If it is determined that the movable area does not touch the lead frame of the designated command area (step ST11; NO), the interlock processing unit 9 determines whether or not the index has moved in the canceled area direction (step ST17). If the index has not moved in the canceling area direction (step ST17; NO), the processing returns to step ST10. On the other hand, when the index moves in the canceling area direction (step ST17; YES), the display control instruction for canceling the display of the index and the movable area is released to the index display control unit 31 and the movable area display control unit 32 (step ST18). The indicator display control unit 31 and the movable area display control unit 32 individually perform display control of the index and the movable area based on the position information acquired by the position information acquisition unit 2 in accordance with the instruction of step ST18 (step ST19).

Next, the release determination unit 12 is based on the overlap determination unit 4 and The result of the determination by the contact determination unit 10 determines whether or not the index is outside the induction region (step ST20). If the indicator is outside the induction area (step ST20; YES), the process proceeds to step ST13. On the other hand, if the index does not appear outside the induction region (step ST20; NO), the process returns to step ST11, and the above process is repeated.

Next, the flowchart of Fig. 5 will be described with reference to a specific example of Fig. 6. Fig. 6 is a schematic diagram showing an example of screen display of the display control device 100 according to the first embodiment. The description of the specific example is similarly divided into three processes (1) guidance display processing, (2) instruction execution processing, and (3) guidance non-display processing. First, the initial screen shown in Fig. 6(a) is displayed on the display unit 14 before the guidance display processing. According to the display control of the index display control unit 31 and the movable area display control unit 32, the index 501 and the movable area 502 are displayed on the initial screen.

(1) Guided display processing

When changing from the initial screen shown in FIG. 6(a) to the screen shown in FIG. 6(b), the overlap determining unit 4 determines the overlap of the index 501 and the movable region 502 as in step ST1. In the case of the sixth direction (b), the incident direction acquiring means 5 determines that the index moves in the direction of the arrow A from the upper side of the paper surface toward the lower side. In step ST2, the incident direction of the index to the movable area is "downward".

In contrast, in step ST3 and step ST4, the collation unit 6 performs a comparison between the incident direction "downward" and the instruction database shown in the third (a) figure, and the "OK" command area is designated to be incident on the index 501. The position where the direction is the angle "0°" and the "NG" command area are designated at the position "90°" with respect to the incident direction as shown in the third (b) figure, and the canceled area is designated relative to the input. The direction of the emission is the information of the angle "180°" described in the third figure (b) and the position of the angle "-90°" described in the third (b) of the incident direction, and is assigned to "OK". The direction of the command area extends the information of the movable area. The movable area display control unit 32, in step ST5, refers to the extension information acquired by the comparison unit 6, and determines whether or not to extend the movable area 502. In the case of the third figure (a), as a result of the determination in step ST6, the movable area 502 is extended in the designated direction of the "OK" command area to become the movable area 502a.

As shown in FIG. 6(c), the guidance generating unit 8 displays the guidance area 503, the "OK" command area 504 adjacent to the navigation frame 503a, and displays "adjacent to the navigation frame 503b" as shown in step ST7. NG" command area 505. In addition, the lead frames 503c and 503d are also canceled boundaries as cancellation areas. The interlock processing unit 9, the index display control unit 31, and the movable area display control unit 32 perform display control for interlocking the display of the index 501 and the movable area 502 in the sixth (c) diagram in steps ST8 and ST9.

(2) Instruction execution processing

When the movement index 501 and the movable area 502a are moved in the screen shown in FIG. 6(c) to change to the display screen shown in the sixth (d) or sixth (e) diagram, the contact determination unit 10 In step ST10, a determination is made as to whether or not the periphery of the movable area 502a is in contact with the lead frame of the guiding area 503. Then, in step ST11, it is determined whether or not the periphery of the movable area 502a is in contact with the lead frames 503a and 503b of the designated "OK" command area 504 and the "NG" command area 505.

In the example shown in FIG. 6(d), the index 501 follows the movement trajectory indicated by the arrow B, and it is judged that the surrounding area of the movable area 502a is contacted to be designated. "OK" is a navigation frame 503a of the command area 504. Further, in the example shown in Fig. 6(e), the index 501 follows the movement trajectory indicated by the arrow C, and it is determined that the periphery of the movable area 502a is in contact with the lead frame 503b of the designated "NG" command area 505.

The instruction execution unit 11 executes the "OK" instruction in the case of the sixth (d) diagram and the "NG" instruction in the case of the sixth (e) diagram, as in step ST12. When the guidance display release unit 13 outputs the guidance display release instruction as in step ST13, the guidance display control unit 31, the movable area display control unit 32, and the guidance display control unit 33 are as in step ST14 to step ST16, as in the sixth ( f) and FIG. 6(g), the display of the unguided area 503, the display of the "OK" command area 504 and the "NG" command area 505, and the extended display of the movable area 502a become the only indicators 501 and Display of the movable area 502. Alternatively, the executed instruction content may be displayed in the movable area 502.

(3) Guide does not display processing

In the case where the index 501 is moved to the display screen shown in FIG. 6(h) in the screen shown in FIG. 6(c), the contact determination unit 10 performs the contact around the movable area 502 as in step ST10. Judgment to the lead frame of the guiding area 503. Then, in step ST11, whether or not the periphery of the movable area 502 is in contact with the lead frames 503a and 503b of the designated command area is performed. In the example shown in FIG. 6(h), the index 501 follows the movement trajectory indicated by the arrow D, and it is judged that the periphery of the movable area 502a is in contact with the lead frame 503c which is not designated by the command area, that is, is designated to be canceled. A lead frame 503c of the area.

In the case of the sixth (h) diagram, the interlock processing unit 9 determines that the index is directed to the guide frames 503c and 503d of the set cancel region. To move, as in step ST18, the interlock is released. The index display control unit 31 and the movable area display control unit 32, in step ST19, do not move the movable area 502 and move only the index 501 in the case of the sixth (h) diagram. The display control of the individual movement index 501 and the movable area 502 is performed only in the movement in the direction of the guide frames 503c and 503d in which the canceled area is set.

The cancel determination unit 12, as in step ST20, determines that the index 501 is out of the induction region in the case of the sixth (h) diagram. Thereafter, the process proceeds to step ST13. The guidance display release unit 13, the index display control unit 31, and the movable area display control unit 32, as shown in step 6(i), release the guidance area 503, the "OK" command area 504, and the step ST13 to step ST16. The display of the "NG" command area 505 and the extended display of the movable area 502a become only the display of the index 501 and the movable area 502.

Next, an effect in the case of applying the display control device 100 of the first embodiment will be described with reference to Figs. 7 to 10 . 7 to 10 are schematic views showing the effects obtained in the case where the display control device 100 of the first embodiment is applied. Fig. 7(a) shows a case where the moving trajectory lower index 601 and the movable area 602 are overlapped by the arrow E, and Fig. 7(b) shows the moving trajectory lower index 601 and the movable area 602 which are overlapped by the arrow F. Happening. In the seventh (a) and seventh (b) drawings, the "OK" command areas 603a and 603b are located at positions where the angle of incidence (arrows E, F) with respect to the index 601 is "0°". Here, the incident direction acquiring unit 5 obtains the incident direction of the index 601 to the movable region 602, and the steering unit 6 obtains the command information in response to the incident direction, regardless of the moving trajectory of the index 601, and the incident direction with respect to the index 601 to the movable region 602. The specified position of the command area is the same. Therefore, as shown in Figure 7(a) and 7(b) As shown in the figure, the "OK" command areas 603a and 603b can be placed on the extension line of the movement trajectory of the index 601, and the continuous input of the command can be made only by the operation of the index 601 entering the movable area 602. In addition, continuous execution of instructions can be made even in the case where the indicator 601 follows any movement trajectory.

Fig. 8 shows a case where the command region 603c is not designated at a position where the angle of the arrow G with respect to the incident direction of the index 601 is "0°", that is, on the extension line of the incident direction. In the command database shown in FIG. 3(a), it is set in advance that the command area 603c is not assigned to the angle "0°" with respect to the incident direction of the index 601. The collating unit 6 specifies the command region 603c at a position of an angle "-90°" with respect to the incident direction of the index 601 as shown in Fig. 8(a) based on the incident direction of the index 601 and the command database. Thereby, even if the index 601 erroneously goes straight out of the movable area in the direction of the arrow G and exits outside the induction area, the "OK" command can be set not to be executed. In this way, by considering the designated position of the command area, the user's erroneous input can be reduced.

FIG. 9 is a view showing the interlocking of the display of the index 601 and the movable area 602, and is a display of the interlocking index 601 and the movable area 602, and the configuration of the command set to the command area 603 is executed through the guiding area 604. When the contact determination unit 10 determines that the periphery of the movable area 602 is in contact with the lead frames 604a, 604b of the designated cancel area, and the interlock processing unit 9 determines that the index 601 is moving in the direction of the lead frames 604a, 604b of the designated cancel area, The interlock processing unit 9, the index display control unit 31, and the movable area display control unit 32 cancel the display of the index 601 and the movable area 602, and perform the display in which the index 601 and the movable area 602 are individually moved.

Thereby, in the case where the index 601 overlaps with the movable area 602, The user identifiable index 601 moves to the direction of the designated command area in conjunction with the movable area 602. Therefore, as shown in FIG. 9(b), when the movement trajectory of the index 610 is meandering and the user unintentionally moves the index 601 to the canceled area direction, the display of the release indicator 601 and the movable area 602 is interlocked, and the use is performed. It can be recognized that the movement moves to the direction in which the command area 603 is not designated. The user can change the moving direction of the index 601 and smoothly induce the movable area 602 to the area of the designated command area 603.

Fig. 10 is a schematic view showing a state in which the index moves outside the induction region. The initial screen that does not overlap the index 601 and the movable region 602 shown in the tenth (a) diagram changes to a state in which the index 601 shown in the tenth (b1) diagram overlaps with the movable region 602. In the case where the extension processing of the movable area 602 is set to the instruction database stored in the instruction data storage unit 7, as shown in the 10th (b1)th and the 10th (b2), the movable area is extended in the defined direction. . The index 601 follows the movement trajectories Ia, Ib, Ic through the extended movable area 602a from the lead frame 604a of the set cancel area to the outside of the induction area. Thereby, even if the buttons corresponding to the movable region 602 shown in FIG. 10(a) are arranged adjacent to each other, the command execution can be canceled following the movement trajectories Ia, Ib, and Ic.

On the other hand, the 10th (c1)th and the 10th (c2)th figure show the case where the movable area 602 is not extended and the area of the induction area of the guide area 604 approximates the area of the movable area 602. In this case, in order to return to the initial screen of FIG. 10(a), when the movement trajectory 601 of the arrows Ja, Jb is followed, the index 601 overlaps with the adjacent movable area 605, and the new movable area 605 is displayed. The command area 606 and the lead area 607 do not return to the initial state shown in FIG. 10(a).

Further, in the examples shown in the tenth (d1)th to tenth (d3)th drawings, the case where the movable region 602 does not extend and only the guidance region of the guide region 604 is extended is shown. In this case, as indicated by the arrows Ka, Kb, and Kc, the distance moved by the index 601 is long, and the hand shake of the user of the operation index 601 occurs. Therefore, there is a possibility that the user moves the index 601 in an unintended direction. In the display control device 100, as shown in FIG. 10(b), the overlap determination unit 4 determines the overlap of the index 601 and the movable region 602, and sets the appropriate extended movable region 602 to the command database in advance, and the movable region display control unit 32 The operability of the display unit 14 can be improved by appropriately extending the display of the movable area based on the information of the instruction database.

Next, an application example of the display control device 100 according to the first embodiment will be described with reference to FIGS. 11 to 13 . Fig. 11 is an explanatory view showing a case where the display control device 100 according to the first embodiment is applied to the display of the list menu. In the 11th (a) diagram, a plurality of movable regions 702a, 702b, 702c, and 702d are simultaneously and in parallel arranged on the display unit 14 to constitute a list menu. For example, the movable area 701a constitutes the menu "Item A", and the movable area 701b constitutes the menu "Item B". Fig. 11(a) is an initial screen, and the index 701 is not overlapped with any of the movable regions 702a, 702b, 702c, and 702d. When the index 701 is moved in the direction of the arrow L on the initial screen, the screen is shifted to the screen shown in FIGS. 11(b), (c), (e), and (f) in response to the amount of movement.

In the 11th (b) diagram, when the overlap determination unit 4 determines that the index 701 overlaps with the movable area 702a, the command area 703a and the guide area 704 are displayed, and the movable area 702a is extended in the direction in which the command area 703a is arranged. In the case of the example of FIG. 11(b), the instruction database stored in the instruction database storage unit 7 is Specify the "OK" command area to the direction of the angle "90°" with respect to the incident direction of the index, and set the "movable" to perform the movable area extension processing in the specified direction of the above command. In addition, the canceled area is assigned to the direction of the angle "0°", "180°", and "-90°" with respect to the incident direction of the index, and the "not" is set to perform the movable area extending process.

In the 11th (c) diagram, when the overlap determination unit 4 determines that the index 701 overlaps with the movable area 702b, the display command area 703b and the guide area 704 are displayed, and the movable area 702b is extended in the direction of the command area 703b. Further, as shown in FIG. 11(d), when the index 701 is moved in the arrow La direction, the contact determination unit 10 determines that the periphery of the movable region 702b contacts the lead frame of the guide region 704 and contacts the designated command region 703b. The guide frame, the instruction execution unit 11 executes the selection of the menu "Item B" set to the command area 703b.

In the 11th (f) diagram, when the overlap determination unit 4 determines that the index 701 overlaps with the movable area 702d, the display command areas 703d and 703e and the guide area 704 are displayed, and the movable area 702d is extended in the arrangement direction of the command areas 703d and 703e. Further, as shown in FIG. 11(g), when the index 701 is moved in the direction of the arrow Lb, the contact determination unit 10 determines that the periphery of the movable region 702d contacts the lead frame of the guide region 704 and contacts the designated command region 703e. The instruction frame 11 executes the instruction "Next" assigned to the instruction area 703e. By the above execution, the display of "Item A" to "Item C" of the page "1/5" is switched to the display of "Item D" to "Item F" of the page "2/5".

Fig. 12 and Fig. 13 are explanatory views showing a case where the display control device 100 according to the first embodiment is used to display the movement of the image. Fig. 12(a) shows a display example when the movable region 802 is formed in an octagonal shape, and Fig. 12(b) shows A schematic diagram of a configuration example of a command database when the movable area 802 is formed in an octagonal shape. The movable area 802 is not limited to a rectangular shape and may be constituted by an octagon or other polygonal shape as shown in Fig. 12(a). When the movable region 802 is octagonal, the incident direction acquiring unit 5 specifically specifies the incident direction of the index 801 in the eight directions. The collating unit 6 compares the incident direction acquired by the incident direction acquiring unit 5 with the command data stored in the command data storage unit 7, and obtains command information in response to the input direction of the eight directions.

The command database is composed of "command", "angle with respect to the incident direction of the index", and "extension processing of the movable area" as in the third figure (a). The "moving arrow in the direction of entry" command is defined as a position at an angle "0°" with respect to the incident direction of the index, and the "moving arrow in the reverse direction" command is placed at an angle with respect to the incident direction of the index. "180°" position. Here, the "moving arrow in the entering direction" command is an instruction to move the background image in the direction of entering the movable area, and the "moving arrow in the reverse entering direction" command is an index to move the background in a direction opposite to the direction in which the movable area is entered. Image instructions. The "cancel" command is defined as an angle of "45°", "90°", "135°", "-45°", "-90°", or "-135°" with respect to the incident direction of the indicator. position. The extension processing of the movable area is defined as all instructions are "not".

The comparison result between the command data library shown in Fig. 12(b) and the incident direction obtained by the incident direction acquiring unit 5 is shown in Fig. 12(a), and the index 801 is incident on the movable field 802 from the arrow M direction. In the case where the command arrow 803a indicating "moving arrow in the entering direction" is designated as "0°" with respect to the direction of the arrow M, "moving arrow toward the reverse entering direction" is displayed. The command area 803b is assigned to a position of "180°" with respect to the direction of the arrow M.

Fig. 13(a) to Fig. 13(f) are explanatory diagrams showing the movement of the image in response to the incident direction of the index. 13(a) and 13(b) show that the index 801 is incident on the movable area 802 from the direction of the arrow M, and the guidance display control unit 33 displays the command areas 803a, 803b, and guide according to the command information in response to the incident direction. The lead area 804 and the cancel area (not shown). Further, the movable region 802 moves in the direction of the arrow M, and the periphery of the movable region 802 comes into contact with the guide frame of the guide region 804 in which the "moving arrow in the entering direction" command region is designated, and the contact determination unit 10 judges the periphery of the movable region 802. Upon reaching the lead frame of the guidance area 804 of the designated command area 803a, the instruction execution unit 11 executes an instruction designated to the command area 803a, and the image X moves in the direction of entry of the index 801 to become the image Xa.

13(c) and 13(d) show that the index 801 is incident from the direction of the arrow N to the movable area 802, and the guidance display control unit 33 displays the command areas 803c, 803d, and guide according to the command information in response to the incident direction. The lead area 804 and the cancel area (not shown). Further, the movable area 802 is moved in the direction of the arrow N, and the periphery of the movable area 802 is in contact with the lead frame of the guide area 804 in which the "moving arrow in the entering direction" command region is designated, and the contact determination unit 10 judges the periphery of the movable area 802. Upon reaching the lead frame of the guidance area 804 of the designated command area 803c, the instruction execution unit 11 executes an instruction designated to the command area 803c, and the image X moves in the direction of entry of the index 801 to become the image Xb.

Fig. 13(e) and Fig. 13(f) show that the index 801 is incident from the direction of the arrow O to the movable area 802, according to the instruction in response to the above incident direction. The navigation display control unit 33 displays the command areas 803e, 803f, the guidance area 804, and the cancellation area (not shown). Further, the movable area 802 moves in the direction of the arrow O, and the periphery of the movable area 802 comes into contact with the lead frame of the guide area 804 in which the "moving arrow in the entering direction" command region is designated, and the contact determination unit 10 determines that the movable area 802 is in contact with When the guidance frame of the command area 803e is designated, the command execution unit 11 executes an instruction designated to the command area 803e, and the image X moves in the direction of entry of the index 801 to become the image Xc.

According to the first embodiment described above, when the overlap determining unit 4 determines that the index overlaps with the movable region, the overlap determining unit 4 includes an incident direction acquiring unit 5 that acquires an incident direction in which the index is incident from the movable region, and a comparison table. The comparison unit 6 that obtains the incident direction and the instruction database to obtain the instruction information, the guidance generation unit 8 that generates the guidance information from the instruction information acquired by the comparison unit 6, and the guidance area and the instruction area based on the generated induction information And the guidance display control unit 33 that cancels the display control of the area, the movable area of the induction index, the guidance area that induces the movable area, and the command area can be disposed anywhere in the display unit 14. Further, since the specified position of the command region is determined from the direction of the movable region according to the index, the execution of the command can be performed without depending on the movement trajectory of the index. In addition, the instructions can be executed simply and continuously. In addition, since the indicator moves through the movable area and the induced area, the jitter of the user's operation index is absorbed, which leads to smooth instruction execution. In addition, since the depth detecting unit for the user's finger is not provided, the action of the user's still finger is not required, and the command can be executed only by the user moving the finger in space.

Further, according to the first embodiment, when the setting of the movable area is displayed in a specific direction in the command data library, the configuration is movable. The area display control unit 32 performs display control for extending the movable area in a specific direction, thereby shortening the moving distance of the index and absorbing the jitter of the user's operation index.

Further, according to the first embodiment, when the contact determination unit determines that the periphery of the movable area is in contact with the lead frame that is not designated by the command area, it is configured such that the interlock processing unit 9 is only guided to the set cancel area. In the movement in the frame direction, the release indicator is interlocked with the display of the movable area, and the user-identifiable index and the movable area are moved in conjunction with the direction of the guide frame of the designated command area, and are used without interlocking the movement indicator and the movable area. The identifiable indicator moves to the direction of the canceled area. Thereby, when the user unintentionally moves the indicator to the direction of the canceled area, the moving direction of the indicator can be changed.

Further, according to the first embodiment, the reference unit 6 is configured to refer to the command data base of the designated position of the command direction in accordance with the incident direction of the index, and the user's erroneous selection command can be reduced by considering the designated position of the command area.

Further, according to the first embodiment, by displaying a plurality of movable areas at the same time, it is possible to apply to various user interfaces such as list display.

Further, according to the first embodiment, the movable area can be formed in any shape, and therefore, it can be applied to various user interfaces such as direction input.

Embodiment 2

In the second embodiment, a case where a plurality of movable regions and a plurality of command regions are displayed on the display unit 14 will be described. Fig. 14 is a view showing an example of display of display control results by the display control device 100a according to the second embodiment. When the indicator 901 enters the command display area 902, a plurality of movable areas 903, a plurality of induced areas, and a plurality of lead frames are displayed (hereinafter referred to as Display control for the navigation area 904 and the plurality of instruction areas 905. In the state shown in Fig. 14, the movement index 901, when the overlap determination unit 4 determines that the index 901 overlaps with any of the movable regions 903, performs the display control processing described in the first embodiment.

Fig. 15 is a schematic diagram showing the configuration of the display control device 100a according to the second embodiment. In the following, the same or equivalent components as those of the display control device 100 according to the first embodiment are denoted by the same reference numerals as those used in the first embodiment, and are omitted or simplified. The display control device 100a is provided with an index position determining unit 15 and a display information storage unit 16 instead of the incident direction acquiring unit 5, the collating unit 6, the command database storage unit 7, and the guidance generating unit 8 shown in the first embodiment.

The index position determining unit 15 refers to the position information of the index acquired by the position information acquiring unit 2, and determines whether or not the index is located in the command display area. The command display area is an area set in advance to the display area of the display unit 14, and when the finger is incident on the above area, an instruction is displayed. When the index is in the command display area, the index position determining unit 15 instructs the movable area display control unit 32a and the guidance display control unit 33a to display the movable area, the guidance area, and the command area. The movable area display control unit 32a refers to the display information stored in the display information storage unit 16, and displays display control of the plurality of movable areas on the display unit 14. The guidance display control unit 33a performs control of displaying the guidance area on the display unit 14 with reference to the display information stored in the display information storage unit 16.

The display information storage unit 16 stores the display size and display position indicating the movable area, the display area and the display position of the guidance area and each guide frame, Display information of the command display content, the configuration size of the command area, and the configuration position of the command area. The overlap determination unit 4 outputs the determination result to the interlock processing unit 9 and the release determination unit 12. The instruction execution unit 11 notifies the release determination unit 12a when controlling the execution instruction. The cancellation determination unit 12a refers to the determination results of the overlap determination unit 4 and the contact determination unit 10, and determines whether or not the index is out of the command display area. The guidance display release unit 13a outputs an instruction to release the display of the guidance area to the display control unit 3 only when the release determination unit 12a determines that the index is output to the command display area.

Next, the operation of the display control device 100a will be described with reference to FIG. Fig. 16 is a flowchart showing the operation of the display control device 100a according to the second embodiment. The same steps as those of the display control device 100 according to the first embodiment are denoted by the same reference numerals as those used in FIG. 5 to omit or briefly describe them. The operation of the display control device 100a is divided into three processes (1) guidance display processing, (2) instruction execution processing, and (3) guidance non-display processing. In the three processes, the input unit 1, the position information acquisition unit 2, and the display control unit 3 are always operating units, and the instruction display area is displayed in advance in the display unit 14, and the indicator display control unit 31 of the display control unit 3 is based on The location information acquired by the location information acquisition unit 2 is a means for controlling the display index.

(1) Guided display processing

First, the guidance display processing will be described with reference to the processing of steps ST31 to ST33, step ST8, and step ST9 of the flowchart of Fig. 16. The index position determining unit 15 refers to the position information of the index acquired by the position information acquiring unit 2, and determines whether or not the index is located in the command display area (step ST31). If The index is not located in the command display area (step ST31; NO), and the process returns to step ST31. On the other hand, if the index is located in the command display area (step ST31; YES), the movable area display control unit 32a and the guidance display control unit 33a refer to the display information stored in the display information storage unit 16, and display a plurality of movable areas, Display control of a plurality of guide areas and a plurality of command areas (step ST32).

The overlap determination unit 4 refers to the index acquired by the position information acquisition unit 2 and the position information of the movable region, and determines whether or not the index overlaps with the movable region (step ST33). If the index does not overlap with the movable area (step ST33; NO), the process returns to step ST33. On the other hand, if the index overlaps with the movable area (step ST33; YES), the interlock processing unit 9 instructs the index display control unit 31 and the movable area display control unit 32a to interlock the display of the index with the movable area (step ST8). The index display control unit 31 and the movable area display control unit 32a perform display control for interlocking the index displayed on the display unit 14 with the movable area in accordance with the instruction of step ST8 (step ST9).

(2) Instruction execution processing

Next, the instruction execution processing will be described with reference to the processing of steps ST10 to ST12 and steps ST34 to ST37 of the flowchart of Fig. 16. When the processing of step ST10 to step ST12 is executed to execute the command, the cancel determination unit 12a refers to the determination result of the overlap determination unit 4 and the contact determination unit 10, and determines whether or not the index is out of the command display area (step ST34). If the indicator does not appear outside the command display area (step ST34; NO), the process returns to step ST33. On the other hand, if the indicator is out of the command display area (step ST34; YES), the guidance display release unit 13a outputs the guidance display release instruction to the guidance display control list. The element 31, the movable area display control unit 32a, and the guidance display control unit 33a (step ST35). The guidance display release instruction is specifically a display indication of the guidance area, the command area, and the movable area.

The guidance display control unit 33a performs display control of not displaying the guidance area and the command area based on the non-display instruction of the guidance area and the command area corresponding to the guidance display release instruction input in step ST35 (step ST36). The movable area display control unit 32a performs display control for not displaying the movable area based on the non-display instruction of the movable area input in step ST35 (step ST37). After that, the process returns to step ST31, and the above processing is repeated.

(3) Guide does not display processing

Finally, the guidance non-display processing will be described with reference to the processing of steps ST17 to ST19 of the flowchart of Fig. 16 and the processing of steps ST34 to ST37. The guidance non-display processing is a process performed in the case where it is determined that the movable area does not touch the lead frame of the designated command area in the determination processing of the above-described step ST11 (step ST11; NO), and the movable area is contacted to not specified. Processing in the case of the cancel area of the command area.

If it is determined that the movable area does not touch the lead frame of the designated command area (step ST11; NO), the interlock processing unit 9 determines whether or not the index has moved in the canceled area direction (step ST17). If the index has not moved in the canceling area direction (step ST17; NO), the processing returns to step ST10. On the other hand, when the index moves in the canceling area direction (step ST17; YES), the display control instruction for canceling the display of the index and the movable area is released to the index display control unit 31 and the movable area display control unit 32a (step ST18). The index display control unit 31 and the movable area display control unit 32a follow the instructions of step ST18. The display of the index and the movable area is individually performed based on the position information acquired by the position information acquisition unit 2 (step ST19). After that, the process proceeds to the determination process of step ST34.

Next, a flowchart of Fig. 16 will be described with reference to a specific example of Fig. 17. Fig. 17 is a schematic diagram showing an example of screen display of the display control device 100a according to the second embodiment, and is an explanatory view showing a state in which the display control device 100a is applied to the numerical value input. The index position determining unit 15 determines whether the index 901 is located in the command display area 902 as in step ST31. As shown in Fig. 17, in the case where the index 901a is located in the command display area 902, the movable area display control unit 32a and the guidance display control unit 33a perform a display of a plurality of movable areas 903 and a plurality of guides in step ST32. Display control of the area 904 and the plurality of command areas 905 (step ST32).

The overlap determination unit 4 determines whether the index 901 overlaps with the movable area 903 as in step ST33. As shown in Fig. 17, the index 901b overlaps with the movable area 903a. The interlock processing unit 9, the index display control unit 31, and the movable area display control unit 32a perform display control of the display of the interlocking index 901b and the movable area 903a in Fig. 17 in steps ST8 and ST9.

The contact determination unit 10, as in step ST10 and step ST11, determines whether or not the movable area 903a is in contact with the lead frame of the guide area 904 and whether it touches the lead frame of the designated command area 905. In the example shown in Fig. 17, the contact determination unit 10 determines that the movable area 903a is in contact with the lead frame of the guidance area 904a of the designated command area 905a. The instruction execution unit 11 executes the selection of the instruction "6" as in step ST12. The cancel determination unit 12a, in step ST34, determines whether the index 901 is out of the command display area 902. in In the example shown in Fig. 17, the index 901a is not outputted to the command display area 902, and the processing of step ST33, step ST8 to step ST12 is repeated, the selection of the command "0" is executed, and the selection of the command "Ent" is executed.

After that, the cancel determination unit 12a, in step ST34, judges that the index 901 is out of the command display area 902, and guides the display release unit 13a. In step ST35, the guidance display release instruction is output. The guidance display control unit 33a, in step ST36, performs display control of not displaying the guidance area 904 and the instruction area 905. The movable area display control unit 32a performs display control in which the movable area 903 is not displayed as in step ST37. Further, as shown in FIG. 17, the display control unit 3 may be configured to display, on the display unit 14, a selection result of an instruction executed by the instruction execution unit 11, for example, a numerical value 906 indicating "600". Further, when the display control of the guidance area 904 and the command area 905 is not displayed, the display of the numerical value 906 may be retained.

As described above, according to the second embodiment, the index position determining unit 15 including the determination index in the command display area is configured to refer to the display stored in the display information storage unit 16 when the determination index is in the command display area. The movable area display control unit 32a and the guidance display control unit 33a that display the movable area, the guide frame, and the command can display a plurality of movable areas, a plurality of guide frames, and a plurality of commands in parallel. Thereby, the user interface of the display control device 100a for continuously executing the instructions of the plurality of configurations can be applied. For example, the application display control device 100a inputs numerical values, and according to the gesture operation of the user, numerical input can be performed.

In addition to the above, within the scope of the invention of the present invention, the free combination of the embodiments, or any of the constituent elements of the embodiments, or The omission of any of the constituent elements in each embodiment is possible.

Industrial utilization possibility

The display control device according to the present invention can provide a display screen that can be executed by a user's gesture operation only, and can be applied to a wearable image display device such as a head mounted display device and an image display of a television, a projection device, or the like. Device.

1‧‧‧ input unit

2‧‧‧Location Information Acquisition Unit

3‧‧‧Display control unit

4‧‧‧Overlapping unit

5‧‧‧Injection direction acquisition unit

6‧‧‧Control unit

7‧‧‧Instruction database storage unit

8‧‧‧Guidance generating unit

9‧‧‧ linkage processing unit

10‧‧‧Contact judgment unit

11‧‧‧Command Execution Unit

12‧‧‧Determining unit

13‧‧‧Guided display release unit

14‧‧‧Display unit

31‧‧‧ indicator display control unit

32‧‧‧ movable area display control unit

33‧‧‧Guided display control unit

100‧‧‧Display control device

Claims (7)

A display control device includes: an incident direction acquiring unit that acquires a direction in which the index is incident on the movable region when a display position of an index that moves in accordance with a user operation overlaps with a display position of a movable region that induces movement of the index; The comparison unit obtains display information according to the incident direction obtained by the incident direction acquiring unit; the guiding generating unit generates a guiding region for inducing the index and the movable region according to the display information obtained by the comparing unit; and the display control unit And performing control for displaying the above-mentioned index, the movable area, and the guidance area generated by the guidance generating unit. The display control device according to claim 1, wherein the guidance generating unit generates, according to the display information obtained by the comparison unit, an area designated to the guiding area in response to the incident direction. The command area in which the index is incident on the area, the command area to which the command to be set in the field is executed, the guidance area inducing the index and the movable area to the command area, and the release of the guidance to the command area in which the index and the movable area are released are released. region. The display control device according to claim 1, further comprising: when the display position of the index overlaps with the display position of the movable area, interlocking the display of the indicator with the display of the movable area by the display control unit And the display control unit performs the control of displaying the index and the movable area in conjunction with each other according to the interlocking instruction of the interlocking processing unit. The display control device according to claim 1, wherein the comparison unit acquires the display information that displays the movable area in a specific direction with respect to the incident direction; the display control unit obtains the information according to the comparison unit The display information is used to control the display of the movable area in the specific direction. The display control device according to claim 2, further comprising: a contact determining unit that determines a contact between the movable area and the guiding area displayed according to the control of the display control unit; and the contact determining unit When it is determined that the movable region is in contact with the guiding region, an instruction execution unit that executes an instruction set to an instruction region of the region in which the movable region is in contact with the guiding region is executed. The display control device according to claim 3, wherein the linkage processing unit specifies the release region when the contact determination unit determines that the movable region is in contact with the guidance region specified by the release region In the movement of the direction, the above-mentioned index is released in conjunction with the display of the movable area. An image display device includes: a display unit for displaying an image; an image capturing unit for taking an image by a user; and a position information acquiring unit for analyzing an image of the user operation captured by the image capturing unit, and obtaining the image accompanying the use a display position of an indicator that moves while operating, and a display position of a movable area that induces movement of the indicator; When the display position of the index obtained by the position information acquiring unit overlaps with the display position of the movable area, the incident direction acquiring means acquires the index to enter the movable area known direction; and the collating unit obtains the unit according to the incident direction Obtaining display information in the incident direction obtained; the guidance generating unit generates a guidance area for inducing the index and the movable area based on the display information obtained by the comparison unit; and a display control unit for displaying the indicator, the movable area, and The guiding area generated by the guiding generating unit is controlled by the display unit.