TWI803134B - Virtual image display device and setting method for input interface thereof - Google Patents

Abstract

A virtual image display device and a setting method for an input interface are provided. The virtual image display device includes a virtual image display and a hand-held electronic device. The virtual image display provides a plurality of prompt commands by executing an application program to perform a setting action for the input interface. The hand-held electronic device displays the input interface and receives a plurality of input touch control operations through the input interface corresponding to each of the prompt commands during the setting action. The virtual image display calculates a plurality of effective touching areas respectively corresponding to the prompt commands according to a position distribution of each input touch control operation corresponding to each of the prompt commands.

Description

Setting method of virtual image display device and its input interface

The present invention relates to a virtual image display device and its input interface setting method, and in particular to a virtual image display device capable of setting touch areas according to individual users and its input interface setting method.

When using the virtual image display device, the user can perform a touch action on the input interface displayed on the handheld electronic device, and use it to control the virtual image display device. However, while experiencing the virtual reality, the user cannot see the input interface displayed on the handheld electronic device. And because each user's finger length, palm size and personal usage habits are not the same, therefore, when performing a touch action on the input interface, the phenomenon of touching an incorrect touch area often occurs.

The present invention provides a virtual image display device and a method for setting the input interface thereof, which can improve the convenience of touch operation for users.

The virtual image display device of the present invention includes: a virtual image display and a handheld electronic device. The virtual image display executes the application program to provide a plurality of prompt commands to execute the setting action of the input interface. The handheld electronic device displays an input interface. And in the setting action, a plurality of input touch actions are received through the input interface corresponding to each prompt command. The virtual image display calculates a plurality of effective touch areas corresponding to the prompt commands according to the position distribution of the input touch actions corresponding to the prompt commands.

The method for setting the input interface of the virtual image display device of the present invention includes: making the virtual image display execute an application program to provide a plurality of prompt commands to perform the setting action of the input interface; making the handheld electronic device display the input interface, and during the setting action receiving a plurality of input touch actions corresponding to each prompt command through the input interface; and calculating a plurality of effective touch areas respectively corresponding to the prompt commands according to the position distribution of the input touch actions corresponding to each prompt command.

Based on the above, in the setting method of the input interface of the virtual image display device of the present invention, the position of the touch action performed by the user corresponding to different prompt commands is received and analyzed during the setting action, and the user can calculate the position suitable for use. The effective touch area of the user's finger length. In this way, the input interface provided by the handheld electronic device can be more suitable for any user, and the convenience of manipulation and the comfort in use of the virtual image display device can be improved.

Please refer to FIG. 1 at the same time. FIG. 1 is a schematic diagram of a virtual image display device according to an embodiment of the present invention. In FIG. 1 , the virtual image display device 100 includes a virtual image display 110 and a handheld electronic device 120 . The virtual image display 110 may be a head-mounted display. The handheld electronic device 120 can be a smart mobile phone. The handheld electronic device 120 can display the input interface GUI, and provide the user with a touch action on the input interface GUI, so as to perform manipulation actions on the virtual image display 110 .

Since the length of each user's finger is different, the input touch action performed by the user may not effectively occur on the preset initial touch without looking at the display screen of the handheld electronic device 120. in the area. Therefore, the virtual image display device 100 needs to set the positions of the multiple touch areas in the input interface GUI for each user.

The virtual image display 110 can execute an application program to perform setting actions on the input interface GUI displayed on the handheld electronic device 120 . In the setting operation, the virtual image display 110 can provide multiple prompt commands to the user according to the application program, and allow the user to perform input touch actions on the input interface GUI displayed on the handheld electronic device 120 according to the prompt commands. The above prompt command may be an image signal and/or an audio signal generated by the virtual image display 110 .

In this embodiment, the input interface GUI displayed on the handheld electronic device 120 has touch areas Z1 - Z4 respectively corresponding to the virtual buttons BT1 - BT4 . The virtual image display 110 can perform the setting operation of the input interface GUI by executing the application program. During the setting operation, please refer to FIG. 2 synchronously, wherein FIG. 2 is a flow chart of a setting method of the input interface of the virtual image display device according to the embodiment of the present invention. In step S210, the virtual image display 110 can execute the application program to provide a plurality of prompt commands to execute the setting action of the input interface. In step S220, the handheld electronic device 120 is used to display the input interface, and in the setting action, the virtual image display 110 instructs the user to perform an input touch action on one of the virtual buttons BT1-BT4, and the handheld electronic device 120 The input touch action performed by the user is received through the input interface corresponding to each prompt command. Correspondingly, the virtual image display 110 can record the position of the input touch action corresponding to each prompt command.

In detail, the user can perform multiple input touch actions on the virtual button BT1 according to the first prompt command provided by the virtual image display 110; Perform multiple input touch actions; according to the third prompt command provided by the virtual image display 110, perform multiple input touch actions for the virtual button BT3; according to the fourth prompt command provided by the virtual image display 110 for The virtual button BT4 performs multiple input touch actions.

After multiple prompt commands are issued, in step S230, the virtual image display 110 can analyze the position of the user's input touch action corresponding to each virtual button BT1~BT4, and calculate the corresponding position of the user's various touch actions. The location distribution of input touch actions for prompt commands. The virtual image display 110 can then calculate a plurality of effective touch areas respectively corresponding to the prompt commands according to these position distributions.

The virtual image display 110 enables the handheld electronic device 120 to display the input interface GUI according to the updated effective touch area.

It is worth mentioning that the above-mentioned setting actions of the input interface can be customized for each user. The virtual image display 110 can also store the identification information of the user corresponding to the setting result. When the user operates the virtual image display device 100, he only needs to input its identification information, and the virtual image display 110 can display an input interface GUI suitable for the user's operation on the handheld electronic device 120, effectively improving the user experience. on the convenience.

Please refer to FIG. 3A to FIG. 3D below. FIG. 3A to FIG. 3D are schematic diagrams illustrating the operation of the setting method of the input interface of the virtual image display device according to the embodiment of the present invention. In FIG. 3A, the virtual image display makes the handheld electronic device 320 display an input interface by executing an application program, wherein the input interface may have a plurality of initial touch areas Z1~Z4 corresponding to the virtual buttons BT1~BT4, and are used to separate the initial The initial boundaries IBD of the touch areas Z1-Z4.

In FIG. 3B, the virtual image display provides multiple prompt commands, and instructs the user to perform multiple input touch actions on each initial touch area Z1~Z4 on the input interface, and generates multiple touch points TC1~ TC4. Among them, the touch point TC1 corresponds to the prompt command for inputting the touch action for the virtual key BT1; the touch point TC2 corresponds to the prompt command for inputting the touch action for the virtual key BT2; the touch point TC3 corresponds to the input touch command for the virtual key BT3. touch point TC4 corresponds to a prompt command for inputting a touch action for the virtual key BT4.

The virtual image display records the positions of the touch points TC1 to TC4, and the distribution range of the position of the touch point TC1; the distribution range of the position of the touch point TC2; the distribution range of the position of the touch point TC3; The distribution range of the position of control point TC4 is analyzed.

Next, in FIG. 3C, the virtual image display can generate an updated boundary ABD according to the distribution range of the positions of the touch points TC1-TC4, and use the updated boundary ABD to regenerate the valid touch points corresponding to the virtual buttons BT1-BT4 respectively. control areas Z1'~Z4', as shown in Figure 3D.

In this embodiment, the virtual image display can calculate the first central position of multiple touch points TC1; the second central position of multiple touch points TC2; the third central position of multiple touch points TC3; The fourth center position of touch point TC4. And calculate the updated boundary ABD according to the first central position to the fourth central position. Corresponding to the updated boundary ABD, the newly generated valid touch areas Z1 ′˜Z4 ′ may respectively contain the positions where the touch points TC1 ˜TC4 occur.

It is worth mentioning that in the embodiment of the present invention, setting four virtual buttons BT1-BT4 is just an example for illustration. In other embodiments of the present invention, the input interface on the handheld electronic device may also have different numbers of virtual keys and different numbers of touch areas. In addition, the distribution method of the touch areas is not limited to the way shown in FIG. 3A , and the designer can arrange the layout of the touch areas according to actual requirements without certain restrictions.

Please refer to FIG. 4 below. FIG. 4 is a flowchart illustrating a method for setting an input interface of a virtual image display device according to an embodiment of the present invention. In step S410 , the head-mounted display as a virtual image display requires the user to touch different virtual keys for a certain number of times through the application program. In step S420, the head-mounted display records and calculates the position of the touch action. In step S430, the head-mounted display adjusts the initial touch area of the virtual key to a new effective touch area, and, in step S440, the head-mounted display can store the effective value of the virtual key for this user. The touch area, and when the user operates, provide the stored effective touch area to perform the input operation.

The details of the actions of the above steps have been described in detail in the aforementioned embodiments, and will not be repeated here.

To sum up, the virtual image display of the present invention uses the execution of the application program to collect multiple touch positions corresponding to each virtual button when an individual user is performing a touch action on the virtual button, and according to the collected touch The position information of the control action is used to generate the effective touch area corresponding to the individual user. In this way, each user can simply touch the virtual keys through the input interface provided by the handheld electronic device when experiencing virtual reality or augmented reality images, effectively improving the user experience. comfort and enhance the experience.

100: Virtual image display device 110: Virtual image display 120: Handheld Electronic Devices ABD: Updated Boundaries BT1~BT4: virtual buttons GUI: input interface IBD: Initial Boundary S210~S230, S410~S440: Steps of the setting method of the input interface TC1~TC4: touch points Z1~Z4: touch area Z1'~Z4': effective touch area

FIG. 1 is a schematic diagram of a virtual image display device according to an embodiment of the present invention. FIG. 2 is a flowchart of a method for setting an input interface of a virtual image display device according to an embodiment of the present invention. FIG. 3A to FIG. 3D are schematic diagrams illustrating the operation of the setting method of the input interface of the virtual image display device according to the embodiment of the present invention. FIG. 4 is a flowchart of a method for setting an input interface of a virtual image display device according to an embodiment of the present invention.

100:Virtual image display device 110:Virtual image display 120: Handheld Electronic Devices BT1~BT4: virtual buttons GUI: input interface Z1~Z4: Touch area

Claims (10)

A virtual image display device, comprising: A virtual image display, executing an application program to provide a plurality of prompt commands to perform a setting action of an input interface; and A hand-held electronic device, displaying the input interface, and receiving multiple input touch actions corresponding to the prompt commands through the input interface during the setting action, Wherein the virtual image display calculates a plurality of effective touch areas respectively corresponding to the prompt commands according to the position distribution of the input touch actions corresponding to the respective prompt commands. The virtual image display device as described in Claim 1, wherein the virtual image display causes the handheld electronic device to display the input interface by executing the application program, wherein the input interface has a plurality of initial touch areas. The virtual image display device as described in claim 2, wherein the virtual image display provides the prompt commands by executing the application program, and each prompt command is used to prompt the user to target one of the initial touch areas Each input touch action is performed. The virtual image display device as claimed in claim 1, wherein the virtual image display calculates the position distribution of the input touch actions corresponding to the prompt commands to set the boundaries between the effective touch areas. The virtual image display device according to claim 1, wherein the virtual image display updates the input interface displayed on the handheld electronic device according to the effective touch areas. A method for setting an input interface of a virtual image display device, comprising: Make a virtual image display execute an application program to provide a plurality of prompt commands to execute a setting action of an input interface; Make a handheld electronic device display the input interface, and in the setting action, receive a plurality of input touch actions corresponding to the prompt commands through the input interface; and A plurality of effective touch areas respectively corresponding to the prompt commands are calculated according to the position distribution of the input touch actions corresponding to the prompt commands. The input interface setting method as described in claim 6, wherein the handheld electronic device is made to display the input interface, and in the setting action, the input touch actions are received through the input interface corresponding to the prompt commands The steps include: Making the virtual image display execute the application program to make the handheld electronic device display the input interface, wherein the input interface has a plurality of initial touch areas. The input interface setting method as described in claim 7, wherein the handheld electronic device is made to display the input interface, and in the setting action, the input touch actions are received through the input interface corresponding to the prompt commands The steps further include: The virtual image display provides the prompt commands by executing the application program, and prompts the user to perform each input touch action on one of the initial touch areas through each prompt command. The setting method of the input interface as described in request item 6 further includes: The virtual image display is used to calculate the position distribution of the input touch actions corresponding to the prompt commands so as to set the boundaries between the effective touch areas. The setting method of the input interface as described in request item 6 further includes: The virtual image display is made to update the input interface displayed on the handheld electronic device according to the effective touch areas.

Images