WO2019100299A1

WO2019100299A1 - Head-mounted display apparatus and automatic calibration method of touch device thereof

Info

Publication number: WO2019100299A1
Application number: PCT/CN2017/112725
Authority: WO
Inventors: 张�浩
Original assignee: 深圳市柔宇科技有限公司
Priority date: 2017-11-23
Filing date: 2017-11-23
Publication date: 2019-05-31
Also published as: CN111316207A

Abstract

A head-mounted display apparatus (100) and an automatic calibration method of a touch device (54) thereof, said method comprising: predetermining an original coordinate system of the touch device (54), and a coordinate conversion formula between the actual coordinate values and the calibration coordinate values of an effective touch point of the touch device; when a relative rotation occurs between the display device (51) and the head- mounted device (53) of the head-mounted display apparatus (100), acquiring an actual angle value between a plane where the display device (51) is located and a plane where the head-mounted device (53) is located; when the actual angle value is not equal to a preset angle value and a touch operation is detected, acquiring actual coordinate data of a touch point corresponding to the touch operation in the original coordinate system; calculating, according to the coordinate conversion formula and the actual coordinate data, calibration coordinate data of the touch point in the original coordinate system; and generating a touch instruction according to the calibration coordinate data, so as to trigger a corresponding touch operation, thereby avoiding the case that the actual operation is inconsistent with the touch operation expected by the user.

Description

Head-mounted display device and automatic calibration method thereof

Technical field

The present application relates to the field of touch calibration technologies, and in particular, to an automatic calibration method for a head mounted display device and a touch device thereof, and a computer readable storage medium.

Background technique

A head mounted display (HMD) refers to a display device that can be worn on a user's head. Currently, head-mounted display devices are becoming more and more popular due to their good visual experience. Head-mounted display devices currently on the market are generally configured to be used with headphones to control the user's vision and hearing, and thus the head-mounted display device typically includes three parts: a display device, a headphone device, and a head-mounted device, wherein the head The display device of the wearable display device is generally designed to be rotatable, and when not in use, the display device can be rotated to a position substantially overlapping with the headgear device for storage; when needed, the display device can be rotated to the head The device is placed in a substantially vertical position to facilitate wearing and placing the display device in front of the user's eyes after wearing.

At present, some head-mounted display devices are also equipped with a touch device, such as a touch panel or a touch screen, to perform corresponding operations on the head-mounted display device. The touch device is generally disposed on the earphone device to facilitate user operation. The touch device also rotates following the rotation of the display device or the headset, such that the operation on the touch device produces different effects as the angle between the headset and the display device changes, such as gestures, up and down, left and right. The judgment may result in misjudgment, which affects the user experience.

Summary of the invention

In view of this, the present application provides an automatic calibration method for a head mounted display device and a touch device thereof, and a computer readable storage medium capable of automatically calibrating coordinates of a touch point when the position of the touch device deviates from a corresponding position in a standard wearing state. Value to accurately identify the touch operation and avoid situations where the actual touch operation is inconsistent with the touch operation desired by the user.

In a first aspect, the present application provides an automatic calibration method for a touch device, the automatic calibration method being applied to a head mounted display device having the touch device, the head mounted display device further comprising a display device and a headset Device. The automatic calibration method includes:

Presetting the original coordinate system of the touch device;

Presetting a coordinate conversion formula between the actual coordinate value of the effective touch point of the touch device in the original coordinate system and the calibration coordinate value;

Obtaining an actual angle value between a plane in which the display device is located and a plane in which the head device is located when relative rotation occurs between the display device and the headwear device;

Obtaining actual coordinate data of the touch point corresponding to the touch operation in the original coordinate system when the actual angle value is not equal to the preset angle value and the touch operation is detected;

Calculating calibration coordinate data of the touch point corresponding to the touch operation in the original coordinate system according to the coordinate conversion formula, the actual angle value, the preset angle value, and the actual coordinate data;

A touch command is generated according to the calibration coordinate data to trigger a corresponding touch control operation.

In a second aspect, the present application provides an automatic calibration method for a touch device, the automatic calibration method being applied to a head mounted display device having the touch device, the head mounted display device further comprising a display device and a headset Device. The automatic calibration method includes:

Presetting the original coordinate system of the touch device;

When the actual angle value is not equal to the preset angle value, setting a calibration coordinate system of the touch device according to a difference between the actual angle value and the preset angle value;

Performing coordinate conversion on coordinate values of the effective touch points of the touch device in the original coordinate system according to the coordinate conversion formula, the actual angle value, and the preset angle value, to obtain the respective effective touch points in the Calibrate the coordinate values in the coordinate system;

Obtaining calibration coordinate data of the touch point corresponding to the touch operation in the calibration coordinate system when a touch operation is detected;

In a third aspect, the present application provides a head mounted display device, the head mounted display device comprising a processor for implementing the touch described in any of the above embodiments when executing a stored computer program in a memory The steps of the automatic calibration method of the device.

In a fourth aspect, the present application provides a computer readable storage medium having stored thereon computer instructions that, when executed by a processor, implement the steps of the automatic calibration method of the touch device described in any of the above embodiments.

The automatic calibration method and device of the touch device of the present application can automatically convert the actual coordinate value of the touched point into a calibration coordinate value when the position of the touch device deviates from the corresponding position in the standard wearing state, thereby accurately identifying the touch operation and effectively The situation that the actual touch operation is inconsistent with the touch operation desired by the user is avoided, and the user has a better use experience.

DRAWINGS

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings to be used in the embodiments or the prior art description will be briefly described below. Obviously, the drawings in the following description are only It is a certain embodiment of the present application, and other drawings can be obtained according to the drawings without any creative work for those skilled in the art.

1 is a perspective view of a head mounted display device according to an embodiment of the present application, the head mounted display device including a display device Set, headset, and touch device.

2 is a schematic diagram showing an equivalent structure of the head mounted display device of FIG. 1 in a first use state.

3 is a flow chart of an automatic calibration method of a touch device according to a first embodiment of the present application.

4 is a schematic illustration of angle values between the plane in which the display device of FIG. 2 is located and the plane in which the headgear is located.

FIG. 5 is a schematic diagram showing an equivalent structure of the head mounted display device of FIG. 1 in a non-use state.

6 is a schematic diagram showing an equivalent structure of the head mounted display device of FIG. 1 in a second use state.

FIG. 7 is a schematic diagram of coordinates of the touch point A and its calibration point B generated in the touch device of FIG. 2 in the original coordinate system.

FIG. 8 is a flowchart of an automatic calibration method of a touch device according to a second embodiment of the present application.

9 is a schematic diagram of coordinates of a touch point generated in the touch device of FIG. 2 in a raw coordinate system and a calibration coordinate system.

FIG. 10 is a functional block diagram of an automatic calibration apparatus according to an embodiment of the present application.

FIG. 11 is a schematic diagram of functional modules of a head mounted display device according to an embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application are clearly and completely described in the following with reference to the drawings in the embodiments of the present application. It is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present application without departing from the inventive scope are the scope of the present application.

Referring to FIG. 1 , the present application provides a head mounted display device 100 for providing a user with a head worn on a head so that a user can view a video or an image and can listen to the sound. The head mounted display device 100 can be a head mounted video player, game device, navigation device, or the like. In the present embodiment, the head mounted display device 100 includes at least a display device 51, an earphone device 52, a headset 53, and a touch device 54. The display device 51 is configured to provide a display screen, the earphone device 52 is configured to provide sound, and the headset device 53 is configured to wear the head mounted display device 100 on a user's head. The touch device 54 is configured to generate a touch signal in response to the touch operation to control the head mounted display device 100 to perform a corresponding function.

In the present embodiment, the display device 51 and the head device 53 are rotatably connected. The earphone device 52 is disposed at a connection between the display device 51 and the headset device 53. The touch device 54 is disposed on the earphone device 52, and the display device 51 and the headset device The center of rotation 513 of 53 (shown in Figure 2) is opposite. When not in use, the display device 51 can be rotated to a position substantially overlapping with the headset 53 (as shown in FIG. 5), that is, a plane in which the display device 51 is located and the headset The plane in which 53 is located substantially coincides to facilitate accommodation of the head mounted display device 100. When it is required to be used, the display device 51 can be rotated to a position substantially perpendicular to the headset 53 (as shown in FIG. 6), that is, a plane in which the display device 51 is located and the headset 53 The plane in which it is located is substantially vertical to facilitate wearing the head mounted display device 100 and placing the display device 51 in front of the user's eyes after wearing. It can be understood that the touch device 54 is disposed on a side of the earphone device 52 away from the user, so that the user operates the touch device 54 while wearing the head mounted display device 100.

As shown in FIG. 2, in the present embodiment, the head mounted display device 100 further includes a first angle sensor 611 disposed on the headset 53 and a second disposed on the display device 51. An angle sensor 612, wherein the first angle sensor 611 is configured to detect an angle value at which the head gear 53 rotates, and the second angle sensor 612 is configured to detect an angle value at which the display device 51 rotates. An angle value of relative rotation between the display device 51 and the headset 53 can be calculated by the angle data detected by the first angle sensor 611 and the second angle sensor 612.

In the embodiment, the touch device 54 can also rotate according to the rotation of the display device 51 or the headset 53 , that is, the touch device 54 and the display device 51 or the headset There is a relatively static connection between 53. Since the touch operation on the touch device 54 may have different effects as the angle value between the head device 53 and the display device 51 changes, for example, a gesture, a determination of up, down, left, and right may occur. Misjudgment, which affects the user experience. Therefore, when using the head mounted display device 100, coordinates of an effective touch point of the touch device 54 according to an actual angle value between a plane in which the headset 53 is located and a plane in which the display device 51 is located are required. The value is calibrated.

For example, after the touch device 54 is deflected by 90 degrees with respect to the position in the standard wearing state, if the user inputs an upward sliding gesture on the touch device 54, the touch device 54 recognizes before the calibration is performed. It is a vector-to-left gesture that needs to be corrected to a vector-up gesture.

Please refer to FIG. 3 , which is a flowchart of an automatic calibration method of a touch device according to a first embodiment of the present application, which is applied to a head mounted display device having the touch device. It should be noted that the automatic calibration method in the embodiment of the present application is not limited to the steps and the sequence in the flowchart shown in FIG. 3. The steps in the illustrated flow diagrams can be added, removed, or changed in order, depending on the requirements.

As shown in FIG. 3, the automatic calibration method includes the following steps:

Step 101: preset an original coordinate system of the touch device.

In the present embodiment, as shown in FIG. 4, after the relative rotation between the display device 51 and the headset 53, the plane where the display device 51 is located and the headset 53 are set. The angle value between the planes is a, as shown in FIG. 5, when the display device 51 is rotated to a position substantially overlapping the headwear 53, the angle value a=0. As shown in FIG. 6, when the display device 51 and the headset 53 are substantially perpendicular to each other, the state can be set to a standard wearing state, and the display device will be in the standard wearing state. The angle value a between the plane in which 51 is located and the plane in which the headgear 53 is located is set to a preset angle value a0.

In the present embodiment, the position of the origin O of the original coordinate system (shown by the dotted line in FIG. 6) is set at the rotation center 513 between the display device 51 and the wearing device 53 in the The projection position of the surface of the touch device 54.

In the present embodiment, the touch device 54 rotates following the rotation of the headset 53, and the ordinate axis of the original coordinate system is set to be parallel to the plane in which the headset 53 is located.

In this embodiment, the preset angle value a0=90 degrees. Thus, the abscissa axis of the original coordinate system is also parallel to the plane in which the display device 51 is located.

It can be understood that, in the standard wearing state, the negative and positive directions of the abscissa of the original coordinate system respectively correspond to the left and right directions of the touch device 54, and the ordinate of the original coordinate system is positive. The negative direction corresponds to the upper and lower directions of the touch device 54, respectively. As such, the touch operations generated on the touch device 54, such as gestures, up, down, left, and the like, are all normal.

It can be understood that in other embodiments, the preset angle value a0 can also be set to other values, such as 95 degrees.

It can be understood that, in other embodiments, the touch device 54 can also rotate according to the rotation of the display device 51, and the abscissa axis of the original coordinate system can also be set to be opposite to the display device 51. The planes are parallel.

Step 102: Predetermine a coordinate conversion formula between an actual coordinate value of the effective touch point of the touch device and the calibration coordinate value in the original coordinate system.

The coordinate conversion formula described above will be described in detail below by taking the touch device 54 following the rotation of the head device 53 as an example.

As shown in FIG. 7 , in the present embodiment, the effective touch area of the touch device 54 is a circle having the origin O as a center and a preset value R as a radius.

Suppose the coordinate value of the origin O is O(x0, y0), assuming that the touch point is point A, and the straight line passing through the touch point A and the origin O of the original coordinate system and the abscissa axis of the original coordinate system The angle between the two is b, and it is assumed that the actual coordinate value of the touch point A detected by the touch device 54 in the original coordinate system is A (x1, y1).

When the angle value a is greater than or less than a0, it may be determined that the position of the headset 53 and the touch device 54 is deflected relative to the position in the standard wearing state, so that the original coordinate system is also The deflection occurs following the touch device 54, so the coordinate values of the touch points generated on the touch device 54 need to be calibrated. The deflection angle of the headset 53 can be determined as (a-a0). Therefore, the position of the touch point A is also centered on the origin of the original coordinate system, and is followed by the headset 53. The angle of (a-a0).

Assume that the equivalent point after the touch point A is calibrated is the calibration point B, and assuming that the coordinate value of the calibration point B in the original coordinate system is B(x, y), the coordinate value B(x, y) That is, the calibration coordinate value of the touch point A. Wherein, an angle between a straight line passing through the touch point A and the origin O of the original coordinate system and a straight line passing through the calibration point B and the origin O of the original coordinate system can be determined as (a-a0) Then, the angle between the straight line passing through the calibration point B and the origin O of the original coordinate system and the abscissa axis of the original coordinate system is (b+a-a0).

The conversion relationship between the coordinate values of the touch point A and the calibration point B can be calculated by using the following trigonometric function formula:

Sin(b)=(y1-y0)/R,

Cos(b)=(x0-x1)/R,

Sin(b+a-a0)=(y-y0)/R,

Cos(b+a-a0)=(x0-x)/R.

After the mathematical relationship is converted, the coordinate conversion formula can be obtained:

x=(x1-x0)*cos(a0-a)-(y-y0)*sin(a0-a)+x0,

y=(x1-x0)*sin(a0-a)+(y-y0)*cos(a0-a)+y0.

It can be understood that in other embodiments, the effective touch area of the touch device 54 may also be other shapes, such as a square, a polygon, or the like. In other embodiments, the touch device 54 can also rotate following the rotation of the display device 51. In the other embodiments, the setting of the coordinate conversion formula is similar to the above example, and details are not repeated herein.

Step 103: Acquire an actual angle value between a plane where the display device is located and a plane where the headset is located when relative rotation occurs between the display device and the headset.

The head-mounted display device 100 further includes a first angle sensor 611 disposed on the headset 53 and a second angle sensor 612 disposed on the display device 51, wherein the head-mounted display device 100 includes a second angle sensor 612 disposed on the display device 51, wherein The first angle sensor 611 is configured to detect an angle value at which the head gear 53 rotates, and the second angle sensor 612 is configured to detect an angle value at which the display device 51 rotates.

In this embodiment, the step of acquiring the actual angle value between the plane where the display device is located and the plane where the headset is located includes:

Acquiring the angle data sensed by the first angle sensor and the second angle sensor respectively;

Calculating an actual angle value between a plane where the display device is located and a plane where the head device is located according to the acquired angle data.

Specifically, the first angle sensor 611 can detect the angle c1 of the wearing device 53 in a specific state, for example, an initial state, and the second angle sensor 612 detects the display by the second angle sensor 612. The angle 51 of the device 51 rotating in the predetermined direction in the predetermined state, and by calculating the sum of the two (ie, a=c1+c2) or the absolute value of the difference between the two (ie, a=| The actual angle value can be obtained by c2-c1|).

It can be understood that if the headset 53 rotates in the same direction as the display device 51, the actual angle value is equal to the absolute value of the difference between the angles of rotation. If the headset 53 rotates in the opposite direction with the display device 51, the actual angle value is equal to the sum of the angles at which the two are rotated. If only one of the headset 53 and the display device 51 is rotated, the actual angle value is equal to the angle value at which the rotating headset 53 or the display device 51 rotates.

The first angle sensor 611 and the second angle sensor 612 may employ a gyro sensor. It can be understood that, in the present embodiment, when the wearing device 53 is overlapped with the display device 51, the actual angle value a=0. In the present embodiment, the state in which the wearing device 53 overlaps with the display device 51 can be set to the initial state, and the first angle sensor 611 and the second angle sensor 612 are in the The status values in the initial state are consistent.

Step 104: Acquire real coordinate data of the touch point corresponding to the touch operation in the original coordinate system when the actual angle value is not equal to the preset angle value and a touch operation is detected.

As described above, the preset angle value is an angle value between a plane in which the display device 51 is located and a plane in which the head gear 53 is located in the standard wearing state.

Step 105: Calculate according to the coordinate conversion formula, the actual angle value, the preset angle value, and the actual coordinate data. The calibration coordinate data of the touch point corresponding to the touch operation in the original coordinate system.

It can be understood that the touch operation includes a single touch operation, and the actual coordinate data and the calibration coordinate data each include a coordinate value.

Optionally, the touch operation may also include a multi-touch operation, and the actual coordinate data and the calibration coordinate data each include a set of coordinate values.

Step 106: Generate a touch instruction according to the calibration coordinate data to trigger a corresponding touch control operation.

For example, when the touch operation is a click, a touch instruction for controlling playing or pausing the currently played audio and video file may be generated. Alternatively, when the touch action is a double tap, a touch command for controlling the call menu may be generated. Alternatively, when the touch operation is a sliding touch, a touch instruction for controlling the adjustment of the playback volume may be generated. Alternatively, when the touch operation is a two-finger open or close operation, a touch instruction or the like for enlarging or reducing the display interface displayed by the display device may be generated. It is to be understood that the related content of the touch operation herein is merely illustrative and is not intended to limit the scope of the application.

The automatic calibration method of the touch device of the present application can automatically convert the actual coordinate value of the touched point into a calibration coordinate value when the position of the touch device deviates from the corresponding position in the standard wearing state, thereby accurately recognizing the touch operation, effectively avoiding The actual touch operation is inconsistent with the touch operation desired by the user, and the user has a better use experience.

Please refer to FIG. 8 , which is a flowchart of an automatic calibration method of a touch device according to a second embodiment of the present application. The main difference between the second embodiment and the first embodiment is that the second embodiment includes setting the calibration coordinates of the touch device according to the difference between the actual angle value and the preset angle value. And performing coordinate transformation on coordinate values of respective effective touch points in the original coordinate system to obtain coordinate values of the respective effective touch points in the calibration coordinate system. It should be noted that, within the scope of the spirit or the basic features of the present application, the specific solutions applicable to the first embodiment may also be correspondingly applied to the second embodiment, in order to save space and avoid repetition, here I won't go into details.

As shown in FIG. 8, the automatic calibration method includes the following steps:

Step 201: preset an original coordinate system of the touch device (as indicated by a dotted line in FIG. 9).

Step 202: Predetermine a coordinate conversion formula between the actual coordinate value of the effective touch point of the touch device in the original coordinate system and the calibration coordinate value.

As shown in FIG. 9 , in the present embodiment, the effective touch area of the touch device 54 is a circle having the origin O as a center and a preset value R as a radius.

When the angle value a is greater than or less than a0, it may be determined that the position of the headset 53 and the touch device 54 is deflected relative to the position in the standard wearing state, so that the original coordinate system is also Deflection occurs following the touch device 54, so the coordinate system of the touch device 54 needs to be calibrated. Wherein the deflection of the headset 53 The angle can be determined as (a-a0), the original coordinate system is also centered on its origin, and the angle of (a-a0) is deflected following the wearing device 53, and the original coordinate system needs to be centered on its origin. The angle of (a-a0) is deflected in the opposite direction to obtain a calibration coordinate system (shown by the solid line in Fig. 9).

Assuming that the coordinate value of the touch point A in the calibration coordinate system is A'(x, y), the coordinate value A'(x, y) is the calibration coordinate value of the touch point A. Wherein the angle between the abscissa axis of the original coordinate system and the abscissa axis of the calibration coordinate system may be determined as (a-a0), then the touch point A and the origin of the calibration coordinate system The angle between the straight line of O and the abscissa axis of the calibration coordinate system is (b+a-a0).

The coordinate relationship between the coordinate values of the touch point A in the original coordinate system and the coordinate values in the calibration coordinate system can be calculated by using the following trigonometric function formula:

Sin(b)=(y1-y0)/R,

Cos(b)=(x0-x1)/R,

Sin(b+a-a0)=(y-y0)/R,

Cos(b+a-a0)=(x0-x)/R.

In the present embodiment, the coordinate value of the origin of the calibration coordinate system is the same as the coordinate value of the origin of the original coordinate system, and is set to O(x0, y0). It can be understood that, in other embodiments, the coordinate value of the origin of the calibration coordinate system and the coordinate value of the origin of the original coordinate system may also be different.

x=(x1-x0)*cos(a0-a)-(y-y0)*sin(a0-a)+x0,

y=(x1-x0)*sin(a0-a)+(y-y0)*cos(a0-a)+y0.

Step 203: Acquire an actual angle value between a plane where the display device is located and a plane where the headset is located when relative rotation occurs between the display device and the headset.

Step 204: Set the calibration coordinate system of the touch device according to a difference between the actual angle value and the preset angle value, where the actual angle value is not equal to the preset angle value.

As described above, the preset angle value is an angle value between a plane in which the display device is located and a plane in which the headwear device is located in the standard wearing state.

In this embodiment, the step of setting the calibration coordinate system of the touch device according to the difference between the actual angle value and the preset angle value specifically includes:

Calculating a difference between the actual angle value and the preset angle value;

If the difference is greater than zero, that is, the actual angle value is greater than the preset angle value, the original coordinate system is placed along the wearing device near the display centering on the origin of the original coordinate system Rotating the first angle of the device to get the a calibration coordinate system of the touch device, wherein the first angle is equal to the difference;

If the difference is less than zero, that is, the actual angle value is less than the preset angle value, the original coordinate system is moved away from the display along the wearing device centering on the origin of the original coordinate system The direction of the device is rotated a second angle to obtain a calibration coordinate system of the touch device, wherein the second angle is equal to the absolute value of the difference.

Step 205: Perform coordinate conversion on coordinate values of the effective touch points of the touch device in the original coordinate system according to the coordinate conversion formula, the actual angle value, and the preset angle value to obtain the effective touch points. Coordinate values in the calibration coordinate system.

Step 206: Acquire calibration coordinate data of the touch point corresponding to the touch operation in the calibration coordinate system when a touch operation is detected.

Step 207: Generate a touch instruction according to the calibration coordinate data to trigger a corresponding touch control operation.

The automatic calibration method of the touch device of the present application can automatically set the calibration coordinate system of the touch device when the position of the touch device deviates from the corresponding position in the standard wearing state, and the effective touch points of the touch device are original The coordinate values in the coordinate system are converted into calibration coordinate values in the calibration coordinate system, and the calibration coordinate values of the touch points in the calibration coordinate system are directly acquired when the touch operation is generated, so that the touch operation can be accurately recognized. The situation that the actual touch operation is inconsistent with the touch operation desired by the user is effectively avoided, and the user has a better use experience.

Please refer to FIG. 10 , which is a schematic structural diagram of an automatic calibration apparatus 10 of a touch device according to an embodiment of the present application. The automatic calibration apparatus 10 is applied to a head mounted display device having the touch device. The automatic calibration device 10 can include one or more modules that are stored in a memory of the head mounted display device and configured to be comprised by one or more processors (this embodiment is A processor) is executed to complete the application. For example, referring to FIG. 10, the automatic calibration apparatus 10 may include a setting module 111, an angle detecting module 112, a coordinate detecting module 113, a coordinate conversion module 114, and a control module 115. The module referred to in the embodiment of the present application may be a program segment that completes a specific function, and is more suitable than the program to describe the execution process of the software in the processor. It can be understood that, corresponding to each of the above-described automatic calibration methods, the automatic calibration apparatus 10 may include some or all of the functional modules shown in FIG. 10, and the functions of each module will be specifically described below.

In this embodiment, the setting module 111 is configured to preset an original coordinate system of the touch device 54 and preset an actual coordinate value and calibration of an effective touch point of the touch device 54 in the original coordinate system. The coordinate conversion formula between coordinate values.

For a detailed description of the setting of the original coordinate system and the coordinate conversion formula, please refer to the related detailed description above. To save space and avoid duplication, it will not be repeated here.

The angle detecting module 112 is configured to acquire a plane between the plane where the display device 51 is located and the plane where the head device 53 is located when the relative rotation between the display device 51 and the headset 53 occurs. Actual angle value.

Specifically, as described above, the head mounted display device 100 further includes a first angle sensor 611 disposed on the headset 53 and a second angle sensor 612 disposed on the display device 51. The first angle sensor 611 is configured to detect an angle value at which the headset device 53 rotates, and the second angle sensor 612 is configured to detect The angle value at which the display device 51 rotates.

The angle detecting module 112 is configured to respectively acquire angle data sensed by the first angle sensor 611 and the second angle sensor 612, and calculate a plane where the display device 51 is located according to the acquired angle data. The actual angular value between the planes in which the headgear 53 is located.

For a detailed description of the calculation of the actual angle value, please refer to the related detailed description above. To save space and avoid duplication, no further details are provided here.

In an embodiment, the coordinate detecting module 113 is configured to acquire a touch point corresponding to the touch operation in the original when the actual angle value is not equal to the preset angle value and a touch operation is detected. Actual coordinate data in the coordinate system.

The coordinate conversion module 114 is configured to calculate calibration coordinate data of the touch point corresponding to the touch operation in the original coordinate system according to the coordinate conversion formula, the actual angle value, the preset angle value, and the actual coordinate data.

The control module 115 is configured to generate a touch instruction according to the calibration coordinate data to trigger a corresponding touch control operation.

For example, when the touch operation is a click, a touch instruction for controlling playing or pausing the currently played audio and video file may be generated. Alternatively, when the touch action is a double tap, a touch command for controlling the call menu may be generated. Alternatively, when the touch operation is a sliding touch, a touch instruction for controlling the adjustment of the playback volume may be generated. Alternatively, when the touch operation is a two-finger open or close operation, a touch instruction or the like for enlarging or reducing the display interface displayed by the display device 51 may be generated. It is to be understood that the related content of the touch operation herein is merely illustrative and is not intended to limit the scope of the application.

The automatic calibration device of the touch device 54 provided by the one embodiment can automatically convert the actual coordinate value of the touched point into a calibration coordinate value when the position of the touch device 54 deviates from the corresponding position in the standard wearing state, thereby being able to accurately Recognizing the touch operation effectively avoids the situation where the actual touch operation is inconsistent with the touch operation desired by the user, and enables the user to have a better use experience.

In another embodiment, the setting module 111 is further configured to: according to the difference between the actual angle value and the preset angle value, the actual angle value is not equal to the preset angle value. A calibration coordinate system of the touch device 54.

In the other embodiment, the position of the origin of the calibration coordinate system is the same as the position of the origin of the original coordinate system.

In the other embodiment, the angle detecting module 112 is further configured to calculate the actual angle value and the preset angle. The difference in degrees.

The setting module 111 is specifically configured to: when the difference is greater than zero, that is, the actual angle value is greater than the preset angle value, centering on an origin of the original coordinate system, and the original coordinate system is along the The headset 53 is rotated a first angle in the direction of the display device 51 to obtain a calibration coordinate system of the touch device 54, wherein the first angle is equal to the difference.

The setting module 111 is further configured to: when the difference is less than zero, that is, when the actual angle value is less than the preset angle value, the original coordinate system is centered on an origin of the original coordinate system The headset 53 is rotated a second angle away from the direction of the display device 51 to obtain a calibration coordinate system of the touch device 54, wherein the second angle is equal to the absolute value of the difference.

The coordinate conversion module 114 is configured to perform coordinate conversion on coordinate values of the effective touch points of the touch device 54 in the original coordinate system according to the coordinate conversion formula, the actual angle value, and the preset angle value to obtain Coordinate values of the respective effective touch points in the calibration coordinate system.

The coordinate detecting module 113 is configured to acquire calibration coordinate data of the touch point corresponding to the touch operation in the calibration coordinate system when a touch operation is detected.

The automatic calibration method of the touch device provided by the other embodiment can automatically set the calibration coordinate system of the touch device when the position of the touch device deviates from the corresponding position in the standard wearing state, and each of the touch devices The coordinate value of the effective touch point in the original coordinate system is converted into the calibration coordinate value in the calibration coordinate system, and the calibration coordinate value of the touch point in the calibration coordinate system is directly acquired when the touch operation is generated, thereby being accurate The touch operation is recognized to effectively avoid the situation that the actual touch operation is inconsistent with the touch operation desired by the user, and the user has a better use experience.

The embodiment of the present application further provides a head mounted display device, including a memory, a processor, and a computer program stored on the memory and operable on the processor, where the processor executes the program to implement the foregoing embodiment. The steps of the automatic calibration method of the touch device.

FIG. 11 is a schematic structural diagram of a head mounted display device 100 according to a first embodiment of the present application. As shown in FIG. 11, the head mounted display device 100 includes at least a processor 20, a memory 30, a computer program 40 (eg, a photographing program) stored in the memory 30 and operable on the processor 20, The display device 51, the earphone device 52, the head device 53, and the touch device 54 are provided.

The head mounted display device 100 may be a head mounted video player, a game device, a navigation device, or the like. For a detailed description of the display device 51, the earphone device 52, the headset 53 and the touch device 54, please refer to the related detailed description above, and for the sake of saving space and avoiding repetition, no further description is provided here.

It can be understood by those skilled in the art that the schematic diagram 11 is only an example of the head mounted display device 100 used in the present application for implementing the automatic calibration method of the touch device 54 and does not constitute a limitation on the head mounted display device 100. More or fewer components may be included, or some components may be combined, or different components, such as the head mounted display device 100. Input and output devices, network access devices, wireless transmission devices, and the like can also be included.

When the processor 20 executes the computer program 40, the steps in the above embodiments of the various automatic calibration methods are implemented, such as steps 101-106 shown in FIG. 3 or steps 201-207 shown in FIG. Alternatively, when the processor 20 executes the computer program 40, the functions of the modules/units, such as the modules 111-115, in the embodiment of the automatic calibration device 10 described above are implemented.

Illustratively, the computer program 40 can be partitioned into one or more modules/units that are stored in the memory 30 and executed by the processor 20 to complete This application. The one or more modules/units may be a series of computer program 40 instruction segments capable of performing a particular function for describing the execution of the computer program 40 in the head mounted display device 100. For example, the computer program 40 can be divided into the setting module 111, the angle detecting module 112, the coordinate detecting module 113, the coordinate conversion module 114, and the control module 115 in FIG. 10, and the specific functions of the modules 111-115 are as described above. For details, in order to save space and avoid duplication, we will not repeat them here.

The processor 20 may be a central processing unit (CPU), or may be other general-purpose processors, a digital signal processor (DSP), an application specific integrated circuit (ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, etc. The general purpose processor may be a microprocessor or the processor may be any conventional processor or the like, and the processor 20 is a control center of the head mounted display device 100, and the entire automatic calibration is connected by using various interfaces and lines. Device 10 / various portions of head mounted display device 100.

The memory 30 can be used to store the computer program 40 and/or modules/units by running or executing computer programs 40 and/or modules/units stored in the memory 30, and for invoking storage The data within the memory 30 enables various functions of the auto-calibration device 10/head-mounted display device 100. The memory 30 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function (for example, a sound playing function, an image playing function, etc.), and the like; the storage data area may be Data created according to the use of the head mounted display device 100 (for example, audio data, data set and acquired by applying the above-described automatic calibration method, and the like) are stored. In addition, the memory 30 may include a high-speed random access memory, and may also include a non-volatile memory such as a hard disk, a memory, a plug-in hard disk, a smart memory card (SMC), and a secure digital (SD). Card, flash card, at least one disk storage device, flash device, or other volatile solid state storage device.

The present application also provides a computer readable storage medium having stored thereon a computer program that, when executed by a processor, implements the steps of the automatic calibration method described in the above embodiments.

The automatic calibration device 10/head mounted display device 100/computer device integrated module/unit of the present application can be stored in a computer readable if it is implemented in the form of a software functional unit and sold or used as a standalone product. In the storage medium. Based on such understanding, the present application implements all or part of the processes in the foregoing embodiments, and may also be completed by a computer program to instruct related hardware. The computer program may be stored in a computer readable storage medium. The steps of the various method embodiments described above may be implemented when the program is executed by the processor. Wherein the computer program includes The computer program code may be in the form of source code, an object code form, an executable file, or some intermediate form. The computer readable medium may include any entity or device capable of carrying the computer program code, a recording medium, a USB flash drive, a removable hard disk, a magnetic disk, an optical disk, a computer memory, a read-only memory (ROM). , random access memory (RAM, Random Access Memory), electrical carrier signals, telecommunications signals, and software distribution media. It should be noted that the content contained in the computer readable medium may be appropriately increased or decreased according to the requirements of legislation and patent practice in a jurisdiction, for example, in some jurisdictions, according to legislation and patent practice, computer readable media Does not include electrical carrier signals and telecommunication signals.

In the several specific embodiments provided by the present application, it should be understood that the disclosed automatic calibration method and apparatus may be implemented in other manners. For example, the above-described automatic calibration device implementation is merely illustrative. For example, the division of the module is only a logical function division, and the actual implementation may have another division manner.

In addition, each functional module in each embodiment of the present application may be integrated in the same processing module, or each module may exist physically separately, or two or more modules may be integrated in the same module. The above integrated modules can be implemented in the form of hardware or in the form of hardware plus software function modules.

It is obvious to those skilled in the art that the present application is not limited to the details of the above-described exemplary embodiments, and the present invention can be implemented in other specific forms without departing from the spirit or essential characteristics of the present application. Therefore, the present embodiments are to be considered as illustrative and not restrictive, and the scope of the invention is defined by the appended claims instead All changes in the meaning and scope of equivalent elements are included in this application. Any reference signs in the claims should not be construed as limiting the claim. In addition, it is to be understood that the word "comprising" does not exclude other elements or steps. A plurality of units or devices recited in the device claims may also be implemented by the same unit or device in software or hardware.

It should be noted that the above embodiments are only used to explain the technical solutions of the present application, and are not limited thereto. Although the present application is described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technology of the present application can be applied. Modifications or equivalents of the embodiments are not to be construed as a departure from the spirit and scope of the invention.

Claims

An automatic calibration method for a touch device is applied to a head mounted display device having the touch device, the head mounted display device further comprising a display device and a head device, wherein the automatic calibration method comprises :

Presetting the original coordinate system of the touch device;

Presetting a coordinate conversion formula between the actual coordinate value of the effective touch point of the touch device in the original coordinate system and the calibration coordinate value;

Obtaining an actual angle value between a plane in which the display device is located and a plane in which the head device is located when relative rotation occurs between the display device and the headwear device;

Obtaining actual coordinate data of the touch point corresponding to the touch operation in the original coordinate system when the actual angle value is not equal to the preset angle value and the touch operation is detected;

Calculating calibration coordinate data of the touch point corresponding to the touch operation in the original coordinate system according to the coordinate conversion formula, the actual angle value, the preset angle value, and the actual coordinate data;

A touch command is generated according to the calibration coordinate data to trigger a corresponding touch control operation.
The automatic calibration method according to claim 1, wherein the preset angle value is an angle value between a plane in which the display device is located and a plane in which the headwear device is located in a standard wearing state.
The automatic calibration method according to claim 2, wherein the preset angle value is 90 degrees.
The automatic calibration method according to any one of claims 1 to 3, wherein a position of an origin of the original coordinate system is set at a center of rotation between the display device and the headwear at the touch The projected position of the surface of the device.
The automatic calibration method according to claim 4, wherein the touch device rotates following the rotation of the headset, and the ordinate axis of the original coordinate system is set to be the same as the headset The plane is parallel.
The automatic calibration method according to claim 1, wherein the head mounted display device further comprises a first angle sensor disposed on the headset, and a second angle disposed on the display device a sensor; the step of obtaining an actual angle value between a plane in which the display device is located and a plane in which the headset is located includes:

Acquiring the angle data sensed by the first angle sensor and the second angle sensor respectively;

Calculating an actual angle value between a plane where the display device is located and a plane where the head device is located according to the acquired angle data.
An automatic calibration method for a touch device is applied to a head mounted display device having the touch device, the head mounted display device further comprising a display device and a head device, wherein the automatic calibration method comprises :

Presetting the original coordinate system of the touch device;

Presetting a coordinate conversion formula between the actual coordinate value of the effective touch point of the touch device in the original coordinate system and the calibration coordinate value;

Obtaining an actual angle value between a plane in which the display device is located and a plane in which the head device is located when relative rotation occurs between the display device and the headwear device;

When the actual angle value is not equal to the preset angle value, setting a calibration coordinate system of the touch device according to a difference between the actual angle value and the preset angle value;

Performing coordinate conversion on coordinate values of the effective touch points of the touch device in the original coordinate system according to the coordinate conversion formula, the actual angle value, and the preset angle value, to obtain the respective effective touch points in the Calibrate the coordinate values in the coordinate system;

Obtaining calibration coordinate data of the touch point corresponding to the touch operation in the calibration coordinate system when a touch operation is detected;

A touch command is generated according to the calibration coordinate data to trigger a corresponding touch control operation.
The automatic calibration method according to claim 7, wherein the preset angle value is an angle value between a plane in which the display device is located and a plane in which the headwear device is located in a standard wearing state.
The automatic calibration method according to claim 8, wherein the preset angle value is 90 degrees.
The automatic calibration method according to any one of claims 7 to 9, wherein a position of an origin of the original coordinate system is set at a center of rotation between the display device and the headwear at the touch The projected position of the surface of the device.
The automatic calibration method according to claim 10, wherein the touch device rotates following the rotation of the headset, and the ordinate axis of the original coordinate system is set to be the same as the headset The plane is parallel.
The automatic calibration method according to claim 11, wherein the position of the origin of the calibration coordinate system is the same as the position of the origin of the original coordinate system, according to the actual angle value and the preset angle value. The difference between the setting of the calibration coordinate system of the touch device includes:

Calculating a difference between the actual angle value and the preset angle value;

If the difference is greater than zero, the original coordinate system is rotated at a first angle along a direction of the wearing device near the display device, with the origin of the original coordinate system as a center, to obtain the touch device. a calibration coordinate system, wherein the first angle is equal to the difference;

If the difference is less than zero, the original coordinate system is rotated at a second angle along a direction away from the display device by the origin of the original coordinate system to obtain the touch device. a calibration coordinate system, wherein the second angle is equal to an absolute value of the difference.
The automatic calibration method according to claim 7, wherein the head mounted display device further comprises a first angle sensor disposed on the headset, and a second angle disposed on the display device a sensor; the step of obtaining an actual angle value between a plane in which the display device is located and a plane in which the headset is located includes:

Acquiring the angle data sensed by the first angle sensor and the second angle sensor respectively;

Calculating an actual angle value between a plane where the display device is located and a plane where the head device is located according to the acquired angle data.
A head mounted display device, characterized in that the head mounted display device comprises a processor for implementing a stored computer program in a memory, as claimed in any one of claims 1-13 The steps of the automatic calibration method of the touch device.
A computer readable storage medium having stored thereon computer instructions, wherein the step of implementing the automatic calibration method of the touch device of any one of claims 1-13 when the computer instructions are executed by the processor .