WO2022142192A1

WO2022142192A1 - Earphone positioning method, terminal device, and storage medium

Info

Publication number: WO2022142192A1
Application number: PCT/CN2021/102017
Authority: WO
Inventors: 王海勇
Original assignee: 歌尔股份有限公司
Priority date: 2020-12-28
Filing date: 2021-06-24
Publication date: 2022-07-07
Also published as: CN112733840A

Abstract

An earphone positioning method, a terminal device, and a computer-readable storage medium. The method comprises the following steps: obtaining image data acquired by an image acquisition device (S10); determining, according to the image data, a positioning mark feature corresponding to the image data (S20); and determining a relative orientation between an earphone and the image acquisition device according to the positioning mark feature (S30). The method achieves the effect of simplifying use steps of the earphone.

Description

Headphone positioning method, terminal device and storage medium

This application claims the priority of the Chinese patent application filed on December 28, 2020, with the application number 202011595585.8 and the application title is "Headphone Positioning Method, Terminal Equipment and Storage Medium", the entire contents of which are incorporated herein by reference middle.

technical field

The present application relates to the field of virtual reality technology, and in particular, to a headset positioning method, a terminal device, and a computer-readable storage medium.

Background technique

With the development of technology, users' pursuit of audio-visual immersion has intensified. Immersive 3D (dimension, three-dimensional) sound effects are becoming more and more popular. In the related art, the user's rotation angle is generally located by a built-in 6-axis sensor in the headset. Thus, according to the detection data of the Sensor, the change of the orientation of the user is determined. Therefore, in the process of using the headset, the user needs to calibrate the reference direction in time before and during use. This has the disadvantage of cumbersome steps to use the headset.

The above content is only used to assist the understanding of the technical solutions of the present application, and does not mean that the above content is the prior art.

SUMMARY OF THE INVENTION

The main purpose of the present application is to provide an earphone positioning method, a terminal device and a computer-readable storage medium, so as to achieve the effect of simplifying the steps of using the earphone.

In order to achieve the above object, the present application provides an earphone positioning method, the earphone includes a left earpiece and a right earpiece, and positioning marks are provided on the first shell of the left earpiece and the second shell of the right earpiece, wherein, The positioning marks corresponding to the first shell and the second shell are different, and the headset positioning method includes the following steps:

acquiring image data collected by the image acquisition device;

Determine the positioning mark feature corresponding to the image data according to the image data;

The relative orientation between the earphone and the image acquisition device is determined according to the feature of the positioning mark.

Optionally, the positioning marks are marked points regularly arranged on the first shell and the second shell, and the positioning mark features include the number of distribution areas of the marking points in the image data. , the step of determining the relative orientation between the earphone and the image acquisition device according to the positioning mark feature includes:

The relative orientation between the headset and the image capture device is determined based on the number of distribution areas.

Optionally, the positioning marker feature further includes the number of the marker points in the distribution area, and the step of determining the relative orientation between the headset and the image capture device based on the number of the distribution area include:

When there is only one distribution area in the image data, the relative orientation between the earphone and the image acquisition device is determined according to the number of the marked points in the distribution area.

Optionally, the positioning marker feature further includes the number of the marker points in each of the distribution areas and/or the curve profile corresponding to the curve where the marker points are located, and the determination of the marker point based on the number of the distribution areas. The step of the relative orientation between the headset and the image acquisition device includes:

When there are two distribution areas in the image data, the relative relationship between the earphone and the image acquisition device is determined according to the number and/or the curve outline of the marker points corresponding to each distribution area position.

Optionally, the step of determining the relative orientation between the earphone and the image capture device according to the positioning mark feature includes:

querying the pre-stored positioning mark features matching the positioning mark features;

The relative orientation between the earphone and the image acquisition device is determined according to the orientation information associated with the pre-stored positioning mark feature.

Optionally, after the step of determining the relative orientation between the earphone and the image acquisition device according to the positioning mark feature, the method further includes:

storing the relative orientation in association with the acquisition time point of the image data;

The headset positioning method further includes:

When the rotation angle detection instruction is received, the rotation angle is determined according to the relative orientation stored in association with the acquisition time point.

Optionally, when the rotation angle detection instruction is received, the step of determining the rotation angle according to the relative orientation saved in association with the collection time point includes:

determining a first time point and a second time point according to the rotation angle detection instruction;

obtaining a first relative orientation associated with the first time point and a second relative orientation associated with the second time point;

The rotation angle of the earphone is determined according to the first relative orientation and the second relative orientation.

Optionally, after the step of determining the rotation angle of the earphone according to the first relative orientation and the second relative orientation, the method further includes:

The output signal of the earphone is adjusted according to the rotation angle.

In addition, in order to achieve the above purpose, the present application also provides a terminal device, the terminal device includes a memory, a processor, and an earphone location program stored in the memory and running on the processor, the earphone location program When the program is executed by the processor, the steps of the earphone positioning method described above are implemented.

In addition, in order to achieve the above purpose, the present application also provides a computer-readable storage medium on which an earphone positioning program is stored, and when the earphone positioning program is executed by a processor, the above-mentioned earphone positioning is realized steps of the method.

An earphone positioning method, a terminal device, and a computer-readable storage medium proposed in an embodiment of the present application first acquire image data collected by an image acquisition device, then determine a positioning marker feature corresponding to the image data according to the image data, and then determine the positioning mark feature corresponding to the image data according to the image data. The location marker feature determines the relative orientation between the headset and the image capture device. Since the orientation of the headset can be determined directly according to the characteristics of the positioning marks in the captured image data, there is no need to perform reference orientation correction, and the effect of simplifying the use of the headset is achieved.

Description of drawings

FIG. 1 is a schematic diagram of a terminal structure of a hardware operating environment involved in a solution according to an embodiment of the present application;

FIG. 2 is a schematic flowchart of an embodiment of an earphone positioning method according to the present application;

FIG. 3 is a schematic structural diagram of an earphone according to an embodiment of the application;

FIG. 4 is a schematic diagram of the positions of an earphone and an image acquisition device involved in an embodiment of the present application;

FIG. 5 is a schematic diagram of the relative positions of the earphones involved in the embodiment of the application;

FIG. 6 is a schematic flowchart of another embodiment of the earphone positioning method of the present application.

The realization, functional characteristics and advantages of the purpose of the present application will be further described with reference to the accompanying drawings in conjunction with the embodiments.

Detailed ways

It should be understood that the specific embodiments described herein are only used to explain the present application, but not to limit the present application.

In order to solve the above defects, an embodiment of the present application proposes an earphone positioning method, and the main solution includes the following steps:

acquiring image data collected by the image acquisition device;

Since the orientation of the earphone can be determined directly according to the characteristics of the positioning marks in the captured image data, there is no need to perform reference orientation correction, and the effect of simplifying the steps of using the earphone is achieved.

As shown in FIG. 1 , FIG. 1 is a schematic structural diagram of a terminal of a hardware operating environment involved in the solution of the embodiment of the present application.

As shown in FIG. 1 , the terminal may include: a processor 1001 , such as a CPU, a network interface 1004 , a user interface 1003 , a memory 1005 , and a communication bus 1002 . Among them, the communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), a mouse, etc., and the optional user interface 1003 may also include a standard wired interface and a wireless interface. Optionally, the network interface 1004 may include a standard wired interface and a wireless interface (eg, a WI-FI interface). The memory 1005 may be high-speed RAM memory, or may be non-volatile memory, such as disk memory. Optionally, the memory 1005 may also be a storage device independent of the aforementioned processor 1001 .

Those skilled in the art can understand that the terminal structure shown in FIG. 1 does not constitute a limitation on the terminal, and may include more or less components than the one shown, or combine some components, or arrange different components.

As shown in FIG. 1, the memory 1005, which is a computer storage medium, may include an operating system, a network communication module, a user interface module, and an earphone positioning program.

In the terminal shown in FIG. 1, the network interface 1004 is mainly used to connect to the background server and perform data communication with the background server; the processor 1001 can be used to call the earphone positioning program stored in the memory 1005, and perform the following operations:

Since the orientation of the headset can be determined directly according to the characteristics of the positioning marks in the captured image data, there is no need to perform reference orientation correction, and the effect of simplifying the use of the headset is achieved.

Further, the processor 1001 can call the earphone positioning program stored in the memory 1005, and also perform the following operations:

The headset positioning method further includes:

The output signal of the earphone is adjusted according to the rotation angle.

Referring to FIG. 2, in an embodiment of the headset positioning method of the present application, the headset positioning method includes the following steps:

Step S10, acquiring image data collected by the image collection device;

Step S20, according to the image data, determine the positioning mark feature corresponding to the image data;

Step S30: Determine the relative orientation between the earphone and the image capture device according to the feature of the positioning mark.

In order to solve the above-mentioned defects, this embodiment proposes an earphone and a method for locating an earphone, aiming to solve the defect of the related art that the steps of using the earphone are cumbersome based on the earphone and the method for locating the earphone provided in this embodiment.

In this embodiment, the earphone includes a left earpiece and a right earpiece, and positioning marks are provided on the first casing of the left earpiece and the second casing of the right earpiece, wherein the first casing and the right earpiece are provided with positioning marks. The positioning marks corresponding to the second housing are different, so that the left earpiece and the right earpiece can be distinguished by the positioning marks.

Further, referring to FIG. 4 , in this embodiment, in order to realize the earphone positioning method, an image acquisition device with a fixed position is further provided. So that the image data including the earphone can be collected by the image collection device. Wherein, when the relative positions of the earphone and the image acquisition device are different, the relative positional relationship between the earphone and the image acquisition device can be determined according to the feature of the positioning mark in the image data.

In an optional embodiment, the positioning marks are marked points regularly arranged on the first casing and the second casing.

Referring to FIG. 3 , in this embodiment, the earphone includes a first casing 10 and a second casing 20 . On the non-user contact surface of the first housing 20, identification points arranged in a circle are arranged. The non-user contact surface of the second casing is also provided with identification points arranged in a circle. In order to make it possible to distinguish the first housing 10 and the second housing 20, the identification points on the first housing 10 and the second housing 20 may be provided in different colors and/or different numbers. For example, 12 identification points may be provided on the first housing 10 and 6 identification points may be provided on the second housing 20 .

It should be noted that the arrangement of the identification points may also be set to other graphics. For example, it can be set as an ellipse or a rectangle. Of course, in some other implementations, the positioning mark may also be set as a ring light strip or other methods. Here, no more enumeration.

Exemplarily, an infrared LED light may be provided at a position corresponding to each of the marking points. Because of the infrared LED, it is only necessary to use a light-transmitting material on the periphery of the earphone to make a circle of windows, which has no effect on the appearance. The left ear shell has 12 LEDs, and the right ear shell has 6 LEDs. The left and right ears are distinguished by setting different numbers of LEDs in the first shell and the second shell.

It can be understood that the determination of the orientation of the headset generally only needs to determine the orientation of the headset when the user wears the headset. Therefore, the function of the positioning mark will be explained below with reference to the scenario where the user wears the earphone.

Referring to FIG. 5 , when the user wears the earphone, the left and right earpieces correspond to the left and right ears of the user, respectively. When the user faces the image capture device, that is, the relative position between the headset and the image capture device is the position A shown in FIG. 5 , the image capture device can capture the first and second housings, and the positioning marks visible on the front . When in position A, the camera will capture 7 LEDs on the first housing and 4 LEDs on the second housing. The user turns 90 degrees clockwise and is positioned at position B. At position B, 12 perfect circular LEDs on the first casing will be photographed (only the marked points on the first casing can be photographed at this time), and the user is moving from position A. In the process of moving to B, the image data will gradually increase from 7 to 12, and the shape will change from an arc to a circle. The second shell will gradually disappear from 4. When the back is facing the image acquisition device, it is the C position, and the front position is turned 90 degrees to the left to define the D position. When the user rotates from the B position to the A position, the image data shows that the first shell is gradually formed by 12 perfect circles. It becomes 7 arc-shaped marking points, and the right ear is made from nothing, and 4 arcs appear. From position C to position D, the left ear gradually disappears from 7 arcs, and the right ear gradually appears 6 perfect circles.

It can be seen that, when the image acquisition device is fixed, if the earphone is rotated, the characteristics of the positioning marks captured in the image data collected by the image acquisition device will change accordingly. Therefore, based on this principle, this embodiment proposes an earphone positioning method.

Specifically, the executive body of the earphone positioning method may be an earphone or other data processing terminal.

Exemplarily, in an application scenario, the user receives VR game sound effects through a headset. In order to achieve the effect of 3D sound effect, the audio output device needs to adjust the output audio in real time according to the position of the earphone. Therefore, the audio output device can be used as the execution subject of the earphone positioning method. In another application scenario, in other VR ecological environments, an audio device or a headset may be directly used as an execution subject of the headset positioning method. Thus, the audio signal with 3D sound effect can be output through the earphone.

Further, in this embodiment, the image data collected by the image acquisition device can be acquired first, and then the positioning mark feature corresponding to the image data can be determined according to the image data, and then the earphone and the device can be determined according to the positioning mark feature. The relative orientation between the image acquisition devices. Wherein, when the relative orientation between the earphone and the image acquisition device is determined according to the positioning mark feature, the positioning mark feature corresponding to each relative orientation is stored in the storage medium, that is, the pre-stored positioning mark and the Relative orientation relationship. Therefore, when positioning the headset, the pre-stored positioning mark feature matching the positioning mark feature can be queried first, and then the position information between the headset and the image acquisition device can be determined according to the orientation information associated with the pre-stored positioning mark feature. relative orientation.

Wherein, when the positioning marks are marked points regularly arranged on the first shell and the second shell, the positioning mark features include the number of distribution areas of the marking points in the image data .

Exemplarily, referring to 5, when the relative positions are the B position and the D position, there is only one distribution area in the image data. Therefore, the relative orientation between the earphone and the image acquisition device can be determined according to the number of the marked points in the distribution area. Wherein, the number of marking points on the first shell and the second shell is different.

The positioning mark feature also includes the number of the mark points in each of the distribution areas and/or the curve outline corresponding to the curve where the mark points are located. When there are two distribution areas in the image data, according to The number and/or the curve profile of the marked points corresponding to each of the distribution areas determines the relative orientation between the earphone and the image acquisition device.

Exemplarily, referring to FIG. 5 , when the relative position is at a position other than the B position and the D position, there are two distribution areas in the image data, so it can be determined according to the difference of the marker points in each distribution area. The number and/or profile of the curve determines the relative orientation between the headset and the image capture device.

In the technical solution disclosed in this embodiment, the image data collected by the image acquisition device is first acquired, and then the positioning mark feature corresponding to the image data is determined according to the image data, and then the earphone and the device are determined according to the positioning mark feature. The relative orientation between the image acquisition devices. Since the orientation of the headset can be determined directly according to the characteristics of the positioning marks in the captured image data, no reference orientation correction is required, and the effect of simplifying the use of the headset is achieved.

Referring to FIG. 6, based on the foregoing embodiment, in another embodiment, after step S30, the method further includes:

Step S40: Associate and save the relative orientation with the acquisition time point of the image data.

In this embodiment, a relative orientation can be determined according to the image data of each frame. Therefore, the acquisition time corresponding to the frame of image data can be stored in association with the relative orientation.

Further, when multiple frames of data are continuously acquired, the relative orientation corresponding to each frame of data may be used. Wherein, when a new frame of image data is collected, a rotation angle detection instruction can be triggered. Then, the first time point and the second time point are determined according to the rotation angle detection instruction. Wherein, the acquisition time point of the previous frame of image data of the current frame may be used as the first time point, and the acquisition time point of the current frame may be used as the second time point. The rotation angle of the user in the period from the first time point to the second time point is determined. That is, the first relative orientation associated with the first time point and the second relative party associated with the second time point can be acquired, and then the rotation angle of the earphone is determined according to the first relative orientation and the second relative orientation. Wherein, the first time point and the second time point correspond to the acquisition time points of the image data.

After the rotation angle of the earphone is determined according to the first relative orientation and the second relative orientation, the output signal of the earphone can be adjusted according to the rotation angle.

In addition, an embodiment of the present application also proposes a terminal device, the terminal device includes a memory, a processor, and an earphone location program stored in the memory and executable on the processor, the earphone location program being When executed by the processor, the steps of implementing the earphone positioning method described in the above embodiments are described.

In addition, an embodiment of the present application also proposes a computer-readable storage medium, where an earphone positioning program is stored on the computer-readable storage medium, and when the earphone positioning program is executed by a processor, the earphone positioning described in the above embodiments is implemented steps of the method.

It should be noted that, herein, the terms "comprising", "comprising" or any other variation thereof are intended to encompass non-exclusive inclusion, such that a process, method, article or system comprising a series of elements includes not only those elements, It also includes other elements not expressly listed or inherent to such a process, method, article or system. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in the process, method, article or system that includes the element.

The above-mentioned serial numbers of the embodiments of the present application are only for description, and do not represent the advantages or disadvantages of the embodiments.

From the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus a necessary general hardware platform, and of course hardware can also be used, but in many cases the former is better implementation. Based on this understanding, the technical solutions of the present application can be embodied in the form of software products in essence or the parts that make contributions to the prior art, and the computer software products are stored in a storage medium (such as ROM/RAM) as described above. , magnetic disk, optical disk), including several instructions to make a terminal device execute the method described in each embodiment of the present application.

The above are only the preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made by using the contents of the description and drawings of the present application, or directly or indirectly applied in other related technical fields , are similarly included within the scope of patent protection of this application.

Claims

An earphone positioning method, characterized in that the earphone comprises a left earpiece and a right earpiece, a first shell of the left earpiece and a second shell of the right earpiece are provided with positioning marks, wherein the first The positioning marks corresponding to the shell and the second shell are different, and the headset positioning method includes:

acquiring image data collected by the image acquisition device;

Determine the positioning mark feature corresponding to the image data according to the image data;

The relative orientation between the earphone and the image acquisition device is determined according to the feature of the positioning mark.
The headset positioning method according to claim 1, wherein the positioning marks are marked points regularly arranged on the first shell and the second shell, and the positioning mark features include the image data , the number of distribution areas of the marker points, wherein the distribution area is a concentrated area of the marker points, and the relative orientation between the earphone and the image acquisition device is determined according to the positioning marker feature The steps include:

The relative orientation between the headset and the image capture device is determined based on the number of distribution areas.
The headphone positioning method according to claim 2, wherein the positioning mark feature further comprises the number of the mark points in the distribution area, and the headphone and the headphone are determined based on the number of the distribution area. The steps of describing the relative orientation between the image capturing devices include:

When there is only one distribution area in the image data, the relative orientation between the earphone and the image acquisition device is determined according to the number of the marked points in the distribution area.
The earphone positioning method according to claim 2, wherein the positioning mark feature further comprises the number of the mark points in each of the distribution areas and/or the curve profile corresponding to the curve where the mark points are located, and the The step of determining the relative orientation between the headset and the image acquisition device based on the number of the distribution areas includes:

When there are two distribution areas in the image data, the relative relationship between the earphone and the image acquisition device is determined according to the number and/or the curve outline of the marker points corresponding to each distribution area position.
The headset positioning method according to claim 1, wherein the step of determining the relative orientation between the headset and the image acquisition device according to the positioning mark feature comprises:

querying the pre-stored positioning mark features matching the positioning mark features;

The relative orientation between the earphone and the image acquisition device is determined according to the orientation information associated with the pre-stored positioning mark feature.
The headset positioning method according to claim 1, wherein after the step of determining the relative orientation between the headset and the image acquisition device according to the positioning mark feature, the method further comprises:

storing the relative orientation in association with the acquisition time point of the image data;

The headset positioning method further includes:

When the rotation angle detection instruction is received, the rotation angle is determined according to the relative orientation stored in association with the acquisition time point.
The headset positioning method according to claim 6, wherein when the rotation angle detection instruction is received, the step of determining the rotation angle according to the relative orientation saved in association with the collection time point comprises:

determining a first time point and a second time point according to the rotation angle detection instruction;

obtaining a first relative orientation associated with the first time point and a second relative orientation associated with the second time point;

The rotation angle of the earphone is determined according to the first relative orientation and the second relative orientation.
The headset positioning method according to claim 7, wherein after the step of determining the rotation angle of the headset according to the first relative orientation and the second relative orientation, the method further comprises:

The output signal of the earphone is adjusted according to the rotation angle.
A terminal device, characterized in that the terminal device comprises: a memory, a processor, and an earphone positioning program stored on the memory and running on the processor, the earphone positioning program being executed by the processor The steps of implementing the earphone positioning method according to any one of claims 1 to 8 when executed.
A computer-readable storage medium, characterized in that a headset positioning program is stored on the computer-readable storage medium, and when the headset positioning program is executed by a processor, the method described in any one of claims 1 to 8 is implemented. The steps of the headset positioning method.