CN113079434A - Control method, device, storage medium and system of audio playing equipment - Google Patents

Control method, device, storage medium and system of audio playing equipment Download PDF

Info

Publication number
CN113079434A
CN113079434A CN202110371875.2A CN202110371875A CN113079434A CN 113079434 A CN113079434 A CN 113079434A CN 202110371875 A CN202110371875 A CN 202110371875A CN 113079434 A CN113079434 A CN 113079434A
Authority
CN
China
Prior art keywords
audio playing
playing device
acceleration
ear wearing
sensing data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110371875.2A
Other languages
Chinese (zh)
Inventor
张斌
蒋兆
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jiangsu Zimi Electronic Technology Co Ltd
Original Assignee
Nanjing Ziniu Software Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nanjing Ziniu Software Technology Co ltd filed Critical Nanjing Ziniu Software Technology Co ltd
Priority to CN202110371875.2A priority Critical patent/CN113079434A/en
Publication of CN113079434A publication Critical patent/CN113079434A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones
    • H04R1/10Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1016Earpieces of the intra-aural type
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones
    • H04R1/10Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1041Mechanical or electronic switches, or control elements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2201/00Details of transducers, loudspeakers or microphones covered by H04R1/00 but not provided for in any of its subgroups
    • H04R2201/10Details of earpieces, attachments therefor, earphones or monophonic headphones covered by H04R1/10 but not provided for in any of its subgroups

Abstract

The application discloses a control method, a control device, a storage medium and a control system of audio playing equipment, which relate to the technical field of electronic information. The method comprises the following steps: under the condition that the first audio playing device and the second audio playing device are both in an in-ear wearing state according to the photoelectric sensing data, acquiring acceleration sensing data of the first audio playing device and acceleration sensing data of the second audio playing device; determining whether the in-ear wearing direction of the first audio playing device is consistent with the in-ear wearing direction of the second audio playing device or not according to the acquired acceleration sensing data; and under the condition that the in-ear wearing direction of the first audio playing device is consistent with the in-ear wearing direction of the second audio playing device, controlling the first audio playing device and/or the second audio playing device to be in a normal working state.

Description

Control method, device, storage medium and system of audio playing equipment
Technical Field
The embodiment of the application relates to the technical field of electronic information, in particular to a control method, a control device, a storage medium and a control system of audio playing equipment.
Background
With the rapid popularization of new-generation consumer electronics devices such as smart phones and tablet computers, products such as audio playing devices (e.g., bluetooth headsets) have also been rapidly developed, so that in-ear detection has become a standard function of most audio playing devices. The in-ear detection function can bring good user experience for the user, possesses the audio playback equipment that the in-ear detected the function, and when the user wore audio playback equipment, bluetooth headset normally broadcast the audio frequency, and when the user did not wear audio playback equipment, audio playback equipment stopped playing the audio frequency.
Currently, it is generally detected whether a user wears an audio playing device through an optical sensor or a capacitive sensor. However, the method of detecting the ear-entering by using the optical sensor is susceptible to the influence of the light intensity, and the accuracy of the ear-entering detection is low when the light is dark. When the capacitive sensor is used for in-ear detection, other body parts (such as hands) of a user often touch the sensing area of the capacitive sensor by mistake, so that the accuracy of in-ear detection is influenced. Therefore, the user experience of the current audio playing device with the in-ear detection function is not very good.
Disclosure of Invention
The application provides a control method, a control device, a storage medium and a control system of audio playing equipment, which are used for controlling the working state of the audio playing equipment according to whether the in-ear wearing directions of the two audio playing equipment are consistent or not, so that the accuracy of in-ear detection is improved, and the user experience is improved.
In order to achieve the purpose, the technical scheme is as follows:
in a first aspect, the present application provides a method for controlling an audio playback device, including: under the condition that the first audio playing device and the second audio playing device are both in an in-ear wearing state according to the photoelectric sensing data, acquiring acceleration sensing data of the first audio playing device and acceleration sensing data of the second audio playing device; then, determining whether the in-ear wearing direction of the first audio playing device is consistent with the in-ear wearing direction of the second audio playing device according to the acceleration sensing data of the first audio playing device and the acceleration sensing data of the second audio playing device; and then controlling the first audio playing device and/or the second audio playing device to be in a normal working state under the condition that the in-ear wearing direction of the first audio playing device is determined to be consistent with the in-ear wearing direction of the second audio playing device.
In the technical scheme provided by the application, the first audio playing device and the second audio playing device are determined to be both in the in-ear wearing state according to the photoelectric sensing data, and the two audio playing devices are not directly controlled to be in the normal working state. The in-ear wearing directions of the two audio playing devices are judged to be consistent according to the acceleration sensing data of the two audio playing devices, and the first audio playing device and/or the second audio playing device are controlled to be in a normal working state under the condition that the in-ear wearing directions of the two audio playing devices are consistent. Because the acceleration sensing data is less influenced by environmental factors, the in-ear detection can be more accurately carried out by combining the acceleration sensing data on the basis of the photoelectric sensing data. Therefore, the technical scheme provided by the application can improve the accuracy rate of the in-ear detection of the audio playing equipment, so that the user experience of the audio playing equipment with the in-ear detection function can be improved.
Optionally, in a possible design, the acquiring acceleration sensing data of the first audio playing device and the acceleration sensing data of the second audio playing device may include:
acquiring a first acceleration, a second acceleration and a third acceleration which are acquired by a triaxial acceleration sensor in first audio playing equipment, and acquiring a fourth acceleration, a fifth acceleration and a sixth acceleration which are acquired by a triaxial acceleration sensor in second audio playing equipment;
the first acceleration and the fourth acceleration are accelerations in a first preset direction; the second acceleration and the fifth acceleration are accelerations in a second preset direction; the third acceleration and the sixth acceleration are accelerations in a third preset direction;
the "determining whether the in-ear wearing direction of the first audio playing device is consistent with the in-ear wearing direction of the second audio playing device according to the acceleration sensing data of the first audio playing device and the acceleration sensing data of the second audio playing device" may include:
and determining whether the in-ear wearing direction of the first audio playing device is consistent with the in-ear wearing direction of the second audio playing device according to the first acceleration, the second acceleration, the third acceleration, the fourth acceleration, the fifth acceleration and the sixth acceleration.
Optionally, in another possible design, the "determining whether the in-ear wearing direction of the first audio playing device is consistent with the in-ear wearing direction of the second audio playing device according to the first acceleration, the second acceleration, the third acceleration, the fourth acceleration, the fifth acceleration, and the sixth acceleration" may include:
and under the condition that the difference value of the first acceleration and the fourth acceleration belongs to a first threshold range, the difference value of the second acceleration and the fifth acceleration belongs to a second threshold range, and the difference value of the third acceleration and the sixth acceleration belongs to a third threshold range, determining that the in-ear wearing direction of the first audio playing device is consistent with the in-ear wearing direction of the second audio playing device.
Optionally, in another possible design, the method for controlling an audio playback device provided by the present application may further include:
under the condition that the first audio playing device is determined to be in an in-ear wearing state according to the photoelectric sensing data, controlling the first audio playing device to be in a normal working state; under the condition that the in-ear wearing direction of the first audio playing device is determined to be consistent with the in-ear wearing direction of the second audio playing device, controlling the second audio playing device to be in a normal working state;
or, under the condition that the second audio playing device is determined to be in the in-ear wearing state according to the photoelectric sensing data, controlling the second audio playing device to be in the normal working state; and under the condition that the in-ear wearing direction of the first audio playing device is consistent with the in-ear wearing direction of the second audio playing device, controlling the first audio playing device to be in a normal working state.
Optionally, in another possible design, the method for controlling an audio playback device provided by the present application may further include:
acquiring first photoelectric sensing data acquired by a photoelectric sensor in first audio playing equipment, and determining whether the first audio playing equipment is in an in-ear wearing state or not according to the first photoelectric sensing data;
acquiring second photoelectric sensing data acquired by a photoelectric sensor in second audio playing equipment; and determining whether the second audio playing device is in an in-ear wearing state according to the second photoelectric sensing data.
Alternatively, in another possible design, the "photosensor" may be an optical sensor or a capacitive sensor.
In a second aspect, the present application provides a control device for an audio playing device, including: the device comprises an acquisition module, a control module and a determination module;
the determining module is used for determining whether the first audio playing device and the second audio playing device are in an in-ear wearing state according to the photoelectric sensing data;
the acquisition module is used for acquiring the acceleration sensing data of the first audio playing device and the acceleration sensing data of the second audio playing device under the condition that the determining module determines that the first audio playing device and the second audio playing device are both in the in-ear wearing state;
the determining module is further configured to determine whether the in-ear wearing direction of the first audio playing device is consistent with the in-ear wearing direction of the second audio playing device according to the acceleration sensing data of the first audio playing device and the acceleration sensing data of the second audio playing device, which are acquired by the acquiring module;
and the control module is used for controlling the first audio playing device and/or the second audio playing device to be in a normal working state under the condition that the determining module determines that the in-ear wearing direction of the first audio playing device is consistent with the in-ear wearing direction of the second audio playing device.
Optionally, in a possible design manner, the obtaining module is specifically configured to: acquiring a first acceleration, a second acceleration and a third acceleration which are acquired by a triaxial acceleration sensor in first audio playing equipment, and acquiring a fourth acceleration, a fifth acceleration and a sixth acceleration which are acquired by a triaxial acceleration sensor in second audio playing equipment; the first acceleration and the fourth acceleration are accelerations in a first preset direction; the second acceleration and the fifth acceleration are accelerations in a second preset direction; the third acceleration and the sixth acceleration are accelerations in a third preset direction;
the determination module is specifically configured to: and determining whether the in-ear wearing direction of the first audio playing device is consistent with the in-ear wearing direction of the second audio playing device according to the first acceleration, the second acceleration, the third acceleration, the fourth acceleration, the fifth acceleration and the sixth acceleration.
Optionally, in another possible design manner, the determining module is further specifically configured to:
and under the condition that the difference value of the first acceleration and the fourth acceleration belongs to a first threshold range, the difference value of the second acceleration and the fifth acceleration belongs to a second threshold range, and the difference value of the third acceleration and the sixth acceleration belongs to a third threshold range, determining that the in-ear wearing direction of the first audio playing device is consistent with the in-ear wearing direction of the second audio playing device.
Optionally, in another possible design, the control module is further configured to:
under the condition that the first audio playing device is determined to be in an in-ear wearing state according to the photoelectric sensing data, controlling the first audio playing device to be in a normal working state; under the condition that the in-ear wearing direction of the first audio playing device is determined to be consistent with the in-ear wearing direction of the second audio playing device, controlling the second audio playing device to be in a normal working state;
or, under the condition that the second audio playing device is determined to be in the in-ear wearing state according to the photoelectric sensing data, controlling the second audio playing device to be in the normal working state; and under the condition that the in-ear wearing direction of the first audio playing device is consistent with the in-ear wearing direction of the second audio playing device, controlling the first audio playing device to be in a normal working state.
Optionally, in another possible design manner, the obtaining module is specifically configured to:
acquiring first photoelectric sensing data acquired by a photoelectric sensor in first audio playing equipment and second photoelectric sensing data acquired by a photoelectric sensor in second audio playing equipment;
the determination module is specifically configured to: and determining whether the first audio playing device is in an in-ear wearing state according to the first photoelectric sensing data, and determining whether the second audio playing device is in an in-ear wearing state according to the second photoelectric sensing data.
Alternatively, in another possible embodiment, the optoelectronic sensor is an optical sensor or a capacitive sensor.
In a third aspect, the present application provides a control apparatus for an audio playing device, including a memory, a processor, a bus, and a communication interface; the memory is used for storing computer execution instructions, and the processor is connected with the memory through a bus; when the control means of the audio playback device is operating, the processor executes the computer-executable instructions stored in the memory to cause the control means of the audio playback device to perform the method for controlling the audio playback device as provided in the above first aspect.
Optionally, the control device of the audio playing apparatus may further include a transceiver, and the transceiver is configured to perform the step of transceiving data, signaling or information, for example, acquiring the photoelectric sensing data, under the control of the processor of the control device of the audio playing apparatus.
Further optionally, the control device of the audio playing apparatus may be a user terminal for implementing control of the audio playing apparatus, or may be a part of a device in the user terminal, for example, a chip system in the user terminal. The chip system is used for supporting the control device of the audio playing apparatus to implement the functions referred to in the first aspect, for example, receiving, sending or processing data and/or information referred to in the control method of the audio playing apparatus. The chip system includes a chip and may also include other discrete devices or circuit structures.
In a fourth aspect, the present application provides a computer-readable storage medium, in which instructions are stored, and when the instructions are executed by a computer, the computer is enabled to execute the control method of the audio playing device according to the first aspect.
In a fifth aspect, the present application provides a computer program product comprising computer instructions which, when run on a computer, cause the computer to perform the method of controlling an audio playback device as provided in the first aspect.
In a sixth aspect, the present application provides a control system for an audio playing device, including a first audio playing device, a second audio playing device, and a control apparatus for the audio playing device as provided in the second aspect; the control device of the audio playing device is respectively in communication connection with the first audio playing device and the second audio playing device.
It should be noted that all or part of the computer instructions may be stored on the computer readable storage medium. The computer-readable storage medium may be packaged with a processor of a control device of the audio playing apparatus, or may be packaged separately from the processor of the control device of the audio playing apparatus, which is not limited in this application.
For the description of the second, third, fourth, fifth and sixth aspects in this application, reference may be made to the detailed description of the first aspect; in addition, for the beneficial effects described in the second aspect, the third aspect, the fourth aspect, the fifth aspect and the sixth aspect, reference may be made to the beneficial effect analysis of the first aspect, and details are not repeated here.
In the present application, the names of the control means of the audio playback device described above do not constitute a limitation on the device or the functional module itself, which may appear under other names in an actual implementation. Insofar as the functions of the respective devices or functional modules are similar to those of the present application, they fall within the scope of the claims of the present application and their equivalents.
These and other aspects of the present application will be more readily apparent from the following description.
Drawings
Fig. 1 is a schematic structural diagram of a control system of an audio playback device according to an embodiment of the present disclosure;
fig. 2 is a schematic flowchart of a control method of an audio playing device according to an embodiment of the present disclosure;
fig. 3 is a schematic flowchart of another control method for an audio playback device according to an embodiment of the present disclosure;
fig. 4 is a schematic flowchart of a control method for an audio playing device according to an embodiment of the present application;
fig. 5 is a schematic flowchart of a control method for an audio playing device according to an embodiment of the present application;
fig. 6 is a schematic flowchart of a control method for an audio playing device according to an embodiment of the present application;
fig. 7 is a schematic structural diagram of a control device of an audio playing apparatus according to an embodiment of the present disclosure;
fig. 8 is a schematic structural diagram of another control device of an audio playing apparatus according to an embodiment of the present application.
Detailed Description
The following describes in detail a control method, an apparatus, a storage medium, and a system for an audio playback device according to an embodiment of the present application with reference to the drawings.
The term "and/or" herein is merely an association describing an associated object, meaning that three relationships may exist, e.g., a and/or B, may mean: a exists alone, A and B exist simultaneously, and B exists alone.
The terms "first" and "second" and the like in the description and drawings of the present application are used for distinguishing different objects or for distinguishing different processes for the same object, and are not used for describing a specific order of the objects.
Furthermore, the terms "including" and "having," and any variations thereof, as referred to in the description of the present application, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
It should be noted that in the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described herein as "exemplary" or "e.g.," is not necessarily to be construed as preferred or advantageous over other embodiments or designs. Rather, use of the word "exemplary" or "such as" is intended to present concepts related in a concrete fashion.
In the description of the present application, the meaning of "a plurality" means two or more unless otherwise specified.
With the rapid popularization of new-generation consumer electronics devices such as smart phones and tablet computers, products such as audio playing devices (e.g., bluetooth headsets) have also been rapidly developed, so that in-ear detection has become a standard function of most audio playing devices. The in-ear detection function can bring good user experience for the user, possesses the audio playback equipment that the in-ear detected the function, and when the user wore audio playback equipment, bluetooth headset normally broadcast the audio frequency, and when the user did not wear audio playback equipment, audio playback equipment stopped playing the audio frequency.
Currently, it is generally detected whether a user wears an audio playing device through an optical sensor or a capacitive sensor. However, the method of detecting the ear-entering by using the optical sensor is susceptible to the influence of the light intensity, and the accuracy of the ear-entering detection is low when the light is dark. When the capacitive sensor is used for in-ear detection, other body parts (such as hands) of a user often touch the sensing area of the capacitive sensor by mistake, so that the accuracy of in-ear detection is influenced. Therefore, the user experience of the current audio playing device with the in-ear detection function is not very good.
In view of the above problems in the prior art, embodiments of the present application provide a method, an apparatus, a storage medium, and a system for controlling an audio playback device, which perform in-ear detection by combining acceleration sensing data based on photoelectric sensing data, and since the acceleration sensing data is less affected by environmental factors, the in-ear detection can be performed more accurately. Therefore, the technical scheme provided by the application can improve the accuracy rate of the in-ear detection of the audio playing equipment, so that the user experience of the audio playing equipment with the in-ear detection function can be improved.
The control method of the audio playing device provided by the embodiment of the application can be applied to the control system of the audio playing device shown in fig. 1. Referring to fig. 1, the control system of the audio playing device may include a control apparatus 01 of the audio playing device, a first audio playing device 02 and a second audio playing device 03; the control device 01 of the audio playing device is in communication connection with the first audio playing device 02 and the second audio playing device 03 respectively.
The control device 01 of the audio playing apparatus may be a user terminal. The user terminal may be a mobile phone, a tablet computer, a desktop computer, a laptop computer, a notebook computer, an ultra-mobile personal computer (UMPC), a handheld computer, a netbook, a Personal Digital Assistant (PDA), a wearable electronic device, a virtual reality device, and other different types of terminals.
The control device 01 of the audio playing apparatus is used for controlling the working states of the first audio playing apparatus 02 and the second audio playing apparatus 03.
In a possible implementation manner, the first audio playing device 02 and the second audio playing device 03 may obtain an audio stream from the control apparatus 01 of the audio playing device in a normal operating state, so as to implement playing of an audio.
The following describes a control method of an audio playing device provided in the present application with reference to the control system of the audio playing device shown in fig. 1.
Referring to fig. 2, a method for controlling an audio playback device provided in an embodiment of the present application includes S201 to S204:
s201, the control device of the audio playing device determines whether the first audio playing device and the second audio playing device are in an in-ear wearing state according to the photoelectric sensing data.
In this embodiment of the application, the control device of the audio playing device may perform the in-ear detection preliminarily according to the photoelectric sensing data, so, optionally, in a possible implementation manner, the control device of the audio playing device may obtain the first photoelectric sensing data acquired by the photoelectric sensor in the first audio playing device, and determine whether the first audio playing device is in the in-ear wearing state according to the first photoelectric sensing data. In addition, the control device of the audio playing device can acquire second photoelectric sensing data acquired by a photoelectric sensor in the second audio playing device, and determine whether the second audio playing device is in an in-ear wearing state according to the second photoelectric sensing data.
Alternatively, in one possible implementation, the photosensor may be an optical sensor or a capacitive sensor. Of course, in practical applications, the photoelectric sensor may also be another type of photoelectric sensor, which is not limited in this application.
For example, taking the first audio playing device provided with the capacitance sensor as an example, the control device of the audio playing device may obtain a capacitance value detected by the capacitance sensor, where the capacitance value may change when the first audio playing device is in an in-ear wearing state, and the control device of the audio playing device may determine whether the first audio playing device is in the in-ear wearing state according to the change value of the capacitance value.
S202, under the condition that the first audio playing device and the second audio playing device are both in the in-ear wearing state according to the photoelectric sensing data, the control device of the audio playing device obtains acceleration sensing data of the first audio playing device and acceleration sensing data of the second audio playing device.
The acceleration sensing data is data collected by an acceleration sensor, and optionally, in a possible implementation manner, the acceleration sensor may be a three-axis acceleration sensor. Under the condition that the first audio playing device and the second audio playing device are both in the in-ear wearing state according to the photoelectric sensing data, the control device of the audio playing device can acquire a first acceleration, a second acceleration and a third acceleration which are acquired by a triaxial acceleration sensor in the first audio playing device, and acquire a fourth acceleration, a fifth acceleration and a sixth acceleration which are acquired by a triaxial acceleration sensor in the second audio playing device.
The first acceleration and the fourth acceleration are accelerations in a first preset direction; the second acceleration and the fifth acceleration are accelerations in a second preset direction; the third acceleration and the sixth acceleration are accelerations in a third preset direction.
The first preset direction, the second preset direction and the third preset direction may be three directions determined in advance manually. For example, the three directions may correspond to directions of three axes of a three-axis acceleration sensor. For example, the three-axis acceleration sensor acquires acceleration sensing data in three directions of X, Y, and Z axes, respectively, then the first acceleration and the fourth acceleration may be accelerations in the X axis direction, the second acceleration and the fifth acceleration may be accelerations in the Y axis direction, and the third acceleration and the sixth acceleration may be accelerations in the Z axis direction.
S203, the control device of the audio playing device determines whether the in-ear wearing direction of the first audio playing device is consistent with the in-ear wearing direction of the second audio playing device according to the acceleration sensing data of the first audio playing device and the acceleration sensing data of the second audio playing device.
When the acceleration sensor in the audio playing device is a triaxial acceleration sensor, the control device of the audio playing device may determine whether the in-ear wearing direction of the first audio playing device is consistent with the in-ear wearing direction of the second audio playing device according to the acquired first acceleration, second acceleration, third acceleration, fourth acceleration, fifth acceleration and sixth acceleration.
Optionally, in a possible implementation manner, in a case that a difference between the first acceleration and the fourth acceleration belongs to a first threshold range, a difference between the second acceleration and the fifth acceleration belongs to a second threshold range, and a difference between the third acceleration and the sixth acceleration belongs to a third threshold range, the control device of the audio playing device may determine that the in-ear wearing direction of the first audio playing device is consistent with the in-ear wearing direction of the second audio playing device.
The first threshold range, the second threshold range, and the third threshold range may be threshold ranges determined in advance by human. The threshold ranges of the first threshold range, the second threshold range and the third threshold range may be equal or different. For example, the difference between the first acceleration and the fourth acceleration is calculated as Δ X, the difference between the second acceleration and the fifth acceleration is calculated as Δ Y, and the difference between the third acceleration and the sixth acceleration is calculated as Δ Z. If Δ X is within the first threshold range, Δ Y is within the second threshold range, and Δ Z is within the third threshold range, the control device of the audio playing device may determine that the in-ear wearing direction of the first audio playing device is consistent with the in-ear wearing direction of the second audio playing device.
It is to be understood that the difference values in the embodiments of the present application may be negative values, so negative values may be included in the first threshold range, the second threshold range, and the third threshold range.
S204, under the condition that the in-ear wearing direction of the first audio playing device is determined to be consistent with the in-ear wearing direction of the second audio playing device, the control device of the audio playing device controls the first audio playing device and/or the second audio playing device to be in a normal working state.
As some users may only wear one audio playing device in the process of using the audio playing device, optionally, in the control method of the audio playing device provided in the embodiment of the present application, the control device of the audio playing device may control the first audio playing device to be in the normal working state first when determining that the first audio playing device is in the in-ear wearing state, and then control the second audio playing device to be in the normal working state when determining that the in-ear wearing direction of the first audio playing device is consistent with the in-ear wearing direction of the second audio playing device. Or the control device of the audio playing device controls the second audio playing device to be in a normal working state under the condition that the second audio playing device is determined to be in the in-ear wearing state, and then controls the first audio playing device to be in the normal working state under the condition that the in-ear wearing direction of the first audio playing device is determined to be consistent with the in-ear wearing direction of the second audio playing device.
In the control method of the audio playing device provided by the embodiment of the application, under the condition that the first audio playing device and the second audio playing device are both in the in-ear wearing state according to the photoelectric sensing data, the two audio playing devices are not directly controlled to be in the normal working state. The in-ear wearing directions of the two audio playing devices are judged to be consistent according to the acceleration sensing data of the two audio playing devices, and the first audio playing device and/or the second audio playing device are controlled to be in a normal working state under the condition that the in-ear wearing directions of the two audio playing devices are consistent. Because the acceleration sensing data is less influenced by environmental factors, the in-ear detection can be more accurately carried out by combining the acceleration sensing data on the basis of the photoelectric sensing data. Therefore, the technical scheme provided by the embodiment of the application can improve the accuracy of the in-ear detection of the audio playing device, so that the user experience of the audio playing device with the in-ear detection function can be improved.
In summary, as shown in fig. 3, step S201 in fig. 2 can be replaced with S2011-S2012:
s2011, a control device of the audio playing device acquires first photoelectric sensing data acquired by a photoelectric sensor in the first audio playing device, and determines whether the first audio playing device is in an in-ear wearing state according to the first photoelectric sensing data;
s2012, the control device of the audio playing device obtains second photoelectric sensing data collected by a photoelectric sensor in the second audio playing device, and determines whether the second audio playing device is in an in-ear wearing state according to the second photoelectric sensing data.
Alternatively, as shown in fig. 4, step S202 in fig. 2 may be replaced with step S2021:
s2021, under the condition that the first audio playing device and the second audio playing device are both in the in-ear wearing state according to the photoelectric sensing data, the control device of the audio playing device acquires a first acceleration, a second acceleration and a third acceleration which are acquired by a three-axis acceleration sensor in the first audio playing device, and acquires a fourth acceleration, a fifth acceleration and a sixth acceleration which are acquired by a three-axis acceleration sensor in the second audio playing device.
Correspondingly, as shown in fig. 4, step S203 in fig. 2 may be replaced by S2031:
s2031, the control device of the audio playing apparatus determines whether the wearing direction of the first audio playing apparatus is consistent with the wearing direction of the second audio playing apparatus according to the first acceleration, the second acceleration, the third acceleration, the fourth acceleration, the fifth acceleration, and the sixth acceleration.
Alternatively, as shown in fig. 5, step S2031 in fig. 4 may be replaced with step S2032:
s2032, in a case that a difference between the first acceleration and the fourth acceleration belongs to a first threshold range, a difference between the second acceleration and the fifth acceleration belongs to a second threshold range, and a difference between the third acceleration and the sixth acceleration belongs to a third threshold range, the control device of the audio playing apparatus determines that the in-ear wearing direction of the first audio playing apparatus is consistent with the in-ear wearing direction of the second audio playing apparatus.
Optionally, as shown in fig. 6, an embodiment of the present application further provides a method for controlling an audio playback device, including S601-S604:
s601, the control device of the audio playing device controls the first audio playing device to be in a normal working state under the condition that the first audio playing device is determined to be in an in-ear wearing state according to the photoelectric sensing data.
S602, acquiring acceleration sensing data of the first audio playing device and acceleration sensing data of the second audio playing device by the control device of the audio playing device under the condition that the second audio playing device is in the in-ear wearing state according to the photoelectric sensing data.
S603, the control device of the audio playing device determines whether the in-ear wearing direction of the first audio playing device is consistent with the in-ear wearing direction of the second audio playing device according to the acceleration sensing data of the first audio playing device and the acceleration sensing data of the second audio playing device.
S604, the control device of the audio playing equipment controls the second audio playing equipment to be in a normal working state under the condition that the in-ear wearing direction of the first audio playing equipment is determined to be consistent with the in-ear wearing direction of the second audio playing equipment.
It can be understood that, in practical applications, if the control device of the audio playing device determines that the second audio playing device is in the in-ear wearing state first, the control device may control the second audio playing device to be in the normal working state first, and then control the first audio playing device to be in the normal working state when determining whether the in-ear wearing directions of the two audio playing devices are consistent according to the acceleration sensing data.
As shown in fig. 7, an embodiment of the present application further provides a control device of an audio playing apparatus, where the control device of the audio playing apparatus may be the control device 01 of the audio playing apparatus in the control system of the audio playing apparatus related to fig. 1 in the foregoing embodiment. The control device of the audio playing equipment comprises: an acquisition module 11, a control module 12 and a determination module 13.
The obtaining module 11 executes S202 in the above method embodiment, the control module 12 executes S204 in the above method embodiment, and the determining module 13 executes S201 and S203 in the above method embodiment.
Specifically, the determining module 13 is configured to determine whether the first audio playing device and the second audio playing device are in an in-ear wearing state according to the photoelectric sensing data;
the obtaining module 11 is configured to obtain acceleration sensing data of the first audio playing device and acceleration sensing data of the second audio playing device when the determining module 13 determines that the first audio playing device and the second audio playing device are both in an in-ear wearing state;
the determining module 13 is further configured to determine whether the in-ear wearing direction of the first audio playing device is consistent with the in-ear wearing direction of the second audio playing device according to the acceleration sensing data of the first audio playing device and the acceleration sensing data of the second audio playing device, which are acquired by the acquiring module 11;
the control module 12 is configured to control the first audio playing device and/or the second audio playing device to be in a normal working state when the determining module 13 determines that the in-ear wearing direction of the first audio playing device is consistent with the in-ear wearing direction of the second audio playing device.
Optionally, in a possible implementation manner, the obtaining module 11 is specifically configured to: acquiring a first acceleration, a second acceleration and a third acceleration which are acquired by a triaxial acceleration sensor in first audio playing equipment, and acquiring a fourth acceleration, a fifth acceleration and a sixth acceleration which are acquired by a triaxial acceleration sensor in second audio playing equipment; the first acceleration and the fourth acceleration are accelerations in a first preset direction; the second acceleration and the fifth acceleration are accelerations in a second preset direction; the third acceleration and the sixth acceleration are accelerations in a third preset direction;
the determining module 13 is specifically configured to: and determining whether the in-ear wearing direction of the first audio playing device is consistent with the in-ear wearing direction of the second audio playing device according to the first acceleration, the second acceleration, the third acceleration, the fourth acceleration, the fifth acceleration and the sixth acceleration.
Optionally, in another possible implementation manner, the determining module 13 is further specifically configured to:
and under the condition that the difference value of the first acceleration and the fourth acceleration belongs to a first threshold range, the difference value of the second acceleration and the fifth acceleration belongs to a second threshold range, and the difference value of the third acceleration and the sixth acceleration belongs to a third threshold range, determining that the in-ear wearing direction of the first audio playing device is consistent with the in-ear wearing direction of the second audio playing device.
Optionally, in another possible implementation manner, the control module 12 is further configured to:
under the condition that the first audio playing device is determined to be in an in-ear wearing state according to the photoelectric sensing data, controlling the first audio playing device to be in a normal working state; under the condition that the in-ear wearing direction of the first audio playing device is determined to be consistent with the in-ear wearing direction of the second audio playing device, controlling the second audio playing device to be in a normal working state;
or, under the condition that the second audio playing device is determined to be in the in-ear wearing state according to the photoelectric sensing data, controlling the second audio playing device to be in the normal working state; and under the condition that the in-ear wearing direction of the first audio playing device is consistent with the in-ear wearing direction of the second audio playing device, controlling the first audio playing device to be in a normal working state.
Optionally, in another possible implementation manner, the obtaining module 11 is specifically configured to:
acquiring first photoelectric sensing data acquired by a photoelectric sensor in first audio playing equipment and second photoelectric sensing data acquired by a photoelectric sensor in second audio playing equipment;
the determining module 13 is specifically configured to: and determining whether the first audio playing device is in an in-ear wearing state according to the first photoelectric sensing data, and determining whether the second audio playing device is in an in-ear wearing state according to the second photoelectric sensing data.
Optionally, in another possible implementation, the photoelectric sensor is an optical sensor or a capacitive sensor.
Optionally, the control device of the audio playing apparatus may further include a storage module, where the storage module is used to store a program code of the control device of the audio playing apparatus, and the like.
As shown in fig. 8, an embodiment of the present application further provides a control device of an audio playing apparatus, which includes a memory 41, a processor 42, a bus 43, and a communication interface 44; the memory 41 is used for storing computer execution instructions, and the processor 42 is connected with the memory 41 through a bus 43; when the control means of the audio playing device operates, the processor 42 executes the computer-executable instructions stored in the memory 41 to cause the control means of the audio playing device to execute the control method of the audio playing device as provided in the above embodiments.
In particular implementations, processor 42(42-1 and 42-2) may include one or more Central Processing Units (CPUs), such as CPU0 and CPU1 shown in FIG. 8, as one example. And as an example, the control means of the audio playback device may comprise a plurality of processors 42, such as processor 42-1 and processor 42-2 shown in fig. 8. Each of the processors 42 may be a single-Core Processor (CPU) or a multi-Core Processor (CPU). Processor 42 may refer herein to one or more devices, circuits, and/or processing cores that process data (e.g., computer program instructions).
The memory 41 may be, but is not limited to, a read-only memory 41 (ROM) or other type of static storage device that can store static information and instructions, a Random Access Memory (RAM) or other type of dynamic storage device that can store information and instructions, an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compact disc, laser disc, optical disc, digital versatile disc, blu-ray disc, etc.), magnetic disk storage media or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer. The memory 41 may be self-contained and coupled to the processor 42 via a bus 43. The memory 41 may also be integrated with the processor 42.
In a specific implementation, the memory 41 is used for storing data in the present application and computer-executable instructions corresponding to software programs for executing the present application. The processor 42 may perform various functions of the control means of the audio playback device by running or executing software programs stored in the memory 41, and by calling up data stored in the memory 41.
The communication interface 44 is any device, such as a transceiver, for communicating with other devices or communication networks, such as a control system, a Radio Access Network (RAN), a Wireless Local Area Network (WLAN), and the like. The communication interface 44 may include a receiving unit implementing a receiving function and a transmitting unit implementing a transmitting function.
The bus 43 may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, an extended ISA (enhanced industry standard architecture) bus, or the like. The bus 43 may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown in FIG. 8, but this is not intended to represent only one bus or type of bus.
As an example, in connection with fig. 7, the obtaining module in the control means of the audio playing device implements the same function as that implemented by the receiving unit in fig. 8, the determining module in the control means of the audio playing device implements the same function as that implemented by the processor in fig. 8, and the storage module in the control means of the audio playing device implements the same function as that implemented by the memory in fig. 8.
For the explanation of the related contents in this embodiment, reference may be made to the above method embodiments, which are not described herein again.
Through the above description of the embodiments, it is clear to those skilled in the art that, for convenience and simplicity of description, the foregoing division of the functional modules is merely used as an example, and in practical applications, the above function distribution may be completed by different functional modules according to needs, that is, the internal structure of the device may be divided into different functional modules to complete all or part of the above described functions. For the specific working processes of the system, the apparatus and the unit described above, reference may be made to the corresponding processes in the foregoing method embodiments, and details are not described here again.
An embodiment of the present application further provides a computer-readable storage medium, where instructions are stored in the computer-readable storage medium, and when the instructions are executed by a computer, the computer is enabled to execute the method for controlling an audio playing device provided in the foregoing embodiment.
The computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a RAM, a ROM, an erasable programmable read-only memory (EPROM), a register, a hard disk, an optical fiber, a CD-ROM, an optical storage device, a magnetic storage device, any suitable combination of the foregoing, or any other form of computer readable storage medium known in the art. An exemplary storage medium is coupled to the processor such the processor can read information from, and write information to, the storage medium. Of course, the storage medium may also be integral to the processor. The processor and the storage medium may reside in an Application Specific Integrated Circuit (ASIC). In embodiments of the present application, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The above description is only an embodiment of the present application, but the scope of the present application is not limited thereto, and any changes or substitutions within the technical scope of the present disclosure should be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (10)

1. A method for controlling an audio playback device, comprising:
under the condition that the first audio playing device and the second audio playing device are both in an in-ear wearing state according to the photoelectric sensing data, acquiring acceleration sensing data of the first audio playing device and acceleration sensing data of the second audio playing device;
determining whether the in-ear wearing direction of the first audio playing device is consistent with the in-ear wearing direction of the second audio playing device according to the acceleration sensing data of the first audio playing device and the acceleration sensing data of the second audio playing device;
and under the condition that the in-ear wearing direction of the first audio playing device is consistent with the in-ear wearing direction of the second audio playing device, controlling the first audio playing device and/or the second audio playing device to be in a normal working state.
2. The method for controlling an audio playback device according to claim 1, wherein the acquiring acceleration sensing data of the first audio playback device and acceleration sensing data of the second audio playback device includes:
acquiring a first acceleration, a second acceleration and a third acceleration which are acquired by a triaxial acceleration sensor in the first audio playing device, and acquiring a fourth acceleration, a fifth acceleration and a sixth acceleration which are acquired by a triaxial acceleration sensor in the second audio playing device; the first acceleration and the fourth acceleration are accelerations in a first preset direction; the second acceleration and the fifth acceleration are accelerations in a second preset direction; the third acceleration and the sixth acceleration are accelerations in a third preset direction;
the determining whether the in-ear wearing direction of the first audio playing device is consistent with the in-ear wearing direction of the second audio playing device according to the acceleration sensing data of the first audio playing device and the acceleration sensing data of the second audio playing device includes:
and determining whether the in-ear wearing direction of the first audio playing device is consistent with the in-ear wearing direction of the second audio playing device according to the first acceleration, the second acceleration, the third acceleration, the fourth acceleration, the fifth acceleration and the sixth acceleration.
3. The method of claim 2, wherein the determining whether the in-ear wearing direction of the first audio playing device is consistent with the in-ear wearing direction of the second audio playing device according to the first acceleration, the second acceleration, the third acceleration, the fourth acceleration, the fifth acceleration, and the sixth acceleration comprises:
determining that the in-ear wearing direction of the first audio playing device is consistent with the in-ear wearing direction of the second audio playing device under the condition that the difference value of the first acceleration and the fourth acceleration belongs to a first threshold range, the difference value of the second acceleration and the fifth acceleration belongs to a second threshold range, and the difference value of the third acceleration and the sixth acceleration belongs to a third threshold range.
4. The method for controlling an audio playback device according to claim 1, further comprising:
under the condition that the first audio playing device is determined to be in the in-ear wearing state according to the photoelectric sensing data, controlling the first audio playing device to be in a normal working state; under the condition that the in-ear wearing direction of the first audio playing device is determined to be consistent with the in-ear wearing direction of the second audio playing device, controlling the second audio playing device to be in a normal working state;
or, under the condition that the second audio playing device is determined to be in the in-ear wearing state according to the photoelectric sensing data, controlling the second audio playing device to be in a normal working state; and under the condition that the in-ear wearing direction of the first audio playing device is consistent with the in-ear wearing direction of the second audio playing device, controlling the first audio playing device to be in a normal working state.
5. The method for controlling an audio playback device according to claim 1, further comprising:
acquiring first photoelectric sensing data acquired by a photoelectric sensor in the first audio playing device, and determining whether the first audio playing device is in the in-ear wearing state or not according to the first photoelectric sensing data;
and second photoelectric sensing data acquired by a photoelectric sensor in the second audio playing device is acquired, and whether the second audio playing device is in the in-ear wearing state is determined according to the second photoelectric sensing data.
6. The method of claim 5, wherein the optical sensor is an optical sensor or a capacitive sensor.
7. A control apparatus for an audio playback device, comprising:
the determining module is used for determining whether the first audio playing device and the second audio playing device are in an in-ear wearing state according to the photoelectric sensing data;
an obtaining module, configured to obtain acceleration sensing data of the first audio playing device and acceleration sensing data of the second audio playing device when the determining module determines that the first audio playing device and the second audio playing device are both in the in-ear wearing state;
the determining module is further configured to determine whether the in-ear wearing direction of the first audio playing device is consistent with the in-ear wearing direction of the second audio playing device according to the acceleration sensing data of the first audio playing device and the acceleration sensing data of the second audio playing device obtained by the obtaining module;
and the control module is used for controlling the first audio playing device and/or the second audio playing device to be in a normal working state under the condition that the determining module determines that the in-ear wearing direction of the first audio playing device is consistent with the in-ear wearing direction of the second audio playing device.
8. The control device of an audio playing device is characterized by comprising a memory, a processor, a bus and a communication interface; the memory is used for storing computer execution instructions, and the processor is connected with the memory through the bus;
when the control device of the audio playing device is operated, the processor executes the computer-executable instructions stored in the memory to cause the control device of the audio playing device to execute the control method of the audio playing device according to any one of claims 1 to 6.
9. A computer-readable storage medium having stored therein instructions, which when executed by a computer, cause the computer to execute the method of controlling an audio playback apparatus according to any one of claims 1 to 6.
10. A control system of audio playing equipment is characterized by comprising a control device of the audio playing equipment, a first audio playing equipment and a second audio playing equipment; and the control device of the audio playing equipment is respectively in communication connection with the first audio playing equipment and the second audio playing equipment.
CN202110371875.2A 2021-04-07 2021-04-07 Control method, device, storage medium and system of audio playing equipment Pending CN113079434A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110371875.2A CN113079434A (en) 2021-04-07 2021-04-07 Control method, device, storage medium and system of audio playing equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110371875.2A CN113079434A (en) 2021-04-07 2021-04-07 Control method, device, storage medium and system of audio playing equipment

Publications (1)

Publication Number Publication Date
CN113079434A true CN113079434A (en) 2021-07-06

Family

ID=76615222

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110371875.2A Pending CN113079434A (en) 2021-04-07 2021-04-07 Control method, device, storage medium and system of audio playing equipment

Country Status (1)

Country Link
CN (1) CN113079434A (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090154720A1 (en) * 2007-12-18 2009-06-18 Yutaka Oki Sound output control device and sound output control method
US20100020982A1 (en) * 2008-07-28 2010-01-28 Plantronics, Inc. Donned/doffed multimedia file playback control
US20150063613A1 (en) * 2013-09-04 2015-03-05 Samsung Electronics Co., Ltd. Method of preventing feedback based on detection of posture and devices for performing the method
CN109511034A (en) * 2018-12-13 2019-03-22 歌尔股份有限公司 A kind of wearing detection method, device and the earphone of earphone
US20190332141A1 (en) * 2018-04-26 2019-10-31 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Method for Detecting Wearing-State and Wearable Device
WO2019211016A1 (en) * 2018-05-04 2019-11-07 Sivantos Pte. Ltd. Method for operating a hearing aid, and hearing aid
CN111698607A (en) * 2020-07-03 2020-09-22 歌尔科技有限公司 TWS earphone audio output control method, apparatus, device and medium
CN111770407A (en) * 2020-06-30 2020-10-13 歌尔科技有限公司 Earphone state detection method and device, earphone and readable storage medium

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090154720A1 (en) * 2007-12-18 2009-06-18 Yutaka Oki Sound output control device and sound output control method
US20100020982A1 (en) * 2008-07-28 2010-01-28 Plantronics, Inc. Donned/doffed multimedia file playback control
US20150063613A1 (en) * 2013-09-04 2015-03-05 Samsung Electronics Co., Ltd. Method of preventing feedback based on detection of posture and devices for performing the method
US20190332141A1 (en) * 2018-04-26 2019-10-31 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Method for Detecting Wearing-State and Wearable Device
WO2019211016A1 (en) * 2018-05-04 2019-11-07 Sivantos Pte. Ltd. Method for operating a hearing aid, and hearing aid
CN109511034A (en) * 2018-12-13 2019-03-22 歌尔股份有限公司 A kind of wearing detection method, device and the earphone of earphone
CN111770407A (en) * 2020-06-30 2020-10-13 歌尔科技有限公司 Earphone state detection method and device, earphone and readable storage medium
CN111698607A (en) * 2020-07-03 2020-09-22 歌尔科技有限公司 TWS earphone audio output control method, apparatus, device and medium

Similar Documents

Publication Publication Date Title
US11145188B2 (en) Techniques for detecting sensor inputs on a wearable wireless device
US11164022B2 (en) Method for fingerprint enrollment, terminal, and non-transitory computer readable storage medium
CN106225806B (en) Calibrate the method, device and mobile terminal of Magnetic Sensor
CN111279205B (en) Method and electronic device for correcting measured values of a sensor
EP3407193A1 (en) Method for allocating processor resources and mobile terminal
CN110365853B (en) Prompting method and electronic equipment
CN107025002B (en) Terminal application control method and device and terminal
US20230291827A1 (en) Screen state control method and apparatus, and storage medium
US9939874B2 (en) Selectively disabling sensors and associated functions
CN107066090B (en) Method for controlling fingerprint identification module and mobile terminal
WO2017031647A1 (en) Method and apparatus for detecting touch mode
US20160296134A1 (en) Electronic device and information processing method
CN113778255A (en) Touch recognition method and device
US9766666B1 (en) Metallic housing for short-range wireless communication
CN113079434A (en) Control method, device, storage medium and system of audio playing equipment
CN110958352B (en) Network signal display method, device, storage medium and mobile terminal
CN110796665A (en) Image segmentation method and related product
CN110796147A (en) Image segmentation method and related product
CN115278431A (en) State determination method and device, electronic equipment and readable storage medium
CN106293006B (en) Run the method, device and mobile terminal in Magnetic Sensor calibration algorithm library
CN113343709B (en) Method for training intention recognition model, method, device and equipment for intention recognition
CN110222506A (en) Detection method, device, equipment and storage medium are applied fastly
CN106525067B (en) A kind of control method of pedometer, device and mobile terminal
CN114706135A (en) Magnetic field intensity compensation method and device, storage medium and mobile terminal
CN114003149A (en) Electronic equipment control method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20220819

Address after: No. 159, Chengjiang Middle Road, Jiangyin City, Wuxi City, Jiangsu Province

Applicant after: JIANGSU ZIMI ELECTRONIC TECHNOLOGY Co.,Ltd.

Address before: 211100 8th floor, building C4, 19-1 Suyuan Avenue, Jiangning District, Nanjing City, Jiangsu Province (Jiangning Development Zone)

Applicant before: Nanjing Ziniu Software Technology Co.,Ltd.