CN108763978A - Information cuing method, device, terminal, earphone and readable storage medium storing program for executing - Google Patents

Information cuing method, device, terminal, earphone and readable storage medium storing program for executing Download PDF

Info

Publication number
CN108763978A
CN108763978A CN201810520637.1A CN201810520637A CN108763978A CN 108763978 A CN108763978 A CN 108763978A CN 201810520637 A CN201810520637 A CN 201810520637A CN 108763978 A CN108763978 A CN 108763978A
Authority
CN
China
Prior art keywords
earphone
user
information
currently used
audio signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810520637.1A
Other languages
Chinese (zh)
Other versions
CN108763978B (en
Inventor
张海平
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN201810520637.1A priority Critical patent/CN108763978B/en
Publication of CN108763978A publication Critical patent/CN108763978A/en
Application granted granted Critical
Publication of CN108763978B publication Critical patent/CN108763978B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/70Protecting specific internal or peripheral components, in which the protection of a component leads to protection of the entire computer
    • G06F21/88Detecting or preventing theft or loss
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones
    • H04R1/10Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1083Reduction of ambient noise
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones
    • H04R1/10Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1091Details not provided for in groups H04R1/1008 - H04R1/1083

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Computer Hardware Design (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Telephone Function (AREA)

Abstract

This application involves a kind of information cuing method, device, terminal, earphone and readable storage medium storing program for executing.This method includes:When the missing mode of earphone is opened, based on the audio-frequency information playing audio signal built in the earphone;When detecting that the earphone is inserted into user's ear, the user information of currently used person is obtained based on the audio signal;If the user information of currently used person is mismatched with pre-set user information, default prompt message is sent out according to default prompt strategy.Pass through the above method, it can pass through earphone playing audio signal after earphone loss, when earphone is picked up by other people, prompt message associated with the owner of earphone can be sent out, it is given back so that picking up taker and can find the owner of lost property, it increases and gives probability for change after earphone is lost, reduce the loss of user.

Description

Information cuing method, device, terminal, earphone and readable storage medium storing program for executing
Technical field
This application involves field of communication technology, more particularly to a kind of information cuing method, device, terminal, earphone and can Read storage medium.
Background technology
The frequency of use of earphone in people's daily life is very high, user can be listened to music by earphone, be conversed, The various activities such as voice, video, video display broadcasting.And as communication equipment develops towards micromation, portability, earphone becomes to get over Come more small and exquisite, the application of wireless headset is also more and more extensive.Due to the small volume of the earphones such as ear type, In-Ear, wireless ear Machine is easy to happen the case where loss, and is difficult to give for change after losing, and certain loss is brought to user.
Invention content
A kind of information cuing method of the embodiment of the present application offer, device, terminal, earphone and readable storage medium storing program for executing, Ke Yi Earphone sends out prompt message after losing, promote earphone and give probability for change.
A kind of information cuing method, including:
When the missing mode of earphone is opened, based on the audio-frequency information playing audio signal built in the earphone;
When detecting that the earphone is inserted into user's ear, user's letter of currently used person is obtained based on the audio signal Breath;
If the user information of currently used person is mismatched with pre-set user information, sent out according to default prompt strategy default Prompt message.
A kind of information presentation device, including:
Audio playing module, for when the missing mode of earphone is opened, being broadcast based on the audio-frequency information built in the earphone Put audio signal;
Data obtaining module, for when detecting that the earphone is inserted into user's ear, being obtained based on the audio signal The user information of currently used person;
Nformation alert module, if the user information for currently used person is mismatched with pre-set user information, according to pre- If prompt strategy sends out default prompt message.
A kind of terminal, including memory and processor store computer-readable instruction, described instruction quilt in the memory When the processor executes so that the processor executes the step of above method.
A kind of computer readable storage medium is stored thereon with computer program, when computer program is executed by processor The step of realizing the above method.
A kind of earphone, the earphone include electroacoustic transducer, memory, processor and storage on a memory and can handle The computer program run on device, processor are electrically connected with electroacoustic transducer and memory, which executes computer program The step of Shi Shixian above methods.
Above- mentioned information reminding method, device, terminal, earphone and computer readable storage medium, when the missing mode of earphone When unlatching, based on the audio-frequency information playing audio signal built in the earphone, when detecting that the earphone is inserted into user's ear, The user information of currently used person is obtained based on the audio signal, if the user information of currently used person and pre-set user information It mismatches, then default prompt message is sent out according to default prompt strategy.By the above method, earphone can be passed through after earphone loss Playing audio signal can send out prompt message associated with the owner of earphone, so that picking up when earphone is picked up by other people Taker can find the owner of lost property and give back, and increase and give probability for change after earphone is lost, reduce the loss of user.
Description of the drawings
In order to illustrate the technical solutions in the embodiments of the present application or in the prior art more clearly, to embodiment or will show below There is attached drawing needed in technology description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this Some embodiments of application for those of ordinary skill in the art without creative efforts, can be with Obtain other attached drawings according to these attached drawings.
Fig. 1 is the application environment schematic diagram of information cuing method in one embodiment;
Fig. 2 is the internal structure schematic diagram of earphone in one embodiment;
Fig. 3 is the flow diagram of information cuing method in one embodiment;
Fig. 4 is the flow diagram of information cuing method in another embodiment;
Fig. 5 is the flow diagram of information cuing method in another embodiment;
Fig. 6 is the structure diagram of information presentation device in one embodiment;
Fig. 7 is the block diagram with the part-structure of the relevant earphone of terminal provided by the embodiments of the present application.
Specific implementation mode
It is with reference to the accompanying drawings and embodiments, right in order to make the object, technical solution and advantage of the application be more clearly understood The application is further elaborated.It should be appreciated that specific embodiment described herein is only used to explain the application, and It is not used in restriction the application.
Unless otherwise defined, all of technologies and scientific terms used here by the article and belong to the technical field of the application The normally understood meaning of technical staff is identical.The term used in the description of the present application is intended merely to description tool herein The purpose of the embodiment of body, it is not intended that limitation the application.
Fig. 1 is the application environment schematic diagram of information cuing method in one embodiment.As shown in Figure 1, the application environment packet Terminal 110, server 120 and earphone 130 are included, terminal 110 and earphone 130 are carried out wireless communication with server 120 respectively.
Wherein, terminal 110 can be mobile phone, tablet computer or personal digital assistant or Wearable etc..Server 120 can be cloud server, can also be independent physical server, can also be physical server cluster.Earphone 130 Type is including but not limited to In-Ear, ear type, wear-type, ear suspension type.It can be between terminal 110, server 120, earphone 130 It is wirelessly communicated, realizes the transmission of data.
Earphone 130 includes acoustic-electrical transducer 131, and acoustic-electrical transducer 131 is located at the tip portion of earphone, by the tip of earphone When part is located in the duct of user, acoustic-electrical transducer 131 exports the audio signal that earphone 130 obtains to user ear canal In.Acoustic-electrical transducer 131 includes loud speaker and microphone, and loud speaker is used for playing audio signal, and microphone is for recording earphone Audio signal around 130, optionally, microphone can also acquire the audio signal of loud speaker broadcasting by ear internal structure The echo signal formed after reflection and vibration.In one embodiment, the loud speaker and the microphone are an integral structure.
Optionally, application program (Application, APP) is installed, application program refers to completing in terminal 110 The computer program of a certain or multinomial particular job, it operates in user mode, can be interacted with user, has visually User interface.Terminal 110 is interacted by application program and user, such as ought to be used by the headphone tube in terminal 110 can To open earphone missing mode, and then dependent instruction is sent to earphone 130 by server 120, so that earphone 130 sends out letter Breath prompt increases and gives probability for change after earphone is lost.
Fig. 2 is the internal structure schematic diagram of earphone in one embodiment.The earphone includes the place connected by system bus Manage device, memory and communication interface.Wherein, which supports the operation of entire earphone for providing calculating and control ability. Memory for storing data, program, and/or instruction code etc., at least one computer program is stored on memory, the calculating Machine program can be executed by processor, to realize the information cuing method suitable for earphone provided in the embodiment of the present application.Storage Device may include the non-volatile memory mediums such as magnetic disc, CD, read-only memory (Read-Only Memory, ROM), or with Machine storage memory (Random-Access-Memory, RAM) etc..For example, in one embodiment, memory includes non-volatile Property storage medium and built-in storage.Non-volatile memory medium is stored with operating system, database and computer program.The data A kind of information cuing method relevant data provided for realizing above each embodiment are provided in library.The computer journey Sequence can be performed by processor, for realizing a kind of information cuing method that each embodiment of the application is provided.Interior storage Device provides the running environment of cache for operating system, database and the computer program in non-volatile memory medium.It is logical Believe that interface includes mobile communication interface, wifi communication interfaces and bluetooth communication interface etc., earphone passes through communication interface and server It is communicatively coupled, to complete data transmission.
It will be understood by those skilled in the art that structure shown in Fig. 1, is only tied with the relevant part of application scheme The block diagram of structure, does not constitute the restriction for the earphone being applied thereon to application scheme, and specific earphone may include than figure Shown in more or fewer components, either combine certain components or arranged with different components.
As shown in figure 3, for the flow chart of information cuing method in one embodiment, the information alert side in the present embodiment Method is described for running on the earphone in Fig. 1.By the information cuing method, can be carried out after earphone loss Information alert increases the probability that earphone is given for change.The information cuing method, includes the following steps 302~step 306:
Step 302:When the missing mode of earphone is opened, audio letter is played based on the audio-frequency information built in the earphone Number.
After earphone is lost, user can open the missing mode of earphone by terminal, and wherein terminal is pre- with the earphone The terminal first bound, under missing mode, terminal, which is transmitted by server to earphone, loses instruction, to indicate that earphone sends out information Prompt.
Specifically, earphone can be managed by the application-specific in terminal, when earphone is lost, passes through end Application program on end opens the missing mode of earphone.For example, user is in advance by earphone and mobile phone, tablet computer or wearable Equipment is bound, and can be managed to the state of earphone by mobile phone, tablet computer or Wearable, when earphone is lost When mistake, starts the missing mode of earphone in the administration interface of mobile phone, tablet computer or Wearable, earphone can be triggered Information alert is carried out, earphone is found convenient for user.
Further, after earphone receives loss instruction, based on the audio-frequency information playing audio signal built in earphone.Its In, audio signal is prestored in earphone, which can be used for detecting user behavior and user information, specifically, audio letter It number can be stored in the memory in earphone, which can be the audio signal of specific frequency, such as ultrasonic wave, i.e., The audio signal is played when making in the ear that earphone is located at user, user also can't hear, and can not thus discover in user In the case of complete user behavior and user information detection.Optionally, which can also be music, voice, earphone Music or voice are played with max volume, can cause other people note that nearby someone hears what earphone played when being located at earphone When sound, it can find the earphone lost and pick up earphone, the probability that earphone is given for change can be increased.
Step 304:When detecting that the earphone is inserted into user's ear, currently used person is obtained based on the audio signal User information.
When other people have found earphone and when putting on earphone, can wear earphone in ear to receive the sound propagated on earphone. Further, the receiver of earphone can send out audio signal and acquire the signal of return, may determine that by analyzing the signal returned Whether the receiver for going out earphone is located in the duct of user.For example, the audio for sending out specific frequency by the receiver of earphone is believed By different barriers different effects can occur for number (such as ultrasonic signal), the audio signal, be acquired at this time from receiver week The signal enclosed, and analyse and compare to the signal of acquisition, if it is detected that when the signal returned is with human ear Data Matching, judge Earphone has been inserted into user's ear.
After detecting that earphone is inserted into user's ear, the current identity information for wearing headset user of association is obtained.Specifically, It is special that acoustics associated with the ear internal structure of active user can be obtained according to audio signal currently playing in earphone Levy model.Wherein, acoustic feature model can be understood as the space characteristics that earphone is currently located user's ear internal structure, I.e., it is possible to characterize the different location that earphone is located inside user's ear with different acoustic feature models.Further, root It can be also used for generating acoustic signature to verify user identity according to the acoustic feature model, namely generate the ear line information of user, Its middle ear line is distinctive feature with a kind of people, unique just as fingerprint is as face appearance.
Step 306:If the user information of currently used person is mismatched with pre-set user information, according to default prompt strategy Send out default prompt message.
Pre-set user information can be owner's information, i.e. the owner of earphone.Optionally, pre-set user information can also wrap Include multiple pre-set user informations, such as the family members of owner, friend, colleague etc..Earphone obtains the user of currently used person Information, and judge whether the user information of currently used person matches with pre-set user information, if the user information of currently used person It is mismatched with pre-set user information, then default prompt message is sent out according to default prompt strategy.
For example, when it is pre-set user to determine currently used person not, earphone can play special sound information, to carry Show that currently used person gives back earphone, the personal information of earphone owner, such as surname are included in the voice messaging that wherein earphone plays The information such as name, phone, address.In this way, after other people pick up the earphone of loss, the prompt message played by obtaining earphone can To quickly find the loss person of earphone.
Above- mentioned information reminding method is broadcast when the missing mode of earphone is opened based on the audio-frequency information built in the earphone Audio signal is put, when detecting that the earphone is inserted into user's ear, the use of currently used person is obtained based on the audio signal Family information is sent out default if the user information of currently used person is mismatched with pre-set user information according to default prompt strategy Prompt message.By the above method, after earphone loss can by earphone playing audio signal, when earphone is picked up by other people, Prompt message associated with the owner of earphone can be sent out, gives back, increases so that picking up taker and can find the owner of lost property Probability is given for change after earphone loss, and user is avoided to lose.
In one embodiment, before the unlatching of the missing mode of the earphone, which further includes:Work as institute When stating earphone and being connected to wireless network, the earphone mark based on the earphone establishes wireless communication connection with server.
Wherein, wireless network (wireless network) is the network realized using wireless communication technique, wireless network May include the wireless network (such as GPRS, 4G, 5G) realized by public mobile network and WLAN (Wireless Local Area Networks, WLAN) etc..Include wireless communication interface on earphone, interface can be connected to by radio communication Wireless network can be communicated for example, when earphone is in the coverage area of Wireless LAN by the wifi built in earphone Module is connected to Wireless LAN.
When the earphone is connected to wireless network, communication link is established with server based on the earphone mark on the earphone It connects.Wherein earphone mark refers to that identity is sent to server by the identity of earphone, earphone by wireless network, when After the identity of server authentication earphone passes through, earphone is established with server and is connected.Earphone and server establish communication link After connecing, request or control instruction etc., ear can be sent to earphone by wireless network mutual data transmission, such as server The request that machine can be sent according to server returns to related data or executes relevant operation according to the control instruction that server is sent Deng.
In one embodiment, as shown in figure 4, the information cuing method further includes:
Step 402:When the missing mode of earphone is opened, the current location information of the earphone is obtained.
When the missing mode of earphone starts, for the position of quick lock in earphone, the present embodiment obtains earphone in real time Current location information.Specifically, it can include GPS module in earphone, the target headset can be got by GPS module Current location information.
Step 404:The earphone sends the position command for carrying the location information to the server, described in instruction Server sends the location information of the earphone to user terminal.
Specifically, location information is for determining that the geographical location that earphone is presently in, earphone obtain current by GPS positioning Location information, earphone generate data packet according to the current location information of acquisition and are sent to as position command, and by position command Server.
Server extracts the location information of earphone, and by the earphone after receiving position command from position command Network is sent to the user terminal location information by radio communication, which is owner's associated end in advance of earphone End, that is to say the terminal bound with earphone.In this way, the owner of earphone can be believed by reading the position of earphone in terminal Breath is convenient for the position of owner's quick lock in earphone, gives earphone for change.
In one embodiment, as shown in figure 5, when detecting that the earphone is inserted into user's ear, it is based on the audio The user information namely step 304 of the currently used person of signal acquisition include:
Step 502:Audio signal is sent out based on the earphone and acquires the signal of return.
Wherein, the receiver of earphone can send out audio signal and acquire the signal of return, can be with by analyzing the signal returned Judge whether the receiver of earphone is located in the duct of user.
Step 504:Judge whether the earphone is located in the duct of user according to the signal for analyzing the return.
For example, sending out the audio signal (such as ultrasonic signal) of specific frequency, the audio by the receiver of earphone Different effect can occur by different barriers for signal, be acquired at this time from the signal around receiver, and to the signal of acquisition into Row is analysed and compared, if it is detected that when the signal returned is with human ear Data Matching, judges that earphone has been inserted into user's ear.
Step 506:When the earphone is located in user ear canal, the audio signal is acquired by ear internal structure The echo signal formed after reflection and vibration.
Earphone includes electroacoustic transducer, and electroacoustic transducer can be used as loud speaker, and the corresponding electric signal of audio signal is turned Change the acoustic signals that user can hear into.Meanwhile electroacoustic transducer is non-to the sound wave in user's ear internal structure (duct) It is often sensitive, the vibration of diffuser can be caused, the coil being connected with cone is driven to be cut in the magnetic field of permanent magnet The movement of the magnetic line of force, to generate the electric current changed with the variation of sound wave, (the phenomenon that generating electric current is physically being known as Electromagnetic induction phenomenon), meanwhile, it will export the electromotive force of audio at coil both ends.Therefore, electroacoustic transducer can also acquire audio The acoustic echo signal that signal generates after the reflection of ear internal structure and vibration.That is, electroacoustic transducer can also be made It is used for microphone.Wherein, the principle of microphone is after the electroacoustic transducer carries out energy reverse transformation, by acoustical signal Reconvert is at electric signal after being converted into mechanical oscillation, to realize the acquisition function of echo signal.
Electroacoustic transducer, although its type, function or working condition are different, they all include two elements, That is electric system and mechanical vibrating system pass through certain physics inside electroacoustic transducer between electric system and mechanical vibrating system Effect connects each other, to complete the conversion of energy.
Reflection of the audio signal through ear internal structure is recorded based on the electroacoustic transducer for playing the audio signal With vibration and the acoustic echo signal that is formed, acoustic echo letter need not be acquired by the way that microphone is additionally arranged in earphone Number, cost has been saved, the internal structure of earphone is simplified.
Optionally, the audio signal can also be acquired by the microphone being arranged in earphone through ear internal structure Reflection and vibration and the acoustic echo signal that is formed.Wherein, when earphone is worn in the ear of access customer, microphone setting exists The side that earphone is in contact with user's ear internal structure, that is, the earphone case in setting loud speaker through-hole is arranged in microphone On.
Step 508:It is determined according to the audio signal, echo signal associated with the ear internal structure of currently used person Acoustic feature model.
Wherein, audio signal earphone speaker played is s (t), the acoustic echo in the collected duct of microphone Signal is r (t), and acoustic feature model associated with the ear internal structure of currently used person is indicated with w (t), therefore can To obtain following expression:
R (t)=s (t) * w (t) (1)
In formula, w (t) is a parameter that can reflect earphone and the coupling of user's ear, can be used for characterizing earphone quilt It is placed on the acoustic feature in the space in user's ear.In formula (1), audio signal is s (t) and acoustic echo signal is r (t) it can be monitored and be obtained by the voicefrequency circuit that earphone or electronic equipment are arranged, and then the ear with currently used person can be obtained Piece associated acoustic feature model w (t) of internal structure.Wherein, acoustic feature model w (t) can be understood as the current institute of earphone In the space characteristics of user's ear internal structure, that is, earphone position can be characterized with different acoustic feature model w (t) Different location inside user's ear.Correspondingly, can also characterize each user's with acoustic feature model w (t) Ear line feature.
Further, a noise factor e (t) can also be increased in above-mentioned formula (1), wherein noise factor e (t) includes Ambient noise and circuit noise;Ambient noise is the process for acoustic echo signal of recording when not having playing audio signal s (t) The ambient noise of middle generation, the ambient noise can have additional microphone to acquire;Circuit noise is in earphone built-in circuit Caused by noise, be the build-in attribute of earphone.It is known parameters to increase noise factor e (t), after considering noise factor e (t), Its formula (1) can be changed to:
R (t)=s (t) * w (t)+e (t) (2)
In formula (2), the noise factor e (t) that newly increases, audio signal are s (t) and acoustic echo signal is r (t) equal For known parameters, and then acoustic feature model w (t) associated with the ear internal structure of currently used person can be obtained.
Information cuing method provided in this embodiment, can be by associated with the ear internal structure of currently used person Acoustic feature model characterizes the identity information of user, improves safety and the convenience of user's identification authentication, only needs It just can determine that user identity when user puts on earphone, and the process for obtaining identity information need not add additional device Part saves device cost.
In one embodiment, default prompt message is sent out according to default prompt strategy, including:Electricity based on the earphone Sonic transducer plays special sound information, and the personal information of earphone owner is included in the voice messaging.For example, when determination is worked as When preceding user is not pre-set user, earphone plays following voice messaging, and " earphone is lost, and XXX, phone XXX, address please be contacted XXX thanks!" in this way, after other people pick up the earphone of loss, the voice messaging that can be played by earphone obtains earphone owner Personal information, so as to be quickly found earphone loss person.Such as the owner of earphone is public in company, subway, school etc. When place falls earphone, there is greater probability that can pick up earphone by passerby, the earphone being now under missing mode can help to pick up Taker quickly finds the owner of lost property, and then increases the probability that earphone is given for change, avoids user's loss.
In one embodiment, which further includes:If the user information and pre-set user of currently used person Information mismatches, then the repertoire or specified function for controlling the earphone enter lock-out state.
Specifically, when it is not pre-set user to determine the currently used person of earphone, it that is to say that earphone is in and picked up by other people State, if the function of earphone can normal use, may cause to pick up taker occupies psychology, will not be given back to pick up taker Earphone.Control earphone enters repertoire or the not available lock-out state of specified function at this time, such as control earphone can not connect Meeting other-end equipment namely currently used person can not the normal use earphone so that the earphone has no currently used person Any use value, to promote currently used person to give back the earphone.
In one embodiment, which further includes:If the user information and pre-set user of currently used person Information mismatches, then the user information of the currently used person is sent to server, and work as by described in by the server The user information of preceding user is sent to the user terminal.
Specifically, when it is not pre-set user to determine the currently used person of earphone, it that is to say that earphone is in and picked up by other people State, the ear line information of currently used person is sent to the user terminal, so that the owner of earphone can pass through the ear line Information determines that earphone picks up the identity of taker.For example, owner after getting ear line information, can be determined by the assistance of the police and be worked as Preceding user personal part really, to further improve the probability that earphone is given for change.Optionally, police mandate is being obtained In the case of, directly the ear line information can also be sent in pre-set police system, and calls in the police system Ear line database so that the police directly can determine currently used person personal part really according to the ear line information, quickly give for change Earphone.
Although should be understood that the corresponding flow chart of above-described embodiment in each step according to arrow instruction successively It has been shown that, but these steps are not the inevitable sequence indicated according to arrow to be executed successively.Unless expressly state otherwise herein, There is no stringent sequences to limit for the execution of these steps, these steps can execute in other order.Moreover, in Fig. 3-5 At least part step may include multiple sub-steps either these sub-steps of multiple stages or stage be not necessarily Synchronization executes completion, but can execute at different times, and the execution sequence in these sub-steps or stage also need not Be so carry out successively, but can with other steps either the sub-step of other steps or at least part in stage in turn or Person alternately executes.
As shown in fig. 6, in one embodiment, providing a kind of information presentation device, which includes:Audio playing module 610, data obtaining module 620, nformation alert module 630.
Audio playing module 610 is used for when the missing mode of earphone is opened, based on the audio-frequency information built in the earphone Playing audio signal.
Data obtaining module 620, for when detecting that the earphone is inserted into user's ear, being obtained based on the audio signal Take the user information of currently used person.
Nformation alert module 630, if the user information for currently used person is mismatched with pre-set user information, basis Default prompt strategy sends out default prompt message.
Above- mentioned information suggestion device, when the missing mode of earphone is opened, audio playing module 610 is based in the earphone The audio-frequency information playing audio signal set, when detecting that the earphone is inserted into user's ear, data obtaining module 620 is based on institute The user information that audio signal obtains currently used person is stated, if the user information of currently used person and pre-set user information are not Match, then nformation alert module 630 sends out default prompt message according to default prompt strategy.By above-mentioned apparatus, when earphone is lost After can send out prompt associated with the owner of earphone by earphone playing audio signal, when earphone is picked up by other people Information is given back so that picking up taker and can find the owner of lost property, is increased and is given probability for change after earphone is lost, reduces user's Loss.
In one embodiment, which further includes being wirelessly connected module, is connected to for working as the earphone When wireless network, wireless communication connection is established with server based on the earphone mark on the earphone.
In one embodiment, which further includes position sending module, for the missing mode when earphone When unlatching, the current location information of the earphone is obtained;The earphone sends to the server and carries the location information Position command sends the location information of the earphone to indicate the server to user terminal;The user terminal is described The owner of earphone associated terminal in advance.
In one embodiment, data obtaining module 620 is additionally operable to be sent out audio signal based on the earphone and acquired to return The signal returned;Judge whether the earphone is located in the duct of user according to the signal for analyzing the return;When the earphone position When in user ear canal, the echo signal that the audio signal is formed after the reflection of ear internal structure and vibration is acquired; Acoustic feature model associated with the ear internal structure of currently used person is determined according to the audio signal, echo signal.
In one embodiment, it is specific to be additionally operable to the broadcasting of the electroacoustic transducer based on the earphone for nformation alert module 630 Voice messaging includes the personal information of earphone owner in the voice messaging.
In one embodiment, which further includes functional control module, if the use for currently used person Family information is mismatched with pre-set user information, then the repertoire or specified function for controlling the earphone enter lock-out state.
In one embodiment, which further includes information sending module, if the use for currently used person Family information is mismatched with pre-set user information, then the user information of the currently used person is sent to server, and pass through institute Server is stated to be sent to the user terminal the user information of the currently used person.
The division of modules is only used for for example, in other embodiments, can will believe in above- mentioned information suggestion device Breath suggestion device is divided into different modules as required, to complete all or part of function of above- mentioned information suggestion device.
Specific about information presentation device limits the restriction that may refer to above for information cuing method, herein not It repeats again.Modules in above- mentioned information suggestion device can be realized fully or partially through software, hardware and combinations thereof.On Stating each module can be embedded in or independently of in the processor in computer equipment, can also store in a software form in the form of hardware In memory in computer equipment, the corresponding operation of the above modules is executed in order to which processor calls.
Realizing for modules in the information presentation device provided in the embodiment of the present application can be the shape of computer program Formula.The computer program can be run in terminal or server.The program module that the computer program is constituted is storable in terminal Or on the memory of server.When the computer program is executed by processor, the information described in the embodiment of the present application is realized The step of reminding method.
The embodiment of the present application also provides a kind of earphone, which includes electroacoustic transducer, memory, processor and storage On a memory and the computer program that can run on a processor, the processor and the electroacoustic transducer and the storage Device is electrically connected, and the processor realizes the information alert side as described in the various embodiments described above when executing the computer program Method.
The embodiment of the present application also provides a kind of computer readable storage mediums.One or more is executable comprising computer The non-volatile computer readable storage medium storing program for executing of instruction, when the computer executable instructions are executed by one or more processors When so that the processor executes the information cuing method as described in the various embodiments described above.
The embodiment of the present application also provides a kind of computer program products.A kind of computer program product including instruction, When run on a computer so that computer executes the information cuing method described in the various embodiments described above.
The embodiment of the present application also provides a kind of terminal devices.As shown in fig. 7, for convenience of description, illustrating only and this Apply for that the relevant part of embodiment, particular technique details are not disclosed, please refers to the embodiment of the present application method part.It is set with terminal For for for earphone:
Fig. 7 is the block diagram with the part-structure of the relevant earphone of terminal provided by the embodiments of the present application.With reference to figure 7, earphone Including:Radio frequency (Radio Frequency, RF) circuit 710, memory 720, input unit 730, display unit 740, sensor 750, voicefrequency circuit 760, Wireless Fidelity (wireless fidelity, WiFi) module 770, processor 780 and power supply 790 Equal components.It will be understood by those skilled in the art that Headphone structure shown in Fig. 7 does not constitute the restriction to earphone, may include Than illustrating more or fewer components, certain components or different components arrangement are either combined.
Wherein, RF circuits 710 can be used for receiving and sending messages or communication process in, signal sends and receivees, can be by base station After downlink information receives, handled to processor 780;The data of uplink can also be sent to base station.In general, RF circuits include but Be not limited to antenna, at least one amplifier, transceiver, coupler, low-noise amplifier (Low Noise Amplifier, LNA), duplexer etc..In addition, RF circuits 710 can also be communicated with network and other equipment by radio communication.Above-mentioned channel radio Letter can use any communication standard or agreement, including but not limited to global system for mobile communications (Global System of Mobile communication, GSM), general packet radio service (General Packet Radio Service, GPRS), CDMA (Code Division Multiple Access, CDMA), wideband code division multiple access (Wideband Code Division Multiple Access, WCDMA), long term evolution (Long Term Evolution, LTE)), Email, Short message service (Short Messaging Service, SMS) etc..
Memory 720 can be used for storing software program and module, and processor 780 is stored in memory 720 by operation Software program and module, to execute various function application and the data processing of earphone.Memory 720 can include mainly Program storage area and data storage area, wherein program storage area can storage program area, the application journey needed at least one function Sequence (such as the application program of sound-playing function, application program of image player function etc.) etc.;Data storage area can store root Created data (such as audio data, address list etc.) etc. are used according to earphone.In addition, memory 720 may include high speed Random access memory, can also include nonvolatile memory, a for example, at least disk memory, flush memory device or Other volatile solid-state parts.
Input unit 730 can be used for receiving the number or character information of input, and generate the user setting with earphone 700 And the related key signals input of function control.Specifically, input unit 730 may include touch panel 731 and other inputs Equipment 732.Touch panel 731, alternatively referred to as touch screen collect user on it or neighbouring touch operation (such as user Use the operation of any suitable object or attachment such as finger, stylus on touch panel 731 or near touch panel 731), And corresponding attachment device is driven according to preset formula.In one embodiment, touch panel 731 may include touching inspection Survey two parts of device and touch controller.Wherein, the touch orientation of touch detecting apparatus detection user, and detect touch operation The signal brought, transmits a signal to touch controller;Touch controller receives touch information from touch detecting apparatus, and will It is converted into contact coordinate, then gives processor 780, and can receive order that processor 780 is sent and be executed.In addition, The multiple types such as resistance-type, condenser type, infrared ray and surface acoustic wave may be used and realize touch panel 731.In addition to touch surface Plate 731, input unit 730 can also include other input equipments 732.Specifically, other input equipments 732 may include but not It is limited to one or more in physical keyboard, function key (such as volume control button, switch key etc.) etc..
Display unit 740 can be used for showing information input by user or be supplied to user information and earphone it is various Menu.Display unit 740 may include display panel 741.In one embodiment, liquid crystal display (Liquid may be used Crystal Display, LCD), the forms such as Organic Light Emitting Diode (Organic Light-EmittingDiode, OLED) come Configure display panel 741.In one embodiment, touch panel 731 can cover display panel 741, when touch panel 731 detects To processor 780 on it or after neighbouring touch operation, is sent to determine the type of touch event, it is followed by subsequent processing device 780 Corresponding visual output is provided on display panel 741 according to the type of touch event.Although in the figure 7, touch panel 731 with Display panel 741 is to realize input and the input function of earphone as two independent components, but in certain embodiments, Can be integrated by touch panel 731 and display panel 741 and that realizes earphone output and input function.
Earphone 700 may also include at least one sensor 750, such as optical sensor, motion sensor and other sensings Device.Specifically, optical sensor may include ambient light sensor and proximity sensor, wherein ambient light sensor can be according to environment The light and shade of light adjusts the brightness of display panel 741, and proximity sensor can close display panel when earphone is moved in one's ear 741 and/or backlight.Motion sensor may include acceleration transducer, can detect by acceleration transducer and adds in all directions The size of speed can detect that size and the direction of gravity when static, can be used to identify application (such as the horizontal/vertical screen of earphone posture Switching), Vibration identification correlation function (such as pedometer, tap) etc.;In addition, earphone can also configure gyroscope, barometer, humidity Other sensors such as meter, thermometer, infrared sensor etc..
Voicefrequency circuit 760, loud speaker 761 and microphone 762 can provide the audio interface between user and earphone.Audio-frequency electric The transformed electric signal of the audio data received can be transferred to loud speaker 761 by road 760, and sound is converted to by loud speaker 761 Signal exports;On the other hand, the voice signal of collection is converted to electric signal by microphone 762, is turned after being received by voicefrequency circuit 760 It is changed to audio data, then by after the processing of audio data output processor 780, another earphone can be sent to through RF circuits 710, or Person exports audio data to memory 720 so as to subsequent processing.
WiFi belongs to short range wireless transmission technology, and earphone can help user's transceiver electronics postal by WiFi module 770 Part, browsing webpage and access streaming video etc., it has provided wireless broadband internet to the user and has accessed.Although Fig. 7 is shown WiFi module 770, but it is understood that, and it is not belonging to must be configured into for earphone 700, it can omit as needed.
Processor 780 is the control centre of earphone, using the various pieces of various interfaces and the entire earphone of connection, is led to It crosses operation or executes the software program and/or module being stored in memory 720, and call and be stored in memory 720 Data execute the various functions and processing data of earphone, to carry out integral monitoring to earphone.In one embodiment, it handles Device 780 may include one or more processing units.In one embodiment, processor 780 can integrate application processor and modulation Demodulation processor, wherein the main processing operation system of application processor, user interface and application program etc.;Modulation /demodulation is handled Device mainly handles wireless communication.It is understood that above-mentioned modem processor can not also be integrated into processor 780.
Earphone 700 further includes the power supply 790 (such as battery) powered to all parts, it is preferred that power supply can pass through electricity Management system and processor 780 are logically contiguous, to realize management charging, electric discharge and power consumption by power-supply management system The functions such as management.
In one embodiment, earphone 700 can also be including bluetooth module etc..
In the embodiment of the present application, the processor 780 included by the terminal device executes the calculating of storage on a memory The information cuing method described in the various embodiments described above is realized when machine program.
When the execution of the computer program run on a processor, audio letter can be played by earphone after earphone loss Number, when earphone is picked up by other people, prompt message associated with the owner of earphone can be sent out, so that picking up taker can look for It is given back to the owner of lost property, increases and give probability for change after earphone is lost, reduce the loss of user.
Used in this application may include to any reference of memory, storage, database or other media is non-volatile And/or volatile memory.Suitable nonvolatile memory may include read-only memory (ROM), programming ROM (PROM), Electrically programmable ROM (EPROM), electrically erasable ROM (EEPROM) or flash memory.Volatile memory may include arbitrary access Memory (RAM), it is used as external cache.By way of illustration and not limitation, RAM is available in many forms, such as It is static RAM (SRAM), dynamic ram (DRAM), synchronous dram (SDRAM), double data rate sdram (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronization link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic ram (DRDRAM) and memory bus dynamic ram (RDRAM).
The several embodiments of the application above described embodiment only expresses, the description thereof is more specific and detailed, but simultaneously Cannot the limitation to the application the scope of the claims therefore be interpreted as.It should be pointed out that for those of ordinary skill in the art For, under the premise of not departing from the application design, various modifications and improvements can be made, these belong to the guarantor of the application Protect range.Therefore, the protection domain of the application patent should be determined by the appended claims.

Claims (14)

1. a kind of information cuing method, which is characterized in that including:
When the missing mode of earphone is opened, based on the audio-frequency information playing audio signal built in the earphone;
When detecting that the earphone is inserted into user's ear, the user information of currently used person is obtained based on the audio signal;
If the user information of currently used person is mismatched with pre-set user information, default prompt is sent out according to default prompt strategy Information.
2. according to the method described in claim 1, it is characterized in that, the earphone missing mode open before, the side Method further includes:
When the earphone is connected to wireless network, wireless communication is established with server based on the earphone mark on the earphone and is connected It connects.
3. according to the method described in claim 2, it is characterized in that, the method further includes:
When the missing mode of earphone is opened, the current location information of the earphone is obtained;
The earphone sends the position command for carrying the location information to the server, to indicate the server to user Terminal sends the location information of the earphone;The user terminal is owner's associated terminal in advance of the earphone.
4. according to the method described in claim 1, it is characterized in that, described when detecting that the earphone is inserted into user's ear, The user information of currently used person is obtained based on the audio signal, including:
Audio signal is sent out based on the earphone and acquires the signal of return;
Judge whether the earphone is located in the duct of user according to the signal for analyzing the return;
When the earphone is located in user ear canal, the audio signal is acquired after the reflection of ear internal structure and vibration The echo signal of formation;
Acoustic feature mould associated with the ear internal structure of currently used person is determined according to the audio signal, echo signal Type.
5. according to the method described in claim 1, it is characterized in that, the default prompt strategy of the basis sends out default prompt letter Breath, including:
Electroacoustic transducer based on the earphone plays special sound information, includes of earphone owner in the voice messaging People's information.
6. according to the method described in claim 1, it is characterized in that, the method further includes:
If the user information of currently used person is mismatched with pre-set user information, the repertoire or specified of the earphone is controlled Function enters lock-out state.
7. according to the method described in claim 1, it is characterized in that, the method further includes:
If the user information of currently used person is mismatched with pre-set user information, the user information of the currently used person is sent out It send to server, and is sent to the user terminal the user information of the currently used person by the server.
8. a kind of information presentation device, which is characterized in that including:
Audio playing module, for when the missing mode of earphone is opened, sound to be played based on the audio-frequency information built in the earphone Frequency signal;
Data obtaining module, for when detecting that the earphone is inserted into user's ear, being obtained based on the audio signal current The user information of user;
Nformation alert module carries if the user information for currently used person is mismatched with pre-set user information according to default Show that strategy sends out default prompt message.
9. a kind of terminal, including memory and processor, computer-readable instruction, described instruction quilt are stored in the memory When the processor executes so that the processor executes the step of method as described in any one of claim 1 to 7.
10. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the computer program The step of method as described in any one of claim 1 to 7 is realized when being executed by processor.
11. a kind of earphone, which is characterized in that the earphone includes electroacoustic transducer, memory, processor and is stored in memory Computer program that is upper and can running on a processor, the processor are electrically connected with the electroacoustic transducer and the memory It connects, when the processor executes the computer program the step of any one of realization claim 1 to 7 the method.
12. earphone according to claim 11, which is characterized in that the electroacoustic transducer is for playing the audio letter Number, and for acquiring the acoustic echo signal generated due to pressure change in user ear canal.
13. earphone according to claim 12, which is characterized in that the electroacoustic transducer includes loud speaker and microphone, The loud speaker is generated for acquiring in user ear canal due to pressure change for playing the audio signal, the microphone Acoustic echo signal.
14. earphone according to claim 13, which is characterized in that the loud speaker and the microphone are integral type knot Structure.
CN201810520637.1A 2018-05-28 2018-05-28 Information prompting method, device, terminal, earphone and readable storage medium Expired - Fee Related CN108763978B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810520637.1A CN108763978B (en) 2018-05-28 2018-05-28 Information prompting method, device, terminal, earphone and readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810520637.1A CN108763978B (en) 2018-05-28 2018-05-28 Information prompting method, device, terminal, earphone and readable storage medium

Publications (2)

Publication Number Publication Date
CN108763978A true CN108763978A (en) 2018-11-06
CN108763978B CN108763978B (en) 2020-05-12

Family

ID=64006469

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810520637.1A Expired - Fee Related CN108763978B (en) 2018-05-28 2018-05-28 Information prompting method, device, terminal, earphone and readable storage medium

Country Status (1)

Country Link
CN (1) CN108763978B (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109767600A (en) * 2019-02-01 2019-05-17 谷东科技有限公司 A kind of AR glasses and its implementation capable of automatic alarm
CN110324746A (en) * 2019-07-23 2019-10-11 奇酷互联网络科技(深圳)有限公司 Earphone false-touch prevention method, apparatus, storage medium and earphone
CN110650408A (en) * 2019-10-29 2020-01-03 歌尔股份有限公司 Earphone, anti-lost method, anti-lost system and computer readable storage medium
CN111818165A (en) * 2020-07-09 2020-10-23 深圳市科奈信科技有限公司 Earphone retrieving prompting method and system, electronic equipment and storage medium
CN113473285A (en) * 2021-06-23 2021-10-01 泰凌微电子(上海)股份有限公司 Equipment positioning method and earphone
CN113810889A (en) * 2021-08-16 2021-12-17 百度在线网络技术(北京)有限公司 Information interaction method, device, equipment and storage medium
CN113993076A (en) * 2021-11-23 2022-01-28 歌尔科技有限公司 Earphone positioning method and device, earphone equipment and storage medium
CN114157952A (en) * 2021-11-26 2022-03-08 歌尔科技有限公司 Earphone anti-loss early warning method and device, earphone and computer readable storage medium
CN115038003A (en) * 2022-06-11 2022-09-09 深圳市华冠智联科技有限公司 Bluetooth headset playing control system

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090003641A1 (en) * 2007-06-29 2009-01-01 Van Der Bilt Casper Headset with on-ear detection
US20140093088A1 (en) * 2012-10-02 2014-04-03 Sony Mobile Communications, Inc. Method of checking earphone wearing state
CN105760732A (en) * 2016-01-29 2016-07-13 宇龙计算机通信科技(深圳)有限公司 Authentication method, device and system
CN107071175A (en) * 2017-04-18 2017-08-18 广东小天才科技有限公司 Alarm clock control method of mobile equipment and mobile equipment
CN107066865A (en) * 2017-04-26 2017-08-18 广东小天才科技有限公司 Unlocking control method and device
CN107277657A (en) * 2017-05-18 2017-10-20 深圳市冠旭电子股份有限公司 A kind of earphone method for retrieving, device and earphone

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090003641A1 (en) * 2007-06-29 2009-01-01 Van Der Bilt Casper Headset with on-ear detection
US20140093088A1 (en) * 2012-10-02 2014-04-03 Sony Mobile Communications, Inc. Method of checking earphone wearing state
CN105760732A (en) * 2016-01-29 2016-07-13 宇龙计算机通信科技(深圳)有限公司 Authentication method, device and system
CN107071175A (en) * 2017-04-18 2017-08-18 广东小天才科技有限公司 Alarm clock control method of mobile equipment and mobile equipment
CN107066865A (en) * 2017-04-26 2017-08-18 广东小天才科技有限公司 Unlocking control method and device
CN107277657A (en) * 2017-05-18 2017-10-20 深圳市冠旭电子股份有限公司 A kind of earphone method for retrieving, device and earphone

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109767600A (en) * 2019-02-01 2019-05-17 谷东科技有限公司 A kind of AR glasses and its implementation capable of automatic alarm
CN110324746A (en) * 2019-07-23 2019-10-11 奇酷互联网络科技(深圳)有限公司 Earphone false-touch prevention method, apparatus, storage medium and earphone
CN110650408A (en) * 2019-10-29 2020-01-03 歌尔股份有限公司 Earphone, anti-lost method, anti-lost system and computer readable storage medium
CN111818165A (en) * 2020-07-09 2020-10-23 深圳市科奈信科技有限公司 Earphone retrieving prompting method and system, electronic equipment and storage medium
CN113473285A (en) * 2021-06-23 2021-10-01 泰凌微电子(上海)股份有限公司 Equipment positioning method and earphone
CN113810889A (en) * 2021-08-16 2021-12-17 百度在线网络技术(北京)有限公司 Information interaction method, device, equipment and storage medium
CN113993076A (en) * 2021-11-23 2022-01-28 歌尔科技有限公司 Earphone positioning method and device, earphone equipment and storage medium
CN114157952A (en) * 2021-11-26 2022-03-08 歌尔科技有限公司 Earphone anti-loss early warning method and device, earphone and computer readable storage medium
CN115038003A (en) * 2022-06-11 2022-09-09 深圳市华冠智联科技有限公司 Bluetooth headset playing control system

Also Published As

Publication number Publication date
CN108763978B (en) 2020-05-12

Similar Documents

Publication Publication Date Title
CN108763978A (en) Information cuing method, device, terminal, earphone and readable storage medium storing program for executing
CN108391206A (en) Signal processing method, device, terminal, earphone and readable storage medium storing program for executing
CN108922537B (en) Audio recognition method, device, terminal, earphone and readable storage medium
CN108521621B (en) Signal processing method, device, terminal, earphone and readable storage medium
CN108540661A (en) Signal processing method, device, terminal, earphone and readable storage medium storing program for executing
CN108803859A (en) Information processing method, device, terminal, earphone and readable storage medium storing program for executing
CN108519871A (en) Acoustic signal processing method and Related product
CN108429969B (en) Audio frequency playing method, device, terminal, earphone and readable storage medium storing program for executing
CN108538320B (en) Recording control method and device, readable storage medium and terminal
CN108391205B (en) Left and right channel switching method and device, readable storage medium and terminal
CN108710486A (en) Audio frequency playing method, device, earphone and computer readable storage medium
CN108668009B (en) Input operation control method, device, terminal, earphone and readable storage medium
CN108763901B (en) Ear print information acquisition method and device, terminal, earphone and readable storage medium
CN108540900A (en) Volume adjusting method and related product
CN106126174B (en) A kind of control method and electronic equipment of scene audio
CN107465595A (en) Equipment message control method for playing back, device, message playback equipment and storage medium
CN108391207A (en) Data processing method, device, terminal, earphone and readable storage medium storing program for executing
CN108600885A (en) Audio signal processing method and Related product
CN108540660A (en) Audio signal processing method and device, readable storage medium storing program for executing, terminal
CN106384597A (en) Audio frequency data processing method and device
CN108763913A (en) Data processing method, device, terminal, earphone and readable storage medium storing program for executing
CN208402071U (en) Audio playing apparatus, earphone and audio frequency broadcast system
CN108810787A (en) Foreign matter detecting method and device based on audio frequency apparatus, terminal
CN103618989B (en) Electronic name card exchange method and device
CN108616640A (en) Terminal unlock method and device, readable storage medium storing program for executing, terminal

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20200512