CN111741405B - Reminding method and device, earphone and server - Google Patents

Reminding method and device, earphone and server Download PDF

Info

Publication number
CN111741405B
CN111741405B CN202010508211.1A CN202010508211A CN111741405B CN 111741405 B CN111741405 B CN 111741405B CN 202010508211 A CN202010508211 A CN 202010508211A CN 111741405 B CN111741405 B CN 111741405B
Authority
CN
China
Prior art keywords
sound data
earphone
user
server
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010508211.1A
Other languages
Chinese (zh)
Other versions
CN111741405A (en
Inventor
赵楠
崔文华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Sogou Intelligent Technology Co Ltd
Original Assignee
Beijing Sogou Intelligent Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Sogou Intelligent Technology Co Ltd filed Critical Beijing Sogou Intelligent Technology Co Ltd
Priority to CN202010508211.1A priority Critical patent/CN111741405B/en
Publication of CN111741405A publication Critical patent/CN111741405A/en
Application granted granted Critical
Publication of CN111741405B publication Critical patent/CN111741405B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00Circuits for transducers, loudspeakers or microphones
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/48Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Navigation (AREA)

Abstract

The embodiment of the invention provides a reminding method, a reminding device, an earphone and a server, wherein the earphone is in communication connection with the server, and the method comprises the following steps: the earphone acquires environmental sound data and sends the environmental sound data to the server; receiving a potential risk event sent by the server, wherein the potential risk event is identified by the server according to the environmental sound data; and carrying out sound reminding according to the potential risk event, so that the earphone can inform the user of the danger in the environment in time in the process of wearing the earphone by the user, and the user can avoid the risk in time.

Description

Reminding method and device, earphone and server
Technical Field
The present invention relates to the field of electronic devices, and in particular, to a reminding method, a reminding device, an earphone, and a server.
Background
With the continuous development of scientific technology, electronic technology has also been developed rapidly, and the variety of electronic equipment is also more and more, and people are more and more accustomed to using multiple electronic equipment in life.
The earphone is a portable electronic device frequently used in daily life of people, and a user can listen to songs or carry out voice communication by using the earphone while performing certain activities frequently. For example, headphones are used during running, walking, cycling, etc. activities.
However, many people wear the earphones outdoors, often neglect the change of surrounding vehicles, pedestrians and even traffic lights, and are easy to generate potential risks.
Disclosure of Invention
The embodiment of the invention provides a reminding method, a reminding device, an earphone and a server.
The embodiment of the invention discloses a reminding method, which is applied to an earphone, wherein the earphone is in communication connection with a server, and the method comprises the following steps:
the earphone acquires environmental sound data and sends the environmental sound data to the server;
receiving a potential risk event sent by the server, wherein the potential risk event is identified by the server according to the environmental sound data;
and carrying out voice reminding according to the potential risk event.
Optionally, the acquiring the environmental sound data includes:
acquiring user voice;
and starting or stopping collecting the environmental sound data according to the user voice.
Optionally, the acquiring the environmental sound data includes:
acquiring user geographical position information;
and starting or stopping collecting the environmental sound data according to the user geographical position information.
Optionally, the acquiring the user geographical location information includes:
and receiving the user geographical position information sent by the server.
Optionally, the earphone is in communication connection with a mobile terminal, and the acquiring the environmental sound data includes:
receiving a control instruction sent by the mobile terminal;
and starting or stopping collecting the environmental sound data by adopting the control instruction.
Optionally, the headset comprises two paired headsets; the acquiring of the environmental sound data comprises:
and starting a far-field pickup mode of at least one earphone to collect far-field sound data.
Optionally, the method further comprises:
starting a near-field pickup mode of one earphone to collect near-field sound data in the process of calling by adopting the earphone;
and carrying out call processing by adopting the near-field sound data.
Optionally, the performing an audio alert according to the risk potential event includes:
and playing a reminding sound corresponding to the potential risk event.
Optionally, the method further comprises:
if a potential risk event is identified and the headset is playing sound data, the volume of playing the sound data is reduced or the sound data is stopped.
Optionally, the method further comprises:
if a potential risk event is identified and the headset is engaged in a call, a predetermined telephone assistant is invoked to take over the call.
Optionally, the method further comprises:
and if the sound data to be played by the earphone comprises voice data, performing voice processing on the sound data to be played by the earphone according to the environment sound data.
Optionally, the performing, according to the environmental sound data, human sound processing on the sound data to be played by the earphone includes:
sending the sound data to be played by the earphone to the server, wherein the server is used for carrying out human voice processing on the sound data to be played by the earphone according to the environment sound data;
and receiving the voice data to be played, which is sent by the server and is subjected to the voice processing.
Optionally, the method further comprises:
acquiring user direction information, and playing navigation voice data according to the user direction information;
and when the potential risk event is acquired, adjusting navigation voice data according to the potential risk event.
Optionally, the playing navigation voice data according to the user orientation information includes:
acquiring user geographical position information;
and playing navigation voice data according to the user direction information and the user geographical position information.
Optionally, the playing navigation voice data according to the user orientation information includes:
sending navigation query information to the server, wherein the navigation query information comprises the user direction information;
receiving navigation voice data returned by the server and playing the navigation voice data to a user; the navigation voice data is generated by the server according to the user direction information.
Optionally, the method further comprises:
receiving and playing the reminding information sent by the server; the reminding information is generated by the server according to the potential risk event and the geographical position information of the user when the potential risk event is identified.
The embodiment of the invention also discloses a reminding method which is applied to a server, wherein the server is in communication connection with the earphone, and the method comprises the following steps:
the server receives the environmental sound data sent by the earphone;
identifying a potential risk event in the environment from the environmental sound data;
transmitting the risk potential event to the headset; the earphone is used for carrying out sound reminding according to the potential risk event.
Optionally, the identifying a risk potential event in the environment from the environmental sound data includes:
inputting the environmental sound data into a pre-trained sound recognition model;
and acquiring the potential risk event identified by the sound identification model by adopting the environmental sound data.
Optionally, the method further comprises:
receiving sound data to be played sent by the earphone; the sound data to be played comprises voice data;
carrying out human voice processing on the voice data to be played;
and sending the voice data to be played after the voice processing to the earphone, wherein the earphone is used for playing the voice data to be played after the voice processing.
Optionally, the method further comprises:
receiving navigation inquiry information sent by the earphone, wherein the navigation inquiry information comprises the user direction information;
generating navigation voice data according to the user direction information;
and sending the navigation voice data to the earphone, wherein the earphone is used for playing the navigation voice data to a user.
Optionally, the generating navigation voice data according to the user orientation information includes:
acquiring user geographical position information;
and generating navigation voice data according to the user geographical position information and the user direction information.
Optionally, the method further comprises:
acquiring user geographical location information identifying when the potential risk event is generated;
and generating reminding information according to the user geographical position information and the potential risk event and sending the reminding information to the earphone.
The embodiment of the invention also discloses a reminding device, which is applied to an earphone, wherein the earphone is in communication connection with the server, and the reminding device comprises:
the environment sound data processing module is used for acquiring environment sound data and sending the environment sound data to the server;
the potential risk event receiving module is used for receiving a potential risk event sent by the server, and the potential risk event is identified by the server according to the environmental sound data;
and the reminding module is used for carrying out voice reminding according to the potential risk event.
Optionally, the environmental sound data processing module is configured to obtain a user voice; and starting or stopping collecting the environmental sound data according to the user voice.
Optionally, the environmental sound data processing module is configured to obtain user geographical location information; and starting or stopping collecting the environmental sound data according to the user geographical position information.
Optionally, the environmental sound data processing module is configured to receive user geographical location information sent by the server.
Optionally, the earphone is in communication connection with a mobile terminal, and the ambient sound data processing module is configured to receive a control instruction sent by the mobile terminal; and starting or stopping collecting the environmental sound data by adopting the control instruction.
Optionally, the headset comprises two paired headsets; the environment sound data processing module is used for starting a far-field pickup mode of at least one earphone to collect far-field sound data.
Optionally, the method further comprises:
the near field sound data acquisition module is used for starting a near field pickup mode of one earphone to acquire near field sound data in the process of adopting the earphone to carry out communication;
and the call processing module is used for carrying out call processing by adopting the near-field sound data.
Optionally, the reminding module is configured to play a reminding sound corresponding to the risk potential event.
Optionally, the method further comprises:
and the sound data adjusting module is used for reducing the volume of playing the sound data or stopping playing the sound data if the potential risk event is identified and the earphone plays the sound data.
Optionally, the method further comprises:
and the pickup module is used for calling a preset telephone assistant to pick up the call if the potential risk event is identified and the earphone is in call.
Optionally, the method further comprises:
and the first human voice processing module is used for performing human voice processing on the sound data to be played by the earphone according to the environment sound data if the sound data to be played by the earphone comprises human voice data.
Optionally, the first human voice processing module is configured to send the sound data to be played by the headset to the server, and the server is configured to perform human voice processing on the sound data to be played by the headset according to the environmental sound data; and receiving the voice data to be played, which is sent by the server and is subjected to the voice processing.
Optionally, the method further comprises:
the navigation voice data playing module is used for acquiring the user direction information and playing navigation voice data according to the user direction information;
and the navigation voice data adjusting module is used for adjusting the navigation voice data according to the potential risk event when the potential risk event is acquired.
Optionally, the navigation voice data playing module is configured to obtain geographic location information of the user; and playing navigation voice data according to the user direction information and the user geographical position information.
Optionally, the navigation voice data playing module is configured to send navigation query information to the server, where the navigation query information includes the user direction information; receiving navigation voice data returned by the server and playing the navigation voice data to a user; the navigation voice data is generated by the server according to the user direction information.
Optionally, the method further comprises:
the reminding information processing module is used for receiving and playing the reminding information sent by the server; the reminding information is generated by the server according to the potential risk event and the geographical position information of the user when the potential risk event is identified.
The embodiment of the invention also discloses a reminding device, which is applied to a server, wherein the server is in communication connection with the earphone, and the reminding device comprises:
the environment sound data receiving module is used for receiving the environment sound data sent by the earphone;
a risk potential event identification module for identifying risk potential events in the environment according to the environment sound data;
a risk potential event sending module for sending the risk potential event to the headset; the earphone is used for carrying out sound reminding according to the potential risk event.
Optionally, the risk potential event recognition module is configured to input the environmental sound data into a pre-trained sound recognition model; and acquiring the potential risk event identified by the sound identification model by adopting the environmental sound data.
Optionally, the method further comprises:
the sound data receiving module is used for receiving sound data to be played, which is sent by the earphone; the sound data to be played comprises voice data;
the second voice processing module is used for carrying out voice processing on the voice data to be played;
and the sound data sending module is used for sending the sound data to be played after the human voice processing to the earphone, and the earphone is used for playing the sound data to be played after the human voice processing.
Optionally, the method further comprises:
the navigation query information receiving module is used for receiving navigation query information sent by the earphone, wherein the navigation query information comprises the user direction information;
the navigation voice data generation module is used for generating navigation voice data according to the user direction information;
and the navigation voice data sending module is used for sending the navigation voice data to the earphone, and the earphone is used for playing the navigation voice data to a user.
Optionally, the navigation voice data generating module is configured to obtain geographic location information of the user; and generating navigation voice data according to the user geographical position information and the user direction information.
Optionally, the method further comprises:
the user geographic position information acquisition module is used for acquiring and identifying the user geographic position information when the potential risk event is generated;
and the reminding information sending module is used for generating reminding information according to the user geographical position information and the potential risk event and sending the reminding information to the earphone.
Also disclosed in an embodiment of the present invention is a headset comprising a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors comprises instructions for:
acquiring environmental sound data and sending the environmental sound data to a server;
receiving a potential risk event sent by the server, wherein the potential risk event is identified by the server according to the environmental sound data;
and carrying out voice reminding according to the potential risk event.
Optionally, the acquiring the environmental sound data includes:
acquiring user voice;
and starting or stopping collecting the environmental sound data according to the user voice.
Optionally, the acquiring the environmental sound data includes:
acquiring user geographical position information;
and starting or stopping collecting the environmental sound data according to the user geographical position information.
Optionally, the acquiring the user geographical location information includes:
and receiving the user geographical position information sent by the server.
Optionally, the earphone is in communication connection with a mobile terminal, and the acquiring the environmental sound data includes:
receiving a control instruction sent by the mobile terminal;
and starting or stopping collecting the environmental sound data by adopting the control instruction.
Optionally, the headset comprises two paired headsets; the acquiring of the environmental sound data comprises:
and starting a far-field pickup mode of at least one earphone to collect far-field sound data.
Optionally, further comprising instructions for:
starting a near-field pickup mode of one earphone to collect near-field sound data in the process of calling by adopting the earphone;
and carrying out call processing by adopting the near-field sound data.
Optionally, the performing an audio alert according to the risk potential event includes:
and playing a reminding sound corresponding to the potential risk event.
Optionally, further comprising instructions for:
if a potential risk event is identified and the headset is playing sound data, the volume of playing the sound data is reduced or the sound data is stopped.
Optionally, further comprising instructions for:
if a potential risk event is identified and the headset is engaged in a call, a predetermined telephone assistant is invoked to take over the call.
Optionally, further comprising instructions for:
and if the sound data to be played by the earphone comprises voice data, performing voice processing on the sound data to be played by the earphone according to the environment sound data.
Optionally, the performing, according to the environmental sound data, human sound processing on the sound data to be played by the earphone includes:
sending the sound data to be played by the earphone to the server, wherein the server is used for carrying out human voice processing on the sound data to be played by the earphone according to the environment sound data;
and receiving the voice data to be played, which is sent by the server and is subjected to the voice processing.
Optionally, further comprising instructions for:
acquiring user direction information, and playing navigation voice data according to the user direction information;
and when the potential risk event is acquired, adjusting navigation voice data according to the potential risk event.
Optionally, the playing navigation voice data according to the user orientation information includes:
acquiring user geographical position information;
and playing navigation voice data according to the user direction information and the user geographical position information.
Optionally, the playing navigation voice data according to the user orientation information includes:
sending navigation query information to the server, wherein the navigation query information comprises the user direction information;
receiving navigation voice data returned by the server and playing the navigation voice data to a user; the navigation voice data is generated by the server according to the user direction information.
Optionally, further comprising instructions for:
receiving and playing the reminding information sent by the server; the reminding information is generated by the server according to the potential risk event and the geographical position information of the user when the potential risk event is identified.
The embodiment of the invention also discloses a server, which comprises a memory and one or more programs, wherein the one or more programs are stored in the memory, and the one or more programs are configured to be executed by one or more processors and comprise instructions for:
receiving environmental sound data sent by an earphone;
identifying a potential risk event in the environment from the environmental sound data;
transmitting the risk potential event to the headset; the earphone is used for carrying out sound reminding according to the potential risk event.
Optionally, the identifying a risk potential event in the environment from the environmental sound data includes:
inputting the environmental sound data into a pre-trained sound recognition model;
and acquiring the potential risk event identified by the sound identification model by adopting the environmental sound data.
Optionally, further comprising instructions for:
receiving sound data to be played sent by the earphone; the sound data to be played comprises voice data;
carrying out human voice processing on the voice data to be played;
and sending the voice data to be played after the voice processing to the earphone, wherein the earphone is used for playing the voice data to be played after the voice processing.
Optionally, further comprising instructions for:
receiving navigation inquiry information sent by the earphone, wherein the navigation inquiry information comprises the user direction information;
generating navigation voice data according to the user direction information;
and sending the navigation voice data to the earphone, wherein the earphone is used for playing the navigation voice data to a user.
Optionally, the generating navigation voice data according to the user orientation information includes:
acquiring user geographical position information;
and generating navigation voice data according to the user geographical position information and the user direction information.
Optionally, further comprising instructions for:
acquiring user geographical location information identifying when the potential risk event is generated;
and generating reminding information according to the user geographical position information and the potential risk event and sending the reminding information to the earphone.
The embodiment of the invention also discloses a computer readable storage medium, wherein a computer program is stored on the computer readable storage medium, and when the computer program is executed by a processor, the steps of the reminding method are realized.
The embodiment of the invention has the following advantages:
in the embodiment of the invention, the server can identify the potential risk event in the environment according to the environment sound data, and the earphone can remind the user with sound according to the potential risk event sent by the server, so that the earphone can inform the user of the danger in the environment in time in the process of wearing the earphone by the user, and the user can avoid the risk in time.
Drawings
FIG. 1 is a flowchart illustrating steps of a first embodiment of a reminding method according to the present invention;
FIG. 2 is a flowchart illustrating a first embodiment of a reminding method according to the present invention;
FIG. 3 is a flowchart illustrating the third step of a reminding method according to a third embodiment of the present invention;
FIG. 4 is a flowchart illustrating a fourth step of an embodiment of a reminding method of the present invention;
FIG. 5 is a block diagram of a first embodiment of a reminder device according to the present invention;
FIG. 6 is a block diagram of a second embodiment of a reminder device according to the present invention;
FIG. 7 is a block diagram of a third embodiment of a reminder device according to the present invention;
FIG. 8 is a block diagram of a fourth embodiment of a reminder device according to the present invention;
FIG. 9 is a block diagram of an exemplary embodiment of an earphone for a reminder;
fig. 10 is a schematic structural diagram of a server for reminders according to another exemplary embodiment of the present invention.
Detailed Description
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.
Referring to fig. 1, a flowchart illustrating steps of a first embodiment of a reminding method according to the present invention is shown, where the method is applied to an earphone, and the earphone is in communication with a server, and the method specifically includes the following steps:
step 101, the earphone acquires environmental sound data and sends the environmental sound data to the server.
The earphone is a portable electronic device frequently used in daily life, and can have a playing function, a sound pickup function and a communication function. The user can listen to the song or communicate over the phone using the headset.
In the embodiment of the present invention, the headset has a sound collection module, such as a microphone, a microphone array, etc., which can collect ambient sound data. The headset may start or stop collecting ambient sound data as controlled by the user.
The environmental sound data refers to sound data around the user's current environment. In outdoor environments, the environmental sound data is complex and may include a plurality of sounds superimposed together, for example, the sounds may include car sounds, train sounds, pedestrian footstep sounds, bicycle sounds, prompting sounds when traffic lights are switched, insect-singing and bird-singing sounds, and the like.
In one example, the headset may capture a user voice, and start or stop collecting ambient sound data based on the user voice.
In another example, the headset may also obtain current user geographical location information, and start or stop collecting the ambient sound data according to the current user geographical location information. For example, when the user geographical position information indicates that the user is on a sidewalk or a traffic light, the collection of the environmental sound data is automatically started. And when the user geographical position information indicates that the user is indoors, stopping collecting the environmental sound data.
The headset may obtain current user geographical location information, e.g., the headset detects current user geographical location information. The headset may also receive user geographical location information sent by the server. The earphone can also be connected with the mobile terminal in a communication mode, and current geographic position information is obtained from the mobile terminal.
In another example, the earphone may further receive a control instruction sent by the mobile terminal, and start or stop collecting the ambient sound data according to the control instruction. For example, if the control command is a start collecting command, the earphone starts collecting the ambient sound data. For example, the mobile terminal may be installed with an APP for controlling the headset, and the user may perform a control operation on the APP, so that the mobile terminal sends a control instruction to the headset.
In embodiments of the present invention, the headphones may comprise two headphones paired, such as a left headphone and a right headphone. Two earphones can all have the sound collection module, can control the sound collection module and according to the pickup mode pickup of difference. The pickup modes of the headset may include a far-field pickup mode and a near-field pickup mode. The far-field sound pickup mode collects far-field sound data, the sound pickup range of the far-field (far-filtered) sound pickup mode is opened to be a range beyond 1 meter, and sound data within a distance of 5 meters can be clearly collected. The near field sound pickup mode collects near field sound data, and the sound pickup range of the near field sound pickup mode is within 20 centimeters. The ambient sound data includes far-field sound data and near-field sound data.
In one example, the headset may turn on or off the far-field pickup mode based on the user's voice, e.g., when the user's voice is "turn on remote pickup", "pick up far sound", the far-field pickup mode of the headset may be turned on. Specifically, the headset may have a voice recognition function, and the headset recognizes a user's voice and turns on or off a far-field sound pickup mode according to a voice recognition result.
In another example, the headset may also turn on or off the far-field pickup mode based on current geographical location information.
In another example, the earphone may also receive a control instruction sent by the mobile terminal, and the far-field sound pickup mode is turned on to collect far-field sound data by using the control instruction. The user can click a button for turning on or off the far-field sound pickup mode on the APP, so that the mobile terminal sends a corresponding control instruction to the headset.
And 102, receiving a potential risk event sent by the server, wherein the potential risk event is identified by the server according to the environmental sound data.
The server may identify the potential risk event in the environment using a pre-trained voice recognition model, which may be a model trained using a large amount of collected environmental voice data as training samples.
A risk potential event in an environment is a risk potential event that may include: there is the vehicle to be close to in user's the scope of predetermineeing, and the scope of predetermineeing has the vehicle to whistle, and the traffic lights is about to switch, has pedestrian etc. within the scope of predetermineeing.
And 103, carrying out voice reminding according to the potential risk event.
The headset may play a reminder sound corresponding to the risk potential event. For example, if the risk potential event is the approach of a vehicle or the vehicle makes a horn sound, a warning sound for "paying attention to the vehicle" may be played. For another example, if the risk potential event is a person calling out aloud, a warning sound of "paying attention to the pedestrian call" may be played.
In the embodiment of the invention, the server can identify the potential risk event in the environment according to the environment sound data, and the earphone can remind the user with sound according to the potential risk event sent by the server, so that the earphone can inform the user of the danger in the environment in time in the process of wearing the earphone by the user, and the user can avoid the risk in time.
In the embodiment of the invention, if a potential risk event is identified and the earphone plays the sound data, the volume of playing the sound data is reduced or the sound data is stopped. For example, during the course of playing a song by the headset, if a potential risk event is identified, the headset may reduce the sound of playing the song or stop playing the song. For another example, during a call using a headset, if a potential risk event is identified, the headset reduces the volume of the call voice.
In an embodiment of the present invention, if a risk potential event is identified and the headset is engaged in a call, a predetermined telephone assistant is invoked to pick up the call. Specifically, the earphone can communicate with the mobile terminal, the call process of the mobile terminal can be taken over by the earphone, and if a potential risk event is identified in the call process by using the earphone, a telephone assistant can be called to take over and automatically reply the telephone content. The telephone assistant may be a program installed in the headset or a program installed in the mobile terminal.
In the embodiment of the present invention, if the sound data to be played by the earphone includes voice data, the voice data to be played by the earphone is processed according to the environmental sound data.
The human voice processing means processing for enhancing human voice effect on the voice data, for example, automatically adjusting noise reduction according to the environmental sound data, increasing gain multiple according to the environmental sound data, and the like, so that human voice is clearer. For the user with hearing impairment, the user can be made to hear clear human voice.
In one example, the sound data to be played may be processed by human voice locally at the headset.
In another embodiment, the earphone may send the sound data to be played to the server, the server performs voice processing on the sound data to be played, and the earphone may receive the voice data to be played, which is sent by the server and is subjected to the voice processing.
In the embodiment of the invention, the earphone can also receive and play the reminding information sent by the server; the reminder information is generated by the server according to the potential risk event and the geographical location information of the user when the potential risk event is identified.
Specifically, the server can detect the geographical position information of the user in real time and determine the road condition information of the road where the geographical position information of the user is located. And when the potential risk event is identified, generating reminding information according to the road condition information of the road. For example, the reminder may be "a car accident occurs on the road ahead, please note that the detour is avoided". Further, the reminding information may include information for guiding the user to go out, so that the user can change the going out route in time.
Referring to fig. 2, a flowchart illustrating steps of a second embodiment of a reminding method according to the present invention is shown, where the method is applied to an earphone, and the earphone is in communication with a server, and the method specifically includes the following steps:
step 201, in the process of using the earphones for communication, starting a near-field sound pickup mode of one earphone to collect near-field sound data, and starting a far-field sound pickup mode of another earphone to collect far-field sound data.
The two earphones adopt a near-field pickup mode and a far-field pickup mode to pick up sound respectively and collect sound data in different distance ranges.
The sound pickup range of the earphone with the near-field sound pickup mode is within 20 cm, and voice spoken by a user can be clearly collected. The sound pickup range of the earphone with the far-field sound pickup mode is beyond 1 meter, and clear environmental sound data can be obtained.
And step 202, carrying out call processing by using the near-field sound data.
The near-field sound data is mainly voice data of a user, so that only the near-field sound data can be transmitted as call data, and the far-field sound data is not transmitted as call data.
Step 203, sending the environmental sound data to the server.
The ambient sound data may include near-field sound data and far-field sound data.
And step 204, receiving a potential risk event sent by the server, wherein the potential risk event is identified by the server according to the environmental sound data.
And step 205, carrying out voice reminding according to the potential risk event.
In the embodiment of the invention, in the process of calling by adopting the earphones, the near-field sound pickup mode of one earphone can be started to collect near-field sound data, the far-field sound pickup mode of the other earphone is started to collect far-field sound data, and the calling processing is carried out by adopting the near-field sound data, so that clear user voice can be transmitted. The far-field sound data are sent to the server, the server identifies potential risk events in the environment and carries out sound reminding according to the potential risk events, the potential risk events in the environment can be detected in the conversation process, and dangers existing in the environment can be informed to the user in time, so that the user can avoid the risks in time.
Referring to fig. 3, a flowchart illustrating steps of a third embodiment of a reminding method according to the present invention is shown, where the method is applied to an earphone, and the earphone is in communication with a server, and the method specifically includes the following steps:
step 301, obtaining the user direction information, and playing navigation voice data according to the user direction information.
The user direction information refers to the front direction of the user, in the embodiment of the invention, the earphone can be provided with the direction sensor, and the direction sensor can detect the user direction information in real time when the user wears the earphone.
In practice, a user is often not good at distinguishing directions on a screen map, and the directions of the user can be judged in real time by the earphone under the condition of wearing the earphone, so that the perception of the user on the directions and the real space are combined more accurately, and the user does not need to distinguish which direction is going to the right through the screen.
In the embodiment of the present invention, the headset may acquire the current user geographical location information, for example, the headset detects the current user geographical location information. Also for example, a headset may be communicatively coupled to the mobile device. The mobile device may be equipped with location capabilities, such as providing a GPS module, or by communicating with a base station for location determination, and the headset may obtain current user geographical location information detected by the mobile device. The headset may also obtain current user geographical location information from the server.
In one example, the step of playing navigation voice data according to the user orientation information may include: acquiring user geographical position information; and playing navigation voice data according to the user direction information and the user geographical position information. And in the interaction process, the navigation voice can be played according to the real-time user direction information and the real-time user geographical position information. In an embodiment of the invention, the headset may obtain the user's geographic location from the headset box.
In another example, the step of playing the navigation voice data according to the user orientation information may include: sending navigation query information to the server, wherein the navigation query information comprises the user direction information; receiving navigation voice data returned by the server and playing the navigation voice data to a user; the navigation voice data is generated by the server according to the user direction information.
The server can query and generate navigation voice data according to the user position information and the user geographical position information, and the user geographical position information can be carried in the navigation query information or can be determined by the server.
Step 302, obtaining environmental sound data, and sending the environmental sound data to the server.
Step 303, receiving a potential risk event sent by the server, where the potential risk event is identified by the server according to the environmental sound data.
And 304, when the potential risk event is acquired, adjusting navigation voice data according to the potential risk event.
When a risk potential event is identified, the headset may adjust the navigation voice data according to the risk potential event, guiding the user away from the risk potential event. For example, the navigation voice may be "please walk to the right" when the risk potential event is the recognition of a pedestrian approaching the front left of the user.
For another example, the user may have a traffic light ahead of the walking direction, and the navigation route may be to walk to an opposite road through the traffic light. When the traffic light in front is switched to the red light in the potential risk event, the navigation voice can be 'please walk along the current direction, the traffic light in front is not passed, and the next traffic light can walk to the opposite road'.
And 305, carrying out voice reminding according to the potential risk event.
The headset may play a reminder sound corresponding to the risk potential event.
In the embodiment of the invention, the earphone can navigate according to the direction information of the user and play navigation voice data. In the navigation process, when a potential risk event sent by the server is received, the navigation voice data is adjusted according to the potential risk event, so that the earphone can inform the user of danger in the environment in time in the process that the user wears the earphone, and the user can avoid the risk in time.
Referring to fig. 4, a flowchart illustrating a fourth step of an embodiment of a reminding method according to the present invention is shown, where the method is applied to a server, and the server is in communication connection with an earphone, and the method specifically includes the following steps:
step 401, the server receives the ambient sound data sent by the earphone.
Step 402, a risk potential event in the environment is identified according to the environment sound data.
The server may identify the potential risk event in the environment using a pre-trained voice recognition model, which may be a model trained using a large amount of collected environmental voice data as training samples.
Step 403, sending the risk potential event to the headset; the earphone is used for carrying out sound reminding according to the potential risk event.
In the embodiment of the invention, the server can receive the environment sound data sent by the earphone, identify the potential risk event in the environment according to the environment sound data, and send the potential risk event to the earphone. The earphone can carry out sound reminding to the user according to the potential risk event, so that the earphone can inform the user of danger existing in the environment in time in the process of wearing the earphone, and the user can avoid the risk in time.
In the embodiment of the present invention, if the sound data to be played by the earphone includes the human voice data, the earphone may send the sound data to be played to the server. The server can receive the sound data to be played sent by the earphone; the sound data to be played comprises human sound data; the server carries out voice processing on the voice data to be played; and sending the voice data to be played after the voice processing to the earphone, wherein the earphone can play the voice data to be played after the voice processing.
In the embodiment of the invention, the earphone can collect the user direction information to carry out voice navigation, the earphone can send navigation inquiry information to the server, the server receives the navigation inquiry information sent by the earphone, and the navigation inquiry information comprises the user direction information; acquiring user geographical position information; and generating navigation voice data according to the user direction information and the user geographical position information, and sending the navigation voice data to the earphone so that the earphone plays the navigation voice data.
In an embodiment of the present invention, the step of generating navigation voice data according to the user orientation information may include: acquiring user geographical position information; and generating navigation voice data according to the user geographical position information and the user direction information.
The server can query and generate navigation voice data according to the user position information and the user geographical position information, and the user geographical position information can be carried in the navigation query information or can be determined by the server.
In the embodiment of the present invention, the server may further obtain geographic location information of the user identifying the time when the potential risk event is generated; and generating reminding information according to the user geographical position information and the potential risk event and sending the reminding information to the earphone.
Specifically, the server can detect the geographical position information of the user in real time and determine the road condition information of the road where the geographical position information of the user is located. And when the potential risk event is identified, generating reminding information according to the road condition information of the road. Further, the reminding information may include information for guiding the user to go out, so that the user can change the going out route in time.
It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.
Referring to fig. 5, a block diagram of a first embodiment of a reminder device according to the present invention is shown, where the reminder device is applied to an earphone, the earphone is in communication connection with a server, and the reminder device specifically includes the following modules:
the environmental sound data processing module 501 is configured to obtain environmental sound data and send the environmental sound data to the server;
a risk potential event receiving module 502, configured to receive a risk potential event sent by the server, where the risk potential event is identified by the server according to the environmental sound data;
and a reminding module 503, configured to perform sound reminding according to the risk potential event.
Referring to fig. 6, a block diagram of a second embodiment of the reminding device according to the present invention is shown, where the reminding device is applied to an earphone, the earphone is in communication connection with a server, and the reminding device specifically includes the following modules:
the environment sound data processing module 601 is configured to acquire environment sound data and send the environment sound data to the server;
a risk potential event receiving module 602, configured to receive a risk potential event sent by the server, where the risk potential event is identified by the server according to the environmental sound data;
and a reminding module 603, configured to perform sound reminding according to the risk potential event.
In the embodiment of the present invention, the environmental sound data processing module 601 is configured to obtain a user voice; and starting or stopping collecting the environmental sound data according to the user voice.
In the embodiment of the present invention, the environmental sound data processing module 601 is configured to obtain user geographical location information; and starting or stopping collecting the environmental sound data according to the user geographical position information.
In this embodiment of the present invention, the environmental sound data processing module 601 is configured to receive user geographical location information sent by the server.
In the embodiment of the present invention, the earphone is in communication connection with a mobile terminal, and the ambient sound data processing module 601 is configured to receive a control instruction sent by the mobile terminal; and starting or stopping collecting the environmental sound data by adopting the control instruction.
In an embodiment of the invention, the headset comprises two paired headsets; the ambient sound data processing module 601 is configured to turn on a far-field pickup mode of at least one earphone to collect far-field sound data.
In this embodiment of the present invention, the reminding device may further include:
a near field sound data acquisition module 604, configured to start a near field pickup mode of an earphone to acquire near field sound data in a call process using the earphone;
and a call processing module 605, configured to perform call processing by using the near-field sound data.
In this embodiment of the present invention, the reminding module 603 is configured to play a reminding sound corresponding to the risk potential event.
In this embodiment of the present invention, the reminding device may further include:
a sound data adjustment module 606, configured to reduce the volume of playing the sound data or stop playing the sound data if a risk potential event is identified and the earphone is playing the sound data.
In this embodiment of the present invention, the reminding device may further include:
a pick-up module 607 for invoking a preset phone assistant to pick up the call if a risk potential event is identified and the headset is in a call.
In this embodiment of the present invention, the reminding device may further include:
the first voice processing module 608 is configured to, if the sound data to be played by the headset includes voice data, perform voice processing on the sound data to be played by the headset according to the environmental sound data.
In this embodiment of the present invention, the first human voice processing module 608 is configured to send the sound data to be played by the earphone to the server, where the server is configured to perform human voice processing on the sound data to be played by the earphone according to the environmental sound data; and receiving the voice data to be played, which is sent by the server and is subjected to the voice processing.
In this embodiment of the present invention, the reminding device may further include:
the navigation voice data playing module 609 is used for acquiring the user direction information and playing the navigation voice data according to the user direction information;
and the navigation voice data adjusting module 610 is configured to adjust navigation voice data according to the potential risk event when the potential risk event is acquired.
In the embodiment of the present invention, the navigation voice data playing module 609 is configured to obtain geographic location information of a user; and playing navigation voice data according to the user direction information and the user geographical position information.
In this embodiment of the present invention, the navigation voice data playing module 609 is configured to send navigation query information to the server, where the navigation query information includes the user direction information; receiving navigation voice data returned by the server and playing the navigation voice data to a user; the navigation voice data is generated by the server according to the user direction information.
In this embodiment of the present invention, the reminding device may further include:
a reminding information processing module 611, configured to receive and play the reminding information sent by the server; the reminding information is generated by the server according to the potential risk event and the geographical position information of the user when the potential risk event is identified.
Referring to fig. 7, a block diagram of a third embodiment of the reminding device according to the present invention is shown, where the reminding device is applied to a server, the server is in communication connection with an earphone, and the reminding device specifically includes the following modules:
an ambient sound data receiving module 701, configured to receive ambient sound data sent by the earphone;
a risk potential event identification module 702 for identifying a risk potential event in the environment according to the environmental sound data;
a risk potential event sending module 703, configured to send the risk potential event to the headset; the earphone is used for carrying out sound reminding according to the potential risk event.
Referring to fig. 8, a block diagram of a fourth embodiment of the reminding device according to the present invention is shown, where the reminding device is applied to a server, the server is in communication connection with an earphone, and the reminding device specifically includes the following modules:
an ambient sound data receiving module 801, configured to receive ambient sound data sent by the earphone;
a risk potential event identification module 802 for identifying a risk potential event in the environment according to the environmental sound data;
a risk potential event sending module 803 for sending the risk potential event to the headset; the earphone is used for carrying out sound reminding according to the potential risk event.
In this embodiment of the present invention, the risk potential event recognition module 802 is configured to input the environmental sound data into a pre-trained sound recognition model; and acquiring the potential risk event identified by the sound identification model by adopting the environmental sound data.
In this embodiment of the present invention, the reminding device may further include:
a sound data receiving module 804, configured to receive sound data to be played, sent by the earphone; the sound data to be played comprises voice data;
a second voice processing module 805, configured to perform voice processing on the voice data to be played;
the sound data sending module 806 is configured to send the sound data to be played after being subjected to the human voice processing to the earphone, where the earphone is configured to play the sound data to be played after being subjected to the human voice processing.
In this embodiment of the present invention, the reminding device may further include:
a navigation query information receiving module 807, configured to receive navigation query information sent by the headset, where the navigation query information includes the user direction information;
a navigation voice data generation module 808, configured to generate navigation voice data according to the user orientation information;
a navigation voice data sending module 809, configured to send the navigation voice data to the headset, where the headset is configured to play the navigation voice data to a user.
In this embodiment of the present invention, the navigation voice data generating module 808 is configured to obtain geographic location information of a user; and generating navigation voice data according to the user geographical position information and the user direction information.
In this embodiment of the present invention, the reminding device may further include:
a user geographic location information obtaining module 810, configured to obtain user geographic location information identifying when the potential risk event is generated;
and the reminding information sending module 811 is used for generating reminding information according to the user geographical position information and the potential risk event and sending the reminding information to the earphone.
For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.
Fig. 9 is a block diagram illustrating a structure of an earphone 900 for a reminder according to an exemplary embodiment. Referring to fig. 9, the headset 900 may include one or more of the following components: a processing component 902, a memory 904, a power component 906, a multimedia component 908, an audio component 910, an input/output (I/O) interface 912, a sensor component 914, and a communication component 916.
The processing component 902 generally controls overall operation of the headset 900, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. Processing element 902 may include one or more processors 920 to execute instructions to perform all or a portion of the steps of the methods described above. Further, processing component 902 can include one or more modules that facilitate interaction between processing component 902 and other components. For example, the processing component 902 can include a multimedia module to facilitate interaction between the multimedia component 908 and the processing component 902.
The memory 904 is configured to store various types of data to support operation at the headset 900. Examples of such data include instructions for any application or method operating on the headset 900, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 904 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
The power component 906 provides power to the various components of the headset 900. The power components 906 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the headset 900.
The multimedia component 908 comprises a screen providing an output interface between the headset 900 and the user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 908 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the headset 900 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
The audio component 910 is configured to output and/or input audio signals. For example, the audio component 910 includes a Microphone (MIC) configured to receive external audio signals when the headset 900 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 904 or transmitted via the communication component 916. In some embodiments, audio component 910 also includes a speaker for outputting audio signals.
I/O interface 912 provides an interface between processing component 902 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
The sensor assembly 914 includes one or more sensors for providing various aspects of state assessment for the headset 900. For example, the sensor assembly 914 may detect an open/closed state of the headset 900, the relative positioning of the components, such as the display and keypad of the headset 900, the sensor assembly 914 may also detect a change in the position of the headset 900 or one of the components of the headset 900, the presence or absence of user contact with the headset 900, orientation or acceleration/deceleration of the headset 900, and a change in the temperature of the headset 900. The sensor assembly 914 may include a proximity sensor configured to detect the presence of a nearby object in the absence of any physical contact. The sensor assembly 914 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 914 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 916 is configured to facilitate wired or wireless communication between the headset 900 and other devices. The headset 900 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication part 914 receives a broadcast signal or broadcast associated information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communications component 914 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the headset 900 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.
In an exemplary embodiment, a non-transitory computer readable storage medium comprising instructions, such as the memory 904 comprising instructions, executable by the processor 920 of the headset 900 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
A headset comprising a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by one or more processors the one or more programs including instructions for:
acquiring environmental sound data and sending the environmental sound data to a server;
receiving a potential risk event sent by the server, wherein the potential risk event is identified by the server according to the environmental sound data;
and carrying out voice reminding according to the potential risk event.
Optionally, the acquiring the environmental sound data includes:
acquiring user voice;
and starting or stopping collecting the environmental sound data according to the user voice.
Optionally, the acquiring the environmental sound data includes:
acquiring user geographical position information;
and starting or stopping collecting the environmental sound data according to the user geographical position information.
Optionally, the acquiring the user geographical location information includes:
and receiving the user geographical position information sent by the server.
Optionally, the earphone is in communication connection with a mobile terminal, and the acquiring the environmental sound data includes:
receiving a control instruction sent by the mobile terminal;
and starting or stopping collecting the environmental sound data by adopting the control instruction.
Optionally, the headset comprises two paired headsets; the acquiring of the environmental sound data comprises:
and starting a far-field pickup mode of at least one earphone to collect far-field sound data.
Optionally, further comprising instructions for:
starting a near-field pickup mode of one earphone to collect near-field sound data in the process of calling by adopting the earphone;
and carrying out call processing by adopting the near-field sound data.
Optionally, the performing an audio alert according to the risk potential event includes:
and playing a reminding sound corresponding to the potential risk event.
Optionally, further comprising instructions for:
if a potential risk event is identified and the headset is playing sound data, the volume of playing the sound data is reduced or the sound data is stopped.
Optionally, further comprising instructions for:
if a potential risk event is identified and the headset is engaged in a call, a predetermined telephone assistant is invoked to take over the call.
Optionally, further comprising instructions for:
and if the sound data to be played by the earphone comprises voice data, performing voice processing on the sound data to be played by the earphone according to the environment sound data.
Optionally, the performing, according to the environmental sound data, human sound processing on the sound data to be played by the earphone includes:
sending the sound data to be played by the earphone to the server, wherein the server is used for carrying out human voice processing on the sound data to be played by the earphone according to the environment sound data;
and receiving the voice data to be played, which is sent by the server and is subjected to the voice processing.
Optionally, further comprising instructions for:
acquiring user direction information, and playing navigation voice data according to the user direction information;
and when the potential risk event is acquired, adjusting navigation voice data according to the potential risk event.
Optionally, the playing navigation voice data according to the user orientation information includes:
acquiring user geographical position information;
and playing navigation voice data according to the user direction information and the user geographical position information.
Optionally, the playing navigation voice data according to the user orientation information includes:
sending navigation query information to the server, wherein the navigation query information comprises the user direction information;
receiving navigation voice data returned by the server and playing the navigation voice data to a user; the navigation voice data is generated by the server according to the user direction information.
Optionally, further comprising instructions for:
receiving and playing the reminding information sent by the server; the reminding information is generated by the server according to the potential risk event and the geographical position information of the user when the potential risk event is identified.
A non-transitory computer readable storage medium having instructions therein which, when executed by a processor of a headset, enable the headset to perform a method of alerting, the method comprising:
acquiring environmental sound data and sending the environmental sound data to a server;
receiving a potential risk event sent by the server, wherein the potential risk event is identified by the server according to the environmental sound data;
and carrying out voice reminding according to the potential risk event.
Optionally, the acquiring the environmental sound data includes:
acquiring user voice;
and starting or stopping collecting the environmental sound data according to the user voice.
Optionally, the acquiring the environmental sound data includes:
acquiring user geographical position information;
and starting or stopping collecting the environmental sound data according to the user geographical position information.
Optionally, the acquiring the user geographical location information includes:
and receiving the user geographical position information sent by the server.
Optionally, the earphone is in communication connection with a mobile terminal, and the acquiring the environmental sound data includes:
receiving a control instruction sent by the mobile terminal;
and starting or stopping collecting the environmental sound data by adopting the control instruction.
Optionally, the headset comprises two paired headsets; the acquiring of the environmental sound data comprises:
and starting a far-field pickup mode of at least one earphone to collect far-field sound data.
Optionally, the method further comprises:
starting a near-field pickup mode of one earphone to collect near-field sound data in the process of calling by adopting the earphone;
and carrying out call processing by adopting the near-field sound data.
Optionally, the performing an audio alert according to the risk potential event includes:
and playing a reminding sound corresponding to the potential risk event.
Optionally, the method further comprises:
if a potential risk event is identified and the headset is playing sound data, the volume of playing the sound data is reduced or the sound data is stopped.
Optionally, the method further comprises:
if a potential risk event is identified and the headset is engaged in a call, a predetermined telephone assistant is invoked to take over the call.
Optionally, the method further comprises:
and if the sound data to be played by the earphone comprises voice data, performing voice processing on the sound data to be played by the earphone according to the environment sound data.
Optionally, the performing, according to the environmental sound data, human sound processing on the sound data to be played by the earphone includes:
sending the sound data to be played by the earphone to the server, wherein the server is used for carrying out human voice processing on the sound data to be played by the earphone according to the environment sound data;
and receiving the voice data to be played, which is sent by the server and is subjected to the voice processing.
Optionally, the method further comprises:
acquiring user direction information, and playing navigation voice data according to the user direction information;
and when the potential risk event is acquired, adjusting navigation voice data according to the potential risk event.
Optionally, the playing navigation voice data according to the user orientation information includes:
acquiring user geographical position information;
and playing navigation voice data according to the user direction information and the user geographical position information.
Optionally, the playing navigation voice data according to the user orientation information includes:
sending navigation query information to the server, wherein the navigation query information comprises the user direction information;
receiving navigation voice data returned by the server and playing the navigation voice data to a user; the navigation voice data is generated by the server according to the user direction information.
Optionally, the method further comprises:
receiving and playing the reminding information sent by the server; the reminding information is generated by the server according to the potential risk event and the geographical position information of the user when the potential risk event is identified.
Fig. 10 is a schematic structural diagram of a server 1000 for reminders according to another exemplary embodiment of the present invention. The servers may vary widely by configuration or performance, and may include one or more Central Processing Units (CPUs) 1022 (e.g., one or more processors) and memory 1032, one or more storage media 1030 (e.g., one or more mass storage devices) storing applications 1042 or data 1044. Memory 1032 and storage medium 1030 may be, among other things, transient or persistent storage. The program stored on the storage medium 1030 may include one or more modules (not shown), each of which may include a series of instruction operations for the server. Still further, the central processor 1022 may be disposed in communication with the storage medium 1030, and execute a series of instruction operations in the storage medium 1030 on the server.
The server may also include one or more power supplies 1026, one or more wired or wireless network interfaces 1050, one or more input-output interfaces 1058, one or more keyboards 1056, and/or one or more operating systems 1041, such as Windows Server, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM, etc.
A server comprising memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by one or more processors the one or more programs including instructions for:
receiving environmental sound data sent by an earphone;
identifying a potential risk event in the environment from the environmental sound data;
transmitting the risk potential event to the headset; the earphone is used for carrying out sound reminding according to the potential risk event.
Optionally, the identifying a risk potential event in the environment from the environmental sound data includes:
inputting the environmental sound data into a pre-trained sound recognition model;
and acquiring the potential risk event identified by the sound identification model by adopting the environmental sound data.
Optionally, further comprising instructions for:
receiving sound data to be played sent by the earphone; the sound data to be played comprises voice data;
carrying out human voice processing on the voice data to be played;
and sending the voice data to be played after the voice processing to the earphone, wherein the earphone is used for playing the voice data to be played after the voice processing.
Optionally, further comprising instructions for:
receiving navigation inquiry information sent by the earphone, wherein the navigation inquiry information comprises the user direction information;
generating navigation voice data according to the user direction information;
and sending the navigation voice data to the earphone, wherein the earphone is used for playing the navigation voice data to a user.
Optionally, the generating navigation voice data according to the user orientation information includes:
acquiring user geographical position information;
and generating navigation voice data according to the user geographical position information and the user direction information.
Optionally, further comprising instructions for:
acquiring user geographical location information identifying when the potential risk event is generated;
and generating reminding information according to the user geographical position information and the potential risk event and sending the reminding information to the earphone.
A non-transitory computer readable storage medium in which instructions, when executed by a processor of a server, enable the server to perform a method of alerting, the method comprising:
receiving environmental sound data sent by an earphone;
identifying a potential risk event in the environment from the environmental sound data;
transmitting the risk potential event to the headset; the earphone is used for carrying out sound reminding according to the potential risk event.
Optionally, the identifying a risk potential event in the environment from the environmental sound data includes:
inputting the environmental sound data into a pre-trained sound recognition model;
and acquiring the potential risk event identified by the sound identification model by adopting the environmental sound data.
Optionally, the method further comprises:
receiving sound data to be played sent by the earphone; the sound data to be played comprises voice data;
carrying out human voice processing on the voice data to be played;
and sending the voice data to be played after the voice processing to the earphone, wherein the earphone is used for playing the voice data to be played after the voice processing.
Optionally, the method further comprises:
receiving navigation inquiry information sent by the earphone, wherein the navigation inquiry information comprises the user direction information;
generating navigation voice data according to the user direction information;
and sending the navigation voice data to the earphone, wherein the earphone is used for playing the navigation voice data to a user.
Optionally, the generating navigation voice data according to the user orientation information includes:
acquiring user geographical position information;
and generating navigation voice data according to the user geographical position information and the user direction information.
Optionally, the method further comprises:
acquiring user geographical location information identifying when the potential risk event is generated;
and generating reminding information according to the user geographical position information and the potential risk event and sending the reminding information to the earphone.
The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing terminal to cause a series of operational steps to be performed on the computer or other programmable terminal to produce a computer implemented process such that the instructions which execute on the computer or other programmable terminal provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications of these embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the embodiments of the invention.
Finally, it should also be noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or terminal that comprises the element.
The above detailed description is made on a reminding method, a reminding device, an earphone and a server provided by the present invention, and a specific example is applied in the text to explain the principle and the implementation of the present invention, and the description of the above embodiment is only used to help understanding the method and the core idea of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims (62)

1. A reminding method is applied to earphones which are in communication connection with a server, and comprises the following steps:
the earphone acquires environmental sound data and sends the environmental sound data to the server;
receiving a potential risk event sent by the server, wherein the potential risk event is identified by the server according to the environmental sound data;
performing voice reminding according to the potential risk event;
acquiring user direction information, and playing navigation voice data according to the user direction information;
and when a potential risk event is acquired, adjusting the navigation voice data according to the potential risk event.
2. The method of claim 1, wherein the obtaining ambient sound data comprises:
acquiring user voice;
and starting or stopping collecting the environmental sound data according to the user voice.
3. The method of claim 1, wherein the obtaining ambient sound data comprises:
acquiring user geographical position information;
and starting or stopping collecting the environmental sound data according to the user geographical position information.
4. The method of claim 3, wherein the obtaining the user geographical location information comprises:
and receiving the user geographical position information sent by the server.
5. The method of claim 1, wherein the headset is communicatively coupled to a mobile terminal, and wherein the obtaining the ambient sound data comprises:
receiving a control instruction sent by the mobile terminal;
and starting or stopping collecting the environmental sound data by adopting the control instruction.
6. The method of claim 1, wherein the headset comprises two headsets in pair; the acquiring of the environmental sound data comprises:
and starting a far-field pickup mode of at least one earphone to collect far-field sound data.
7. The method of claim 1, further comprising:
starting a near-field pickup mode of one earphone to collect near-field sound data in the process of calling by adopting the earphone;
and carrying out call processing by adopting the near-field sound data.
8. The method of claim 1, wherein the audible alert based on the risk potential event comprises:
and playing a reminding sound corresponding to the potential risk event.
9. The method of claim 1, further comprising:
if a potential risk event is identified and the headset is playing sound data, the volume of playing the sound data is reduced or the sound data is stopped.
10. The method of claim 1, further comprising:
if a potential risk event is identified and the headset is engaged in a call, a predetermined telephone assistant is invoked to take over the call.
11. The method of claim 1, further comprising:
and if the sound data to be played by the earphone comprises voice data, performing voice processing on the sound data to be played by the earphone according to the environment sound data.
12. The method according to claim 11, wherein the human voice processing the sound data to be played by the earphone according to the environmental sound data comprises:
sending the sound data to be played by the earphone to the server, wherein the server is used for carrying out human voice processing on the sound data to be played by the earphone according to the environment sound data;
and receiving the voice data to be played, which is sent by the server and is subjected to the voice processing.
13. The method of claim 1, wherein playing navigation voice data according to the user orientation information comprises:
acquiring user geographical position information;
and playing navigation voice data according to the user direction information and the user geographical position information.
14. The method of claim 13, wherein playing navigation voice data according to the user orientation information comprises:
sending navigation query information to the server, wherein the navigation query information comprises the user direction information;
receiving navigation voice data returned by the server and playing the navigation voice data to a user; the navigation voice data is generated by the server according to the user direction information.
15. The method of claim 1, further comprising:
receiving and playing the reminding information sent by the server; the reminding information is generated by the server according to the potential risk event and the geographical position information of the user when the potential risk event is identified.
16. A reminding method is applied to a server, the server is in communication connection with earphones, and the method comprises the following steps:
the server receives the environmental sound data sent by the earphone;
identifying a potential risk event in the environment from the environmental sound data;
transmitting the risk potential event to the headset; the earphone is used for carrying out sound reminding according to the potential risk event;
receiving navigation inquiry information sent by the earphone, wherein the navigation inquiry information comprises user direction information;
generating navigation voice data according to the user direction information;
sending the navigation voice data to the earphone, wherein the earphone is used for playing the navigation voice data to a user; the earphone is used for adjusting the navigation voice data according to the potential risk event when the potential risk event is acquired.
17. The method of claim 16, wherein identifying a risk potential event in an environment from the environmental sound data comprises:
inputting the environmental sound data into a pre-trained sound recognition model;
and acquiring the potential risk event identified by the sound identification model by adopting the environmental sound data.
18. The method of claim 16, further comprising:
receiving sound data to be played sent by the earphone; the sound data to be played comprises voice data;
carrying out human voice processing on the voice data to be played;
and sending the voice data to be played after the voice processing to the earphone, wherein the earphone is used for playing the voice data to be played after the voice processing.
19. The method of claim 16, wherein generating navigation voice data from the user position information comprises:
acquiring user geographical position information;
and generating navigation voice data according to the user geographical position information and the user direction information.
20. The method of claim 16, further comprising:
acquiring user geographical location information identifying when the potential risk event is generated;
and generating reminding information according to the user geographical position information and the potential risk event and sending the reminding information to the earphone.
21. A reminding device is applied to earphones which are in communication connection with a server, and comprises:
the environment sound data processing module is used for acquiring environment sound data and sending the environment sound data to the server;
the potential risk event receiving module is used for receiving a potential risk event sent by the server, and the potential risk event is identified by the server according to the environmental sound data;
the reminding module is used for carrying out voice reminding according to the potential risk event;
the navigation voice data playing module is used for acquiring the user direction information and playing navigation voice data according to the user direction information;
and the navigation voice data adjusting module is used for adjusting the navigation voice data according to the potential risk event when the potential risk event is acquired.
22. The warning device as claimed in claim 21, wherein the ambient sound data processing module is configured to obtain a user voice; and starting or stopping collecting the environmental sound data according to the user voice.
23. The warning device as claimed in claim 21, wherein the ambient sound data processing module is configured to obtain user geographical location information; and starting or stopping collecting the environmental sound data according to the user geographical position information.
24. The warning device as claimed in claim 23, wherein the ambient sound data processing module is configured to receive user geographical location information sent by the server.
25. The reminding device as claimed in claim 21, wherein the earphone is in communication connection with a mobile terminal, and the ambient sound data processing module is configured to receive a control command sent by the mobile terminal; and starting or stopping collecting the environmental sound data by adopting the control instruction.
26. A reminder device according to claim 21, wherein the headphones include two paired headphones; the environment sound data processing module is used for starting a far-field pickup mode of at least one earphone to collect far-field sound data.
27. A reminder device in accordance with claim 21, further comprising:
the near field sound data acquisition module is used for starting a near field pickup mode of one earphone to acquire near field sound data in the process of adopting the earphone to carry out communication;
and the call processing module is used for carrying out call processing by adopting the near-field sound data.
28. The reminder device of claim 21, wherein the reminder module is configured to play a reminder sound corresponding to the risk potential event.
29. A reminder device in accordance with claim 21, further comprising:
and the sound data adjusting module is used for reducing the volume of playing the sound data or stopping playing the sound data if the potential risk event is identified and the earphone plays the sound data.
30. A reminder device in accordance with claim 21, further comprising:
and the pickup module is used for calling a preset telephone assistant to pick up the call if the potential risk event is identified and the earphone is in call.
31. A reminder device in accordance with claim 21, further comprising:
and the first human voice processing module is used for performing human voice processing on the sound data to be played by the earphone according to the environment sound data if the sound data to be played by the earphone comprises human voice data.
32. The reminding device as claimed in claim 31, wherein the first human voice processing module is configured to send the sound data to be played by the headset to the server, and the server is configured to perform human voice processing on the sound data to be played by the headset according to the environmental sound data; and receiving the voice data to be played, which is sent by the server and is subjected to the voice processing.
33. The reminder device of claim 21, wherein the navigation voice data playback module is configured to obtain user geographical location information; and playing navigation voice data according to the user direction information and the user geographical position information.
34. The reminder device of claim 33, wherein the navigation voice data playback module is configured to send navigation query information to the server, the navigation query information including the user location information; receiving navigation voice data returned by the server and playing the navigation voice data to a user; the navigation voice data is generated by the server according to the user direction information.
35. A reminder device in accordance with claim 21, further comprising:
the reminding information processing module is used for receiving and playing the reminding information sent by the server; the reminding information is generated by the server according to the potential risk event and the geographical position information of the user when the potential risk event is identified.
36. The reminding device is applied to a server, the server is in communication connection with earphones, and the reminding device comprises:
the environment sound data receiving module is used for receiving the environment sound data sent by the earphone;
a risk potential event identification module for identifying risk potential events in the environment according to the environment sound data;
a risk potential event sending module for sending the risk potential event to the headset; the earphone is used for carrying out sound reminding according to the potential risk event;
the navigation query information receiving module is used for receiving navigation query information sent by the earphone, and the navigation query information comprises user direction information;
the navigation voice data generation module is used for generating navigation voice data according to the user direction information;
the navigation voice data sending module is used for sending the navigation voice data to the earphone, and the earphone is used for playing the navigation voice data to a user; the earphone is used for adjusting the navigation voice data according to the potential risk event when the potential risk event is acquired.
37. The reminder device of claim 36, wherein the risk potential event recognition module is configured to input the environmental sound data into a pre-trained sound recognition model; and acquiring the potential risk event identified by the sound identification model by adopting the environmental sound data.
38. A reminder device in accordance with claim 36, further comprising:
the sound data receiving module is used for receiving sound data to be played, which is sent by the earphone; the sound data to be played comprises voice data;
the second voice processing module is used for carrying out voice processing on the voice data to be played;
and the sound data sending module is used for sending the sound data to be played after the human voice processing to the earphone, and the earphone is used for playing the sound data to be played after the human voice processing.
39. The reminder device of claim 36, wherein the navigation voice data generation module is configured to obtain user geographical location information; and generating navigation voice data according to the user geographical position information and the user direction information.
40. A reminder device in accordance with claim 36, further comprising:
the user geographic position information acquisition module is used for acquiring and identifying the user geographic position information when the potential risk event is generated;
and the reminding information sending module is used for generating reminding information according to the user geographical position information and the potential risk event and sending the reminding information to the earphone.
41. An earphone comprising a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by one or more processors, the one or more programs comprising instructions for:
acquiring environmental sound data and sending the environmental sound data to a server;
receiving a potential risk event sent by the server, wherein the potential risk event is identified by the server according to the environmental sound data;
performing voice reminding according to the potential risk event;
further comprising instructions for:
acquiring user direction information, and playing navigation voice data according to the user direction information;
and when a potential risk event is acquired, adjusting the navigation voice data according to the potential risk event.
42. The headset of claim 41, wherein the obtaining ambient sound data comprises:
acquiring user voice;
and starting or stopping collecting the environmental sound data according to the user voice.
43. The headset of claim 41, wherein the obtaining ambient sound data comprises:
acquiring user geographical position information;
and starting or stopping collecting the environmental sound data according to the user geographical position information.
44. The headset of claim 43, wherein obtaining user geographic location information comprises:
and receiving the user geographical position information sent by the server.
45. The headset of claim 41, wherein the headset is communicatively coupled to a mobile terminal, and wherein the obtaining ambient sound data comprises:
receiving a control instruction sent by the mobile terminal;
and starting or stopping collecting the environmental sound data by adopting the control instruction.
46. The headset of claim 41, wherein the headset comprises two headsets in pair; the acquiring of the environmental sound data comprises:
and starting a far-field pickup mode of at least one earphone to collect far-field sound data.
47. The headset of claim 41, further comprising instructions for:
starting a near-field pickup mode of one earphone to collect near-field sound data in the process of calling by adopting the earphone;
and carrying out call processing by adopting the near-field sound data.
48. The headset of claim 41, wherein the audible alert based on the risk potential event comprises:
and playing a reminding sound corresponding to the potential risk event.
49. The headset of claim 41, further comprising instructions for:
if a potential risk event is identified and the headset is playing sound data, the volume of playing the sound data is reduced or the sound data is stopped.
50. The headset of claim 41, further comprising instructions for:
if a potential risk event is identified and the headset is engaged in a call, a predetermined telephone assistant is invoked to take over the call.
51. The headset of claim 41, further comprising instructions for:
and if the sound data to be played by the earphone comprises voice data, performing voice processing on the sound data to be played by the earphone according to the environment sound data.
52. The headset of claim 51, wherein the human voice processing of the sound data to be played by the headset according to the environmental sound data comprises:
sending the sound data to be played by the earphone to the server, wherein the server is used for carrying out human voice processing on the sound data to be played by the earphone according to the environment sound data;
and receiving the voice data to be played, which is sent by the server and is subjected to the voice processing.
53. The headset of claim 41, wherein playing navigation voice data based on the user orientation information comprises:
acquiring user geographical position information;
and playing navigation voice data according to the user direction information and the user geographical position information.
54. The headset of claim 42, wherein playing navigation voice data based on the user orientation information comprises:
sending navigation query information to the server, wherein the navigation query information comprises the user direction information;
receiving navigation voice data returned by the server and playing the navigation voice data to a user; the navigation voice data is generated by the server according to the user direction information.
55. The headset of claim 51, further comprising instructions for:
receiving and playing the reminding information sent by the server; the reminding information is generated by the server according to the potential risk event and the geographical position information of the user when the potential risk event is identified.
56. A server comprising a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured for execution by one or more processors the one or more programs including instructions for:
receiving environmental sound data sent by an earphone;
identifying a potential risk event in the environment from the environmental sound data;
transmitting the risk potential event to the headset; the earphone is used for carrying out sound reminding according to the potential risk event;
further comprising instructions for:
receiving navigation inquiry information sent by the earphone, wherein the navigation inquiry information comprises user direction information;
generating navigation voice data according to the user direction information;
sending the navigation voice data to the earphone, wherein the earphone is used for playing the navigation voice data to a user; the earphone is used for adjusting the navigation voice data according to the potential risk event when the potential risk event is acquired.
57. The server according to claim 56, wherein said identifying a risk potential event in an environment from said environmental sound data comprises:
inputting the environmental sound data into a pre-trained sound recognition model;
and acquiring the potential risk event identified by the sound identification model by adopting the environmental sound data.
58. The server according to claim 56, further comprising instructions for:
receiving sound data to be played sent by the earphone; the sound data to be played comprises voice data;
carrying out human voice processing on the voice data to be played;
and sending the voice data to be played after the voice processing to the earphone, wherein the earphone is used for playing the voice data to be played after the voice processing.
59. The server according to claim 56, wherein the generating navigation voice data based on the user orientation information comprises:
acquiring user geographical position information;
and generating navigation voice data according to the user geographical position information and the user direction information.
60. The server according to claim 56, further comprising instructions for:
acquiring user geographical location information identifying when the potential risk event is generated;
and generating reminding information according to the user geographical position information and the potential risk event and sending the reminding information to the earphone.
61. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the reminder method according to any one of claims 1 to 15.
62. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the reminder method according to any one of claims 16 to 20.
CN202010508211.1A 2020-06-05 2020-06-05 Reminding method and device, earphone and server Active CN111741405B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010508211.1A CN111741405B (en) 2020-06-05 2020-06-05 Reminding method and device, earphone and server

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010508211.1A CN111741405B (en) 2020-06-05 2020-06-05 Reminding method and device, earphone and server

Publications (2)

Publication Number Publication Date
CN111741405A CN111741405A (en) 2020-10-02
CN111741405B true CN111741405B (en) 2021-12-21

Family

ID=72648343

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010508211.1A Active CN111741405B (en) 2020-06-05 2020-06-05 Reminding method and device, earphone and server

Country Status (1)

Country Link
CN (1) CN111741405B (en)

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1897054A (en) * 2005-07-14 2007-01-17 松下电器产业株式会社 Device and method for transmitting alarm according various acoustic signals
EP2451187A2 (en) * 2010-11-05 2012-05-09 Sony Ericsson Mobile Communications AB Headset with accelerometers to determine direction and movements of user head and method
CN104244131A (en) * 2014-09-10 2014-12-24 青岛歌尔声学科技有限公司 Indoor voice navigation method and Bluetooth earphone
CN104394491A (en) * 2014-12-09 2015-03-04 北京奇虎科技有限公司 Intelligent headset, cloud server, volume adjustment method and volume adjustment system
CN105611443A (en) * 2015-12-29 2016-05-25 歌尔声学股份有限公司 Control method and system of earphone and earphone
CN107613113A (en) * 2017-09-05 2018-01-19 深圳天珑无线科技有限公司 A kind of headset mode control method, device and computer-readable recording medium
CN208622228U (en) * 2018-07-10 2019-03-19 福建师范大学福清分校 A kind of traffic accident transmitting warning system based on Zigbee
WO2019067443A1 (en) * 2017-09-27 2019-04-04 Zermatt Technologies Llc Spatial audio navigation
CN110139178A (en) * 2018-02-02 2019-08-16 中兴通讯股份有限公司 A kind of method, apparatus, equipment and the storage medium of determining terminal moving direction
CN110198381A (en) * 2019-04-28 2019-09-03 北京蓦然认知科技有限公司 A kind of method and device of identification AI incoming call
CN110493681A (en) * 2019-08-09 2019-11-22 无锡中感微电子股份有限公司 Headphone device and its control method with full natural user interface
CN110708625A (en) * 2019-09-25 2020-01-17 华东师范大学 Intelligent terminal-based environment sound suppression and enhancement adjustable earphone system and method

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106685929A (en) * 2016-12-06 2017-05-17 南京金雀智能科技有限公司 Wearable Bluetooth video earphone based communication processing system and method
CN110236895A (en) * 2019-05-10 2019-09-17 苏州米特希赛尔人工智能有限公司 AI blind men navigation spectacles

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1897054A (en) * 2005-07-14 2007-01-17 松下电器产业株式会社 Device and method for transmitting alarm according various acoustic signals
EP2451187A2 (en) * 2010-11-05 2012-05-09 Sony Ericsson Mobile Communications AB Headset with accelerometers to determine direction and movements of user head and method
CN104244131A (en) * 2014-09-10 2014-12-24 青岛歌尔声学科技有限公司 Indoor voice navigation method and Bluetooth earphone
CN104394491A (en) * 2014-12-09 2015-03-04 北京奇虎科技有限公司 Intelligent headset, cloud server, volume adjustment method and volume adjustment system
CN105611443A (en) * 2015-12-29 2016-05-25 歌尔声学股份有限公司 Control method and system of earphone and earphone
CN107613113A (en) * 2017-09-05 2018-01-19 深圳天珑无线科技有限公司 A kind of headset mode control method, device and computer-readable recording medium
WO2019067443A1 (en) * 2017-09-27 2019-04-04 Zermatt Technologies Llc Spatial audio navigation
CN110139178A (en) * 2018-02-02 2019-08-16 中兴通讯股份有限公司 A kind of method, apparatus, equipment and the storage medium of determining terminal moving direction
CN208622228U (en) * 2018-07-10 2019-03-19 福建师范大学福清分校 A kind of traffic accident transmitting warning system based on Zigbee
CN110198381A (en) * 2019-04-28 2019-09-03 北京蓦然认知科技有限公司 A kind of method and device of identification AI incoming call
CN110493681A (en) * 2019-08-09 2019-11-22 无锡中感微电子股份有限公司 Headphone device and its control method with full natural user interface
CN110708625A (en) * 2019-09-25 2020-01-17 华东师范大学 Intelligent terminal-based environment sound suppression and enhancement adjustable earphone system and method

Also Published As

Publication number Publication date
CN111741405A (en) 2020-10-02

Similar Documents

Publication Publication Date Title
CN111696577B (en) Reminding method, reminding device and earphone
CN105205955B (en) A kind of method and apparatus sending out standby signal
CN105261227B (en) Arrival prompting method and device
CN107978316A (en) The method and device of control terminal
CN109353297B (en) Volume adjustment method, device and computer readable storage medium
CN109151719B (en) Secure boot method, apparatus and storage medium
CN105206113A (en) Method and device for early warning during meeting at curves
US11057728B2 (en) Information processing apparatus, information processing method, and program
CN104008664A (en) Method and device for obtaining road condition information
CN110708630B (en) Method, device and equipment for controlling earphone and storage medium
CN104977010A (en) Navigation prompting method and apparatus
CN108806674A (en) A kind of positioning navigation method, device and electronic equipment
CN104867349A (en) Information prompting method and information prompting device
CN105653236A (en) Sound volume control method and device and mobile terminal
CN105139874A (en) Navigation prompt method and apparatus
CN111739530A (en) Interaction method and device, earphone and earphone storage device
CN106126058A (en) Based reminding method and device
EP3162082B1 (en) A hearing device, method and system for automatically enabling monitoring mode within said hearing device
CN111696578B (en) Reminding method and device, earphone and earphone storage device
US20230381025A1 (en) Situational awareness, communication, and safety in hearing protection and communication systems
CN111741405B (en) Reminding method and device, earphone and server
CN111739528A (en) Interaction method and device and earphone
JP2015138534A (en) Electronic device
JP2016095705A (en) Unclear item resolution system
CN105530563A (en) Method and device for volume control

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20210706

Address after: 100084 Room 802, 8th floor, building 9, yard 1, Zhongguancun East Road, Haidian District, Beijing

Applicant after: Beijing Sogou Intelligent Technology Co.,Ltd.

Address before: 100084. Room 9, floor 01, cyber building, building 9, building 1, Zhongguancun East Road, Haidian District, Beijing

Applicant before: BEIJING SOGOU TECHNOLOGY DEVELOPMENT Co.,Ltd.

GR01 Patent grant
GR01 Patent grant