CN111696578B - Reminding method and device, earphone and earphone storage device - Google Patents

Reminding method and device, earphone and earphone storage device Download PDF

Info

Publication number
CN111696578B
CN111696578B CN202010507513.7A CN202010507513A CN111696578B CN 111696578 B CN111696578 B CN 111696578B CN 202010507513 A CN202010507513 A CN 202010507513A CN 111696578 B CN111696578 B CN 111696578B
Authority
CN
China
Prior art keywords
sound data
earphone
user
voice
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010507513.7A
Other languages
Chinese (zh)
Other versions
CN111696578A (en
Inventor
赵楠
崔文华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Sogou Intelligent Technology Co Ltd
Original Assignee
Beijing Sogou Intelligent Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Sogou Intelligent Technology Co Ltd filed Critical Beijing Sogou Intelligent Technology Co Ltd
Priority to CN202010507513.7A priority Critical patent/CN111696578B/en
Publication of CN111696578A publication Critical patent/CN111696578A/en
Application granted granted Critical
Publication of CN111696578B publication Critical patent/CN111696578B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/48Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
    • G10L25/51Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
    • AHUMAN NECESSITIES
    • A45HAND OR TRAVELLING ARTICLES
    • A45CPURSES; LUGGAGE; HAND CARRIED BAGS
    • A45C11/00Receptacles for purposes not provided for in groups A45C1/00-A45C9/00
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/18Status alarms
    • G08B21/24Reminder alarms, e.g. anti-loss alarms
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B3/00Audible signalling systems; Audible personal calling systems
    • G08B3/10Audible signalling systems; Audible personal calling systems using electric transmission; using electromagnetic transmission
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones
    • H04R1/10Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H04R1/1091Details not provided for in groups H04R1/1008 - H04R1/1083
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00Circuits for transducers, loudspeakers or microphones
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02Services making use of location information
    • H04W4/025Services making use of location information using location based information parameters
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02Services making use of location information
    • H04W4/029Location-based management or tracking services
    • AHUMAN NECESSITIES
    • A45HAND OR TRAVELLING ARTICLES
    • A45CPURSES; LUGGAGE; HAND CARRIED BAGS
    • A45C11/00Receptacles for purposes not provided for in groups A45C1/00-A45C9/00
    • A45C2011/001Receptacles for purposes not provided for in groups A45C1/00-A45C9/00 for portable audio devices, e.g. headphones or MP3-players
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2201/00Details of transducers, loudspeakers or microphones covered by H04R1/00 but not provided for in any of its subgroups
    • H04R2201/10Details of earpieces, attachments therefor, earphones or monophonic headphones covered by H04R1/10 but not provided for in any of its subgroups

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • Acoustics & Sound (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Health & Medical Sciences (AREA)
  • Electromagnetism (AREA)
  • Computational Linguistics (AREA)
  • Navigation (AREA)
  • Telephone Function (AREA)

Abstract

The embodiment of the invention provides a reminding method, a reminding device, an earphone and an earphone containing device, wherein the earphone is in communication connection with the earphone containing device, and the method comprises the following steps: the earphone receives a potential risk event sent by the earphone containing device, and the potential risk event is identified by the earphone containing device according to environmental sound data; and carrying out sound reminding according to the potential risk event, so that the earphone can timely inform the user of the danger existing in the environment in the process of wearing the earphone, and the user can timely avoid the risk.

Description

Reminding method and device, earphone and earphone storage device
Technical Field
The invention relates to the technical field of electronic equipment, in particular to a reminding method, a reminding device, an earphone and an earphone storage device.
Background
With the continuous development of science and technology, electronic technology has also been rapidly developed, and electronic devices are more and more various, so that people are more and more accustomed to using various electronic devices in life.
Headphones are portable electronic devices often used in people's daily lives, and users can use headphones to listen to songs or talk over voice while often performing some activities. For example, headphones are used during running, walking, riding, etc. activities.
However, many people wear headphones outdoors, often neglect the change of surrounding vehicles, pedestrians and even traffic lights, and potential risks are easily generated.
Disclosure of Invention
The embodiment of the invention provides a reminding method, a reminding device, an earphone and an earphone storage device.
The embodiment of the invention discloses a reminding method which is applied to an earphone, wherein the earphone is in communication connection with an earphone storage device, and the method comprises the following steps:
the earphone receives a potential risk event sent by the earphone containing device, and the potential risk event is identified by the earphone containing device according to environmental sound data;
and carrying out sound reminding according to the potential risk event.
Optionally, the method further comprises:
and collecting the environmental sound data and sending the environmental sound data to the earphone storage device.
Optionally, the collecting environmental sound data includes:
acquiring user voice;
and starting or stopping collecting the environmental sound data according to the user voice.
Optionally, the collecting environmental sound data includes:
acquiring geographic position information of a user;
and starting or stopping collecting the environmental sound data according to the geographical position information of the user.
Optionally, the acquiring the geographic location information of the user includes:
And receiving the geographic position information of the user sent by the earphone storage device.
Optionally, the earphone is in communication connection with the mobile terminal, and the collecting environmental sound data includes:
receiving a control instruction sent by the mobile terminal;
and starting or stopping collecting the environmental sound data by adopting the control instruction.
Optionally, the headset comprises two paired headsets; the collecting environmental sound data includes:
far-field sound data are collected by starting a far-field pickup mode of at least one earphone.
Optionally, the method further comprises:
in the process of adopting the earphone to carry out communication, starting a near-field pickup mode of at least one earphone to collect near-field sound data;
and adopting the near-field sound data to carry out call processing.
Optionally, the performing an acoustic alert according to the potentially dangerous event includes:
and playing reminding sound corresponding to the potential risk event.
Optionally, the method further comprises:
if a potential risk event is identified and the earphone is playing sound data, the volume of playing the sound data is reduced or the sound data is stopped.
Optionally, the method further comprises:
and if the potential risk event is identified and the earphone is in communication, calling a preset telephone assistant to connect the communication instead.
Optionally, the method further comprises:
and if the sound data to be played by the earphone comprises voice data, performing voice processing on the sound data to be played by the earphone according to the environment voice data.
Optionally, the performing voice processing on the sound data to be played by the earphone according to the environmental sound data includes:
the sound data to be played by the earphone is sent to the earphone storage device, and the box is used for carrying out voice processing on the sound data to be played by the earphone according to the environmental sound data;
and receiving the voice data to be played, which is sent by the earphone storage device and subjected to human voice processing.
Optionally, the method further comprises:
acquiring user azimuth information, and playing navigation voice data according to the user azimuth information;
when a potential risk event is acquired, adjusting navigation voice data according to the potential risk event.
Optionally, the playing the navigation voice data according to the user azimuth information includes:
acquiring geographic position information of a user;
and playing navigation voice data according to the user azimuth information and the user geographic position information.
Optionally, the playing the navigation voice data according to the user azimuth information includes:
Transmitting navigation inquiry information to the earphone storage device, wherein the navigation inquiry information comprises the user azimuth information;
and receiving and playing the navigation voice data returned by the earphone storage device.
The embodiment of the invention also discloses a reminding method which is applied to the earphone containing device, wherein the earphone containing device is in communication connection with the earphone, and the method comprises the following steps:
the earphone storage device acquires environmental sound data;
identifying potential risk events in the environment according to the environmental sound data;
transmitting the potentially risky event to the headset; the earphone is used for carrying out sound reminding according to the potential risk event.
Optionally, the acquiring the environmental sound data includes:
environmental sound data in a current environment is collected.
Optionally, the acquiring the environmental sound data includes:
and receiving the environmental sound data collected by the earphone.
Optionally, the collecting environmental sound data in the current environment includes:
acquiring user voice;
and starting or stopping collecting the environmental sound data in the current environment according to the user voice.
Optionally, the collecting environmental sound data in the current environment includes:
acquiring geographic position information of a user;
And starting or stopping collecting the environmental sound data in the current environment according to the geographical position information of the user.
Optionally, the earphone storage device is in communication connection with the mobile terminal, and the collecting of the environmental sound data in the current environment includes:
receiving a control instruction sent by the mobile terminal;
and starting or stopping collecting the environmental sound data in the current environment by adopting the control instruction.
Optionally, the collecting environmental sound data in the current environment includes:
starting an omnidirectional far-field pickup mode, and collecting far-field sound data in a 360-degree range;
or starting a remote pointing pickup mode to collect far-field sound data of a pointing range.
Optionally, the identifying a potential risk event in the environment according to the environmental sound data includes:
inputting the environmental sound data into a pre-trained voice recognition model;
and acquiring potential risk events which are acquired by the voice recognition model and recognized by the environmental sound data.
Optionally, the earphone receiving device is communicatively connected with a server, and the identifying the potential risk event in the environment according to the environmental sound data includes:
transmitting the environmental sound data to a server;
And receiving the sent potential risk event, wherein the potential risk event is identified by the server according to the environmental sound data.
Optionally, the method further comprises:
receiving sound data to be played sent by the earphone; the sound data to be played comprises voice data;
performing voice processing on the voice data to be played;
and sending the sound data to be played after the voice processing to the earphone, wherein the earphone is used for playing the sound data to be played after the voice processing.
Optionally, the voice processing for the sound data to be played includes:
the sound data to be played is sent to the server, and the server is used for carrying out voice processing on the sound data to be played according to the environment sound data;
and receiving the voice data to be played, which is sent by the server and subjected to the voice processing.
Optionally, the method further comprises:
receiving navigation inquiry information sent by the earphone, wherein the navigation inquiry information comprises the user azimuth information;
acquiring geographic position information of a user;
and generating navigation voice data according to the user azimuth information and the user geographic position information and sending the navigation voice data to the earphone, wherein the earphone is used for playing the navigation voice data.
Optionally, the generating navigation voice data according to the user azimuth information and the user geographic position information includes:
transmitting the navigation inquiry information to a server, wherein the navigation inquiry information comprises the user azimuth information and the user geographic position information;
and receiving the navigation voice data sent by the server, wherein the navigation voice data is generated by the server according to the user azimuth information and the user geographic position information.
The embodiment of the invention also discloses a reminding device which is applied to the earphone, wherein the earphone is in communication connection with the earphone storage device, and the reminding device comprises:
the risk potential event receiving module is used for receiving a risk potential event sent by the earphone containing device, and the risk potential event is identified by the earphone containing device according to the environmental sound data;
and the reminding module is used for carrying out sound reminding according to the potential risk event.
Optionally, the method further comprises:
and the environmental sound data processing module is used for collecting the environmental sound data and sending the environmental sound data to the earphone storage device.
Optionally, the environmental sound data processing module is used for acquiring user voice;
And starting or stopping collecting the environmental sound data according to the user voice.
Optionally, the environmental sound data processing module is used for acquiring geographic position information of the user; and starting or stopping collecting the environmental sound data according to the geographical position information of the user.
Optionally, the environmental sound data processing module is configured to receive the geographic location information of the user sent by the earphone storage device.
Optionally, the earphone is in communication connection with the mobile terminal, and the environmental sound data processing module is used for receiving a control instruction sent by the mobile terminal; and starting or stopping collecting the environmental sound data by adopting the control instruction.
Optionally, the headset comprises two paired headsets; the environmental sound data processing module is used for starting a far-field pickup mode of at least one earphone to collect far-field sound data.
Optionally, the method further comprises:
the near-field sound data acquisition module is used for starting a near-field pickup mode of at least one earphone to acquire near-field sound data in the process of adopting the earphone to carry out communication;
and the call processing module is used for performing call processing by adopting the near-field sound data.
Optionally, the reminding module is configured to play a reminding sound corresponding to the potentially dangerous event.
Optionally, the method further comprises:
and the sound data adjusting module is used for reducing the volume of playing the sound data or stopping playing the sound data if the potential risk event is identified and the earphone is playing the sound data.
Optionally, the method further comprises:
and the substituting module is used for calling a preset telephone assistant to substitute for the call if the potential risk event is identified and the earphone is in the call.
Optionally, the method further comprises:
and the first voice processing module is used for performing voice processing on the voice data to be played by the earphone according to the environment voice data if the voice data to be played by the earphone comprises voice data.
Optionally, the first voice processing module is configured to send the sound data to be played by the earphone to the earphone storage device, and the box is configured to perform voice processing on the sound data to be played by the earphone according to the environmental sound data; and receiving the voice data to be played, which is sent by the earphone storage device and subjected to human voice processing.
Optionally, the method further comprises:
the navigation voice data playing module is used for acquiring the user azimuth information and playing the navigation voice data according to the user azimuth information;
And the navigation voice data adjustment module is used for adjusting the navigation voice data according to the potential risk event when the potential risk event is acquired.
Optionally, the navigation voice data playing module is used for acquiring geographic position information of the user; and playing navigation voice data according to the user azimuth information and the user geographic position information.
Optionally, the navigation voice data playing module is configured to send navigation query information to the earphone storage device, where the navigation query information includes the user azimuth information; and receiving and playing the navigation voice data returned by the earphone storage device.
The embodiment of the invention also discloses a reminding device which is applied to the earphone containing device, wherein the earphone containing device is in communication connection with the earphone, and the reminding device comprises:
the environment sound data acquisition module is used for acquiring environment sound data;
the potential risk event identification module is used for identifying potential risk events in the environment according to the environmental sound data;
a potentially dangerous event sending module, configured to send the potentially dangerous event to the earphone; the earphone is used for carrying out sound reminding according to the potential risk event.
Optionally, the environmental sound data acquisition module is configured to acquire environmental sound data in a current environment.
Optionally, the environmental sound data acquisition module is configured to receive environmental sound data collected by the earphone.
Optionally, the environmental sound data acquisition module is used for acquiring user voice; and starting or stopping collecting the environmental sound data in the current environment according to the user voice.
Optionally, the environmental sound data acquisition module is used for acquiring geographic position information of the user; and starting or stopping collecting the environmental sound data in the current environment according to the geographical position information of the user.
Optionally, the earphone storage device is in communication connection with a mobile terminal, and the environmental sound data acquisition module is used for receiving a control instruction sent by the mobile terminal; and starting or stopping collecting the environmental sound data in the current environment by adopting the control instruction.
Optionally, the environmental sound data acquisition module is used for starting an omnidirectional far-field pickup mode and acquiring far-field sound data in a 360-degree range; or starting a remote pointing pickup mode to collect far-field sound data of a pointing range.
Optionally, the risk potential event recognition module is configured to input the environmental sound data into a pre-trained voice recognition model; and acquiring potential risk events which are acquired by the voice recognition model and recognized by the environmental sound data.
Optionally, the earphone storage device is in communication connection with a server, and the risk potential event identification module is used for sending the environmental sound data to the server; and receiving the sent potential risk event, wherein the potential risk event is identified by the server according to the environmental sound data.
Optionally, the method further comprises:
the sound data receiving module is used for receiving the sound data to be played, which is sent by the earphone; the sound data to be played comprises voice data;
the second voice processing module is used for performing voice processing on the voice data to be played;
the sound data transmitting module is used for transmitting the sound data to be played after the voice processing to the earphone, and the earphone is used for playing the sound data to be played after the voice processing.
Optionally, the second voice processing module is configured to send the voice data to be played to the server, where the server is configured to perform voice processing on the voice data to be played according to the environmental sound data; and receiving the voice data to be played, which is sent by the server and subjected to the voice processing.
Optionally, the method further comprises:
The navigation inquiry information receiving module is used for receiving navigation inquiry information sent by the earphone, wherein the navigation inquiry information comprises the user azimuth information;
the geographic position information acquisition module is used for acquiring geographic position information of a user;
and the navigation voice data processing module is used for generating navigation voice data according to the user azimuth information and the user geographic position information and sending the navigation voice data to the earphone, and the earphone is used for playing the navigation voice data.
Optionally, the navigation voice data processing module is configured to send the navigation query information to a server, where the navigation query information includes the user location information and the user geographic location information; and receiving the navigation voice data sent by the server, wherein the navigation voice data is generated by the server according to the user azimuth information and the user geographic position information.
The embodiment of the invention also discloses a headset, which comprises a memory and one or more programs, wherein the one or more programs are stored in the memory and are configured to be executed by one or more processors, and the one or more programs comprise instructions for:
Receiving a potential risk event sent by an earphone storage device, wherein the potential risk event is identified by the earphone storage device according to environmental sound data;
and carrying out sound reminding according to the potential risk event.
Optionally, further comprising instructions for:
and collecting the environmental sound data and sending the environmental sound data to the earphone storage device.
Optionally, the collecting environmental sound data includes:
acquiring user voice;
and starting or stopping collecting the environmental sound data according to the user voice.
Optionally, the collecting environmental sound data includes:
acquiring geographic position information of a user;
and starting or stopping collecting the environmental sound data according to the geographical position information of the user.
Optionally, the acquiring the geographic location information of the user includes:
and receiving the geographic position information of the user sent by the earphone storage device.
Optionally, the earphone is in communication connection with the mobile terminal, and the collecting environmental sound data includes:
receiving a control instruction sent by the mobile terminal;
and starting or stopping collecting the environmental sound data by adopting the control instruction.
Optionally, the headset comprises two paired headsets; the collecting environmental sound data includes:
Far-field sound data are collected by starting a far-field pickup mode of at least one earphone.
Optionally, further comprising instructions for:
in the process of adopting the earphone to carry out communication, starting a near-field pickup mode of at least one earphone to collect near-field sound data;
and adopting the near-field sound data to carry out call processing.
Optionally, the performing an acoustic alert according to the potentially dangerous event includes:
and playing reminding sound corresponding to the potential risk event.
Optionally, further comprising instructions for:
if a potential risk event is identified and the earphone is playing sound data, the volume of playing the sound data is reduced or the sound data is stopped.
Optionally, further comprising instructions for:
and if the potential risk event is identified and the earphone is in communication, calling a preset telephone assistant to connect the communication instead.
Optionally, further comprising instructions for:
and if the sound data to be played by the earphone comprises voice data, performing voice processing on the sound data to be played by the earphone according to the environment voice data.
Optionally, the performing voice processing on the sound data to be played by the earphone according to the environmental sound data includes:
the sound data to be played by the earphone is sent to the earphone storage device, and the box is used for carrying out voice processing on the sound data to be played by the earphone according to the environmental sound data;
and receiving the voice data to be played, which is sent by the earphone storage device and subjected to human voice processing.
Optionally, further comprising instructions for:
acquiring user azimuth information, and playing navigation voice data according to the user azimuth information;
when a potential risk event is acquired, adjusting navigation voice data according to the potential risk event.
Optionally, the playing the navigation voice data according to the user azimuth information includes:
acquiring geographic position information of a user;
and playing navigation voice data according to the user azimuth information and the user geographic position information.
Optionally, the playing the navigation voice data according to the user azimuth information includes:
transmitting navigation inquiry information to the earphone storage device, wherein the navigation inquiry information comprises the user azimuth information;
And receiving and playing the navigation voice data returned by the earphone storage device.
The embodiment of the invention also discloses a headset containing device, which comprises a memory and one or more programs, wherein the one or more programs are stored in the memory and are configured to be executed by one or more processors, and the one or more programs comprise instructions for:
acquiring environmental sound data;
identifying potential risk events in the environment according to the environmental sound data;
sending the potential risk event to a headset; the earphone is used for carrying out sound reminding according to the potential risk event.
Optionally, the acquiring the environmental sound data includes:
environmental sound data in a current environment is collected.
Optionally, the acquiring the environmental sound data includes:
and receiving the environmental sound data collected by the earphone.
Optionally, the collecting environmental sound data in the current environment includes:
acquiring user voice;
and starting or stopping collecting the environmental sound data in the current environment according to the user voice.
Optionally, the collecting environmental sound data in the current environment includes:
Acquiring geographic position information of a user;
and starting or stopping collecting the environmental sound data in the current environment according to the geographical position information of the user.
Optionally, the earphone storage device is in communication connection with the mobile terminal, and the collecting of the environmental sound data in the current environment includes:
receiving a control instruction sent by the mobile terminal;
and starting or stopping collecting the environmental sound data in the current environment by adopting the control instruction.
Optionally, the collecting environmental sound data in the current environment includes:
starting an omnidirectional far-field pickup mode, and collecting far-field sound data in a 360-degree range;
or starting a remote pointing pickup mode to collect far-field sound data of a pointing range.
Optionally, the identifying a potential risk event in the environment according to the environmental sound data includes:
inputting the environmental sound data into a pre-trained voice recognition model;
and acquiring potential risk events which are acquired by the voice recognition model and recognized by the environmental sound data.
Optionally, the earphone receiving device is communicatively connected with a server, and the identifying the potential risk event in the environment according to the environmental sound data includes:
transmitting the environmental sound data to a server;
And receiving the sent potential risk event, wherein the potential risk event is identified by the server according to the environmental sound data.
Optionally, further comprising instructions for:
receiving sound data to be played sent by the earphone; the sound data to be played comprises voice data;
performing voice processing on the voice data to be played;
and sending the sound data to be played after the voice processing to the earphone, wherein the earphone is used for playing the sound data to be played after the voice processing.
Optionally, the voice processing for the sound data to be played includes:
the sound data to be played is sent to the server, and the server is used for carrying out voice processing on the sound data to be played according to the environment sound data;
and receiving the voice data to be played, which is sent by the server and subjected to the voice processing.
Optionally, further comprising instructions for:
receiving navigation inquiry information sent by the earphone, wherein the navigation inquiry information comprises the user azimuth information;
acquiring geographic position information of a user;
and generating navigation voice data according to the user azimuth information and the user geographic position information and sending the navigation voice data to the earphone, wherein the earphone is used for playing the navigation voice data.
Optionally, the generating navigation voice data according to the user azimuth information and the user geographic position information includes:
transmitting the navigation inquiry information to a server, wherein the navigation inquiry information comprises the user azimuth information and the user geographic position information;
and receiving the navigation voice data sent by the server, wherein the navigation voice data is generated by the server according to the user azimuth information and the user geographic position information.
The embodiment of the invention also discloses a computer readable storage medium, wherein the computer readable storage medium stores a computer program, and the computer program realizes the steps of the reminding method according to any one of the above steps when being executed by a processor.
The embodiment of the invention has the following advantages:
according to the embodiment of the invention, the earphone storage device can identify potential risk events in the environment according to the environmental sound data, and the earphone can remind the user of sound according to the potential risk events sent by the earphone storage device, so that the earphone can timely inform the user of dangers in the environment during the process of wearing the earphone, and the user can timely avoid the dangers.
Drawings
FIG. 1 is a flowchart illustrating steps of a first embodiment of a reminding method according to the present invention;
FIG. 2 is a flowchart illustrating steps of a second embodiment of a reminding method according to the present invention;
FIG. 3 is a flow chart of steps of a third embodiment of a reminding method according to the invention;
FIG. 4 is a flowchart illustrating steps of a fourth embodiment of a reminding method according to the present invention;
FIG. 5 is a flowchart showing steps of a fifth embodiment of a reminding method according to the present invention;
FIG. 6 is a block diagram of a reminder device according to an embodiment of the present invention;
FIG. 7 is a block diagram illustrating a second embodiment of a reminder device according to the present invention;
FIG. 8 is a block diagram of a third embodiment of a reminder device in accordance with the present invention;
FIG. 9 is a block diagram of a fourth embodiment of a reminder device in accordance with the present invention;
FIG. 10 is a block diagram illustrating the structure of an electronic device with reminders, according to an exemplary embodiment.
Detailed Description
In order that the above-recited objects, features and advantages of the present invention will become more readily apparent, a more particular description of the invention will be rendered by reference to the appended drawings and appended detailed description.
Referring to fig. 1, a flowchart illustrating steps of a first embodiment of a reminding method according to the present invention is applied to a headset, where the headset is communicatively connected to a headset receiving device, and the method specifically includes the steps of:
Step 101, the earphone receives a potential risk event sent by the earphone containing device, wherein the potential risk event is identified by the earphone containing device according to environmental sound data.
The earphone is portable electronic equipment frequently used in daily life, and can have a playing function, a sound pickup function and a communication function. The user can listen to songs or make telephone communication using headphones.
The earphone receiving device is a device matched with the earphone, and is generally used for storing the earphone and charging the wireless earphone. Compared with the earphone, the earphone containing device has less high requirements on volume and weight, so that more computing chips can be arranged in the earphone containing device.
The earphone storage device can acquire environmental sound data in the environment, and identify potential risk events in the environment according to the environmental sound data. The earphone storage device can collect the environmental sound data through the local sound collection module, and the environmental sound data can also be collected by the earphone and then sent to the earphone storage device.
The ambient sound data refers to sound data around the current environment of the user. In an outdoor environment, the environmental sound data is complex and can comprise a plurality of superimposed sounds, such as car sounds, train sounds, pedestrian footstep sounds, bicycle sounds, prompting sounds when traffic lights are switched, insect-ringing bird sounds and the like.
The earphone receiving device can adopt a pre-trained voice recognition model to recognize potential risk events in the environment, and the voice recognition model can be a model obtained by training by collecting a large amount of environment sound data as a training sample.
A potentially risky event in an environment is an event that is potentially risky, which may include: the vehicles approach in the preset range of the user, the vehicles whistle in the preset range, the traffic lights are about to switch, pedestrians are in the preset range, and the like.
And 102, carrying out sound reminding according to the potential risk event.
The earphone can play reminding sounds corresponding to the potential risk events. For example, if a potential risk event is that a vehicle is approaching, or that a vehicle is sounding a horn, a warning sound of "attention to the vehicle" may be played. For another example, if the potential risk event is a loud voice call, a warning sound of "notice pedestrian call" may be played.
According to the embodiment of the invention, the earphone storage device can identify potential risk events in the environment according to the environmental sound data, and the earphone can remind the user of sound according to the potential risk events sent by the earphone storage device, so that the earphone can timely inform the user of dangers in the environment during the process of wearing the earphone, and the user can timely avoid the dangers.
In the embodiment of the invention, when a user uses the earphone to communicate, the near-field pickup mode of at least one earphone can be started to collect near-field sound data.
Under the condition that the earphone is in communication connection with the earphone storage device, the earphone can only be in charge of starting a near-field pickup mode to collect near-field sound data. The earphone storage device can be responsible for starting a far-field pickup module and collecting far-field sound data.
In the embodiment of the invention, if a potential risk event is identified and the earphone is playing sound data, the volume of playing the sound data is reduced or the sound data is stopped. For example, during the course of playing a song by the headphones, if a potential risk event is identified, the headphones reduce the sound of playing the song, or stop playing the song. For another example, during a conversation using the headset, if a potential risk event is identified, the headset reduces the volume of the conversation voice.
In the embodiment of the invention, if a potential risk event is identified and the earphone is in communication, a preset telephone assistant is called to connect the communication instead. Specifically, the earphone can communicate with the mobile terminal, the communication process of the mobile terminal can be taken over by the earphone, and if a potential risk event is identified in the communication process of using the earphone, the telephone assistant can be called to connect instead, and the telephone content can be automatically replied. The telephone assistant may be a program installed in the earphone or a program installed in the mobile terminal.
In the embodiment of the invention, if the sound data to be played by the earphone comprises voice data, voice processing is performed on the sound data to be played by the earphone according to the environmental sound data.
The voice processing refers to processing of enhancing voice effect on voice data, for example, automatically adjusting noise reduction according to environmental voice data, increasing gain multiple according to the environmental voice data, and the like, so that voice is clearer. For users with hearing impairment, clear human voice can be heard.
In one example, voice data to be played may be humanly processed locally at the headphones.
In another aspect, the step of performing, by the earphone receiving device, voice processing on the voice data to be played by the earphone according to the environmental sound data may include: the sound data to be played by the earphone is sent to the earphone storage device, and the box is used for carrying out voice processing on the sound data to be played by the earphone according to the environmental sound data; and receiving the voice data to be played, which is sent by the earphone storage device and subjected to human voice processing.
Referring to fig. 2, a flowchart of steps of a second embodiment of a reminding method of the present invention is shown, the method is applied to a headset, the headset is communicatively connected with a headset receiving device, and the method specifically includes the following steps:
And step 201, collecting environmental sound data and sending the environmental sound data to the earphone storage device.
In the embodiment of the invention, the earphone is provided with a sound collection module, such as a microphone, a microphone array and the like, and can collect surrounding environmental sound data. The earphone can start or stop collecting the environmental sound data according to the control of the user.
In one example, the headset may obtain user speech, and begin or stop gathering ambient sound data based on the user speech.
In another example, the headset may also obtain current user geographic location information, and begin or stop collecting ambient sound data based on the current user geographic location information. For example, when the user geographical location information indicates that the user is on a sidewalk or traffic light, the acquisition of ambient sound data is automatically turned on. And stopping collecting the environmental sound data when the geographical position information of the user indicates that the user is indoors.
The headset may obtain current user geographical location information, e.g., the headset detects the current user geographical location information. The headset housing device may be provided with positioning capabilities, such as a GPS module, or by communicating with a base station for positioning, the headset may obtain current user geographical location information detected by the headset housing device. The earphone can also be in communication connection with the mobile terminal, and current geographic position information is acquired from the mobile terminal.
In another example, the earphone may also receive a control instruction sent by the mobile terminal, and start or stop collecting the environmental sound data according to the control instruction. For example, the control command is a start acquisition command, and the earphone starts to acquire the environmental sound data. For example, the mobile terminal may be equipped with an APP for controlling the headset, and the user may perform a control operation on the APP, so that the mobile terminal sends a control instruction to the headset.
In an embodiment of the present invention, the headphones may include two headphones paired, such as a left headphone and a right headphone. Both earphones can be provided with a sound collection module, and the sound collection module can be controlled to pick up sound according to different pickup modes. The pickup mode of the headset may include a far field pickup mode and a near field pickup mode. Far-field sound data are collected in a far-field sound pickup mode, and the sound pickup range of the far-field (far-filtered) sound pickup mode is a range beyond 1 meter, so that sound data within a distance of 5 meters can be clearly collected. Near field sound data is collected by a near field sound pickup mode, and the sound pickup range of the near field sound pickup mode is within 20 cm. The ambient sound data includes far field sound data and near field sound data.
In one example, the headset may be turned on or off in accordance with the user's voice Cheng Sheyin mode, such as when the user's voice is "turn on remote pickup," "collect remote sound," then the remote pickup mode of the headset may be turned on. Specifically, the earphone may have a voice recognition function, and the earphone recognizes a user's voice and turns on or off a remote pickup mode according to a voice recognition result.
In another example, the headset may also turn on or off the remote pickup mode based on current geographic location information.
In another example, the earphone may further collect far-field sound data by turning on a far-field pickup mode with receiving a control command sent by the mobile terminal and using the control command. An application program APP for the earphone can be installed on the mobile terminal, and a user can click a button for opening or closing a remote pickup mode on the APP, so that the mobile terminal sends a corresponding control instruction to the earphone.
Step 202, receiving a potential risk event sent by the earphone containing device, wherein the potential risk event is identified by the earphone containing device according to environmental sound data.
And 203, carrying out sound reminding according to the potential risk event.
The earphone can play reminding sounds corresponding to the potential risk events.
In the embodiment of the invention, if the earphone is playing the sound data when the potential risk event is identified, the volume of playing the sound data is reduced or the sound data is stopped.
In the embodiment of the invention, if the sound data to be played by the earphone comprises voice data, voice processing is performed on the sound data to be played by the earphone according to the environmental sound data.
In one example, voice data to be played may be humanly processed locally at the headphones.
In another aspect, the step of performing, by the earphone receiving device, voice processing on the voice data to be played by the earphone according to the environmental sound data may include: the sound data to be played by the earphone is sent to the earphone storage device, and the box is used for carrying out voice processing on the sound data to be played by the earphone according to the environmental sound data; and receiving the voice data to be played, which is sent by the earphone storage device and subjected to human voice processing.
In the embodiment of the invention, the earphone can acquire the environmental sound data and send the environmental sound data to the earphone storage device, and the earphone storage device can identify the potential risk event in the environment according to the environmental sound data and send the potential risk event to the earphone. The earphone can carry out sound reminding to the user according to the potential risk event, so that the user can timely inform the danger existing in the user environment when wearing the earphone, and the user can timely avoid the risk.
Referring to fig. 3, a flowchart illustrating steps of a third embodiment of a reminding method according to the present invention is shown, the method is applied to a headset, the headset is communicatively connected with a headset receiving device, and the method specifically includes the following steps:
Step 301, obtaining user azimuth information, and playing navigation voice data according to the user azimuth information.
The user azimuth information refers to the front direction of the user, and in the embodiment of the invention, the earphone can be provided with an azimuth sensor, and the azimuth sensor can detect the user azimuth information in real time when the user wears the earphone.
In practice, the user is often not good at distinguishing the direction on the screen map, and under the circumstance of wearing the earphone, the earphone can judge the direction of the user in real time, so that the user can more accurately perceive the direction and combine the real space, and the user does not need to distinguish which direction is going through the screen.
In the embodiment of the invention, the earphone can acquire the current user geographic position information, for example, the earphone detects the current user geographic position information. As another example, a headset may be communicatively coupled with the mobile device. The mobile device may be provided with positioning capabilities, such as setting up a GPS module, or by communicating with a base station for positioning, the headset may obtain current user geographical location information detected by the mobile device.
In one example, the step of playing navigation voice data according to the user orientation information may include: acquiring geographic position information of a user; and playing navigation voice data according to the user azimuth information and the user geographic position information. In the interaction process, navigation voice can be played according to real-time user azimuth information and real-time user geographic position information. In the embodiment of the invention, the earphone can acquire the geographic position of the user from the earphone storage device.
In another example, the step of playing navigation voice data according to the user orientation information may include: transmitting the navigation inquiry information to the earphone storage device, wherein the navigation inquiry information comprises the user azimuth information; and receiving and playing the navigation voice data returned by the earphone storage device.
The earphone storage device can generate navigation voice data according to the user azimuth information and the user geographic position information query, and the user geographic position information can be carried in the navigation query information or can be determined by the earphone storage device.
Step 302, receiving a potential risk event sent by the earphone containing device, wherein the potential risk event is identified by the earphone containing device according to environmental sound data.
Step 303, when a potential risk event is acquired, adjusting navigation voice data according to the potential risk event.
When the potential risk event is identified, the earphone can adjust the navigation voice data according to the potential risk event, and guide the user to avoid the potential risk event. For example, when a potential risk event is recognition that a pedestrian is approaching in front of the user's left, the navigational speech may be "walk to the right".
For another example, the user may have a traffic light in front of the direction of travel, and the navigation route may be to travel to the opposite road by the traffic light. When the potential risk event is that the front traffic light is switched to the red light, the navigation voice can be "please walk along the current direction, not pass through the front traffic light, and can walk to the opposite road at the next traffic light".
And step 304, carrying out sound reminding according to the potential risk event.
The earphone can play reminding sounds corresponding to the potential risk events.
In the embodiment of the invention, the earphone can navigate according to the azimuth information of the user and play the navigation voice data. In the navigation process, when a potential risk event sent by the earphone storage device is received, navigation voice data are adjusted according to the potential risk event, so that the earphone can timely inform a user of dangers existing in the environment of the user in the process of wearing the earphone, and the user can timely avoid the dangers.
Referring to fig. 4, a flowchart of steps of a fourth embodiment of a reminding method according to the present invention is shown, the method is applied to a headset receiving device, and the headset receiving device is communicatively connected with a headset, and the method specifically may include the following steps:
In step 401, the earphone storage device acquires environmental sound data.
In the embodiment of the invention, the earphone storage device can acquire the environmental sound data.
In one example, the headset housing device may employ a local sound collection module to collect ambient sound data of the current environment. In another example, the headset housing device may receive ambient sound data collected by the headset.
Step 402, identifying a potential risk event in the environment according to the environmental sound data.
The earphone receiving device can adopt a pre-trained voice recognition model to recognize potential risk events in the environment, and the voice recognition model can be a model obtained by training by collecting a large amount of environment sound data as a training sample.
In one example, the headset housing device may be in communication with a server. Compared with the earphone containing device, the processing capacity of the server is better, and the server can process algorithms with higher demands on the running capacity.
The headset receiving device is communicatively coupled to a server, and the step of identifying a potentially risky event in the environment based on the ambient sound data may include: transmitting the environmental sound data to a server; and receiving the sent potential risk event, wherein the potential risk event is identified by the server according to the environmental sound data.
Step 403, sending the potential risk event to the earphone; the earphone is used for carrying out sound reminding according to the potential risk event.
In the embodiment of the invention, the earphone storage device can acquire the environmental sound data, identify the potential risk event in the environment according to the environmental sound data, and send the potential risk event to the earphone. The earphone can carry out sound reminding to the user according to the potential risk event, so that the user can timely inform the danger existing in the user environment when wearing the earphone, and the user can timely avoid the risk.
In the embodiment of the invention, if the sound data to be played by the earphone includes the voice data, the earphone may send the sound data to be played to the earphone storage device. The earphone containing device can receive sound data to be played, which are sent by the earphone; the sound data to be played comprises voice data; the earphone storage device performs voice processing on the voice data to be played; and sending the sound data to be played after the human voice processing to the earphone, wherein the earphone can play the sound data to be played after the human voice processing.
In one example, the step of performing the voice processing on the sound data to be played may include: the sound data to be played is sent to the server, and the server is used for carrying out voice processing on the sound data to be played according to the environment sound data; and receiving the voice data to be played, which is sent by the server and subjected to the voice processing.
In the embodiment of the invention, the earphone can acquire the user azimuth information for voice navigation, and can send navigation inquiry information to the earphone accommodating device, and the earphone accommodating device receives the navigation inquiry information sent by the earphone, wherein the navigation inquiry information comprises the user azimuth information; acquiring geographic position information of a user; and generating navigation voice data according to the user azimuth information and the user geographic position information and sending the navigation voice data to the earphone so as to enable the earphone to play the navigation voice data.
In one example, the step of generating navigation voice data from the user location information and the user geographic location information may include: transmitting the navigation inquiry information to a server, wherein the navigation inquiry information comprises the user azimuth information and the user geographic position information; and receiving the navigation voice data sent by the server, wherein the navigation voice data is generated by the server according to the user azimuth information and the user geographic position information.
Referring to fig. 5, a flowchart of steps of a fifth embodiment of a reminding method according to the present invention is shown, the method is applied to a headset receiving device, and the headset receiving device is communicatively connected with a headset, and the method specifically may include the following steps:
In step 501, ambient sound data in a current environment is collected.
In the embodiment of the invention, the earphone containing device is provided with a sound collecting module, such as a microphone, a microphone array and the like, and can collect surrounding environmental sound data. The earphone storage device can start or stop collecting the environmental sound data according to the control of a user.
In one example, the headset receiving device may obtain user speech; and starting or stopping collecting the environmental sound data in the current environment according to the user voice.
In another example, the headset receiving device may obtain user geographic location information; and starting or stopping collecting the environmental sound data in the current environment according to the geographical position information of the user. For example, when the user geographical location information indicates that the user is on a sidewalk or traffic light, the acquisition of ambient sound data is automatically turned on. And stopping collecting the environmental sound data when the geographical position information of the user indicates that the user is indoors.
In another example, the earphone storage device may be communicatively connected to the mobile terminal, and the earphone storage device may further receive a control instruction sent by the mobile terminal, and start or stop collecting the environmental sound data according to the control instruction. For example, the control command is a start acquisition command, and the earphone starts to acquire the environmental sound data.
In the embodiment of the invention, the earphone storage device comprises two pickup modes, namely an omnidirectional far-field pickup mode and a remote-direction pickup mode. Under the omnidirectional far-field pickup mode, the earphone storage device can collect far-field sound data in a 360-degree range. In the remote pointing pickup mode, the earphone receiving device can collect far-field sound data of a pointing range.
The step of collecting environmental sound data in the current environment may include: starting an omnidirectional far-field pickup mode, and collecting far-field sound data in a 360-degree range; or starting a remote pointing pickup mode to collect far-field sound data of a pointing range.
Step 502, identifying a potential risk event in the environment according to the environmental sound data.
Specifically, the earphone storage device may input the environmental sound data into a pre-trained voice recognition model; and acquiring a potential risk event which is obtained by the voice recognition model and recognized by adopting the environmental sound data. The voice recognition model may be a model trained using a collection of a large amount of ambient sound data as training samples.
Step 503, sending the potential risk event to the earphone; the earphone is used for carrying out sound reminding according to the potential risk event.
In the embodiment of the invention, the earphone storage device can collect the environmental sound data in the current environment, identify the potential risk event in the environment according to the environmental sound data, and send the potential risk event to the earphone. The earphone can carry out sound reminding to the user according to the potential risk event, so that the user can timely inform the danger existing in the user environment when wearing the earphone, and the user can timely avoid the risk.
It should be noted that, for simplicity of description, the method embodiments are shown as a series of acts, but it should be understood by those skilled in the art that the embodiments are not limited by the order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred embodiments, and that the acts are not necessarily required by the embodiments of the invention.
Referring to fig. 6, a block diagram of a first embodiment of a reminding device according to the present invention is shown, where the reminding device is applied to an earphone, and the earphone is communicatively connected to an earphone storage device, and the reminding device may specifically include the following modules:
A risk potential event receiving module 601, configured to receive a risk potential event sent by the earphone storage device, where the risk potential event is identified by the earphone storage device according to environmental sound data;
and the reminding module 602 is configured to perform an audio reminding according to the potential risk event.
Referring to fig. 7, a block diagram of a second embodiment of a reminding device according to the present invention is shown, where the reminding device is applied to an earphone, and the earphone is communicatively connected to an earphone storage device, and the reminding device may specifically include the following modules:
a risk potential event receiving module 701, configured to receive a risk potential event sent by the earphone storage device, where the risk potential event is identified by the earphone storage device according to environmental sound data;
and the reminding module 702 is used for carrying out sound reminding according to the potential risk event.
In an embodiment of the present invention, the reminding device may further include:
the environmental sound data processing module 703 is configured to collect environmental sound data and send the environmental sound data to the earphone storage device.
In the embodiment of the present invention, the environmental sound data processing module 703 is configured to obtain a user's voice;
and starting or stopping collecting the environmental sound data according to the user voice.
In the embodiment of the present invention, the environmental sound data processing module 703 is configured to obtain geographic location information of a user; and starting or stopping collecting the environmental sound data according to the geographical position information of the user.
In the embodiment of the present invention, the environmental sound data processing module 703 is configured to receive the geographic location information of the user sent by the earphone storage device.
In the embodiment of the present invention, the earphone is in communication connection with a mobile terminal, and the environmental sound data processing module 703 is configured to receive a control instruction sent by the mobile terminal; and starting or stopping collecting the environmental sound data by adopting the control instruction.
In an embodiment of the present invention, the earphone includes two earphones paired; the environmental sound data processing module 703 is configured to start a far-field pickup mode of at least one earphone to collect far-field sound data.
In an embodiment of the present invention, the reminding device further includes:
the near-field sound data acquisition module 704 is configured to start a near-field pickup mode of at least one earphone to acquire near-field sound data in a process of performing a call by using the earphone;
and a call processing module 705, configured to perform call processing by using the near-field sound data.
In the embodiment of the present invention, the reminding module 702 is configured to play a reminding sound corresponding to the potentially dangerous event.
In an embodiment of the present invention, the reminding device may further include:
the sound data adjustment module 706 is configured to, if a potentially dangerous event is identified and the earphone is playing sound data, reduce the volume of playing the sound data or stop playing the sound data.
In an embodiment of the present invention, the reminding device may further include:
and the surrogate connection module 707 is configured to invoke a preset telephone assistant to surrogate the call if a potential risk event is identified and the headset is in a call.
In an embodiment of the present invention, the reminding device may further include:
the first voice processing module 708 is configured to perform voice processing on the voice data to be played by the earphone according to the environmental sound data if the voice data to be played by the earphone includes voice data.
In the embodiment of the present invention, the first voice processing module 708 is configured to send the sound data to be played by the earphone to the earphone storage device, and the box is configured to perform voice processing on the sound data to be played by the earphone according to the environmental sound data; and receiving the voice data to be played, which is sent by the earphone storage device and subjected to human voice processing.
In an embodiment of the present invention, the reminding device further includes:
a navigation voice data playing module 709, configured to obtain user location information, and play navigation voice data according to the user location information;
the navigation voice data adjustment module 710 is configured to adjust the navigation voice data according to the potentially risky event when the potentially risky event is acquired.
In the embodiment of the present invention, the navigation voice data playing module 709 is configured to obtain geographic location information of a user; and playing navigation voice data according to the user azimuth information and the user geographic position information.
In the embodiment of the present invention, the navigation voice data playing module 709 is configured to send navigation query information to the earphone storage device, where the navigation query information includes the user azimuth information; and receiving and playing the navigation voice data returned by the earphone storage device.
Referring to fig. 8, there is shown a block diagram of a third embodiment of a reminder device according to the present invention, where the reminder device is applied to an earphone receiving device, and the earphone receiving device is communicatively connected to an earphone, and the reminder device may specifically include the following modules:
an environmental sound data acquisition module 801, configured to acquire environmental sound data;
A risk potential event identification module 802, configured to identify a risk potential event in an environment according to the environmental sound data;
a potentially risky event sending module 803 configured to send the potentially risky event to the earphone; the earphone is used for carrying out sound reminding according to the potential risk event.
Referring to fig. 9, there is shown a block diagram of a fourth embodiment of a reminder device according to the present invention, where the reminder device is applied to an earphone receiving device, and the earphone receiving device is communicatively connected to an earphone, and the reminder device may specifically include the following modules:
the environmental sound data acquisition module 901 is configured to acquire environmental sound data;
a risk potential event identification module 902, configured to identify a risk potential event in an environment according to the environmental sound data;
a risk potential event sending module 903, configured to send the risk potential event to the earphone; the earphone is used for carrying out sound reminding according to the potential risk event.
In the embodiment of the present invention, the environmental sound data acquisition module 901 is configured to acquire environmental sound data in a current environment.
In the embodiment of the present invention, the environmental sound data obtaining module 901 is configured to receive environmental sound data collected by the earphone.
In the embodiment of the present invention, the environmental sound data obtaining module 901 is configured to obtain a user's voice; and starting or stopping collecting the environmental sound data in the current environment according to the user voice.
In the embodiment of the present invention, the environmental sound data acquisition module 901 is configured to acquire geographic location information of a user; and starting or stopping collecting the environmental sound data in the current environment according to the geographical position information of the user.
In the embodiment of the present invention, the earphone storage device is in communication connection with a mobile terminal, and the environmental sound data acquisition module 901 is configured to receive a control instruction sent by the mobile terminal; and starting or stopping collecting the environmental sound data in the current environment by adopting the control instruction.
In the embodiment of the present invention, the environmental sound data acquisition module 901 is configured to start an omnidirectional far-field pickup mode, and collect far-field sound data in a 360-degree range; or starting a remote pointing pickup mode to collect far-field sound data of a pointing range.
In an embodiment of the present invention, the risk potential event recognition module 902 is configured to input the environmental sound data into a pre-trained voice recognition model; and acquiring potential risk events which are acquired by the voice recognition model and recognized by the environmental sound data.
In the embodiment of the present invention, the earphone storage device is communicatively connected to a server, and the risk potential event identification module 902 is configured to send the environmental sound data to the server; and receiving the sent potential risk event, wherein the potential risk event is identified by the server according to the environmental sound data.
In an embodiment of the present invention, the reminding device further includes:
a sound data receiving module 904, configured to receive sound data to be played sent by the earphone; the sound data to be played comprises voice data;
a second voice processing module 905, configured to perform voice processing on the voice data to be played;
the sound data sending module 906 is configured to send sound data to be played after the voice processing to the earphone, where the earphone is configured to play the sound data to be played after the voice processing.
In this embodiment of the present invention, the second voice processing module 905 is configured to send the voice data to be played to the server, where the server is configured to perform voice processing on the voice data to be played according to the environmental sound data; and receiving the voice data to be played, which is sent by the server and subjected to the voice processing.
In an embodiment of the present invention, the reminding device may further include:
a navigation inquiry information receiving module 907, configured to receive navigation inquiry information sent by the earphone, where the navigation inquiry information includes the user azimuth information;
a geographic location information acquisition module 908 for acquiring geographic location information of a user;
and the navigation voice data processing module 909 is configured to generate navigation voice data according to the user azimuth information and the user geographic location information, and send the generated navigation voice data to the earphone, where the earphone is configured to play the navigation voice data.
In the embodiment of the present invention, the navigation voice data processing module 909 is configured to send the navigation query information to a server, where the navigation query information includes the user location information and the user geographic location information; and receiving the navigation voice data sent by the server, wherein the navigation voice data is generated by the server according to the user azimuth information and the user geographic position information.
For the device embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, and reference is made to the description of the method embodiments for relevant points.
Fig. 10 is a block diagram illustrating a configuration of an electronic device 1000 with alerts, according to an example embodiment. For example, the electronic device 1000 may be a headset, a headset housing device, or the like.
Referring to fig. 10, an electronic device 1000 may include one or more of the following components: a processing component 1002, a memory 1004, a power component 1006, a multimedia component 1008, an audio component 1010, an input/output (I/O) interface 1012, a sensor component 1014, and a communication component 1016.
The processing component 1002 generally controls overall operation of the electronic device 1000, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing element 1002 may include one or more processors 1020 to execute instructions to perform all or part of the steps of the methods described above. Further, the processing component 1002 can include one or more modules that facilitate interaction between the processing component 1002 and other components. For example, the processing component 1002 may include a multimedia module to facilitate interaction between the multimedia component 1008 and the processing component 1002.
The memory 1004 is configured to store various types of data to support operations at the device 1000. Examples of such data include instructions for any application or method operating on the electronic device 1000, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 1004 may be implemented by any type or combination of volatile or nonvolatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.
The power component 1006 provides power to the various components of the electronic device 1000. Power component 1006 can include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for electronic device 1000.
The multimedia component 1008 includes a screen between the electronic device 1000 and the user that provides an output interface. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may sense not only the boundary of a touch or slide action, but also the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia assembly 1008 includes a front-facing camera and/or a rear-facing camera. When the electronic device 1000 is in an operational mode, such as a shooting mode or a video mode, the front-facing camera and/or the rear-facing camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have focal length and optical zoom capabilities.
The audio component 1010 is configured to output and/or input audio signals. For example, the audio component 1010 includes a Microphone (MIC) configured to receive external audio signals when the electronic device 1000 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may be further stored in memory 1004 or transmitted via communication component 1016. In some embodiments, the audio component 1010 further comprises a speaker for outputting audio signals.
The I/O interface 1012 provides an interface between the processing assembly 1002 and peripheral interface modules, which may be a keyboard, click wheel, buttons, and the like. These buttons may include, but are not limited to: homepage button, volume button, start button, and lock button.
The sensor assembly 1014 includes one or more sensors for providing status assessment of various aspects of the electronic device 1000. For example, the sensor assembly 1014 may detect an on/off state of the device 1000, a relative positioning of components such as a display and keypad of the electronic device 1000, the sensor assembly 1014 may also detect a change in position of the electronic device 1000 or a component of the electronic device 1000, the presence or absence of a user's contact with the electronic device 1000, an orientation or acceleration/deceleration of the electronic device 1000, and a change in temperature of the electronic device 1000. The sensor assembly 1014 may include a proximity sensor configured to detect the presence of nearby objects in the absence of any physical contact. The sensor assembly 1014 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 1014 can also include an acceleration sensor, a gyroscopic sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 1016 is configured to facilitate communication between the electronic device 1000 and other devices, either wired or wireless. The electronic device 1000 may access a wireless network based on a communication standard, such as WiFi,2G, or 3G, or a combination thereof. In one exemplary embodiment, the communication part 1014 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 1014 further includes a Near Field Communication (NFC) module to facilitate short range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra Wideband (UWB) technology, bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the electronic device 1000 may be implemented by one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic elements for executing the methods described above.
A headset comprising a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by one or more processors, the one or more programs comprising instructions for:
Receiving a potential risk event sent by an earphone storage device, wherein the potential risk event is identified by the earphone storage device according to environmental sound data;
and carrying out sound reminding according to the potential risk event.
Optionally, further comprising instructions for:
and collecting the environmental sound data and sending the environmental sound data to the earphone storage device.
Optionally, the collecting environmental sound data includes:
acquiring user voice;
and starting or stopping collecting the environmental sound data according to the user voice.
Optionally, the collecting environmental sound data includes:
acquiring geographic position information of a user;
and starting or stopping collecting the environmental sound data according to the geographical position information of the user.
Optionally, the acquiring the geographic location information of the user includes:
and receiving the geographic position information of the user sent by the earphone storage device.
Optionally, the earphone is in communication connection with the mobile terminal, and the collecting environmental sound data includes:
receiving a control instruction sent by the mobile terminal;
and starting or stopping collecting the environmental sound data by adopting the control instruction.
Optionally, the headset comprises two paired headsets; the collecting environmental sound data includes:
Far-field sound data are collected by starting a far-field pickup mode of at least one earphone.
Optionally, further comprising instructions for:
in the process of adopting the earphone to carry out communication, starting a near-field pickup mode of at least one earphone to collect near-field sound data;
and adopting the near-field sound data to carry out call processing.
Optionally, the performing an acoustic alert according to the potentially dangerous event includes:
and playing reminding sound corresponding to the potential risk event.
Optionally, further comprising instructions for:
if a potential risk event is identified and the earphone is playing sound data, the volume of playing the sound data is reduced or the sound data is stopped.
Optionally, further comprising instructions for:
and if the potential risk event is identified and the earphone is in communication, calling a preset telephone assistant to connect the communication instead.
Optionally, further comprising instructions for:
and if the sound data to be played by the earphone comprises voice data, performing voice processing on the sound data to be played by the earphone according to the environment voice data.
Optionally, the performing voice processing on the sound data to be played by the earphone according to the environmental sound data includes:
the sound data to be played by the earphone is sent to the earphone storage device, and the box is used for carrying out voice processing on the sound data to be played by the earphone according to the environmental sound data;
and receiving the voice data to be played, which is sent by the earphone storage device and subjected to human voice processing.
Optionally, further comprising instructions for:
acquiring user azimuth information, and playing navigation voice data according to the user azimuth information;
when a potential risk event is acquired, adjusting navigation voice data according to the potential risk event.
Optionally, the playing the navigation voice data according to the user azimuth information includes:
acquiring geographic position information of a user;
and playing navigation voice data according to the user azimuth information and the user geographic position information.
Optionally, the playing the navigation voice data according to the user azimuth information includes:
transmitting navigation inquiry information to the earphone storage device, wherein the navigation inquiry information comprises the user azimuth information;
And receiving and playing the navigation voice data returned by the earphone storage device.
An earphone receiving device comprising a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by one or more processors, the one or more programs comprising instructions for:
acquiring environmental sound data;
identifying potential risk events in the environment according to the environmental sound data;
sending the potential risk event to a headset; the earphone is used for carrying out sound reminding according to the potential risk event.
Optionally, the acquiring the environmental sound data includes:
environmental sound data in a current environment is collected.
Optionally, the acquiring the environmental sound data includes:
and receiving the environmental sound data collected by the earphone.
Optionally, the collecting environmental sound data in the current environment includes:
acquiring user voice;
and starting or stopping collecting the environmental sound data in the current environment according to the user voice.
Optionally, the collecting environmental sound data in the current environment includes:
acquiring geographic position information of a user;
And starting or stopping collecting the environmental sound data in the current environment according to the geographical position information of the user.
Optionally, the earphone storage device is in communication connection with the mobile terminal, and the collecting of the environmental sound data in the current environment includes:
receiving a control instruction sent by the mobile terminal;
and starting or stopping collecting the environmental sound data in the current environment by adopting the control instruction.
Optionally, the collecting environmental sound data in the current environment includes:
starting an omnidirectional far-field pickup mode, and collecting far-field sound data in a 360-degree range;
or starting a remote pointing pickup mode to collect far-field sound data of a pointing range.
Optionally, the identifying a potential risk event in the environment according to the environmental sound data includes:
inputting the environmental sound data into a pre-trained voice recognition model;
and acquiring potential risk events which are acquired by the voice recognition model and recognized by the environmental sound data.
Optionally, the earphone receiving device is communicatively connected with a server, and the identifying the potential risk event in the environment according to the environmental sound data includes:
transmitting the environmental sound data to a server;
And receiving the sent potential risk event, wherein the potential risk event is identified by the server according to the environmental sound data.
Optionally, further comprising instructions for:
receiving sound data to be played sent by the earphone; the sound data to be played comprises voice data;
performing voice processing on the voice data to be played;
and sending the sound data to be played after the voice processing to the earphone, wherein the earphone is used for playing the sound data to be played after the voice processing.
Optionally, the voice processing for the sound data to be played includes:
the sound data to be played is sent to the server, and the server is used for carrying out voice processing on the sound data to be played according to the environment sound data;
and receiving the voice data to be played, which is sent by the server and subjected to the voice processing.
Optionally, further comprising instructions for:
receiving navigation inquiry information sent by the earphone, wherein the navigation inquiry information comprises the user azimuth information;
acquiring geographic position information of a user;
and generating navigation voice data according to the user azimuth information and the user geographic position information and sending the navigation voice data to the earphone, wherein the earphone is used for playing the navigation voice data.
Optionally, the generating navigation voice data according to the user azimuth information and the user geographic position information includes:
transmitting the navigation inquiry information to a server, wherein the navigation inquiry information comprises the user azimuth information and the user geographic position information;
and receiving the navigation voice data sent by the server, wherein the navigation voice data is generated by the server according to the user azimuth information and the user geographic position information.
A non-transitory computer readable storage medium, which when executed by a processor of a headset, causes the headset to perform a method of alerting, the method comprising:
receiving a potential risk event sent by an earphone storage device, wherein the potential risk event is identified by the earphone storage device according to environmental sound data;
and carrying out sound reminding according to the potential risk event.
Optionally, the method further comprises:
and collecting the environmental sound data and sending the environmental sound data to the earphone storage device.
Optionally, the collecting environmental sound data includes:
acquiring user voice;
and starting or stopping collecting the environmental sound data according to the user voice.
Optionally, the collecting environmental sound data includes:
acquiring geographic position information of a user;
and starting or stopping collecting the environmental sound data according to the geographical position information of the user.
Optionally, the acquiring the geographic location information of the user includes:
and receiving the geographic position information of the user sent by the earphone storage device.
Optionally, the earphone is in communication connection with the mobile terminal, and the collecting environmental sound data includes:
receiving a control instruction sent by the mobile terminal;
and starting or stopping collecting the environmental sound data by adopting the control instruction.
Optionally, the headset comprises two paired headsets; the collecting environmental sound data includes:
far-field sound data are collected by starting a far-field pickup mode of at least one earphone.
Optionally, the method further comprises:
in the process of adopting the earphone to carry out communication, starting a near-field pickup mode of at least one earphone to collect near-field sound data;
and adopting the near-field sound data to carry out call processing.
Optionally, the performing an acoustic alert according to the potentially dangerous event includes:
and playing reminding sound corresponding to the potential risk event.
Optionally, the method further comprises:
If a potential risk event is identified and the earphone is playing sound data, the volume of playing the sound data is reduced or the sound data is stopped.
Optionally, the method further comprises:
and if the potential risk event is identified and the earphone is in communication, calling a preset telephone assistant to connect the communication instead.
Optionally, the method further comprises:
and if the sound data to be played by the earphone comprises voice data, performing voice processing on the sound data to be played by the earphone according to the environment voice data.
Optionally, the performing voice processing on the sound data to be played by the earphone according to the environmental sound data includes:
the sound data to be played by the earphone is sent to the earphone storage device, and the box is used for carrying out voice processing on the sound data to be played by the earphone according to the environmental sound data;
and receiving the voice data to be played, which is sent by the earphone storage device and subjected to human voice processing.
Optionally, the method further comprises:
acquiring user azimuth information, and playing navigation voice data according to the user azimuth information;
when a potential risk event is acquired, adjusting navigation voice data according to the potential risk event.
Optionally, the playing the navigation voice data according to the user azimuth information includes:
acquiring geographic position information of a user;
and playing navigation voice data according to the user azimuth information and the user geographic position information.
Optionally, the playing the navigation voice data according to the user azimuth information includes:
transmitting navigation inquiry information to the earphone storage device, wherein the navigation inquiry information comprises the user azimuth information;
and receiving and playing the navigation voice data returned by the earphone storage device.
A non-transitory computer readable storage medium, which when executed by a processor of a headset, causes the headset to perform a method of alerting, the method comprising:
acquiring environmental sound data;
identifying potential risk events in the environment according to the environmental sound data;
sending the potential risk event to a headset; the earphone is used for carrying out sound reminding according to the potential risk event.
Optionally, the acquiring the environmental sound data includes:
environmental sound data in a current environment is collected.
Optionally, the acquiring the environmental sound data includes:
and receiving the environmental sound data collected by the earphone.
Optionally, the collecting environmental sound data in the current environment includes:
acquiring user voice;
and starting or stopping collecting the environmental sound data in the current environment according to the user voice.
Optionally, the collecting environmental sound data in the current environment includes:
acquiring geographic position information of a user;
and starting or stopping collecting the environmental sound data in the current environment according to the geographical position information of the user.
Optionally, the earphone storage device is in communication connection with the mobile terminal, and the collecting of the environmental sound data in the current environment includes:
receiving a control instruction sent by the mobile terminal;
and starting or stopping collecting the environmental sound data in the current environment by adopting the control instruction.
Optionally, the collecting environmental sound data in the current environment includes:
starting an omnidirectional far-field pickup mode, and collecting far-field sound data in a 360-degree range;
or starting a remote pointing pickup mode to collect far-field sound data of a pointing range.
Optionally, the identifying a potential risk event in the environment according to the environmental sound data includes:
inputting the environmental sound data into a pre-trained voice recognition model;
and acquiring potential risk events which are acquired by the voice recognition model and recognized by the environmental sound data.
Optionally, the earphone receiving device is communicatively connected with a server, and the identifying the potential risk event in the environment according to the environmental sound data includes:
transmitting the environmental sound data to a server;
and receiving the sent potential risk event, wherein the potential risk event is identified by the server according to the environmental sound data.
Optionally, the method further comprises:
receiving sound data to be played sent by the earphone; the sound data to be played comprises voice data;
performing voice processing on the voice data to be played;
and sending the sound data to be played after the voice processing to the earphone, wherein the earphone is used for playing the sound data to be played after the voice processing.
Optionally, the voice processing for the sound data to be played includes:
the sound data to be played is sent to the server, and the server is used for carrying out voice processing on the sound data to be played according to the environment sound data;
and receiving the voice data to be played, which is sent by the server and subjected to the voice processing.
Optionally, the method further comprises:
receiving navigation inquiry information sent by the earphone, wherein the navigation inquiry information comprises the user azimuth information;
Acquiring geographic position information of a user;
and generating navigation voice data according to the user azimuth information and the user geographic position information and sending the navigation voice data to the earphone, wherein the earphone is used for playing the navigation voice data.
Optionally, the generating navigation voice data according to the user azimuth information and the user geographic position information includes:
transmitting the navigation inquiry information to a server, wherein the navigation inquiry information comprises the user azimuth information and the user geographic position information;
and receiving the navigation voice data sent by the server, wherein the navigation voice data is generated by the server according to the user azimuth information and the user geographic position information.
In this specification, each embodiment is described in a progressive manner, and each embodiment is mainly described by differences from other embodiments, and identical and similar parts between the embodiments are all enough to be referred to each other.
It will be apparent to those skilled in the art that embodiments of the present invention may be provided as a method, apparatus, or computer program product. Accordingly, embodiments of the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the invention may take the form of a computer program product on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
Embodiments of the present invention are described with reference to flowchart illustrations and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing terminal device to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing terminal device, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. It is therefore intended that the following claims be interpreted as including the preferred embodiment and all such alterations and modifications as fall within the scope of the embodiments of the invention.
Finally, it is further noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or terminal that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or terminal. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article or terminal device comprising the element.
The foregoing has described in detail a reminding method, a reminding device, an earphone and an earphone receiving device provided by the present invention, and specific examples are applied to illustrate the principles and embodiments of the present invention, and the above examples are only used to help understand the method and core ideas of the present invention; meanwhile, as those skilled in the art will have variations in the specific embodiments and application scope in accordance with the ideas of the present invention, the present description should not be construed as limiting the present invention in view of the above.

Claims (86)

1. A method of alerting, applied to a headset, the headset communicatively coupled to a headset housing device, the method comprising:
the earphone receives a potential risk event sent by the earphone containing device, and the potential risk event is identified by the earphone containing device according to environmental sound data;
carrying out sound reminding according to the potential risk event;
acquiring user azimuth information, and playing navigation voice data according to the user azimuth information;
when a potential risk event is acquired, adjusting navigation voice data according to the potential risk event.
2. The method as recited in claim 1, further comprising:
and collecting the environmental sound data and sending the environmental sound data to the earphone storage device.
3. The method of claim 2, wherein the collecting environmental sound data comprises:
acquiring user voice;
and starting or stopping collecting the environmental sound data according to the user voice.
4. The method of claim 2, wherein the collecting environmental sound data comprises:
acquiring geographic position information of a user;
and starting or stopping collecting the environmental sound data according to the geographical position information of the user.
5. The method of claim 4, wherein the obtaining user geographic location information comprises:
and receiving the geographic position information of the user sent by the earphone storage device.
6. The method of claim 2, wherein the headset is communicatively coupled to a mobile terminal, and wherein the collecting environmental sound data comprises:
receiving a control instruction sent by the mobile terminal;
and starting or stopping collecting the environmental sound data by adopting the control instruction.
7. The method of claim 2, wherein the headphones comprise paired two headphones; the collecting environmental sound data includes:
Far-field sound data are collected by starting a far-field pickup mode of at least one earphone.
8. The method as recited in claim 1, further comprising:
in the process of adopting the earphone to carry out communication, starting a near-field pickup mode of at least one earphone to collect near-field sound data;
and adopting the near-field sound data to carry out call processing.
9. The method of claim 1, wherein the audibly alerting the potential risk event comprises:
and playing reminding sound corresponding to the potential risk event.
10. The method as recited in claim 1, further comprising:
if a potential risk event is identified and the earphone is playing sound data, the volume of playing the sound data is reduced or the sound data is stopped.
11. The method as recited in claim 1, further comprising:
and if the potential risk event is identified and the earphone is in communication, calling a preset telephone assistant to connect the communication instead.
12. The method as recited in claim 1, further comprising:
and if the sound data to be played by the earphone comprises voice data, performing voice processing on the sound data to be played by the earphone according to the environment voice data.
13. The method of claim 12, wherein the performing the human voice processing on the sound data to be played by the earphone according to the environmental sound data comprises:
the sound data to be played by the earphone is sent to the earphone containing device, and the earphone containing device is used for carrying out voice processing on the sound data to be played by the earphone according to the environmental sound data;
and receiving the voice data to be played, which is sent by the earphone storage device and subjected to human voice processing.
14. The method of claim 1, wherein playing navigation voice data according to the user orientation information comprises:
acquiring geographic position information of a user;
and playing navigation voice data according to the user azimuth information and the user geographic position information.
15. The method of claim 1, wherein playing navigation voice data according to the user orientation information comprises:
transmitting navigation inquiry information to the earphone storage device, wherein the navigation inquiry information comprises the user azimuth information;
and receiving and playing the navigation voice data returned by the earphone storage device.
16. A method of reminding, applied to a headset housing device, the headset housing device being in communication with a headset, the method comprising:
The earphone storage device acquires environmental sound data;
identifying potential risk events in the environment according to the environmental sound data;
transmitting the potentially risky event to the headset; the earphone is used for carrying out sound reminding according to the potential risk event and adjusting navigation voice data according to the potential risk event when the navigation voice data are played.
17. The method of claim 16, wherein the acquiring ambient sound data comprises:
environmental sound data in a current environment is collected.
18. The method of claim 16, wherein the acquiring ambient sound data comprises:
and receiving the environmental sound data collected by the earphone.
19. The method of claim 17, wherein the collecting environmental sound data in the current environment comprises:
acquiring user voice;
and starting or stopping collecting the environmental sound data in the current environment according to the user voice.
20. The method of claim 17, wherein the collecting environmental sound data in the current environment comprises:
acquiring geographic position information of a user;
and starting or stopping collecting the environmental sound data in the current environment according to the geographical position information of the user.
21. The method of claim 17, wherein the headset housing device is communicatively coupled to a mobile terminal, and wherein the capturing of ambient sound data in the current environment comprises:
receiving a control instruction sent by the mobile terminal;
and starting or stopping collecting the environmental sound data in the current environment by adopting the control instruction.
22. The method of claim 17, wherein the collecting environmental sound data in the current environment comprises:
starting an omnidirectional far-field pickup mode, and collecting far-field sound data in a 360-degree range;
or starting a remote pointing pickup mode to collect far-field sound data of a pointing range.
23. The method of claim 16, wherein the identifying potential risk events in an environment from the ambient sound data comprises:
inputting the environmental sound data into a pre-trained voice recognition model;
and acquiring potential risk events which are acquired by the voice recognition model and recognized by the environmental sound data.
24. The method of claim 16, wherein the headset housing device is communicatively coupled to a server, the identifying a potential risk event in an environment from the environmental sound data comprising:
Transmitting the environmental sound data to a server;
and receiving the sent potential risk event, wherein the potential risk event is identified by the server according to the environmental sound data.
25. The method as recited in claim 16, further comprising:
receiving sound data to be played sent by the earphone; the sound data to be played comprises voice data;
performing voice processing on the voice data to be played;
and sending the sound data to be played after the voice processing to the earphone, wherein the earphone is used for playing the sound data to be played after the voice processing.
26. The method of claim 25, wherein said voice processing of said sound data to be played comprises:
the sound data to be played is sent to a server, and the server is used for carrying out voice processing on the sound data to be played according to the environment sound data;
and receiving the voice data to be played, which is sent by the server and subjected to the voice processing.
27. The method as recited in claim 16, further comprising:
receiving navigation inquiry information sent by the earphone, wherein the navigation inquiry information comprises user azimuth information;
Acquiring geographic position information of a user;
and generating navigation voice data according to the user azimuth information and the user geographic position information and sending the navigation voice data to the earphone, wherein the earphone is used for playing the navigation voice data.
28. The method of claim 27, wherein generating navigational speech data based on the user location information and the user geographical location information comprises:
transmitting the navigation inquiry information to a server, wherein the navigation inquiry information comprises the user azimuth information and the user geographic position information;
and receiving the navigation voice data sent by the server, wherein the navigation voice data is generated by the server according to the user azimuth information and the user geographic position information.
29. A reminder device, characterized in that is applied to the earphone, earphone and earphone storage device communication connection, the reminder device includes:
the risk potential event receiving module is used for receiving a risk potential event sent by the earphone containing device, and the risk potential event is identified by the earphone containing device according to the environmental sound data;
the reminding module is used for carrying out sound reminding according to the potential risk event;
The navigation voice data playing module is used for acquiring the user azimuth information and playing the navigation voice data according to the user azimuth information;
and the navigation voice data adjustment module is used for adjusting the navigation voice data according to the potential risk event when the potential risk event is acquired.
30. The reminder device of claim 29, further comprising:
and the environmental sound data processing module is used for collecting the environmental sound data and sending the environmental sound data to the earphone storage device.
31. The alert device of claim 30, wherein the ambient sound data processing module is configured to obtain user speech;
and starting or stopping collecting the environmental sound data according to the user voice.
32. The reminder of claim 30, wherein the ambient sound data processing module is configured to obtain geographic location information of the user; and starting or stopping collecting the environmental sound data according to the geographical position information of the user.
33. The reminder device of claim 32, wherein the ambient sound data processing module is configured to receive user geographic location information sent by the earphone receiving device.
34. The reminding device according to claim 30, wherein the earphone is in communication connection with a mobile terminal, and the environmental sound data processing module is configured to receive a control instruction sent by the mobile terminal; and starting or stopping collecting the environmental sound data by adopting the control instruction.
35. The reminder device of claim 30, wherein the headphones comprise paired headphones; the environmental sound data processing module is used for starting a far-field pickup mode of at least one earphone to collect far-field sound data.
36. The reminder device of claim 29, further comprising:
the near-field sound data acquisition module is used for starting a near-field pickup mode of at least one earphone to acquire near-field sound data in the process of adopting the earphone to carry out communication;
and the call processing module is used for performing call processing by adopting the near-field sound data.
37. The reminder device of claim 29, wherein the reminder module is configured to play a reminder sound corresponding to the potentially risky event.
38. The reminder device of claim 29, further comprising:
And the sound data adjusting module is used for reducing the volume of playing the sound data or stopping playing the sound data if the potential risk event is identified and the earphone is playing the sound data.
39. The reminder device of claim 29, further comprising:
and the substituting module is used for calling a preset telephone assistant to substitute for the call if the potential risk event is identified and the earphone is in the call.
40. The reminder device of claim 29, further comprising:
and the first voice processing module is used for performing voice processing on the voice data to be played by the earphone according to the environment voice data if the voice data to be played by the earphone comprises voice data.
41. The alert device of claim 40, wherein the first voice processing module is configured to send sound data to be played by the headphones to the headphone housing device, and the headphone housing device is configured to perform voice processing on the sound data to be played by the headphones according to the ambient sound data; and receiving the voice data to be played, which is sent by the earphone storage device and subjected to human voice processing.
42. The reminder device of claim 29, wherein the navigation voice data playback module is configured to obtain geographic location information of the user; and playing navigation voice data according to the user azimuth information and the user geographic position information.
43. The reminder device of claim 29, wherein the navigation voice data playback module is configured to send navigation query information to the headset housing device, the navigation query information including the user location information; and receiving and playing the navigation voice data returned by the earphone storage device.
44. A reminder device, characterized in that is applied to earphone storage device, earphone storage device and earphone communication connection, the reminder device includes:
the environment sound data acquisition module is used for acquiring environment sound data;
the potential risk event identification module is used for identifying potential risk events in the environment according to the environmental sound data;
a potentially dangerous event sending module, configured to send the potentially dangerous event to the earphone; the earphone is used for carrying out sound reminding according to the potential risk event and adjusting navigation voice data according to the potential risk event when the navigation voice data are played.
45. The alert device of claim 44, wherein the ambient sound data acquisition module is configured to collect ambient sound data in a current environment.
46. The alert device of claim 44, wherein the ambient sound data acquisition module is configured to receive ambient sound data collected by the headset.
47. The alert device of claim 45, wherein the ambient sound data acquisition module is configured to acquire user speech; and starting or stopping collecting the environmental sound data in the current environment according to the user voice.
48. The alert device of claim 45, wherein the ambient sound data acquisition module is configured to acquire user geographic location information; and starting or stopping collecting the environmental sound data in the current environment according to the geographical position information of the user.
49. The reminding device according to claim 45, wherein the earphone accommodating device is in communication connection with a mobile terminal, and the environmental sound data obtaining module is configured to receive a control instruction sent by the mobile terminal; and starting or stopping collecting the environmental sound data in the current environment by adopting the control instruction.
50. The alert device of claim 44, wherein the ambient sound data acquisition module is configured to initiate an omni-directional far-field pickup mode to collect far-field sound data over a 360 degree range; or starting a remote pointing pickup mode to collect far-field sound data of a pointing range.
51. The alert device of claim 44, wherein the risk potential event recognition module is configured to input the ambient sound data into a pre-trained voice recognition model; and acquiring potential risk events which are acquired by the voice recognition model and recognized by the environmental sound data.
52. The reminder device of claim 44, wherein the headset housing device is communicatively coupled to a server, the risk potential event identification module for transmitting the environmental sound data to the server; and receiving the sent potential risk event, wherein the potential risk event is identified by the server according to the environmental sound data.
53. The reminder device of claim 44, further comprising:
the sound data receiving module is used for receiving the sound data to be played, which is sent by the earphone; the sound data to be played comprises voice data;
The second voice processing module is used for performing voice processing on the voice data to be played;
the sound data transmitting module is used for transmitting the sound data to be played after the voice processing to the earphone, and the earphone is used for playing the sound data to be played after the voice processing.
54. The alert device of claim 53, wherein the second voice processing module is configured to send the sound data to be played to a server, the server being configured to perform voice processing on the sound data to be played according to the ambient sound data; and receiving the voice data to be played, which is sent by the server and subjected to the voice processing.
55. The reminder device of claim 44, further comprising:
the navigation inquiry information receiving module is used for receiving navigation inquiry information sent by the earphone, wherein the navigation inquiry information comprises user azimuth information;
the geographic position information acquisition module is used for acquiring geographic position information of a user;
and the navigation voice data processing module is used for generating navigation voice data according to the user azimuth information and the user geographic position information and sending the navigation voice data to the earphone, and the earphone is used for playing the navigation voice data.
56. The alert device of claim 55, wherein the navigation voice data processing module is configured to send the navigation query information to a server, the navigation query information including the user location information and the user geographic location information; and receiving the navigation voice data sent by the server, wherein the navigation voice data is generated by the server according to the user azimuth information and the user geographic position information.
57. A headset comprising a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by one or more processors, the one or more programs comprising instructions for:
receiving a potential risk event sent by an earphone storage device, wherein the potential risk event is identified by the earphone storage device according to environmental sound data;
carrying out sound reminding according to the potential risk event;
acquiring user azimuth information, and playing navigation voice data according to the user azimuth information;
when a potential risk event is acquired, adjusting navigation voice data according to the potential risk event.
58. The headset of claim 57, further comprising instructions for:
and collecting the environmental sound data and sending the environmental sound data to the earphone storage device.
59. The headset of claim 58, wherein the capturing ambient sound data comprises:
acquiring user voice;
and starting or stopping collecting the environmental sound data according to the user voice.
60. The headset of claim 58, wherein the capturing ambient sound data comprises:
acquiring geographic position information of a user;
and starting or stopping collecting the environmental sound data according to the geographical position information of the user.
61. The headset of claim 60, wherein the obtaining user geographic location information comprises:
and receiving the geographic position information of the user sent by the earphone storage device.
62. The headset of claim 58, wherein the headset is communicatively coupled to a mobile terminal, the capturing ambient sound data comprising:
receiving a control instruction sent by the mobile terminal;
and starting or stopping collecting the environmental sound data by adopting the control instruction.
63. The headset of claim 58, wherein the headset comprises two headset pairs; the collecting environmental sound data includes:
Far-field sound data are collected by starting a far-field pickup mode of at least one earphone.
64. The headset of claim 57, further comprising instructions for:
in the process of adopting the earphone to carry out communication, starting a near-field pickup mode of at least one earphone to collect near-field sound data;
and adopting the near-field sound data to carry out call processing.
65. The headset of claim 57, wherein the audibly alerting from the potentially risky event comprises:
and playing reminding sound corresponding to the potential risk event.
66. The headset of claim 57, further comprising instructions for:
if a potential risk event is identified and the earphone is playing sound data, the volume of playing the sound data is reduced or the sound data is stopped.
67. The headset of claim 57, further comprising instructions for:
and if the potential risk event is identified and the earphone is in communication, calling a preset telephone assistant to connect the communication instead.
68. The headset of claim 57, further comprising instructions for:
And if the sound data to be played by the earphone comprises voice data, performing voice processing on the sound data to be played by the earphone according to the environment voice data.
69. The headset of claim 68, wherein the voice processing of sound data to be played by the headset based on the ambient sound data comprises:
the sound data to be played by the earphone is sent to the earphone containing device, and the earphone containing device is used for carrying out voice processing on the sound data to be played by the earphone according to the environmental sound data;
and receiving the voice data to be played, which is sent by the earphone storage device and subjected to human voice processing.
70. The headset as recited in claim 57, wherein playing navigation voice data based on the user orientation information, comprises:
acquiring geographic position information of a user;
and playing navigation voice data according to the user azimuth information and the user geographic position information.
71. The headset as recited in claim 57, wherein playing navigation voice data based on the user orientation information, comprises:
transmitting navigation inquiry information to the earphone storage device, wherein the navigation inquiry information comprises the user azimuth information;
And receiving and playing the navigation voice data returned by the earphone storage device.
72. A headset housing device comprising a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by one or more processors, the one or more programs comprising instructions for:
acquiring environmental sound data;
identifying potential risk events in the environment according to the environmental sound data;
sending the potential risk event to a headset; the earphone is used for carrying out sound reminding according to the potential risk event and adjusting navigation voice data according to the potential risk event when the navigation voice data are played.
73. The headphone housing apparatus according to claim 72 wherein the acquiring environmental sound data comprises:
environmental sound data in a current environment is collected.
74. The headphone housing apparatus according to claim 72 wherein the acquiring environmental sound data comprises:
and receiving the environmental sound data collected by the earphone.
75. The headphone housing apparatus according to claim 73 wherein the capturing environmental sound data in the current environment comprises:
Acquiring user voice;
and starting or stopping collecting the environmental sound data in the current environment according to the user voice.
76. The headphone housing apparatus according to claim 73 wherein the capturing environmental sound data in the current environment comprises:
acquiring geographic position information of a user;
and starting or stopping collecting the environmental sound data in the current environment according to the geographical position information of the user.
77. The headset carrying device of claim 73, wherein the headset carrying device is communicatively coupled to a mobile terminal, the capturing ambient sound data in the current environment comprising:
receiving a control instruction sent by the mobile terminal;
and starting or stopping collecting the environmental sound data in the current environment by adopting the control instruction.
78. The headphone housing apparatus according to claim 73 wherein the capturing environmental sound data in the current environment comprises:
starting an omnidirectional far-field pickup mode, and collecting far-field sound data in a 360-degree range;
or starting a remote pointing pickup mode to collect far-field sound data of a pointing range.
79. The headphone housing apparatus according to claim 72 wherein the identifying potential risk events in an environment from the environmental sound data comprises:
Inputting the environmental sound data into a pre-trained voice recognition model;
and acquiring potential risk events which are acquired by the voice recognition model and recognized by the environmental sound data.
80. The headphone housing apparatus according to claim 72 wherein the headphone housing apparatus is communicatively coupled to a server, the identifying potential risk events in an environment from the environmental sound data comprising:
transmitting the environmental sound data to a server;
and receiving the sent potential risk event, wherein the potential risk event is identified by the server according to the environmental sound data.
81. The headphone housing apparatus according to claim 72 further comprising instructions for:
receiving sound data to be played sent by the earphone; the sound data to be played comprises voice data;
performing voice processing on the voice data to be played;
and sending the sound data to be played after the voice processing to the earphone, wherein the earphone is used for playing the sound data to be played after the voice processing.
82. The headphone housing apparatus according to claim 81, wherein the performing human voice processing on the sound data to be played comprises:
The sound data to be played is sent to a server, and the server is used for carrying out voice processing on the sound data to be played according to the environment sound data;
and receiving the voice data to be played, which is sent by the server and subjected to the voice processing.
83. The headphone housing apparatus according to claim 72 further comprising instructions for:
receiving navigation inquiry information sent by the earphone, wherein the navigation inquiry information comprises user azimuth information;
acquiring geographic position information of a user;
and generating navigation voice data according to the user azimuth information and the user geographic position information and sending the navigation voice data to the earphone, wherein the earphone is used for playing the navigation voice data.
84. The headset carrying device of claim 83, wherein the generating navigational speech data based on the user orientation information and the user geographical location information comprises:
transmitting the navigation inquiry information to a server, wherein the navigation inquiry information comprises the user azimuth information and the user geographic position information;
and receiving the navigation voice data sent by the server, wherein the navigation voice data is generated by the server according to the user azimuth information and the user geographic position information.
85. A computer readable storage medium, characterized in that the computer readable storage medium has stored thereon a computer program which, when executed by a processor, implements the steps of the reminder method according to one of claims 1 to 15.
86. A computer readable storage medium, wherein a computer program is stored on the computer readable storage medium, which when executed by a processor, implements the steps of the reminder method according to one of claims 16 to 28.
CN202010507513.7A 2020-06-05 2020-06-05 Reminding method and device, earphone and earphone storage device Active CN111696578B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010507513.7A CN111696578B (en) 2020-06-05 2020-06-05 Reminding method and device, earphone and earphone storage device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010507513.7A CN111696578B (en) 2020-06-05 2020-06-05 Reminding method and device, earphone and earphone storage device

Publications (2)

Publication Number Publication Date
CN111696578A CN111696578A (en) 2020-09-22
CN111696578B true CN111696578B (en) 2023-08-18

Family

ID=72479552

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010507513.7A Active CN111696578B (en) 2020-06-05 2020-06-05 Reminding method and device, earphone and earphone storage device

Country Status (1)

Country Link
CN (1) CN111696578B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP4160565A1 (en) * 2021-09-29 2023-04-05 GN Hearing A/S A system for locating an electronic accessory device

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1897054A (en) * 2005-07-14 2007-01-17 松下电器产业株式会社 Device and method for transmitting alarm according various acoustic signals
CN104394491A (en) * 2014-12-09 2015-03-04 北京奇虎科技有限公司 Intelligent headset, cloud server, volume adjustment method and volume adjustment system
CN106488013A (en) * 2016-09-27 2017-03-08 维沃移动通信有限公司 A kind of danger based reminding method and mobile terminal
CN106878849A (en) * 2017-01-22 2017-06-20 歌尔股份有限公司 Wireless earphone device and artificial intelligence device
CN109120298A (en) * 2018-08-30 2019-01-01 歌尔科技有限公司 A kind of earphone far field exchange method, earphone far field interaction accessory and wireless headset
CN109361987A (en) * 2018-12-25 2019-02-19 歌尔科技有限公司 A kind of sports earphones and its control method, device, equipment
CN110139178A (en) * 2018-02-02 2019-08-16 中兴通讯股份有限公司 A kind of method, apparatus, equipment and the storage medium of determining terminal moving direction

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1897054A (en) * 2005-07-14 2007-01-17 松下电器产业株式会社 Device and method for transmitting alarm according various acoustic signals
CN104394491A (en) * 2014-12-09 2015-03-04 北京奇虎科技有限公司 Intelligent headset, cloud server, volume adjustment method and volume adjustment system
CN106488013A (en) * 2016-09-27 2017-03-08 维沃移动通信有限公司 A kind of danger based reminding method and mobile terminal
CN106878849A (en) * 2017-01-22 2017-06-20 歌尔股份有限公司 Wireless earphone device and artificial intelligence device
CN110139178A (en) * 2018-02-02 2019-08-16 中兴通讯股份有限公司 A kind of method, apparatus, equipment and the storage medium of determining terminal moving direction
CN109120298A (en) * 2018-08-30 2019-01-01 歌尔科技有限公司 A kind of earphone far field exchange method, earphone far field interaction accessory and wireless headset
CN109361987A (en) * 2018-12-25 2019-02-19 歌尔科技有限公司 A kind of sports earphones and its control method, device, equipment

Also Published As

Publication number Publication date
CN111696578A (en) 2020-09-22

Similar Documents

Publication Publication Date Title
CN111696577B (en) Reminding method, reminding device and earphone
KR101875743B1 (en) Mobile terminal and control method therof
CN110716776A (en) Method for displaying user interface and vehicle-mounted terminal
CN109353297B (en) Volume adjustment method, device and computer readable storage medium
CN105205955A (en) Method and device for sending out warning signal
CN101373139A (en) Terminal and method for determining route information between the terminal, a destination and a further terminal
CN104008664A (en) Method and device for obtaining road condition information
CN110708630B (en) Method, device and equipment for controlling earphone and storage medium
CN105653236A (en) Sound volume control method and device and mobile terminal
CN103902002B (en) Method for managing power supply and device
CN104867349A (en) Information prompting method and information prompting device
CN112150778A (en) Environmental sound processing method and related device
CN106097650A (en) The alarm method of terminal, device and terminal
CN106126058A (en) Based reminding method and device
CN111696578B (en) Reminding method and device, earphone and earphone storage device
CN106202193A (en) The method of road image acquisition of information, Apparatus and system
US20230381025A1 (en) Situational awareness, communication, and safety in hearing protection and communication systems
CN111741405B (en) Reminding method and device, earphone and server
KR20150012927A (en) Electronic device and control method thereof
CN111739528A (en) Interaction method and device and earphone
KR101805533B1 (en) Mobile terminal, news providing apparatus and position based news providing method
CN105530563A (en) Method and device for volume control
CN105101063A (en) Position ordering method and device
CN104223611B (en) A kind of method and apparatus of Offered target move distance
KR101851295B1 (en) Mobile terminal and control method for mobile terminal

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20210705

Address after: 100084 Room 802, 8th floor, building 9, yard 1, Zhongguancun East Road, Haidian District, Beijing

Applicant after: Beijing Sogou Intelligent Technology Co.,Ltd.

Address before: 100084. Room 9, floor 01, cyber building, building 9, building 1, Zhongguancun East Road, Haidian District, Beijing

Applicant before: BEIJING SOGOU TECHNOLOGY DEVELOPMENT Co.,Ltd.

GR01 Patent grant
GR01 Patent grant