WO2011100890A1 - Reminding method of environmental sound and mobile terminal thereof - Google Patents

Reminding method of environmental sound and mobile terminal thereof Download PDF

Info

Publication number
WO2011100890A1
WO2011100890A1 PCT/CN2011/070951 CN2011070951W WO2011100890A1 WO 2011100890 A1 WO2011100890 A1 WO 2011100890A1 CN 2011070951 W CN2011070951 W CN 2011070951W WO 2011100890 A1 WO2011100890 A1 WO 2011100890A1
Authority
WO
WIPO (PCT)
Prior art keywords
sound
reminding
user
processing
sound signal
Prior art date
Application number
PCT/CN2011/070951
Other languages
French (fr)
Chinese (zh)
Inventor
丁琦
Original Assignee
华为终端有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为终端有限公司 filed Critical 华为终端有限公司
Publication of WO2011100890A1 publication Critical patent/WO2011100890A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/60Substation equipment, e.g. for use by subscribers including speech amplifiers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality

Definitions

  • the present invention relates to the field of communications technologies, and in particular, to an environmental sound reminding method and a mobile terminal. Background technique
  • mobile terminals such as mobile phones, tablets, etc.
  • the functions of mobile terminals are also becoming more and more diversified.
  • entertainment and socialization In addition to satisfying the basic needs of people's mobile communications, they can also provide rich functions such as entertainment and socialization, which greatly improves people's lives.
  • Using mobile terminals to listen to music, listen to the radio and play games has become an indispensable form of entertainment for people. Users often wear headphones when using these entertainment functions of the mobile terminal (for example, wearing headphones to listen to music or enjoying sound effects in the game), and the sound played by the mobile terminal is transmitted to the user's ear through the earphone.
  • some mobile terminals have a reminding function for reminding the user of time or event.
  • the user presets the reminding time and the reminding mode, and the mobile terminal starts a corresponding timer when the time of the timer arrives (when the time set by the user arrives) ), the mobile terminal will remind the user according to the reminder method preset by the user.
  • an embodiment of the present invention provides an environment capable of alerting a user according to an environmental sound signal.
  • An environmental sound reminding method including:
  • a mobile terminal includes:
  • a sound signal collection module for collecting sound signals of an external environment
  • a sound processing module configured to process the sound signal as a sound processing value according to a sound processing policy preset by the user; and determine whether the sound processing value is within a range indicated by the user preset reminding condition;
  • the CPU module is configured to perform an operation for reminding the user according to the reminding manner preset by the user when the sound processing module determines that it is YES.
  • the embodiment of the present invention processes the sound signal by collecting the sound signal of the external environment in real time, and obtains a sound processing value indicating the sound signal.
  • the sound processing value is in the reminder range indicated by the reminding condition, according to the reminding mode information, Remind the user with the preset reminder method, which realizes the function of automatically reminding the user of the ambient sound information when the sound of the earphone is greatly restricted due to the sound played by the earphone, so that the user can correctly handle the sound around the clock in time to avoid missing important Or urgent things.
  • FIG. 1 is a schematic diagram of a basic flow of a first embodiment of a sound environment sound reminding method according to the present invention
  • FIG. 2 is a schematic diagram of a basic flow of a sound environment sound reminding method according to a second embodiment of the present invention
  • the embodiment of the present invention provides an environmental sound reminding method.
  • the sound environment of the external environment is used to remind the user of the external environment sound by using a preset reminding manner.
  • the embodiment of the present invention further provides a corresponding mobile terminal. The details are described below separately.
  • Embodiment 1 The basic flow of the environmental sound reminding method of the first embodiment of the present invention can be referred to FIG. 1.
  • the environmental sound reminding method of the present embodiment mainly includes the following steps: Step 101: Collecting sound signals of an external environment in real time.
  • the real-time sound signal of the external environment can be obtained by real-time recording, and the sound recording of the external environment of each time period can be obtained and stored.
  • Step 102 Process the sound signal as a sound processing value according to a processing command corresponding to the reminding condition preset by the user.
  • the mobile terminal provides different manners of reminding conditions according to its own software and hardware support capabilities.
  • Reminder conditions include but are not limited to the following: Sensitivity reminder conditions, the user sets to, according to the volume of the sound or the size of the frequency to decide whether to remind the user, when the sound processing value (volume) of the detected sound signal reaches the user-set reminder
  • the condition initiates the reminder;
  • the change amount reminder condition the user sets, according to whether the size of the change of the sound processing value (volume) of the sound signal in the detected environment reaches the reminder condition set by the user to decide whether to remind.
  • the voice recognition reminder condition is set by the user to, when the collected sound is compared with the pre-recorded sound, a reminder occurs when the similarity reaches a certain level.
  • the user Zhang San recorded the recordings of "Zhang San,, and "Xiao Zhang".
  • the reminder occurs when the similarity reaches the set level.
  • the user can be reminded to call Zhang three.
  • the interface can provide some intuitive options for the user to select, or can be set by the user.
  • the user can set the reminder condition as: the sound volume intensity reaches the reminder door Reminders occur within a limited time. You can also use the text that is easier for the average user to understand. Select tiny, medium, noisy, or harsh sounds on the interface. Each option corresponds to a quantified reminder condition.
  • the user preset reminder condition and the processing command are corresponding relationships, and the processing command includes a detection attribute and a calculation method, and the detection attribute indicates whether the attribute value of the sound signal is a volume size, a frequency size or a power size, and the detection attribute indicates a frequency of detecting the sound signal, Then, the attribute value of the sound signal is the frequency value of the sound signal. If the detection attribute is only the volume level of the sound signal, the attribute value of the sound is the volume value of the sound signal.
  • the calculation method is a processing method for calculating the attribute value of the sound signal as the sound processing value, and the calculation method may be an average value according to the attribute value of the sound signal, or another calculation method for processing the attribute value of the sound signal.
  • the sound processing value obtained by calculating the attribute value of the sound signal by the calculation method is more accurate and reliable.
  • the corresponding processing command may be selected to process the sound signal.
  • the alert condition is a frequency alert threshold
  • the attribute value of the sound signal is detected according to the detection attribute of the processing command according to the processing command corresponding thereto, and the attribute value of the sound signal is the frequency value of the sound signal, and then calculated according to the calculation.
  • Method calculating the frequency value of the detected sound signal.
  • the corresponding relationship between the reminding condition and the processing command is preset in the foregoing manner in the embodiment of the present invention.
  • Step 103 Determine whether the sound processing value is within a range indicated by the user preset reminding condition, and if yes, proceed to step 104; for example, as shown in Table 1 below, the reminding condition that can be selected by the user setting is the sound intensity value.
  • the thresholds are a, b, c, and d (a ⁇ b ⁇ c ⁇ d): The four thresholds correspond to tiny sounds, medium sounds, noisy sounds, and harsh sounds, as shown in Table 1 below.
  • the reminder range indicated by the user-selected reminder condition can be converted into
  • Step 104 Perform an operation of reminding the user according to the preset reminding manner information.
  • the user can set a reminder method suitable for himself, such as ringtone reminder, interface prompt, earphone reminder, vibration reminder, intelligent voice reminder, etc., store these reminder methods, and judge in step 103 When it is broken, the user is reminded according to the user setting or the system default reminder.
  • the sound signal is processed by collecting the sound signal of the external environment in real time, and the sound processing value indicating the sound signal is obtained.
  • the sound processing value is in the reminding range indicated by the reminding condition, according to the reminding mode information ⁇ Remind the user with a preset reminder method, which realizes the function of automatically reminding the user of the ambient sound information when the sound of the earphone is greatly restricted due to the sound of the earphone playback, so that the user can correctly handle the sound around the body in time, avoiding Miss important or urgent things.
  • the second embodiment of the environmental sound reminding method in the embodiment of the present invention includes: Step 201, obtaining user settings or The default reminder mode, reminder conditions, and time interval for detecting sound signals. There are many types of reminders, and users can set them to remind users of their sounds, images, vibrations, etc.
  • ringtone reminder a certain ringtone to remind the user
  • interface reminder display a prompt message on the mobile terminal interface to remind the user
  • earphone reminder play a certain sound through the earphone to the user's ear to remind the user
  • vibration reminder vibration movement
  • the terminal reminds the user; intelligent voice reminder, the mobile phone can pre-produce a frequency meter, and pre-produce some recordings, such as the human voice frequency, the frequency of the whistle, the frequency of the thunder, etc., when the sound frequency and frequency table of the detected sound signal When a match is made, the phone plays a corresponding recording to prompt.
  • a frequency meter such as the human voice frequency, the frequency of the whistle, the frequency of the thunder, etc.
  • the mobile terminal can provide different manners of reminding conditions according to its own software and hardware support capabilities.
  • Reminder conditions include but are not limited to the following: Sensitivity reminder conditions, the user sets to, according to the volume of the sound or the size of the frequency to decide whether to remind the user, when the sound processing value (volume) of the detected sound signal reaches the user-set reminder The condition initiates the reminder; the change amount reminder condition, the user sets, according to whether the size of the change of the sound processing value (volume) of the sound signal in the detected environment reaches the reminder condition set by the user to decide whether to remind. Such as: small changes, medium changes and large changes.
  • the voice recognition reminder condition the user sets the sound and the preset The first recorded sound is compared, and a reminder occurs when the similarity reaches a certain level.
  • a reminder occurs when the similarity reaches a certain level.
  • the user Zhang San recorded the recordings of "Zhang San” and "Xiao Zhang”.
  • the interface can provide some Intuitive options are available for the user to select, or they can be set by the user.
  • the user can set the reminder condition as: When the sound volume intensity reaches the reminder threshold, a reminder occurs, or a text that is easier for the average user to understand can be selected, and a small sound is selected on the interface. Medium sound, noisy sound or harsh sound, each option corresponds to a quantized reminder condition.
  • the user preset reminder condition and processing command are corresponding, the processing command includes detection attribute and calculation method, and the detection attribute indicates the attribute value of the sound signal. Is the volume size, frequency size or power size, the detection attribute indicates the frequency of detecting the sound signal, then the attribute value of the sound signal is the frequency value of the sound signal, and if the detection attribute is only detecting the volume level of the sound signal, then the attribute value of the sound is The volume value of the sound signal.
  • the calculation method is a processing method for calculating the attribute value of the sound signal as the sound processing value, and the calculation method may be averaging according to the attribute value of the sound signal, or other calculation method for processing the attribute value of the sound signal.
  • the sound processing value obtained by the attribute value of the signal is more accurate and reliable.
  • the corresponding processing command can be selected to process the sound signal. For example, if the reminding condition is the frequency reminding threshold.
  • the attribute value of the sound signal is the frequency value of the sound signal, and calculating the detected sound signal according to the calculation method.
  • the frequency value is averaging according to the attribute value of the sound signal, or other calculation method for processing the attribute value of the sound signal.
  • the corresponding relationship between the reminding condition and the processing command is preset in the above manner.
  • the detecting precision is a time interval at which the user detects the attribute value of the sound signal, and the user can set the level.
  • the interval between detections changes The accuracy of the sound signal is measured, and the higher the detection precision set by the user, the smaller the interval time of the sound signal of the level detection.
  • Step 202 Collecting the sound signal of the external environment in real time; real-time recording the sound signal of the external environment through real-time recording
  • the sound signal of the external environment is included in the embodiment of the present invention, but is not limited to the above manner to collect the sound signal of the external environment.
  • Step 203 Find processing corresponding to the reminding condition command.
  • the processing command includes a detection attribute and a calculation method, and the correspondence between the reminding condition and the processing command is pre-configured, and the sound processing value is obtained according to the detection attribute and the calculation method of the processing command corresponding to the reminding condition, for example, if the range of the reminding condition indication is The frequency range, then the processing command processing detection attribute is to detect the frequency value of the sound signal, calculate the detected frequency value according to the calculation method, and obtain the sound signal processing value. If the range indicated by the reminding condition is the volume level, the processing command detects the attribute of the sound signal. The value is the power value, and the power value is calculated as the sound processing value.
  • Step 204 Set a timer according to a time interval at which the sound signal is detected.
  • the user setting information further includes accuracy information indicating a time interval at which the sound signal is detected.
  • the detection timer is set according to this time interval.
  • Step 205 Detect an attribute value of the sound signal of the external environment according to the detection attribute every time the timer expires. The shorter the timer interval, the higher the accuracy of detecting the sound signal.
  • Step 206 Calculate, according to the calculation method, an attribute value of the detected sound signal of the external environment as a sound processing value. The calculation method is used to process the attribute value of the sound signal to obtain a sound processing value that intuitively and accurately reflects the sound signal.
  • the user preset reminder condition is that the sound signal frequency is higher than 50 Hz. Then the reminder range indicated by the reminder condition is the frequency f 50HZ.
  • Step 207 Determine whether the sound processing value is within a range indicated by the reminding condition, and if yes, proceed to step 208.
  • Step 208 Perform an operation of alerting the user according to the preset reminding manner information.
  • ringtone reminder a certain ringtone to remind the user
  • interface reminder display a prompt message on the mobile terminal interface to remind the user
  • earphone reminder play a certain sound through the earphone Remind the user to the user's ear
  • vibrate the alarm vibrate the mobile terminal to remind the user
  • intelligent voice reminder the mobile phone can pre-produce a frequency meter, and pre-produce some recordings, such as the human voice frequency, the frequency of the whistle, the frequency of the thunder, etc.
  • Various reminders that can be conceived by those skilled in the art should be included in the embodiments of the present invention.
  • step 207 if it is determined in step 207 that the sound processing value is not within the range indicated by the reminding condition, the process proceeds to step 209.
  • Step 209 the user is not prompted.
  • the sound signal is processed according to the processing command, and the sound processing value indicating the sound signal is obtained, and when the sound processing value is in the reminding range indicated by the reminding condition, according to Remind the way information, remind the user with the preset reminder method, realize the function of automatically reminding the user of the ambient sound information when the sound of the earphone is greatly restricted due to the sound played by the earphone, so that the user can correctly make the sound of the surrounding side timely Deal with, avoid missing important or urgent things.
  • the mobile terminal of the embodiment of the invention for performing the above-mentioned environmental sound reminding method is described below.
  • the structure of the mobile terminal is shown in FIG. 3, which is a schematic structural diagram of a mobile terminal according to an embodiment of the present invention.
  • the mobile terminal includes a signal collecting module 31. , a sound processing module 32 and a CPU module 33.
  • the sound signal collecting module 31 is configured to collect sound signals of an external environment. Used to collect sound signals from the external environment in real time.
  • the signal collection module 31 includes a recording unit, and the recording unit collects the sound signal of the external environment in real time by means of recording, and acquires a recording segment of the sound signal of the external environment of each time period and stores it in the CPU module 33.
  • the sound processing module 32 is configured to process the sound signal as a sound processing value according to a preset processing policy; and determine whether the sound processing value is within a range indicated by a user preset reminding condition;
  • the CPU module 33 is configured to perform an operation for reminding the user according to the reminding manner preset by the user when the sound processing module determines that it is YES.
  • the mobile terminal further includes: a setting module 34, configured to acquire a reminder condition preset by the user, a reminding manner, and a time interval for detecting the sound signal.
  • the sound processing module 32 includes: a detecting unit 321 configured to detect according to the detection attribute indicated by the processing command corresponding to the reminding condition
  • the sound signal of the external environment is the attribute value of the sound signal.
  • the detecting unit includes: a timer sub-unit, configured to set a timer according to a time interval for detecting an external sound signal preset by a user; and a detecting sub-unit, configured to be in each set when the timer expires The attribute value of the sound signal is detected in the sound signal.
  • the processing unit 322 is configured to search for a calculation method indicated by the processing command corresponding to the reminding condition, and calculate an attribute value of the sound signal as a sound processing value;
  • the determining unit 323 is configured to determine whether the sound processing value is within a range indicated by a reminder condition preset by the user. It should be noted that in order to avoid excessively meaningless reminders caused by occasional narrow noise in the space, the signal processing unit 322 can also optimize the processing logic of the processing command, and optimize the average algorithm of the sound processing value of the sound signal, for example The sound processing value of obtaining a sound signal is much larger than the sound processing value of the two times before and after, and can be regarded as a bad point discarding, thereby improving the accuracy of sound processing value detection. This improves the accuracy of sound processing and avoids unnecessary reminders. For ease of understanding, the above embodiments are described in detail in a specific application scenario: Scene 1, can also be seen in FIG. 2 and FIG.
  • Step 201 the mobile terminal setting module 34 obtains user setting information, and the mobile terminal passes A, B, through the interface. The volume levels of the four levels C and D are displayed, and the user selects D, then D is stored as the reminder condition information in the CPU module 33.
  • the user Zhang selects the reminder mode of the smart voice reminder, then the smart voice reminder is used as the reminder mode.
  • the information is stored in the CPU module 33. Further, the accuracy information set by the user Zhang is 1 ms, and 1 ms is stored as accuracy information in the CPU module 33.
  • Step 202 The sound signal collecting module 31 collects the sound signal of the external environment in real time, and the sound signal collecting module 31 records the external data, obtains the real-time recording segment, and stores the recorded segment in the CPU module 33.
  • Step 203 the sound processing module 32 Obtaining a processing command from the CPU module 33, the CPU module 33, the user preset preset reminder condition information is the volume intensity D, and the reminder range indicated by the user-selected reminder condition may be converted into 0, 1, 2, 3 and sent to the sound processing module 32, and the sound processing module 32 is based on the advance The settings then convert 0, 1, 2, 3 into corresponding reminder conditions.
  • a processing command corresponding to the reminder condition of the volume intensity D is obtained.
  • the sound processing value processed by the processing command is the volume level of the sound signal.
  • Step 204 the sound processing module 32 sets a timer according to the detection interval 1 ms; Step 205, each time the timer expires, the current sound signal is detected from the collected data; Step 206, the sound signal detected by the processing step 205 is At time TO, the detected sound processing value of the sound signal is: volume intensity DO, and the data is recorded, the next time the timer expires, the data D1 is obtained, and so on, can be obtained for a period of time. Sound signal volume intensity data D0, Dl, ..., Dn. These volume intensity data are the sound processing values obtained after processing.
  • Step 207 the sound processing module 32 determines whether the sound processing value is in the reminder range indicated by the reminding condition, and the sound processing value is greater than the volume intensity value D.
  • the sound processing module 32 generates a reminder trigger signal for reminding the user, sends a reminder trigger signal to the CPU module 33, and the CPU module 33 according to the stored reminder mode information.
  • Scene 2 can also refer to Figure 2 and Figure 3, 4, user Li Si wearing a mobile phone to use the mobile terminal to play the game, the mobile terminal pre-made the prompt text "Please note that there are abnormalities around the display interface.
  • the user wants to display an alert on the display screen by "Please note that there is an abnormality around” when there is an abnormal sound in the surrounding environment.
  • the frequency of the sound signal in the surrounding environment changes too much, it is considered that there is an abnormal sound around.
  • Step 201 The setting module 34 of the mobile terminal acquires user setting information, and the user Li can set a frequency difference threshold E. When the frequency difference between the external ambient sound signal and the previous average frequency is greater than the threshold E, the surrounding sound is abnormal. E is stored in the CPU module 33 as the reminder condition information. When the user selects the reminder mode of the smart voice reminder, the smart voice reminder mode is stored as the reminder mode information in the CPU module 33. Further, the user-set accuracy information is 1 ms, and then 1 ms is stored as the accuracy information in the CPU module 33.
  • Step 203 the sound processing module 32 obtains a processing command in the CPU module 33, and the CPU module 33 reads the preset condition information of the user as the frequency difference threshold E, and the setting module can also convert the reminding range indicated by the user-selected reminding condition.
  • 0, 1, 2, 3 are sent to the CPU module, and the CPU module converts 0, 1, 2, 3 into corresponding reminding conditions according to the preset settings.
  • a processing command corresponding to the reminder condition being the frequency difference threshold E is obtained.
  • the sound processing value processed by the processing command is the frequency difference value of the sound signal.
  • Step 204 the sound processing module 32 sets a timer according to the detection interval 1 ms; Step 205, each time the timer expires, the current sound signal is detected from the collected data; Step 206, the sound processing module 32 detects the current sound signal.
  • the volume intensity DO, and record this data, the next time the timer expires, then the data D1 is detected, and so on, the sound signal volume intensity data D0, Dl, ..., Dn can be obtained for a period of time.
  • These volume intensity data are the sound processing values obtained after processing.
  • Step 207 The sound processing module 32 determines whether the sound processing value is in the reminder range indicated by the reminding condition, and the sound processing value is greater than the frequency difference E.
  • the sound processing module 32 generates a reminder trigger signal for reminding the user, and sends the reminder trigger signal to the CPU module 33.
  • the CPU module 33 reminds the user by using the preset smart voice reminding method according to the stored reminding mode information, the mobile terminal The display shows "Please note that there is an abnormality around the interface. User Li Si can detect changes in ambient sounds while playing games with headphones.
  • Step 201 The setting module 34 of the mobile terminal acquires user setting information, and the user Xiao Wang sets the reminding condition and the reminding mode to display the volume level of any sound in the external environment on the display screen in real time. Further, the accuracy information set by the user Xiao Wang is 0.1 ms, and then 0.1 ms is stored as the accuracy information in the CPU module 33.
  • Step 202 The sound signal collecting module 31 collects the sound signal of the external environment in real time, and the signal collecting module 31 records the external data to obtain a real-time recording segment, and stores the recorded segment in the CPU module 33.
  • Step 203 the sound processing module 32 acquires a processing command in the CPU module 33, and the CPU module 33 reads the reminding condition information preset by the user for all the sound signals to be reminded, and the reminding range indicated by the reminding condition is all sound processing values.
  • Step 204 the sound processing module 32 sets a timer according to the detection interval of 0.1 ms; Step 205, detecting the current sound signal from the collected data every time the timer expires; Step 206, the sound processing module 32 processes the detected sound The volume level DO of the signal, and record this data, the next time the timer expires, the data D1 is obtained again, and so on, the sound signal volume intensity data D0, Dl, ..., Dn can be obtained for a period of time.
  • Step 207 The sound processing module 32 determines whether the sound processing value is in the reminder range indicated by the reminding condition, and all the sound processing values are within the reminding range, and proceeds to step 206.
  • Step 208 the sound processing module 32 generates a reminder trigger signal for reminding the user, and sends a reminder trigger signal to the CPU module 33.
  • the CPU module 33 uses the preset real-time display sound volume level to set the sound processing value detected at each time point. Dn is displayed on the display. It should be noted that the present invention can also be applied to other various scenarios, for example: for a hospital treatment system, when a patient is called for help, yelling, and shouting loudly, the physician is reminded to rush to the scene for treatment. It can also be used in early childhood education systems. For example, when it is detected that a child is being crying, the teacher is reminded to know the situation in time to avoid accidents.
  • the mobile terminal processes the sound signal according to the processing command by collecting the sound signal of the external environment in real time, and obtains a sound processing value indicating the sound signal, at the sound.
  • the value of the reminder indicates the reminder range
  • the user is reminded by the preset reminder method to realize the function of automatically reminding the user of the ambient sound information when the sound of the earphone is greatly restricted by the earphone, so that the user Correctly handle the sounds around you and avoid missing important or urgent things.
  • the program can be stored in a computer readable storage medium.
  • the storage medium can include: ROM, RAM, disk or CD, etc.

Abstract

A reminding method of environmental sound and a mobile terminal thereof are provided by the present invention. The embodiments of the present invention collect a sound signal of the external environment in real time, process said sound signal according to a processing command, obtain a sound processing value indicating said sound signal, and when the sound processing value is within the reminding range indicated by a reminding condition, remind a user by a preset reminding manner according to the reminding manner information. The embodiments of the present invention realize the function of automatically reminding users of environmental sound information when the sense of hearing is greatly limited, thus enabling users to correctly process the surrounding sound in time and avoiding missing important or emergent matters.

Description

一种环境声音提醒方法和移动终端  Environmental sound reminding method and mobile terminal
本申请要求于 2010 年 2 月 20 日提交中国专利局、 申请号为 201010112218.8、发明名称为"一种环境声音提醒方法和移动终端 "的中国专利 申请的优先权, 其全部内容通过引用结合在本申请中。 技术领域  This application claims priority to Chinese Patent Application No. 201010112218.8, entitled "An Environmental Sound Reminder Method and Mobile Terminal", filed on February 20, 2010, the entire contents of which are incorporated herein by reference. In the application. Technical field
本发明涉及通信技术领域, 具体涉及一种环境声音提醒方法和移动终端。 背景技术  The present invention relates to the field of communications technologies, and in particular, to an environmental sound reminding method and a mobile terminal. Background technique
随着通信技术的发展, 移动终端 (如手机、 平板电脑等)已经密切融入人们 生活中。 移动终端的功能也越来越多元化, 除了满足人们的移动通信的基本 需求, 还可以提供娱乐、 社交等丰富的功能, 大大改善了人们的生活。 使用 移动终端听音乐、 听收音机和玩游戏已经成为人们不可或缺的娱乐方式。 用 户在使用移动终端的这些娱乐功能时往往要戴上耳机(例如, 戴上耳机听音 乐或在游戏中享受音响效果等 ), 移动终端播放的声音通过耳机传输到用户耳 朵里。  With the development of communication technologies, mobile terminals (such as mobile phones, tablets, etc.) have been closely integrated into people's lives. The functions of mobile terminals are also becoming more and more diversified. In addition to satisfying the basic needs of people's mobile communications, they can also provide rich functions such as entertainment and socialization, which greatly improves people's lives. Using mobile terminals to listen to music, listen to the radio and play games has become an indispensable form of entertainment for people. Users often wear headphones when using these entertainment functions of the mobile terminal (for example, wearing headphones to listen to music or enjoying sound effects in the game), and the sound played by the mobile terminal is transmitted to the user's ear through the earphone.
如今, 一些移动终端具有提醒用户时间或者事件的提醒功能, 例如, 用 户预先设置提醒时间和提醒方式, 移动终端就启动一个相应的定时器, 在定 时器的时间到达时(用户设置的时间到达时), 移动终端就会按照用户预先设 置的提醒方式对用户进行提醒。  Nowadays, some mobile terminals have a reminding function for reminding the user of time or event. For example, the user presets the reminding time and the reminding mode, and the mobile terminal starts a corresponding timer when the time of the timer arrives (when the time set by the user arrives) ), the mobile terminal will remind the user according to the reminder method preset by the user.
在对现有技术的研究和实践过程中, 本发明实施例的发明人发现, 现有 技术中存在以下技术问题: 如果用户在街上一边行走一边戴耳机欣赏音乐, 过马路时正好有高速行驶的汽车从侧面过来, 用户可能会因为听不到汽车的 声音而不能做出及时反应, 从而发生车祸。 用户戴上耳机聆听移动终端播放 的声音时, 作为辅助视觉感官的听觉因耳机播放的声音受到了极大的限制。 用户很难注意到外部环境的声音(呼救信号, 警报等), 也难以对外部环境声 音#丈出正确和及时的响应。 发明内容  In the research and practice of the prior art, the inventors of the embodiments of the present invention found that the following technical problems exist in the prior art: If the user walks on the street while wearing headphones to enjoy music, there is a high speed when crossing the road. The car comes from the side, and the user may not be able to respond in time because he can't hear the car's voice, resulting in a car accident. When a user wears a headphone to listen to the sound played by the mobile terminal, the sound as an auxiliary visual sense is greatly limited by the sound played by the earphone. It is difficult for the user to notice the sound of the external environment (distress signal, alarm, etc.), and it is also difficult to respond correctly and promptly to the external environment sound #. Summary of the invention
鉴于此, 本发明实施例提供一种能够根据环境声音信号提醒用户的环境 声音提醒方法和一种相应的移动终端。 In view of this, an embodiment of the present invention provides an environment capable of alerting a user according to an environmental sound signal. A voice alert method and a corresponding mobile terminal.
一种环境声音提醒方法, 包括:  An environmental sound reminding method, including:
釆集外部环境的声音信号;  Collecting sound signals from the external environment;
根据预置的声音处理策略, 处理所述声音信号为声音处理值;  Processing the sound signal as a sound processing value according to a preset sound processing strategy;
判断所述声音处理值是否在预置的提醒条件指示的范围内;  Determining whether the sound processing value is within a range indicated by a preset reminding condition;
若是, 则根据用户预置的提醒方式, 执行提醒用户的操作。  If yes, the operation of reminding the user is performed according to the reminder mode preset by the user.
一种移动终端, 包括:  A mobile terminal includes:
声音信号釆集模块, 用于釆集外部环境的声音信号;  a sound signal collection module for collecting sound signals of an external environment;
声音处理模块, 用于根据用户预置的声音处理策略, 处理所述声音信号 为声音处理值; 判断所述声音处理值是否在用户预置的提醒条件指示的范围 内;  a sound processing module, configured to process the sound signal as a sound processing value according to a sound processing policy preset by the user; and determine whether the sound processing value is within a range indicated by the user preset reminding condition;
CPU模块, 用于在声音处理模块判断为是时, 根据用户预置的提醒方式, 执行提醒用户的操作。  The CPU module is configured to perform an operation for reminding the user according to the reminding manner preset by the user when the sound processing module determines that it is YES.
本发明实施例通过实时釆集外部环境的声音信号, 处理所述声音信号, 获得指示所述声音信号的声音处理值, 当声音处理值在提醒条件指示的提醒 范围时, 根据提醒方式信息, 釆用预置的提醒方式提醒用户, 实现了在听觉 因耳机播放的声音受到了极大的限制时, 自动提醒用户周围环境声音信息的 功能, 使得用户对身边声音及时做出正确处理, 避免错过重要或紧急事情。 附图说明  The embodiment of the present invention processes the sound signal by collecting the sound signal of the external environment in real time, and obtains a sound processing value indicating the sound signal. When the sound processing value is in the reminder range indicated by the reminding condition, according to the reminding mode information, Remind the user with the preset reminder method, which realizes the function of automatically reminding the user of the ambient sound information when the sound of the earphone is greatly restricted due to the sound played by the earphone, so that the user can correctly handle the sound around the clock in time to avoid missing important Or urgent things. DRAWINGS
为了更清楚地说明本发明实施例或现有技术中的技术方案, 下面将对实 施例中所需要使用的附图作简单地介绍, 显而易见地, 下面描述中的附图仅 仅是本发明的一些实施例, 对于本领域普通技术人员来讲, 在不付出创造性 劳动性的前提下, 还可以根据这些附图获得其他的附图。  In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings to be used in the embodiments will be briefly described below. Obviously, the drawings in the following description are only some of the present invention. For the embodiments, those skilled in the art can obtain other drawings according to the drawings without any creative labor.
图 1是本发明声音环境声音提醒方法的第一实施例的基本流程示意图; 图 2是本发明声音环境声音提醒方法的第二实施例的基本流程示意图; 图 3是本发明实施例移动终端的结构示意图。 具体实施方式  1 is a schematic diagram of a basic flow of a first embodiment of a sound environment sound reminding method according to the present invention; FIG. 2 is a schematic diagram of a basic flow of a sound environment sound reminding method according to a second embodiment of the present invention; Schematic. detailed description
下面将结合本发明实施例中的附图, 对本发明实施例中的技术方案进行 清楚、 完整地描述, 显然, 所描述的实施例仅仅是本发明一部分实施例, 而 不是全部的实施例。 基于本发明中的实施例, 本领域普通技术人员在没有做 出创造性劳动前提下所获得的所有其他实施例 , 都属于本发明保护的范围。 本发明实施例提供一种环境声音提醒方法, 通过釆集的外部环境的声音 信号, 釆用预先设置的提醒方式提醒用户外部环境声音, 本发明实施例还提 供相应的移动终端。 以下分别进行详细说明。 实施例一 本发明第一实施例的环境声音提醒方法基本流程可参考图 1 ,本实施例的 环境声音提醒方法的主要包括步骤: 步骤 101 , 实时釆集外部环境的声音信号。 实时釆集外部环境的声音信号可以通过实时录音的方式, 获取各个时段 外部环境的声音信号的录音片段并存储起来。 当然在本发明实施例中包括但 不限于上述方式来釆集外部环境的声音信号。 步骤 102,根据用户预置的提醒条件对应的处理命令, 处理所述声音信 号为声音处理值。 移动终端根据自身软硬件支持能力, 提供不同方式的提醒条件。 提醒 条件包括但不限于以下几种: 敏感度提醒条件, 用户设置为, 根据声音的音 量大小或者频率大小来决定是否提醒用户, 当检测的声音信号的声音处理值 (音量) 达到用户设置的提醒条件才发起提醒; 变化量提醒条件, 用户设置 为, 根据检测到的环境中的声音信号的声音处理值(音量)发生的改变的大 小是否达到用户设置的提醒条件来决定是否提醒。 如: 微小变化、 中等变化 和很大变化等。 语音识别提醒条件, 用户设置为, 当釆集到的声音与预先录 入的声音进行对比,在相似度达到一定程度时发生提醒。例如,用户张三把"张 三,,和"小张"的录音录入。 当有人呼叫"张三,,或"小张,,时, 相似度达到设定的 程度时发生提醒, 此时, 可以提醒用户周围有人呼叫张三。 用户在设置提醒 条件时, 界面上可以提供一些直观的选项供用户选择, 也可以由用户自己设 置。 如, 用户可以设置提醒条件为: 声音音量强度达到提醒门限时发生提醒, 也可以用普通用户更易理解的文字, 在界面上选择微小声音、 中等声音、 嘈 杂声音或刺耳声音, 每个选项都对应经过量化的提醒条件。 用户预置的提醒条件和处理命令为对应关系, 处理命令包括检测属性和 计算方法, 检测属性指示声音信号的属性值是音量大小、 频率大小还是功率 大小, 检测属性指示检测声音信号的频率大小, 那么声音信号的属性值就是 声音信号的频率值, 若检测属性只是检测声音信号的音量大小, 那么声音的 属性值就是声音信号的音量值。 计算方法是计算声音信号的属性值为声音处 理值的处理方法, 计算方法可以是根据声音信号的属性值求平均值, 也可以 是处理声音信号的属性值的其他计算方法。 通过计算方法计算声音信号的属 性值得到的声音处理值更加精确可靠。 根据用户预置的提醒条件和提醒条件 于处理命令的对应关系, 可选择对应的处理命令来处理声音信号。 例如, 若 提醒条件是频率提醒门限, 那么, 根据与之对应的处理命令, 根据该处理命 令的检测属性检测声音信号的属性值, 该声音信号的属性值是声音信号的频 率值, 再根据计算方法, 计算检测到的声音信号的频率值。 当然, 在本发明 实施例中包括但不限于釆用上述方式来预先设置提醒条件与处理命令的对应 关系。 The technical solution in the embodiment of the present invention will be described below with reference to the accompanying drawings in the embodiments of the present invention. It is clear that the described embodiments are only a part of the embodiments of the invention, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present invention without departing from the inventive scope are the scope of the present invention. The embodiment of the present invention provides an environmental sound reminding method. The sound environment of the external environment is used to remind the user of the external environment sound by using a preset reminding manner. The embodiment of the present invention further provides a corresponding mobile terminal. The details are described below separately. Embodiment 1 The basic flow of the environmental sound reminding method of the first embodiment of the present invention can be referred to FIG. 1. The environmental sound reminding method of the present embodiment mainly includes the following steps: Step 101: Collecting sound signals of an external environment in real time. The real-time sound signal of the external environment can be obtained by real-time recording, and the sound recording of the external environment of each time period can be obtained and stored. Of course, in the embodiment of the present invention, but not limited to the above manner, the sound signals of the external environment are collected. Step 102: Process the sound signal as a sound processing value according to a processing command corresponding to the reminding condition preset by the user. The mobile terminal provides different manners of reminding conditions according to its own software and hardware support capabilities. Reminder conditions include but are not limited to the following: Sensitivity reminder conditions, the user sets to, according to the volume of the sound or the size of the frequency to decide whether to remind the user, when the sound processing value (volume) of the detected sound signal reaches the user-set reminder The condition initiates the reminder; the change amount reminder condition, the user sets, according to whether the size of the change of the sound processing value (volume) of the sound signal in the detected environment reaches the reminder condition set by the user to decide whether to remind. Such as: small changes, medium changes and large changes. The voice recognition reminder condition is set by the user to, when the collected sound is compared with the pre-recorded sound, a reminder occurs when the similarity reaches a certain level. For example, the user Zhang San recorded the recordings of "Zhang San,, and "Xiao Zhang". When someone calls "Zhang San," or "Xiao Zhang,", the reminder occurs when the similarity reaches the set level. At this time, The user can be reminded to call Zhang three. When the user sets the reminder condition, the interface can provide some intuitive options for the user to select, or can be set by the user. For example, the user can set the reminder condition as: the sound volume intensity reaches the reminder door Reminders occur within a limited time. You can also use the text that is easier for the average user to understand. Select tiny, medium, noisy, or harsh sounds on the interface. Each option corresponds to a quantified reminder condition. The user preset reminder condition and the processing command are corresponding relationships, and the processing command includes a detection attribute and a calculation method, and the detection attribute indicates whether the attribute value of the sound signal is a volume size, a frequency size or a power size, and the detection attribute indicates a frequency of detecting the sound signal, Then, the attribute value of the sound signal is the frequency value of the sound signal. If the detection attribute is only the volume level of the sound signal, the attribute value of the sound is the volume value of the sound signal. The calculation method is a processing method for calculating the attribute value of the sound signal as the sound processing value, and the calculation method may be an average value according to the attribute value of the sound signal, or another calculation method for processing the attribute value of the sound signal. The sound processing value obtained by calculating the attribute value of the sound signal by the calculation method is more accurate and reliable. According to the corresponding condition of the reminder condition and the reminding condition preset by the user in the processing command, the corresponding processing command may be selected to process the sound signal. For example, if the alert condition is a frequency alert threshold, the attribute value of the sound signal is detected according to the detection attribute of the processing command according to the processing command corresponding thereto, and the attribute value of the sound signal is the frequency value of the sound signal, and then calculated according to the calculation. Method, calculating the frequency value of the detected sound signal. Of course, the corresponding relationship between the reminding condition and the processing command is preset in the foregoing manner in the embodiment of the present invention.
步骤 103 , 判断所述声音处理值是否在用户预置的提醒条件指示的范围 内, 若是, 则进入步骤 104; 例如, 下表 1所示, 用户设置时可以选择的提醒条件为声音的强度值, 提 醒门限分别为 a、 b、 c和 d ( a<b<c<d ): 四个门限分别对应微小声音、 中等声 音、 嘈杂声音和刺耳声音, 如下表 1所示。
Figure imgf000005_0002
Step 103: Determine whether the sound processing value is within a range indicated by the user preset reminding condition, and if yes, proceed to step 104; for example, as shown in Table 1 below, the reminding condition that can be selected by the user setting is the sound intensity value. The thresholds are a, b, c, and d (a<b<c<d): The four thresholds correspond to tiny sounds, medium sounds, noisy sounds, and harsh sounds, as shown in Table 1 below.
Figure imgf000005_0002
Figure imgf000005_0001
Figure imgf000005_0001
用户选择提醒条件后, 可将用户选择的提醒条件指示的提醒范围转化为 After the user selects the reminder condition, the reminder range indicated by the user-selected reminder condition can be converted into
0, 1 , 2 , 3发送出去, 根据预先的设置, 再把 0, 1 , 2, 3读取为对应的范围 ( dbm, 强度值), 处理过后的声音处理值就是声音强度值, 判断该强度值是 否在读取的范围内, 在判断为是的时候进入步骤 104。 步骤 104, 根据预置的提醒方式信息执行提醒用户的操作。 用户可以设置适合自己的提醒方式, 如, 铃声提醒, 界面提示, 耳机提 醒, 振动提醒, 智能语音提醒等, 将这些提醒方式存储起来, 在步骤 103 判 断为是时, 根据用户设置或系统默认的提醒方式提醒用户。 当然, 在本发明 实施例中包括但不限于釆用上述方式来提醒用户。 经过本实施例中, 通过实时釆集外部环境的声音信号, 处理所述声音信 号, 获得指示所述声音信号的声音处理值, 在声音处理值在提醒条件指示的 提醒范围时, 根据提醒方式信息, 釆用预先设置的提醒方式提醒用户, 实现 了在听觉因耳机播放的声音受到了极大的限制时, 自动提醒用户周围环境声 音信息的功能, 使得用户对身边声音及时做出正确处理, 避免错过重要或紧 急事情。 0, 1 , 2 , 3 are sent out. According to the preset setting, 0, 1 , 2, 3 are read as the corresponding range (dbm, intensity value), and the processed sound processing value is the sound intensity value. Whether the intensity value is within the range of reading, and when it is judged as YES, the process proceeds to step 104. Step 104: Perform an operation of reminding the user according to the preset reminding manner information. The user can set a reminder method suitable for himself, such as ringtone reminder, interface prompt, earphone reminder, vibration reminder, intelligent voice reminder, etc., store these reminder methods, and judge in step 103 When it is broken, the user is reminded according to the user setting or the system default reminder. Of course, in the embodiment of the present invention, including but not limited to, the user is reminded in the above manner. In this embodiment, the sound signal is processed by collecting the sound signal of the external environment in real time, and the sound processing value indicating the sound signal is obtained. When the sound processing value is in the reminding range indicated by the reminding condition, according to the reminding mode information提醒 Remind the user with a preset reminder method, which realizes the function of automatically reminding the user of the ambient sound information when the sound of the earphone is greatly restricted due to the sound of the earphone playback, so that the user can correctly handle the sound around the body in time, avoiding Miss important or urgent things.
实施例二 为便于理解, 下面对本发明实施例中的环境声音提醒方法进行详细描述, 请参阅图 2, 本发明实施例中环境声音提醒方法的第二实施例包括: 步骤 201 , 获取用户设置或系统默认的提醒方式、提醒条件和检测声音信 号的时间间隔。 提醒方式的种类有很多种, 用户可以设置为以声音、 图像、 振动等提 醒方式提醒用户注意。 如: 铃声提醒, 播放的某种铃声提醒用户; 界面提醒, 在移动终端界面上显示提示消息来提醒用户; 耳机提醒, 播放某种声音通过 耳机传到用户耳朵来提醒用户; 振动提醒, 振动移动终端来提醒用户; 智能 语音提醒, 手机中可以预制一张频率表, 并预制一些录音, 如人发声频率, 汽笛的频率, 雷声的频率等, 当检测到的声音信号的声音频率与频率表某项 匹配时, 手机播放相对应录音来提示。 如: "您周围有人呼唤"、 "您周围有汽 车鸣笛 "等。 可以理解的是, 本领域技术人员能够想到的各种提醒方式都应包 括在本发明实施例中。 移动终端可以根据自身软硬件支持能力, 提供不同方式的提醒条件。 提醒条件包括但不限于以下几种: 敏感度提醒条件, 用户设置为, 根据声音 的音量大小或者频率大小来决定是否提醒用户, 当检测的声音信号的声音处 理值(音量) 达到用户设置的提醒条件才发起提醒; 变化量提醒条件, 用户 设置为, 根据检测到的环境中的声音信号的声音处理值(音量)发生的改变 的大小是否达到用户设置的提醒条件来决定是否提醒。 如: 微小变化、 中等 变化和很大变化等。 语音识别提醒条件, 用户设置为, 当釆集到的声音与预 先录入的声音进行对比, 在相似度达到一定程度时发生提醒。 例如, 用户张 三把"张三"和"小张"的录音录入。 当有人呼叫"张三"或"小张,,时, 相似度达到 设定的程度时发生提醒, 此时, 可以提醒用户周围有人呼叫张三。 用户在设 置提醒条件时, 界面上可以提供一些直观的选项供用户选择, 也可以由用户 自己设置。 如, 用户可以设置提醒条件为: 声音音量强度达到提醒门限时发 生提醒, 也可以用普通用户更易理解的文字, 在界面上选择微小声音、 中等 声音、 嘈杂声音或刺耳声音, 每个选项都对应经过量化的提醒条件。 用户预置的提醒条件和处理命令为对应关系, 处理命令包括检测属性和 计算方法, 检测属性指示声音信号的属性值是音量大小、 频率大小还是功率 大小, 检测属性指示检测声音信号的频率大小, 那么声音信号的属性值就是 声音信号的频率值, 若检测属性只是检测声音信号的音量大小, 那么声音的 属性值就是声音信号的音量值。 计算方法是计算声音信号的属性值为声音处 理值的处理方法, 计算方法可以是根据声音信号的属性值求平均值, 也可以 是处理声音信号的属性值的其他计算方法。 通过计算方法计算声音信号的属 性值得到的声音处理值更加精确可靠。 根据用户预置的提醒条件和提醒条件 于处理命令的对应关系, 可选择对应的处理命令来处理声音信号。 例如, 若 提醒条件是频率提醒门限, 那么, 根据与之对应的处理命令, 根据该处理命 令的检测属性检测声音信号的属性值, 该声音信号的属性值是声音信号的频 率值, 再根据计算方法, 计算检测到的声音信号的频率值。 当然, 在本发明 实施例中包括但不限于釆用上述方式来预先设置提醒条件与处理命令的对应 关系。 检测精度是用户检测声音信号的属性值的时间间隔, 用户可以设置电 平检测的间隔时间来改变检测声音信号的精度, 用户设置的检测精度越高, 电平检测的声音信号的间隔时间越小。 步骤 202, 实时釆集外部环境的声音信号; 实时釆集外部环境的声音信号可以通过实时录音的方式, 获取各个时段 外部环境的声音信号的录音片段并存储起来。 当然在本发明实施例中包括但 不限于上述方式来釆集外部环境的声音信号。 步骤 203 , 查找与提醒条件对应的处理命令。 处理命令包括检测属性和计算方法, 提醒条件与处理命令的对应关系是 预先配置的, 根据提醒条件对应的处理命令的检测属性和计算方法来获得声 音处理值, 例如, 若提醒条件指示的范围是频率范围, 那么处理命令处理检 测属性是检测声音信号的频率值, 根据计算方法计算检测的频率值, 获得声 音信号处理值, 若提醒条件指示的范围是音量大小, 那么处理命令检测声音 信号的属性值为功率值, 计算该功率值为声音处理值。 The second embodiment of the environmental sound reminding method in the embodiment of the present invention includes: Step 201, obtaining user settings or The default reminder mode, reminder conditions, and time interval for detecting sound signals. There are many types of reminders, and users can set them to remind users of their sounds, images, vibrations, etc. Such as: ringtone reminder, a certain ringtone to remind the user; interface reminder, display a prompt message on the mobile terminal interface to remind the user; earphone reminder, play a certain sound through the earphone to the user's ear to remind the user; vibration reminder, vibration movement The terminal reminds the user; intelligent voice reminder, the mobile phone can pre-produce a frequency meter, and pre-produce some recordings, such as the human voice frequency, the frequency of the whistle, the frequency of the thunder, etc., when the sound frequency and frequency table of the detected sound signal When a match is made, the phone plays a corresponding recording to prompt. Such as: "Some around you call", "There is a car whistling around you" and so on. It will be understood that various reminders that can be conceived by those skilled in the art should be included in the embodiments of the present invention. The mobile terminal can provide different manners of reminding conditions according to its own software and hardware support capabilities. Reminder conditions include but are not limited to the following: Sensitivity reminder conditions, the user sets to, according to the volume of the sound or the size of the frequency to decide whether to remind the user, when the sound processing value (volume) of the detected sound signal reaches the user-set reminder The condition initiates the reminder; the change amount reminder condition, the user sets, according to whether the size of the change of the sound processing value (volume) of the sound signal in the detected environment reaches the reminder condition set by the user to decide whether to remind. Such as: small changes, medium changes and large changes. The voice recognition reminder condition, the user sets the sound and the preset The first recorded sound is compared, and a reminder occurs when the similarity reaches a certain level. For example, the user Zhang San recorded the recordings of "Zhang San" and "Xiao Zhang". When someone calls "Zhang San" or "Xiao Zhang," when the similarity reaches the set level, a reminder occurs. At this time, the user can be reminded to call Zhang San. When the user sets the reminder condition, the interface can provide some Intuitive options are available for the user to select, or they can be set by the user. For example, the user can set the reminder condition as: When the sound volume intensity reaches the reminder threshold, a reminder occurs, or a text that is easier for the average user to understand can be selected, and a small sound is selected on the interface. Medium sound, noisy sound or harsh sound, each option corresponds to a quantized reminder condition. The user preset reminder condition and processing command are corresponding, the processing command includes detection attribute and calculation method, and the detection attribute indicates the attribute value of the sound signal. Is the volume size, frequency size or power size, the detection attribute indicates the frequency of detecting the sound signal, then the attribute value of the sound signal is the frequency value of the sound signal, and if the detection attribute is only detecting the volume level of the sound signal, then the attribute value of the sound is The volume value of the sound signal. The calculation method is a processing method for calculating the attribute value of the sound signal as the sound processing value, and the calculation method may be averaging according to the attribute value of the sound signal, or other calculation method for processing the attribute value of the sound signal. The sound processing value obtained by the attribute value of the signal is more accurate and reliable. According to the corresponding condition of the reminder condition and the reminding condition of the user, the corresponding processing command can be selected to process the sound signal. For example, if the reminding condition is the frequency reminding threshold Then, according to the processing command corresponding thereto, detecting the attribute value of the sound signal according to the detection attribute of the processing command, the attribute value of the sound signal is the frequency value of the sound signal, and calculating the detected sound signal according to the calculation method. The frequency value. Of course, in the embodiment of the present invention, but not limited to, the corresponding relationship between the reminding condition and the processing command is preset in the above manner. The detecting precision is a time interval at which the user detects the attribute value of the sound signal, and the user can set the level. The interval between detections changes The accuracy of the sound signal is measured, and the higher the detection precision set by the user, the smaller the interval time of the sound signal of the level detection. Step 202: Collecting the sound signal of the external environment in real time; real-time recording the sound signal of the external environment through real-time recording In the embodiment of the present invention, the sound signal of the external environment is included in the embodiment of the present invention, but is not limited to the above manner to collect the sound signal of the external environment. Step 203: Find processing corresponding to the reminding condition command. The processing command includes a detection attribute and a calculation method, and the correspondence between the reminding condition and the processing command is pre-configured, and the sound processing value is obtained according to the detection attribute and the calculation method of the processing command corresponding to the reminding condition, for example, if the range of the reminding condition indication is The frequency range, then the processing command processing detection attribute is to detect the frequency value of the sound signal, calculate the detected frequency value according to the calculation method, and obtain the sound signal processing value. If the range indicated by the reminding condition is the volume level, the processing command detects the attribute of the sound signal. The value is the power value, and the power value is calculated as the sound processing value.
步骤 204, 根据检测声音信号的时间间隔设定定时器。 用户设置信息还包括精度信息, 所述精度信息指示检测所述声音信号的 时间间隔。 根据这个时间间隔设定检测定时器。  Step 204: Set a timer according to a time interval at which the sound signal is detected. The user setting information further includes accuracy information indicating a time interval at which the sound signal is detected. The detection timer is set according to this time interval.
步骤 205 , 在每次定时器到时, 根据检测属性, 检测外部环境的声音信号 的属性值。 定时器时间间隔越短, 检测声音信号的精度就越高。 步骤 206,根据计算方法, 计算检测的外部环境的声音信号的属性值为声 音处理值。 通过计算方法处理声音信号的属性值, 获得直观而精确反应声音信号的 声音处理值, 例如, 用户预置的提醒条件为声音信号频率高于 50HZ。 那么该 提醒条件指示的提醒范围是频率 f 50HZ。 选择与提醒条件对应的处理命令, 该处理命令的检测属性指示检测声音信号为声音频率值, 在获得声音信号频 率值之后, 通过计算方法 (例如, 求平均值)处理检测到的声音信号的属性 值, 从而获得更为直观而又精确反应声音信号的声音处理值。 需要注意的是, 为了避免空间中偶然的窄噪声导致过多无意义的提醒, 还可以对处理命令的处理逻辑进行优化, 对于声音信号的声音处理值的平均 算法进行优化, 例如, 获取一个声音信号的声音处理值比前后两个时间的声 音处理值大很多, 可以认为是坏点丟弃, 提高声音处理值检测的准确性。 步骤 207 , 判断所述声音处理值是否在提醒条件所指示的范围, 若是, 则进入步骤 208。 步骤 208,根据预置的提醒方式信息执行提醒用户的操作。提醒方式的种 类有很多种, 如: 铃声提醒, 播放的某种铃声提醒用户; 界面提醒, 在移动 终端界面上显示提示消息来提醒用户; 耳机提醒, 播放某种声音通过耳机传 到用户耳朵来提醒用户; 振动提醒, 振动移动终端来提醒用户; 智能语音提 醒, 手机中可以预制一张频率表, 并预制一些录音, 如人发声频率, 汽笛的 频率, 雷声的频率等, 本领域技术人员能够想到的各种提醒方式都应包括在 本发明实施例中。 Step 205: Detect an attribute value of the sound signal of the external environment according to the detection attribute every time the timer expires. The shorter the timer interval, the higher the accuracy of detecting the sound signal. Step 206: Calculate, according to the calculation method, an attribute value of the detected sound signal of the external environment as a sound processing value. The calculation method is used to process the attribute value of the sound signal to obtain a sound processing value that intuitively and accurately reflects the sound signal. For example, the user preset reminder condition is that the sound signal frequency is higher than 50 Hz. Then the reminder range indicated by the reminder condition is the frequency f 50HZ. Selecting a processing command corresponding to the alert condition, the detection attribute of the processing command indicating that the detected sound signal is a sound frequency value, and after obtaining the sound signal frequency value, processing the attribute of the detected sound signal by a calculation method (eg, averaging) The value, in order to obtain a sound processing value that is more intuitive and accurately reflects the sound signal. It should be noted that in order to avoid excessive and meaningless reminders caused by occasional narrow noise in the space, the processing logic of the processing command can be optimized, and the average algorithm of the sound processing value of the sound signal is optimized, for example, acquiring a sound. The sound processing value of the signal is much larger than the sound processing values of the two times before and after, and can be regarded as a bad point discarding, and the accuracy of the sound processing value detection is improved. Step 207: Determine whether the sound processing value is within a range indicated by the reminding condition, and if yes, proceed to step 208. Step 208: Perform an operation of alerting the user according to the preset reminding manner information. There are many types of reminders, such as: ringtone reminder, a certain ringtone to remind the user; interface reminder, display a prompt message on the mobile terminal interface to remind the user; earphone reminder, play a certain sound through the earphone Remind the user to the user's ear; vibrate the alarm, vibrate the mobile terminal to remind the user; intelligent voice reminder, the mobile phone can pre-produce a frequency meter, and pre-produce some recordings, such as the human voice frequency, the frequency of the whistle, the frequency of the thunder, etc. Various reminders that can be conceived by those skilled in the art should be included in the embodiments of the present invention.
进一步地, 若在步骤 207 中, 判断出该声音处理值不在提醒条件指示的 范围内, 则进入步骤 209。  Further, if it is determined in step 207 that the sound processing value is not within the range indicated by the reminding condition, the process proceeds to step 209.
步骤 209, 不提示用户。 经过本实施例中, 通过实时釆集外部环境的声音信号, 按照处理命令处 理所述声音信号, 获得指示所述声音信号的声音处理值, 在声音处理值在提 醒条件指示的提醒范围时, 根据提醒方式信息, 釆用预先设置的提醒方式提 醒用户, 实现了在听觉因耳机播放的声音受到了极大的限制时, 自动提醒用 户周围环境声音信息的功能, 使得用户对身边声音及时做出正确处理, 避免 错过重要或紧急事情。  Step 209, the user is not prompted. In this embodiment, by real-time collecting the sound signal of the external environment, the sound signal is processed according to the processing command, and the sound processing value indicating the sound signal is obtained, and when the sound processing value is in the reminding range indicated by the reminding condition, according to Remind the way information, remind the user with the preset reminder method, realize the function of automatically reminding the user of the ambient sound information when the sound of the earphone is greatly restricted due to the sound played by the earphone, so that the user can correctly make the sound of the surrounding side timely Deal with, avoid missing important or urgent things.
下面对用于执行上述环境声音提醒方法的发明实施例的移动终端进行说 明, 其结构示意图参考图 3 , 是本发明实施例提供的移动终端的结构示意图, 该移动终端包括信号釆集模块 31、 声音处理模块 32和 CPU模块 33。 声音信号釆集模块 31 , 用于釆集外部环境的声音信号。 用于实时釆集外部环境的声音信号。 具体的, 信号釆集模块 31包括一个 录音单元, 录音单元通过录音的方式实时釆集外部环境的声音信号, 获取各 个时段外部环境的声音信号的录音片段并存储在 CPU模块 33。 声音处理模块 32, 用于根据预置的处理策略, 处理所述声音信号为声音 处理值; 判断所述声音处理值是否在用户预置的提醒条件指示的范围内;  The mobile terminal of the embodiment of the invention for performing the above-mentioned environmental sound reminding method is described below. The structure of the mobile terminal is shown in FIG. 3, which is a schematic structural diagram of a mobile terminal according to an embodiment of the present invention. The mobile terminal includes a signal collecting module 31. , a sound processing module 32 and a CPU module 33. The sound signal collecting module 31 is configured to collect sound signals of an external environment. Used to collect sound signals from the external environment in real time. Specifically, the signal collection module 31 includes a recording unit, and the recording unit collects the sound signal of the external environment in real time by means of recording, and acquires a recording segment of the sound signal of the external environment of each time period and stores it in the CPU module 33. The sound processing module 32 is configured to process the sound signal as a sound processing value according to a preset processing policy; and determine whether the sound processing value is within a range indicated by a user preset reminding condition;
CPU模块 33 , 用于在声音处理模块判断为是时, 根据用户预置的提醒方 式, 执行提醒用户的操作。 The CPU module 33 is configured to perform an operation for reminding the user according to the reminding manner preset by the user when the sound processing module determines that it is YES.
该移动终端还包括: 设置模块 34 , 用于获取用户预置的提醒条件、 提醒 方式和检测声音信号的时间间隔。 优选的, 声音处理模块 32包括: 检测单元 321 , 用于根据提醒条件对应的处理命令指示的检测属性,检测 外部环境的声音信号为声音信号的属性值。 具体的, 该检测单元包括: 定时 器子单元, 用于根据用户预置的检测外部声音信号的时间间隔设定定时器; 检测子单元, 用于在每次定时器到时, 在釆集的声音信号中检测声音信号的 属性值。 The mobile terminal further includes: a setting module 34, configured to acquire a reminder condition preset by the user, a reminding manner, and a time interval for detecting the sound signal. Preferably, the sound processing module 32 includes: a detecting unit 321 configured to detect according to the detection attribute indicated by the processing command corresponding to the reminding condition The sound signal of the external environment is the attribute value of the sound signal. Specifically, the detecting unit includes: a timer sub-unit, configured to set a timer according to a time interval for detecting an external sound signal preset by a user; and a detecting sub-unit, configured to be in each set when the timer expires The attribute value of the sound signal is detected in the sound signal.
处理单元 322 , 用于查找与提醒条件对应的处理命令指示的计算方法, 计 算所述声音信号的属性值为声音处理值;  The processing unit 322 is configured to search for a calculation method indicated by the processing command corresponding to the reminding condition, and calculate an attribute value of the sound signal as a sound processing value;
判断单元 323 ,用于判断所述声音处理值是否在用户预置的提醒条件指示 的范围内。 需要注意的是, 为了避免空间中偶然的窄噪声导致过多无意义的提醒, 信号处理单元 322还可以对处理命令的处理逻辑进行优化, 对于声音信号的 声音处理值的平均算法进行优化, 例如, 获取一个声音信号的声音处理值比 前后两个时间的声音处理值大很多, 可以认为是坏点丟弃, 提高声音处理值 检测的准确性。 这样提高声音处理的准确性, 避免产生不必要的提醒。 为了便于理解, 下面以具体的应用场景对上述实施例进行详细描述: 场景 1 , 可同样参见图 2和图 3 , 假设, 张三在深夜回家的路上, 边走边 用手机听音乐, 路上较为安静, 张三预先设置为在环境音量强度大于 D的时 候产生 "请注意, 周围有较大声响,,的提醒。 手机中预制了一张音量强度表, 该 音量强度表对应有 A、 B、 C和 D四个级别的音量强度。并预制了人声录音"请 注意, 周围有较大声响"。 步骤 201 , 移动终端的设置模块 34获取用户设置信息, 移动终端通过界 面把 A、 B、 C和 D四个级别的音量强度显示出来, 用户张三选择 D, 那么 D 作为提醒条件信息存储于 CPU模块 33。用户张三选择智能语音提醒的提醒方 式, 那么智能语音的提醒方式作为提醒方式信息存储于 CPU模块 33 , 此外, 用户张三设置的精度信息为 1ms,那么 1ms作为精度信息存储于 CPU模块 33。 步骤 202, 声音信号釆集模块 31 实时釆集外部环境的声音信号, 声音信 号釆集模块 31对外部数据进行录音, 获得实时的录音片段, 将录音片段存储 于 CPU模块 33。 步骤 203 , 声音处理模块 32从 CPU模块 33中获取处理命令, CPU模块 33读取用户预置的提醒条件信息为音量强度 D, 也可将用户选择的提醒条件 指示的提醒范围转化为 0, 1 , 2, 3发送给声音处理模块 32, 声音处理模块 32根据预先的设置再把 0, 1 , 2, 3转化为对应的提醒条件。 获取与提醒条件 为音量强度 D对应的处理命令。 该处理命令处理的声音处理值为声音信号的 音量大小。 The determining unit 323 is configured to determine whether the sound processing value is within a range indicated by a reminder condition preset by the user. It should be noted that in order to avoid excessively meaningless reminders caused by occasional narrow noise in the space, the signal processing unit 322 can also optimize the processing logic of the processing command, and optimize the average algorithm of the sound processing value of the sound signal, for example The sound processing value of obtaining a sound signal is much larger than the sound processing value of the two times before and after, and can be regarded as a bad point discarding, thereby improving the accuracy of sound processing value detection. This improves the accuracy of sound processing and avoids unnecessary reminders. For ease of understanding, the above embodiments are described in detail in a specific application scenario: Scene 1, can also be seen in FIG. 2 and FIG. 3, assuming that Zhang San is on the way home late at night, while listening to music while walking, on the road. Quiet, Zhang San is preset to generate a reminder when the ambient volume level is greater than D. "Please note that there is a loud sound around, reminder. A volume intensity meter is prefabricated in the phone, and the volume intensity table corresponds to A, B, C and D four levels of volume intensity. Pre-made vocal recordings "Please note that there is a loud sound around." Step 201, the mobile terminal setting module 34 obtains user setting information, and the mobile terminal passes A, B, through the interface. The volume levels of the four levels C and D are displayed, and the user selects D, then D is stored as the reminder condition information in the CPU module 33. The user Zhang selects the reminder mode of the smart voice reminder, then the smart voice reminder is used as the reminder mode. The information is stored in the CPU module 33. Further, the accuracy information set by the user Zhang is 1 ms, and 1 ms is stored as accuracy information in the CPU module 33. Step 202 The sound signal collecting module 31 collects the sound signal of the external environment in real time, and the sound signal collecting module 31 records the external data, obtains the real-time recording segment, and stores the recorded segment in the CPU module 33. Step 203, the sound processing module 32 Obtaining a processing command from the CPU module 33, the CPU module 33, the user preset preset reminder condition information is the volume intensity D, and the reminder range indicated by the user-selected reminder condition may be converted into 0, 1, 2, 3 and sent to the sound processing module 32, and the sound processing module 32 is based on the advance The settings then convert 0, 1, 2, 3 into corresponding reminder conditions. A processing command corresponding to the reminder condition of the volume intensity D is obtained. The sound processing value processed by the processing command is the volume level of the sound signal.
步骤 204, 声音处理模块 32根据检测间隔 1ms设定定时器; 步骤 205, 每次定时器到时, 从釆集的数据中检测当前的声音信号; 步骤 206, 处理步骤 205检测的声音信号, 在时间 TO时, 检测的声音信 号处理后的声音处理值为: 音量强度 DO, 并记录下这个数据, 下一次定时器 到时, 再此检测得到数据 D1 , 依此类推, 可以得到一段时间内的声音信号音 量强度数据 D0,Dl,...,Dn。 这些音量强度数据就是处理过后得到的声音处理 值。  Step 204, the sound processing module 32 sets a timer according to the detection interval 1 ms; Step 205, each time the timer expires, the current sound signal is detected from the collected data; Step 206, the sound signal detected by the processing step 205 is At time TO, the detected sound processing value of the sound signal is: volume intensity DO, and the data is recorded, the next time the timer expires, the data D1 is obtained, and so on, can be obtained for a period of time. Sound signal volume intensity data D0, Dl, ..., Dn. These volume intensity data are the sound processing values obtained after processing.
步骤 207, 声音处理模块 32判断所述声音处理值是否在提醒条件指示的 提醒范围, 声音处理值大于音量强度值 D。 在检测到声音强度 Dn时, Dn>D, 进入步骤 208; 步骤 208, 声音处理模块 32产生提醒用户的提醒触发信号, 将提醒触发 信号发给 CPU模块 33 , CPU模块 33根据存储的提醒方式信息, 釆用预先设 置的智能语音提醒方式提醒用户, 移动终端的播放模块播放 "请注意, 周围有 较大声响", 通过耳机传到用户张三耳朵里。  Step 207, the sound processing module 32 determines whether the sound processing value is in the reminder range indicated by the reminding condition, and the sound processing value is greater than the volume intensity value D. When the sound intensity Dn is detected, Dn>D, the process proceeds to step 208; Step 208, the sound processing module 32 generates a reminder trigger signal for reminding the user, sends a reminder trigger signal to the CPU module 33, and the CPU module 33 according to the stored reminder mode information.提醒Use the preset intelligent voice reminder to remind the user that the playback module of the mobile terminal plays "Please note that there is a loud sound around", which is transmitted to the user's three ears through the earphone.
场景 2, 可同样参见图 2和图 3 , 4叚设, 用户李四戴着耳机使用移动终端 玩游戏, 移动终端中预制了提示文本 "请注意, 周围有异常"的显示界面。 用户 想在周围环境中有异常响声时候通过显示屏显示 "请注意,周围有异常"的界面 提醒。 在周围环境的声音信号的频率变化过大时, 可认为周围有异常响声。  Scene 2, can also refer to Figure 2 and Figure 3, 4, user Li Si wearing a mobile phone to use the mobile terminal to play the game, the mobile terminal pre-made the prompt text "Please note that there are abnormalities around the display interface. The user wants to display an alert on the display screen by "Please note that there is an abnormality around" when there is an abnormal sound in the surrounding environment. When the frequency of the sound signal in the surrounding environment changes too much, it is considered that there is an abnormal sound around.
步骤 201 , 移动终端的设置模块 34获取用户设置信息, 用户李四可以设 置一个频率差阀值 E,在外部环境声音信号与之前的平均频率的频率差值大于 阀值 E时, 说明周围声音有异常。 E作为提醒条件信息存储于 CPU模块 33。 用户选择智能语音提醒的提醒方式, 那么智能语音的提醒方式作为提醒方式 信息存储于 CPU模块 33 , 此外, 用户设置的精度信息为 1ms, 那么 1ms作为 精度信息存储于 CPU模块 33。 步骤 202, 声音信号釆集模块 31 实时釆集外部环境的声音信号, 信号釆 集模块 31 对外部数据进行录音, 获得实时的录音片段, 将录音片段存储于 CPU模块 33。 步骤 203, 声音处理模块 32在 CPU模块 33中获取处理命令, CPU模块 33读取用户预置的提醒条件信息为频率差阀值 E, 设置模块也可将用户选择 的提醒条件指示的提醒范围转化为 0, 1 , 2, 3发送给 CPU模块, CPU模块 根据预先的设置再把 0, 1 , 2, 3转化为对应的提醒条件。 获取与提醒条件为 频率差阀值 E对应的处理命令。 该处理命令处理的声音处理值为声音信号的 频率差值。 Step 201: The setting module 34 of the mobile terminal acquires user setting information, and the user Li can set a frequency difference threshold E. When the frequency difference between the external ambient sound signal and the previous average frequency is greater than the threshold E, the surrounding sound is abnormal. E is stored in the CPU module 33 as the reminder condition information. When the user selects the reminder mode of the smart voice reminder, the smart voice reminder mode is stored as the reminder mode information in the CPU module 33. Further, the user-set accuracy information is 1 ms, and then 1 ms is stored as the accuracy information in the CPU module 33. Step 202: The sound signal collecting module 31 collects the sound signal of the external environment in real time, and the signal collecting module 31 records the external data to obtain a real-time recording segment, and stores the recorded segment in the CPU module 33. Step 203, the sound processing module 32 obtains a processing command in the CPU module 33, and the CPU module 33 reads the preset condition information of the user as the frequency difference threshold E, and the setting module can also convert the reminding range indicated by the user-selected reminding condition. 0, 1, 2, 3 are sent to the CPU module, and the CPU module converts 0, 1, 2, 3 into corresponding reminding conditions according to the preset settings. A processing command corresponding to the reminder condition being the frequency difference threshold E is obtained. The sound processing value processed by the processing command is the frequency difference value of the sound signal.
步骤 204, 声音处理模块 32根据检测间隔 1ms设定定时器; 步骤 205, 每次定时器到时, 从釆集的数据中检测当前的声音信号; 步骤 206, 声音处理模块 32检测当前的声音信号音量强度 DO, 并记录下 这个数据, 下一次定时器到时, 再此检测得到数据 D1 , 依此类推, 可以得到 一段时间内的声音信号音量强度数据 D0,Dl,...,Dn。这些音量强度数据就是处 理过后得到的声音处理值。 同时, 根据之前的数据得到这段时间的平均声音 强度 S0,Sl,...,Sn, Sn = l/(n + 1)(D0 + D1 + ... + Dn)。 每次检测到一个声音强 度后, 都和平均强度比较得到当前强度和平均强度的差值 E0, ΕΙ,. , .,Εη, Εη = Dn - S(n-1)。 这些差值就是声音信号的声音处理值。  Step 204, the sound processing module 32 sets a timer according to the detection interval 1 ms; Step 205, each time the timer expires, the current sound signal is detected from the collected data; Step 206, the sound processing module 32 detects the current sound signal. The volume intensity DO, and record this data, the next time the timer expires, then the data D1 is detected, and so on, the sound signal volume intensity data D0, Dl, ..., Dn can be obtained for a period of time. These volume intensity data are the sound processing values obtained after processing. At the same time, the average sound intensity S0, S1, ..., Sn, Sn = l / (n + 1) (D0 + D1 + ... + Dn) is obtained from the previous data. Each time a sound intensity is detected, the difference between the current intensity and the average intensity is obtained by comparing with the average intensity E0, ΕΙ, . , ., Εη, Εη = Dn - S(n-1). These differences are the sound processing values of the sound signal.
步骤 207, 声音处理模块 32判断所述声音处理值是否在提醒条件指示的 提醒范围, 声音处理值大于频率差值 E。 在检测到声音强度 En时, En>E, 此 时, 并不马上进入步骤 208, 而是继续检测下一个时间点的声音强度值 En+1 , 在一定时间段 En到 En+j都大于 E时, 进入步骤 208。 步骤 208, 声音处理模块 32产生提醒用户的提醒触发信号, 将提醒触发 信号发给 CPU模块 33 , CPU模块 33根据存储的提醒方式信息, 釆用预先设 置的智能语音提醒方式提醒用户, 移动终端的显示屏显示"请注意, 周围有异 常,,的界面, 用户李四可以在戴着耳机玩游戏的时候察觉周围的环境声音变 化。  Step 207: The sound processing module 32 determines whether the sound processing value is in the reminder range indicated by the reminding condition, and the sound processing value is greater than the frequency difference E. When the sound intensity En is detected, En>E, at this time, does not immediately proceed to step 208, but continues to detect the sound intensity value En+1 at the next time point, En to En+j are greater than E in a certain period of time Then, proceed to step 208. Step 208, the sound processing module 32 generates a reminder trigger signal for reminding the user, and sends the reminder trigger signal to the CPU module 33. The CPU module 33 reminds the user by using the preset smart voice reminding method according to the stored reminding mode information, the mobile terminal The display shows "Please note that there is an abnormality around the interface. User Li Si can detect changes in ambient sounds while playing games with headphones.
场景 3 , 可同样参见图 2和图 3 , 4叚设, 用户小王听力不好, 戴着耳机使 用移动终端玩游戏, 用户小王希望随时能够知道周围环境的声音情况, 小王 设置为移动终端实时显示周围环境的音量大小。 步骤 201 , 移动终端的设置模块 34获取用户设置信息, 用户小王设置提 醒条件和提醒方式为外部环境任何声音的音量大小都实时显示在显示屏上。 此外, 用户小王设置的精度信息为 0.1ms, 那么 0.1ms作为精度信息存储于 CPU模块 33。 步骤 202, 声音信号釆集模块 31 实时釆集外部环境的声音信号, 信号釆 集模块 31 对外部数据进行录音, 获得实时的录音片段, 将录音片段存储于 CPU模块 33。 步骤 203, 声音处理模块 32在 CPU模块 33中获取处理命令, CPU模块 33读取用户预置的提醒条件信息为所有声音信号都提醒, 该提醒条件指示的 提醒范围是所有声音处理值。 步骤 204, 声音处理模块 32根据检测间隔 0.1ms设定定时器; 步骤 205 , 每次定时器到时, 从釆集的数据中检测当前的声音信号; 步骤 206, 声音处理模块 32处理检测的声音信号的音量强度 DO, 并记录 下这个数据, 下一次定时器到时, 再次得到数据 D1 , 依此类推, 可以得到一 段时间内的声音信号音量强度数据 D0,Dl,... ,Dn。 步骤 207 , 声音处理模块 32判断所述声音处理值是否在提醒条件指示的 提醒范围, 所有的声音处理值都在提醒范围内, 进入步骤 206。 步骤 208, 声音处理模块 32产生提醒用户的提醒触发信号, 将提醒触发 信号发给 CPU模块 33 , CPU模块 33釆用预先设置的实时显示声音音量大小, 将每个时间点检测到的声音处理值 Dn显示在显示屏上。 需要指出的是, 本发明还可以应用于其他多种场景, 例如: 用于医院治 疗体系, 当检测到病人呼救、 大喊大叫、 大声呻吟时, 提醒医师及时赶赴现 场救治处理。 也可用于幼教体系, 例如当检测到被监测儿童发生哭闹, 提醒 老师及时了解情况, 避免发生意外。 还可以利用在所有使用耳机或者听力障 碍人士使用的设备上, 因外界声音而产生提醒的功能的设备。 在此不再赘述。 经过本实施例中, 移动终端通过实时釆集外部环境的声音信号, 按照处 理命令处理所述声音信号, 获得指示所述声音信号的声音处理值, 在声音处 理值在提醒条件指示的提醒范围时, 釆用预先设置的提醒方式提醒用户, 实 现了在听觉因耳机播放的声音受到了极大的限制时, 自动提醒用户周围环境 声音信息的功能, 使得用户对身边声音及时做出正确处理, 避免错过重要或 紧急事情。 Scene 3, can also see Figure 2 and Figure 3, 4叚, user Xiaowang can't listen well, wear headphones to use the mobile terminal to play games, user Xiaowang wants to know the sound of the surrounding environment at any time, Xiao Wang Set to the mobile terminal to display the volume of the surrounding environment in real time. Step 201: The setting module 34 of the mobile terminal acquires user setting information, and the user Xiao Wang sets the reminding condition and the reminding mode to display the volume level of any sound in the external environment on the display screen in real time. Further, the accuracy information set by the user Xiao Wang is 0.1 ms, and then 0.1 ms is stored as the accuracy information in the CPU module 33. Step 202: The sound signal collecting module 31 collects the sound signal of the external environment in real time, and the signal collecting module 31 records the external data to obtain a real-time recording segment, and stores the recorded segment in the CPU module 33. Step 203, the sound processing module 32 acquires a processing command in the CPU module 33, and the CPU module 33 reads the reminding condition information preset by the user for all the sound signals to be reminded, and the reminding range indicated by the reminding condition is all sound processing values. Step 204, the sound processing module 32 sets a timer according to the detection interval of 0.1 ms; Step 205, detecting the current sound signal from the collected data every time the timer expires; Step 206, the sound processing module 32 processes the detected sound The volume level DO of the signal, and record this data, the next time the timer expires, the data D1 is obtained again, and so on, the sound signal volume intensity data D0, Dl, ..., Dn can be obtained for a period of time. Step 207: The sound processing module 32 determines whether the sound processing value is in the reminder range indicated by the reminding condition, and all the sound processing values are within the reminding range, and proceeds to step 206. Step 208, the sound processing module 32 generates a reminder trigger signal for reminding the user, and sends a reminder trigger signal to the CPU module 33. The CPU module 33 uses the preset real-time display sound volume level to set the sound processing value detected at each time point. Dn is displayed on the display. It should be noted that the present invention can also be applied to other various scenarios, for example: for a hospital treatment system, when a patient is called for help, yelling, and shouting loudly, the physician is reminded to rush to the scene for treatment. It can also be used in early childhood education systems. For example, when it is detected that a child is being crying, the teacher is reminded to know the situation in time to avoid accidents. It is also possible to use a device that generates a reminder function for external sounds on all devices that use headphones or hearing impaired persons. I will not repeat them here. In this embodiment, the mobile terminal processes the sound signal according to the processing command by collecting the sound signal of the external environment in real time, and obtains a sound processing value indicating the sound signal, at the sound. When the value of the reminder indicates the reminder range, the user is reminded by the preset reminder method to realize the function of automatically reminding the user of the ambient sound information when the sound of the earphone is greatly restricted by the earphone, so that the user Correctly handle the sounds around you and avoid missing important or urgent things.
本领域普通技术人员可以理解上述实施例的各种方法中的全部或部分步 骤是可以通过程序来指令相关的硬件来完成, 该程序可以存储于一计算机可 读存储介质中, 存储介质可以包括: ROM、 RAM, 磁盘或光盘等。 以上对本发明实施例所提供的环境声音提醒方法和移动终端进行了详细 实施例的说明只是用于帮助理解本发明的方法及其核心思想; 同时, 对于本 领域的一般技术人员, 依据本发明的思想, 在具体实施方式及应用范围上均 会有改变之处, 综上所述, 本说明书内容不应理解为对本发明的限制。  A person skilled in the art can understand that all or part of the steps of the foregoing embodiments can be completed by a program to instruct related hardware. The program can be stored in a computer readable storage medium. The storage medium can include: ROM, RAM, disk or CD, etc. The above description of the detailed embodiments of the environmental sound reminding method and the mobile terminal provided by the embodiments of the present invention is only for helping to understand the method of the present invention and its core idea; meanwhile, for those skilled in the art, according to the present invention, The present invention is not limited by the scope of the present invention.

Claims

权 利 要 求 Rights request
1、、 一种环境声音提醒方法, 其特征在于, 包括: 1. An environmental sound reminding method, characterized in that:
釆集外部环境的声音信号;  Collecting sound signals from the external environment;
根据预置的声音处理策略, 处理所述声音信号为声音处理值;  Processing the sound signal as a sound processing value according to a preset sound processing strategy;
判断所述声音处理值是否在预置的提醒条件指示的范围内;  Determining whether the sound processing value is within a range indicated by a preset reminding condition;
若是, 则根据用户预置的提醒方式, 执行提醒用户的操作。  If yes, the operation of reminding the user is performed according to the reminder mode preset by the user.
2、 如权利要求 1所述的环境声音提醒方法, 其特征在于, 所述根据预置 的声音处理策略, 处理所述声音信号为声音处理值, 具体为: 根据用户预置 的提醒条件所对应的处理命令, 处理所述声音信号为声音处理值。  The environment sound reminding method according to claim 1, wherein the processing the sound signal as a sound processing value according to a preset sound processing policy, specifically: corresponding to a reminder condition preset by a user The processing command processes the sound signal as a sound processing value.
3、 如权利要求 2所述的环境声音提醒方法, 其特征在于, 所述根据预置 的提醒条件所对应的处理命令, 处理所述声音信号为声音处理值具体包括: 根据提醒条件对应的处理命令所指示的检测属性, 检测外部环境的声音 信号为声音信号的属性值;  The method according to claim 2, wherein the processing the sound signal as the sound processing value according to the processing command corresponding to the preset reminding condition comprises: processing according to the reminding condition The detection attribute indicated by the command detects the sound signal of the external environment as the attribute value of the sound signal;
查找与提醒条件对应的处理命令所指示的计算方法, 计算所述声音信号 的属性值为声音处理值。  The calculation method indicated by the processing command corresponding to the reminding condition is searched, and the attribute value of the sound signal is calculated as a sound processing value.
4、 如权利要求 1所述的环境声音提醒方法, 其特征在于, 所述提醒条件 和处理命令的对应关系由用户预先设置或系统默认设置。  4. The ambient sound reminding method according to claim 1, wherein the correspondence between the reminding condition and the processing command is preset by a user or set by a system.
5、 如权利要求 3所述的环境声音提醒方法, 其特征在于, 所述提醒条件 具体包括: 声音信号的频率提醒门限或者声音信号的音量提醒门限。  The ambient sound reminding method according to claim 3, wherein the reminding condition specifically comprises: a frequency alert threshold of the sound signal or a volume alert threshold of the sound signal.
6、 如权利要求 3所述的环境声音提醒方法, 其特征在于, 所述检测外部 环境的声音信号为声音信号的属性值包括:  The ambient sound reminding method according to claim 3, wherein the detecting the sound signal of the external environment as the attribute value of the sound signal comprises:
根据用户预置的检测外部声音信号的时间间隔设定定时器;  Setting a timer according to a time interval of detecting an external sound signal preset by the user;
当每次定时器到时, 在釆集的声音信号中检测声音信号的属性值。  When each time the timer expires, the attribute value of the sound signal is detected in the collected sound signal.
7、 如权利要求 1所述的环境声音提醒方法, 其特征在于, 所述预置的提 醒方式具体包括: 通过语音或者振动提醒用户。  The ambient sound reminding method according to claim 1, wherein the preset reminding manner specifically comprises: alerting the user by voice or vibration.
8、 一种移动终端, 其特征在于, 包括:  8. A mobile terminal, comprising:
声音信号釆集模块, 用于釆集外部环境的声音信号;  a sound signal collection module for collecting sound signals of an external environment;
声音处理模块, 用于根据用户预置的声音处理策略, 处理所述声音信号 为声音处理值; 判断所述声音处理值是否在用户预置的提醒条件指示的范围 CPU模块, 用于在声音处理模块判断为是时, 根据用户预置的提醒方式, 执行提醒用户的操作。 a sound processing module, configured to process the sound signal as a sound processing value according to a sound processing policy preset by a user; and determine whether the sound processing value is within a range of a preset condition indication by a user The CPU module is configured to perform an operation for reminding the user according to the reminding manner preset by the user when the sound processing module determines that it is YES.
9、 如权利要求 5所述的移动终端, 其特征在于, 所述声音处理模块包括: 检测单元, 用于根据提醒条件对应的处理命令所指示的检测属性, 检测 外部环境的声音信号为声音信号的属性值;  The mobile terminal according to claim 5, wherein the sound processing module comprises: a detecting unit, configured to detect a sound signal of the external environment as a sound signal according to the detection attribute indicated by the processing command corresponding to the reminding condition Attribute value;
处理单元, 用于查找与提醒条件对应的处理命令所指示的计算方法, 计 算所述声音信号的属性值为声音处理值;  a processing unit, configured to search for a calculation method indicated by the processing command corresponding to the alert condition, and calculate an attribute value of the sound signal as a sound processing value;
判断单元, 用于判断所述声音处理值是否在用户预置的提醒条件指示的 范围内。  The determining unit is configured to determine whether the sound processing value is within a range indicated by the user preset reminding condition.
10、 如权利要求 5所述的移动终端, 其特征在于, 所述移动终端还包括: 预置模块, 用于获取用户预置的提醒条件、 处理命令和提醒方式。  The mobile terminal according to claim 5, wherein the mobile terminal further comprises: a preset module, configured to acquire a reminder condition, a processing command, and a reminding manner preset by the user.
11、 如权利要求 5所述的移动终端, 其特征在于, 所述 CPU模块还用于存 储预置的提醒条件和处理命令的对应关系。  The mobile terminal according to claim 5, wherein the CPU module is further configured to store a correspondence between a preset reminding condition and a processing command.
12、 如权利要求 6所述的环境声音提醒方法, 其特征在于, 所述检测单元 包括:  The environment sound reminding method according to claim 6, wherein the detecting unit comprises:
定时器子单元, 用于根据用户预置的检测外部声音信号的时间间隔设定 定时器;  a timer subunit, configured to set a timer according to a time interval for detecting an external sound signal preset by a user;
检测子单元, 用于在每次定时器到时, 在釆集的声音信号中检测声音信 号的属性值。  The detecting subunit is configured to detect the attribute value of the sound signal in the collected sound signal every time the timer expires.
PCT/CN2011/070951 2010-02-20 2011-02-12 Reminding method of environmental sound and mobile terminal thereof WO2011100890A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201010112218.8 2010-02-20
CN201010112218.8A CN101790000B (en) 2010-02-20 2010-02-20 Environmental sound reminding method and mobile terminal

Publications (1)

Publication Number Publication Date
WO2011100890A1 true WO2011100890A1 (en) 2011-08-25

Family

ID=42533048

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2011/070951 WO2011100890A1 (en) 2010-02-20 2011-02-12 Reminding method of environmental sound and mobile terminal thereof

Country Status (2)

Country Link
CN (1) CN101790000B (en)
WO (1) WO2011100890A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3547709A1 (en) * 2018-03-30 2019-10-02 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Method for processing signals, terminal device, and non-transitory computer-readable storage medium
EP3547710A1 (en) * 2018-03-30 2019-10-02 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Method for processing signals, terminal device, and non-transitory computer-readable storage medium

Families Citing this family (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101790000B (en) * 2010-02-20 2014-08-13 华为终端有限公司 Environmental sound reminding method and mobile terminal
CN102376303B (en) * 2010-08-13 2014-03-12 国基电子(上海)有限公司 Sound recording device and method for processing and recording sound by utilizing same
CN102624980A (en) * 2012-03-06 2012-08-01 惠州Tcl移动通信有限公司 Method for detecting abrupt environment and prompting based on earphone of mobile phone and mobile phone
CN103456301B (en) * 2012-05-28 2019-02-12 中兴通讯股份有限公司 A kind of scene recognition method and device and mobile terminal based on ambient sound
CN103067581A (en) * 2012-12-24 2013-04-24 深圳市金立通信设备有限公司 Implementation method and terminal of terminal alarm clock
CN103024198B (en) * 2012-12-27 2015-05-13 东莞宇龙通信科技有限公司 Mobile terminal and prompting method
CN103905956B (en) * 2012-12-28 2019-06-25 联想(北京)有限公司 Audio control method, electronic equipment and audio output apparatus
CN103152479A (en) * 2013-02-18 2013-06-12 广东欧珀移动通信有限公司 Method for stopping ringing of mobile phone in sound control way and mobile phone with function for stopping ringing in sound control way
CN103218045B (en) * 2013-04-25 2016-03-16 广东欧珀移动通信有限公司 A kind of method and device lighting mobile terminal screen
CN103414982B (en) * 2013-07-31 2018-02-13 小米科技有限责任公司 A kind of method and apparatus that sound is provided
CN104933825B (en) * 2014-03-18 2018-03-13 华为技术有限公司 The alarm method and device of a kind of mobile terminal
US9357320B2 (en) * 2014-06-24 2016-05-31 Harmon International Industries, Inc. Headphone listening apparatus
CN104078040A (en) * 2014-06-26 2014-10-01 美的集团股份有限公司 Voice recognition method and system
CN105759948A (en) * 2014-12-18 2016-07-13 联想(北京)有限公司 Information processing method and electronic device
ES2607255B1 (en) * 2015-09-29 2018-01-09 Fusio D'arts Technology, S.L. Notification method and device
CN105528440A (en) * 2015-12-17 2016-04-27 合肥联宝信息技术有限公司 Information prompting method and system and electronic equipment
CN105681950B (en) * 2016-01-15 2019-01-22 宇龙计算机通信科技(深圳)有限公司 Reminding method, suggestion device, earphone and terminal
WO2017120955A1 (en) * 2016-01-17 2017-07-20 谢文 Information notification method for giving alarm with headphones, and headphones for giving alarm
WO2017120958A1 (en) * 2016-01-17 2017-07-20 谢文 Method of giving alarm during headphone usage, and headphones for giving alarm
WO2017120956A1 (en) * 2016-01-17 2017-07-20 谢文 Method of giving alarm during headphone usage, and headphones for giving alarm
WO2017120944A1 (en) * 2016-01-17 2017-07-20 谢文 Technology-related data collection method for giving alarm with headphones, and headphones for giving alarm
WO2017120957A1 (en) * 2016-01-17 2017-07-20 谢文 Information notification method for giving alarm with headphones, and headphones for giving alarm
CN106126058A (en) * 2016-06-17 2016-11-16 北京小米移动软件有限公司 Based reminding method and device
CN106126177A (en) * 2016-06-21 2016-11-16 中国农业大学 The sound volume regulating system of a kind of target sound and method
CN106297184A (en) * 2016-08-26 2017-01-04 珠海格力电器股份有限公司 The monitoring method of mobile terminal surrounding, device and mobile terminal
CN106572242A (en) * 2016-10-21 2017-04-19 上海与德信息技术有限公司 Mobile terminal and auxiliary incoming call prompting method and module
WO2018227560A1 (en) * 2017-06-16 2018-12-20 深圳市柔宇科技有限公司 Method and system for controlling earphone
EP3563372B1 (en) * 2017-07-14 2023-08-30 Hewlett-Packard Development Company, L.P. Alerting users to events
CN108540661A (en) 2018-03-30 2018-09-14 广东欧珀移动通信有限公司 Signal processing method, device, terminal, earphone and readable storage medium storing program for executing
CN109451385A (en) * 2018-10-16 2019-03-08 深圳壹账通智能科技有限公司 A kind of based reminding method and device based on when using earphone
CN112150778A (en) * 2019-06-29 2020-12-29 华为技术有限公司 Environmental sound processing method and related device
CN110505128A (en) * 2019-07-29 2019-11-26 恒大智慧科技有限公司 Indoor call prompting method, router and computer readable storage medium
CN110493681A (en) * 2019-08-09 2019-11-22 无锡中感微电子股份有限公司 Headphone device and its control method with full natural user interface

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1547802A (en) * 2001-07-13 2004-11-17 �����ɷ� Adaptive audible alert volume control
CN1625277A (en) * 2003-12-01 2005-06-08 上海迪比特实业有限公司 Method of automatic regulating mobile phone prompt mode according to environment noise
CN1780349A (en) * 2004-11-25 2006-05-31 上海环达计算机科技有限公司 Automatic adjuster and adjusting method for cell-phone bell
CN1893498A (en) * 2005-07-01 2007-01-10 英华达(上海)电子有限公司 Method for intelligently regulating incoming telegrame bell sound-volume of hand-set its prompting manner
CN101175265A (en) * 2006-10-31 2008-05-07 英华达(上海)电子有限公司 Method for automatically switching scene mode of mobile phone
CN101304455A (en) * 2008-06-26 2008-11-12 中兴通讯股份有限公司 Apparatus and method for self-adaption adjusting mobile terminal acoustic environment
CN101790000A (en) * 2010-02-20 2010-07-28 华为终端有限公司 Environmental sound reminding method and mobile terminal
CN101840700A (en) * 2010-04-28 2010-09-22 宇龙计算机通信科技(深圳)有限公司 Voice recognition method based on mobile terminal and mobile terminal

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1547802A (en) * 2001-07-13 2004-11-17 �����ɷ� Adaptive audible alert volume control
CN1625277A (en) * 2003-12-01 2005-06-08 上海迪比特实业有限公司 Method of automatic regulating mobile phone prompt mode according to environment noise
CN1780349A (en) * 2004-11-25 2006-05-31 上海环达计算机科技有限公司 Automatic adjuster and adjusting method for cell-phone bell
CN1893498A (en) * 2005-07-01 2007-01-10 英华达(上海)电子有限公司 Method for intelligently regulating incoming telegrame bell sound-volume of hand-set its prompting manner
CN101175265A (en) * 2006-10-31 2008-05-07 英华达(上海)电子有限公司 Method for automatically switching scene mode of mobile phone
CN101304455A (en) * 2008-06-26 2008-11-12 中兴通讯股份有限公司 Apparatus and method for self-adaption adjusting mobile terminal acoustic environment
CN101790000A (en) * 2010-02-20 2010-07-28 华为终端有限公司 Environmental sound reminding method and mobile terminal
CN101840700A (en) * 2010-04-28 2010-09-22 宇龙计算机通信科技(深圳)有限公司 Voice recognition method based on mobile terminal and mobile terminal

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3547709A1 (en) * 2018-03-30 2019-10-02 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Method for processing signals, terminal device, and non-transitory computer-readable storage medium
EP3547710A1 (en) * 2018-03-30 2019-10-02 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Method for processing signals, terminal device, and non-transitory computer-readable storage medium
US10482871B2 (en) 2018-03-30 2019-11-19 Guangdong Oppo Mobile Telecommunications Corp., Ltd. Method for processing signals, terminal device, and non-transitory computer-readable storage medium

Also Published As

Publication number Publication date
CN101790000B (en) 2014-08-13
CN101790000A (en) 2010-07-28

Similar Documents

Publication Publication Date Title
WO2011100890A1 (en) Reminding method of environmental sound and mobile terminal thereof
US11605456B2 (en) Method and device for audio recording
CN106464751B (en) A method of alarm is presented in the user into environment
CN104158970A (en) Environmental sound prompting method and mobile terminal
US9509269B1 (en) Ambient sound responsive media player
CN104967932B (en) Earphone uses based reminding method and device, intelligent terminal
WO2015139481A1 (en) Alarm method and device for mobile terminal
CN107765891B (en) Microphone control method and microphone
WO2012144396A1 (en) Information processing device, information processing method, and program
CN105138319B (en) Event-prompting method and device
CN201354064Y (en) Automobile alarming device with multiple alarming modes
CN109618263B (en) Head/neck inclination angle detection method, device and system and wireless earphone controller
JP2012186622A (en) Information processing apparatus, information processing method, and program
CN109345767B (en) Safety reminding method, device, equipment and storage medium for wearable equipment user
JP6318129B2 (en) Playback device
WO2022227655A1 (en) Sound playing method and apparatus, and electronic device and readable storage medium
WO2014057921A1 (en) Electronic apparatus and sound reproduction method
JPWO2018180024A1 (en) Information processing apparatus, information processing method, and program
WO2017156895A1 (en) Multimedia playing method and device
KR20200045311A (en) Method and device that automatically adjust the volume depending on the situation
CN111028838A (en) Voice wake-up method, device and computer readable storage medium
KR101866367B1 (en) Body Temperature Measuring Method and System Using Earphone
JP2014042213A (en) Hearing aid
JP2006295669A (en) Sound reproducing apparatus
CN107894880A (en) A kind of message prompt method and terminal device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11744248

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11744248

Country of ref document: EP

Kind code of ref document: A1