CN109493884A - A kind of outside sound source safety prompt function method, system, equipment and medium - Google Patents

A kind of outside sound source safety prompt function method, system, equipment and medium Download PDF

Info

Publication number
CN109493884A
CN109493884A CN201811488030.6A CN201811488030A CN109493884A CN 109493884 A CN109493884 A CN 109493884A CN 201811488030 A CN201811488030 A CN 201811488030A CN 109493884 A CN109493884 A CN 109493884A
Authority
CN
China
Prior art keywords
feature vector
audio
audio signal
sound source
outside sound
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201811488030.6A
Other languages
Chinese (zh)
Inventor
陈佳雷
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jiangsu Manyun Software Technology Co Ltd
Original Assignee
Jiangsu Manyun Software Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jiangsu Manyun Software Technology Co Ltd filed Critical Jiangsu Manyun Software Technology Co Ltd
Priority to CN201811488030.6A priority Critical patent/CN109493884A/en
Publication of CN109493884A publication Critical patent/CN109493884A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/48Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
    • G10L25/51Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
    • G10L25/54Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination for retrieval
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B21/00Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
    • G08B21/18Status alarms
    • G08B21/24Reminder alarms, e.g. anti-loss alarms
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B3/00Audible signalling systems; Audible personal calling systems
    • G08B3/10Audible signalling systems; Audible personal calling systems using electric transmission; using electromagnetic transmission
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11CSTATIC STORES
    • G11C7/00Arrangements for writing information into, or reading information out from, a digital store
    • G11C7/16Storage of analogue signals in digital stores using an arrangement comprising analogue/digital [A/D] converters, digital memories and digital/analogue [D/A] converters 

Abstract

The invention discloses a kind of outside sound source safety prompt function method, system, equipment and media, comprising: the location information of user is obtained according to the position sensor being set in the mobile device, and matching obtains a scene type according to the positional information;Audio signal outside acquisition;Extraction step extracts audio feature vector according to the audio signal;It is matched to obtain a property data base for prestoring early warning feature vector according to the scene type;It is matched in the property data base according to the audio feature vector;The early warning feature vector to match if it exists with the audio feature vector, a pre-warning signal is then sent to user by earphone, the audio signal in environment outside monitoring acquisition, feature extraction is carried out to the audio signal collected and obtains audio feature vector, the feature vector by specific sound is stored in property data base, it is matched in property data base according to the audio feature vector, is then released and alerted to user by earphone.

Description

A kind of outside sound source safety prompt function method, system, equipment and medium
Technical field
The present invention relates to a kind of technologies of field of audio play, more specifically, being related to a kind of outside sound source safety Based reminding method, system, equipment and medium.
Background technique
Earphone is widely used for listening to voice resource, it includes the generator for converting electrical signals to voice signal, One converts voice signal to the sound collector of electric signal.Earphone may be connected in voice resource equipment, such as CD, DVD, computer, home theater, MP3, on the media player of multimedia handset etc..It is more more and more universal with mobile device, People's lives level also significantly improves.More and more people, which like having on earphone, to be listened to music, and is listened to the radio programme, either walk, It runs, take transit bus, by the subway under even any scene, you can see that someone has on an earplug.Mobile phone give really people with It is convenient many audiovisual have been carried out.But it can also cause many problems.
On the one hand having on earphone can't hear extraneous sound, be easy to cause safety problem, for example goes across the road and do not hear once The whistle of car, it is easy to accident occur;On the other hand some important informations are probably missed because earphone has been worn, it is false It is in a hurry at a distance if any acquaintance and calls out you, you do not hear, miss critical event;Boss is you, you but have on an earphone, what It does not hear, it is clear that less suitable.
Detailed description of the invention
Upon reading the detailed description of non-limiting embodiments with reference to the following drawings, other feature of the invention, Objects and advantages will become more apparent upon.
Fig. 1 is a kind of specific implementation scene of outside sound source safety prompt function method in preferred embodiment of the invention;
Fig. 2 is a kind of outside sound source safety prompt function method flow schematic diagram in preferred embodiment of the invention;
Fig. 3 is a kind of process schematic for sending pre-warning signal in preferred embodiment of the invention;
Fig. 4 is in preferred embodiment of the invention, and another kind sends the process schematic of pre-warning signal;
Fig. 5 is a kind of structural block diagram of outside sound source safety prompting system in preferred embodiment of the invention;
Fig. 6 is a kind of structural schematic diagram of outside sound source safety prompt function equipment in preferred embodiment of the invention;
Fig. 7 is a kind of structural schematic diagram of computer readable storage medium in preferred embodiment of the invention.
From the detailed description below in conjunction with attached drawing, the features and advantages of the present invention will become more apparent.Through attached drawing, Identical attached drawing identifies respective element.In the accompanying drawings, same reference numerals be indicated generally at it is identical, functionally similar and/or Similar element in structure.
Summary of the invention
In view of the problems of the existing technology, the purpose of the present invention is to provide a kind of outside sound source safety prompt function method, System, equipment and medium can monitor the audio signal in the environment outside acquisition in real time, believe the audio collected Number carrying out feature extraction obtains audio feature vector, in property data base storage by specific sound (tucket, language etc.) spy Vector is levied, is matched in property data base according to the audio feature vector, then warning (mute, drop is released to user by earphone Amount of bass, prompt tone etc.).
According to the present invention on one side, a kind of outside sound source safety prompt function method is provided, applied to the movement including earphone Equipment, comprising:
Positioning step obtains customer position information, and root according to the position sensor being set in the mobile device It matches to obtain a scene type according to the location information;
Acquisition step acquires external audio signal;
Extraction step extracts audio feature vector according to the audio signal;
Library step is selected, is matched to obtain a property data base for prestoring early warning feature vector according to the scene type;
Matching step matches in the property data base according to the audio feature vector;
Warning step, the early warning feature vector to match if it exists with the audio feature vector, then pass through earphone A pre-warning signal is sent to user.
It preferably, include the decibels of the audio signal in the audio feature vector, the warning step specifically wraps Include following steps:
The early warning feature vector to match if it exists with the audio feature vector, then from the audio feature vector In the extraction audio signal the decibels;
Judge whether the decibels are greater than a decibel threshold;
If the decibels are greater than the decibel threshold, the pre-warning signal is sent to user by earphone.
Preferably, the warning step specifically includes the following steps:
The early warning feature vector to match if it exists with the audio feature vector, then extract the early warning feature vector The history match time of last successful match;
The matching interval time between the matching twice of the early warning feature vector is obtained according to the history match time;
Judge the matching interval time whether less than a matching threshold;
If so, sending the pre-warning signal to user by earphone.
Preferably, the extraction step specifically includes the following steps:
Windowing process is carried out to the audio signal, obtains the audio signal sequence in several preset period of time;
Extract the characteristic parameter of each audio signal sequence;
The audio feature vector of the audio signal is obtained according to the characteristic parameter of each audio signal sequence.
Preferably, the audio signal is digital signal.
Preferably, windowing process is carried out to the audio signal by rectangular window or quarter window.
Preferably, the characteristic parameter includes: short-time energy, short-time average magnitude or short-time zero-crossing rate.
Preferably, the preset period of time is 10ms, 20ms or 30ms.
Preferably, the outside sound source safety prompt function method is further comprising the steps of, updates the spy with a predetermined period The early warning feature vector in database is levied, the predetermined period is for 24 hours.
Preferably, the pre-warning signal is the mute state of lasting one fixed duration.
According to an aspect of the present invention, a kind of outside sound source safety prompting system is provided, comprising:
Locating module obtains customer position information, and root according to the position sensor being set in the mobile device It matches to obtain a scene type according to the location information;
Acquisition module acquires external audio signal;
Extraction module extracts audio feature vector according to the audio signal;
Library module is selected, is matched to obtain a property data base for prestoring early warning feature vector according to the scene type;
Matching module matches in the property data base according to the audio feature vector;
Warning module, the early warning feature vector to match if it exists with the audio feature vector, then pass through earphone A pre-warning signal is sent to user.
According to an aspect of the present invention, a kind of outside sound source safety prompt function equipment is provided,
Processor;
Memory, wherein being stored with the executable instruction of the processor;
Wherein, the processor is configured to execute said external sound source safety prompt function via the executable instruction is executed The step of method.
According to an aspect of the present invention, a kind of computer readable storage medium is provided, for storing program, described program It is performed the step of realizing said external sound source safety prompt function method.
The beneficial effect of above-mentioned technical proposal is:
Outside sound source safety prompt function method, system, equipment and medium of the present invention can be monitored in real time outside acquisition Audio signal in environment carries out feature extraction to the audio signal collected and obtains audio feature vector, property data base Middle storage by specific sound (tucket, language etc.) feature vector, according to the audio feature vector in property data base Match, then warning (mute, reduction volume, prompt tone etc.) is released to user by earphone.
Other features and advantages of the present invention and various embodiments of the present invention structurally and operationally, will referring to Attached drawing is described in detail.It should be noted that the present invention is not limited to specific embodiments described hereins.It is given herein these The purpose that embodiment is merely to illustrate that.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete Site preparation description, it is clear that the described embodiment is only a part of the embodiment of the present invention, instead of all the embodiments.Based on this Embodiment in invention, those of ordinary skill in the art are obtained every other under the premise of not making the creative labor Embodiment shall fall within the protection scope of the present invention.
" first ", " second " used in the present invention and similar word are not offered as any sequence, quantity or again The property wanted, and be used only to distinguish different component parts.The similar word such as " comprising " or "comprising" means before there is the word The element or object in face are covered the element for appearing in the word presented hereinafter or object and its are equal, and are not excluded for other elements Or object." connection " either the similar word such as " connected " is not limited to physics or mechanical connection, but can be with It is either direct or indirect including electrical connection."upper", "lower", "left", "right" etc. are only used for indicating relative position Relationship, after the absolute position for being described object changes, then the relative positional relationship may also correspondingly change.
It should be noted that in the absence of conflict, the feature in embodiment and embodiment in the present invention can phase Mutually combination.
The present invention will be further explained below with reference to the attached drawings and specific examples, but not as the limitation of the invention.
Fig. 1 is a kind of specific implementation scene of outside sound source safety prompt function method, includes earphone 101, mobile device in Fig. 1 102 and server 103.Mobile device and earphone realize connection by wireless network or connection line, to transmit sound Signal, i.e. mobile device 102 pass through earphone 101 to user's playing audio signal.Meanwhile mobile device 102 also needs to detect outside The audio signal language of people around (tucket) in portion's (ambient enviroment of user), and early warning is issued to user currently in use Signal.
It can be by wireless network connection, for example, the wireless networks such as bluetooth, WiFi between earphone 101 and mobile device 102 Network can also realize connection by connection line.Mobile device 102 can be but not limited to any one can with user into The electronic product of row human-computer interaction, for example, smart phone, tablet computer or server etc..The electronic product can be any behaviour Make system, such as Android operation system, IOS operating system and Windows operating system.Mobile device 102 and server It is connected between 103 by network, server 103 can be but not limited to a kind of instruction that can be set or store according to realization, The automatic electronic equipment for carrying out numerical value calculating and information processing, hardware includes but is not limited to microprocessor, specific integrated circuit (ASIC), programmable logic device (PLD), field programmable gate array (FPGA), digital signal processor (DSP) and insertion Formula equipment etc..Server can be desktop computer, network host, single network server, multiple network server clusters or The cloud that multiple servers are constituted;Here, cloud by based on cloud computing (Cloud Computing) a large amount of computers or network service Device is constituted, wherein cloud computing is one kind of distributed computing, the virtual supercomputing being made of the computer of a group loose couplings Machine.The network that server 103 is connected with mobile device 102 can include but is not limited to internet, wide area network, Metropolitan Area Network (MAN), VPN net Network, wireless self-organization network (Ad Hoc network) etc..
Outside sound source safety prompt function method is described in detail below based on specific implementation scene shown in fig. 1.
Fig. 2 is a kind of outside sound source safety prompt function method flow schematic diagram, Fig. 2 shows dangerous outside sound source safety prompt function Method, including step S201, step S202, step S203, step S204, step S205 and step S206.
The location information of user is obtained according to the position sensor being set in the mobile device in step S201, and Matching obtains a scene type according to the positional information.Use can be positioned by the position sensor being set in mobile device The location information at family can match to obtain scene type locating for user according to the positional information, and scene type includes work Scene, mobile context, moving scene.
In step S202, mobile device 102 acquires external audio signal.When the mobile device 102 and earphone of user After 101 are connected by wireless network or connection line, earphone 101 normal work, i.e. music or view are read Dubbing for frequency is played out by earphone 101 to user.At this point, mobile device 102 is adopted by an audio collection device Collect the audio signal in external (ambient enviroment of user), which can be but not limited to the whistle sound (loudspeaker of automobile Sound), the specific language segment etc. that issues of people around.The audio collection device can be in mobile device 102 built-in microphone or Sound transducer is also possible to the sound transducer for the external individual packages being connected with mobile device 102.Mobile device 102 Audio letter has been obtained after being carried out analog-to-digital conversion after the analog signal of the external sound collected by audio collection device Number, which is digital signal.
In step S203, audio feature vector is extracted according to the audio signal.To the sound obtained in step S202 Frequency signal carries out feature extraction, obtains the audio feature vector of the audio signal.The specific of feature extraction is carried out to audio signal Process includes step S2011, step S2012, step S2013.In step S2011, the audio signal is carried out at adding window Reason, obtains the audio signal sequence in several preset period of time.The audio signal of the outside collected can be the language of people, Can be tucket etc., it is therefore desirable to audio signal is cut into multiple audio signal sequences, each audio signal sequence when An a length of preset period of time, the time span of the preset period of time can be 10ms, 20ms or 30ms.Audio signal is the language of people When, it is considered that the sound channel of people and excitation property do not change in the preset period of time, allow us with to steady mistake The method of journey is handled.Specifically, obtaining several audio signal sequences, i.e., by carrying out windowing process to audio signal Being multiplied by window function with original audio signal can be obtained several audio signal sequences.The window function used can be rectangle Window, rectangular window belong to the zero degree power window of time variable, and quarter window also can be used, and it is power that quarter window, which also known as takes outstanding (Fejer) window, The first power form of window.In step S2012, the characteristic parameter of each audio signal sequence is extracted, characteristic parameter can be with It is short-time energy, short-time average magnitude or short-time zero-crossing rate, linear predictor coefficient (LPC), coefficient of part correlation (PAECOA) spy Sign, line spectrum pair (LSP) feature etc..In step S2013, obtained according to the characteristic parameter of each audio signal sequence The audio feature vector of the audio signal.The characteristic parameter of each audio signal sequence obtained in step S2012 is combined, To obtain the audio feature vector of entire audio signal.
In step S204, matched to obtain a characteristic for prestoring early warning feature vector according to the scene type Library.The early warning feature vector of different scenes type storage is different, so needing to be matched according to different scene types corresponding Property data base.
In step S205, according to the audio feature vector in the property data base for prestoring early warning feature vector Match.Property data base is prestored in mobile device 102, property data base includes to need to send the extraneous of pre-warning signal by each The audio feature vector of audio signal, that is, early warning feature vector.Mobile device 102 is connected with server 103, passes through the server 103 can update the early warning feature vector in the property data base with a predetermined period, which can be for 24 hours. Early warning feature vector includes several verbal audios (language of people), for example, the name of user or position etc., extract the language in advance The feature vector of audio is as the early warning feature vector in property data base.The verbal audio can be user if the primary input Language.
In step S206, the early warning feature vector to match if it exists with the audio feature vector then passes through Earphone 101 sends a pre-warning signal to user.One in the audio feature vector and property data base of extraneous audio signal is pre- The alert feature vector i.e. extraneous someone that matches shouts user, and mobile device 102 sends early warning letter to user by earphone 101 Number.The pre-warning signal can be the mute state of lasting one fixed duration, and fixed duration can be 1s or 3s etc..The pre-warning signal It is also possible to prompt tone.
Fig. 3 is a kind of process schematic for sending pre-warning signal.Step S206 can be specifically includes the following steps: step S301, step S302 and step S303.In step S301, what is matched if it exists with the audio feature vector is described pre- Alert feature vector, early warning feature vector are that early warning feature vector i.e. audio signal of extraneous tucket is extraneous tucket, Then from the decibels of the extraction audio signal in the audio feature vector.In the step of before step S204, The decibels of audio signal can be included in audio feature vector.In step S302, judge whether the decibels are greater than One decibel threshold.The decibel threshold can be 60dB, 90dB or 120dB.In step S303, if the decibels are greater than described Decibel threshold then sends the pre-warning signal to user by earphone 101, i.e., when the decibel of tucket is greater than the decibel threshold Just by earphone 101 to for sending pre-warning signal.
Fig. 4 is another process schematic for sending pre-warning signal.Step S206 can be specifically includes the following steps: step S401, step S402, step S403 and step S404.In step s 404, if it exists with the audio feature vector phase The early warning feature vector matched, then extract the history match time of early warning feature vector last time successful match.Early warning is special Sign vector is that early warning feature vector i.e. audio signal of extraneous tucket is extraneous tucket.The audio signal of this acquisition It is extraneous tucket by matching, time history match time of the early warning feature vector last time of tucket is last The time of origin of tucket.Step S402 obtains the matching twice of the early warning feature vector according to the history match time Between matching interval time, that is, obtain the interval time of current tucket and last tucket.Step S403 breaks described Interval time is matched whether less than a matching threshold.Matching threshold can be 3s, 2s or 1s.Step S404, if so, passing through ear Machine 101 sends the pre-warning signal to user.
According to an aspect of the present invention, a kind of outside sound source safety prompting system is provided.
Fig. 5 is a kind of structural block diagram of outside sound source safety prompting system.Outside sound source safety prompting system shown in Fig. 5 500 include:
Locating module 501 obtains customer position information according to the position sensor being set in the mobile device, and Matching obtains a scene type according to the positional information;
Acquisition module 502 acquires external audio signal;
Extraction module 503 extracts audio feature vector according to the audio signal;
Library module 504 is selected, is matched to obtain a property data base for prestoring early warning feature vector according to the scene type;
Matching module 505 matches in the property data base according to the audio feature vector;
Warning module 506, the early warning feature vector to match if it exists with the audio feature vector, then pass through ear Machine sends a pre-warning signal to user.
According to an aspect of the present invention, a kind of outside sound source safety prompt function equipment is provided, comprising: processor;Memory, Wherein it is stored with the executable instruction of processor;Wherein, processor executes outside sound source safety to executable instruction when executed The step of based reminding method.
Fig. 6 is the structural schematic diagram of outside sound source safety prompt function equipment of the invention.It is described referring to Fig. 6 according to this The electronic equipment 600 of this embodiment of invention.The electronic equipment 600 that Fig. 6 is shown is only an example, should not be to this hair The function and use scope of bright embodiment bring any restrictions.
As shown in fig. 6, electronic equipment 600 is showed in the form of universal computing device.The component of electronic equipment 600 can wrap Include but be not limited to: at least one processing unit 610, at least one storage unit 620, connection different platform component (including storage Unit 620 and processing unit 610) bus 630, display unit 640 etc..
Wherein, storage unit is stored with program code, and program code can be executed with unit 610 processed, so that processing is single Member 610 executes various exemplary implementations according to the present invention described in this specification above-mentioned electronic prescription circulation processing method part The step of mode.For example, processing unit 610 can execute step as shown in Figure 2.
Storage unit 620 may include the readable medium of volatile memory cell form, such as Random Access Storage Unit (RAM) 6201 and/or cache memory unit 6202, it can further include read-only memory unit (ROM) 6203.
Storage unit 620 can also include program/utility with one group of (at least one) program module 6205 6204, such program module 6205 includes but is not limited to: operating system, one or more application program, other program moulds It may include the realization of network environment in block and program data, each of these examples or certain combination.
Bus 630 can be to indicate one of a few class bus structures or a variety of, including storage unit bus or storage Cell controller, peripheral bus, graphics acceleration port, processing unit use any bus structures in a variety of bus structures Local bus.
Electronic equipment 600 can also be with one or more external equipments 700 (such as keyboard, sensing equipment, bluetooth equipment Deng) communication, can also be enabled a user to one or more equipment interact with the electronic equipment 600 communicate, and/or with make Any equipment (such as the router, modulation /demodulation that the electronic equipment 600 can be communicated with one or more of the other calculating equipment Device etc.) communication.This communication can be carried out by input/output (I/O) interface 650.Also, electronic equipment 600 can be with By network adapter 660 and one or more network (such as local area network (LAN), wide area network (WAN) and/or public network, Such as internet) communication.Network adapter 660 can be communicated by bus 630 with other modules of electronic equipment 600.It should Understand, although not shown in the drawings, other hardware and/or software module can be used in conjunction with electronic equipment 600, including but unlimited In: microcode, device driver, redundant processing unit, external disk drive array, RAID system, tape drive and number According to backup storage platform etc..
According to an aspect of the present invention, a kind of computer readable storage medium is provided, for storing program, described program It is performed the step of realizing the above method.
Fig. 7 is the structural schematic diagram of computer readable storage medium of the invention.Refering to what is shown in Fig. 7, describing according to this The program product 800 for realizing the above method of the embodiment of invention can use the read-only storage of portable compact disc Device (CD-ROM) and including program code, and can be run on terminal device, such as PC.However, journey of the invention Sequence product is without being limited thereto, and in this document, readable storage medium storing program for executing can be any tangible medium for including or store program, the journey Sequence can be commanded execution system, device or device use or in connection.
Program product can be using any combination of one or more readable mediums.Readable medium can be readable signal Jie Matter or readable storage medium storing program for executing.Readable storage medium storing program for executing for example can be but be not limited to electricity, magnetic, optical, electromagnetic, infrared ray or partly lead System, device or the device of body, or any above combination.More specific example (the non exhaustive column of readable storage medium storing program for executing Table) it include: the electrical connection with one or more conducting wires, portable disc, hard disk, random access memory (RAM), read-only storage Device (ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, portable compact disc read only memory (CD- ROM), light storage device, magnetic memory device or above-mentioned any appropriate combination.
Computer readable storage medium may include in a base band or as carrier wave a part propagate data-signal, In carry readable program code.The data-signal of this propagation can take various forms, including but not limited to electromagnetic signal, Optical signal or above-mentioned any appropriate combination.Readable storage medium storing program for executing can also be any readable Jie other than readable storage medium storing program for executing Matter, the readable medium can send, propagate or transmit for by instruction execution system, device or device use or and its The program of combined use.The program code for including on readable storage medium storing program for executing can transmit with any suitable medium, including but not It is limited to wireless, wired, optical cable, RF etc. or above-mentioned any appropriate combination.
The program for executing operation of the present invention can be write with any combination of one or more programming languages Code, programming language include object oriented program language-Java, C++ etc., further include conventional process Formula programming language-such as " C " language or similar programming language.Program code can be calculated fully in user It executes in equipment, partly execute on a user device, executing, as an independent software package partially in user calculating equipment Upper part executes on a remote computing or executes in remote computing device or server completely.It is being related to remotely counting In the situation for calculating equipment, remote computing device can pass through the network of any kind, including local area network (LAN) or wide area network (WAN), it is connected to user calculating equipment, or, it may be connected to external computing device (such as utilize ISP To be connected by internet).
To sum up, outside sound source safety prompt function method, system, equipment and medium of the present invention, can monitor acquisition in real time Audio signal in external environment carries out feature extraction to the audio signal collected and obtains audio feature vector, feature The feature vector by specific sound (tucket, language etc.) is stored in database, according to the audio feature vector in characteristic It is matched in library, then warning (mute, reduction volume, prompt tone etc.) is released to user by earphone.
The above content is a further detailed description of the present invention in conjunction with specific preferred embodiments, and it cannot be said that Specific implementation of the invention is only limited to these instructions.For those of ordinary skill in the art to which the present invention belongs, exist Under the premise of not departing from present inventive concept, a number of simple deductions or replacements can also be made, all shall be regarded as belonging to of the invention Protection scope.

Claims (13)

1. a kind of outside sound source safety prompt function method, which is characterized in that applied to the mobile device for being equipped with earphone, comprising:
Positioning step, according to the location information for the position sensor acquisition user being set in the mobile device, and according to The location information matches to obtain a scene type;
Acquisition step acquires external audio signal;
Extraction step extracts audio feature vector according to the audio signal;
Library step is selected, is matched to obtain a property data base for prestoring early warning feature vector according to the scene type;
Matching step matches in the property data base according to the audio feature vector;
Warning step, the early warning feature vector to match if it exists with the audio feature vector, then by earphone to Family sends a pre-warning signal.
2. outside sound source safety prompt function method according to claim 1, which is characterized in that wrapped in the audio feature vector Include the decibels of the audio signal, the warning step specifically includes the following steps:
The early warning feature vector to match if it exists with the audio feature vector, then from the audio feature vector Extract the decibels of the audio signal;
Judge whether the decibels are greater than a decibel threshold;
If the decibels are greater than the decibel threshold, the pre-warning signal is sent to user by earphone.
3. outside sound source safety prompt function method according to claim 1, which is characterized in that the warning step specifically includes Following steps:
The early warning feature vector to match if it exists with the audio feature vector, then extract one in the early warning feature vector The history match time of secondary successful match;
The matching interval time between the matching twice of the early warning feature vector is obtained according to the history match time;
Judge the matching interval time whether less than a matching threshold;
If so, sending the pre-warning signal to user by earphone.
4. outside sound source safety prompt function method according to claim 1, which is characterized in that the extraction step specifically includes Following steps:
Windowing process is carried out to the audio signal, obtains the audio signal sequence of several preset period of time;
Extract the characteristic parameter of each audio signal sequence;
The audio feature vector of the audio signal is obtained according to the characteristic parameter of each audio signal sequence.
5. outside sound source safety prompt function method according to claim 1, which is characterized in that the audio signal is number letter Number.
6. outside sound source safety prompt function method according to claim 4, which is characterized in that pass through rectangular window or quarter window pair The audio signal carries out windowing process.
7. outside sound source safety prompt function method according to claim 4, which is characterized in that the characteristic parameter includes: short Shi Nengliang, short-time average magnitude or short-time zero-crossing rate.
8. outside sound source safety prompt function method according to claim 4, which is characterized in that the preset period of time be 10ms, 20ms or 30ms.
9. outside sound source safety prompt function method according to claim 1, which is characterized in that it is further comprising the steps of, with one Predetermined period updates the early warning feature vector in the property data base, and the predetermined period is for 24 hours.
10. outside sound source safety prompt function method according to claim 1, which is characterized in that the pre-warning signal is lasting The mute state of one fixed duration.
11. a kind of outside sound source safety prompting system characterized by comprising
Locating module obtains customer position information according to the position sensor being set in the mobile device, and according to institute Location information is stated to match to obtain a scene type;
Acquisition module acquires external audio signal;
Extraction module extracts audio feature vector according to the audio signal;
Library module is selected, is matched to obtain a property data base for prestoring early warning feature vector according to the scene type;
Matching module matches in the property data base according to the audio feature vector;
Warning module, the early warning feature vector to match if it exists with the audio feature vector, then by earphone to Family sends a pre-warning signal.
12. a kind of outside sound source safety prompt function equipment, which is characterized in that
Processor;
Memory, wherein being stored with the executable instruction of the processor;
Wherein, the processor is configured to come any one of perform claim requirement 1-10 institute via the execution executable instruction The step of stating outside sound source safety prompt function method.
13. a kind of computer readable storage medium, for storing program, which is characterized in that described program is performed realization power Benefit requires the step of outside sound source safety prompt function method described in any one of 1-10.
CN201811488030.6A 2018-12-06 2018-12-06 A kind of outside sound source safety prompt function method, system, equipment and medium Pending CN109493884A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811488030.6A CN109493884A (en) 2018-12-06 2018-12-06 A kind of outside sound source safety prompt function method, system, equipment and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811488030.6A CN109493884A (en) 2018-12-06 2018-12-06 A kind of outside sound source safety prompt function method, system, equipment and medium

Publications (1)

Publication Number Publication Date
CN109493884A true CN109493884A (en) 2019-03-19

Family

ID=65698320

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811488030.6A Pending CN109493884A (en) 2018-12-06 2018-12-06 A kind of outside sound source safety prompt function method, system, equipment and medium

Country Status (1)

Country Link
CN (1) CN109493884A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110931041A (en) * 2019-11-21 2020-03-27 北京地平线机器人技术研发有限公司 Sound source determining method and device
CN111491231A (en) * 2020-03-16 2020-08-04 深圳市多亲科技有限公司 Method and device for playing alarm prompt tone by earphone and mobile terminal
CN111886878A (en) * 2020-02-13 2020-11-03 深圳市汇顶科技股份有限公司 Hearing aid method, device, chip, earphone and storage medium for noise reduction
WO2021000817A1 (en) * 2019-06-29 2021-01-07 华为技术有限公司 Ambient sound processing method and related device
CN112580470A (en) * 2020-12-11 2021-03-30 北京软通智慧城市科技有限公司 City visual perception method and device, electronic equipment and storage medium

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105205955A (en) * 2015-09-25 2015-12-30 小米科技有限责任公司 Method and device for sending out warning signal
KR20160028651A (en) * 2014-09-04 2016-03-14 주식회사 코윈디에스티 Safety Earphone
CN106408891A (en) * 2016-08-30 2017-02-15 上海卓易科技股份有限公司 Intelligent prompting method and device
CN106445459A (en) * 2016-10-12 2017-02-22 深圳市金立通信设备有限公司 Method for controlling audio playing of earphones and terminal
CN106530613A (en) * 2016-11-11 2017-03-22 广东小天才科技有限公司 User prompt method and system and intelligent equipment
CN107423201A (en) * 2017-05-24 2017-12-01 维沃移动通信有限公司 A kind of reminding method and mobile terminal
CN107863110A (en) * 2017-12-14 2018-03-30 西安Tcl软件开发有限公司 Safety prompt function method, intelligent earphone and storage medium based on intelligent earphone
CN108234751A (en) * 2017-12-19 2018-06-29 努比亚技术有限公司 A kind of automatic detection dangerous approach, mobile terminal and computer readable storage medium
CN108540661A (en) * 2018-03-30 2018-09-14 广东欧珀移动通信有限公司 Signal processing method, device, terminal, earphone and readable storage medium storing program for executing

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20160028651A (en) * 2014-09-04 2016-03-14 주식회사 코윈디에스티 Safety Earphone
CN105205955A (en) * 2015-09-25 2015-12-30 小米科技有限责任公司 Method and device for sending out warning signal
CN106408891A (en) * 2016-08-30 2017-02-15 上海卓易科技股份有限公司 Intelligent prompting method and device
CN106445459A (en) * 2016-10-12 2017-02-22 深圳市金立通信设备有限公司 Method for controlling audio playing of earphones and terminal
CN106530613A (en) * 2016-11-11 2017-03-22 广东小天才科技有限公司 User prompt method and system and intelligent equipment
CN107423201A (en) * 2017-05-24 2017-12-01 维沃移动通信有限公司 A kind of reminding method and mobile terminal
CN107863110A (en) * 2017-12-14 2018-03-30 西安Tcl软件开发有限公司 Safety prompt function method, intelligent earphone and storage medium based on intelligent earphone
CN108234751A (en) * 2017-12-19 2018-06-29 努比亚技术有限公司 A kind of automatic detection dangerous approach, mobile terminal and computer readable storage medium
CN108540661A (en) * 2018-03-30 2018-09-14 广东欧珀移动通信有限公司 Signal processing method, device, terminal, earphone and readable storage medium storing program for executing

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021000817A1 (en) * 2019-06-29 2021-01-07 华为技术有限公司 Ambient sound processing method and related device
CN110931041A (en) * 2019-11-21 2020-03-27 北京地平线机器人技术研发有限公司 Sound source determining method and device
CN111886878A (en) * 2020-02-13 2020-11-03 深圳市汇顶科技股份有限公司 Hearing aid method, device, chip, earphone and storage medium for noise reduction
WO2021159369A1 (en) * 2020-02-13 2021-08-19 深圳市汇顶科技股份有限公司 Hearing aid method and apparatus for noise reduction, chip, earphone and storage medium
CN111491231A (en) * 2020-03-16 2020-08-04 深圳市多亲科技有限公司 Method and device for playing alarm prompt tone by earphone and mobile terminal
CN112580470A (en) * 2020-12-11 2021-03-30 北京软通智慧城市科技有限公司 City visual perception method and device, electronic equipment and storage medium

Similar Documents

Publication Publication Date Title
CN109493884A (en) A kind of outside sound source safety prompt function method, system, equipment and medium
US20220075594A1 (en) Methods, systems, and media for rewinding media content based on detected audio events
CN109166593B (en) Audio data processing method, device and storage medium
CN108962240A (en) A kind of sound control method and system based on earphone
CN107948801B (en) Earphone control method and earphone
US9374649B2 (en) Smart hearing aid
KR101888391B1 (en) Method for managing audio signal and electronic device implementing the same
US9703524B2 (en) Privacy protection in collective feedforward
CN108681440A (en) A kind of smart machine method for controlling volume and system
CN102770909A (en) Voice activity detection based on plural voice activity detectors
CN110347862B (en) Recording processing method, device, equipment, system and audio equipment
CN109151697B (en) Microphone hole blockage detection method and related product
CN110097895B (en) Pure music detection method, pure music detection device and storage medium
US11218796B2 (en) Annoyance noise suppression
CN102333157A (en) Mobile terminal and conversation voice recording method and device used for mobile terminal
CN107613113A (en) A kind of headset mode control method, device and computer-readable recording medium
CN109979433A (en) Voice is with reading processing method, device, equipment and storage medium
JP2020009440A (en) Method and device for generating information
CN115424629A (en) Vehicle internal and external communication method and system based on vehicle-mounted entertainment system and vehicle
CN112259076B (en) Voice interaction method, voice interaction device, electronic equipment and computer readable storage medium
CN108668011A (en) Output method, output equipment and electronic equipment
EP2887698B1 (en) Hearing aid for playing audible advertisement
CN110400562B (en) Interactive processing method, device, equipment and audio equipment
US10027302B2 (en) Audio interrupter alertness device for headphones
CN106254641A (en) The earphone monitoring method and system of smart machine

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20190319