CN108983965A - For alerting the method and apparatus and augmented reality glasses of abnormal sound source - Google Patents

For alerting the method and apparatus and augmented reality glasses of abnormal sound source Download PDF

Info

Publication number
CN108983965A
CN108983965A CN201810596746.1A CN201810596746A CN108983965A CN 108983965 A CN108983965 A CN 108983965A CN 201810596746 A CN201810596746 A CN 201810596746A CN 108983965 A CN108983965 A CN 108983965A
Authority
CN
China
Prior art keywords
sound source
sound
alerted
volume
source
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810596746.1A
Other languages
Chinese (zh)
Inventor
苏进
张志扬
李琦
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Jia Er Medical Technology Co Ltd
Original Assignee
Beijing Jia Er Medical Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Jia Er Medical Technology Co Ltd filed Critical Beijing Jia Er Medical Technology Co Ltd
Priority to CN201810596746.1A priority Critical patent/CN108983965A/en
Publication of CN108983965A publication Critical patent/CN108983965A/en
Priority to PCT/CN2019/090607 priority patent/WO2019238017A1/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • G06F3/167Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality
    • GPHYSICS
    • G08SIGNALLING
    • G08BSIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
    • G08B25/00Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems
    • G08B25/01Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium
    • G08B25/012Alarm systems in which the location of the alarm condition is signalled to a central station, e.g. fire or police telegraphic systems characterised by the transmission medium using recorded signals, e.g. speech
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0141Head-up displays characterised by optical features characterised by the informative content of the display
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01Indexing scheme relating to G06F3/01
    • G06F2203/012Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment

Abstract

The embodiment of the present invention provides a kind of method and apparatus and augmented reality glasses for alerting abnormal sound source, belongs to augmented reality field.This method comprises: receiving the sound of at least one sound source;Based on the sound of each sound source at least one received sound source, the orientation of each sound source at least one sound source is determined;Sound and default alarm conditions based on each sound source at least one sound source judge at least one sound source with the presence or absence of the sound source alerted;And in the case where there is the sound source alerted in determining at least one sound source, information corresponding with the sound source alerted is shown.The device includes sound receiving module, determining module, processing module and display module.The augmented reality glasses include above-mentioned device.It is thereby achieved that hearing-impaired people is made to note abnormalities in time sound source, security risk is avoided.

Description

For alerting the method and apparatus and augmented reality glasses of abnormal sound source
Technical field
The present invention relates to augmented reality fields, more particularly to a kind of method and apparatus for alerting abnormal sound source And augmented reality glasses.
Background technique
Augmented reality (Augmented Reality, AR) technology is a kind of position and angle by calculating image in real time Degree, is superimposed corresponding image, video, 3D model, and then to the technology that virtual world is merged with real world on image. AR client can carry out real-time image to environment under the line of user in conjunction with its local picture recognition material is stored directly in Identification, and target enhances on the position in real scene according to the bandwagon effect of pre-configuration under the specific line identified Show corresponding display data.With the development of technology, augmented reality application it is very extensive, but for hearing-impaired people and Speech, augmented reality is but without helping to arrive them well.
Hearing-impaired people generally can not have found the automobile such as blown a whistle, the pedestrian to lift up one's voice, pendant since hearing is limited in time Glass fallen etc. has the sound source of abnormal alert messages, and such case is for hearing-impaired people, and there are certain safety is hidden Suffer from.
Summary of the invention
The method and apparatus and augmented reality glasses that the object of the present invention is to provide a kind of for alerting abnormal sound source, can It realizes so that hearing-impaired people notes abnormalities in time sound source, avoid security risk.
To achieve the goals above, one aspect of the present invention provides the method for alerting abnormal sound source, this method packet It includes: receiving the sound of at least one sound source;Based on the sound of each sound source at least one received described sound source, institute is determined State the orientation of each sound source at least one sound source;Sound based on each sound source at least one described sound source and default Alarm conditions judge at least one described sound source with the presence or absence of the sound source alerted, wherein the default alarm conditions Including it is following one or more: the volume that the volume of the sound of sound source is greater than the sound of default alarm volume, sound source is greater than background The volume and waveform for being greater than the sound of preset difference value volume and sound source with the difference of the background volume meets predetermined waveform; And it in the case where in determining at least one described sound source in the presence of the sound source alerted, shows and is alerted The corresponding information of sound source, wherein the information corresponding with the sound source alerted includes the sound source alerted Orientation.
Optionally, the information corresponding with sound source that is being alerted further includes the sound of the sound source alerted The volume and/or alert symbol of sound.
Optionally, in the case where there is the sound source alerted in determining at least one described sound source, this method Further include: the feature of the sound of the sound source alerted is compared with preset sound Wave data feature, determining should The type of the sound of the sound source alerted, the information corresponding with sound source that is being alerted further includes determining Type.
Correspondingly, another aspect of the present invention provides a kind of for alerting the device of abnormal sound source, which includes: sound Receiving module, for receiving the sound of at least one sound source;Determining module, for based at least one received described sound source Each sound source sound, determine the orientation of each sound source at least one described sound source;Processing module, for based on described The sound of each sound source at least one sound source and default alarm conditions, which judge to whether there is at least one described sound source, to be needed The sound source alerted, wherein the default alarm conditions include it is following one or more: the volume of the sound of sound source is greater than The volume of the sound of default alarm volume, sound source is greater than background sound amount and is greater than preset difference value sound with the difference of the background volume The waveform of the sound of amount and sound source meets predetermined waveform;And display module, in determining at least one described sound source In the case where the sound source alerted, show corresponding with the sound source alerted information, wherein described in and The corresponding information of the sound source alerted includes the orientation of the sound source alerted.
Optionally, the information corresponding with sound source that is being alerted further includes the sound of the sound source alerted The volume and/or alert symbol of sound.
Optionally, in the case where there is the sound source alerted in determining at least one described sound source, the place The feature of the sound for the sound source that reason module is also used to alert is compared with preset sound Wave data feature, really The type of the sound of the fixed sound source alerted, the information corresponding with sound source that is being alerted further includes institute Determining type.
Optionally, the display module is near-eye display.
Optionally, the near-eye display is perspective formula near-eye display.
In addition, another aspect of the present invention also provides a kind of augmented reality glasses, which includes above-mentioned Device.
In addition, another aspect of the present invention also provides a kind of machine readable storage medium, on the machine readable storage medium It is stored with instruction, which is used for so that machine executes above-mentioned method.
Through the above technical solutions, determining the sound source for existing at least one sound source received and being alerted In the case where, the orientation of the sound source alerted is shown, in this way, informing that hearing-impaired people exists in a manner of simply and intuitively Abnormal sound source sound source and understands its position so that hearing-impaired people notes abnormalities in time, allows hearing-impaired people to abnormal sound source There is counter-measure, avoids security risk.
Other features and advantages of the present invention will the following detailed description will be given in the detailed implementation section.
Detailed description of the invention
Attached drawing is to further understand for providing to the embodiment of the present invention, and constitute part of specification, under The specific embodiment in face is used to explain the present invention embodiment together, but does not constitute the limitation to the embodiment of the present invention.Attached In figure:
Fig. 1 is the flow chart for the method for alerting abnormal sound source that one embodiment of the invention provides;
Fig. 2 be another embodiment of the present invention provides the exemplary diagram for making direction indicated by an arrow;
Fig. 3 be another embodiment of the present invention provides orientation exemplary diagram;
Fig. 4 be another embodiment of the present invention provides display information corresponding with the sound source alerted example Figure;
Fig. 5 be another embodiment of the present invention provides for alert abnormal sound source method flow chart;And
Fig. 6 be another embodiment of the present invention provides for alert abnormal sound source device structural block diagram.
Description of symbols
1 sound receiving module, 2 determining module
3 processing module, 4 display module
Specific embodiment
It is described in detail below in conjunction with specific embodiment of the attached drawing to the embodiment of the present invention.It should be understood that this Locate described specific embodiment and be merely to illustrate and explain the present invention embodiment, is not intended to restrict the invention embodiment.
The one aspect of the embodiment of the present invention provides a kind of method for alerting abnormal sound source.Fig. 1 present invention one is implemented The flow chart for the method for alerting abnormal sound source that example provides.As shown in Figure 1, this approach includes the following steps.
In step slo, the sound of at least one sound source is received.
In step s 11, the sound based on each sound source at least one received sound source, determines at least one sound source In each sound source orientation.Wherein it is determined that the orientation of sound source can be based on the time for receiving the sound issued from sound source. For example, the sound receiving module of the sound for receiving at least one sound source includes multiple sound acquisition modules, multiple sound Acquisition module is arranged on different positions, and multiple sound acquisition modules receive the time of the sound issued from same sound source not Together.For each sound source at least one sound source, the difference of the time of multiple sound acquisition modules is reached according to sound, that is, The time difference that multiple sound acquisition modules are reached according to sound determines the orientation of sound source.Optionally, in embodiments of the present invention, Sound acquisition module can be microphone, which can be microphone array.For example, microphone array can wrap Include 2,4,6,7 or 8 microphones.Optionally, in embodiments of the present invention, the datum mark in orientation can carry out according to the actual situation Setting, for example, it may be the position where sound receiving module.Specifically, it can be any in multiple sound acquisition modules Sound acquisition module, or can also be the middle position of multiple sound acquisition modules.In addition, when sound receiving module is listened barrier When personage wears or distance apart from hearing-impaired people is not far, the point on the basis of sound receiving module is practical i.e. with hearing-impaired people On the basis of point, in this way, hearing-impaired people can understand position of the sound source relative to oneself based on the orientation determined.Optionally, exist In the embodiment of the present invention, orientation may include direction and/or distance.
In step s 12, sound and default alarm conditions based on each sound source at least one sound source judge at least With the presence or absence of the sound source that is alerted in one sound source, wherein preset alarm conditions include it is following one or more: sound source The volume of the volume sound that is greater than default alarm volume, sound source of sound be greater than background sound amount and big with the difference of background volume Meet predetermined waveform in the waveform of the sound of preset difference value volume and sound source.If it is determined that there is the sound source alerted In the case where, S13 is thened follow the steps, it is no to then follow the steps S10, the sound issued from sound source is continued to, continues to judge. The sound of each sound source at least one sound source is compared with default alarm conditions in this step, with judge one by one to Whether each sound source in a few sound source is the sound source alerted, to judge to whether there is at least one sound source The sound source alerted.Optionally, in embodiments of the present invention, presetting alarm volume can be 90dB.Optionally, at this In inventive embodiments, preset difference value volume can be 30dB.In addition, in embodiments of the present invention, background volume can be in advance Setting;It is also possible to after reaching an environment, after measuring background volume using other equipment, inputs into;It can be with It is that there are sound detection modules, automatic to detect background volume.
In step s 13, in determining at least one sound source exist alerted sound source in the case where, display and The corresponding information of the sound source alerted, wherein information corresponding with the sound source alerted includes needing to carry out The orientation of the sound source of alarm.Optionally, in embodiments of the present invention, orientation may include direction and/or distance, the benchmark in orientation Point can be set according to the actual situation, as described in above-mentioned.In addition, can adopt in embodiments of the present invention indicated by an arrow Direction, arrow are located in the region of circumference delimitation, and the starting point of arrow is the origin of the circumference, wherein the origin, which is equivalent to, to be listened Hinder personage position, arrow deviates one angle of the longitudinal axis across the circumference, as shown in Fig. 2, dotted line is across circumference in figure The longitudinal axis.In addition, on the basis of the horizontal axis of circumference, shown in lateral dotted line as shown in Figure 2, when arrow is located at the part of horizontal axis or more When, indicate sound source in the front of hearing-impaired people;When arrow is located at horizontal axis part below, indicate sound source after hearing-impaired people Side.For example, the sound source that the arrow indicates is in the front of hearing-impaired people by taking direction example as indicated with 2 as an example.In addition, should be with arrow Head indicates that the mode in the direction of sound source can also be read as indicating direction using clock.Wherein circumference represents dial plate, is located at circle The longitudinal axis of the top half of the horizontal axis in week indicates 12 o'clock direction, determines that sound source probably exists according to the angle that arrow deviateed for 12 o'clock What time direction.By taking direction example shown in Fig. 2 as an example, the sound source that arrow indicates is probably in 10 o'clock direction.In addition, in orientation In the case where including direction and distance, orientation can be indicated using example as shown in Figure 3.It should be noted that display distance Position can be set according to the actual situation, in this regard, being not limited.In addition, in the case where orientation only includes distance, It can only display distance.In addition, in embodiments of the present invention, verbal description orientation can also be used, for example, with shown in Fig. 3 For orientation, it can show that " direction is ten o'clock direction to text, and distance is 50cm ".It include one in the sound source alerted In the case where a sound source, the orientation of the sound source alerted is shown with way of example shown in Fig. 3;It is being accused In the case that alert sound source includes multi-acoustical, it is aobvious that each sound source alerted is all made of way of example shown in Fig. 3 Show orientation.
In the case where determining the sound source for existing at least one sound source received and being alerted, display needs The orientation of the sound source alerted, in this way, informing that hearing-impaired people has abnormal sound source in a manner of simply and intuitively, so that listening barrier Personage notes abnormalities in time sound source and understands its position, allows hearing-impaired people to have counter-measure to abnormal sound source, avoids Security risk.In addition, it is necessary to which explanation, the method provided in an embodiment of the present invention for alerting abnormal sound source can not only fit For hearing-impaired people, it is also applied for ordinary people.
Optionally, in embodiments of the present invention, information corresponding with the sound source alerted further includes needing to carry out The volume and/or alert symbol of the sound of the sound source of alarm.Optionally, alert symbol can be "!", " * " etc..To need to carry out The sound source of alarm include the volume of a sound source and the sound of the sound source be 100dB, it is corresponding with the sound source alerted For information includes orientation, volume and alert symbol, show that information corresponding with the sound source alerted can be such as Fig. 4 institute Show, wherein used in Fig. 4 "!" indicate alert symbol.In addition, the sound source alerted include multi-acoustical and with When the corresponding information of the sound source alerted includes orientation, volume and alert symbol, each alerted is shown It can be shown using example shown in Fig. 4 when the corresponding information of sound source.The relevant information of plurality of sound source can more than Lower or left and right successively arranges, or the information of the multi-acoustical alerted is arranged using other modes.
Optionally, in embodiments of the present invention, there is the sound source alerted in determining at least one sound source In the case of, this method further include: by the feature of the sound of the sound source alerted and preset sound Wave data feature into Row compares, and determines the type of the sound of the sound source alerted, information corresponding with the sound source alerted is also Including identified type.
Fig. 5 be another embodiment of the present invention provides for alert abnormal sound source method flow chart.As shown in figure 5, Method shown in fig. 5 and method shown in FIG. 1 the difference is that, method shown in fig. 5 further includes the following contents.
In the case where there is the sound source alerted in determining at least one sound source, step S53 is executed.In step In S53, the feature of the sound of the sound source alerted is compared with preset sound Wave data feature, determines the need The type of the sound of the sound source alerted.It is shown with the sound source pair alerted in addition, in step S54 The information answered may also include determined type in addition to the orientation for including the sound source alerted.In addition, with need into The corresponding information of sound source of row alarm may also include the volume and/or alert symbol of the sound of the sound source alerted.Such as This, so that hearing-impaired people understands the possible sound type of the sound source alerted, to accomplish to know what's what.Specifically, It in embodiments of the present invention, can be by AI machine learning by the feature and preset sound of the sound of the sound source alerted Wave data feature is compared.
Correspondingly, the another aspect of the embodiment of the present invention also provides a kind of for alerting the device of abnormal sound source.
Fig. 6 be another embodiment of the present invention provides for alert abnormal sound source device structural block diagram.Such as Fig. 6 institute Show, which includes sound receiving module 1, determining module 2, processing module 3 and display module 4.Wherein, sound receiving module 1 For receiving the sound of at least one sound source.Determining module 2 is used for based on each sound source at least one received sound source Sound determines the orientation of each sound source at least one sound source.Processing module 3 is used for based on each at least one sound source The volume of the sound of sound source and default alarm conditions judge at least one sound source with the presence or absence of the sound source alerted, In preset alarm conditions include it is following one or more: the volume of the sound of sound source is greater than the sound of default alarm volume, sound source Volume be greater than background sound amount and the waveform for being greater than the sound of preset difference value volume and sound source with the difference of background volume meets Predetermined waveform.In the case where for there is the sound source alerted in determining at least one sound source in display module 4, display Information corresponding with the sound source alerted, wherein information corresponding with the sound source alerted includes needing to carry out The orientation of the sound source of alarm.
In the case where determining the sound source for existing at least one sound source received and being alerted, display needs The orientation of the sound source alerted, in this way, informing that hearing-impaired people has abnormal sound source in a manner of simply and intuitively, so that listening barrier Personage notes abnormalities in time sound source and understands its position, allows hearing-impaired people to have counter-measure to abnormal sound source, avoids Security risk.
Optionally, in embodiments of the present invention, display module can be near-eye display, in this way, realize will need into The orientation of the sound source of row alarm presents before eyes.Preferably, in embodiments of the present invention, it is close to can be perspective formula for near-eye display Eye display sees hearing-impaired people in real time in this way, realizing while not influencing hearing-impaired people and observing other things To the orientation of the sound source alerted.
Concrete operating principle and benefit and the present invention provided in an embodiment of the present invention for alerting the device of abnormal sound source The concrete operating principle and benefit for the method for alerting abnormal sound source that embodiment provides are similar, will not be described in great detail here.
In addition, the embodiment of the present invention also provides a kind of augmented reality glasses, which includes above-described embodiment Described in device.Wherein, which includes the electronic circuit for supporting the operation of device described in above-described embodiment System, the electronic circuit system include the modules such as power supply, processor, network connection and sound receiving module.In addition, the electronics Circuit system can also include externally visible man-machine interface module and button and/or touch control board.Wherein, processor Including processing module described in above-described embodiment and sound recognition module.Man-machine interface module includes display module.Processor is also It may be implemented locally carrying out offline voice recognition, also may be implemented to carry out online voice recognition beyond the clouds via network connection.
Optionally, in embodiments of the present invention, touch control board described in above-described embodiment, button and/or sound connect The glasses of augmented reality glasses can be arranged on perhaps on glasses accessories for example, being arranged in temple, frame or mirror by receiving module On piece.Optionally, in embodiments of the present invention, sound receiving module can be arranged on frame, in same temple or not With in temple.For example, in the case where sound receiving module is microphone array and Mike's subarray includes two microphones, it should Two microphones are respectively set on two frames, are perhaps arranged on the different location of same temple or are set individually In two temples.In addition, realizing the sound source that will be alerted in the case where display module is near-eye display Orientation presents before eyes.Wherein, near-eye display can be see-through, be also possible to can not to have an X-rayed.Further, close In the case that eye display is perspective formula near-eye display, realize while not influencing hearing-impaired people's observation display scene, Hearing-impaired people is allowed to see the orientation of the sound source alerted in real time.
In addition, the another aspect of the embodiment of the present invention also provides a kind of machine readable storage medium, the machine readable storage Instruction is stored on medium, which is used for so that machine executes method described in above-described embodiment.
In conclusion there is the case where sound source alerted at least one sound source received determining Under, show the orientation of the sound source alerted, there are abnormal sounds in this way, informing hearing-impaired people in a manner of simply and intuitively Source sound source and understands its position so that hearing-impaired people notes abnormalities in time, hearing-impaired people is allowed to have reply to abnormal sound source Measure avoids security risk.It is determined in addition, shown information corresponding with sound source that is being alerted may also include The type of the sound source alerted out.In this way, the possible sound for the sound source for alerting hearing-impaired people's understanding Sound type, to accomplish to know what's what.
The optional embodiment of the embodiment of the present invention is described in detail in conjunction with attached drawing above, still, the embodiment of the present invention is simultaneously The detail being not limited in above embodiment can be to of the invention real in the range of the technology design of the embodiment of the present invention The technical solution for applying example carries out a variety of simple variants, these simple variants belong to the protection scope of the embodiment of the present invention.
It is further to note that specific technical features described in the above specific embodiments, in not lance In the case where shield, it can be combined in any appropriate way.In order to avoid unnecessary repetition, the embodiment of the present invention pair No further explanation will be given for various combinations of possible ways.
It will be appreciated by those skilled in the art that implementing the method for the above embodiments is that can pass through Program is completed to instruct relevant hardware, which is stored in a storage medium, including some instructions are used so that single Piece machine, chip or processor (processor) execute all or part of the steps of each embodiment the method for the application.And it is preceding The storage medium stated includes: USB flash disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory The various media that can store program code such as (RAM, Random Access Memory), magnetic or disk.
In addition, any combination can also be carried out between a variety of different embodiments of the embodiment of the present invention, as long as it is not The thought of the embodiment of the present invention is violated, equally should be considered as disclosure of that of the embodiment of the present invention.

Claims (10)

1. a kind of method for alerting abnormal sound source, which is characterized in that this method comprises:
Receive the sound of at least one sound source;
Based on the sound of each sound source at least one received described sound source, determine each at least one described sound source The orientation of sound source;
Sound and default alarm conditions based on each sound source at least one described sound source judge at least one described sound source In with the presence or absence of the sound source that is alerted, wherein the default alarm conditions include it is following one or more: the sound of sound source The volume that the volume of sound is greater than the sound of default alarm volume, sound source is greater than background sound amount and big with the difference of the background volume Meet predetermined waveform in the waveform of the sound of preset difference value volume and sound source;And
In the case where there is the sound source alerted in determining at least one described sound source, shows and alerted The corresponding information of sound source, wherein the information corresponding with the sound source alerted includes the sound source alerted Orientation.
2. the method according to claim 1, wherein the information corresponding with sound source that is being alerted is also The volume and/or alert symbol of sound including the sound source alerted.
3. method according to claim 1 or 2, which is characterized in that exist in determining at least one described sound source and need In the case where the sound source alerted, this method further include: by the feature of the sound of the sound source alerted and default sound Sound wave graphic data feature is compared, and determines the type of the sound of the sound source alerted,
The information corresponding with sound source that is being alerted further includes identified type.
4. a kind of for alerting the device of abnormal sound source, which is characterized in that the device includes:
Sound receiving module, for receiving the sound of at least one sound source;
Determining module determines described at least one for the sound based on each sound source at least one received described sound source The orientation of each sound source in a sound source;
Processing module, for based on each sound source at least one described sound source sound and default alarm conditions judgement described in With the presence or absence of the sound source alerted at least one sound source, wherein the default alarm conditions include following one or more Person: the volume that the volume of the sound of sound source is greater than the sound of default alarm volume, sound source be greater than background sound amount and with the background The waveform that the difference of volume is greater than the sound of preset difference value volume and sound source meets predetermined waveform;And
Display module, in the case where for there is the sound source alerted in determining at least one described sound source, display Information corresponding with the sound source alerted, wherein the information corresponding with the sound source alerted includes needs The orientation of the sound source alerted.
5. device according to claim 4, which is characterized in that the information corresponding with sound source that is being alerted is also The volume and/or alert symbol of sound including the sound source alerted.
6. device according to claim 4, which is characterized in that exist in determining at least one described sound source and need to carry out In the case where the sound source of alarm, the feature of the sound for the sound source that the processing module is also used to alert and default sound Sound wave graphic data feature is compared, and determines the type of the sound of the sound source alerted,
The information corresponding with sound source that is being alerted further includes identified type.
7. the device according to any one of claim 4-6, which is characterized in that the display module is near-eye display.
8. device according to claim 7, which is characterized in that the near-eye display is perspective formula near-eye display.
9. a kind of augmented reality glasses, which is characterized in that the augmented reality glasses include: described in any one of claim 4-8 Device.
10. a kind of machine readable storage medium, it is stored with instruction on the machine readable storage medium, which is used for so that machine Perform claim requires method described in any one of 1-3.
CN201810596746.1A 2018-06-11 2018-06-11 For alerting the method and apparatus and augmented reality glasses of abnormal sound source Pending CN108983965A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201810596746.1A CN108983965A (en) 2018-06-11 2018-06-11 For alerting the method and apparatus and augmented reality glasses of abnormal sound source
PCT/CN2019/090607 WO2019238017A1 (en) 2018-06-11 2019-06-11 Method and device for providing anomalous sound source alert and augmented reality glasses

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810596746.1A CN108983965A (en) 2018-06-11 2018-06-11 For alerting the method and apparatus and augmented reality glasses of abnormal sound source

Publications (1)

Publication Number Publication Date
CN108983965A true CN108983965A (en) 2018-12-11

Family

ID=64540247

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810596746.1A Pending CN108983965A (en) 2018-06-11 2018-06-11 For alerting the method and apparatus and augmented reality glasses of abnormal sound source

Country Status (2)

Country Link
CN (1) CN108983965A (en)
WO (1) WO2019238017A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019238017A1 (en) * 2018-06-11 2019-12-19 北京佳珥医学科技有限公司 Method and device for providing anomalous sound source alert and augmented reality glasses
CN112185415A (en) * 2020-09-10 2021-01-05 珠海格力电器股份有限公司 Sound visualization method and device, storage medium and MR mixed reality equipment
CN112462520A (en) * 2020-12-03 2021-03-09 江西台德智慧科技有限公司 Outdoor exercises glasses based on artificial intelligence

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103049077A (en) * 2011-10-14 2013-04-17 鸿富锦精密工业(深圳)有限公司 Sound feedback device and working method thereof
CN106205117A (en) * 2016-07-20 2016-12-07 广东小天才科技有限公司 A kind of potential safety hazard based reminding method and device
CN106768284A (en) * 2016-12-20 2017-05-31 西安科技大学 A kind of abnormal sound source judges and alignment system and method

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107682772B (en) * 2017-10-25 2019-05-24 倬韵科技(深圳)有限公司 A kind of hazard recognition is to control the method, apparatus and earphone of audio output
CN108983965A (en) * 2018-06-11 2018-12-11 北京佳珥医学科技有限公司 For alerting the method and apparatus and augmented reality glasses of abnormal sound source

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103049077A (en) * 2011-10-14 2013-04-17 鸿富锦精密工业(深圳)有限公司 Sound feedback device and working method thereof
CN106205117A (en) * 2016-07-20 2016-12-07 广东小天才科技有限公司 A kind of potential safety hazard based reminding method and device
CN106768284A (en) * 2016-12-20 2017-05-31 西安科技大学 A kind of abnormal sound source judges and alignment system and method

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019238017A1 (en) * 2018-06-11 2019-12-19 北京佳珥医学科技有限公司 Method and device for providing anomalous sound source alert and augmented reality glasses
CN112185415A (en) * 2020-09-10 2021-01-05 珠海格力电器股份有限公司 Sound visualization method and device, storage medium and MR mixed reality equipment
CN112462520A (en) * 2020-12-03 2021-03-09 江西台德智慧科技有限公司 Outdoor exercises glasses based on artificial intelligence

Also Published As

Publication number Publication date
WO2019238017A1 (en) 2019-12-19

Similar Documents

Publication Publication Date Title
US11727952B2 (en) Glasses with closed captioning, voice recognition, volume of speech detection, and translation capabilities
US11234096B2 (en) Individualization of head related transfer functions for presentation of audio content
WO2017165035A1 (en) Gaze-based sound selection
WO2017092332A1 (en) Method and device for image rendering processing
EP3922048A1 (en) Audio spatialization and reinforcement between multiple headsets
US9696798B2 (en) Eye gaze direction indicator
TW201316328A (en) Sound feedback device and work method thereof
US10088868B1 (en) Portable electronic device for acustic imaging and operating method for the same
CN108983965A (en) For alerting the method and apparatus and augmented reality glasses of abnormal sound source
US11482237B2 (en) Method and terminal for reconstructing speech signal, and computer storage medium
CN103105926A (en) Multi-sensor posture recognition
CN103049077A (en) Sound feedback device and working method thereof
US20220066207A1 (en) Method and head-mounted unit for assisting a user
US11082794B2 (en) Compensating for effects of headset on head related transfer functions
WO2019237427A1 (en) Method, apparatus and system for assisting hearing-impaired people, and augmented reality glasses
US20210044916A1 (en) Determination of an acoustic filter for incorporating local effects of room modes
JP7048784B2 (en) Display control system, display control method and program
WO2019237428A1 (en) Method and device for providing sound source information and augmented reality glasses
CN115136619A (en) Hearing assistance device with intelligent audio focus control
WO2021230180A1 (en) Information processing device, display device, presentation method, and program
CN112751582A (en) Wearable device for interaction, interaction method and equipment, and storage medium
CN105094304B (en) A kind of information processing method and electronic equipment
WO2019237429A1 (en) Method, apparatus and system for assisting communication, and augmented reality glasses
US20190089899A1 (en) Image processing device
CN108899029A (en) It is absorbed in the methods, devices and systems of the voice of single sound source

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20181211

RJ01 Rejection of invention patent application after publication