CN104506586A - Intelligent earphone system capable of regulating volume by gesture and regulation method - Google Patents

Intelligent earphone system capable of regulating volume by gesture and regulation method Download PDF

Info

Publication number
CN104506586A
CN104506586A CN201410746548.0A CN201410746548A CN104506586A CN 104506586 A CN104506586 A CN 104506586A CN 201410746548 A CN201410746548 A CN 201410746548A CN 104506586 A CN104506586 A CN 104506586A
Authority
CN
China
Prior art keywords
volume
intelligent earphone
cloud server
gesture
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201410746548.0A
Other languages
Chinese (zh)
Inventor
刘浩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Qihoo Technology Co Ltd
Qizhi Software Beijing Co Ltd
Original Assignee
Beijing Qihoo Technology Co Ltd
Qizhi Software Beijing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Qihoo Technology Co Ltd, Qizhi Software Beijing Co Ltd filed Critical Beijing Qihoo Technology Co Ltd
Priority to CN201410746548.0A priority Critical patent/CN104506586A/en
Publication of CN104506586A publication Critical patent/CN104506586A/en
Pending legal-status Critical Current

Links

Abstract

The invention discloses an intelligent earphone system capable of regulating volume by gesture and a regulation method. The volume regulation method comprises the following steps: acquiring surrounding environmental sounds by an intelligent earphone; sending the acquired environmental sounds to a cloud server; receiving a volume regulation instruction determined by the cloud server according to the content and/or volume of the environmental sounds; displaying the regulated volume and the current volume by projection; realizing the regulation of the volume by a user by means of gesture operation. Therefore, the intelligent earphone mentioned in the invention can be used for automatically regulating the volume according to the volume regulation instruction of the cloud server, providing convenience for the user by realizing a method in which automatic volume regulation is combined with manual control in combination with projection and gesture acquisition functions of the intelligent earphone, realizing greater humanization in volume regulation, guaranteeing the heath of double ears of the user and also realizing greater humanization and portability in operation on the intelligent earphone.

Description

A kind of intelligent earphone system and control method being regulated volume by gesture
Technical field
The present invention relates to network communication technology field, be specifically related to a kind of the intelligent earphone system and the control method that are regulated volume by gesture.
Background technology
Intelligent earphone has a wide range of applications in daily life, utilizes intelligent earphone can listen to the contents such as music whenever and wherever possible, and can not bother other people.But the volume sent due to intelligent earphone is directly communicated to people's ear, therefore, if the excessive comfort level that will have a strong impact on user of the volume of intelligent earphone, the hearing of user may even also be jeopardized; If the volume of intelligent earphone is too small, user can be caused not hear, affect the result of use of user.
At present, if user will adjust the volume of intelligent earphone, usually need the electronic equipment (as computer, mobile phone etc.) directly regulating intelligent earphone to connect, or, need to regulate the knob on intelligent earphone connecting line.In a word, existing intelligent earphone volume adjusting mode all needs user manually to adjust.
Key mode realizes answering, hang up, the function of volume adjustment, when extraneous volume changes time, manual setting is just needed to arrive suitable volume, certainly now when extraneous volume is very large, the volume of adjustment just very high ability meet and listen to needs, but the concrete decibel of volume high is like this how many? can damage ear? ordinary people is fathomless; Simultaneously because the button intelligence of machinery progressively adjusts volume from small to large or from big to small, therefore the change speed of volume is very slow.
Also have a lot of acoustic control to adjust the intelligent earphone of volume in the market, but be not suitable for using Sound control in a lot of occasion, such as, in occasions such as quiet offices, being therefore badly in need of will method for controlling volume easily.
Summary of the invention
In order to solve the problems of the technologies described above, one of technical scheme that the present invention proposes: a kind of intelligent earphone system being regulated volume by gesture, suitable volume can be automatically set according to the change of external environment, and volume value is shown to user, the volume of the method choice adopting gesture by user whether after Use Adjustment.
Comprise: intelligent earphone and Cloud Server; Described intelligent earphone is connected by network with described Cloud Server;
Described intelligent earphone comprises: projection module, audio collection module, data sending/receiving module, Computer image genration module, image capture module and volume adjusting module;
Described audio collection module for gathering the ambient sound around intelligent earphone, and sends to described Cloud Server;
The volume value of ambient sound that described Computer image genration module will collect, and the volume value after adjustment generates volume and controls picture, and the volume of generation is controlled picture projected by described projection module;
Described image capture module is used for the projection information of intelligent earphone described in continuous acquisition, and sends to described Cloud Server;
Described Cloud Server comprises: volume computing module, image processing module, control module and signal sending/receiving module;
Described volume computing module receives the volume value of the ambient sound that described intelligent earphone gathers, and carries out the volume value calculated after adjustment according to the volume value of the ambient sound gathered, and the volume value after adjustment is returned to described intelligent earphone;
Described image processing module is used for analyzing the projected image that described intelligent earphone gathers, from described projected image, determine described gesture; Described control module generates volume control command according to described gesture and sends to described intelligent earphone;
The volume control command that the volume adjusting module of described intelligent earphone sends according to described Cloud Server adjusts described intelligent earphone volume;
The data sending/receiving module of described intelligent earphone carries out data communication by the signal sending/receiving of network and described Cloud Server.
Described Cloud Server also comprises memory module, described memory module for store from described intelligent earphone continuous acquisition to projected image, the first projected image and the gesture that prestores; Described first projected image is that the volume of described intelligent earphone Computer image genration CMOS macro cell controls picture;
The projected image collected and described first projected image are compared by the image processing module of described Cloud Server, obtain gesture path; Described gesture path and the gesture prestored contrast by described control module, obtain volume control command.
Preferably, a volume is at least shown in the picture of described intelligent earphone Computer image genration CMOS macro cell;
The described gesture that described image processing module is determined is for choosing gesture; Described image processing module also comprises the region determining the described projected image that described gesture is positioned at;
Described control module according to described in choose gesture and described in choose volume corresponding to region that gesture is positioned at described projected image, send volume control command; Described volume control command comprises: described in the volume value chosen.
In addition, the audio collection module of intelligent earphone described in the present invention also comprises the content gathering ambient sound;
The content of the ambient sound that the content of the current ambient sound collected and a upper time period collect by the computing module of described Cloud Server contrasts, when finding that there is change, and the volume value after setting adjustment, and be sent to described intelligent earphone.
Preferably, described intelligent earphone also comprises station acquisition function;
The positional information that a time period in the current positional information collected collects contrasts by the computing module of described Cloud Server, when finding that there is change, and the volume value after setting adjustment, and be sent to described intelligent earphone.
The technical scheme two that the present invention proposes: a kind of intelligent earphone regulates the method for volume by gesture, comprising:
S1, the environmental volume around intelligent earphone Real-time Collection, and the ambient sound value collected is sent to Cloud Server;
S2, described Cloud Server, according to the volume value after described ambient sound value setting adjustment, sends to intelligent earphone;
S3, described intelligent earphone by adjustment after volume value and described intelligent earphone current volume value generating pictures information and shown by projection arrangement; User is selected in described projected image by gesture;
S4, described intelligent earphone uses camera head continuous acquisition projected image, and the projected image of described continuous acquisition is sent to described Cloud Server; The projected image of described intelligent earphone collection comprises pictorial information and the projection of gesture in described pictorial information of the generation of described intelligent earphone;
S5, the projected image of described Cloud Server to described intelligent earphone continuous acquisition is analyzed, from described projected image, determine described gesture, and then generates volume control command;
S6, described intelligent earphone receives the volume control command that described Cloud Server sends, row relax of going forward side by side.
Preferably, the projected image of described Cloud Server to described intelligent earphone continuous acquisition is analyzed and is determined that the method for the gesture of described user is:
S1.1, after the information of intelligent earphone generating pictures described in described step S3, sends to described Cloud Server as the first projected image;
S1.2, by described intelligent earphone continuous acquisition to projected image and described first projected image compare, obtain the gesture path of user;
S1.3, is combined the gesture path of user with described projected image and analyzes, obtain the region that user's gesture path is positioned at described projected image;
S1.4, analyzes the content that described user's gesture path is positioned at described projected image area, generates volume control command.
In the present invention, user to be selected described projected image by hand motion and the method adjusting volume is:
S2.1, at least comprises a volume in the described volume adjusting image that described intelligent earphone is shown by projection arrangement;
S2.2, user is in the viewing area of described volume adjusting image, and employing is chosen gesture and selected a volume;
S2.3, described Cloud Server user adopts the volume generation volume control command chosen gesture and select;
S2.4, described intelligent earphone adjusts the volume of described intelligent earphone according to described volume control command.
Preferably, the described information in described step S1 is the ambient sound around described intelligent earphone, and described Cloud Server is analyzed the ambient sound around described intelligent earphone, and the method generating volume adjusting image is:
S3.1, the ambient sound around described intelligent earphone collection, and described ambient sound is sent to described cloud service;
S3.2, described Cloud Server determines described ambient sound type according to the content of described ambient sound and/or volume;
S3.3, when described Cloud Server detects that described ambient sound type changes, the Dynamic gene corresponding according to described ambient sound type calculates adjustment volume;
S3.4, described Cloud Server, according to described adjustment volume, generates volume adjusting image.
In addition, the described information in described step S1 is the positional information of described intelligent earphone, and the positional information of described Cloud Server to described intelligent earphone is analyzed, and the method generating volume adjusting image is:
S3.1, described intelligent earphone collection position information, and described positional information is sent to described cloud service;
S3.2, described Cloud Server determines described location type according to described positional information;
S3.3, when described Cloud Server detects that described location type changes, the Dynamic gene corresponding according to described location type calculates adjustment volume;
S3.4, described Cloud Server, according to described adjustment volume, generates volume adjusting image.
Intelligent earphone can not only gather the ambient sound in surrounding environment on one's own initiative, the ambient sound collected is sent to Cloud Server, and receive the Cloud Server environmentally content of sound and/or volume and the volume adjusting instruction determined, and extend the function of intelligent earphone, volume after adjustment is shown to user, allow the size knowing volume that user is clear and definite, by the projection that intelligent earphone carries, camera head realizes visual selection employing or the volume after not adopting adjustment, the powerful computing capability simultaneously provided by Cloud Server, realize the quick response of intelligent earphone, thus realize current play content intelligence, visual volume adjusting.As can be seen here, intelligent earphone in the present invention can according to the rational volume of the change calculations of timely external environment, avoid damaging ear, extend the function of intelligent earphone simultaneously, intelligent earphone is made to provide the visual services of hommization more, the present invention simultaneously adopts the powerful computing function of Cloud Server and obtains more reasonable and intelligent volume adjusting based on the analysis of mass data, provides the operation of visual hommization while ensureing user's ears health.
Above-mentioned explanation is only the general introduction of technical solution of the present invention, in order to technological means of the present invention can be better understood, and can be implemented according to the content of specification, and can become apparent, below especially exemplified by the specific embodiment of the present invention to allow above and other objects of the present invention, feature and advantage.
Accompanying drawing explanation
By reading hereafter detailed description of the preferred embodiment, various other advantage and benefit will become cheer and bright for those of ordinary skill in the art.Accompanying drawing only for illustrating the object of preferred implementation, and does not think limitation of the present invention.And in whole accompanying drawing, represent identical parts by identical reference symbol.In the accompanying drawings:
Fig. 1 shows a kind of hardware configuration schematic diagram of intelligent earphone provided by the invention;
Fig. 2 shows the intelligent earphone system construction drawing being regulated volume by gesture provided by the invention;
Fig. 3 shows intelligent earphone provided by the invention regulates the method for volume schematic flow sheet by gesture;
Fig. 4 shows the schematic flow sheet of the volume adjusting method based on intelligent earphone that the embodiment of the present invention one provides;
Fig. 5 shows the schematic flow sheet of the volume adjusting method based on intelligent earphone that the embodiment of the present invention two provides;
Fig. 6 shows the structural representation of intelligent earphone provided by the invention;
Fig. 7 shows the structural representation of Cloud Server provided by the invention;
Fig. 8 shows the structural representation of sound volume regulating system provided by the invention.
Embodiment
Below with reference to accompanying drawings exemplary embodiment of the present disclosure is described in more detail.Although show exemplary embodiment of the present disclosure in accompanying drawing, however should be appreciated that can realize the disclosure in a variety of manners and not should limit by the embodiment set forth here.On the contrary, provide these embodiments to be in order to more thoroughly the disclosure can be understood, and complete for the scope of the present disclosure can be conveyed to those skilled in the art.
Embodiments provide a kind of the intelligent earphone system and the control method that are regulated volume by gesture, can solve intelligent earphone volume adjusting mode of the prior art all needs user's manual adjustments and accurately cannot learn the problem of volume value.
The invention provides a intelligent earphone that can be regulated volume by gesture, this intelligent earphone can not only Received signal strength, initiatively can also send signal, and receive the feedback result of Cloud Server to Cloud Server, therefore, this intelligent earphone can also use independent of other electronic equipments.For the ease of understanding the present invention, first the hardware configuration of intelligent earphone provided by the invention is introduced below with reference to accompanying drawing: Fig. 1 shows a kind of hardware configuration schematic diagram of intelligent earphone provided by the invention, as shown in Figure 1, this intelligent earphone mainly comprises the L channel part 11 and R channel part 12 that are connected by connecting line.Wherein, L channel part 11 mainly comprises: NFC module 111, battery 112, memory module 113, microphone 114, left side intelligent earphone phonation unit 115, camera 116 and microprocessor 117.R channel part 12 mainly comprises: physical button and identification module 121, network communication module 122, microphone 123, computing circuit 124, data-interface 125, right side intelligent earphone phonation unit 126 and projecting apparatus 127.Wherein, battery, microphone and intelligent earphone phonation unit are the conventional modules of intelligent earphone inside, omit the description to its function herein, introduce other modules below: camera 116 is mainly used in obtaining image information, and described image information is transferred to Cloud Server; Microprocessor 117 is mainly used in acoustic information to be converted to image information; The visual information projection display of projecting apparatus 127 for processor 117 is generated; Physical button and mainly acting on of identification module 121 identify user identity, such as, identification module wherein can be fingerprint identification module, iris recognition module or voiceprint identification module etc., can be used for each generic module identifying user biological characteristic information, it is by comparing the user biological characteristic information of the registered user prestored in the user biological characteristic information of the active user collected and intelligent earphone, realize the object of identification, thus can prevent some unauthorized users from using the situation of intelligent earphone without authorization.Network communication module 122 can be such as all kinds of wireless network modules such as 3G/4G module, wifi module, for the radio communication realized and between Cloud Server or other electronic equipments.Computing circuit 124 is for realizing some calculation functions according to the data received, and feedback op result.The quantity of data-interface 125 can be one or more, and can be realized by various types of communication interface, data-interface 125 enables this intelligent earphone realize open interface design, and user can connect other expansion equipments to realize greater functionality by this data-interface 125.NFC module 111 can utilize near-field communication (Near Field Communication, being called for short NFC) technology realizes short-range high-frequency wireless communication, thus, matched by this module and wireless router and can obtain local area network (LAN) and network and arrange, thus networked by wifi, to reduce 3G/4G data traffic, save user's rate.The Main Function of memory module 113 is that the data message (the user biological characteristic information of registered user as escribed above) to intelligent earphone inside will be used stores, and can the data that receive from Cloud Server of buffer memory.As can be seen here, this intelligent earphone can fully utilize all kinds of technology such as embedding assembly technology, cloud computing technology, and can realize the several functions such as personal identification, music service.The hardware configuration schematic diagram of the intelligent earphone shown in Fig. 1 is only schematic, and those skilled in the art also can increase module wherein, delete or replace, to realize types of functionality flexibly.In addition, a kind of possible structure that Fig. 1 illustrate only intelligent earphone divides schematic diagram, and those skilled in the art can also divide according to other dividing mode (such as dividing according to the software function) functional module to intelligent earphone.
Fig. 2 shows the intelligent earphone system construction drawing being regulated volume by gesture provided by the invention, comprises following functions module: intelligent earphone and Cloud Server; Intelligent earphone is connected by network with Cloud Server;
Wherein, intelligent earphone comprises: projection module, audio collection module, data sending/receiving module, Computer image genration module, image capture module and volume adjusting module;
Audio collection module for gathering the ambient sound around intelligent earphone, and sends to Cloud Server;
The volume value of ambient sound that Computer image genration module will collect, and the volume value after adjustment generates volume and controls picture, and the volume of generation is controlled picture projected by projection module;
Image capture module is used for the projection information of continuous acquisition intelligent earphone, and sends to Cloud Server.
Cloud Server comprises: volume computing module, image processing module, control module and signal sending/receiving module;
Volume computing module receives the volume value of the ambient sound that intelligent earphone gathers, and carries out the volume value calculated after adjustment according to the volume value of the ambient sound gathered, and the volume value after adjustment is returned to intelligent earphone;
Image processing module is used for analyzing the projected image of intelligent earphone collection, from projected image, determine gesture; Control module generates volume control command according to gesture and sends to intelligent earphone;
The volume control command that the volume adjusting module of intelligent earphone sends according to Cloud Server adjusts intelligent earphone volume.
The data sending/receiving module of intelligent earphone carries out data communication by the signal sending/receiving of network and Cloud Server.
Fig. 3 shows intelligent earphone provided by the invention regulates the method for volume schematic flow sheet by gesture, comprises the steps:
Step S110: intelligent earphone gathers the ambient sound in surrounding environment, and the ambient sound collected is sent to Cloud Server.
Particularly, in this step, the audio collection module (as micro recorder, microphone etc.) by intelligent earphone is installed gathers the ambient sound in surrounding environment.
Step S120: receive the ambient sound that above-mentioned intelligent earphone gathers, and analyze content and/or the volume of above-mentioned ambient sound, then calculates the intelligent earphone volume matched with the content of ambient sound and/or volume.
Step S130: the volume value that the image generating module of intelligent earphone is determined according to the content of above-mentioned ambient sound and/or volume according to the Cloud Server received, the current volume value of the volume value determined by Cloud Server and intelligent earphone generates volume and controls pictorial information.
Step S140: shown by projection arrangement;
User selects to be the volume of intelligent earphone is adjusted to the volume value that Cloud Server is determined or the current volume continuing to keep intelligent earphone by gesture in projected image;
Concrete, the gesture of user also can be shown by projecting apparatus on the image of projection, at this moment, user can hook by the volume value determined at Cloud Server is drawn or in the current volume value of intelligent earphone, draw the volume value hooking and select to want the confidential realization of current Intellgent Ear;
Step S150: intelligent earphone uses the image of camera continuous acquisition projection, and the projected image of described continuous acquisition is sent to Cloud Server; Here, the projected image of intelligent earphone collection comprises the projection of the volume control picture of intelligent earphone generation and the hand of user;
Step S160: now receive the projection image information that intelligent earphone sends continuously, and this image information is analyzed, determine the gesture of user, and the volume value that gesture is chosen
Concrete, when projection arrangement starts to show volume control picture, first the volume of display being controlled picture sends to Cloud Server as the image information preset, and gather the image information of coming up later and compare with the image information preset, its difference section is exactly the projection of hand; Get continuous print image information to compare with the image information preset respectively, obtain projection information and the gesture of continuous action in one's hands, now gesture is compared with default gesture, determine the meaning that gesture is expressed; Then, obtain the region that gesture covers, this region and the image information preset are compared, obtains the graphical information in this region, then do pattern analysis, determine the meaning that this graphics field represents.
Such as also make comparisons with the gesture prestored through continuous print graphical analysis, show that gesture that user uses is for choosing (expression is chosen), now check that the graphics field that gesture covers is: 45 decibels (volume value after adjustment), now represents: user selects the volume of intelligent earphone to adjust to 45 decibels.
Step S170: send volume control command according to result of calculation to above-mentioned intelligent earphone, for above-mentioned intelligent earphone, volume adjusting is carried out to current play content,
Here volume control command comprises the volume value 45 decibels chosen according to above-mentioned steps.
Step S180: when intelligent earphone receives the volume control command that Cloud Server sends, carry out volume adjusting according to the current play content of volume control command to intelligent earphone.
As can be seen here, in the present invention, intelligent earphone can gather the ambient sound in surrounding environment on one's own initiative, the ambient sound collected is sent to Cloud Server, and receive the Cloud Server environmentally content of sound and/or volume and the volume adjusting instruction determined, thus volume adjusting is carried out to current play content.As can be seen here, intelligent earphone in the present invention can according to the volume adjusting instruction automatic regulating volume of Cloud Server, without the need to user's manual adjustments, thus for user provides convenience, be particularly useful for the occupied user of both hands (as driven or embracing the user of child), and then ensure the result of use of user and the health of user's ears.
The volume adjusting method based on intelligent earphone provided by the invention is described in detail below by specific embodiment:
Embodiment one,
As shown in Figure 4, this first embodiment comprises the following steps:
Step S410: the biological information obtaining active user's input, compares the biological information of the biological information got with the registered user prestored, and determines whether to allow current user operation intelligent earphone according to comparison result.
This step is an optional step, and object is to determine whether active user is authorized registered user, to prevent unauthorized user operative intelligence earphone without authorization, also this step can be omitted in other embodiment of the present invention.
Wherein, biological information, for identifying the identity of user, can be specifically fingerprint feature information, iris feature information etc.Suppose that the biological information in the present embodiment is fingerprint feature information, in order to obtain the fingerprint feature information of active user, needing, on intelligent earphone, a Fingerprint Identification Unit is installed, being used for gathering user fingerprints.This Fingerprint Identification Unit automatically can be opened, to point out user's typing fingerprint after user presses power key start.In addition, in order to the finger print information collected Fingerprint Identification Unit identifies, also need typing in advance and store the biological information of at least one registered user, if the biometric information matches of the finger print information collected and registered user, then determine that active user is authorized registered user, allow it to continue this intelligent earphone of operation; Otherwise determine that active user is nonregistered user, intelligent earphone is closed automatically.
Step S420: intelligent earphone gathers the ambient sound in surrounding environment, and the ambient sound collected is sent to Cloud Server.
Wherein, intelligent earphone can gather the ambient sound in surrounding environment by acquisition modules such as built-in micro recorder, microphones.In addition, step S420 can automatically perform after step S410 is verified, and also can be triggered by one or more in following triggering mode:
In the first triggering mode, user can carry out triggered step S420 by button triggering mode, now, can arrange a physical button on intelligent earphone, as long as user presses this button, and will triggering collection module acquires send ambient sound.
In the second triggering mode, user can carry out triggered step S420 by speech trigger mode, now, sound identification module can be set on intelligent earphone, as long as the voice such as " collection ambient sound " or " adjustment volume " instruction that user sends, this sound identification module will indicate triggering collection module acquires according to the voice received and send ambient sound.
Above-mentioned two kinds of triggering modes are user and initiatively trigger, and only gather ambient sound when user triggers, and then do not gather ambient sound at other times.In order to further facilitate user, the invention allows for the third triggering mode, this kind of triggering mode does not need user initiatively to trigger.In the third triggering mode, intelligent earphone is in the process of start operation, automatically ambient sound is gathered continuously, and automatically intellectual analysis is carried out to the situation of change of ambient sound, only just send ambient sound to Cloud Server when the situation of change of ambient sound meets and imposes a condition, so that Cloud Server adjusts the volume of intelligent earphone according to the ambient sound after change.Wherein, imposing a condition can be that the volume change of ambient sound is greater than setting threshold.Such as, setting threshold can be 30 decibels, and threshold value here can according to user habit sets itself, ambient sound corresponding when therefore then can send 60 decibels to Cloud Server when ambient sound brings up to 60 decibels from 20 decibels suddenly.Or imposing a condition also can be the content generation significant change of ambient sound.Such as, when the environment residing for user is transformed into kindergarten from KTV, obviously can there is significant change in the content of ambient sound, and therefore intelligent earphone sends the ambient sound after being transformed into kindergarten to Cloud Server.Adopt the third triggering mode, initiatively trigger volume adjusting step without the need to user, the environment that can be according to user automatically for user regulates suitable volume, for user provides convenience.
In above three kinds of execution modes, descant amount can also be set.
Those skilled in the art can also arrange other modes and carry out triggered step S420, and the present invention does not limit this.
Step S430: the ambient sound that cloud server intelligent earphone gathers, and the content of analysis environments sound and/or volume.
Wherein, the content of ambient sound can be determined by the various ways such as speech recognition or artificial judgment.During specific implementation, all kinds of sound such as the personage's conversation content in ambient sound, animal cry and vehicle roar can be identified by the mode of speech recognition, thus judge the particular content of ambient sound, can also the content of environmentally sound ambient sound be classified.Such as, according to the sound type occurred in ambient sound to analyze the location type residing for user, thus ambient sound is divided into the ambient sound etc. of ambient sound in the ambient sound on road limit, park, KTV.The volume of ambient sound can be represented by decibels, and, according to decibels, ambient sound can be divided into the ambient sound etc. of the ambient sound of quiet type, the ambient sound of noisy type and noisy type.In addition, when classifying to ambient sound, both can separately environmentally the interior perhaps volume of sound classify, also can classify according to the combination of content and volume.
Step S440: Cloud Server calculates the intelligent earphone volume matched with the content of above-mentioned ambient sound and/or volume, and send volume adjusting instruction according to result of calculation to intelligent earphone.
Particularly, in step S440, can calculate by multiple account form the intelligent earphone volume matched with the content of above-mentioned ambient sound and/or volume.Provide a kind of preferred account form below:
First, typical problem and the volume range of intelligent earphone is pre-set.
Wherein, the typical problem of intelligent earphone be generally intelligent earphone start after default volume.Therefore, identical numerical value (as 30 decibels) can be set to by Cloud Server by unified for the typical problem of all intelligent earphones.Or this typical problem also can be arranged according to the use habit of self by intelligent earphone user, and send to Cloud Server by arranging result in advance.Similar with the set-up mode of typical problem, the volume range of intelligent earphone also can be carried out unifying to arrange (as being set to 10 decibels to 60 decibels) according to people's ear comfort level situation by Cloud Server, or also can be arranged according to the use habit of self by intelligent earphone user, and send to Cloud Server by arranging result in advance.
Then, Cloud Server determines the first kind Dynamic gene corresponding with the content of above-mentioned ambient sound and/or volume according to the volume adjusting list preset, and in above-mentioned volume range, utilize first kind Dynamic gene to regulate typical problem, obtain the intelligent earphone volume matched with the content of ambient sound and/or volume.
Wherein, Cloud Server is previously stored with volume adjusting list, stores the first kind Dynamic gene corresponding with the ambient sound of various content and/or various volume in the list.Table 1 shows the partial content schematic diagram of volume adjusting list.Volume adjusting list in table 1 is only schematic, and those skilled in the art can also adjust the set-up mode of volume adjusting list, such as, and can comprehensively environmentally the content of sound and volume arrange corresponding first kind Dynamic gene.
Table 1
Ambient sound type First kind Dynamic gene
The ambient sound on road limit 1.2
Ambient sound in park 0.8
The ambient sound of KTV 3.0
The ambient sound of quiet type 0.6
The ambient sound of noisy type 1.5
The ambient sound of noisy type 2.0
Suppose that the typical problem of intelligent earphone is 30 decibels, and Cloud Server analyzes the ambient sound that ambient sound is quiet type, the first kind Dynamic gene corresponding to ambient sound being obtained the type by question blank 1 is 0.6, then utilize first kind Dynamic gene 0.6 pair of typical problem 30 to regulate, the intelligent earphone volume obtaining matching with the ambient sound of quiet type is 18 decibels.Further, this result of calculation does not exceed the volume range pre-set, therefore, without the need to revising result of calculation.If result of calculation is beyond the volume range pre-set, then correspondingly result of calculation can be modified to higher limit or the lower limit of default volume range, to reach the object of protection hearing or guarantee result of use.
Finally, volume adjusting instruction is sent according to result of calculation to intelligent earphone.In the above example, Cloud Server will send the volume adjusting instruction of " volume being adjusted to 18 decibels " to intelligent earphone.
Step S450: intelligent earphone receives the volume adjusting instruction that Cloud Server is determined according to the content of above-mentioned ambient sound and/or volume, and carries out volume adjusting according to the instruction of this volume adjusting to the current play content of intelligent earphone.Such as, the volume adjusting of current play content is 18 decibels after receiving the volume adjusting instruction of above-mentioned " volume being adjusted to 18 decibels " by intelligent earphone.
By above-mentioned step S410 to step S450, the object automatically regulating intelligent earphone volume just can be realized.Alternatively, in order to the use habit making above-mentioned volume adjusting method more meet user, the method in this embodiment can further include following step S460 and step S470.
Step S460: intelligent earphone sends volume setting information to Cloud Server, so that Cloud Server is according to the volume adjusting instruction sent before above-mentioned volume setting information amendment.
The effect of implementation step S460 mainly contains two: first, when the volume adjustment result of intelligent earphone user to Cloud Server can be made to be unsatisfied with by step S460, initiatively can send volume setting information, to revise the adjustment result of Cloud Server, make it more meet the demand of user.Second, Cloud Server can be made to collect the volume setting information of each intelligent earphone user by step S460, thus infer the use habit most users, and then the volume adjusting list of preserving before is revised, make it more meet the use habit of most users.Above-mentioned volume setting information both can be sent by key-press input mode, also can be sent by phonetic entry mode.Such as, user directly says " volume being adjusted to 10 decibels " intelligent earphone, then the acquisition module in intelligent earphone will collect this phonetic order, and send it to Cloud Server, so that Cloud Server sends the instruction of amended volume adjusting accordingly.
Step S470: the volume setting information that cloud server intelligent earphone user sends, according to the volume adjusting instruction sent before the amendment of this volume setting information; Further, according to this volume setting information, the first kind Dynamic gene stored in volume adjusting list is revised.
First, in step S470, Cloud Server, according to the volume setting information received, resets and sends volume adjusting instruction, to be the volume set in volume setting information by the volume adjusting of intelligent earphone, to meet the requirement of this user.
Secondly, Cloud Server is further according to the volume setting information received, and the volume adjusting list shown in his-and-hers watches 1 is revised.Such as, in this example, user receives Cloud Server according to after the volume adjusting instruction of the volume adjusting list transmission shown in table 1, the instruction of this volume adjusting is adjusted to 10 decibels from 18 decibels by further transmission volume setting information, can infer thus, when user is in the ambient sound of quiet type, more tend to the content listening to low decibel, therefore, the first kind Dynamic gene corresponding to the ambient sound of type quiet in table 1 suitably can be turned down (being such as adjusted to 0.5).In a practical situation, Cloud Server can carry out the volume adjusting list shown in correction chart 1 in conjunction with the volume setting information of a large number of users feedback, and concrete makeover process can be realized by machine learning scheduling algorithm.
Step S480: the volume value that the image generating module of intelligent earphone is determined according to the content of above-mentioned ambient sound and/or volume according to the Cloud Server received, the current volume value of the volume value determined by Cloud Server and intelligent earphone generates volume and controls pictorial information.
Step S490: shown by projection arrangement;
User selects to be the volume of intelligent earphone is adjusted to the volume value that Cloud Server is determined or the current volume continuing to keep intelligent earphone by gesture in projected image;
Concrete, the gesture of user also can be shown by projecting apparatus on the image of projection, at this moment, user can hook by the volume value determined at Cloud Server is drawn or in the current volume value of intelligent earphone, draw the volume value hooking and select to want the confidential realization of current Intellgent Ear;
Here, projection arrangement can adopt the laser projection of LASER Light Source.Laser projection has the features such as energy consumption is low, volume is little.The optical modulator of laser projection adopts liquid crystal on silicon (LCOS).To reduce volume, reduce energy consumption.Certain projector equipment main body 1 also can adopt LED light source, or the projector of other light sources.
Step S491: intelligent earphone uses the image of camera continuous acquisition projection, and the projected image of described continuous acquisition is sent to Cloud Server; Here, the projected image of intelligent earphone collection comprises the projection of the volume control picture of intelligent earphone generation and the hand of user;
The external image of the projector equipment of camera picked-up here projecting direction, camera here needs to have recording function.
Step S492: now receive the projection image information that intelligent earphone sends continuously, and this image information is analyzed, determine the gesture of user, and the volume value that gesture is chosen
Concrete, when projection arrangement starts to show volume control picture, first the volume of display being controlled picture sends to Cloud Server as the image information preset, and gather the image information of coming up later and compare with the image information preset, its difference section is exactly the projection of hand; Get continuous print image information to compare with the image information preset respectively, obtain projection information and the gesture of continuous action in one's hands, now gesture is compared with default gesture, determine the meaning that gesture is expressed; Then, obtain the region that gesture covers, this region and the image information preset are compared, obtains the graphical information in this region, then do pattern analysis, determine the meaning that this graphics field represents.
Such as also make comparisons with the gesture prestored through continuous print graphical analysis, show that gesture that user uses is for choosing (expression is chosen), now check that the graphics field that gesture covers is: 45 decibels (volume value after adjustment), now represents: user selects the volume of intelligent earphone to adjust to 45 decibels.
Step S493: send volume control command according to result of calculation to above-mentioned intelligent earphone, for above-mentioned intelligent earphone, volume adjusting is carried out to current play content.
Here volume control command comprises the volume value 45 decibels chosen according to above-mentioned steps.
Obtain differential image information here, described differential image information and the control command information stored are contrasted, so that reduce operation strength.
The particularly image at screen place.External image and background image, with the direct image as a setting of current shown image information, contrast by microprocessor system 3.
Step S494: when intelligent earphone receives the volume control command that Cloud Server sends, carry out volume adjusting according to the current play content of volume control command to intelligent earphone.
In addition, because the use habit of each intelligent earphone user is different, therefore, in order to meet the demand of different user better, in the present embodiment, can also create respectively for each intelligent earphone user and store a user-specific list further, record the volume setting information (the ambient sound type corresponding to the volume setting information that physical record sends at every turn and the volume after arranging) that this user in use sent in the list.Thus one, when Cloud Server adjusts volume for this intelligent earphone user again, not only can the volume adjusting list shown in question blank 1, also can inquire about the user-specific list corresponding to this user further, the volume after adjusting comprehensively is determined, to meet the demand of this user better according to the combination of the two.In addition, in above-mentioned user-specific list, can also store the use preference information of respective user further, this use preference information reflects this user optimum volume as a rule.
As can be seen here, above-mentioned volume adjusting list and user-specific list can be upgraded by the mode of machine learning, automatically more to meet user's request.
Embodiment two,
Embodiment two is with the main distinction of embodiment one: except sending ambient sound, and intelligent earphone can also send positional information to Cloud Server further, so that Cloud Server arranges volume adjusting instruction further combined with positional information.Because residing environment can affect volume, such as, be all quiet environment, the sound of intelligent earphone can be larger at home, and to reach reasonable audibility, but in office, in order to not affect the people of surrounding, what volume can be controlled is lower.
As shown in Figure 5, this second embodiment comprises the following steps:
Step S510: intelligent earphone gathers the ambient sound in surrounding environment, and the ambient sound collected is sent to Cloud Server; Further, intelligent earphone obtains positional information further, and this positional information is sent to Cloud Server.
Wherein, the implementation that the triggering mode of step S510 and intelligent earphone gather ambient sound is all identical with the step S420 in embodiment one, repeats no more herein.Introduce the implementation that intelligent earphone obtains positional information below: such as, the current location of intelligent earphone can be obtained by positioners such as GPS that intelligent earphone is installed.Wherein, the operation that intelligent earphone obtains positional information can take the synchronous mode triggered with the operation that intelligent earphone gathers ambient sound, as long as i.e.: intelligent earphone collection send ambient sound, just obtains simultaneously and sends positional information.Or, also can trigger separately additionally by modes such as button triggering or speech trigger the operation that intelligent earphone obtains positional information.
Step S520: the ambient sound that cloud server intelligent earphone gathers, and the content of analysis environments sound and/or volume; Further, the positional information that intelligent earphone sends is obtained further, and the type of analysis position information.
Wherein, cloud server the content of analysis environments sound and/or volume, and the implementation of classifying to ambient sound is identical with the step S430 in embodiment one, repeats no more herein.Introduce Cloud Server below and obtain the positional information the implementation of the type of analysis position information that intelligent earphone sends: Cloud Server can carry out classifying and dividing to all kinds of positional informations that may receive in advance, when dividing, different dividing mode can be taked as required.Such as, can divide according to the purposes of position, specifically comprise: office-type and types of entertainment etc.Or, also can divide according to the environment of position, specifically comprise: quiet type and noisy type etc.Particularly, after the positional information that cloud server sends to intelligent earphone, determine the accurate orientation of this positional information on GPS map, and determine the concrete title of this position further, if this position is office building or Office Area, then can determine that the type of this positional information is office-type or quiet type; If this position is park or KTV, then can determine that the type of this positional information is types of entertainment, wherein, KTV can also be confirmed as noisy type.
Step S530: Cloud Server calculates in conjunction with the type of above-mentioned positional information the intelligent earphone volume matched with the content of above-mentioned ambient sound and/or volume, and send volume adjusting instruction according to result of calculation to intelligent earphone.
Particularly, this step can adopt the mode similar with the mode of the step S440 in embodiment one to realize.Such as, the typical problem and the volume range (set-up mode is see embodiment one) that pre-set intelligent earphone is needed equally; Afterwards, in volume range, the volume adjusting list preset is utilized to regulate typical problem, to obtain the intelligent earphone volume matched with the content of ambient sound and/or volume.
In above-mentioned volume adjusting list, except storing as shown in table 1, corresponding with ambient sound first kind Dynamic gene, also store as shown in table 2, corresponding with positional information Equations of The Second Kind Dynamic gene further:
Table 2
Positional information type Equations of The Second Kind Dynamic gene
The ambient sound of office-type 0.8
The ambient sound of types of entertainment 1.5
Ambient sound on road 1.1
The ambient sound in park 1.0
The ambient sound of market type 1.0
When being provided with first kind Dynamic gene and Equations of The Second Kind Dynamic gene in volume adjusting list simultaneously, Cloud Server both separately according to first kind Dynamic gene or adjust intelligent earphone volume according to Equations of The Second Kind Dynamic gene separately, also can adjust intelligent earphone volume with reference to first kind Dynamic gene and Equations of The Second Kind Dynamic gene simultaneously.Such as, suppose that the Cloud Server first kind Dynamic gene that environmentally sound is determined is 0.6, be 0.8 according to the Equations of The Second Kind Dynamic gene that positional information is determined, then can adjust by getting the various ways such as maximum, minimum value or mean value in two numerical value.In a word, combining position information, can infer the current residing environment of user better, thus determine the volume being more suitable for user.
Step S540: intelligent earphone receives the volume adjusting instruction that Cloud Server is determined according to the content of above-mentioned ambient sound and/or volume, and carries out volume adjusting according to the instruction of this volume adjusting to the current play content of intelligent earphone.
By above-mentioned step S510 to step S540, the object automatically regulating intelligent earphone volume just can be realized.Alternatively, similar with embodiment one, in order to the use habit making above-mentioned volume adjusting method more meet user, the method in embodiment two also may further include following step S550 and step S560.
Step S550: intelligent earphone sends volume setting information to Cloud Server, so that Cloud Server is according to the volume adjusting instruction sent before above-mentioned volume setting information amendment.
The implementation of this step is all identical with the step S460 in embodiment one with enforcement object, repeats no more herein.
Step S560: the volume setting information that cloud server intelligent earphone user sends, according to the volume adjusting instruction sent before the amendment of this volume setting information; Further, according to this volume setting information, the first kind Dynamic gene stored in volume adjusting list and/or Equations of The Second Kind Dynamic gene are revised.
Step S470 in the implementation of this step and embodiment one is similar, and difference is, in embodiment two, can be revised by modes such as machine learning to the first kind Dynamic gene stored in volume adjusting list and Equations of The Second Kind Dynamic gene simultaneously.
In addition, because the use habit of each intelligent earphone user is different, therefore, in order to meet the demand of different user better, in embodiment two, also can create respectively for each intelligent earphone user and store a user-specific list further, record volume setting information that this user in use sent (the ambient sound type corresponding to the volume setting information that physical record sends at every turn and/or positional information type and the volume after arranging) in the list.Thus one, when Cloud Server adjusts volume for this intelligent earphone user again, not only can the volume adjusting list shown in question blank 1, also can inquire about the user-specific list corresponding to this user further, the volume after adjusting comprehensively is determined, to meet the demand of this user better according to the combination of the two.In addition, in above-mentioned user-specific list, can also store the use preference information of respective user further, this use preference information reflects this user optimum volume as a rule.
In sum, provided by the invention based in the volume adjusting method of intelligent earphone, Cloud Server environmentally sound and/or positional information can control intelligent earphone adjustment volume, thus achieves the automatic regulation function of intelligent earphone volume.By said method, the user that can be not easy to operative intelligence earphone for some both hands provides convenient, can also play protection hearing and ensure the effect of audibility.
In addition, provided by the invention based in the volume adjusting method of intelligent earphone, can also environmentally sound and/or positional information push music to intelligent earphone user further.Therefore, in the above embodiments one and embodiment two, following steps can also be performed further in the running of intelligent earphone:
Cloud Server, according to the ambient sound received and/or positional information, pushes music to intelligent earphone user further.
Such as, when pushing music according to positional information, propelling movement list can be prestored on Cloud Server, in this propelling movement list, storing the music corresponding to positional information of every type.Under normal circumstances, the music corresponding with the positional information of quiet type is generally some soft light musics of releiving, the music corresponding with the positional information of noisy type is generally some rock musics full of moving sense, to adapt to the current environment facies be in of intelligent earphone user.Particularly, in propelling movement list, music corresponding to every type can be obtained by the mode of carrying out user investigation in advance, also can obtain according to the experience of keeper, and, in the running of Cloud Server, constantly can receive the feedback of each intelligent earphone user, Cloud Server can also carry out machine learning according to the user feedback situation received, and improves this propelling movement list, thus meet consumers' demand better to constantly update.When environmentally sound pushes music, can the feature of combining environmental sound push, such as, if Cloud Server is by the analysis to voice content, judge the voice comprising child in this ambient sound, then can infer there is child around intelligent earphone user, therefore, propelling movement music can be adjusted to nursery rhymes.In addition, Cloud Server also can consider the music pushing list and ambient sound and determine to push.
Wherein, the music that Cloud Server pushes can send intelligent earphone to by various ways.In the first form, Cloud Server directly can send music itself to intelligent earphone, intelligent earphone directly by wireless network from cloud server to music, and the music received to be play in real time.In the second form, Cloud Server can send music identification corresponding for music to intelligent earphone, search this music by intelligent earphone voluntarily according to this music identification and play, such as, this music identification can be the URL address corresponding on the webserver of this music, and intelligent earphone is accessed this URL address and listened to corresponding music online and maybe this music is cached to this locality and listens to.
In the process of above-mentioned propelling movement music, if intelligent earphone user is unsatisfied with the music that Cloud Server pushes, also can feed back to Cloud Server.During concrete feedback, the speech play instruction that intelligent earphone acquisition user sends also sends to Cloud Server; Cloud Server carries out association search according to the instruction action comprised in this speech play instruction and/or instruction prescribed information, returns operation information according to Search Results to intelligent earphone, makes intelligent earphone perform corresponding operation according to this operation information.
Wherein, this speech play instruction gathers after can carrying out noise reduction process by the voice acquisition module be arranged on intelligent earphone.The instruction action comprised in speech play instruction comprises: play, suspend, change a first or stopping; Instruction prescribed information comprises: musical designation or music categories etc.Such as, the speech play instruction that user sends can be such as " playing a first English song ", and wherein, " broadcasting " is instruction action, and " one ", " English ", " song " are instruction prescribed information; Or the speech play instruction that user sends also only can comprise instruction action, as " changing a head ".After cloud server to above-mentioned speech play instruction, first call semantic module and speech play instruction is split as some keywords, and these keywords are divided into instruction action keyword (as " broadcasting ") and prescribed information keyword (as " English ", " song ").Then, Cloud Server is according to the prescribed information keyword obtained, association search is carried out in searching resource server, and receive the relevant search result that searching resource server returns, such as, the Search Results obtained according to " English ", " song " these two keywords comprises " prettyboy ".Meanwhile, instruction action keyword " broadcasting " mates by Cloud Server in the command library preset, to obtain the program command " broadcasting " after mating.Wherein, in the command library preset, store the various order that may receive, as " broadcasting ", " time-out ", " changing a head ", " stopping " etc.The coupling that Cloud Server carries out is fuzzy matching, and therefore, instruction action keyword " is put ", " listening " etc. can Auto-matching be all also " broadcasting ", and instruction action keyword " stops ", "Off" etc. can Auto-matching be all also " stopping ".Cloud Server is according to mentioned above searching results " pretty boy " and program command " broadcasting ", return corresponding operation information to intelligent earphone " to open music player and play pretty boy ", the broadcast address of song " pretty boy " is issued to intelligent earphone simultaneously.After intelligent earphone receives this operation information, open local music player, access the broadcast address of " pretty boy " thus this song is play.If user does not want to listen " pretty boy " this song, user again can also input speech play instruction and " change a head ".Again call semantic module after cloud server to this instruction and obtain instruction action keyword " change first ", owing to not comprising prescribed information keyword in this speech play instruction, therefore, Cloud Server can carry out association search in conjunction with the prescribed information keyword in last speech play instruction, obtain an other first English song, and return corresponding operation information to intelligent earphone and " play next ", the broadcast address of next song is issued to intelligent earphone simultaneously.After intelligent earphone receives this operation information, stop the current song play, access the broadcast address of next song and this song is play.If user does not want to continue to listen to song, speech play instruction " stopping " can being inputted, after cloud server to this instruction, return operation information " stopping music player " according to instruction action keyword " stopping " wherein to intelligent earphone, thus control intelligent earphone stopping broadcasting music.In above process, Cloud Server can also set priority to the order in command library as required respectively, such as, the priority that the priority that " stopping " ordering is ordered higher than " changing a head ", " the change one first " priority of ordering higher than the priority etc. of the Play command, like this, when after the order that cloud server is higher to priority, order that then can be low by the priority performed stops, and performs the high order of this priority.
In addition, in order to make propelling movement list more meet user's request, Cloud Server, after the feedback receiving user, can also upgrade propelling movement list further by modes such as machine learning.Particularly, if Cloud Server is according to the positional information of user and combine and push list for after user pushed a song, have received again the speech play instruction of changing a head that user sends, the song not too satisfaction of user to Cloud Server propelling movement last time can be inferred thus, therefore, the prescribed information " English " of changing in the speech play instruction of a head that Cloud Server can send according to user infers that user is more prone to listen to English song when being in relevant position, therefore, can in propelling movement list, some English songs are increased in the corresponding music of positional information of the current residing type of intelligent earphone user, concrete song title can be determined according to the feedback of user further.And, in order to the demand of every user can be catered to better, in propelling movement list, can also further for every intelligent earphone user creates the propelling movement sublist of this user-specific respectively, so that the speech play instruction of feeding back when listening to music according to this user in this propelling movement sublist upgrades at every turn, thus propelling movement result is made more to meet the demand of every user.
Provided by the invention based in the volume adjusting method of intelligent earphone, due to music can be pushed to intelligent earphone user further, therefore, user only needs the music pushed with regard to energy uppick by intelligent earphone, makes intelligent earphone without the need to depending on other electronic equipments; And need only need send phonetic order when changing music, without the need to user's manual operation intelligent earphone or other electronic equipments, thus for user provides convenience, be particularly useful for some and the crowd that unskilled the elderly and both hands are often in busy condition (such as driving) is operated to electronic equipment.
The embodiment of the present invention additionally provides a kind of intelligent earphone 60, as shown in Figure 6, comprising: acquisition module 61, receiver module 62 and adjustment module 63.Wherein, the described ambient sound collected, for gathering the ambient sound in surrounding environment, is sent to Cloud Server by acquisition module 61.The volume adjusting instruction that receiver module 62 is determined according to the content of described ambient sound and/or volume for receiving Cloud Server.Adjustment module 63 is for carrying out volume adjusting according to described volume adjusting instruction to the current play content of described intelligent earphone.
Alternatively, in order to make the adjustment result of Cloud Server more meet user's request, this intelligent earphone comprises further: acquisition module 64, for obtaining positional information, and this positional information is sent to Cloud Server; Then further combined with the type of described positional information, Cloud Server determines that described volume adjusting indicates.
Alternatively, feed back to Cloud Server to enable intelligent earphone user, this intelligent earphone comprises further: arrange module, is suitable for sending volume setting information to described Cloud Server, so that described Cloud Server revises the instruction of described volume adjusting according to described volume setting information.
Alternatively, in order to improve the fail safe of intelligent earphone, this intelligent earphone comprises further: comparing module 65, be suitable for the biological information obtaining active user's input, the biological information of described biological information with the registered user prestored is compared, determines whether to allow intelligent earphone described in current user operation according to comparison result.
Specific works principle about the modules in intelligent earphone can refer to the description of corresponding steps in embodiment of the method, and the present invention does not repeat this.
The embodiment of the present invention additionally provides a kind of Cloud Server 70, as shown in Figure 7, comprising: receiver module 71, computing module 72 and sending module 73.Wherein, the ambient sound that receiver module 71 gathers for receiving described intelligent earphone, and analyze content and/or the volume of described ambient sound.Computing module 72 is for calculating the intelligent earphone volume matched with the content of described ambient sound and/or volume.Sending module 73, for sending volume adjusting instruction according to result of calculation to described intelligent earphone, carries out volume adjusting for described intelligent earphone to current play content.
Alternatively, above-mentioned computing module 72 comprises further: arrange submodule, is suitable for the typical problem and the volume range that pre-set intelligent earphone; Determine submodule, the first kind Dynamic gene corresponding with the content of described ambient sound and/or volume is determined in the volume adjusting list be suitable for according to presetting, wherein, the first kind Dynamic gene corresponding with the ambient sound of various content and/or various volume is stored in described volume adjusting list; Regulate submodule, be suitable in described volume range, utilize described first kind Dynamic gene to regulate described typical problem, obtain the intelligent earphone volume matched with the content of described ambient sound and/or volume.
Alternatively, in order to make the adjustment result of Cloud Server more meet user's request, this Cloud Server comprises further: acquisition module 74, is suitable for the positional information obtaining intelligent earphone transmission, and analyzes the type of described positional information; Then store the Equations of The Second Kind Dynamic gene corresponding with various types of positional information further in described volume adjusting list; And described adjustment submodule is in described volume range, further combined with described Equations of The Second Kind Dynamic gene, described typical problem is regulated, to obtain the intelligent earphone volume matched with the content of described ambient sound and/or volume.
Alternatively, this Cloud Server comprises further: correcting module 75, is suitable for the volume setting information receiving described intelligent earphone user transmission, revises the instruction of described volume adjusting according to described volume setting information; Further, according to described volume setting information, the first kind Dynamic gene stored in described volume adjusting list and/or Equations of The Second Kind Dynamic gene are revised.
Specific works principle about the modules in Cloud Server can refer to the description of corresponding steps in embodiment of the method, and the present invention does not repeat this.
The embodiment of the present invention additionally provides a kind of sound volume regulating system, as shown in Figure 8, comprising: above-mentioned intelligent earphone 60 and Cloud Server 70.
In intelligent earphone provided by the invention, Cloud Server and volume adjusting method and system, intelligent earphone can gather the ambient sound in surrounding environment on one's own initiative, the ambient sound collected is sent to Cloud Server, and receive the Cloud Server environmentally content of sound and/or volume and the volume adjusting instruction determined, thus volume adjusting is carried out to current play content.As can be seen here, intelligent earphone in the present invention can according to the volume adjusting instruction automatic regulating volume of Cloud Server, without the need to user's manual adjustments, thus for user provides convenience, be particularly useful for the occupied user of both hands (as driven or embracing the user of child), and then ensure the result of use of user and the health of user's ears.
Intrinsic not relevant to any certain computer, virtual system or miscellaneous equipment with display at this algorithm provided.Various general-purpose system also can with use based on together with this teaching.According to description above, the structure constructed required by this type systematic is apparent.In addition, the present invention is not also for any certain programmed language.It should be understood that and various programming language can be utilized to realize content of the present invention described here, and the description done language-specific is above to disclose preferred forms of the present invention.
In specification provided herein, describe a large amount of detail.But can understand, embodiments of the invention can be put into practice when not having these details.In some instances, be not shown specifically known method, structure and technology, so that not fuzzy understanding of this description.
Similarly, be to be understood that, in order to simplify the disclosure and to help to understand in each inventive aspect one or more, in the description above to exemplary embodiment of the present invention, each feature of the present invention is grouped together in single embodiment, figure or the description to it sometimes.But, the method for the disclosure should be construed to the following intention of reflection: namely the present invention for required protection requires feature more more than the feature clearly recorded in each claim.Or rather, as claims below reflect, all features of disclosed single embodiment before inventive aspect is to be less than.Therefore, the claims following embodiment are incorporated to this embodiment thus clearly, and wherein each claim itself is as independent embodiment of the present invention.
Those skilled in the art are appreciated that and adaptively can change the module in the equipment in embodiment and they are arranged in one or more equipment different from this embodiment.Module in embodiment or unit or assembly can be combined into a module or unit or assembly, and multiple submodule or subelement or sub-component can be put them in addition.Except at least some in such feature and/or process or unit be mutually repel except, any combination can be adopted to combine all processes of all features disclosed in this specification (comprising adjoint claim, summary and accompanying drawing) and so disclosed any method or equipment or unit.Unless expressly stated otherwise, each feature disclosed in this specification (comprising adjoint claim, summary and accompanying drawing) can by providing identical, alternative features that is equivalent or similar object replaces.
In addition, those skilled in the art can understand, although embodiments more described herein to comprise in other embodiment some included feature instead of further feature, the combination of the feature of different embodiment means and to be within scope of the present invention and to form different embodiments.Such as, in the following claims, the one of any of embodiment required for protection can use with arbitrary compound mode.
All parts embodiment of the present invention with hardware implementing, or can realize with the software module run on one or more processor, or realizes with their combination.It will be understood by those of skill in the art that the some or all functions that microprocessor or digital signal processor (DSP) can be used in practice to realize according to the some or all parts in the device of the embodiment of the present invention.The present invention can also be embodied as part or all equipment for performing method as described herein or device program (such as, computer program and computer program).Realizing program of the present invention and can store on a computer-readable medium like this, or the form of one or more signal can be had.Such signal can be downloaded from internet website and obtain, or provides on carrier signal, or provides with any other form.
The present invention will be described instead of limit the invention to it should be noted above-described embodiment, and those skilled in the art can design alternative embodiment when not departing from the scope of claims.In the claims, any reference symbol between bracket should be configured to limitations on claims.Word " comprises " not to be got rid of existence and does not arrange element in the claims or step.Word "a" or "an" before being positioned at element is not got rid of and be there is multiple such element.The present invention can by means of including the hardware of some different elements and realizing by means of the computer of suitably programming.In the unit claim listing some devices, several in these devices can be carry out imbody by same hardware branch.Word first, second and third-class use do not represent any order, can be title by these word explanations.

Claims (10)

1. regulated an intelligent earphone system for volume by gesture, it is characterized in that, comprising: intelligent earphone and Cloud Server; Described intelligent earphone is connected by network with described Cloud Server;
Described intelligent earphone comprises: projection module, audio collection module, data sending/receiving module, Computer image genration module, image capture module and volume adjusting module;
Described audio collection module for gathering the ambient sound around intelligent earphone, and sends to described Cloud Server;
The volume value of ambient sound that described Computer image genration module will collect, and the volume value after adjustment generates volume and controls picture, and the volume of generation is controlled picture projected by described projection module;
Described image capture module is used for the projection information of intelligent earphone described in continuous acquisition, and sends to described Cloud Server;
Described Cloud Server comprises: volume computing module, image processing module, control module and signal sending/receiving module;
Described volume computing module receives the volume value of the ambient sound that described intelligent earphone gathers, and carries out the volume value calculated after adjustment according to the volume value of the ambient sound gathered, and the volume value after adjustment is returned to described intelligent earphone;
Described image processing module is used for analyzing the projected image that described intelligent earphone gathers, from described projected image, determine described gesture; Described control module generates volume control command according to described gesture and sends to described intelligent earphone;
The volume control command that the volume adjusting module of described intelligent earphone sends according to described Cloud Server adjusts described intelligent earphone volume;
The data sending/receiving module of described intelligent earphone carries out data communication by the signal sending/receiving of network and described Cloud Server.
2. the intelligent earphone system being regulated volume by gesture according to claim 1, it is characterized in that, described Cloud Server also comprises memory module, described memory module for store from described intelligent earphone continuous acquisition to projected image, the first projected image and the gesture that prestores; Described first projected image is that the volume of described intelligent earphone Computer image genration CMOS macro cell controls picture;
The projected image collected and described first projected image are compared by the image processing module of described Cloud Server, obtain gesture path; Described gesture path and the gesture prestored contrast by described control module, obtain volume control command.
3. the intelligent earphone system being regulated volume by gesture according to claim 1 and 2, be is characterized in that, at least show a volume in the picture of described intelligent earphone Computer image genration CMOS macro cell;
The described gesture that described image processing module is determined is for choosing gesture; Described image processing module also comprises the region determining the described projected image that described gesture is positioned at;
Described control module according to described in choose gesture and described in choose volume corresponding to region that gesture is positioned at described projected image, send volume control command; Described volume control command comprises: described in the volume value chosen.
4. the intelligent earphone system being regulated volume by gesture according to claim 1-3, be is characterized in that,
The audio collection module of described intelligent earphone also comprises the content gathering ambient sound;
The content of the ambient sound that the content of the current ambient sound collected and a upper time period collect by the computing module of described Cloud Server contrasts, when finding that there is change, and the volume value after setting adjustment, and be sent to described intelligent earphone.
5. the intelligent earphone system being regulated volume by gesture according to claim 1-4, be is characterized in that,
Preferably, described intelligent earphone also comprises station acquisition function;
The positional information that a time period in the current positional information collected collects contrasts by the computing module of described Cloud Server, when finding that there is change, and the volume value after setting adjustment, and be sent to described intelligent earphone.
6. intelligent earphone regulates a method for volume by gesture, it is characterized in that, comprising:
S1, the environmental volume around intelligent earphone Real-time Collection, and the ambient sound value collected is sent to Cloud Server;
S2, described Cloud Server, according to the volume value after described ambient sound value setting adjustment, sends to intelligent earphone;
S3, described intelligent earphone by adjustment after volume value and described intelligent earphone current volume value generating pictures information and shown by projection arrangement; User is selected in described projected image by gesture;
S4, described intelligent earphone uses camera head continuous acquisition projected image, and the projected image of described continuous acquisition is sent to described Cloud Server; The projected image of described intelligent earphone collection comprises pictorial information and the projection of gesture in described pictorial information of the generation of described intelligent earphone;
S5, the projected image of described Cloud Server to described intelligent earphone continuous acquisition is analyzed, from described projected image, determine described gesture, and then generates volume control command;
S6, described intelligent earphone receives the volume control command that described Cloud Server sends, row relax of going forward side by side.
7. intelligent earphone according to claim 6 regulates the method for volume by gesture, and it is characterized in that, the projected image of described Cloud Server to described intelligent earphone continuous acquisition is analyzed and determined that the method for the gesture of described user is:
S1.1, after the information of intelligent earphone generating pictures described in described step S3, sends to described Cloud Server as the first projected image;
S1.2, by described intelligent earphone continuous acquisition to projected image and described first projected image compare, obtain the gesture path of user;
S1.3, is combined the gesture path of user with described projected image and analyzes, obtain the region that user's gesture path is positioned at described projected image;
S1.4, analyzes the content that described user's gesture path is positioned at described projected image area, generates volume control command.
8. intelligent earphone according to claim 6 regulates the method for volume by gesture, it is characterized in that, user to be selected described projected image by hand motion and the method adjusting volume is:
S2.1, at least comprises a volume in the described volume adjusting image that described intelligent earphone is shown by projection arrangement;
S2.2, user is in the viewing area of described volume adjusting image, and employing is chosen gesture and selected a volume;
S2.3, described Cloud Server user adopts the volume generation volume control command chosen gesture and select;
S2.4, described intelligent earphone adjusts the volume of described intelligent earphone according to described volume control command.
9. the intelligent earphone according to claim 7 or 8 regulates the method for volume by gesture, it is characterized in that, described information in described step S1 is the ambient sound around described intelligent earphone, described Cloud Server is analyzed the ambient sound around described intelligent earphone, and the method generating volume adjusting image is:
S3.1, the ambient sound around described intelligent earphone collection, and described ambient sound is sent to described cloud service;
S3.2, described Cloud Server determines described ambient sound type according to the content of described ambient sound and/or volume;
S3.3, when described Cloud Server detects that described ambient sound type changes, the Dynamic gene corresponding according to described ambient sound type calculates adjustment volume;
S3.4, described Cloud Server, according to described adjustment volume, generates volume adjusting image.
10. any one intelligent earphone according to claim 6-9 regulates the method for volume by gesture, it is characterized in that, described information in described step S1 is the positional information of described intelligent earphone, the positional information of described Cloud Server to described intelligent earphone is analyzed, and the method generating volume adjusting image is:
S3.1, described intelligent earphone collection position information, and described positional information is sent to described cloud service;
S3.2, described Cloud Server determines described location type according to described positional information;
S3.3, when described Cloud Server detects that described location type changes, the Dynamic gene corresponding according to described location type calculates adjustment volume;
S3.4, described Cloud Server, according to described adjustment volume, generates volume adjusting image.
CN201410746548.0A 2014-12-09 2014-12-09 Intelligent earphone system capable of regulating volume by gesture and regulation method Pending CN104506586A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410746548.0A CN104506586A (en) 2014-12-09 2014-12-09 Intelligent earphone system capable of regulating volume by gesture and regulation method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410746548.0A CN104506586A (en) 2014-12-09 2014-12-09 Intelligent earphone system capable of regulating volume by gesture and regulation method

Publications (1)

Publication Number Publication Date
CN104506586A true CN104506586A (en) 2015-04-08

Family

ID=52948301

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410746548.0A Pending CN104506586A (en) 2014-12-09 2014-12-09 Intelligent earphone system capable of regulating volume by gesture and regulation method

Country Status (1)

Country Link
CN (1) CN104506586A (en)

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104795080A (en) * 2015-04-09 2015-07-22 广东欧珀移动通信有限公司 Music playing control method and device
CN105472497A (en) * 2015-12-07 2016-04-06 京东方科技集团股份有限公司 Headset control device, headset, wearable equipment and headset control method
CN107049280A (en) * 2017-05-23 2017-08-18 宁波大学 A kind of intelligent wearable device of mobile Internet
CN107371094A (en) * 2017-08-24 2017-11-21 歌尔科技有限公司 Volume adjusting method and device, processing equipment
CN107454244A (en) * 2016-05-31 2017-12-08 宇龙计算机通信科技(深圳)有限公司 Method of speech processing, voice processing apparatus and equipment
WO2018058899A1 (en) * 2016-09-28 2018-04-05 珠海格力电器股份有限公司 Sound volume adjusting method and apparatus of intelligent terminal
CN108028995A (en) * 2015-08-24 2018-05-11 科利耳有限公司 Prosthesis function is controlled to be represented with data
CN108121526A (en) * 2016-11-29 2018-06-05 英业达科技有限公司 Volume adjusting apparatus and method for regulation of sound volume
CN109739464A (en) * 2018-12-20 2019-05-10 Oppo广东移动通信有限公司 Setting method, device, terminal and the storage medium of audio
CN110853662A (en) * 2018-08-02 2020-02-28 深圳市优必选科技有限公司 Voice interaction method and device and robot
CN112671967A (en) * 2020-12-22 2021-04-16 英华达(上海)科技有限公司 Bluetooth headset control method, system, device and medium
CN113891208A (en) * 2021-09-27 2022-01-04 深圳艾创力科技有限公司 Earphone sound control method, system, device and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101227759A (en) * 2007-01-15 2008-07-23 上海杰得微电子有限公司 Earphone device with automatic volume control function
CN101437124A (en) * 2008-12-17 2009-05-20 三星电子(中国)研发中心 Method for processing dynamic gesture identification signal facing (to)television set control
CN103905868A (en) * 2012-12-27 2014-07-02 三星电子株式会社 Display apparatus and method for controlling display apparatus thereof
CN104158506A (en) * 2014-07-29 2014-11-19 腾讯科技(深圳)有限公司 Method, device and terminal for adjusting volume
CN104182051A (en) * 2014-08-29 2014-12-03 百度在线网络技术(北京)有限公司 Headset intelligent device and interactive system with same

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101227759A (en) * 2007-01-15 2008-07-23 上海杰得微电子有限公司 Earphone device with automatic volume control function
CN101437124A (en) * 2008-12-17 2009-05-20 三星电子(中国)研发中心 Method for processing dynamic gesture identification signal facing (to)television set control
CN103905868A (en) * 2012-12-27 2014-07-02 三星电子株式会社 Display apparatus and method for controlling display apparatus thereof
CN104158506A (en) * 2014-07-29 2014-11-19 腾讯科技(深圳)有限公司 Method, device and terminal for adjusting volume
CN104182051A (en) * 2014-08-29 2014-12-03 百度在线网络技术(北京)有限公司 Headset intelligent device and interactive system with same

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104795080A (en) * 2015-04-09 2015-07-22 广东欧珀移动通信有限公司 Music playing control method and device
CN104795080B (en) * 2015-04-09 2018-01-16 广东欧珀移动通信有限公司 A kind of music control method and device
CN108028995B (en) * 2015-08-24 2021-03-09 科利耳有限公司 Apparatus, system and method for prosthesis functional control and data representation
CN108028995A (en) * 2015-08-24 2018-05-11 科利耳有限公司 Prosthesis function is controlled to be represented with data
US11917375B2 (en) 2015-08-24 2024-02-27 Cochlear Limited Prosthesis functionality control and data presentation
CN105472497A (en) * 2015-12-07 2016-04-06 京东方科技集团股份有限公司 Headset control device, headset, wearable equipment and headset control method
WO2017097058A1 (en) * 2015-12-07 2017-06-15 Boe Technology Group Co., Ltd. Apparatus for controlling earphone or media player in communication with the earphone, and controlling method thereof
CN109511045A (en) * 2015-12-07 2019-03-22 京东方科技集团股份有限公司 Earphone control device, earphone, wearable device and headset control method
CN107454244A (en) * 2016-05-31 2017-12-08 宇龙计算机通信科技(深圳)有限公司 Method of speech processing, voice processing apparatus and equipment
WO2018058899A1 (en) * 2016-09-28 2018-04-05 珠海格力电器股份有限公司 Sound volume adjusting method and apparatus of intelligent terminal
CN108121526A (en) * 2016-11-29 2018-06-05 英业达科技有限公司 Volume adjusting apparatus and method for regulation of sound volume
CN107049280A (en) * 2017-05-23 2017-08-18 宁波大学 A kind of intelligent wearable device of mobile Internet
CN107371094A (en) * 2017-08-24 2017-11-21 歌尔科技有限公司 Volume adjusting method and device, processing equipment
CN110853662A (en) * 2018-08-02 2020-02-28 深圳市优必选科技有限公司 Voice interaction method and device and robot
CN110853662B (en) * 2018-08-02 2022-06-24 深圳市优必选科技有限公司 Voice interaction method and device and robot
CN109739464A (en) * 2018-12-20 2019-05-10 Oppo广东移动通信有限公司 Setting method, device, terminal and the storage medium of audio
CN112671967A (en) * 2020-12-22 2021-04-16 英华达(上海)科技有限公司 Bluetooth headset control method, system, device and medium
CN113891208A (en) * 2021-09-27 2022-01-04 深圳艾创力科技有限公司 Earphone sound control method, system, device and storage medium

Similar Documents

Publication Publication Date Title
CN104506586A (en) Intelligent earphone system capable of regulating volume by gesture and regulation method
CN104394491A (en) Intelligent headset, cloud server, volume adjustment method and volume adjustment system
JP6811758B2 (en) Voice interaction methods, devices, devices and storage media
US11651676B2 (en) System and method of controlling external apparatus connected with device
US10958457B1 (en) Device control based on parsed meeting information
KR101726945B1 (en) Reducing the need for manual start/end-pointing and trigger phrases
DE112011103728B4 (en) Automatic profile change on a mobile computing device
KR20190111624A (en) Electronic device and method for providing voice recognition control thereof
JP6752870B2 (en) Methods and systems for controlling artificial intelligence devices using multiple wake words
US20140038489A1 (en) Interactive plush toy
CN109243444B (en) Voice interaction method, device and computer-readable storage medium
US20200213706A1 (en) Adaptive headphone system
JP2017009867A (en) Control apparatus, control method thereof, and program
KR20140092634A (en) Electronic apparatus and method of controlling the same
KR102343084B1 (en) Electronic device and method for executing function of electronic device
WO2021136962A1 (en) Hearing aid systems and methods
CN105812567A (en) Mobile terminal control method and device
JP6920398B2 (en) Continuous conversation function in artificial intelligence equipment
CN108648754B (en) Voice control method and device
CN106550132A (en) A kind of mobile terminal and its control method
CN110020423A (en) Audio stream is routed based on the results set semantically generated
KR102369309B1 (en) Electronic device for performing an operation for an user input after parital landing
WO2021051588A1 (en) Data processing method and apparatus, and apparatus used for data processing
KR20190061824A (en) Electric terminal and method for controlling the same
JP7222354B2 (en) Information processing device, information processing terminal, information processing method, and program

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20150408

RJ01 Rejection of invention patent application after publication