CN110096154A - For handling the method and device of information - Google Patents
For handling the method and device of information Download PDFInfo
- Publication number
- CN110096154A CN110096154A CN201910378951.5A CN201910378951A CN110096154A CN 110096154 A CN110096154 A CN 110096154A CN 201910378951 A CN201910378951 A CN 201910378951A CN 110096154 A CN110096154 A CN 110096154A
- Authority
- CN
- China
- Prior art keywords
- gesture operation
- information
- image
- operation image
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01H—MEASUREMENT OF MECHANICAL VIBRATIONS OR ULTRASONIC, SONIC OR INFRASONIC WAVES
- G01H17/00—Measuring mechanical vibrations or ultrasonic, sonic or infrasonic waves, not provided for in the preceding groups
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Embodiment of the disclosure discloses the method and device for handling information.One specific embodiment of this method includes: that environmental noise is greater than setting noise threshold in audio-frequency information to be processed in response to detecting, shows the first prompt information being used to indicate using gesture operation；The image of corresponding above-mentioned first prompt information is obtained, and obtains the target gesture operation image for being used to indicate respective operations instruction from above-mentioned image；It determines the corresponding operational order of above-mentioned target gesture operation image, and is instructed according to aforesaid operations and carry out information processing.This embodiment improves the accuracy of information exchange and validity.
Description
Technical field
Embodiment of the disclosure is related to technical field of data processing, and in particular to for handling the method and device of information.
Background technique
With the development of science and technology, intelligent robot can carry out information exchange by voice signal and user.Intelligence machine
People can be from getting operational order corresponding with voice signal, and executes operational order, to complete the number of corresponding voice messaging
According to processing, the convenience that user carries out data processing is improved.
Summary of the invention
Embodiment of the disclosure proposes the method and device for handling information.
In a first aspect, embodiment of the disclosure provides a kind of method for handling information, this method comprises: in response to
Detect that environmental noise is greater than setting noise threshold in audio-frequency information to be processed, shows first be used to indicate using gesture operation
Prompt information；The image of corresponding above-mentioned first prompt information is obtained, and is obtained from above-mentioned image and to be used to indicate respective operations and refer to
The target gesture operation image of order；It determines the corresponding operational order of above-mentioned target gesture operation image, and is referred to according to aforesaid operations
It enables and carries out information processing.
In some embodiments, the above method further include: in response to receiving audio-frequency information to be processed, it is above-mentioned to obtain correspondence
The directional information of audio-frequency information to be processed, above-mentioned directional information are used to characterize the side where the sound source of above-mentioned audio-frequency information to be processed
To.
In some embodiments, above-mentioned acquisition corresponds to the image of above-mentioned first prompt information, and obtains from above-mentioned image
It is used to indicate the target gesture operation image of respective operations instruction, comprising: obtain the video of corresponding above-mentioned first prompt information；It is logical
It crosses gesture operation diagram image set and closes the acquisition target gesture operation image from above-mentioned video, wherein above-mentioned gesture operation image collection
The gesture operation image for including is corresponding with operational order.
In some embodiments, target gesture operation figure is obtained from above-mentioned video above by gesture operation image collection
Picture, comprising: compare the picture frame that the gesture operation image in above-mentioned gesture operation image collection includes with video, from upper
State the target image frame for obtaining in video and including；Corresponding above-mentioned target image frame is matched from above-mentioned gesture operation image collection
Target gesture operation image.
In some embodiments, the above method further include: in response to detecting that environmental noise is not in audio-frequency information to be processed
Greater than above-mentioned setting noise threshold, the second prompt information being used to indicate using voice operating is shown.
Second aspect, embodiment of the disclosure provide a kind of for handling the device of information, which includes: first to mention
Show information display unit, environmental noise is greater than setting noise threshold in audio-frequency information to be processed in response to detecting, is configured to
Show the first prompt information being used to indicate using gesture operation；Image acquisition unit is configured to obtain corresponding above-mentioned first
The image of prompt information, and the target gesture operation image for being used to indicate respective operations instruction is obtained from above-mentioned image；Information
Processing unit, is configured to determine the corresponding operational order of above-mentioned target gesture operation image, and according to aforesaid operations instruct into
Row information processing.
In some embodiments, above-mentioned apparatus further include: directional information acquiring unit, in response to receiving audio to be processed
Information, is configured to obtain the directional information of corresponding above-mentioned audio-frequency information to be processed, above-mentioned directional information for characterize it is above-mentioned to
Handle the direction where the sound source of audio-frequency information.
In some embodiments, above-mentioned image acquisition unit includes: video acquisition subelement, is configured to obtain on corresponding
State the video of the first prompt information；Target gesture operation image obtains subelement, is configured to through gesture operation image collection
Target gesture operation image is obtained from above-mentioned video, wherein the gesture operation image that above-mentioned gesture operation image collection includes
It is corresponding with operational order.
In some embodiments, it includes: that target image frame obtains module that above-mentioned target gesture operation image, which obtains subelement,
It is configured to compare the picture frame that the gesture operation image in above-mentioned gesture operation image collection includes with video, from upper
State the target image frame for obtaining in video and including；Target gesture operation image collection module is configured to from above-mentioned gesture operation
The target gesture operation image of corresponding above-mentioned target image frame is matched in image collection.
In some embodiments, above-mentioned apparatus further include: the second prompt information display unit, it is to be processed in response to detecting
Environmental noise is not more than above-mentioned setting noise threshold in audio-frequency information, is configured to show the be used to indicate using voice operating
Two prompt informations.
The third aspect, embodiment of the disclosure provide a kind of electronic equipment, comprising: one or more processors；Storage
Device is stored thereon with one or more programs, when said one or multiple programs are executed by said one or multiple processors,
So that said one or multiple processors execute the method for handling information of above-mentioned first aspect.
Fourth aspect, embodiment of the disclosure provide a kind of computer-readable medium, are stored thereon with computer program,
It is characterized in that, the program realizes the method for handling information of above-mentioned first aspect when being executed by processor.
The method and device for being used to handle information that embodiment of the disclosure provides, first in the audio to be processed received
When environmental noise is greater than setting noise threshold in information, the first prompt information being used to indicate using gesture operation is shown；Then,
The image of corresponding above-mentioned first prompt information is obtained, and obtains the target hand for being used to indicate respective operations instruction from above-mentioned image
Gesture operates image；Finally, determining the corresponding operational order of above-mentioned target gesture operation image, and is instructed and carried out according to aforesaid operations
Information processing.Technical scheme can be obtained when environmental noise is greater than setting noise threshold by gesture operation image
Corresponding operational order improves the accuracy and validity of information exchange.
Detailed description of the invention
By reading a detailed description of non-restrictive embodiments in the light of the attached drawings below, the disclosure is other
Feature, objects and advantages will become more apparent upon:
Fig. 1 is that one embodiment of the disclosure can be applied to exemplary system architecture figure therein；
Fig. 2 is the flow chart according to one embodiment of the method for handling information of the disclosure；
Fig. 3 is the schematic diagram according to an application scenarios of the method for handling information of the disclosure；
Fig. 4 is the flow chart according to another embodiment of the method for handling information of the disclosure；
Fig. 5 is the structural schematic diagram according to one embodiment of the device for handling information of the disclosure；
Fig. 6 is adapted for the electronic devices structure schematic diagram for realizing embodiment of the disclosure.
Specific embodiment
The disclosure is described in further detail with reference to the accompanying drawings and examples.It is understood that this place is retouched
The specific embodiment stated is used only for explaining related invention, rather than the restriction to the invention.It also should be noted that in order to
Convenient for description, part relevant to related invention is illustrated only in attached drawing.
It should be noted that in the absence of conflict, the feature in embodiment and embodiment in the disclosure can phase
Mutually combination.The disclosure is described in detail below with reference to the accompanying drawings and in conjunction with the embodiments.
Fig. 1 is shown can the method for handling information using embodiment of the disclosure or the dress for handling information
The exemplary system architecture 100 set.
As shown in Figure 1, system architecture 100 may include terminal device 101, network 102 and server 103.Network 102 is used
To provide the medium of communication link between terminal device 101 and server 103.Network 102 may include various connection types,
Such as wired, wireless communication link or fiber optic cables etc..
Can be equipped on terminal device 101 microphone, camera, information display device, loudspeaker, touching display screen,
Speech recognition application, gesture identification application, information inquiry application etc..
Terminal device 101 can be hardware, be also possible to software.When terminal device 101 is hardware, can be with aobvious
Display screen and the various electronic equipments for supporting processing information, including but not limited to smart phone, tablet computer, portable meter on knee
Calculation machine, desktop computer, robot etc..When terminal device 101 is software, it may be mounted at above-mentioned cited electronics and set
In standby.Multiple softwares or software module (such as providing Distributed Services) may be implemented into it, also may be implemented into single
Software or software module, are not specifically limited herein.
Server 103 can be to provide the server of various services, for example, audio signal that terminal device 101 is sent or
Hand signal provides the server supported.Server can carry out the data such as the audio-frequency information to be processed received analyzing etc.
Reason, and processing result is fed back into terminal device.
It should be noted that for handling the method for information generally by terminal device provided by embodiment of the disclosure
101 execute, and correspondingly, the device for handling information is generally positioned in terminal device 101.
It should be noted that server can be hardware, it is also possible to software.When server is hardware, may be implemented
At the distributed server cluster that multiple servers form, individual server also may be implemented into.It, can when server is software
To be implemented as multiple softwares or software module (such as providing Distributed Services), single software or software also may be implemented into
Module is not specifically limited herein.
It should be understood that the number of terminal device, network and server in Fig. 1 is only schematical.According to realization need
It wants, can have any number of terminal device, network and server.
With continued reference to Fig. 2, the process of one embodiment of the method for handling information according to the disclosure is shown
200.This be used for handle information method the following steps are included:
Step 201, in response to detecting, environmental noise is greater than setting noise threshold in audio-frequency information to be processed, and displaying is used for
Indicate the first prompt information using gesture operation.
In the present embodiment, for handle the method for information executing subject (such as terminal device shown in FIG. 1 101 and/
Or server 103) audio-frequency information to be processed can be obtained by wired connection mode or radio connection.Wherein, wait locate
Reason audio-frequency information can be the voice messaging that user is sent by way of voice to executing subject, can also be from other devices
The audio-frequency information that (such as can be television set, broadcast, memory etc.) gets.It is pointed out that above-mentioned wireless connection side
Formula can include but is not limited to 3G/4G connection, WiFi connection, bluetooth connection, WiMAX connection, Zigbee connection, UWB (ultra
Wideband) connection and other currently known or exploitation in the future radio connections.
In the prior art, intelligent robot is easy in the information interactive process with user by various interference.Intelligent machine
The audio-frequency information that device people obtains has generally comprised various environmental noises, causes intelligent robot that can not be accurately obtained effective language
Message breath, and then carry out corresponding operation can not be executed, reduce the information exchange efficiency with user.
The executing subject of the application can detect first in audio-frequency information to be processed after receiving audio-frequency information to be processed
Environmental noise.When detecting that environmental noise is greater than the noise threshold of setting, it is believed that audio-frequency information to be processed at this time
Containing excessive environmental noise, accurately and effectively audio-frequency information can not be obtained.For example, being held when getting audio-frequency information to be processed
Row main body can detect voice signal from audio-frequency information to be processed in several ways, and will be in audio-frequency information to be processed
Non-speech audio is as environmental noise.Later, executing subject can detect environmental noise, when environmental noise is greater than setting
When noise threshold (such as can be 50 decibels), explanation can not obtain accurate voice messaging.At this point, executing subject can be shown
First prompt information.Wherein, the first prompt information can serve to indicate that using gesture operation.First prompt information can pass through
The mode of audio plays to user, can also be shown to user by modes such as text, images, specific depending on actual needs.
In some optional implementations of the present embodiment, the above method can also include: in response to receive to
Audio-frequency information is handled, the directional information of corresponding above-mentioned audio-frequency information to be processed is obtained.
In practice, user can send audio-frequency information to be processed to executing subject with multiple directions, as long as executing subject energy
Enough receive audio-frequency information to be processed, so that it may execute corresponding data processing.But if environment in audio-frequency information to be processed
Noise is greater than setting noise threshold, then needs to obtain gesture operation image to carry out data processing.At this point, executing subject needs obtain
The directional information of audio-frequency information to be processed is taken, to determine the direction where user (or the main body for issuing audio-frequency information to be processed).
Later, the available image to the direction of executing subject.Wherein, above-mentioned directional information can be used for characterizing above-mentioned sound to be processed
Direction where the sound source of frequency information.
Step 202, the image of corresponding above-mentioned first prompt information is obtained, and is obtained from above-mentioned image and is used to indicate correspondence
The gesture operation image of operational order.
After showing the first prompt information, executing subject can obtain image by modes such as cameras.It mentions due to first
Show information instruction user using gesture operation, therefore, the image that executing subject is got at this time may include being used to indicate correspondence
The target gesture operation image of operational order.Later, executing subject can obtain out target hand from image in several ways
Gesture operates image.
In some optional implementations of the present embodiment, above-mentioned acquisition corresponds to the image of above-mentioned first prompt information,
And the target gesture operation image for being used to indicate respective operations instruction is obtained from above-mentioned image, it may comprise steps of:
The first step obtains the video of corresponding above-mentioned first prompt information.
In order to guarantee to obtain sufficiently comprehensive information, executing subject can control camera etc. according to above-mentioned directional information
Device carries out video acquisition, to obtain the video of corresponding first prompt information.Exist at this point, containing gesture operation image in video
Interior, user whole action messages.
Second step obtains target gesture operation image by gesture operation image collection from above-mentioned video.
Executing subject can get gesture operation image collection in advance.Gesture operation image, which can be, to be pre-set
Gesture motion image.It, can be from view when executing subject identifies the image in video by gesture operation image collection
Corresponding target gesture operation image is obtained in frequency.Wherein, the gesture operation image that above-mentioned gesture operation image collection includes can
With corresponding with operational order.
In some optional implementations of the present embodiment, above by gesture operation image collection from above-mentioned video
Target gesture operation image is obtained, may comprise steps of:
The first step, by above-mentioned gesture operation image collection gesture operation image and the video picture frame that includes carry out pair
Than obtaining the target image frame for including from above-mentioned video.
Executing subject can be by the gesture operation image in gesture operation image collection, each frame figure for including to video
As comparing, so it is available include into video gesture operation target image frame.
Second step matches the target gesture operation of corresponding above-mentioned target image frame from above-mentioned gesture operation image collection
Image.
In practice, the gesture that user makes is usually distinct with the gesture of standard.For this purpose, obtaining target image frame
Afterwards, executing subject also needs to match the gesture operation image in target image frame and gesture operation image collection, matching
The target gesture operation image of target image frame is corresponded to out.
Step 203, it determines the corresponding operational order of above-mentioned target gesture operation image, and is instructed and carried out according to aforesaid operations
Information processing.
Seen from the above description, the gesture operation image that gesture operation image collection includes can be corresponding with operational order.
After finding target gesture operation image, executing subject can find the operational order of corresponding target gesture operation image, and root
Corresponding information processing is carried out according to the operational order.
With continued reference to the signal that Fig. 3, Fig. 3 are according to the application scenarios of the method for handling information of the present embodiment
Figure.In the application scenarios of Fig. 3, user can issue voice messaging to executing subject (such as can be terminal device 101):
" today is removed the flight of XX the latest in inquiry ".Executing subject gets audio-frequency information to be processed (comprising above-mentioned voice messaging and environment
Noise) after, detect that environmental noise is greater than setting noise threshold；Then, executing subject, which can issue the user with, (such as can be
The modes such as show by voice, screen) the first prompt information, inform that user uses gesture operation；Later, executing subject is from user
Target gesture operation image is got in the images of gestures of sending；Finally, executing subject inquires corresponding target gesture operation image
Operational order: " flight inquiring: [time=today；Departure place: local；Destination: XX；Shift: the very end of the train] ", and execute
The operational order, to carry out information processing, obtain result information may is that " today fly to XX last air flight times be 22:
30 ", and show result information.
Environmental noise is big first in the audio-frequency information to be processed received for the method provided by the above embodiment of the disclosure
When setting noise threshold, the first prompt information being used to indicate using gesture operation is shown；Then, corresponding above-mentioned first is obtained
The image of prompt information, and the target gesture operation image for being used to indicate respective operations instruction is obtained from above-mentioned image；Finally,
It determines the corresponding operational order of above-mentioned target gesture operation image, and is instructed according to aforesaid operations and carry out information processing.The application
Technical solution can obtain corresponding operational order by gesture operation image when environmental noise is greater than setting noise threshold,
Improve the accuracy and validity of processing information.
With further reference to Fig. 4, it illustrates the processes 400 of another embodiment of the method for handling information.The use
In the process 400 of the method for processing information, comprising the following steps:
Step 401, in response to detecting, environmental noise is greater than setting noise threshold in audio-frequency information to be processed, and displaying is used for
Indicate the first prompt information using gesture operation.
In the present embodiment, for handle the method for information executing subject (such as terminal device shown in FIG. 1 101 and/
Or server 103) audio-frequency information to be processed can be obtained by wired connection mode or radio connection.Step 401
Content is identical as the content of step 201, no longer repeats one by one herein.
Step 402, the image of corresponding above-mentioned first prompt information is obtained, and is obtained from above-mentioned image and is used to indicate correspondence
The gesture operation image of operational order.
The content of step 402 and the content of step 202 are identical, no longer repeat one by one herein.
Step 403, it determines the corresponding operational order of above-mentioned target gesture operation image, and is instructed and carried out according to aforesaid operations
Information processing.
The content of step 403 and the content of step 203 are identical, no longer repeat one by one herein.
Step 404, in response to detecting, environmental noise is not more than above-mentioned setting noise threshold, exhibition in audio-frequency information to be processed
Show the second prompt information being used to indicate using voice operating.
In general, for users, voice operating has convenience more better than gesture operation.When executing subject detect to
When handling that environmental noise is not more than above-mentioned setting noise threshold in audio-frequency information, illustrate that executing subject can be from receiving to from
Accurately and effectively information is obtained in reason audio-frequency information.At this point, executing subject can show the second prompt information, with inform user into
Row voice operating.Wherein, the second prompt information is used to indicate using voice operating.
With further reference to Fig. 5, as the realization to method shown in above-mentioned each figure, present disclose provides one kind for handling letter
One embodiment of the device of breath, the Installation practice is corresponding with embodiment of the method shown in Fig. 2, which can specifically answer
For in various electronic equipments.
As shown in figure 5, the device 500 for handling information of the present embodiment may include: that the first prompt information shows list
Member 501, image acquisition unit 502 and information process unit 503.Wherein, the first prompt information display unit 501, in response to inspection
It measures environmental noise in audio-frequency information to be processed and is greater than setting noise threshold, be configured to displaying and be used to indicate using gesture operation
The first prompt information；Image acquisition unit 502 is configured to obtain the image of corresponding above-mentioned first prompt information, and from above-mentioned
The target gesture operation image for being used to indicate respective operations instruction is obtained in image；Information process unit 503 is configured to determine
The corresponding operational order of above-mentioned target gesture operation image, and instructed according to aforesaid operations and carry out information processing.
In some optional implementations of the present embodiment, the above-mentioned device 500 for handling information can also include:
It is above-mentioned to be configured to obtain correspondence in response to receiving audio-frequency information to be processed for directional information acquiring unit (not shown)
The directional information of audio-frequency information to be processed, above-mentioned directional information are used to characterize the side where the sound source of above-mentioned audio-frequency information to be processed
To.
In some optional implementations of the present embodiment, above-mentioned image acquisition unit 502 may include: video acquisition
Subelement (not shown) and target gesture operation image obtain subelement (not shown).Wherein, video acquisition is single
Member is configured to obtain the video of corresponding above-mentioned first prompt information；Target gesture operation image obtains subelement and is configured to lead to
It crosses gesture operation diagram image set and closes the acquisition target gesture operation image from above-mentioned video, wherein above-mentioned gesture operation image collection
The gesture operation image for including is corresponding with operational order.
In some optional implementations of the present embodiment, above-mentioned target gesture operation image obtains subelement and includes:
Target image frame obtains module (not shown) and target gesture operation image collection module (not shown).Wherein, mesh
Logo image frame obtains module and is configured to the figure for including with video by the gesture operation image in above-mentioned gesture operation image collection
As frame compares, the target image frame for including is obtained from above-mentioned video；Target gesture operation image collection module is configured
At the target gesture operation image for matching corresponding above-mentioned target image frame from above-mentioned gesture operation image collection.
In some optional implementations of the present embodiment, the above-mentioned device 500 for handling information can also include:
Second prompt information display unit (not shown), in response to detecting that environmental noise is no more than upper in audio-frequency information to be processed
Setting noise threshold is stated, is configured to show the second prompt information being used to indicate using voice operating.
The present embodiment additionally provides a kind of electronic equipment, comprising: one or more processors；Memory is stored thereon with
One or more programs, when said one or multiple programs are executed by said one or multiple processors, so that said one
Or multiple processors execute the above-mentioned method for handling information.
The present embodiment additionally provides a kind of computer-readable medium, is stored thereon with computer program, and the program is processed
Device realizes the above-mentioned method for handling information when executing.
Below with reference to Fig. 6, it illustrates the electronic equipments for being suitable for being used to realize embodiment of the disclosure (for example, in Fig. 1
Server 103) computer system 600 structural schematic diagram.Electronic equipment shown in Fig. 6 is only an example, should not be right
The function and use scope of embodiment of the disclosure bring any restrictions.
As shown in fig. 6, electronic equipment 600 may include processing unit (such as central processing unit, graphics processor etc.)
601, random access can be loaded into according to the program being stored in read-only memory (ROM) 602 or from storage device 608
Program in memory (RAM) 603 and execute various movements appropriate and processing.In RAM 603, it is also stored with electronic equipment
Various programs and data needed for 600 operations.Processing unit 601, ROM 602 and RAM 603 pass through the phase each other of bus 604
Even.Input/output (I/O) interface 605 is also connected to bus 604.
In general, following device can connect to I/O interface 605: including such as touch screen, touch tablet, keyboard, mouse, taking the photograph
As the input unit 606 of head, microphone, accelerometer, gyroscope etc.；Including such as liquid crystal display (LCD), loudspeaker, vibration
The output device 607 of dynamic device etc.；Storage device 608 including such as tape, hard disk etc.；And communication device 609.Communication device
609, which can permit electronic equipment 600, is wirelessly or non-wirelessly communicated with other equipment to exchange data.Although Fig. 6 shows tool
There is the electronic equipment 600 of various devices, it should be understood that being not required for implementing or having all devices shown.It can be with
Alternatively implement or have more or fewer devices.Each box shown in Fig. 6 can represent a device, can also root
According to needing to represent multiple devices.
Particularly, in accordance with an embodiment of the present disclosure, it may be implemented as computer above with reference to the process of flow chart description
Software program.For example, embodiment of the disclosure includes a kind of computer program product comprising be carried on computer-readable medium
On computer program, which includes the program code for method shown in execution flow chart.In such reality
It applies in example, which can be downloaded and installed from network by communication device 609, or from storage device 608
It is mounted, or is mounted from ROM 602.When the computer program is executed by processing unit 601, the implementation of the disclosure is executed
The above-mentioned function of being limited in the method for example.
It is situated between it should be noted that the above-mentioned computer-readable medium of embodiment of the disclosure can be computer-readable signal
Matter or computer readable storage medium either the two any combination.Computer readable storage medium for example can be with
System, device or the device of --- but being not limited to --- electricity, magnetic, optical, electromagnetic, infrared ray or semiconductor, or it is any more than
Combination.The more specific example of computer readable storage medium can include but is not limited to: have one or more conducting wires
Electrical connection, portable computer diskette, hard disk, random access storage device (RAM), read-only memory (ROM), erasable type are programmable
Read-only memory (EPROM or flash memory), optical fiber, portable compact disc read-only memory (CD-ROM), light storage device, magnetic are deposited
Memory device or above-mentioned any appropriate combination.In embodiment of the disclosure, computer readable storage medium, which can be, appoints
What include or the tangible medium of storage program that the program can be commanded execution system, device or device use or and its
It is used in combination.And in embodiment of the disclosure, computer-readable signal media may include in a base band or as carrier wave
The data-signal that a part is propagated, wherein carrying computer-readable program code.The data-signal of this propagation can be adopted
With diversified forms, including but not limited to electromagnetic signal, optical signal or above-mentioned any appropriate combination.Computer-readable signal is situated between
Matter can also be any computer-readable medium other than computer readable storage medium, which can be with
It sends, propagate or transmits for by the use of instruction execution system, device or device or program in connection.Meter
The program code for including on calculation machine readable medium can transmit with any suitable medium, including but not limited to: electric wire, optical cable,
RF (radio frequency) etc. or above-mentioned any appropriate combination.
Above-mentioned computer-readable medium can be included in above-mentioned electronic equipment；It is also possible to individualism, and not
It is fitted into the electronic equipment.Above-mentioned computer-readable medium carries one or more program, when said one or more
When a program is executed by the electronic equipment, so that the electronic equipment: in response to detecting environmental noise in audio-frequency information to be processed
Greater than setting noise threshold, the first prompt information being used to indicate using gesture operation is shown；Obtain corresponding above-mentioned first prompt
The image of information, and the target gesture operation image for being used to indicate respective operations instruction is obtained from above-mentioned image；It determines above-mentioned
The corresponding operational order of target gesture operation image, and instructed according to aforesaid operations and carry out information processing.
The behaviour for executing embodiment of the disclosure can be write with one or more programming languages or combinations thereof
The computer program code of work, above procedure design language include object oriented program language-such as Java,
Smalltalk, C++ further include conventional procedural programming language-such as " C " language or similar program design language
Speech.Program code can be executed fully on the user computer, partly be executed on the user computer, as an independence
Software package execute, part on the user computer part execute on the remote computer or completely in remote computer or
It is executed on server.In situations involving remote computers, remote computer can pass through the network of any kind --- packet
It includes local area network (LAN) or wide area network (WAN)-is connected to subscriber computer, or, it may be connected to outer computer (such as benefit
It is connected with ISP by internet).
Flow chart and block diagram in attached drawing illustrate system, method and the computer of the various embodiments according to the disclosure
The architecture, function and operation in the cards of program product.In this regard, each box in flowchart or block diagram can be with
A part of a module, program segment or code is represented, a part of the module, program segment or code includes one or more
Executable instruction for implementing the specified logical function.It should also be noted that in some implementations as replacements, institute in box
The function of mark can also occur in a different order than that indicated in the drawings.For example, two boxes succeedingly indicated are practical
On can be basically executed in parallel, they can also be executed in the opposite order sometimes, and this depends on the function involved.Also it wants
It is noted that the combination of each box in block diagram and or flow chart and the box in block diagram and or flow chart, Ke Yiyong
The dedicated hardware based system of defined functions or operations is executed to realize, or can be referred to specialized hardware and computer
The combination of order is realized.
Being described in unit involved in embodiment of the disclosure can be realized by way of software, can also be passed through
The mode of hardware is realized.Described unit also can be set in the processor, for example, can be described as: a kind of processor
Including the first prompt information display unit, image acquisition unit and information process unit.Wherein, the title of these units is at certain
In the case of do not constitute restriction to the unit itself, for example, information process unit is also described as " passing through gesture operation
The unit of image progress information processing ".
Above description is only the preferred embodiment of the disclosure and the explanation to institute's application technology principle.Those skilled in the art
Member is it should be appreciated that invention scope involved in the disclosure, however it is not limited to technology made of the specific combination of above-mentioned technical characteristic
Scheme, while should also cover in the case where not departing from foregoing invention design, it is carried out by above-mentioned technical characteristic or its equivalent feature
Any combination and the other technical solutions formed.Such as features described above has similar function with (but being not limited to) disclosed in the disclosure
Can technical characteristic replaced mutually and the technical solution that is formed.
Claims (12)
1. a kind of method for handling information, comprising:
In response to detecting, environmental noise is greater than setting noise threshold in audio-frequency information to be processed, and displaying is used to indicate using gesture
First prompt information of operation；
The image of corresponding first prompt information is obtained, and obtains the mesh for being used to indicate respective operations instruction from described image
Mark gesture operation image；
It determines the corresponding operational order of the target gesture operation image, and information processing is carried out according to the operational order.
2. according to the method described in claim 1, wherein, the method also includes:
In response to receiving audio-frequency information to be processed, the directional information of the corresponding audio-frequency information to be processed, the direction are obtained
Information is used to characterize the direction where the sound source of the audio-frequency information to be processed.
3. according to the method described in claim 1, wherein, the image for obtaining corresponding first prompt information, and from institute
State the target gesture operation image for obtaining in image and being used to indicate respective operations instruction, comprising:
Obtain the video of corresponding first prompt information；
Target gesture operation image is obtained from the video by gesture operation image collection, wherein the gesture operation figure
It is corresponding with operational order that image set closes the gesture operation image for including.
4. described to obtain mesh from the video by gesture operation image collection according to the method described in claim 3, wherein
Mark gesture operation image, comprising:
The picture frame that gesture operation image in the gesture operation image collection includes with video is compared, from the view
The target image frame for including is obtained in frequency；
The target gesture operation image of the corresponding target image frame is matched from the gesture operation image collection.
5. the method according to claim 1, wherein the method also includes:
In response to detecting, environmental noise is not more than the setting noise threshold in audio-frequency information to be processed, and displaying, which is used to indicate, to be made
With the second prompt information of voice operating.
6. a kind of for handling the device of information, comprising:
First prompt information display unit, in response to detecting, environmental noise is greater than setting noise threshold in audio-frequency information to be processed
Value is configured to show the first prompt information being used to indicate using gesture operation；
Image acquisition unit, is configured to obtain the image of corresponding first prompt information, and obtains and use from described image
In the target gesture operation image of instruction respective operations instruction；
Information process unit is configured to determine the corresponding operational order of the target gesture operation image, and according to the behaviour
Make instruction and carries out information processing.
7. device according to claim 6, wherein described device further include:
Directional information acquiring unit is configured to obtain the corresponding sound to be processed in response to receiving audio-frequency information to be processed
The directional information of frequency information, the directional information are used to characterize the direction where the sound source of the audio-frequency information to be processed.
8. device according to claim 6, wherein described image acquiring unit includes:
Video acquisition subelement is configured to obtain the video of corresponding first prompt information；
Target gesture operation image obtains subelement, is configured to obtain mesh from the video by gesture operation image collection
Mark gesture operation image, wherein the gesture operation image that the gesture operation image collection includes is corresponding with operational order.
9. device according to claim 8, wherein the target gesture operation image obtains subelement and includes:
Target image frame obtains module, is configured to the gesture operation image and video bag in the gesture operation image collection
The picture frame contained compares, and the target image frame for including is obtained from the video；
Target gesture operation image collection module is configured to match the corresponding mesh from the gesture operation image collection
The target gesture operation image of logo image frame.
10. according to device described in claim 6 to 9 any one, wherein described device further include:
Second prompt information display unit, in response to detecting in audio-frequency information to be processed that environmental noise is made an uproar no more than the setting
Sound threshold value is configured to show the second prompt information being used to indicate using voice operating.
11. a kind of electronic equipment, comprising:
One or more processors；
Memory is stored thereon with one or more programs,
When one or more of programs are executed by one or more of processors, so that one or more of processors
Perform claim requires any method in 1 to 5.
12. a kind of computer-readable medium, is stored thereon with computer program, which is characterized in that the program is executed by processor
Method of the Shi Shixian as described in any in claim 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910378951.5A CN110096154A (en) | 2019-05-08 | 2019-05-08 | For handling the method and device of information |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910378951.5A CN110096154A (en) | 2019-05-08 | 2019-05-08 | For handling the method and device of information |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110096154A true CN110096154A (en) | 2019-08-06 |
Family
ID=67447351
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910378951.5A Pending CN110096154A (en) | 2019-05-08 | 2019-05-08 | For handling the method and device of information |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110096154A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113671846A (en) * | 2021-08-06 | 2021-11-19 | 深圳市欧瑞博科技股份有限公司 | Intelligent device control method and device, wearable device and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150331490A1 (en) * | 2013-02-13 | 2015-11-19 | Sony Corporation | Voice recognition device, voice recognition method, and program |
| CN105468145A (en) * | 2015-11-18 | 2016-04-06 | 北京航空航天大学 | Robot man-machine interaction method and device based on gesture and voice recognition |
| CN206179323U (en) * | 2016-09-30 | 2017-05-17 | 广州音书科技有限公司 | A intelligent glasses for speech recognition and sign language discernment |
| TW201804459A (en) * | 2016-07-29 | 2018-02-01 | 富邦綜合證券股份有限公司 | Method of switching input modes, mobile communication device and computer-readable medium allowing users to switch, in presence of large amount of ambient noises, from a voice input mode to a text input mode while operating a financial software |
| CN107799125A (en) * | 2017-11-09 | 2018-03-13 | 维沃移动通信有限公司 | A kind of audio recognition method, mobile terminal and computer-readable recording medium |
-
2019
- 2019-05-08 CN CN201910378951.5A patent/CN110096154A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150331490A1 (en) * | 2013-02-13 | 2015-11-19 | Sony Corporation | Voice recognition device, voice recognition method, and program |
| CN105468145A (en) * | 2015-11-18 | 2016-04-06 | 北京航空航天大学 | Robot man-machine interaction method and device based on gesture and voice recognition |
| TW201804459A (en) * | 2016-07-29 | 2018-02-01 | 富邦綜合證券股份有限公司 | Method of switching input modes, mobile communication device and computer-readable medium allowing users to switch, in presence of large amount of ambient noises, from a voice input mode to a text input mode while operating a financial software |
| CN206179323U (en) * | 2016-09-30 | 2017-05-17 | 广州音书科技有限公司 | A intelligent glasses for speech recognition and sign language discernment |
| CN107799125A (en) * | 2017-11-09 | 2018-03-13 | 维沃移动通信有限公司 | A kind of audio recognition method, mobile terminal and computer-readable recording medium |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113671846A (en) * | 2021-08-06 | 2021-11-19 | 深圳市欧瑞博科技股份有限公司 | Intelligent device control method and device, wearable device and storage medium |
| CN113671846B (en) * | 2021-08-06 | 2024-03-12 | 深圳市欧瑞博科技股份有限公司 | Intelligent device control method and device, wearable device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109993150B (en) | Method and device for identifying age | |
| CN110162670A (en) | Method and apparatus for generating expression packet | |
| KR20180096183A (en) | Method for controlling an intelligent system that performs multilingual processing | |
| CN107005739A (en) | External view for voice-based equipment is interacted | |
| CN108322855A (en) | Method and device for obtaining audio-frequency information | |
| CN104049745A (en) | Input control method and electronic device supporting the same | |
| CN110059623B (en) | Method and apparatus for generating information | |
| EP4117313A1 (en) | Audio processing method and apparatus, readable medium, and electronic device | |
| CN108536509B (en) | Application body-splitting method and mobile terminal | |
| CN108364648A (en) | Method and device for obtaining audio-frequency information | |
| EP2945156A1 (en) | Audio signal recognition method and electronic device supporting the same | |
| CN109918530A (en) | Method and apparatus for pushing image | |
| CN110110666A (en) | Object detection method and device | |
| CN110111241A (en) | Method and apparatus for generating dynamic image | |
| CN109241721A (en) | Method and apparatus for pushed information | |
| US9429447B2 (en) | Method of utilizing image based on location information of the image in electronic device and the electronic device thereof | |
| CN109669710B (en) | Note processing method and terminal | |
| CN109949793A (en) | Method and apparatus for output information | |
| CN110160548A (en) | For generating the mthods, systems and devices of travel route | |
| CN109829431A (en) | Method and apparatus for generating information | |
| CN110096154A (en) | For handling the method and device of information | |
| CN111400552A (en) | Note creating method and electronic equipment | |
| CN109995543A (en) | Method and apparatus for adding group members | |
| CN109819026A (en) | Method for transmitting information and device | |
| CN112231023A (en) | Information display method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |