CN101639696B - Control method based on audio-visual recognition and system thereof - Google Patents
Control method based on audio-visual recognition and system thereof Download PDFInfo
- Publication number
- CN101639696B CN101639696B CN200810144449XA CN200810144449A CN101639696B CN 101639696 B CN101639696 B CN 101639696B CN 200810144449X A CN200810144449X A CN 200810144449XA CN 200810144449 A CN200810144449 A CN 200810144449A CN 101639696 B CN101639696 B CN 101639696B
- Authority
- CN
- China
- Prior art keywords
- project
- instruction
- signal
- control device
- visual recognition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Controls And Circuits For Display Device (AREA)
Abstract
The invention is a control method based on audio-visual recognition and a system thereof; a display unit is used for displaying a plurality of different project signals for a user to send out an expected instruction based on one of the project signals, then a capturing device is used for capturing the expected instruction of the user and sending to a controller, sequentially, the controller is used for converting the expected instruction captured by the capturing device into a group of instruction binary codes, and the controller searches a database to obtain the project signals corresponding to the instruction binary codes, sends a control signal to an acting device, and the control signal corresponds to the project signals.
Description
Technical field
What the present invention relates to is a kind of control method and system thereof, particularly be a kind of many groups project is provided and makes things convenient for interpretation utilize control method and the system thereof of audio-visual recognition for the basis.
Background technology
The existing control system that is the basis with the identification image is to comprise an image capture unit and a control device.Described image capture unit is connected described control device; And the image of described image capture unit acquisition user's limb action; And described image is sent to described control device; So that carry out a signal Processing operation by described control device, and then it is expressed and expect that described control device is on behalf of the instruction of accomplishing through limb action to carry out the user.
Yet; Because when the user uses described existing system; Need a large amount of different limb actions of utilization to begin to give expression to different instruction; For example represent out the instruction of TV, the instruction representing to switch off the TV with 3 fingers, represent to increase the instruction of television sound volume, or represent instruction that reduces television sound volume etc. to hold fist tight in one's hands with 1 finger with 5 fingers.Described control device must carry out accurate image processing and interpretation to the various different images of described image capture unit acquisition; Thereby increase the complicacy in the described control device interpretation and elongate the interpretation time, and cause the image interpretation mistake easily and can't carry out the instruction that the user desires to assign; In addition, for physical disabilities or laid up bed person of a specified duration, also be difficult to accomplish diversified limb action, therefore described existing system not only can't provide good ease of use, the kind of also serious limit instruction.
Summary of the invention
Fundamental purpose of the present invention provides a kind of control method and system thereof that utilizes audio-visual recognition for the basis, and it is to be made up of one group of project dual code through the project signal that a project database stores, and makes the present invention have the diversified effect of lifting project.
Another object of the present invention provides a kind of control method and system thereof that utilizes audio-visual recognition for the basis; It is represent dual code through two kinds of different Display Modes the phase dystopy to show each described project signal, make the present invention have the diversified effect of lifting project.
Another object of the present invention provides a kind of control method and system thereof that utilizes audio-visual recognition for the basis, and it is through each described project signal of two kinds of the user different expression manual expressions, makes the present invention have the effect of ease of use.
A purpose more of the present invention provides a kind of control method and system thereof that utilizes audio-visual recognition for the basis; It is to convert sound that receives or limbs image information into one group of instruction dual code through a control module, makes the present invention have and shortens image interpretation time and the effect that promotes the image interpretation correctness.
A kind of control system and method thereof of utilizing audio-visual recognition for the basis of the present invention; Be to utilize a display unit to show several different project signals; Send an expectation instruction for the user according to one of which project signal, utilize a capture device to capture described user's expectation instruction again and be sent to a control device; Then; Utilize described control device that the expectation instruction transformation that described capture device captured is become one group of instruction dual code; And described control device is searched a database to obtain the corresponding project signal of described instruction dual code; And utilize described control device transmission one to control signal to a movement device, and described control signal is corresponding with described project signal.
Description of drawings
The audio-visual recognition that utilizes of Fig. 1 first embodiment of the invention is the control method on basis and the configuration diagram of system thereof;
Fig. 2 first embodiment of the invention utilize the action synoptic diagram of audio-visual recognition for the control method and the system thereof on basis;
Fig. 3 first embodiment of the invention utilize the method step block flow diagram of audio-visual recognition for the control method and the system thereof on basis;
The audio-visual recognition that utilizes of Fig. 4 second embodiment of the invention is the control method on basis and the configuration diagram of system thereof;
Fig. 5 second embodiment of the invention utilize the method step block flow diagram of audio-visual recognition for the control method and the system thereof on basis;
Fig. 6 third embodiment of the invention utilize the method step block flow diagram of audio-visual recognition for the control method and the system thereof on basis.
Description of reference numerals: 1-teaching device; The 11-project database; The 12-display unit; The 13-bulb; 131-first bulb; 132-second bulb; 133-the 3rd bulb; The 2-capture device; The 3-control device; The 31-instruction database; 31 '-database; The 4-movement device.
Embodiment
Below in conjunction with accompanying drawing, do more detailed explanation with other technical characterictic and advantage to the present invention is above-mentioned.
Please with reference to shown in Figure 1, it is to comprise a teaching device 1, a capture device 2, a control device 3 and a movement device 4 for the control system on basis that first embodiment of the invention is utilized audio-visual recognition.
The audio-visual recognition that utilizes of the present invention mainly must be left for the trouble of controlling various electrical equipment in order to exempt the user voluntarily for the control system on basis; As shown in Figure 1, for example: when the present invention uses in hospital or sanatorium etc., and described movement device 4 is when being a TV, and the user of health inconvenience keeps couching in the posture of sick bed, promptly can accomplish the switch TV or the action of channel selection.Utilizing the present invention to carry out in the process of the various household electrical appliances of Remote; The user only need observe described teaching device 1; According to the teaching of described teaching device 1, the expectation that selection one is desired to carry out is instructed, and expresses described expectation instruction through sounding or showing limb action; Then,, utilize described control device 3 to receive again and the described expectation instruction of interpretation, just can replace carrying out the user and control various electrical equipment by described control device 3 via the described user's of acquisition the expectation instruction automatically of described capture device 2.Therefore, for physical disabilities and patient, the present invention effectively promotes the convenience of life really.
Described teaching device 1 comprises a project database 11 and a display unit 12.Described project database 11 stores several different project signals, and each described project signal is being represented different instructions.Described display unit 12 demonstrates each described project signal; Wherein, The command content of each described project signal can show through described display unit 12; Also can write at a Hard copy and supply the user to read, so that after the user understands the command content of each described project signal, in each described project signal, choose one as assigning of instruction.
Moreover each described project signal is made up of one group of project dual code, and described display unit 12 utilizes the difference of luminosity, color, sound, literal or figure to produce two kinds of different Display Modes, to represent the position 1 and 0 in the dual code respectively.Described two different Display Modes are the bright of for example luminosity with strong and weak, the literal of dark and shallow or white and black, the sound of dark, color just with zero and etc. anti-, figure.Because described display unit 12 only needs two kinds of different Display Modes to represent the position 1 and 0 in the dual code respectively; So described display unit 12 different circuits configuration also capable of using design; The flicker that forms neon bulb for example or traffic lights is to show the Projects with Different signal; At this moment, described teaching device 1 need not comprise described project database 11.
Again, described display unit 12 is in the unit interval that one sets, and utilizes described two Display Modes of Alternation Display and changes the each time span that shows of described two Display Modes, so that express each described project signal in the described unit interval.So, the present invention can have diversified project signal, and can be in response to each described project signal of different environment for use requirements set.When for example environment for use was hospital or sanatorium etc., the project signal can be switch nurse call service bell, adjustment sick bed height and switch night-light etc.; And environment for use is when being general family, and the project signal can be adjusted to then that the various household electrical appliances of switch, television channel are selected, computer website switches, the washing machine water yield is set or micro-wave oven intensity setting etc.
Please refer again to shown in Figure 1ly, the display unit 12 of present embodiment is preferably by bulb and produces lamp is bright and lamp is dark two states as described two Display Modes.Described display unit 12 has several bulbs 13, and each bulb 13 is all in order to represent a project signal; In other words, if the quantity of the bulb 13 of described display unit 12 is chosen as three, then described display unit 12 is that described three bulbs 13 capable of using show three project signals.Again, each described bulb 13 is constantly to repeat to show each described project signal respectively, can observe and choose arbitrary project signal at any time for the user.
Below be to lift an embodiment: the described unit interval is set at 6 seconds (s) so that the running of described teaching device 1 to be described; Described several project signals are to comprise one first project signal, one second project signal and one the 3rd project signal; It is shown by one first bulb 131, one second bulb 132 and one the 3rd bulb 133 respectively; And its project dual code for example is 110110,011011 and 100100, and the command content of described project signal representative can be respectively out TV, switch off the TV and the 1st of TV programme; Again; When secretly keeping the position 1 and 0 of 1s through described display unit 12 each described project dual code of expression with bright 1s of keeping of lamp and lamp respectively, the display result of the then described first project signal, the second project signal and the 3rd project signal be in regular turn " bright 2s, dark 1s, bright 2s, dark 1s ", " dark 1s, bright 2s, dark 1s, bright 2s " and " bright 1s, secretly 2s, bright 1s, 2s secretly ".By the way, described display unit 12 promptly can show multiple Projects with Different signal easily, and then is available for users to assign through the present invention the instruction of each described project signal representative.In addition, selecting with bulb is size and the brightness of being convenient to change described bulb as described display unit 12, for example can select bigger or brighter bulb for use, and patient's each described project signal of identification clearly of old man or the long-term bed of vision degeneration is provided.
Please with reference to shown in Figure 2; Because each described project signal all constitutes with one group of project dual code; And also represent with described two kinds of different Display Modes through described display unit 12, so the user also only needs to represent described two kinds of different Display Modes respectively with two kinds of different sound or limb action.In other words; When the user selects a project signal in described several project signals after; Just represent a kind of Display Modes according to indication with a kind of sound or limb action, represent another kind of Display Modes, and described two kinds of different sound or limb action need the frequency according to described two kinds of Display Modes with another kind of sound or limb action; Utilize successional sound or limb action to show described project signal; Capture described sound or limbs image for described capture device 2, and successional sound that the user sends or limb action are to be called an expectation instruction, described capture device 2 promptly captures described expectation instruction; Only; User's the sound or the responsiveness of limb action are preferably the display speed of the described project signal that coexists mutually; And described sound or described limb action should repeat described project signal for several times; Be preferably and continue to that described expectation instruction is received by described control device 3 and interpretation finishes, be merely the segment of described expectation instruction with the expectation instruction that the person of avoiding the use of was sent.
For example: the definable user is with sounding or with limb action opening indication lamp bright (ascending the throne 1), not sounding or the limb action indication lamp dark (position 0) of remaining silent.So; (the project dual code is 110110 when the user chooses the first above-mentioned project signal; Instruction is for opening TV) and when desiring to express, follow described display unit 12 lasting with " sounding 2s, noiseless 1s, sounding 2s, noiseless 1s " or with " opening 2s, the 1s that remains silent, opening 2s, 1s remains silent " express the described first project signal.In addition, the sound that the user is used in expression is can select like sound such as ba, pa, ma, fa or da, its limb action then also can change over bow and come back, turn left head with turn right head or open one's hand and hold action such as hand tight in one's hands.In sum; Comparing at existing system needs to express the various instructions of desiring to assign with a large amount of limb actions; The present invention is that person easy to use only utilizes the action of two kinds of different simplifications can reach identical purpose; And can be according to its limb action position of health decision of user, to improve the convenience that uses.
Please refer again to shown in Figure 1ly, described capture device 2 is to interconnect with described control device 3, so that after acquisition user's the expectation instruction, can the expectation instruction that captured be sent to described control device 3.For monitoring at any time and the acquisition expectation that the user sent instruction, described capture device 2 is to be held open state, to avoid omitting any one expectation instruction of acquisition.Described capture device 2 can be selected from a CCD camera module, a CMOS camera module or a phonographic recorder.
Described control device 3 comprises an instruction database 31, and described instruction database 31 is that the project signal construction by described project database 11 forms.Described control device 3 is the expectation instructions that transmitted with the described capture device 2 of interpretation in order to receive, and is one group of corresponding instruction dual code with described expectation instruction transformation.As shown in Figure 2; Described control device 3 receives an expectation instruction; It is sound " sounding 2s, noiseless 1s, sounding 2s, noiseless 1s " or limbs image " opening 2s, the 1s that remains silent, opening 2s, 1s remains silent "; When described control device 3 definition sounding 1s or opening 1s are the positions 1 that converts the instruction dual code into, the noiseless 1s or the 1s that remains silent are the positions 0 o'clock that converts the instruction dual code into, and described expectation instruction is one group of instruction dual code 110110 after via described control device 3 conversions.
After the expectation instruction transformation that described control device 3 is captured described capture device 2 is one group of instruction dual code; Described control device 3 then is that described instruction dual code and the project dual code of forming the project signal in the described instruction database 31 are carried out a comparison operation, so that find out the project signal of described instruction dual code representative.Because described instruction database 31 has the data of identical project signal with described project database 11, so can analyze the instruction of user through the selected project signal representative of described teaching device 1 via described comparison operation.For example: after comparing each other by the instruction dual code 110110 and the project signal datas in the described instruction database 31 of described control device 3 conversion gained; Can analyze to such an extent that described instruction dual code 110110 is the first above-mentioned project signal, and then judge and learn that instruction that the user desires to assign is for opening TV.Moreover described control device 3 also connects described movement device 4, and after described control device 3 was accomplished the comparison operation of one group of instruction dual code, described control device 3 promptly sent one and controls signal to described movement device 4; It is characterized in that: described control signal is to carry out the instruction of the corresponding project signal of described instruction dual code representative.So, described movement device 4 can be carried out the instruction that the user assigns.
Please with reference to shown in Figure 3, the audio-visual recognition that utilizes of first embodiment of the invention carries out control action for the control system on basis is main according to following method:
First step S1 is that the display unit 12 of described teaching device 1 constantly shows described several project signals; Observe described display unit 12 for the user; And select a project signal, follow described project signal and utilize sound or limb action to send an expectation instruction.
The second step S2 is described capture device 2 acquisition users' sound or a limbs image, and promptly described expectation instruction is to be sent to described control device 3.
Third step S3 is that the expectation instruction transformation that described control device 3 is captured described capture device 2 becomes one group of instruction dual code.It is characterized in that: described control device 3 is preferably has voluntarily the also ability of lookup error dual code; Because through the ability of error correction voluntarily and in the scope that can correct; When the user utilizes sound or limb action to give expression to the expectation instruction of a mistake; Described control device 3 can the successful expectation instruction transformation with described mistake be the instruction dual code of correct expectation instruction still; Described expectation instruction be must express again with the person of avoiding the use of, user's burden and temporal waste caused.
The 4th step S4 is that described control device 3 is compared the data of described instruction dual code and described instruction database 31, so that find out the corresponding project signal of described instruction dual code.
The 5th step S5 is that described control device 3 transmissions one control signal to described movement device 4, and described movement device 4 moves according to described control signal, to accomplish the instruction of described project signal representative.
Please with reference to shown in Figure 4; Second embodiment of the invention utilize the control system of audio-visual recognition for the basis; Be connected described control device 3 with different being in of first embodiment, and described control device 3 is preferably the instruction database 31 of control device 3 of project database 11 and first embodiment that replaces the teaching device 1 of first embodiment with single database 31 ' in described teaching device 1.Described database 31 ' is to store several different project signals, and each described project signal also is made up of one group of project dual code.The control device 3 of present embodiment is preferably a main frame is connected described main frame with one computer screen with display unit 12; And be preferably through multimedia Flash software, Gif map file, web page program VBScript or JavaScript and write each described option signal of editor; Each described option signal can demonstrate through described computer screen, for user's observation and by wherein selecting a project signal.Moreover, if when described movement device 4 be described main frame, need long-term computed worker promptly can utilize the effect of sound or limb action replacement bimanualness mouse or keyboard, effectively to avoid problem such as wrist inflammation.
Please with reference to shown in Figure 5, the audio-visual recognition that utilizes of second embodiment of the invention carries out control action for the control system on basis is main according to following method:
First step S1 is that the display unit 12 of described teaching device 1 constantly shows several different project signals; Observe described display unit 12 and select one of described several project signals for the user, and utilize sound or limb action to send an expectation instruction.Each described project signal content is the various operation that is relevant to computing machine, for example webpage switching, volume adjustment, editing picture or write literal etc.
The second step S2 is described capture device 2 acquisition users' sound or a limbs image, and promptly described expectation instruction is to be sent to described control device 3.Because described display unit 12 is a computer screen, and the user is many towards described display unit 12, so the position that is provided with of described capture device 2 is preferably towards the user, and can be selected from a network camera.
Third step S3 is that the expectation instruction transformation that described control device 3 is captured described capture device 2 becomes one group of instruction dual code.
The 4th step S4 is that described control device 3 is compared the data of described instruction dual code and described database 31 ', so that find out the corresponding project signal of described instruction dual code.
The 5th step S5 is that described control device 3 transmissions one control signal to described movement device 4; It is characterized in that: described movement device 4 can be described control device 3, and described movement device 4 moves according to described control signal, to accomplish the instruction of described project signal representative.
Third embodiment of the invention utilize the control system of audio-visual recognition for the basis; Its teaching device 1 connects described control device 3; And several different project signals that described display unit 12 is shown are classified, to form several different project signal groups; It is characterized in that: the project signal in each described project signal group is preferably has mutual relationship each other, so that carry out a series of controlling to same movement device 4.For example: the first project signal group that described display unit 12 shows comprises two project signals, and the instruction of its representative is respectively out TV and switches off the TV; The second project signal group comprises six project signals, the instruction of its representative be respectively the 1st of TV programme, the 2nd of TV programme, the 3rd of TV programme, the last group of TV programme the 4th, time with to next group; And the 3rd project signal group comprises four project signals, and the instruction of its representative is respectively volume 15, volume 20, volume 25 and goes back to a last group.
Moreover; Each described project signal group is shown by described display unit 12 simultaneously; Described display unit 12 only shows one of described several project signal groups, and the opportunity that each described project signal group is shown be by described control device 3 automatic feedbacks or by the user choose control.More detailed speech, when described control device 3 sends one when controlling signal to a described movement device 4, described control device 3 also sends a feedback signal to described teaching device 1, shows another project signal group to order described display unit 12 to change; Perhaps; The user can send one through described control device 3 and control signal to described teaching device 1 to order the desirable project signal of described display unit 12 demonstration users group by choosing in the described display unit 12 as returning a last group and instruction to next group more equally.
Below be to lift an embodiment so that the conversion of described project signal group to be described: when the user select to open in by the above-mentioned described first project signal group TV as the first expectation instruction after; Described control device 3 sends a control signal opens described TV, and sends a feedback signal to described teaching device 1 to order the described second project signal group of described display unit 12 demonstrations.When the user observe described display unit 12 once more and by the described second project signal group in when selecting the 3rd of TV programme as the second expectation instruction, described control device 3 promptly sends a control signal described TV is switched to the 3rd of program; If; When user's desire is adjusted the volume of described TV; Can be by selecting to hope instruction as the third phase in the described second project signal group to next group; After described control module receives described expectation instruction, just send one and control signal to described teaching device 1, select the project signal of television sound volume size for the user to order described the 3rd project signal group of described display unit 12 demonstrations; Otherwise; When if the user desires to close described TV; Can reelect the instruction of selecting go back to a group, described control module is changed to order described display unit 12 to show the described first project signal group again, observe and send the instruction that switches off the TV for the user.So; Described display unit 12 can show described several project signals in batches; Make each items displayed signal in good order, avoid the too much mixed and disorderly again chaotic user of project signal, the user can follow described display unit 12 to choose relevant project signal one by one; Carry out a succession of relevant instruction through described control device 3, with abundant lifting hommization of the present invention.
Please with reference to shown in Figure 6, the audio-visual recognition that utilizes of third embodiment of the invention carries out control action for the control system on basis is main according to following method:
First step S1 is that the display unit 12 of described teaching device 1 constantly shows one of several project signal groups; Each described project signal group has several different project signals; Observe described display unit 12 and by selecting a project signal in the described project signal group for the user, and utilize sound or limb action to send an expectation instruction.
The second step S2 is described capture device 2 acquisition users' sound or a limbs image, and promptly described expectation instruction is to be sent to described control device 3.
Third step S3 is that the expectation instruction transformation that described control device 3 is captured described capture device 2 becomes one group of instruction dual code.
The 4th step S4 is that described control device 3 is compared the data of described instruction dual code and described instruction database 31, so that find out the corresponding project signal of described instruction dual code.
The 5th step S5 is that described control device 3 sends a control signal and feedback signal to a movement device 4 and described teaching device 1 respectively; Described movement device 4 moves according to described control signal; To accomplish the instruction of described project signal representative; And described display unit 12 changes another project sets of signals that shows described several project signal groups according to described feedback signal, observes for the user.When described movement device 4 was described teaching device 1, described control device 3 need not send described feedback signal to described teaching device 1.
Control method and the system thereof that utilizes audio-visual recognition for the basis of the present invention; Be to utilize described display unit 12 to show that several different project signals are for user's observation and selection; And form by one group of project dual code through each described project signal; Make described project database 11 or described database 31 ' can store also diversified project signal kinds; The user representes that the mode of item selected signal also oversimplifies, and no longer needs a large amount of limb actions, in addition; Described control device 3 is handled sound or the limbs image information that described capture device 2 is captured easily, and then the correctness that shortens the image processing time, reduces the situation of image interpretation mistake and improve the expectation instruction of carrying out the user.
The above is merely preferred embodiment of the present invention, only is illustrative for the purpose of the present invention, and nonrestrictive.Those skilled in the art is understood, and in spirit that claim of the present invention limited and scope, can carry out many changes to it, revise, in addition equivalent, but all will fall in protection scope of the present invention.
Claims (37)
1. control system of utilizing audio-visual recognition for the basis is characterized in that: comprise:
A teaching device; Comprise a display unit and a project database; Described display unit shows several different project signals; Described project database stores described several project signals, and each described project signal is made up of one group of project dual code and is respectively represented different instruction, sends an expectation instruction for the user according to an one of which project signal;
A capture device, it captures described user's expectation instruction;
A control device; Its connection and to change the expectation instruction that described capture device captures be one group of instruction dual code; Described control device comprises an instruction database, and described instruction database is that the project signal construction by described project database forms; With
A movement device, it connects described control device;
Described display unit is to utilize two kinds of different Display Modes to represent the two-phase dystopy of described project dual code.
2. the control system of utilizing audio-visual recognition for the basis according to claim 1 is characterized in that: the time that described two Display Modes showed through Alternation Display and change in a unit interval at every turn is to demonstrate each described project signal.
3. the control system of utilizing audio-visual recognition for the basis according to claim 1; It is characterized in that: described control device is with the project signal fusing in described instruction dual code and the described instruction database; Obtaining the pairing project signal of described instruction dual code, and send an instruction that controls signal to described movement device with project implementation signal representative.
4. the control system of utilizing audio-visual recognition for the basis according to claim 1 and 2 is characterized in that: described two Display Modes are two different luminosity, two different colors, two different sound, two different literal or two different figures.
5. the control system of utilizing audio-visual recognition for the basis according to claim 1 is characterized in that: successional sound or limb action that described expectation instruction is sent for the user.
6. control system of utilizing audio-visual recognition for the basis, it is characterized in that: it comprises:
A control device, it has several different project signals of a database storage, and each described project signal is made up of one group of project dual code and is respectively represented an instruction;
A teaching device, it is connected described control device and comprises a display unit, and described display unit is the project signal that shows described database, sends an expectation instruction for the user according to an one of which project signal;
A capture device, it captures described user's expectation instruction and also is connected with described control device; With
A movement device, it connects described control device;
Wherein said control device is changed expectation instruction that described capture device captures forming one group of instruction dual code, and described display unit utilizes two-phase dystopy that two kinds of different Display Modes represent described project dual code to show each described project signal.
7. the control system of utilizing audio-visual recognition for the basis according to claim 6 is characterized in that: described two Display Modes in a unit interval, through Alternation Display with change each time that shows to demonstrate each described project signal.
8. the control system of utilizing audio-visual recognition for the basis according to claim 6; It is characterized in that: described control device is with the project signal fusing in described instruction dual code and the described database; Obtaining the pairing project signal of described instruction dual code, and send one and control signal to described movement device to carry out the instruction of described project signal representative.
9. the control system of utilizing audio-visual recognition for the basis according to claim 6; It is characterized in that: described control device is with the project signal fusing in described instruction dual code and the described database; Obtaining the pairing project signal of described instruction dual code, and send one and control signal to described control device to carry out the instruction of described project signal representative.
10. according to claim 6 or the 7 described control system of utilizing audio-visual recognition for the basis, it is characterized in that: described two Display Modes are two different luminosity, two different colors, two different sound, two different literal or two different figures.
11. the control system of utilizing audio-visual recognition for the basis according to claim 6 is characterized in that: successional sound or limb action that described expectation instruction is sent for the user.
12. a control system of utilizing audio-visual recognition for the basis, it comprises:
A teaching device; It comprises a display unit; Described display unit shows one of several different project signal groups, and each described project signal group has several different project signals, and each described project signal is made up of one group of project dual code and is respectively represented an instruction; By selecting a project signal in the described project signal group, and send an expectation instruction for the user;
A capture device, it captures described user's expectation instruction;
A control device; Its connection and to change the expectation instruction that described capture device captures be one group of instruction dual code; Described control device comprises an instruction database; Described instruction database is that the project signal construction by described several project signal groups forms, and described control device also connects described teaching device; With
A movement device, it connects described control device;
Wherein, described display unit utilizes two kinds of different Display Modes to represent the two-phase dystopy of described project dual code.
13. the control system of utilizing audio-visual recognition for the basis according to claim 12 is characterized in that: the time that described two Display Modes showed through Alternation Display and change in a unit interval at every turn is to demonstrate each described project signal.
14. the control system of utilizing audio-visual recognition for the basis according to claim 12; It is characterized in that: described control device is with the project signal fusing in described instruction dual code and the described instruction database; To obtain the pairing project signal of described instruction dual code; And send an instruction that controls signal to described movement device with project implementation signal representative; Other sends a feedback signal to described teaching device, and described display unit changes another project signal group that shows described several project signal groups according to described feedback signal, observes for the user.
15. the control system of utilizing audio-visual recognition for the basis according to claim 12; It is characterized in that: described control device is with the project signal fusing in described instruction dual code and the described instruction database; Obtaining the pairing project signal of described instruction dual code, and send an instruction that controls signal to described teaching device with project implementation signal representative.
16. according to claim 12 or the 13 described control system of utilizing audio-visual recognition for the basis, it is characterized in that: described two Display Modes are two different luminosity, two different colors, two different sound, two different literal or two different figures.
17. the control system of utilizing audio-visual recognition for the basis according to claim 12 is characterized in that: described teaching device comprises a project database in addition, described project database is to store described several different project signal groups.
18. the control system of utilizing audio-visual recognition for the basis according to claim 12 is characterized in that: successional sound or limb action that described expectation instruction is sent for the user.
19. a control method of utilizing audio-visual recognition for the basis, it is characterized in that: its step comprises:
Utilize a display unit to show several different project signals, send an expectation instruction according to an one of which project signal for the user;
Utilize a capture device to capture described user's expectation instruction and be sent to a control device;
With described control device the expectation instruction transformation that described capture device was captured is become one group of instruction dual code, and database of described control device search is to obtain the corresponding project signal of described instruction dual code; With
Utilize described control device to send one and control signal to a movement device, and described control signal is corresponding with described project signal.
20. the control method of utilizing audio-visual recognition for the basis according to claim 19; It is characterized in that: each described project signal is made up of one group of project dual code; Described display unit utilizes two kinds of different Display Modes to represent two phase dystopys of described project dual code, and the time that described two Display Modes showed through Alternation Display and change in a unit interval at every turn is to demonstrate each described project signal.
21. the control method of utilizing audio-visual recognition for the basis according to claim 19; It is characterized in that: described database is to be formed by described several project signal construction; And after utilizing described control device that the expectation instruction transformation that described capture device captured is become described instruction dual code; Utilize described control device that described instruction dual code and described database are compared, to obtain the corresponding project signal of described instruction dual code.
22. the control method of utilizing audio-visual recognition for the basis according to claim 19; It is characterized in that: each described project signal is respectively to represent an instruction; Utilize described control device send described control signal to described movement device after; Utilize described movement device according to described control signal action, to accomplish the instruction of described project signal representative.
23. according to claim 19 or the 22 described control methods of utilizing audio-visual recognition for the basis, it is characterized in that: described movement device is described control device.
24. the control method of utilizing audio-visual recognition for the basis according to claim 19 is characterized in that: when utilizing described display unit to show described several project signals, described display unit is constantly to repeat to show each described project signal.
25. according to claim 19 or the 21 described control methods of utilizing audio-visual recognition for the basis, it is characterized in that: described several project signals are to be stored in the project database, show for described display unit; And described control device is an instruction database for the described database that obtains to instruct the corresponding project signal of dual code to search; Described instruction database is located in the described control device, and described instruction database is also formed by described several project signal construction.
26. according to claim 19 or the 21 described control methods of utilizing audio-visual recognition for the basis, it is characterized in that: described several project signals are to be stored in the described database, and described database is located in the described control device.
27. the control system of utilizing audio-visual recognition for the basis according to claim 19 is characterized in that: successional sound or limb action that described expectation instruction is sent for the user.
28. a control method of utilizing audio-visual recognition for the basis, it is characterized in that: its step comprises:
Utilize display unit to show one of several different project signal groups, each described project signal group has several different project signals, sends an expectation for the user according to an one of which project signal and instructs;
Utilize a capture device to capture described user's expectation instruction and be sent to a control device;
With described control device the expectation instruction transformation that described capture device was captured is become one group of instruction dual code, and database of described control device search is to obtain the corresponding project signal of described instruction dual code; With
Utilize described control device to send one and control signal to a movement device, and described control signal is corresponding with described project signal.
29. the control method of utilizing audio-visual recognition for the basis according to claim 28; It is characterized in that: utilize when described control device transmission is described to control signal to a movement device; Utilize described control device to send a feedback signal to described display unit; Described display unit changes another project signal group that shows described several project signal groups according to described feedback signal, observes for the user.
30. the control method of utilizing audio-visual recognition for the basis according to claim 28; It is characterized in that: each described project signal is respectively represented an instruction; Utilize described control device send described control signal to described movement device after; Utilize described movement device according to described control signal action, to accomplish the instruction of described project signal representative.
31. according to claim 28 or the 30 described control methods of utilizing audio-visual recognition for the basis, it is characterized in that: described movement device is described display unit.
32. the control method of utilizing audio-visual recognition for the basis according to claim 28; It is characterized in that: each described project signal is made up of one group of project dual code; Described display unit utilizes two kinds of different Display Modes to represent two phase dystopys of described project dual code, and the time that described two Display Modes showed through Alternation Display and change in a unit interval at every turn is to demonstrate each described project signal.
33. the control method of utilizing audio-visual recognition for the basis according to claim 28; It is characterized in that: described database is that the project signal construction by described several project signal groups forms; And after utilizing described control device that the expectation instruction transformation that described capture device captured is become described instruction dual code; Utilize described control device that described instruction dual code and described database are compared, to obtain the corresponding project signal of described instruction dual code.
34. the control method of utilizing audio-visual recognition for the basis according to claim 28; It is characterized in that: when utilizing described display unit to show one of described several project signal groups, described display unit is the project signal that constantly repeats to show in the described project signal group.
35. according to claim 28 or the 33 described control methods of utilizing audio-visual recognition for the basis, it is characterized in that: the project signal of described several project signal groups is to be stored in the project database, shows for described display unit; And described control device is an instruction database for the described database that obtains to instruct the corresponding project signal of dual code to search; Described instruction database is located in the described control device, and described instruction database is also formed by the project signal construction of described several project signal groups.
36. according to claim 28 or the 33 described control methods of utilizing audio-visual recognition for the basis, it is characterized in that: the project signal of described several project signal groups is to be stored in the described database, and described database is located in the described control device.
37. the control system of utilizing audio-visual recognition for the basis according to claim 28 is characterized in that: successional sound or limb action that described expectation instruction is sent for the user.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200810144449XA CN101639696B (en) | 2008-07-31 | 2008-07-31 | Control method based on audio-visual recognition and system thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200810144449XA CN101639696B (en) | 2008-07-31 | 2008-07-31 | Control method based on audio-visual recognition and system thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101639696A CN101639696A (en) | 2010-02-03 |
| CN101639696B true CN101639696B (en) | 2012-06-27 |
Family
ID=41614719
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN200810144449XA Expired - Fee Related CN101639696B (en) | 2008-07-31 | 2008-07-31 | Control method based on audio-visual recognition and system thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101639696B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102279644B (en) * | 2010-06-08 | 2015-01-07 | 仁宝电脑工业股份有限公司 | Interactive system |
| TWI700166B (en) * | 2017-09-20 | 2020-08-01 | 達明機器人股份有限公司 | Teaching system and method of robot arm |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN2274077Y (en) * | 1996-12-30 | 1998-02-11 | 东方国际集团贸易发展有限公司 | Voice-sound controlling device for fire engine |
| CN1201970A (en) * | 1998-05-29 | 1998-12-16 | 黄显婷 | Acoustical calculater and timer and controlling method thereof |
-
2008
- 2008-07-31 CN CN200810144449XA patent/CN101639696B/en not_active Expired - Fee Related
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN2274077Y (en) * | 1996-12-30 | 1998-02-11 | 东方国际集团贸易发展有限公司 | Voice-sound controlling device for fire engine |
| CN1201970A (en) * | 1998-05-29 | 1998-12-16 | 黄显婷 | Acoustical calculater and timer and controlling method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101639696A (en) | 2010-02-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP2014056670A (en) | Lighting control system | |
| CN102402383A (en) | Information processing device and information processing method | |
| CN104135681A (en) | Interactive gesture remote control | |
| CN101025655A (en) | Screen transmission device, method of generating screen | |
| WO2007126286A1 (en) | Non-contact selection device | |
| CN109426353B (en) | System module for customizing display frame in non-invasive data acquisition system | |
| JP5140159B2 (en) | Key input device for remote control device, key input method for key input device for remote control device, program and recording medium | |
| CN101416563A (en) | Event based ambient lighting control | |
| CN112333495B (en) | Focus switching method, display device and system | |
| CN102034341B (en) | Control system and method for generating control picture by using control system | |
| CN101639696B (en) | Control method based on audio-visual recognition and system thereof | |
| CN102385889A (en) | Media player and method for realizing intelligent household control by using the same | |
| CN103135746A (en) | Non-touch control method and non-touch control system and non-touch control device based on static postures and dynamic postures | |
| CN102402842A (en) | Augmented reality remote control method and device thereof | |
| CN109431447A (en) | It is a kind of for showing the Vission detector of eyesight detection image | |
| TWI362620B (en) | A control method based on image or voice identification | |
| Sorgalla et al. | ARGI: Augmented Reality for Gesture-based Interaction in Variable Smart Environments. | |
| US10397531B2 (en) | Projector, display device, and display method | |
| CN1598748A (en) | Method and device for realizing wireless mouse function | |
| KR20070115510A (en) | Device capable of non-contact function selection and method thereof | |
| JP2008083861A (en) | Image projector and image projection system | |
| CN114489310A (en) | Virtual reality device and handle positioning method | |
| CN113194302B (en) | Intelligent display device and starting control method | |
| CN111045522A (en) | Intelligent interaction system | |
| TWI420833B (en) | Control system and generating method of control frames thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20120627 Termination date: 20140731 |
|
| EXPY | Termination of patent right or utility model |