CN102316219A - Method for controlling network terminal equipment, apparatus and system - Google Patents
Method for controlling network terminal equipment, apparatus and system Download PDFInfo
- Publication number
- CN102316219A CN102316219A CN201110281889A CN201110281889A CN102316219A CN 102316219 A CN102316219 A CN 102316219A CN 201110281889 A CN201110281889 A CN 201110281889A CN 201110281889 A CN201110281889 A CN 201110281889A CN 102316219 A CN102316219 A CN 102316219A
- Authority
- CN
- China
- Prior art keywords
- eye motion
- user
- sample
- control command
- eye
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Telephonic Communication Services (AREA)
Abstract
The invention relates to a method foe controlling of network terminal equipment, an apparatus and a system. According to the embodiment of the invention, eye motion information is obtained and a control instruction is matched to the eye motion information according to a preset condition; and then the matched control instruction is sent to network terminal equipment, so that an objective that operations of the network terminal equipment are controlled by an eye motion is achieved. The above-mentioned technical scheme has an advantage of simple operation; and thus another mode is provided for a user to make operations on network terminal equipment; especially, when it is inconvenient for the user to make operations on the network terminal equipment by hands, the effect of the method is more obvious.
Description
Technical field
The present invention relates to communication technical field, be specifically related to a kind of control method, device and system of network-termination device.
Background technology
Along with the development of information technology, various communication equipments have obtained using widely such as mobile phone, STB etc., bring great convenience to daily life.
In daily life, many household electrical appliances all can connect the Internet, become network-termination device.And in the prior art, include two kinds for the control of network-termination device, a kind of is directly network-termination device to be controlled through the operation keys of network-termination device, such as directly STB being controlled through the operation keys on the STB; Another kind is through remote controller network-termination device to be controlled, and such as the remote controller through STB STB is controlled.In research and practice process to prior art, inventor of the present invention finds, no matter is directly network-termination device to be operated; Still through remote controller network-termination device is controlled; Generally speaking, the user need go to operate through hand, and these are under some scenes; When movable, very not convenient such as the injured inconvenience of user's hand.
Summary of the invention
The embodiment of the invention provides a kind of control method, device and system of network-termination device, can pass through mobile phone, utilizes eye motion that network-termination device is controlled.
A kind of control method of network-termination device comprises:
Obtain eye motion information;
According to prerequisite is said eye motion information matches control command;
The control command that the transmission coupling obtains is given network-termination device.
A kind of control method of network-termination device comprises:
The eye motion sample that mobile terminal receive sends;
For said eye motion sample is provided with control corresponding instruction, the corresponding relation of controlled instruction and eye motion sample;
The corresponding relation of control command and eye motion sample is sent to portable terminal, so that portable terminal is an eye motion information matches control command according to said corresponding relation;
The control command that the coupling that mobile terminal receive sends obtains.
A kind of portable terminal comprises:
Information acquisition unit is used to obtain eye motion information;
Matching unit, being used for according to prerequisite is the eye motion information matches control command that information acquisition unit gets access to;
Transmitting element is used to send the control command that the matching unit coupling obtains and gives network-termination device.
A kind of network-termination device comprises:
The sample receiving element is used for the eye motion sample that mobile terminal receive sends;
The unit is set, is used to said eye motion sample control corresponding instruction, the corresponding relation of controlled instruction and eye motion sample are set;
Transmitting element is used for the corresponding relation of control command and eye motion sample is sent to portable terminal, so that portable terminal is an eye motion information matches control command according to said corresponding relation;
The command reception unit is used for the control command that coupling that mobile terminal receive sends obtains.
A kind of communication system comprises any network-termination device that any portable terminal that the embodiment of the invention provides and the embodiment of the invention provide.
The embodiment of the invention can be through obtaining eye motion information; According to prerequisite is eye motion information matches control command, and the control command that transmission coupling then obtains is given network-termination device, thereby realizes coming through eye motion the purpose of the operation of Control Network terminal equipment; This scheme is easy to operate; For the user provides another kind of mode to the operation of network-termination device, particularly when user's inconvenience was operated network-termination device with hand, effect was more outstanding.
Description of drawings
In order to be illustrated more clearly in the technical scheme in the embodiment of the invention; The accompanying drawing of required use is done to introduce simply in will describing embodiment below; Obviously, the accompanying drawing in describing below only is some embodiments of the present invention, to those skilled in the art; Under the prerequisite of not paying creative work, can also obtain other accompanying drawing according to these accompanying drawings.
Fig. 1 is the flow chart of the control method of the network-termination device that provides of the embodiment of the invention;
Fig. 2 is the another flow chart of the control method of the network-termination device that provides of the embodiment of the invention;
Fig. 3 is another flow chart of the control method of the network-termination device that provides of the embodiment of the invention;
Fig. 4 a is the structural representation of the portable terminal that provides of the embodiment of the invention;
Fig. 4 b is the structural representation of the portable terminal that provides of the embodiment of the invention;
Fig. 5 is the structural representation of the network-termination device that provides of the embodiment of the invention.
Embodiment
To combine the accompanying drawing in the embodiment of the invention below, the technical scheme in the embodiment of the invention is carried out clear, intactly description, obviously, described embodiment only is the present invention's part embodiment, rather than whole embodiment.Based on the embodiment among the present invention, those skilled in the art are not making the every other embodiment that is obtained under the creative work prerequisite, all belong to the scope of the present invention's protection.
The embodiment of the invention provides a kind of control method, device and system of network-termination device.Below be elaborated respectively.
Embodiment one,
Present embodiment will be described from the angle of portable terminal, and this portable terminal specifically can be equipment such as personal computer, panel computer or mobile phone.
A kind of control method of network-termination device comprises: obtaining eye motion information, is this eye motion information matches control command according to prerequisite, and the control command that the transmission coupling obtains is given network-termination device.
Wherein, prerequisite can be provided with according to the demand of practical application, for example, can extract eye motion information through recognition of face, and the sample with eye motion information and preservation compares then, matees control command according to comparative result.Such as, if eye left, then represent left page turning, if eye right, then be right page turning, if close one's eyes, then expression cancellation, the then expression of singly opening eyes is definite, or the like.Wherein, sample can be the same sample that presets, and also can different samples be set according to different user.That is, before obtaining eye motion information, the control method of this network-termination device can also comprise:
Obtain the eye motion sample; This eye motion sample is sent to network-termination device, so that this network-termination device is provided with the control corresponding instruction for the eye motion sample; Receive and preserve the control command of network-termination device transmission and the corresponding relation of eye motion sample.
This moment then, according to prerequisite be said eye motion information matches control command specifically can for: according to the control command of preserving and the corresponding relation of eye motion sample, be eye motion information matches control command.
Referring to Fig. 1, idiographic flow can be following:
101, obtain the eye motion sample; This eye motion sample can be provided with according to user's hobby and custom, for example, and specifically can be following:
Obtain face's pictorial information of user through camera; Wherein, face's pictorial information can comprise individual face's front picture when opening right eye of individual face's front picture and user when opening left eye of face's front picture when eyes of user is just being seen, the face's front picture when an eyes of user left side is seen, the face's front picture when the eyes of user right side is seen, user; Can be with each pictures as an eye motion sample.
What need explanation is that above eye motion sample is an example only, should be understood that, the eye motion sample of other types can also be set.
102, the eye motion sample that gets access to is sent to network-termination device, so that this network-termination device is provided with the control corresponding instruction for these eye motion samples;
Wherein, network-termination device for the eye motion sample be provided with control corresponding instruction specifically can for:
Network-termination device prompting user is that each eye motion sample is selected the control corresponding instruction, and the corresponding relation of each eye motion sample and control command is set according to user's selection then.
For example, if the eye motion sample is specially: individual face's front picture when opening right eye of individual face's front picture and user when opening left eye of the face's front picture when eyes of user is just being seen, the face's front picture when an eyes of user left side is seen, the face's front picture when the eyes of user right side is seen, user.Then the corresponding relation of eye motion sample and control command specifically can be following any one:
Face's front picture when (1) an eyes of user left side is seen is represented left page turning; Face's front picture when the eyes of user right side is seen is represented right page turning; Individual face's front picture when opening left eye of user is represented cancellation, and individual face's front picture when opening left eye of user is represented cancellation, and individual face's front picture when opening right eye of user is represented to confirm; Perhaps,
Face's front picture when (2) an eyes of user left side is seen is represented right page turning; Face's front picture when the eyes of user right side is seen is represented left page turning; Individual face's front picture when opening left eye of user is represented cancellation, and individual face's front picture when opening left eye of user is represented cancellation, and individual face's front picture when opening right eye of user is represented to confirm; Perhaps,
Face's front picture when (3) an eyes of user left side is seen is represented right page turning; Face's front picture when the eyes of user right side is seen is represented left page turning; Individual face's front picture when opening left eye of user representes to confirm, individual face's front picture when opening left eye of user is represented cancellation, and individual face's front picture when opening right eye of user is represented cancellation; Perhaps,
Face's front picture when (4) an eyes of user left side is seen is represented left page turning; Face's front picture when the eyes of user right side is seen is represented right page turning; Individual face's front picture when opening left eye of user representes to confirm, individual face's front picture when opening left eye of user is represented cancellation, and individual face's front picture when opening right eye of user is represented cancellation.
103, receive and preserve the control command of network-termination device transmission and the corresponding relation of eye motion sample;
104, obtain eye motion information;
For example, can obtain face's pictorial information of user through camera, from the face's pictorial information that gets access to, extract eye motion information then, wherein this eye motion information specifically can be the eye motion pictorial information.
Optional, in order more accurately to extract eye motion information, and let this control method have more personalization; Can the corresponding control method of one cover (meaning that promptly each user has corresponding eye motion sample alone) all be set respectively for each user; If each user has corresponding eye motion sample, then before from face's pictorial information, extracting eye motion information, can also judge whether the active user had extracted the eye sample action earlier; And can confirm further which the pairing eye motion sample of active user is; Just carry out follow-up operation then, if the active user did not extract the eye sample action, then can process ends; Perhaps point out the user to extract the eye motion sample earlier and carry out the setting of control command, or the like.That is to say that from face's pictorial information, extract before the eye motion information, the control method of this network-termination device can also comprise:
According to face's pictorial information, confirm that through face recognition technology the active user is the user who extracted the eye sample action.
105, according to the control command of preserving and the corresponding relation of eye motion sample, be eye motion information matches control command;
For example, if in step 103, preserved the corresponding relation of control command and eye motion sample, then this moment, step 105 specifically can be following:
Eye motion information and eye motion sample are carried out picture texture coupling; Confirm to mate most the eye motion sample according to matching degree; The control command through searching preservation and the corresponding relation of eye motion sample are then confirmed and are mated eye motion sample control instruction corresponding most.
106, the control command that coupling obtains in the forwarding step 105 is given network-termination device.
In addition, before portable terminal and network-termination device communicate, also need connect with network-termination device, such as, wireless connections such as Wireless Fidelity (WiFi, Wireless Fidelity) or bluetooth can be set up.That is, before step 101, the control method of this network-termination device can also comprise:
Wireless connections between foundation and the network-termination device.
By on can know that present embodiment can utilize the corresponding relation of this setting to come the eye motion information matches control command for getting access to through the corresponding relation between eye motion sample and the control command is set then; And be handed down to network-termination device to the control command that coupling obtains; Thereby realize coming through eye motion the purpose of the operation of Control Network terminal equipment, this scheme is easy to operate, for the user provides another kind of mode to the operation of network-termination device; Particularly when user's inconvenience is operated network-termination device with hand; Injured such as user's hand, in the time of perhaps can't vacateing affairs on hand, effect is more outstanding.
Embodiment two,
Present embodiment will be described from the angle of network-termination device.
A kind of control method of network-termination device; Comprise: the eye motion sample that mobile terminal receive sends; For the eye motion sample is provided with control corresponding instruction, the corresponding relation of controlled instruction and eye motion sample sends to portable terminal with the corresponding relation of control command and eye motion sample; So that portable terminal is an eye motion information matches control command according to said corresponding relation, the control command that the coupling that mobile terminal receive sends obtains.
Referring to Fig. 2, idiographic flow can be following:
201, the eye motion sample of mobile terminal receive transmission; For example, specifically can be following:
Face's pictorial information that mobile terminal receive sends; Wherein, Face's pictorial information can comprise individual face's front picture when opening right eye of individual face's front picture and user when opening left eye of face's front picture when eyes of user is just being seen, the face's front picture when an eyes of user left side is seen, the face's front picture when the eyes of user right side is seen, user; Wherein, each pictures is as an eye motion sample.
What need explanation is that above eye motion sample is an example only, should be understood that, the eye motion sample of other types can also be set.
202, for the eye motion sample that receives control corresponding instruction, the corresponding relation of controlled instruction and eye motion sample are set; For example, specifically can be following:
The prompting user is that each eye motion sample is selected the control corresponding instruction, and the corresponding relation of each eye motion sample and control command is set according to user's selection then.
For example, if the eye motion sample is specially: individual face's front picture when opening right eye of individual face's front picture and user when opening left eye of the face's front picture when eyes of user is just being seen, the face's front picture when an eyes of user left side is seen, the face's front picture when the eyes of user right side is seen, user.Then the corresponding relation of eye motion sample and control command specifically can be following any one:
Face's front picture when (1) an eyes of user left side is seen is represented left page turning; Face's front picture when the eyes of user right side is seen is represented right page turning; Individual face's front picture when opening left eye of user is represented cancellation, and individual face's front picture when opening left eye of user is represented cancellation, and individual face's front picture when opening right eye of user is represented to confirm; Perhaps,
Face's front picture when (2) an eyes of user left side is seen is represented right page turning; Face's front picture when the eyes of user right side is seen is represented left page turning; Individual face's front picture when opening left eye of user is represented cancellation, and individual face's front picture when opening left eye of user is represented cancellation, and individual face's front picture when opening right eye of user is represented to confirm; Perhaps,
Face's front picture when (3) an eyes of user left side is seen is represented right page turning; Face's front picture when the eyes of user right side is seen is represented left page turning; Individual face's front picture when opening left eye of user representes to confirm, individual face's front picture when opening left eye of user is represented cancellation, and individual face's front picture when opening right eye of user is represented cancellation; Perhaps,
Face's front picture when (4) an eyes of user left side is seen is represented left page turning; Face's front picture when the eyes of user right side is seen is represented right page turning; Individual face's front picture when opening left eye of user representes to confirm, individual face's front picture when opening left eye of user is represented cancellation, and individual face's front picture when opening right eye of user is represented cancellation.
203, the corresponding relation with control command and eye motion sample sends to portable terminal, so that portable terminal is an eye motion information matches control command according to this corresponding relation;
204, the control command that obtains of the mobile terminal receive coupling of sending.
In addition, before network-termination device and portable terminal communicate, also need connect with portable terminal, such as, wireless connections such as WiFi or bluetooth can be set up.That is, the eye motion sample (being step 201) that sends at mobile terminal receive before, the control method of this network-termination device can also comprise:
Wireless connections between foundation and the portable terminal.
By on can know; Present embodiment can be through being provided with the corresponding relation between eye motion sample and the control command, and utilize the corresponding relation of this setting to come the eye motion information matches control command for getting access to, thereby realize coming through eye motion the purpose of the operation of Control Network terminal equipment; This scheme is easy to operate; For the user provides another kind of mode to the operation of network-termination device, particularly when user's inconvenience is operated network-termination device with hand, injured such as user's hand; In the time of perhaps can't vacateing affairs on hand, effect is more outstanding.
Embodiment three,
According to the described method of front embodiment, below will do further explain for example.
In the present embodiment, will be specially mobile phone with portable terminal, it is that example describes that network-termination device is specially STB.
Referring to Fig. 3, idiographic flow can be following:
301, mobile phone and STB are set up wireless connections, such as connecting through bluetooth or WiFi etc.
302, handset starting eye control application module, and the announcement machine top box gets into the eye control model.Wherein, the control of the eye in mobile phone application module can be realized through program.
303, the eye in mobile phone control application module prompting user makes eye motion, sees, eyes left such as can just doing respectively, eyes right, and individual opens right eye, and individual opens actions such as left eye, and keeps a period of time respectively, such as keeping for 2 seconds, or the like.
What need explanation is, method provided by the present invention not merely is only limited to above-mentioned action, should be understood that, and also can be other eye motion.
304, the control of the eye in mobile phone application module triggers the camera startup of mobile phone; Obtaining the eye motion sample, individual face's front picture when opening right eye of individual face's front picture and user when opening left eye of the face's front picture when obtaining eyes of user respectively and just seeing, the face's front picture when an eyes of user left side is seen, the face's front picture when the eyes of user right side is seen, user.
Mobile phone is according to picture shot (be the face front picture of eyes of user when just seeing, face's front picture when an eyes of user left side is seen, individual face's front picture when opening right eye of individual face's front picture and user when opening left eye of face's front picture, user when the eyes of user right side is seen); The global feature information and the left side of the face when utilizing people's face extraction algorithm and human body extraction algorithm to obtain the positive face of active user are seen; The right side is seen; Individual opens right eye; Individual opens the pictorial information of four actions of left eye, and the prompting user obtains the success of eye motion sample;
305, mobile phone sends to STB with the eye motion sample that gets access to;
306, STB is after receiving the eye motion sample, and the prompting user is provided with the control corresponding instruction for the eye motion sample.Specifically can be following:
Set-top box prompts user is that each eye motion sample is selected the control corresponding instruction, and the corresponding relation of each eye motion sample and control command is set according to user's selection then.For example, individual can be set open right eye representative and confirm that individual opens left eye representative cancellation, the left page turning of representative is seen on a left side; The right page turning of representative is seen on the right side, perhaps, individual also can be set open right eye representative cancellation, and individual is opened the left eye representative and confirms; The left page turning of representative is seen on a left side, and the right page turning of representative is seen on the right side, by that analogy, or the like.That is, the corresponding relation of eye motion sample and control command specifically can be following any one:
Face's front picture when (1) an eyes of user left side is seen is represented left page turning; Face's front picture when the eyes of user right side is seen is represented right page turning; Individual face's front picture when opening left eye of user is represented cancellation, and individual face's front picture when opening left eye of user is represented cancellation, and individual face's front picture when opening right eye of user is represented to confirm; Perhaps,
Face's front picture when (2) an eyes of user left side is seen is represented right page turning; Face's front picture when the eyes of user right side is seen is represented left page turning; Individual face's front picture when opening left eye of user is represented cancellation, and individual face's front picture when opening left eye of user is represented cancellation, and individual face's front picture when opening right eye of user is represented to confirm; Perhaps,
Face's front picture when (3) an eyes of user left side is seen is represented right page turning; Face's front picture when the eyes of user right side is seen is represented left page turning; Individual face's front picture when opening left eye of user representes to confirm, individual face's front picture when opening left eye of user is represented cancellation, and individual face's front picture when opening right eye of user is represented cancellation; Perhaps,
Face's front picture when (4) an eyes of user left side is seen is represented left page turning; Face's front picture when the eyes of user right side is seen is represented right page turning; Individual face's front picture when opening left eye of user representes to confirm, individual face's front picture when opening left eye of user is represented cancellation, and individual face's front picture when opening right eye of user is represented cancellation.
What need explanation is, if other eye motion, then the corresponding relation of its eye motion and control command also should be done adaptive adjustment, and its implementation is identical therewith, repeats no more at this.
307, STB sends to mobile phone with the corresponding relation of control command and eye motion sample.
308, after mobile phone receives the corresponding relation of control command that STB sends and eye motion sample, preserve the corresponding relation of this control command and eye motion sample.
309, mobile phone notifies the user to begin to do eye motion, and obtains face's pictorial information of user real time through camera.
310, mobile phone confirms through face recognition technology whether the active user is the user who extracted the eye sample action according to face's pictorial information, if then execution in step 311, if not, then flow process finishes.
311, mobile phone extracts eye motion information from the face's pictorial information that gets access to, and according to the control command of preserving and the corresponding relation of eye motion sample, is eye motion information matches control command; For example, specifically can be following:
Eye motion information and eye motion sample are carried out picture texture coupling; Confirm to mate most the eye motion sample according to matching degree; The control command through searching preservation and the corresponding relation of eye motion sample are then confirmed and are mated eye motion sample control instruction corresponding most.
312, mobile phone sends the control command of confirming and gives STB.
313, after STB receives this control command, upgrade operation interface, and according to control command household electrical appliances are operated, optional, STB can return response message and give mobile phone.
By on can know; Present embodiment can be through being provided with the corresponding relation between eye motion sample and the control command, and utilize the corresponding relation of this setting to come the eye motion information matches control command for getting access to, thereby realize coming through eye motion the purpose of the operation of Control Network terminal equipment; This scheme is easy to operate; For the user provides another kind of mode to the operation of network-termination device, particularly when user's inconvenience is operated network-termination device with hand, injured such as user's hand; In the time of perhaps can't vacateing affairs on hand, effect is more outstanding.
Embodiment four,
In order to implement above method better, the embodiment of the invention also correspondingly provides a kind of portable terminal, and shown in Fig. 4 a, this portable terminal can comprise information acquisition unit 401, matching unit 402 and transmitting element 403;
Transmitting element 403 is used to send the control command that matching unit 402 couplings obtain and gives network-termination device.
Wherein, prerequisite can be provided with according to the demand of practical application, for example, can extract eye motion information through recognition of face, and the sample with eye motion information and preservation compares then, matees control command according to comparative result.Such as, if eye left, then represent left page turning, if eye right, then be right page turning, if close one's eyes, then expression cancellation, the then expression of singly opening eyes is definite, or the like.Wherein, sample can be the same sample that presets, and also can different samples be set according to different user.That is, shown in Fig. 4 b, this portable terminal can also comprise sample acquisition unit 404 and receiving element 405;
Transmitting element 403 also is used for getting access to sample acquisition unit 404 to such an extent that the eye motion sample sends to network-termination device, so that said network-termination device is said eye motion sample the control corresponding instruction is set;
Receiving element 405 is used to receive and preserve the control command of network-termination device transmission and the corresponding relation of eye motion sample;
For example, if the eye motion sample is specially: individual face's front picture when opening right eye of individual face's front picture and user when opening left eye of the face's front picture when eyes of user is just being seen, the face's front picture when an eyes of user left side is seen, the face's front picture when the eyes of user right side is seen, user.Then the corresponding relation of eye motion sample and control command specifically can be following any one:
Face's front picture when (1) an eyes of user left side is seen is represented left page turning; Face's front picture when the eyes of user right side is seen is represented right page turning; Individual face's front picture when opening left eye of user is represented cancellation, and individual face's front picture when opening left eye of user is represented cancellation, and individual face's front picture when opening right eye of user is represented to confirm; Perhaps,
Face's front picture when (2) an eyes of user left side is seen is represented right page turning; Face's front picture when the eyes of user right side is seen is represented left page turning; Individual face's front picture when opening left eye of user is represented cancellation, and individual face's front picture when opening left eye of user is represented cancellation, and individual face's front picture when opening right eye of user is represented to confirm; Perhaps,
Face's front picture when (3) an eyes of user left side is seen is represented right page turning; Face's front picture when the eyes of user right side is seen is represented left page turning; Individual face's front picture when opening left eye of user representes to confirm, individual face's front picture when opening left eye of user is represented cancellation, and individual face's front picture when opening right eye of user is represented cancellation; Perhaps,
Face's front picture when (4) an eyes of user left side is seen is represented left page turning; Face's front picture when the eyes of user right side is seen is represented right page turning; Individual face's front picture when opening left eye of user representes to confirm, individual face's front picture when opening left eye of user is represented cancellation, and individual face's front picture when opening right eye of user is represented cancellation.
Then this moment, matching unit 402 specifically is used for being eye motion information matches control command according to the control command of receiving element 405 preservations and the corresponding relation of eye motion sample.
Wherein, matching unit 402 can comprise that texture matees subelement, sample is confirmed subelement and the definite subelement of instruction;
Texture coupling subelement is used for said eye motion information and eye motion sample are carried out picture texture coupling;
Sample is confirmed subelement, is used for confirming to mate most the eye motion sample according to matching degree;
Subelement is confirmed in instruction, is used for the control command and the corresponding relation of eye motion sample through searching preservation, confirms and matees eye motion sample control instruction corresponding most.
Optional, in order more accurately to extract eye motion information, and let this control method have more personalization; Can the corresponding control method of one cover all be set respectively for each user; If each user has corresponding eye motion sample, then before from face's pictorial information, extracting eye motion information, can also judge whether the active user had extracted the eye sample action earlier; And can confirm further which the pairing eye motion sample of active user is; Just carry out follow-up operation then, if the active user did not extract the eye sample action, then can process ends; Perhaps point out the user to extract the eye motion sample earlier and carry out the setting of control command, or the like.That is to say that this portable terminal can also comprise recognition unit;
Recognition unit is used for face's pictorial information of getting access to according to information acquisition unit, confirms that through face recognition technology the active user is the user who extracted the eye sample action.
Then information acquisition unit 401, specifically are used for obtaining through camera face's pictorial information of user, confirm that at recognition unit the active user is when extracting the user of eye sample action, from face's pictorial information, extract eye motion information.
In addition, before portable terminal and network-termination device communicate, also need connect with network-termination device, such as, wireless connections such as WiFi or bluetooth can be set up.Promptly this portable terminal can also comprise and sets up the unit;
Set up the unit, be used to set up and network-termination device between wireless connections.
More than the practical implementation of each unit can repeat no more at this, during practical implementation referring to the embodiment of front; More than each unit can be used as independent entity and realize; Also can carry out combination in any, realize, repeat no more at this as same or plurality of entity.
This portable terminal specifically can be equipment such as mobile phone, palmtop PC, personal computer.
By on can know; The sample acquisition unit 404 of the portable terminal of present embodiment can be obtained user's eye motion sample, and sends to network-termination device by transmitting element 403, so that network-termination device is provided with the corresponding relation between eye motion sample and the control command; Then after receiving element 405 receives and preserves this corresponding relation; Utilize the corresponding relation of this preservation to come the eye motion information matches control command that gets access to for information acquisition unit 401 by matching unit 402, and be handed down to network-termination device to the control command that coupling obtains, thereby realization comes the purpose of the operation of Control Network terminal equipment through eye motion by transmitting element 403; This scheme is easy to operate; For the user provides another kind of mode to the operation of network-termination device, particularly when user's inconvenience is operated network-termination device with hand, injured such as user's hand; In the time of perhaps can't vacateing affairs on hand, effect is more outstanding.
Embodiment five,
Correspondingly, the embodiment of the invention also provides a kind of network-termination device, and is as shown in Figure 5, and this network-termination device comprises sample receiving element 501, unit 502 is set, transmitting element 503 and command reception unit 504;
Sample receiving element 501 is used for the eye motion sample that mobile terminal receive sends; For example, specifically can be following:
Face's pictorial information that sample receiving element 501 mobile terminal receives send; Wherein, Face's pictorial information can comprise individual face's front picture when opening right eye of individual face's front picture and user when opening left eye of face's front picture when eyes of user is just being seen, the face's front picture when an eyes of user left side is seen, the face's front picture when the eyes of user right side is seen, user; Wherein, each pictures is as an eye motion sample.
If the eye motion sample is specially: individual face's front picture when opening right eye of individual face's front picture and user when opening left eye of the face's front picture when eyes of user is just being seen, the face's front picture when an eyes of user left side is seen, the face's front picture when the eyes of user right side is seen, user.Then the corresponding relation of eye motion sample and control command specifically can be following any one:
Face's front picture when (1) an eyes of user left side is seen is represented left page turning; Face's front picture when the eyes of user right side is seen is represented right page turning; Individual face's front picture when opening left eye of user is represented cancellation, and individual face's front picture when opening left eye of user is represented cancellation, and individual face's front picture when opening right eye of user is represented to confirm; Perhaps,
Face's front picture when (2) an eyes of user left side is seen is represented right page turning; Face's front picture when the eyes of user right side is seen is represented left page turning; Individual face's front picture when opening left eye of user is represented cancellation, and individual face's front picture when opening left eye of user is represented cancellation, and individual face's front picture when opening right eye of user is represented to confirm; Perhaps,
Face's front picture when (3) an eyes of user left side is seen is represented right page turning; Face's front picture when the eyes of user right side is seen is represented left page turning; Individual face's front picture when opening left eye of user representes to confirm, individual face's front picture when opening left eye of user is represented cancellation, and individual face's front picture when opening right eye of user is represented cancellation; Perhaps,
Face's front picture when (4) an eyes of user left side is seen is represented left page turning; Face's front picture when the eyes of user right side is seen is represented right page turning; Individual face's front picture when opening left eye of user representes to confirm, individual face's front picture when opening left eye of user is represented cancellation, and individual face's front picture when opening right eye of user is represented cancellation.
Transmitting element 503 is used for the corresponding relation of control command and eye motion sample is sent to portable terminal, so that portable terminal is an eye motion information matches control command according to corresponding relation;
Wherein, unit 503 being set can comprise the prompting subelement and subelement is set;
The prompting subelement, being used to point out the user is that each eye motion sample is selected the control corresponding instruction;
Subelement is set, is used for being provided with the corresponding relation of each eye motion sample and control command according to user's selection.
Sample receiving element 501; Specifically be used for face's pictorial information that mobile terminal receive sends; Wherein, Face's pictorial information comprises individual face's front picture when opening right eye of individual face's front picture and user when opening left eye of face's front picture when eyes of user is just being seen, the face's front picture when an eyes of user left side is seen, the face's front picture when the eyes of user right side is seen, user, and wherein, each pictures is as an eye motion sample.
In addition, before network-termination device and portable terminal communicate, also need connect with portable terminal, such as, wireless connections such as WiFi or bluetooth can be set up.That is, this network-termination device can also comprise and sets up the unit;
Set up the unit, be used to set up and portable terminal between wireless connections.
More than the practical implementation of each unit can repeat no more at this, during practical implementation referring to the embodiment of front; More than each unit can be used as independent entity and realize; Also can carry out combination in any, realize, repeat no more at this as same or plurality of entity.
This network-termination device specifically can be STB.
By on can know; The eye motion sample that the sample receiving element 501 of the network-termination device of present embodiment can mobile terminal receive sends the corresponding relation between eye motion sample and the control command by unit 503 is set, and then by transmitting element 503 this corresponding relation is fed back to portable terminal; So that portable terminal utilizes this corresponding relation to come the eye motion information matches control command for getting access to; Thereby realize coming through eye motion the purpose of the operation of Control Network terminal equipment, this scheme is easy to operate, for the user provides another kind of mode to the operation of network-termination device; Particularly when user's inconvenience is operated network-termination device with hand; Injured such as user's hand, in the time of perhaps can't vacateing affairs on hand, effect is more outstanding.
Embodiment six,
A kind of communication system comprises any network-termination device that any portable terminal that the embodiment of the invention provides and the embodiment of the invention provide, for example, and can be following:
Portable terminal; Be used to obtain the eye motion sample, the eye motion sample is sent to network-termination device, receive and preserve the control command of network-termination device transmission and the corresponding relation of eye motion sample; Obtain eye motion information; According to the control command of preserving and the corresponding relation of eye motion sample, be this eye motion information matches control command, the control command that the transmission coupling obtains is given network-termination device.
Network-termination device; Be used for the eye motion sample that mobile terminal receive sends; For the eye motion sample is provided with the control corresponding instruction; The corresponding relation of controlled instruction and eye motion sample sends to portable terminal with the corresponding relation of control command and eye motion sample, the control command that the coupling that mobile terminal receive sends obtains.
More than each equipment specifically can repeat no more at this referring to front embodiment.
Below will make schematic illustration to the concrete execution flow process of this communication system, as follows:
Step 1, portable terminal obtain the eye motion sample; This eye motion sample can be provided with according to user's hobby and custom, for example, and specifically can be following:
Obtain face's pictorial information of user through camera; Wherein, face's pictorial information can comprise individual face's front picture when opening right eye of individual face's front picture and user when opening left eye of face's front picture when eyes of user is just being seen, the face's front picture when an eyes of user left side is seen, the face's front picture when the eyes of user right side is seen, user; Can be with each pictures as an eye motion sample.
Step 2, portable terminal send to network-termination device with the eye motion sample that gets access to.
The eye motion sample that step 3, network-termination device mobile terminal receive send; And control corresponding instruction is set for the eye motion sample; Such as; Specifically can on screen, point out the user is that each eye motion sample is selected the control corresponding instruction, and the corresponding relation of each eye motion sample and control command is set according to user's selection then.For example, specifically can be following:
If the eye motion sample is specially: individual face's front picture when opening right eye of individual face's front picture and user when opening left eye of the face's front picture when eyes of user is just being seen, the face's front picture when an eyes of user left side is seen, the face's front picture when the eyes of user right side is seen, user.Then the corresponding relation of eye motion sample and control command specifically can be following any one:
Face's front picture when (1) an eyes of user left side is seen is represented left page turning; Face's front picture when the eyes of user right side is seen is represented right page turning; Individual face's front picture when opening left eye of user is represented cancellation, and individual face's front picture when opening left eye of user is represented cancellation, and individual face's front picture when opening right eye of user is represented to confirm; Perhaps,
Face's front picture when (2) an eyes of user left side is seen is represented right page turning; Face's front picture when the eyes of user right side is seen is represented left page turning; Individual face's front picture when opening left eye of user is represented cancellation, and individual face's front picture when opening left eye of user is represented cancellation, and individual face's front picture when opening right eye of user is represented to confirm; Perhaps,
Face's front picture when (3) an eyes of user left side is seen is represented right page turning; Face's front picture when the eyes of user right side is seen is represented left page turning; Individual face's front picture when opening left eye of user representes to confirm, individual face's front picture when opening left eye of user is represented cancellation, and individual face's front picture when opening right eye of user is represented cancellation; Perhaps,
Face's front picture when (4) an eyes of user left side is seen is represented left page turning; Face's front picture when the eyes of user right side is seen is represented right page turning; Individual face's front picture when opening left eye of user representes to confirm, individual face's front picture when opening left eye of user is represented cancellation, and individual face's front picture when opening right eye of user is represented cancellation.
Step 4, network-termination device send to portable terminal with the corresponding relation of control command and eye motion sample.
Step 5, portable terminal receive and preserve the control command of network-termination device transmission and the corresponding relation of eye motion sample;
Step 6, portable terminal obtain eye motion information;
For example, can obtain face's pictorial information of user, from the face's pictorial information that gets access to, extract eye motion information then through camera.
Step 7, portable terminal are eye motion information matches control command according to the control command of preserving and the corresponding relation of eye motion sample, specifically can be following:
Eye motion information and eye motion sample are carried out picture texture coupling; Confirm to mate most the eye motion sample according to matching degree; The control command through searching preservation and the corresponding relation of eye motion sample are then confirmed and are mated eye motion sample control instruction corresponding most.
The control command that step 8, portable terminal transmission coupling obtain is given network-termination device.
The control command that the coupling that step 9, network-termination device mobile terminal receive send obtains is operated household electrical appliances according to control command.Optional, network-termination device can return response message and give portable terminal.
Certainly, before this, need connect between portable terminal and the network equipment terminal, such as, wireless connections such as WiFi or bluetooth can be set up, then execution in step 1.
By on can know; The communication system of present embodiment can be through being provided with the corresponding relation between eye motion sample and the control command, and utilize the corresponding relation of this setting to come the eye motion information matches control command for getting access to, thereby realize coming through eye motion the purpose of the operation of Control Network terminal equipment; This scheme is easy to operate; For the user provides another kind of mode to the operation of network-termination device, particularly when user's inconvenience is operated network-termination device with hand, injured such as user's hand; In the time of perhaps can't vacateing affairs on hand, effect is more outstanding.
One of ordinary skill in the art will appreciate that all or part of step in the whole bag of tricks of the foregoing description is to instruct relevant hardware to accomplish through program; This program can be stored in the computer-readable recording medium; Storage medium can comprise: read-only memory (ROM; Read Only Memory), random access memory (RAM, Random Access Memory), disk or CD etc.
More than control method, device and the system of a kind of network-termination device that the embodiment of the invention provided carried out detailed introduction; Used concrete example among this paper principle of the present invention and execution mode are set forth, the explanation of above embodiment just is used for helping to understand method of the present invention and core concept thereof; Simultaneously, for those skilled in the art, according to thought of the present invention, the part that on embodiment and range of application, all can change, in sum, this description should not be construed as limitation of the present invention.
Claims (12)
1. the control method of a network-termination device is characterized in that, comprising:
Obtain eye motion information;
According to prerequisite is said eye motion information matches control command;
The control command that the transmission coupling obtains is given network-termination device.
2. method according to claim 1 is characterized in that, said obtaining before the eye motion information also comprises:
Obtain the eye motion sample;
Said eye motion sample is sent to network-termination device, the control corresponding instruction is set so that said network-termination device is said eye motion sample;
Receive and preserve the control command of network-termination device transmission and the corresponding relation of eye motion sample;
Then said is that said eye motion information matches control command is specially according to prerequisite: according to the control command of preserving and the corresponding relation of eye motion sample, be said eye motion information matches control command.
3. method according to claim 2 is characterized in that, said network-termination device is that said eye motion sample is provided with the control corresponding instruction, is specially:
Network-termination device prompting user is that each eye motion sample is selected the control corresponding instruction;
The corresponding relation of each eye motion sample and control command is set according to user's selection.
4. method according to claim 2 is characterized in that, saidly is said eye motion information matches control command according to the control command of preserving and the corresponding relation of eye motion sample, is specially:
Said eye motion information and eye motion sample are carried out picture texture coupling;
Confirm to mate most the eye motion sample according to matching degree;
The control command through searching preservation and the corresponding relation of eye motion sample are confirmed and are mated eye motion sample control instruction corresponding most.
5. the control method of a network-termination device is characterized in that, comprising:
The eye motion sample that mobile terminal receive sends;
For said eye motion sample is provided with control corresponding instruction, the corresponding relation of controlled instruction and eye motion sample;
The corresponding relation of control command and eye motion sample is sent to portable terminal, so that portable terminal is an eye motion information matches control command according to said corresponding relation;
The control command that the coupling that mobile terminal receive sends obtains.
6. control method according to claim 5 is characterized in that, said for the eye motion sample is provided with the control corresponding instruction, the corresponding relation of controlled instruction and eye motion sample is specially:
The prompting user is that each eye motion sample is selected the control corresponding instruction;
The corresponding relation of each eye motion sample and control command is set according to user's selection.
7. a portable terminal is characterized in that, comprising:
Information acquisition unit is used to obtain eye motion information;
Matching unit, being used for according to prerequisite is the eye motion information matches control command that information acquisition unit gets access to;
Transmitting element is used to send the control command that the matching unit coupling obtains and gives network-termination device.
8. portable terminal according to claim 7 is characterized in that, also comprises sample acquisition unit and receiving element;
Said sample acquisition unit is used to obtain the eye motion sample;
Said transmitting element also is used for said eye motion sample is sent to network-termination device, so that said network-termination device is said eye motion sample the control corresponding instruction is set;
Said receiving element is used to receive and preserve the control command of network-termination device transmission and the corresponding relation of eye motion sample;
Then said matching unit specifically is used for being said eye motion information matches control command according to the control command of preserving and the corresponding relation of eye motion sample.
9. portable terminal according to claim 8 is characterized in that, said matching unit comprises:
Texture coupling subelement is used for said eye motion information and eye motion sample are carried out picture texture coupling;
Sample is confirmed subelement, is used for confirming to mate most the eye motion sample according to matching degree;
Subelement is confirmed in instruction, is used for the control command and the corresponding relation of eye motion sample through searching preservation, confirms and matees eye motion sample control instruction corresponding most.
10. a network-termination device is characterized in that, comprising:
The sample receiving element is used for the eye motion sample that mobile terminal receive sends;
The unit is set, is used to said eye motion sample control corresponding instruction, the corresponding relation of controlled instruction and eye motion sample are set;
Transmitting element is used for the corresponding relation of control command and eye motion sample is sent to portable terminal, so that portable terminal is an eye motion information matches control command according to said corresponding relation;
The command reception unit is used for the control command that coupling that mobile terminal receive sends obtains.
11. network-termination device according to claim 10 is characterized in that, the said unit that is provided with comprises:
The prompting subelement, being used to point out the user is that each eye motion sample is selected the control corresponding instruction;
Subelement is set, is used for being provided with the corresponding relation of each eye motion sample and control command according to user's selection.
12. a communication system is characterized in that, comprises described any portable terminal of claim 7 to 9 and described any network-termination device of claim 10 to 11.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110281889A CN102316219A (en) | 2011-09-21 | 2011-09-21 | Method for controlling network terminal equipment, apparatus and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110281889A CN102316219A (en) | 2011-09-21 | 2011-09-21 | Method for controlling network terminal equipment, apparatus and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102316219A true CN102316219A (en) | 2012-01-11 |
Family
ID=45429020
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110281889A Pending CN102316219A (en) | 2011-09-21 | 2011-09-21 | Method for controlling network terminal equipment, apparatus and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102316219A (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102611801A (en) * | 2012-03-30 | 2012-07-25 | 深圳市金立通信设备有限公司 | System and method for controlling mobile phone interaction based on eye movement trajectory |
| CN103294178A (en) * | 2012-02-29 | 2013-09-11 | 联想(北京)有限公司 | Man-machine interaction control method and electronic terminal |
| CN103869829A (en) * | 2012-12-13 | 2014-06-18 | 鸿富锦精密工业(武汉)有限公司 | Display screen moving system and method |
| CN103869829B (en) * | 2012-12-13 | 2016-11-30 | 鸿富锦精密工业(武汉)有限公司 | Display screen mobile system and method |
| CN106647398A (en) * | 2016-12-23 | 2017-05-10 | 广东美的制冷设备有限公司 | Remote controller, operation control method and device |
| CN107801098A (en) * | 2016-08-31 | 2018-03-13 | 南京中兴新软件有限责任公司 | The instruction executing method and device of set top box |
| CN107992816A (en) * | 2017-11-28 | 2018-05-04 | 广东小天才科技有限公司 | One kind is taken pictures searching method, device and electronic equipment |
| WO2018195941A1 (en) * | 2017-04-28 | 2018-11-01 | 深圳市元征科技股份有限公司 | Method and device for controlling object placement vehicle in stadium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040174435A1 (en) * | 1999-06-28 | 2004-09-09 | Olympus Optical Co., Ltd. | Information processing system and camera system |
| CN1896918A (en) * | 2005-07-15 | 2007-01-17 | 英华达(上海)电子有限公司 | Method for controlling input on manual equipment by face expression |
| CN201145883Y (en) * | 2008-01-30 | 2008-11-05 | 叶盛誉 | Hand-hold mobile terminal with motion recognition function and hereby being operated and controlled |
| CN101825947A (en) * | 2010-05-04 | 2010-09-08 | 中兴通讯股份有限公司 | Method and device for intelligently controlling mobile terminal and mobile terminal thereof |
| CN101950353A (en) * | 2010-08-17 | 2011-01-19 | 深圳市同洲电子股份有限公司 | Method and mobile terminal for controlling device remotely by image identification |
| CN102096501A (en) * | 2010-11-26 | 2011-06-15 | 深圳市同洲电子股份有限公司 | Method and system for controlling set top box by using mobile terminal |
-
2011
- 2011-09-21 CN CN201110281889A patent/CN102316219A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040174435A1 (en) * | 1999-06-28 | 2004-09-09 | Olympus Optical Co., Ltd. | Information processing system and camera system |
| CN1896918A (en) * | 2005-07-15 | 2007-01-17 | 英华达(上海)电子有限公司 | Method for controlling input on manual equipment by face expression |
| CN201145883Y (en) * | 2008-01-30 | 2008-11-05 | 叶盛誉 | Hand-hold mobile terminal with motion recognition function and hereby being operated and controlled |
| CN101825947A (en) * | 2010-05-04 | 2010-09-08 | 中兴通讯股份有限公司 | Method and device for intelligently controlling mobile terminal and mobile terminal thereof |
| CN101950353A (en) * | 2010-08-17 | 2011-01-19 | 深圳市同洲电子股份有限公司 | Method and mobile terminal for controlling device remotely by image identification |
| CN102096501A (en) * | 2010-11-26 | 2011-06-15 | 深圳市同洲电子股份有限公司 | Method and system for controlling set top box by using mobile terminal |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103294178A (en) * | 2012-02-29 | 2013-09-11 | 联想(北京)有限公司 | Man-machine interaction control method and electronic terminal |
| CN102611801A (en) * | 2012-03-30 | 2012-07-25 | 深圳市金立通信设备有限公司 | System and method for controlling mobile phone interaction based on eye movement trajectory |
| CN103869829A (en) * | 2012-12-13 | 2014-06-18 | 鸿富锦精密工业(武汉)有限公司 | Display screen moving system and method |
| CN103869829B (en) * | 2012-12-13 | 2016-11-30 | 鸿富锦精密工业(武汉)有限公司 | Display screen mobile system and method |
| CN107801098A (en) * | 2016-08-31 | 2018-03-13 | 南京中兴新软件有限责任公司 | The instruction executing method and device of set top box |
| CN107801098B (en) * | 2016-08-31 | 2021-10-29 | 中兴通讯股份有限公司 | Instruction execution method and device of set top box |
| CN106647398A (en) * | 2016-12-23 | 2017-05-10 | 广东美的制冷设备有限公司 | Remote controller, operation control method and device |
| WO2018195941A1 (en) * | 2017-04-28 | 2018-11-01 | 深圳市元征科技股份有限公司 | Method and device for controlling object placement vehicle in stadium |
| CN107992816A (en) * | 2017-11-28 | 2018-05-04 | 广东小天才科技有限公司 | One kind is taken pictures searching method, device and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102316219A (en) | Method for controlling network terminal equipment, apparatus and system | |
| CN105608861B (en) | Control method of electronic device and device | |
| CN107708014B (en) | Method and device for automatically switching master-slave relation of wireless earphone and wireless earphone | |
| CN104468837B (en) | The binding method and device of smart machine | |
| CN104935615B (en) | Realize the system and method for voice control household appliance | |
| CN105187871B (en) | A kind of method and system of the mobile terminal data transmission television terminal based on NFC | |
| CN105242556A (en) | A speech control method and device of intelligent devices, a control device and the intelligent device | |
| CN105282583B (en) | A kind of remote controler intelligent Matching system and implementation method | |
| EP1758356A3 (en) | Mobile phone, communication terminal, phone call method and phone call program | |
| CN102346643A (en) | Realization method and device for learnable type remoter | |
| CN109285546B (en) | Control system and method of terminal, storage medium and electronic device | |
| CN104605793A (en) | Floor cleaning robot system and intelligent household electrical appliance system | |
| CN104601715B (en) | A kind of file sharing method based on Quick Response Code, system and mobile terminal | |
| CN105407111A (en) | Earphone recognition data processing method and system | |
| CN107942690A (en) | It is a kind of to control the intelligence system of household electrical appliances and the control method based on the system | |
| CN108600057A (en) | A kind of method and system perceiving control household electrical appliance based on WiFi | |
| CN106101773A (en) | Content is with shielding method, device and display device | |
| CN108694946A (en) | A kind of speaker control method and system | |
| CN103794215A (en) | Speech control-based handheld terminal, system and speech control-based control method | |
| CN106550487A (en) | WI FI direct-connected method and system | |
| CN204332356U (en) | A kind of voice command recognition device | |
| CN103873661A (en) | State switching method and electronic equipment | |
| CN105187471B (en) | Information switching method and system | |
| CN104731615A (en) | Intelligent device configuration method and device | |
| CN109712380A (en) | Find method and device, the storage medium, terminal device, remote control equipment of remote control equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20120111 |