CN109803450A - Wireless device and computer connection method, electronic device and storage medium - Google Patents
Wireless device and computer connection method, electronic device and storage medium Download PDFInfo
- Publication number
- CN109803450A CN109803450A CN201811520441.9A CN201811520441A CN109803450A CN 109803450 A CN109803450 A CN 109803450A CN 201811520441 A CN201811520441 A CN 201811520441A CN 109803450 A CN109803450 A CN 109803450A
- Authority
- CN
- China
- Prior art keywords
- computer
- wireless device
- wireless
- image
- face
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Position Input By Displaying (AREA)
Abstract
The present invention relates to artificial intelligence, a kind of wireless device and computer connection method, electronic device and storage medium are provided, method includes: that the wireless connector of every computer receives the connection signal that wireless device is sent, and every computer all includes camera, display and wireless connector；The camera of every computer obtains the image of corresponding imaging area and storage；Recognition of face is carried out respectively to the image that each camera obtains, and according to the area-of-interest of the facial image interception left eye and right eye that recognize；The line-of-sight detection and tracking at eyeball center are carried out according to the area-of-interest being truncated to, according to the display that the sight at eyeball center is invested, the wireless connector for the corresponding computer of display that the sight at eyeball center is invested is connect with wireless device.The present invention, which controls multiple computers using a set of wireless device, to be switched, and helps to need the user in face of multiple computers work, save the cost improves switching control efficiency.
Description
Technical field
The present invention relates to artificial intelligence fields, specifically, being related to a kind of wireless device and computer connection method, electronics fill
It sets and storage medium.
Background technique
Key mouse communication includes multiple wireless technology standards such as bluetooth, Wi-Fi, Infrared, ZigBee at present,
But it is all difficult to realize a set of wireless key mouse switching control multiple computers equipment, existing implementation has sieve skill K480 blue on the market
The product of the higher costs such as tooth keyboard, the k4u of amulet hotkey, wireless key mouse+KVM, and switching is controlled substantially by rotation
Button, hot key, mouse remove the poor modes of user experiences such as interface.
Summary of the invention
In order to solve the above technical problems, the present invention provides a kind of wireless device and computer connection method, is applied to electronics and fills
It sets, every computer all includes camera, display and wireless connector, and the wireless connector is for receiving wireless device transmitting
Connection signal computer is connect with wireless device, the wireless connector of every computer receives the connection letter that wireless device is sent
Number；The camera of every computer obtains the image of corresponding imaging area and storage；To each camera obtain image respectively into
Row recognition of face, to identify facial image, and according to the region of interest of the facial image interception left eye and right eye that recognize
Domain；The line-of-sight detection and tracking at eyeball center are carried out according to the area-of-interest being truncated to, and according to the sight at eyeball center institute
The display of trend of purchasing, the wireless connector and wireless device of the corresponding computer of display that the sight at the eyeball center is invested
Connection.
Preferably, recognition of face forms people using multiple disaggregated models in Haar feature or LBP feature training OpenCV
Face recognition classifier, for carrying out recognition of face.
Preferably, recognition of face only identifies frontal faces, and the region of right and left eyes is marked off based on frontal faces, for just
Face face, the area size of right and left eyes and position be probably it is fixed, the length and width of entire image are respectively wI、hI, the length of ocular
Width is wE, hE,
wE=35wI/100
hE=35hI/100
Left eye ROI image top left corner pixel point position coordinates: xL=13wI/ 100, yL=25hI/100；
Right eye ROI image top left corner pixel point position coordinates: xR=wI-wE-13wI/ 100, yR=25hI/100。
Preferably, on entire eyeball, normalized displacement vector d is calculatediWith gradient vector giDot product, and ask
Optimal eyeball center c* is taken, i.e., that most point of the straight line intersection on gradient direction, formula is as follows:
Wherein, c* is eyeball center；
diIt is to preset eyeball center to position xiMotion vector；
giIt is in position XiGradient vector；
N is the number of the pixel of eyeball；
T is the transposition of vector；
C is default eyeball center；
XiIt is any point coordinate in eyeball.
Preferably, the wireless device is by bluetooth, infrared, wifi, 2.4G wireless transmission, radio frequency, ZigBee
A kind of mode to connect with computer.
Preferably, recognition of face only identifies frontal faces, for occurring the case where multiple positive face images in camera, only with
The facial image identified at first connect to control wireless device with computer.
Preferably, wireless device also detects and saves finger print information, and the finger print information is associated with recognition of face, only with
The facial image of the people of the currently detected finger print information of wireless device connect to control wireless device with computer.
Preferably, by controlling switching push button switching control people, so that pressing the face detected after control switching push button
Image connect to control wireless device with computer.
The present invention also provides a kind of electronic device, described device includes: memory, processor, camera and is stored in institute
The wireless device and computer linker that can be run on memory and on the processor are stated, the wireless device and computer connect
Connect program to be executed by the processor, it can be achieved that following steps: the wireless connector of every computer receives what wireless device was sent
Connection signal, every computer all include camera, display and wireless connector, and the wireless connector is wirelessly set for receiving
The connection signal that preparation is penetrated connect computer with wireless device；The camera of every computer obtains the image of corresponding imaging area
And it stores；The image obtained to each camera carries out recognition of face respectively, to identify facial image, and according to recognizing
Facial image interception left eye and right eye area-of-interest；The sight at eyeball center is carried out according to the area-of-interest being truncated to
Detection and tracking, and the display invested according to the sight at eyeball center, the display that the sight at the eyeball center is invested
The wireless connector of the corresponding computer of device is connect with wireless device.
It include wirelessly setting in the computer readable storage medium the present invention also provides a kind of computer readable storage medium
It is standby with computer linker, when the wireless device and computer linker are executed by processor, realize as described above wireless
The step of equipment and computer connection method.
Wireless device of the invention strengthens software development with computer connection method, electronic device and storage medium and reduces
Hardware cost demand, hardware merely add wireless connector, are controlled by recognition of face and eyeball central vision and wirelessly set
The standby connection with computer.User experience is improved, the display of eye focus is captured by camera, thus switching control computer,
User hardly feels switching.A set of wireless device, which controls multiple computers, to be switched, and help needs to work in face of multiple computers
User, resolve that there are few line equipment occupation spaces or a set of wireless device but frequently to plug wireless connector to controlling
Problem on the computer of system.
Detailed description of the invention
By the way that embodiment is described in conjunction with following accompanying drawings, features described above of the invention and technological merit will become
More understands and be readily appreciated that.
Fig. 1 is the wireless device of the embodiment of the present invention and the flow diagram of computer connection method；
Fig. 2 is the floor map of the area-of-interest interception of the embodiment of the present invention；
Fig. 3 is the hardware structure schematic diagram of the electronic device of the embodiment of the present invention；
Fig. 4 is the wireless device of the embodiment of the present invention and the module structure drafting of computer linker.
Specific embodiment
Wireless device of the present invention and computer connection method, electronic device and storage described below with reference to the accompanying drawings
The embodiment of medium.Those skilled in the art will recognize, without departing from the spirit and scope of the present invention the case where
Under, described embodiment can be modified with a variety of different modes or combinations thereof.Therefore, attached drawing and description are in essence
On be it is illustrative, be not intended to limit the scope of the claims.In addition, in the present specification, attached drawing is not in scale
It draws, and identical appended drawing reference indicates identical part.
Wireless device of the present invention can be wireless by sending such as wireless mouse, Wireless Keyboard, wireless controller
The equipment that signal is connect with the wireless connector of installation on computers.
Fig. 1 is the flow diagram of wireless device provided in an embodiment of the present invention and computer connection method, and this method includes
Following steps:
Step S10, the wireless connector of every computer receive the connection signal that wireless device is sent, wherein every computer
It all include camera, display and wireless connector.Wherein, wireless connector is the connection letter to receive wireless device transmission
Number, the wireless connector on each computer can receive the connection signal of wireless device transmitting.Camera is for obtaining it
The image of imaging area.Although each wireless connector has received the connection signal of wireless device transmission, the present embodiment
That only computer is connect by wireless connector with wireless device, therefore, as use this connection signal come with wirelessly
Equipment generates connection, is controlled by the capture of the eye sight line of step S40.
Step S20, the camera of every computer all obtain the image of respective imaging area and storage.
Step S30 carries out recognition of face for image acquired in every computer, according to the facial image recognized respectively
(area-of-interest, in field of image processing, area-of-interest is selected from image to the ROI region of interception left eye and right eye
One image-region, this region are image analysis emphasis of interest, draw a circle to approve the region to be further processed).
Step S40 carries out the line-of-sight detection and tracking at eyeball center according to the area-of-interest being truncated to, and according to eyeball
The display that the sight at center is invested, the wireless connection for the corresponding computer of display that the sight at the eyeball center is invested
Device is connect with wireless device.Since wireless device is connect with a certain computer, it is possible to pass through wireless device controls institute
State a certain computer.For example, wireless device if it is wireless mouse and Wireless Keyboard, then can control a certain computer
Pointer on display can input information on computer by Wireless Keyboard.And other computers are not connect then with wireless device,
Wireless device not can control other computers.
In one alternate embodiment, recognition of face use OpenCV (be a cross-platform computer vision library, can be with
It operates in Linux, Windows, Android and Mac OS operating system, is made of a series of C functions and C++ class, mentions simultaneously
The interface for having supplied the language such as Python, Ruby, MATLAB realizes many general calculations in terms of image procossing and computer vision
Method) in model, using Haar feature or LBP (Local Binary Pattern, local binary patterns) feature training it is multiple
Weak typing model forms recognition of face classifier, for carrying out recognition of face.Wherein, Haar feature is a kind of reflection image
Grey scale change, pixel sub-module seeks a kind of feature of difference.It is divided into three classes: edge feature, linear character, central feature and
Diagonal line feature.Be combined into feature templates with two kinds of rectangle frames of black and white, in feature templates with black rectangle pixel and subtract it is white
Color rectangular pixels and come the characteristic value that indicates this template.Wherein, LBP feature is that one kind is used to describe image local textural characteristics
Operator can be understood as certain characteristic reactions caused by grey scale change in image procossing for extracting the texture in feature.
In one alternate embodiment, as shown in Fig. 2, the recognition of face only identifies frontal faces, and using frontal faces as base
Plinth marks off the region of right and left eyes.For frontal faces, the area size of right and left eyes and position be probably it is fixed, entire image
Length and width are respectively wI、hI, the length and width of ocular are wE, hE,
wE=35wI/100
hE=35hI/100
Left eye ROI image top left corner pixel point position coordinates: xL=13wI/ 100, yL=25hI/100；
Right eye ROI image top left corner pixel point position coordinates: xR=wI-wE-13wI/ 100, yR=25hI/100。
In one alternate embodiment, it can use circle to substitute eyeball image, in order to obtain eyeball center.For
For eyeball, it is more proximate to the position at eyeball center, gray value is lower, and the straight line for just having more gradient directions meets at eye
Ball center.Therefore, normalized displacement vector d can be calculated on entire eyeballiWith gradient vector giDot product, and ask
Optimal eyeball center c* is taken, i.e., that most point of the straight line intersection on gradient direction, formula is as follows:
Wherein, c* is eyeball center；
diIt is to preset eyeball center to position xiMotion vector；
giIt is in position xiGradient vector；
N is the number of the pixel of eyeball；
T is the transposition of vector；
C is default eyeball center；
xiIt is any point coordinate in eyeball.
In one alternate embodiment, the wireless mouse and Wireless Keyboard can be for example, by bluetooth, it is infrared,
Wifi, 2.4G wireless transmission, radio frequency, one in ZigBee (being the low-power consumption LAN protocol based on IEEE802.15.4 standard)
Kind mode to connect with computer.
In one alternate embodiment, the recognition of face only identifies frontal faces, for occurring multiple fronts in camera
The case where face image, is only connect with the facial image identified at first to control wireless device with computer.For example, all existing there are two people
A computer is watched in front attentively.If connect with a certain computer before wireless mouse and Wireless Keyboard, that is to say, that it
Before have and the first connect by the first control with a computer using computer, wireless mouse and Wireless Keyboard.Second people occurs
And same computer is watched attentively with the first front simultaneously.Then controlled using only the first facial image identified in advance
The connection of wireless mouse and Wireless Keyboard and computer.The eyeball sight of the facial image of second people is not tracked, so that second
People will not cause confusion to the connection of wireless mouse and Wireless Keyboard and computer.Alternatively, it is multiple everybody to face computer simultaneously, but
Control computer people only one, then the people for needing to control computer appears in camera in advance, in advance identify the people face
Image, and track its eyeball sight and fall on the display of which computer, and the facial image occurred after other is not tracked then
Eyeball sight.
In one alternate embodiment, if the image in camera does not have frontal faces, mouse and keyboard are maintained at it
On that computer of preceding connection.If it is first connection, then prompt user to just a certain computer, otherwise wireless mouse and wireless
Keyboard is not connect with any computer.
In one alternate embodiment, usual wireless mouse and Wireless Keyboard are to be operated simultaneously by a people, Ke Yitong
The fingerprint for crossing detection user carrys out the connection of match control wireless mouse and Wireless Keyboard and computer.Wireless device, which is detected and saved, to be referred to
Line information, the finger print information is associated with recognition of face, only with the people of the people of the currently detected finger print information of wireless device
Face image connect to control wireless device with computer.For example, when the first use wireless mouse and Wireless Keyboard, wireless mouse inspection
It surveys and saves the first finger print information.The second people is exchanged with to come using wireless mouse and Wireless Keyboard, although it is the first simultaneously
It does not leave, but faces the camera of a certain computer side by side with the second people.At this point, the second people operation wireless mouse, but nothing
The first fingerprint is not detected in Line Mouse, then the first company that can not be further continued for control Wireless Keyboard, wireless mouse and computer
It connects.Turn the connection that Wireless Keyboard, wireless mouse and computer are controlled by the second people.
In one alternate embodiment, by controlling switching push button switching control people, so that after pressing control switching push button
The facial image detected connect to control wireless device with computer.Such as control switching push button is provided on Wireless Keyboard,
Control switching push button is clicked, then can be controlled with switching control people, the connection of Wireless Keyboard, wireless mouse and computer by another people
System.For example, the facial image of recognition of face before there are the first, two people of the second people, it is the first control before, is pressing control
After switching push button processed, then no longer track the first eyeball sight, and only track the eyeball sight of the second people, so as to by
The connection of second people control Wireless Keyboard and wireless mouse and computer.
As shown in fig.3, being the hardware structure schematic diagram of the embodiment of electronic device of the present invention.It is described in the present embodiment
Electronic device 2 be it is a kind of can according to the instruction for being previously set or store, automatic progress numerical value calculating and/or information processing
Equipment.For example, it may be smart phone, tablet computer, laptop, desktop computer, rack-mount server, blade type take
It is engaged in device, tower server or Cabinet-type server (including server set composed by independent server or multiple servers
Group) etc..As shown in figure 3, the electronic device 2 includes at least, but it is not limited to, depositing for connection can be in communication with each other by system bus
Reservoir 21, processor 22, camera 23, wireless connector 24.Wherein: the memory 21 includes at least a type of calculating
Machine readable storage medium storing program for executing, the readable storage medium storing program for executing include flash memory, hard disk, multimedia card, card-type memory (for example, SD or DX
Memory etc.), random access storage device (RAM), static random-access memory (SRAM), read-only memory (ROM), electrically erasable
Except programmable read only memory (EEPROM), programmable read only memory (PROM), magnetic storage, disk, CD etc..One
In a little embodiments, the memory 21 can be the internal storage unit of the electronic device 2, such as the electronic device 2 is hard
Disk or memory.In further embodiments, the memory 21 is also possible to the External memory equipment of the electronic device 2, example
The plug-in type hard disk being equipped on such as electronic device 2, intelligent memory card (Smart Media Card, SMC), secure digital
(Secure Digital, SD) card, flash card (Flash Card) etc..Certainly, the memory 21 can also both include described
The internal storage unit of electronic device 2 also includes its External memory equipment.In the present embodiment, the memory 21 is commonly used in depositing
Storage is installed on the operating system and types of applications software of the electronic device 2, such as the wireless device and computer linker
Code etc..In addition, the memory 21 can be also used for temporarily storing the Various types of data that has exported or will export.
The processor 22 can be in some embodiments central processing unit (Central Processing Unit,
CPU), controller, microcontroller, microprocessor or other data processing chips.The processor 22 is commonly used in the control electricity
The overall operation of sub-device 2, such as execute control relevant to the electronic device 2 progress data interaction or communication and processing
Deng.In the present embodiment, the processor 22 is for running the program code stored in the memory 21 or processing data, example
Wireless device and computer linker as described in running.
The camera 23 is installed on each computer, the image in image pickup scope for capturing camera.And by its
The image transmitting of shooting is stored to memory 21, and processor 22, which is executed, to be connect for the wireless device stored on memory 21 with computer
Program executes recognition of face and eyeball sight capture function.
Wherein, wireless connector 24 is the connection signal for receiving the transmission of wireless device 100, the nothing on each computer
Wiring connector 24 can receive the connection signal of the transmitting of wireless device 100.
It should be pointed out that Fig. 3 illustrates only the electronic device 2 with component 21-23, it should be understood that not
It is required that implement all components shown, the implementation that can be substituted is more or less component.
It may include operating system, wireless device and computer linker 50 in memory 21 comprising readable storage medium storing program for executing
Deng.Processor 22 realizes following steps when executing wireless device and computer linker 50 in memory 21:
Step S10, the wireless connector of every computer receive the connection signal that wireless device is sent, wherein every computer
It all include camera, display and wireless connector.Wherein, wireless connector is the connection letter to receive wireless device transmission
Number, the wireless connector on each computer can receive the connection signal of wireless device transmitting.Camera is for obtaining it
The image of imaging area.Although each wireless connector has received the connection signal of wireless device transmission, the present embodiment
That only computer is connect by wireless connector with wireless device, therefore, as use this connection signal come with wirelessly
Equipment generates connection, is controlled by the capture of the eye sight line of step S40.
Step S20, the camera of every computer all obtain the image of respective imaging area and storage.
Step S30 carries out recognition of face for image acquired in every computer, according to the facial image recognized respectively
(area-of-interest, in field of image processing, area-of-interest is selected from image to the ROI region of interception left eye and right eye
One image-region, this region are image analysis emphasis of interest, draw a circle to approve the region to be further processed).
Step S40 carries out the line-of-sight detection and tracking at eyeball center according to the area-of-interest being truncated to, and according to eyeball
The display that the sight at center is invested, the wireless connection for the corresponding computer of display that the sight at the eyeball center is invested
Device is connect with wireless device.Since wireless device is connect with a certain computer, it is possible to pass through wireless device controls institute
State a certain computer.For example, wireless device if it is wireless mouse and Wireless Keyboard, then can control a certain computer
Pointer on display can input information on computer by Wireless Keyboard.And other computers are not connect then with wireless device,
Wireless device not can control other computers.
In the present embodiment, the wireless device being stored in memory 21 can be divided into computer linker
One or more program module, one or more of program modules are stored in memory 21, and can by one or
Multiple processors (the present embodiment is processor 22) are performed, to complete the present invention.For example, Fig. 4 shows the wireless device
With the program module schematic diagram of computer linker, in the embodiment, the wireless device and computer linker 50 can be by
It is divided into wireless connector control module 501, camera control module 502, face recognition module 503, area-of-interest interception
Module 504, eye tracking module 505.Wherein, the so-called program module of the present invention is to refer to complete a series of of specific function
Computer program instructions section, than program more suitable for describing the wireless device and computer linker in the electronic device 2
In implementation procedure.The concrete function of the program module will specifically be introduced by being described below.
Wherein, the wireless connector that wireless connector control module 501 controls every computer receives what wireless device was sent
Connection signal, and control whether wireless connector connect with wireless device.Wherein, every computer all includes camera, display
And wireless connector.
The camera that camera control module 502 controls every computer all obtains image and the storage of respective imaging area.
Face recognition module 503 carries out recognition of face to image acquired in every computer respectively, identifies facial image.
Area-of-interest interception module 504 intercepts the ROI region of left eye and right eye according to the facial image recognized.
Eye tracking module 505 is connect with wireless connector control module 501.Eye tracking module 505 is according to being truncated to
Area-of-interest carry out the line-of-sight detection and tracking at eyeball center, and the display invested according to the sight at eyeball center,
The information for the display that eye tracking module 505 is invested to the sight that wireless connector control module 501 sends eyeball center, nothing
The wireless connector for the corresponding computer of display that the sight that wiring connector control module 501 controls the eyeball center is invested
It is connect with wireless device.
In one alternate embodiment, face recognition module 503 (is one based on BSD license distribution using in OpenCV
Cross-platform computer vision library, may operate in Linux, Windows, Android and MacOS operating system, by a system
Column C function and C++ class are constituted, while providing the interface of the language such as Python, Ruby, MATLAB, realize image procossing and
Many general-purpose algorithms in terms of computer vision) in model, using Haar feature or LBP (Local Binary Pattern,
Local binary patterns) the multiple weak typing models of feature training, recognition of face classifier is formed, for carrying out recognition of face.Wherein,
Haar feature is a kind of grey scale change for reflecting image, and pixel sub-module seeks a kind of feature of difference.It is divided into three classes: edge
Feature, linear character, central feature and diagonal line feature.Feature templates are combined into two kinds of rectangle frames of black and white, in feature templates
The interior characteristic value with black rectangle pixel with white rectangle pixel is subtracted and to indicate this template.Wherein, LBP feature is a kind of
For describing the operator of image local textural characteristics, for extracting the texture in feature, ash can be understood as in image procossing
Certain characteristic reactions caused by degree changes.
In one alternate embodiment, area-of-interest interception module 504 only identifies frontal faces, and based on frontal faces
Mark off the region of right and left eyes.For frontal faces, the area size of right and left eyes and position are probably fixed, the length of entire image
Width is respectively wI、hI, the length and width of ocular are wE、hE,
wE=35wI/100
hE=35hI/100
Left eye ROI image top left corner pixel point position coordinates: xL=13wI/ 100, yL=25hI/100；
Right eye ROI image top left corner pixel point position coordinates: xR=wI-wE-13wI/ 100, yR=25hI/100。
In one alternate embodiment, eye tracking module 505 substitutes eyeball image using circle, in order to obtain eye
Ball center.For eyeball, it is more proximate to the position at eyeball center, gray value is lower, just has more gradient directions
Straight line meet at eyeball center.Therefore, normalized displacement vector di and gradient vector g can be calculated on entire eyeballi's
Dot product, and seek optimal eyeball center c*, i.e., that most point of the straight line intersection on gradient direction, formula is such as
Under:
Wherein, c* is eyeball center；
diIt is to preset eyeball center to position xiMotion vector；
giIt is in position xiGradient vector；
N is the number of the pixel of eyeball；
T is the transposition of vector；
C is default eyeball center；
xiIt is any point coordinate in eyeball.
In one alternate embodiment, wireless device can be for example, by bluetooth, infrared, wifi, 2.4G wireless transmission,
One of radio frequency, ZigBee (being the low-power consumption LAN protocol based on IEEE802.15.4 standard) mode come with computer connect
It connects.
It in one alternate embodiment, further include preferential attachment module 508, for occurring multiple frontal faces figures in camera
The case where picture, preferential attachment module 508 are only connect with the facial image identified at first to control wireless device with computer.For example,
A computer all is watched attentively in front there are two people.If connected with a certain computer before wireless mouse and Wireless Keyboard
It connects, that is to say, that have before and the first connected by the first control with computer using computer, wireless mouse and Wireless Keyboard
It connects.Second people occurs and watches same computer attentively with the first front simultaneously.It is then used only identified in advance the first
Facial image controls the connection of wireless mouse and Wireless Keyboard and computer.The eyeball sight of the facial image of second people is refused
Tracking, so that the second people will not cause confusion to the connection of wireless mouse and Wireless Keyboard and computer.Alternatively, multiple, everybody is same
When face computer, but control computer people only one, then the people for needing to control computer appears in camera in advance, in advance know
The facial image of other the people, and track its eyeball sight and fall on the display of which computer, and to the face occurred after other
Image does not track eyeball sight then.
It in one alternate embodiment, further include that connection keeps module 509, if the image in camera is without front
Face then connects on that computer connected before keeping module 509 that wireless mouse and Wireless Keyboard are maintained at.If it is first
Secondary connection then prompts user to just a certain computer, and otherwise wireless mouse and Wireless Keyboard are not connect with any computer.
In one alternate embodiment, wireless device and computer linker 50 further include fingerprint identification module 506.Usually
Wireless mouse and Wireless Keyboard are to be operated simultaneously by a people, can be by detecting the fingerprint of user come the wireless mouse of match control
The connection of mark and Wireless Keyboard and computer.Wireless device detects the fingerprint of user, and finger print information is sent to fingerprint recognition mould
Block 506.The finger print information is associated with recognition of face, only with the eyeball of the people of the currently detected finger print information of wireless device
Central vision connect to control wireless device with computer.For example, when the first use wireless mouse and Wireless Keyboard, wireless mouse
The first finger print information is had detected, and is sent to the storage of fingerprint identification module 506.Be exchanged with the second people come using wireless mouse and
Wireless Keyboard, although the first do not leave, but face the camera of a certain computer side by side with the second people.At this point,
Second people operates wireless mouse, and wireless mouse is sent to fingerprint identification module 506, fingerprint recognition after detecting the fingerprint of the second people
Really admit a fault the first fingerprint after the comparison of module 506, then the first to control Wireless Keyboard, wireless mouse and computer again
Connection turns the connection that Wireless Keyboard, wireless mouse and computer are controlled by the second people.
In one alternate embodiment, wireless device and computer linker 50 further include switching control module 507, switching
Control module 507 is by control switching push button switching control people, so that the facial image detected after pressing switching push button is controlled
Wireless device processed is connect with computer.Such as switching push button is provided on Wireless Keyboard, switching push button is clicked, then can be switched
People is controlled, the connection of Wireless Keyboard, wireless mouse and computer is controlled by another people.For example, the facial image of recognition of face before
There are the first, two people of the second people, be the first control before, after having pressed switching push button, then no longer tracks the first
Eyeball sight, and the eyeball sight of the second people is only tracked, so as to control Wireless Keyboard and wireless mouse and electricity by the second people
The connection of brain.More than two people, then switching push button can be pressed again, then switch over, switch so as to successively sequence
Control the people for needing to control.
In addition, the embodiment of the present invention also proposes a kind of computer readable storage medium, the computer readable storage medium
It can be hard disk, multimedia card, SD card, flash card, SMC, read-only memory (ROM), Erasable Programmable Read Only Memory EPROM
(EPROM), any one in portable compact disc read-only memory (CD-ROM), USB storage etc. or several timess
Meaning combination.The specific embodiment of the computer readable storage medium of the present invention and above-mentioned wireless device and computer connection method with
And the specific embodiment of electronic device 2 is roughly the same, details are not described herein.
The above description is only a preferred embodiment of the present invention, is not intended to restrict the invention, for those skilled in the art
For member, the invention may be variously modified and varied.All within the spirits and principles of the present invention, it is made it is any modification,
Equivalent replacement, improvement etc., should all be included in the protection scope of the present invention.
Claims (10)
1. a kind of wireless device and computer connection method, be applied to electronic device, every computer all include camera, display and
Wireless connector, the connection signal that the wireless connector is used to receive wireless device transmitting connect computer and wireless device
It connects, which is characterized in that
The wireless connector of every computer receives the connection signal that wireless device is sent；
The camera of every computer obtains the image of corresponding imaging area and storage；
The image obtained to each camera carries out recognition of face respectively, to identify facial image, and according to recognizing
The area-of-interest of facial image interception left eye and right eye；
The line-of-sight detection and tracking at eyeball center are carried out according to the area-of-interest being truncated to, and according to the sight at eyeball center institute
The display of trend of purchasing, the wireless connector and wireless device of the corresponding computer of display that the sight at the eyeball center is invested
Connection.
2. wireless device according to claim 1 and computer connection method, which is characterized in that recognition of face is special using Haar
Sign or LBP feature train multiple disaggregated models in OpenCV, recognition of face classifier are formed, for carrying out recognition of face.
3. wireless device according to claim 1 and computer connection method, which is characterized in that
Recognition of face only identifies frontal faces, and the region of right and left eyes is marked off based on frontal faces, for frontal faces, right and left eyes
Area size and position be probably it is fixed, the length and width of entire image are respectively wI、hI, the length and width of ocular are wE, hE,
wE=35wI/100
hE=35hI/100；
Left eye ROI image top left corner pixel point position coordinates: xL=13wI/ 100, yL=25hI/100；
Right eye ROI image top left corner pixel point position coordinates: xR=wI-wE-13wI/ 100, yR=25hI/100。
4. wireless device according to claim 1 and computer connection method, which is characterized in that on entire eyeball, calculate
Normalized displacement vector diWith gradient vector giDot product, and seek optimal eyeball center c*, i.e., on gradient direction
That most point of straight line intersection, formula are as follows:
||gi||2=1
Wherein, c* is eyeball center；
diIt is to preset eyeball center to position xiMotion vector；
giIt is in position xiGradient vector；
N is the number of the pixel of eyeball；
T is the transposition of vector；
C is default eyeball center；
xiIt is any point coordinate in eyeball.
5. wireless device according to claim 1 and computer connection method, which is characterized in that
The wireless device be by one of bluetooth, infrared, wifi, 2.4G wireless transmission, radio frequency, ZigBee mode come with
Computer connection.
6. wireless device according to claim 1 and computer connection method, which is characterized in that
Recognition of face only identifies frontal faces, for occurring the case where multiple positive face images in camera, only to identify at first
Facial image connect to control wireless device with computer.
7. wireless device according to claim 1 and computer connection method, which is characterized in that
Wireless device also detects and saves finger print information, and the finger print information is associated with recognition of face, is only worked as with wireless device
Before the facial image of the people of finger print information that detects connect to control wireless device with computer.
8. wireless device according to claim 1 and computer connection method, which is characterized in that
By controlling switching push button switching control people, so that pressing after control switching push button the facial image that detects to control nothing
Line equipment is connect with computer.
9. a kind of electronic device, which is characterized in that described device includes: memory, processor, camera and is stored in described deposit
On reservoir and the wireless device that can run on the processor and computer linker, the wireless device connect journey with computer
Sequence is executed by the processor, it can be achieved that following steps:
The wireless connector of every computer receives the connection signal that wireless device is sent, and every computer all includes camera, display
Device and wireless connector, the connection signal that the wireless connector is used to receive wireless device transmitting make computer and wireless device
Connection；
The camera of every computer obtains the image of corresponding imaging area and storage；
The image obtained to each camera carries out recognition of face respectively, to identify facial image, and according to recognizing
The area-of-interest of facial image interception left eye and right eye；
The line-of-sight detection and tracking at eyeball center are carried out according to the area-of-interest being truncated to, and according to the sight at eyeball center institute
The display of trend of purchasing, the wireless connector and wireless device of the corresponding computer of display that the sight at the eyeball center is invested
Connection.
10. a kind of computer readable storage medium, which is characterized in that include wireless device in the computer readable storage medium
With computer linker, when the wireless device and computer linker are executed by processor, realize as in claim 1 to 8
The step of described in any item wireless devices and computer connection method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811520441.9A CN109803450A (en) | 2018-12-12 | 2018-12-12 | Wireless device and computer connection method, electronic device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811520441.9A CN109803450A (en) | 2018-12-12 | 2018-12-12 | Wireless device and computer connection method, electronic device and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109803450A true CN109803450A (en) | 2019-05-24 |
Family
ID=66556644
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811520441.9A Pending CN109803450A (en) | 2018-12-12 | 2018-12-12 | Wireless device and computer connection method, electronic device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109803450A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110362207A (en) * | 2019-07-17 | 2019-10-22 | 广州魅视电子科技有限公司 | A kind of mouse control system based on the micro- expression of face |
| WO2024040861A1 (en) * | 2022-08-25 | 2024-02-29 | 湖北星纪魅族科技有限公司 | Operation permission control method and system, and electronic device and storage medium |
Citations (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100066855A1 (en) * | 2008-09-12 | 2010-03-18 | Sony Corporation | Image display apparatus and detection method |
| CN102622590A (en) * | 2012-03-13 | 2012-08-01 | 上海交通大学 | Identity recognition method based on face-fingerprint cooperation |
| US20120246079A1 (en) * | 2011-03-24 | 2012-09-27 | Dave William Wilson | Authentication using application authentication element |
| CN103021053A (en) * | 2012-11-22 | 2013-04-03 | 成都江法科技有限公司 | Security system for human face recognition |
| EP2587436A2 (en) * | 2011-10-28 | 2013-05-01 | Adidas AG | Interactive retail system |
| CN103336577A (en) * | 2013-07-04 | 2013-10-02 | 宁波大学 | Mouse control method based on facial expression recognition |
| CN103793692A (en) * | 2014-01-29 | 2014-05-14 | 五邑大学 | Low-resolution multi-spectral palm print and palm vein real-time identity recognition method and system |
| CN103839034A (en) * | 2012-11-22 | 2014-06-04 | 成都江法科技有限公司 | Security protection system based on facial identification cloud server |
| CN103902027A (en) * | 2012-12-26 | 2014-07-02 | 鸿富锦精密工业（深圳）有限公司 | Intelligent switching device and intelligent switching method and system thereof |
| CN104239891A (en) * | 2014-08-12 | 2014-12-24 | 广州恺悦通信技术有限公司 | Remote intelligent evidence obtaining system |
| CN104268591A (en) * | 2014-09-19 | 2015-01-07 | 海信集团有限公司 | Face key point detecting method and device |
| CN104537351A (en) * | 2014-12-31 | 2015-04-22 | 深圳泰山在线科技有限公司 | Quick large-number face recognition method and system |
| CN104656884A (en) * | 2013-11-25 | 2015-05-27 | 大连佑嘉软件科技有限公司 | Intelligent terminal human-computer interaction method capable of fusing human face and gesture |
| CN106326880A (en) * | 2016-09-08 | 2017-01-11 | 电子科技大学 | Pupil center point positioning method |
| WO2017076652A1 (en) * | 2015-11-03 | 2017-05-11 | Barco Nv | Method and system for optimized routing of data streams in telecommunication networks |
| CN106990839A (en) * | 2017-03-21 | 2017-07-28 | 张文庆 | A kind of eyeball identification multimedia player and its implementation |
| CN107633206A (en) * | 2017-08-17 | 2018-01-26 | 平安科技（深圳）有限公司 | Eyeball motion capture method, device and storage medium |
| CN108427938A (en) * | 2018-03-30 | 2018-08-21 | 广东欧珀移动通信有限公司 | Image processing method, device, storage medium and electronic equipment |
| CN108491823A (en) * | 2018-03-30 | 2018-09-04 | 百度在线网络技术（北京）有限公司 | Method and apparatus for generating eye recognition model |
| CN108764041A (en) * | 2018-04-25 | 2018-11-06 | 电子科技大学 | The face identification method of facial image is blocked for lower part |
-
2018
- 2018-12-12 CN CN201811520441.9A patent/CN109803450A/en active Pending
Patent Citations (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100066855A1 (en) * | 2008-09-12 | 2010-03-18 | Sony Corporation | Image display apparatus and detection method |
| US20120246079A1 (en) * | 2011-03-24 | 2012-09-27 | Dave William Wilson | Authentication using application authentication element |
| EP2587436A2 (en) * | 2011-10-28 | 2013-05-01 | Adidas AG | Interactive retail system |
| CN102622590A (en) * | 2012-03-13 | 2012-08-01 | 上海交通大学 | Identity recognition method based on face-fingerprint cooperation |
| CN103021053A (en) * | 2012-11-22 | 2013-04-03 | 成都江法科技有限公司 | Security system for human face recognition |
| CN103839034A (en) * | 2012-11-22 | 2014-06-04 | 成都江法科技有限公司 | Security protection system based on facial identification cloud server |
| CN103902027A (en) * | 2012-12-26 | 2014-07-02 | 鸿富锦精密工业（深圳）有限公司 | Intelligent switching device and intelligent switching method and system thereof |
| CN103336577A (en) * | 2013-07-04 | 2013-10-02 | 宁波大学 | Mouse control method based on facial expression recognition |
| CN104656884A (en) * | 2013-11-25 | 2015-05-27 | 大连佑嘉软件科技有限公司 | Intelligent terminal human-computer interaction method capable of fusing human face and gesture |
| CN103793692A (en) * | 2014-01-29 | 2014-05-14 | 五邑大学 | Low-resolution multi-spectral palm print and palm vein real-time identity recognition method and system |
| CN104239891A (en) * | 2014-08-12 | 2014-12-24 | 广州恺悦通信技术有限公司 | Remote intelligent evidence obtaining system |
| CN104268591A (en) * | 2014-09-19 | 2015-01-07 | 海信集团有限公司 | Face key point detecting method and device |
| CN104537351A (en) * | 2014-12-31 | 2015-04-22 | 深圳泰山在线科技有限公司 | Quick large-number face recognition method and system |
| WO2017076652A1 (en) * | 2015-11-03 | 2017-05-11 | Barco Nv | Method and system for optimized routing of data streams in telecommunication networks |
| CN106326880A (en) * | 2016-09-08 | 2017-01-11 | 电子科技大学 | Pupil center point positioning method |
| CN106990839A (en) * | 2017-03-21 | 2017-07-28 | 张文庆 | A kind of eyeball identification multimedia player and its implementation |
| CN107633206A (en) * | 2017-08-17 | 2018-01-26 | 平安科技（深圳）有限公司 | Eyeball motion capture method, device and storage medium |
| CN108427938A (en) * | 2018-03-30 | 2018-08-21 | 广东欧珀移动通信有限公司 | Image processing method, device, storage medium and electronic equipment |
| CN108491823A (en) * | 2018-03-30 | 2018-09-04 | 百度在线网络技术（北京）有限公司 | Method and apparatus for generating eye recognition model |
| CN108764041A (en) * | 2018-04-25 | 2018-11-06 | 电子科技大学 | The face identification method of facial image is blocked for lower part |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110362207A (en) * | 2019-07-17 | 2019-10-22 | 广州魅视电子科技有限公司 | A kind of mouse control system based on the micro- expression of face |
| WO2024040861A1 (en) * | 2022-08-25 | 2024-02-29 | 湖北星纪魅族科技有限公司 | Operation permission control method and system, and electronic device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11587297B2 (en) | Virtual content generation | |
| Gorodnichy et al. | Nouse ‘use your nose as a mouse’perceptual vision technology for hands-free games and interfaces | |
| KR102173123B1 (en) | Method and apparatus for recognizing object of image in electronic device | |
| US9836263B2 (en) | Display control device, display control method, and program | |
| US7340078B2 (en) | Multi-sensing devices cooperative recognition system | |
| US9721387B2 (en) | Systems and methods for implementing augmented reality | |
| JP4061379B2 (en) | Information processing apparatus, portable terminal, information processing method, information processing program, and computer-readable recording medium | |
| US20130202160A1 (en) | Information processing terminal, recognition control method for the same, and recognition control program | |
| CN109937434A (en) | Image processing method, device, terminal and storage medium | |
| WO2020190547A1 (en) | Intelligent video presentation system | |
| JP5812550B1 (en) | Image display device, image display method, and program | |
| US20200211413A1 (en) | Method, apparatus and terminal device for constructing parts together | |
| WO2007108100A1 (en) | Video image information processing device, judging method, and computer program | |
| CN111340848A (en) | Object tracking method, system, device and medium for target area | |
| CN109803450A (en) | Wireless device and computer connection method, electronic device and storage medium | |
| US9501710B2 (en) | Systems, methods, and media for identifying object characteristics based on fixation points | |
| KR20200127928A (en) | Method and apparatus for recognizing object of image in electronic device | |
| CN109241942B (en) | Image processing method and device, face recognition equipment and storage medium | |
| EP3082017A1 (en) | Method and system for displaying additional information associated with a content via an optical head mounted display device | |
| CN115840550A (en) | Angle-adaptive display screen display method, device and medium | |
| US20230186596A1 (en) | Object recognition method, apparatus, device and storage medium | |
| JP2014219822A (en) | Content display device, content display method, program, and content display system | |
| CN111079662A (en) | Figure identification method and device, machine readable medium and equipment | |
| KR101844367B1 (en) | Apparatus and Method for Head pose estimation using coarse holistic initialization followed by part localization | |
| CN113420279A (en) | Password input method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190524 |
|
| RJ01 | Rejection of invention patent application after publication |