CN101794174A - Device, image user equipment and method using light source for inputting - Google Patents
Device, image user equipment and method using light source for inputting Download PDFInfo
- Publication number
- CN101794174A CN101794174A CN201010135918A CN201010135918A CN101794174A CN 101794174 A CN101794174 A CN 101794174A CN 201010135918 A CN201010135918 A CN 201010135918A CN 201010135918 A CN201010135918 A CN 201010135918A CN 101794174 A CN101794174 A CN 101794174A
- Authority
- CN
- China
- Prior art keywords
- light source
- movement locus
- target light
- image
- period
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention provides a method, an image user interface device and a device using a light source for inputting, wherein the device comprises an acquisition module and an analytic module, wherein the acquisition module is used for receiving images, acquired by image acquisition equipment at a certain frequency, of a target light source; and the analytic module is used for analyzing a movement track of the target light source during a period of time according to the images acquired by the image acquisition equipment during the period of time and outputting characters or control commands according to the movement track. The device or the method provided by the invention can use the light source to input the characters or control commands conveniently.
Description
Technical field
The invention belongs to technical field of electronic equipment, be specifically related to a kind of input media and method of utilizing light source.
Background technology
The input equipment of present existing realization man-machine interaction mainly contains, mouse, touch-screen, keyboard and touch pad etc.
Genius mouse claims mouse again, can be divided into mechanical mouse and optical mouse by the difference of its principle of work.Mechanical mouse mainly is made up of spin, roller and grating signal sensor.When dragging mouse, drive ball turns, spin drives roller again and rotates, be contained in the photoelectric pulse signal that the grating signal sensor of roller end produces and reflect the change in displacement of Genius mouse in vertical and horizontal direction, the mobile of cursor on the screen controlled in processing by computer program and conversion again.Optical mouse is by detecting the displacement of Genius mouse, displacement signal is converted to electric impulse signal, and moving of mouse pointer on the screen controlled in processing by program and conversion again.Optical mouse has replaced spin with photoelectric sensor.
Touch-screen is formed by touching detection part and touch screen controller.Touch detection part and be installed in the indicator screen front, be used to detect user touch location, send touch screen controller after the reception, and the main effect of touch screen controller is to receive touch information from touch point detection device, and converts it to contact coordinate.
And touch pad mainly is to utilize a special surface-mounted integrated circuit below the touch pad can ceaselessly measure and report out the track of touch, thereby finds out the action and the position of finger.
These above-mentioned input medias are not very convenient.
Summary of the invention
In view of this, an aspect of of the present present invention provides a kind of input equipment, and input character or control command easily comprise:
Acquisition module is used to receive the target light that image acquisition equipment obtains according to certain frequency
The image in source;
Parsing module is used for the image that obtains according to described image acquisition equipment in a period of time, resolve described target light source movement locus during this period of time, according to described movement locus output character or control command.
Another aspect of the present invention provides a kind of graphical user interface device, comprising:
Image acquisition equipment is used for obtaining according to certain frequency the image of target light source;
The above-mentioned input media that utilizes light source, described input media is connected from described image acquisition equipment;
Graphical user interface apparatus is used for the character of exporting at the described input media of graphical user interface displays or responds the control command that described input equipment is exported.
Another aspect of the present invention provides a kind of method of utilizing the light source input, comprising:
Utilize image acquisition equipment to obtain the image of a period of time internal object light source according to certain frequency;
According to the described target light source of described image analysis movement locus during this period of time;
According to described movement locus output character or control command.
Above-mentioned device, method can utilize light source input character or control command comparatively easily, and cost are lower, and application scenarios is extensive.
Description of drawings:
A kind of schematic block diagram that utilizes the input media of light source that Fig. 1 provides for an embodiment;
The application scenarios of the input media that utilizes light source that Fig. 2, Fig. 3 provide for another embodiment;
A kind of schematic flow sheet that utilizes the input method of light source that Fig. 4 provides for another embodiment;
The input media schematic block diagram that utilizes light source that Fig. 5 provides for another embodiment.
Embodiment:
For the present invention can better be understood, the utility model is described in further detail below in conjunction with Figure of description.
In each embodiment of the present invention, character can comprise the character that all buttons on the general keyboard can be exported, for example, and control character, English letter, numeral, Chinese character, radical, the character etc. of communicating with the eyes; Wherein, control character can comprise again: moving symbol up and down, delete mark, carriage-return character etc.And control command comprises, for example left click, right click, a left side are double-clicked, rightly double-click, slide up and down, horizontally slipped, the volume accent is turned down greatly, mobile phone release, music F.F., game control etc.
Embodiment 1:
See also Fig. 1, a kind of input media that utilizes light source be provided, comprising:
Wherein, target light source can be a pointolite, the pointolite of forming as the LED lamp of 3 primary colours.Can be within the imaging scope of image acquisition equipment, the movement locus of controlled target light source.And vision facilities obtains the image of target light source continuously according to certain frequency, by this continuous picture, and movement locus that can the measuring point light source.
Image acquisition equipment can be camera, video camera or digital camera, can take pictures according to certain frequency, and can export with digital format; Perhaps can export the video flowing of digital format.
If the time shutter is shorter, then the effect of catching can be better.Experiment confirm, the time shutter was that 30 frames/s or above frequency are obtained image less than 0.01 second according to frequency, captured target light source preferably, and recognition effect is better.In the image of imaging, the color of target light source will be easy to the background colour in the picture shot.
The image of digital format is made up of pixel one by one, and the color of each pixel can represent by numeral, for example, by (R, G represent that B) R represents redness (Red), G represents (Green), B (Blue), and different colors can be represented by different rgb values.Define a two-dimensional array,, in array, travel through then, search and equal or, thereby can find the position of target light source in image near the color pixel point of target light source in order to preserve the color attribute of pixel.
The position of target light source can adopt the form of coordinate to identify, and for example image is regarded as a coordinate axis, selects a coordinate, with (x, form y) is represented the position of target light source.
Because target light source may present a geometric configuration in image, for example be circular, oval, in order to obtain the position of target light source, can get the center.Certainly, also can get other positions according to actual needs.
In a period of time, image acquisition equipment will get access to multiple image, by obtaining the coordinate of target light source in these images, then coordinate is together in series, and just can obtain the movement locus of target light source.Here, can make smoothing processing to the movement locus of target light source earlier.
Can set a storehouse in advance, movement locus is set up mapping relations with different character or control command, after obtaining movement locus, just can obtain corresponding character or control command according to movement locus.
For example, can be with horizontal stroke from accomplishing, expression character 1; With horizontal stroke from right to left, expression character 2.When the movement locus that detects target light source for from left to right the time, output 1; If horizontal stroke from right to left then exports 2.
Perhaps, from the bottom up vertical line is expressed as on the mouse moves, when the movement locus that detects target light source during for from the bottom up vertical line, the control command of moving on the output mouse.
In actual applications, two kinds or more of patterns can be set, for example, keyboard mode is used to import various characters; Mouse mode is used to import various mouse actions; Perhaps the telepilot pattern is used for input and changes various commands such as platform, accent platform; The game paddle pattern is used to import various game operation orders.Switching command can use the change of the color of light source to realize.
Because may there be a certain distance in the track data of preserving in movement locus and the storehouse,, can adopt the corresponding same character of a plurality of tracks in order to increase the accuracy rate of identification.
The device that present embodiment provides can adopt FPGA (Field Programmable Gate Array) to realize, for example, can adopt on-site programmable gate array FPGA (Field Programmable Gate Array) to realize.This FPGA can have 3 ports, and a port is used to receive the image or the video flowing of input; Another port is used for output character; The 3rd port is used to export various control commands.Perhaps, this FPGA also can only have 2 ports, and a port is used to receive image or video flowing, and another port is used to export control command or character.
Utilize this FPGA,, promptly can be used as mouse or keyboard and use in conjunction with an image acquiring device.
Perhaps, the device that present embodiment provides also can adopt the application-specific integrated circuit ASIC chip to realize, is installed on equipment such as mobile phone, televisor.
Perhaps, the device that present embodiment provides can adopt software to realize, is carried out by chip with processing capacity or processor.For example, can run on computer, mobile phone, the set-top box.
The device that provides in this enforcement can be exported corresponding character or control command according to the movement locus of light source, and it is comparatively convenient to use, and cost is lower.
Embodiment 2:
See also Fig. 2, a kind of concrete application scenarios of the device that Fig. 2 provides for embodiment.In scene shown in Figure 2, target light source is a track rod, and this track rod can show multiple different color, by button, can change the color that the track rod shows.
Image acquisition equipment is a camera, is connected with PC, and the pixel of camera picture shot is 800 * 600, and the track rod moves within the imaging scope of camera.Camera is taken the movement locus of track rod according to the speed of 35 frame per seconds, and is input in the computer.
And character entry apparatus adopts software to realize, runs among the computer; Perhaps, also can adopt chip to realize, link to each other with computer by USB mouth, parallel port, serial ports, com port etc.
After character entry apparatus receives the image of camera shooting, become redness if detect the color of target light source, then begin to resolve the positional information in image of target light source, when the color of target light source in image becomes white, then stop to resolve the positional information of target light source in image, and the positional information of the target light source that obtains according to parsing, obtain target light source movement locus during this period of time, compare with the track storehouse of preserving in advance according to movement locus, obtain corresponding characters.
For example, if the track that transports of track rod is a serpentine, that corresponding serpentine is character S in the character library, and then output character S gives the input interface of computer; After computer receives the character " S " of input, can be at this character of graphical user interface displays; If there is the corresponding movement locus serpentine of a plurality of characters in the character library, then can export a plurality of characters, computer is listed these characters after receiving the character S of input on graphic user interface, select for the user.
Perhaps, if the movement locus of track rod is downward one perpendicular, the color of track rod be green, and then the output control character that moves down mouse is given computer, and mobile position is the relative displacement of excellent starting point of track and terminal point; If the color of track rod is red, then output character 1 is given computer.
After computer receives the character or control command of input, make corresponding response according to this character or control command.
See also Fig. 3, the Another Application scene that provides for present embodiment.The input media that utilizes light source that present embodiment provides can adopt JAVA software to realize, when the customer watching network TV of IPTV, can download corresponding application from the service provider, moves on set-top box; And a camera is installed in addition, to set-top box input picture or video flowing, as input media, receive user's input, as channel selection, input network address etc. with the track rod.
By above-mentioned description as can be seen, the device that present embodiment provides can be with people's gesture, is converted into character or control command is input to computer or televisor by target light source, thereby can reaches the effect of keyboard and mouse.
Embodiment 3:
See also Fig. 3, the method that provides for another embodiment shown in Figure 3 comprises the steps:
S401, utilize the image of image acquisition equipment according to certain frequency photographic subjects light source.
S403, when satisfying default first condition, begin to receive and preserve the photo of the shooting of image acquisition equipment.
First condition that should be default, can be when the color that detect target light source become first color or target light source has been opened or, can be that the user has imported a control command.
In the process that receives image, can resolve the position of target light source simultaneously; Further, can also on the display graphics user interface apparatus, show this target light source, to show the movement locus of taken target light source to the user.
S405, when satisfying default second condition, resolve target light source movement locus during this period of time.
The second condition that should preset can be that the color of target light source becomes another kind of color, and perhaps, target light source is opened circuit, and perhaps, also can be timer expiry etc.
When satisfying second condition, can be with within during this period of time, the coordinate of target light source in every pictures combines, and resolves the movement locus of target light source.For the ease of resolving, can carry out smoothing processing to the coordinate data of target light source in advance.
The method of resolving, for example, the relation between each that can calculate target light source by the method for statistical study put; Perhaps, can design the function of various possible movement locus in advance,, and then obtain the movement locus of target light source by the relation between the function validates coordinate.
In order to simplify computing, can define some simple movement locus, so that resolve.
Movement locus and track storehouse that S407, basis parse obtain character or control command.
In the track storehouse, stored the corresponding relation between movement locus and character or the control command in advance.The movement locus and the movement locus in the track storehouse that parse are compared, to obtain corresponding characters or control command.
In the track storehouse, movement locus and the corresponding relation of character time may be one-to-manies, can obtain a plurality of characters in this case.
The control command that S409, the character that obtains in graphical user interface displays or response obtain.
In the method that present embodiment provides, the user can be by the movement locus of controlled target light source, to graphic user interface input character or control command.
The method that present embodiment provides can be used as the input method of mobile phone, panel computer, Web TV etc.Than traditional input equipment, the method that present embodiment provides is imported more convenient.
Embodiment 4:
See also Fig. 5, a kind of input media that utilizes light source is provided, comprise acquisition module 501, parsing module 502 and control module 503.
Wherein, acquisition module 501 is used to receive the image of the target light source that image acquisition equipment obtains according to certain frequency.
This view data can be binary digital format, and frequency can be more than or equal to 30 frames/s.Frequency can be adjusted as required, and frequency is higher, and effect generally can be better.
Parsing module 502, the image that in a period of time, obtains according to image acquisition equipment 501, resolve target light source movement locus during this period of time, according to described movement locus output character or control command, perhaps according to the color output character or the control command of movement locus and target light source.
Provided a kind of corresponding relation below:
Further, parsing module 502 can be carried out and resolve according to the control command of control module 503 outputs.
Such as, in the time of order that the left button that receives control module 503 output is pressed, begin to resolve the image of target light source, in the time of message that the right button that receives control module 503 outputs is pressed, stop to resolve.
The device that present embodiment provides can be exported corresponding character or control command according to the movement locus of light source, and it is comparatively convenient to use, and cost is lower.
Embodiment 5:
Present embodiment provides a kind of method of utilizing the light source input, and in the present embodiment, image acquisition equipment is a camera, and this method comprises:
S601, when the color that detects target light source becomes the first default color, camera becomes other color according to the image of certain frequency photographic subjects light source up to target light source.
Wherein, other color comprises the color after target light source is switched off.After target light source is switched off, camera can not capture target light source, in this case, and can be with a kind of color of acquiescence, as the color of black as light source.
The movement locus of the image analysis target light source that S603, basis are taken during this period of time.
For example, can obtain the coordinate information of target light source in every pictures earlier, calculate the movement locus of target light source then according to coordinate information.
For the ease of analyzing and calculating, can define several fairly simple movement locus.
S605, according to the color of movement locus and target light source, the output corresponding characters.
For example, the corresponding relation in a track storehouse between definition movement locus and the character, one of them movement locus can corresponding a plurality of characters, and perhaps a plurality of movement locus can corresponding character.Corresponding character is exported in the movement locus that obtains according to parsing, the color and the track storehouse of target light source.
This method can be applicable to computer, the method that present embodiment provides, and its step can be passed through software code realization, is carried out by CPU; Link to each other with computer by the USB mouth as camera, the photo of the target light source of camera shooting is sent to the internal memory of computer by the USB mouth with binary form, and CPU can read picture data from internal memory, and analyzes.
Use apparatus and method provided by the invention, all use the equipment of graphic user interface (GUI) to obtain cursor position and key information can to realize computing machine, mobile phone, PDA, game machine, navigator, POS machine, household electrical appliance, industrial instrument, wearable computer etc., realize the function of similar mouse, touch pad and touch-screen and keyboard etc.
The above only is a preferred embodiment, be not that the present invention is done any formal and substantial restriction, all those skilled in the art, in not breaking away from the technical solution of the present invention scope, when utilizing the above technology contents that discloses, and the equivalent variations of a little change of making, modification and differentiation is equivalent embodiment of the present invention; Simultaneously, all foundations essence of the present invention all still belongs in the scope of technical scheme of the present invention change, modification and the differentiation of any equivalent variations that above embodiment did.
Claims (12)
1. an input media that utilizes light source is characterized in that, comprising:
Acquisition module is used to receive the image of the target light source that image acquisition equipment obtains according to certain frequency;
Parsing module is used for the image that obtains according to described image acquisition equipment in a period of time, resolve described target light source movement locus during this period of time, according to described movement locus output character or control command.
2. device as claimed in claim 1 is characterized in that, described parsing module comprises:
The track acquisition module is used for the image of the target light source during this period of time obtained according to described image acquisition equipment, resolves described target light source movement locus during this period of time; The track storehouse comprises the corresponding relation between movement locus and character or movement locus and the control command;
Matching module is used for described track acquisition module is resolved resulting movement locus, with the movement locus coupling in the described track storehouse, exports one or more corresponding characters or control command according to the degree of coupling.
3. device as claimed in claim 2; it is characterized in that; described track acquisition module; specifically be used for; the image that during this period of time obtains according to described image acquisition equipment; resolve the coordinate information of described target light source in described image, obtain the movement locus of described target light source according to described coordinate information.
4. as the arbitrary described device of claim 1-3, it is characterized in that, described parsing module, specifically be used for, when becoming the first default color, described target light source begins the image that obtained in become till the second default color during this period of time according to described acquisition module, resolve described target light source movement locus during this period of time, according to described movement locus output character or control command
5. as the arbitrary described device of claim 1-4, it is characterized in that described device also comprises control module, during the color change of target light source described in the image that is used for obtaining when described acquisition module, the output control command.
6. a graphical user interface device is characterized in that, comprising:
Image acquisition equipment is used for obtaining according to certain frequency the image of target light source; As the arbitrary described input media of claim 1-5, described input media is connected from described image acquisition equipment;
Graphical user interface apparatus is used for the character of exporting at the described input media of graphical user interface displays or responds the control command that described input equipment is exported.
7. device as claimed in claim 6 comprises computer, mobile phone, televisor, game machine, personal digital assistant, household electrical appliance and industrial instrumentation instrument.
8. a method of utilizing the light source input is characterized in that, comprising:
Utilize image acquisition equipment to obtain the image of a period of time internal object light source according to certain frequency;
According to the described target light source of described image analysis movement locus during this period of time;
According to described movement locus output character or control command.
9. method as claimed in claim 8 is characterized in that, and is described according to the described target light source of described image analysis movement locus during this period of time, comprising:
According to described image acquisition equipment image of obtaining in section during this period of time, resolve described target light source movement locus during this period of time;
Utilize the movement locus coupling in described movement locus and the track storehouse, export one or more corresponding characters or control command according to matching degree, described track storehouse comprises the corresponding relation between movement locus and character or movement locus and the control command.
10. method as claimed in claim 8 is characterized in that, the described image acquisition equipment that utilizes obtains the image of a period of time internal object light source according to certain frequency, comprising:
Utilize described image acquisition equipment according to certain frequency, obtain and become the first default color from described target light source and begin to becoming till the second default color image of internal object light source during this period of time.
11. method as claimed in claim 8 is characterized in that, and is described according to described movement locus output character or control command, comprising:
According to the color of described movement locus and/or described target light source, output character or control command.
12. method as claimed in claim 8 is characterized in that, described method also comprises:
Change output control command according to described target light source color.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010135918A CN101794174A (en) | 2010-03-31 | 2010-03-31 | Device, image user equipment and method using light source for inputting |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201010135918A CN101794174A (en) | 2010-03-31 | 2010-03-31 | Device, image user equipment and method using light source for inputting |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101794174A true CN101794174A (en) | 2010-08-04 |
Family
ID=42586903
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201010135918A Pending CN101794174A (en) | 2010-03-31 | 2010-03-31 | Device, image user equipment and method using light source for inputting |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101794174A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102671382A (en) * | 2011-03-08 | 2012-09-19 | 德信互动科技（北京）有限公司 | Somatic game device |
| WO2013104315A1 (en) * | 2012-01-09 | 2013-07-18 | 西安智意能电子科技有限公司 | Method and system for mapping for movement trajectory of emission light source application trajectory thereof |
| CN104915024A (en) * | 2014-03-10 | 2015-09-16 | 联想(北京)有限公司 | Control operation method, intelligent input pen and electronic device |
-
2010
- 2010-03-31 CN CN201010135918A patent/CN101794174A/en active Pending
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102671382A (en) * | 2011-03-08 | 2012-09-19 | 德信互动科技（北京）有限公司 | Somatic game device |
| WO2013104315A1 (en) * | 2012-01-09 | 2013-07-18 | 西安智意能电子科技有限公司 | Method and system for mapping for movement trajectory of emission light source application trajectory thereof |
| US20150084853A1 (en) * | 2012-01-09 | 2015-03-26 | Jeenon, LLC | Method and System for Mapping for Movement Trajectory of Emission Light Source Application Trajectory Thereof |
| CN104915024A (en) * | 2014-03-10 | 2015-09-16 | 联想(北京)有限公司 | Control operation method, intelligent input pen and electronic device |
| CN104915024B (en) * | 2014-03-10 | 2018-01-23 | 联想(北京)有限公司 | Method, intelligent input pen and the electronic equipment of control operation |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101859209A (en) | Infrared detection device and method, infrared input device and figure user equipment | |
| US11295552B2 (en) | Mobile user interface extraction | |
| CN104199550B (en) | Virtual keyboard operation device, system and method | |
| US8768006B2 (en) | Hand gesture recognition | |
| US8643598B2 (en) | Image processing apparatus and method, and program therefor | |
| RU2642404C2 (en) | Method and device for extracting image area | |
| KR100938337B1 (en) | An autonomous handheld device having a?drawing tool | |
| CN104199547B (en) | Virtual touch screen operation device, system and method | |
| CN108733296B (en) | Method, device and equipment for erasing handwriting | |
| CN102124435A (en) | Content display device and content display method | |
| CN101268434A (en) | An autonomous handheld device having a drawing tool | |
| CN104035555A (en) | System, Information Processing Apparatus, And Information Processing Method | |
| CN104199548B (en) | A kind of three-dimensional man-machine interactive operation device, system and method | |
| KR20210008403A (en) | Interaction method and system of information devices based on optical labels | |
| CN101794174A (en) | Device, image user equipment and method using light source for inputting | |
| CN104246673A (en) | Display control system, display device, and display panel | |
| JP2014029656A (en) | Image processor and image processing method | |
| US20180136740A1 (en) | Ambient light sensing device and method, and interactive device using same | |
| CN202093528U (en) | Character recognition system and translation system based on gestures | |
| JP2015132865A (en) | User adaptive interface provision system and method | |
| CN103201706A (en) | Method for driving virtual mouse | |
| CN105807989A (en) | Gesture touch method and system | |
| KR20140057150A (en) | System and method for transfering content among devices using touch command and unusual touch | |
| CN104267802A (en) | Human-computer interactive virtual touch device, system and method | |
| CN103543825A (en) | Camera cursor system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20100804 |