CN1533180A - Remote control device and method based on video frequency picture detection - Google Patents
Remote control device and method based on video frequency picture detection Download PDFInfo
- Publication number
- CN1533180A CN1533180A CNA031072488A CN03107248A CN1533180A CN 1533180 A CN1533180 A CN 1533180A CN A031072488 A CNA031072488 A CN A031072488A CN 03107248 A CN03107248 A CN 03107248A CN 1533180 A CN1533180 A CN 1533180A
- Authority
- CN
- China
- Prior art keywords
- remote control
- mark
- video image
- image
- detects
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
- H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
- H04N21/42222—Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Details Of Television Systems (AREA)
- Position Input By Displaying (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
This invention provides, a remote control device based on a video image detection including an image collection device collecting video images and converting them into video signals, a selection position computing device for detecting markers in the said signals and computing the optical marker position directed by the said remote control device, an order input device for inputting orders entering or exitting the menu item selection state to the said device and an signal transmitting device for receiving the optical position information output by the said selection position computing device and transmitting the control signals instructing the said optical marker position information to make the display devices to display the target directed by the device. It also includes a system and method applying remote control devices.
Description
Technical field
The present invention relates to a kind of remote control that detects based on picture and and method, particularly, relate to a kind of sensing of in interactive television, determining remote control, select the candidate object, thereby carry out the remote control and the method for straighforward operation with this by the detection mark.
Background technology
Common TV remote controller is selected television channel and different functions by the numeral that provides on the remote controller is provided with function button.But these remote controllers do not possess mutual selection function.Along with the continuous expansion of TV functions, only have simply watch function simulated television to having the development of interactivity, intelligentized Digital Television.In digital TV picture, except display video, can also provide menu interface to realize several data broadcasting, multimedia service and video request program (VOD) service etc.Choosing the specific part of menu in the picture etc. convenient and simplely, click operations such as selection, is to realize mutual basis between Digital Television and the people.
As in computer realm, at present realized that the instrument of identity function mainly is a mouse, but the motion of mouse and cursor mobile is not directly and nature corresponding, but the motion of cursor is got in touch or be corresponding in the motion on another plane with mouse with arrow key up and down, operation is nature inadequately.
Having the electronic equipment that disposes menu and programming menu at present normally utilizes the function key on the remote controller to access menu screen.When menu screen accessed, instructs cursor was usually located at the upper left corner of menu, and the user moves to instructs cursor on the option that will select by the directionkeys on the remote controller, pressed definite key again and selected this option.In the remote controller of prior art, the directionkeys that the user need press on the remote controller repeatedly just can make instructs cursor move to the menu option that will select.The menu option that shows on screen can cause operation more loaded down with trivial details more for a long time, lacks flexibility.In addition, under the situation of menu more complicated, the speed of the operating influence interactive operation of the remote controller of prior art.
Summary of the invention
An object of the present invention is to provide and a kind ofly determine the sensing of remote control, thereby and select the remote control system of particular options by the option that the mobile remote control device will be chosen its sensing by detecting mark in the television image.
Another object of the present invention provides a kind of remote control that utilizes and detects the sensing that mark in the television image is determined remote control, thereby and selectes the remote control of particular options by the option that the mobile remote control device will be chosen its sensing.
A further object of the present invention provides a kind ofly determines the sensing of remote control by detecting mark in the television image, thereby and selectes the method for particular options by the option that the mobile remote control device will be chosen its sensing.
According to a first aspect of the invention, a kind of remote control system that detects based on video image is provided, comprise: the remote control that is provided with image collecting device, described image collecting device is used to gather video image, so that described remote control detects the mark in the video image, and the target of pointing to according to the described remote control of the positional information calculation of mark; And display unit, be used to receive the control signal that described remote control sends, and show the video image of the mark that detects for described remote control and the interactive menu option of Gong choosing by the video display interface, and the target of indication remote control sensing.
According to a second aspect of the invention, provide a kind of remote control that detects based on video image, comprising: image collecting device is used to gather video image and converts described video image to vision signal; The chosen position calculation element is used for detecting the mark of described vision signal and calculates the cursor position that described remote control points to; Instruction inputting device is used for entering or withdraw from the instruction that menu option is chosen state to described remote control input; And remote control signal transmission device, be used to receive the cursor position information of described chosen position calculation element output and the control signal that described cursor position information is indicated in emission, so that display unit shows the target that described remote control points to.
According to a third aspect of the invention we, provide a kind of remote control thereof that detects based on video image, comprise step: gather the display unit video image displayed; Detect the mark that whether comprises the sensing that is used for definite remote control in the video image of being gathered; If comprise described mark in the described video image, then calculate the positional information of described mark on the display interface of described display unit; Point to the positional information of display interface according to the described remote control of the described positional information calculation of the described mark that calculates; The positional information of the described remote control that calculates being pointed to described display interface sends to described display unit, and shows the current selected option of described remote control on display interface.
Having overcome in the prior art needs according to remote control of the present invention and method presses button repeatedly and could select option to be selected and operate loaded down with trivial details defective.
Description of drawings
By below in conjunction with accompanying drawing to the detailed description that indefiniteness embodiment of the present invention did, will make above and other objects of the present invention, characteristic and advantage become clearer, wherein:
Fig. 1 is the schematic diagram of expression according to the remote control system of the embodiment of the invention;
Fig. 2 is the block diagram of expression according to the remote control system of the embodiment of the invention;
Fig. 3 is the flow chart of expression according to the operational processes of the remote control system of the embodiment of the invention;
Fig. 4 represents the profile of mark according to an embodiment of the invention;
Fig. 5 is an example of the captured image of expression remote controller of the present invention; With
Fig. 6 represents the profile of mark in accordance with another embodiment of the present invention.
Embodiment
Principle of the present invention is described below.At first, utilize on the remote control function key to send control signal to television set, make television set enter TV interactive operation state, TV also shows a special mark automatically except that showing the interactive menu picture on picture on screen.Secondly, take this menu screen detecting mark by being installed in image collecting device on the remote control, and draw remote control position pointed by the position of calculating this mark, that is the specific part in the picture that should choose.At last, the instructs cursor that demonstrates a correspondence at the picture position that calculates feeds back to the operator.The operator can change the position of choosing or carry out selection operation with reference to this instructs cursor.
Below with reference to accompanying drawing embodiments of the invention are described.
At first with reference to the schematic diagram of figure 1 description according to the remote control system of the embodiment of the invention.Remote control system according to the present invention is by comprising remote controller and television set.According to principle of the present invention, determine the position that remote controller is pointed by the picture that detects screen display, and select the menu option that to select by the sensing of change remote controller.The screen detection itself is a relatively problem of difficulty, because the pattern on the screen constantly changes, extraneous background light also may change at any time, and native system to require detection speed be real-time, therefore detect and cause a lot of interference to picture.In order to address these problems, the present invention adopts the method for show label thing on video screen that enters behind the detected state, realizes that rapid and precise screen detects.
Specifically, image collecting device is installed on TV remote controller.When the function key on pressing remote controller switches to menu screen with picture, the position of the mark in the image that photographs by the image collecting device in the remote controller is detected the position of video screen in real time, determine the position and the sensing of remote controller indication, reach the purpose of choosing the ad-hoc location in the picture.
Comprise television set 1 among Fig. 1, the picture 3 that the image collecting device of remote controller 2 and remote controller is captured.The position at mark place and the position that remote controller points in screen of TV set, have been marked.What the oval part in the upper right corner showed in the screen of television set 1 among the figure is mark, the point that the remote controller that the round dot in the screen shows points to, the captured picture of image collecting device of reference number 3 expression remote controllers 2.
An embodiment of remote control system of the present invention is described below with reference to Fig. 2.As shown in Figure 2, this remote control system comprises remote controller part 21 and the television set part 22 of sending control signal.Wherein remote controller part 21 comprises the image collecting device 23 of gathering image, calculate and detect mark and calculate the chosen position calculation element 24 of instructs cursor position, partly launch the remote control signal transmission device 25 of remote signal to television set, be used for control system and enter or withdraw from the instruction enter key 26 that menu option is chosen state.Instruction enter key 26 comprises that menu chooses start key and choose cancel key.Television set part 22 comprises video display devices 27 and remote signal receiver 28, and other device (not shown) that comprises in the television set.
The operation of remote control system of the present invention is described below.Remote controller detects and whether to enter screen and chooses state, if the start key of choosing of remote controller is pressed, to image scanner 23, is camera in the present embodiment, and chosen position calculation element 24 sends and enters the instruction that on-screen menu is chosen state.Enter the signal that menu is chosen state by signal receiver 28 emissions of the signal projector in the remote controller 25 in being arranged on television set.Remote control system then enters menu and chooses state.At this moment, show alternative menu option on the video screen.As a kind of substitute mode, at present operated by rotary motion has a data key on the digital television remote controller, is used to receive the data broadcasting service of general video outside viewing and admiring.Thereby, also can be set in and make remote control system enter menu when data key is pressed to choose state.After entering menu and choosing state, the inner vision signal that produces mark to be detected of TV also shows this mark on screen.
Next, remote controller is pointed to display screen, image collecting device 23 on the remote controller, be camera in the present embodiment, begin to take the image of direction, and become vision signal to offer chosen position calculation element 24 captured image transitions to handle (its processing procedure will be described below), obtain remote controller position pointed thus, and the sensing position of definite remote controller is in the scope of which menu option, and make corresponding menu option be in highlighted state, that is, make this menu option of cursor pointing.After this, the user can point to by changing remote controller simply, and option and utilization instruction enter key 26 that the remote controller sensing will be selected are selected.
The screen position selecting device of prior art, for example common menu is chosen remote controller, enter behind the state of choosing general cursor or focus and fall within on certain menu bar, choose corresponding menu bar by key all around or the numerical key pressed on the remote controller, the inconvenience that operates is nature also.
Different with the position selecting device of prior art, the present invention need determine the position relation of remote controller and screen.This is to reach by the mark that detects on the screen.After having determined relative position relation, we just can determine the position that instructs cursor should be pointed to, and as remote controller is referred to left, cursor also can relative moving to left on screen, and giving people's sensation is the luminous point that is sent by remote controller as cursor.It is convenient and natural to operate.
In a preferred embodiment of the invention, at first be to detect mark, be the sign object point that we need with which point on the image of determining camera 23 shootings on the remote controller.Next is the position of determining mark, so that determine the central point of mark by these detected sign object points.Because the relative position of mark and screen determines, the relative position relation of having known mark and remote controller has also just been known the relative position relation of screen and remote controller.After having determined the position of mark, just can determine the position of the instructs cursor that on screen, will show by geometrical relationship.
Below the preferred embodiment that detects mark and calculating remote controller sensing position among the present invention is described in detail.The at first detection of description flags thing.At the upper right corner of screen show label thing, but the invention is not restricted to this, mark can be presented at any position on the screen, as the bottom right or the lower left corner etc.At this moment remote controller pointed at television screen, image collecting device 23, promptly camera is filmed mark.
In the present embodiment, determine mark by the color that detects mark.In the image of taking, adopt the some detection and the median filter method of HSI color model to detect mark in real time.Wherein H represents colourity (Hue), and S represents saturation (Saturation), and I represents brightness (Intensity).Usually, the RGB color model is the most commonly used, and it thinks that color is by red (Red), and green (Green), blue (Blue) three kinds of basic colors mix.The combination of the varying strength of each basic color has just constituted different colors.For example, if the maximum intensity of every kind of basic color represents that with 8 bits so the maximum intensity of every kind of basic color is exactly 255, then redness is R=255, G=B=0; And yellow is R=G=255, B=0.But along with the light and shade of light changes, three components of RGB change simultaneously, do not have to embody the independent description to color.
The HSI color space is the vision system from the people, can show the variation situation of tone, brightness and color saturation very clearly.Usually the color harmony saturation is commonly referred to as colourity, is used for representing the classification and the depth degree of color.Because people's vision far is better than sensitivity to color to the sensitivity of brightness, handles and identification for the ease of color, people's vision system often adopts the HSI color space, and it more meets human vision property than rgb color space.Big quantity algorithm all can use in the HSI color space easily in image processing and computer vision, and they can separate processes and are separate.Therefore, in the HSI color space workload of simplified image analysis and processing greatly.
The HSI color space is the different representations of same physical quantity with rgb color space, thereby exists transformational relation between them.
Marker detection among the present invention be color showing with object from the RGB color notation conversion space to the HSI color space.After image collecting device 23 photographs mark, its color is handled the color binary map of the RGB that obtains this mark.Then, chosen position calculation element 24 is by calculating the HIS value that following conversion formula can obtain mark.Wherein obtain the gray value of mark by following formula (1)
I＝(R+G+B)/3 (1)
Wherein R, G, B represent trichromatic numerical value.
The saturation of formula (2) the calculation flag thing below utilizing:
S＝1-min(R，G，B)/I (2)
Wherein (B) expression is got R, G, the minimum value among the B to min for R, G.
Formula (3) below utilizing calculates colourity:
Wherein F is a variable, utilizes empirical equation to obtain F=(2*R-G-B)/(G-B);
It is constant substantially that H, S component can keep when bright and dark light changes, so when illumination variation, can detect mark by detection H, S component, eliminates the interference of extraneous light, reached the purpose that detects mark.As an example, chosen position calculation element 24 can be implemented by microprocessor.Fig. 4 illustrates an embodiment of the mark of selection, this mark adopts single color characteristic (blue look), after being mapped to colourity H and saturation S component, threshold ratio by colourity and saturation are set in the H that will calculate and S component value and the chosen position calculation element 24, point more than or equal to predetermined threshold is set to 1, point less than this threshold value is set to 0, satisfies the predetermined condition image section and is mark.Obtain the binary map B of mark thus, thereby obtain the candidate point of mark.Wherein be made as 1 point among the B and be the sign object point.Inevitably, some isolated noise spots are arranged in binary map B, can adopt median filter method to remove these isolated noise spots.By above-mentioned processing, can determine the mark that shows on the screen.
Adopt possible that the object of same color in the image of color that the mark of solid color exists mark and screen display obscures mutually in the foregoing description.As an alternative, detect mark other execution mode also can be arranged.As mark can be arranged on outside the screen after entering detected state, has increased production cost outward though mark is arranged on screen, and the effect of handling can be better, because the interference of its suffered screen picture is smaller.
The detection method computational speed of above-described some color detection and simple filtering is than very fast, but also can adopt other image processing techniques, as pattern recognition and filtering techniques that some are comparatively complicated etc.For example the design of mark can be adopted the shape of rule, as circle, rhombus etc. can also be assisted method with template matches in the pattern recognition for the detection of mark like this, after promptly having known the shape of mark, just can be not removing with the noise spot of this form fit.
The method that can also judge with multiple color combination of the detection of mark in addition, promptly mark adopts multicolour and suitable distribution of color shaped design to improve the antijamming capability of detection.Fig. 6 shows another embodiment of mark.Comprise three kinds of colors of regular distribution on the space in this mark, the rule in this example is: the left side of blue dot is that redness and the right are green.After detecting three kinds of colors, have only the point of the spatial distribution rule that satisfies three kinds of colors just to think to indicate object point.This method can improve the stability of system, overcome the interference that may be subjected in the testing process effectively, as having occurred colourity situation all identical with mark fully with saturation or the like on the screen.
More than illustrated the captured mark image of camera is converted into binary map B, be made as 1 point among the B and be the sign object point.Can determine the position of central point in the captured image of camera of mark thus.
The following describes the position process of chosen position calculation element 24 calculation flag things, as the preferred embodiments of the present invention, the position of centre of gravity X that the center of gravity calculation formula (4) below adopting and (5) obtain mark
zAnd Y
zAs follows:
Wherein B represents binary map, and (i j) is abscissa to X, and (i is an ordinate j) to Y, and the lower left corner of choosing photographic images is the origin of coordinates, and W, H are respectively level, the vertical resolutions of camera.
Obtained mark behind the position of centre of gravity of photographic images, because position of centre of gravity can be used as the center of mark, and the level of camera, vertical resolution fix, and can calculate the position at instructs cursor place thus.For example, if mark takes in the image of taking, can make the camera on the remote controller point to the left side of being partial to screen, instructs cursor should appear at remote controller direction pointed, the just left side of screen so.The relative position of other mark and instructs cursor can be by that analogy.Just can converse the position X of instructs cursor in screen by the position of mark in the image of taking
s, Y
s(lower left corner with screen is initial point).
The position X of cursor in screen
s, Y
sCan draw by following reduction formula (6) and (7):
X
s＝W
s/2+K
x*(W/2-X
z) (6)
Y
s＝H
s/2+K
y*(H/2-Y
z) (7)
W wherein
sRepresent the horizontal resolution of screen, H
sRepresent vertical resolution, K
xBe the coefficient of expression cursor movement speed, other symbolic representation is with mentioned above identical.
With formula (6) is example, if mark is taken the X of image at stylus
zThe place illustrates that so accordingly camera points to partially in the opposite direction, is exactly-X
zThe place, the speed of instructs cursor motion is by COEFFICIENT K
xControl because initial point is taken at the lower left corner, adds the compensation rate of translation, and final formulate is just shown in (6).(7) also in like manner.
In a word, the meaning of formula (6) and (7) is if mark appears at a side of camera, and instructs cursor appears at correspondence one side of screen so, and the speed of instructs cursor motion is by COEFFICIENT K
x, K
yControl.
After calculating by top formula (6) and (7) has obtained the positional information of instructs cursor, cursor position information is sent to television set by the sender unit in the remote controller 25.Television set demonstrates selected position at present on screen.
Choose in the application at menu, if the position is dropped in certain menu area, this menu bar just is in selected state so; Press button and can enter this option.In addition, positional information also can be applied in the later interactive television, and is selected as continuous zone.
If press the cancel key of choosing of remote controller, then enter the non-state of choosing, corresponding special sign and position indication disappear.
The operating process of remote control system is described below in conjunction with Fig. 3.At first, at step S31, detect remote control system and whether be in the interactive operation state.If the result is for negating, then whether detect on the screen show label thing at step S32, if shown mark on the screen, then this mark is eliminated, so that watch the image of demonstration at step S33.If the judged result of step S32 is for negating, i.e. show label thing not on the screen, flow process then turns back to step S31, detects remote control system and whether is in interaction mode.If the result of step S31 is for affirming that flow process then enters step S34, sends remote signal by remote control 21 to television set, on TV the show label thing.Next, flow process proceeds to step S35, and remote control 21 judges whether to detect the mark on the image in the image that image collecting device 23 is gathered.If do not detect mark, then return step S31.If detected the mark in the image at step S35, then carry out the center of calculation flag thing, and the position of the cursor of remote control point pointed, and make the selected option of this point feed back to the operator by modes such as " highlighted ", so that the operator can change the position of choosing or carry out selection operation by the sensing of regulating remote controller with reference to instructs cursor.After this, remote controller can send remote signal and will indicate the positional information of clicking cursor to be sent to subsequent operation.
Fig. 5 shows the instantiation of the screen mark that utilizes remote control system shooting of the present invention.Left-half among the figure shows the screen map that has mark, and the blue look mark that wherein has " PANASONIC " literal is presented at the upper right corner of screen.Right half part among the figure shows the camera actual photographed image of remote controller, has wherein shown the mark of blue look.
Illustrated that more than the position probing based on television image according to the present invention chooses the remote control system and the method for the ad-hoc location in the picture.
Among the present invention, when entering TV interactive operation state, TV shows a special mark automatically on picture.Detect this mark by the camera that is installed on the remote controller, and calculate the position of remote controller indication that is the specific part in the picture that should choose thus.At last, the instructs cursor that demonstrates a correspondence at the picture position that calculates feeds back to the operator.The operator can change chosen position or carry out selection operation with reference to instructs cursor.Adopt present technique, select the ad-hoc location on the screen to seem convenient and natural.
Though provide and illustrated the present invention with reference to the preferred embodiments of the present invention,, it will be understood by those of skill in the art that under the situation that does not break away from the spirit and scope of the present invention, can carry out various variations and change to the present invention.
Claims (15)
1. remote control system that detects based on video image comprises:
Be provided with the remote control of image collecting device, described image collecting device is used to gather video image, so that described remote control detects the mark in the video image, and the target of pointing to according to the described remote control of the positional information calculation of mark; With
Display unit is used to receive the control signal that described remote control sends, and shows the video image of the mark that detects for described remote control and the interactive menu option of Gong choosing by the video display interface, and the target of indication remote control sensing.
2. remote control that detects based on video image comprises:
Image collecting device is used to gather video image and converts described video image to vision signal;
The chosen position calculation element is used for detecting the mark of described vision signal and calculates the cursor position that described remote control points to;
Instruction inputting device is used for entering or withdraw from the instruction that menu option is chosen state to described remote control input; With
Remote control signal transmission device is used to receive the cursor position information of described chosen position calculation element output and the control signal that described cursor position information is indicated in emission, so that display unit shows the target that described remote control points to.
3. the remote control that detects based on video image according to claim 2, wherein said image collecting device is a camera.
4. the remote control that detects based on video image according to claim 2, wherein said chosen position calculation element converts the RGB three primary colors color model of the mark of described image collecting device collection to hue-saturation-brightness (HSI) color model and detects described mark.
5. the remote control that detects based on video image according to claim 4, wherein said chosen position calculation element are carried out according to following formula RGB three primary colors color model are converted to tone-saturation-intensity (HIS) color model:
I＝(R+G+B)/3
S＝1-min(R，G，B)/I
Wherein red in R, G, the B difference indicator sign thing, the numerical value of three components of green and blue look, F=(2*R-G-B)/(G-B); I represents brightness, and S represents color saturation, and H represents colourity.
6. the remote control that detects based on video image according to claim 5, after wherein being mapped to colourity H and color saturation S component, with threshold ratio that colourity and color saturation be set in the H that calculates and S component value and the chosen position calculation element, point more than or equal to predetermined threshold is set to 1, point less than described threshold value is set to 0, and the image section that satisfies predetermined condition is mark.
7. the remote control that detects based on video image according to claim 6, after wherein said chosen position calculation element detects mark, described mark image is converted into binary map B, calculates the position X of described mark in the image of taking according to following formula
zAnd Y
z:
Wherein B represents the binary map that the mark image transforms, and (i j) is abscissa to X, and (i is an ordinate j) to Y, and the lower left corner of choosing photographic images is the origin of coordinates, and W, H are respectively level, the vertical resolutions of camera.
8. the remote control that detects based on video image according to claim 7, wherein said chosen position calculation element is according to the positional information X of mark in the image of taking
zAnd Y
zCalculate the position X of instructs cursor in screen according to following formula
s, Y
s:
X
s＝W
s/2+K
x*(W/2-X
z)
Y
s＝H
s/2+K
y*(H/2-Y
z)
W wherein
sRepresent the horizontal resolution of screen, H
sRepresent vertical resolution, K
xIt is the coefficient of expression cursor movement speed.
9. the remote control that detects based on video image according to claim 2, wherein said instruction inputting device start described image collecting device and described chosen position calculation element entering to described remote control input when menu option is chosen the instruction of state.
10. remote control thereof that detects based on video image comprises step:
Gather the display unit video image displayed;
Detect the mark that whether comprises the sensing that is used for definite remote control in the video image of being gathered;
If comprise described mark in the described video image, then calculate the target information of described mark on the display interface of described display unit;
Point to the target information of display interface according to the described remote control of the described positional information calculation of the described mark that calculates;
The target information of the described remote control that calculates being pointed to described display interface sends to described display unit, and shows the current selected option of described remote control on display interface.
11. the remote control thereof that detects based on video image according to claim 10 also is included in described remote control when not pointing to the option that will choose on the display interface, regulates the sensing of described remote control, so that described remote control points to the option that will choose.
12. the remote control thereof that detects based on video image according to claim 10, the step that wherein detects described mark comprises the step that the RGB three primary colors color model of described mark is converted to hue-saturation-brightness (HSI) color model.
13. the remote control thereof that detects based on video image according to claim 12, wherein further comprise convert RGB three primary colors color model to colourity H and color saturation S component after, with threshold ratio that colourity and color saturation be set in the H that calculates and S component value and the chosen position calculation element, point more than or equal to predetermined threshold is set to 1, is set to 0 step less than the point of described threshold value.
14. the remote control thereof that detects based on video image according to claim 10, wherein further be included in detect mark after, described mark image is converted into binary map B, calculate the position X in the image of gathering of described mark
zAnd Y
zStep.
15. the remote control thereof that detects based on video image according to claim 14 wherein further comprises according to the positional information X of mark in the image of taking
zAnd Y
zCalculate the position X of instructs cursor in screen of described remote control
s, Y
sStep.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB031072488A CN1258135C (en) | 2003-03-19 | 2003-03-19 | Remote control device and method based on video frequency picture detection |
| PCT/CN2004/000210 WO2004084544A1 (en) | 2003-03-19 | 2004-03-17 | Remote control apparatus and method based on video image detection |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB031072488A CN1258135C (en) | 2003-03-19 | 2003-03-19 | Remote control device and method based on video frequency picture detection |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1533180A true CN1533180A (en) | 2004-09-29 |
| CN1258135C CN1258135C (en) | 2006-05-31 |
Family
ID=32997022
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB031072488A Expired - Fee Related CN1258135C (en) | 2003-03-19 | 2003-03-19 | Remote control device and method based on video frequency picture detection |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN1258135C (en) |
| WO (1) | WO2004084544A1 (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100407760C (en) * | 2004-12-10 | 2008-07-30 | 精工爱普生株式会社 | Control system, apparatus compatible with the system, and remote controller |
| CN101388138B (en) * | 2007-09-12 | 2011-06-29 | 原相科技股份有限公司 | Interaction image system, interaction apparatus and operation method thereof |
| CN102289304A (en) * | 2011-08-17 | 2011-12-21 | Tcl集团股份有限公司 | Method and system for realizing mouse movement simulation of remote controller as well as remote controller |
| CN102646326A (en) * | 2012-03-26 | 2012-08-22 | 赵舜培 | Non-contact remote controller with touch control screen electronic product matching function |
| CN103051964A (en) * | 2011-10-14 | 2013-04-17 | 中国科学院计算技术研究所 | Intelligent television human-computer interaction method, device and system based on positioning remote controller |
| CN103885610A (en) * | 2012-12-21 | 2014-06-25 | 联想(北京)有限公司 | Control method and electronic devices |
| CN103051964B (en) * | 2011-10-14 | 2016-11-30 | 中国科学院计算技术研究所 | Intelligent television human-machine interaction based on remote position controlled device, device and system |
| CN106817611A (en) * | 2016-12-01 | 2017-06-09 | 青岛海信电器股份有限公司 | A kind of screen localization method and equipment |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101163084B1 (en) * | 2003-12-18 | 2012-07-06 | 코닌클리케 필립스 일렉트로닉스 엔.브이. | Method and system for control of a device |
| CN102984563A (en) * | 2011-09-05 | 2013-03-20 | 富士通半导体（上海）有限公司 | Intelligent remote controlled television system and remote control method thereof |
| CN115174975B (en) * | 2022-06-27 | 2023-08-18 | 湖南嘻呱网络科技有限公司 | Panorama interaction method based on television remote control |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH07284166A (en) * | 1993-03-12 | 1995-10-27 | Mitsubishi Electric Corp | Remote controller |
| US6727887B1 (en) * | 1995-01-05 | 2004-04-27 | International Business Machines Corporation | Wireless pointing device for remote cursor control |
| JP3475419B2 (en) * | 1995-10-11 | 2003-12-08 | ソニー株式会社 | Television receiver |
| US6564378B1 (en) * | 1997-12-08 | 2003-05-13 | United Video Properties, Inc. | Program guide system with browsing display |
| US6535198B1 (en) * | 1999-03-28 | 2003-03-18 | Nongqiang Fan | Remote control for interactive television |
-
2003
- 2003-03-19 CN CNB031072488A patent/CN1258135C/en not_active Expired - Fee Related
-
2004
- 2004-03-17 WO PCT/CN2004/000210 patent/WO2004084544A1/en active Application Filing
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100407760C (en) * | 2004-12-10 | 2008-07-30 | 精工爱普生株式会社 | Control system, apparatus compatible with the system, and remote controller |
| CN101388138B (en) * | 2007-09-12 | 2011-06-29 | 原相科技股份有限公司 | Interaction image system, interaction apparatus and operation method thereof |
| CN102289304A (en) * | 2011-08-17 | 2011-12-21 | Tcl集团股份有限公司 | Method and system for realizing mouse movement simulation of remote controller as well as remote controller |
| CN102289304B (en) * | 2011-08-17 | 2014-05-07 | Tcl集团股份有限公司 | Method and system for realizing mouse movement simulation of remote controller as well as remote controller |
| CN103051964A (en) * | 2011-10-14 | 2013-04-17 | 中国科学院计算技术研究所 | Intelligent television human-computer interaction method, device and system based on positioning remote controller |
| CN103051964B (en) * | 2011-10-14 | 2016-11-30 | 中国科学院计算技术研究所 | Intelligent television human-machine interaction based on remote position controlled device, device and system |
| CN102646326A (en) * | 2012-03-26 | 2012-08-22 | 赵舜培 | Non-contact remote controller with touch control screen electronic product matching function |
| CN102646326B (en) * | 2012-03-26 | 2014-04-23 | 赵舜培 | Non-contact remote controller with touch control screen electronic product matching function |
| CN103885610A (en) * | 2012-12-21 | 2014-06-25 | 联想(北京)有限公司 | Control method and electronic devices |
| CN103885610B (en) * | 2012-12-21 | 2019-02-05 | 联想(北京)有限公司 | Control method and electronic equipment |
| CN106817611A (en) * | 2016-12-01 | 2017-06-09 | 青岛海信电器股份有限公司 | A kind of screen localization method and equipment |
| CN106817611B (en) * | 2016-12-01 | 2020-06-02 | 海信视像科技股份有限公司 | Screen positioning method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2004084544A1 (en) | 2004-09-30 |
| CN1258135C (en) | 2006-05-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| AU2007202102B2 (en) | Function command system, function command device, function command analysis system, presentation system, and computer readable medium | |
| US6641269B2 (en) | Indicated position detection by multiple resolution image analysis | |
| US11561608B2 (en) | Method for controlling an application employing identification of a displayed image | |
| US7787693B2 (en) | Text detection on mobile communications devices | |
| CN102682589B (en) | System for distant control of controlled device | |
| US20110216011A1 (en) | Remote control system for electronic device and remote control method thereof | |
| Finlayson et al. | Hue that is invariant to brightness and gamma. | |
| CN1680867A (en) | A system and method for visual echo cancellation in a projector-camera-whiteboard system | |
| JP6553624B2 (en) | Measurement equipment and system | |
| CN1207924C (en) | Method for testing face by image | |
| CN1258135C (en) | Remote control device and method based on video frequency picture detection | |
| JP2007248861A (en) | Image display device and receiving device | |
| CN102063231A (en) | Non-contact electronic whiteboard system and detection method based on image detection | |
| CN106060473A (en) | Big data processing method and big data processing device | |
| CN102667689B (en) | Interactive display | |
| CN106162076A (en) | Big data image gray processing processing means | |
| CN103297675A (en) | Image capture method and relative image capture system | |
| CN103765473A (en) | Method of providing adjusted digital image representation of view, and apparatus | |
| CN105933676B (en) | Remote control table based on graphical analysis | |
| CN105872115B (en) | A kind of remote supervision system based on cloud computing | |
| CN106162077A (en) | IN service based on the Internet management system | |
| CN107545212A (en) | Binary channels cloud data management platform | |
| KR100849532B1 (en) | Device having function of non-contact mouse and method thereof | |
| KR20040027561A (en) | A TV system with a camera-based pointing device, and an acting method thereof | |
| CN108419047B (en) | Remote monitoring method based on cloud computing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20060531 Termination date: 20200319 |