CN103566587B - The electricity saving method of remote control unit and interactive system - Google Patents
The electricity saving method of remote control unit and interactive system Download PDFInfo
- Publication number
- CN103566587B CN103566587B CN201210280075.0A CN201210280075A CN103566587B CN 103566587 B CN103566587 B CN 103566587B CN 201210280075 A CN201210280075 A CN 201210280075A CN 103566587 B CN103566587 B CN 103566587B
- Authority
- CN
- China
- Prior art keywords
- image
- view data
- light source
- reference light
- scope
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Abstract
A kind of remote control unit, including imageing sensor, reading circuit and processing unit。This imageing sensor obtains the first image and the second image that include at least one reference light source image successively。This reading circuit in order to read the first view data of this first image and the second view data of this second image from this imageing sensor。This processing unit in order to calculate the characteristics of image of this at least one reference light source image according to this first view data, and control this reading circuit according to this characteristics of image and only read this second view data of the concern scope in this second image。The present invention also provides for the electricity saving method of a kind of interactive system。
Description
Technical field
The present invention is about a kind of interactive system, only reads an electricity saving method sensing the partial pixel data of array remote control unit and interactive system to carry out object tracking especially with regard to a kind of。
Background technology
Known games remote control unit, " the index positioner of camera " such as China's Taiwan patent of invention the I267754th, it can be applicable to a light gun game, this index positioner is to photograph to be provided with control circuit in index device again, and it is connected to camera, computing unit and communication interface。This communication interface is connected to main frame, and this camera front is provided with filter, and is provided with the multiple light-emitting components being available for camera shooting on screen。When user uses this photography index device to carry out the program performed by main frame, when this photo-opportunity shoots display screen, because camera has filter, therefore the light source beyond the spectrum that can be sent by light-emitting component filters, so the picture captured by camera only there will be the light source of light-emitting component。Transfer to computing unit calculate the coordinate figure of camera aiming point and be sent to main frame in this picture again, make main frame that this coordinate figure can be utilized to carry out the control being correlated with。
But in actual use, in order to promote the property convenient for control of remote control unit, remote control unit system utilizes and carries out data transmission between wireless telecommunications and main frame, and use the electric energy needed for battery module supply remote control unit entirety。Owing to remote control unit includes several dissipative cell, it is necessary to reduce consuming energy the life-span to extend battery module of each element as far as possible。Generally for the precision promoting computing unit calculating aiming point coordinate, camera is preferably with higher Image Acquisition frequency acquisition image, but hi-vision acquisition rate can increase the computational load of computing unit relatively, and then the total consumption electric energy of increase remote control unit, and reduce the service life of battery module。
China's Taiwan patent of invention discloses No. 200912700 open a kind of " displacement detection apparatus and electricity saving method thereof "。This displacement detection apparatus should be mouse, and including light source and image acquisition unit, wherein image acquisition unit can continuously acquire the image that light source projects is formed in a surface。Displacement detection apparatus can calculate in aforementioned consecutive image with reference to the alternate position spike of object to obtain motion vector (motionvector), when motion vector value is respectively less than a threshold value within a scheduled time, then displacement detection apparatus is identified is be in idle state and non-operating state。If displacement detection apparatus is in idle state, the glow frequency of light source can be reduced, so can reduce power consumption。Similarly, China's Taiwan patent of invention discloses No. 200943131 open a kind of " displacement detection apparatus and electricity saving method thereof ", it according to the displacement of this displacement detection apparatus in during the double luminescence of light source, to adjust the light period of light source, and can be expected and can reduce power consumption。
The target being different from aforementioned two publication description is mouse, China's Taiwan patent of invention the I338241st open a kind of " mutual picture system, interactive device and How It Works thereof ", can by the sampling frequency of image module in immediately modulation interactive device, the consumption electric energy overall to save interactive device。No matter reducing the sampling frequency of image module or the glow frequency of reduction light source, these prior arts are still and obtain complete picture (frame) and process the data of this complete picture, therefore still cannot effectively reduce power consumption。
It is likely to relevant patent to this case and see United States Patent (USP) or publication US7,839,388;US7,738,013;US7,738,013;US7,619,669;US20070024587 etc.。
In view of this, the present invention separately proposes the electricity saving method of a kind of remote control unit and interactive system, its partial pixel data that only can select according to the characteristics of image of reference light source image to read a sensing array, uses the overall power consumption saving image sensering device。
Summary of the invention
One purpose of the present invention can interact the remote control unit of formula operation and the electricity saving method of interactive system at the whole pixel datas providing a kind of sensing array not needing to read imageing sensor。
Another object of the present invention is providing the electricity saving method of a kind of remote control unit and interactive system, it can estimate a concern scope (rangeofinterest) of next image according to a characteristics of image of at least one reference light source image in a current image, and reduces power consumption by only reading the pixel data of this concern scope in sensing array。
The present invention provides a kind of remote control unit, including imageing sensor, reading circuit and processing unit。This imageing sensor obtains the first image and the second image that include at least one reference light source image successively。This reading circuit reads the first view data of this first image and the second view data of this second image from this imageing sensor。This processing unit in order to calculate a characteristics of image of this at least one reference light source image and to control this reading circuit according to this characteristics of image and only read in this second image this second view data paying close attention to scope according to this first view data, and wherein this concern scope is less than this second image。
In one embodiment, this characteristics of image include the picture position of this reference light source image and picture size, brightness of image and action vector at least one。
In one embodiment, this processing unit determines the first concern scope in this first image according to a picture position of this at least one reference light source image, and this first concern scope is estimated in this second image the second concern scope according to an action vector of this reference light source image or estimates the second concern scope in this second image according to a spreading parameter relatively；Wherein, this action vector and this spreading parameter are a preset value or obtain according to multiple images are computed before this second image。
In one embodiment, this imageing sensor is another before obtaining this first image obtains the pre-treatment image including this at least one reference light source image, and this reading circuit reads the part row view data of this pre-treatment image；This processing unit can determine the first concern scope according to this at least one reference light source image in this part row view data of this pre-treatment image, and control this reading circuit and only read in this first image this and first pay close attention to this first view data of scope to calculate this characteristics of image；Wherein, this part row view data is the view data of the odd column of this pre-treatment image or even column。
In one embodiment, this processing unit controls this reading circuit and separately reads in this second image this second view data of the part row beyond this concern scope, to carry out removing misinterpretation。
The present invention separately provides the electricity saving method of a kind of interactive system, comprises the following steps: to utilize imageing sensor to obtain the pre-treatment image and the first image including at least one reference light source image successively；Reading circuit is utilized to read the part row view data of this pre-treatment image；Processing unit is utilized to determine the first concern scope according to this at least one reference light source image in this part row view data of this pre-treatment image；This reading circuit is utilized only to read the first view data of this first concern scope in this first image；And utilize this processing unit to calculate a characteristics of image of this at least one reference light source image according to this first view data。
In one embodiment, the electricity saving method of this interactive system separately comprises the following steps: to utilize this imageing sensor separately to obtain the second image including this at least one reference light source image；And utilize this processing unit to control this reading circuit according to this characteristics of image only to read in this second image the second the second view data paying close attention to scope, and this second pays close attention to scope less than this second image。
The present invention also provides for the electricity saving method of a kind of interactive system, comprises the following steps: to utilize imageing sensor to obtain the first image and the second image including at least one reference light source image successively；Reading circuit is utilized to read all images data of this first image；Processing unit is utilized to calculate a characteristics of image of this at least one reference light source image according to these all images data of this first image；And utilize this processing unit to control this reading circuit according to this characteristics of image only to read in this second image a view data paying close attention to scope, and this concern scope is less than this second image。
In the remote control unit of the embodiment of the present invention and the electricity saving method of interactive system, only need to read the part image data of sensing array due to this reading circuit, therefore can effectively save the power consumption of the pixel data treatment elements such as programmable gain amplifier (PGA), analog-digital converter (ADC) and processing unit。Additionally, due to the time reading view data relatively reduces, more can relatively promote sampling frequency (framerate) to increase system response speed。
Accompanying drawing explanation
Fig. 1 is the schematic diagram of the mutual picture system of one embodiment of the invention；
Fig. 2 A-2D is that interaction control device of the present invention obtains the image including multiple reference point image；
Fig. 3 is the flow chart of the How It Works that idle state of the present invention confirms；
Fig. 4 A is the schematic diagram of the interactive system of the embodiment of the present invention；
Fig. 4 B is the block schematic diagram of the remote control unit of the interactive system of the embodiment of the present invention；
Fig. 5 is the running schematic diagram of the interactive system of first embodiment of the invention；
Fig. 6 is the running schematic diagram of the interactive system of second embodiment of the invention；
Fig. 7 is the flow chart of the electricity saving method of the interactive system of first embodiment of the invention；
Fig. 8 is the flow chart of the electricity saving method of the interactive system of second embodiment of the invention。
Description of reference numerals
10 mutual picture system 13 light sources
11 interaction control device 131 reference points
111 wireless module 14 image displays
112 control circuit 21-23 reference point images
113 imageing sensor 20a-20d images
12 main frame 241-245 pixel regions
121 wireless module 31-36 steps
122 processors
4 remote control unit 41 imageing sensors
410 pre-treatment image 411 first images
412 second image 42 reading circuits
43 processing unit 5 image devices
51 reference light source I51、I51' reference light source image
ROI1First pays close attention to scope ROI2Second pays close attention to scope
MV action vector dp expansion parameters
S61-S66Step S71-S79Step
R1-R8Pixel column。
Detailed description of the invention
In order to the above and other purpose of the present invention, feature and advantage can be become apparent from, hereafter will coordinate accompanying drawing, be described in detail below。In the explanation of the present invention, identical component system represents with identical symbol, first chats bright in this conjunction。
The present invention be applicable on the execution of interactive game program of game host, display device the remote control of webpage and browse and other remote control audio-video systems (such as: wisdom TV；SmartTV) operation, but because game host is the most common at present, therefore be illustrated for game host below。
With reference to shown in Fig. 1, Fig. 1 discloses the schematic diagram of the mutual picture system of one embodiment of the invention。Mutual picture system 10 includes interaction control device 11, main frame 12, light source 13 and image display 14。The embodiment of main frame 12 can be game host, computer system main frame or mutual image player, it is possible to performs interactive game program, is shown in produce interaction figure picture on this image display 14 for user manipulation。Main frame 12 includes wireless module 121 and processor 122, and by bi-directional transfer of data (RF1 and RF2) between wireless module 111 in wireless module 121 and interaction control device 11, processor 122 can according to described data to interact game。This main frame 12 can also wired or wireless mode be connected with this image display 14, or is directly arranged in this image display 14 by this main frame 12。
Display highlighting on the screen of this image display 14, what embodiment included, but not limited to the point of impact of light gun and image clicks arrow etc.。Interaction control device 11 includes this wireless module 111, control circuit 112 and imageing sensor 113, wherein imageing sensor 113 can obtain the image of multiple reference points 131 in light source 13, and control circuit 112 determines the position of interaction control device 11, moving direction and amount of movement according to the image of reference point 131, namely aforementioned smooth target location and displacement。
The embodiment of the reference point 131 of light source 13 can be, but it is not limited to, the variously-shaped reference point that the luminescence unit of several infrared light emitting diodes or specific wavelength rearranges, it can be electrically connected to main frame 12 or this image display 14, it is also possible to independent power supply supplies electric energy required during luminescence voluntarily。This light source 13 also can be integrated among this display 14 or this main frame 12。Additionally, the number of reference point 131 is not limited in diagram 6, it is also possible to be one or more。Interaction control device 11 obtains the image of described reference point 131, to judge relative position and/or the angle change of this interaction control device 11 and this reference point, is marked in the position on image display 14 and movement with relation control light。Interaction control device 11 is in order to manipulate games performed by this main frame 12 or computer software。When person performed by this main frame 12 is Games Software, this interactive device 11 such as can be used as (but not limited to) light gun, billiard stick, golf clubs, tennis racket, bat, Badminton racket and table tennis bat etc. to manipulate the carrying out of game。When performed by main frame 12, person is computer software, this interaction control device 11 such as can be used as an index (cursor) positioner to manipulate the carrying out of this computer software。
Fig. 2 A-2D is that interaction control device of the present invention obtains the image including multiple reference point image。In Fig. 2 A-2D, image 20a-20d is the image that multiple reference point images in imageing sensor 113。Fig. 2 A is at the acquired complete image of idle state, and reference point image is reference point (bright spot) region imaged。In this figure, reference point image 21-23 is only illustration, is not limited to the pixel of a unit, and in figure, a unit also can represent multiple pixel again。In addition; image 20a-20d is the image that interaction control device 11 obtains in an idle state; so switched to the determination mechanism of idle state by mode of operation and can adopt the method disclosed in any prior art, for instance: aforementioned utilize motion vector to judge entering the methods such as idle state all belongs to protection scope of the present invention。
In Fig. 2 A, image 20a has three reference point image 21-23, figure represents this three reference point image 21-23 with white portion, other thin lattice array regions are that imageing sensor 113 scans the pixel cell not finding reference point image, this image 20a system's imageing sensor 113 each pixel cell of complete scan and obtain。
In Fig. 2 B, image 20b system imageing sensor 113 obtains so that the pixel compartments (pixelcell) corresponding to these three reference point images in image 20a scans, other pixel compartments are to be turned off to effectively reduce power consumption, represent the pixel cell being not gated on scanning in figure with closely spaced lattice column region。It is, the control circuit 112 of interaction control device 11 can open in imageing sensor 113 pixel compartments of these three reference point image 21-23 in correspondence image 20a, and only it is scanned with described pixel compartments。In figure, reference point image 21 and 23 is still scanned in situ and obtain, but reference point image 22 cannot be scanned in former scanned region obtaining, then control circuit 112 is understood by idle state, interaction control device 11 is switched to mode of operation。
For to confirm that in image 20b, at least one reference point image is not present in position, image 20a Central Plains, and interaction control device 11 is switched to mode of operation, control circuit 112 can compare threshold value and the brightness information of the pixel of these three reference point image 21-23 in correspondence image 20a in image 20b, such as: in image 20b, in correspondence image 20a, the brightness value of the pixel cell of reference point image 22 or average brightness lower than a predetermined threshold, then can determine whether this reference point image 22 or position, bright spot already out image 20a Central Plains。Otherwise, if the brightness of this pixel cell is higher than a predetermined threshold, then can be assumed that this reference point image 22 is still in position, image 20a Central Plains, if reference point image 21 and 23 is also in their position originally, then can be assumed that interaction control device 11 is still in idle state。When confirming that interaction control device 11 is also in idle state, the sampling frequency of imageing sensor 113 can be reduced by control circuit 112 further, or reduces the glow frequency of light source 13, to save power consumption。Namely can determining according to system requirements disappears in a bright spot switches to mode of operation, as long as or have a bright spot sustainable existence to be namely maintained at idle state, also may be set to have at least N number of bright spot to exist further and just can be maintained at idle state。
In one embodiment, described threshold value can include single one or more, for instance all pixels of this image 20b all can compared with same threshold value；Or, each pixel is all compared with different threshold values, and now described threshold value can be such as enter in previous image of idle state relative to a ratio of the grey decision-making of each pixel own or offset (offset)。
Fig. 2 B is the only pixel compartments of three reference point images in scanogram 20a, so may misidentification interaction control device 11 leaves idle state because of interference or desktop trickle rocking。Therefore can image 20a be benchmark at the pixel compartments of three reference point images, and expanding the multiple pixel compartments of reselection to surrounding is sweep limits, three pixel region 241-243 are had as sweep limits in Fig. 2 A, or it is called concern district, namely the pixel compartments in other regions can be closed when next picture scans。In the present invention, pixel region can be the sweep limits of aforementioned expansion, or the pixel coverage at script reference point image place。Namely 2C figure is the image 20c that the scanning of next picture is obtained, and in pixel region 242-243, reference point image 22-23 does not all change its position, but in pixel region 241, the position of reference point image 21 changes。Because reference point image 21 is still located in pixel region 241, therefore control circuit 112 can determine whether that interaction control device 11 does not leave idle state。If or detecting pixel region 241 has at least one bright spot to exist, so that it may judge that interaction control device 11 does not leave idle state。So-called bright spot exists or judges, namely the brightness value of pixel is more than a predetermined threshold, then can assert that this pixel is bright spot place。
Referring to Fig. 2 D, in image 20d, pixel region 244 and 245 is that to choose column of pixels lattice according to the position of three reference point image 21-23 in image 20a be sweep limits。In other embodiments, it is also possible to selecting whole hurdle pixel compartments is sweep limits, the pixel compartments that the sweep limits of foregoing embodiments may be set to formed objects corresponding to reference picture 21～23, expands or shrinks。
Previous embodiment system illustrates with sketch, and this paragraph system adopts the example of reality and is further described。The pixel compartments of imageing sensor is sized to 128 × 96, if there being two reference point images in the first image, and each reference point image size is about 30-50 pixel。Two pixel regions are set to 50 pixel compartments, and therefore imageing sensor only needs to open the pixel compartments of 0.81%, and it is calculated as follows: (50 × 2)/(128 × 96)=0.00813。Equally, in interaction control device 11, the circuit module such as signal and image procossing can be commensurately smaller process number of pixels, therefore can reduce power consumption further。
Fig. 3 is the flow chart of the How It Works of the mutual picture system of the present invention。Referring to step 31, in an idle state, interaction control device can open whole pixel compartments of imageing sensor to obtain one first image。At least one pixel region is chosen in position according to reference point image at least one in the first image, and pixel region can be same range or the expanded scope of the respective pixel lattice including reference point image again, as shown at step 32。According to step 33, the pixel compartments in image sensor scan pixel region is to obtain one second image。As indicated at step 34, a threshold value Th and the brightness information of at least one pixel in this pixel region in this second image are compared, for instance: brightness value or average brightness, to confirm that whether this interaction control device is still in this idle state。As shown at step 35, when confirming that interaction control device is also in idle state, it is possible to further the sampling frequency of imageing sensor is reduced, or reduce the glow frequency of light source, to save power consumption。If sampling frequency or glow frequency have fallen to lowest frequency value, avoid the need for downgrading again, and direct rebound step 33。Otherwise, if the brightness value of this pixel is lower than threshold value Th, then can determine whether that this reference point image is not in the first position, image Central Plains, then require that interaction control device enters mode of operation, as indicated in step 36。
With reference to shown in Fig. 4 A and 4B, Fig. 4 A is the schematic diagram of the interactive system of the embodiment of the present invention；Fig. 4 B is the block schematic diagram of the remote control unit of the interactive system of the embodiment of the present invention。The interactive system of the embodiment of the present invention includes remote control unit 4, image device 5 and at least one reference light source (such as shown here as two reference light sources 51)；Wherein, this reference light source 51 can be combined on this image device 5 or powered by independent power supply and separated from one another with this image device 5, there is no specific restriction。This reference light source 51 preferably sends black light or luminous to distinguish with environment light with a preset emission pattern；This reference light source 51 can be such as light emitting diode, laser diode or other main passive light sources, there is no specific restriction。In other embodiments, this reference light source 51 can be shown in the image of this image device 5。Should be noted that, the number system of this reference light source 51 determines according to following the trail of the algorithm that uses of this reference light source 51, is not limited to given number。
This image device 5 can be such as the device in order to show image such as intelligent TV, gaming machine screen, projector screen, computer screen。In the present embodiment, this remote control unit 4 is the image obtaining and including this at least one reference light source 51 and interacts with this image device 5 according to the image change (such as change in location and/or angle change) of this at least one reference light source image in acquired image, for instance control this application program performed by image device 5, shown image or cursor etc.；Wherein, the function that a remote controller and a display device interact is for it is known that therefore repeat no more in this。The present invention essentially consists in the power consumption reduced when this remote control unit 4 operates。
This remote control unit 4 includes imageing sensor 41, reading circuit 42 and processing unit 43；Wherein, this imageing sensor 41 obtains image with a fixing or adjustable sampling frequency, this reading circuit 42 reads all or part of view data of acquired image from this imageing sensor 41 and is sent to this processing unit 43, this view data is carried out post processing and controls this reading circuit 42(and such as send a control signal by this processing unit 43) select to read the region of view data from this imageing sensor 41, this processing unit 43 separately can interact according to this view data and this image device 5。
With reference to shown in Fig. 4 B and 5, the function mode of the interactive system of first embodiment of the invention is then described。
This imageing sensor 41 is preferably an active array imageing sensor (activeimagesensor), for instance cmos image sensor, and it includes a sensing array (being such as shown here as the sensing array of 8 × 8) and obtains image with a sampling frequency。Such as, in Fig. 5, this imageing sensor 41 obtains successively and includes at least one reference light source image I respectively51And I51' one first image 411 and one second image 412。In the present embodiment, this first image 411 and this second image 412 represent the view data of the sensing array actual sensed of this imageing sensor 41, and namely this first image 411 and this second image 412 are this sensing array each pixel data (i.e. grey decision-making) institute former。This reading circuit 42 reads one first view data of this first image 411 and one second view data of this second image 412 from this imageing sensor 41；In the present embodiment, this first view data is whole pixel datas of this first image 411, and this second view data is the partial pixel data of this second image 412。In other words, in the present embodiment, these optional partial pixel data reading this imageing sensor 41 acquired image of reading circuit 42。In a kind of embodiment, due to this reference light source image I51And I51' pixel gray level value can more than background grey decision-making (i.e. reference light source image I51And I51' pixel region in addition), therefore pixel gray level value in the first image 411 and this second image 412 can be judged to this reference light source image I more than the pixel region of a threshold value by the present embodiment respectively51And I51', and this threshold value can be determined according to different application；Wherein, from image, the mode of identification reference light source image has been it is known that therefore repeat no more in this。
This processing unit 43 can be a digital signal processor (DSP), in order to calculate this at least one reference light source image I according to this first view data51A characteristics of image, for instance include this reference light source image I51Picture position and picture size, brightness of image and action vector (motionvector) at least one。According to this characteristics of image, this processing unit 43 also determines that the one of this sensing array pays close attention to scope ROI(rangeofinterest), only read this second view data of this concern scope ROI in this second image 412 controlling this reading circuit 42；Wherein, in order to save the power consumption when running of this remote control unit 4, for instance including the power consumption of this reading circuit 42, programmable gain amplifier (PGA), analog-digital converter (ADC) and this processing unit 43, this concern scope ROI is less than this second image 412。For example, it is assumed that this sensing array is of a size of 128 × 96, this reference light source image I51Being of a size of 50, in the embodiment considering two reference light sources 51, this concern scope ROI is this sensing array 0.81%, thus can be greatly reduced the image data amount of reading and post processing。
Additionally, due to multiple pixel systems of this sensing array arrange with array, this concern scope ROI2Can be such as a rectangular pixel area (such as Fig. 5) or multiple row pixel region (pixel column R of such as Fig. 62-R4Or pixel column R2-R8)。In other embodiments, the shape of this concern scope ROI is preferably the determined preset shape pixel region of the shape according to this reference light source 51, is not limited to disclosed in Fig. 5 and 6。Should be noted that, the pixel region that the region representation filled up with thin point in this second image 412 in Fig. 5 is not read。
In a kind of embodiment, this processing unit 43 is according to this at least one reference light source image I51A picture size and a picture position determine in this first image 411 that one first pays close attention to scope ROI1, and relatively this first pay close attention to scope ROI1According to this reference light source image I51An action vector M V(such as I of reference light source image shown in top right plot51To I51' a direction vector) estimate in this second image 412 one second and pay close attention to scope ROI2；Wherein, this location of pixels can be such as this reference light source image I51A center of gravity or center, this picture size can be such as that in image, pixel gray level value is more than the number of pixels of threshold value, according to different embodiments, described concern scope ROI1、ROI2Optional more than or equal to described reference light source image I51、I51' a picture size。In the present embodiment, this action vector M V can be a preset value or this processing unit 43 obtains according to multiple images before this second image 412 (can include or not include this first image 411) are computed；Such as, can preset (such as including a size of this reference light source 51 and an operating distance of this remote control unit 4) this preset value of this action vector M V according to the operating parameter of interactive system, or try to achieve according to relation (such as dependency) between multiple images before this second image 412；Wherein, this action vector M V such as includes the information of moving direction and amount of movement。
In another embodiment, this processing unit 43 is according to this at least one reference light source image I51A picture size and a picture position determine in this first image 411 that one first pays close attention to scope ROI1, and according to a spreading parameter dp(bottom-right graph) estimate one second concern scope ROI in this second image 4122；Wherein, this spreading parameter dp can be a preset value or this processing unit 43 obtains according to before this second image 412, multiple images are computed, the action vector M V such as multiple images before this second image 412 (can include or not include this first image 411) tried to achieve as this spreading parameter dp, or according to the operating parameter of interactive system preset this spreading parameter dp(such as herein this spreading parameter dp be two pixels of outward expansion)。In addition, in above-mentioned two embodiments, this picture size is likely to and sets according to the operating parameter (size of such as this reference light source 51 and an operating distance of this remote control unit 4) of interactive system in advance, and therefore this processing unit 43 is according only to this at least one reference light source image I51A picture position namely can determine that in this first image 411 that one first pays close attention to scope ROI1。
With reference to shown in Fig. 4 B and 6, the function mode of the interactive system of second embodiment of the invention is then described。The present embodiment is not in order to get this at least one reference light source image I at this imageing sensor 4151Time, save the power consumption of this remote control unit 4。
In the present embodiment, this imageing sensor 41 another acquisition before obtaining this first image 411 includes at least one reference light source image I51A pre-treatment image (pretreatmentimage) 410, namely this pre-treatment image 410 be not used to calculate the image change of this reference light source 51 and only in order to judge whether reference light source image is acquired and its picture position。This reading circuit 42 reads the part row view data of this pre-treatment image 410；Wherein, this part row view data is such as the view data of the odd column of this pre-treatment image 410 or even column, but is not limited thereto。In other embodiments, it is possible to skip at least string pixel after reading multiple row view data every time and be not read out。In other words, when this processing unit 43 judges that this imageing sensor 41 does not get this at least one reference light source image I51Time, then control this reading circuit 42 and only read the part row view data of sensing array of this imageing sensor 41 using as this pre-treatment image 410；When this processing unit 43 judges that this imageing sensor 41 has got this at least one reference light source image I51Time, this processing unit 43 is then according to this at least one reference light source image I in this part row view data of this pre-treatment image 41051Determine one first concern scope ROI1, and control this reading circuit 42 and only read in this first image 411 this and first pay close attention to scope ROI1This first view data；This processing unit 43 is then according to this first concern scope ROI1This first view data calculate this at least one reference light source image I51A characteristics of image, and control this reading circuit 42 according to this characteristics of image and only read in this second image 412 one second and pay close attention to scope ROI2This second view data；Wherein, control this reading circuit 42 according to this characteristics of image and only read one second concern scope ROI in this second image 4122The mode of this second view data be similar to first embodiment, therefore repeat no more in this。The difference of the second embodiment and first embodiment is in that, this reading circuit 42 first reads the part row view data of this pre-treatment image 410 to determine one first concern scope ROI1, and only read this first concern scope ROI in this first image 4111View data but not this first pay close attention to scope ROI1All images data；Wherein, this first concern scope ROI1Size such as can preset according to the operating parameter (size of such as this reference light source 51 and an operating distance of this remote control unit 4) of interactive system。Should be noted that, the pixel region that the region representation filled up with thin point in this pre-treatment image 410, this first image 411 and this second image 412 in the 6th figure is not read。Additionally, other embodiments can carry out same operation based on pixel column (pixelcolumn)。
Additionally, due to this processing unit 43 may judge this reference light source image I by accident51, in first and second embodiment of the present invention, this processing unit 43 can control this reading circuit 42 and separately read this second concern scope ROI in this second image 4122This second view data of part row in addition, to confirm that whether there are other reference light source images in this second image 412 is not included in this second concern scope ROI2In。Additionally, due to this reading circuit 42 only needs to read the partial pixel region of the sensing array of this imageing sensor 41, sampling frequency therefore separately can be improved relatively to improve system response speed。Additionally, for simplifying diagram, Fig. 5 and only show a reference light source image I in 651。It will be appreciated that may extend to the running of multiple reference light source image shown in figure about the function mode of a reference light source image。
With reference to shown in Fig. 7, it is the flow chart of electricity saving method of interactive system of first embodiment of the invention, comprises the following steps: to obtain one first image (the step S including at least one reference light source image61)；Read all images data (the step S of this first image62)；These all images data according to this first image calculate characteristics of image (the step S of this at least one reference light source image63)；Obtain one second image (the step S including this at least one reference light source image64)；View data (the step S of a concern scope in this second image is only read according to this characteristics of image65)；And update this and second pay close attention to and range for this first concern scope and update this second view data for this first view data (step S66), it is subsequently returning to step S63。
Referring concurrently to Fig. 4 A, 4B, shown in 5 and 7, the embodiment of the electricity saving method of the interactive system of first embodiment of the invention is then described。
Step S61: this imageing sensor 41 first obtains and includes at least one reference light source image I51One first image 411。
Step S62: this reading circuit 42 is successively read all images data of this first image 411。
Step S63: this processing unit 43 calculates this at least one reference light source image I according to these all images data of this first image 41151Characteristics of image；As it was previously stated, this characteristics of image include the picture position of this reference light source image and picture size, brightness of image and action vector at least one。
Step S64: then, this imageing sensor 41 obtains and includes this at least one reference light source image (such as I51') one second image 412。
Step S65: according to this characteristics of image, this processing unit 43 determines that the one of this sensing array pays close attention to scope ROI, only read a view data of this concern scope ROI in this second image 412 and do not read the view data beyond this concern scope ROI controlling this reading circuit 42。In one embodiment, this processing unit 43 can according to this at least one reference light source image I51A picture position determine in this first image 411 that one first pays close attention to scope ROI1, and relatively this first pay close attention to scope ROI1According to this reference light source image I51An action vector M V estimate in this second image 412 one second and pay close attention to scope ROI2(such as Fig. 5 top right plot)；In another embodiment, this processing unit 43 can according to this reference light source image I51A picture position determine in this first image 411 that one first pays close attention to scope ROI1, and relatively this first pay close attention to scope ROI1One second concern scope ROI in this second image 412 is estimated according to a spreading parameter pd2(such as Fig. 5 bottom-right graph)。As it was previously stated, this action vector M V and this spreading parameter pd can be a preset value or this processing unit 43 obtains according to before this second image 412, multiple images are computed。Owing to the purpose of the present embodiment is saving power consumption, therefore this second concern scope ROI2Less than this second image 412。In other embodiments, if using an operating parameter presetting spreading parameter and known interactive system, it is possible to need to prior to this first image 411 is not determined this first concern district ROI1, it is only necessary to know this reference light source image I in this first image 41151A picture position, directly can set this according to this default spreading parameter and second pay close attention to district ROI2。
Step S66: last, this processing unit 43 updates this second concern scope ROI2For this first concern scope ROI1And to update this second view data be this first view data。Then, step S is returned to63。
Return to step S63After, this processing unit 43 calculates this at least one reference light source image I according to this first view data after updating51An after image feature (i.e. step S63)；Update image (the i.e. step S that this second image is a new acquisition64), namely this imageing sensor 41 reacquires an image as this second image 412 after updating；And this processing unit 43 only reads one second concern scope ROI in this second image 412 after updating according to this reading circuit 42 of this after image character control2One second view data (i.e. step S65)。
This processing unit 43 can according to this first image 411 and this second concern district ROI2Between dependency follow the trail of reference light source image and interact according to following the trail of result and this image device 5, and circulate execution step S63-S66To keep track the action of reference light source image。Such as a sampling frequency circulation can perform step S63-S66。
In the present embodiment, in order to avoid the situation controlled occurs by mistake, this processing unit 43 controls this reading circuit 42 every a Preset Time and separately reads this second concern scope ROI in this second image 4122This view data of part row in addition, to be confirmed whether to there is the reference light source image not being read；Wherein, this Preset Time can be determined according to required degree of accuracy and different application。
With reference to shown in Fig. 8, Fig. 8 is the flow chart of the electricity saving method of the interactive system of second embodiment of the invention, comprises the following steps: to obtain pre-treatment image (the step S including at least one reference light source image71)；Read part row view data (the step S of this pre-treatment image72)；One first concern scope (step S is determined according to this at least one reference light source image in this part row view data of this pre-treatment image73)；Obtain one first image (the step S including this at least one reference light source image74)；Only read one first view data (step S of this first concern scope in this first image75)；A characteristics of image (step S of this at least one reference light source image is calculated according to this first view data76)；Obtain one second image (the step S including this at least one reference light source image77)；One second view data (step S of one second concern scope in this second image is only read according to this characteristics of image78)；And update this and second pay close attention to and range for this first concern scope and update this second view data for this first view data (step S79), then, return to step S76。Owing to the purpose of the present embodiment is saving power consumption, this second concern scope system is less than this second image。
Referring concurrently to Fig. 4 A, 4B, shown in 6 and 8, the embodiment of the electricity saving method of the interactive system of second embodiment of the invention is then described。
Step S71: this imageing sensor 41 obtains a pre-treatment image 410。As it was previously stated, this pre-treatment image 410 is to confirm in the visual field whether reference light source image has been enter into imageing sensor 41。
Step S72: in order to save power consumption, this reading circuit 42 only reads the part row view data of this pre-treatment image 410；Wherein, described part row view data is the view data of the odd column of this pre-treatment image 410 or even column, but it is not limited thereto, it can also be the view data that skip over obtain the view data that at least two row are above every time after and obtain more than at least string, as long as obtain the part row view data of this pre-treatment image 410, there is no specific restriction。Such as, in the upper figure in centre of Fig. 6, this reading circuit 42 only reads blank pixel row and does not read and insert the pixel column dredging point。When this imageing sensor 41 does not get the reference light source image I of this reference light source 5151Time, then return to step S71, as the reference light source image I getting this reference light source 5151Time, then enter step S73。
Step S73: this processing unit 43 is according to this at least one reference light source image I in this part row view data of this pre-treatment image 41051Determine that the one first of this sensing array pays close attention to scope ROI1, for instance this processing unit 43 is according to this at least one reference light source image I51A picture position determine this first pay close attention to scope ROI1Position, and this first pay close attention to scope ROI1Size then can according to the operating parameter of interactive system, for instance the size of this reference light source 51 and/or the operating distance of this remote control unit 4 and determine。
Step S74: then, this imageing sensor 41 obtains and includes this at least one reference light source image I51One first image 411。
Step S75: as this first concern scope ROI1It has been determined that this processing unit 43 controls this reading circuit 42 only reads this first concern scope ROI in this first image 4111One first view data and do not read this first pay close attention to scope ROI1View data in addition, uses reduction power consumption。As it was previously stated, the present embodiment separately can improve sampling frequency to increase system response speed simultaneously。
Step S76: this processing unit 43 then can calculate this at least one reference light source image I according to this first view data51Characteristics of image；As it was previously stated, this characteristics of image can include this reference light source image I51Picture position and picture size, brightness of image and action vector at least one。
Step S77: then, this imageing sensor 41 obtains and includes this at least one reference light source image (such as I51') one second image 412。
Step S78: according to this characteristics of image, this processing unit 43 determines that the one second of this sensing array pays close attention to scope ROI2, and control this reading circuit 42 and only read in this second image 412 this and second pay close attention to scope ROI2One second view data and do not read this second pay close attention to scope ROI2View data in addition；Wherein, its embodiment is same as the step S of first embodiment65, therefore repeat no more in this。
Step S79: last, this processing unit 43 updates this second concern scope ROI2For this first concern scope ROI1, and to update this second view data be this first view data。Then, step S is returned to76。
Return to step S76After, this processing unit 43 calculates this at least one reference light source image I according to this first view data after updating51An after image feature (i.e. step S76)；Update image (the i.e. step S that this second image is a new acquisition77), namely this imageing sensor 41 reacquires an image as this second image 412 after updating；And this processing unit 43 only reads one second concern scope ROI in this second image 412 after updating according to this reading circuit 42 of this after image character control2One second view data (i.e. step S78)。
This processing unit 43 can according to this first concern district ROI1And this second concern district ROI2Between dependency follow the trail of reference light source image and interact according to following the trail of result and this image device 5, and circulate execution step S76-step S79To keep track the action of reference light source image。Such as a sampling frequency circulation can perform step S76-S79。
In like manner, except circulation performs step S76-step S79Outward, in order to avoid by mistake control, interactive system can be configured to every a Preset Time from step S78Return to step S71Re-execute the electricity saving method of second embodiment of the invention, there is other reference light source images to avoid paying close attention to beyond district ROI, even if namely this reference light source image is acquired, this pre-treatment image 410 still can be acquired once every a Preset Time, to increase manipulation accuracy。Additionally, described processing unit 43 can control this reading circuit 42 every a Preset Time separately reads this second concern scope ROI in this second image 412 after updating2This second view data of part row in addition, its purpose is increase manipulation accuracy equally。In the present embodiment, this Preset Time can set according to the different application such as system accuracies and systematic parameter。
In sum, it is known that the power saving mode of interactive system still has the problem that cannot fully save system power consumption。Therefore, the present invention separately proposes a kind of interactive system (Fig. 4 A), remote control unit (Fig. 4 B) and electricity saving method (Fig. 7 to 8) thereof, and it can carry out post processing by only reading the part image data of a sensing array, effectively to save system power consumption。Additionally, when imageing sensor does not get reference light source image, it is possible to reduce system power consumption further by only reading part row view data。
Although the present invention is open with previous embodiment, so it is not limited to the present invention, and any persond having ordinary knowledge in the technical field of the present invention, without departing from the spirit and scope of the present invention, when doing various changes and amendment。Therefore protection scope of the present invention is when being as the criterion depending on the defined person of appended claims。
Claims (19)
1. a remote control unit, this remote control unit includes:
Imageing sensor, obtains successively and includes the pre-treatment image of at least one reference light source image, the first image and the second image；
Reading circuit, in order to read the second view data of the part row view data of described pre-treatment image, the first view data of described first image and described second image from described imageing sensor；And
Processing unit, in order to determine the first concern scope according to the described at least one reference light source image in the described part row view data of described pre-treatment image, and control described reading circuit only read in described first image described first pay close attention to scope described first view data to calculate the characteristics of image of described at least one reference light source image, and according to described characteristics of image control described reading circuit only read in described second image second pay close attention to scope described second view data, wherein said second pay close attention to scope less than described second image。
2. remote control unit according to claim 1, wherein said characteristics of image includes at least one in the picture position of described reference light source image and picture size, brightness of image and action vector。
3. remote control unit according to claim 1, wherein said first concern scope and described second is paid close attention to and is ranged for preset shape pixel region or multiple row pixel region。
4. remote control unit according to claim 1, wherein said part row view data is the view data of the odd column of described pre-treatment image or even column。
5. remote control unit according to claim 1, wherein said processing unit controls described reading circuit and also reads described second view data of the part row beyond the described second concern scope in described second image。
6. remote control unit according to claim 1, wherein said second pays close attention to the scope picture size be more than or equal to described reference light source image。
7. remote control unit according to claim 1, wherein said at least one reference light source is fixed on image device。
8. an electricity saving method for interactive system, the method comprises the following steps:
Imageing sensor is utilized to obtain the pre-treatment image and the first image including at least one reference light source image successively；
Reading circuit is utilized to read the part row view data of described pre-treatment image；
Processing unit is utilized to determine the first concern scope according to the described at least one reference light source image in the described part row view data of described pre-treatment image；
Utilize described reading circuit only to read described first in described first image and pay close attention to the first view data of scope；And
Described processing unit is utilized to calculate the characteristics of image of described at least one reference light source image according to described first view data。
9. electricity saving method according to claim 8, wherein said part row view data is the view data of the odd column of described pre-treatment image or even column。
10. electricity saving method according to claim 8, wherein said processing unit determines described first concern scope according to the picture position of described at least one reference light source image。
11. electricity saving method according to claim 8, the method also comprises the following steps:
Described imageing sensor is utilized also to obtain the second image including described at least one reference light source image；And
Utilize described processing unit to control described reading circuit according to described characteristics of image and only read the second view data of the second concern scope in described second image, and described second pays close attention to scope less than described second image。
12. electricity saving method according to claim 11, the method also includes:
Update described second to pay close attention to and range for described first concern scope and to update described second view data be described first view data；
Described processing unit is utilized to calculate the after image feature of described at least one reference light source image according to described first view data after updating；
Updating described second image is an image newly obtained；And
In described second image after utilizing described processing unit reading circuit according to described after image character control only to read renewal second pays close attention to the second view data of scope。
13. electricity saving method according to claim 12, wherein said pre-treatment image is acquired every a Preset Time。
14. electricity saving method according to claim 12, the method also includes:
Described processing unit is utilized to control, every a Preset Time, described second view data that the part beyond the described second concern scope in described second image after described reading circuit also reads renewal arranges。
15. an electricity saving method for interactive system, this electricity saving method comprises the following steps:
Imageing sensor is utilized to obtain the first image and the second image including at least one reference light source image successively；
Reading circuit is utilized to read all images data of described first image；
Processing unit is utilized to calculate the characteristics of image of described at least one reference light source image according to the described all images data of described first image；And
Utilize described processing unit to control described reading circuit according to described characteristics of image and only read the concern scope in described second image and the view data of the row of the part beyond described concern scope, and described concern scope is less than described second image。
16. electricity saving method according to claim 15, wherein said processing unit determines the first concern scope in described first image according to the picture position of described at least one reference light source image, and relatively described first pays close attention to scope according to the second concern scope in action vector described second image of estimation of described reference light source image or according to the second concern scope in spreading parameter described second image of estimation。
17. electricity saving method according to claim 16, wherein said action is vectorial and described spreading parameter be a preset value or described processing unit calculated according to multiple images before described second image。
18. a remote control unit, this remote control unit includes:
Imageing sensor, obtains successively and includes the pre-treatment image of at least one reference light source image, the first image and the second image；
Reading circuit, in order to read the second view data of the part row view data of described pre-treatment image, the first view data of described first image and described second image from described imageing sensor, wherein said part row view data is the view data of the odd column of described pre-treatment image or even column；And
Processing unit, in order to calculate the characteristics of image of described at least one reference light source image according to described first view data, and control described reading circuit according to described characteristics of image and only read described second view data of the concern scope in described second image, wherein said concern scope is less than described second image。
19. a remote control unit, this remote control unit includes:
Imageing sensor, obtains the first image and the second image that include at least one reference light source image successively；
Reading circuit, in order to read the first view data of described first image and the second view data of described second image from described imageing sensor；And
Processing unit, in order to calculate the characteristics of image of described at least one reference light source image according to described first view data, and the concern scope in described second image and described second view data of the row of the part beyond described concern scope is only read according to the described characteristics of image described reading circuit of control, wherein said concern scope is less than described second image。
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210280075.0A CN103566587B (en) | 2012-08-08 | 2012-08-08 | The electricity saving method of remote control unit and interactive system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210280075.0A CN103566587B (en) | 2012-08-08 | 2012-08-08 | The electricity saving method of remote control unit and interactive system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103566587A CN103566587A (en) | 2014-02-12 |
| CN103566587B true CN103566587B (en) | 2016-06-22 |
Family
ID=50039832
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210280075.0A Active CN103566587B (en) | 2012-08-08 | 2012-08-08 | The electricity saving method of remote control unit and interactive system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103566587B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108184150B (en) * | 2017-12-29 | 2021-01-05 | 北京淳中科技股份有限公司 | Vector control method and device of remote labeling signal and signal processing system |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101546374A (en) * | 2008-03-28 | 2009-09-30 | 北京威亚视讯科技有限公司 | Somatosensory pointing remote control method, device and system |
| CN101673139A (en) * | 2008-09-10 | 2010-03-17 | Tcl集团股份有限公司 | Remote controller and input system and method thereof |
| CN102056002A (en) * | 2009-11-05 | 2011-05-11 | Lg电子株式会社 | Image display apparatus and method for controlling the image display apparatus |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9176598B2 (en) * | 2007-05-08 | 2015-11-03 | Thinkoptics, Inc. | Free-space multi-dimensional absolute pointer with improved performance |
-
2012
- 2012-08-08 CN CN201210280075.0A patent/CN103566587B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101546374A (en) * | 2008-03-28 | 2009-09-30 | 北京威亚视讯科技有限公司 | Somatosensory pointing remote control method, device and system |
| CN101673139A (en) * | 2008-09-10 | 2010-03-17 | Tcl集团股份有限公司 | Remote controller and input system and method thereof |
| CN102056002A (en) * | 2009-11-05 | 2011-05-11 | Lg电子株式会社 | Image display apparatus and method for controlling the image display apparatus |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103566587A (en) | 2014-02-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP4990211B2 (en) | System and method for labeling feature clusters in a frame of image data for optical navigation | |
| TWI338241B (en) | Interactive image system, interactive device and operative method thereof | |
| CN110036258B (en) | Information processing apparatus, information processing method, and computer program | |
| TWI526878B (en) | Method for controlling electronic apparatus, handheld electronic apparatus and monitoring system | |
| CN107197170A (en) | A kind of exposal control method and mobile terminal | |
| CN107037962A (en) | Image processing apparatus, electronic equipment and image processing method | |
| CN103019014B (en) | Projection apparatus, and projection control method | |
| US20150010309A1 (en) | System for Use in Remote Controlling Controlled Device | |
| JP3410919B2 (en) | Image extraction device | |
| US20090237529A1 (en) | Image recording method, image recording device, and storage medium | |
| US8851994B2 (en) | Game device, game control method, and game control program adapted to control game by using position and posture of input device | |
| JP5320332B2 (en) | GAME DEVICE, GAME DEVICE CONTROL METHOD, AND PROGRAM | |
| JP2010522922A (en) | System and method for tracking electronic devices | |
| CN109145809A (en) | A kind of note spectrum processing method and device and computer readable storage medium | |
| CN101617535A (en) | Image processing apparatus, image processing method, image processing program | |
| CN112672069B (en) | Exposure method and apparatus | |
| US20120274606A1 (en) | Optical navigation system with object detection | |
| JP2009064409A (en) | System and method for tracking input device using display screen in captured frames of image data | |
| CN109126135B (en) | Virtual shooting method, computer storage medium and terminal | |
| Meško et al. | Laser spot detection | |
| CN105874409A (en) | Information processing system, information processing method, and program | |
| CN103566587B (en) | The electricity saving method of remote control unit and interactive system | |
| CN107079098A (en) | Image playing method and device based on Pan/Tilt/Zoom camera | |
| CN112291480B (en) | Tracking focusing method, tracking focusing device, electronic device and readable storage medium | |
| JP2021002152A (en) | Image processing device, control method, and control program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |