WO2013104312A1 - 一种用于对受控设备进行遥控的系统 - Google Patents

一种用于对受控设备进行遥控的系统 Download PDF

Info

Publication number
WO2013104312A1
WO2013104312A1 PCT/CN2013/070284 CN2013070284W WO2013104312A1 WO 2013104312 A1 WO2013104312 A1 WO 2013104312A1 CN 2013070284 W CN2013070284 W CN 2013070284W WO 2013104312 A1 WO2013104312 A1 WO 2013104312A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
transmitting
unit
imaging
control
Prior art date
Application number
PCT/CN2013/070284
Other languages
English (en)
French (fr)
Inventor
李东舸
王玮
白霖抒
周长琳
Original Assignee
西安智意能电子科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 西安智意能电子科技有限公司 filed Critical 西安智意能电子科技有限公司
Priority to US14/371,383 priority Critical patent/US20150010309A1/en
Publication of WO2013104312A1 publication Critical patent/WO2013104312A1/zh

Links

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08CTRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C23/00Non-electrical signal transmission systems, e.g. optical systems
    • G08C23/04Non-electrical signal transmission systems, e.g. optical systems using light waves, e.g. infrared
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/42221Transmission circuitry, e.g. infrared [IR] or radio frequency [RF]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/4223Cameras
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213Monitoring of end-user related data
    • H04N21/44218Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/44Receiver circuitry for the reception of television signals according to analogue transmission standards
    • HELECTRICITY
    • H03ELECTRONIC CIRCUITRY
    • H03KPULSE TECHNIQUE
    • H03K17/00Electronic switching or gating, i.e. not by contact-making and –breaking
    • H03K17/94Electronic switching or gating, i.e. not by contact-making and –breaking characterised by the way in which the control signals are generated
    • H03K17/96Touch switches
    • H03K17/962Capacitive touch switches
    • HELECTRICITY
    • H03ELECTRONIC CIRCUITRY
    • H03KPULSE TECHNIQUE
    • H03K2217/00Indexing scheme related to electronic switching or gating, i.e. not by contact-making or -breaking covered by H03K17/00
    • H03K2217/94Indexing scheme related to electronic switching or gating, i.e. not by contact-making or -breaking covered by H03K17/00 characterised by the way in which the control signal is generated
    • H03K2217/96Touch switches
    • H03K2217/96054Double function: touch detection combined with detection of a movable element

Definitions

  • the present invention relates to the field of intelligent control technologies, and more particularly to a technique for remotely controlling a controlled device. Background technique
  • a certain signal transmitted by the transmitting device such as an electromagnetic signal, a sound signal or an optical signal
  • the detecting device In the field of intelligent control such as smart TV, somatosensory interaction, virtual reality, etc., a certain signal transmitted by the transmitting device, such as an electromagnetic signal, a sound signal or an optical signal, is usually detected by the detecting device to perform corresponding control operations, such as opening or closing. Controlled device.
  • an electromagnetic signal-based system is susceptible to the presence of electronic devices or geomagnetism in the environment when measuring the electromagnetic signal; and the sound signal-based system is susceptible to environmental noise when measuring the sound signal. .
  • a transmitting device comprising an emitting light source for transmitting a control signal
  • a detecting device comprising an imaging unit, configured to acquire imaging information of the control signal in the imaging unit;
  • a computing device configured to determine location information of the transmitting device according to the imaging information acquired by the detecting device
  • a control device configured to determine a control instruction corresponding to the location information for controlling a controlled device connected to the system.
  • the detecting device further includes a mode detecting unit, configured to detect an operating mode of the transmitting device, wherein the image capturing unit is preceded with a removable filter,
  • the detecting device further includes an imaging control unit, the imaging control The unit is configured to perform an adding or removing operation on the filter according to the working mode detected by the mode detecting unit.
  • the mode detecting unit includes an infrared detecting sensor for detecting whether the transmitting device operates in an infrared mode.
  • the mode detecting unit comprises an ambient brightness sensor for detecting an ambient brightness of an environment in which the transmitting device is located to determine an operating mode of the transmitting device by comparing the ambient brightness with a predetermined brightness threshold.
  • the detecting device further includes a mode detecting unit, configured to detect an operating mode of the transmitting device, wherein the detecting device includes two infrared filters and visible light respectively An imaging unit of the filter, and an imaging switching unit for providing imaging information of the imaging unit with the filter corresponding to the working mode to the calculation according to the working mode Device.
  • a mode detecting unit configured to detect an operating mode of the transmitting device, wherein the detecting device includes two infrared filters and visible light respectively An imaging unit of the filter, and an imaging switching unit for providing imaging information of the imaging unit with the filter corresponding to the working mode to the calculation according to the working mode Device.
  • the system further includes gesture recognition means for identifying gesture imaging information of the user acquired by the camera unit; wherein the control means is configured to determine the position information and the gesture imaging information corresponding to the gesture information Control instructions for controlling a controlled device connected to the system.
  • gesture recognition means for identifying gesture imaging information of the user acquired by the camera unit
  • control means is configured to determine the position information and the gesture imaging information corresponding to the gesture information Control instructions for controlling a controlled device connected to the system.
  • the detecting device further comprises an infrared emitting unit for emitting infrared light, so as to acquire the gesture imaging information of the user.
  • the system further includes application mode identifying means for determining a current application mode of the system according to a predetermined application mode identification rule; wherein the control device is configured to use the current application according to the current application a mode, a control instruction corresponding to the location information and the gesture imaging information is determined for controlling a controlled device connected to the system.
  • the application pattern recognition rule comprises at least one of the following:
  • Determining the current application mode according to an operating state of the transmitting device determining the current application mode according to a priority setting of the application mode
  • the transmitting device includes a plurality of transmitting light sources for transmitting control signals; wherein the computing device is configured to generate, according to the plurality of emitted lights The imaging information of the plurality of control signals corresponding to the source determines the location information of the transmitting device.
  • the system includes a plurality of transmitting devices, each of the plurality of transmitting devices including an emitting light source for transmitting a control signal; wherein the system further includes a transmitting identifying device for Identifying the plurality of transmitting devices.
  • the transmission identifying means is configured to transmit the illumination mode of the control signal according to an emission source of each of the plurality of transmitting devices, and identify the plurality of transmitting devices.
  • the transmission identifying means is configured to identify the plurality of transmitting devices according to a motion trajectory of imaging information corresponding to a transmitting light source of each of the plurality of transmitting devices.
  • the transmission identifying means is further for determining a priority of the plurality of transmitting means.
  • the system further includes an auxiliary information acquiring device, configured to acquire, according to the imaging information of the control signal in the imaging unit, the imaging information corresponding to the imaging information Auxiliary information; wherein the control device is configured to determine a control instruction corresponding to the location information and the auxiliary information for controlling a controlled device corresponding to the remote control system.
  • the light emitting mode in which the transmitting light source transmits the control signal includes at least one of the following:
  • the emission light source transmits the control signal in an alternating illumination mode, wherein the alternating illumination mode comprises at least one of the following:
  • the detecting device includes a plurality of camera sheets
  • the plurality of imaging units are configured to respectively acquire imaging information of the control signal; wherein the computing device is configured to determine a location of the transmitting device according to the plurality of imaging information acquired by the plurality of imaging units information.
  • the system further includes feedback means for transmitting feedback information corresponding to the control signal to the transmitting device, wherein the transmitting device further comprises:
  • a receiving unit configured to receive the feedback information
  • an execution unit configured to perform an operation corresponding to the feedback information according to the feedback information.
  • the executing unit is configured to adjust brightness control information of the transmitting light source according to distance information and/or brightness information of the imaging information included in the feedback information.
  • the transmitting device further includes:
  • an instruction acquisition unit configured to acquire an instruction that the user intends to send through the transmitting device
  • a transmission control modulating unit configured to control the transmitting light source to transmit the control signal at a certain flicker frequency according to the instruction information, wherein a brightness change of the control signal corresponds to the instruction information
  • the image capturing unit acquires the imaging information and the brightness change at an exposure frequency that is at least twice the blinking frequency;
  • control device is used to:
  • the transmitting device further includes:
  • An instruction acquiring unit configured to acquire instruction information that the user intends to send through the transmitting device
  • An instruction sending unit configured to send, according to the instruction information, a command signal corresponding to the instruction information
  • the system also includes:
  • An instruction receiving device configured to receive a command signal from the transmitting device; Wherein, the control device is used to:
  • the transmitting device further includes a switching unit for performing switching control and/or brightness adjustment on the transmitting light source, for performing on the transmitting device according to an operation of the user Switching operation and / or brightness adjustment.
  • the switch unit comprises a touch button switch unit for performing a corresponding operation on the transmitting device according to the pressing or lifting or touching operation of the user.
  • the system further includes a state switching triggering device for detecting whether a sleep triggering condition for switching the system to the sleep mode is satisfied; wherein the detecting device is configured to:
  • the sleep background operation includes adjusting an exposure frequency of the image capturing unit; wherein the detecting device is configured to:
  • the state switching triggering device is further configured to detect whether a ready-to-trigger condition for switching the system to the ready mode is met; wherein the detecting device is further configured to enter and be ready when the ready-to-trigger condition is met The working mode corresponding to the trigger condition.
  • the location information includes three-dimensional location information
  • the computing device further includes:
  • a light spot detecting unit configured to detect an input light spot corresponding to the transmitting device according to the imaging information acquired by the detecting device
  • a three-dimensional computing unit configured to calculate three-dimensional position information of the transmitting device according to the spot attribute information of the input spot.
  • the three-dimensional position information includes three-dimensional rotational position information.
  • control device is used to:
  • the transmitting device further includes a spacing unit located at an outer circumference of the light emitting source, wherein a portion of the spacing unit facing the image capturing unit is dark or covered with a light absorbing material.
  • the controlled device comprises one or more of a television set, a set top box, a mobile device, a gaming machine or a PC.
  • the present invention includes a computing device for calculating position information of the transmitting device at the receiving end of the system, and a control device for determining a corresponding control command according to the position information, thereby realizing remote control of the controlled device. Improves the accuracy of control, which in turn improves control efficiency and enhances the user's control experience.
  • FIG. 1 shows a system diagram of a system for remotely controlling a controlled device in accordance with an aspect of the present invention
  • FIG. 2 shows a schematic diagram of an apparatus for a system for remotely controlling a controlled device in accordance with a preferred embodiment of the present invention
  • Figure 3 is a block diagram showing an apparatus for remotely controlling a controlled device in accordance with another preferred embodiment of the present invention.
  • FIG. 4 is a system diagram of a system for remotely controlling a controlled device in accordance with still another preferred embodiment of the present invention.
  • Figure 5 is a system diagram showing a system for remotely controlling a controlled device in accordance with still another preferred embodiment of the present invention.
  • FIG. 6 shows a system diagram of a system for remotely controlling a controlled device in accordance with still another preferred embodiment of the present invention
  • Figure 7 is a block diagram showing a touch button circuit according to still another preferred embodiment of the present invention.
  • Figure 8 is a block diagram showing the structure of a touch button switch unit in accordance with still another preferred embodiment of the present invention.
  • Figure 9 illustrates the power of a touch key switch unit in accordance with still another preferred embodiment of the present invention.
  • Road map illustrates the power of a touch key switch unit in accordance with still another preferred embodiment of the present invention.
  • the system 1 shows a system diagram of a system for remotely controlling a controlled device in accordance with an aspect of the present invention
  • the system 1 includes a transmitting device 11, a detecting device 12, a computing device 13, and a control device 14, wherein the detecting device 12 includes Imaging unit 121.
  • the present invention only takes the transmitting device 11 as a transmitting end to transmit a control signal, and the detecting device 12 as a receiving end to detect imaging information.
  • the device 12 transmits a control signal as a transmitting end, and the transmitting device 11 detects imaging information as a receiving end, which is hereby incorporated by reference.
  • the transmitting device 11 includes an emitting light source for transmitting a control signal.
  • the transmitting device 11 may be, for example, a remote controller, a game controller, or the like.
  • the transmitting device 11 is provided with an emitting light source, and the emitting light source emits light at a certain wavelength as a control signal, and the emitting light source includes but is not limited to a point light source. , a surface light source, a spherical light source or any other light source that emits light at a certain wavelength, such as an LED visible light source, an LED infrared light source, an OLED (Organic Light-Emitting Diode) light source, a laser light source, and the like.
  • the transmitting device 11 may include only one transmitting light source for transmitting a control signal, and may also include a plurality of transmitting light sources for transmitting the control signal.
  • LEDs are taken as an example, and those skilled in the art should understand that other existing or future generations of other forms of emission light sources, such as OLEDs, as applicable to the present invention, should also be included in the present invention. It is within the scope of the invention and is hereby incorporated by reference.
  • an LED Light Emitting Diode
  • an LED is a solid-state semiconductor device capable of converting electrical energy into visible light, which can directly convert electricity into light and use the light as a control signal.
  • the illumination mode of the LED transmitting the control signal comprises at least one of the following:
  • the (equal) LED emits light in a shape such as a triangle, a circle, or a square, and if the LED is made into a special shape, the emitted light has the special shape as a control. a signal; or, a plurality of LEDs form a triangle, a circle, or a square shape, and simultaneously emit light as a control signal; or, each LED in the LED dot matrix, by lighting or extinguishing, forms a light-emitting pattern having a special shape as control signal.
  • the (equivalent) LED emits light at a certain wavelength to form a color corresponding to the wavelength.
  • the (equal) LED emits light at a certain blinking frequency, such as ten flashes per second.
  • the (equal) LED emits light at a certain brightness, where the brightness indicates the luminous flux of the (equal) LED in a unit area of a solid angle unit in a particular direction, the brightness being calculated by the LED in the LED frame.
  • the average value or the sum of the gray values of the corresponding imaging information is represented.
  • the (equal) LED emits light with a certain brightness distribution, such as a brightly distributed ambient light distribution in the middle.
  • the (equal) LED transmits the control signal at a certain flicker frequency, such as ten times per second, the blinking frequency may also be based on, for example, loading
  • the modulation signal (such as the command signal) changes.
  • the emission light source transmits the control signal in an alternating illumination mode, wherein the alternating illumination mode comprises at least one of the following:
  • the light-emitting modes in which the light and dark alternately change include, but are not limited to:
  • the dark minimum duration is at least not lower than the exposure time of the image pickup unit.
  • the minimum duration of light or dark is not lower than the sum of the exposure time of the image pickup unit and the double exposure time interval.
  • the light or dark of the predetermined duration of the emitted light source is used as a signal value, such as a continuous lightening of 10 ms as a value of 1 and a continuous darkness of 10 ms as a value of 0, a continuous lightening of 20 ms and a continuous dark signal of 10 ms.
  • the value is 110.
  • the minimum duration of light or dark is at least not less than the exposure time of the camera unit.
  • the minimum duration of light or dark is not lower than the sum of the exposure time of the camera unit and the double exposure time interval.
  • the minimum time interval of alternating light and dark is at least twice the exposure time of the image capturing unit, preferably, the minimum of two light and dark alternating
  • the time interval is at least twice the sum of the exposure time of the camera unit and the double exposure time interval.
  • the two light-dark alternating time intervals of the transmitting light source are used as signal values, for example, the signal value is 1 when the two-flashing time interval is 10 ms, and the signal value is when the two-flashing time interval is 20 ms. 2, when the first and second flashing time interval is 10ms, and the second and third flashing time interval is 20ms, the generated signal value is 12.
  • the minimum time interval between the two light and dark alternates should be at least twice the exposure time of the camera unit.
  • the minimum time interval between the two light and dark alternations is at least twice the sum of the exposure time of the camera unit and the interval between the two exposure times.
  • the exposure frequency of the imaging unit is at least twice the alternating light and dark frequency, wherein the exposure frequency is the number of exposures of the imaging unit in a unit time.
  • the alternating light and dark frequency of the transmitting light source that is, the blinking frequency
  • the blinking frequency is used as a signal value, for example, a flashing signal value of 1 occurs in Is, and a blinking signal value of 2 occurs twice, then a flashing occurs in the first Is and When two flashes occur in the second s, the resulting signal value is 12.
  • the exposure frequency of the imaging unit is at least twice the alternating frequency of the light and dark.
  • the signal value obtained by the above manner can be used to load the control signal to Control operations on the controlled device.
  • signal value 10 can be used to implement a "confirm" function
  • signal value 110 can be used to implement a "return” function
  • signal value 112 can be used to implement a connection request
  • signal value 113 can be used to implement a data transfer request or the like.
  • the signal value obtained by the above manner can be used to determine the device ID number to distinguish between multiple devices to be connected.
  • a string of signal values after the signal value 20 can be used as the device ID number to identify the unique identity of the device
  • a string of signal values after the signal value 21 can be used as the permission level of the device, and the obtained signal value can be used to perform the device on the device. Identity match, get the appropriate permissions.
  • the transmission identification device mentioned below may distinguish the plurality of transmitting devices according to signal values respectively sent by the plurality of transmitting devices corresponding to the plurality of devices to be connected, and further distinguish the plurality of devices to be connected.
  • the signal values obtained in the above manner can be used as a specific mode for noise immunity.
  • the specific signal value represents a specific illuminating law, and the noise in nature generally does not have such illuminating law.
  • the signal value 12111211 represents that the light source blinks brightly and darkly at a certain brightness time, or that it is performed at a certain light-dark interval. Blinking, or indicating that the flashing is performed at a certain flicker frequency. When the detected spot does not have such flickering characteristics, it can be regarded as noise and deleted.
  • the illumination mode of the change in the geometric characteristics of the spot includes, but is not limited to, the number of spots of the emitted light source, the changed geometry, or the like, or the combination of the above two variations to transmit the control signal.
  • the emission source transmits the control signal in combination with any of the plurality of alternate illumination modes described above, for example, transmitting the control signal in an illumination mode in which the light and dark are alternately changed in combination with the wavelength alternately.
  • the LED emits light in a red, green, and bright alternating light pattern.
  • the alternating illumination modes of the emission source may also comprise a combined illumination of a plurality of different wavelength (color) emission sources, the alternations of which may be represented by a combination of different colors alternating.
  • a transmitting device having a plurality of emitting light sources each of the emitting light sources has a certain wavelength (color), and the plurality of emitting light sources are blinking at a certain frequency, thereby realizing alternating light emitting patterns of different wavelengths (colors) of the emitting device.
  • each of the transmitting devices has at least one emitting light source, the at least one emitting light
  • the source has a certain wavelength (color) and is flickered at a frequency to achieve alternating illumination modes of different wavelengths (colors) of the plurality of emitting devices.
  • the combination of different wavelengths (colors) can constitute a light-emitting unit, for example, by using a two-color LED or two or more LEDs of different wavelengths (colors).
  • the emission source may also transmit a control signal using a plurality of different wavelengths (colors) in combination with alternating illumination modes of alternating light and dark variations, changes in spot geometry.
  • only one of the LEDs or two LEDs can be illuminated at the same time to form different illuminating color distributions, and one LED can be always bright, and the other blinks at a certain frequency to achieve an alternating illuminating mode of different color combinations.
  • noise immunity is achieved by an alternate illumination mode in which one LED is constantly lit and another is blinking at a certain frequency.
  • the illumination mode first uses two LED illumination points to screen out the noise points of the individual illumination points in the natural world; the illumination mode then uses the LED illumination points with a specific color distribution to screen out the noise points in the natural world that are not the specific color; The illumination mode is further illuminated by an LED that blinks at a specific frequency to filter out other noise points that are not in the illumination mode.
  • the detecting device 12 includes an imaging unit 121 that acquires imaging information of the control signal in the imaging unit 121.
  • the detecting device 12 may include only one imaging unit, such as a camera sensor that can simultaneously detect visible light and infrared light, and may also include a plurality of imaging units.
  • the (equal) camera unit 121 is capable of sensing and acquiring visible and/or infrared images emitted by the LEDs.
  • the (equal) imaging unit 121 emits at a sufficiently high acquisition frame rate, such as 15 fps or more, a suitable resolution, such as 640 x 480 or more, and a sufficiently short exposure time, such as 1/500 or less.
  • One or more LEDs at the end of the device 11 are photographed to acquire imaging information of the control signal transmitted by the one or more LEDs in the imaging unit 121.
  • each LED in the LED dot matrix of the transmitting device 11 is turned on or off to form a triangular light emitting pattern.
  • the imaging unit 121 obtains the triangular light emitting pattern by capturing the LED dot matrix.
  • Imaging information in the imaging unit 121 includes However, it is not limited to the positional information of the LED in the LED frame captured by the imaging unit 121, the size and shape of the formed image, and the like.
  • imaging information and the manner of acquiring imaging information are only examples, and other existing or future imaging information or methods for acquiring imaging information may be applied to the present invention, and should also be included in the present invention. It is within the scope of protection and is hereby incorporated by reference.
  • the computing device 13 determines the location information of the transmitting device 11 based on the imaging information acquired by the detecting device 12. Specifically, the computing device 13 according to the imaging information acquired by the detecting device 12, such as the position information of the LED in the LED frame captured by the imaging unit 121, the size and shape of the formed image, etc. The calculation determines the position information of the transmitting device 11, such as two-dimensional position information, three-dimensional position information, two-dimensional motion trajectory, three-dimensional motion trajectory, and the like of the transmitting device 11. For example, the computing device 13 maps the change of the position information into the physical space according to the change of the position information in the LED frame captured by the camera unit 121 by the LED of the transmitting device 11 to determine the two-dimensional motion trajectory of the transmitting device 11.
  • the computing device 13 determines the two-dimensional position information of the transmitting device 11 according to the position information of the LEDs of the transmitting device 11 at the LED frame captured by the imaging unit 121, and further, according to the corresponding LED in the LED frame.
  • the size of the imaging information is combined with the actual area of the LED spot to calculate the distance between the LED and the camera unit 121 to determine the three-dimensional position information of the transmitting device 11.
  • the control device 14 determines a control command corresponding to the position information for controlling the controlled device connected to the system. Specifically, the control device 14 calculates the determined location information of the transmitting device 11 according to the computing device 13, such as one of two-dimensional position information, three-dimensional position information, two-dimensional motion trajectory, and three-dimensional motion trajectory of the transmitting device 11. Or several, or a specific combination of motions, etc., by performing a matching query in the instruction library, obtaining a control instruction corresponding to the location information, to be connected to the system The connected controlled device is controlled.
  • the computing device 13 determines, by calculation, that the location information of the transmitting device 11 is a top-down two-dimensional motion trajectory; the control device 14 matches the search in the instruction library according to the location information, and determines a control corresponding to the location information.
  • the instruction is to scroll the page from top to bottom.
  • the control device 14 sends the control command to one or more connected to the system 1 by wired communication or by wireless communication methods such as WIFI, Bluetooth, infrared, etc. Controlled devices to control the one or more controlled devices.
  • control device 14 can simultaneously control a plurality of controlled devices.
  • the control device 14 simultaneously transmits control commands for scrolling pages from top to bottom to the set top box, the game machine, and the PC, and the set top box, the game machine, and the PC are According to the control instruction, the operation of scrolling the page from top to bottom is performed at the same time.
  • the control device 14 may sequentially send the control commands to the corresponding controlled device according to the priority of the plurality of controlled devices.
  • the mapping library is pre-set with a mapping relationship between the location information and the control command, and the mapping relationship can be updated according to the user's settings.
  • the controlled device includes, but is not limited to, one or more of a television set, a set top box, a mobile device, a gaming machine, or a PC.
  • FIG. 2 shows a schematic diagram of a device for remotely controlling a controlled device in accordance with a preferred embodiment of the present invention; wherein the detecting device 22 includes an imaging unit 221, a mode detecting unit 222, and an imaging control unit 223.
  • the mode detecting unit 222 detects an operation mode of the transmitting device 21; the image capturing unit 221 is preceded with a removable filter, and the detecting device 22 further includes an imaging control unit 223, and the imaging control unit 223 according to the mode The operation mode detected by the detecting unit 222 adds or removes the filter.
  • the imaging unit 221 For example, a camera sensor capable of detecting both visible light and infrared light; the camera unit
  • a removable filter is attached to the front surface 221, the removable filter includes an infrared filter and/or a visible light filter; the detecting device 22 further includes an imaging control unit 223, which includes, for example, an electromagnetic A switch controls whether an infrared filter or a visible light filter is placed on the imaging unit 221. Assuming that the mode detecting unit 222 detects that the transmitting device 21 is operating in the visible light mode and the infrared filter is already present on the image capturing unit 221, the imaging control unit 223 removes it with an electromagnetic switch, otherwise nothing is done.
  • the imaging control unit 223 uses the electromagnetic switch to turn the infrared filter. It is added to the imaging unit 221.
  • the mode detecting unit 222 includes an infrared detecting sensor that detects whether the transmitting device 21 operates in an infrared mode.
  • the infrared detecting sensor detects a control signal transmitted by the transmitting device 21, and when detecting that the control signal is an infrared signal, the infrared detecting sensor determines that the transmitting device 21 operates in an infrared mode.
  • the mode detecting unit 222 includes an ambient brightness sensor that detects an ambient brightness of an environment in which the transmitting device 21 is located to determine the transmitting device by comparing the ambient brightness with a predetermined brightness threshold.
  • Working mode For example, the ambient brightness sensor first detects the ambient brightness of the environment in which the transmitting device 21 is located, and then compares the ambient brightness with a predetermined brightness threshold. When the ambient brightness is higher than the brightness threshold, the ambient brightness sensor determines the transmitting device. 21 operates in visible light mode, or operates in visible light and infrared compatible mode; when the ambient brightness is lower than the brightness threshold, the ambient brightness sensor determines that the transmitting device 21 is operating in the infrared mode.
  • the mode detecting unit 222 may include only one of the infrared detecting sensor or the ambient brightness sensor, and may also include the two sensors.
  • the mode detecting unit 222 includes only the infrared detecting sensor, the system 1 operates in the remote control mode, and the infrared detecting sensor detects that the control signal sent by the transmitting device 21 is an infrared signal, it is determined that the transmitting device 21 operates in the infrared. Mode; when the infrared detecting sensor does not detect the infrared signal sent by the transmitting device 21, it is determined that the transmitting device 21 operates in visible light Mode.
  • FIG. 3 is a schematic diagram of an apparatus for remotely controlling a controlled device in accordance with a preferred embodiment of the present invention; wherein the detecting means 32 includes an imaging unit 321a, an imaging unit 321b, a mode detecting unit 322, and an imaging switching unit 324.
  • the mode detecting unit 322 detects an operation mode of the transmitting device 31.
  • the detecting device 22 includes an image capturing unit 321a with an infrared filter disposed thereon, and an image capturing unit 321b with a visible light filter disposed thereon, and an image switching device.
  • the unit 324, the imaging switching unit 324 provides the imaging information of the imaging unit with the filter corresponding to the working mode to the computing device according to the operation mode determined by the mode detecting unit 322.
  • the detecting device 22 includes two imaging units, one of which is provided with an infrared filter for detecting infrared light, and the other is provided with a visible light filter for detecting visible light; the imaging switching unit 324 includes a control circuit.
  • the control circuit determines whether to stop using a certain camera unit, or decides to enable a certain camera unit; when the mode detecting unit 322 detects the operation mode of the transmitting device 31, the imaging switching unit 324 selects the enabled front through the control circuit.
  • An imaging unit corresponding to the filter mode of the working mode, and providing imaging information of the imaging unit to the computing device.
  • the mode detecting unit 322 detects that the operating mode of the transmitting device 31 is the infrared mode, and the imaging switching unit 324 determines to stop using the image capturing unit 321b with the visible light filter disposed thereon, and uses the image with the infrared filter in front.
  • the unit 321a; further, the imaging switching unit 324 supplies the imaging information of the imaging unit 321a with the infrared filter disposed thereon to the computing device.
  • the mode detecting unit 322 is the same as or substantially the same as the mode detecting unit 222 in the embodiment shown in FIG. 2, and thus is not described herein again, and is included herein by reference.
  • the system 1 includes a transmitting device 41, a detecting device 42 including an imaging unit 421, a computing device 43, and a control device 44.
  • Gesture recognition device 45 and pattern recognition device 46 are respectively the same as or similar to the corresponding device shown in FIG. 1, and therefore are not described herein again, and are included herein by reference.
  • the gesture recognition device 45 identifies the gesture imaging information of the user acquired by the imaging unit 421; the control device 44 determines a control instruction corresponding to the location information and the gesture imaging information for use with the system Connected controlled devices are controlled.
  • the imaging unit 421 acquires imaging information of the control signal while acquiring the gesture imaging information of the user; the gesture recognition device 45 according to the gesture of the user acquired by the imaging unit 421 Imaging information, by image processing or the like, identifying the gesture imaging information, such as gesture imaging information identifying the user's thumbs up; the computing device 43 determines the location information of the transmitting device 41 according to the imaging information of the control signal; The control device 44, according to the location information, in combination with the gesture imaging information, determines, by matching the query in the instruction library, a control instruction corresponding to the location information and the gesture imaging information for connecting to the system. Controlled devices are controlled.
  • control device 44 may further determine the corresponding control command according to the priority of the location information and the gesture imaging information. For example, when the priority of the gesture imaging information is higher than the location information, the corresponding control is determined only according to the gesture imaging information. Or; or, according to the gesture imaging information, supplemented by the location information of the transmitting device 11, the corresponding control command is determined.
  • the detecting means 42 further comprises an infrared emitting unit (not shown) that emits infrared light in order to acquire the gesture imaging information of the user.
  • the infrared emitting unit is, for example, an LED that can emit infrared light, and emits infrared light in an area that the infrared emitting unit can illuminate, so that the user can make a corresponding gesture in the area, and the imaging unit in the detecting device 42 Working in infrared mode, obtaining imaging information of the user's gesture.
  • the system further includes an application pattern recognition device (not shown) that determines a current application mode of the system according to a predetermined application mode identification rule; subsequently, the control device 44 is configured according to the current application mode, A control command corresponding to the position information and the gesture imaging information is determined for controlling a controlled device connected to the system.
  • the system 1 may include different applications, and different applications imply different detection modes.
  • the mode recognition device determines the current application mode of the system 1 according to a predetermined application mode identification rule.
  • the system 1 currently works in a remote control mode, a gesture recognition mode, and the like.
  • the application pattern recognition rule includes but is not limited to at least one of the following:
  • Determining the current application mode according to an operating state of the transmitting device determining the current application mode according to a priority setting of the application mode
  • the application mode recognition device detects whether the transmitting device 41 is in an active state by using a sensor or the like, and determines that the current application mode of the system 1 is the remote control mode when the transmitting device 41 is in an active state; otherwise, determining the current state of the system 1
  • the application mode is the gesture recognition mode.
  • the priority of the preset gesture recognition mode of the system 1 is higher than the remote control mode, when the system 1 recognizes the gesture of the user and detects the LED imaging information, the application mode recognition device according to the priority of the application mode.
  • the application mode recognition device determines the current application mode of the system according to the current application information of the system. If the current application of the system is a video call, the application mode recognition device determines that the current application mode of the system is a gesture recognition mode. Or infrared and visible light compatibility mode.
  • the control device 44 determines a control instruction corresponding to the location information and the gesture imaging information according to the current application mode of the system determined by the application mode identification device, such as when the current application mode of the system 1 is a gesture Identifying the mode, the control device 14 determines corresponding control commands for controlling the controlled device connected to the system according to the gesture imaging information; or, when the current application mode of the system 1 is the remote control mode Then, the control device 14 determines a corresponding control command based on the position information of the transmitting device 41.
  • the transmitting device 11 includes a plurality of LEDs for transmitting control signals, wherein the computing device 13 determines the location based on imaging information of the plurality of control signals corresponding to the plurality of LEDs.
  • the location information of the transmitting device includes a plurality of LEDs for transmitting control signals, and the plurality of LEDs have a certain The control signal is transmitted in an illumination mode such as shape, wavelength, flicker frequency, brightness or brightness distribution.
  • the plurality of LEDs form a shape such as a triangle, a circle, or a square, and simultaneously emit light as a control signal; or, a plurality of LEDs in the LED dot matrix are turned on or off to form a light-emitting pattern having a special shape as control signal.
  • the computing device 13 determines imaging information of the plurality of control signals corresponding to the plurality of LEDs, such as position information of the plurality of LEDs in the LED frame captured by the imaging unit 121, size, shape, etc. of the formed image.
  • the position information of the transmitting device 11 is determined by a certain calculation, such as two-dimensional position information, three-dimensional position information, two-dimensional motion trajectory, three-dimensional motion trajectory, and the like of the transmitting device 11.
  • the computing device 13 calculates the position information of the plurality of LEDs, and determines the position information of the transmitting device 11 where the plurality of LEDs are located by performing a certain conversion calculation on the plurality of position information, such as a weighted average calculation or the like.
  • the system 1 comprises a plurality of transmitting devices, each of the plurality of transmitting devices comprising an emitting light source for transmitting a control signal; wherein the system 1 further comprises a transmitting identification device (not shown), the transmitting An identification device is used to identify the plurality of transmitting devices.
  • the system may simultaneously emit visible or infrared light to the receiving device by more than one transmitting device; the detecting device 12 respectively acquires imaging information of the visible or infrared light in the imaging unit; and the imaging information calculating device 13 respectively calculates the plurality of Two-dimensional or three-dimensional position information of the transmitting device.
  • the system may detect candidate imaging information by using the foregoing method.
  • the system may detect the remote controller corresponding to the N transmitting devices, and extract up to N candidate imaging information that meet the conditions as the transmitting. Imaging information corresponding to the device; and then extracting corresponding imaging feature information to distinguish different transmitting devices
  • the manner in which the transmission identifying device identifies the plurality of transmitting devices includes, but is not limited to:
  • the emission recognition device is based on the emission devices.
  • the lighting mode distinguishes different launchers.
  • the emission identification device may use an image according to imaging information corresponding to LEDs of the plurality of transmitting devices
  • Common methods in processing detect circulars of different sizes, identify triangles or quadrilaterals by straight line detection of edge of the area or corner detection to distinguish different transmitting devices; or, the transmitting identifying device can distinguish different transmitting devices according to different blinking frequencies
  • the acquisition frame rate of the camera unit must be greater than twice the maximum flashing frequency of the LED (preferably more than three times); or, the transmission identification device uses the difference method to detect the blinking frequency of the LED, thereby distinguishing different transmitting ends; or, transmitting
  • the identification device uses different colors or a combination thereof to distinguish different emitters.
  • the color detection can capture the light spot with a color camera and then distinguish the dominant color of the light spot region with RGB or other color space; or, corresponding to different brightness distribution patterns, emit
  • the identification device can previously train the classifier (such as the LDA classifier) using the intensity distribution of the samples of the different transmitting devices (e.g., all pixel intensity values within the spot), and assign each spot to the classification result of the classifier when in use.
  • the classifier such as the LDA classifier
  • the transmission identifying means can identify the plurality of transmitting means based on alternating lighting patterns of the plurality of transmitting means. For example, the transmission identifying means identifies the plurality of transmitting means based on a signal value obtained by transmitting a control signal in an illumination mode in which the light source of the plurality of transmitting means changes in light and dark alternately.
  • the launch identification device can use the tracking technique under video to distinguish the motion trajectories of different LEDs to distinguish different transmitting devices at any time.
  • the transmission identification device can also distinguish the different transmitting devices at any time by using the motion trajectory of the imaging information corresponding to each transmitting device, such as which imaging information belongs to the transmitting device that is turned on at time i, and which belongs to the time j.
  • the transmitting device that is, the transmitting device that is turned on at any time 1 and the transmitting device that is turned on at time j are respectively located, thereby corresponding to the corresponding operations.
  • each imaging information can be tracked according to a motion model, such as a model of constant velocity or acceleration, using existing target tracking methods. For example, assuming that there are at most N transmitting devices, the transmitting identifying device extracts motion trajectories of the N imaging information that meet the conditions as candidate imaging information, and then the transmitting identifying device records historical features such as the start time and position of each motion trajectory. Until the end of the trajectory, each motion trajectory corresponds to one transmitting device at any time.
  • a motion model such as a model of constant velocity or acceleration
  • the computing device 13 respectively calculating position information of different transmitting devices, and the control device 14 determines different control commands corresponding to different position information to respectively send the different control commands to the corresponding controlled devices.
  • the transmission identification device can also determine the priority corresponding to the different transmission devices.
  • the emission identification device combines the start time of the imaging information corresponding to the LED, the position or the motion area of the trajectory (front and rear, left and right), and distinguishes different transmission devices corresponding to different LEDs.
  • the first enabled transmitting device (which can be judged based on the time at which the imaging information is detected) is always mastered and has a higher priority, or the corresponding position information is always mastered in the front or middle area of the transmitting device. And have higher priority and so on.
  • the system 1 further includes an auxiliary information acquiring device (not shown) that acquires imaging information in the imaging unit 121 based on the control signal. Auxiliary information corresponding to the imaging information; wherein the control device 14 determines a control instruction corresponding to the position information and the auxiliary information for use in a controlled device corresponding to the remote control system Take control.
  • the auxiliary information acquiring device acquires auxiliary information corresponding to the imaging information according to the imaging information of the control signal corresponding to the (equal) LED in the imaging unit 121, and the auxiliary information includes but is not limited to the imaging The color, brightness, formed pattern, etc.
  • the control device 14 performs matching in the instruction library according to the position information of the LED (the LED) determined by the computing device 13 and one or more of the auxiliary information.
  • the query determines a corresponding control command for controlling the controlled device corresponding to the remote control system. For example, each LED in the LED dot matrix of the transmitting device 11 is turned on or off to form a triangular light emitting pattern.
  • the imaging unit 121 obtains the triangular light emitting pattern by capturing the LED dot matrix.
  • the detecting device 12 includes a plurality of photographs
  • the imaging unit is configured to acquire imaging information of the control signal, respectively, wherein the computing device 13 determines the transmitting device 11 according to the plurality of imaging information acquired by the plurality of imaging units. location information.
  • the plurality of imaging units operate, for example, in the same working mode, and simultaneously capture one or more LEDs of the transmitting device 11 end by acquiring the frame rate, the same resolution, the same exposure time, and the like, respectively.
  • the computing device 13 respectively obtains, according to the plurality of imaging information acquired by the plurality of imaging units, position information of the one or more LEDs in the LED frame captured by the plurality of imaging units, the size of the formed image,
  • the position and the like of the transmitting device 11 such as the two-dimensional position information, the three-dimensional position information, the two-dimensional motion trajectory, the three-dimensional motion trajectory, and the like of the transmitting device 11 are determined by a certain calculation.
  • the detecting device 12 includes two imaging units that respectively acquire imaging information of a control signal transmitted by the transmitting device 11; the computing device 13 calculates a position information of the transmitting device 11 by using a binocular stereo vision algorithm. .
  • the system 1 includes a transmitting device 51, a detecting device 52, a computing device 53, a control device 54, and a feedback device 57.
  • the transmitting device 51 includes a receiving unit 511 and an executing unit 512.
  • the detecting device 52, the calculating device 53 and the control device 54 are respectively the same as or similar to the corresponding device shown in Fig. 1, and therefore will not be described again here, and are incorporated herein by reference.
  • the feedback device 57 sends feedback information corresponding to the control signal to the transmitting device 51; the transmitting device 51 further includes a receiving unit 511 and an executing unit 512, the receiving unit 511 receives the feedback information; and the executing unit 512 Based on the feedback information, an operation corresponding to the feedback information is performed.
  • the feedback information sent by the feedback device 57 to the transmitting device 51 includes but is not limited to: 1) a receipt statement indicating that the detecting device 52 has detected the position information of the transmitting device 51; 2) feeding back a command to enable the transmitting device 51 performs a corresponding operation according to the feedback instruction, such as causing the transmitting device 51 to perform some kind of vibration similar to the game handle to increase the realism of the game, to emit a specific corresponding sound, to emit light of a specific color frequency, and the like.
  • the wireless communication between the transmitting device 51 and the feedback device 57 The modes include, but are not limited to, wired communication methods, or wireless communication methods such as WIFI, Bluetooth, infrared, and the like.
  • the executing unit 512 adjusts the brightness control information of the transmitting light source according to the distance information and/or the brightness information of the imaging information included in the feedback information.
  • the feedback information sent by the feedback device 57 to the transmitting device 51 includes distance information and/or brightness information of the imaging information, such as the current working distance of the transmitting device 51 from the detecting device 52 and/or the transmitting.
  • the brightness of the imaging information corresponding to the light source of the device 51 is high, and the executing unit 512 adjusts the brightness control information of the light source according to the feedback information, so that the light source of the transmitting device operates in a low brightness mode; If the brightness of the imaging device is lower than the current working distance of the detecting device 52 and/or the brightness of the imaging information corresponding to the emitting light source of the transmitting device 51 is low, the executing unit 512 adjusts the brightness of the emitting light source according to the feedback information.
  • the control information is such that the emission source of the transmitting device operates in a high brightness manner.
  • the transmitting device when the working distance is close or the brightness of the imaging information is high, the transmitting device operates in a low brightness manner, thereby saving power consumption; on the contrary, when the working distance is long or the brightness of the imaging information is low, the transmitting device works in a high brightness manner, thereby improving Operating range.
  • the system uses WIFI, Bluetooth or infrared communication methods to send feedback information from the feedback device to the transmitting device to help the system work in an optimal way and achieve higher precision, better experience, more power saving, more noise immunity, Or a larger operating range, etc.
  • the detection device can detect information about the input environment and imaging information (e.g., current working distance), the detecting device can thereby transmit feedback information to the transmitting device to indicate the mode of operation of the transmitting device. For example, when detection device 52 detects that the brightness of the obtained imaging frame is low, such as when the system is operating in a low light environment, feedback device 57 may instruct the transmitting device to operate in a low power mode. If the ambient noise is large and there are multiple candidate imaging information, the feedback device 57 may indicate that the transmitting device's emitting light source, such as an LED, blinks at a certain frequency, and the system can detect the light to illuminate the dark change to effectively distinguish the background noise and the imaging. information.
  • the transmitting device's emitting light source such as an LED
  • the feedback device 57 can also send an indication to the transmitting device depending on the particular application or mode of use, thereby causing the transmitting device to operate in a different manner. For example, when the system needs to operate in an infrared state, the feedback device 57 sends an indication to the transmitting device 51 to indicate the transmission.
  • the radiation device 51 uses an infrared LED, otherwise a visible light LED is used.
  • the feedback device 57 sends an indication to the transmitting device 51 to indicate that the transmitting device 51 operates in a specific mode, such as the LED of the transmitting device blinks with a certain amount. And high brightness mode.
  • the system can activate different LEDs or a combination thereof according to the application, and the feedback device 57 sends an indication to the transmitting device 51 to instruct the transmitting device 51 to activate different LEDs or combination.
  • the system 1 includes a transmitting device 61, a detecting device 62 including an imaging unit 621, a computing device 63, and a control device 64, wherein the transmitting device 61 includes an instruction acquiring unit 613 and a transmission control modulating unit 614.
  • the computing device 63 and the control device 64 are the same as or similar to the corresponding devices shown in FIG. 1, and therefore will not be described again here, and are incorporated herein by reference.
  • the command acquiring unit 613 in the transmitting device 61 acquires the command information that the user intends to send through the transmitting device; the transmitting control modulation unit 614 controls the LED to transmit the control signal at a certain blinking frequency according to the command information, where And the brightness change of the control signal corresponds to the instruction information; wherein the imaging unit 621 in the detecting device 62 acquires the imaging information and the brightness change at an exposure frequency that is at least twice the blinking frequency
  • the control device 64 determines the control command for controlling the controlled device corresponding to the remote control system according to the position information and the brightness change.
  • the user inputs the instruction information to be sent by the user through interaction with the transmitting device 61.
  • the transmitting device 61 is a remote controller
  • the user inputs the command information to be sent by pressing a button on the remote controller.
  • the instruction acquisition unit 613 acquires the instruction information that the user intends to transmit through the transmitting device 61.
  • the emission control modulation unit 614 controls the LED in the transmitting device 61 according to the instruction information, so that the (etc.) LED sends a control signal at a certain blinking frequency, for example, the LED is loaded with high frequency flashing load instruction information, and sent a control signal, where the brightness change of the control signal corresponds to the command information.
  • the user intends to issue a button by pressing the button on the transmitting device 61.
  • the instruction information sent is pause playback, and the brightness change of the control signal corresponding to the instruction information is bright and dark; the instruction acquisition unit 613 acquires the instruction information; and the transmission control modulation unit 614 controls the transmitting device according to the instruction information.
  • the LED in 61 transmits a control signal at a blinking frequency of five times per second, and the LED transmits the control signal at the blinking frequency and with a brightness change of "bright, dark, and bright".
  • the imaging unit 621 acquires the imaging information of the transmitting device 61 and the brightness change of the control signal at an exposure frequency of at least twice the blinking frequency; the control device 64 according to the position information of the computing device 61 and the control signal
  • the brightness change is determined by performing a matching query in the instruction library to determine a corresponding control instruction for controlling the controlled device corresponding to the remote control system, for example, determining that the corresponding control command is paused. Used to control the corresponding controlled device to achieve pause playback.
  • the exposure frequency of the camera unit is at least twice the flashing frequency of the LED, preferably more than three times, the brightness change of each LED spot will be captured, and the number of times the light spot appears brightly for a period of time.
  • the frequency of the flicker can be calculated. Further, by detecting and decoding the blinking frequency of the LED, the command information loaded by the LED can be obtained, so that the system 1 simultaneously detects the position information and the transmission instruction information of the transmitting device.
  • the transmitting device 11 further includes an instruction acquisition unit (not shown) and an instruction transmitting unit (not shown), the system further including an instruction receiving device (not shown).
  • the user inputs the instruction information to be sent by the user through interaction with the transmitting device 11, for example, when the transmitting device 11 is a remote controller, the user inputs the command information to be sent by pressing a button on the remote controller.
  • the command acquiring unit acquires the instruction information that the user intends to send through the transmitting device 11; and then, the command sending unit performs operations such as encoding, modulation, etc. on the command information to generate a corresponding command signal, and is wired.
  • the communication method transmits the command signal.
  • the command receiving device receives the command signal from the transmitting device by means of wired or wireless communication, such as the above; subsequently, the control device 14 performs operations such as amplification, shaping, demodulation, decoding, etc. on the command signal, in conjunction with the computing device 13 Calculating the position information of the transmitting device 11, determining a control command corresponding to the position information and the command signal, for using the system Connected controlled devices are controlled.
  • the instruction transmitting unit may encode the instruction information by using an encoding method of the current infrared remote controller to generate a command signal; and the command receiving device adopts an infrared receiving mode, for example, on a carrier of 38 KHz, and receives the loaded command signal.
  • the command transmitting unit includes, but is not limited to, an infrared emitting device, a visible light emitting device, a radio transmitting device (including but not limited to Bluetooth, WIFI, NFC), a radio frequency transmitting device or an acoustic wave transmitting device, and the like.
  • the transmitting device 11 further comprises a switching unit (not shown) for switching control and/or brightness adjustment of the LED, the switching unit being operated according to the user And performing a switching operation and/or brightness adjustment on the transmitting device 11.
  • the transmitting device 11 includes a switch unit for performing switch control and/or brightness adjustment on the LED, the switch unit including, for example, a touch button switch unit, according to the user's pressing or lifting or touch operation, The transmitting device performs a corresponding operation.
  • the switch unit is, for example, a depressible touch key to enable the launching device 11 to perform a click (select) and drag function.
  • the transmitting device 11 When the user touches the touch key, the transmitting device 11 turns on the LED or causes the LED to transmit a control signal in a continuous specific mode, such as transmitting infrared rays, so that the detecting device 12 detects the imaging information of the transmitting device 11, and causes the computing device 13
  • the position information of the transmitting device 11 is calculated.
  • the switch unit can be a dedicated manual button instead of a touch switch to turn on the LED or let the LED send a control signal in a continuous, specific mode.
  • the frequency change can be detected by the microcontroller to determine if there is a button.
  • two diodes are added to the input of the circuit. This function is to protect the I/O port of the microcontroller. When the voltage exceeds Vdd+0.7V, diode D1 will be turned on and current will flow into capacitor C1. If the voltage is lower than GND-0.7V, diode D2 will be turned on and current will flow from the capacitor into the circuit.
  • the R1 resistor is used to ensure that the external diode is triggered first, protecting the entire circuit.
  • the touch button switch unit performs a corresponding operation on the transmitting device according to a pressing or lifting or touching operation of the user.
  • Traditional buttons are implemented on a button, such as the right mouse button, the left button is the confirmation button, and the right button is the shortcut button.
  • the button has only two states of pressing and lifting, and there is no coincidence between the two button states. If the button is not in the up state, the button is in the pressed state.
  • the button of the touch key switch unit has three states, a touch state, a press state, and a lift. In the touch state, the finger touches the button; the two states of pressing and lifting are the same as the conventional mechanical button, and there is no overlap between pressing and lifting. There can be an overlap between the touch state and the two states of pressing and lifting.
  • the table below shows the truth table for all possible states of the buttons of the touch button switch unit.
  • FIG. 8 is a block diagram showing the structure of a touch key switch unit according to still another preferred embodiment of the present invention.
  • the touch button switch unit is a combination of a conventional mechanical button and a touch button. Structurally, a touch button is superimposed on a conventional mechanical button, the mechanical button is below, and the touch button is superimposed on top of the mechanical button. When the hand is not on the touch button, the button is in the raised state; when the hand touches the touch button, the controller detects the touch of the hand, and the touch state and the raised state of the button are simultaneously valid; when the hand presses the mechanical button in the button In part, the touch state and the pressed state are effective at the same time.
  • Figure 9 is a circuit diagram showing a touch key switch unit in accordance with still another preferred embodiment of the present invention.
  • the mechanical button and the touch button of the touch button switch unit are separately detected.
  • the mechanical button is first detected. If the mechanical button is pressed, the touch button must be pressed, and the touch button need not be detected; if the mechanical button is raised, The state of the touch button needs to be detected.
  • the system further includes a state switching triggering device (not shown) that detects whether a sleep triggering condition for switching the system to the sleep mode is satisfied; wherein the detecting device 12 satisfies The sleep trigger condition is performed to perform a sleep background operation.
  • the state switching triggering device detects whether a sleep trigger condition for switching the system to the sleep mode is satisfied, the sleep trigger condition is, for example, no mouse input, no detected light source, etc. within a predetermined time period; when the sleep trigger condition is met
  • the detecting device 12 can record the background noise position, the analysis background (such as brightness, etc.), the face position detection, the motion detection, and the like, which can be used to affect the operation of the system working mode in the sleep mode.
  • the system can help the system to resist noise.
  • the system can preferentially select candidate imaging information of the non-noise position as the input imaging information.
  • the detecting device 12 acquires imaging information of the control signal in the image capturing unit according to the adjusted exposure frequency.
  • the state switching triggering device detects whether a sleep trigger condition for switching the system to the sleep mode is satisfied, the sleep trigger condition is, for example, no mouse input, no detection light source, etc. within a predetermined time period; when the sleep trigger is satisfied Condition, the detecting device 12 adjusts the exposure frequency of the imaging unit thereon, for example, reduces the exposure frequency of the imaging unit, and then acquires imaging information of the control signal in the imaging unit based on the adjusted exposure frequency.
  • the system reduces the exposure frequency of the camera unit, for example, processing once every few frames, thereby reducing the computational cost and power consumption of the processor.
  • the state switching triggering device detects whether a ready trigger condition for switching the system to the ready mode is satisfied; wherein the detecting device 12 satisfies the ready touch The condition is entered, and the working mode corresponding to the ready trigger condition is entered. Specifically, the state switching triggering device may further detect whether a ready-to-trigger condition for switching the system to the ready mode, such as receiving information from a system application or other specific signals (such as an encoding of infrared transmission), is satisfied.
  • the detecting device 12 can also receive information from the automatic detection according to the sleep mode, such as detecting mouse input, detecting a face, when the background appears motion or sudden change in brightness, or detecting an input spot, etc.; Ready trigger condition, the detecting device 12 enters an operating mode corresponding to the ready triggering condition, such as when a mouse input is detected, a face is detected, etc., the detecting device 12 enters a visible light working mode, and when the background appears motion or brightness When the input light spot or the like is abruptly changed, the detecting device 12 enters an infrared operation mode or the like.
  • the sleep mode such as detecting mouse input, detecting a face, when the background appears motion or sudden change in brightness, or detecting an input spot, etc.
  • Ready trigger condition the detecting device 12 enters an operating mode corresponding to the ready triggering condition, such as when a mouse input is detected, a face is detected, etc., the detecting device 12 enters a visible light working mode, and when the background appears motion or brightness
  • the location information of the transmitting device 11 includes three-dimensional position information; wherein the computing device 13 further includes a light spot detecting unit (not shown) and a three-dimensional computing unit (not shown) ).
  • the light spot detecting unit detects an input spot corresponding to the transmitting device 11 according to the imaging information acquired by the detecting device; the three-dimensional calculating unit f according to the spot attribute information of the input spot, The three-dimensional position information of the transmitting device 11 is calculated.
  • the spot attribute information of the input spot includes, but is not limited to, any related optical attribute, such as the input spot, which can be directly or indirectly used to determine the three-dimensional position information of the transmitting device 11, which is applicable to the present invention.
  • the three-dimensional position information of the transmitting device 11 includes three-dimensional translational position information of the transmitting device 11 and/or three-dimensional rotational position information of the transmitting device 11.
  • the three-dimensional coordinates of a spatial origin are marked as ( X. J. ' Z. )
  • the three-dimensional translational position information of the transmitting device 11 is its three-dimensional coordinates, where X is the horizontal coordinate of the centroid of the transmitting device 11, It is the vertical coordinate of the centroid of the transmitting device 11, and z is the depth coordinate of the centroid of the transmitting device 11.
  • the three-dimensional rotational position information of the transmitting device 11 is, for example, an angle ⁇ between the axis of the transmitting device 11 and the connecting line of the transmitting device 11 to the imaging unit 121; further, the three-dimensional rotational position information of the transmitting device 11 can also be It is expressed, for example, as the angle of rotation of the launching device 11 about its centroid axis, i.e., the angle of rotation of the launching device 11.
  • the control device 14 determines a control command corresponding to the three-dimensional rotational position information for controlling a controlled device connected to the system. Specifically, the control device 14 determines the three-dimensional rotational position information of the transmitting device 11 according to the rotational position acquiring unit, such as the rotation angle of the transmitting device 11, or the axis thereof and the connection between the transmitting device 11 and the imaging unit 121. The angle ⁇ , or the change of the angle, determines the corresponding control command to control the corresponding controlled device without the user clicking the operation.
  • the rotational position acquiring unit such as the rotation angle of the transmitting device 11, or the axis thereof and the connection between the transmitting device 11 and the imaging unit 121.
  • the angle ⁇ or the change of the angle, determines the corresponding control command to control the corresponding controlled device without the user clicking the operation.
  • the screen menu of the controlled device automatically scrolls up, and the scrolling speed is related to the elevation angle; when the user no longer lifts the remote controller, the screen menu stops scrolling.
  • the remote controller ie, the transmitting device 11
  • the picture on the screen of the corresponding controlled device is turned to the next page, or the user uses the remote controller (ie, transmits)
  • the device 11 draws a circle, and the corresponding controlled device enters a control menu page or the like.
  • the corresponding controlled device enters a state (such as the scrolling menu) and needs to exceed a high threshold. To stop this state, it needs to be lower than a low threshold.
  • the high threshold has a certain drop than the low threshold to prevent Jitter between the two states.
  • the transmitting device 11 further includes a spacing unit located at an outer circumference of the LED, wherein the portion of the spacing unit facing the image capturing unit is dark or covered with a light absorbing material.
  • the spacer unit may be a spherical surface enclosing the LED, and includes a groove on the spherical surface, so that the LED can send a control signal through the groove, and the portion of the spherical surface facing the camera unit is dark or the The spherical surface is covered with a light absorbing material so that the periphery of the LED is always surrounded by a black area, and is not connected to the background or other bright areas, so that the imaging information corresponding to the LED is easily detected and analyzed.
  • the spacing unit may be a plate having a shape larger than the spot size of the LED, and the LED is located between the spacing unit and the camera unit, and the portion of the plate facing the camera unit is dark. Or covered with light absorbing material.
  • the shape, structure, size, and the like of the spacer unit should not be limited to the above examples, and any other interval that can surround the LED background using the angle range without blocking the spot of the LED
  • the elements are intended to be included within the scope of the invention and are hereby incorporated by reference. It is obvious to those skilled in the art that the present invention is not limited to the details of the above-described exemplary embodiments, and the present invention can be embodied in other specific forms without departing from the spirit or essential characteristics of the invention. Therefore, the present embodiments are to be considered as illustrative and not restrictive, and the scope of the invention is defined by the appended claims All changes in the meaning and scope of equivalent elements are included in the present invention.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Social Psychology (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Databases & Information Systems (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Selective Calling Equipment (AREA)
  • User Interface Of Digital Computer (AREA)
  • Optical Communication System (AREA)
  • Studio Devices (AREA)

Abstract

一种用于对受控设备进行遥控的系统,该系统包括1)发射装置(11,41,51,61),包括用于发送控制信号的发射光源;2)检测装置(12,42,52,62),包括摄像单元(121,421,521,621),用于获取所述控制信号在所述摄像单元(121,421,521,621)中的成像信息;3)计算装置(13,43,53,63),用于根据所述检测装置(12,42,52,62)所获取的成像信息,确定所述发射装置(11,41,51,61)的位置信息;4)控制装置(14,44,54,64),用于确定与所述位置信息相对应的控制指令,以用于对与所述系统相连接的受控设备进行控制。该系统在系统的接收端包括用于计算发射装置(11,41,51,61)的位置信息的计算装置(13,43,53,63),及根据该位置信息确定对应的控制指令的控制装置(14,44,54,64),实现了对受控设备进行遥控,提高了控制的精确度,进而提高了控制效率并提升了用户的控制体验。

Description

一种用于对受控设备进行遥控的系统
技术领域
本发明涉及智能控制技术领域, 尤其涉及一种用于对受控设备进 行遥控的技术。 背景技术
在智能电视、 体感交互、 虚拟现实等智能控制领域, 通常通过检 测装置检测由发射装置所发送的一定信号, 如电磁信号、 声音信号或 光信号等, 来进行相应的控制操作, 如打开或关闭受控设备。 然而, 基于电磁信号的系统在对该电磁信号进行测量时, 容易受到环境中存 在的电子设备或地磁等影响; 而基于声音信号的系统在对该声音信号 进行测量时, 容易受到环境噪声等影响。
因此, 如何针对上述不足, 确定一种用于对受控设备进行遥控的 系统, 成为本领域技术人员亟需解决的技术问题之一。 发明内容
本发明的目的是提供一种用于对受控设备进行遥控的系统,其中, 该系统包括:
发射装置, 包括用于发送控制信号的发射光源;
检测装置, 包括摄像单元, 用于获取所述控制信号在所述摄像单 元中的成像信息;
计算装置, 用于根据所述检测装置所获取的成像信息, 确定所述 发射装置的位置信息;
控制装置, 用于确定与所述位置信息相对应的控制指令, 以用于 对与所述系统相连接的受控设备进行控制。
作为本发明的优选实施例之一, 所述检测装置还包括模式检测单 元, 用于检测所述发射装置的工作模式; 其中, 所述摄像单元前附加 有可移除的滤光片, 所述检测装置还包括成像控制单元, 该成像控制 单元用于根据所述模式检测单元所检测的工作模式, 对所述滤光片进 行添加或移除操作。
优选地, 所述模式检测单元包括红外检测传感器, 用于检测所述 发射装置是否工作在红外模式。
优选地, 所述模式检测单元包括环境亮度传感器, 用于检测所述 发射装置所处环境的环境亮度, 以通过比较所述环境亮度与预定的亮 度阈值, 来确定所述发射装置的工作模式。
作为本发明的优选实施例之一, 所述检测装置还包括模式检测单 元, 用于检测所述发射装置的工作模式; 其中, 所述检测装置包括两 个分别前置有红外滤光片和可见光滤光片的摄像单元, 以及成像切换 单元, 该成像切换单元用于根据所述工作模式, 将前置有与所述工作 模式相对应滤光片的摄像单元的成像信息, 提供给所述计算装置。
优选地, 该系统还包括手势识别装置, 用于识别所述摄像单元所 获取的用户的手势成像信息; 其中, 所述控制装置用于确定与所述位 置信息及所述手势成像信息相对应的控制指令, 以用于对与所述系统 相连接的受控设备进行控制。
优选地, 所述检测装置还包括红外发射单元, 用于发射红外光, 以便于获取所述用户的手势成像信息。
作为本发明的优选实施例之一, 该系统还包括应用模式识别装 置,用于根据预定的应用模式识别规则,确定该系统的当前应用模式; 其中, 所述控制装置用于根据所述当前应用模式, 确定与所述位置信 息及所述手势成像信息相对应的控制指令, 以用于对与所述系统相连 接的受控设备进行控制。
优选地, 所述应用模式识别规则包括以下至少任一项:
- 根据所述发射装置的工作状态, 确定所述当前应用模式; - 根据应用模式的优先级设置, 确定所述当前应用模式;
- 根据该系统的当前应用信息, 确定所述当前应用模式。
作为本发明的优选实施例之一, 所述发射装置包括多个用于发送 控制信号的发射光源; 其中, 所述计算装置用于根据所述多个发射光 源所对应的多个控制信号的成像信息, 确定所述发射装置的位置信 息。
作为本发明的优选实施例之一, 该系统包括多个发射装置, 所述 多个发射装置中每一个均包括用于发送控制信号的发射光源; 其中, 该系统还包括发射识别装置, 用于识别所述多个发射装置。
优选地, 所述发射识别装置用于根据所述多个发射装置中每一个 的发射光源发送所述控制信号的发光模式, 识别所述多个发射装置。
优选地, 所述发射识别装置用于根据所述多个发射装置中每一个 的发射光源所对应的成像信息的运动轨迹, 识别所述多个发射装置。
更优选地, 所述发射识别装置还用于确定所述多个发射装置的优 先级。
作为本发明的优选实施例之一, 该系统还包括辅助信息获取装 置, 该辅助信息获取装置用于根据所述控制信号在所述摄像单元中的 成像信息, 获取与所述成像信息相对应的辅助信息; 其中, 所述控制 装置用于确定与所述位置信息及所述辅助信息相对应的控制指令, 以 用于对与所述遥控系统相对应的受控设备进行控制。
作为本发明的优选实施例之一, 所述发射光源发送所述控制信号 的发光模式包括以下至少任一项:
- 形状;
- 波长;
- 闪烁频率;
- 亮度;
- 亮度分布。
优选地, 所述发射光源以交替的发光模式发送所述控制信号, 其 中, 所述交替的发光模式包括以下至少任一项:
- 亮暗交替变化的发光模式;
- 波长交替变化的发光模式;
- 光点几何特征变化的发光模式。
作为本发明的优选实施例之一, 所述检测装置包括多个摄像单 元,所述多个摄像单元用于分别获取所述控制信号的成像信息;其中, 所述计算装置用于根据所述多个摄像单元所获取的多个成像信息, 确 定所述发射装置的位置信息。
作为本发明的优选实施例之一, 该系统还包括反馈装置, 用于向 所述发射装置发送与所述控制信号相对应的反馈信息; 其中, 所述发 射装置还包括:
接收单元, 用于接收所述反馈信息;
执行单元, 用于根据所述反馈信息, 执行与所述反馈信息相对应 的操作。
优选地, 所述执行单元用于根据所述反馈信息所包括的所述成像 信息的距离信息和 /或亮度信息, 调整所述发射光源的亮度控制信息。
作为本发明的优选实施例之一, 所述发射装置还包括:
- 指令获取单元, 用于获取用户拟通过所述发射装置发送的指令
Ί^- ,
- 发射控制调制单元, 用于根据所述指令信息控制所述发射光源 以一定的闪烁频率发送所述控制信号, 其中, 所述控制信号的亮度变 化与所述指令信息相对应;
其中, 所述摄像单元以至少两倍于所述闪烁频率的曝光频率获取 所述成像信息与所述亮度变化;
其中, 所述控制装置用于:
- 根据所述位置信息与所述亮度变化, 确定所述控制指令, 以用 于对与所述遥控系统相对应的受控设备进行控制。
优选地, 所述发射装置还包括:
指令获取单元, 用于获取用户拟通过所述发射装置发送的指令信 息;
指令发送单元, 用于根据所述指令信息, 发送与所述指令信息相 对应的指令信号;
其中, 该系统还包括:
指令接收装置, 用于接收来自所述发射装置的指令信号; 其中, 所述控制装置用于:
- 确定与所述位置信息及所述指令信号相对应的控制指令, 以用 于对与所述系统相连接的受控设备进行控制。
作为本发明的优选实施例之一, 所述发射装置还包括用于对所述 发射光源进行开关控制和 /或亮度调节的开关单元,用于根据所述用户 的操作, 对所述发射装置执行开关操作和 /或亮度调节。
优选地, 所述开关单元包括触摸按键开关单元, 用于根据所述用 户的按压或抬起或触摸操作, 对所述发射装置执行对应的操作。
作为本发明的优选实施例之一, 该系统还包括状态切换触发装 置, 用于检测是否满足将所述系统切换至休眠模式的休眠触发条件; 其中, 所述检测装置用于:
- 当满足所述休眠触发条件, 进行休眠后台操作。
优选地, 所述休眠后台操作包括调整所述摄像单元的曝光频率; 其中, 所述检测装置用于:
- 根据所述调整后的曝光频率, 获取所述控制信号在所述摄像单 元中的成像信息。
优选地, 所述状态切换触发装置还用于检测是否满足将所述系统 切换至就绪模式的就绪触发条件; 其中, 所述检测装置还用于当满足 所述就绪触发条件, 进入与所述就绪触发条件相对应的工作模式。
优选地, 所述位置信息包括三维位置信息; 其中, 所述计算装置 还包括:
光点检测单元, 用于根据所述检测装置所获取的成像信息, 检测 所述发射装置所对应的输入光点;
三维计算单元, 用于才艮据所述输入光点的光点属性信息, 计算所述 发射装置的三维位置信息。
优选地, 所述三维位置信息包括三维转动位置信息。
更优选地, 所述控制装置用于:
- 确定与所述三维转动位置信息相对应的控制指令, 以用于对与所 述系统相连接的受控设备进行控制。 优选地, 所述发射装置还包括位于所述发射光源的外周的间隔单 元, 其中, 所述间隔单元朝向所述摄像单元的部分为暗色或覆盖有吸 光材料。
作为本发明的优选实施例之一, 所述受控设备包括电视机、 机顶 盒、 移动设备、 游戏机或 PC中的一个或多个。
与现有技术相比, 本发明在系统的接收端包括用于计算发射装置 的位置信息的计算装置, 及根据该位置信息确定对应的控制指令的控 制装置, 实现了对受控设备进行遥控, 提高了控制的精确度, 进而提 高了控制效率并提升了用户的控制体验。 附图说明
通过阅读参照以下附图所作的对非限制性实施例所作的详细描述, 本发明的其它特征、 目的和优点将会变得更明显:
图 1示出根据本发明一个方面的用于对受控设备进行遥控的系统 的系统示意图;
图 2示出根据本发明一个优选实施例的用于对受控设备进行遥控 的系统的装置示意图;
图 3示出根据本发明另一个优选实施例的用于对受控设备进行遥 控的系统的装置示意图;
图 4示出根据本发明又一个优选实施例的用于对受控设备进行遥 控的系统的系统示意图;
图 5示出根据本发明再一个优选实施例的用于对受控设备进行遥 控的系统的系统示意图;
图 6示出根据本发明再一个优选实施例的用于对受控设备进行遥 控的系统的系统示意图;
图 7示出根据本发明再一个优选实施例的触摸按键电路示意图; 图 8示出根据本发明再一个优选实施例的触摸按键开关单元的结 构示意图;
图 9示出根据本发明再一个优选实施例的触摸按键开关单元的电 路示意图。
附图中相同或相似的附图标记代表相同或相似的部件。 具体实施方式
下面结合附图对本发明作进一步详细描述。
图 1示出根据本发明一个方面的用于对受控设备进行遥控的系统 的系统示意图; 该系统 1 包括发射装置 11、 检测装置 12、 计算装置 13和控制装置 14, 其中, 检测装置 12包括摄像单元 121。 在此, 本 发明仅以发射装置 11作为发送端发送控制信号、检测装置 12作为接 收端检测成像信息的系统为例, 本领域技术人员应能理解, 系统 1的 另一种实现方式还可以检测装置 12作为发送端发送控制信号、 发射 装置 11作为接收端检测成像信息, 在此以引用方式包含于此。
其中, 发射装置 11包括用于发送控制信号的发射光源。 具体地, 该发射装置 11例如可以是遥控器、 游戏手柄等, 该发射装置 11上装 置有发射光源, 该发射光源以一定的波长发光, 以作为控制信号, 该 发射光源包括但不限于点光源、 面光源、 球状光源或其他任意以一定 波长进行发光的光源, 如 LED可见光光源、 LED红外光光源、 OLED ( Organic Light-Emitting Diode,有机发光二极管)光源、激光光源等。 该发射装置 11 可以只包括一个用于发送控制信号的发射光源, 也可 以包括多个用于发送控制信号的发射光源。
本实施例仅以 LED 为例, 本领域技术人员应能理解, 其他现有 的或今后可能出现的其他形式的发射光源, 特别地, 如 OLED, 如可 适用于本发明, 也应包含在本发明保护范围以内, 并在此以引用方式 包含于此。 在此, LED ( Light Emitting Diode, 发光二极管)是一种 能够将电能转化为可见光的固态的半导体器件, 它可以直接把电转化 为光, 并将所述光作为控制信号。
优选地, 所述 LED发送所述控制信号的发光模式包括以下至少 任一项:
- 形状; - 波长;
- 闪烁频率;
- 亮度;
- 亮度分布。
例如, 该(等) LED以一定的形状发光, 如发出三角形、 圆形或方形 等形状的光, 如该(等) LED被制成特殊形状, 则发出的光即具有该 特殊形状, 作为控制信号; 或者, 多个 LED形成三角形、 圆形或方 形等形状, 同时发光以作为控制信号; 又或者, LED 点阵中的各个 LED, 通过点亮或熄灭, 形成具有特殊形状的发光图案, 作为控制信 号。 又如, 该(等) LED以一定的波长发光, 以形成与该波长对应的 颜色。 又如, 该(等) LED以一定的闪烁频率发光, 如每秒闪烁十次。 或者, 该(等) LED以一定的亮度发光, 在此, 亮度表明该(等) LED 在特定方向单位立体角单位面积内的光通量, 该亮度可通过计算该 (等) LED在 LED帧中所对应的成像信息的灰度值的平均值或总和 来表示。 又或者, 该(等) LED以一定的亮度分布发光, 如以四周明 亮、 中间黑暗的亮度分布进行发光。
更优选地, 不管形状、 波长 (颜色)、 亮度或亮度分布如何, 该 (等) LED以一定的闪烁频率发送所述控制信号, 如每秒闪烁十次, 该闪烁频率还可以根据例如加载的调制信号 (如指令信号) 而变化。
本领域技术人员应能理解上述发光模式仅为举例, 其他现有的或 今后可能出现的发光模式如可适用于本发明, 也应包含在本发明保护 范围以内, 并在此以引用方式包含于此。
优选地, 所述发射光源以交替的发光模式发送所述控制信号, 其 中, 所述交替的发光模式包括以下至少任一项:
- 亮暗交替变化的发光模式;
- 波长交替变化的发光模式;
- 光点几何特征变化的发光模式。
其中, 所述亮暗交替变化的发光模式包括但不限于:
1 ) 以所述发射光源的预定持续时间的亮或暗作为信号值, 亮或 暗的最小持续时间至少不低于所述摄像单元的曝光时间, 优选地, 亮 或暗的最小持续时间不低于所述摄像单元的曝光时间与两次曝光时 间间隔之和。
例如, 以所述发射光源的预定持续时间的亮或暗作为信号值, 比 如 10ms的持续发亮作为 1值, 10ms的持续黑暗作为 0值, 则 20ms 的持续发亮和 10ms的持续黑暗的信号值为 110。 再次, 亮或暗的最 小持续时间至少不低于所述摄像单元的曝光时间。 优选地, 亮或暗的 最小持续时间不低于所述摄像单元的曝光时间与两次曝光时间间隔 之和。
2 ) 以所述发射光源的两次亮暗交替时间间隔作为信号值, 两次 亮暗交替的最小时间间隔至少两倍于所述摄像单元的曝光时间, 优选 地, 两次亮暗交替的最小时间间隔至少两倍于所述摄像单元的曝光时 间与两次曝光时间间隔之和。
例如, 以所述发射光源的两次亮暗交替时间间隔, 即闪烁时间间 隔, 作为信号值, 比如两次闪烁时间间隔为 10ms时信号值为 1 , 两 次闪烁时间间隔为 20ms时信号值为 2, 则当第一次与第二次闪烁时 间间隔为 10ms, 第二次与第三次闪烁时间间隔为 20ms时, 产生的信 号值为 12。 在此, 两次亮暗交替的最小时间间隔, 即闪烁时间间隔, 应至少两倍于所述摄像单元的曝光时间。 优选地, 两次亮暗交替的最 小时间间隔至少两倍于所述摄像单元的曝光时间与两次曝光时间间 隔之和。
3 ) 以所述发射光源的亮暗交替频率作为信号值, 所述摄像单元 的曝光频率至少两倍于所述亮暗交替频率, 其中, 曝光频率为单位时 间内所述摄像单元的曝光次数。
例如, 以所述发射光源的亮暗交替频率, 即闪烁频率, 作为信号 值, 比如 Is内发生一次闪烁信号值为 1 , 发生两次闪烁信号值为 2, 则当第 Is内发生一次闪烁且第 2s内发生两次闪烁时, 产生的信号值 为 12。在此,所述摄像单元的曝光频率至少两倍于所述亮暗交替频率。
在此, 通过上述方式所获得的信号值可以用于加载控制信号, 以 对受控设备进行控制操作。 例如, 信号值 10可以用来实现 "确认 "功 能, 信号值 110可以用来实现"返回"功能, 信号值 112可以用来实现 连接请求, 信号值 113可以用来实现数据传输请求等。
又如, 通过上述方式所获得的信号值可以用来确定设备 ID号, 以对多个待连接设备进行区分。 例如, 在信号值 20后的一串信号值 可以作为设备 ID号来标识设备的唯一身份,信号值 21后的一串信号 值可以作为设备的权限等级, 可以利用所获得的信号值对设备进行身 份匹配, 获得相应权限。 例如, 在下文中提到的发射识别装置, 即可 根据多个待连接设备所对应的多个发射装置所分别发送的信号值, 区 分该多个发射装置, 进而, 区分该多个待连接设备。
再如, 通过上述方式所获得的信号值可以用来作为特定模式以进 行抗噪。 特定的信号值表现了特定的发光规律, 而自然界中的噪声一 般不具备这样的发光规律, 例如信号值 12111211 代表光源以一定的 亮度时间进行亮暗闪烁, 或者表示以一定的亮暗时间间隔进行闪烁, 或者表示以一定的闪烁频率进行闪烁, 当检测到的光点不具备这样的 闪烁特征时, 可以认为是噪声, 予以删除。
优选地, 上述光点几何特征变化的发光模式包括但不限于所述发 射光源以变化的光点数目、 变化的几何形状等, 或结合上述两种变化 形式来发送所述控制信号。
优选地, 所述发射光源结合上述任意多种的交替的发光模式发送 所述控制信号, 例如, 以亮暗交替变化结合波长交替变化的发光模式 发送所述控制信号。 以 LED为例, 该 LED如以红绿兼亮暗交替的发 光模式进行发光。
更优选地, 所述发射光源的交替的发光模式还可包括多个不同波 长(颜色)发射光源的组合发光, 其交替可表现为不同颜色的组合进 行交替。 例如, 对于具有多个发射光源的发射装置, 每个发射光源具 有一定的波长 (颜色), 该多个发射光源以一定频率闪烁, 从而实现 该发射装置的不同波长(颜色) 的交替的发光模式; 或者, 对于多个 发射装置, 每个发射装置具有至少一个发射光源, 该至少一个发射光 源具有一定的波长 (颜色), 并以一定频率闪烁, 从而实现该多个发 射装置的不同波长(颜色) 的交替的发光模式。 在此, 不同波长(颜 色) 的组合例如可通过使用双色 LED或者两个以上不同波长(颜色) 的 LED组成发光单元。 更优选地, 该发射光源还可以使用多个不同 波长(颜色)结合亮暗交替变化、 光点几何特征变化的交替的发光模 式,发送控制信号。例如,任一时刻只用其中一个 LED或者两个 LED 同时亮即可组成不同的发光颜色分布, 也可有一个 LED 常亮, 另一 个以一定频率闪烁从而达到不同颜色组合的交替发光模式。
优选地, 采用一个 LED 常亮另一个以一定频率闪烁的交替的发 光模式可进行抗噪。 例如, 该种发光模式首先利用两个 LED发光点 筛除自然界中单独发光点的噪声点; 该种发光模式再利用具有特定颜 色分布的 LED发光点筛除自然界中非该特定颜色的噪声点; 该种发 光模式再以一个 LED常亮一个 LED以特定频率闪烁筛除其他非该发 光模式的噪声点。
本领域技术人员应能理解上述交替的发光模式仅为举例, 其他现 有的或今后可能出现的交替的发光模式如可适用于本发明, 也应包含 在本发明保护范围以内, 并在此以引用方式包含于此。
检测装置 12包括摄像单元 121 ,该摄像单元 121获取所述控制信 号在所述摄像单元 121 中的成像信息。 在此, 检测装置 12可以只包 括一个摄像单元, 如可同时检测可见光和红外光的摄像头传感器, 也 可以包括多个摄像单元。 该(等)摄像单元 121能够感应和采集 LED 发出的可见光和 /或红外线图像。 具体地, 该 (等)摄像单元 121以 足够高的采集帧速率, 如 15fps或以上, 合适的分辨率, 如 640x480 或以上, 及足够短的曝光时间, 如 1/500或更短, 对发射装置 11端的 一个或多个 LED进行拍摄, 获取该一个或多个 LED所发送的控制信 号在该摄像单元 121中的成像信息。 例如, 发射装置 11的 LED点阵 中的各个 LED, 通过点亮或熄灭, 形成了三角形的发光图案, 作为控 制信号, 摄像单元 121通过对该 LED点阵进行拍摄, 获取该三角形 发光图案在该摄像单元 121中的成像信息。 在此, 所述成像信息包括 但不限于该 (等) LED在该摄像单元 121所拍摄的 LED帧中的位置 信息、 所形成的图像的大小、 形状等信息。
本领域技术人员应能理解上述成像信息及获取成像信息的方式 仅为举例, 其他现有的或今后可能出现的成像信息或获取成像信息的 方式如可适用于本发明, 也应包含在本发明保护范围以内, 并在此以 引用方式包含于此。
计算装置 13根据所述检测装置 12所获取的成像信息, 确定所述 发射装置 11 的位置信息。 具体地, 计算装置 13根据该检测装置 12 所获取的成像信息, 如该(等) LED在该摄像单元 121所拍摄的 LED 帧中的位置信息、 所形成的图像的大小、 形状等, 通过一定的计算, 确定该发射装置 11的位置信息, 如该发射装置 11的二维位置信息、 三维位置信息、 二维运动轨迹、 三维运动轨迹等。 例如, 计算装置 13 根据发射装置 11端的 LED在摄像单元 121所拍摄的 LED帧中的位 置信息的变化, 将该位置信息的变化映射到物理空间中, 确定该发射 装置 11的二维运动轨迹。 又如, 计算装置 13根据发射装置 11端的 LED在摄像单元 121所拍摄的 LED帧中的位置信息, 确定该发射装 置 11 的二维位置信息, 进一步地, 根据该 LED在该 LED帧中对应 的成像信息的面积大小, 再结合该 LED光点的实际面积大小, 计算 该 LED与该摄像单元 121间的距离大小, 以确定该发射装置 11的三 维位置信息。
本领域技术人员应能理解上述计算位置信息的方式仅为举例, 其 他现有的或今后可能出现的计算位置信息的方式如可适用于本发明, 也应包含在本发明保护范围以内, 并在此以引用方式包含于此。
控制装置 14确定与所述位置信息相对应的控制指令, 以用于对 与所述系统相连接的受控设备进行控制。 具体地, 控制装置 14根据 该计算装置 13计算所确定的该发射装置 11的位置信息, 如该发射装 置 11 的二维位置信息、 三维位置信息、 二维运动轨迹、 三维运动轨 迹中的一种或几种, 或其中某种特定运动组合等, 通过在指令库中进 行匹配查询, 获得该位置信息对应的控制指令, 以对与所述系统相连 接的受控设备进行控制。
例如, 计算装置 13通过计算, 确定发射装置 11的位置信息为自 上而下的二维运动轨迹; 控制装置 14根据该位置信息, 在指令库中 匹配查找, 确定与该位置信息相对应的控制指令为自上而下滚动页 面, 进一步地, 该控制装置 14通过有线通信方式, 或通过诸如 WIFI、 蓝牙、 红外等无线通信方式, 将该控制指令发送至与该系统 1相连接 的一个或多个受控设备, 以对该一个或多个受控设备进行控制。
在此, 控制装置 14可同时对多个受控设备进行控制, 例如该控 制装置 14 同时将自上而下滚动页面的控制指令发送至机顶盒、 游戏 机和 PC, 该机顶盒、 游戏机和 PC才艮据该控制指令, 同时执行自上而 下滚动页面的操作。 优选地, 该控制装置 14也可根据该多个受控设 备的优先级, 将控制指令按照优先级的高低依次发送至对应的受控设 备。
在此, 该指令库中预设有位置信息与控制指令的映射关系, 该映 射关系可以根据用户的设置进行更新。 在此, 受控设备包括但不限于 电视机、 机顶盒、 移动设备、 游戏机或 PC中的一个或多个。
本领域技术人员应能理解上述确定控制指令的方式仅为举例, 其 他现有的或今后可能出现的确定控制指令的方式如可适用于本发明, 也应包含在本发明保护范围以内, 并在此以引用方式包含于此。 本领 域技术人员还应能理解上述受控设备仅为举例, 其他现有的或今后可 能出现的受控设备如可适用于本发明, 也应包含在本发明保护范围以 内, 并在此以引用方式包含于此。
图 2示出根据本发明一个优选实施例的用于对受控设备进行遥控 的系统的装置示意图; 其中, 检测装置 22包括摄像单元 221、 模式检 测单元 222和成像控制单元 223。
其中, 模式检测单元 222检测所述发射装置 21 的工作模式; 摄 像单元 221前附加有可移除的滤光片, 该检测装置 22还包括成像控 制单元 223 , 该成像控制单元 223根据所述模式检测单元 222所检测 的工作模式,对所述滤光片进行添加或移除操作。在此,摄像单元 221 例如为一个可同时检测可见光和红外光的摄像头传感器; 该摄像单元
221 前附加有可移除的滤光片, 该可移除的滤光片包括红外滤片和 / 或可见光过滤片; 检测装置 22还包括成像控制单元 223 , 该成像控制 单元 223例如包括一个电磁开关来控制是否将红外滤片或可见光过滤 片置于该摄像单元 221之上。假设模式检测单元 222检测出该发射装 置 21工作在可见光模式, 而该摄像单元 221之上已经有红外滤片, 则成像控制单元 223用电磁开关将其移除, 否则什么都不做。 假设模 式检测单元 222检测出该发射装置 21工作在红外模式, 而该摄像单 元 221之上已添加有红外滤片, 则什么都不做; 否则该成像控制单元 223用电磁开关将该红外滤片添加于该摄像单元 221之上。
优选地, 该模式检测单元 222包括红外检测传感器, 该红外检测 传感器检测所述发射装置 21 是否工作在红外模式。 例如, 该红外检 测传感器检测发射装置 21 所发送的控制信号, 当检测到该控制信号 为红外信号时, 该红外检测传感器判断该发射装置 21 工作在红外模 式。
更优选地, 该模式检测单元 222包括环境亮度传感器, 该环境亮 度传感器检测所述发射装置 21 所处环境的环境亮度, 以通过比较所 述环境亮度与预定的亮度阈值, 来确定所述发射装置的工作模式。 例 如, 该环境亮度传感器首先检测发射装置 21 所处环境的环境亮度, 再将该环境亮度与预定的亮度阈值进行比较, 当该环境亮度高于该亮 度阈值时, 该环境亮度传感器判断该发射装置 21工作在可见光模式、 或工作在可见光与红外兼容模式; 当该环境亮度低于该亮度阈值时, 则该环境亮度传感器判断该发射装置 21工作在红外模式。
在此, 该模式检测单元 222可以只包括该红外检测传感器或环境 亮度传感器中的一个, 也可以包括这两个传感器。 例如, 当该模式检 测单元 222只包括红外检测传感器, 该系统 1工作在遥控模式, 而该 红外检测传感器检测到发射装置 21 所发送的控制信号为红外信号, 则判断该发射装置 21 工作在红外模式; 当该红外检测传感器未检测 到发射装置 21发送的红外信号, 则判断该发射装置 21工作在可见光 模式。
图 3示出根据本发明一个优选实施例的用于对受控设备进行遥控 的系统的装置示意图; 其中, 检测装置 32包括摄像单元 321a、 摄像 单元 321b、 模式检测单元 322和成像切换单元 324。
其中, 模式检测单元 322检测所述发射装置 31 的工作模式; 该 检测装置 22包括一个前置有红外滤光片的摄像单元 321a和一个前置 有可见光滤光片的摄像单元 321b , 以及成像切换单元 324, 该成像 切换单元 324根据该模式检测单元 322所确定的工作模式, 将前置有 与该工作模式相对应滤光片的摄像单元的成像信息, 提供给计算装 置。 在此, 检测装置 22 包括两个摄像单元, 其中一个前置有红外滤 光片, 以检测红外光; 另一个前置有可见光滤光片, 以检测可见光; 成像切换单元 324包括一个控制电路, 该控制电路决定是否停止使用 某个摄像单元、 或决定启用某个摄像单元; 当模式检测单元 322检测 出该发射装置 31的工作模式, 该成像切换单元 324通过该控制电路, 选择启用前置有与该工作模式相对应滤光片的摄像单元, 并将该摄像 单元的成像信息, 提供给该计算装置。 例如, 模式检测单元 322检测 出该发射装置 31 的工作模式为红外模式, 该成像切换单元 324决定 停止使用前置有可见光滤光片的摄像单元 321b,而使用前置有红外滤 光片的摄像单元 321a; 进一步地, 该成像切换单元 324将该前置有红 外滤光片的摄像单元 321a的成像信息, 提供给该计算装置。
在此, 该模式检测单元 322与图 2所述实施例中的模式检测单元 222所执行的操作相同或基本相同, 故此处不再赘述, 并通过引用的 方式包含于此。
图 4示出根据本发明又一个优选实施例的用于对受控设备进行遥 控的系统的系统示意图; 该系统 1 包括发射装置 41、 包含摄像单元 421的检测装置 42、 计算装置 43、 控制装置 44、 手势识别装置 45和 模式识别装置 46。 在此, 该发射装置 41、 检测装置 42和计算装置 43 分别与图 1所示对应装置相同或相似, 故此处不再赘述, 并通过引用 的方式包含于此。 其中, 手势识别装置 45识别所述摄像单元 421所获取的用户的 手势成像信息; 控制装置 44确定与所述位置信息及所述手势成像信 息相对应的控制指令, 以用于对与所述系统相连接的受控设备进行控 制。 例如, 当该系统 1工作在遥控模式和手势模式兼容的情况下, 摄 像单元 421获取控制信号的成像信息,同时获取用户的手势成像信息; 手势识别装置 45根据摄像单元 421所获取的用户的手势成像信息, 通过图像处理等方式, 识别出该手势成像信息, 如识别出用户竖起大 拇指的手势成像信息; 计算装置 43根据该控制信号的成像信息, 确 定发射装置 41的位置信息; 随后, 控制装置 44根据该位置信息, 再 结合该手势成像信息, 通过在指令库中匹配查询, 确定与该位置信息 及该手势成像信息相对应的控制指令, 以用于对与所述系统相连接的 受控设备进行控制。 优选地, 该控制装置 44还可以结合位置信息与 手势成像信息的优先级, 确定对应的控制指令, 如当手势成像信息的 优先级高于位置信息时, 只根据该手势成像信息确定对应的控制指 令; 或者, 主要根据该手势成像信息, 再辅以该发射装置 11 的位置 信息, 确定对应的控制指令。
优选地, 所述检测装置 42还包括红外发射单元(未示出), 该红 外发射单元发射红外光, 以便于获取所述用户的手势成像信息。 具体 地, 该红外发射单元例如为可发射红外光的 LED, 在该红外发射单元 所能照射到的区域发射红外光, 使得用户可在该区域做出相应的手 势, 检测装置 42 中的摄像单元工作在红外模式, 获取该用户的手势 成像信息。
优选地, 该系统还包括应用模式识别装置 (未示出), 该应用模 式识别装置根据预定的应用模式识别规则, 确定该系统的当前应用模 式; 随后, 控制装置 44根据所述当前应用模式, 确定与所述位置信 息及所述手势成像信息相对应的控制指令, 以用于对与所述系统相连 接的受控设备进行控制。 具体地, 该系统 1可能包含不同的应用, 而 不同应用隐含了不同的检测模式, 当用户打开一种应用时, 模式识别 装置根据预定的应用模式识别规则, 确定该系统 1的当前应用模式, 如该系统 1 当前工作在遥控模式、 手势识别模式等。 在此, 应用模式 识别规则包括但不限于以下至少任一项:
- 根据所述发射装置的工作状态, 确定所述当前应用模式; - 根据应用模式的优先级设置, 确定所述当前应用模式;
- 根据该系统的当前应用信息, 确定所述当前应用模式。
例如, 应用模式识别装置通过传感器等, 检测该发射装置 41 是否处 于工作状态, 当该发射装置 41处于工作状态, 则确定该系统 1 的当 前应用模式为遥控模式; 否则, 确定该系统 1的当前应用模式为手势 识别模式。 又如, 假设系统 1预设手势识别模式的优先级高于遥控模 式, 则当该系统 1同时识别到用户的手势、 检测到 LED成像信息时, 该应用模式识别装置根据该应用模式的优先级设置, 确定该系统的当 前应用模式为手势识别模式。 再如, 应用模式识别装置根据该系统的 当前应用信息, 确定该系统的当前应用模式, 如该系统的当前应用为 视频通话, 则应用模式识别装置确定该系统的当前应用模式为手势识 别模式、 或红外与可见光兼容模式。
随后, 控制装置 44根据该应用模式识别装置所确定的该系统的 当前应用模式, 确定与所述位置信息及所述手势成像信息相对应的控 制指令, 如当该系统 1的当前应用模式为手势识别模式, 则该控制装 置 14根据该手势成像信息, 确定对应的控制指令, 以用于对与所述 系统相连接的受控设备进行控制; 或者, 当该系统 1的当前应用模式 为遥控模式, 则该控制装置 14根据该发射装置 41的位置信息, 确定 对应的控制指令。
本领域技术人员应能理解上述应用模式识别规则仅为举例, 其他 现有的或今后可能出现的应用模式识别规则如可适用于本发明, 也应 包含在本发明保护范围以内, 并在此以引用方式包含于此。
在一优选实施例中 (参照图 1 ), 发射装置 11 包括多个用于发送 控制信号的 LED; 其中, 计算装置 13根据所述多个 LED所对应的多 个控制信号的成像信息, 确定所述发射装置的位置信息。 具体地, 发 射装置 11包括多个用于发送控制信号的 LED,这多个 LED以一定的 形状、 波长、 闪烁频率、 亮度或亮度分布等发光模式发送所述控制信 号。 例如, 这多个 LED形成三角形、 圆形或方形等形状, 同时发光 以作为控制信号; 又或者, LED 点阵中的多个 LED, 通过点亮或熄 灭, 形成具有特殊形状的发光图案, 作为控制信号。 随后, 计算装置 13 根据这多个 LED 所对应的多个控制信号的成像信息, 如这多个 LED在该摄像单元 121所拍摄的 LED帧中的位置信息、 所形成的图 像的大小、 形状等, 通过一定的计算, 确定该发射装置 11 的位置信 息, 如该发射装置 11 的二维位置信息、 三维位置信息、 二维运动轨 迹、 三维运动轨迹等。 例如, 计算装置 13分别计算这多个 LED的位 置信息, 再通过对这多个位置信息进行一定的转换计算, 如加权平均 计算等, 确定这多个 LED所在的发射装置 11的位置信息。
优选地, 该系统 1包括多个发射装置, 所述多个发射装置中每一 个均包括用于发送控制信号的发射光源; 其中, 该系统 1还包括发射 识别装置 (未示出), 该发射识别装置用于识别所述多个发射装置。 在此, 系统可以由超过一个发射装置同时向接收装置发出可见或红外 光; 检测装置 12分别获取这些可见或红外光在所述摄像单元中的成 像信息; 成像信息计算装置 13分别计算该多个发射装置的二维或三 维位置信息。 例如, 系统可用前述方法检测候选成像信息, 如最多可 有 N个发射装置, 则系统可对 N种发射装置所对应的遥控器进行检 测,提取符合条件的最多 N个候选成像信息作为该等发射装置所对应 的成像信息; 然后提取其相应的成像特征信息来区分不同的发射装置
( 1、 2 N )。 具体地, 该发射识别装置识别所述多个发射装置的 方式包括但不限于:
1 )根据所述多个发射装置中每一个的发射光源发送所述控制信 号的发光模式, 识别所述多个发射装置。 例如, 假设每个发射装置上 的发射光源, 如 LED, 使用不同形状、 波长 (颜色)、 闪烁频率、 亮 度、 亮度分布的发光模式或其组合, 进行发光, 则发射识别装置根据 该等发射装置的发光模式, 区分不同的发射装置。 在此, 发射识别装 置可以根据所述多个发射装置的 LED所对应的成像信息, 利用图像 处理中的常用方法检测不同大小的圆形、通过对区域边缘的直线检测 或角点检测识别三角形或四边形等, 来区分不同的发射装置; 或者, 发射识别装置可以根据不同闪烁频率区分不同发射装置, 此时摄像单 元的采集帧率必须大于 LED最高闪烁频率两倍 (最好为三倍以上); 或者, 发射识别装置利用差分法, 检测 LED 的闪烁频率, 进而区分 不同发射端; 或者, 发射识别装置使用不同颜色或其组合区分不同发 射端, 颜色的检测可用彩色摄像头捕捉光点然后用 RGB或其他颜色 空间区分光点区域的主要颜色 (dominate color ); 或者, 对应不同亮 度分布模式, 发射识别装置可以使用不同发射装置的样本的强度分布 (如光点内所有像素强度值)事先训练分类器(如 LDA分类器), 使 用时把每个光点归于分类器的分类结果。
优选地, 该发射识别装置可以根据该多个发射装置的交替的发光 模式, 识别该多个发射装置。 例如, 该发射识别装置根据该多个发射 装置的发射光源以亮暗交替变化的发光模式发送控制信号所获得的 信号值, 识别该多个发射装置。
2 )根据所述多个发射装置中每一个的发射光源所对应的成像信 息的运动轨迹, 识别所述多个发射装置。 例如, 发射识别装置可以使 用视频下的 艮踪技术, 区分不同 LED 的运动轨迹, 从而在任何时刻 区分不同的发射装置。 优选地, 发射识别装置还可以利用每个发射装 置所对应的成像信息的运动轨迹, 在任何时刻区分不同的发射装置, 如哪个成像信息属于时间 i开启的发射装置, 而哪个属于时间 j开启 的发射装置, 即任一时刻 1开启的发射装置和时刻 j开启的发射装置 分别在哪里, 从而对应相应操作。 一旦每帧检测出候选成像信息, 可 用现有目标跟踪的方法,根据运动模型(如恒定速度或加速度的模型) 跟踪每个成像信息。 例如, 假设最多可有 N个发射装置, 则发射识别 装置提取符合条件的 N个成像信息的运动轨迹作为候选成像信息,随 后, 发射识别装置记录每个运动轨迹的起始时间、 位置等历史特征直 至轨迹结束, 任何时刻每个运动轨迹对应于一个发射装置。
进一步地, 当发射识别装置识别出不同的发射装置后, 计算装置 13分别计算不同发射装置的位置信息, 控制装置 14确定不同位置信 息所对应的不同控制指令, 以将该不同控制指令分别发送至对应的受 控设备。
优选地, 发射识别装置还可确定不同发射装置所对应的优先级。 例如, 该发射识别装置结合 LED对应的成像信息的起始时间、 位置 或轨迹的运动区域(前后、 左右), 区分不同 LED所对应的不同的发 射装置。 例如, 最先启动的发射装置(可根据成像信息被检测到的时 间来判断)总是主控并有更高优先级, 或者, 对应的位置信息在前面 或中间区域的发射装置总是主控并具有更高优先级等。
在另一优选实施例中(参照图 1 ), 该系统 1还包括辅助信息获取 装置 (未示出), 该辅助信息获取装置根据所述控制信号在所述摄像 单元 121中的成像信息, 获取与所述成像信息相对应的辅助信息; 其 中, 所述控制装置 14确定与所述位置信息及所述辅助信息相对应的 控制指令, 以用于对与所述遥控系统相对应的受控设备进行控制。 具 体地, 辅助信息获取装置根据该(等) LED对应的控制信号在该摄像 单元 121中的成像信息, 获取与所述成像信息相对应的辅助信息, 辅 助信息包括但不限于该 (等)成像信息的颜色、 亮度、 所形成的图案 等; 随后, 控制装置 14根据计算装置 13所确定的该(等) LED的位 置信息,及上述辅助信息中的一个或多个,在指令库中进行匹配查询, 确定对应的控制指令, 以用于对与所述遥控系统相对应的受控设备进 行控制。 例如, 发射装置 11的 LED点阵中的各个 LED, 通过点亮或 熄灭, 形成了三角形的发光图案, 作为控制信号, 摄像单元 121通过 对该 LED 点阵进行拍摄, 获取该三角形发光图案在该摄像单元 121 中的成像信息; 计算装置 13根据该成像信息, 计算得出该发射装置 11的位置信息; 辅助信息获取装置根据该成像信息, 获取的辅助信息 为 LED形成了三角形图案; 控制装置 14根据该三角形图案与该位置 信息, 确定对应的控制指令为暂停播放, 用于对与相应的受控设备控 制以实现该受控设备暂停播放。
在又一优选实施例中 (参照图 1 ), 所述检测装置 12包括多个摄 像单元, 所述多个摄像单元用于分别获取所述控制信号的成像信息; 其中, 所述计算装置 13根据所述多个摄像单元所获取的多个成像信 息, 确定所述发射装置 11 的位置信息。 在此, 这多个摄像单元例如 工作在同样的工作模式下, 并以同样地采集帧速率、 同样的分辨率、 同样的曝光时间等, 对发射装置 11端的一个或多个 LED进行拍摄, 分别获取该一个或多个 LED 所发送的控制信号在这多个摄像单元 121中的成像信息。而该计算装置 13根据这多个摄像单元分别获取的 多个成像信息, 如这多个摄像单元分别拍摄到的该一个或多个 LED 在 LED 帧中的位置信息、 所形成的图像的大小、 形状等, 通过一定 的计算, 确定该发射装置 11的位置信息, 如该发射装置 11的二维位 置信息、 三维位置信息、 二维运动轨迹、 三维运动轨迹等。 例如, 检 测装置 12包括两个摄像单元, 这两个摄像单元分别获取发射装置 11 所发送的控制信号的成像信息; 计算装置 13采用双目立体视觉算法, 计算得出该发射装置 11的位置信息。
图 5示出根据本发明再一个优选实施例的用于对受控设备进行遥 控的系统的系统示意图; 该系统 1 包括发射装置 51、 检测装置 52、 计算装置 53、 控制装置 54和反馈装置 57 , 其中, 该发射装置 51 包 括接收单元 511和执行单元 512。 在此, 该检测装置 52、 计算装置 53 和控制装置 54分别与图 1所示对应装置相同或相似, 故此处不再赘 述, 并通过引用的方式包含于此。
其中, 该反馈装置 57向所述发射装置 51发送与所述控制信号相 对应的反馈信息; 发射装置 51还包括接收单元 511和执行单元 512, 该接收单元 511接收所述反馈信息;执行单元 512根据所述反馈信息, 执行与所述反馈信息相对应的操作。 在此, 反馈装置 57 向发射装置 51发送的反馈信息包括但不限于: 1 ) 回执声明, 表明该检测装置 52 已检测到该发射装置 51的位置信息; 2 )反馈指令, 以使该发射装置 51根据该反馈指令执行相应的操作, 如让发射装置 51执行某种类似 游戏手柄的震动以增加游戏的真实感、 发特定的相应声音、 发出特定 颜色频率的光等。 在此, 发射装置 51与反馈装置 57间的无线通信方 式包括但不限于有线通信方式、 或诸如 WIFI、 蓝牙、 红外等无线通 信方式。
优选地, 执行单元 512根据所述反馈信息所包括的所述成像信 息的距离信息和 /或亮度信息,调整所述发射光源的亮度控制信息。例 如, 该反馈装置 57向该发射装置 51所发送的反馈信息中包括该成像 信息的距离信息和 /或亮度信息, 如该发射装置 51 距离检测装置 52 的当前工作距离较近和 /或该发射装置 51的发射光源对应的成像信息 的亮度较高, 则该执行单元 512根据该反馈信息, 调整该发射光源的 亮度控制信息, 使该发射装置的发射光源以低亮度方式工作; 当该反 馈信息显示该发射装置 51距离检测装置 52的当前工作距离较远和 / 或该发射装置 51 的发射光源对应的成像信息的亮度较低, 则该执行 单元 512根据该反馈信息, 调整该发射光源的亮度控制信息, 使该发 射装置的发射光源以高亮度方式工作。
在此, 当工作距离近或成像信息亮度高时, 发射装置以低亮度方 式工作, 从而节省耗电; 反之, 当工作距离远或成像信息亮度低时, 发射装置以高亮度方式工作, 从而提高操作范围。
在此, 系统使用 WIFI、 蓝牙或红外等通信方式, 从反馈装置向 发射装置发送反馈信息, 以帮助系统以最佳方式工作并达到更高精 度、 更好体验、 更省电、 更抗噪、 或更大操作范围等。
更优选地, 由于在检测装置可检测输入环境和成像信息的相关信 息 (如当前工作距离), 检测装置由此可向发射装置传送反馈信息以 指示发射装置的工作方式。 例如, 当检测装置 52检测到所获得的成 像帧的亮度较低, 如系统在低亮度环境工作时, 反馈装置 57可指示 发射装置以低功耗方式工作。 而如果环境噪声大, 有多个候选成像信 息存在时, 反馈装置 57可指示发射装置的发射光源, 如 LED等, 以 一定频率闪烁, 系统可检测光点亮暗变化从而有效区分背景噪声和成 像信息。 该反馈装置 57也可根据具体的应用程序或使用模式向发射 装置发送指示, 从而使发射装置以不同方式工作。 例如, 当系统需工 作在红外状态时, 反馈装置 57向发射装置 51发送指示, 以指示该发 射装置 51使用红外 LED, 否则使用可见光 LED。 再如, 当系统需使 用摄像头作其他使用时 (如视频通话), 反馈装置 57 向发射装置 51 发送指示, 以指示该发射装置 51 以特定的模式工作, 如该发射装置 端的 LED以一定的闪烁和高亮度方式发光。 又如, 当发射装置 51有 多个 LED时, 系统可才艮据应用启动不同的 LED或其组合, 该反馈装 置 57向发射装置 51发送指示,以指示该发射装置 51启动不同的 LED 或其组合。
图 6示出根据本发明再一个优选实施例的用于对受控设备进行遥 控的系统的系统示意图; 该系统 1 包括发射装置 61、 包含摄像单元 621的检测装置 62、 计算装置 63和控制装置 64, 其中, 该发射装置 61包括指令获取单元 613和发射控制调制单元 614。 在此, 该计算装 置 63和控制装置 64分别与图 1所示对应装置相同或相似, 故此处不 再赘述, 并通过引用的方式包含于此。
其中, 发射装置 61 中的指令获取单元 613获取用户拟通过所述 发射装置发送的指令信息; 发射控制调制单元 614根据所述指令信息 控制所述 LED 以一定的闪烁频率发送所述控制信号, 其中, 所述控 制信号的亮度变化与所述指令信息相对应; 其中, 所述检测装置 62 中的摄像单元 621以至少两倍于所述闪烁频率的曝光频率获取所述成 像信息与所述亮度变化; 其中, 所述控制装置 64根据所述位置信息 与所述亮度变化, 确定所述控制指令, 以用于对与所述遥控系统相对 应的受控设备进行控制。
具体地, 用户通过与发射装置 61 的交互, 输入了该用户拟发送 的指令信息, 如当该发射装置 61 为遥控器, 用户通过按动该遥控器 上的按键,输入了拟发送的指令信息,如按键信息,指令获取单元 613 获取该用户拟通过该发射装置 61 所发送的指令信息。 发射控制调制 单元 614根据该指令信息, 控制该发射装置 61中的 LED, 使该(等) LED 以一定的闪烁频率发送控制信号, 如使该 (等) LED 以高频闪 烁加载指令信息, 发送控制信号, 在此, 该控制信号的亮度变化与该 指令信息相对应。 例如, 用户通过按动发射装置 61 上的按键, 拟发 送的指令信息为暂停播放, 而该指令信息对应的控制信号的亮度变化 为亮暗亮暗亮; 指令获取单元 613获取到该指令信息; 发射控制调制 单元 614根据该指令信息, 控制该发射装置 61中的 LED以每秒闪烁 五次的闪烁频率发送控制信号, 该 LED即以该闪烁频率, 并以"亮暗 亮暗亮"的亮度变化发送控制信号。 同时, 所述摄像单元 621 以至少 两倍于该闪烁频率的曝光频率获取该发射装置 61 的成像信息及该控 制信号的亮度变化; 控制装置 64根据该计算装置 61的位置信息与该 控制信号的亮度变化, 通过在指令库中进行匹配查询, 确定对应的控 制指令, 以用于对与所述遥控系统相对应的受控设备进行控制, 如接 上例, 确定对应的控制指令为暂停播放, 用于对相应的受控设备进行 控制以实现暂停播放。
在此, 当摄像单元的曝光频率至少为 LED 的闪烁频率的两倍, 最好为三倍以上, 每次 LED光点的亮暗变化都会被捕捉下来, 通过 光点在一段时间出现亮的次数可以计算闪烁的频率, 进一步地, 通过 对 LED闪烁频率的检测和解码, 可获得通过 LED加载的指令信息, 以使该系统 1同时检测发射装置的位置信息和传输指令信息。
在另一优选实施例中 (参照图 1 ), 发射装置 11还包括指令获取 单元 (未示出) 和指令发送单元 (未示出), 该系统还包括指令接收 装置 (未示出)。 具体地, 用户通过与发射装置 11的交互, 输入了该 用户拟发送的指令信息, 如当该发射装置 11 为遥控器, 用户通过按 动该遥控器上的按键, 输入了拟发送的指令信息, 如按键信息, 指令 获取单元获取该用户拟通过该发射装置 11所发送的指令信息; 随后, 指令发送单元对该指令信息进行诸如编码、 调制等操作, 以生成对应 的指令信号, 并通过有线通信方式, 或通过诸如 WIFI、 蓝牙、 红外 等无线通信方式, 将该指令信号发送出去。 该指令接收装置通过诸如 上述有线或无线通信方式, 接收来自该发射装置的指令信号; 随后, 控制装置 14通过对该指令信号进行诸如放大、 整形、 解调、 解码等 操作, 再结合计算装置 13计算得出的该发射装置 11的位置信息, 确 定与该位置信息及该指令信号相对应的控制指令, 以用于对与该系统 相连接的受控设备进行控制。 其中, 指令发送单元对指令信息进行编 码的方式可采用目前红外遥控器的编码方式, 以生成指令信号; 指令 接收装置例如在 38KHz 的载波上采用红外接收方式, 接收加载的指 令信号。
在此, 指令发送单元包括但不限于红外发射装置、 可见光发射装 置、 无线电发射装置 (包括但不限于蓝牙、 WIFI、 NFC ), 射频发射 装置或声波发射装置等。
在又一优选实施例中 (参照图 1 ), 发射装置 11还包括用于对所 述 LED进行开关控制和 /或亮度调节的开关单元(未示出), 该开关单 元根据所述用户的操作, 对所述发射装置 11执行开关操作和 /或亮度 调节。 具体地, 发射装置 11 包括用于对所述 LED进行开关控制和 / 或亮度调节的开关单元, 该开关单元例如包括触摸按键开关单元, 根 据所述用户的按压或抬起或触摸操作, 对所述发射装置执行对应的操 作。 该开关单元例如为可按压的触摸键, 以使该发射装置 11 实现点 击 (选择) 和拖拽功能。 当用户接触该触摸键时, 发射装置 11 才开 启 LED或让 LED以持续的特定模式发送控制信号,如发送发红外线, 以使检测装置 12检测该发射装置 11 的成像信息, 并使计算装置 13 计算该发射装置 11 的位置信息。 当用户按压此触摸键时, 则对应于 点击(选择)功能; 当用户按压但不松开此触摸键, 则对应拖拽功能。 或者, 该开关单元也可以是一个专门的手动按钮代替触摸开启, 以打 开 LED或让 LED以持续的特定模式发送控制信号。
图 7示出根据本发明再一个优选实施例的触摸按键电路示意图。 首先焊盘与地之间形成一寄生电容 Cp, 当手指触摸到焊盘时, 触 摸点 -手指 -地之间形成一电容 Cf, 这两电容并联。 并联电容相加, 所 以当 接近焊盘时, 总电容增加。 电容增量的百分比为:
Figure imgf000027_0001
而电容的增量就是所要检测的依据。 由于手指触摸按键产生额外 电容, T = R (df+ ep》, 导致振荡器的时间常数发生改变, 随着时间 常数的增加, 振荡器频率将减小。 通过单片机可以检测频率变化, 从 而确定是否有按键。 其次在电路的输入端添加了两个二极管, 此功能 是保护单片机的 I/O端口 。 当电压超过 Vdd+0.7V, 二极管 D1将导 通, 电流流进电容 C1 ; 若电压低于 GND-0.7V, 二极管 D2将导通, 电流从电容流入电路。 R1 电阻用来确保外部的二极管首先触发, 对 整个电路起到一个保护作用。
优选地, 该触摸按键开关单元根据所述用户的按压或抬起或触摸 操作, 对所述发射装置执行对应的操作。 传统的按键都是在一个按键 上实现一种功能, 譬如右手习惯的鼠标按键, 左键是确认键, 右键是 快捷键。 按键只有按下和抬起两种状态, 而且这两种按键状态之间没 有重合, 要不按键是处于抬起状态, 要不按键是属于按下状态。 在 此, 该触摸按键开关单元的按键具有三种状态, 触摸态、 按压和抬 起。 触摸态即手指轻触了按键; 按压和抬起两种状态和传统的机械按 键相同, 按压和抬起这两种状态之间也没有重叠。 触摸态与按压和抬 起这两种状态之间可以有重叠。 下表为该触摸按键开关单元的按键所 有可能状态的真值表。
表 1 触摸按键开关单元的按键的状态真值表
Figure imgf000028_0001
图 8示出根据本发明再一个优选实施例的触摸按键开关单元的结 构示意图。
该触摸按键开关单元由一个传统的机械按键和一个触摸按键组合 而成。 结构上是在传统的机械按键上面叠加一个触摸按键, 机械按键 在下面, 触摸按键叠加在机械按键的上方。 当手没有在触摸按键上的 时候, 按键处于抬起状态; 当手接触到触摸按键时, 控制器检测到手 的触摸, 按键的触摸态和抬起状态同时有效; 当手按下按键中的机械 部分时, 触摸态和按压状态同时有效。 图 9示出根据本发明再一个优选实施例的触摸按键开关单元的电 路示意图。
在电路设计上, 该触摸按键开关单元的机械按键和触摸按键分开 检测。 对该触摸按键开关单元的按键进行检测时, 先检测机械按键, 若机械按键处于按压状态, 则触摸按键一定处于按压状态, 无需再对 该触摸按键进行检测; 若机械按键处于抬起状态, 则需要对该触摸按 键的状态进行检测。
优选地(参见图 1 ), 该系统还包括状态切换触发装置(未示出), 该状态切换触发装置检测是否满足将所述系统切换至休眠模式的休 眠触发条件; 其中, 检测装置 12 当满足所述休眠触发条件, 进行休 眠后台操作。 具体地, 状态切换触发装置检测是否满足将所述系统切 换至休眠模式的休眠触发条件, 该休眠触发条件例如在预定时间段内 无鼠标输入、 未检测到发射光源等; 当满足该休眠触发条件, 该检测 装置 12在休眠模式下可记录背景噪音位置、 分析背景 (如亮度等)、 人脸位置检测、 运动检测等可用于影响系统工作模式操作的信息。 例 如通过对背景噪音位置的记录可帮助系统抗噪, 如系统可优先选择非 噪声位置的候选成像信息作为输入成像信息等。
优选地, 当该休眠后台操作包括调整所述摄像单元的曝光频率; 该检测装置 12根据所述调整后的曝光频率, 获取所述控制信号在所 述摄像单元中的成像信息。 具体地, 状态切换触发装置检测是否满足 将所述系统切换至休眠模式的休眠触发条件, 该休眠触发条件例如在 预定时间段内无鼠标输入、 未检测到发射光源等; 当满足该等休眠触 发条件, 检测装置 12调整其上的摄像单元的曝光频率, 例如降低该 摄像单元的曝光频率, 接着, 根据该调整后的曝光频率, 获取控制信 号在该摄像单元中的成像信息。
在此, 系统在休眠模式下, 降低了摄像单元的曝光频率, 例如隔 几帧做一次处理, 进而降低了处理器的计算花费和耗电。
更优选地, 该状态切换触发装置检测是否满足将所述系统切换至 就绪模式的就绪触发条件; 其中, 该检测装置 12 当满足所述就绪触 发条件, 进入与所述就绪触发条件相对应的工作模式。 具体地, 状态 切换触发装置还可以检测是否满足将所述系统切换至就绪模式的就 绪触发条件, 该就绪触发条件例如接收到来自于系统应用程序的信息 或其他特定信号 (如红外发射的编码), 也可接收到来自于根据休眠 模式下的自动检测而产生的信息,如检测到鼠标输入、人脸被检测到、 当背景出现运动或亮度突变、 或检测到输入光点等; 当满足该就绪触 发条件, 检测装置 12进入与所述就绪触发条件相对应的工作模式, 如当检测到鼠标输入、 人脸被检测到等, 则该检测装置 12进入可见 光工作模式, 当背景出现运动或亮度突变、 或检测到输入光点等, 则 该检测装置 12进入红外工作模式等。
在再一优选实施例中 (参照图 1 ) , 发射装置 11的位置信息包括三 维位置信息; 其中, 所述计算装置 13 还包括光点检测单元(未示出) 和三维计算单元(未示出)。 具体地, 该光点检测单元根据所述检测装 置所获取的成像信息, 检测所述发射装置 11 所对应的输入光点; 该三 维计算单元 f艮据所述输入光点的光点属性信息, 计算所述发射装置 11 的三维位置信息。 在此, 所述输入光点的光点属性信息包括但不限于 任何可适用于本发明的, 可直接或间接用于确定发射装置 11 的三维位 置信息的相关光学属性, 诸如所述输入光点的圆半径、 亮度或光分布 特性等。 发射装置 11的三维位置信息包括该发射装置 11的三维平动位 置信息和 /或该发射装置 11 的三维转动位置信息。 在此, 将某空间原点 的三维坐标标记为(X。J。'Z。), 则发射装置 11的三维平动位置信息为其三 维坐标 , 其中, X是该发射装置 11 质心的水平坐标, 是该发射 装置 11质心的竖直坐标, z是该发射装置 11质心的纵深坐标。 而该发 射装置 11的三维转动位置信息例如为该发射装置 11的轴线与该发射装 置 11到摄像单元 121连线之间的夹角 Θ; 进一步地, 该发射装置 11的 三维转动位置信息还可表示为例如该发射装置 11 围绕其质心轴的转 角, 即该发射装置 11 的自转角度。 例如, 摄像单元 121拍摄发射装置 11 的 LED的成像信息; 随后, 光点检测单元检测出该成像信息对应的 光点的光点半径 r和亮度 I; 接着, 三维计算单元根据该半径 r和亮度 I, 基于预定的夹角拟合曲线 0=h(r, I), 获得发射装置 11 的轴线与该发 射装置 11到摄像单元 121连线之间的夹角 Θ, 也即该发射装置 11的三 维转动位置信息。
更优选地, 所述控制装置 14 确定与所述三维转动位置信息相对应 的控制指令, 以用于对与所述系统相连接的受控设备进行控制。 具体 地, 控制装置 14根据转动位置获取单元所获取的该发射装置 11的三维 转动位置信息, 如该发射装置 11 的自转角度, 或其轴线与该发射装置 11到摄像单元 121连线之间的夹角 Θ, 或该夹角的变化, 确定对应的控 制指令, 以对相应的受控设备进行控制, 而不需用户点击操作。 例 如, 当用户上仰遥控器(即发射装置 11 )时, 受控设备的屏幕菜单自动 向上滚动, 滚动速度与仰角相关; 当用户不再仰起该遥控器时, 该屏 幕菜单停止滚动。 又如, 当用户由左向右移动遥控器 (即发射装置 11 ) 的距离超过一定门限时, 对应的受控设备的屏幕上的图片翻到下一 页, 或者, 用户使用遥控器(即发射装置 11 )进行画圆, 则对应的受控 设备进入控制菜单页面等。 为了防止误操作和抖动, 对应的受控设备 进入一个状态 (如滚动菜单) 需超过一个高门限, 而停止此状态则需低 于一个低门限, 高门限比低门限有一定的落差以防止在两个状态间抖 动。
优选地, 发射装置 11还包括位于所述 LED的外周的间隔单元, 其 中, 所述间隔单元朝向所述摄像单元的部分为暗色或覆盖有吸光材料。 例如, 该间隔单元可以是一个球面, 包裹住该 LED, 在该球面上包括一 个凹槽, 以使该 LED能透过该凹槽发出控制信号,该球面朝向该摄像单 元的部分为暗色或该球面覆盖有吸光材料,以使该 LED周围总是被黑色 区域包围, 而不会与背景或其他亮区连接,便于检测和分析 LED所对应 的成像信息。 又如, 该间隔单元可以是一个具有一定形状的板, 面积大 于 LED的光点大小, 且该 LED位于该间隔单元与该摄像单元的连线中 间, 该板朝向所述摄像单元的部分为暗色或覆盖有吸光材料。
在此, 间隔单元的形状、 结构、 大小等不应局限于上述示例, 其他 任意能在使用角度范围包围 LED背景而又不挡住 LED的光点的间隔单 元都应包含在本发明保护范围以内, 并在此以引用方式包含于此。 对于本领域技术人员而言, 显然本发明不限于上述示范性实施例的 细节, 而且在不背离本发明的精神或基本特征的情况下, 能够以其他的 具体形式实现本发明。 因此, 无论从哪一点来看, 均应将实施例看作是 示范性的, 而且是非限制性的, 本发明的范围由所附权利要求而不是上 述说明限定, 因此旨在将落在权利要求的等同要件的含义和范围内的所 有变化涵括在本发明内。 不应将权利要求中的任何附图标记视为限制所 涉及的权利要求。 此外, 显然"包括"一词不排除其他单元或步骤, 单数 不排除复数。 装置权利要求中陈述的多个单元或装置也可以由一个单元 或装置通过软件或者硬件来实现。 第一, 第二等词语用来表示名称, 而 并不表示任何特定的顺序。

Claims

权 利 要 求 书
1. 一种用于对受控设备进行遥控的系统, 其中, 该系统包括: 发射装置, 包括用于发送控制信号的发射光源;
检测装置, 包括摄像单元, 用于获取所述控制信号在所述摄像单 元中的成像信息;
计算装置, 用于根据所述检测装置所获取的成像信息, 确定所述 发射装置的位置信息;
控制装置, 用于确定与所述位置信息相对应的控制指令, 以用于 对与所述系统相连接的受控设备进行控制。
2. 根据权利要求 1 所述的系统, 其中, 所述检测装置还包括模 式检测单元, 用于检测所述发射装置的工作模式;
其中, 所述摄像单元前附加有可移除的滤光片, 所述检测装置还 包括成像控制单元, 该成像控制单元用于根据所述模式检测单元所检 测的工作模式, 对所述滤光片进行添加或移除操作。
3. 根据权利要求 2所述的系统, 其中, 所述模式检测单元包括 红外检测传感器, 用于检测所述发射装置是否工作在红外模式。
4. 根据权利要求 2或 3所述的系统, 其中, 所述模式检测单元 包括环境亮度传感器, 用于检测所述发射装置所处环境的环境亮度, 以通过比较所述环境亮度与预定的亮度阈值, 来确定所述发射装置的 工作模式。
5. 根据权利要求 1 所述的系统, 其中, 所述检测装置还包括模 式检测单元, 用于检测所述发射装置的工作模式;
其中, 所述检测装置包括两个分别前置有红外滤光片和可见光滤 光片的摄像单元, 以及成像切换单元, 该成像切换单元用于根据所述 工作模式, 将前置有与所述工作模式相对应滤光片的摄像单元的成像 信息, 提供给所述计算装置。
6. 根据权利要求 1至 5中任一项所述的系统, 其中, 该系统还 包括手势识别装置, 用于识别所述摄像单元所获取的用户的手势成像 其中, 所述控制装置用于确定与所述位置信息及所述手势成像信 息相对应的控制指令, 以用于对与所述系统相连接的受控设备进行控 制。
7. 根据权利要求 6所述的系统, 其中, 所述检测装置还包括红 外发射单元,用于发射红外光,以便于获取所述用户的手势成像信息。
8. 根据权利要求 6所述的系统, 其中, 该系统还包括应用模式 识别装置, 用于才艮据预定的应用模式识别规则, 确定该系统的当前应 用模式;
其中, 所述控制装置用于根据所述当前应用模式, 确定与所述位 置信息及所述手势成像信息相对应的控制指令, 以用于对与所述系统 相连接的受控设备进行控制。
9. 根据权利要求 8所述的系统, 其中, 所述应用模式识别规则 包括以下至少任一项:
- 根据所述发射装置的工作状态, 确定所述当前应用模式; - 根据应用模式的优先级设置, 确定所述当前应用模式;
- 根据该系统的当前应用信息, 确定所述当前应用模式。
10. 根据权利要求 1至 9中任一项所述的系统, 其中, 所述发射 装置包括多个用于发送控制信号的发射光源;
其中, 所述计算装置用于:
- 根据所述多个发射光源所对应的多个控制信号的成像信息, 确 定所述发射装置的位置信息。
11. 根据权利要求 1至 10中任一项所述的系统, 其中, 该系统 包括多个发射装置, 所述多个发射装置中每一个均包括用于发送控制 信号的发射光源;
其中, 该系统还包括:
发射识别装置, 用于识别所述多个发射装置。
12. 根据权利要求 11 所述的系统, 其中, 所述发射识别装置用 于: - 根据所述多个发射装置中每一个的发射光源发送所述控制信 号的发光模式, 识别所述多个发射装置。
13. 根据权利要求 11 所述的系统, 其中, 所述发射识别装置用 于:
- 根据所述多个发射装置中每一个的发射光源所对应的成像信 息的运动轨迹, 识别所述多个发射装置。
14. 根据权利要求 11至 13中任一项所述的系统, 其中, 所述发 射识别装置还用于确定所述多个发射装置的优先级。
15. 根据权利要求 1至 14中任一项所述的系统, 其中, 该系统 还包括辅助信息获取装置, 该辅助信息获取装置用于根据所述控制信 号在所述摄像单元中的成像信息, 获取与所述成像信息相对应的辅助 Ί^- ,
其中, 所述控制装置用于确定与所述位置信息及所述辅助信息相 对应的控制指令, 以用于对与所述遥控系统相对应的受控设备进行控 制。
16. 根据权利要求 1至 15中任一项所述的系统, 其中, 所述发 射光源发送所述控制信号的发光模式包括以下至少任一项:
- 形状;
- 波长;
- 闪烁频率;
- 亮度;
- 亮度分布。
17. 根据权利要求 1至 16中任一项所述的系统, 其中, 所述发射 光源发送以交替的发光模式发送所述控制信号, 其中, 所述交替的发 光模式包括以下至少任一项:
- 亮暗交替变化的发光模式;
- 波长交替变化的发光模式;
- 光点几何特征变化的发光模式。
18. 根据权利要求 1至 17中任一项所述的系统, 其中, 所述检 测装置包括多个摄像单元, 所述多个摄像单元用于分别获取所述控制 信号的成像信息;
其中, 所述计算装置用于:
- 根据所述多个摄像单元所获取的多个成像信息, 确定所述发射 装置的位置信息。
19. 根据权利要求 1至 18中任一项所述的系统, 其中, 该系统 还包括反馈装置, 用于向所述发射装置发送与所述控制信号相对应的 反馈信息;
其中, 所述发射装置还包括:
接收单元, 用于接收所述反馈信息;
执行单元, 用于根据所述反馈信息, 执行与所述反馈信息相对应 的操作。
20. 根据权利要求 19所述的系统, 其中, 所述执行单元用于:
- 根据所述反馈信息所包括的所述成像信息的距离信息和 /或亮 度信息, 调整所述发射光源的亮度控制信息。
21. 根据权利要求 1至 20中任一项所述的系统, 其中, 所述发 射装置还包括:
- 指令获取单元, 用于获取用户拟通过所述发射装置发送的指令
Ί^- ,
- 发射控制调制单元, 用于根据所述指令信息控制所述发射光源 以一定的闪烁频率发送所述控制信号, 其中, 所述控制信号的亮度变 化与所述指令信息相对应;
其中, 所述摄像单元以至少两倍于所述闪烁频率的曝光频率获取 所述成像信息与所述亮度变化;
其中, 所述控制装置用于:
- 根据所述位置信息与所述亮度变化, 确定所述控制指令, 以用 于对与所述遥控系统相对应的受控设备进行控制。
22. 根据权利要求 1至 21 中任一项所述的系统, 其中, 所述发 射装置还包括:
指令获取单元, 用于获取用户拟通过所述发射装置发送的指令信 息;
指令发送单元, 用于根据所述指令信息, 发送与所述指令信息相 对应的指令信号;
其中, 该系统还包括:
指令接收装置, 用于接收来自所述发射装置的指令信号; 其中, 所述控制装置用于:
- 确定与所述位置信息及所述指令信号相对应的控制指令, 以用 于对与所述系统相连接的受控设备进行控制。
23. 根据权利要求 1至 22中任一项所述的系统, 其中, 所述发 射装置还包括用于对所述发射光源进行开关控制和 /或亮度调节的开 关单元, 用于根据所述用户的操作, 对所述发射装置执行开关操作和 /或亮度调节。
24. 根据权利要求 23所述的系统, 其中, 所述开关单元包括触 摸按键开关单元, 用于根据所述用户的按压或抬起或触摸操作, 对所 述发射装置执行对应的操作。
25. 根据权利要求 1至 24中任一项所述的系统, 其中, 该系统 还包括状态切换触发装置, 用于检测是否满足将所述系统切换至休眠 模式的休眠触发条件; 其中, 所述检测装置用于:
- 当满足所述休眠触发条件, 进行休眠后台操作。
26. 根据权利要求 25所述的系统, 其中, 所述休眠后台操作包 括调整所述摄像单元的曝光频率;
其中, 所述检测装置用于:
- 根据所述调整后的曝光频率, 获取所述控制信号在所述摄像单 元中的成像信息。
27. 根据权利要求 25或 26所述的系统, 其中, 所述状态切换触 发装置还用于检测是否满足将所述系统切换至就绪模式的就绪触发 条件; 其中, 所述检测装置还用于: - 当满足所述就绪触发条件, 进入与所述就绪触发条件相对应的 工作模式。
28. 根据权利要求 1至 27中任一项所述的系统, 其中, 所述位 置信息包括三维位置信息; 其中, 所述计算装置还包括:
光点检测单元, 用于根据所述检测装置所获取的成像信息, 检测 所述发射装置所对应的输入光点;
三维计算单元, 用于才艮据所述输入光点的光点属性信息, 计算所述 发射装置的三维位置信息。
29. 根据权利要求 28 所述的系统, 其中, 所述三维位置信息还包 括三维转动位置信息。
30. 根据权利要求 29所述的系统, 其中, 所述控制装置用于:
- 确定与所述三维转动位置信息相对应的控制指令, 以用于对与所 述系统相连接的受控设备进行控制。
31. 根据权利要求 1至 30中任一项所述的系统, 其中, 所述发 射装置还包括位于所述发射光源的外周的间隔单元, 其中, 所述间隔 单元朝向所述摄像单元的部分为暗色或覆盖有吸光材料。
32. 根据权利要求 1至 31中任一项所述的系统,其中, 所述受控 设备包括电视机、 机顶盒、 移动设备、 游戏机或 PC中的一个或多个。
PCT/CN2013/070284 2012-01-09 2013-01-09 一种用于对受控设备进行遥控的系统 WO2013104312A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US14/371,383 US20150010309A1 (en) 2012-01-09 2013-01-09 System for Use in Remote Controlling Controlled Device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201210004846.3A CN102682589B (zh) 2012-01-09 2012-01-09 一种用于对受控设备进行遥控的系统
CN201210004846.3 2012-01-09

Publications (1)

Publication Number Publication Date
WO2013104312A1 true WO2013104312A1 (zh) 2013-07-18

Family

ID=46814434

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2013/070284 WO2013104312A1 (zh) 2012-01-09 2013-01-09 一种用于对受控设备进行遥控的系统

Country Status (3)

Country Link
US (1) US20150010309A1 (zh)
CN (1) CN102682589B (zh)
WO (1) WO2013104312A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106341185A (zh) * 2015-07-09 2017-01-18 深圳市裕富照明有限公司 Led可见光通信系统及其控制方法

Families Citing this family (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103196362B (zh) * 2012-01-09 2016-05-11 西安智意能电子科技有限公司 一种用于确定发射装置相对检测装置的三维位置的系统
CN102682589B (zh) * 2012-01-09 2015-03-25 西安智意能电子科技有限公司 一种用于对受控设备进行遥控的系统
CN103809772A (zh) * 2012-11-12 2014-05-21 扬州永利宁科技有限公司 电子系统及其相关方法
CN103914969A (zh) * 2013-01-07 2014-07-09 凹凸电子(武汉)有限公司 移动终端装置以及控制电器设备的方法
CN103152625B (zh) * 2013-03-01 2016-02-03 青岛海信电器股份有限公司 电视系统、便携式智能终端、智能电视机、人机交互系统
CN103389739B (zh) * 2013-07-29 2015-12-02 中国传媒大学 一种平行式立体影视云台通讯装置的控制方法
CN104656878A (zh) * 2013-11-19 2015-05-27 华为技术有限公司 手势识别方法、装置及系统
CN108279788B (zh) * 2013-12-23 2021-02-02 原相科技股份有限公司 用于遥控器的控制单元
CN104932666B (zh) * 2014-03-19 2019-05-31 联想(北京)有限公司 控制方法、控制装置及电子设备
CN104410892A (zh) * 2014-11-26 2015-03-11 中国科学院半导体研究所 一种应用于显示设备中的手势控制装置
CN106484079B (zh) * 2015-08-24 2019-07-26 联想(北京)有限公司 信息处理方法及电子设备
CN106097701A (zh) * 2016-07-29 2016-11-09 无锡思泰迪半导体有限公司 一种基于fpga的红外芯片测试平台
US10506192B2 (en) * 2016-08-16 2019-12-10 Google Llc Gesture-activated remote control
CN106568434A (zh) * 2016-11-08 2017-04-19 深圳市虚拟现实科技有限公司 虚拟现实空间定位方法及系统
CN107799174A (zh) * 2017-11-23 2018-03-13 上海联影医疗科技有限公司 一种医疗设备控制系统及方法
CN107985533B (zh) * 2017-12-26 2020-06-09 天津深之蓝海洋设备科技有限公司 无人遥控潜水器及其控制方法
EP3560814A4 (en) 2017-12-26 2020-05-27 Tianjin Deepfar Ocean Technology Co., Ltd. REMOTE CONTROLLED UNDERWATER VEHICLE AND ITS CONTROL METHOD
US11168855B2 (en) 2018-10-18 2021-11-09 Marche International Llc Light engine and method of simulating a flame
CN110087044B (zh) * 2019-05-24 2020-11-20 北京人福医疗器械有限公司 一种货物装卸全方位实时预警监控装置
CN110493494B (zh) * 2019-05-31 2021-02-26 杭州海康威视数字技术股份有限公司 图像融合装置及图像融合方法
DE202020102537U1 (de) * 2020-05-06 2021-08-09 Leuze Electronic Gmbh + Co. Kg Sensoranordnung
CN112382075B (zh) * 2020-12-29 2022-04-26 武汉乐风信息技术有限公司 一种基于物联网的道闸控制设备
CN114743368B (zh) * 2022-04-01 2023-03-21 深圳市多亲科技有限公司 通过空间方位感知自动配置的万能遥控装置及其操作方法

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080186412A1 (en) * 2007-02-06 2008-08-07 General Instrument Corporation Remote Control with Integrated Optical Mouse Functionality
CN101794171A (zh) * 2010-01-29 2010-08-04 广州酷智电子科技有限公司 基于红外光运动捕捉的无线感应交互系统
CN101853568A (zh) * 2010-04-13 2010-10-06 鸿富锦精密工业(深圳)有限公司 手势遥控装置
CN201854361U (zh) * 2010-10-19 2011-06-01 盛乐信息技术(上海)有限公司 电视机
CN102112941A (zh) * 2008-06-04 2011-06-29 惠普开发有限公司 计算机的遥控系统和方法
KR20110094727A (ko) * 2010-02-17 2011-08-24 (주)휴맥스 적외선 리모콘의 모션 데이터 검출 장치 및 방법
CN102495674A (zh) * 2011-12-05 2012-06-13 无锡海森诺科技有限公司 一种红外人机交互方法及装置
CN102682589A (zh) * 2012-01-09 2012-09-19 西安智意能电子科技有限公司 一种用于对受控设备进行遥控的系统

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101729808B (zh) * 2008-10-14 2012-03-28 Tcl集团股份有限公司 一种电视遥控方法及用该方法遥控操作电视机的系统
CN101437124A (zh) * 2008-12-17 2009-05-20 三星电子(中国)研发中心 面向电视控制的动态手势识别信号处理方法

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080186412A1 (en) * 2007-02-06 2008-08-07 General Instrument Corporation Remote Control with Integrated Optical Mouse Functionality
CN102112941A (zh) * 2008-06-04 2011-06-29 惠普开发有限公司 计算机的遥控系统和方法
CN101794171A (zh) * 2010-01-29 2010-08-04 广州酷智电子科技有限公司 基于红外光运动捕捉的无线感应交互系统
KR20110094727A (ko) * 2010-02-17 2011-08-24 (주)휴맥스 적외선 리모콘의 모션 데이터 검출 장치 및 방법
CN101853568A (zh) * 2010-04-13 2010-10-06 鸿富锦精密工业(深圳)有限公司 手势遥控装置
CN201854361U (zh) * 2010-10-19 2011-06-01 盛乐信息技术(上海)有限公司 电视机
CN102495674A (zh) * 2011-12-05 2012-06-13 无锡海森诺科技有限公司 一种红外人机交互方法及装置
CN102682589A (zh) * 2012-01-09 2012-09-19 西安智意能电子科技有限公司 一种用于对受控设备进行遥控的系统

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106341185A (zh) * 2015-07-09 2017-01-18 深圳市裕富照明有限公司 Led可见光通信系统及其控制方法

Also Published As

Publication number Publication date
CN102682589A (zh) 2012-09-19
CN102682589B (zh) 2015-03-25
US20150010309A1 (en) 2015-01-08

Similar Documents

Publication Publication Date Title
WO2013104312A1 (zh) 一种用于对受控设备进行遥控的系统
US9301372B2 (en) Light control method and lighting device using the same
TWI699707B (zh) 結構光投射器的控制方法、深度相機和電子裝置
EP3192330B1 (en) Lighting preference arbitration.
EP3434069B1 (en) An adaptive lighting system for a mirror component and a method of controlling an adaptive lighting system
US9565238B2 (en) Method for controlling electronic apparatus, handheld electronic apparatus and monitoring system
TWI701606B (zh) 亮屏方法、移動終端及儲存媒體
US20080111789A1 (en) Control device with hybrid sensing system comprised of video-based pattern recognition and electronic signal transmission
US10112295B2 (en) Remote control system for pointing robot
CN106774868B (zh) 一种无线演示装置
TWI468655B (zh) 溫度監測系統及方法
US20160041632A1 (en) Contact detection system, information processing method, and information processing apparatus
EP2928269A1 (en) Lighting system and control method thereof
US20170185233A1 (en) Information processing apparatus, information input system, method for processing information
CN105468210B (zh) 位置检测装置、投影仪以及位置检测方法
TWI441042B (zh) 互動影像系統、互動控制裝置及其運作方法
JP6405836B2 (ja) 位置検出装置、プロジェクター、及び、位置検出方法
CN108227923A (zh) 一种基于体感技术的虚拟触控系统和方法
KR20120070320A (ko) 스테레오 카메라를 포함하는 디스플레이 시스템 및 이를 이용한 위치검출 방법
TW201128455A (en) Signaling device position determination
CN107368200B (zh) 遥控装置
CN103677271B (zh) 远程指向设备及其应用方法
KR20040027561A (ko) 카메라 기반의 지시 장치를 갖는 텔레비전 시스템, 및 그동작 방법
EP3201727A1 (en) User interface system based on pointing device
KR101471304B1 (ko) 가상 리모트 컨트롤 장치 및 그 방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13736071

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 14371383

Country of ref document: US

122 Ep: pct application non-entry in european phase

Ref document number: 13736071

Country of ref document: EP

Kind code of ref document: A1