US20140372072A1 - Methods and Devices for Transmitting/Obtaining Identification Information and Positioning by Visible Light Signal - Google Patents
Methods and Devices for Transmitting/Obtaining Identification Information and Positioning by Visible Light Signal Download PDFInfo
- Publication number
- US20140372072A1 US20140372072A1 US14/246,460 US201414246460A US2014372072A1 US 20140372072 A1 US20140372072 A1 US 20140372072A1 US 201414246460 A US201414246460 A US 201414246460A US 2014372072 A1 US2014372072 A1 US 2014372072A1
- Authority
- US
- United States
- Prior art keywords
- light source
- identification information
- visible light
- bright
- varied
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 238000000034 method Methods 0.000 title claims abstract description 83
- 230000004907 flux Effects 0.000 claims description 41
- 238000012937 correction Methods 0.000 claims description 33
- 238000005096 rolling process Methods 0.000 claims description 20
- 238000005286 illumination Methods 0.000 claims description 9
- 238000010586 diagram Methods 0.000 description 78
- 230000008569 process Effects 0.000 description 14
- 230000004397 blinking Effects 0.000 description 12
- 238000012986 modification Methods 0.000 description 12
- 230000004048 modification Effects 0.000 description 12
- 238000005070 sampling Methods 0.000 description 11
- 238000004891 communication Methods 0.000 description 10
- 230000005540 biological transmission Effects 0.000 description 5
- 230000005484 gravity Effects 0.000 description 5
- 230000004913 activation Effects 0.000 description 4
- 238000001514 detection method Methods 0.000 description 4
- 230000001133 acceleration Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000007704 transition Effects 0.000 description 3
- 230000003213 activating effect Effects 0.000 description 2
- 238000013459 approach Methods 0.000 description 2
- 230000036772 blood pressure Effects 0.000 description 2
- 230000036760 body temperature Effects 0.000 description 2
- 230000000295 complement effect Effects 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 238000003306 harvesting Methods 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 229920001690 polydopamine Polymers 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B10/00—Transmission systems employing electromagnetic waves other than radio-waves, e.g. infrared, visible or ultraviolet light, or employing corpuscular radiation, e.g. quantum communication
- H04B10/11—Arrangements specific to free-space transmission, i.e. transmission through air or vacuum
- H04B10/114—Indoor or close-range type systems
- H04B10/116—Visible light communication
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C15/00—Surveying instruments or accessories not provided for in groups G01C1/00 - G01C13/00
- G01C15/002—Active optical surveying means
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/20—Instruments for performing navigational calculations
- G01C21/206—Instruments for performing navigational calculations specially adapted for indoor navigation
-
- H05B37/02—
-
- H05B37/0227—
-
- H—ELECTRICITY
- H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
- H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
- H05B47/00—Circuit arrangements for operating light sources in general, i.e. where the type of light source is not relevant
- H05B47/10—Controlling the light source
-
- H—ELECTRICITY
- H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
- H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
- H05B47/00—Circuit arrangements for operating light sources in general, i.e. where the type of light source is not relevant
- H05B47/10—Controlling the light source
- H05B47/105—Controlling the light source in response to determined parameters
-
- H—ELECTRICITY
- H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
- H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
- H05B47/00—Circuit arrangements for operating light sources in general, i.e. where the type of light source is not relevant
- H05B47/10—Controlling the light source
- H05B47/105—Controlling the light source in response to determined parameters
- H05B47/115—Controlling the light source in response to determined parameters by determining the presence or movement of objects or living beings
- H05B47/125—Controlling the light source in response to determined parameters by determining the presence or movement of objects or living beings by using cameras
-
- H—ELECTRICITY
- H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
- H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
- H05B47/00—Circuit arrangements for operating light sources in general, i.e. where the type of light source is not relevant
- H05B47/10—Controlling the light source
- H05B47/175—Controlling the light source by remote control
- H05B47/19—Controlling the light source by remote control via wireless transmission
-
- H—ELECTRICITY
- H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
- H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
- H05B47/00—Circuit arrangements for operating light sources in general, i.e. where the type of light source is not relevant
- H05B47/10—Controlling the light source
- H05B47/175—Controlling the light source by remote control
- H05B47/196—Controlling the light source by remote control characterised by user interface arrangements
- H05B47/1965—Controlling the light source by remote control characterised by user interface arrangements using handheld communication devices
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02B—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO BUILDINGS, e.g. HOUSING, HOUSE APPLIANCES OR RELATED END-USER APPLICATIONS
- Y02B20/00—Energy efficient lighting technologies, e.g. halogen lamps or gas discharge lamps
- Y02B20/40—Control techniques providing energy savings, e.g. smart controller or presence detection
Definitions
- the present invention generally relates to the field of visible light communication, and particularly relates to methods and devices for transmitting/obtaining identification information and positioning by visible light signal.
- GPS global positioning system
- Visible light communication is also developed to transmit identification information for positioning by using the variation of visible light (color, intensity, or position).
- Such communication technology for transmitting identification information is based on high-frequency blinking visible lights.
- the identification information to be transmitted is firstly compiled into a digital signal; this digital signal is then applied to modulate the duration time or frequencies of the driving current or driving voltage of the light source, so that the light source blinks in high frequencies.
- This high-frequency blinking signal can be detected by a photosensitive device, for example, an image sensor.
- the image sensor may be based on the “rolling shutter” mechanism, which means that different parts of the sensor, each row or each column, are exposed at different time. Based on this feature, when taking pictures of a light source with rapidly changing brightness, the image sensor with a rolling shutter can deliver an image which contains bright or dark stripes. By measuring the width of the stripes, the frequencies of the driving current or driving voltage of the light source may be calculated and the transmitted identification information may thus be restored.
- the width of the stripes can be affected by local over-exposure of the image sensor, for instance, the bright stripes may become broader and the dark stripes may become narrower or even disappear within the over-exposed area, causing failure of the image analysis and decoding and different background lighting conditions may induce uncertainties for measuring the width of stripes.
- the photosensitive devices used in such visible light communication technology require to be specially designed to detect the visible light signal, and thus, only can be applied in limited scenarios.
- the commercially available mobile devices such as, smartphones, tablets, PDAs
- have photosensitive components, for example, the image sensor they are not suitable for sensing such high-frequency blinking signal.
- Objects of the present invention are to provide technical solutions for transmitting identification information, obtaining identification information, or positioning by visible light signals, which obviate at least one of the above-mentioned disadvantages.
- a method transmitting identification information of a light source by visible light signal comprising: modulating, on the basis of the identification information to be transmitted, a driving signal of the light source to obtain a modulated driving signal for driving the light source to emit visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points; and emitting the visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points on the basis of the modulated driving signal, so as to transmit identification information corresponding to the varied numbers of bright or dark stripes shown in one or more images obtained from the visible light signal at one or more time points, which numbers are corresponding to the varied frequencies.
- modulating on the basis of the identification information to be transmitted a driving signal of the light source to obtain a modulated driving signal comprises: modulating on the basis of the identification information to be transmitted a driving voltage or a driving current of the light source to obtain a first modulated driving voltage or a first modulated driving current.
- the first modulated driving current is greater than an un-modulated driving current, so that luminous flux of the light source driven by the first modulated driving current is equal to luminous flux of the light source driven by the un-modulated driving current.
- the method further comprising: emitting the visible light signal on the basis of a second modulated driving current which is greater than an un-modulated driving current together with a high frequency carrier wave signal, so that luminous flux of the light source driven by the second modulated driving current is constant among periods comprising peak levels and bottom levels.
- the first modulated driving voltage or the first modulated driving current is used for driving the light source to emit a visible light signal with a frequency from 100 Hz to 1.37 MHz, and duration of each bottom level of the visible light signal is fixed, or duration of each peak level of the light pulse signal is fixed.
- the method further comprising: detecting the presence of a human being within a illumination scope of the light source; and emitting a visible light signal on the basis of un-modulated driving signal in the absence of a human being.
- the identification information corresponding to the varied numbers of bright or dark stripes comprises data bits, which comprise data corresponding to the varied frequencies, and each data bit corresponds to a number among the varied numbers of bright or dark stripes.
- the identification information corresponding to the varied numbers of bright or dark stripes further comprises one or more start bits and/or one or more error correction bits, the one or more start bits being used to identify a start position of a set of data bits, and the one or more error correction bits being used to check error in the data bits.
- a method for obtaining identification information of a light source from visible light signals comprising: obtaining one or more images at one or more time points from a visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points emitted by a light source; measuring the varied numbers of bright or dark stripes in the one or more images, the varied numbers of bright or dark stripes being corresponding to the varied frequencies; and obtaining identification information corresponding to the varied numbers of the bright or dark stripes.
- a method for positioning by visible light signals comprising: obtaining at a position one or more images at one or more time points from a visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points emitted by a light source; measuring varied numbers of bright or dark stripes in the one or more images, the varied numbers of bright or dark stripes being corresponding to the varied frequencies; obtaining identification information of the light source corresponding to the varied number of the bright or dark stripes; and determining the position by checking the identification information in a predetermined map database.
- the method further comprising: before determining the position by checking the identification information in a predetermined map database, determining an area of the position by means of one or more wireless positioning schemes; and determining the position by checking the identification information in a predetermined map database comprises: determining the position by checking the identification information with data of the area in the predetermined map database.
- the wireless positioning scheme comprises positioning by means of GPS, GPRS, GSM, CDMA, WIFI, Zigbee, Bluetooth, and RFID.
- identification information of a light source is unique for an area at which the light source is located.
- obtaining at a position one or more images at one or more time points from a visible light signal comprises: obtaining at the position the one or more images at one or more time points by an image capturing device comprising an image sensor whose exposure mode is rolling shutter mode, and a sampling rate of the rolling shutter is higher than the frame rate of the image sensor.
- obtaining at a position one or more images at one or more time points from a visible light signal comprises capturing at the position on an image sensor with a rolling shutter the one or more images in which different portions of the image sensor are exposed at different time points.
- the visible light signal is emitted by the light source on the basis of a modulated driving signal, which drives the light source to emit the visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points.
- the light source is one or more light sources, and obtaining one or more images at one or more time points from visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points emitted by a light source comprises: obtaining one or more images at one or more time points from visible light signal having their level changed between peak levels and bottom levels with varied frequencies at different time points emitted by the one or more light sources, wherein one or more exposed regions in each image correspond to the one or more light sources, measuring the varied numbers of bright or dark stripes in the one or more images comprises: measuring the varied numbers of the bright or dark stripes of the one or more exposed regions in each image, and obtaining identification information corresponding to the varied numbers of the bright or dark stripes comprises: obtaining identification information corresponding to the varied numbers of the bright or dark stripes of the one or more exposed regions in each image.
- the identification information corresponding to the varied numbers of bright or dark stripes comprises data bits which comprise data corresponding to the varied frequencies, and each data bit corresponds to a number among the varied numbers of bright or dark stripes.
- the identification information corresponding to the varied numbers of bright or dark stripes further comprises one or more start bits and/or one or more error correction bits, the one or more start bits being used to identify a start position of a set of data bits, and the one or more error correction bits being used to check error in the data bits.
- light source for transmitting identification information by visible light signal, comprising: a modulator configured to modulate, on the basis of the identification information to be transmitted, a driving signal of the light source to obtain a modulated driving signal for driving the light source to emit visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points; and an emitter configured to emit the visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points on the basis of the modulated driving signal, so as to transmit identification information corresponding to the varied numbers of bright or dark stripes shown in one or more images obtained from the visible light signal at one or more time points, which numbers are corresponding to the varied frequencies.
- the modulator is configured to modulate on the basis of the identification information to be transmitted a driving voltage or a driving current of the light source to obtain a first modulated driving voltage or a first modulated driving current.
- the first modulated driving current is greater than an un-modulated driving current, so that luminous flux of the light source driven by the first modulated driving current is equal to luminous flux of the light source driven by the un-modulated driving current.
- the emitter is configured to emit the visible light signal on the basis of a second modulated driving current which is greater than an un-modulated driving current together with a high frequency carrier wave signal, so that luminous flux of the light source driven by the second modulated driving current is constant among periods comprising peak levels and bottom levels.
- the first modulated driving voltage or the first modulated driving current is used for driving the light source to emit a visible light signal with a frequency from 100 Hz to 1.37 MHz, and duration of each bottom level of the visible light signal is fixed, or duration of each peak level of the light pulse signal is fixed.
- the light source further comprising: a detector configured to detect the presence of a human being within an illumination scope of the light source; and the emitter is configured to emit a visible light signal on the basis of un-modulated driving signal in the absence of a human being.
- the identification information corresponding to the varied numbers of bright or dark stripes comprises data bits, which comprise data corresponding to the varied frequencies, and each data bit corresponds to a number among the varied numbers of bright or dark stripes.
- the identification information corresponding to the varied numbers of bright or dark stripes further comprises one or more start bits and/or one or more error correction bits, the one or more start bits being used to identify a start position of a set of data bits, and the one or more error correction bits being used to check error in the data bits.
- a device for obtaining identification information of a light source from visible light signal comprising: an image sensor configured to obtain one or more images at one or more time points from a visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points emitted by a light source; a memory configured to store the one or more images obtained by the image sensor at one or more time points; and a processor configured to measure varied numbers of bright or dark stripes in the one or more images stored in the memory and obtain identification information corresponding to the varied numbers of the bright or dark stripes, the varied numbers of bright or dark stripes being corresponding to the varied frequencies.
- a device for positioning by visible light signal comprising: an image sensor configured to obtain at a position one or more images at one or more time points from a visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points emitted by a light source; a memory configured to store the one or more images obtained by the image sensor at one or more time points; and a processor configured to measure varied numbers of bright or dark stripes in the one or more images stored in the memory, obtain identification information of the light source corresponding to the varied number of the bright and dark stripes, and determine the position by checking the identification information in a predetermined map database, the varied numbers of bright or dark stripes being corresponding to the varied frequencies.
- the processor is configured to before determining the position by checking the identification information in a predetermined map database, determine an area of the position by means of one or more wireless positioning schemes; and the processor is configured to determine the position by checking the identification information with data of the area in the predetermined map database.
- the wireless positioning scheme comprises positioning by means of GPS, GPRS, GSM, CDMA, WIFI, Zigbee, Bluetooth, and RFID.
- identification information of a light source is unique for an area at which the light source is located.
- exposure mode of the image sensor is rolling shutter mode, and a sampling rate of the rolling shutter is higher than the frame rate of the image sensor.
- the image sensor is an image sensor with a rolling shutter and is configured to obtain the one or more images in which different portions of the image sensor are exposed at different time points.
- the visible light signal is emitted by the light source on the basis of a modulated driving signal, which drives the light source to emit the visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points.
- the light source is one or more light sources
- the image sensor is configured to obtain one or more images at one or more time points from visible light signal having their level changed between peak levels and bottom levels with varied frequencies at different time points emitted by the one or more light sources, wherein one or more exposed regions in each image correspond to the one or more light sources
- the memory is configured to store the one or more images obtained by the image sensor at one or more time points
- the processor is configured to measure the varied numbers of the bright or dark stripes of the one or more exposed regions in each image, obtain identification information corresponding to the varied numbers of the bright or dark stripes of the one or more exposed regions in each image.
- the identification information corresponding to the varied numbers of bright or dark stripes comprises data bits which comprise data corresponding to the varied frequencies, and each data bit corresponds to a number among the varied numbers of bright or dark stripes.
- the identification information corresponding to the varied numbers of bright or dark stripes further comprises one or more start bits and/or one or more error correction bits, the one or more start bits being used to identify a start position of a set of data bits, and the one or more error correction bits being used to check error in the data bits.
- the embodiments of the present invention provide an efficient and effective approach for positioning, transmitting and obtaining information, which can achieve indoor positioning, transmit and obtain information much faster and more accurate, and the information transmitted and obtained may contain more data bits.
- the present invention has advantages of high confidentiality, no occupancy of wireless channel resources, low cost, and easy integration with various light sources. Further, the present invention effectively avoids the undesirable blinking of the light source detectable by human eyes.
- FIG. 1 is a flow chart illustrating a method 100 for transmitting information by visible light signal from a light source according to an embodiment of the present invention
- FIGS. 2 a - 2 c are the schematic diagrams of the driving signals for driving the light source according to embodiments of the present invention.
- FIGS. 3 a , 3 c and 3 e are the schematic diagrams of the driving signals for driving the light source according to embodiments of the present invention.
- FIGS. 3 b , 3 d and 3 f are the images obtained from the driving signals of FIGS. 3 a , 3 c and 3 e respectively according to embodiments of the present invention
- FIG. 3 g shows visible light signal with varied frequencies at different time points emitted by a light source driven by a first modulated driving current according to another embodiment of the present invention
- FIG. 4 a is the schematic diagram of a modulated driving current of a light source equal to the un-modulated driving current according to an embodiment of the present invention.
- FIG. 4 b is the schematic diagram of a modulated driving current greater than the un-modulated driving current according to an embodiment of the present invention.
- FIG. 4 c is the schematic diagram of a modulated driving current greater than the un-modulated driving current without high frequency carrier wave signal according to an embodiment of the present invention
- FIG. 4 d is the schematic diagram of a modulated driving current greater than the un-modulated driving current together with a high frequency carrier wave signal according to an embodiment of the present invention
- FIG. 5 a is the schematic diagram of the information corresponding to the varied numbers of bright or dark stripes comprising a start bit according to an embodiment of the present invention
- FIG. 5 b is the schematic diagram of the information corresponding to the varied numbers of bright or dark stripes comprising a start bit and an error correction bit according to an embodiment of the present invention
- FIG. 6 shows a light source emitting visible light signal for transmitting information in response to the presence of a human being according to an embodiment of the present invention
- FIG. 7 is a flow chart illustrating a method for obtaining information from visible light signal according to an embodiment of the present invention.
- FIG. 8 is a flow chart illustrating a method for positioning by visible light signals according to an embodiment of the present invention.
- FIG. 9 is a schematic diagram of an image containing one or more exposed regions corresponding to one or more light sources according to an embodiment of the present invention.
- FIG. 10 is a schematic diagram of a light source and a device for transmitting information by visible light signal according to an embodiment of the present invention.
- FIG. 11 is a flowchart of a process that a mobile device accesses the indoor map
- FIG. 12 is the schematic diagram of a mobile device integrated with a positioning software
- FIG. 13 is the schematic diagram of the relation between the map database and the identification information of light sources
- FIG. 14 is the schematic diagram of a light source with a mobile modification device comprising a receiver and a transmitter;
- FIG. 15 is the schematic diagram of a mobile modification device that can update the information stored in the light source
- FIG. 16 is the schematic diagram of a mobile modification device updating the identification information of the light source
- FIG. 17 is the flow chart of updating the identification information of a light source
- FIG. 18 is the flow chart of searching the identification information of a light source
- FIG. 19 a shows that the image sensor is placed horizontally for capturing image
- FIG. 19 b shows the captured image under when the image sensor is placed horizontally
- FIG. 20 a shows that the image sensor for capturing image is tilted from the horizontal plane
- FIG. 20 b shows the image captured by the image sensor when the image sensor is tilted from the horizontal plane
- FIG. 21 shows the diagram on how to calculate the midpoint of the image
- FIG. 22 a shows the schematic diagram of a gyroscope
- FIG. 22 b is a schematic diagram of the coordinate system an accelerometer of the mobile device
- FIG. 23 shows the schematic diagram on how to calculate the midpoint of the captured image
- FIG. 24 is the schematic diagram of the format of the data stored in the databases.
- FIG. 25 is the schematic diagram of information related to the identification information of the light source
- FIG. 26 is the schematic diagram of recording a route
- FIG. 27 is the schematic diagram of the captured image of two light sources
- FIG. 28 is the schematic diagram of the captured image of two light sources which is calibrated
- FIG. 29 is a schematic diagram of a light source comprising an AC/DC converter, a micro-controller and a memory according to an embodiment of the present invention
- FIG. 30 a is a flowchart of a process that the exposure time of the image sensor is adjusted before capturing an image according to an embodiment of the present invention
- FIGS. 30 b and 30 c are schematic diagrams of the sampling duration rate of the image sensor and the duration of the peak level or bottom level of the visible light signal emitted by the light source according to an embodiment of the present invention
- FIG. 30 d is a schematic diagram of an image obtained from the visible light signal having the duration of the peak level of as shown in FIG. 30 c according to an embodiment of the present invention
- FIGS. 31 a and 31 b are schematic diagrams of the exposed region in the image detected according to an embodiment of the present invention.
- FIGS. 32 a - 32 c are schematic diagrams of strategy for detecting the exposed region in the image according to an embodiment of the present invention.
- FIG. 33 is a flowchart of a process that the exposure time of the image sensor is adjusted before capturing an image according to an embodiment of the present invention
- FIG. 34 a is a schematic diagram of the image captured by the image sensor according to embodiments of the present invention.
- FIG. 34 b is a schematic diagram of the exposed region within the image being searched from the center of the image outwards along a spiral route according to embodiments of the present invention
- FIG. 34 c is a schematic diagram of the determined rectangular exposed region in the image according to an embodiment of the present invention.
- FIG. 34 d is a schematic diagram of determining the coordinates of the rectangular exposed region in the image according to an embodiment of the present invention.
- FIG. 34 e is a schematic diagram of optimized exposed region in the image according to an embodiment of the present invention.
- FIG. 34 f is a schematic diagram of measuring the number of the bright or dark strips according to an embodiment of the present invention.
- FIG. 34 g is a schematic diagram of measuring the number of the bright or dark strips according to another embodiment of the present invention.
- FIG. 35 is a schematic diagram of a device containing multiple image sensors according to an embodiment of the present invention.
- FIG. 36A is a schematic diagram of an interface with the real-time image and the information obtained therefrom displayed in full screen according to an embodiment of the present invention
- FIG. 36B is a schematic diagram of an interface with the information obtained from the image displayed according to an embodiment of the present invention.
- FIG. 37 is a schematic diagram showing an embodiment of the present invention with a device for obtaining information from visible light signals comprising an image sensor activated by an activation signal sent by the transmitter;
- FIG. 38 is a schematic diagram showing an embodiment of the present invention with a hardware-based switch installed on the transmitter for activating the image sensor in the device for obtaining information from visible light signals;
- FIG. 39 is a schematic diagram showing an embodiment of the present invention with a sensor integrated in the emitter
- FIG. 40 is a schematic diagram showing an embodiment of the present invention with a transmitter for transmitting multiple types of information
- FIG. 41 is a schematic diagram showing an embodiment of the present invention with a transmitter comprising a light source, a processor, a battery, and a charging circuit;
- FIG. 42 is a schematic diagram showing an embodiment of the present invention with a transmitter comprising a light source, a processor, a battery, a charging circuit, and a sensor;
- FIG. 43 is a schematic diagram showing an embodiment of the present invention with a transmitter comprising a light source, a processor, a battery, a charging circuit, a sensor, and a memory;
- FIG. 44 is a schematic diagram of the device for obtaining information according to an embodiment of the present invention.
- FIG. 45 is a schematic diagram showing an embodiment of the present invention with an image sensor integrated in a ring;
- FIG. 46 is a schematic diagram showing an embodiment of the present invention with a transmitter integrated in a wearable electronic device powered by a power supply;
- FIG. 47 is a schematic diagram of a transmitter comprising two or more light sources and a microprocessor according to an embodiment of the present invention.
- FIG. 48 is a schematic diagram of a transmitter comprising two or more light sources, a microprocessor, and a driver according to an embodiment of the present invention
- FIG. 49 is a schematic diagram of a transmitter comprising a microprocessor and a battery charging circuit according to an embodiment of the present invention.
- FIG. 50 is a schematic diagram of a transmitter comprising a microprocessor, a battery charging circuit, and a memory according to an embodiment of the present invention
- FIG. 51 is a schematic diagram of a transmitter comprising a microprocessor, a battery charging circuit, a memory, and a sensor according to an embodiment of the present invention
- FIG. 52 is a schematic diagram of a transmitter comprising a microprocessor, a battery charging circuit, a memory, a sensor, and a network adaptor according to an embodiment of the present invention
- FIG. 53 is a schematic diagram illustrating communication between a transmitter and a device for obtaining information from visible light signals comprising an image sensor according to an embodiment of the present invention
- FIG. 54 is a flowchart of a process that a transmitter sends visible light signals according to an embodiment of the present invention.
- FIG. 55 is a flowchart of a process that an image sensor receives the visible light signals according to an embodiment of the present invention.
- FIG. 56 is a schematic diagram of a positioning system based on the visible light signals according to an embodiment of the present invention.
- FIG. 1 is a flow chart illustrating the method 100 for transmitting identification information of a light source by visible light signal according to an embodiment of the present invention.
- the method 100 begins with a step 110 of modulating, on the basis of the identification information to be transmitted, a driving signal of the light source to obtain a modulated driving signal for driving the light source to emit visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points.
- the light source may be any type of light source emitting visible light signal, for example, LED, fluorescent, or incandescent lamp.
- the identification information transmitted by visible light signal may be any type of identification information, for example, the identifier (ID) of the light source, and other identification information.
- the driving signal of the light source may be in the forms of square wave, sine wave, triangle wave, wave on a higher-frequency carrier, the aforesaid waves containing DC component, or in other forms of wave.
- the driving signal of the light source may be modulated by the Pulse Width Modulation (PWM).
- PWM Pulse Width Modulation
- the pulse duration is fixed, and the duty of the signal can be modulated, wherein the duty in a pulse cycle (such as square wave) is the ratio of the positive pulse duration (i.e., duration of the positive part) to the total duration.
- the step 110 may comprise: modulating on the basis of the identification information to be transmitted a driving voltage or a driving current of the light source to obtain a first modulated driving voltage or a first modulated driving current.
- the first modulated driving voltage or the first modulated driving current may be used to drive the light source to emit the visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points.
- FIGS. 2 a - 2 c are the schematic diagrams of the driving signals for driving the light source according to embodiments of the present invention.
- the driving signal, optionally the driving current, of a light source is in the form of sine wave with a frequency of f 2a .
- the driving signal, optionally the driving current, of the light source is in the form of sine wave with a frequency of f 2b , and f 2a >f 2b .
- the driving signal, optionally the driving current, of the light source may be modulated on the basis of the identification information to be transmitted to obtain a first modulated driving current, as shown in FIG. 2 c , which has a frequency of f 2b at time points within a time interval ⁇ T1, a frequency of f 2a at time points within a time interval 2 ⁇ T2, a frequency of f 2b at time points within a time interval 3 ⁇ T3, a frequency of f 2a at time points within a time interval 4 ⁇ T4, and a frequency of f 2b at time points within a time interval 5 ⁇ T5.
- the first modulated driving current may be used to drive the light source to emit the visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points, for example, with varied frequencies f 2a and f 2b at different time points within ⁇ T1, ⁇ T2, ⁇ T3, ⁇ T4 and ⁇ T5.
- the driving voltage of the light source may also be modulated on the basis of the identification information to be transmitted.
- the driving current or the driving voltage of the light source may have other wave forms.
- the driving current or the driving voltage of the light source may be modulated to emit visible light signal with three or more kinds of varied frequencies at different time points.
- a step 120 of the method 100 is performed, that is, emitting the visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points on the basis of the modulated driving signal, so as to transmit identification information corresponding to the varied numbers of bright or dark stripes shown in one or more images obtained from the visible light signal at one or more time points, which numbers are corresponding to the varied frequencies.
- the dark stripe corresponds to the bottom level of the visible light signal
- the bright stripe corresponds to the peak level of the visible light signal.
- the varied number of the bright stripes and dark stripes corresponds to different identification information transmitted.
- FIGS. 3 a , 3 c and 3 e are the schematic diagrams of the driving signals for driving the light source
- FIGS. 3 b , 3 d and 3 f are the images obtained respectively according to embodiments of the present invention.
- the driving signal, optionally the driving current, of a light source is in the form of square wave with a frequency of f 3a and the starting time for capturing an image is at the time point when one of the peal levels of the visible light signal is emitted.
- the driving signal shown in FIG. 3 a an image with 10 dark stripes and 11 bright stripes as shown in FIG. 3 b may be obtained, where the number of the bright or dark stripes is corresponding to the frequency f 3a .
- an image having 11 dark stripes and 10 bright stripes may be obtained (not shown).
- the driving signal, optionally the driving current, of a light source is in the form of square wave with a frequency of f 3c with f 3a >f 3c and the starting time for capturing an image is at the time point when one of the peal levels of the visible light signal is emitted.
- the driving signal shown in FIG. 3 c an image with 5 dark stripes and 6 bright stripes as shown in FIG. 3 d may be obtained, where the number of the bright or dark stripes is corresponding to the frequency f 3c .
- an image having 6 dark stripes and 5 bright stripes may be obtained (not shown).
- the driving signal, optionally the driving current, of a light source is in the form of square wave with a frequency of f 3e with f 3c >f 3e , and the starting time for capturing an image is at the time point when one of the peal levels of the visible light signal is emitted.
- the driving signal shown in FIG. 3 c an image with 3 dark stripes and 4 bright stripes as shown in FIG. 3 f may be obtained, where the number of the bright or dark stripes is corresponding to the frequency f 3e .
- an image having 4 dark stripes and 3 bright stripes may be obtained (not shown).
- FIG. 3 g shows a visible light signal with varied frequencies at different time points emitted by a light source driven by a first modulated driving current.
- the first modulated driving current may be used to drive the light source to emit the visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points, for example, with varied frequencies f 3a , f 3c and f 3e at different time points within time intervals ⁇ T1, ⁇ T2 and ⁇ T3.
- a code is transmitted, for example, within ⁇ T1 a code “1” is transmitted, within ⁇ T2 a code “2” is transmitted, and within ⁇ T3 a code “3” is transmitted.
- an image with 10 dark stripes and 11 bright stripes as shown in FIG. 3 b , corresponding to f 3a may be obtained at different time points within ⁇ T1; an image with 5 dark stripes and 6 bright stripes as shown in FIG. 3 d , corresponding to f 3c , may be obtained at different time points within ⁇ T2; and an image with 3 dark stripes and 4 bright stripes as shown in FIG. 3 f , corresponding to f 3e , may be obtained at different time points within ⁇ T3.
- the driving voltage of the light source may also be modulated on the basis of the identification information to be transmitted.
- the driving current or the driving voltage of the light source may have other wave forms.
- the driving current or the driving voltage of the light source may be modulated to emit visible light signal with four or more kinds of varied frequencies at different time points.
- the first modulated driving current is greater than the un-modulated driving current, so that luminous flux of the light source driven by the first modulated driving current is equal to luminous flux of the light source driven by the un-modulated driving current.
- the luminous flux is the measure of the power of light emitted by the light source during unit time, and is proportional to the area below the wave of the driving signal, the variation of which is sensitive to human eye.
- the driving signal may be modulated with the first modulated driving currents greater than un-modulated driving currents, so that luminous flux of the light source is constant throughout the transmission of identification information to avoid blinking.
- the driving signal may be modulated, in the similar manner as shown in FIGS. 4 a and 4 b , so that luminous flux of the light source driven by the first modulated driving current in ⁇ T1, ⁇ T2, ⁇ T3 is equal to luminous flux of the light source driving by the un-modulated driving current.
- the method 100 may comprise a step of emitting the visible light signal on the basis of a second modulated driving current which is greater than an un-modulated driving current together with a high frequency carrier wave signal, so that luminous flux of the light source driven by the second modulated driving current is constant among periods comprising peak levels and bottom levels.
- FIG. 4 c is the schematic diagram of a modulated driving current greater than the un-modulated driving current without high frequency carrier wave signal according to an embodiment of the present invention.
- the peak levels and bottom levels may have different durations of peak levels and bottom levels for transmitting different codes, as shown in FIG. 4 c , resulting in different luminous fluxes of the light source driven by the modulated driving current, causing the light source to blink. For example, as shown in FIG.
- the driving current which is greater than un-modulated driving current is further modulated with a high frequency carrier wave signal.
- a high frequency carrier wave signal By modulating with a high frequency carrier wave signal, within different time intervals, the durations of peak levels and bottom levels of the driving current for transmitting different codes are same, giving the same luminous flux among periods comprising the peak levels and bottom levels, and thus avoiding the blinking of the light source. For example, as shown in FIG.
- the visible light signals shown in FIG. 4 c and FIG. 4 d have the same frequency within different intervals ⁇ T1 and ⁇ T2.
- a modulated driving current for driving the light source to emit the visible light signal with varied frequencies at different time points may be modulated in the similar manner as shown in FIGS. 4 c and 4 d , so that the luminous flux of the light source driven by the modulated driving current is equal to the luminous flux of the light source driving by the un-modulated driving current.
- the identification information corresponding to the varied numbers of bright or dark stripes comprises data bits, which comprise data corresponding to the varied frequencies, and each data bit corresponds to a number among the varied numbers of bright or dark stripes.
- the images as shown in FIGS. 3 b , 3 d and 3 f may be obtained at different time points within time intervals ⁇ T1, ⁇ T2 and ⁇ T3.
- the identification information corresponding to the varied numbers of bright or dark stripes in the images as shown in FIGS. 3 b , 3 d and 3 f may be transmitted.
- the identification information transmitted may comprise data bits which comprise data corresponding to the varied frequencies, such as f 3a , f 3c and f 3e at different time points within time intervals ⁇ T1, ⁇ T2 and ⁇ T3.
- Each data bit corresponds to a number among the varied numbers of bright or dark stripes. For example, 10 dark stripes and 11 bright stripes as shown in FIG.
- the first modulated driving current may have other combinations of signals with different frequencies or different durations.
- the identification information corresponding to the varied numbers of bright or dark stripes further comprises one or more starts bit and/or one or more error correction bits, the one or more start bits being used to identify a start position of a set of data bits, and the one or more error correction bits being used to check error in the data bits
- FIG. 5 a is the schematic diagram of the identification information corresponding to the varied numbers of bright or dark stripes comprising a start bit according to an embodiment of the present invention. As shown in FIG. 5 a , a start bit is added at the beginning of the data bits. Alternatively, more than one start bits may be included.
- FIG. 5 b is the schematic diagram of the identification information corresponding to the varied numbers of bright or dark stripes comprising a start bit and an error correction bit according to an embodiment of the present invention.
- an error correction bit is also added at the end of the data bits.
- more than one error correction bits may be included.
- the one or more error correction bits may be added to the data bits without the start bit.
- the first modulated driving voltage or the first modulated driving current is used for driving the light source to emit a visible light signal with a frequency from 100 Hz to 1.37 MHz, and duration of each bottom level of the visible light signal is fixed, or duration of each peak level of the light pulse signal is fixed.
- the image may be obtained by an image capturing device comprising an image sensor whose exposure mode is the rolling shutter mode.
- the exposure time of the image sensor is defined as the exposure time of pixels in each row (or column) of the rolling shutter based image sensor.
- the exposure time of each is less than 70 us
- the first modulated driving current has the frequency of f 3a at time points within the time interval ⁇ T1, the frequency of f 3c at time points within the time interval ⁇ T2, and frequency of f 3e at time points within the time interval ⁇ T3.
- Different time intervals ⁇ T1, ⁇ T2 and ⁇ T3 have same duration, and the numbers of the peak levels or bottom levels are different. For example, there are three peak levels or bottom levels within ⁇ T1; there are two peak levels or bottom levels within ⁇ T2; and there is one peak level or bottom level within ⁇ T3.
- the duration of each bottom level of the visible light signal is fixed.
- the images as shown in FIGS. 3 b , 3 d and 3 f may be obtained at different time points within ⁇ T1, ⁇ T2 and ⁇ T3, and the dark stripes in the images as shown in FIGS. 3 b , 3 d and 3 f have the same width.
- the duration of each peak level of the visible light signal may be fixed, and the bright stripes in the images have the same width.
- the method 100 may further comprise steps of detecting the presence of a human being within an illumination scope of the light source, and emitting a visible light signal on the basis of un-modulated driving signal in the absence of a human being.
- FIG. 6 shows a light source emitting visible light signal for transmitting identification information in response to the presence of a human being.
- a visible light signal is emitted on the basis of un-modulated driving signal and no identification information is transmitted.
- a human being is presented within the illumination scope of the light source, such as at “position b” shown in FIG.
- the presence of the human being is detected, the driving signal of the light source is modulated on the basis of the identification information to be transmitted, the visible light signal is emitted on the basis of the modulated driving signal, and the identification information corresponding to the varied numbers of bright or dark stripes shown in one or more images obtained from the visible light signal is transmitted.
- the human being leaves the illumination scope of the light source, such as at “position c” shown in FIG. 6 , a visible light signal on the basis of un-modulated driving signal is emitted, and no identification information is transmitted.
- frequencies, waveforms, or widths of the peak levels and bottom levels of the modulated driving current are not limited to the above exemplary values, but may be set to have any values as required.
- frequencies, waveforms, or widths of the peak levels and bottom levels of the high frequency signal wave signal are not limited to the above exemplary values, but may be set to have any values as required.
- FIG. 7 is a flow chart illustrating the method 200 for obtaining identification information of a light source from visible light signal according to an embodiment of the present invention.
- the method 200 begins with a step 210 of obtaining one or more images at one or more time points from a visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points emitted by a light source.
- step 220 of the method 200 is performed, wherein the varied numbers of bright or dark stripes in the one or more images is measured and the varied numbers of bright or dark stripes are corresponding to the varied frequencies.
- step 230 of the method 200 is performed, wherein identification information corresponding to the varied numbers of the bright or dark stripes is obtained.
- FIG. 8 is a flow chart illustrating the method 300 for positioning by visible light signal according to an embodiment of the present invention.
- Embodiments of the third aspect of the present invention also apply to the second aspect of the present invention, thus only the embodiments of the third aspect will be described in details hereinafter, and same embodiments of the second aspect will not be described repeatedly for the sake of conciseness.
- the method 300 begins with a step 310 of obtaining one or more images at one or more time points from a visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points emitted by a light source.
- the visible light signal may be emitted by the light source on the basis of a modulated driving signal, which drives the light source to emit visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points, as described hereinbefore in details with respect to the method 100 .
- the modulated driving signal may be modulated by the PWM scheme.
- the modulated driving signals may be modulated driving voltages or modulated driving currents.
- the modulated driving current may be greater than un-modulated driving current, so that luminous flux of the light source driven by the modulated driving current is equal to luminous flux of light source driven by the un-modulated driving current, as described hereinbefore in details with respect to the method 100 making reference to FIGS. 4 a and 4 b.
- the modulated driving current may be greater than un-modulated driving currents together with a high frequency carrier wave signal, so that the luminous flux of the light source driven by the driving current is constant among periods comprising peak levels and bottom levels, as described hereinbefore in details with respect to the method 100 making reference to FIGS. 4 c and 4 d.
- the image obtained from the visible light signal may be an image containing bright or dark stripes as shown in FIGS. 3 b , 3 d , 3 f , where varied numbers of bright or dark stripes correspond to the varied frequencies of the visible light signal.
- the step 210 may comprise obtaining at the position one or more images at one or more time points by an image capturing device comprising an image sensor whose exposure mode is rolling shutter mode, and a sampling rate of the rolling shutter is higher than the frame rate of the image sensor.
- the image capturing device is used for capturing the one or more images obtained from the visible light signal emitted by the light source.
- the image capturing device may be a smartphone, laptop computer, or other electronic device equipped with camera(s).
- the image capturing device may be an embedded system integrated in other devices or objects, for example, piece jewelry, key, card, pen, etc.
- the image sensor may be a photosensitive component.
- the image sensor may obtain one or more images containing bright or dark stripes, such as those shown in FIG. 3 b , 3 d or 3 f , when capturing one or more images at different time points of a rapidly changing light source driven by the modulated driving signal, such as those shown in FIG. 3 g .
- the sampling rate of the rolling shutter is higher than the frame rate of the image sensor, so as to obtain a clear image containing bright or dark stripes with each stripe being corresponding to each row.
- the exposure time of each is less than 69 us and the sampling rate is higher than 30 Hz.
- the step 210 may comprise capturing at the position on an image sensor with a rolling shutter the one or more images in which different portions of the image sensor are exposed at different time points.
- the image sensor may be a complementary metal-oxide-semiconductor (CMOS) image sensor or a Charge-Coupled Device (CCD) image sensor.
- CMOS complementary metal-oxide-semiconductor
- CCD Charge-Coupled Device
- step 320 of the method 300 is performed, wherein varied numbers of bright or dark stripes in the one or more images is measured, and the varied numbers of bright or dark stripes are corresponding to the varied frequencies.
- varied numbers of bright or dark stripes in the one or more images obtained from the visible light signal may be measured by, for example, an image processor or a general purpose processor.
- the optical signal detected by the image sensor is converted into electrical signal by the image sensor.
- the analog electrical signals are converted into digital signals by an analog-to-digital-converter (ADC) of the image sensor or the processor.
- ADC analog-to-digital-converter
- the processor is applied to further process the digital signal and generate a digital image, which may be displayed on a monitor.
- a digital signal processing (DSP) module of the processor may be applied to process the digital signal and generate a digital image.
- step 330 of the method 200 may be performed, wherein identification information of the light source corresponding to the varied numbers of the bright or dark stripes is obtained.
- the identification information of the light source corresponding to the pattern of the color stripes may be any type of identification information, for example, the identifier (ID) of the light source, and other identification information.
- ID the identifier
- the varied numbers of bright or dark stripes in the one or more images are derived from the varied frequencies of the visible light signal at different time points.
- the identification information of the light source corresponding to the varied numbers of bright or dark stripes may be decoded. By this way, the initial identification information carried on the visible light signal can be recovered.
- the images captured by an image sensor can be generated from the light source emitting visible light signal at different time points, which is driven by the modulated driving signal as shown in FIG. 3 g .
- the analysis of the captured images is based on the measurements of varied numbers of bright or dark stripes.
- the image shown in FIG. 3 b has 10 dark stripes and 11 bright stripes, and its decoded wave form corresponds to that in FIG. 3 a or within ⁇ T1 as shown in FIG. 3 g ;
- the image shown in FIG. 3 d has 5 dark stripes and 6 bright stripes, and its decoded wave form corresponds to that in FIG.
- FIG. 3 e has 3 dark stripes and 4 bright stripes, and its decoded wave form corresponds to that in FIG. 3 e or within ⁇ T3 as shown in FIG. 3 g.
- the transmitted identification information of the light source may be decoded by comparing the relative frequencies corresponding to the numbers of the bright or dark stripes, instead of the absolute frequencies of the visible light signals.
- the light source may be one or more light sources.
- One or more images from visible light signal emitted by the light source may be obtained at one or more time points.
- Each image obtained may have one or more exposed regions, and each exposed region may contain bright or dark stripes corresponding to one light source.
- FIG. 9 is a schematic diagram of an image containing one or more exposed regions corresponding to one or more light sources according to an embodiment of the present invention.
- the image obtained has three exposed regions, and each exposed region contains bright or dark stripes, such as those shown in FIG. 3 b , 3 d or 3 f , corresponding to one light source driven by the modulated driving signal, such as those shown in FIG. 3 a , 3 c or 3 e.
- the step 310 may comprise: obtaining one or more images at one or more time points from visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points emitted by the one or more light sources, wherein one or more exposed regions in each image correspond to the one or more light sources.
- the image having one or more exposed regions obtained from one or more light source for example the image shown in FIG. 9 , may be obtained in the similar way as that obtained from one light source as mentioned above, which will not be iterated herein for the sake of conciseness.
- the step 320 may comprise measuring the varied numbers of the bright or dark stripes of the one or more exposed regions in each image.
- the varied numbers of bright or dark stripes of each exposed region corresponding to each set light source may be measured in the similar way as mentioned above.
- varied numbers of bright or dark stripes of each exposed region corresponding to each light source shown in FIG. 9 may be respectively measured in the similar way as those shown in FIGS. 3 b , 3 d and 3 f , which will not be iterated herein for the sake of conciseness.
- the step 330 may comprise obtaining identification information corresponding to the varied numbers of the bright or dark stripes of the one or more exposed regions in each image.
- the identification information corresponding to the varied number of bright or dark stripes of each exposed regions in the image may be obtained respectively, in the similar way as that from one light source as mention above.
- identification information corresponding to the varied number of bright or dark stripes of each exposed region corresponding to each light source shown in FIG. 9 may be respectively obtained in the similar way as that corresponding to those shown in FIGS. 3 b , 3 d and 3 f , which will not be iterated herein for the sake of conciseness.
- the shape of the light spot projected on the image sensor may have distortion, for example, from a circular to an ellipse.
- acceleration meter, gravity sensor, tilt sensor, gyro, or magnetic sensor may be applied to measure the angle of inclination, which may be used to obtain the identification information of one or more light sources corresponding to the varied numbers of bright or dark stripes of the one or more exposed regions in the image.
- step 340 of the method 300 is performed, wherein the position is determined by checking the identification information in a predetermined map database.
- the predetermined map database contains identification information and the corresponding position information of each light source. By checking the identification information in the map database, the position of the light source can be determined.
- method 300 may further comprise determining an area of the position by means of one or more wireless positioning schemes. After the area of the position is determined, the position can be then determined by checking the identification information with data of the area in the predetermined map database.
- identification information of a light source is unique for an area at which the light source is located.
- the wireless positioning scheme comprises positioning by means of GPS, GPRS, GSM, CDMA, WIFI, Zigbee, Bluetooth, and RFID.
- the area where the light source is located can be determined, providing the rough position of the light source. Then, the position of the light source within the area can be determined by checking the identification information with data of the area in the predetermined map database, providing the accurate position of the light source. By this way, each area may have independent map database. The identification information of the light source in one area may be different from that in a different area.
- the identification information of the light source in one area may be same as that in a different area, and under such circumstances, the area where the light source is located should be determined firstly and then the position of the light source within the area can be determined on the basis of the identification information which unique in the area.
- Such embodiment allows easier coding and shorter length of the identification information, and faster transmission of the identification information.
- the identification information corresponding to the varied numbers of bright or dark stripes comprises data bits which comprise data corresponding to the varied frequencies, and each data bit corresponds to a number among the varied numbers of bright or dark stripes.
- the images as shown in FIGS. 3 b , 3 d and 3 f may be obtained at different time points within time intervals ⁇ T1, ⁇ T2 and ⁇ T3.
- the identification information corresponding to the varied numbers of bright or dark stripes in the images as shown in FIGS. 3 b , 3 d and 3 f may be transmitted.
- the identification information of the light source transmitted may comprise data bits which comprise data corresponding to the varied frequencies, such as f 3a , f 3c and f 3e at different time points within time intervals ⁇ T1, ⁇ T2 and ⁇ T3. Each data bit corresponds to a number among the varied numbers of bright or dark stripes.
- 10 dark stripes and 11 bright stripes as shown in FIG. 3 b may represent code “1”
- 5 dark stripes and 6 bright stripes as shown in FIG. 3 d may represent code “2”
- 3 dark stripes and 4 bright stripes as shown in FIG. 3 f may represent code “3”.
- the modulated driving current may have other combinations of signals with different frequencies or different durations.
- the identification information corresponding to the varied numbers of bright or dark stripes further comprises one or more start bits and/or one or more error correction bits, the one or more start bits being used to identify a start position of a set of data bits, and the one or more error correction bits being used to check error in the data bits.
- the identification information corresponding to the varied numbers of bright or dark stripes may comprise a start bit according to an embodiment of the present invention.
- a start bit is added at the beginning of the data bits.
- more than one start bits may be included.
- the identification information corresponding to the varied numbers of bright or dark stripes may comprise a start bit and an error correction bit according to an embodiment of the present invention.
- an error correction bit is also added at the end of the data bits.
- more than one error correction bits may be included.
- the one or more error correction bits may be added to the data bits without the start bit.
- a light source 400 for transmitting identification information by visible light signal may be a lamp, for example a LED lamp, LED backlight, LED flat light, etc.
- the light source 400 is not limited to the above example, but may be any light source capable of transmitting visible light signals.
- the light source 400 may comprise a modulator 410 and an emitter 420 .
- the modulator 410 may be a modulator driven by an electric signal with constant current, constant voltage, constant electric power, constant optical power, or by an electric signal modulated by PWM.
- the emitter 420 may be a LED which may emit visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points.
- the emitter 420 may be one or more LEDs connected in one string, including 1 to dozens of LEDs.
- the emitter 420 may be one or more LEDs connected in more strings with each string including 1 to dozens of LEDs.
- the emitter 420 comprises more LEDs.
- the modulator 410 or the emitter 420 is not limited to the above example, but may be any modulator or emitter.
- the modulator 410 may be configured to modulate, on the basis of the identification information to be transmitted, a driving signal of the light source to obtain a modulated driving signal for driving the light source to emit visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points.
- the emitter 420 may be configured to emit the visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points on the basis of the modulated driving signal, so as to transmit identification information corresponding to the varied numbers of bright or dark stripes shown in one or more images obtained from the visible light signal at one or more time points, which numbers are corresponding to the varied frequencies.
- the modulator 410 may be configured to modulate on the basis of the identification information to be transmitted a driving voltage or a driving current of the light source to obtain a first modulated driving voltage or a first modulated driving current.
- the first modulated driving current is greater than the un-modulated driving current, so that the luminous flux of the light source driven by the first modulated driving current is equal to the luminous flux of the light source driven by the un-modulated driving current.
- the emitter 420 can be configured to emit the visible light signal on the basis of a second modulated driving current which is greater than the un-modulated driving current together with a high frequency carrier wave signal, so that luminous flux of the light source driven by the second modulated driving current is constant among periods comprising peak levels and bottom levels.
- the identification information corresponding to the varied numbers of bright or dark stripes comprises data bits which comprise data corresponding to the varied frequencies, and each data bit corresponds to a number among the varied numbers of bright or dark stripes.
- the identification information corresponding to the varied numbers of bright or dark stripes may further comprise one or more starts bit and/or one or more error correction bits, the start bits are used to identify a start position of a set of data bits, and the one or more error correction bits are used to check error in the data bits.
- the first modulated driving voltage or the first modulated driving current is used for driving the light source to emit a visible light signal with a frequency from 100 Hz to 1.37 MHz, and duration of each bottom level of the visible light signal is fixed, or duration of each peak level of the light pulse signal is fixed.
- the light source 400 may further comprise a detector configured to detect the presence of a human being within an illumination scope of the light source, and the emitter is configured to emit a visible light signal on the basis of un-modulated driving signal in the absence of a human being.
- the step 110 in the method 100 can be performed by the modulator 410
- the step 120 in the method 100 can be performed by the emitter 420 .
- a device 500 for obtaining identification information from visible light signal may be a mobile device with a camera, such as a smartphone, tablet, laptop computer, or other electronic device.
- the device 500 is not limited to these examples, but can be any electronic device with photosensitive component.
- the device 500 for obtaining identification information of light source from visible light signal may comprise an image sensor 510 , a memory 520 , and a processor 530 .
- the image sensor 510 may be for example a camera, photodiode, and photodiode array.
- the memory 520 may be for example volatile memory, non-volatile memory, etc.
- the processor 530 may be general purpose processor, dedicated processor, etc.
- the image sensor 510 can be configured to obtain one or more images at one or more time points from a visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points emitted by a light source.
- the memory 520 can be configured to store the one or more images obtained by the image sensor at one or more time points.
- the processor 530 can be configured to measure varied numbers of bright or dark stripes in the one or more images stored in the memory 520 and obtain identification information corresponding to the varied numbers of the bright or dark stripes, and the varied numbers of bright or dark stripes are corresponding to the varied frequencies.
- the device may be a mobile device with a camera, such as a smartphone, tablet, laptop computer, or other electronic device.
- the device is not limited to these examples, but can be any electronic device with photosensitive component.
- Embodiments of the sixth aspect of the present invention also apply to the fifth aspect of the present invention, thus only the embodiments of the sixth aspect will be described in details hereinafter, and same embodiments of the fifth aspect will not be described repeatedly for the sake of conciseness.
- Embodiments of device according to the sixth aspect of the present invention will be described with reference to FIG. 10 again hereinafter, and same reference numbers with the fifth aspect will be used.
- the device 500 for positioning by visible light signal may comprise an image sensor 510 , a memory 520 , and a processor 530 .
- the image sensor 510 may be for example a camera, photodiode, and photodiode array.
- the memory 520 may be for example volatile memory, non-volatile memory, etc.
- the processor 530 may be general purpose processor, dedicated processor, etc.
- the image sensor 510 can be configured to obtain at a position one or more images at one or more time points from a visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points emitted by a light source.
- the memory 520 can be configured to store the one or more images obtained by the image sensor at one or more time points.
- the processor 530 can be configured to measure varied numbers of bright or dark stripes in the one or more images stored in the memory 520 , obtain identification information corresponding to the varied numbers of the bright or dark stripes, and determine the position by checking the identification information in a predetermined map database, the varied numbers of bright or dark stripes being corresponding to the varied frequencies.
- the processor 530 is configured to before determining the position by checking the identification information in a predetermined map database, determine an area of the position by means of one or more wireless positioning schemes; and the processor 530 is configured to determine the position by checking the identification information with data of the area in the predetermined map database.
- the wireless positioning scheme comprises positioning by means of GPS, GPRS, GSM, CDMA, WIFI, Zigbee, Bluetooth, and RFID.
- identification information of a light source 400 is unique for an area at which the light source 400 is located.
- the area where the light source is located can be determined, providing the rough position of the light source. Then, the position of the light source within the area can be determined by checking the identification information with data of the area in the predetermined map database, providing the accurate position of the light source. By this way, each area may have independent map database. The identification information of the light source in one area may be different from that in a different area.
- the identification information of the light source in one area may be same as that in a different area, and under such circumstances, the area where the light source is located should be determined firstly and then the position of the light source within the area can be determined on the basis of the identification information which unique in the area.
- Such embodiment allows easier coding and shorter length of the identification information, and faster transmission of the identification information.
- exposure mode of the image sensor is rolling shutter mode, and a sampling rate of the rolling shutter is higher than the frame rate of the image sensor.
- the image sensor 510 is an image sensor with a rolling shutter and is configured to obtain the one or more images in which different portions of the image sensor are exposed at different time points.
- the image sensor 510 may be a complementary metal-oxide-semiconductor (CMOS) image sensor or a Charge-Coupled Device (CCD) image sensor.
- CMOS complementary metal-oxide-semiconductor
- CCD Charge-Coupled Device
- the visible light signal is emitted by the light source 400 on the basis of a modulated driving signal, which drives the light source 400 to emit the visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points.
- the light source 400 may be one or more sets of light sources
- the image sensor 510 can be configured to obtain one or more images at one or more time points from visible light signal having their level changed between peak levels and bottom levels with varied frequencies at different time points emitted by the one or more light sources, wherein one or more exposed regions in each image correspond to the one or more light sources
- the memory 520 can be configured to store the one or more images obtained by the image sensor at one or more time points
- the processor 530 can be configured to measure the varied numbers of the bright or dark stripes of the one or more exposed regions in each image, and obtain identification information corresponding to the varied numbers of the bright or dark stripes of the one or more exposed regions in each image.
- the identification information corresponding to the varied numbers of bright or dark stripes comprises data bits which comprise data corresponding to the varied frequencies, and each data bit corresponds to a number among the varied numbers of bright or dark stripes.
- the identification information corresponding to the varied numbers of bright or dark stripes further comprises one or more start bits and/or one or more error correction bits, the one or more start bits being used to identify a start position of a set of data bits, and the one or more error correction bits being used to check error in the data bits.
- the step 310 in the method 300 as described above can be performed by the image sensor 510 and memory 520
- the steps 330 , 340 and 350 in the method 300 can be performed by the processor 530 .
- the device for positioning by visible light signal may be a mobile device.
- FIG. 11 shows a flow chart of a process that a mobile device accesses the indoor map.
- the mobile device starts the software for indoor positioning, initializes the wireless network, determines an area of the position by means of one or more wireless positioning schemes.
- the software searches where there is the map of the current position in the predetermined may database of the mobile device. If no, the map of the current position is downloaded to the mobile device through wireless network. If yes, the mobile device checks the map of the current position and determines the position by checking the identification information in the map.
- a mobile device may be integrated with a positioning software.
- FIG. 12 shows the diagram of a mobile device integrated with a positioning software.
- the identification information and a predetermined map database can be stored in the memory of the mobile device. Therefore, the mobile device can compare the received identification information with the map database, and show the map of the position on the display of the mobile device.
- the working flow of a mobile device integrated with a positioning software is as follows: one or more images of the light source are captured by the image sensor; the captured images are sent to the processor to decode the identification information; the recovered identification information is compared with the predetermined map database and the accurate position is shown on the display of the mobile device.
- a predetermined map database contains the identification information of the light sources.
- FIG. 13 is the diagram of the relation between the map database and the identification information of light sources.
- the predetermined map database containing identification information may be stored in a mobile device.
- the predetermined map database containing identification information may be stored in a remote server. After recovering the identification information, the mobile device can access the predetermined map database on the remote server through network. Then, the mobile device compares the received identification information with the map database, and the accurate position is shown on the display of the mobile device.
- the identification information of the light source may be modified by a mobile modification device via wireless communication.
- FIG. 14 is the diagram of a light source with a mobile modification device comprising a receiver and a transmitter.
- the light source can receive the wireless signal sent by the mobile device and update the identification information stored in the integrated memory.
- the wireless signal could be a light signal, RF signal or other kind of wireless signals.
- the visible light signal is chosen as an example to further explain the method and related devices.
- the present invention provides an easy and low cost way to modify identification information stored in the integrated memory in light sources.
- a mobile modification device can update the information stored in the light source as shown in FIG. 15 .
- the light detection module is applied for receiving the visible light signal sent by the mobile device for updating the identification information in the light source; and updating the identification information in the integrated memory in light sources.
- the identification information of the light source may be updated through the mobile modification device as shown in FIG. 16 .
- a light detection module is integrated in the light source. This light detection module is applied for receiving the visible light signal sent by the mobile modification device for updating the identification information in the light source.
- the processor updates the identification information in the integrated memory in the light source.
- FIG. 17 is the flow chart of updating the identification information of a light source.
- Mobile modification device receives the visible light signal sent by the light source; demodulates the visible light signal with a microprocessor; and shows the demodulated identification information on a display. Meanwhile, the microprocessor search the memory for the identification information of the light source and display the identification information to be updated on the display, determine whether the demodulated identification information is the same as the identification information. If they are not the same, the transmitter sends the visible light signal modulated by the modulator to the light source. The light source receives the visible light signal, the microprocessor demodulates the identification information and updates the identification information.
- FIG. 18 is the flow chart of searching the identification information of a light source.
- the light source sends the updated identification information to the mobile modification device.
- the receiver of the mobile modification device receives the information, the microprocessor demodulates the identification information of the light source and display a confirmation message after updating is completed. If the received updated identification information is the same as the identification information to be updated, then the process ends. Otherwise, the mobile modification device resends the visible light signal containing the identification information to the light source.
- FIG. 19 a shows that the image sensor is placed horizontally for capturing image.
- the image sensor is placed below the light source for capturing the image from the visible light signals of multiple light sources.
- FIG. 19 b shows the captured image under when the image sensor is placed horizontally.
- the captured image contains three exposed regions corresponding to three light sources.
- the current position of the mobile device can be calculated by the position of the corresponding three light sources.
- the ratio Q Y between the actual distance and the distance of the pixel points on the image may be obtained by the actual distance D/D AB on Y direction.
- This distance may be pre-stored in the database.
- the ratio Q X between the actual distance and the distance of the pixel points on the image may be obtained by the actual distance D/D AC on X direction.
- the actual coordinates of the midpoint (X mid ,Y mid ) may be determined by the midpoint (X mid ,Y mid ) and anyone of A, B C.
- FIG. 20 a shows that the image sensor for capturing image is tilted from the horizontal plane.
- the image sensor is inclined, the surface of the image sensor is not perpendicular to the direction of the incident light, causing the midpoint of the captured image is different from the midpoint of the image captured when the image sensor is placed horizontally.
- An angular transducer or other devices capable of detecting angle integrated in the mobile device may be used, in order to compensate the decoding error caused by the tilting angle.
- the different distance between each light source and the image sensor may also be reflected by the intensity of the visible light signal emitted by the light source and received by the image sensor.
- the position of the mobile device may be calculated through the intensity of the visible light signal emitted by the light source and received by the image sensor.
- FIG. 20 b shows the image captured by the image sensor when the image sensor is tilted from the horizontal plane, that is, the surface of the image sensor is not perpendicular to the direction of the incident light. In this case, the position of the mobile device needed to be calibrated by calculating the tilting angle of the mobile device.
- FIG. 21 shows the diagram on how to calculate the midpoint of the image.
- FIG. 22 a shows the schematic diagram of a gyroscope.
- the gyroscope can be applied for measuring the angular relationship between X, Y, Z axis and the angle between the surface of the image sensor and the incident light.
- the rotation angle of the mobile device may be obtained by calculating the angular velocity along X, Y, Z axis, respectively.
- FIG. 22 b is a schematic diagram of the coordinate system an accelerometer of the mobile device. A mobile device is placed facing up, X, Y axis is in the horizontal plane and the Z axis is along the gravity direction and perpendicular to the horizontal plane.
- FIG. 23 shows the schematic diagram on how to calculate the midpoint of the captured image.
- the actual position of the mobile device may be calculated.
- the distance from the midpoint to the actual location point where the mobile device is capturing the image is d.
- the position information of the light source may be obtained from the predetermined may database. According to the image information and the position information of light sources A and B, the midpoint of the image is (X mid ,Y mid ).
- This distance may be pre-stored in the database.
- the ratio Q Y between the actual distance and the distance of the pixel points on the image may be obtained by the actual distance D/D AB on Y direction.
- This distance may be pre-stored in the database.
- the ratio Q X between the actual distance and the distance of the pixel points on the image may be obtained by the actual distance D/D AC on X direction.
- the actual coordinates of the midpoint (X mid ,Y mid ) may be determined by the midpoint (X mid ,Y mid ) and anyone of A, B C.
- Y Y B(actual coordinate) +(Y mid ⁇ Y B )*Q Y
- the actual coordinate of the midpoint is (X+d*cos ⁇ ,Y+d*sin ⁇ ).
- FIG. 24 is the schematic diagram of the format of the data stored in the databases.
- the mobile device receives the visible light signal sent by the light source; the identification information is recovered by the software integrated in the mobile device, the identification information is sent to the database through network; by comparing the identification information with the database, the position of the mobile device is determined; the identification information is transmitted to the mobile device by the database computer through wireless schemes, such as, GPRS, GSM, CDMA, WIFI, Zigbee and Bluetooth, etc.
- the position information of the mobile device is displayed in the map shown in the display of the mobile device.
- FIG. 25 is the schematic diagram of information related to the identification information of the light source.
- the identification information of the light source may correspond to the following information: the coordinates of the position in the map database; other related information, such as advertisements information, service information, reminder information, etc.
- Magnetometer and gyroscope could be used to measure the direction of motion.
- the positioning can be realized only by visible light signal, or by combining with other positioning methods, such as, GPS, GPRS, GSM, CDMA, Wi-Fi, Zigbee, Bluetooth, RFID, accelerometer, angular transducer, gyroscope, ultrasonic, etc. Between two light sources, more methods as mentioned above may be applied, to improve the consistency and continuity of the positioning. For example, accelerometer is applied to measure the frequency of human steps; then the walking speed can be estimated by a normal length of ty of the positiangular transducer is applied to measure the walking direction. In this way, when moving between two light sources, the position of the mobile device still can be roughly positioned.
- FIG. 26 is the schematic diagram of recording a route.
- a magnetic sensor is applied to determine the initial direction
- the gyroscope is applied to measure the walking direction
- a gravity sensor is applied to determine human steps when he is walking. According to the speed of walking and a normal length of “one step”, the walking direction and speed may be roughly determined and can be indicated on the map.
- FIG. 27 is the schematic diagram of the captured image of two light sources.
- the position may be determined by capturing the image of the light signals emitted by the light sources.
- the two light sources may be placed such that the distance between them is e less than 0.5 m, which allows the two light sources can be captured within one image.
- FIG. 28 is the schematic diagram of the captured image of two light sources which is calibrated.
- the two light sources are installed in a south-north orientation.
- the last bit in the identification information indicates the orientation.
- “For example, orientation.led in The mobile device captures the image of the two light source, receives the identification information of these two light sources, calibrated with gyroscope multiple times, to insure the accuracy of the orientation obtained.
- a map database may be used for positioning.
- the mobile device receives the light signal sent by the light source; the position of the mobile device is determined by comparing the identification codes with the database; the current position of the mobile device is shown on the display of the mobile device.
- This positioning system can be applied for the navigation in a shopping mall or super market, and can be used for business statistics, market expansion, online support, SNS (Social Networking Services), Management profiles, or other position-related applications.
- the light source 400 may further comprises an AC/DC converter, a micro-controller and a memory, as shown in FIG. 29 .
- the AC/DC converter is configured to convert the AC power of the light source 400 obtained from electric power supply to DC power.
- the micro-controller is configured to compile the pre-stored identification information in the memory to modulation signal based on pre-defined coding method.
- the modulator is configured to receive the modulation signal and modulate, on the basis of the identification information to be transmitted, a driving signal of the light source to obtain a modulated driving signal for driving the light source to emit visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points.
- the exposure time of the image sensor 510 may be adjusted before capturing an image.
- FIG. 30 a is a flowchart of a process that the exposure time of the image sensor 510 is adjusted before capturing an image according to an embodiment of the present invention.
- An image sensor is turned on and the exposure time is adjusted.
- the frame rate is 30 Hz and the resolution of each frame is 640*480. Since the light source is close to the image sensor, the light intensity is high.
- the exposure time of the image sensor may be set at a small value, such as 1/14400 s. When the exposure time of the image senor is less than 1/14400 s, such exposure time is fixed by software. Then, the image senor is ready to capture an image.
- the exposure time of the image sensor when the exposure time of the image sensor is short enough, images with bright or dark strips can be captured clearly for transmitting identification information. By this way, the communication between the light source and the image sensor is achieved.
- the sampling duration rate of the image sensor may be smaller or equal to the duration of the peak level or bottom level of the visible light signal emitted by the light source, as shown in FIG. 30 b .
- the duration of the bottom level is smaller compared to that of the peak level.
- the sampling duration of the image sensor is smaller or equal to the duration of the bottom level.
- the frequency of the visible light signal is fixed, the smaller the sampling duration, the clearer the bright or dark stripes obtained. For instance, as shown in FIG.
- FIG. 30 c within the duration of the bottom level of the visible light signal, a dark stripe having of 3 rows is obtained; and within the duration of the peak level of the visible light signal, a bright stripe having 13 rows is obtained.
- an image as shown in FIG. 30 d may be obtained, which contains bright or dark stripes as shown in FIG. 30 c.
- the exposed region in the image is detected as shown in FIGS. 31 a and 31 b .
- the exposed region may be detected by software in following way: searching the exposed regions from the center of the image outwards along a spiral route; detecting the exposed region; and adjusting the exposure parameters of the image sensor according to the brightness of the exposed region.
- each image captured may contain one or more exposed regions corresponding to one or more light sources.
- the one or more exposed regions in the image may be detected as shown in FIGS. 32 a - 32 c .
- FIG. 32 a shows an image captured by an image sensor from one or more light sources.
- the one or more exposed regions on each image may be detected as shown in FIG. 32 b in following way: searching the exposed regions from the center of the image outwards along a spiral route; dividing the image into one more regions corresponding to the one or more light sources; detecting each exposed region corresponding to each light source as shown in FIG. 32 c ; determining the number of the stripes; and obtaining the identification information transmitted.
- the exposure time of the image sensor 510 may be adjusted before capturing an image.
- FIG. 33 is a flowchart of a process that the exposure time of the image sensor 510 is adjusted before capturing an image according to an embodiment of the present invention.
- the exposure time of the image sensor may be adjusted to a suitable value, based on the brightness in the center of the light source.
- the exposure time of the image senor is less than the suitable value, such exposure time is fixed by software. Then, the image senor is ready to capture an image.
- the frame rate is 30 Hz and the resolution of each frame is 640*480.
- the duration of the bottom level corresponding to dark stripes or the duration of the peak level corresponding to bright stripes should be larger than the exposure time 1/2000 s, and thus the width of the dark or bright stripes should be larger than 7 rows.
- the exposure time may be set as an interface according to underlying software agreement and this interface can be directly applied to the application software. When an image sensor is turned on, the exposure time is set directly by the application layer interface.
- the captured image containing bright and dark stripes may be decoded, optionally by decoding software, in the following manner: capturing one or more images from the visible light signal emitted by a light source; determining one or more exposed regions in each image; measuring the number of the bright or dark strips where different number represents different code; and recovering the transmitted identification information.
- FIG. 34 a is a schematic diagram of the image captured by the image sensor, according to embodiments of the present invention.
- the exposed region within the image is searched from the center of the image outwards along a spiral route, optionally, by pre-installed software, as shown in FIG. 34 b , according to embodiments of the present invention.
- the exposed region may be determined by searching pixels with gray scale values higher than a threshold value. For instance, for an image to be analyzed with a resolution of 640*480, a threshold value is set to the average value of the gray scale of all pixels; the exposed region is searched from the center of the image outwards along a spiral route; when there are a plurality of pixels with gray scale values higher than the threshold in a region, this region is determined as a exposed region.
- the determined exposed region may be a rectangular region in the image according to embodiments of the present invention, as shown in FIG. 34 c , with the coordinates of the four corners of the rectangle (x min , y min ), (x max , y min ), (x min , y max ) and (x max , y max ).
- x min and x max are the minimum and maximum coordinates on the x-axis of the pixels with gray scale values higher than the threshold, respectively
- y min and y max are the minimum and maximum coordinates on the y-axis of the pixels with gray scale values higher than the threshold, respectively.
- the coordinates may be obtained by scanning, comparing and screening each pixel in the image, as shown in FIG. 34 d .
- the determined exposed region may be further optimized to eliminate the interference from the non-exposed region though the center (x mid , y mid ), that is, the coordinates of the four corners of the exposed region is determined as (x mid ⁇ 5,y min ), (x mid +5,y min ), (x mid ⁇ 5,y max ) and (x mid +5,y max ) as shown in FIG. 34 e.
- the number of the bright or dark strips within the optimized exposed region may be measured by measuring the gray scale value within the optimized exposed region according to embodiments of the present invention, as shown in FIG. 34 f .
- the RGB-based color image is converted to the gray-scale image and the gray scale value of each pixel in the image is measured.
- the minimum and maximum gray scale values are set to 0 and 255, respectively, corresponding to brightness levels from the darkest to the brightest.
- a gray scale threshold is set to the average of the maximum and minimum gray scale values, or the average of the gray scale values of all pixels within the exposed region.
- the measured gray scale value of each pixel is compared with the gray scale threshold; and if the measured gray scale value of a pixel is higher the gray scale threshold, the pixel is assigned a gray scale dualization value of “1”, otherwise the pixel is assigned a gray scale dualization value of “0”.
- the gray scale dualizaton values of the pixels in the same row are summed and compared with a dualization threshold.
- the dualization threshold is set to the average of the maximum and minimum of the sum of gray scale dualizaton values in a row, or is set to the average of the sum of gray scale dualizaton values in all rows within the exposed region. If the sum of gray scale dualizaton values of the pixels in the row is higher than the dualization threshold, the dualization value of the row is set to “1”, representing bright stripe; otherwise, the dualization value of the row is set to “0”, representing dark stripe.
- the number of the bright or dark strips may be measured according to embodiments of the present invention, as shown in FIG. 34 f .
- the dualization value “1” represents bright stripe and the dualization value “0” represents dark stripe.
- the dualization value of a row is “0” and the dualization value of the next row is “1”
- the dualization value of a row is “1” and the dualization value of the next row is “0”
- the dualization value of a row is “1” and the dualization value of the next row is still “1”
- the dualization value of a row is “0” and the dualization value of the next row is still “0”
- the transmitted identification information may be decoded by measuring the number of the dark stripes, by measuring the number of the bright stripes, or by collectively measuring the number of the bright or dark stripes, where different number represents different code.
- the number of the dark stripes is 5
- the number of the bright stripes is 6
- the number of the bright or dark stripes is 11.
- the number of the bright or dark strips may be measured according to another embodiment of the present invention, as shown in FIG. 34 g .
- the first-order derivative of the sum of gray scale dualization values is calculated.
- the sign (positive or negative) of the first-order derivatives is further derivated. If the derivative of the sign is larger than 0, it means the transition from a bright stripe to a dark stripe or from a dark stripe to a bright stripe.
- the number of the bright or dark stripes may be obtained by calculating the number of the derivative of the sign larger than 0.
- the device 400 may contain multiple image sensors as shown in FIG. 35 .
- the strategy may be as follows: activating all image sensors; choosing the image sensor which receives the light signal first as an activated image sensor, and switching off other image sensors.
- the strategy may be manually choosing one image sensor as an activated image sensor.
- the strategy may be choosing one image sensor as an activated image sensor based on the identification information collected by other image sensors or processors to obtain the identification information corresponding to the varied numbers of bright or dark stripes of the one or more exposed regions in the image.
- a software program may be used to trigger the image sensor in the device for obtaining identification information from visible light signal to start receiving the visible light signal.
- the real-time image and the identification information obtained therefrom may be displayed in the program during the process of capturing image, as shown in FIG. 36A .
- only the identification information obtained from the image may be displayed in the program during the process of capturing image, as shown in FIG. 36B .
- a light source for transmitting identification information by visible light signal comprising a modulator and an emitter according to the present invention may be included in a transmitter as shown in FIG. 37 .
- the transmitter may further comprise a power supply, and a microprocessor, e.g., a micro controller unit (MCU).
- MCU micro controller unit
- the image sensor should be activated in advance.
- the image sensor may be activated by an activation signal sent by the transmitter, as shown in FIG. 18 .
- the activation may be realized by a software-based switch. When this switch is turned on, the image sensor starts receiving the visible light signal.
- the image sensor may be activated by other manners. For instance, when the software begins to operate, the image sensor is activated at the same time.
- the activation can also be achieved by other switches, sensors or network.
- the transmitter when the image sensor is activated to receive the visible light signal, the transmitter is informed to send the visible light signal.
- This can be realized by a hardware-based switch installed on the transmitter, as shown in FIG. 38 . When this switch is turned, the transmitter starts to send the visible light signal; when the switch is turned off, the transmitter stops sending the visible light signal.
- the transmitter may be informed by other manners, such as, buttons, physical contact, sensors, and network.
- a photosensitive device may be integrated in the transmitter to detect the state of the image sensor, such as whether the image sensor is ready to capture images.
- the photosensitive device may first check the state of the image sensor.
- the light emitting component of the image sensor changes the brightness at a certain frequency, and such changes of the brightness can be detected by the photosensitive device integrated in the transmitter; and then the transmitter starts to send the visible light signal, as shown in FIG. 39 .
- the state of the image sensor may be detected by other sensors, such as, sound sensor, gravity sensor, acceleration meter, etc.
- the state of the image sensor may be detected by other manners, such as, network adaptors, for example GPRS, GSM, CDMA, WiFi, Zigbee, Bluetooth, RFID, etc.
- the transmitter may transmit multiple types of identification information, comprising but not limited to, identifier (ID) of the transmitter, voice, text, audio, pictures, video, etc., which may be stored in the memory, as shown in FIG. 40 .
- ID identifier
- the transmitter may comprise a light source according to the present invention, a microprocessor (for example a MCU), and a battery, as shown in FIG. 41 .
- the microprocessor encodes the driving current/voltage of the light source
- a modulator in the light source may modulate the driving current/voltage of the light source on the basis of the identification information to be transmitted
- an emitter in the light source may emit the visible light signal on the basis of the modulated driving current/voltage.
- the light source may emit visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points.
- the battery may be used to provide energy for the light source and the microprocessor.
- the transmitter may further comprise a charging circuit applied for charging the battery or protecting the battery from being overcharged or overheated, etc.
- the transmitter may further comprise a sensor as shown in FIG. 42 .
- the sensor may be applied for measuring electrical parameters, such as temperature, humidity, voltage, and current, or biological parameters, such as human heart rate, body temperature, and blood pressure.
- the transmitter may further comprise a memory as shown in FIG. 43 .
- the memory is applied for storing identification information, such as pre-stored data, and identification information collected by sensors.
- the transmitter may further comprise a display as shown in FIG. 43 .
- the display is applied for showing the transmitted identification information.
- the device for obtaining identification information may comprise an image sensor, a microprocessor (for example a MCU) and a power supply, as shown in FIG. 44 .
- the image sensor is applied for capturing the visible light signals mitted by the light source.
- the processor is applied for measuring the varied numbers of bright or dark stripes contained in the captured image and obtaining identification information corresponding to the varied numbers of bright or dark stripes.
- the power supply is used to provide energy for the processor.
- the device for obtaining identification information from visible light signal having its level changed between a peak level and a bottom level with varied frequencies may further comprise a communication module, as shown in FIG. 44 .
- the communication module may be wired or wireless, and may be applied for data transmission between the device and other electronic devices, or connecting the device to Internet.
- the transmitter could be a lamp.
- the transmitter may be an embedded system integrated in other devices, such as an integrated part of a ring, as shown in FIG. 45 .
- the basic working principle of the system for transmitting and obtaining identification information by visible light signal comprising a light source for transmitting identification information by visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points and a device for obtaining identification information from visible light signal from light source according to embodiments of the present invention is as follows: the image sensor in the device captures the visible light signal emitted by the light source and obtain one or more images therefrom, and the processor in the device measures the varied numbers of bright or dark stripes in each image and recovers the identification information corresponding to the varied numbers of bright or dark stripes.
- the transmitter may be integrated in a wearable electronic device, providing advantages of small in volume, easy to carry, and low in power consumption.
- the wearable electronic device may be a jewelry, such as a ring, an earrings, a necklace, a watches, etc., or maybe a key, a card, a pen, etc.
- the transmitter is integrated in the wearable electronic device, such wearable electronic device can emit visible light signals for transmitting identification information.
- the transmitter may be integrated in a wearable electronic device, such as a ring powered by a battery, as shown in FIG. 46 .
- a wearable electronic device such as a ring powered by a battery, as shown in FIG. 46 .
- the battery is used to provide energy for the transmitter.
- the light source included in the transmitter can emit visible light having its level changed between a peak level and a bottom level with varied frequencies at different time points and each light source may be modulated independently.
- the transmitter may comprise one or more light sources that can emit visible light signals having their level changed between peak levels and bottom levels with varied frequencies at different time points, as shown in FIG. 47 .
- One or more exposed regions in each image correspond to the one or more light sources.
- the transmitter may be integrated in a wearable electronic device.
- the transmitter may further comprise a driver, as shown in FIG. 48 .
- the transmitter may be integrated in a wearable electronic device.
- the driver is added to drive the light source.
- the driver can supply larger driving current or driving voltage to drive high-power light source. In this way, the transmission distance of transmitter can be increased.
- the transmitter may further comprise a battery charging circuit, as shown in FIG. 49 .
- the transmitter may be integrated in a wearable electronic device.
- the charging circuit is applied not only for charging the battery, but also for limiting the charging current/voltage or checking the temperature, etc., so as to protect the battery from being overcharged or overheated.
- the charging circuit can be powered by an external power source, such as power mains, solar panel, generator, or energy harvesting system, etc.
- the charging circuit can be a wireless charging system.
- the transmitter may further comprise a memory as shown in FIG. 50 .
- the transmitter may be integrated in a wearable electronic device.
- the memory is applied for storing identification information, such as pre-stored data, and the identification information collected by the image sensor.
- the transmitter may further comprise a sensor as shown in FIG. 51 .
- the transmitter may be integrated in a wearable electronic device.
- the sensor may be applied for measuring parameters, such as temperature, humidity, voltage and current, or biological parameters, such as human heart rate, body temperature and blood pressure.
- Such sensor could be a temperature sensor, humidity sensor, optical sensor, sound sensor, accelerometer, pressure sensor, etc.
- the transmitter may also comprise a voltage/current sensing circuit, which is applied for detecting the state of the battery. If a low battery is detected, the transmitter may inform the user by signal of light, sound, vibration, etc.
- the transmitter may further comprise a network adaptor as shown in FIG. 52 .
- the transmitter may be integrated in a wearable electronic device.
- the network adapter is applied for data exchange between the device for obtaining identification information from visible light signal and other electronic devices with network capability, e.g., a computer; or sending commands to control other devices.
- the network adapter may use following communication technologies: GPRS, GSM, CDMA, WiFi, Zigbee, Bluetooth, RFID, etc.
- the transmitter may first check the state of the image sensor in the device for obtaining identification information from visible light signal.
- the screen of the light emitting component changes the brightness at a certain frequency, and such changes of the brightness can be detected by the photosensitive device (e.g., a sensor) integrated in the transmitter; and then the transmitter starts to send the visible light signal, as shown in FIG. 53 .
- the photosensitive device e.g., a sensor
- the transmitter starts to send the visible light signal, as shown in FIG. 53 .
- the device for obtaining identification information from is a smartphone
- a LED flashlight embedded in the smartphone may be used to send signals to the transmitter.
- the state of the device for obtaining identification information from visible light signals may be detected by other sensors, such as, sound sensor, gravity sensor, acceleration meter, etc.
- the state of the device for obtaining identification information from visible light signals may be detected by other manners, such as, network adaptors, for example GPRS, GSM, CDMA, WiFi, Zigbee, Bluetooth, RFID, etc.
- the device for obtaining identification information from visible light signal may be a laptop computer or other electronic devices which have photosensitive component(s).
- the transmitter is integrated in a wearable electronic device.
- the wearable electronic device starts to send the visible light signals, its transmitter should be turned on. This can be realized by a hardware-based switch installed on the transmitter, or other sensor-based switch connected to the transmitter.
- the wearable electronic device receives the switch-on signal, it starts to send light signal. The above described process is illustrated in FIG. 54 .
- the working flow of the image sensor in the device for obtaining identification information from visible light signal is as follows, as shown in FIG. 55 : starting the receiving program, initializing the image sensor, setting the exposure parameters, sending request for receiving the visible light signal and waiting for the visible light signal; after receiving the visible light signal, checking the start code, analyzing the captured images, measuring the varied numbers of bright or dark stripes in the images, and recovering the identification information.
- the device for obtaining identification information from visible light signals comprising an image sensor may be a mobile device containing photosensitive components.
- the mobile device could be a smartphone.
- the light source e.g., in a transmitter
- the emitted visible light signal contains the unique ID of the corresponding light source
- an image sensor in the smartphone captures images of the light sources, measures the varied number of bright or dark stripes in these images, decodes the ID identification information, and compares the decoded ID with the data stored in a map database. In this way, the accurate position of the image sensor can be determined from the position of the light source.
- the embodiments of the present invention provide an efficient and effective approach for transmitting/obtaining identification information and positioning by visible light signal, which can achieve indoor positioning, transmit/obtain identification information much faster and more accurate, and the identification information transmitted/obtained may contain more data bits. Further, the embodiments of the present invention effectively avoid the undesirable blinking of the light source detectable by human eyes.
Landscapes
- Engineering & Computer Science (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Physics & Mathematics (AREA)
- Computer Networks & Wireless Communication (AREA)
- General Physics & Mathematics (AREA)
- Electromagnetism (AREA)
- Signal Processing (AREA)
- Automation & Control Theory (AREA)
- Optical Communication System (AREA)
- Circuit Arrangement For Electric Light Sources In General (AREA)
- Navigation (AREA)
- Length Measuring Devices By Optical Means (AREA)
- Studio Devices (AREA)
Abstract
Description
- The present invention generally relates to the field of visible light communication, and particularly relates to methods and devices for transmitting/obtaining identification information and positioning by visible light signal.
- Currently, global positioning system (GPS) is the most widely used positioning system. However, GPS is difficult to achieve a good positioning accuracy in an indoor environment and practically cannot be used for indoor positioning applications, since the signal of GPS is blocked by the roof and walls of buildings and thus is very weak or disappeared in the indoor environment.
- Visible light communication is also developed to transmit identification information for positioning by using the variation of visible light (color, intensity, or position). Such communication technology for transmitting identification information is based on high-frequency blinking visible lights. In details, the identification information to be transmitted is firstly compiled into a digital signal; this digital signal is then applied to modulate the duration time or frequencies of the driving current or driving voltage of the light source, so that the light source blinks in high frequencies.
- This high-frequency blinking signal can be detected by a photosensitive device, for example, an image sensor. The image sensor may be based on the “rolling shutter” mechanism, which means that different parts of the sensor, each row or each column, are exposed at different time. Based on this feature, when taking pictures of a light source with rapidly changing brightness, the image sensor with a rolling shutter can deliver an image which contains bright or dark stripes. By measuring the width of the stripes, the frequencies of the driving current or driving voltage of the light source may be calculated and the transmitted identification information may thus be restored.
- However, this method has following drawbacks: the width of the stripes can be affected by local over-exposure of the image sensor, for instance, the bright stripes may become broader and the dark stripes may become narrower or even disappear within the over-exposed area, causing failure of the image analysis and decoding and different background lighting conditions may induce uncertainties for measuring the width of stripes.
- Additionally, the photosensitive devices used in such visible light communication technology require to be specially designed to detect the visible light signal, and thus, only can be applied in limited scenarios. Additionally, although the commercially available mobile devices (such as, smartphones, tablets, PDAs) have photosensitive components, for example, the image sensor, they are not suitable for sensing such high-frequency blinking signal.
- Objects of the present invention are to provide technical solutions for transmitting identification information, obtaining identification information, or positioning by visible light signals, which obviate at least one of the above-mentioned disadvantages.
- According to a first aspect of the present invention, there is provided a method transmitting identification information of a light source by visible light signal, the method comprising: modulating, on the basis of the identification information to be transmitted, a driving signal of the light source to obtain a modulated driving signal for driving the light source to emit visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points; and emitting the visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points on the basis of the modulated driving signal, so as to transmit identification information corresponding to the varied numbers of bright or dark stripes shown in one or more images obtained from the visible light signal at one or more time points, which numbers are corresponding to the varied frequencies.
- According to some embodiments of the present invention, modulating on the basis of the identification information to be transmitted a driving signal of the light source to obtain a modulated driving signal comprises: modulating on the basis of the identification information to be transmitted a driving voltage or a driving current of the light source to obtain a first modulated driving voltage or a first modulated driving current.
- According to some embodiments of the present invention, the first modulated driving current is greater than an un-modulated driving current, so that luminous flux of the light source driven by the first modulated driving current is equal to luminous flux of the light source driven by the un-modulated driving current.
- According to some embodiments of the present invention, the method further comprising: emitting the visible light signal on the basis of a second modulated driving current which is greater than an un-modulated driving current together with a high frequency carrier wave signal, so that luminous flux of the light source driven by the second modulated driving current is constant among periods comprising peak levels and bottom levels.
- According to some embodiments of the present invention, the first modulated driving voltage or the first modulated driving current is used for driving the light source to emit a visible light signal with a frequency from 100 Hz to 1.37 MHz, and duration of each bottom level of the visible light signal is fixed, or duration of each peak level of the light pulse signal is fixed.
- According to some embodiments of the present invention, the method further comprising: detecting the presence of a human being within a illumination scope of the light source; and emitting a visible light signal on the basis of un-modulated driving signal in the absence of a human being.
- According to some embodiments of the present invention, the identification information corresponding to the varied numbers of bright or dark stripes comprises data bits, which comprise data corresponding to the varied frequencies, and each data bit corresponds to a number among the varied numbers of bright or dark stripes.
- According to some embodiments of the present invention, the identification information corresponding to the varied numbers of bright or dark stripes further comprises one or more start bits and/or one or more error correction bits, the one or more start bits being used to identify a start position of a set of data bits, and the one or more error correction bits being used to check error in the data bits.
- According to a second aspect of the present invention, there is provided a method for obtaining identification information of a light source from visible light signals, the method comprising: obtaining one or more images at one or more time points from a visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points emitted by a light source; measuring the varied numbers of bright or dark stripes in the one or more images, the varied numbers of bright or dark stripes being corresponding to the varied frequencies; and obtaining identification information corresponding to the varied numbers of the bright or dark stripes.
- According to a third aspect of the present invention, there is provided a method for positioning by visible light signals, the method comprising: obtaining at a position one or more images at one or more time points from a visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points emitted by a light source; measuring varied numbers of bright or dark stripes in the one or more images, the varied numbers of bright or dark stripes being corresponding to the varied frequencies; obtaining identification information of the light source corresponding to the varied number of the bright or dark stripes; and determining the position by checking the identification information in a predetermined map database.
- According to some embodiments of the present invention, the method further comprising: before determining the position by checking the identification information in a predetermined map database, determining an area of the position by means of one or more wireless positioning schemes; and determining the position by checking the identification information in a predetermined map database comprises: determining the position by checking the identification information with data of the area in the predetermined map database.
- According to some embodiments of the present invention, the wireless positioning scheme comprises positioning by means of GPS, GPRS, GSM, CDMA, WIFI, Zigbee, Bluetooth, and RFID.
- According to some embodiments of the present invention, identification information of a light source is unique for an area at which the light source is located.
- According to some embodiments of the present invention, obtaining at a position one or more images at one or more time points from a visible light signal comprises: obtaining at the position the one or more images at one or more time points by an image capturing device comprising an image sensor whose exposure mode is rolling shutter mode, and a sampling rate of the rolling shutter is higher than the frame rate of the image sensor.
- According to some embodiments of the present invention, obtaining at a position one or more images at one or more time points from a visible light signal comprises capturing at the position on an image sensor with a rolling shutter the one or more images in which different portions of the image sensor are exposed at different time points.
- According to some embodiments of the present invention, the visible light signal is emitted by the light source on the basis of a modulated driving signal, which drives the light source to emit the visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points.
- According to some embodiments of the present invention, the light source is one or more light sources, and obtaining one or more images at one or more time points from visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points emitted by a light source comprises: obtaining one or more images at one or more time points from visible light signal having their level changed between peak levels and bottom levels with varied frequencies at different time points emitted by the one or more light sources, wherein one or more exposed regions in each image correspond to the one or more light sources, measuring the varied numbers of bright or dark stripes in the one or more images comprises: measuring the varied numbers of the bright or dark stripes of the one or more exposed regions in each image, and obtaining identification information corresponding to the varied numbers of the bright or dark stripes comprises: obtaining identification information corresponding to the varied numbers of the bright or dark stripes of the one or more exposed regions in each image.
- According to some embodiments of the present invention, the identification information corresponding to the varied numbers of bright or dark stripes comprises data bits which comprise data corresponding to the varied frequencies, and each data bit corresponds to a number among the varied numbers of bright or dark stripes.
- According to some embodiments of the present invention, the identification information corresponding to the varied numbers of bright or dark stripes further comprises one or more start bits and/or one or more error correction bits, the one or more start bits being used to identify a start position of a set of data bits, and the one or more error correction bits being used to check error in the data bits.
- According to a fourth aspect of the present invention, there is provided light source for transmitting identification information by visible light signal, comprising: a modulator configured to modulate, on the basis of the identification information to be transmitted, a driving signal of the light source to obtain a modulated driving signal for driving the light source to emit visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points; and an emitter configured to emit the visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points on the basis of the modulated driving signal, so as to transmit identification information corresponding to the varied numbers of bright or dark stripes shown in one or more images obtained from the visible light signal at one or more time points, which numbers are corresponding to the varied frequencies.
- According to some embodiments of the present invention, the modulator is configured to modulate on the basis of the identification information to be transmitted a driving voltage or a driving current of the light source to obtain a first modulated driving voltage or a first modulated driving current.
- According to some embodiments of the present invention, the first modulated driving current is greater than an un-modulated driving current, so that luminous flux of the light source driven by the first modulated driving current is equal to luminous flux of the light source driven by the un-modulated driving current.
- According to some embodiments of the present invention, the emitter is configured to emit the visible light signal on the basis of a second modulated driving current which is greater than an un-modulated driving current together with a high frequency carrier wave signal, so that luminous flux of the light source driven by the second modulated driving current is constant among periods comprising peak levels and bottom levels.
- According to some embodiments of the present invention, the first modulated driving voltage or the first modulated driving current is used for driving the light source to emit a visible light signal with a frequency from 100 Hz to 1.37 MHz, and duration of each bottom level of the visible light signal is fixed, or duration of each peak level of the light pulse signal is fixed.
- According to some embodiments of the present invention, the light source further comprising: a detector configured to detect the presence of a human being within an illumination scope of the light source; and the emitter is configured to emit a visible light signal on the basis of un-modulated driving signal in the absence of a human being.
- According to some embodiments of the present invention, the identification information corresponding to the varied numbers of bright or dark stripes comprises data bits, which comprise data corresponding to the varied frequencies, and each data bit corresponds to a number among the varied numbers of bright or dark stripes.
- According to some embodiments of the present invention, the identification information corresponding to the varied numbers of bright or dark stripes further comprises one or more start bits and/or one or more error correction bits, the one or more start bits being used to identify a start position of a set of data bits, and the one or more error correction bits being used to check error in the data bits.
- According to a fifth aspect of the present invention, there is provided a device for obtaining identification information of a light source from visible light signal, comprising: an image sensor configured to obtain one or more images at one or more time points from a visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points emitted by a light source; a memory configured to store the one or more images obtained by the image sensor at one or more time points; and a processor configured to measure varied numbers of bright or dark stripes in the one or more images stored in the memory and obtain identification information corresponding to the varied numbers of the bright or dark stripes, the varied numbers of bright or dark stripes being corresponding to the varied frequencies.
- According to a sixth aspect of the present invention, there is provided a device for positioning by visible light signal, comprising: an image sensor configured to obtain at a position one or more images at one or more time points from a visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points emitted by a light source; a memory configured to store the one or more images obtained by the image sensor at one or more time points; and a processor configured to measure varied numbers of bright or dark stripes in the one or more images stored in the memory, obtain identification information of the light source corresponding to the varied number of the bright and dark stripes, and determine the position by checking the identification information in a predetermined map database, the varied numbers of bright or dark stripes being corresponding to the varied frequencies.
- According to some embodiments of the present invention, the processor is configured to before determining the position by checking the identification information in a predetermined map database, determine an area of the position by means of one or more wireless positioning schemes; and the processor is configured to determine the position by checking the identification information with data of the area in the predetermined map database.
- According to some embodiments of the present invention, the wireless positioning scheme comprises positioning by means of GPS, GPRS, GSM, CDMA, WIFI, Zigbee, Bluetooth, and RFID.
- According to some embodiments of the present invention, identification information of a light source is unique for an area at which the light source is located.
- According to some embodiments of the present invention, exposure mode of the image sensor is rolling shutter mode, and a sampling rate of the rolling shutter is higher than the frame rate of the image sensor.
- According to some embodiments of the present invention, the image sensor is an image sensor with a rolling shutter and is configured to obtain the one or more images in which different portions of the image sensor are exposed at different time points.
- According to some embodiments of the present invention, the visible light signal is emitted by the light source on the basis of a modulated driving signal, which drives the light source to emit the visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points.
- According to some embodiments of the present invention, the light source is one or more light sources, and the image sensor is configured to obtain one or more images at one or more time points from visible light signal having their level changed between peak levels and bottom levels with varied frequencies at different time points emitted by the one or more light sources, wherein one or more exposed regions in each image correspond to the one or more light sources, the memory is configured to store the one or more images obtained by the image sensor at one or more time points; and the processor is configured to measure the varied numbers of the bright or dark stripes of the one or more exposed regions in each image, obtain identification information corresponding to the varied numbers of the bright or dark stripes of the one or more exposed regions in each image.
- According to some embodiments of the present invention, the identification information corresponding to the varied numbers of bright or dark stripes comprises data bits which comprise data corresponding to the varied frequencies, and each data bit corresponds to a number among the varied numbers of bright or dark stripes.
- According to some embodiments of the present invention, the identification information corresponding to the varied numbers of bright or dark stripes further comprises one or more start bits and/or one or more error correction bits, the one or more start bits being used to identify a start position of a set of data bits, and the one or more error correction bits being used to check error in the data bits.
- In conclusion, the embodiments of the present invention provide an efficient and effective approach for positioning, transmitting and obtaining information, which can achieve indoor positioning, transmit and obtain information much faster and more accurate, and the information transmitted and obtained may contain more data bits. The present invention has advantages of high confidentiality, no occupancy of wireless channel resources, low cost, and easy integration with various light sources. Further, the present invention effectively avoids the undesirable blinking of the light source detectable by human eyes.
- The accompanying drawings are included to provide a further understanding of embodiments and constitute a part of this description. The drawings illustrate embodiments and together with the description serve to explain principles of embodiments. The elements of the drawings are not necessarily to scale relative to each other. Similar reference numerals designate corresponding similar parts. It should be expressly understood that the drawings are included for illustrative purposes and do not in any manner limit the scope of the present invention.
-
FIG. 1 is a flow chart illustrating amethod 100 for transmitting information by visible light signal from a light source according to an embodiment of the present invention; -
FIGS. 2 a-2 c are the schematic diagrams of the driving signals for driving the light source according to embodiments of the present invention; -
FIGS. 3 a, 3 c and 3 e are the schematic diagrams of the driving signals for driving the light source according to embodiments of the present invention; -
FIGS. 3 b, 3 d and 3 f are the images obtained from the driving signals ofFIGS. 3 a, 3 c and 3 e respectively according to embodiments of the present invention; -
FIG. 3 g shows visible light signal with varied frequencies at different time points emitted by a light source driven by a first modulated driving current according to another embodiment of the present invention; -
FIG. 4 a is the schematic diagram of a modulated driving current of a light source equal to the un-modulated driving current according to an embodiment of the present invention. -
FIG. 4 b is the schematic diagram of a modulated driving current greater than the un-modulated driving current according to an embodiment of the present invention. -
FIG. 4 c is the schematic diagram of a modulated driving current greater than the un-modulated driving current without high frequency carrier wave signal according to an embodiment of the present invention; -
FIG. 4 d is the schematic diagram of a modulated driving current greater than the un-modulated driving current together with a high frequency carrier wave signal according to an embodiment of the present invention; -
FIG. 5 a is the schematic diagram of the information corresponding to the varied numbers of bright or dark stripes comprising a start bit according to an embodiment of the present invention; -
FIG. 5 b is the schematic diagram of the information corresponding to the varied numbers of bright or dark stripes comprising a start bit and an error correction bit according to an embodiment of the present invention; -
FIG. 6 shows a light source emitting visible light signal for transmitting information in response to the presence of a human being according to an embodiment of the present invention; -
FIG. 7 is a flow chart illustrating a method for obtaining information from visible light signal according to an embodiment of the present invention; -
FIG. 8 is a flow chart illustrating a method for positioning by visible light signals according to an embodiment of the present invention; -
FIG. 9 is a schematic diagram of an image containing one or more exposed regions corresponding to one or more light sources according to an embodiment of the present invention; -
FIG. 10 is a schematic diagram of a light source and a device for transmitting information by visible light signal according to an embodiment of the present invention; -
FIG. 11 is a flowchart of a process that a mobile device accesses the indoor map; -
FIG. 12 is the schematic diagram of a mobile device integrated with a positioning software; -
FIG. 13 is the schematic diagram of the relation between the map database and the identification information of light sources; -
FIG. 14 is the schematic diagram of a light source with a mobile modification device comprising a receiver and a transmitter; -
FIG. 15 is the schematic diagram of a mobile modification device that can update the information stored in the light source; -
FIG. 16 is the schematic diagram of a mobile modification device updating the identification information of the light source; -
FIG. 17 is the flow chart of updating the identification information of a light source; -
FIG. 18 is the flow chart of searching the identification information of a light source; -
FIG. 19 a shows that the image sensor is placed horizontally for capturing image; -
FIG. 19 b shows the captured image under when the image sensor is placed horizontally; -
FIG. 20 a shows that the image sensor for capturing image is tilted from the horizontal plane; -
FIG. 20 b shows the image captured by the image sensor when the image sensor is tilted from the horizontal plane; -
FIG. 21 shows the diagram on how to calculate the midpoint of the image; -
FIG. 22 a shows the schematic diagram of a gyroscope; -
FIG. 22 b is a schematic diagram of the coordinate system an accelerometer of the mobile device; -
FIG. 23 shows the schematic diagram on how to calculate the midpoint of the captured image; -
FIG. 24 is the schematic diagram of the format of the data stored in the databases; -
FIG. 25 is the schematic diagram of information related to the identification information of the light source; -
FIG. 26 is the schematic diagram of recording a route; -
FIG. 27 is the schematic diagram of the captured image of two light sources; -
FIG. 28 is the schematic diagram of the captured image of two light sources which is calibrated; -
FIG. 29 is a schematic diagram of a light source comprising an AC/DC converter, a micro-controller and a memory according to an embodiment of the present invention; -
FIG. 30 a is a flowchart of a process that the exposure time of the image sensor is adjusted before capturing an image according to an embodiment of the present invention; -
FIGS. 30 b and 30 c are schematic diagrams of the sampling duration rate of the image sensor and the duration of the peak level or bottom level of the visible light signal emitted by the light source according to an embodiment of the present invention; -
FIG. 30 d is a schematic diagram of an image obtained from the visible light signal having the duration of the peak level of as shown inFIG. 30 c according to an embodiment of the present invention; -
FIGS. 31 a and 31 b are schematic diagrams of the exposed region in the image detected according to an embodiment of the present invention; -
FIGS. 32 a-32 c are schematic diagrams of strategy for detecting the exposed region in the image according to an embodiment of the present invention; -
FIG. 33 is a flowchart of a process that the exposure time of the image sensor is adjusted before capturing an image according to an embodiment of the present invention; -
FIG. 34 a is a schematic diagram of the image captured by the image sensor according to embodiments of the present invention; -
FIG. 34 b is a schematic diagram of the exposed region within the image being searched from the center of the image outwards along a spiral route according to embodiments of the present invention; -
FIG. 34 c is a schematic diagram of the determined rectangular exposed region in the image according to an embodiment of the present invention; -
FIG. 34 d is a schematic diagram of determining the coordinates of the rectangular exposed region in the image according to an embodiment of the present invention; -
FIG. 34 e is a schematic diagram of optimized exposed region in the image according to an embodiment of the present invention; -
FIG. 34 f is a schematic diagram of measuring the number of the bright or dark strips according to an embodiment of the present invention; -
FIG. 34 g is a schematic diagram of measuring the number of the bright or dark strips according to another embodiment of the present invention; -
FIG. 35 is a schematic diagram of a device containing multiple image sensors according to an embodiment of the present invention; -
FIG. 36A is a schematic diagram of an interface with the real-time image and the information obtained therefrom displayed in full screen according to an embodiment of the present invention; -
FIG. 36B is a schematic diagram of an interface with the information obtained from the image displayed according to an embodiment of the present invention; -
FIG. 37 is a schematic diagram showing an embodiment of the present invention with a device for obtaining information from visible light signals comprising an image sensor activated by an activation signal sent by the transmitter; -
FIG. 38 is a schematic diagram showing an embodiment of the present invention with a hardware-based switch installed on the transmitter for activating the image sensor in the device for obtaining information from visible light signals; -
FIG. 39 is a schematic diagram showing an embodiment of the present invention with a sensor integrated in the emitter; -
FIG. 40 is a schematic diagram showing an embodiment of the present invention with a transmitter for transmitting multiple types of information; -
FIG. 41 is a schematic diagram showing an embodiment of the present invention with a transmitter comprising a light source, a processor, a battery, and a charging circuit; -
FIG. 42 is a schematic diagram showing an embodiment of the present invention with a transmitter comprising a light source, a processor, a battery, a charging circuit, and a sensor; -
FIG. 43 is a schematic diagram showing an embodiment of the present invention with a transmitter comprising a light source, a processor, a battery, a charging circuit, a sensor, and a memory; -
FIG. 44 is a schematic diagram of the device for obtaining information according to an embodiment of the present invention; -
FIG. 45 is a schematic diagram showing an embodiment of the present invention with an image sensor integrated in a ring; -
FIG. 46 is a schematic diagram showing an embodiment of the present invention with a transmitter integrated in a wearable electronic device powered by a power supply; -
FIG. 47 is a schematic diagram of a transmitter comprising two or more light sources and a microprocessor according to an embodiment of the present invention; -
FIG. 48 is a schematic diagram of a transmitter comprising two or more light sources, a microprocessor, and a driver according to an embodiment of the present invention; -
FIG. 49 is a schematic diagram of a transmitter comprising a microprocessor and a battery charging circuit according to an embodiment of the present invention; -
FIG. 50 is a schematic diagram of a transmitter comprising a microprocessor, a battery charging circuit, and a memory according to an embodiment of the present invention; -
FIG. 51 is a schematic diagram of a transmitter comprising a microprocessor, a battery charging circuit, a memory, and a sensor according to an embodiment of the present invention; -
FIG. 52 is a schematic diagram of a transmitter comprising a microprocessor, a battery charging circuit, a memory, a sensor, and a network adaptor according to an embodiment of the present invention; -
FIG. 53 is a schematic diagram illustrating communication between a transmitter and a device for obtaining information from visible light signals comprising an image sensor according to an embodiment of the present invention; -
FIG. 54 is a flowchart of a process that a transmitter sends visible light signals according to an embodiment of the present invention; -
FIG. 55 is a flowchart of a process that an image sensor receives the visible light signals according to an embodiment of the present invention; and -
FIG. 56 is a schematic diagram of a positioning system based on the visible light signals according to an embodiment of the present invention. - In the following description, for purposes of explanation rather than limitation, specific details, such as the particular architecture, structure, techniques, etc., are set forth for illustration. However, it will be apparent to those of ordinary skill in the art that other embodiments that depart from these specific details would still be understood to be within the scope of the present invention. Moreover, for the purpose of clarity, detailed descriptions of well-known devices, circuits, and methods are omitted so as not to obscure the description of the present invention. It is to be understood that the features of the various exemplary embodiments described herein may be combined with each other, unless specifically noted otherwise.
- According to a first aspect of the present invention, there is provided a method for transmitting identification information of a light source by visible light signal.
FIG. 1 is a flow chart illustrating themethod 100 for transmitting identification information of a light source by visible light signal according to an embodiment of the present invention. - As shown in
FIG. 1 , themethod 100 begins with astep 110 of modulating, on the basis of the identification information to be transmitted, a driving signal of the light source to obtain a modulated driving signal for driving the light source to emit visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points. - According to some embodiments of the present invention, the light source may be any type of light source emitting visible light signal, for example, LED, fluorescent, or incandescent lamp.
- According to some embodiments of the present invention, the identification information transmitted by visible light signal may be any type of identification information, for example, the identifier (ID) of the light source, and other identification information.
- According to some embodiments of the present invention, the driving signal of the light source may be in the forms of square wave, sine wave, triangle wave, wave on a higher-frequency carrier, the aforesaid waves containing DC component, or in other forms of wave.
- According to some embodiments of the present invention, the driving signal of the light source may be modulated by the Pulse Width Modulation (PWM). Generally, the pulse duration is fixed, and the duty of the signal can be modulated, wherein the duty in a pulse cycle (such as square wave) is the ratio of the positive pulse duration (i.e., duration of the positive part) to the total duration.
- According to some embodiments of the present invention, the
step 110 may comprise: modulating on the basis of the identification information to be transmitted a driving voltage or a driving current of the light source to obtain a first modulated driving voltage or a first modulated driving current. And the first modulated driving voltage or the first modulated driving current may be used to drive the light source to emit the visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points. -
FIGS. 2 a-2 c are the schematic diagrams of the driving signals for driving the light source according to embodiments of the present invention. InFIG. 2 a, the driving signal, optionally the driving current, of a light source is in the form of sine wave with a frequency of f2a. InFIG. 2 b, the driving signal, optionally the driving current, of the light source is in the form of sine wave with a frequency of f2b, and f2a>f2b. - According to some embodiments of the present invention, the driving signal, optionally the driving current, of the light source may be modulated on the basis of the identification information to be transmitted to obtain a first modulated driving current, as shown in
FIG. 2 c, which has a frequency of f2b at time points within a time interval ΔT1, a frequency of f2a at time points within atime interval 2 ΔT2, a frequency of f2b at time points within atime interval 3 ΔT3, a frequency of f2a at time points within atime interval 4 ΔT4, and a frequency of f2b at time points within atime interval 5 ΔT5. The first modulated driving current may be used to drive the light source to emit the visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points, for example, with varied frequencies f2a and f2b at different time points within ΔT1, ΔT2, ΔT3, ΔT4 and ΔT5. Alternatively, the driving voltage of the light source may also be modulated on the basis of the identification information to be transmitted. Alternatively, the driving current or the driving voltage of the light source may have other wave forms. Alternatively, the driving current or the driving voltage of the light source may be modulated to emit visible light signal with three or more kinds of varied frequencies at different time points. - As shown in
FIG. 1 , after thestep 110 described hereinbefore, astep 120 of themethod 100 is performed, that is, emitting the visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points on the basis of the modulated driving signal, so as to transmit identification information corresponding to the varied numbers of bright or dark stripes shown in one or more images obtained from the visible light signal at one or more time points, which numbers are corresponding to the varied frequencies. - Optionally, the dark stripe corresponds to the bottom level of the visible light signal, and the bright stripe corresponds to the peak level of the visible light signal. The varied number of the bright stripes and dark stripes corresponds to different identification information transmitted.
-
FIGS. 3 a, 3 c and 3 e are the schematic diagrams of the driving signals for driving the light source, andFIGS. 3 b, 3 d and 3 f are the images obtained respectively according to embodiments of the present invention. - In
FIG. 3 a, the driving signal, optionally the driving current, of a light source is in the form of square wave with a frequency of f3a and the starting time for capturing an image is at the time point when one of the peal levels of the visible light signal is emitted. Optionally, from the driving signal shown inFIG. 3 a, an image with 10 dark stripes and 11 bright stripes as shown inFIG. 3 b may be obtained, where the number of the bright or dark stripes is corresponding to the frequency f3a. Alternatively, where the starting time for capturing an image is at the time point when one of the bottom levels of the visible light signal is emitted, an image having 11 dark stripes and 10 bright stripes may be obtained (not shown). - In
FIG. 3 c, the driving signal, optionally the driving current, of a light source is in the form of square wave with a frequency of f3c with f3a>f3c and the starting time for capturing an image is at the time point when one of the peal levels of the visible light signal is emitted. Optionally, from the driving signal shown inFIG. 3 c, an image with 5 dark stripes and 6 bright stripes as shown inFIG. 3 d may be obtained, where the number of the bright or dark stripes is corresponding to the frequency f3c. Alternatively, where the starting time for capturing an image is at the time point when one of the bottom levels of the visible light signal is emitted, an image having 6 dark stripes and 5 bright stripes may be obtained (not shown). - In
FIG. 3 e, the driving signal, optionally the driving current, of a light source is in the form of square wave with a frequency of f3e with f3c>f3e, and the starting time for capturing an image is at the time point when one of the peal levels of the visible light signal is emitted. Optionally, from the driving signal shown inFIG. 3 c, an image with 3 dark stripes and 4 bright stripes as shown inFIG. 3 f may be obtained, where the number of the bright or dark stripes is corresponding to the frequency f3e. Alternatively, where the starting time for capturing an image is at the time point when one of the bottom levels of the visible light signal is emitted, an image having 4 dark stripes and 3 bright stripes may be obtained (not shown). -
FIG. 3 g shows a visible light signal with varied frequencies at different time points emitted by a light source driven by a first modulated driving current. The first modulated driving current may be used to drive the light source to emit the visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points, for example, with varied frequencies f3a, f3c and f3e at different time points within time intervals ΔT1, ΔT2 and ΔT3. Optionally, within each time interval with a different frequency, a code is transmitted, for example, within ΔT1 a code “1” is transmitted, within ΔT2 a code “2” is transmitted, and within ΔT3 a code “3” is transmitted. - After emitting the visible light signal on the basis of the first modulated driving current, as shown in
FIG. 3 g, an image with 10 dark stripes and 11 bright stripes as shown inFIG. 3 b, corresponding to f3a, may be obtained at different time points within ΔT1; an image with 5 dark stripes and 6 bright stripes as shown inFIG. 3 d, corresponding to f3c, may be obtained at different time points within ΔT2; and an image with 3 dark stripes and 4 bright stripes as shown inFIG. 3 f, corresponding to f3e, may be obtained at different time points within ΔT3. The identification information corresponding to the varied numbers of bright or dark stripes shown in the images inFIG. 3 b, 3 d, 3 f obtained from the visible light signal inFIG. 3 g is transmitted, and the numbers of bright or dark stripes are corresponding to frequencies f3a, f3c, f3e. Alternatively, the driving voltage of the light source may also be modulated on the basis of the identification information to be transmitted. - Alternatively, the driving current or the driving voltage of the light source may have other wave forms. Alternatively, the driving current or the driving voltage of the light source may be modulated to emit visible light signal with four or more kinds of varied frequencies at different time points.
- According to an embodiment of the present invention, the first modulated driving current is greater than the un-modulated driving current, so that luminous flux of the light source driven by the first modulated driving current is equal to luminous flux of the light source driven by the un-modulated driving current.
- The luminous flux is the measure of the power of light emitted by the light source during unit time, and is proportional to the area below the wave of the driving signal, the variation of which is sensitive to human eye. The driving signal may be modulated with the first modulated driving currents greater than un-modulated driving currents, so that luminous flux of the light source is constant throughout the transmission of identification information to avoid blinking.
-
FIG. 4 a is the schematic diagram of a modulated driving current of a light source equal to the un-modulated driving current according to an embodiment of the present invention. It can be assumed that the luminous flux of the light source driven by the un-modulated driving currents is 100%. Assuming that the width of the peak levels and bottom levels of the modulated driving current may be 0.1 ms respectively and the modulated driving current is equal to the un-modulated driving current, the luminous flux of the light source driven by the modulated driving current shown inFIG. 4 a can be calculated to be (0.1*0+0.1*1)*100%/(0.1+0.1)=50%. The luminous flux 50% of the light source driven by the modulated driving current is lower than that of the light source driven by the un-modulated driving current (100%), causing undesirable blinking of the light source detectable by human eye. -
FIG. 4 b is the schematic diagram of a modulated driving current greater than the un-modulated driving current according to an embodiment of the present invention. Still, assuming that the width of the peak levels and bottom levels of the modulated driving current is 0.1 ms, respectively, and the modulated driving current is twice of the un-modulated driving current, the luminous flux of the light source driven by the modulated driving current shown inFIG. 4 b can be calculated to be (0.1*0+0.1*2)*100%/(0.1+0.1)=100%. Theluminous flux 100% of the light source driven by the modulated driving current is equal to theluminous flux 100% of light source driven by the un-modulated driving current, avoiding undesirable blinking of the light source detectable by human eye. It should be noted that, the values provide in the embodiments of the present invention are theoretical values for illustrative purposes, but not actual values. The actual values may vary due to the parameters of different devices. - Alternatively, as for a first modulated driving current for driving the light source to emit the visible light signal with varied frequencies at different time points, for example, with varied frequencies f3a, f3c and f3e at different time points within time intervals ΔT1, ΔT2 and ΔT3 as shown in
FIG. 3 g, the driving signal may be modulated, in the similar manner as shown inFIGS. 4 a and 4 b, so that luminous flux of the light source driven by the first modulated driving current in ΔT1, ΔT2, ΔT3 is equal to luminous flux of the light source driving by the un-modulated driving current. - According to some embodiments of the present invention, optionally, the
method 100 may comprise a step of emitting the visible light signal on the basis of a second modulated driving current which is greater than an un-modulated driving current together with a high frequency carrier wave signal, so that luminous flux of the light source driven by the second modulated driving current is constant among periods comprising peak levels and bottom levels. -
FIG. 4 c is the schematic diagram of a modulated driving current greater than the un-modulated driving current without high frequency carrier wave signal according to an embodiment of the present invention. As shown inFIG. 4 c, within different time intervals ΔT1 and ΔT2, the peak levels and bottom levels may have different durations of peak levels and bottom levels for transmitting different codes, as shown inFIG. 4 c, resulting in different luminous fluxes of the light source driven by the modulated driving current, causing the light source to blink. For example, as shown inFIG. 4 c, within a time interval ΔT1 representing code “1”, the driving current is modulated to have a total duration of peak level of ΔT1peak=½*ΔT1, giving a luminous flux of 50%; and within another time interval ΔT2 representing code “2”, the driving current is modulated to have a total duration of peak level of ΔT2peak=⅔*ΔT2, giving a luminous flux of 66.7%. Therefore, the luminous flux within ΔT1 representing code “1” is less than that within ΔT2 representing code “2”, causing the light source to blink. - In order to avoid the blinking of the light source when transmitting different codes, the driving current which is greater than un-modulated driving current is further modulated with a high frequency carrier wave signal. By modulating with a high frequency carrier wave signal, within different time intervals, the durations of peak levels and bottom levels of the driving current for transmitting different codes are same, giving the same luminous flux among periods comprising the peak levels and bottom levels, and thus avoiding the blinking of the light source. For example, as shown in
FIG. 4 d, within time interval ΔT1 representing code “1”, the driving current is further modulated with a high frequency carrier wave to have a total duration of peak levels of ΔT1peak=½*ΔT1*66.7%, giving a luminous flux of 33.3%; within time interval ΔT2 representing code “2”, the driving current is further modulated with a high frequency carrier wave to have a total duration of peak levels of ΔT2peak=⅔*ΔT2*50%, giving a luminous flux of 33.3%. Therefore, the luminous flux within ΔT1 representing code “1” is equal to that within ΔT2 representing code “2”, avoiding undesirable blinking of the light source detectable by human eye. - For the purpose of illustration, the visible light signals shown in
FIG. 4 c andFIG. 4 d have the same frequency within different intervals ΔT1 and ΔT2. It should be noted by those skilled in the art that a modulated driving current for driving the light source to emit the visible light signal with varied frequencies at different time points may be modulated in the similar manner as shown inFIGS. 4 c and 4 d, so that the luminous flux of the light source driven by the modulated driving current is equal to the luminous flux of the light source driving by the un-modulated driving current. - According to some embodiments of the present invention, the identification information corresponding to the varied numbers of bright or dark stripes comprises data bits, which comprise data corresponding to the varied frequencies, and each data bit corresponds to a number among the varied numbers of bright or dark stripes.
- With the first modulated driving current as shown in
FIG. 3 g, the images as shown inFIGS. 3 b, 3 d and 3 f may be obtained at different time points within time intervals ΔT1, ΔT2 and ΔT3. The identification information corresponding to the varied numbers of bright or dark stripes in the images as shown inFIGS. 3 b, 3 d and 3 f may be transmitted. The identification information transmitted may comprise data bits which comprise data corresponding to the varied frequencies, such as f3a, f3c and f3e at different time points within time intervals ΔT1, ΔT2 and ΔT3. Each data bit corresponds to a number among the varied numbers of bright or dark stripes. For example, 10 dark stripes and 11 bright stripes as shown inFIG. 3 b may represent code “1”, 5 dark stripes and 6 bright stripes as shown inFIG. 3 d may represent code “2”, and 3 dark stripes and 4 bright stripes as shown inFIG. 3 f may represent code “3”. Of course, the first modulated driving current may have other combinations of signals with different frequencies or different durations. - According to an embodiment of the present invention, the identification information corresponding to the varied numbers of bright or dark stripes further comprises one or more starts bit and/or one or more error correction bits, the one or more start bits being used to identify a start position of a set of data bits, and the one or more error correction bits being used to check error in the data bits
-
FIG. 5 a is the schematic diagram of the identification information corresponding to the varied numbers of bright or dark stripes comprising a start bit according to an embodiment of the present invention. As shown inFIG. 5 a, a start bit is added at the beginning of the data bits. Alternatively, more than one start bits may be included. -
FIG. 5 b is the schematic diagram of the identification information corresponding to the varied numbers of bright or dark stripes comprising a start bit and an error correction bit according to an embodiment of the present invention. As shown inFIG. 5 b, besides a start bit, an error correction bit is also added at the end of the data bits. Alternatively, more than one error correction bits may be included. Alternatively, the one or more error correction bits may be added to the data bits without the start bit. - According to some embodiments of the present invention, the first modulated driving voltage or the first modulated driving current is used for driving the light source to emit a visible light signal with a frequency from 100 Hz to 1.37 MHz, and duration of each bottom level of the visible light signal is fixed, or duration of each peak level of the light pulse signal is fixed.
- Optionally, the image may be obtained by an image capturing device comprising an image sensor whose exposure mode is the rolling shutter mode. The exposure time of the image sensor is defined as the exposure time of pixels in each row (or column) of the rolling shutter based image sensor.
- When a frame rate of the image sensor is 30 Hz and a resolution is 640*480 (V-line*H-line), time required for capturing one image is 1 s/frame rate=1 s/30 Hz=0.033 s=33 ms, and time required for capturing each row is 1 s/(frame rate*H-line)=33 ms/480=69 us≈70 us. In order to obtain a clear image containing bright or dark stripes with each stripe being corresponding to each row, the exposure time of each is less than 70 us, the duration of alternating the peak and bottom levels of the visible light signal emitted by the light source should be equal to or larger than 70 us and thus the frequency of the visible light signal is less than or equal to 1 s/(duration required for bright stripes+duration required for dark stripes)=1 s/(1 s/(Frame rate*H-line)+1 s/(Frame rate*H-line))=1 s/(70 us+70 us)=7.14 kHz.
- When a frame rate of the image sensor is 30 Hz, a resolution is 3 billion Hz with V-line:H-line=1:1, the frequency of the visible light signal is less than or equal to 1 s/(duration required for bright stripes+duration required for dark stripes)=1 s/(1 s/(Frame rate*H-line)+1 s/(Frame rate*H-line))=0.5*30 Hz*(3000000000)0.5=1.37 MHz. Since the light blinking frequency detectable by human eyes is less than 100 Hz, the frequency of visible light signal is from 100 Hz to 1.37 MHz.
- Referring to
FIG. 3 g again, the first modulated driving current has the frequency of f3a at time points within the time interval ΔT1, the frequency of f3c at time points within the time interval ΔT2, and frequency of f3e at time points within the time interval ΔT3. Different time intervals ΔT1, ΔT2 and ΔT3 have same duration, and the numbers of the peak levels or bottom levels are different. For example, there are three peak levels or bottom levels within ΔT1; there are two peak levels or bottom levels within ΔT2; and there is one peak level or bottom level within ΔT3. As shown inFIG. 3 g, the duration of each bottom level of the visible light signal is fixed. Therefore, after emitting the visible light signal on the basis of the first modulated driving current as shown inFIG. 3 g, the images as shown inFIGS. 3 b, 3 d and 3 f may be obtained at different time points within ΔT1, ΔT2 and ΔT3, and the dark stripes in the images as shown inFIGS. 3 b, 3 d and 3 f have the same width. Alternatively, the duration of each peak level of the visible light signal may be fixed, and the bright stripes in the images have the same width. - According to some embodiments of the present invention, optionally, the
method 100 may further comprise steps of detecting the presence of a human being within an illumination scope of the light source, and emitting a visible light signal on the basis of un-modulated driving signal in the absence of a human being. -
FIG. 6 shows a light source emitting visible light signal for transmitting identification information in response to the presence of a human being. As shown inFIG. 6 , when no human being is presented within an illumination scope of the light source, such as at “position a” shown inFIG. 6 , a visible light signal is emitted on the basis of un-modulated driving signal and no identification information is transmitted. When a human being is presented within the illumination scope of the light source, such as at “position b” shown inFIG. 6 , the presence of the human being is detected, the driving signal of the light source is modulated on the basis of the identification information to be transmitted, the visible light signal is emitted on the basis of the modulated driving signal, and the identification information corresponding to the varied numbers of bright or dark stripes shown in one or more images obtained from the visible light signal is transmitted. When the human being leaves the illumination scope of the light source, such as at “position c” shown inFIG. 6 , a visible light signal on the basis of un-modulated driving signal is emitted, and no identification information is transmitted. - It should be noted by those skilled in the art that the frequencies, waveforms, or widths of the peak levels and bottom levels of the modulated driving current are not limited to the above exemplary values, but may be set to have any values as required. Similarly, the frequencies, waveforms, or widths of the peak levels and bottom levels of the high frequency signal wave signal are not limited to the above exemplary values, but may be set to have any values as required.
- According to a second aspect of the present invention, there is provided a method for obtaining identification information of a light source from visible light signal.
FIG. 7 is a flow chart illustrating themethod 200 for obtaining identification information of a light source from visible light signal according to an embodiment of the present invention. - As shown in
FIG. 7 , themethod 200 begins with astep 210 of obtaining one or more images at one or more time points from a visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points emitted by a light source. As shown inFIG. 7 , after thestep 210, step 220 of themethod 200 is performed, wherein the varied numbers of bright or dark stripes in the one or more images is measured and the varied numbers of bright or dark stripes are corresponding to the varied frequencies. Afterstep 220, step 230 of themethod 200 is performed, wherein identification information corresponding to the varied numbers of the bright or dark stripes is obtained. - According to a third aspect of the present invention, there is provided a
method 300 for positioning by visible light signals.FIG. 8 is a flow chart illustrating themethod 300 for positioning by visible light signal according to an embodiment of the present invention. - Embodiments of the third aspect of the present invention also apply to the second aspect of the present invention, thus only the embodiments of the third aspect will be described in details hereinafter, and same embodiments of the second aspect will not be described repeatedly for the sake of conciseness.
- As shown in
FIG. 8 , themethod 300 begins with astep 310 of obtaining one or more images at one or more time points from a visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points emitted by a light source. - According to some embodiments of the present invention, the visible light signal may be emitted by the light source on the basis of a modulated driving signal, which drives the light source to emit visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points, as described hereinbefore in details with respect to the
method 100. - According to some embodiments of the present invention, the modulated driving signal may be modulated by the PWM scheme. Optionally, the modulated driving signals may be modulated driving voltages or modulated driving currents.
- Optionally, the modulated driving current may be greater than un-modulated driving current, so that luminous flux of the light source driven by the modulated driving current is equal to luminous flux of light source driven by the un-modulated driving current, as described hereinbefore in details with respect to the
method 100 making reference toFIGS. 4 a and 4 b. - Optionally, the modulated driving current may be greater than un-modulated driving currents together with a high frequency carrier wave signal, so that the luminous flux of the light source driven by the driving current is constant among periods comprising peak levels and bottom levels, as described hereinbefore in details with respect to the
method 100 making reference toFIGS. 4 c and 4 d. - The above embodiments have been described in details previously with respect to the
method 100, and will not be iterated herein for the sake of conciseness. - According to some embodiments of the present invention, the image obtained from the visible light signal may be an image containing bright or dark stripes as shown in
FIGS. 3 b, 3 d, 3 f, where varied numbers of bright or dark stripes correspond to the varied frequencies of the visible light signal. - According to some embodiments of the present invention, the
step 210 may comprise obtaining at the position one or more images at one or more time points by an image capturing device comprising an image sensor whose exposure mode is rolling shutter mode, and a sampling rate of the rolling shutter is higher than the frame rate of the image sensor. The image capturing device is used for capturing the one or more images obtained from the visible light signal emitted by the light source. The image capturing device may be a smartphone, laptop computer, or other electronic device equipped with camera(s). Alternatively, the image capturing device may be an embedded system integrated in other devices or objects, for example, piece jewelry, key, card, pen, etc. The image sensor may be a photosensitive component. - For an image sensor whose exposure mode is rolling shutter mode, different parts of the image sensor, each row or each column, may be exposed at different time. The image sensor may obtain one or more images containing bright or dark stripes, such as those shown in
FIG. 3 b, 3 d or 3 f, when capturing one or more images at different time points of a rapidly changing light source driven by the modulated driving signal, such as those shown inFIG. 3 g. Optionally, the sampling rate of the rolling shutter is higher than the frame rate of the image sensor, so as to obtain a clear image containing bright or dark stripes with each stripe being corresponding to each row. For example, for a frame rate of the image sensor of 30 Hz and a resolution of 640*480, time required for capturing one image is 1 s/30 Hz=0.033 s=33 ms, and time required for capturing each row is 33 ms/480=69 us. In order to obtain a clear image containing bright or dark stripes with each stripe being corresponding to each row, the exposure time of each is less than 69 us and the sampling rate is higher than 30 Hz. - According to some embodiments of the present invention, the
step 210 may comprise capturing at the position on an image sensor with a rolling shutter the one or more images in which different portions of the image sensor are exposed at different time points. Optionally, the image sensor may be a complementary metal-oxide-semiconductor (CMOS) image sensor or a Charge-Coupled Device (CCD) image sensor. - As shown in
FIG. 8 , after thestep 310 described hereinbefore, step 320 of themethod 300 is performed, wherein varied numbers of bright or dark stripes in the one or more images is measured, and the varied numbers of bright or dark stripes are corresponding to the varied frequencies. - According to some embodiments of the present invention, varied numbers of bright or dark stripes in the one or more images obtained from the visible light signal may be measured by, for example, an image processor or a general purpose processor. After the image is projected onto the image sensor surface, the optical signal detected by the image sensor is converted into electrical signal by the image sensor. The analog electrical signals are converted into digital signals by an analog-to-digital-converter (ADC) of the image sensor or the processor. The processor is applied to further process the digital signal and generate a digital image, which may be displayed on a monitor. Optionally, a digital signal processing (DSP) module of the processor may be applied to process the digital signal and generate a digital image.
- As shown in
FIG. 8 , after thestep 320 described hereinbefore, step 330 of themethod 200 may be performed, wherein identification information of the light source corresponding to the varied numbers of the bright or dark stripes is obtained. - According to some embodiments of the present invention, the identification information of the light source corresponding to the pattern of the color stripes may be any type of identification information, for example, the identifier (ID) of the light source, and other identification information.
- According to some embodiments of the present invention, the varied numbers of bright or dark stripes in the one or more images are derived from the varied frequencies of the visible light signal at different time points. According to some embodiments of the present invention, the identification information of the light source corresponding to the varied numbers of bright or dark stripes may be decoded. By this way, the initial identification information carried on the visible light signal can be recovered.
- As shown in
FIGS. 3 b, 3 d and 3 f, the images captured by an image sensor can be generated from the light source emitting visible light signal at different time points, which is driven by the modulated driving signal as shown inFIG. 3 g. When decoding the identification information corresponding to the varied numbers of bright or dark stripes, the analysis of the captured images is based on the measurements of varied numbers of bright or dark stripes. For example, the image shown inFIG. 3 b has 10 dark stripes and 11 bright stripes, and its decoded wave form corresponds to that inFIG. 3 a or within ΔT1 as shown inFIG. 3 g; the image shown inFIG. 3 d has 5 dark stripes and 6 bright stripes, and its decoded wave form corresponds to that inFIG. 3 c or within ΔT2 as shown inFIG. 3 g; the image shown inFIG. 3 e has 3 dark stripes and 4 bright stripes, and its decoded wave form corresponds to that inFIG. 3 e or within ΔT3 as shown inFIG. 3 g. - It should be noted that although varied frequencies of the visible light signals at different time points are used during coding, the transmitted identification information of the light source may be decoded by comparing the relative frequencies corresponding to the numbers of the bright or dark stripes, instead of the absolute frequencies of the visible light signals.
- According to some embodiments of the present invention, the light source may be one or more light sources. One or more images from visible light signal emitted by the light source may be obtained at one or more time points. Each image obtained may have one or more exposed regions, and each exposed region may contain bright or dark stripes corresponding to one light source.
-
FIG. 9 is a schematic diagram of an image containing one or more exposed regions corresponding to one or more light sources according to an embodiment of the present invention. InFIG. 9 , the image obtained has three exposed regions, and each exposed region contains bright or dark stripes, such as those shown inFIG. 3 b, 3 d or 3 f, corresponding to one light source driven by the modulated driving signal, such as those shown inFIG. 3 a, 3 c or 3 e. - The
step 310 may comprise: obtaining one or more images at one or more time points from visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points emitted by the one or more light sources, wherein one or more exposed regions in each image correspond to the one or more light sources. The image having one or more exposed regions obtained from one or more light source, for example the image shown inFIG. 9 , may be obtained in the similar way as that obtained from one light source as mentioned above, which will not be iterated herein for the sake of conciseness. Further, thestep 320 may comprise measuring the varied numbers of the bright or dark stripes of the one or more exposed regions in each image. The varied numbers of bright or dark stripes of each exposed region corresponding to each set light source may be measured in the similar way as mentioned above. For example, varied numbers of bright or dark stripes of each exposed region corresponding to each light source shown inFIG. 9 may be respectively measured in the similar way as those shown inFIGS. 3 b, 3 d and 3 f, which will not be iterated herein for the sake of conciseness. Still further, thestep 330 may comprise obtaining identification information corresponding to the varied numbers of the bright or dark stripes of the one or more exposed regions in each image. The identification information corresponding to the varied number of bright or dark stripes of each exposed regions in the image may be obtained respectively, in the similar way as that from one light source as mention above. For example, identification information corresponding to the varied number of bright or dark stripes of each exposed region corresponding to each light source shown inFIG. 9 may be respectively obtained in the similar way as that corresponding to those shown inFIGS. 3 b, 3 d and 3 f, which will not be iterated herein for the sake of conciseness. - When the incident light is not in perpendicular with the plane of the image sensor, the shape of the light spot projected on the image sensor may have distortion, for example, from a circular to an ellipse. In this case, acceleration meter, gravity sensor, tilt sensor, gyro, or magnetic sensor may be applied to measure the angle of inclination, which may be used to obtain the identification information of one or more light sources corresponding to the varied numbers of bright or dark stripes of the one or more exposed regions in the image.
- As shown in
FIG. 8 , after thestep 330 described hereinbefore, step 340 of themethod 300 is performed, wherein the position is determined by checking the identification information in a predetermined map database. According to some embodiments of the present invention, the predetermined map database contains identification information and the corresponding position information of each light source. By checking the identification information in the map database, the position of the light source can be determined. - According to some embodiments of the present invention, optionally, before
step 330,method 300 may further comprise determining an area of the position by means of one or more wireless positioning schemes. After the area of the position is determined, the position can be then determined by checking the identification information with data of the area in the predetermined map database. - According to some embodiments of the present invention, identification information of a light source is unique for an area at which the light source is located.
- According to some embodiments of the present invention, the wireless positioning scheme comprises positioning by means of GPS, GPRS, GSM, CDMA, WIFI, Zigbee, Bluetooth, and RFID.
- By determining an area of the position by means of one or more wireless positioning schemes, the area where the light source is located can be determined, providing the rough position of the light source. Then, the position of the light source within the area can be determined by checking the identification information with data of the area in the predetermined map database, providing the accurate position of the light source. By this way, each area may have independent map database. The identification information of the light source in one area may be different from that in a different area.
- Alternatively, the identification information of the light source in one area may be same as that in a different area, and under such circumstances, the area where the light source is located should be determined firstly and then the position of the light source within the area can be determined on the basis of the identification information which unique in the area. Such embodiment allows easier coding and shorter length of the identification information, and faster transmission of the identification information.
- According to some embodiments of the present invention, the identification information corresponding to the varied numbers of bright or dark stripes comprises data bits which comprise data corresponding to the varied frequencies, and each data bit corresponds to a number among the varied numbers of bright or dark stripes.
- With the modulated driving current as shown in
FIG. 3 g, the images as shown inFIGS. 3 b, 3 d and 3 f may be obtained at different time points within time intervals ΔT1, ΔT2 and ΔT3. The identification information corresponding to the varied numbers of bright or dark stripes in the images as shown inFIGS. 3 b, 3 d and 3 f may be transmitted. The identification information of the light source transmitted may comprise data bits which comprise data corresponding to the varied frequencies, such as f3a, f3c and f3e at different time points within time intervals ΔT1, ΔT2 and ΔT3. Each data bit corresponds to a number among the varied numbers of bright or dark stripes. For example, 10 dark stripes and 11 bright stripes as shown inFIG. 3 b may represent code “1”, 5 dark stripes and 6 bright stripes as shown inFIG. 3 d may represent code “2”, and 3 dark stripes and 4 bright stripes as shown inFIG. 3 f may represent code “3”. Of course, the modulated driving current may have other combinations of signals with different frequencies or different durations. - According to some embodiments of the present invention, the identification information corresponding to the varied numbers of bright or dark stripes further comprises one or more start bits and/or one or more error correction bits, the one or more start bits being used to identify a start position of a set of data bits, and the one or more error correction bits being used to check error in the data bits.
- Referring to
FIG. 5 a again, the identification information corresponding to the varied numbers of bright or dark stripes may comprise a start bit according to an embodiment of the present invention. Optionally, a start bit is added at the beginning of the data bits. Alternatively, more than one start bits may be included. - Referring to
FIG. 5 b again, the identification information corresponding to the varied numbers of bright or dark stripes may comprise a start bit and an error correction bit according to an embodiment of the present invention. Optionally, besides a start bit, an error correction bit is also added at the end of the data bits. Alternatively, more than one error correction bits may be included. Alternatively, the one or more error correction bits may be added to the data bits without the start bit. - According to a fourth aspect of the present invention, there is provided a
light source 400 for transmitting identification information by visible light signal. As shown inFIG. 10 , thelight source 400 may be a lamp, for example a LED lamp, LED backlight, LED flat light, etc. However, thelight source 400 is not limited to the above example, but may be any light source capable of transmitting visible light signals. - As shown in
FIG. 10 , thelight source 400 may comprise amodulator 410 and anemitter 420. Themodulator 410 may be a modulator driven by an electric signal with constant current, constant voltage, constant electric power, constant optical power, or by an electric signal modulated by PWM. Theemitter 420 may be a LED which may emit visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points. As for one-way LED driving, theemitter 420 may be one or more LEDs connected in one string, including 1 to dozens of LEDs. Alternatively, theemitter 420 may be one or more LEDs connected in more strings with each string including 1 to dozens of LEDs. According to some embodiments of the present invention, theemitter 420 comprises more LEDs. However, themodulator 410 or theemitter 420 is not limited to the above example, but may be any modulator or emitter. - The
modulator 410 may be configured to modulate, on the basis of the identification information to be transmitted, a driving signal of the light source to obtain a modulated driving signal for driving the light source to emit visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points. - The
emitter 420 may be configured to emit the visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points on the basis of the modulated driving signal, so as to transmit identification information corresponding to the varied numbers of bright or dark stripes shown in one or more images obtained from the visible light signal at one or more time points, which numbers are corresponding to the varied frequencies. - According to some embodiments of the present invention, the
modulator 410 may be configured to modulate on the basis of the identification information to be transmitted a driving voltage or a driving current of the light source to obtain a first modulated driving voltage or a first modulated driving current. - According to some embodiments of the present invention, the first modulated driving current is greater than the un-modulated driving current, so that the luminous flux of the light source driven by the first modulated driving current is equal to the luminous flux of the light source driven by the un-modulated driving current.
- According to some embodiments of the present invention, the
emitter 420 can be configured to emit the visible light signal on the basis of a second modulated driving current which is greater than the un-modulated driving current together with a high frequency carrier wave signal, so that luminous flux of the light source driven by the second modulated driving current is constant among periods comprising peak levels and bottom levels. - According to some embodiments of the present invention, the identification information corresponding to the varied numbers of bright or dark stripes comprises data bits which comprise data corresponding to the varied frequencies, and each data bit corresponds to a number among the varied numbers of bright or dark stripes.
- According to some embodiments of the present invention, the identification information corresponding to the varied numbers of bright or dark stripes may further comprise one or more starts bit and/or one or more error correction bits, the start bits are used to identify a start position of a set of data bits, and the one or more error correction bits are used to check error in the data bits.
- According to some embodiments of the present invention, the first modulated driving voltage or the first modulated driving current is used for driving the light source to emit a visible light signal with a frequency from 100 Hz to 1.37 MHz, and duration of each bottom level of the visible light signal is fixed, or duration of each peak level of the light pulse signal is fixed.
- According to some embodiments of the present invention, the
light source 400 may further comprise a detector configured to detect the presence of a human being within an illumination scope of the light source, and the emitter is configured to emit a visible light signal on the basis of un-modulated driving signal in the absence of a human being. - The above detailed descriptions for the
method 100 also apply to the embodiments of thelight source 400 according to the present invention, and are thus not iterated for the sake of conciseness. In particular, thestep 110 in themethod 100 can be performed by themodulator 410, and thestep 120 in themethod 100 can be performed by theemitter 420. - According to a fifth aspect of the present invention, there is provided a
device 500 for obtaining identification information from visible light signal. For example, the device may be a mobile device with a camera, such as a smartphone, tablet, laptop computer, or other electronic device. However, thedevice 500 is not limited to these examples, but can be any electronic device with photosensitive component. - As shown in
FIG. 10 , thedevice 500 for obtaining identification information of light source from visible light signal may comprise animage sensor 510, amemory 520, and aprocessor 530. Theimage sensor 510 may be for example a camera, photodiode, and photodiode array. Thememory 520 may be for example volatile memory, non-volatile memory, etc. Theprocessor 530 may be general purpose processor, dedicated processor, etc. - The
image sensor 510 can be configured to obtain one or more images at one or more time points from a visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points emitted by a light source. Thememory 520 can be configured to store the one or more images obtained by the image sensor at one or more time points. Theprocessor 530 can be configured to measure varied numbers of bright or dark stripes in the one or more images stored in thememory 520 and obtain identification information corresponding to the varied numbers of the bright or dark stripes, and the varied numbers of bright or dark stripes are corresponding to the varied frequencies. - According to a sixth aspect of the present invention, there is provided a device for positioning by visible light signal. For example, the device may be a mobile device with a camera, such as a smartphone, tablet, laptop computer, or other electronic device. However, the device is not limited to these examples, but can be any electronic device with photosensitive component.
- Embodiments of the sixth aspect of the present invention also apply to the fifth aspect of the present invention, thus only the embodiments of the sixth aspect will be described in details hereinafter, and same embodiments of the fifth aspect will not be described repeatedly for the sake of conciseness.
- Embodiments of device according to the sixth aspect of the present invention will be described with reference to
FIG. 10 again hereinafter, and same reference numbers with the fifth aspect will be used. - As shown in
FIG. 10 , thedevice 500 for positioning by visible light signal may comprise animage sensor 510, amemory 520, and aprocessor 530. Theimage sensor 510 may be for example a camera, photodiode, and photodiode array. Thememory 520 may be for example volatile memory, non-volatile memory, etc. Theprocessor 530 may be general purpose processor, dedicated processor, etc. - The
image sensor 510 can be configured to obtain at a position one or more images at one or more time points from a visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points emitted by a light source. Thememory 520 can be configured to store the one or more images obtained by the image sensor at one or more time points. Theprocessor 530 can be configured to measure varied numbers of bright or dark stripes in the one or more images stored in thememory 520, obtain identification information corresponding to the varied numbers of the bright or dark stripes, and determine the position by checking the identification information in a predetermined map database, the varied numbers of bright or dark stripes being corresponding to the varied frequencies. - According to some embodiments of the present invention, the
processor 530 is configured to before determining the position by checking the identification information in a predetermined map database, determine an area of the position by means of one or more wireless positioning schemes; and theprocessor 530 is configured to determine the position by checking the identification information with data of the area in the predetermined map database. According to some embodiments of the present invention, the wireless positioning scheme comprises positioning by means of GPS, GPRS, GSM, CDMA, WIFI, Zigbee, Bluetooth, and RFID. - According to some embodiments of the present invention, identification information of a
light source 400 is unique for an area at which thelight source 400 is located. - By determining an area of the position by means of one or more wireless positioning schemes, the area where the light source is located can be determined, providing the rough position of the light source. Then, the position of the light source within the area can be determined by checking the identification information with data of the area in the predetermined map database, providing the accurate position of the light source. By this way, each area may have independent map database. The identification information of the light source in one area may be different from that in a different area.
- Alternatively, the identification information of the light source in one area may be same as that in a different area, and under such circumstances, the area where the light source is located should be determined firstly and then the position of the light source within the area can be determined on the basis of the identification information which unique in the area. Such embodiment allows easier coding and shorter length of the identification information, and faster transmission of the identification information.
- According to some embodiments of the present invention, exposure mode of the image sensor is rolling shutter mode, and a sampling rate of the rolling shutter is higher than the frame rate of the image sensor.
- According to some embodiments of the present invention, the
image sensor 510 is an image sensor with a rolling shutter and is configured to obtain the one or more images in which different portions of the image sensor are exposed at different time points. Optionally, theimage sensor 510 may be a complementary metal-oxide-semiconductor (CMOS) image sensor or a Charge-Coupled Device (CCD) image sensor. - According to some embodiments of the present invention, the visible light signal is emitted by the
light source 400 on the basis of a modulated driving signal, which drives thelight source 400 to emit the visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points. - According to some embodiments of the present invention, the
light source 400 may be one or more sets of light sources, and theimage sensor 510 can be configured to obtain one or more images at one or more time points from visible light signal having their level changed between peak levels and bottom levels with varied frequencies at different time points emitted by the one or more light sources, wherein one or more exposed regions in each image correspond to the one or more light sources; thememory 520 can be configured to store the one or more images obtained by the image sensor at one or more time points; and theprocessor 530 can be configured to measure the varied numbers of the bright or dark stripes of the one or more exposed regions in each image, and obtain identification information corresponding to the varied numbers of the bright or dark stripes of the one or more exposed regions in each image. - According to some embodiments of the present invention, the identification information corresponding to the varied numbers of bright or dark stripes comprises data bits which comprise data corresponding to the varied frequencies, and each data bit corresponds to a number among the varied numbers of bright or dark stripes.
- According to some embodiments of the present invention, the identification information corresponding to the varied numbers of bright or dark stripes further comprises one or more start bits and/or one or more error correction bits, the one or more start bits being used to identify a start position of a set of data bits, and the one or more error correction bits being used to check error in the data bits.
- The above detailed descriptions for the
method 300 also apply to the embodiments of thedevice 500 according to the sixth aspect of the present invention, and are thus not iterated for the sake of conciseness. In particular, thestep 310 in themethod 300 as described above can be performed by theimage sensor 510 andmemory 520, and thesteps method 300 can be performed by theprocessor 530. - According to some embodiments of the present invention, the device for positioning by visible light signal may be a mobile device.
FIG. 11 shows a flow chart of a process that a mobile device accesses the indoor map. The mobile device starts the software for indoor positioning, initializes the wireless network, determines an area of the position by means of one or more wireless positioning schemes. The software searches where there is the map of the current position in the predetermined may database of the mobile device. If no, the map of the current position is downloaded to the mobile device through wireless network. If yes, the mobile device checks the map of the current position and determines the position by checking the identification information in the map. - According to some embodiments of the present invention, a mobile device may be integrated with a positioning software.
FIG. 12 shows the diagram of a mobile device integrated with a positioning software. The identification information and a predetermined map database can be stored in the memory of the mobile device. Therefore, the mobile device can compare the received identification information with the map database, and show the map of the position on the display of the mobile device. As described above, the working flow of a mobile device integrated with a positioning software is as follows: one or more images of the light source are captured by the image sensor; the captured images are sent to the processor to decode the identification information; the recovered identification information is compared with the predetermined map database and the accurate position is shown on the display of the mobile device. - According to some embodiments of the present invention, a predetermined map database contains the identification information of the light sources.
FIG. 13 is the diagram of the relation between the map database and the identification information of light sources. The predetermined map database containing identification information may be stored in a mobile device. Alternatively, the predetermined map database containing identification information may be stored in a remote server. After recovering the identification information, the mobile device can access the predetermined map database on the remote server through network. Then, the mobile device compares the received identification information with the map database, and the accurate position is shown on the display of the mobile device. - There are two conventional ways to modify the identification information stored in the light source: Disassembling the memory chip from the light source, and modifying the identification information by a compiler, which can rewrite the memory chip; and reserving an interface for modifying identification information on the light source, connecting the interface with a compiler which can rewrite the memory chip through a cable to modify the memory chip. Both ways are complex and consequently lead to a high maintenance cost.
- According to some embodiments of the present invention, the identification information of the light source may be modified by a mobile modification device via wireless communication.
FIG. 14 is the diagram of a light source with a mobile modification device comprising a receiver and a transmitter. The light source can receive the wireless signal sent by the mobile device and update the identification information stored in the integrated memory. The wireless signal could be a light signal, RF signal or other kind of wireless signals. The visible light signal is chosen as an example to further explain the method and related devices. The present invention provides an easy and low cost way to modify identification information stored in the integrated memory in light sources. - According to some embodiments of the present invention, a mobile modification device can update the information stored in the light source as shown in
FIG. 15 . The light detection module is applied for receiving the visible light signal sent by the mobile device for updating the identification information in the light source; and updating the identification information in the integrated memory in light sources. - According to some embodiments of the present invention, the identification information of the light source may be updated through the mobile modification device as shown in
FIG. 16 . A light detection module is integrated in the light source. This light detection module is applied for receiving the visible light signal sent by the mobile modification device for updating the identification information in the light source. When the light detection module receives a signal which is confirmed as correct identification information, the processor updates the identification information in the integrated memory in the light source. -
FIG. 17 is the flow chart of updating the identification information of a light source. Mobile modification device receives the visible light signal sent by the light source; demodulates the visible light signal with a microprocessor; and shows the demodulated identification information on a display. Meanwhile, the microprocessor search the memory for the identification information of the light source and display the identification information to be updated on the display, determine whether the demodulated identification information is the same as the identification information. If they are not the same, the transmitter sends the visible light signal modulated by the modulator to the light source. The light source receives the visible light signal, the microprocessor demodulates the identification information and updates the identification information. -
FIG. 18 is the flow chart of searching the identification information of a light source. After the identification information is updated, the light source sends the updated identification information to the mobile modification device. The receiver of the mobile modification device receives the information, the microprocessor demodulates the identification information of the light source and display a confirmation message after updating is completed. If the received updated identification information is the same as the identification information to be updated, then the process ends. Otherwise, the mobile modification device resends the visible light signal containing the identification information to the light source. - According to some embodiments of the present invention,
FIG. 19 a shows that the image sensor is placed horizontally for capturing image. The image sensor is placed below the light source for capturing the image from the visible light signals of multiple light sources.FIG. 19 b shows the captured image under when the image sensor is placed horizontally. The captured image contains three exposed regions corresponding to three light sources. The current position of the mobile device can be calculated by the position of the corresponding three light sources. The distance between point A and B is: DAB=((XA,−XB)2+(YA−YB)2)0.5. This distance may be pre-stored in the database. The ratio QY between the actual distance and the distance of the pixel points on the image may be obtained by the actual distance D/DAB on Y direction. The distance between point A and C is: DAc=((XA,−XC)2+(YA−YC)2)0.5. This distance may be pre-stored in the database. The ratio QX between the actual distance and the distance of the pixel points on the image may be obtained by the actual distance D/DAC on X direction. The actual coordinates of the midpoint (Xmid,Ymid) may be determined by the midpoint (Xmid,Ymid) and anyone of A, B C. The actual coordinates of the midpoint (X,Y) may be calculated as X=XB(actual coordinate)+(Xmid−XB)*QX, Y=YB(actual coordinate)+(Ymid−YB)*QY. - According to some embodiments of the present invention,
FIG. 20 a shows that the image sensor for capturing image is tilted from the horizontal plane. When the image sensor is inclined, the surface of the image sensor is not perpendicular to the direction of the incident light, causing the midpoint of the captured image is different from the midpoint of the image captured when the image sensor is placed horizontally. An angular transducer or other devices capable of detecting angle integrated in the mobile device may be used, in order to compensate the decoding error caused by the tilting angle. Alternatively, the different distance between each light source and the image sensor may also be reflected by the intensity of the visible light signal emitted by the light source and received by the image sensor. Therefore, the position of the mobile device may be calculated through the intensity of the visible light signal emitted by the light source and received by the image sensor.FIG. 20 b shows the image captured by the image sensor when the image sensor is tilted from the horizontal plane, that is, the surface of the image sensor is not perpendicular to the direction of the incident light. In this case, the position of the mobile device needed to be calibrated by calculating the tilting angle of the mobile device. - According to some embodiments of the present invention,
FIG. 21 shows the diagram on how to calculate the midpoint of the image. The midpoint of the image may be calculated through the exposed regions on the image. 01, the angle between the surface of the mobile device and G direction, may be obtained by the gyroscope in the mobile device. As shown in the figure, θ2=90−θ1. The distance h between the mobile device and the floor is generally about 1.0˜1.2 meters. Therefore, the distance between the mobile device and the ceiling is: H=h−1.2 m. The distance from the midpoint to the actual location point is d=H*Tan θ2, where d is the distance from the physical location of the mobile device when capturing image to the midpoint of the image. - According to some embodiments of the present invention,
FIG. 22 a shows the schematic diagram of a gyroscope. The gyroscope can be applied for measuring the angular relationship between X, Y, Z axis and the angle between the surface of the image sensor and the incident light. The rotation angle of the mobile device is φn=φn-1+1sgl, where φn is the angle at the present moment, φn-1 is the angle at the previous moment, ω is the angular velocity measured by the gyroscope, dt is the sampling interval. The rotation angle of the mobile device may be obtained by calculating the angular velocity along X, Y, Z axis, respectively.FIG. 22 b is a schematic diagram of the coordinate system an accelerometer of the mobile device. A mobile device is placed facing up, X, Y axis is in the horizontal plane and the Z axis is along the gravity direction and perpendicular to the horizontal plane. - According to some embodiments of the present invention,
FIG. 23 shows the schematic diagram on how to calculate the midpoint of the captured image. According to the projection in horizontal plane of the angle between the surface of the image sensor and the incident light, as well as the angular relationship with X axis, the actual position of the mobile device may be calculated. The rotation angle of the mobile device is φn=φn-1+ω·dt. As shown inFIG. 21 , the distance from the midpoint to the actual location point where the mobile device is capturing the image is d. The position information of the light source may be obtained from the predetermined may database. According to the image information and the position information of light sources A and B, the midpoint of the image is (Xmid,Ymid). The distance between point A and B is: DAB=((XA,−XB)2+(YA−YB)2)0.5. This distance may be pre-stored in the database. The ratio QY between the actual distance and the distance of the pixel points on the image may be obtained by the actual distance D/DAB on Y direction. The distance between point A and C is: DAc=((XA,−Xc)2+(YA−Yc)2)0.5. This distance may be pre-stored in the database. The ratio QX between the actual distance and the distance of the pixel points on the image may be obtained by the actual distance D/DAC on X direction. The actual coordinates of the midpoint (Xmid,Ymid) may be determined by the midpoint (Xmid,Ymid) and anyone of A, B C. The actual coordinates of the midpoint (X,Y) may be calculated as X=XB(actual coordinate)+(Xmid−XB)*QX, Y=YB(actual coordinate)+(Ymid−YB)*QY. The actual coordinate of the midpoint is (X+d*cos φ,Y+d*sin φ). - According to some embodiments of the present invention,
FIG. 24 is the schematic diagram of the format of the data stored in the databases. The mobile device receives the visible light signal sent by the light source; the identification information is recovered by the software integrated in the mobile device, the identification information is sent to the database through network; by comparing the identification information with the database, the position of the mobile device is determined; the identification information is transmitted to the mobile device by the database computer through wireless schemes, such as, GPRS, GSM, CDMA, WIFI, Zigbee and Bluetooth, etc. The position information of the mobile device is displayed in the map shown in the display of the mobile device. - According to some embodiments of the present invention,
FIG. 25 is the schematic diagram of information related to the identification information of the light source. The identification information of the light source may correspond to the following information: the coordinates of the position in the map database; other related information, such as advertisements information, service information, reminder information, etc. - Magnetometer and gyroscope could be used to measure the direction of motion. The positioning can be realized only by visible light signal, or by combining with other positioning methods, such as, GPS, GPRS, GSM, CDMA, Wi-Fi, Zigbee, Bluetooth, RFID, accelerometer, angular transducer, gyroscope, ultrasonic, etc. Between two light sources, more methods as mentioned above may be applied, to improve the consistency and continuity of the positioning. For example, accelerometer is applied to measure the frequency of human steps; then the walking speed can be estimated by a normal length of ty of the positiangular transducer is applied to measure the walking direction. In this way, when moving between two light sources, the position of the mobile device still can be roughly positioned.
- According to some embodiments of the present invention,
FIG. 26 is the schematic diagram of recording a route. A magnetic sensor is applied to determine the initial direction, the gyroscope is applied to measure the walking direction, a gravity sensor is applied to determine human steps when he is walking. According to the speed of walking and a normal length of “one step”, the walking direction and speed may be roughly determined and can be indicated on the map. - According to some embodiments of the present invention,
FIG. 27 is the schematic diagram of the captured image of two light sources. When the mobile device is under the light sources, the position may be determined by capturing the image of the light signals emitted by the light sources. The two light sources may be placed such that the distance between them is e less than 0.5 m, which allows the two light sources can be captured within one image. - According to some embodiments of the present invention,
FIG. 28 is the schematic diagram of the captured image of two light sources which is calibrated. The two light sources are installed in a south-north orientation. The last bit in the identification information indicates the orientation. For example, “For example, orientation.led in The mobile device captures the image of the two light source, receives the identification information of these two light sources, calibrated with gyroscope multiple times, to insure the accuracy of the orientation obtained. - According to some embodiments of the present invention, a map database may be used for positioning. The mobile device receives the light signal sent by the light source; the position of the mobile device is determined by comparing the identification codes with the database; the current position of the mobile device is shown on the display of the mobile device. This positioning system can be applied for the navigation in a shopping mall or super market, and can be used for business statistics, market expansion, online support, SNS (Social Networking Services), Management profiles, or other position-related applications.
- According to some embodiments of the present invention, the
light source 400 may further comprises an AC/DC converter, a micro-controller and a memory, as shown inFIG. 29 . The AC/DC converter is configured to convert the AC power of thelight source 400 obtained from electric power supply to DC power. The micro-controller is configured to compile the pre-stored identification information in the memory to modulation signal based on pre-defined coding method. The modulator is configured to receive the modulation signal and modulate, on the basis of the identification information to be transmitted, a driving signal of the light source to obtain a modulated driving signal for driving the light source to emit visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points. - According to some embodiments of the present invention, the exposure time of the
image sensor 510 may be adjusted before capturing an image.FIG. 30 a is a flowchart of a process that the exposure time of theimage sensor 510 is adjusted before capturing an image according to an embodiment of the present invention. An image sensor is turned on and the exposure time is adjusted. Optionally, the frame rate is 30 Hz and the resolution of each frame is 640*480. Since the light source is close to the image sensor, the light intensity is high. The exposure time of the image sensor may be set at a small value, such as 1/14400 s. When the exposure time of the image senor is less than 1/14400 s, such exposure time is fixed by software. Then, the image senor is ready to capture an image. By adjusting the exposure time of the image sensor, when the exposure time of the image sensor is short enough, images with bright or dark strips can be captured clearly for transmitting identification information. By this way, the communication between the light source and the image sensor is achieved. - According to some embodiments of the present invention, in order to capture images with bright or dark stripes clearly, the sampling duration rate of the image sensor may be smaller or equal to the duration of the peak level or bottom level of the visible light signal emitted by the light source, as shown in
FIG. 30 b. For instance, inFIG. 30 b, the duration of the bottom level is smaller compared to that of the peak level. In order to capture dark stripes clearly, which corresponds to the bottom level, the sampling duration of the image sensor is smaller or equal to the duration of the bottom level. In the case that the frequency of the visible light signal is fixed, the smaller the sampling duration, the clearer the bright or dark stripes obtained. For instance, as shown inFIG. 30 c, within the duration of the bottom level of the visible light signal, a dark stripe having of 3 rows is obtained; and within the duration of the peak level of the visible light signal, a bright stripe having 13 rows is obtained. Similarly, an image as shown inFIG. 30 d may be obtained, which contains bright or dark stripes as shown inFIG. 30 c. - According to some embodiments of the present invention, after the image is captured, the exposed region in the image is detected as shown in
FIGS. 31 a and 31 b. Alternatively, the exposed region may be detected by software in following way: searching the exposed regions from the center of the image outwards along a spiral route; detecting the exposed region; and adjusting the exposure parameters of the image sensor according to the brightness of the exposed region. - According to some embodiments of the present invention, when the light source is one or more light source, each image captured may contain one or more exposed regions corresponding to one or more light sources. The one or more exposed regions in the image may be detected as shown in
FIGS. 32 a-32 c.FIG. 32 a shows an image captured by an image sensor from one or more light sources. The one or more exposed regions on each image may be detected as shown inFIG. 32 b in following way: searching the exposed regions from the center of the image outwards along a spiral route; dividing the image into one more regions corresponding to the one or more light sources; detecting each exposed region corresponding to each light source as shown inFIG. 32 c; determining the number of the stripes; and obtaining the identification information transmitted. - According to some embodiments of the present invention, the exposure time of the
image sensor 510 may be adjusted before capturing an image.FIG. 33 is a flowchart of a process that the exposure time of theimage sensor 510 is adjusted before capturing an image according to an embodiment of the present invention. When the light source is far away from the image sensor and the light intensity detected by the image sensor is low, the exposure time of the image sensor may be adjusted to a suitable value, based on the brightness in the center of the light source. When the exposure time of the image senor is less than the suitable value, such exposure time is fixed by software. Then, the image senor is ready to capture an image. Optionally, the frame rate is 30 Hz and the resolution of each frame is 640*480. The time for the image sensor to capture one image is 1 s/30 Hz=0.033 s=33 ms, and the time for capturing each row is 33 ms/480=69 us≈10 us. When the exposure time is fixed to 1/2000 s corresponds to the time for capturing ( 1/2000 s)/70 us=7.2 rows. In order to capture images with bright and dark strips clearly for transmitting identification information, the duration of the bottom level corresponding to dark stripes or the duration of the peak level corresponding to bright stripes should be larger than theexposure time 1/2000 s, and thus the width of the dark or bright stripes should be larger than 7 rows. Optionally, the exposure time may be set as an interface according to underlying software agreement and this interface can be directly applied to the application software. When an image sensor is turned on, the exposure time is set directly by the application layer interface. - According to some embodiments of the present invention, the captured image containing bright and dark stripes may be decoded, optionally by decoding software, in the following manner: capturing one or more images from the visible light signal emitted by a light source; determining one or more exposed regions in each image; measuring the number of the bright or dark strips where different number represents different code; and recovering the transmitted identification information.
-
FIG. 34 a is a schematic diagram of the image captured by the image sensor, according to embodiments of the present invention. - Alternatively, the exposed region within the image is searched from the center of the image outwards along a spiral route, optionally, by pre-installed software, as shown in
FIG. 34 b, according to embodiments of the present invention. Alternatively, the exposed region may be determined by searching pixels with gray scale values higher than a threshold value. For instance, for an image to be analyzed with a resolution of 640*480, a threshold value is set to the average value of the gray scale of all pixels; the exposed region is searched from the center of the image outwards along a spiral route; when there are a plurality of pixels with gray scale values higher than the threshold in a region, this region is determined as a exposed region. Alternatively, the determined exposed region may be a rectangular region in the image according to embodiments of the present invention, as shown inFIG. 34 c, with the coordinates of the four corners of the rectangle (xmin, ymin), (xmax, ymin), (xmin, ymax) and (xmax, ymax). Here, xmin and xmax are the minimum and maximum coordinates on the x-axis of the pixels with gray scale values higher than the threshold, respectively; ymin and ymax are the minimum and maximum coordinates on the y-axis of the pixels with gray scale values higher than the threshold, respectively. And the center of the exposed region is: (xmid, ymid), where xmid=(xmin+xmax)/2 and ymid=(ymin+ymax)/2. Alternatively, the coordinates may be obtained by scanning, comparing and screening each pixel in the image, as shown inFIG. 34 d. Alternatively, since the light source generally has a circular shape, the determined exposed region may be further optimized to eliminate the interference from the non-exposed region though the center (xmid, ymid), that is, the coordinates of the four corners of the exposed region is determined as (xmid−5,ymin), (xmid+5,ymin), (xmid−5,ymax) and (xmid+5,ymax) as shown inFIG. 34 e. - Alternatively, the number of the bright or dark strips within the optimized exposed region may be measured by measuring the gray scale value within the optimized exposed region according to embodiments of the present invention, as shown in
FIG. 34 f. The RGB-based color image is converted to the gray-scale image and the gray scale value of each pixel in the image is measured. Optionally, the minimum and maximum gray scale values are set to 0 and 255, respectively, corresponding to brightness levels from the darkest to the brightest. Optionally, a gray scale threshold is set to the average of the maximum and minimum gray scale values, or the average of the gray scale values of all pixels within the exposed region. The measured gray scale value of each pixel is compared with the gray scale threshold; and if the measured gray scale value of a pixel is higher the gray scale threshold, the pixel is assigned a gray scale dualization value of “1”, otherwise the pixel is assigned a gray scale dualization value of “0”. The gray scale dualizaton values of the pixels in the same row are summed and compared with a dualization threshold. Optionally, the dualization threshold is set to the average of the maximum and minimum of the sum of gray scale dualizaton values in a row, or is set to the average of the sum of gray scale dualizaton values in all rows within the exposed region. If the sum of gray scale dualizaton values of the pixels in the row is higher than the dualization threshold, the dualization value of the row is set to “1”, representing bright stripe; otherwise, the dualization value of the row is set to “0”, representing dark stripe. - Alternatively, the number of the bright or dark strips may be measured according to embodiments of the present invention, as shown in
FIG. 34 f. As described above, the dualization value “1” represents bright stripe and the dualization value “0” represents dark stripe. When the dualization value of a row is “0” and the dualization value of the next row is “1”, it means the transition from a dark stripe to a bright stripe; when the dualization value of a row is “1” and the dualization value of the next row is “0”, it means the transition from a bright stripe to a dark stripe; when the dualization value of a row is “1” and the dualization value of the next row is still “1”, it means the two rows of pixels are still within one bright stripe; when the dualization value of a row is “0” and the dualization value of the next row is still “0”, it means the two rows of pixels are still within one dark stripe. By this way, the transmitted identification information may be decoded by measuring the number of the dark stripes, by measuring the number of the bright stripes, or by collectively measuring the number of the bright or dark stripes, where different number represents different code. For example, inFIG. 34 f, the number of the dark stripes is 5, the number of the bright stripes is 6, and the number of the bright or dark stripes is 11. - Alternatively, the number of the bright or dark strips may be measured according to another embodiment of the present invention, as shown in
FIG. 34 g. InFIG. 34 g, the first-order derivative of the sum of gray scale dualization values is calculated. The sign (positive or negative) of the first-order derivatives is further derivated. If the derivative of the sign is larger than 0, it means the transition from a bright stripe to a dark stripe or from a dark stripe to a bright stripe. The number of the bright or dark stripes may be obtained by calculating the number of the derivative of the sign larger than 0. - According to some embodiments of the present invention, the
device 400 may contain multiple image sensors as shown inFIG. 35 . When using multiple image sensors in the device, it is necessary to pre-determine which image sensor is activated. Optionally, the strategy may be as follows: activating all image sensors; choosing the image sensor which receives the light signal first as an activated image sensor, and switching off other image sensors. Optionally, the strategy may be manually choosing one image sensor as an activated image sensor. Optionally, the strategy may be choosing one image sensor as an activated image sensor based on the identification information collected by other image sensors or processors to obtain the identification information corresponding to the varied numbers of bright or dark stripes of the one or more exposed regions in the image. - According to some embodiments of the present invention, a software program may be used to trigger the image sensor in the device for obtaining identification information from visible light signal to start receiving the visible light signal. Optionally, the real-time image and the identification information obtained therefrom may be displayed in the program during the process of capturing image, as shown in
FIG. 36A . Optionally, only the identification information obtained from the image may be displayed in the program during the process of capturing image, as shown inFIG. 36B . - According to some embodiments of the present invention, a light source for transmitting identification information by visible light signal comprising a modulator and an emitter according to the present invention may be included in a transmitter as shown in
FIG. 37 . The transmitter may further comprise a power supply, and a microprocessor, e.g., a micro controller unit (MCU). Before the visible light signal is ready to be emitted by the transmitter, the image sensor should be activated in advance. Optionally, the image sensor may be activated by an activation signal sent by the transmitter, as shown inFIG. 18 . The activation may be realized by a software-based switch. When this switch is turned on, the image sensor starts receiving the visible light signal. Alternatively, the image sensor may be activated by other manners. For instance, when the software begins to operate, the image sensor is activated at the same time. Optionally, the activation can also be achieved by other switches, sensors or network. - According to some embodiments of the present invention, when the image sensor is activated to receive the visible light signal, the transmitter is informed to send the visible light signal. This can be realized by a hardware-based switch installed on the transmitter, as shown in
FIG. 38 . When this switch is turned, the transmitter starts to send the visible light signal; when the switch is turned off, the transmitter stops sending the visible light signal. Alternatively, the transmitter may be informed by other manners, such as, buttons, physical contact, sensors, and network. - According to some embodiments of the present invention, a photosensitive device may be integrated in the transmitter to detect the state of the image sensor, such as whether the image sensor is ready to capture images. Before the transmitter sends the visible light signal, the photosensitive device may first check the state of the image sensor. Optionally, when the image sensor is ready to capture images, the light emitting component of the image sensor changes the brightness at a certain frequency, and such changes of the brightness can be detected by the photosensitive device integrated in the transmitter; and then the transmitter starts to send the visible light signal, as shown in
FIG. 39 . Alternatively, the state of the image sensor may be detected by other sensors, such as, sound sensor, gravity sensor, acceleration meter, etc. Alternatively, the state of the image sensor may be detected by other manners, such as, network adaptors, for example GPRS, GSM, CDMA, WiFi, Zigbee, Bluetooth, RFID, etc. - According to some embodiments of the present invention, the transmitter may transmit multiple types of identification information, comprising but not limited to, identifier (ID) of the transmitter, voice, text, audio, pictures, video, etc., which may be stored in the memory, as shown in
FIG. 40 . - According to some embodiments of the present invention, the transmitter may comprise a light source according to the present invention, a microprocessor (for example a MCU), and a battery, as shown in
FIG. 41 . The microprocessor encodes the driving current/voltage of the light source, a modulator in the light source may modulate the driving current/voltage of the light source on the basis of the identification information to be transmitted, and an emitter in the light source may emit the visible light signal on the basis of the modulated driving current/voltage. The light source may emit visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points. The battery may be used to provide energy for the light source and the microprocessor. Optionally, as shown inFIG. 41 , the transmitter may further comprise a charging circuit applied for charging the battery or protecting the battery from being overcharged or overheated, etc. - According to some embodiments of the present invention, the transmitter may further comprise a sensor as shown in
FIG. 42 . The sensor may be applied for measuring electrical parameters, such as temperature, humidity, voltage, and current, or biological parameters, such as human heart rate, body temperature, and blood pressure. - According to some embodiments of the present invention, the transmitter may further comprise a memory as shown in
FIG. 43 . The memory is applied for storing identification information, such as pre-stored data, and identification information collected by sensors. - According to some embodiments of the present invention, the transmitter may further comprise a display as shown in
FIG. 43 . The display is applied for showing the transmitted identification information. - According to some embodiments of the present invention, the device for obtaining identification information may comprise an image sensor, a microprocessor (for example a MCU) and a power supply, as shown in
FIG. 44 . The image sensor is applied for capturing the visible light signals mitted by the light source. The processor is applied for measuring the varied numbers of bright or dark stripes contained in the captured image and obtaining identification information corresponding to the varied numbers of bright or dark stripes. The power supply is used to provide energy for the processor. - According to some embodiments of the present invention, the device for obtaining identification information from visible light signal having its level changed between a peak level and a bottom level with varied frequencies according to embodiments of the present invention may further comprise a communication module, as shown in
FIG. 44 . The communication module may be wired or wireless, and may be applied for data transmission between the device and other electronic devices, or connecting the device to Internet. - According to some embodiments of the present invention, the transmitter could be a lamp. The transmitter may be an embedded system integrated in other devices, such as an integrated part of a ring, as shown in
FIG. 45 . - According to some embodiments of the present invention, the basic working principle of the system for transmitting and obtaining identification information by visible light signal comprising a light source for transmitting identification information by visible light signal having its level changed between a peak level and a bottom level with varied frequencies at different time points and a device for obtaining identification information from visible light signal from light source according to embodiments of the present invention is as follows: the image sensor in the device captures the visible light signal emitted by the light source and obtain one or more images therefrom, and the processor in the device measures the varied numbers of bright or dark stripes in each image and recovers the identification information corresponding to the varied numbers of bright or dark stripes.
- According to some embodiments of the present invention, the transmitter may be integrated in a wearable electronic device, providing advantages of small in volume, easy to carry, and low in power consumption. The wearable electronic device may be a jewelry, such as a ring, an earrings, a necklace, a watches, etc., or maybe a key, a card, a pen, etc. When the transmitter is integrated in the wearable electronic device, such wearable electronic device can emit visible light signals for transmitting identification information.
- According to some embodiments of the present invention, the transmitter may be integrated in a wearable electronic device, such as a ring powered by a battery, as shown in
FIG. 46 . It should be noted that the ring is only used for illustrating the present invention, but should not be considered as the limitation to the present invention. The battery is used to provide energy for the transmitter. The light source included in the transmitter can emit visible light having its level changed between a peak level and a bottom level with varied frequencies at different time points and each light source may be modulated independently. - According to some embodiments of the present invention, the transmitter may comprise one or more light sources that can emit visible light signals having their level changed between peak levels and bottom levels with varied frequencies at different time points, as shown in
FIG. 47 . One or more exposed regions in each image correspond to the one or more light sources. As described before, the transmitter may be integrated in a wearable electronic device. - According to some embodiments of the present invention, the transmitter may further comprise a driver, as shown in
FIG. 48 . As described before, the transmitter may be integrated in a wearable electronic device. The driver is added to drive the light source. The driver can supply larger driving current or driving voltage to drive high-power light source. In this way, the transmission distance of transmitter can be increased. - According to some embodiments of the present invention, the transmitter may further comprise a battery charging circuit, as shown in
FIG. 49 . As described before, the transmitter may be integrated in a wearable electronic device. The charging circuit is applied not only for charging the battery, but also for limiting the charging current/voltage or checking the temperature, etc., so as to protect the battery from being overcharged or overheated. Optionally, the charging circuit can be powered by an external power source, such as power mains, solar panel, generator, or energy harvesting system, etc. Optionally, the charging circuit can be a wireless charging system. - According to some embodiments of the present invention, the transmitter may further comprise a memory as shown in
FIG. 50 . As described before, the transmitter may be integrated in a wearable electronic device. The memory is applied for storing identification information, such as pre-stored data, and the identification information collected by the image sensor. - According to some embodiments of the present invention, the transmitter may further comprise a sensor as shown in
FIG. 51 . As described before, the transmitter may be integrated in a wearable electronic device. The sensor may be applied for measuring parameters, such as temperature, humidity, voltage and current, or biological parameters, such as human heart rate, body temperature and blood pressure. Such sensor could be a temperature sensor, humidity sensor, optical sensor, sound sensor, accelerometer, pressure sensor, etc. The transmitter may also comprise a voltage/current sensing circuit, which is applied for detecting the state of the battery. If a low battery is detected, the transmitter may inform the user by signal of light, sound, vibration, etc. - According to some embodiments of the present invention, the transmitter may further comprise a network adaptor as shown in
FIG. 52 . As described before, the transmitter may be integrated in a wearable electronic device. The network adapter is applied for data exchange between the device for obtaining identification information from visible light signal and other electronic devices with network capability, e.g., a computer; or sending commands to control other devices. Optionally, the network adapter may use following communication technologies: GPRS, GSM, CDMA, WiFi, Zigbee, Bluetooth, RFID, etc. - According to some embodiments of the present invention, before the transmitter sends the visible light signal, the transmitter may first check the state of the image sensor in the device for obtaining identification information from visible light signal. Optionally, when the image sensor is ready to capture images, the screen of the light emitting component changes the brightness at a certain frequency, and such changes of the brightness can be detected by the photosensitive device (e.g., a sensor) integrated in the transmitter; and then the transmitter starts to send the visible light signal, as shown in
FIG. 53 . Optionally, when the device for obtaining identification information from is a smartphone, a LED flashlight embedded in the smartphone may be used to send signals to the transmitter. Alternatively, the state of the device for obtaining identification information from visible light signals may be detected by other sensors, such as, sound sensor, gravity sensor, acceleration meter, etc. Alternatively, the state of the device for obtaining identification information from visible light signals may be detected by other manners, such as, network adaptors, for example GPRS, GSM, CDMA, WiFi, Zigbee, Bluetooth, RFID, etc. Alternatively, the device for obtaining identification information from visible light signal may be a laptop computer or other electronic devices which have photosensitive component(s). - According to some embodiments of the present invention, the transmitter is integrated in a wearable electronic device. When the wearable electronic device starts to send the visible light signals, its transmitter should be turned on. This can be realized by a hardware-based switch installed on the transmitter, or other sensor-based switch connected to the transmitter. When the wearable electronic device receives the switch-on signal, it starts to send light signal. The above described process is illustrated in
FIG. 54 . - According to some embodiments of the present invention, after a transmitter starts to send the visible light signal, the working flow of the image sensor in the device for obtaining identification information from visible light signal is as follows, as shown in
FIG. 55 : starting the receiving program, initializing the image sensor, setting the exposure parameters, sending request for receiving the visible light signal and waiting for the visible light signal; after receiving the visible light signal, checking the start code, analyzing the captured images, measuring the varied numbers of bright or dark stripes in the images, and recovering the identification information. - According to some embodiments of the present invention, it provides a positioning system based on the visible light signal as shown in
FIG. 56 . Optionally, the device for obtaining identification information from visible light signals comprising an image sensor may be a mobile device containing photosensitive components. Optionally, such mobile device could be a smartphone. The light source (e.g., in a transmitter) may be modulated to emit the above mentioned visible light signal; the emitted visible light signal contains the unique ID of the corresponding light source; an image sensor in the smartphone, captures images of the light sources, measures the varied number of bright or dark stripes in these images, decodes the ID identification information, and compares the decoded ID with the data stored in a map database. In this way, the accurate position of the image sensor can be determined from the position of the light source. - In conclusion, the embodiments of the present invention provide an efficient and effective approach for transmitting/obtaining identification information and positioning by visible light signal, which can achieve indoor positioning, transmit/obtain identification information much faster and more accurate, and the identification information transmitted/obtained may contain more data bits. Further, the embodiments of the present invention effectively avoid the undesirable blinking of the light source detectable by human eyes.
- It should be noted that the aforesaid embodiments are exemplary rather than limiting the present invention, substitute an alternative embodiments may be designed by those skilled in the art without departing from the scope of the claims enclosed. The word “include” does not exclude elements or steps which are present but not listed in the claims. The word “a” or “an” preceding the elements does not exclude the presence of a plurality of such elements. In the apparatus claims that list several components, several ones among these components can be specifically embodied in the same hardware item. The use of such words as first, second, third does not represent any order, which can be simply explained as names.
Claims (30)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/161,968 US20160269112A1 (en) | 2013-04-09 | 2016-05-23 | Methods and Devices for Transmitting/Obtaining Identification Information and Positioning by Visible Light Signal |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201310121480.2 | 2013-04-09 | ||
CN201310121480 | 2013-04-09 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/161,968 Continuation US20160269112A1 (en) | 2013-04-09 | 2016-05-23 | Methods and Devices for Transmitting/Obtaining Identification Information and Positioning by Visible Light Signal |
Publications (1)
Publication Number | Publication Date |
---|---|
US20140372072A1 true US20140372072A1 (en) | 2014-12-18 |
Family
ID=49491285
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/246,503 Expired - Fee Related US8934784B2 (en) | 2013-04-09 | 2014-04-07 | Methods and devices for transmitting/obtaining information by visible light signal |
US14/246,460 Abandoned US20140372072A1 (en) | 2013-04-09 | 2014-04-07 | Methods and Devices for Transmitting/Obtaining Identification Information and Positioning by Visible Light Signal |
US15/161,968 Abandoned US20160269112A1 (en) | 2013-04-09 | 2016-05-23 | Methods and Devices for Transmitting/Obtaining Identification Information and Positioning by Visible Light Signal |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/246,503 Expired - Fee Related US8934784B2 (en) | 2013-04-09 | 2014-04-07 | Methods and devices for transmitting/obtaining information by visible light signal |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/161,968 Abandoned US20160269112A1 (en) | 2013-04-09 | 2016-05-23 | Methods and Devices for Transmitting/Obtaining Identification Information and Positioning by Visible Light Signal |
Country Status (2)
Country | Link |
---|---|
US (3) | US8934784B2 (en) |
CN (10) | CN203519822U (en) |
Cited By (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140285113A1 (en) * | 2013-03-22 | 2014-09-25 | International Mobile Iot Corp. | Illumination control system |
US20150372753A1 (en) * | 2014-06-18 | 2015-12-24 | Qualcomm Incorporated | Transmission of identifiers using visible light communication |
US20160119756A1 (en) * | 2014-08-12 | 2016-04-28 | Abl Ip Holding Llc | System and method for estimating the position and orientation of a mobile communications device in a beacon-based positioning system |
US20160374169A1 (en) * | 2014-12-30 | 2016-12-22 | Sengled Optelecronics Co., Ltd. | Lighting device, smart terminal, lighting-device network-forming system, and methods thereof |
US20170318213A1 (en) * | 2012-12-27 | 2017-11-02 | Panasonic Intellectual Property Corporation of Ame rica | Information communication method |
US9838846B1 (en) * | 2014-08-01 | 2017-12-05 | Google Llc | Extraction of walking direction from device orientation and reconstruction of device orientation during optimization of walking direction |
US20180050264A1 (en) * | 2015-10-27 | 2018-02-22 | Guangdong Virtual Reality Technology Co., Ltd. | Apparatus, methods, and systems for tracking an optical object |
CN108141945A (en) * | 2015-10-15 | 2018-06-08 | 飞利浦照明控股有限公司 | Lighting arrangements, computer program product, mobile communication equipment and lighting system |
US20180180701A1 (en) * | 2016-12-23 | 2018-06-28 | Osram Gmbh | Operating of a transmission deviceof a lighting device comprising an illumination device |
US20180212680A1 (en) * | 2016-04-08 | 2018-07-26 | Industrial Technology Research Institute | Luminaire positioning system and method thereof |
US10209062B1 (en) | 2014-08-01 | 2019-02-19 | Google Llc | Use of offline algorithm to determine location from previous sensor data when location is requested |
US10240995B2 (en) | 2014-08-01 | 2019-03-26 | Google Llc | Construction of a surface of best GPS visibility from passive traces using SLAM for horizontal localization and GPS readings and barometer readings for elevation estimation |
CN109740718A (en) * | 2016-11-19 | 2019-05-10 | 哈尔滨理工大学 | A kind of packaging system based on fringe gray level information hidden function |
US10523876B2 (en) | 2012-12-27 | 2019-12-31 | Panasonic Intellectual Property Corporation Of America | Information communication method |
US20200209712A1 (en) * | 2016-07-14 | 2020-07-02 | Guangdong Virtual Reality Technology Co., Ltd. | Method and device for identifying flashing light source |
US11206723B2 (en) | 2018-01-31 | 2021-12-21 | Minebea Mitsumi Inc. | Remote control device, communication device, variable device and lighting device |
US11408959B2 (en) * | 2017-12-22 | 2022-08-09 | University Of Virginia Patent Foundation | Positioning through multipath reflection |
Families Citing this family (180)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20130249811A1 (en) * | 2012-03-23 | 2013-09-26 | Microsoft Corporation | Controlling a device with visible light |
DE102013014536B4 (en) * | 2013-09-03 | 2015-07-09 | Sew-Eurodrive Gmbh & Co Kg | Method for transmitting information and apparatus for carrying out the method |
CN103607541A (en) * | 2013-12-02 | 2014-02-26 | 吴东辉 | Method and system for obtaining information by way of camera shooting, camera shooting device and information modulation device |
US9813676B2 (en) * | 2013-12-11 | 2017-11-07 | Qualcomm Incorporated | Use of mobile device with image sensor to retrieve information associated with light fixture |
CN103746739B (en) * | 2013-12-30 | 2017-06-20 | 北京国承万通信息科技有限公司 | The method and system of electronic equipment interaction |
CN103808319B (en) * | 2014-02-26 | 2016-08-17 | 上海交通大学 | Based on inertial positioning and the indoor hybrid location system of VLC technology and method |
CN103869284A (en) * | 2014-02-28 | 2014-06-18 | 北京邮电大学 | Visible light communication-based indoor positioning system and method |
US10256905B2 (en) * | 2014-03-25 | 2019-04-09 | Osram Sylvania Inc. | Commissioning a luminaire with location information |
CN103869285B (en) * | 2014-04-01 | 2016-04-06 | 中国人民解放军信息工程大学 | A kind of method and apparatus utilizing visible ray to position |
CN103900560B (en) * | 2014-04-08 | 2016-11-09 | 中国矿业大学 | A kind of indoor positioning devices and methods therefor based on white light/INS combination |
CN104363382B (en) * | 2014-04-24 | 2015-10-14 | 北京国承万通信息科技有限公司 | A kind of method and apparatus utilizing visible light signal transmission/obtaining information |
US20170148310A1 (en) * | 2014-05-12 | 2017-05-25 | Philips Lighting Holding B.V. | Detection of coded light |
TWI511616B (en) * | 2014-05-13 | 2015-12-01 | Yu Sheng So | Controling system based on sychronizing with ac frequency and controling method thereof |
US10330706B2 (en) | 2014-06-04 | 2019-06-25 | Telefonaktiebolaget Lm Ericsson (Publ) | Optical electrical measurement system, a measurement probe and a method therefor |
CN104022824A (en) * | 2014-06-21 | 2014-09-03 | 滁州惠智科技服务有限公司 | LED street lamp system with communication function |
JP6434724B2 (en) * | 2014-07-01 | 2018-12-05 | パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカPanasonic Intellectual Property Corporation of America | Information communication method |
US9735868B2 (en) * | 2014-07-23 | 2017-08-15 | Qualcomm Incorporated | Derivation of an identifier encoded in a visible light communication signal |
US9749782B2 (en) * | 2014-07-31 | 2017-08-29 | Qualcomm Incorporated | Light fixture commissioning using encoded light signals |
KR20180127556A (en) * | 2014-08-18 | 2018-11-28 | 파나소닉 아이피 매니지먼트 가부시키가이샤 | Control system and sensor unit |
CN105450298B (en) * | 2014-08-22 | 2017-12-19 | 扬州艾笛森光电有限公司 | Multidirectional optical positioning method and its device |
CN105444751A (en) * | 2014-08-26 | 2016-03-30 | 深圳市芯通信息科技有限公司 | LED-lamp-based indoor positioning method, device and system |
CN105444752A (en) * | 2014-09-02 | 2016-03-30 | 深圳市芯通信息科技有限公司 | Light source brightness-based indoor positioning method, and apparatus and system thereof |
CN104198989B (en) * | 2014-09-16 | 2017-10-20 | 北京邮电大学 | A kind of mixed mode indoor locating system based on lighting source and Wi Fi signals |
KR102299980B1 (en) * | 2014-10-07 | 2021-09-09 | 삼성전자주식회사 | Method and electronic device for selecting and controlling a home network device |
TWI613615B (en) * | 2014-10-15 | 2018-02-01 | 在地實驗文化事業有限公司 | Guiding system and method |
JP6591262B2 (en) | 2014-11-14 | 2019-10-16 | パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカPanasonic Intellectual Property Corporation of America | REPRODUCTION METHOD, REPRODUCTION DEVICE, AND PROGRAM |
CN104470075B (en) * | 2014-11-20 | 2018-01-09 | 国家电网公司 | The method, apparatus and system of network Street lamps control |
WO2016086399A1 (en) * | 2014-12-05 | 2016-06-09 | 覃政 | Beacon-based visual positioning system and method |
JP6389275B2 (en) * | 2014-12-09 | 2018-09-12 | 旭化成株式会社 | Position / orientation detection device and position / orientation detection program |
CN105783906A (en) * | 2014-12-25 | 2016-07-20 | 财团法人车辆研究测试中心 | Indoor positioning system |
JP6485767B2 (en) * | 2014-12-26 | 2019-03-20 | パナソニックIpマネジメント株式会社 | Lighting apparatus and visible light communication system |
CN104619081A (en) * | 2014-12-30 | 2015-05-13 | 深圳华智测控技术有限公司 | Street lamp information acquisition system, management system, management Cloud platform and acquisition method |
CN104639242B (en) * | 2014-12-30 | 2018-12-28 | 深圳华智测控技术有限公司 | Road lamp identifies acquisition system and method |
CN104661000B (en) * | 2015-03-17 | 2018-01-09 | 珠海横琴华策光通信科技有限公司 | Alignment system, based on the image of located space come the method and apparatus that is positioned |
CN104914407B (en) * | 2015-05-20 | 2017-09-29 | 中国科学院深圳先进技术研究院 | A kind of indoor positioning device and localization method |
US9883351B2 (en) | 2015-03-25 | 2018-01-30 | Shenzhen Institutes Of Advanced Technology Chinese Academy Of Sciences | Indoor positioning device and indoor positioning method |
CN104833353A (en) * | 2015-04-13 | 2015-08-12 | 苏州天趣信息科技有限公司 | Indoor positioning method and system based on ASCII code |
CN106153035B (en) * | 2015-04-28 | 2019-07-23 | 北京智谷睿拓技术服务有限公司 | Information processing method and equipment |
DE202015102756U1 (en) * | 2015-05-28 | 2016-08-31 | Tridonic Gmbh & Co Kg | Illumination system with transmission of signals via light |
JP6593681B2 (en) * | 2015-06-02 | 2019-10-23 | パナソニックIpマネジメント株式会社 | Modulator, light emitting device, and light emitting system |
CN104966415A (en) * | 2015-06-15 | 2015-10-07 | 上海交通大学 | Vehicle safety control method and system based on LED visible light communication technology |
JP6540271B2 (en) * | 2015-06-24 | 2019-07-10 | カシオ計算機株式会社 | Information decryption apparatus, information decryption method and program |
CN105068047A (en) * | 2015-07-01 | 2015-11-18 | 北京理工大学 | Indoor visible light positioning and information push method based on frequency-shift keying |
US10348403B2 (en) * | 2015-07-27 | 2019-07-09 | Signify Holding B.V. | Light emitting device for generating light with embedded information |
CN105119636B (en) * | 2015-07-28 | 2017-09-15 | 深圳市文鼎创数据科技有限公司 | Information sending, receiving method and information are sent, reception device |
GB2557776B (en) * | 2015-08-04 | 2021-09-29 | Ford Global Tech Llc | In-vehicle device position determination |
CN105227244B (en) * | 2015-08-26 | 2017-11-28 | 联想(北京)有限公司 | A kind of signaling method, signal acceptance method, send equipment and receiving device |
CN106483527B (en) * | 2015-08-28 | 2020-01-17 | 中国电信股份有限公司 | Positioning method and system based on visible light and mobile terminal |
CN105262538B (en) * | 2015-09-07 | 2019-04-26 | 尹军 | A kind of optical information positioning system |
CN105306141B (en) * | 2015-09-18 | 2017-03-22 | 北京理工大学 | Indoor visible light asynchronous location method using camera |
CN105162520A (en) * | 2015-10-21 | 2015-12-16 | 北京联海科技有限公司 | Automatic identification method and information service system based on visible light illumination |
CN105388456B (en) * | 2015-10-21 | 2017-08-25 | 宁波大学 | The many array element 3-D wireless alignment systems of visible light communication |
CN105515657B (en) * | 2015-11-19 | 2018-01-02 | 广东顺德中山大学卡内基梅隆大学国际联合研究院 | A kind of visible light camera communication system using LED lamp MIMO array framework |
CN105430289B (en) * | 2015-11-19 | 2018-05-15 | 广东顺德中山大学卡内基梅隆大学国际联合研究院 | A kind of method based on cmos image sensor detection LED flicker frequencies |
TWI578722B (en) * | 2015-11-23 | 2017-04-11 | 財團法人資訊工業策進會 | Optical communication system and optical communication transmission device |
CN105509734A (en) * | 2015-11-30 | 2016-04-20 | 上海航天测控通信研究所 | Indoor positioning method and system based on visible light |
CN105471501A (en) * | 2015-12-02 | 2016-04-06 | 苏州华之杰电讯有限公司 | Digital communication method based on visible light |
CN106851551A (en) * | 2015-12-04 | 2017-06-13 | 中国移动通信集团公司 | A kind of location information acquisition method and device |
CN105973223A (en) * | 2015-12-30 | 2016-09-28 | 乐视移动智能信息技术(北京)有限公司 | Indoor navigation method and device thereof |
CN106931959A (en) * | 2015-12-31 | 2017-07-07 | 深圳市金叶光线发展有限公司 | A kind of indoor visible light communication alignment system |
CN105430851B (en) * | 2016-01-05 | 2017-12-22 | 镇江市高等专科学校 | A kind of intelligent landscape control system |
CN105430850B (en) * | 2016-01-05 | 2017-12-22 | 镇江市高等专科学校 | It is a kind of that there is the intelligent landscape control system for viewing and admiring pattern more |
CN105740791A (en) * | 2016-01-26 | 2016-07-06 | 哈尔滨工业大学 | Vision-based target system for multi-joint position identification of moving object |
CN105548964B (en) * | 2016-01-28 | 2016-10-26 | 北京理工大学 | A kind of indoor visible light localization method based on source imaging |
JP6554237B2 (en) * | 2016-02-04 | 2019-07-31 | シグニファイ ホールディング ビー ヴィ | Coded light transmitter, coded light receiver, coded light transmission method, and coded light reception method |
US20170237486A1 (en) * | 2016-02-11 | 2017-08-17 | West Pharmaceutical Services, Inc. | Visual communication between mobile communication devices and drug delivery devices |
CN107171924A (en) * | 2016-03-07 | 2017-09-15 | 中国电信股份有限公司 | The information interacting method and system and relevant device realized based on strobe light |
CN105866736B (en) * | 2016-04-05 | 2018-07-06 | 华中科技大学 | A kind of indoor orientation method based on light pattern |
CN105891778B (en) * | 2016-04-05 | 2018-10-30 | 北京国承万通信息科技有限公司 | Position beam delivery system, method and indoor locating system |
CN107270906A (en) * | 2016-04-08 | 2017-10-20 | 北京黎阳之光科技有限公司 | A kind of personnel's precise positioning system based on WIFI |
TWI625535B (en) * | 2016-04-08 | 2018-06-01 | 財團法人工業技術研究院 | Positioning system and positioning method by visible light |
CN105979472A (en) * | 2016-04-18 | 2016-09-28 | 清华大学 | Method and system for cooperative work of visible light positioning and bluetooth communication |
KR20190008253A (en) * | 2016-05-23 | 2019-01-23 | 인터디지털 씨이 페턴트 홀딩스 | Method and apparatus for indoor location estimation |
CN105898924A (en) * | 2016-05-30 | 2016-08-24 | 京东方科技集团股份有限公司 | Fresh food lamp, mobile terminal, product information determination system and determination method |
CA3025388C (en) * | 2016-06-02 | 2024-01-02 | Eaton Intelligent Power Limited | Asset tracking using visible light communication |
CN105911522A (en) * | 2016-06-20 | 2016-08-31 | 复旦大学 | Visible light communication-based accurate positioning system |
CN106209230A (en) * | 2016-07-11 | 2016-12-07 | 中国科学院上海技术物理研究所 | A kind of visible light communication system identifying striations code based on APP |
CN106156769A (en) * | 2016-07-14 | 2016-11-23 | 上海摩象网络科技有限公司 | The multi-targets recognition technology of feature based frequency optical system |
WO2018032488A1 (en) * | 2016-08-19 | 2018-02-22 | 广州艾若博机器人科技有限公司 | Map building method and apparatus based on light emitting device, and correction method and apparatus |
US10158425B2 (en) * | 2016-09-14 | 2018-12-18 | Qualcomm Incorporated | Methods and systems for adjusting an orientation of a light sensor |
US10541752B2 (en) * | 2016-09-22 | 2020-01-21 | Signify Holding B.V. | Associating a mobile device with a group |
US10284293B2 (en) | 2016-09-23 | 2019-05-07 | Qualcomm Incorporated | Selective pixel activation for light-based communication processing |
DE102016219099A1 (en) * | 2016-09-30 | 2018-04-05 | Robert Bosch Gmbh | Optical sensor for distance and / or speed measurement, system for mobility monitoring of autonomous vehicles and method for monitoring the mobility of autonomous vehicles |
TWI699639B (en) * | 2016-10-13 | 2020-07-21 | 原相科技股份有限公司 | Charging system and charging method |
CN106338712A (en) * | 2016-10-21 | 2017-01-18 | 泉州装备制造研究所 | Visible light indoor positioning method and system based on camera communication |
CN106547272B (en) * | 2016-10-26 | 2019-12-03 | 北京京东尚科信息技术有限公司 | The method and apparatus for determining equipment movement routine |
CN106597374B (en) * | 2016-11-09 | 2019-05-21 | 北京大学 | A kind of indoor visible light localization method and system based on camera shooting frame analysis |
CN110114988B (en) * | 2016-11-10 | 2021-09-07 | 松下电器(美国)知识产权公司 | Transmission method, transmission device, and recording medium |
CN106788721B (en) * | 2016-11-15 | 2019-06-21 | 武汉邮电科学研究院 | A kind of visible light communication system and method based on auxiliary positioning |
EP3336574B1 (en) | 2016-12-13 | 2020-05-06 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | System for determining a position of a tag and corresponding method |
CN106501771B (en) * | 2016-12-14 | 2024-02-27 | 北京国承万通信息科技有限公司 | Positioning optical signal transmitting system, method and positioning system |
CN106737687A (en) * | 2017-01-17 | 2017-05-31 | 暨南大学 | Indoor Robot system based on visible ray location navigation |
CN106900122B (en) * | 2017-01-22 | 2018-06-29 | 中山市华艺灯饰照明股份有限公司 | It is a kind of can precise positioning interior lighting system |
CN106888052A (en) * | 2017-02-15 | 2017-06-23 | 深圳前沿通信技术开发有限公司 | The communication means of visible ray indoor positioning, device and system |
JP2020509535A (en) * | 2017-02-16 | 2020-03-26 | シグニファイ ホールディング ビー ヴィSignify Holding B.V. | System for optical communication with lighting devices |
CN106932770A (en) * | 2017-02-18 | 2017-07-07 | 广东顺德中山大学卡内基梅隆大学国际联合研究院 | A kind of indoor locating system and method based on LED |
CN107104730B (en) * | 2017-03-07 | 2019-08-02 | 广东顺德中山大学卡内基梅隆大学国际联合研究院 | Fringe counting method and infomation detection algorithm for visual light imaging positioning |
CN106877929B (en) * | 2017-03-14 | 2019-05-31 | 大连海事大学 | A kind of mobile terminal camera visible light communication method and system of compatible multi-model |
CN108629384A (en) * | 2017-03-16 | 2018-10-09 | 上海酷蓝电子科技有限公司 | A kind of LIFI indoor locating systems based on image recognition |
CN106921434B (en) * | 2017-04-05 | 2019-05-21 | 北京大学 | A kind of the location information transmitting and detection method of novel visible indoor locating system |
CN107203731B (en) * | 2017-04-18 | 2020-03-10 | 东莞信大融合创新研究院 | Method and device for generating label set and method and device for scanning label set |
CN107222258B (en) * | 2017-04-18 | 2020-10-20 | 东莞信大融合创新研究院 | Data acquisition method, data sending device and data transmission system |
CN107196705B (en) * | 2017-04-18 | 2019-08-30 | 东莞信大融合创新研究院 | A kind of data demodulation method and device based on visible light communication |
CN107144816B (en) * | 2017-04-19 | 2020-01-10 | 北京大学 | Novel LED array and indoor visible light positioning method and system based on same |
CN107255524B (en) * | 2017-04-26 | 2020-03-24 | 广东顺德中山大学卡内基梅隆大学国际联合研究院 | Method for detecting frequency of LED light source based on mobile equipment camera |
CN108810440A (en) * | 2017-04-26 | 2018-11-13 | 宁波观原网络科技有限公司 | The realization method and system of video digital watermark steganography |
WO2018232613A1 (en) * | 2017-06-21 | 2018-12-27 | 广东虚拟现实科技有限公司 | Light source identification method and device |
CN107479079A (en) * | 2017-07-13 | 2017-12-15 | 临沂大学 | A kind of method closed based on PDR and LED junction |
CN107330939B (en) * | 2017-07-14 | 2020-08-28 | 中国矿业大学 | Visible light positioning system and method based on mine roadway lamp |
CN108605081B (en) * | 2017-07-18 | 2020-09-01 | 杭州他若信息科技有限公司 | Intelligent target tracking |
CN107370538B (en) * | 2017-07-20 | 2019-08-06 | 西安电子科技大学 | Radio data transmission method, camera and system |
US10495467B2 (en) | 2017-07-28 | 2019-12-03 | Qualcomm Incorporated | Positioning with interleaved VLC signals |
CN107465457A (en) * | 2017-08-07 | 2017-12-12 | 北京智慧光达通信科技有限公司 | A kind of method for reception and the decoding that visible light communication is realized using android mobile phone cameras |
CN107465459B (en) * | 2017-08-29 | 2020-01-03 | 北京邮电大学 | Indoor visible light positioning method based on color space intensity distribution |
JP7019798B2 (en) * | 2017-08-30 | 2022-02-15 | シャンシー ホワイハウ インフォメーション テクノロジー カンパニー リミテッド | Optical communication devices and systems, and corresponding information transmission and reception methods. |
CN108344974B (en) * | 2017-09-29 | 2021-12-31 | 中山大学 | Sound wave signal coding method for sound wave indoor positioning system |
CN107800477A (en) * | 2017-10-12 | 2018-03-13 | 漳州立达信光电子科技有限公司 | A kind of visible light communication method of reseptance based on camera |
CN107991649A (en) * | 2017-10-31 | 2018-05-04 | 吉林大学 | Visible ray indoor positioning device |
CN107864013B (en) * | 2017-11-10 | 2019-09-10 | 深圳市光域物联科技有限公司 | Self adaptive imaging Position Fixing Navigation System and method towards automatic driving vehicle |
CN107979418A (en) * | 2017-11-22 | 2018-05-01 | 吴东辉 | Determine that its client corresponds to the AR method and systems of id based on mobile phone flashlight |
CN107831921B (en) * | 2017-11-24 | 2020-01-10 | 深圳多哚新技术有限责任公司 | Method, device and system for determining corresponding relation between handle space position and code |
CN108199770B (en) * | 2017-12-08 | 2019-12-10 | 武汉邮电科学研究院 | Auxiliary positioning system and method based on visible light communication |
CN107944326B (en) * | 2017-12-12 | 2021-03-30 | 来飞光通信有限公司 | Data acquisition method, data processing method and system |
CN108332748B (en) * | 2017-12-18 | 2022-06-24 | 中国电子科技集团公司电子科学研究院 | Indoor visible light positioning method and device |
CN109936694B (en) * | 2017-12-19 | 2020-12-11 | 陕西外号信息技术有限公司 | Optical communication device comprising reference light source and corresponding information transmission and reception method |
CN111492596A (en) * | 2017-12-19 | 2020-08-04 | 松下电器(美国)知识产权公司 | Transmission method, reception method, transmission device, and reception device |
CN109934319B (en) * | 2017-12-19 | 2021-06-15 | 陕西外号信息技术有限公司 | Optical communication device and corresponding anti-counterfeiting method and system |
CN109936713B (en) * | 2017-12-19 | 2020-08-21 | 陕西外号信息技术有限公司 | Method and apparatus for decoding information conveyed by a light source |
TWI640796B (en) * | 2018-01-08 | 2018-11-11 | 凱祿光電股份有限公司 | Replaceable light emitting module capable of transmitting a wireless signal, navigation system, and navigation method thereof |
JP7357624B2 (en) * | 2018-01-26 | 2023-10-06 | プロフジー | Method and apparatus for processing signals from event-based sensors |
TWI636274B (en) * | 2018-03-06 | 2018-09-21 | 宏達國際電子股份有限公司 | A positioning system and a positioning method |
CN108449138B (en) * | 2018-03-07 | 2023-08-22 | 华南理工大学 | M sequence visual detection method and system for visible light communication |
CN108734101A (en) * | 2018-04-17 | 2018-11-02 | 上海徕尼智能科技有限公司 | A kind of destination apparatus, object detection method and electronic equipment |
CN108871420A (en) * | 2018-04-25 | 2018-11-23 | 北京全电智领科技有限公司 | Device and method is surveyed in lightwave communication alignment fixtures physical examination |
CN108650026A (en) * | 2018-05-08 | 2018-10-12 | 深圳清创新科技有限公司 | Visible light positioning device and system suitable for a wide range of visible light-seeking |
CN110471402A (en) * | 2018-05-09 | 2019-11-19 | 陕西外号信息技术有限公司 | The system and method that the machine for capableing of autonomous is guided |
CN110471403B (en) * | 2018-05-09 | 2023-11-03 | 北京外号信息技术有限公司 | Method for guiding an autonomously movable machine by means of an optical communication device |
CN108768524A (en) * | 2018-06-10 | 2018-11-06 | 广州光瀚科技有限公司 | Lighting apparatus control method and device |
CN108833013B (en) * | 2018-06-11 | 2020-02-21 | 北京科技大学 | Visible light transceiving method and system |
CN109297489B (en) * | 2018-07-06 | 2022-08-02 | 广东数相智能科技有限公司 | Indoor navigation method based on user characteristics, electronic equipment and storage medium |
CN108966462B (en) * | 2018-08-14 | 2020-01-14 | 深圳市银河风云网络系统股份有限公司 | Method and device for determining physical position of lamp |
CN109188357B (en) * | 2018-08-28 | 2023-04-14 | 上海宽创国际文化科技股份有限公司 | Indoor positioning system and method based on structured light array |
CN109387810A (en) * | 2018-09-10 | 2019-02-26 | 珠海横琴华策光通信科技有限公司 | A kind of indoor locating system |
CN109063212A (en) * | 2018-09-28 | 2018-12-21 | 西北工业大学 | A kind of intelligence auxiliary purchase guiding system and method based on visible light communication |
DE102018217148A1 (en) * | 2018-10-08 | 2020-04-09 | Osram Gmbh | LIGHTING SYSTEM WITH VLC DATA TRANSMISSION AND METHOD |
CN111062228A (en) * | 2018-10-16 | 2020-04-24 | 华北电力大学扬中智能电气研究中心 | LED array signal detection method and device |
CN109784119B (en) * | 2018-12-11 | 2021-10-26 | 北京天立秀科技有限公司 | Optical code generating device, decoding device, encoding method, decoding method, and system |
CN109655790A (en) * | 2018-12-18 | 2019-04-19 | 天津大学 | Multi-target detection and identification system and method based on indoor LED light source |
CN109596067B (en) * | 2018-12-25 | 2020-08-25 | 东南大学 | Three-dimensional laser scanning visible light confirmation method for steel mill driving scheduling |
CN109596317B (en) * | 2018-12-25 | 2021-01-22 | 新华三技术有限公司 | Detection method and device for panel lamp |
CN109671037B (en) * | 2018-12-27 | 2022-09-06 | 中国科学技术大学 | Light source identification method and system for visible light communication |
CN109725318B (en) * | 2018-12-29 | 2021-08-27 | 百度在线网络技术(北京)有限公司 | Signal processing method and device, active sensor and storage medium |
CN109636850B (en) * | 2019-01-14 | 2021-02-19 | 刘翔宇 | Visible light positioning method for indoor intelligent lamp |
CN109842875A (en) * | 2019-03-28 | 2019-06-04 | 贵州省计量测试院 | A kind of calamity emergency Public Information Issuance System based on visible light communication technology |
CN109962993A (en) * | 2019-04-02 | 2019-07-02 | 乐高乐佳(北京)信息技术有限公司 | Address method, apparatus, system and the computer readable storage medium of positioning |
CA3157554A1 (en) * | 2019-05-14 | 2020-11-19 | Wenjing Wu | Optical networking method, optical communication device, and optical networking system |
CN110133685B (en) * | 2019-05-22 | 2023-04-14 | 吉林大学 | OCC-based street lamp auxiliary mobile phone detailed positioning communication system |
CN110661775A (en) * | 2019-07-13 | 2020-01-07 | 中国矿业大学(北京) | Underground personnel identification positioning and communication system based on miner lamp with special structure |
CN110532860A (en) * | 2019-07-18 | 2019-12-03 | 华南理工大学 | The modulation of visible light bar code and recognition methods based on RGB LED lamp |
CN110440808A (en) * | 2019-08-13 | 2019-11-12 | Oppo(重庆)智能科技有限公司 | Indoor orientation method, system and device based on visible light communication |
CN110531318B (en) * | 2019-09-03 | 2021-04-30 | 北京理工大学 | Method for indoor positioning extension of light-emitting unit ID (identity) in visible light imaging |
CN112532316B (en) * | 2019-09-04 | 2022-05-13 | Oppo广东移动通信有限公司 | LiFi module transmission direction adjusting method and device, mobile terminal and storage medium |
CN110726971B (en) * | 2019-10-22 | 2021-11-12 | Oppo(重庆)智能科技有限公司 | Visible light positioning method, device, terminal and storage medium |
CN110736964A (en) * | 2019-10-25 | 2020-01-31 | 厦门市致创能源技术有限公司 | Automatic street lamp deployment and positioning system and street lamp deployment and positioning method |
CN111405735B (en) * | 2020-04-20 | 2022-04-22 | 深圳市纽尔科技有限公司 | Automatic focus positioning type stage light-following tracking system and use method thereof |
DE102020002848A1 (en) | 2020-05-11 | 2020-07-16 | Daimler Ag | Method of detecting presence |
EP3930218B1 (en) * | 2020-06-23 | 2024-07-31 | IMRA Europe S.A.S. | Vlc in streets |
CN112073577B (en) * | 2020-08-19 | 2021-08-24 | 深圳移航通信技术有限公司 | Terminal control method and device, terminal equipment and storage medium |
CN112164113B (en) * | 2020-09-17 | 2022-02-25 | 北京邮电大学 | Novel visible light communication auxiliary perspective four-line method in indoor positioning |
CN112284392A (en) * | 2020-10-16 | 2021-01-29 | 拓能英特森通信服务(北京)有限公司 | Indoor positioning system |
CN112333798B (en) * | 2020-11-05 | 2022-01-18 | 珠海格力电器股份有限公司 | Control method and device of intelligent equipment |
US11522608B1 (en) | 2021-06-29 | 2022-12-06 | Cisco Technology, Inc. | Geospatial coordinate provisioning using LiFi |
CN113607158A (en) * | 2021-08-05 | 2021-11-05 | 中铁工程装备集团有限公司 | Visual identification matching positioning method and system for flat light source based on visible light communication |
CN113959439B (en) * | 2021-10-21 | 2024-03-19 | 重庆邮电大学 | Indoor high-precision visible light positioning method and system under sparse light source |
CN113674344A (en) * | 2021-10-22 | 2021-11-19 | 深圳市莱法照明通信科技有限公司 | Industrial camera-based illumination light positioning method and device and related equipment |
CN114061588A (en) * | 2021-11-16 | 2022-02-18 | 郑州轻工业大学 | Route determining method and system based on optical communication |
CN114189813A (en) * | 2021-11-30 | 2022-03-15 | 中国人民解放军战略支援部队信息工程大学 | Target positioning method and system based on visible light communication |
CN115065409B (en) * | 2022-04-28 | 2023-08-22 | 浙江大学湖州研究院 | Visible light indoor communication and positioning integrated system based on wavelength division multiplexing |
CN115189769B (en) * | 2022-06-30 | 2023-07-18 | 乐鑫信息科技(上海)股份有限公司 | Coding method for visible light communication |
CN116865855B (en) * | 2023-06-05 | 2024-06-11 | 苏州大学 | Adaptive dimming receiving, transmitting and communication system and method based on optical camera |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040161246A1 (en) * | 2001-10-23 | 2004-08-19 | Nobuyuki Matsushita | Data communication system, data transmitter and data receiver |
US20100247112A1 (en) * | 2009-03-31 | 2010-09-30 | Soo-Young Chang | System and Method for Visible Light Communications |
US20130015785A1 (en) * | 2011-07-15 | 2013-01-17 | Panasonic Corporation | Illumination light communication device, and illumination apparatus and system including same |
US20130330088A1 (en) * | 2012-05-24 | 2013-12-12 | Panasonic Corporation | Information communication device |
Family Cites Families (25)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4243684B2 (en) * | 2003-10-07 | 2009-03-25 | 独立行政法人産業技術総合研究所 | Walking motion detection processing device and walking motion detection processing method |
US7600613B2 (en) * | 2003-10-31 | 2009-10-13 | Otis Elevator Company | RFID and low resolution CCD sensor based positioning system |
KR101345357B1 (en) * | 2006-03-02 | 2013-12-30 | 코닌클리케 필립스 엔.브이. | A lighting device |
KR101376375B1 (en) * | 2007-07-20 | 2014-03-20 | 한국과학기술원 | Method and apparatus for indication status of mobile node in wireless local area network using visible light communication |
CN101430204B (en) * | 2007-11-09 | 2011-01-19 | 北京爱国者妙笔数码科技有限责任公司 | System for implementing area navigation through reading image code |
JP5459179B2 (en) * | 2010-05-14 | 2014-04-02 | カシオ計算機株式会社 | Moving state discriminating apparatus, moving state discriminating method and program |
CN102404897A (en) * | 2010-09-10 | 2012-04-04 | 上海三思电子工程有限公司 | Intelligent control device of light-emitting diode (LED) street lamps with querying and identifying functions and intelligent control method |
CN102288940A (en) * | 2011-05-16 | 2011-12-21 | 李漪阳 | Lighting light-emitting diode (LED) based spatial positioning method |
KR101940790B1 (en) * | 2011-05-18 | 2019-04-17 | 한국전자통신연구원 | Optical communication interface device of textile-structure and optical communication interface system of textile-structure |
CN102215068A (en) * | 2011-06-03 | 2011-10-12 | 江南大学 | Wireless automatic navigation system based on visible light communication |
US9287976B2 (en) * | 2011-07-26 | 2016-03-15 | Abl Ip Holding Llc | Independent beacon based light position system |
US8457502B2 (en) * | 2011-07-26 | 2013-06-04 | ByteLight, Inc. | Method and system for modulating a beacon light source in a light based positioning system |
JP2013046117A (en) * | 2011-08-22 | 2013-03-04 | Outstanding Technology:Kk | Status information gathering device |
CN102419180B (en) * | 2011-09-02 | 2014-01-01 | 无锡智感星际科技有限公司 | Indoor positioning method based on inertial navigation system and WIFI (wireless fidelity) |
CN202647238U (en) * | 2012-03-29 | 2013-01-02 | 佛山市国星光电股份有限公司 | LED (Light Emitting Diode) light source module for visible-light communication |
JP5936902B2 (en) * | 2012-04-13 | 2016-06-22 | 株式会社東芝 | Transmission system, transmission device and reception device |
CN102749072B (en) * | 2012-06-15 | 2014-11-05 | 易程科技股份有限公司 | Indoor positioning method, indoor positioning apparatus and indoor positioning system |
CN102833674A (en) * | 2012-08-10 | 2012-12-19 | 章晓芸 | Network access system and network access method |
CN102829775A (en) * | 2012-08-29 | 2012-12-19 | 成都理想境界科技有限公司 | Indoor navigation method, systems and equipment |
CN102901512B (en) * | 2012-11-05 | 2016-12-21 | 珠海横琴华策光通信科技有限公司 | Guider and system |
CN102901948B (en) * | 2012-11-05 | 2016-08-03 | 珠海横琴华策光通信科技有限公司 | Indoor positioning Apparatus and system |
CN102901947B (en) * | 2012-11-05 | 2015-07-01 | 珠海横琴华策光通信科技有限公司 | Positioning system and method |
CN102904640B (en) * | 2012-11-05 | 2016-08-10 | 珠海横琴华策光通信科技有限公司 | The update method of geocoding and updating device |
CN102967307B (en) * | 2012-11-23 | 2015-04-15 | 清华大学 | Positioning and navigation system based on indoor illumination |
US9407367B2 (en) * | 2013-04-25 | 2016-08-02 | Beijing Guo Cheng Wan Tong Information Co. Ltd | Methods and devices for transmitting/obtaining information by visible light signals |
-
2013
- 2013-06-09 CN CN201320335810.3U patent/CN203519822U/en not_active Expired - Lifetime
- 2013-06-09 CN CN201320335796.7U patent/CN203574655U/en not_active Expired - Lifetime
- 2013-06-09 CN CN201310231442.2A patent/CN103383446B/en not_active Expired - Fee Related
- 2013-06-09 CN CN2013102321394A patent/CN103427902A/en active Pending
- 2013-12-03 CN CN201310645568.4A patent/CN103825655B/en not_active Expired - Fee Related
-
2014
- 2014-04-07 US US14/246,503 patent/US8934784B2/en not_active Expired - Fee Related
- 2014-04-07 US US14/246,460 patent/US20140372072A1/en not_active Abandoned
- 2014-04-09 CN CN201410141223.XA patent/CN103916185B/en not_active Expired - Fee Related
- 2014-04-09 CN CN201410143511.9A patent/CN103940419B/en not_active Expired - Fee Related
- 2014-04-09 CN CN201410141189.6A patent/CN103983262A/en active Pending
- 2014-04-09 CN CN201410141402.3A patent/CN104243029B/en not_active Expired - Fee Related
- 2014-04-09 CN CN201410141403.8A patent/CN104243030B/en not_active Expired - Fee Related
-
2016
- 2016-05-23 US US15/161,968 patent/US20160269112A1/en not_active Abandoned
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040161246A1 (en) * | 2001-10-23 | 2004-08-19 | Nobuyuki Matsushita | Data communication system, data transmitter and data receiver |
US20100247112A1 (en) * | 2009-03-31 | 2010-09-30 | Soo-Young Chang | System and Method for Visible Light Communications |
US20130015785A1 (en) * | 2011-07-15 | 2013-01-17 | Panasonic Corporation | Illumination light communication device, and illumination apparatus and system including same |
US20130330088A1 (en) * | 2012-05-24 | 2013-12-12 | Panasonic Corporation | Information communication device |
Cited By (59)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10531009B2 (en) | 2012-12-27 | 2020-01-07 | Panasonic Intellectual Property Corporation Of America | Information communication method |
US20190253599A1 (en) * | 2012-12-27 | 2019-08-15 | Panasonic Intellectual Property Corporation Of America | Information communication method |
US12088923B2 (en) | 2012-12-27 | 2024-09-10 | Panasonic Intellectual Property Corporation Of America | Information communication method |
US11659284B2 (en) | 2012-12-27 | 2023-05-23 | Panasonic Intellectual Property Corporation Of America | Information communication method |
US11490025B2 (en) | 2012-12-27 | 2022-11-01 | Panasonic Intellectual Property Corporation Of America | Information communication method |
US11165967B2 (en) | 2012-12-27 | 2021-11-02 | Panasonic Intellectual Property Corporation Of America | Information communication method |
US10887528B2 (en) | 2012-12-27 | 2021-01-05 | Panasonic Intellectual Property Corporation Of America | Information communication method |
US10368006B2 (en) | 2012-12-27 | 2019-07-30 | Panasonic Intellectual Property Corporation Of America | Information communication method |
US10368005B2 (en) | 2012-12-27 | 2019-07-30 | Panasonic Intellectual Property Corporation Of America | Information communication method |
US10051194B2 (en) * | 2012-12-27 | 2018-08-14 | Panasonic Intellectual Property Corporation Of America | Information communication method |
US10742891B2 (en) | 2012-12-27 | 2020-08-11 | Panasonic Intellectual Property Corporation Of America | Information communication method |
US10531010B2 (en) | 2012-12-27 | 2020-01-07 | Panasonic Intellectual Property Corporation Of America | Information communication method |
US20180309921A1 (en) * | 2012-12-27 | 2018-10-25 | Panasonic Intellectual Property Corporation Of America | Information communication method |
US20170318213A1 (en) * | 2012-12-27 | 2017-11-02 | Panasonic Intellectual Property Corporation of Ame rica | Information communication method |
US10523876B2 (en) | 2012-12-27 | 2019-12-31 | Panasonic Intellectual Property Corporation Of America | Information communication method |
US10516832B2 (en) | 2012-12-27 | 2019-12-24 | Panasonic Intellectual Property Corporation Of America | Information communication method |
US10455161B2 (en) | 2012-12-27 | 2019-10-22 | Panasonic Intellectual Property Corporation Of America | Information communication method |
US10616496B2 (en) * | 2012-12-27 | 2020-04-07 | Panasonic Intellectual Property Corporation Of America | Information communication method |
US10205887B2 (en) * | 2012-12-27 | 2019-02-12 | Panasonic Intellectual Property Corporation Of America | Information communication method |
US10666871B2 (en) | 2012-12-27 | 2020-05-26 | Panasonic Intellectual Property Corporation Of America | Information communication method |
US9807857B2 (en) * | 2013-03-22 | 2017-10-31 | International Mobile Iot Corp. | Illumination control system |
US20140285113A1 (en) * | 2013-03-22 | 2014-09-25 | International Mobile Iot Corp. | Illumination control system |
US10009100B2 (en) * | 2014-06-18 | 2018-06-26 | Qualcomm Incorporated | Transmission of identifiers using visible light communication |
US10382129B2 (en) | 2014-06-18 | 2019-08-13 | Qualcomm Incorporated | Transmission of identifiers using visible light communication |
US20150372753A1 (en) * | 2014-06-18 | 2015-12-24 | Qualcomm Incorporated | Transmission of identifiers using visible light communication |
US10209062B1 (en) | 2014-08-01 | 2019-02-19 | Google Llc | Use of offline algorithm to determine location from previous sensor data when location is requested |
US20180084387A1 (en) * | 2014-08-01 | 2018-03-22 | Google Llc | Determining Location Based on Measurements of Device Orientation |
US10976161B2 (en) | 2014-08-01 | 2021-04-13 | Google Llc | Use of offline algorithm to determine location from previous sensor data when location is requested |
US9838846B1 (en) * | 2014-08-01 | 2017-12-05 | Google Llc | Extraction of walking direction from device orientation and reconstruction of device orientation during optimization of walking direction |
US10240995B2 (en) | 2014-08-01 | 2019-03-26 | Google Llc | Construction of a surface of best GPS visibility from passive traces using SLAM for horizontal localization and GPS readings and barometer readings for elevation estimation |
US11525678B2 (en) | 2014-08-01 | 2022-12-13 | Google Llc | Use of offline algorithm to determine location from previous sensor data when location is requested |
US20160119747A1 (en) * | 2014-08-12 | 2016-04-28 | Abl Ip Holding Llc | System and method for estimating the position and orientation of a mobile communications device in a beacon-based positioning system |
US10001547B2 (en) * | 2014-08-12 | 2018-06-19 | Abl Ip Holding Llc | System and method for estimating the position and orientation of a mobile communications device in a beacon-based positioning system |
US9989624B2 (en) * | 2014-08-12 | 2018-06-05 | Abl Ip Holding Llc | System and method for estimating the position and orientation of a mobile communications device in a beacon-based positioning system |
US20160195605A1 (en) * | 2014-08-12 | 2016-07-07 | Abl Ip Holding Llc | System and method for estimating the position and orientation of a mobile communications device in a beacon-based positioning system |
US20160170007A1 (en) * | 2014-08-12 | 2016-06-16 | Abl Ip Holding Llc | System and method for estimating the position and orientation of a mobile communications device in a beacon-based positioning system |
US9846222B2 (en) * | 2014-08-12 | 2017-12-19 | Abl Ip Holding Llc | System and method for estimating the position and orientation of a mobile communications device in a beacon-based positioning system |
US20160119755A1 (en) * | 2014-08-12 | 2016-04-28 | Abl Ip Holding Llc | System and method for estimating the position and orientation of a mobile communications device in a beacon-based positioning system |
US9791543B2 (en) | 2014-08-12 | 2017-10-17 | Abl Ip Holding Llc | System and method for estimating the position and orientation of a mobile communications device in a beacon-based positioning system |
US10578705B2 (en) | 2014-08-12 | 2020-03-03 | Abl Ip Holding Llc | System and method for estimating the position and orientation of a mobile communications device in a beacon-based positioning system |
US20160119756A1 (en) * | 2014-08-12 | 2016-04-28 | Abl Ip Holding Llc | System and method for estimating the position and orientation of a mobile communications device in a beacon-based positioning system |
US9791542B2 (en) * | 2014-08-12 | 2017-10-17 | Abl Ip Holding Llc | System and method for estimating the position and orientation of a mobile communications device in a beacon-based positioning system |
US20160195604A1 (en) * | 2014-08-12 | 2016-07-07 | Abl Ip Holding Llc | System and method for estimating the position and orientation of a mobile communications device in a beacon-based positioning system |
US9743477B2 (en) * | 2014-12-30 | 2017-08-22 | Sengled Optoelectronics Co., Ltd. | Lighting device, smart terminal, lighting-device network-forming system, and methods thereof |
US20160374169A1 (en) * | 2014-12-30 | 2016-12-22 | Sengled Optelecronics Co., Ltd. | Lighting device, smart terminal, lighting-device network-forming system, and methods thereof |
US10616978B2 (en) * | 2015-10-15 | 2020-04-07 | Signify Holding B.V. | Lighting arrangement, computer program product, mobile communication device and lighting system |
CN108141945A (en) * | 2015-10-15 | 2018-06-08 | 飞利浦照明控股有限公司 | Lighting arrangements, computer program product, mobile communication equipment and lighting system |
US20180288856A1 (en) * | 2015-10-15 | 2018-10-04 | Philips Lighting Holding B.V. | Lighting arrangement, computer program product, mobile communication device and lighting system |
US20180050264A1 (en) * | 2015-10-27 | 2018-02-22 | Guangdong Virtual Reality Technology Co., Ltd. | Apparatus, methods, and systems for tracking an optical object |
US10709967B2 (en) * | 2015-10-27 | 2020-07-14 | Guangdong Virtual Reality Technology Co., Ltd. | Apparatus, methods, and systems for tracking an optical object |
US10581524B2 (en) * | 2016-04-08 | 2020-03-03 | Industrial Technology Research Institute | Luminaire positioning system and method thereof |
US20180212680A1 (en) * | 2016-04-08 | 2018-07-26 | Industrial Technology Research Institute | Luminaire positioning system and method thereof |
US20200209712A1 (en) * | 2016-07-14 | 2020-07-02 | Guangdong Virtual Reality Technology Co., Ltd. | Method and device for identifying flashing light source |
US10895799B2 (en) * | 2016-07-14 | 2021-01-19 | Guangdong Virtual Reality Technology Co., Ltd. | Method and device for identifying flashing light source |
CN109740718A (en) * | 2016-11-19 | 2019-05-10 | 哈尔滨理工大学 | A kind of packaging system based on fringe gray level information hidden function |
US10725140B2 (en) * | 2016-12-23 | 2020-07-28 | Osram Gmbh | Operating of a transmission device of a lighting device comprising an illumination device |
US20180180701A1 (en) * | 2016-12-23 | 2018-06-28 | Osram Gmbh | Operating of a transmission deviceof a lighting device comprising an illumination device |
US11408959B2 (en) * | 2017-12-22 | 2022-08-09 | University Of Virginia Patent Foundation | Positioning through multipath reflection |
US11206723B2 (en) | 2018-01-31 | 2021-12-21 | Minebea Mitsumi Inc. | Remote control device, communication device, variable device and lighting device |
Also Published As
Publication number | Publication date |
---|---|
US8934784B2 (en) | 2015-01-13 |
CN103983262A (en) | 2014-08-13 |
CN103940419A (en) | 2014-07-23 |
US20160269112A1 (en) | 2016-09-15 |
CN203574655U (en) | 2014-04-30 |
CN103916185A (en) | 2014-07-09 |
CN104243029A (en) | 2014-12-24 |
CN103427902A (en) | 2013-12-04 |
CN104243030B (en) | 2018-10-19 |
CN104243030A (en) | 2014-12-24 |
CN103383446A (en) | 2013-11-06 |
US20140301737A1 (en) | 2014-10-09 |
CN103825655B (en) | 2017-07-07 |
CN104243029B (en) | 2018-11-02 |
CN103825655A (en) | 2014-05-28 |
CN203519822U (en) | 2014-04-02 |
CN103940419B (en) | 2017-06-30 |
CN103916185B (en) | 2017-12-12 |
CN103383446B (en) | 2017-07-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20160269112A1 (en) | Methods and Devices for Transmitting/Obtaining Identification Information and Positioning by Visible Light Signal | |
US9407367B2 (en) | Methods and devices for transmitting/obtaining information by visible light signals | |
US11309961B2 (en) | Commissioning a luminaire with location information | |
US10578705B2 (en) | System and method for estimating the position and orientation of a mobile communications device in a beacon-based positioning system | |
US10708732B2 (en) | Systems, methods and apparatus for light enabled indoor positioning and reporting | |
CN104363382B (en) | A kind of method and apparatus utilizing visible light signal transmission/obtaining information | |
JP6429288B2 (en) | Transmitter, transmission method and program | |
US10181901B2 (en) | Determining encoding schemes for formatting output signals of light-based communication enabled luminaires | |
US10505628B2 (en) | Designated map luminaires | |
JP2015012537A (en) | Visible light communication system | |
US10117316B1 (en) | Rotating identifications in light-based positioning systems | |
CN106663213A (en) | Detection of coded light |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: BEIJING SEMICONDUCTOR LIGHTING TECHNOLOGY PROMOTIO Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:GUO, CHENG;HU, HONG;REEL/FRAME:033301/0589 Effective date: 20140528 Owner name: ZHUHAI HENGQIN GREAT AIM VISIBLE LIGHT COMMUNICATI Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:BEIJING SEMICONDUCTOR LIGHTING TECHNOLOGY PROMOTION CENTER;REEL/FRAME:033309/0767 Effective date: 20140618 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO PAY ISSUE FEE |