WO2015014237A1 - 可见光信号的接收方法及其装置 - Google Patents

可见光信号的接收方法及其装置 Download PDF

Info

Publication number
WO2015014237A1
WO2015014237A1 PCT/CN2014/082954 CN2014082954W WO2015014237A1 WO 2015014237 A1 WO2015014237 A1 WO 2015014237A1 CN 2014082954 W CN2014082954 W CN 2014082954W WO 2015014237 A1 WO2015014237 A1 WO 2015014237A1
Authority
WO
WIPO (PCT)
Prior art keywords
spot
boundary
point
pixel
image
Prior art date
Application number
PCT/CN2014/082954
Other languages
English (en)
French (fr)
Inventor
刘若鹏
范林勇
李春来
Original Assignee
深圳光启创新技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN201310330068.1A external-priority patent/CN103812558B/zh
Priority claimed from CN201310544341.0A external-priority patent/CN103795467B/zh
Application filed by 深圳光启创新技术有限公司 filed Critical 深圳光启创新技术有限公司
Priority to KR1020167004270A priority Critical patent/KR101903697B1/ko
Priority to JP2016530333A priority patent/JP6167236B2/ja
Priority to EP14831500.5A priority patent/EP3029856B1/en
Publication of WO2015014237A1 publication Critical patent/WO2015014237A1/zh
Priority to US15/011,569 priority patent/US9673903B2/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04BTRANSMISSION
    • H04B10/00Transmission systems employing electromagnetic waves other than radio-waves, e.g. infrared, visible or ultraviolet light, or employing corpuscular radiation, e.g. quantum communication
    • H04B10/11Arrangements specific to free-space transmission, i.e. transmission through air or vacuum
    • H04B10/114Indoor or close-range type systems
    • H04B10/116Visible light communication
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04BTRANSMISSION
    • H04B10/00Transmission systems employing electromagnetic waves other than radio-waves, e.g. infrared, visible or ultraviolet light, or employing corpuscular radiation, e.g. quantum communication
    • H04B10/60Receivers

Definitions

  • the present invention relates to the field of visible light communication, and in particular to a method and a device for receiving visible light signals. Background technique
  • Visible light communication is an emerging, short-range, high-speed wireless optical communication technology developed in LED technology.
  • the basic principle of visible light communication is to use light-emitting diodes (LEDs) to switch faster than fluorescent and incandescent lamps, and to communicate by high-frequency flickering of LED light sources.
  • Light has a binary value of 1, and no light represents a binary 0.
  • High-speed optical signals containing digital information can be obtained by photoelectric conversion.
  • Wireless optical communication technology Because its data is not easily interfered and captured, optical communication equipment can be used to make wireless optical encryption keys because it is simple to manufacture and should not be damaged or demagnetized. Compared with microwave technology, wireless optical communication has a very rich spectrum of resources, which is unmatched by general microwave communication and wireless communication.
  • visible light communication can be applied to any communication protocol and is applicable to any environment.
  • wireless optical communication Compared with the traditional magnetic materials, there is no need to worry about the degaussing problem, and there is no need to worry about the communication content being stolen.
  • the wireless optical communication equipment is flexible and convenient to set up, and the cost is low, which is suitable for large-scale popular application.
  • the technical problem to be solved by the present invention is to provide a method and a device for receiving visible light signals, which rely on a camera to receive visible light.
  • the technical solution adopted by the present invention to solve the above technical problem is to provide a method for receiving a visible light signal, comprising the steps of: controlling a camera as an optical signal receiver, collecting a set of consecutive images covering a source, the emitting source emitting visible light a signal; dividing the continuous image into a plurality of images; comparing the brightness and darkness of each fixed size region in each image with time, selecting a continuously changing region, and determining that a visible light signal exists in the region; and analyzing The light and dark changes in the area are processed to obtain a visible light signal from the source.
  • the method further comprises: performing signal processing on the visible light signal to restore the original information.
  • comparing the change in brightness and darkness of each fixed size region in each image over time includes analyzing the change in the average gray value of each of the fixed size regions over time.
  • the step of signal processing the visible light signal comprises decoding, decrypting and/or descrambling.
  • the step of controlling the camera as the optical signal receiver comprises: controlling an independent camera or a camera integrated into an electronic device as an optical signal receiver, and connecting the independent camera to a security system , a monitoring system or a computer.
  • the plurality of images are multi-frame images; selecting a continuously changing region, and determining that visible light signals are present in the region include Processing each frame image according to the following steps to identify a spot in the frame image: searching for a pixel point having the largest gray value in the frame image as a center point of the first spot; determining a boundary of the first spot; Determining the size of the first spot by the boundary of the first spot and the center point of the first spot; determining whether the first spot is an effective spot according to the determined boundary and size of the first spot; recovering according to the identified spot The visible light communication signal.
  • the step of determining the boundary of the first spot includes: calculating, in the first direction, the gray value of the pixel point at a distance from the center point of the first spot by the distance from small to large, And calculating a position of the first spot with the first pixel of the gray point in the first direction as the boundary of the first spot in the first direction, and calculating the distance from the small direction to the center point of the first spot in the second direction.
  • the gray value of the pixel point separated by a distance, and the previous pixel point of the abrupt point of the gray value in the second direction is used as the boundary of the first spot in the second direction.
  • the first direction is opposite to the second direction.
  • the step of using the gray level value at the previous pixel point of the abrupt point in the first direction as the boundary of the first spot in the first direction comprises: if there is a gray of the first pixel point If the degree value is less than a gray level threshold, the previous pixel point of the first pixel point is used as the boundary of the first light spot in the first direction, otherwise the boundary of the frame image in the first direction is used as the first light spot.
  • a step of the previous pixel of the gradation point of the gradation value in the second direction as a boundary of the first spot in the second direction comprises: if there is a gradation of the second pixel If the value is less than a gray threshold, the previous pixel of the second pixel is used as the first The boundary of the spot in the second direction, or the boundary of the frame image in the second direction as the boundary of the first spot in the second direction.
  • the grayscale threshold is an average grayscale value of the frame image.
  • the step of confirming whether the first spot is an effective spot according to the determined boundary of the first spot comprises: determining whether any boundary of the first spot is located at a boundary of the image, and if not, the The first spot is an effective spot.
  • the step of confirming whether the first spot is an effective spot according to the determined size of the first spot comprises: determining whether the size of the first spot is greater than a threshold, and if yes, confirming the first The spot is an effective spot, wherein a larger value of the distance between the boundary of the first spot and the second direction and the center point of the first spot is selected as the size of the first spot.
  • the second spot in the frame image is further identified according to the following steps: searching for a pixel point of the frame image that has the largest gray value in a region other than the first spot, as the second spot a center point; determining a boundary of the second spot; determining a size of the first spot according to a distance between a boundary of the second spot and a center point of the second spot; and confirming the boundary according to the determined boundary and size of the second spot Whether the second spot is an effective spot.
  • the step of determining the boundary of the second spot includes: calculating, in the first direction, the gray value of the pixel point at a distance from the center point of the second spot by the distance from small to large, And calculating a position of the second spot with the gray spot value in the first pixel of the first direction as the boundary of the second spot in the first direction and the distance from the second direction in the second direction.
  • the gray value of the pixel point at a distance, and the previous pixel point of the mutated point of the gradation value in the second direction is the boundary of the second spot in the second direction.
  • the step of searching for a pixel point of the frame image that has the largest gray value in the region other than the first spot includes: setting a gray value of the pixel point in the first spot of the frame image to The average gray value of the image is obtained by obtaining a modified image; searching for the pixel point having the largest gray value in the modified image.
  • the step of using the gray level value at the previous pixel point of the abrupt point in the first direction as the boundary of the second spot in the first direction comprises: if there is a gray of the first pixel point If the degree value is less than a gray level threshold, the previous pixel point of the first pixel point is used as the boundary of the second light spot in the first direction, otherwise the boundary of the frame image in the first direction is used as the second light spot.
  • a step of the previous pixel of the gradation point of the gradation value in the second direction as a boundary of the second spot in the second direction comprises: if there is a gradation of the second pixel If the value is less than a grayscale threshold, the previous pixel of the second pixel is used as the boundary of the second spot in the second direction, otherwise the boundary of the frame image in the second direction is used as the second spot.
  • the grayscale threshold is an average grayscale value of the frame image.
  • the step of processing each frame image to identify a spot in the frame image further comprises: reducing the frame image by a predetermined ratio, the predetermined ratio of the row number of pixels and the number of column pixels of the image. common divisor.
  • the method when the camera is in a low frame rate mode, the method further includes: identifying a start code of a predetermined sequence in the visible light communication signal; switching the camera to a high frame rate mode; or, identifying An end code of a predetermined sequence in the visible light communication signal; switching the camera to a low frame rate mode; wherein, the method of switching the frame rate mode of the camera comprises: modifying a register of the photoreceptor of the camera.
  • the present invention further provides a receiving device for a visible light signal, comprising: a module for controlling a camera as an optical signal receiver to collect a set of consecutive images covering a transmitting source, the transmitting source emitting a visible light signal; and for using the group
  • a module for obtaining a visible light signal from the emission source in a continuous image comprising: a module for dividing the set of consecutive images into a plurality of images; for comparing brightness and darkness of each fixed size region in each image with time And selecting a module having a continuously changing region, and determining a module having a visible light signal in the region; and a module for analyzing and processing the light and dark changes of the region to obtain a visible light signal from the emission source.
  • the receiving device further includes means for performing signal processing on the visible light signal to restore the original information.
  • comparing the change in brightness and darkness of each fixed size region in each image over time includes analyzing the change in the average gray value of each of the fixed size regions over time.
  • the means for signal processing the visible light signal to reduce to the original information is for decoding, decryption and/or descrambling.
  • the module for controlling a camera as an optical signal receiver to collect a set of consecutive images covering a transmission source comprises: a module for obtaining a multi-frame image containing a visible light communication signal from a camera
  • the means for obtaining a visible light signal from the set of consecutive images from the set of images comprises: means for processing each frame of image to identify a spot in the frame image, comprising: for searching the image of the frame a pixel having the largest gray value, a module as a center point of the first spot; a module for determining a boundary of the first spot; and a distance for a boundary of the first spot according to a center point of the first spot a module for determining a size of the first spot; a module for confirming whether the first spot is an effective spot according to the determined boundary and size of the first spot; a module for recovering the visible light communication signal according to the identified spot .
  • the module for determining the boundary of the first spot includes: calculating, in order from the small direction in the first direction, the pixel points at a distance from the center point of the first spot a gray value, and a module of a gray point value at a point of the abrupt point of the first direction as a boundary of the first spot in the first direction, for calculating the distance from the second direction to the second direction a gray value of a pixel point at a distance from a center point of the first spot, and a previous pixel point of the gradation point of the gradation value in the second direction as a boundary of the first spot at the second direction Module.
  • the first direction is opposite to the second direction.
  • the gray value of the pixel point at a distance from the center point of the first spot is calculated in order from the small direction in the first direction, and the gray value is a pixel of the first point of the mutation point is a module of the first spot in the boundary of the first direction.
  • the first pixel is a previous pixel as a boundary of the first spot in the first direction, or a boundary of the frame image in the first direction as a boundary of the first spot in the first direction;
  • the direction calculates the gradation value of the pixel point at a distance from the center point of the first spot by the distance from small to large, and uses the gradation value as the first spot of the mutated point of the second direction
  • the previous pixel of the second pixel is used as the first spot in the second direction. Boundary, otherwise the image of the frame is in the The boundary of the two directions serves as the boundary of the first spot in the second direction.
  • the grayscale threshold is an average grayscale value of the frame image.
  • the module for confirming whether the first spot is an effective spot according to the determined boundary and size of the first spot is determining whether any boundary of the first spot is located at a boundary of the image, if not And the first spot is an effective spot; the module for confirming whether the first spot is an effective spot according to the determined boundary and size of the first spot is determining whether the size of the first spot is greater than a threshold, and if so, Confirm that the first spot is an effective spot.
  • the module for processing each frame image to identify a spot in the frame image further comprises: searching for the largest gray value in the modified image in a region other than the first spot a pixel, a module as a center point of the second spot; a module for determining a boundary of the second spot; a distance for selecting a boundary of the second spot and a center point of the second spot as the second spot a module of a size; a module for confirming whether the second spot is an effective spot according to the determined boundary of the second spot.
  • the module for determining the boundary of the second spot includes: calculating, in order from the first direction, the distance from the small point to the pixel point of the second spot in the first direction a gray value, and a module of a gray point value at a point of a sudden change of the first direction as a boundary of the second spot in the first direction, for calculating the distance from the second direction to the second direction a gray value of a pixel point at a distance from a center point of the second spot, and a gray pixel value at a previous pixel point of the abrupt point in the second direction as a boundary of the second spot in the second direction Module.
  • the first direction is opposite to the second direction.
  • a module for searching for a pixel having the largest gray value in a region other than the first spot in the modified image, and a module serving as a center point of the second spot includes: The gray value of the pixel in the first spot of the image is set as the average gray value of the image, and a module for modifying the image is obtained; and a module for searching for the pixel with the largest gray value in the modified image.
  • the gray value of the pixel point at a distance from the center point of the second spot is calculated in order from the small direction in the first direction, and the gray value is a previous pixel of the abrupt point of the first direction is used as a module of the second spot at the boundary of the first direction, and if a gray value of the first pixel is less than a gray threshold, the first pixel is used a previous pixel as a boundary of the second spot in the first direction, or a boundary of the frame image in the first direction as a boundary of the second spot in the first direction;
  • the direction calculates the gradation value of the pixel point at a distance from the center point of the second spot in order from the smallest distance to the distance, and uses the gradation value as the second spot in the previous pixel point of the mutated point in the second direction In the module of the boundary of the first direction, if a gray value of the second pixel is less than a gray threshold, the previous pixel of the second pixel is used as the second spot in
  • the grayscale threshold is an average grayscale value of the frame image.
  • the means for processing each frame image to identify a spot in the frame image further comprises means for reducing the image by a predetermined ratio, the predetermined ratio being a row pixel of the frame image The common divisor of the number of columns and columns.
  • the device when the camera is in a low frame rate mode, the device further includes: a module for identifying a start code of a predetermined sequence in the visible light communication signal; a module that switches to a high frame rate mode; a module for identifying an end code of a predetermined sequence in the visible light communication signal; a module for switching the camera to a low frame rate mode based on the identified end code.
  • a continuous image is acquired by a camera, and then image processing is performed on the continuous image to obtain a visible light signal.
  • This receiving method uses a camera to receive visible light signals, and can realize visible light communication functions of various devices or systems without adding or modifying hardware.
  • the above technical solution of the present invention adopts a processing method dedicated to processing and identifying a spot in a visible light communication signal, and identifies the spot by simply determining the boundary of the center of the spot to be compared with a general image processing technique. It has simpler and more effective features.
  • FIG. 1 is a flow chart showing a method for receiving a visible light signal according to an embodiment of the present invention.
  • FIGS. 2B and 2C show that part of the spot falls outside the image, but the spot center remains In the image
  • Figures 2D and 2E show that part of the spot falls outside the image and the center of the spot is also outside the image.
  • Figure 3 shows a frame of image with two spots.
  • Figure 4 shows a frame modified image from which one spot identified has been removed.
  • Figure 5 is a diagram showing the method of identifying a start code of a visible light communication signal in a low frame rate mode, in accordance with an embodiment of the present invention.
  • FIG. 6 shows a schematic diagram of a register that modifies a photoreceptor of a camera, in accordance with an embodiment of the present invention.
  • FIG. 7 is a flow chart showing a method of recognizing a visible light communication signal received by a camera according to an embodiment of the invention.
  • FIG. 8 illustrates a flow chart of a method of identifying a spot in an image, in accordance with an embodiment of the present invention.
  • FIG. 9 illustrates a flow chart of a method of identifying a spot in an image in accordance with another embodiment of the present invention.
  • FIG. 10 is a flow chart showing a method of recognizing a visible light communication signal received by a camera according to another embodiment of the present invention.
  • Figure 11 illustrates a flow chart for adjusting the frame rate of a camera in accordance with an embodiment of the present invention. detailed description
  • embodiments of the present invention provide a method of receiving a visible light signal that utilizes a camera instead of a conventional photodiode-based optical signal receiver.
  • the obvious advantage of this design is that it saves hardware overhead by eliminating the need for a dedicated optical signal receiver in many applications.
  • Embodiments of the present invention can be implemented in the context of a mobile phone as a receiving device for visible light signals.
  • the emission source it may be a light emitting diode (LED) or a light emitting diode chip. LEDs can be integrated into electronic devices such as cell phones, tablets, laptops, digital cameras, MP3 players or MP4 players.
  • the light emitting diode can also be a separate device, such as a light.
  • the visible light emitted by this illuminator can be modulated by a control device to carry the signal.
  • FIG. 1 is a flow chart showing a method for receiving a visible light signal according to an embodiment of the present invention. Referring to Figure 1, the method includes:
  • Step 101 open the camera of the mobile phone, point it to the emission source of the visible light signal, so that the emission source falls within the imaging range of the camera;
  • Step 102 Control a camera of the mobile phone as an optical signal receiver, and collect a set of consecutive images;
  • the set of consecutive images will contain the image formed by the visible light signal of the source and the background image, so the key is to separate the image formed by the visible light signal from the background image.
  • Step 103 Obtain a visible light signal from the emission source from the set of consecutive images by using an image processing technique
  • Step 104 Perform signal processing on the visible light signal to restore the original information.
  • the original information includes, but is not limited to, text, pictures, audio, and/or video.
  • a method for obtaining a visible light signal from the set of consecutive images using image processing techniques includes:
  • the continuous image is divided into a plurality of images.
  • the light and dark changes in the area are analyzed and processed to obtain a visible light signal from the source.
  • the change of light and dark with time may be the change of the average gray value with time, when there is visible light signal, the image
  • the average gray value is small.
  • the average gray value is significantly larger.
  • a special video processing module can be configured in the mobile phone, and the obtained continuous image is analyzed and processed to separate the visible light signal therein.
  • the step of signal processing the visible light signal may accordingly include inverse processing, such as decoding, decryption, and/or descrambling.
  • the original information separated by the above steps can be transmitted to the subsequent module independently of the background image.
  • the image captured by the camera does not contain the visible light signal of the above-mentioned emission source, only the normal background image will be output after the above steps.
  • the method for receiving visible light signals by using a mobile phone camera in the embodiment provides a method for collecting a continuous image by pointing the mobile phone camera to a visible light signal source, and then performing image processing on the continuous image to obtain a visible light signal, and then decoding the visible light signal to restore the signal to a visible light signal.
  • Original information Since this method uses a mobile phone camera to receive visible light signals, it is possible to receive visible light using a mobile phone without adding or modifying mobile phone hardware. The function of the signal. In this way, the mobile phone can receive data such as text, pictures, audio, and/or video from other devices, such as another mobile phone or tablet, in a non-connected state.
  • the camera of the present invention in addition to being implemented in the environment of a mobile phone as a receiving device for visible light signals, it can also be implemented in the environment of a tablet computer as a receiving device for visible light signals; the camera of the present invention can be integrated not only in the aforementioned mobile phone or tablet computer It can also be integrated on other electronic devices such as laptops, digital cameras, MP3 players or MP4 players.
  • a separate camera is used as a receiving device for visible light signals.
  • an independent camera is directed to a visible light signal source to acquire a continuous image, and then image processing is performed on the continuous image. Obtaining a visible light signal, and then decoding the visible light signal to restore the original information. Since this method uses a separate camera to receive visible light signals, it can provide many aspects of the system with the camera as a standard equipped with visible light communication. Other systems can also be equipped with a camera to obtain the extended function of visible light communication. For example, a security system or a surveillance system is usually equipped with a number of cameras.
  • the camera may be of a charge coupled device (CCD) type or a complementary metal oxide semiconductor (CMOS) type.
  • CCD charge coupled device
  • CMOS complementary metal oxide semiconductor
  • the above embodiment of the present invention provides a method for receiving a visible light signal by collecting a continuous image by pointing the camera at a visible light signal emitting source, and then performing image processing on the continuous image to obtain a visible light signal, and then decoding the visible light signal and the like. Restore to original information.
  • This receiving method uses a camera to receive visible light signals, and can realize visible light communication functions of various devices or systems without adding or modifying hardware.
  • the present invention further provides a receiving device for a visible light signal, comprising: a module for controlling a camera as an optical signal receiver to collect a set of consecutive images covering a transmitting source, the transmitting source emitting a visible light signal; and for using the group A module that obtains a visible light signal from the source in a continuous image.
  • the receiving device further includes a module for performing signal processing on the visible light signal to restore the original information.
  • the above module for obtaining a visible light signal from the emission source from the set of consecutive images comprises: a module for dividing the set of consecutive images into a plurality of images; for comparing light and dark of each fixed size region in each image With time varying, a region with continuously varying regions is selected, and a module for detecting visible light in the region is determined; and a module for analyzing and processing the shading of the region to obtain a visible light signal from the transmitting source.
  • the above means for signal processing the visible light signal to be restored to the original information is for decoding, decryption and/or descrambling.
  • the embodiment of the present invention further provides a method for identifying a visible light communication signal received by a camera, which may be a preferred embodiment of a method for receiving a visible light signal according to an embodiment of the present invention.
  • the method of this embodiment can be used to determine the position of the spot formed by the light emitted by the source in the image in the above method of receiving visible light signals. This method is simplified because it is particularly directed to an image containing a visible light communication signal, particularly an image containing a spot, thereby becoming more efficient.
  • the light source used in the transmitting end of visible light communication includes a light emitting diode (LED) which is widely used due to good on/off performance.
  • LED light emitting diode
  • flashlights using portable electronic devices with camera functions are also a viable option, especially in the case where very popular mobile phones are generally equipped with flash lamps instead of LED lights.
  • the type of partial flash is itself an LED light.
  • the camera is adapted to receive visible light emitted by the light source, but is not limited thereto.
  • the camera of the present invention can be a stand-alone camera or a camera integrated into various electronic devices such as mobile phones, tablet computers, notebook computers, digital cameras, MP3 players, MP4 players (such as Apple's iTouch).
  • Fig. 2A shows a frame image having one spot.
  • Figure 3 shows a frame of image with two spots.
  • the receiver After the receiver receives these images from the camera, its important task is to identify which images contain spots, thereby restoring the corresponding digital signals.
  • the light source is defined to have a light illumination representative of binary 1 and no light illumination represents a binary 0, the image containing the spot is correspondingly recognized as binary 1 at the receiving end and the image containing no spot is identified as binary 0.
  • this definition is only an example, and the specific rules can be defined by the person skilled in the art. For example, including multiple spots may represent additional information.
  • FIG. 7 is a flow chart showing a method of recognizing a visible light communication signal received by a camera according to an embodiment of the invention. Referring to Figure 7, the method includes the following steps:
  • step 601 obtaining a multi-frame image including a visible light communication signal from the camera;
  • each frame of image is processed to identify a spot in the frame image
  • the visible light communication signal is recovered in accordance with the identified spot. It can be understood that the above process routine operates in a pipeline manner, that is, each time a frame of image is obtained, image processing is performed, and the visible light communication signal therein is recovered.
  • Step 602 is the main step.
  • the specific method can be as follows: Step 701: Search for the pixel with the largest gray value in the image of one frame as the center point of the spot; Step 702 Determine the boundary of the spot in the first direction.
  • the gradation value of the pixel point at a distance from the center point of the spot may be calculated in order from the smallest direction in the first direction, and the gradation value is the previous pixel of the mutated point in the first direction.
  • the point serves as the boundary of the spot in the first direction.
  • the gray value of the pixel is compared with a gray threshold. If the gray value of the pixel is greater than or equal to a gray threshold, such as an average gray value of the image, the pixel is considered to belong to the spot area; conversely, if the gray value of the pixel is smaller than the average gray value of the image, It is considered that the pixel does not belong to the spot area.
  • the previous pixel point of the abrupt point whose gray value is smaller than the average gray value of the image is taken as the boundary of the spot in the first direction, and is referred to as the first pixel point.
  • the distance between the first pixel and the center point of the spot is recorded as the first distance.
  • the spot is usually treated as a circle, so the first distance can generally be considered the radius of the spot.
  • the first distance dl determined along the +x direction is the radius of the spot.
  • Step 703 determining a boundary of the spot in the second direction.
  • the gray value of the pixel point at a distance from the center point of the spot may be calculated in order from the smallest direction in the second direction, and the gray value is in the previous pixel of the abrupt point in the second direction.
  • the point serves as the boundary of the spot in the second direction.
  • the pixel is considered to belong to the spot region; if, the gray value of the pixel is smaller than the average gray of the image. Value, it is considered that the pixel does not belong to the spot area. Therefore, the previous pixel point of the abrupt point whose gradation value is smaller than the average gradation value of the image is used as the boundary of the spot in the second direction, and is referred to as the second pixel point. The distance between the second pixel point and the center point of the spot is recorded as the second distance d2.
  • a gray threshold such as the average gray value of the image
  • Step 704 determining the spot size according to the distance between the boundary of the spot and the center point of the spot.
  • the maximum values of the first distance dl and the second distance d2 are selected as the size of the spot.
  • Step 705 Determine, according to the determined boundary of the spot, whether the spot is an effective spot.
  • the spot determined in step 704 is less than a threshold, such as 5, the spot is considered to be caused by noise, and the spot is excluded. At this time, the frame image does not actually contain a spot.
  • a threshold such as 5
  • steps 701-705 it will be possible to identify whether there is a spot in one frame of image and the boundary of the spot.
  • one frame of image may be subjected to noise reduction processing before the process to improve image quality and reduce the probability of occurrence of invalid spots.
  • the boundary of the spot can only be determined from two directions (+x and -X directions) in this embodiment, it can be understood that in other embodiments, it can be from less direction, for example, from 1 direction (such as +x direction) determines the boundary of the spot; or you can determine the boundary of the spot from more directions, such as 4 (+x, -X direction, +y, -y direction). Determining the boundary of the spot from one direction is sufficient to cope with the situation as shown in Fig. 2A. In this case, it can be considered that the cases of Figs. 2B-2E are regarded as invalid spots.
  • (i, j) is the pixel coordinate in the image
  • i is the abscissa or column coordinate
  • j is the ordinate, that is, the row coordinate.
  • the gray value of the pixel in the third row and the fourth column can be expressed as g(4, 3).
  • the invalid spot is excluded.
  • km is the brightest spot radius; otherwise g(s,t) is noise, and the calculation ends, and the image is considered to have no spot.
  • Second, if kl or k2 0, the spot is also considered invalid.
  • step 602 can be implemented as the flow shown in Fig. 9. Refer to Figure 9:
  • Step 801 Search for a pixel point having the largest gray value in one frame image as a center point of the light spot; Step 802, determine a boundary of the light spot in the first direction.
  • the gradation value of the pixel point at a distance from the center point of the spot may be calculated in order from the smallest direction in the first direction, and the gradation point of the gradation value in the first direction is a previous pixel as the boundary of the spot in the first direction;
  • the gray value of the pixel is compared with a gray threshold, and if the gray value of the pixel is greater than or equal to a gray threshold, such as the average gray value of the image, the pixel is considered to be the pixel. It belongs to the spot area; on the contrary, if the gray value of the pixel is smaller than the average gray value of the image, the pixel is considered not to belong to the spot area.
  • the previous pixel point of the abrupt point whose gray value is smaller than the average gray value of the image is taken as the boundary of the spot in the first direction, and is referred to as the first pixel point.
  • the distance between the first pixel and the center point of the spot is recorded as the first distance.
  • step 802 if during the calculation of step 802, it is found that the calculated pixel point is already at the boundary of the image, the calculation is stopped. The pixel is also recorded as the first pixel, and the first distance dl is obtained.
  • Step 803 determining a boundary of the spot in the second direction.
  • the pixel is considered to belong to the spot area; conversely, if the gray value of the pixel is smaller than the average gray of the image For the degree value, the pixel point is considered not to belong to the spot area. Therefore, the previous pixel of the abrupt point whose gradation value is smaller than the average gradation value of the image is taken as the boundary of the spot in the second direction, and is referred to as the second pixel.
  • the distance between the second pixel and the center point of the spot is recorded as the second distance d2.
  • the pixel is recorded as the second pixel to obtain the second distance d2.
  • Step 804 determining the spot size according to the distance between the boundary of the spot and the center point of the spot.
  • the maximum value of the first distance d1 and the second distance d2 is selected as the size of the spot.
  • Step 805 Determine whether the spot is an effective spot according to the determined boundary of the spot.
  • steps 801-805 it will be possible to identify whether there is a spot in one frame of image and the boundary of the spot.
  • step 805 if it is found in step 805 that the size of the determined spot is less than a threshold, for example 5, the spot is considered to be caused by noise, and the frame is considered not to be included while the spot is considered to be an invalid spot. Spot. Therefore, when it is judged in step 806 whether or not there is an unrecognized spot in the image, the flow ends.
  • a threshold for example 5
  • step 807 the gray value of the pixel in the identified spot area of the frame image is set as the average gray value of the image to obtain a modified image; then, returning to step 801 to identify another spot.
  • step 807 The purpose of step 807 is to exclude the identified spot area during subsequent processing. From the results, the subsequent processing is actually the maximum gray value outside the identified spot area in the search image. It will be understood that the above-described search may be performed directly outside the identified spot area without performing the aforementioned modifications in actual processing.
  • the gray value of the identified spot area is set to the average gray value of the image in the current picture. This loops until it is determined in step 806 that the frame image does not contain other spots that are not recognized, thereby ending the entire flow.
  • the invalid spot is excluded.
  • km is the brightest spot radius; otherwise g(s,t) is noise, and the calculation ends, and the image is considered to have no spot.
  • Second, if kl or k2 0, the spot is also considered invalid. If the foregoing process can find an effective spot A, then after finding the spot A, the gray values of the regions [s-km, s+km], [t-km, t+km] are all set to ⁇ . A modified image as shown in FIG. 4 is obtained. Also in the same way as above, the spot ⁇ can be found. When there are multiple spots, follow this method in order to determine the area of each spot.
  • FIG. 10 is a flow chart showing a method of recognizing a visible light communication signal received by a camera according to another embodiment of the present invention. Referring to Figure 10, the method includes the following steps:
  • a multi-frame image including a visible light communication signal is obtained from a camera
  • step 902a each frame image is processed, and the frame image is reduced by a predetermined ratio
  • the resolution of the image is reduced by a predetermined ratio.
  • step 902b identifying a spot in the frame image
  • the visible light communication signal is restored in accordance with the identified spot.
  • the above process routine operates in a pipeline manner, that is, each time an image is obtained, image processing is performed, and the visible light communication signal therein is recovered.
  • the difference between the above embodiment and the embodiment shown in Fig. 10 is that the frame image is first reduced by a predetermined ratio before the spot in each frame image is recognized. This will reduce the resolution of the image and thus the amount of computation required to process the image, thereby simplifying the method.
  • the predetermined ratio is a common divisor of the number of rows of pixels and the number of columns of pixels of the frame image. For example, an image with a resolution of 800*600 (that is, 800 pixels in a row and 600 pixels in a column), and the predetermined ratio can be selected as 8, that is, the image is reduced to 100*75.
  • both the number of rows of pixels and the number of columns of pixels may be greater than a threshold to be able to identify the desired number of spots.
  • the adjacent four pixels of the image ⁇ can be calculated as one unit, that is, every 2 ⁇ 2 pixels as one unit, so that the image is simplified to M/2XN/2 dimensions.
  • the pixels (1, 1), (1, 2), (2, 1), and (2, 2) are pre-calculated as new pixels (1, 1).
  • (i, j) is the pixel coordinate of the simplified image
  • i represents the abscissa or column coordinate
  • j represents the ordinate, that is, the row coordinate.
  • the gray value of the parent pixel in the third row and the fourth column can be expressed as ⁇ (4,3).
  • the image can be reduced to M/pgxN/pg, where l ⁇ g ⁇ m.
  • the pg is too large to affect the resolution, there is a trade-off between image processing speed and resolution.
  • step 902b can be implemented by the flow of the embodiment shown in FIG. 8 or FIG.
  • the frame rate of the camera used needs to be able to match the data transmission rate of visible light emitted by the transmitting end. For example, if the bit rate of the visible light communication signal from the transmitting end is approximately 50 bps (bits per second), the camera is required to have at least lOOfps (frames per second).
  • the adjustment of the camera frame rate can be done by modifying the CMOS register by the microcontroller, and the protocol is I 2 C.
  • the hardware involved in camera frame rate adjustment can be seen in Figure 7.
  • a predetermined sequence of start codes can be agreed at the beginning of the visible light communication signal to instruct the camera to adjust to the high frame rate mode.
  • an end code of the predetermined sequence can be agreed at the end of the visible light communication signal to instruct the camera to adjust back to the low frame rate mode.
  • Figure 11 illustrates a flow chart for adjusting the frame rate of a camera in accordance with an embodiment of the present invention. Assuming the camera is normally in the low frame rate mode, it will adjust to the high frame rate mode according to the flow of Figure 9.
  • step 1001 the visible light communication signal is received and recognized at the camera.
  • the identification in this step can be implemented by referring to the flow shown in Figure 7 or Figure 9.
  • a start code in the visible light signal can be obtained.
  • step 1002 it is identified whether the start code is an agreed predetermined sequence, and if so, the camera is switched to the high frame rate mode in step 1003.
  • Figure 5 is a diagram showing the method of identifying a start code of a visible light communication signal in a low frame rate mode, in accordance with an embodiment of the present invention.
  • the transmission rate of the transmitting end of the visible light communication signal is 50 bps, wherein the starting code is 110011, so that the information captured by the camera with a frame rate of 30 fps is only three images, which are taken at 33 ms, 67 ms, and 100 ms, respectively.
  • the first and third have bright spots, while the second image has no bright spots.
  • the result of the recognition is that the corresponding values of the three images are 1, 0, and 1, respectively.
  • the camera is booted into a high frame rate (e.g., 120 fps) mode. Similarly, set the end code of the signal, such as 0x111. When the camera receives the end code, it automatically switches back to the low frame rate (for example, 30fps) mode.
  • a high frame rate e.g. 120 fps
  • the end code of the signal such as 0x111.
  • Another embodiment of the present invention is an apparatus for recognizing a visible light communication signal received by a camera, comprising: means for obtaining a multi-frame image including a visible light communication signal from a camera; for processing each frame image to identify the frame image a module of the spot; and means for recovering the visible light communication signal in accordance with the identified spot.
  • the module for processing each frame image to identify a spot in the frame image further includes: a module for searching for a pixel point having the largest gray value in the frame image as a center point of the first spot; Calculating, in the first direction, the gray value of the pixel point at a distance from the center point of the first spot by the distance from small to large, and using the gray value as the previous pixel point of the sudden change point in the first direction a module of a boundary of the first spot in the first direction; a gray value for calculating a pixel point at a distance from a center point of the first spot in order from a small direction in the second direction, and using the gray value a pixel at a point of the abrupt point in the second direction as a module of the boundary of the first spot in the second direction; for selecting a boundary of the first spot in the first direction and the second direction and the first a larger value of the distance of the center point of a spot, a module that is the size of the first spot; and a module for confirming whether the first spot
  • the gray value of the pixel point at a distance from the center point of the first spot is calculated in order from the first direction in the first direction, and the gray value is in the first
  • the previous pixel of the mutated point in one direction is used as the module of the first spot at the boundary of the first direction. If the gradation value of a first pixel is smaller than the average gradation of the frame image, The previous pixel of one pixel is used as the boundary of the first spot in the first direction, otherwise the boundary of the frame image in the first direction is used as the boundary of the first spot in the first direction.
  • the gray value of the pixel point at a distance from the center point of the first spot is calculated in order from the second direction in the second direction, and the gray value is in the first
  • the previous pixel of the two-point mutation point is used as a module of the first spot at the boundary of the first direction. If the gray value of a second pixel is smaller than the average gray value of the frame image, The previous pixel of the two pixels is used as the boundary of the first spot in the second direction, otherwise the boundary of the frame image in the second direction is used as the boundary of the first spot in the second direction.
  • the first direction is opposite the second direction.
  • the module for processing each frame image to identify a spot in the frame image further comprises: setting a gray value of a pixel point in the first spot of the frame image as an image An average gray value value, a module for modifying an image; a module for searching for a pixel point having the largest gray value in the modified image as a center point of the second spot; for sequentially decreasing the distance from the first direction Calculating a gray value of a pixel point at a distance from a center point of the second spot, and using a gray color value at a previous pixel point of the abrupt point in the first direction as a boundary of the second light spot in the first direction Module for calculating the second light in order from the second direction by the distance from small to large a gray point value of a pixel point at a distance from a center point of the spot, and a block of a gray point value at a point of the abrupt point of the second direction as a boundary of the second spot in the second direction; Selecting a larger value of the distance between the boundary of
  • the means for processing each frame of image to identify a spot in the frame image further comprises means for reducing the image by a predetermined ratio.
  • the predetermined ratio is a common divisor of the number of rows of pixels and the number of columns of pixels of the frame image.
  • the apparatus when the camera is in a low frame rate mode, the apparatus further includes: means for identifying a start code of a predetermined sequence in the visible light communication signal; and configured to: according to the identified start code The camera switches to the module in high frame rate mode.
  • the apparatus further comprises: means for identifying a termination sequence of the predetermined sequence in the visible light communication signal; means for switching the camera to the low frame rate mode based on the identified end code.
  • the apparatus for identifying a visible light communication signal received by a camera of the present invention can be used as a photon receiver for use in a visible optical communication system.
  • the various embodiments described herein can be implemented in a computer readable medium such as computer software, hardware or a combination of computer software and hardware.
  • the embodiments described herein may be in one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DAPDs), programmable logic devices (PLDs), A field programmable gate array (FPGA), a processor, a controller, a microcontroller, a microprocessor, other electronic devices for performing the above functions, or a selected combination of the above are implemented.
  • ASICs application specific integrated circuits
  • DSPs digital signal processors
  • DAPDs digital signal processing devices
  • PLDs programmable logic devices
  • FPGA field programmable gate array
  • a processor a controller
  • microcontroller a microcontroller
  • microprocessor other electronic devices for performing the above functions, or a selected combination of the above are implemented.
  • a controller such an embodiment can be implemented by a controller.
  • the embodiments described herein may be implemented by separate software modules, such as program modules and functions, each of which performs one or more of the functions described herein. And operation.
  • the software code can be implemented by application software written in a suitable programming language, stored in memory, and executed by a controller or processor.

Landscapes

  • Physics & Mathematics (AREA)
  • Electromagnetism (AREA)
  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Optical Communication System (AREA)
  • Studio Devices (AREA)

Abstract

本发明涉及一种可见光信号的接收方法及其装置,该方法包括以下步骤:控制摄像头作为光信号接收器,采集涵盖一发射源的一组连续图像,该发射源发出可见光信号;从该组连续图像中获得来自该发射源的可见光信号。本发明由于采用摄像头接收可见光信号,可以在不增加和修改硬件的前提下,实现各种设备或系统的可见光通信功能。

Description

可见光信号的接收方法及其装置
技术领域
本发明涉及可见光通信领域, 尤其是涉及一种可见光信号的接收方法及其装置。 背景技术
可见光通信是一种在 LED 技术上发展起来的新兴的、 短距离高速无线光通信技 术。 可见光通信的基本原理就是利用发光二极管 (LED) 比荧光灯和白炽灯切换速度 快的特点, 通过 LED光源的高频率闪烁来进行通信。 有光代表二进制 1, 无光代表二 进制 0。 包含了数字信息的高速光信号经过光电转换即可获得信息。 无线光通信技术 因为其数据不易被干扰和捕获, 光通信设备制作简单且不宜损坏或消磁, 可以用来制 作无线光加密钥匙。 与微波技术相比, 无线光通信有相当丰富的频谱资源, 这是一般 微波通信和无线通信无法比拟的; 同时可见光通信可以适用任何通信协议、 适用于任 何环境; 在安全性方面, 无线光通信相比传统的磁性材料, 无需担心消磁问题, 更不 必担心通信内容被人窃取; 无线光通信的设备架设灵活便捷, 且成本低廉, 适合大规 模普及应用。
随着可见光通信的快速推广,已经提出了利用电子设备的 LED灯发送可见光信号 的技术,这使得电子设备与另一设备之间依靠可见光通信来实现短距离通信成为可能。 然而目前可见光信号的接收单元普遍地采用基于光电二极管 (例如 PIN、 APD等) 的 光信号接收器。 光信号接收器接收光信号后, 进行光电转换, 然后再对转换出来的电 信号进行解码等信号处理, 还原成原信号。 这样, 如果要在接收装置接收可见光, 还 需额外配备基于光电二极管的光信号接收器, 这需要变更接收装置的硬件, 而且增加 了成本。
已经提出了使用摄像机作为可见光通信的接收端的光接收器的设想, 例如
CN1702984. 然而与光电二极管仅感测单点光强变化不同的是, 摄像机所采集到的平 面感光图像。 还需要对这些图像进行处理, 以识别其中包含的可见光通信信号。 尽管 存在处理图像以识别亮度或颜色不同的局部区域的通用图像处理技术, 但是使用这样 的通用技术来识别摄像机所拍摄的连续感光图像中的局部区域, 其效能及速度均不理 相、。
有鉴于此, 希望有一种专门识别摄像机接收的可见光通信信号的方法。 发明内容
本发明所要解决的技术问题是提供一种可见光信号的接收方法及其装置, 它依靠 摄像头来接收可见光。 本发明为解决上述技术问题而采用的技术方案是提出一种可见光信号的接收方法, 包 括以下步骤: 控制摄像头作为光信号接收器, 采集涵盖一发射源的一组连续图像, 该 发射源发出可见光信号; 将该组连续图像分割为多幅图像; 对比各幅图像中每个固定 大小区域的明暗随时间的变化情况, 选取出有连续变化的区域, 并判定该区域中存在 可见光信号; 以及分析处理该区域的明暗变化, 获得来自发射源的可见光信号。
在本发明的一实施例中, 获得来自该发射源的可见光信号之后还包括: 对该可见 光信号进行信号处理, 还原成原始信息。
在本发明的一实施例中, 对比各幅图像中每个固定大小区域的明暗随时间的变化 情况包括分析该每个固定大小区域的平均灰度值随时间的变化情况。
在本发明的一实施例中, 对该可见光信号进行信号处理的步骤包括解码、 解密和 / 或解扰。
在本发明的一实施例中, 控制摄像头作为光信号接收器的步骤包括: 控制独立的 摄像头或集成到一电子设备中的摄像头作为光信号接收器, 且使该独立的摄像头连接 到一安防系统、 一监控系统或一计算机。
在本发明的一实施例中, 在将该组连续图像分割为多幅图像的步骤中, 该多幅图 像为多帧图像; 选取出有连续变化的区域, 并判定该区域中存在可见光信号包括依照 下述步骤处理每一帧图像以识别该帧图像中的光斑: 搜索该帧图像中的灰度值最大的 像素点, 作为第一光斑的中心点; 确定该第一光斑的边界; 依据该第一光斑的边界与 该第一光斑的中心点的距离, 确定该第一光斑的尺寸; 根据所确定的第一光斑的边界 和尺寸确认第一光斑是否为有效光斑; 依据所识别的光斑恢复该可见光通信信号。
在本发明的一实施例中, 确定该第一光斑的边界的步骤包括: 沿第一方向按距离 从小到大依次计算与该第一光斑的中心点相距一距离的像素点的灰度值, 并以灰度值 在该第一方向的突变点的前一像素点作为该第一光斑在该第一方向的边界, 沿第二方 向按距离从小到大依次计算与该第一光斑的中心点相距一距离的像素点的灰度值, 并 以灰度值在该第二方向的突变点的前一像素点作为该第一光斑在该第二方向的边界。
在本发明的一实施例中, 该第一方向与该第二方向相反。
在本发明的一实施例中, 以灰度值在该第一方向的突变点的前一像素点作为该第 一光斑在该第一方向的边界的步骤包括: 如果有一第一像素点的灰度值小于一灰度阈 值, 则以该第一像素点的前一像素点作为该第一光斑在该第一方向的边界, 否则以该 帧图像在该第一方向的边界作为该第一光斑在该第一方向的边界; 以灰度值在该第二 方向的突变点的前一像素点作为该第一光斑在该第二方向的边界的步骤包括: 如果有 一第二像素点的灰度值小于一灰度阈值, 则以该第二像素点的前一像素点作为该第一 光斑在该第二方向的边界, 否则以该帧图像在该第二方向的边界作为该第一光斑在该 第二方向的边界。
在本发明的一实施例中, 该灰度阈值为该帧图像的平均灰度值。
在本发明的一实施例中, 根据所确定的第一光斑的边界确认第一光斑是否为有效 光斑的步骤包括: 判断该第一光斑的任一边界是否位于图像的边界, 如果不是, 则该 第一光斑为有效光斑。
在本发明的一实施例中, 根据所确定的第一光斑的尺寸确认第一光斑是否为有效 光斑的步骤包括: 判断该第一光斑的尺寸是否大于一阈值, 如果是, 则确认该第一光 斑为有效光斑, 其中, 选择该第一光斑在该第一方向和该第二方向的边界与该第一光 斑的中心点的距离的较大值, 作为该第一光斑的尺寸。
在本发明的一实施例中, 还依照下述步骤识别该帧图像中的第二光斑: 搜索该帧 图像中位于该第一光斑以外区域的灰度值最大的像素点, 作为第二光斑的中心点; 确 定该第二光斑的边界; 依据该第二光斑的边界与该第二光斑的中心点的距离, 确定该 第一光斑的尺寸; 根据所确定的第二光斑的边界和尺寸确认该第二光斑是否为有效光 斑。
在本发明的一实施例中, 确定该第二光斑的边界的步骤包括: 沿第一方向按距离 从小到大依次计算与该第二光斑的中心点相距一距离的像素点的灰度值, 并以灰度值 在该第一方向的突变点的前一像素点作为该第二光斑在该第一方向的边界, 沿第二方 向按距离从小到大依次计算与该第二光斑的中心点相距一距离的像素点的灰度值, 并 以灰度值在该第二方向的突变点的前一像素点作为该第二光斑在该第二方向的边界。
在本发明的一实施例中, 搜索该帧图像中位于该第一光斑以外区域的灰度值最大 的像素点的步骤包括: 将该帧图像的第一光斑中像素点的灰度值置为该图像的平均灰 度值, 获得一修改图像; 搜索该修改图像中灰度值最大的像素点。
在本发明的一实施例中, 以灰度值在该第一方向的突变点的前一像素点作为该第 二光斑在该第一方向的边界的步骤包括: 如果有一第一像素点的灰度值小于一灰度阈 值, 则以该第一像素点的前一像素点作为该第二光斑在该第一方向的边界, 否则以该 帧图像在该第一方向的边界作为该第二光斑在该第一方向的边界; 以灰度值在该第二 方向的突变点的前一像素点作为该第二光斑在该第二方向的边界的步骤包括: 如果有 一第二像素点的灰度值小于一灰度阈值, 则以该第二像素点的前一像素点作为该第二 光斑在该第二方向的边界, 否则以该帧图像在该第二方向的边界作为该第二光斑在该 第二方向的边界。
在本发明的一实施例中, 该灰度阈值为该帧图像的平均灰度值。 在本发明的一实施例中,处理每一帧图像以识别该帧图像中的光斑的步骤还包括: 按一预定比例缩小该帧图像, 该预定比例为图像的行像素数和列像素数的公约数。
在本发明的一实施例中, 当该摄像机常态为低帧速模式时, 该方法还包括: 识别 该可见光通信信号中预定序列的开始码; 将该摄像机切换到高帧速模式; 或者, 识别 该可见光通信信号中预定序列的结束码; 将该摄像机切换到低帧速模式; 其中, 切换 该摄像机的帧速模式的方法包括: 修改该摄像机的感光器的寄存器。
本发明另提出一种可见光信号的接收装置, 包括: 用于控制摄像头作为光信号接 收器来采集涵盖一发射源的一组连续图像的模块, 该发射源发出可见光信号; 以及用 于从该组连续图像中获得来自该发射源的可见光信号的模块, 包括: 用于将该组连续 图像分割为多幅图像的模块; 用于对比各幅图像中每个固定大小区域的明暗随时间的 变化情况, 选取出有连续变化的区域, 并判定该区域中存在可见光信号的模块; 以及 用于分析处理该区域的明暗变化, 获得来自发射源的可见光信号的模块。
在本发明的一实施例中, 上述接收装置还包括用于对该可见光信号进行信号处理 而还原成原始信息的模块。
在本发明的一实施例中,,对比各幅图像中每个固定大小区域的明暗随时间的变化 情况包括分析该每个固定大小区域的平均灰度值随时间的变化情况。
在本发明的一实施例中, 上述用于对该可见光信号进行信号处理而还原成原始信 息的模块是进行解码、 解密和 /或解扰。
在本发明的一实施例中, 所述用于控制摄像头作为光信号接收器来采集涵盖一发 射源的一组连续图像的模块包括: 用于从摄像机获得包含可见光通信信号的多帧图像 的模块; 所述用于从该组连续图像中获得来自该发射源的可见光信号的模块包括: 用 于处理每一帧图像以识别该帧图像中的光斑的模块, 包括: 用于搜索该帧图像中的灰 度值最大的像素点, 作为第一光斑的中心点的模块; 用于确定该第一光斑的边界的模 块; 用于依据该第一光斑的边界与该第一光斑的中心点的距离, 确定该第一光斑的尺 寸的模块; 用于根据所确定的第一光斑的边界和尺寸确认该第一光斑是否为有效光斑 的模块; 用于依据所识别的光斑恢复该可见光通信信号的模块。
在本发明的一实施例中, 用于确定该第一光斑的边界的模块包括: 用于沿第一方 向按距离从小到大依次计算与该第一光斑的中心点相距一距离的像素点的灰度值, 并 以灰度值在该第一方向的突变点的前一像素点作为该第一光斑在该第一方向的边界的 模块, 用于沿第二方向按距离从小到大依次计算与该第一光斑的中心点相距一距离的 像素点的灰度值, 并以灰度值在该第二方向的突变点的前一像素点作为该第一光斑在 该第二方向的边界的模块。
在本发明的一实施例中, 该第一方向与该第二方向相反。 在本发明的一实施例中, 在该用于沿第一方向按距离从小到大依次计算与该第一 光斑的中心点相距一距离的像素点的灰度值, 并以灰度值在该第一方向的突变点的前 一像素点作为该第一光斑在该第一方向的边界的模块中, 如果有一第一像素点的灰度 值小于一灰度阈值, 则以该第一像素点的前一像素点作为该第一光斑在该第一方向的 边界, 否则以该帧图像在该第一方向的边界作为该第一光斑在该第一方向的边界; 在 该用于沿第二方向按距离从小到大依次计算与该第一光斑的中心点相距一距离的像素 点的灰度值, 并以灰度值在该第二方向的突变点的前一像素点作为该第一光斑在该第 一方向的边界的模块中, 如果有一第二像素点的灰度值小于一灰度阈值, 则以该第二 像素点的前一像素点作为该第一光斑在该第二方向的边界, 否则以该帧图像在该第二 方向的边界作为该第一光斑在该第二方向的边界。
在本发明的一实施例中, 该灰度阈值为该帧图像的平均灰度值。
在本发明的一实施例中, 用于根据所确定的第一光斑的边界和尺寸确认第一光斑 是否为有效光斑的模块是判断该第一光斑的任一边界是否位于图像的边界,如果不是, 则该第一光斑为有效光斑; 用于根据所确定的第一光斑的边界和尺寸确认第一光斑是 否为有效光斑的模块是判断该第一光斑的尺寸是否大于一阈值, 如果是, 则确认该第 一光斑为有效光斑。
在本发明的一实施例中, 该用于处理每一帧图像以识别该帧图像中的光斑的模块 还包括: 用于搜索该修改图像中位于该第一光斑以外区域的灰度值最大的像素点, 作 为第二光斑的中心点的模块; 用于确定该第二光斑的边界的模块; 用于选择该第二光 斑的边界与该第二光斑的中心点的距离, 作为第二光斑的尺寸的模块; 用于根据所确 定的第二光斑的边界确认该第二光斑是否为有效光斑的模块。
在本发明的一实施例中, 用于确定该第二光斑的边界的模块包括: 用于沿第一方 向按距离从小到大依次计算与该第二光斑的中心点相距一距离的像素点的灰度值, 并 以灰度值在该第一方向的突变点的前一像素点作为该第二光斑在该第一方向的边界的 模块, 用于沿第二方向按距离从小到大依次计算与该第二光斑的中心点相距一距离的 像素点的灰度值, 并以灰度值在该第二方向的突变点的前一像素点作为该第二光斑在 该第二方向的边界的模块。
在本发明的一实施例中, 该第一方向与该第二方向相反。
在本发明的一实施例中, 用于搜索该修改图像中位于该第一光斑以外区域的灰度 值最大的像素点, 作为第二光斑的中心点的模块的模块包括: 用于将该帧图像的第一 光斑中像素点的灰度值置为该图像的平均灰度值, 获得一修改图像的模块; 用于搜索 该修改图像中灰度值最大的像素点的模块。 在本发明的一实施例中, 在该用于沿第一方向按距离从小到大依次计算与该第二 光斑的中心点相距一距离的像素点的灰度值, 并以灰度值在该第一方向的突变点的前 一像素点作为该第二光斑在该第一方向的边界的模块中, 如果有一第一像素点的灰度 值小于一灰度阈值, 则以该第一像素点的前一像素点作为该第二光斑在该第一方向的 边界, 否则以该帧图像在该第一方向的边界作为该第二光斑在该第一方向的边界; 在 该用于沿第二方向按距离从小到大依次计算与该第二光斑的中心点相距一距离的像素 点的灰度值, 并以灰度值在该第二方向的突变点的前一像素点作为该第二光斑在该第 一方向的边界的模块中, 如果有一第二像素点的灰度值小于一灰度阈值, 则以该第二 像素点的前一像素点作为该第二光斑在该第二方向的边界, 否则以该帧图像在该第二 方向的边界作为该第二光斑在该第二方向的边界。
在本发明的一实施例中, 该灰度阈值为该帧图像的平均灰度值。
在本发明的一实施例中, 该用于处理每一帧图像以识别该帧图像中的光斑的模块 还包括用于按一预定比例缩小图像的模块, 该预定比例为该帧图像的行像素数和列像 素数的公约数。
在本发明的一实施例中, 当该摄像机常态为低帧速模式时, 该装置还包括: 用于 识别该可见光通信信号中预定序列的开始码的模块; 用于根据识别的该开始码将该摄 像机切换到高帧速模式的模块; 用于识别该可见光通信信号中预定序列的结束码的模 块; 用于根据识别的该结束码将该摄像机切换到低帧速模式的模块。
本发明的上述技术方案的可见光信号的接收方法, 通过摄像头采集连续图像, 然 后对连续图像进行图像处理, 获得可见光信号。 这一接收方法采用摄像头接收可见光 信号, 可以在不增加和修改硬件的前提下, 实现各种设备或系统的可见光通信功能。
本发明的以上技术方案采用了一种专门用于处理及识别可见光通信信号中的光斑 的处理方法, 通过简单地确定光斑的中心的边界来识别光斑, 使之与一般的图像处理 技术相比, 具有更为简单、 有效的特点。 附图说明
为让本发明的上述目的、 特征和优点能更明显易懂, 以下结合附图对本发明的具 体实施方式作详细说明, 其中:
图 1示出本发明实施例的可见光信号的接收方法流程图。
图 2A-2E示出具有一个光斑的一帧图像的光斑位置的各种情形, 其中图 2A示出 整个光斑完全位于图像中, 图 2B和 2C示出部分光斑落入图像外, 但光斑中心仍在图 像中, 图 2D和 2E示出部分光斑落入图像外且光斑中心也在图像外。
图 3示出具有两个光斑的一帧图像。 图 4示出去除已识别的一个光斑的一帧修改图像。
图 5示出根据本发明一实施例的方法在低帧速模式下识别可见光通信信号的开始 码的示意图。
图 6示出根据本发明一实施例的修改摄像机的感光器的寄存器的示意图。
图 7 示出根据本发明一实施例的识别摄像机接收的可见光通信信号的方法流程 图。
图 8示出根据本发明一实施例的识别图像中的光斑的方法流程图。
图 9示出根据本发明另一实施例的识别图像中的光斑的方法流程图。
图 10 示出根据本发明另一实施例的识别摄像机接收的可见光通信信号的方法流 程图。
图 11示出根据本发明一实施例的调整摄像机帧速的流程图。 具体实施方式
目前的许多电子设备, 例如手机、 平板电脑、 笔记本电脑、 数码相机、 MP3播放 器 (如苹果公司的 iTouch)、 MP4播放器 (如苹果公司的 iTouch) 均配备有摄像头。 与之形成比较的是, 大部分的电子设备均未配备基于光电二极管作为光信号接收器。 因此, 本发明的实施例提出一种可见光信号的接收方法, 它利用摄像头而不是传统的 基于光电二极管作为光信号接收器。 这一设计的显而易见的优势是, 在许多应用环境 中省去了配备专用的光信号接收器的需要, 从而节省硬件方面的开支。
现在参考附图描述所要求保护的发明, 在全部附图中使用相同的参考标号来指相 同的部件或步骤。 在以下描述中, 为解释起见, 披露了众多具体细节以提供对所要求 保护的主题的全面理解。 然而, 显而易见的是, 这些发明也可以不采用这些具体细节 来实施。
本发明实施例可以在手机作为可见光信号的接收装置的环境下实施。关于发射源, 可以是发光二极管 (LED) 或发光二极管芯片。 发光二极管可以集成到手机、 平板电 脑、 笔记本电脑、 数码相机、 MP3播放器或 MP4播放器这样的电子设备中。 发光二 极管也可以是单独的装置, 例如照明灯。 这一照明灯所发出的可见光可以受一控制装 置的调制, 从而携带信号。
图 1示出本发明实施例的可见光信号的接收方法流程图。 参照图 1所示, 该方法 包括:
步骤 101, 打开手机的摄像头, 将其指向可见光信号的发射源, 使发射源落在摄 像头的摄像范围之内;
步骤 102, 控制手机的摄像头作为光信号接收器, 采集一组连续图像; 这组连续图像将会包含发射源的可见光信号所形成的图像和背景图像, 因此关键 是将可见光信号所形成的图像从背景图像中分离。
步骤 103, 采用图像处理技术从该组连续图像中获得来自该发射源的可见光信号; 以及
步骤 104, 对该可见光信号进行信号处理, 还原成原始信息。
在本实施例中, 原始信息包括但不限于, 文本、 图片、 音频、 和 /或视频。
在步骤 103中, 采用图像处理技术从该组连续图像中获得来自该发射源的可见光 信号的方法包括:
首先, 将连续图像分割为多幅图像。
然后, 对比各幅图像中每个固定大小区域的明暗随时间的变化情况, 选取出有连 续变化的区域, 并判定该区域中存在来自该发射源的可见光信号; 至于其它没有连续 变化的区别, 则被判定为背景图像。
接着, 分析处理该区域的明暗变化, 获得来自发射源的可见光信号。
本实施例中, 在对比各幅图像中每个固定大小区域的明暗随时间的变化情况的步 骤中, 明暗随时间变化可以为平均灰度值随时间的变化情况, 当有可见光信号时, 图 像的平均灰度值较小, 当有可见光信号存在时, 平均灰度值明显变大, 通过对比平均 灰度值则可以判断图像中是否存在可见光信号。 在上述选取出有连续变化的区域, 并 判定该区域中存在来自该发射源的可见光信号的步骤, 可以判断发射源发出的光线在 图像中所形成的光斑的位置, 具体的方法可以采用后续的识别摄像机接收的可见光通 信信号的方法的实施例。
在手机中可配置专门的视频处理模块, 对获得的连续图像进行分析处理以分离出 其中的可见光信号。
根据发射源的处理, 例如编码、 解密和 /或加扰, 在步骤 104中, 对该可见光信号 进行信号处理的步骤可相应地包括逆处理, 例如解码、 解密和 /或解扰。
当摄像头所采集的图像包含上述发射源的可见光信号时, 上述步骤所分离出的原 始信息可以独立于背景图像, 传送给后续的模块。 当摄像头所采集的图像未包含上述 发射源的可见光信号时, 经过上述步骤后仅会输出普通的背景图像。
本实施例提供的采用手机摄像头接收可见光信号的方法, 将手机摄像头指向可见 光信号发射源采集连续图像, 然后对连续图像进行图像处理, 获得可见光信号, 接着 对可见光信号进行解码等信号处理, 还原成原始信息。 由于这一方法采用手机摄像头 接收可见光信号, 可以在不增加和修改手机硬件的前提下, 实现采用手机接收可见光 信号的功能。 这样, 手机就可在非连接状态下从其它设备, 例如另一手机、 平板电脑 中接收文本、 图片、 音频、 和 /或视频等数据。
在本发明中, 除了可以在手机作为可见光信号的接收装置的环境下实施, 也可以 在平板电脑作为可见光信号的接收装置的环境下实施; 本发明的摄像头不仅可以集成 在前述的手机、 平板电脑上, 还可以集成在笔记本电脑、 数码相机、 MP3 播放器或 MP4播放器等其它电子设备上。
在本发明中, 还可以在独立摄像头作为可见光信号的接收装置的环境下实施, 对 于采用独立摄像头接收可见光信号的方法, 将独立摄像头指向可见光信号发射源采集 连续图像, 然后对连续图像进行图像处理, 获得可见光信号, 接着对可见光信号进行 解码等信号处理, 还原成原始信息。 由于这一方法采用独立摄像头接收可见光信号, 可以给许多将摄像头作为标准配备的系统提供可见光通信功能, 其它系统也可以配备 摄像头来获得可见光通信的扩展功能。 举例来说, 安防系统或监控系统通常连接配备 有许多摄像头, 如果通过这些摄像头接收可见光信号, 然后在系统中进行后续的图像 处理和信号处理, 就能够实现可见光通信功能。 另外, 对于台式电脑或者不配备摄像 头的笔记本电脑而言, 通过连接一个外置的摄像头, 在获得视频拍摄功能的同时, 还 可以获得可见光通信的扩展功能。 当以台式电脑或笔记本电脑以主机时, 这一功能可 便于从手机、 平板电脑、 数码相机等便携式电子设备处获得数据。
在本发明的上述实施例中, 摄像头可以是电荷耦合器件 (CCD) 类型或者互补金 属氧化物半导体 (CMOS) 类型。
本发明的上述实施例所提出一种可见光信号的接收方法, 通过将摄像头指向可见 光信号发射源采集连续图像, 然后对连续图像进行图像处理, 获得可见光信号, 接着 对可见光信号进行解码等信号处理, 还原成原始信息。 这一接收方法采用摄像头接收 可见光信号, 可以在不增加和修改硬件的前提下, 实现各种设备或系统的可见光通信 功能。
本发明另提出一种可见光信号的接收装置, 包括: 用于控制摄像头作为光信号接 收器来采集涵盖一发射源的一组连续图像的模块, 该发射源发出可见光信号; 以及用 于从该组连续图像中获得来自该发射源的可见光信号的模块。
上述接收装置还包括用于对该可见光信号进行信号处理而还原成原始信息的模 块。
上述用于从该组连续图像中获得来自该发射源的可见光信号的模块包括: 用于将 该组连续图像分割为多幅图像的模块; 用于对比各幅图像中每个固定大小区域的明暗 随时间的变化情况, 选取出有连续变化的区域, 并判定该区域中存在可见光信号的模 块; 以及用于分析处理该区域的明暗变化, 获得来自发射源的可见光信号的模块。 上述用于对该可见光信号进行信号处理而还原成原始信息的模块是进行解码、 解 密和 /或解扰。
本发明实施例还提供了一种识别摄像机接收的可见光通信信号的方法, 该方法可 以为本发明实施例的可见光信号的接收方法的优选实施方式。 本实施例的方法可以用 于上述可见光信号的接收方法中判断发射源发出的光线在图像中所形成的光斑的位 置。 这一方法由于特别针对含有可见光通信信号的图像, 特别是包含了光斑的图像, 由此识别过程得以简化, 从而变得更有效率。
现在参考附图描述所要求保护的发明, 在全部附图中使用相同的参考标号来指相 同的部件或步骤。 在以下描述中, 为解释起见, 披露了众多具体细节以提供对所要求 保护的主题的全面理解。 然而, 显而易见的是, 这些发明也可以不采用这些具体细节 来实施。
可见光通信的发送端所采用的光源包括是发光二极管 (LED), 其因良好的开 /关 性能而得到广泛使用。 除此之外, 使用具有照相功能的便携式电子设备的闪光灯也是 一种可行的选择,尤其是在十分普及的手机普遍配备了闪光灯而不配备 LED灯的情况 下。 当然, 部分闪光灯的类型本身就是 LED灯。
本发明实施例中, 摄像机适于接收上述光源所发出的可见光, 但并不以此为限。 本发明的摄像机可以是独立的摄像机, 也可以是集成到各种电子设备, 例如手机、 平 板电脑、 笔记本电脑、 数码相机、 MP3、 MP4播放器 (如苹果公司的 iTouch) 等的摄 像头。
当摄像机进行连续拍摄时, 如果在拍摄瞬间接收到可见光, 会在其所拍摄的图像 中留下光斑。 图 2A示出具有一个光斑的一帧图像。
可以理解的是, 当由不同的发送端的光源分别发出不同光束时, 摄像机所拍摄的 一帧图像中可能会有多个光斑。 图 3示出具有两个光斑的一帧图像。
接收端从摄像机获取这些图像后, 其重要的任务是识别哪些图像中包含光斑, 从 而还原出对应的数字信号。 举例来说, 当在发射源定义有光照射代表二进制 1, 而无 光照射代表二进制 0时, 在接收端相应将包含光斑的图像识别为二进制 1, 而不包含 光斑的图像识别为二进制 0。 当然, 这一定义仅为举例而已, 具体的规则可以由本领 域技术人员自行定义。 例如, 包含多个光斑可能代表了额外的信息。
图 7 示出根据本发明一实施例的识别摄像机接收的可见光通信信号的方法流程 图。 参照图 7所示, 该方法包括以下步骤:
在步骤 601, 从摄像机获得包含可见光通信信号的多帧图像;
在步骤 602, 处理每一帧图像, 以识别该帧图像中的光斑;
在步骤 603, 依据所识别的光斑恢复该可见光通信信号。 可以理解, 上述流程常规是按照流水线的方式运作, 即每获得一帧图像, 即进行 图像处理, 并恢复出其中的可见光通信信号。
上述流程中, 步骤 602是主要的步骤, 其具体方法可以参照图 8所示, 描述如下: 步骤 701, 搜索一帧图像中的灰度值最大的像素点, 作为光斑的中心点; 步骤 702, 确定光斑在第一方向的边界。
确定光斑边界的已知算法有不少, 这里列举一种简单的算法。 具体地说, 可以沿 第一方向按距离从小到大依次计算与该光斑的中心点相距一距离的像素点的灰度值, 并以灰度值在该第一方向的突变点的前一像素点作为该光斑在该第一方向的边界。
也就是说, 在上述计算过程中, 比较像素点的灰度值与一灰度阈值。 如果像素点 的灰度值大于或等于一个灰度阈值, 例如图像的平均灰度值, 则认为该像素点属于光 斑区域; 相反, 如果像素点的灰度值小于图像的平均灰度值, 则认为该像素点不属于 光斑区域。 以灰度值小于图像的平均灰度值的突变点的前一像素点作为光斑在该第一 方向的边界, 记为第一像素点。 第一像素点与光斑的中心点的距离记为第一距离。
光斑通常被视为圆形来处理, 因此该第一距离通常可以被认为是光斑的半径。 以 图 2A来说, 沿着 +x方向决定的第一距离 dl为光斑的半径。
然而, 存在如图 2B所示的情形。 在此情形中, 由于发射源并未对准摄像机, 光 斑只是部分地落入图像区域。 因此, 如果在步骤 702的计算过程中, 发现所计算的像 素点已经位于图像的边界, 即停止计算。 同样记录该像素点为第一像素点, 得到第一 距离 dl。 图 2C所示情形也是如此。
考虑到图 2B和图 2C所示情形的存在, 沿着与第一方向相反的第二方向(即 -X方 向) 寻找光斑的边界成为必要。
步骤 703, 确定光斑在第二方向的边界。
类似于前述算法, 可以沿第二方向按距离从小到大依次计算与该光斑的中心点相 距一距离的像素点的灰度值, 以灰度值在该第二方向的突变点的前一像素点作为该光 斑在该第二方向的边界。
同样地, 如果像素点的灰度值大于或等于一个灰度阈值,例如图像的平均灰度值, 则认为该像素点属于光斑区域; 相反, 如果像素点的灰度值小于图像的平均灰度值, 则认为该像素点不属于光斑区域。 因此, 以灰度值小于图像的平均灰度值的突变点的 前一像素点作为光斑在该第二方向的边界, 记为第二像素点。 第二像素点与光斑的中 心点的距离记为第二距离 d2。 另外, 如果在前述的计算过程中发现所计算的像素点已 经位于图像的边界, 即停止计算。 同样, 记录该像素点为第二像素点, 得到第二距离 d2。 步骤 704, 根据光斑的边界与光斑中心点的距离确定光斑尺寸。
在此, 选择第一距离 dl和第二距离 d2的最大值, 作为光斑的尺寸。
步骤 705, 根据所确定的光斑的边界确定该光斑是否为有效光斑。
例如, 当步骤 704所确定的光斑的尺寸小于一阈值, 例如 5时, 认为光斑是由噪 声引起的, 排除这一光斑。 此时该帧图像实际上不包含光斑。
实际中还存在如图 2D和图 2E所示的情形, 在这些情形中, 发射源发生更严重地 偏离, 光斑的中心 0落在图像的边界之外, 因此第一距离 dl实际为 0, 只能计算出一 个有效的第二距离 d2。 尽管在技术上有处理此类光斑的可能, 但较佳地, 当第一距离 dl和第二距离 d2出现 0时, 可以将光斑作为无效光斑排除。
通过步骤 701-705, 将能识别一帧图像中是否有光斑, 以及光斑的边界。
较佳地, 可以在流程之前, 将对一帧图像进行降噪处理, 以提高图像质量, 降低 无效光斑出现的概率。
值得一提的是,本实施例中尽管只能从 2个方向(+x和 -X方向)确定光斑的边界, 但可以理解的是, 在其它实施例中, 可以从更少方向, 例如从 1个方向 (如 +x方向) 确定光斑的边界; 或者可以从更多方向, 例如 4个 (+x, -X方向, +y,-y方向) 确定光 斑的边界。 从 1个方向确定光斑的边界足可应付如图 2A所示情形, 在这种情况下, 可以考虑将图 2B-2E的情形均视为无效光斑。
下面例举图 8所示流程的处理示例。
假设图像为 ΜχΝ个像素, 各个像素的灰度值为 g(ij), i=l,2,...M, j=l,2,..N。 其中 (i,j)为图像中像素坐标, i表示横坐标即列坐标, j表示给纵坐标即行坐标, 如第 3行第 4列的像素点的灰度值即可表示为 g(4,3)。
先对行进行操作, 找出每行的灰度最大值 gm (i), i=l,2,...M。 再找出 gm中的最 大值 g(S,t)=gmaX, 同时也是整个图像的灰度最大值。 (s, t)即为灰度最大值的像素点坐 标。 另外, 还计算整个图像的平均灰度值八。
计算 gm(s-k)- A, k=l,2,...,kl, 其中 kl满足 gm(s-kl)- Δ 0, 且 gm ( s-kl-1) - Δ<0。 在此, kl+1处发生了灰度值的突变, 其上一个值 kl所代表的像素点被认为是光斑的 一个方向的边界。 可能存在多个满足上述突变的 kl, 但是只计算到第一个或最小 kl 就停止计算。 如果上述突变点尚未找到, 就已碰到图像的边界, 也记录此时的 kl。
计算 gm(s+k)- Δ, k=l,2,...,k2, 其中 k2满足 gm(s+k2)- Δ^Ο, 且 gm ( s+k2+l) - Δ <0。 在此, k2+l处发生了灰度值的突变, 其上一个值 k2所代表的像素点被认为是光 斑的另一个方向的边界。 可能存在多个满足上述突变的 k2, 但是只计算到第一个或最 小 k2 就停止计算。 如果上述突变点尚未找到, 就已碰到图像的边界, 也记录此时的 k2。
由此确定最亮光斑中心 Cs,t), 半径为 km=maxCkl,k2)。
接下来排除无效光斑。 首先, 如果 km 5, 则 km为最亮光斑半径; 否则 g(s,t)为 噪声, 结束计算, 认为图像没有光斑。 其次, 如果 kl或 k2=0, 也认为光斑无效。
图 8所示实施例的识别过程主要关注图像是否有光斑及光斑边界。 如前所述, 存 在一帧图像包含多个光斑的情形(如图 3所示),如果识别过程还关注图像包含的光斑 数目, 则步骤 602可以实施为如图 9所示的流程。 参照图 9所示:
步骤 801, 搜索一帧图像中的灰度值最大的像素点, 作为光斑的中心点; 步骤 802, 确定光斑在第一方向的边界。
类似于前述实施例的算法, 可以沿第一方向按距离从小到大依次计算与该光斑的 中心点相距一距离的像素点的灰度值, 并以灰度值在该第一方向的突变点的前一像素 点作为该光斑在该第一方向的边界;
也就是说, 在上述计算过程中比较像素点的灰度值与一灰度阈值, 如果像素点的 灰度值大于或等于一个灰度阈值, 例如图像的平均灰度值, 则认为该像素点属于光斑 区域; 相反, 如果像素点的灰度值小于图像的平均灰度值, 则认为该像素点不属于光 斑区域。 以灰度值小于图像的平均灰度值的突变点的前一像素点作为光斑在该第一方 向的边界, 记为第一像素点。 第一像素点与光斑的中心点的距离记为第一距离。
另外, 如果在步骤 802的计算过程中,发现所计算的像素点已经位于图像的边界, 即停止计算。 同样记录该像素点为第一像素点, 得到第一距离 dl。
步骤 803, 确定光斑在第二方向的边界。
类似于前述算法, 沿第二方向按距离从小到大依次计算与该光斑的中心点相距一 距离的像素点的灰度值, 以灰度值在该第二方向的突变点的前一像素点作为该光斑在 该第二方向的边界。
也就是说, 如果像素点的灰度值大于或等于一个灰度阈值, 例如图像的平均灰度 值, 则认为该像素点属于光斑区域; 相反, 如果像素点的灰度值小于图像的平均灰度 值, 则认为该像素点不属于光斑区域。 因此, 以灰度值小于图像的平均灰度值的突变 点的前一像素点作为光斑在该第二方向的边界, 记为第二像素点。 第二像素点与光斑 的中心点的距离记为第二距离 d2。 另外, 如果在前述的计算过程中发现所计算的像素 点已经位于图像的边界, 即停止计算。 同样, 记录该像素点为第二像素点, 得到第二 距离 d2。
步骤 804, 根据光斑的边界与光斑中心点的距离确定光斑尺寸。 在此, 选择第一距离 dl和第二距离 d2的最大值, 作为光斑的尺寸。
步骤 805, 根据所确定的光斑的边界确定该光斑是否为有效光斑。
通过步骤 801-805, 将能识别一帧图像中是否有光斑, 以及光斑的边界。
另外, 如果在步骤 805中, 发现所确定的光斑的尺寸小于一阈值, 例如 5时, 认 为光斑是由噪声引起的, 在认为这一光斑是无效光斑的同时, 认为该帧图像实际上不 包含光斑。 因此在步骤 806判断图像中是否可能存在未识别的光斑时, 流程结束。
在其它情况下,例如排除了过于偏离图像区域的光斑(如图 2D和图 2E所示)后, 认为图像仍可能含有未识别的光斑, 流程进入步骤 807。
在步骤 807, 将该帧图像的已识别的光斑区域中像素点的灰度值置为图像的平均 灰度值, 获得一修改图像; 然后, 回到步骤 801, 以识别另一光斑。
步骤 807的目的是在后续处理过程中, 将已识别的光斑区域排除在外。 从结果上 看, 后续的处理实际上是在搜索图像中已识别的光斑区域外的最大灰度值。 可以理解 的是, 在实际处理时可以不进行前述的修改, 而直接在已识别的光斑区域外进行上述 的搜索。
这样, 每次识别了一个光斑, 则在当前图像中将识别的光斑区域的灰度值设置为 图像的平均灰度值。 如此循环, 直到在步骤 806, 确定该帧图像未包含未识别的其它 光斑, 从而结束整个流程。
下面例举图 9所示流程的处理示例。
假设图像为 ΜχΝ个像素, 灰度值为 g(ij), i=l,2,...M, j=l,2,..N。
先对行进行操作, 找出每行的灰度最大值 gm (i), i=l,2,...M。 再找出 gm中的最 大值 g(S,t)=gmaX, 同时也是整个图像的灰度最大值。 (s, t) 即为灰度最大值的像素点。 另外, 还计算整个图像的平均灰度 Δ。
按 k从小到大的顺序计算 gmCs-k)- Δ, k=l,2,...,kl, 其中 kl满足 gmCs-kl)- Δ^Ο, 且 gm ( s-kl-l) - A<0。 在此, kl+1处发生了灰度值的突变, 其前一值 kl所代表的像 素点被认为是光斑的一个方向的边界。 需要指出的是, 可能存在多个满足上述突变的 kl , 但是只计算到第一个或最小 kl就停止计算。如果上述突变点尚未找到, 就已碰到 图像的边界, 也记录此时的 kl。
按 k从小到大的顺序计算 gmCs+k)- Δ, k=l,2,...,k2, 其中 k2满足 gm(s+k2;)- Δ^Ο, 且 gm ( s+k2+l) - Δ<0。 在此, k2+2处发生了灰度值的突变, 其前一值 k2所代表的 像素点被认为是光斑的另一方向的边界。 可能存在多个满足上述突变的 k2, 但是只计 算到第一个或最小 k2就停止计算。 如果上述突变点尚未找到, 就已碰到图像的边界, 也记录此时的 k2。 由此确定最亮光斑中心 Cs,t), 半径为 km=maxCkl,k2)。
接下来排除无效光斑。 首先, 如果 km 5, 则 km为最亮光斑半径; 否则 g(s,t)为 噪声, 结束计算, 认为图像没有光斑。 其次, 如果 kl或 k2=0, 也认为光斑无效。 如 果前述的过程能够找到一个有效光斑 A, 那么在找到光斑 A 后, 此时将区域 [s-km,s+km] , [t-km,t+km]的灰度值都置为 Δ, 得到如图 4所示的修改后的图像。 同样 按照前述方法, 可以找到光斑 Β。 当有多个光斑时, 按照这种方法依次进行下去, 可 以确定每个光斑的区域。
图 7所示流程虽然能够正确地识别光斑及光斑个数, 然而流程可能会不必要地复 杂。 原因在于, 如果在图像的原有分辨率上进行, 识别图像是否存在光斑, 所需的计 算量会比较庞大。 而为了识别图像是否存在光斑及确定光斑个数, 并不需要很高的分 辨率。 因此本发明的另一实施例提出一种简化的方案。
图 10 示出根据本发明另一实施例的识别摄像机接收的可见光通信信号的方法流 程图。 参照图 10所示, 该方法包括以下步骤:
在步骤 901, 从摄像机获得包含可见光通信信号的多帧图像;
在步骤 902a, 处理每一帧图像, 按一预定比例缩小该帧图像;
也就是说, 按一预定比例降低图像的分辨率。
在步骤 902b, 识别该帧图像中的光斑;
在步骤 903, 依据所识别的光斑恢复该可见光通信信号。
可以理解, 上述流程常规是按照流水线的方式运作, 即每获得一帧图像, 即进行 图像处理, 并恢复出其中的可见光通信信号。
可以看出, 上述实施例与图 10所示实施例的差别在于,在识别每一帧图像中的光 斑之前, 会先按一预定比例缩小该帧图像。 这将降低图像的分辨率, 从而也降低处理 图像所需的计算量, 由此简化了方法。
在本实施例中, 预定比例为该帧图像的行像素数和列像素数的公约数。 例如, 分 辨率为 800*600的图像 (即行像素数为 800, 列像素数为 600), 预定比例可以选取为 8, 即将图像缩小为 100*75。
可以理解, 预定比例可以在计算复杂度和识别准确性方面进行折衷。 例如可以要 求经缩小的该帧图像中, 行像素数和列像素数均大于一个阈值, 以能够识别所需数目 的光斑。
举例来说, 可以将图像 ΜχΝ的相邻四个像素作为 1个单位进行计算, 即每 2 X 2 个像素作为一个单位,这样图像简化为 M/2XN/2维。例如将像素 (1, 1), (1,2), (2, 1)和 (2,2) 预先计算平均值作为新的像素 ( 1, 1 ) 。 一般地, 原图像的像素点 (2i-l,2j-l),(2i-l,2j),(2i,2j-l)和 (2i, 2j)对应于简化图像的像素点 (i, j), l≤i≤M/2, l≤j≤N/2, 并且 g'(ij)=(g(2i-l,2j-l)+ g (2i-l,2j) + g (2i,2j-l)+ g (2i, 2j))/4, Γ表示简化后图像灰度值。 其中 (i,j)为简化后图像的像素坐标, i表示横坐标即列坐标, j表示给纵坐标即行坐标, 如第 3行第 4列的母像素点的灰度值即可表示为 Γ(4,3)。
进一步地, 如果 Μ 和 Ν 公约数包含值 pi, p2, pm, 那么图像可以简化为 M/pgxN/pg, 其中 l≤g≤m。 当然如果 pg过大会影响分辨率, 所以在需要在图像处理速 度和分辨率之间做相应的取舍。
可以理解, 图 10所示的流程中, 步骤 902b可以用图 8或图 9所示实施例的流程 实施。
在接收可见光时, 所使用摄像机的帧速需要能够匹配发射端所发出的可见光的数 据传输速率。 例如, 如果发射端发出的可见光通信信号的比特率大致为 50bps (比特 / 秒), 要求摄像头至少具有 lOOfps (帧 /秒)。
大部分摄像机都可以满足上述帧速要求。 不过, 有些摄像机, 例如拍摄日常视频 用的摄像机常规地将帧速设置在 25fps或者 30fps的低帧速模式。因此在接收可见光通 信信号的过程中, 需要适应性地调整这些摄像机到高帧速模式。
摄像机帧速的调整可以通过单片机修改 CMOS寄存器来完成, 协议为 I2C。 涉及 摄像机帧速调整的硬件可以参照图 7所示。
可以在可见光通信信号的开头约定预定序列的开始码, 以指令摄像机调整到高帧 速模式。 同样地, 如果需要, 可以在可见光通信信号的结尾约定预定序列的结束码, 以指令摄像机调整回低帧速模式。
图 11示出根据本发明一实施例的调整摄像机帧速的流程图。假设摄像机常态地处 于低帧速模式, 那么其将按照图 9的流程调整到高帧速模式。
在步骤 1001, 在摄像机接收及识别可见光通信信号。 这一步骤中的识别, 可以参 照图 7或图 9所示流程来实施。 通过识别, 可以得到可见光信号中的开始码。 然后, 在步骤 1002识别开始码是否是约定的预定序列, 如果是, 在步骤 1003将摄像机切换 到高帧速模式。
图 5示出根据本发明一实施例的方法在低帧速模式下识别可见光通信信号的开始 码的示意图。 参照图 5所示, 假设可见光通信信号的发射端的发送速率为 50bps, 其 中开始码为 110011, 这样帧速为 30fps的摄像机所捕获的信息仅为三幅图像, 分别在 33ms, 67ms和 100ms是拍摄到, 其中第一幅和第三幅有亮斑, 而第二幅图像没有亮 斑。 识别的结果是, 三幅图像对应值依次为 1、 0、 1。
因此, 如果在低帧速下接收的开始码为 0x101, 那么摄像机启动进入高帧速 (例 如 120fps) 模式。 类似地, 设定信号的结束码, 比如 0x111。 摄像机接收到结束码后, 就自动切换 回低帧速 (例如 30fps) 模式。
本发明的另一实施例为一种识别摄像机接收的可见光通信信号的装置, 包括用于 从摄像机获得包含可见光通信信号的多帧图像的模块; 用于处理每一帧图像以识别该 帧图像中的光斑的模块; 以及用于依据所识别的光斑恢复该可见光通信信号的模块。
其中, 用于处理每一帧图像以识别该帧图像中的光斑的模块进一步包括: 用于搜 索该帧图像中的灰度值最大的像素点, 作为第一光斑的中心点的模块; 用于沿第一方 向按距离从小到大依次计算与该第一光斑的中心点相距一距离的像素点的灰度值, 并 以灰度值在该第一方向的突变点的前一像素点作为该第一光斑在该第一方向的边界的 模块; 用于沿第二方向按距离从小到大依次计算与该第一光斑的中心点相距一距离的 像素点的灰度值, 并以灰度值在该第二方向的突变点的前一像素点作为该第一光斑在 该第二方向的边界的模块; 用于选择该第一光斑在该第一方向和该第二方向的边界与 该第一光斑的中心点的距离的较大值, 作为第一光斑的尺寸的模块; 以及用于根据所 确定的第一光斑的边界确认该第一光斑是否为有效光斑的模块。
在一较佳实施例中, 在该用于沿第一方向按距离从小到大依次计算与该第一光斑 的中心点相距一距离的像素点的灰度值, 并以灰度值在该第一方向的突变点的前一像 素点作为该第一光斑在该第一方向的边界的模块中, 如果有一第一像素点的灰度值小 于该帧图像的平均灰度值, 则以该第一像素点的前一像素点作为该第一光斑在该第一 方向的边界, 否则以该帧图像在该第一方向的边界作为该第一光斑在该第一方向的边 界。
在一较佳实施例中, 在该用于沿第二方向按距离从小到大依次计算与该第一光斑 的中心点相距一距离的像素点的灰度值, 并以灰度值在该第二方向的突变点的前一像 素点作为该第一光斑在该第一方向的边界的模块中, 如果有一第二像素点的灰度值小 于该帧图像的平均灰度值, 则以该第二像素点的前一像素点作为该第一光斑在该第二 方向的边界, 否则以该帧图像在该第二方向的边界作为该第一光斑在该第二方向的边 界。
在一较佳实施例中, 该第一方向与该第二方向相反。
在一较佳实施例中, 该用于处理每一帧图像以识别该帧图像中的光斑的模块还包 括: 用于将该帧图像的第一光斑中像素点的灰度值置为图像的平均灰度值, 获得一修 改图像的模块; 用于搜索该修改图像中的灰度值最大的像素点, 作为第二光斑的中心 点的模块; 用于沿第一方向按距离从小到大依次计算与该第二光斑的中心点相距一距 离的像素点的灰度值, 并以灰度值在该第一方向的突变点的前一像素点作为该第二光 斑在该第一方向的边界的模块; 用于沿第二方向按距离从小到大依次计算与该第二光 斑的中心点相距一距离的像素点的灰度值, 并以灰度值在该第二方向的突变点的前一 像素点作为该第二光斑在该第二方向的边界的模块; 用于选择该第二光斑在该第一方 向和该第二方向的边界与该第二光斑的中心点的距离的较大值, 作为第二光斑的尺寸 的模块; 以及用于根据所确定的第二光斑的边界确认该第二光斑是否为有效光斑的模 块。
在一较佳实施例中, 该用于处理每一帧图像以识别该帧图像中的光斑的模块还包 括用于按一预定比例缩小图像的模块。
在一较佳实施例中, 该预定比例为该帧图像的行像素数和列像素数的公约数。 在一较佳实施例中, 当该摄像机常态为低帧速模式时, 该装置还包括: 用于识别 该可见光通信信号中预定序列的开始码的模块; 用于根据所识别的开始码将该摄像机 切换到高帧速模式的模块。
在一较佳实施例中, 该装置还包括: 用于识别该可见光通信信号中预定序列的结 束码的模块; 用于根据所识别的结束码将该摄像机切换到低帧速模式的模块。
本发明的识别摄像机接收的可见光通信信号的装置可以作为光子接收器, 用于可 见光通信系统中。
本文中描述的各种实施例可在例如计算机软件、 硬件或计算机软件与硬件的组合 的计算机可读取介质中加以实施。 对于硬件实施而言, 本文中所描述的实施例可在一 个或多个专用集成电路(ASIC)、数字信号处理器(DSP)、数字信号处理器件(DAPD)、 可编程逻辑器件 (PLD)、 现场可编程门阵列 (FPGA)、 处理器、 控制器、 微控制器、 微处理器、 用于执行上述功能的其它电子装置或上述装置的选择组合来加以实施。 在 部分情况下, 这类实施例可以通过控制器进行实施。
对软件实施而言, 本文中所描述的实施例可通过诸如程序模块(procedures)和函 数模块 (functions) 等独立的软件模块来加以实施, 其中每一个模块执行一个或多个 本文中描述的功能和操作。 软件代码可通过在适当编程语言中编写的应用软件来加以 实施, 可以储存在内存中, 由控制器或处理器执行。
虽然本发明已参照当前的具体实施例来描述, 但是本技术领域中的普通技术人员 应当认识到, 以上的实施例仅是用来说明本发明, 在没有脱离本发明精神的情况下还 可作出各种等效的变化或替换, 因此, 只要在本发明的实质精神范围内对上述实施例 的变化、 变型都将落在本申请的权利要求书的范围内。

Claims

权 利 要 求 书
1. 一种可见光信号的接收方法, 包括以下步骤:
控制摄像头作为光信号接收器, 采集涵盖一发射源的一组连续图像, 该发射源发出可 见光信号;
将该组连续图像分割为多幅图像;
对比各幅图像中每个固定大小区域的明暗随时间的变化情况, 选取出有连续变化的区 域, 并判定该区域中存在可见光信号; 以及
分析处理该区域的明暗变化, 获得来自发射源的可见光信号。
2. 根据权利要求 1 所述的方法, 其特征在于, 获得来自该发射源的可见光信号之后 还包括: 对该可见光信号进行信号处理, 还原成原始信息。
3. 根据权利要求 1 所述的方法, 其特征在于, 对比各幅图像中每个固定大小区域的 明暗随时间的变化情况包括分析该每个固定大小区域的平均灰度值随时间的变化情 况。
4. 根据权利要求 1 所述的方法, 其特征在于, 对该可见光信号进行信号处理的步骤 包括解码、 解密和 /或解扰。
5. 根据权利要求 1 所述的方法, 其特征在于, 控制摄像头作为光信号接收器的步骤 包括: 控制独立的摄像头或集成到一电子设备中的摄像头作为光信号接收器, 且使该 独立的摄像头连接到一安防系统、 一监控系统或一计算机。
6. 根据权利要求 1所述的方法, 其特征在于:
在将该组连续图像分割为多幅图像的步骤中, 该多幅图像为多帧图像;
选取出有连续变化的区域, 并判定该区域中存在可见光信号包括依照下述步骤处理每 一帧图像以识别该帧图像中的光斑:
搜索该帧图像中的灰度值最大的像素点, 作为第一光斑的中心点;
确定该第一光斑的边界;
依据该第一光斑的边界与该第一光斑的中心点的距离, 确定该第一光斑的尺寸; 以及 根据所确定的第一光斑的边界和尺寸确认第一光斑是否为有效光斑;
依据所识别的光斑恢复该可见光通信信号。
7. 根据权利要求 6所述的方法, 其特征在于, 确定该第一光斑的边界的步骤包括: 沿第一方向按距离从小到大依次计算与该第一光斑的中心点相距一距离的像素点的灰 度值, 并以灰度值在该第一方向的突变点的前一像素点作为该第一光斑在该第一方向 的边界,
沿第二方向按距离从小到大依次计算与该第一光斑的中心点相距一距离的像素点的灰 度值, 并以灰度值在该第二方向的突变点的前一像素点作为该第一光斑在该第二方向 的边界。
8. 根据权利要求 7所述的方法, 其特征在于, 该第一方向与该第二方向相反。
9. 根据权利要求 6所述的方法, 其特征在于, 以灰度值在该第一方向的突变点的前 一像素点作为该第一光斑在该第一方向的边界的步骤包括: 如果有一第一像素点的灰 度值小于一灰度阈值, 则以该第一像素点的前一像素点作为该第一光斑在该第一方向 的边界, 否则以该帧图像在该第一方向的边界作为该第一光斑在该第一方向的边界; 以灰度值在该第二方向的突变点的前一像素点作为该第一光斑在该第二方向的边界的 步骤包括: 如果有一第二像素点的灰度值小于一灰度阈值, 则以该第二像素点的前一 像素点作为该第一光斑在该第二方向的边界, 否则以该帧图像在该第二方向的边界作 为该第一光斑在该第二方向的边界。
10. 根据权利要求 9所述的方法, 其特征在于, 该灰度阈值为该帧图像的平均灰度值。
11. 根据权利要求 6所述的方法, 其特征在于, 根据所确定的第一光斑的边界确认第 一光斑是否为有效光斑的步骤包括:判断该第一光斑的任一边界是否位于图像的边界, 如果不是, 则该第一光斑为有效光斑。
12. 根据权利要求 7所述的方法, 其特征在于, 根据所确定的第一光斑的尺寸确认第 一光斑是否为有效光斑的步骤包括: 判断该第一光斑的尺寸是否大于一阈值,如果是, 则确认该第一光斑为有效光斑, 其中, 选择该第一光斑在该第一方向和该第二方向的 边界与该第一光斑的中心点的距离的较大值, 作为该第一光斑的尺寸。
13. 根据权利要求 6所述的方法, 其特征在于, 还依照下述步骤识别该帧图像中的第 二光斑:
搜索该帧图像中位于该第一光斑以外区域的灰度值最大的像素点, 作为第二光斑的中 心点;
确定该第二光斑的边界;
依据该第二光斑的边界与该第二光斑的中心点的距离, 确定该第一光斑的尺寸; 以及 根据所确定的第二光斑的边界和尺寸确认该第二光斑是否为有效光斑。
14. 根据权利要求 6所述的方法, 其特征在于, 确定该第二光斑的边界的步骤包括: 沿第一方向按距离从小到大依次计算与该第二光斑的中心点相距一距离的像素点的灰 度值, 并以灰度值在该第一方向的突变点的前一像素点作为该第二光斑在该第一方向 的边界,
沿第二方向按距离从小到大依次计算与该第二光斑的中心点相距一距离的像素点的灰 度值, 并以灰度值在该第二方向的突变点的前一像素点作为该第二光斑在该第二方向 的边界。
15. 根据权利要求 13所述的方法, 其特征在于, 搜索该帧图像中位于该第一光斑以外 区域的灰度值最大的像素点的步骤包括:
将该帧图像的第一光斑中像素点的灰度值置为该图像的平均灰度值,获得一修改图像; 以及
搜索该修改图像中灰度值最大的像素点。
16. 根据权利要求 13所述的方法, 其特征在于, 以灰度值在该第一方向的突变点的前 一像素点作为该第二光斑在该第一方向的边界的步骤包括: 如果有一第一像素点的灰 度值小于一灰度阈值, 则以该第一像素点的前一像素点作为该第二光斑在该第一方向 的边界, 否则以该帧图像在该第一方向的边界作为该第二光斑在该第一方向的边界; 以灰度值在该第二方向的突变点的前一像素点作为该第二光斑在该第二方向的边界的 步骤包括: 如果有一第二像素点的灰度值小于一灰度阈值, 则以该第二像素点的前一 像素点作为该第二光斑在该第二方向的边界, 否则以该帧图像在该第二方向的边界作 为该第二光斑在该第二方向的边界。
17. 根据权利要求 16所述的方法,其特征在于,该灰度阈值为该帧图像的平均灰度值。
18. 根据权利要求 6所述的方法, 其特征在于, 处理每一帧图像以识别该帧图像中的 光斑的步骤还包括:
按一预定比例缩小该帧图像, 该预定比例为图像的行像素数和列像素数的公约数。
19. 根据权利要求 6所述的方法, 其特征在于, 当该摄像机常态为低帧速模式时, 该 方法还包括:
识别该可见光通信信号中预定序列的开始码;
将该摄像机切换到高帧速模式;
或者
识别该可见光通信信号中预定序列的结束码;
将该摄像机切换到低帧速模式;
其中, 切换该摄像机的帧速模式的方法包括: 修改该摄像机的感光器的寄存器。
20. 一种可见光信号的接收装置, 包括: 用于控制摄像头作为光信号接收器来采集涵盖一发射源的一组连续图像的模块, 该发 射源发出可见光信号;
用于从该组连续图像中获得来自该发射源的可见光信号的模块, 包括:
用于将该组连续图像分割为多幅图像的模块;
用于对比各幅图像中每个固定大小区域的明暗随时间的变化情况, 选取出有连续变化 的区域, 并判定该区域中存在可见光信号的模块; 以及
用于分析处理该区域的明暗变化, 获得来自发射源的可见光信号的模块。
21. 根据权利要求 20所述的装置, 其特征在于, 还包括用于对该可见光信号进行信号 处理, 还原成原始信息的模块。
22. 根据权利要求 20所述的方法, 其特征在于, 对比各幅图像中每个固定大小区 域的明暗随时间的变化情况包括分析该每个固定大小区域的平均灰度值随时间的变化 情况。
23. 根据权利要求 20所述的装置, 其特征在于, 用于对该可见光信号进行信号处理而 还原成原始信息的模块是进行解码、 解密和 /或解扰。
24. 根据权利要求 20所述的装置, 其特征在于, 包括:
所述用于控制摄像头作为光信号接收器来采集涵盖一发射源的一组连续图像的模块包 括: 用于从摄像机获得包含可见光通信信号的多帧图像的模块;
所述用于从该组连续图像中获得来自该发射源的可见光信号的模块包括: 用于处理每 一帧图像以识别该帧图像中的光斑的模块, 包括:
用于搜索该帧图像中的灰度值最大的像素点, 作为第一光斑的中心点的模块; 用于确定该第一光斑的边界的模块;
用于依据该第一光斑的边界与该第一光斑的中心点的距离, 确定该第一光斑的尺寸的 模块; 以及
用于根据所确定的第一光斑的边界和尺寸确认该第一光斑是否为有效光斑的模块; 用于依据所识别的光斑恢复该可见光通信信号的模块。
25. 根据权利要求 24所述的装置, 其特征在于, 用于确定该第一光斑的边界的模块包 括:
用于沿第一方向按距离从小到大依次计算与该第一光斑的中心点相距一距离的像素点 的灰度值, 并以灰度值在该第一方向的突变点的前一像素点作为该第一光斑在该第一 方向的边界的模块, 用于沿第二方向按距离从小到大依次计算与该第一光斑的中心点相距一距离的像素点 的灰度值, 并以灰度值在该第二方向的突变点的前一像素点作为该第一光斑在该第二 方向的边界的模块。
26. 根据权利要求 25所述的装置, 其特征在于, 该第一方向与该第二方向相反。
27. 根据权利要求 25所述的装置, 其特征在于, 在该用于沿第一方向按距离从小到大 依次计算与该第一光斑的中心点相距一距离的像素点的灰度值, 并以灰度值在该第一 方向的突变点的前一像素点作为该第一光斑在该第一方向的边界的模块中, 如果有一 第一像素点的灰度值小于一灰度阈值, 则以该第一像素点的前一像素点作为该第一光 斑在该第一方向的边界, 否则以该帧图像在该第一方向的边界作为该第一光斑在该第 一方向的边界; 在该用于沿第二方向按距离从小到大依次计算与该第一光斑的中心点 相距一距离的像素点的灰度值, 并以灰度值在该第二方向的突变点的前一像素点作为 该第一光斑在该第一方向的边界的模块中, 如果有一第二像素点的灰度值小于一灰度 阈值, 则以该第二像素点的前一像素点作为该第一光斑在该第二方向的边界, 否则以 该帧图像在该第二方向的边界作为该第一光斑在该第二方向的边界。
28. 根据权利要求 27所述的装置,其特征在于,该灰度阈值为该帧图像的平均灰度值。
29. 根据权利要求 24所述的识别摄像机接收的可见光通信信号的方法, 其特征在于, 用于根据所确定的第一光斑的边界和尺寸确认第一光斑是否为有效光斑的模块是判断 该第一光斑的任一边界是否位于图像的边界, 如果不是, 则该第一光斑为有效光斑; 用于根据所确定的第一光斑的边界和尺寸确认第一光斑是否为有效光斑的模块是判断 该第一光斑的尺寸是否大于一阈值, 如果是, 则确认该第一光斑为有效光斑。
30. 根据权利要求 24所述的装置, 其特征在于, 该用于处理每一帧图像以识别该帧图 像中的光斑的模块还包括:
用于搜索该修改图像中位于该第一光斑以外区域的灰度值最大的像素点, 作为第二光 斑的中心点的模块;
用于确定该第二光斑的边界的模块;
用于选择该第二光斑的边界与该第二光斑的中心点的距离, 作为第二光斑的尺寸的模 块; 以及
用于根据所确定的第二光斑的边界确认该第二光斑是否为有效光斑的模块。
31. 根据权利要求 30所述的装置, 其特征在于, 用于确定该第二光斑的边界的模块包 括:
用于沿第一方向按距离从小到大依次计算与该第二光斑的中心点相距一距离的像素点 的灰度值, 并以灰度值在该第一方向的突变点的前一像素点作为该第二光斑在该第一 方向的边界的模块, 用于沿第二方向按距离从小到大依次计算与该第二光斑的中心点相距一距离的像素点 的灰度值, 并以灰度值在该第二方向的突变点的前一像素点作为该第二光斑在该第二 方向的边界的模块。
32. 根据权利要求 31所述的装置, 其特征在于, 该第一方向与该第二方向相反。
33. 根据权利要求 30所述的装置, 其特征在于, 用于搜索该修改图像中位于该第一光 斑以外区域的灰度值最大的像素点, 作为第二光斑的中心点的模块的模块包括: 用于将该帧图像的第一光斑中像素点的灰度值置为该图像的平均灰度值, 获得一修改 图像的模块; 以及
用于搜索该修改图像中灰度值最大的像素点的模块。
34. 根据权利要求 31所述的装置, 其特征在于, 在该用于沿第一方向按距离从小到大 依次计算与该第二光斑的中心点相距一距离的像素点的灰度值, 并以灰度值在该第一 方向的突变点的前一像素点作为该第二光斑在该第一方向的边界的模块中, 如果有一 第一像素点的灰度值小于一灰度阈值, 则以该第一像素点的前一像素点作为该第二光 斑在该第一方向的边界, 否则以该帧图像在该第一方向的边界作为该第二光斑在该第 一方向的边界; 在该用于沿第二方向按距离从小到大依次计算与该第二光斑的中心点 相距一距离的像素点的灰度值, 并以灰度值在该第二方向的突变点的前一像素点作为 该第二光斑在该第一方向的边界的模块中, 如果有一第二像素点的灰度值小于一灰度 阈值, 则以该第二像素点的前一像素点作为该第二光斑在该第二方向的边界, 否则以 该帧图像在该第二方向的边界作为该第二光斑在该第二方向的边界。
35. 根据权利要求 34所述的装置,其特征在于,该灰度阈值为该帧图像的平均灰度值。
36. 根据权利要求 24所述的装置, 其特征在于, 该用于处理每一帧图像以识别该帧图 像中的光斑的模块还包括用于按一预定比例缩小图像的模块, 该预定比例为该帧图像 的行像素数和列像素数的公约数。
37. 根据权利要求 24所述的装置, 其特征在于, 当该摄像机常态为低帧速模式时, 该 装置还包括:
用于识别该可见光通信信号中预定序列的开始码的模块;
用于根据识别的该开始码将该摄像机切换到高帧速模式的模块;
用于识别该可见光通信信号中预定序列的结束码的模块;
用于根据识别的该结束码将该摄像机切换到低帧速模式的模块。
PCT/CN2014/082954 2013-07-31 2014-07-24 可见光信号的接收方法及其装置 WO2015014237A1 (zh)

Priority Applications (4)

Application Number Priority Date Filing Date Title
KR1020167004270A KR101903697B1 (ko) 2013-07-31 2014-07-24 가시 광선 신호의 접수방법 및 그 장치
JP2016530333A JP6167236B2 (ja) 2013-07-31 2014-07-24 可視光信号の受信方法及びその装置
EP14831500.5A EP3029856B1 (en) 2013-07-31 2014-07-24 Method and apparatus for receiving visible light signal
US15/011,569 US9673903B2 (en) 2013-07-31 2016-01-31 Method and apparatus for receiving visible light signal

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN201310330068.1A CN103812558B (zh) 2013-07-31 2013-07-31 可见光信号的接收方法及其装置
CN201310330068.1 2013-07-31
CN201310544341.0A CN103795467B (zh) 2013-11-05 2013-11-05 识别摄像机接收的可见光通信信号的方法和装置
CN201310544341.0 2013-11-05

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US15/011,569 Continuation US9673903B2 (en) 2013-07-31 2016-01-31 Method and apparatus for receiving visible light signal

Publications (1)

Publication Number Publication Date
WO2015014237A1 true WO2015014237A1 (zh) 2015-02-05

Family

ID=52430985

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/082954 WO2015014237A1 (zh) 2013-07-31 2014-07-24 可见光信号的接收方法及其装置

Country Status (5)

Country Link
US (1) US9673903B2 (zh)
EP (1) EP3029856B1 (zh)
JP (1) JP6167236B2 (zh)
KR (1) KR101903697B1 (zh)
WO (1) WO2015014237A1 (zh)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018189980A1 (ja) * 2017-04-11 2018-10-18 パナソニックIpマネジメント株式会社 光通信方法
US10181901B2 (en) * 2017-05-11 2019-01-15 Osram Sylvania Inc. Determining encoding schemes for formatting output signals of light-based communication enabled luminaires
CN107612617A (zh) * 2017-09-13 2018-01-19 华南理工大学 一种基于通用cmos摄像头的可见光通信方法及装置
CN113226934B (zh) * 2019-01-11 2024-07-19 日本显示器设计开发合同会社 光通信系统
CN110739996A (zh) * 2019-11-15 2020-01-31 安徽中骄智能科技有限公司 基于led可见光通信传输设备
US11288935B2 (en) * 2020-01-21 2022-03-29 Arris Enterprises Llc Relaying device status information using light indicator patterns
US11640232B2 (en) * 2021-09-02 2023-05-02 Electrolux Home Products, Inc. Cost efficient method for communicating from an appliance to an external device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1702984A (zh) 2004-05-28 2005-11-30 三星电子株式会社 利用摄像机设备来实现可见光短距离通信的无线终端
CN101159821A (zh) * 2007-11-21 2008-04-09 华东理工大学 光接收机面阵传感器的信号输出方法
CN102331795A (zh) * 2011-08-26 2012-01-25 浙江中控太阳能技术有限公司 基于光斑识别的控制日光反射装置自动跟踪太阳的方法
CN103795467A (zh) * 2013-11-05 2014-05-14 深圳光启创新技术有限公司 识别摄像机接收的可见光通信信号的方法和装置
CN103812558A (zh) * 2013-07-31 2014-05-21 深圳光启创新技术有限公司 可见光信号的接收方法及其装置

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7194031B2 (en) * 2003-07-09 2007-03-20 Silicon Integrated Systems Corp. Rate control method with region of interesting support
US9684968B2 (en) * 2007-12-07 2017-06-20 Tom Chau Method, system and computer program for detecting and characterizing motion
JP2010147527A (ja) * 2008-12-16 2010-07-01 Kyocera Corp 通信端末および情報発信源特定プログラム
JP5282899B2 (ja) * 2009-03-19 2013-09-04 カシオ計算機株式会社 情報復元装置及び情報復元方法
JP2011055288A (ja) * 2009-09-02 2011-03-17 Toshiba Corp 可視光通信装置及びデータ受信方法
US8773577B2 (en) * 2010-10-27 2014-07-08 Qualcomm Incorporated Region of interest extraction
US8988574B2 (en) 2012-12-27 2015-03-24 Panasonic Intellectual Property Corporation Of America Information communication method for obtaining information using bright line image
US9407367B2 (en) * 2013-04-25 2016-08-02 Beijing Guo Cheng Wan Tong Information Co. Ltd Methods and devices for transmitting/obtaining information by visible light signals

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1702984A (zh) 2004-05-28 2005-11-30 三星电子株式会社 利用摄像机设备来实现可见光短距离通信的无线终端
CN101159821A (zh) * 2007-11-21 2008-04-09 华东理工大学 光接收机面阵传感器的信号输出方法
CN102331795A (zh) * 2011-08-26 2012-01-25 浙江中控太阳能技术有限公司 基于光斑识别的控制日光反射装置自动跟踪太阳的方法
CN103812558A (zh) * 2013-07-31 2014-05-21 深圳光启创新技术有限公司 可见光信号的接收方法及其装置
CN103795467A (zh) * 2013-11-05 2014-05-14 深圳光启创新技术有限公司 识别摄像机接收的可见光通信信号的方法和装置

Also Published As

Publication number Publication date
US20160164606A1 (en) 2016-06-09
EP3029856B1 (en) 2019-09-11
US9673903B2 (en) 2017-06-06
KR20160040222A (ko) 2016-04-12
JP2016525847A (ja) 2016-08-25
JP6167236B2 (ja) 2017-07-19
EP3029856A1 (en) 2016-06-08
EP3029856A4 (en) 2017-03-29
KR101903697B1 (ko) 2018-10-04

Similar Documents

Publication Publication Date Title
WO2015014237A1 (zh) 可见光信号的接收方法及其装置
CN103795467B (zh) 识别摄像机接收的可见光通信信号的方法和装置
Danakis et al. Using a CMOS camera sensor for visible light communication
Guan et al. Performance analysis and enhancement for visible light communication using CMOS sensors
US10659158B1 (en) Signal transmitting and receiving devices, method and system based on visible light communication
US7505607B2 (en) Identifying objects tracked in images using active device
Duque et al. Unleashing the power of LED-to-camera communications for IoT devices
Lain et al. Non-line-of-sight optical camera communication in a heterogeneous reflective background
Zhang et al. Mobile phone camera based visible light communication using non-line-of-sight (NLOS) link
CN107222260B (zh) 一种基于变数据区长度的可见光通信编码扩码方法
KR20190032837A (ko) 광 카메라 통신 시스템에서 관심 영역을 설정하는 방법 및 이를 위한 장치
US9729794B2 (en) Display device, display control method, and non-transitory recording medium
US10075237B2 (en) Visible light communication system and method
US11770541B2 (en) Image encoder, image decoder, and image processing method
WO2020107152A1 (en) Method, system, and computer-readable medium for image sensor communication using different sending data sequence rate and receiving frame rate
Nava et al. Image processing techniques for high speed camera-based free-field optical communication
Haider et al. Vehicular communication using 5G
Marcu et al. Flicker free VLC system with enhanced transmitter and low frame rate camera
Zhang et al. Reducing grayscale value fluctuation for mobile-phone camera based VLC system
De Murcia et al. Principal Component Analysis for Robust Region-of-Interest Detection in NLOS Optical Camera Communication
CN110166124B (zh) 基于手机摄像头的mimo可见光通信信号提取方法
Lartigue et al. High-efficient manchester coding for beacon-to-CMOS camera in visible light communications
JP4224405B2 (ja) データ信号受信方法とその装置及びプログラム並びにその記録媒体
US20210259071A1 (en) Self-identifying light fixture
CN111525958B (zh) 一种具有数据通信和手势动作识别功能的光相机通信系统

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14831500

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2014831500

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2016530333

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 20167004270

Country of ref document: KR

Kind code of ref document: A