CN110289909A - Outdoor visible light communication target signal source based on optical flow method tracks extracting method - Google Patents

Outdoor visible light communication target signal source based on optical flow method tracks extracting method Download PDF

Info

Publication number
CN110289909A
CN110289909A CN201910572969.9A CN201910572969A CN110289909A CN 110289909 A CN110289909 A CN 110289909A CN 201910572969 A CN201910572969 A CN 201910572969A CN 110289909 A CN110289909 A CN 110289909A
Authority
CN
China
Prior art keywords
signal source
visible light
optical flow
led
light communication
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910572969.9A
Other languages
Chinese (zh)
Inventor
文尚胜
黄谋潇
陈增鸿
关伟鹏
范智博
邓树乐
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
South China University of Technology SCUT
Original Assignee
South China University of Technology SCUT
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by South China University of Technology SCUT filed Critical South China University of Technology SCUT
Priority to CN201910572969.9A priority Critical patent/CN110289909A/en
Publication of CN110289909A publication Critical patent/CN110289909A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04BTRANSMISSION
    • H04B10/00Transmission systems employing electromagnetic waves other than radio-waves, e.g. infrared, visible or ultraviolet light, or employing corpuscular radiation, e.g. quantum communication
    • H04B10/11Arrangements specific to free-space transmission, i.e. transmission through air or vacuum
    • H04B10/114Indoor or close-range type systems
    • H04B10/116Visible light communication
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04BTRANSMISSION
    • H04B10/00Transmission systems employing electromagnetic waves other than radio-waves, e.g. infrared, visible or ultraviolet light, or employing corpuscular radiation, e.g. quantum communication
    • H04B10/50Transmitters
    • H04B10/516Details of coding or modulation
    • H04B10/54Intensity modulation
    • H04B10/541Digital intensity or amplitude modulation

Landscapes

  • Physics & Mathematics (AREA)
  • Electromagnetism (AREA)
  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Optical Communication System (AREA)

Abstract

The invention discloses a kind of, and the outdoor visible light communication target signal source based on optical flow method tracks extracting method, comprising the following steps: the LED array signal of the transmitting terminal under outdoor scene is carried out OOK modulation;The high speed imaging sensor of receiving end captures picture with high frame per second, and the track algorithm using optical flow method as target signal source tracks signal source;OTSU binary conversion treatment is carried out to the target area of tracking;The decoder of receiving end demodulates original LED modulation data based on obtained pixelated array value, realizes communication.The invention tracks target signal source using optical flow method, using OTSU binary processing method, overcome the moire effect generated by transmitting terminal and receiving end distance, improve the demodulation rate of decoder, more traditional processing method bit error rate based on threshold value is lower, this method is applied to outdoor visible light communication system, enhances the practicability of outdoor visible light communication.

Description

Outdoor visible light communication target signal source based on optical flow method tracks extracting method
Technical field
The present invention relates to visible light communications and technical field of computer vision, and in particular to a kind of outdoor based on optical flow method Visible light communication target signal source tracks extracting method.
Background technique
In recent years, the semiconductor devices LED for being known as " green illumination " is rapidly developed.It is shone compared to traditional incandescent lamp etc. Mingguang City source, LED low energy consumption, service life are long, environmentally protective.Meanwhile LED also has that modulating performance is good, response sensitivity is high, without electromagnetism The advantages that interference, can be transmitted signal with the unrecognized high frequency of human eye, and the optical frequencies that LED is issued does not need to permit to award The high broadband of low cost and the high wireless telecommunications of transmission rate may be implemented in power, therefore have expedited the emergence of one and can be realized illumination and logical Believe integrated technology --- visible light communication technology.
Visible light communication technology has very wide application field, and application can be divided into indoor application and outdoor utility two major classes. Wherein it can be used between intelligent transportation system, including vehicle and vehicle in outdoor utility, between the infrastructure such as vehicle and street lamp The transmitting of information, in such applications, communication are generated in the scene being mutually shifted and are carried out in sending and receiving end under conditions of outdoor , therefore, it is seen that optic communication needs the auxiliary and support of excellent target following technology.
Target following is one of the hot spot in computer vision research field.The technology is detected in each frame image by analysis The resemblance and motion feature of each pinpoint target out determine the motion profile of target, realize the behavior to moving target Understanding and real-time tracking.If visible light communication technology is applied to outdoor mobile communication, then outdoor target following technology is especially It is important.
Therefore, seek one kind reliably just becomes extremely must depending on outer visible light communication target signal source tracking extracting method It wants, so as to the bit error rate for accurately detecting identification target, improving the tracking ability to target, reducing data transmission, enhances visible The actual availability of optic communication.
Summary of the invention
The purpose of the present invention is to solve drawbacks described above in the prior art, providing a kind of outdoor based on optical flow method can Light-exposed communication target signal source tracks extracting method.
The purpose of the present invention can be reached by adopting the following technical scheme that:
A kind of outdoor visible light communication target signal source tracking extracting method based on optical flow method, the outdoor visible light Communication target signal source track extracting method the following steps are included:
S1, the LED array signal of the transmitting terminal under outdoor scene is subjected to OOK modulation;
S2, receiving end high speed imaging sensor with high frame per second capture picture, signal source is tracked using optical flow method;
S3, OTSU binary conversion treatment is carried out to the target area of tracking;
S4, receiving end decoder original LED modulation data is demodulated based on obtained pixelated array value, realize communication.
Further, the step S1 includes:
S11, transmitting terminal encoder use OOK to count line number for the be positive LED light array of Integer N of positive integer M, columns According to modulation;
S12, the LED region as composed by every 4 adjacent LED light will be distributed to by the modulated data information of OOK, To realize that data are transmitted.
Further, the step S2 includes:
S21, a continuous sequence of frames of video is handled, for each sequence of frames of video, is carried out at gray processing Reason, detects the LED queue of appearance;
If LED pixel point occur in S22, a certain video frame, the angle point of LED queue is found, as characteristic point;
S23, the position prediction that next video frame is carried out to this feature point, if this feature point is f in the gray value of t moment (x, y, t), wherein x, y are respectively the row coordinate and column coordinate of pixel, It is gray scale respectively Value f (x, y, t) is to x, the partial derivative of y, t, and pixel value when subsequent time t+dt is f (x+dx, y+dy, t+dt), and u is x to t's Partial derivative, v are partial derivative of the y to t, and dx is the differential of x, and dy is the differential of y, and dt is the differential of t, it is assumed that light stream campaign is small, Then have
Ix*dx+Iy*dy+It* dt=0
Ix*u+Iy* v=-It
Assuming thatA small field comprising m pixel in, IxnFor the gray value f of nth pixel pointn(x,y, T) to the partial derivative of x, IynFor the gray value f of nth pixel pointnThe partial derivative of (x, y, t) to y, ItnFor n-th point to the inclined of t Derivative, brightness is constant in field, then
It enables
Then have
S24, makeMinimum obtains the optimum position of next video frame this feature point;To any two later A adjacent video frames find the optimum position of the characteristic point occurred in previous frame in the current frame, exist to obtain foreground target Position coordinates in present frame;
S25, such iteration carry out, and realize the tracking of target.
Further, the step S3 includes:
S31, the subregion that the gray level image obtained in the step s 21 is divided into multiple N row N column;
S32, to each subregion, two classes, the ratio w of prospect occupied area area image are divided into according to threshold value T1(T),μ1(T) it is Prospect gray average.The ratio w of background occupied area area image2(T), μ2It (T) is background gray average, μ is that total gray scale in the region is flat Mean value,For inter-class variance.Column write out inter-class variance equation:
μ=μ1(T)*w1(T)+μ2(T)*w2(T)
S33, according to inter-class variance equation, seek threshold value T, makeObtain maximum value;
S34, binary conversion treatment is carried out to the region according to the threshold value t of all subregion, wherein luminous diode is corresponding Pixel value is set as 255, and non-luminous diode pair answers pixel value to be set as 0.
Further, the step S4 includes:
S41, decoder read the pixel data of bianry image all subregion, obtain LED sequence brightness information, are decoded Data;
S42, decoding data is carried out in raw modulation data set to similarity-rough set, chooses the maximum modulation number of similarity Communication is realized according to according to rule.
The present invention has the following advantages and effects with respect to the prior art:
(1) present invention consider because transmitting terminal and receiving end distance generate moire effect, by local OTSU algorithm into Row optimization, improves the success rate of demodulation.
(2) present invention combines target tracking algorism with outdoor visible light communication technology, and it is logical to improve outdoor visible light The practicability of letter technology.
Detailed description of the invention
Fig. 1 is the outdoor visible light communication target signal source tracking extracting method disclosed in the present invention based on optical flow method Flow chart;
Fig. 2 is the outdoor visible light communication system structure chart in the embodiment of the present invention based on optical flow method;
Fig. 3 is the mobile schematic diagram of optical flow method characteristic point applied in the embodiment of the present invention;
Fig. 4 is the Optical-flow Feature vectogram for the optical flow method applied in the embodiment of the present invention.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention In attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is A part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art Every other embodiment obtained without making creative work, shall fall within the protection scope of the present invention.
Embodiment
The outdoor visible light communication target signal source based on optical flow method that present embodiment discloses a kind of tracks extracting method, tool Body referring to Fig. 1, Fig. 1 be disclosed in the present embodiment it is a kind of based on optical flow method outdoor visible light communication target signal source tracking mention Take the flow chart of method.Fig. 2 is the present embodiment visible light communication system course of work schematic diagram.This embodiment illustrates visible lights The feasibility and novelty of communication.With Wi-Fi communication and infrared communication compared with, using visible light carry out communication can it is more convenient with Safety.The problem of side frequency interferes with each other is substantially not present in visible light communication, while also with the ability of high data capacity.Benefit It is tracked with target tracking algorism, realize communication can in a dynamic condition.
The outdoor visible light communication target signal source track extracting method specifically includes the following steps:
S1, the LED array signal of the transmitting terminal under outdoor scene is subjected to OOK modulation;
Wherein, the process of step S1 is as follows:
S11, transmitting terminal encoder use OOK to count line number for the be positive LED light array of Integer N of positive integer M, columns According to modulation;
S12, the LED region as composed by every 4 adjacent LED light will be distributed to by the modulated data information of OOK, To realize that data are transmitted.
S2, receiving end high speed imaging sensor with high frame per second capture picture, using optical flow method as target signal source Track algorithm tracks signal source;
Wherein, the process of step S2 is as follows:
S21, a continuous sequence of frames of video is handled, for each sequence of frames of video, is carried out at gray processing Reason, detects the LED queue of appearance;
If LED pixel point occur in S22, a certain video frame, the angle point of LED queue is found, as characteristic point;
S23, the position prediction that next video frame is carried out to this feature point, if this feature point is f in the gray value of t moment (x, y, t), wherein x, y are respectively the row coordinate and column coordinate of pixel, It is gray scale respectively Value f (x, y, t) is to x, the partial derivative of y, t.Pixel value when subsequent time t+dt is f (x+dx, y+dy, t+dt).U is x to t's Partial derivative, v are partial derivative of the y to t, and dx is the differential of x, and dy is the differential of y, and dt is the differential of t.Assuming that light stream campaign is small, Then have
Ix*dx+Iy*dy+It* dt=0
Ix*u+Iy* v=-It
Assuming thatA small field comprising m pixel in, IxnFor the gray value f of nth pixel pointn(x, Y, t) to the partial derivative of x, IynFor the gray value f of nth pixel pointnThe partial derivative of (x, y, t) to y, ItnFor n-th point to t's Partial derivative, brightness is constant in field, then
It enables
Then have
S24, makeMinimum obtains the optimum position of next video frame this feature point;To any two later A adjacent video frames find the optimum position of the characteristic point occurred in previous frame in the current frame, exist to obtain foreground target Position coordinates in present frame;Fig. 3 is the light stream vector figure for the single feature point that the step obtains.
S25, as shown in figure 4, so iteration carry out, the light stream vector figure of all characteristic points can be obtained, realize target with Track.
S3, OTSU binary conversion treatment is carried out to the target area of tracking;
Wherein, the process of step S3 is as follows:
S31, the subregion that the gray level image obtained in the step s 21 is divided into multiple N row N column;
S32, to each subregion, two classes, the ratio w of prospect occupied area area image are divided into according to threshold value T1(T),μ1(T) it is Prospect gray average.The ratio w of background occupied area area image2(T), μ2It (T) is background gray average, μ is that total gray scale in the region is flat Mean value,For inter-class variance.Column write out inter-class variance equation:
μ=μ1(T)*w1(T)+μ2(T)*w2(T)
S33, according to inter-class variance equation, seek threshold value T, makeObtain maximum value;
S34, binary conversion treatment is carried out to the region according to the threshold value t of all subregion, wherein luminous diode is corresponding Pixel value is set as 255, and non-luminous diode pair answers pixel value to be set as 0.
S4, receiving end decoder original LED modulation data is demodulated based on obtained pixelated array value, realize communication.
Wherein, the process of step S4 is as follows:
S41, decoder read the pixel data of bianry image all subregion, obtain LED sequence brightness information, are decoded Data;
S42, decoding data is carried out in raw modulation data set to similarity-rough set, chooses the maximum modulation number of similarity Communication is realized according to according to rule.
Existing visible light communication application mostly carries out in a static condition, and the present embodiment is innovatively by target tracking algorism It is combined with visible light communication technology, visible light communication is enable to carry out in a dynamic condition.By transmitting terminal modulation intelligence on LED area Domainization distribution, and receiving end uses the high speed imaging sensor that picture is captured with high frame per second, has ensured visible light communication matter Amount.
The above embodiment is a preferred embodiment of the present invention, but embodiments of the present invention are not by above-described embodiment Limitation, other any changes, modifications, substitutions, combinations, simplifications made without departing from the spirit and principles of the present invention, It should be equivalent substitute mode, be included within the scope of the present invention.

Claims (5)

1. a kind of outdoor visible light communication target signal source based on optical flow method tracks extracting method, which is characterized in that described Outdoor visible light communication target signal source tracking extracting method the following steps are included:
S1, the LED array signal of the transmitting terminal under outdoor scene is subjected to OOK modulation;
S2, receiving end high speed imaging sensor with high frame per second capture picture, signal source is tracked using optical flow method;
S3, OTSU binary conversion treatment is carried out to the target area of tracking;
S4, receiving end decoder original LED modulation data is demodulated based on obtained pixelated array value, realize communication.
2. the outdoor visible light communication target signal source according to claim 1 based on optical flow method tracks extracting method, It is characterized in that, the step S1 includes:
S11, transmitting terminal encoder use OOK to line number for positive integer M, columns be positive Integer N LED light array carry out data tune System;
S12, the LED region as composed by every 4 adjacent LED light will be distributed to by the modulated data information of OOK, with reality Existing data transmission.
3. the outdoor visible light communication target signal source according to claim 1 based on optical flow method tracks extracting method, It is characterized in that, the step S2 includes:
S21, a continuous sequence of frames of video is handled, for each sequence of frames of video, carries out gray processing processing, inspection Measure existing LED queue;
If LED pixel point occur in S22, a certain video frame, the angle point of LED queue is found, as characteristic point;
S23, the position prediction that next video frame is carried out to this feature point, if this feature point t moment gray value be f (x, y, T), wherein x, y are respectively the row coordinate and column coordinate of pixel, It is gray value f respectively (x, y, t) to x, the partial derivative of y, t, pixel value when subsequent time t+dt is f (x+dx, y+dy, t+dt), and u is x to the inclined of t Derivative, v are partial derivative of the y to t, and dx is the differential of x, and dy is the differential of y, and dt is the differential of t, it is assumed that light stream campaign is small, then Have
Ix*dx+Iy*dy+It* dt=0
Ix*u+Iy* v=-It
Assuming thatA small field comprising m pixel in, IxnFor the gray value f of nth pixel pointn(x, y, t) is right The partial derivative of x, IynFor the gray value f of nth pixel pointnThe partial derivative of (x, y, t) to y, ItnFor the n-th point of partial derivative to t, Brightness is constant in field, then
It enables
Then have
S24, makeMinimum obtains the optimum position of next video frame this feature point;To any two phase later Adjacent video frame finds the optimum position of the characteristic point occurred in previous frame in the current frame, to obtain foreground target current Position coordinates in frame;
S25, such iteration carry out, and realize the tracking of target.
4. the outdoor visible light communication target signal source according to claim 3 based on optical flow method tracks extracting method, It is characterized in that, the step S3 includes:
S31, the subregion that the gray level image obtained in the step s 21 is divided into multiple N row N column;
S32, to each subregion, two classes, the ratio w of prospect occupied area area image are divided into according to threshold value T1(T),μ1It (T) is prospect Gray average.The ratio w of background occupied area area image2(T), μ2It (T) is background gray average, μ is that total gray scale in the region is average Value,For inter-class variance.Column write out inter-class variance equation:
μ=μ1(T)*w1(T)+μ2(T)*w2(T)
S33, according to inter-class variance equation, seek threshold value T, makeObtain maximum value;
S34, binary conversion treatment is carried out to the region according to the threshold value t of all subregion, wherein the corresponding pixel of luminous diode Value is set as 255, and non-luminous diode pair answers pixel value to be set as 0.
5. the outdoor visible light communication target signal source according to claim 1 based on optical flow method tracks extracting method, It is characterized in that, the step S4 includes:
S41, decoder read the pixel data of bianry image all subregion, obtain LED sequence brightness information, obtain solution yardage According to;
S42, decoding data is carried out in raw modulation data set to similarity-rough set, chooses the maximum modulation data of similarity and presses Communication is realized according to rule.
CN201910572969.9A 2019-06-28 2019-06-28 Outdoor visible light communication target signal source based on optical flow method tracks extracting method Pending CN110289909A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910572969.9A CN110289909A (en) 2019-06-28 2019-06-28 Outdoor visible light communication target signal source based on optical flow method tracks extracting method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910572969.9A CN110289909A (en) 2019-06-28 2019-06-28 Outdoor visible light communication target signal source based on optical flow method tracks extracting method

Publications (1)

Publication Number Publication Date
CN110289909A true CN110289909A (en) 2019-09-27

Family

ID=68020072

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910572969.9A Pending CN110289909A (en) 2019-06-28 2019-06-28 Outdoor visible light communication target signal source based on optical flow method tracks extracting method

Country Status (1)

Country Link
CN (1) CN110289909A (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104504662A (en) * 2014-12-26 2015-04-08 北京慧眼智行科技有限公司 Homomorphic filtering based image processing method and system
CN107764271A (en) * 2017-11-15 2018-03-06 华南理工大学 A kind of photopic vision dynamic positioning method and system based on light stream
CN108736972A (en) * 2018-06-07 2018-11-02 华南理工大学 LED vision-based detections based on ITS-VLC and tracking and its system
CN108871290A (en) * 2018-06-07 2018-11-23 华南理工大学 A kind of visible light dynamic positioning method based on optical flow method detection and Bayesian forecasting
CN109035198A (en) * 2018-06-07 2018-12-18 华南理工大学 The LED detection method of outdoor visible light communication based on edge detection
WO2019039324A1 (en) * 2017-08-22 2019-02-28 Panasonic Intellectual Property Corporation Of America Image encoder, image decoder, image encoding method, and image decoding method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104504662A (en) * 2014-12-26 2015-04-08 北京慧眼智行科技有限公司 Homomorphic filtering based image processing method and system
WO2019039324A1 (en) * 2017-08-22 2019-02-28 Panasonic Intellectual Property Corporation Of America Image encoder, image decoder, image encoding method, and image decoding method
CN107764271A (en) * 2017-11-15 2018-03-06 华南理工大学 A kind of photopic vision dynamic positioning method and system based on light stream
CN108736972A (en) * 2018-06-07 2018-11-02 华南理工大学 LED vision-based detections based on ITS-VLC and tracking and its system
CN108871290A (en) * 2018-06-07 2018-11-23 华南理工大学 A kind of visible light dynamic positioning method based on optical flow method detection and Bayesian forecasting
CN109035198A (en) * 2018-06-07 2018-12-18 华南理工大学 The LED detection method of outdoor visible light communication based on edge detection

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
TAKAYA YAMAZATO: "Vehicle Motion and Pixel Illumination Modeling for Image Sensor Based Visible Light Communication", 《IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS》 *
WEIPENG GUAN: "High-Speed Robust Dynamic Positioning and Tracking Method Based on Visual Visible Light Communication Using Optical Flow Detection and Bayesian Forecast", 《IEEE PHOTONICS JOURNAL 》 *
于连生,于翔: "《海洋仪器研制的信息法 以悬浮颗粒图像仪设计为例》", 30 June 2015 *
俞力: "动态场景下的车辆检测和跟踪方法研究", 《中国优秀博硕士学位论文全文数据库(硕士) 信息科技辑》 *

Similar Documents

Publication Publication Date Title
CN107421506B (en) Visual tracking and positioning system and method based on indoor visible light communication
Fang et al. High-speed indoor navigation system based on visible light and mobile phone
US7415212B2 (en) Data communication system, data transmitter and data receiver
CN110261823B (en) Visible light indoor communication positioning method and system based on single LED lamp
CN103795467B (en) Method and apparatus for identifying visible light communication signal received by camera
CN111610484B (en) Automatic driving vehicle tracking and positioning method based on OCC
US9673903B2 (en) Method and apparatus for receiving visible light signal
CN107483114B (en) Multichannel indicator light data parallel Transmission system and method
Hasan et al. Optical camera communication in vehicular applications: A review
CN108288289A (en) A kind of LED visible detection methods and its system for visible light-seeking
He et al. A deep learning-assisted visible light positioning scheme for vehicles with image sensor
Zhang et al. Thresholding scheme based on boundary pixels of stripes for visible light communication with mobile-phone camera
Han et al. A fixed-scale pixelated MIMO visible light communication system
US6750790B2 (en) Data-encoding apparatus, data-encoding method, data-decoding apparatus, data-decoding method, data-transmitting apparatus, data-receiving apparatus, data storage medium and computer programs
CN111490823B (en) Visible light imaging communication decoding method based on convolutional neural network
CN110289909A (en) Outdoor visible light communication target signal source based on optical flow method tracks extracting method
CN108462534B (en) Signal inversion visual tracking method and system for visible light communication
KR20190032837A (en) Method and apparatus for configuring region of interest in an optical camera communication
CN115314642B (en) Camera optical communication system based on multi-pixel accumulation and implementation method
Tang et al. Sequential maximum likelihood decoding incorporating reliability determination for image sensor communication
CN109004981B (en) Visual visible light communication detection method based on fuzzy effect
CN208015731U (en) A kind of signal for visible light communication inverts visual pursuit system
Nava et al. Image processing techniques for high speed camera-based free-field optical communication
Tamang et al. Optical camera communication for vehicular applications: A survey
Arisue et al. BER measurement for transmission pattern design of ITS image sensor communication using DMD projector

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20190927

RJ01 Rejection of invention patent application after publication