TWI470947B - Apparatus and method for data embedding in light communication and the light communication system and method thereof - Google Patents
Apparatus and method for data embedding in light communication and the light communication system and method thereof Download PDFInfo
- Publication number
- TWI470947B TWI470947B TW101149574A TW101149574A TWI470947B TW I470947 B TWI470947 B TW I470947B TW 101149574 A TW101149574 A TW 101149574A TW 101149574 A TW101149574 A TW 101149574A TW I470947 B TWI470947 B TW I470947B
- Authority
- TW
- Taiwan
- Prior art keywords
- data
- image
- communication
- embedded
- embedding
- Prior art date
Links
Landscapes
- Editing Of Facsimile Originals (AREA)
- Image Processing (AREA)
Description
本揭露係關於一種光通訊資料嵌入的裝置與方法以及光通訊系統和方法。The disclosure relates to an apparatus and method for embedding optical communication data, and an optical communication system and method.
光通訊是一種無線通訊技術,使用400THz至800THz之間人類可見光頻率。無線頻寬(Radio Frequency bandwidth,RF bandwidth)是一種稀有的資源。因此,可見光通訊可以提供一種無線通訊的替代技術,來滿足強勁的需求。例如,從一或多個發光二極體(Light Emitting Diode,LED)發出的可見光,在家庭和辦公室中被廣泛使用,因此使得一或多個LEDs發出的可見光適合無處不在的資料傳送器。第一A圖與第一B圖是白光LED的兩種類型範例。如第一A圖所示,一白光LED的範例使用一藍色LED110和一黃色螢光體(phosphor)115。黃色螢光體115限制調變頻寬(modulation bandwidth)不超過大 約10Mbps。如第一B圖所示,另一白光LED的範例使用紅綠藍三重態(RGB triplet),可包括一藍色LED 121,一紅色LED 122和一綠色LED 123,並且此三個LEDs分別發出藍光131、紅光132、以及綠光133。相較於第一A圖的白光LED,此RGB三重態可提供更高的頻寬,而且三重態的混合經由藍光、紅光、以及綠光的任意組合可產生任何想要的顏色。因此,一RGB三重態LED陣列可同時作為一高位元率(high-bit-rate)的資料傳送器和一照明(lighting)裝置。Optical communication is a wireless communication technology that uses human visible light frequencies between 400 THz and 800 THz. Radio Frequency bandwidth (RF bandwidth) is a rare resource. Therefore, visible light communication can provide an alternative to wireless communication to meet strong demand. For example, visible light emitted from one or more Light Emitting Diodes (LEDs) is widely used in homes and offices, thus making visible light from one or more LEDs suitable for ubiquitous data transmitters. The first A and the first B are examples of two types of white LEDs. As shown in FIG. A, an example of a white LED uses a blue LED 110 and a yellow phosphor 115. The yellow phosphor 115 limits the modulation bandwidth to no more than About 10Mbps. As shown in FIG. B, another example of a white LED uses a red, green, and blue triplet (RGB triplet), which may include a blue LED 121, a red LED 122, and a green LED 123, and the three LEDs are respectively issued. Blue light 131, red light 132, and green light 133. This RGB triplet provides a higher bandwidth than the white LED of Figure A, and the triplet mixture produces any desired color via any combination of blue, red, and green. Therefore, an RGB triplet LED array can simultaneously serve as a high-bit-rate data transmitter and a lighting device.
第二A圖是使用一單一輸入資料串流(data stream)212的RGB三重態LED的一般傳送器的一範例示意圖。在傳送器200中,由一錯誤校正編碼器(error correction encoder)214接收單一輸入資料串流212,並且一調變器(modulator)216的輸出直接被應用在一個三重態LED驅動器218。三種基色(primary colors,即紅色、綠色、以及藍色)的輸出功率PR 、PG 、以及PB 是由三重態LED驅動器218所產生的。第二B圖是利用一通-斷鍵控調變(on-off keying modulation)方法的調變器的輸出的一個範例。由調變器216輸出的位元串流(bit stream)依順序分布至此三重態LED,其中,R、G、以及B分別代表三基色的三串位元串流。第二C圖是此三重態LED驅動器的輸出功率的一個範例。A second diagram is an exemplary diagram of a general transmitter of an RGB triplet LED using a single input data stream 212. In transmitter 200, a single input data stream 212 is received by an error correction encoder 214, and the output of a modulator 216 is applied directly to a triplet LED driver 218. The output powers P R , P G , and P B of the three primary colors (i.e., red, green, and blue) are generated by the triplet LED driver 218. The second B diagram is an example of the output of a modulator utilizing an on-off keying modulation method. The bit stream output by the modulator 216 is sequentially distributed to the triplet LED, where R, G, and B represent three strings of three primary colors, respectively. The second C diagram is an example of the output power of this triplet LED driver.
第三A圖是使用多個輸入資料的RGB三重態LED的一 種波長分波多工(Wavelength Division Multiplexing,WDM)的傳送器300的一範例示意圖。在傳送器300中,多個輸入資料中每一輸入資料如輸入資料0、輸入資料1、以及輸入資料2,各具有單獨的錯誤校正編碼器和調變器。三個調變器的輸出被直接耦合至三個LED驅動器。第三B圖是三重態LED驅動器的輸出功率的一個範例。The third A picture is a RGB triplet LED using multiple input data. An exemplary schematic diagram of a Wavelength Division Multiplexing (WDM) transmitter 300. In the transmitter 300, each of the plurality of input materials, such as the input data 0, the input data 1, and the input data 2, each has a separate error correction encoder and modulator. The outputs of the three modulators are directly coupled to the three LED drivers. Figure 3B is an example of the output power of a triplet LED driver.
第四圖是一種可見光通訊(Visible Light Communication,VLC)技術的一範例示意圖。如第四圖所示,一VLC裝置可包含一傳送端裝置410和一接收端裝置420。傳送端裝置410用來傳送一或多個通訊資料(例如,資料1、資料2、資料3等)的傳送端裝置410包括一照明器(illuminator)412,用來產生照明光;一通訊量調節器(communication amount adjuster)413;以及一調變器411。通訊量調節器413接收一或多個通訊資料信號的每一通訊資料信號,並且為一或多個各自的光源(individual light source)的每一各自的光源產生一相對應的一虛擬資料(dummy data),如此,經由每一光源傳送的資料具有相等的通訊量。調變器411將每一收到的通訊資料信號以及收到的虛擬資料調變為該多個光源中的每一光源的一驅動信號。The fourth figure is an example schematic diagram of a Visible Light Communication (VLC) technology. As shown in the fourth figure, a VLC device can include a transmitting device 410 and a receiving device 420. The transmitting end device 410 for transmitting one or more communication materials (for example, data 1, data 2, data 3, etc.) includes an illuminator 412 for generating illumination light; a traffic adjustment (communication amount adjuster) 413; and a modulator 411. The traffic conditioner 413 receives each communication data signal of one or more communication data signals and generates a corresponding virtual data for each respective light source of one or more respective light sources (dummy) Data), as such, the data transmitted via each source has equal amount of communication. The modulator 411 tunes each received communication data signal and the received virtual data into a driving signal for each of the plurality of light sources.
第五圖是使用可見光通訊的一種資料傳送裝置的一範例示意圖。如第五圖所示,資料傳送裝置510可包含一編碼產生 器512、一調變單元514、多個LED 518、以及一光源驅動器516。編碼產生器512根據時間T0 、T1 、...、TN-1 、TN ,將傳送資料轉換成具有不同顏色和圖案的一個二維資料碼(two-dimensional data code)520。調變單元514調變此二維資料以產生一調變信號。多個LED 518被安排成一種二維的形式並且發射光。光源驅動器516根據調變信號來控制LED 518的導通。The fifth figure is an exemplary diagram of a data transfer device using visible light communication. As shown in the fifth figure, the data transfer device 510 can include a code generator 512, a modulation unit 514, a plurality of LEDs 518, and a light source driver 516. The code generator 512 converts the transmitted data into a two-dimensional data code 520 having different colors and patterns according to the times T 0 , T 1 , ..., T N-1 , T N . The modulation unit 514 modulates the two-dimensional data to generate a modulated signal. The plurality of LEDs 518 are arranged in a two-dimensional form and emit light. Light source driver 516 controls the conduction of LED 518 based on the modulated signal.
從上述的技術可以看出,如果調變器或調變單元的輸出被直接應用至LED驅動器,此三基色相對應的能量分佈可以是彼此不同的。所以,可能存在不必要調整顏色的情況。並且,當傳送器同時作為照明裝置時,隨時間變化的亮度可能被人眼感應到。光通訊仍然是一個全球無線頻譜短缺的潛在解決方案。可見光通訊技術的多種解決方案的建議已經被提出。在這些解決方案中,利用一裝置同時執行影像或視訊顯示和光通訊仍然存在著各種挑戰。As can be seen from the above technique, if the output of the modulator or modulation unit is directly applied to the LED driver, the energy distributions corresponding to the three primary colors may be different from each other. Therefore, there may be cases where it is not necessary to adjust the color. Also, when the transmitter simultaneously functions as a lighting device, the brightness that changes with time may be sensed by the human eye. Optical communications remains a potential solution to the global wireless spectrum shortage. Recommendations for various solutions for visible light communication technology have been proposed. In these solutions, there are still various challenges in using a device to simultaneously perform image or video display and optical communication.
本揭露實施例可提供一種光通訊資料嵌入的裝置與方法以及光通訊系統和方法。The disclosed embodiments can provide an apparatus and method for embedding optical communication data, and an optical communication system and method.
本揭露的一實施例是關於一種嵌入資料於光通訊中的裝置,適應於一傳送器(transmitter)。此裝置可包含一資料嵌入 單元(data embedding unit),被安排在此傳送器中的一傳送端通訊資料處理單元與一發光裝置驅動器(light emitting device driver)之間,其中此資料嵌入單元根據一調變方法,嵌入一通訊處理資料(communication processed data)於一原始影像的一空間域(spatial domain),並且取得一通訊資料嵌入影像(communication data embedded image)的多個紅綠藍(RGB)值。An embodiment of the present disclosure is directed to a device for embedding data in optical communication, adapted to a transmitter. This device can contain a data embedding A data embedding unit is arranged between a transmitting communication data processing unit and a light emitting device driver in the transmitter, wherein the data embedding unit embeds a communication according to a modulation method The processed processed data is in a spatial domain of an original image, and obtains a plurality of red, green and blue (RGB) values of a communication data embedded image.
本揭露的另一實施例是關於一種嵌入資料於光通訊中的方法,適應於一傳送器。此方法包含:安排一資料嵌入單元於此傳送器中的一傳送端通訊資料處理單元與一發光裝置驅動器之間;利用此資料嵌入單元,根據一調變方法來嵌入一通訊處理資料於一空間域,以產生一通訊調變影像(communication modulated image);以及執行一逆轉換(inverse transform)和一域轉換(domain transform),此域轉換將此通訊調變影像從一頻域轉換至此空間域,並且取得一通訊資料嵌入影像的多個紅綠藍(RGB)值。Another embodiment of the present disclosure is directed to a method of embedding data in optical communication adapted to a transmitter. The method comprises: arranging a data embedding unit between a transmitting end communication data processing unit and an illuminating device driver in the transmitter; using the data embedding unit to embed a communication processing data in a space according to a modulation method a domain to generate a communication modulated image; and performing an inverse transform and a domain transform, the domain transform converts the communication modulated image from a frequency domain to the spatial domain And obtaining a plurality of red, green and blue (RGB) values embedded in the image of the communication data.
本揭露的又一實施例是關於一種嵌入資料於光通訊中的接收裝置。此接收裝置可包含一影像感測裝置(image sensing device)、一影像變形單元(image warping unit)、以及一資料擷取(data extraction)單元。此影像感測裝置偵測由一發光裝置傳送的一傳送端(transmitter-side)通訊資料嵌入影像,以及產生一接收端(receiver-side)通訊資料嵌入影像。此影像變形單元藉 由執行此傳送端通訊資料嵌入影像的一影像變形處理(image warping processing)來補償此接收器端通訊資料嵌入影像的一變形(deformation),並且輸出一變形的(warped)通訊資料嵌入影像。此資料擷取單元從變形的通訊資料嵌入影像擷取一通訊處理資料。Yet another embodiment of the present disclosure is directed to a receiving device for embedding data in optical communication. The receiving device can include an image sensing device, an image warping unit, and a data extraction unit. The image sensing device detects a transmitter-side communication data embedded image transmitted by an illumination device, and generates a receiver-side communication data embedded image. This image deformation unit borrows An image warping processing for embedding the image of the communication data of the transmitting end is used to compensate for a deformation of the embedded data of the receiver communication data, and a warped communication data embedded image is output. The data acquisition unit embeds an image from the transformed communication data to retrieve a communication processing data.
本揭露的又一實施例是關於一種嵌入資料於光通訊中的接收方法。此接收方法可包含:在一影像感測裝置和一接收端通訊資料處理單元之間配置一影像變形單元和一資料擷取單元;使用此影像感測裝置來偵測由一發光裝置傳送的一傳送端通訊資料嵌入影像,並且產生一接收端通訊資料嵌入影像;使用此影像變形單元在此傳送端通訊資料嵌入影像中執行一影像變形處理,並且輸出一變形的通訊資料嵌入影像;以及使用此資料擷取單元,從此變形的通訊資料嵌入影像中擷取一通訊處理資料。Yet another embodiment of the present disclosure is directed to a method of receiving embedded data in optical communication. The receiving method may include: configuring an image deforming unit and a data capturing unit between an image sensing device and a receiving end communication data processing unit; and using the image sensing device to detect a transmitted by a light emitting device The transmitting end communication data is embedded in the image, and a receiving end communication data is embedded in the image; the image deforming unit is used to perform an image deformation processing on the transmitting end communication data embedded image, and output a deformed communication data embedded image; and use the image The data acquisition unit inserts a communication processing data from the transformed communication data embedded in the image.
本揭露的又一實施例是關於一種光通訊系統。此光通訊系統可包含一傳送器、以及一接收裝置,此傳送器嵌入一通訊處理資料於一原始影像的一頻域轉換(frequency domain transform)的一或多個頻率係數(frequency coefficient)、執行一通訊調變影像的一逆轉換與一域轉換、以及藉由嵌入多個紅綠藍(RGB)值於此原始影像中來形成一通訊資料嵌入影像。此接收裝置偵測由一發光裝置傳送的此通訊資料嵌入影像,並且產 生一接收端(通訊資料嵌入影像,並且依此接收端通訊資料嵌入影像執行一影像變形處理,以恢復此通訊資料嵌入影像,並且從一變形的通訊資料嵌入影像擷取此通訊處理資料。Yet another embodiment of the present disclosure is directed to an optical communication system. The optical communication system can include a transmitter and a receiving device, the transmitter embedding a frequency coefficient of a frequency domain transform of the communication processing data in an original image, and executing An inverse conversion and a domain conversion of a communication modulated image, and a communication data embedded image formed by embedding a plurality of red, green, and blue (RGB) values in the original image. The receiving device detects the embedded data transmitted by the illumination device and generates the image The first receiving end (the communication data is embedded in the image, and the receiving end communication data is embedded in the image to perform an image deformation processing to restore the embedded data of the communication data, and the communication processing data is captured from a transformed communication data.
本揭露的又一實施例是關於一種光通訊方法。此光通訊方法可包含:在一傳送器中,嵌入一通訊處理資料於一原始影像的一頻域轉換的一或多個頻率係數,執行一通訊調變影像的一逆轉換和一域轉換,並且藉由嵌入多個紅綠藍(RGB)值於此原始影像中來形成一通訊資料嵌入影像;以及在一接收裝置中,偵測一發光裝置傳送的此通訊資料嵌入影像,產生一接收端通訊資料嵌入影像,依此接收端通訊資料嵌入影像來執行一影像變形處理以恢復此通訊資料嵌入影像,並且從一變形的通訊資料嵌入影像擷取此通訊處理資料。Yet another embodiment of the present disclosure is directed to an optical communication method. The optical communication method may include: embedding a communication processing data in a frequency domain to convert one or more frequency coefficients of a original image in a transmitter, performing an inverse conversion and a domain conversion of a communication modulated image, And forming a communication data embedded image by embedding a plurality of red, green and blue (RGB) values in the original image; and detecting, in a receiving device, the communication data transmitted by the light emitting device to embed the image, generating a receiving end The communication data is embedded in the image, and the communication data embedded in the receiving end is used to perform an image deformation processing to restore the embedded data of the communication data, and the communication processing data is captured from a modified communication data.
茲配合下列圖示、實施例之詳細說明及申請專利範圍,將上述及本發明之其他優點詳述於後。The above and other advantages of the present invention will be described in detail below with reference to the following drawings, detailed description of the embodiments, and claims.
110‧‧‧藍色LED110‧‧‧Blue LED
115‧‧‧黃色螢光體115‧‧‧Yellow phosphor
121‧‧‧藍色LED121‧‧‧Blue LED
122‧‧‧紅色LED122‧‧‧Red LED
123‧‧‧綠色LED123‧‧‧Green LED
131‧‧‧藍光131‧‧‧Blue
132‧‧‧紅光132‧‧‧Red light
133‧‧‧綠光133‧‧‧Green light
LED‧‧‧發光二極體LED‧‧‧Light Emitting Diode
212‧‧‧輸入資料串流212‧‧‧ Input data stream
214‧‧‧錯誤校正編碼器214‧‧‧Error Correction Encoder
216‧‧‧調變器216‧‧‧ modulator
218‧‧‧三重態LED驅動器218‧‧‧ Triplet LED Driver
R、G、B‧‧‧三基色的三串位元串流Three-string stream of R, G, B‧‧‧ three primary colors
PR 、PG 、PB ‧‧‧三種基色的輸出功率P R , P G , P B ‧‧‧ output power of three primary colors
410‧‧‧傳送端裝置410‧‧‧Transport device
420‧‧‧接收端裝置420‧‧‧ receiving device
411‧‧‧調變器411‧‧‧Transformer
413‧‧‧通訊量調節器413‧‧‧Communication regulator
412‧‧‧照明器412‧‧‧ illuminator
510‧‧‧資料傳送裝置510‧‧‧ data transfer device
520‧‧‧二維資料碼520‧‧‧2D data code
512‧‧‧編碼產生器512‧‧‧Code Generator
514‧‧‧調變單元514‧‧‧Modulation unit
516‧‧‧光源驅動器516‧‧‧Light source driver
518‧‧‧LED518‧‧‧LED
610‧‧‧傳送端裝置610‧‧‧Transport device
620‧‧‧接收端裝置620‧‧‧ receiving device
612a‧‧‧通訊輸入資料612a‧‧‧Communication input data
612‧‧‧傳送端通訊資料處理單元612‧‧‧Transport communication data processing unit
614a‧‧‧通訊處理資料614a‧‧‧Communication processing data
614b‧‧‧原始影像614b‧‧‧ original image
614c‧‧‧外部指示器614c‧‧‧External indicator
614‧‧‧資料嵌入單元614‧‧‧Data embedding unit
616‧‧‧發光裝置驅動器616‧‧‧Lighting device driver
618‧‧‧發光裝置618‧‧‧Lighting device
618b‧‧‧通訊資料嵌入影像618b‧‧‧Communication data embedded in images
622‧‧‧影像感測裝置622‧‧‧Image sensing device
624‧‧‧影像變形單元624‧‧‧Image Deformation Unit
626‧‧‧資料擷取單元626‧‧‧Information acquisition unit
628‧‧‧接收端通訊資料處理單元628‧‧‧Receiver communication data processing unit
720‧‧‧將通訊處理的資料嵌入在原始影像的一頻域轉換中的一或多個頻率係數720‧‧‧Incorporating communication processed data into one or more frequency coefficients in a frequency domain conversion of the original image
722‧‧‧通訊調變影像722‧‧‧Communication modulation image
730‧‧‧將通訊調變影像從頻域轉換至一空間域730‧‧‧Converting communication modulated images from frequency domain to spatial domain
732‧‧‧RGB值732‧‧‧RGB values
RGB‧‧‧三基色RGB‧‧‧ three primary colors
810‧‧‧預先處理器810‧‧‧Preprocessor
812‧‧‧預先處理程序812‧‧‧Pre-processing procedures
910‧‧‧RGB至YUV轉換910‧‧‧RGB to YUV conversion
920‧‧‧離散餘弦轉換920‧‧‧Discrete cosine transform
930‧‧‧嵌入Y、U、以及V部分的任何組合的頻率係數930‧‧‧ Frequency factor of any combination of Y, U, and V parts embedded
940‧‧‧反離散餘弦轉換940‧‧‧anti-discrete cosine transform
950‧‧‧YUV至RGB轉換950‧‧‧YUV to RGB conversion
912‧‧‧原始影像的像素陣列912‧‧‧Pixel array of original images
922‧‧‧YUV域的像素陣列922‧‧‧Pixel array of YUV domain
924‧‧‧通訊調變影像的像素陣列924‧‧‧Pixel array of communication modulated images
932‧‧‧已經被嵌入通訊處理資料於一空間域之頻率係數的三個像素陣列932‧‧‧Three pixel arrays of frequency coefficients that have been embedded in communication processing data in a spatial domain
952‧‧‧RGB值952‧‧‧RGB values
b00 ,b01 ,...,b13 ‧‧‧二進位位元串流b 00 , b 01 ,...,b 13 ‧‧‧ binary bit stream
Y0 ,Y1 ‧‧‧時間0與1的一離散餘弦轉換結果的兩個Y分量Y 0 , Y 1 ‧‧‧Two Y components of a discrete cosine transform result of time 0 and 1
{b00 ,b01 ,...,b17 }‧‧‧通訊處理資料{b 00 ,b 01 ,...,b 17 }‧‧‧Communication processing data
QPSK‧‧‧四相相位位移鍵QPSK‧‧‧ four-phase phase shift key
BPSK‧‧‧雙相相位位移鍵BPSK‧‧‧biphase phase shift key
1510‧‧‧通訊調變影像1510‧‧‧Communication modulation image
1520‧‧‧通訊資料嵌入影像1520‧‧‧Communication data embedded in images
1620‧‧‧通訊資料嵌入影像(RGB空間域)1620‧‧‧Communication data embedded in images (RGB spatial domain)
1710‧‧‧安排一資料嵌入單元在一傳送端通訊資料處理單元與在此傳送器中的一發光裝置驅動器之間1710‧‧‧ Arranging a data embedding unit between a transmitting communication data processing unit and a lighting device driver in the transmitter
1720‧‧‧藉由使用此資料嵌入單元,根據一調變方法,將一通訊處理資料嵌入在一原始影像的一頻域中的一或多個頻率係數以產生一通訊調變影像1720‧‧‧ By using the data embedding unit, a communication processing data is embedded in one or more frequency coefficients in a frequency domain of an original image according to a modulation method to generate a communication modulation image
1730‧‧‧執行一逆轉換與一域轉換,將此通訊調變影像從一頻域轉換 至一空間域,並且取得一通訊資料嵌入影像的多個RGB值1730‧‧‧ Perform an inverse conversion and a domain conversion to convert this communication modulated image from a frequency domain To a spatial domain, and obtain a plurality of RGB values of a communication data embedded image
1822‧‧‧影像感測裝置1822‧‧‧Image sensing device
1822a‧‧‧傳送端通訊資料嵌入影像1822a‧‧‧Transport communication data embedded in images
1822b‧‧‧接收端通訊資料嵌入影像1822b‧‧‧ Receiver communication data embedded in the image
1824b‧‧‧變形的通訊資料嵌入影像1824b‧‧‧Transformed communication data embedded in images
1828‧‧‧通訊資料處理1828‧‧‧Communication data processing
1824‧‧‧影像變形單元1824‧‧•Image Deformation Unit
1826‧‧‧資料擷取單元1826‧‧‧Information acquisition unit
1800‧‧‧接收裝置1800‧‧‧ receiving device
2020‧‧‧計算一相對應的點p=αa +βb +γc 的步驟2020‧‧‧Steps to calculate a corresponding point p= αa + βb + γc
2030‧‧‧像素值插入步驟2030‧‧‧ pixel value insertion step
2110‧‧‧將變形的通訊資料嵌入影像的多個資料從一第一空間表示法轉換至一第二空間表示法2110‧‧‧Converting a plurality of data embedded in a deformed communication data from a first spatial representation to a second spatial representation
2120‧‧‧將第二空間表示法中變形的通訊資料嵌入影像中劃分為在一頻域中的多個區塊,並且在此多個區塊中的每一區塊上執行一頻域轉換2120‧‧‧ Dividing the transformed communication data embedded in the second spatial representation into a plurality of blocks in a frequency domain, and performing a frequency domain conversion on each of the plurality of blocks
2130‧‧‧擷取嵌入在一或多個頻率係數的位元,來決定通訊處理資料2130‧‧‧Draw a bit embedded in one or more frequency coefficients to determine the communication processing data
2210‧‧‧在一影像感測裝置和一接收端通訊資料處理單元之間配置一影像變形單元和一資料擷取單元2210‧‧ An image deformation unit and a data acquisition unit are disposed between an image sensing device and a receiving communication data processing unit
2220‧‧‧藉由使用此影像感測裝置偵測一發光裝置傳送的一傳送端通訊資料嵌入影像,並且產生一接收端通訊資料嵌入影像2220‧‧. Using the image sensing device to detect a transmission communication data embedded in a transmitting device, and generating a receiving communication data embedded image
2230‧‧‧藉由使用此影像變形單元,在傳送端通訊資料嵌入影像上執行一影像變形處理,並且輸出一變形的通訊資料嵌入影像;以及藉由使用此資料擷取單元,從變形的通訊資料嵌入影像中擷取通訊處理資料2230‧‧‧ by using the image warping unit, performing an image warping process on the transmitting end communication data embedded image, and outputting a deformed communication data embedded image; and using the data capturing unit to transform the communication Data embedded in the image to capture communication processing data
第一A圖與第一B圖是白光LED的兩種類型範例。The first A and the first B are examples of two types of white LEDs.
第二A圖是使用一單一輸入資料流的RGB三重態LED的一般傳送器的一範例示意圖。Figure 2A is a schematic illustration of a general transmitter of an RGB triplet LED using a single input stream.
第二B圖是利用一通-斷鍵控調變方法的調變器的輸出的一個範例。The second B diagram is an example of the output of a modulator utilizing an on-off keying modulation method.
第二C圖是此三重態LED驅動器的輸出功率的一個範例。The second C diagram is an example of the output power of this triplet LED driver.
第三A圖是使用多個輸入資料的RGB三重態LED的一種波長分波多工的傳送器的一範例示意圖。Figure 3A is a schematic illustration of a wavelength division multiplexed transmitter of RGB triplet LEDs using multiple input data.
第三B圖是三重態LED驅動器的輸出功率的一個範例。Figure 3B is an example of the output power of a triplet LED driver.
第四圖是一種可見光通訊技術的一範例示意圖。The fourth figure is a schematic diagram of an example of visible light communication technology.
第五圖是使用可見光通訊的一種資料傳送裝置的一範例示意圖。The fifth figure is an exemplary diagram of a data transfer device using visible light communication.
第六圖是根據本揭露一實施例,說明一種可見光通訊系統。The sixth figure illustrates a visible light communication system according to an embodiment of the present disclosure.
第七圖是根據本揭露一實施例,說明一種嵌入資料於光通訊中的裝置,適應於一傳送器。The seventh figure is a device for embedding data in optical communication according to an embodiment of the present disclosure, which is adapted to a transmitter.
第八圖是根據本揭露一實施例,說明一種嵌入資料於光通訊中的裝置,此裝置包括一預先處理器。The eighth figure is a device for embedding data in optical communication according to an embodiment of the present disclosure, the device comprising a pre-processor.
第九圖是根據本揭露一實施例,說明採用一原始輸入影像作為例子的嵌入資料於光通訊中的裝置的運作。The ninth figure illustrates the operation of the apparatus for embedding data in optical communication using an original input image as an example in accordance with an embodiment of the present disclosure.
第十圖是根據本揭露一實施例,說明以一種以雙相相位位移鍵(Binary Phase Shift Keying,BPSK)調變方法嵌入的通訊處理資料的第一範例。The tenth figure is a first example of communication processing data embedded by a Binary Phase Shift Keying (BPSK) modulation method according to an embodiment of the present disclosure.
第十一圖是根據本揭露一實施例,說明以一種以BPSK調變方法嵌入的通訊處理資料的第二範例。The eleventh figure is a second example of communication processing data embedded in a BPSK modulation method according to an embodiment of the present disclosure.
第十二圖是根據本揭露一實施例,說明以一種四相相位位移鍵(Quadrature Phase Shift Keying,QPSK)調變方法嵌入的通訊處理資料的第三範例。Figure 12 is a third example of communication processing data embedded by a Quadrature Phase Shift Keying (QPSK) modulation method according to an embodiment of the present disclosure.
第十三圖是根據本揭露一實施例,說明以混合BPSK與QPSK 調變方法嵌入的通訊處理資料的第四範例。Figure 13 is a diagram illustrating mixing BPSK and QPSK according to an embodiment of the present disclosure. A fourth example of communication processing data embedded in a modulation method.
第十四圖是根據本揭露一實施例,說明以一種展頻序列(spread spectrum sequence)調變方法嵌入的通訊處理資料的第五範例。The fourteenth embodiment is a fifth example of communication processing data embedded in a spread spectrum sequence modulation method according to an embodiment of the present disclosure.
第十五圖是根據本揭露一實施例,說明將通訊調變影像與原始影像嵌入於一YUV空間域中。The fifteenth figure illustrates the embedding of the communication modulated image and the original image in a YUV spatial domain according to an embodiment of the present disclosure.
第十六圖是根據本揭露一實施例,說明將通訊調變影像與原始影像嵌入於一RGB空間域中。FIG. 16 is a diagram illustrating embedding a communication modulated image and an original image in an RGB spatial domain according to an embodiment of the present disclosure.
第十七圖是根據本揭露一實施例,說明一種嵌入資料於光通訊中的方法,適應於一傳送器。Figure 17 is a diagram illustrating a method of embedding data in optical communication according to an embodiment of the present disclosure, adapted to a transmitter.
第十八圖是根據本揭露一實施例,說明一種嵌入資料於光通訊中的接收裝置。Figure 18 is a diagram showing a receiving device for embedding data in optical communication according to an embodiment of the present disclosure.
第十九圖是根據本揭露一實施例,說明影像變形處理中的一個三角形中的一個點的質心座標轉換(barycentric coordinate conversion)。FIG. 19 is a diagram showing a barycentric coordinate conversion of a point in a triangle in image deformation processing according to an embodiment of the present disclosure.
第二十圖是根據本揭露一實施例,說明影像變形處理的運作。Figure 20 is a diagram illustrating the operation of image warping processing in accordance with an embodiment of the present disclosure.
第二十一圖是根據本揭露一實施例,說明資料擷取單元的運作。The twenty-first figure illustrates the operation of the data capture unit in accordance with an embodiment of the present disclosure.
第二十二圖是根據本揭露一實施例,說明一種嵌入資料於光通訊中的接收方法。The twenty-second figure is a method for receiving embedded data in optical communication according to an embodiment of the present disclosure.
本揭露實施例提供一種嵌入資料於光通訊中,以同時執行影像或視訊顯示和光通訊的技術。該技術先使用通訊處理資料 的一資料嵌入技術,然後再將通訊處理資料應用至發光裝置驅動器或影像/視訊顯示驅動器,而不是直接將通訊處理資料應用至發光裝置驅動器如LED驅動器。當光通訊被執行時,本揭露實施範例將通訊處理資料嵌入至影像或視訊的空間域中頻率係數對眼睛不敏感的部分。The disclosed embodiments provide a technique for embedding data in optical communication to simultaneously perform image or video display and optical communication. The technology first uses communication to process data. Instead of directly applying the communication processing data to the illuminator driver, such as an LED driver, a data embedding technique is then applied to the illuminator driver or the video/video display driver. When the optical communication is performed, the disclosed embodiment embeds the communication processing data into a portion of the spatial domain of the video or video that is not sensitive to the eyes.
如第六圖所示,根據本揭露一實施例的一光通訊系統600可包含一傳送端裝置610以及一接收端裝置620。傳送端裝置610可包含一傳送端通訊資料處理單元612、一資料嵌入單元614、一發光裝置驅動器616、以及一發光裝置618。傳送端通訊資料處理單元612可執行通訊輸入資料612a的一信號處理。資料嵌入單元614可根據一調變編碼(modulation encoding)方法,將通訊處理資料614a嵌入於一原始影像614b的一頻域轉換的一或多個頻率係數。在嵌入通訊處理資料614a之前,一外部指示器(external indicator)614c可用來指出是否執行一預先處理(pre-processing)程序。外部指示器614c可由一軟體模組或一硬體元件來產生。發光裝置驅動器616可根據資料嵌入單元614處理的輸出資料來驅動發光裝置618。As shown in the sixth figure, an optical communication system 600 according to an embodiment of the present disclosure may include a transmitting end device 610 and a receiving end device 620. The transmitting end device 610 can include a transmitting end communication data processing unit 612, a data embedding unit 614, a lighting device driver 616, and a lighting device 618. The transmit end communication data processing unit 612 can perform a signal processing of the communication input data 612a. The data embedding unit 614 can embed the communication processing data 614a in a frequency domain converted one or more frequency coefficients of an original image 614b according to a modulation encoding method. An external indicator 614c can be used to indicate whether a pre-processing procedure is to be performed prior to embedding the communication processing material 614a. The external indicator 614c can be generated by a software module or a hardware component. The illumination device driver 616 can drive the illumination device 618 based on the output data processed by the data embedding unit 614.
接收端裝置620可包含一影像感測裝置622、一影像變形單元624、一資料擷取單元626、以及一接收端通訊資料處理單元628。影像感測裝置622可偵測從發光裝置618經由一通道傳送的一通訊資料嵌入影像618b。影像變形單元624可執 行一影像變形函數(image warping function)來補償來自影像感測單元622的一感測影像(sensed image)的變形。資料擷取單元626可擷取從影像變形單元624輸出的通訊處理資料614a。接收端通訊資料處理單元628執行共同的通訊資料處理,如解調(demodulation)與錯誤修正,以從被資料擷取單元626所擷取的通訊處理資料614a中恢復通訊輸入資料612a。The receiving device 620 can include an image sensing device 622, an image deforming unit 624, a data capturing unit 626, and a receiving end communication data processing unit 628. The image sensing device 622 can detect a communication data embedded image 618b transmitted from the light emitting device 618 via a channel. Image warping unit 624 can be executed An image warping function is performed to compensate for a deformation of a sensed image from the image sensing unit 622. The data capture unit 626 can retrieve the communication processing data 614a output from the image warping unit 624. The receiving end communication data processing unit 628 performs common communication material processing, such as demodulation and error correction, to recover the communication input data 612a from the communication processing data 614a retrieved by the data retrieval unit 626.
如第六圖所提及的,傳送端通訊資料處理單元可執行在傳送端裝置中的共同通訊信號處理,例如錯誤修正編碼和調變等,來產生通訊處理資料。通訊處理資料可以是,但不限於,一信號串流(a stream of signals)的一位元串流(bit stream),例如實數虛數對(I/Q pair)。第七圖是根據本揭露一實施例,說明一種嵌入資料於光通訊中的裝置,適應於一傳送器。參考第七圖,嵌入資料於光通訊中的裝置可包含資料嵌入單元614,被安排在傳送端通訊資料處理單元612與發光裝置驅動器616之間。資料嵌入單元614可根據調變方法,將通訊處理的資料614a嵌入在原始影像614b的一頻域轉換如離散餘弦轉換(DCT)的一或多個頻率係數(步驟720)。沒有嵌入通訊資料的原始影像6l4b可以是一靜止影像(still image)或是一視訊序列(video sequence)中的一畫面(frame)。嵌入一頻域轉換的一或多個頻率係數後,資料嵌入單元執行一域轉換(domain transform),例如逆DCT(Inverse DCT,IDCT),將通訊調變影像從頻域轉換至一空間域(步驟730),並取得通訊資料嵌入影像618b的多 個RGB值732,例如藉由將亮度(luminance)及色度(chrominance)信號轉換成RGB信號。As mentioned in the sixth figure, the transmitting end communication data processing unit can perform common communication signal processing, such as error correction encoding and modulation, in the transmitting end device to generate communication processing data. The communication processing data may be, but not limited to, a bit stream of a stream of signals, such as a real imaginary pair (I/Q pair). The seventh figure is a device for embedding data in optical communication according to an embodiment of the present disclosure, which is adapted to a transmitter. Referring to the seventh figure, the device embedded in the optical communication may include a data embedding unit 614 disposed between the transmitting end communication data processing unit 612 and the illuminating device driver 616. The data embedding unit 614 may embed the communication processed data 614a in a frequency domain conversion of the original image 614b, such as one or more frequency coefficients of a discrete cosine transform (DCT), according to the modulation method (step 720). The original image 6l4b without embedded communication data may be a still image or a frame in a video sequence. After embedding one or more frequency coefficients of a frequency domain conversion, the data embedding unit performs a domain transform, such as inverse DCT (Inverse DCT, IDCT), to convert the communication modulated image from the frequency domain to a spatial domain ( Step 730), and obtain the communication data embedded in the image 618b The RGB values 732 are converted to RGB signals, for example, by converting luminance and chrominance signals.
換句話說,資料嵌入單元614可以產生一通訊調變影像722,並且取得通訊資料嵌入影像的多個RGB值。資料嵌入單元可藉由插入一原始影像中的多個原始畫面的一或多個影像強度所調變的一或多個畫面,來嵌入通訊處理資料。被插入的一或多個畫面是由原始影像中不同區域的一或多個部分影像的一或多個強度來調變的。In other words, the data embedding unit 614 can generate a communication modulation image 722 and obtain a plurality of RGB values of the communication data embedded image. The data embedding unit may embed the communication processing data by inserting one or more pictures of one or more image intensities of the plurality of original pictures in the original image. The one or more pictures that are inserted are modulated by one or more intensities of one or more partial images of different regions in the original image.
資料嵌入單元可藉由將通訊處理資料嵌入在原始影像的一頻域轉換的一或多個頻率係數來產生一通訊調變影像。資料嵌入單元可藉由將此通訊調變影像嵌入在原始影像的頻域中、執行頻域轉換、以及將多個亮度和色度資料轉換為多個RGB值,來產生通訊資料嵌入影像。或是,此資料嵌入單元可執行一域轉換,將此通訊調變影像從一頻域轉換至一RGB空間域,並且將多個衍生的(resulted)亮度和色度資料轉換為多個RGB值,以及藉由嵌入多個RGB值至原始影像中來產生此通訊資料嵌入影像。或是,此資料嵌入單元可執行一域轉換,將此通訊調變影像從一頻域轉換至一空間域,並且藉由將一轉換結果嵌入在原始影像,以及將一資料嵌入影像(data embedded image)的多個衍生的亮度和色度資料轉換為多個RGB值來產生此通訊資料嵌入影像。The data embedding unit may generate a communication modulated image by embedding the communication processing data in one or more frequency coefficients of a frequency domain conversion of the original image. The data embedding unit can generate the communication data embedding image by embedding the communication modulation image in the frequency domain of the original image, performing frequency domain conversion, and converting the plurality of luminance and chrominance data into a plurality of RGB values. Alternatively, the data embedding unit may perform a domain conversion to convert the communication modulated image from a frequency domain to an RGB spatial domain, and convert the plurality of derived luminance and chrominance data into a plurality of RGB values. And generating the communication data embedded image by embedding a plurality of RGB values into the original image. Alternatively, the data embedding unit may perform a domain conversion to convert the communication modulated image from a frequency domain to a spatial domain, and embed a conversion result in the original image, and embed a data into the image (data embedded Image) A plurality of derived luminance and chrominance data are converted into a plurality of RGB values to generate an embedded image of the communication data.
在嵌入此通訊處理資料之前,此嵌入資料於光通訊中的裝置可根據外部指示器614c來執行一預先處理程序。例如,預先處理程序可包括將原始影像的像素陣列614b從一第一域,例如一RGB域,轉換至一第二域,例如一YUV(或YCbCr)域,以及執行此YUV域中像素陣列的DCT。外部指示器614c指出是否執行此預先處理程序。外部指示器可以由一軟體模組或一硬體元件來產生。資料嵌入單元可嵌入此通訊處理資料至原始影像的如離散餘弦轉換(DCT)的一或多個預定的頻率係數。發光裝置驅動器根據由資料嵌入單元處理的信號來驅動此發光裝置。在傳送器中的發光裝置618的輸出是光通訊要被傳送的一通訊資料嵌入影像。Prior to embedding the communication processing material, the device embedded in the optical communication can perform a pre-processing procedure based on the external indicator 614c. For example, the pre-processing program can include converting the pixel array 614b of the original image from a first domain, such as an RGB domain, to a second domain, such as a YUV (or YCbCr) domain, and performing pixel arrays in the YUV domain. DCT. The external indicator 614c indicates whether or not to execute this pre-processing procedure. The external indicator can be generated by a software module or a hardware component. The data embedding unit may embed the communication processing data into one or more predetermined frequency coefficients of the original image, such as discrete cosine transform (DCT). The illuminator driver drives the illuminating device based on signals processed by the data embedding unit. The output of the illumination device 618 in the transmitter is a communication data embedded image to be transmitted by the optical communication.
依此,如第八圖的一實施例所示,第七圖之嵌入資料於光通訊中的裝置還可包括一預先處理器810,此預先處理器810配置來根據外部指示器614c,在嵌入此通訊處理資料之前,執行一預先處理程序812。執行此預先處理程序後,資料嵌入單元614嵌入此通訊處理資料614於空間域的一或多個頻率係數(例如,執行步驟720和730),並且取得通訊資料嵌入影像618b的多個RGB值732。Accordingly, as shown in an embodiment of the eighth figure, the apparatus for embedding data in the optical communication of the seventh figure may further include a pre-processor 810 configured to be embedded according to the external indicator 614c. A pre-processing program 812 is executed before the communication processing data. After executing the pre-processing procedure, the data embedding unit 614 embeds one or more frequency coefficients of the communication processing material 614 in the spatial domain (eg, performing steps 720 and 730), and obtains a plurality of RGB values 732 of the communication material embedded image 618b. .
第九圖是根據本揭露一實施例,說明採用一原始輸入影像作為例子的嵌入資料於光通訊中的裝置的運作。在本實施例 中,原始輸入影像是由8×8 RGB像素陣列912所組成的。當外部指示器614c指出應執行此預先處理程序時,在嵌入此通訊處理資料之前,預先處理器810執行一預先處理程序,例如將原始影像的像素陣列912從一RGB域轉換至另一域例如YUV(或YCbCr)域(即RGB至YUV轉換的步驟910),來產生YUV(或YCbCr)域的像素陣列922,並且在YUV域922中的像素陣列上執行一DCT(即步驟920),此DCT執行後,產生一通訊調變影像的像素陣列924。外部指示器614c可藉由使用一軟體編程暫存器(software programming register)或是一硬體元件來產生。The ninth figure illustrates the operation of the apparatus for embedding data in optical communication using an original input image as an example in accordance with an embodiment of the present disclosure. In this embodiment The original input image is composed of an 8 x 8 RGB pixel array 912. When the external indicator 614c indicates that this pre-processing should be performed, the pre-processor 810 performs a pre-processing procedure, such as converting the pixel array 912 of the original image from one RGB domain to another, for example, prior to embedding the communication processing material. A YUV (or YCbCr) domain (i.e., step 910 of RGB to YUV conversion) is used to generate a pixel array 922 of the YUV (or YCbCr) domain, and a DCT is performed on the pixel array in the YUV domain 922 (ie, step 920), After the DCT is executed, a pixel array 924 of communication modulated images is generated. The external indicator 614c can be generated by using a software programming register or a hardware component.
資料嵌入單元614可根據一調變編碼方法,將通訊處理資料614a嵌入在DCT區塊的Y、U、以及V部分的任意組合的一或多個頻率係數(即步驟930中,嵌入Y、U、以及V部分的任何組合的頻率係數),進而產生例如已經被嵌入通訊處理資料614a於一空間域之頻率係數的三個像素陣列932。資料嵌入單元614可根據通訊處理資料614a與調變類型來移除原始輸入影像的係數以及添加至少一個值。資料嵌入單元614可執行一逆離散餘弦轉換(IDCT)(即步驟940)來恢復像素陣列922,以及一YUV(YCbCr)至RGB的轉換(即步驟950)來依序地取得一通訊資料嵌入影像的多個RGB值952。在本範例中,通訊資料嵌入影像932是藉由將得到的RGB值952嵌入至8×8 RGB像素陣列912中而形成的,並且通訊資料嵌入影像 932將被傳送器傳送。RGB值952將被應用至一發光裝置驅動器,此發光裝置驅動器驅動發光裝置輸出一通訊資料嵌入影像。The data embedding unit 614 may embed the communication processing data 614a in one or more frequency coefficients of any combination of the Y, U, and V portions of the DCT block according to a modulation coding method (ie, in step 930, embedding Y, U. And the frequency coefficients of any combination of the V portions, thereby generating, for example, three pixel arrays 932 of frequency coefficients that have been embedded in the communication processing data 614a in a spatial domain. The data embedding unit 614 can remove the coefficients of the original input image and add at least one value according to the communication processing data 614a and the modulation type. The data embedding unit 614 can perform an inverse discrete cosine transform (IDCT) (ie, step 940) to restore the pixel array 922, and a YUV (YCbCr) to RGB conversion (ie, step 950) to sequentially acquire a communication data embedded image. Multiple RGB values of 952. In this example, the communication data embedded image 932 is formed by embedding the obtained RGB values 952 into the 8×8 RGB pixel array 912, and the communication data is embedded in the image. 932 will be transmitted by the transmitter. The RGB value 952 will be applied to an illumination device driver that drives the illumination device to output a communication data embedded image.
藉由適當地選擇一或多個頻率係數來嵌入通訊處理資料,此一或多個頻率係數例如是,但不限於中低頻率係數,人眼可能不會感測到嵌入通訊處理資料後的失真。下面的例子說明了一些嵌入通訊處理資料的方法。第十圖是根據本揭露一實施例,說明以一種以雙相相位位移鍵(BPSK)調變方法嵌入通訊處理資料的第一範例。在第十圖的範例中,一影像,例如是,但不限於由多個8×8像素陣列所組成的,並且多個DCT區塊中的每一區塊的大小為8×8。通訊處理資料是由{b00 ,b01 ,...,b13 }表示的一個二進位位元串流(binary bit stream),其中bij 表示被嵌入在一第i個畫面的第j個位元。假設Y0 ,Y1 分別代表在時間0與1的一DCT結果的兩個Y分量。令{fi0 ,fi1 ,...,fi(N-1) }是嵌入通訊處理資料的N個頻率係數,其中N是每一DCT區塊中頻率係數的數目。對於此BPSK調變方法,根據通訊處理資料的輸入位元,將這些fi0 ,fi1 ,...,fi(N-1) 的值設定為fi0 =fi1 =…=fi(N-1) =+m或是fi0 =fi1 =…=fi(N-1) =-m。在第十圖的範例中,分別由三個斜線正方形標記的三個頻率係數是用來以BPSK調變方法嵌入此通訊處理資料的。在此情況下,N=3以及m=4。4個DCT區塊上的第1行的12個低和中頻率係數根據B00 的值,都被設定為-4或4,此4個DCT區塊上的第2行 的12個低和中頻率係數都被設定為b01 的值,以此類推。The communication processing data is embedded by appropriately selecting one or more frequency coefficients, such as, but not limited to, low and medium frequency coefficients, and the human eye may not sense the distortion after embedding the communication processing data. . The following example illustrates some ways to embed communication processing data. The tenth figure is a first example of embedding communication processing data in a two-phase phase shift key (BPSK) modulation method according to an embodiment of the present disclosure. In the example of the tenth figure, an image is, for example, but not limited to, composed of a plurality of 8×8 pixel arrays, and each of the plurality of DCT blocks has a size of 8×8. The communication processing data is a binary bit stream represented by {b 00 , b 01 , ..., b 13 }, where b ij represents the jth embedded in an i-th picture Bit. Let Y 0 and Y 1 represent the two Y components of a DCT result at times 0 and 1, respectively. Let {f i0 ,f i1 ,...,f i(N-1) } be the N frequency coefficients embedded in the communication processing data, where N is the number of frequency coefficients in each DCT block. For this BPSK modulation method, the values of these f i0 , f i1 , . . . , f i(N-1) are set to f i0 =f i1 =...=f i according to the input bit of the communication processing data. N-1) = +m or f i0 = f i1 =...=f i(N-1) = -m. In the example of the tenth figure, three frequency coefficients respectively marked by three diagonal squares are used to embed the communication processing data in the BPSK modulation method. In this case, N=3 and m=4. The 12 low and medium frequency coefficients of the 1st row on the 4 DCT blocks are set to -4 or 4 according to the value of B 00 , and the 4 DCTs The 12 low and medium frequency coefficients of the second row on the block are set to the value of b 01 , and so on.
第十一圖是根據本揭露一實施例,說明以一種以BPSK調變方法,交錯地嵌入通訊處理資料的第二範例。在第十一圖範例中,通訊處理資料{b00 ,b01 ,...,b17 }以BPSK調變方法被交錯嵌入在DCT區塊的低和中頻率係數。當通訊處理資料的輸入位元值是1時,相關的DCT區塊的低和中頻率係數(由斜線正方形表示)被設定為4,否則,係數被設定為-4。在本範例中,在第1行上的兩個DCT區塊的6個低和中頻率係數是根據b00 的值來設定,並且在第1行上的其他兩個DCT區塊的6個低和中頻率係數是根據b01 的值來設定,以此類推。The eleventh figure is a second example of interleaving embedded communication processing data in a BPSK modulation method according to an embodiment of the present disclosure. In the example of the eleventh figure, the communication processing data {b 00 , b 01 , ..., b 17 } are interleaved in the low and medium frequency coefficients of the DCT block by the BPSK modulation method. When the input bit value of the communication processing data is 1, the low and medium frequency coefficients (represented by a slanted square) of the associated DCT block are set to 4, otherwise, the coefficient is set to -4. In this example, the six low and medium frequency coefficients of the two DCT blocks on the first row are set according to the value of b 00 , and the six other DCT blocks on the first row are low. The sum frequency coefficient is set according to the value of b 01 , and so on.
第十二圖是根據本揭露一實施例,說明以一種QPSK調變方法嵌入通訊處理資料的第三範例。在本範例中,多個DCT區塊中的每一區塊的大小為8×8,每一小正方形代表一DCT區塊中的一係數。通訊處理資料是由QPSK符號組成的。{fi0_00 ,fi1_00 ,…,f(N-1)_00 }、{fi0_01 ,fi1_01 ,…,f(N-1)_01 }、{fi0_10 ,fi1_10 ,…,f(N-1)_10 }、以及{fi0_11 ,fi1_11 ,...,f(N-1)_11 }分別是4個QPSK符號,即00、01、10、以及11,在每一DCT區塊中的N個頻率係數,其中N是每一DCT區塊中頻率係數的數目。在第十二圖的範例中,N=3。當通訊處理資料中的QPSK符號是00、01、10、以及11時,一相對應的DCT區塊的中和低頻率係數(由斜線正方形表示)分別由{-4,-4,-4}、{-4,4,4}、{4,-4,-4}、 以及{4,4,4}來取代。Figure 12 is a third example of embedding communication processing data in a QPSK modulation method according to an embodiment of the present disclosure. In this example, each of the plurality of DCT blocks has a size of 8 x 8, and each small square represents a coefficient in a DCT block. The communication processing data is composed of QPSK symbols. {f i0_00 , f i1_00 ,...,f (N-1)_00 }, {f i0_01 , f i1_01 ,...,f (N-1)_01 }, {f i0_10 ,f i1_10 ,...,f (N-1 )_10 }, and {f i0_11 , f i1_11 ,...,f (N-1)_11 } are respectively 4 QPSK symbols, ie 00, 01, 10, and 11, N in each DCT block Frequency coefficients, where N is the number of frequency coefficients in each DCT block. In the example of the twelfth figure, N=3. When the QPSK symbols in the communication processing data are 00, 01, 10, and 11, the neutral and low frequency coefficients (represented by slanted squares) of a corresponding DCT block are respectively {-4, -4, -4} , {-4, 4, 4}, {4, -4, -4}, and {4, 4, 4} are replaced.
第十三圖是根據本揭露一實施例,說明以混合BPSK與QPSK調變方法嵌入的通訊處理資料的第四範例。在本範例中,像素陣列與DCT區塊的大小都是8×8,並且兩種調變方法混合在一區塊中。當從一影像感測裝置接收時,因為一影像可能遭受噪音和幾何變形,中間頻率係數比那些高頻率係數更可靠。所以,通訊處理資料可被嵌入在一較強調變方法的高頻率係數,以及嵌入在一較弱調變方法的中間頻率係數。在本範例中,通訊處理資料用QPSK調變的被嵌入在中頻率係數,以及用BPSK調變的被嵌入在高頻率係數。A thirteenth diagram is a fourth example of communication processing data embedded by a hybrid BPSK and QPSK modulation method according to an embodiment of the present disclosure. In this example, the size of the pixel array and the DCT block are both 8x8, and the two modulation methods are mixed in one block. When received from an image sensing device, the intermediate frequency coefficients are more reliable than those with higher frequency coefficients because an image may be subject to noise and geometric distortion. Therefore, the communication processing data can be embedded in a higher frequency coefficient that emphasizes the variable method, and an intermediate frequency coefficient embedded in a weaker modulation method. In this example, the communication processing data is embedded in the medium frequency coefficient with QPSK modulation, and is embedded in the high frequency coefficient with BPSK modulation.
第十四圖是根據本揭露一實施例,說明以一種展頻序列調變方法嵌入通訊處理資料的第五範例。在本範例中,像素陣列和DCT區塊的大小都是8×8。通訊處理資料由一個二進位位元串流表示。令{fi0_0 ,fi1_0 ,…,f(N-1)_0 }與{fi0_1 ,fi1_1 ,…,f(N-1)_1 }分別是用來嵌入位元0和位元1的每一DCT區塊的N個頻率係數,其中N是每一DCT區塊頻率係數的數目,並且這些fi_j 的值可以是不同的。在第十四圖的範例中,N=28,並且具位元值為0的通訊處理資料被嵌入至一展頻圖樣(序列)1410中的頻率係數,並且具位元值為1的通訊處理資料被嵌入至一展頻圖樣(序列)1420中的頻率係數。這些頻率係數的不同組合可用來代表此展頻編碼。接收器可擷取在頻域中的係數並 作為輸入信號,並且計算此兩展頻序列的相關性來恢復此通訊處理資料。例如,當一輸入信號與值為0的序列之間的相關性大於一輸入信號與值為1的序列之間的相關性時,展頻碼是0,否則展頻碼是1。The fourteenth embodiment is a fifth example of embedding communication processing data in a spread spectrum sequence modulation method according to an embodiment of the present disclosure. In this example, the size of the pixel array and DCT block are both 8x8. The communication processing data is represented by a binary bit stream. Let {f i0_0 , f i1_0 ,...,f (N-1)_0 } and {f i0_1 ,f i1_1 ,...,f (N-1)_1 } be used to embed each of bit 0 and bit 1, respectively. N frequency coefficients of a DCT block, where N is the number of frequency coefficients per DCT block, and the values of these f i_j may be different. In the example of Fig. 14, N = 28, and communication processing data having a bit value of 0 is embedded into a frequency coefficient in a spread spectrum pattern (sequence) 1410, and communication processing with a bit value of 1 The data is embedded into a frequency coefficient in a spread spectrum pattern (sequence) 1420. Different combinations of these frequency coefficients can be used to represent this spread spectrum coding. The receiver can take the coefficients in the frequency domain and use them as input signals, and calculate the correlation of the two spreading sequences to recover the communication processing data. For example, when the correlation between an input signal and a sequence having a value of 0 is greater than the correlation between an input signal and a sequence having a value of 1, the spreading code is 0, otherwise the spreading code is 1.
在傳送器中,通訊處理資料嵌入原始影像中有多種不同的方法。第十五圖和第十六圖分別說明兩個範例。第十五圖是根據本揭露一實施例,說明將通訊調變影像與原始影像嵌入於一YUV空間域中。在第十五圖範例中,在嵌入通訊處理資料之前,預先處理器,例如是一RGB至YUV轉換910,可將原始影像的像素陣列從一第一空間域,例如是一RGB域,轉換至一第二空間域,例如是一YUV(或YCbCr)域。執行此預先處理後,資料嵌入單元614可根據一調變方法,將通訊處理資料嵌入在頻域中的係數,例如嵌入在Y、U、以及V部份的任何組合的頻率係數,標記為930,並且產生具嵌入的頻率係數的通訊調變影像1510,以及執行一IDCT轉換。資料嵌入單元藉由嵌入通訊調變影像1510至原始影像的空間YUV域,產生一空間YUV域的通訊資料嵌入影像1520。最後,此資料嵌入單元將通訊資料嵌入影像1520從YUV(YCbCr)空間域轉換至RGB空間域,以取得在RGB空間域中通訊資料嵌入影像的多個RGB值來進行光通訊。In the transmitter, there are many different ways to embed communication processing data into the original image. The fifteenth and sixteenth figures illustrate two examples, respectively. The fifteenth figure illustrates the embedding of the communication modulated image and the original image in a YUV spatial domain according to an embodiment of the present disclosure. In the fifteenth example, before embedding the communication processing data, the pre-processor, for example, an RGB to YUV conversion 910, can convert the pixel array of the original image from a first spatial domain, such as an RGB domain, to A second spatial domain, such as a YUV (or YCbCr) domain. After performing this pre-processing, the data embedding unit 614 can embed the communication processing data in the frequency domain according to a modulation method, for example, the frequency coefficient embedded in any combination of the Y, U, and V parts, labeled 930. And generating a communication modulated image 1510 with embedded frequency coefficients, and performing an IDCT conversion. The data embedding unit generates a spatial YUV domain communication data embedding image 1520 by embedding the communication modulation image 1510 into the spatial YUV domain of the original image. Finally, the data embedding unit converts the communication data embedded image 1520 from the YUV (YCbCr) spatial domain to the RGB spatial domain to obtain a plurality of RGB values embedded in the communication data in the RGB spatial domain for optical communication.
第十六圖是根據本揭露一實施例,說明將通訊調變影像嵌 入於原始影像的RGB空間域中。在第十六圖範例中,沒有執行預先處理程序。資料嵌入單元614根據一調變方法,將通訊處理資料嵌入在頻域中的係數,來產生通訊調變影像1510,並且執行通訊調變影像1510的一IDCT轉換,以及將通訊調變影像1510從YUV(YCbCr)域轉換至RGB域,以依序取得在RGB空間域的一通訊調變影像1620的多個RGB值。最後,資料嵌入單元614將通訊調變影像中的RGB值嵌入至RGB空間域的原始影像的RGB值,以產生RGB空間域的一通訊資料嵌入影像1620來進行光通訊。Figure 16 is a diagram illustrating the embedding of a communication modulated image according to an embodiment of the present disclosure. Enter the RGB spatial domain of the original image. In the example of the sixteenth figure, the pre-processing procedure is not executed. The data embedding unit 614 embeds the communication processing data in the frequency domain according to a modulation method to generate the communication modulation image 1510, and performs an IDCT conversion of the communication modulation image 1510, and the communication modulation image 1510 is The YUV (YCbCr) domain is converted to the RGB domain to sequentially acquire a plurality of RGB values of a communication modulated image 1620 in the RGB spatial domain. Finally, the data embedding unit 614 embeds the RGB values in the communication modulated image into the RGB values of the original image in the RGB spatial domain to generate a communication data embedded image 1620 in the RGB spatial domain for optical communication.
如上所述,第十七圖是根據本揭露一實施例,說明一種嵌入資料於光通訊中的方法,適應於一傳送器。在第十七圖中,此方法可安排一資料嵌入單元在一傳送端通訊資料處理單元與在此傳送器中的一發光裝置驅動器之間(步驟1710);並且藉由使用此資料嵌入單元,根據一調變方法,將一通訊處理資料嵌入在一原始影像的一頻域中的一或多個頻率係數以產生一通訊調變影像(步驟1720),然後執行一逆轉換與一域轉換,將此通訊調變影像從一頻域轉換至一空間域,並且取得一通訊資料嵌入影像的多個RGB值(步驟1730),其中,此通訊資料嵌入影像是由嵌入至此原始影像的多個RGB值來形成。As described above, the seventeenth embodiment is a method for embedding data in optical communication according to an embodiment of the present disclosure, which is adapted to a transmitter. In the seventeenth figure, the method can arrange a data embedding unit between a transmitting end communication data processing unit and a lighting device driver in the transmitting device (step 1710); and by using the data embedding unit, According to a modulation method, a communication processing data is embedded in one or more frequency coefficients in a frequency domain of an original image to generate a communication modulated image (step 1720), and then an inverse conversion and a domain conversion are performed. Converting the communication modulated image from a frequency domain to a spatial domain, and obtaining a plurality of RGB values of a communication data embedded image (step 1730), wherein the communication data embedded image is a plurality of RGB embedded in the original image. Values are formed.
如之前所述,當根據一外部指示器執行一預先處理程序 時,原始影像可從一RGB空間域轉換至一YUV空間域。預先處理程序已完成以及通訊調變影像產生後,此方法可藉由將通訊調變影像嵌入至原始影像的YUV空間域以產生通訊資料嵌入影像,並且將通訊資料嵌入影像從YUV空間域轉換至RGB空間域,來取得通訊資料嵌入影像的多個RGB值以進行光通訊。當無預先處理程序被執行時,此方法執行一IDCT轉換後,可將此通訊調變影像從YUV(YCbCr)域轉換至RGB域,在RGB空間域依序取得此通訊調變影像的RGB值,並且在RGB空間域嵌入通訊調變影像的RGB值至原始影像中的RGB值,來產生在RGB空間域的通訊資料嵌入影像以進行光通訊。As described earlier, when performing a pre-processing procedure based on an external indicator The original image can be converted from an RGB spatial domain to a YUV spatial domain. After the pre-processing procedure is completed and the communication modulation image is generated, the method can embed the communication modulation image into the YUV space domain of the original image to generate the communication data embedded image, and convert the communication data into the image from the YUV space domain to The RGB spatial domain is used to obtain a plurality of RGB values of the communication data embedded in the image for optical communication. When no pre-processing program is executed, after performing an IDCT conversion, the method can convert the communication modulated image from the YUV (YCbCr) domain to the RGB domain, and sequentially obtain the RGB values of the communication modulated image in the RGB spatial domain. And embedding the RGB values of the communication modulated image into the RGB values in the original image in the RGB spatial domain to generate the communication data embedded in the RGB spatial domain for optical communication.
如上所述,嵌入資料於光通訊中的方法可根據一調變編碼方法將通訊處理資料嵌入在DCT區塊的Y、U、以及V部分的任何組合的一或多個頻率係數。可用不同的調變方法來嵌入通訊處理資料,例如是但不限於第十圖至第十四圖的實施範例可應用至此方法。As described above, the method of embedding data in optical communication can embed communication processing data in one or more frequency coefficients of any combination of Y, U, and V portions of the DCT block according to a modulation coding method. The modulation processing data can be embedded by different modulation methods, and the implementation examples such as, but not limited to, the tenth to fourteenth embodiments can be applied to the method.
當發光裝置618經由光通訊的一通道傳送一通訊資料嵌入影像時,嵌入資料於光通訊中的一接收裝置的一實施例可參考第十八圖。在第十八圖中,嵌入資料於光通訊中的一接收裝置1800可包含一影像感測裝置1822、一影像變形單元1824、以及一資料擷取單元1826。影像感測單元1822可偵測由發光裝置618經由一通道傳送的一傳送端通訊資料嵌入影像 1822a,並且產生一接收端通訊資料嵌入影像1822b。因為接收端通訊資料嵌入影像1822b的大小和形狀可能與傳送端通訊資料嵌入影像1822a不同,影像變形單元1824被配置來藉由對傳送端嵌入影像1822a執行一影像變形處理以補償接收端通訊資料嵌入影像1822b的變形,並且輸出一變形的通訊資料嵌入影像1824b。資料擷取單元1826被配置為從變形的通訊資料嵌入影像1824b中擷取通訊處理資料614a。此接收裝置還可對通訊處理資料614a執行一通訊資料處理1828,以得到恢復的(recovered)資料。When the illuminating device 618 transmits a communication data embedded image via a channel of optical communication, an embodiment of a receiving device embedded in the optical communication can refer to FIG. In the eighteenth figure, a receiving device 1800 embedded in the optical communication device can include an image sensing device 1822, an image deforming unit 1824, and a data capturing unit 1826. The image sensing unit 1822 can detect a communication data embedded in the image transmitted by the light emitting device 618 via a channel. 1822a, and generates a receiving end communication data embedded image 1822b. Because the size and shape of the receiving end communication data embedded image 1822b may be different from the transmitting end communication data embedded image 1822a, the image deforming unit 1824 is configured to perform an image deformation process on the transmitting end embedded image 1822a to compensate the receiving end communication data embedding. The image 1822b is deformed and a deformed communication material is output to the image 1824b. The data retrieval unit 1826 is configured to retrieve the communication processing data 614a from the transformed communication data embedded image 1824b. The receiving device can also perform a communication data processing 1828 on the communication processing data 614a to obtain recovered data.
由影像變形單元1824執行的影像變形處理可包括在傳送端通訊資料嵌入影像1822a的區域中的多個像素資料的一座標轉換,並且一座標,例如是一質心座標,可用於此影像變形程序中。第十九圖是根據本揭露一實施例,說明影像變形處理中的一個三角形中的一個點的一質心座標轉換。令abc是由頂點a、b、以及c定義的一個三角形。三角形abc內一點p可以表示為αa +βb +γc ,其中,α、β、以及γ可以由每一個三角形的面積比率(area ratio)計算出,並且必須符合α +β +γ =1的條件。換句話說,點p和條件可以由下面的公式來表示。p=αa +βb +γc ,α=Aa /A,β=Ab /A,γ=Ac /A,α+β+γ=1,其中,Aa 是三角形bcp的面積,Ab 是三角形cap的面積,以及Ac 是三角形abp的面積,以及A是三角形abc的面積。The image deformation processing performed by the image warping unit 1824 may include a label conversion of a plurality of pixel data in an area of the transmission end communication data embedded image 1822a, and a label, such as a centroid coordinate, may be used for the image deformation program. in. The nineteenth embodiment is a centroid coordinate conversion of a point in a triangle in the image warping process according to an embodiment of the present disclosure. Let abc be a triangle defined by vertices a, b, and c. A point p in the triangle abc can be expressed as αa + βb + γc , wherein α, β, and γ can be calculated from the area ratio of each triangle, and must satisfy the condition of α + β + γ =1. In other words, the point p and the condition can be expressed by the following formula. p = αa + βb + γc , α = A a / A, β = A b / A, γ = A c / A, α + β + γ = 1, where A a is the area of the triangle bcp, and A b is The area of the triangle cap, and A c is the area of the triangle abp, and A is the area of the triangle abc.
基於此質心座標,第二十圖是根據本揭露一實施例,說明影像變形處理的運作。參考第二十圖,影像變形單元可將傳送端通訊資料嵌入影像1822a分割為幾個三角形,其中傳送端通訊資料嵌入影像1822a中的每一個三角形a'b'c'分別對應於接收端通訊資料嵌入影像1822b的一個三角形abc,並且計算相對應在每一個三角形a'b'c'中每一點p'的質心座標(α,β,γ)p' ,並且對於在傳送端通訊資料嵌入影像1822a的每一個三角形a'b'c'中每一點p',在接收端通訊資料嵌入影像1822b變形後,執行計算一相對應的點p=αa +βb +γc 的步驟2020。而對於在傳送端通訊資料嵌入影像1822a的每一個三角形a'b'c'的每一點p',影像變形單元還可執行一像素值插入步驟2030,來恢復p'的像素值,此插入的像素值是點p的周圍內被接收的像素的一像素值。執行傳送端通訊資料嵌入影像1822a的區域中點的質心座標轉換後,傳送端通訊資料嵌入影像1822a的像素值可藉由在影像變形處理中的接收端通訊資料嵌入式影像1822b中的像素值來恢復。Based on this centroid coordinate, the twentieth diagram illustrates the operation of the image warping process in accordance with an embodiment of the present disclosure. Referring to FIG. 20, the image deforming unit may divide the transmitting end communication data embedded image 1822a into several triangles, wherein each of the triangles a'b'c' of the transmitting end communication data embedded in the image 1822a respectively corresponds to the receiving end communication data. Embedding a triangle abc of the image 1822b, and calculating a centroid coordinate (α, β, γ) p' corresponding to each point p' in each triangle a'b'c ' , and embedding the image for the communication data at the transmitting end At each point p' of each triangle a'b'c' of 1822a, after the receiving end communication data embedding image 1822b is deformed, a step 2020 of calculating a corresponding point p = αa + βb + γc is performed. For each point p' of each triangle a'b'c' of the transmission end communication data embedded image 1822a, the image warping unit may also perform a pixel value insertion step 2030 to restore the pixel value of p', the inserted The pixel value is a pixel value of the pixel received within the periphery of point p. After performing the centroid coordinate conversion of the midpoint of the area of the transmission end communication data embedded in the image 1822a, the pixel value of the transmission end communication data embedded image 1822a can be obtained by the pixel value in the receiving end communication data embedded image 1822b in the image deformation processing. To recover.
第二十一圖是根據本揭露一實施例,說明資料擷取單元1826的運作。參考第二十一圖,資料擷取單元1826將變形的通訊資料嵌入影像1824b的多個資料從一第一空間表示法(例如一RGB表示法),轉換至一第二空間表示法(例如一YUV(或YCbCr)表示法)(步驟2110),再將第二空間表示法(例如YUV表示法)中變形的通訊資料嵌入影像中劃分為在一頻域中的多 個區塊,並且在此多個區塊中的每一區塊上執行一頻域轉換(例如離散餘弦轉換或小波轉換(wavelet transform))(步驟2120),以及擷取嵌入在一或多個頻率係數的位元,來決定通訊處理資料614a(步驟2130)。此通訊處理資料614a是藉由在一或多個頻率係數所擷取的位元上執行一種多數表決(majority voting)、解對應(demapping)或圖樣匹配(pattern matching)而決定的。此光通訊的接收裝置還可包括一接收端通訊資料處理單元,此接收端通訊資料處理單元可執行在接收裝置中一般的通訊資料處理,例如解調和錯誤修正以從所擷取的通訊處理資料中恢復通訊資料,並且輸出此恢復資料。The twenty-first figure illustrates the operation of the data capture unit 1826 in accordance with an embodiment of the present disclosure. Referring to the twenty-first figure, the data capture unit 1826 converts the plurality of data embedded in the image 1824b of the transformed communication data from a first spatial representation (eg, an RGB representation) to a second spatial representation (eg, a YUV (or YCbCr) notation) (step 2110), and then transform the transformed communication data embedded in the second spatial representation (such as YUV representation) into multiple images in a frequency domain. Blocks, and perform a frequency domain conversion (eg, discrete cosine transform or wavelet transform) on each of the plurality of blocks (step 2120), and capture embedded in one or more The bit of the frequency coefficient determines the communication processing data 614a (step 2130). The communication processing material 614a is determined by performing a majority voting, demapping, or pattern matching on the bits captured by the one or more frequency coefficients. The receiving device of the optical communication may further comprise a receiving end communication data processing unit, wherein the receiving end communication data processing unit may perform general communication data processing, such as demodulation and error correction, in the receiving device to process the data from the captured communication. Restore the communication data and output this recovery data.
依此,第二十二圖是根據本揭露一實施例,說明一種嵌入資料於光通訊中的接收方法。在第二十二圖中,嵌入資料於光通訊中的接收方法可在一影像感測裝置和一接收端通訊資料處理單元之間配置一影像變形單元和一資料擷取單元(步驟2210);藉由使用此影像感測裝置偵測一發光裝置傳送的一傳送端通訊資料嵌入影像,並且產生一接收端通訊資料嵌入影像(步驟2220);藉由使用此影像變形單元,在傳送端通訊資料嵌入影像上執行一影像變形處理,並且輸出一變形的通訊資料嵌入影像;以及藉由使用此資料擷取單元,從變形的通訊資料嵌入影像中擷取通訊處理資料(步驟2230)。Accordingly, the twenty-second figure is a method for receiving embedded data in optical communication according to an embodiment of the present disclosure. In the twenty-second figure, the receiving method for embedding the data in the optical communication may configure an image deforming unit and a data capturing unit between an image sensing device and a receiving end communication data processing unit (step 2210); Using the image sensing device to detect a transmitting end communication data embedded image transmitted by an illuminating device, and generating a receiving end communication data embedded image (step 2220); by using the image morphing unit, transmitting data at the transmitting end Performing an image morphing process on the embedded image, and outputting a transformed communication data embedded image; and using the data capturing unit to embed the communication processing data from the deformed communication data embedded image (step 2230).
對於嵌入一個展頻序列的通訊處理資料,此嵌入資料於光 通訊中的接收方法可執行一接收端通訊資料嵌入影像的一影像變形並且將變形的通訊資料嵌入影像的資料點從一RGB表示法轉換至一YUV表示法;對每一如8×8區塊可執行一DCT以及擷取每一區塊的一或多個頻率係數,並且可執行每一區塊的一序列匹配(sequence matching),以及作一群區塊的一種多數表決。被偵測到的通訊處理資料還可應用至一接收端通訊資料處理單元。For the communication processing data embedded in a spread spectrum sequence, the embedded data is in the light The receiving method in the communication can perform an image deformation of the embedded communication data embedded in the image and convert the deformed communication data into the image data point from an RGB representation to a YUV representation; for each block such as 8×8 A DCT can be performed and one or more frequency coefficients for each block can be retrieved, and a sequence matching of each block can be performed, as well as a majority vote for a group of blocks. The detected communication processing data can also be applied to a receiving communication data processing unit.
如上已經描述的,根據一實施例的光通訊系統可包含一傳送器以及一接收裝置。此傳送器可被配置為嵌入一通訊處理資料在原始影像的頻域轉換的一或多個頻率係數,以產生一通訊調變影像,在通訊調變後的影像上執行一逆轉換與一域轉換,以及藉由嵌入在原始影像中的多個RGB值,形成一通訊資料嵌入影像。此接收裝置可被配置為偵測一發光裝置所傳送的通訊資料嵌入影像,並且產生一接收端通訊資料嵌入影像,並執行一影像變形處理,藉由此接收端通訊資料嵌入影像來恢復傳送端通訊資料嵌入影像,並且從一變形的通訊資料嵌入影像中擷取此通訊處理資料。As has been described above, an optical communication system according to an embodiment may include a transmitter and a receiving device. The transmitter can be configured to embed one or more frequency coefficients of a communication processing data in a frequency domain of the original image to generate a communication modulated image, and perform an inverse conversion and a domain on the communication modulated image. Converting, and forming a communication data embedded image by embedding a plurality of RGB values in the original image. The receiving device can be configured to detect the embedded data of the communication data transmitted by the illuminating device, and generate a receiving end communication data embedded image, and perform an image morphing process, thereby recovering the transmitting end by embedding the communication data of the receiving end The communication data is embedded in the image, and the communication processing data is captured from a modified communication data embedded in the image.
此光通訊系統中的傳送器還可以包括一發光裝置驅動器來驅動發光裝置傳送此通訊資料嵌入影像。發射器還可包括一預先處理器,此預先處理器根據一外部指示器,在嵌入此通訊處理資料之前,執行一預先處理程序。如果此預先處理程序不 是必需的,則與RGB空間域的原始影像嵌入一RGB空間域的通訊調變影像來形成此通訊資料嵌入影像。The transmitter in the optical communication system may further include an illumination device driver for driving the illumination device to transmit the communication data embedded image. The transmitter may also include a pre-processor that executes a pre-processing procedure prior to embedding the communication processing material based on an external indicator. If this preprocessor is not It is necessary to embed an RGB spatial domain communication modulation image with the original image of the RGB spatial domain to form the communication data embedded image.
依此,根據一實施例,在一傳送器中,一光通訊方法可將一通訊處理資料嵌入在原始影像的頻域轉換的一或多個頻率係數,以產生一通訊調變影像,在通訊調變影像上執行一逆轉換和一域轉換,並且藉由嵌入在原始影像中的多個RGB值來形成一通訊資料嵌入影像。在一接收裝置中,此光通訊方法可偵測由一發光裝置傳送的此通訊資料嵌入影像,並且產生一接收端通訊資料嵌入影像,以及執行一影像變形處理,藉由此接收端通訊資料嵌入影像來恢復通訊資料嵌入影像,並且從一變形的通訊資料嵌入影像中擷取此通訊處理資料。According to an embodiment, in a transmitter, an optical communication method can embed a communication processing data in one or more frequency coefficients of a frequency domain conversion of an original image to generate a communication modulation image in communication. An inverse transform and a domain transform are performed on the modulated image, and a communication data embedded image is formed by a plurality of RGB values embedded in the original image. In a receiving device, the optical communication method can detect the embedded data transmitted by the illuminating device, and generate a receiving end communication data embedded image, and perform an image morphing process, thereby embedding the receiving end communication data The image is used to restore the communication data embedded image, and the communication processing data is captured from a transformed communication data embedded in the image.
在嵌入通訊處理資料之前執行一預先處理程序、形成通訊資料嵌入影像、執行影像變形處理、以來擷取通訊處理資料的細節已在前面實施例中描述,並且在此處被省略。Details of performing a pre-processing procedure, forming a communication material embedding image, performing image warping processing, and capturing communication processing data before embedding the communication processing material have been described in the foregoing embodiments, and are omitted herein.
綜上所述,本揭露實施例提供一種嵌入資料在光通訊中的裝置與方法以及光通訊系統和方法。此技術使用通訊處理資料的一資料嵌入技術,然後再應用此通訊處理資料至發光裝置驅動器或影像/視訊顯示驅動器。而不是以現有的光通訊技術直接將通訊處理資料應用至發光裝置驅動器。當光通訊被執行時,本揭露實施例將此通訊處理資料嵌入至影像或視訊的空間 域中頻率係數對眼睛的不敏感部分。所以,本揭露實施例可同時執行影像或視訊顯示以及光通訊。In summary, the disclosed embodiments provide an apparatus and method for embedding data in optical communication, and an optical communication system and method. This technology uses a data embedding technique for communication processing data, which is then applied to the illuminator driver or video/video display driver. Rather than applying the communication processing data directly to the illuminator driver using existing optical communication technology. When the optical communication is performed, the disclosed embodiment embeds the communication processing data into the space of the image or video The frequency coefficient in the domain is insensitive to the eye. Therefore, the disclosed embodiments can simultaneously perform image or video display and optical communication.
以上所述者僅為本揭露實施例,當不能依此限定本揭露實施之範圍。即舉凡本發明申請專利範圍所作之均等變化與修飾,皆應仍屬本發明專利涵蓋之範圍。The above is only the embodiment of the disclosure, and the scope of the disclosure is not limited thereto. All changes and modifications made to the scope of the present invention should remain within the scope of the present invention.
610‧‧‧傳送端裝置610‧‧‧Transport device
620‧‧‧接收端裝置620‧‧‧ receiving device
612a‧‧‧通訊輸入資料612a‧‧‧Communication input data
612‧‧‧傳送端通訊資料處理單元612‧‧‧Transport communication data processing unit
614a‧‧‧通訊處理資料614a‧‧‧Communication processing data
614b‧‧‧原始影像614b‧‧‧ original image
614c‧‧‧外部指示器614c‧‧‧External indicator
614‧‧‧資料嵌入單元614‧‧‧Data embedding unit
616‧‧‧發光裝置驅動器616‧‧‧Lighting device driver
618‧‧‧發光裝置618‧‧‧Lighting device
618b‧‧‧通訊資料嵌入影像618b‧‧‧Communication data embedded in images
622‧‧‧影像感測裝置622‧‧‧Image sensing device
624‧‧‧影像變形單元624‧‧‧Image Deformation Unit
626‧‧‧資料擷取單元626‧‧‧Information acquisition unit
628‧‧‧接收端通訊資料處理單元628‧‧‧Receiver communication data processing unit
Claims (40)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW101149574A TWI470947B (en) | 2012-12-24 | 2012-12-24 | Apparatus and method for data embedding in light communication and the light communication system and method thereof |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW101149574A TWI470947B (en) | 2012-12-24 | 2012-12-24 | Apparatus and method for data embedding in light communication and the light communication system and method thereof |
Publications (2)
Publication Number | Publication Date |
---|---|
TW201427305A TW201427305A (en) | 2014-07-01 |
TWI470947B true TWI470947B (en) | 2015-01-21 |
Family
ID=51725782
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW101149574A TWI470947B (en) | 2012-12-24 | 2012-12-24 | Apparatus and method for data embedding in light communication and the light communication system and method thereof |
Country Status (1)
Country | Link |
---|---|
TW (1) | TWI470947B (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9905725B2 (en) | 2015-07-15 | 2018-02-27 | Southern Taiwan University Of Science And Technology | Light emitting diode and data transmission and reception apparatus |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TWI586178B (en) * | 2014-12-05 | 2017-06-01 | 吳槐桂 | Data broadcasting system using visible light, signal transmitting apparatus and apparatus for receiving visible light |
TWI620420B (en) * | 2016-12-02 | 2018-04-01 | 財團法人資訊工業策進會 | Visible light communication system and method |
TWI686061B (en) * | 2017-07-07 | 2020-02-21 | 張清亮 | Wireless optical communication method for realizing image encryption and decryption |
TWI674772B (en) * | 2018-03-02 | 2019-10-11 | 和碩聯合科技股份有限公司 | Correction method for photoelectric transmission power |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7127079B2 (en) * | 2000-12-07 | 2006-10-24 | Sony United Kingdom Limited | Image processing apparatus |
TWI280049B (en) * | 2004-04-16 | 2007-04-21 | Sharp Kk | Image processing apparatus, image processing method, and recording medium storing program for processing image |
CN1965509A (en) * | 2004-06-10 | 2007-05-16 | 株式会社藤仓 | Optical communication apparatus and optical communication system |
WO2010099738A1 (en) * | 2009-03-03 | 2010-09-10 | Gu Zecang | Method for embedding and identifying information in print image |
-
2012
- 2012-12-24 TW TW101149574A patent/TWI470947B/en active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7127079B2 (en) * | 2000-12-07 | 2006-10-24 | Sony United Kingdom Limited | Image processing apparatus |
TWI280049B (en) * | 2004-04-16 | 2007-04-21 | Sharp Kk | Image processing apparatus, image processing method, and recording medium storing program for processing image |
CN1965509A (en) * | 2004-06-10 | 2007-05-16 | 株式会社藤仓 | Optical communication apparatus and optical communication system |
WO2010099738A1 (en) * | 2009-03-03 | 2010-09-10 | Gu Zecang | Method for embedding and identifying information in print image |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9905725B2 (en) | 2015-07-15 | 2018-02-27 | Southern Taiwan University Of Science And Technology | Light emitting diode and data transmission and reception apparatus |
Also Published As
Publication number | Publication date |
---|---|
TW201427305A (en) | 2014-07-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8942571B2 (en) | Apparatus and method for data embedding in light communication and the light communication system and method thereof | |
TWI470947B (en) | Apparatus and method for data embedding in light communication and the light communication system and method thereof | |
Le et al. | A survey of design and implementation for optical camera communication | |
US10432818B2 (en) | Sparse modulation for robust signaling and synchronization | |
US11756148B2 (en) | Signal encoding for difficult environments | |
US10304149B2 (en) | Signal encoding for difficult environments | |
Perli et al. | PixNet: Interference-free wireless links using LCD-camera pairs | |
CN104081753B (en) | The most flash visible light communication system, dispensing device, reception device and communication means | |
US9450671B2 (en) | Transmitting and receiving apparatus and method for light communication, and the light communication system thereof | |
US10218440B2 (en) | Method for visible light communication using display colors and pattern types of display | |
US11798116B2 (en) | Signal encoding based on spectral requirements | |
US20180159624A1 (en) | Image sensor communication system and communication method using rolling shutter modulation | |
CN102750660A (en) | Method and device for embedding and extracting digital watermarking | |
US10559052B1 (en) | Signal encoding for physical objects including dark ink | |
CN104410845B (en) | Optic communication sending method and device, method of reseptance and device, optical communication system | |
CN1513256A (en) | Embedding color profiles in raster image data using data hiding techniques | |
KR102270371B1 (en) | MIMO-OFDM of Optical Wireless System Using Screen | |
CN105933710A (en) | Information transmission method and information transmission system | |
US10944923B2 (en) | Code division compression for array cameras | |
KR20120067268A (en) | Apparatus and method for transmitting and receiving using visible light communication | |
Penubaku et al. | An attempt to transfer information using light as a medium and camera as receiver | |
CN110649966B (en) | Method for realizing near-distance optical communication based on visible light and mobile phone camera imaging characteristics | |
CN114677956B (en) | Long-distance real-time display camera communication system and method | |
US20070297684A1 (en) | Data Conversion Apparatus, Data Conversion Method, and Data Conversion System | |
Kim et al. | Color Barcode Detection of Complementary Color Barcode-based Optical Camera Communications with a Deep Neural Network |