TW201427305A - Apparatus and method for data embedding in light communication and the light communication system and method thereof - Google Patents

Abstract

In a light communication system, a data embedding unit arranged between a transmitter-side communication data processing unit and a light emitting device driver embeds a communication processed data at a spatial domain of an original image according to a modulation scheme, and gets multiple RGB values for a communication data embedded image. A receiving apparatus detects a transmitter-side communication data embedded image, generates a receiver-side communication data embedded image, compensate a deformation of the receiver-side communication data embedded image, outputs a warped communication data embedded image, and extracts a communication processed data from the warped communication data embedded image.

Description

Apparatus and method for embedding optical communication data, and optical communication system and method

The disclosure relates to an apparatus and method for embedding optical communication data, and an optical communication system and method.

Optical communication is a wireless communication technology that uses human visible light frequencies between 400 THz and 800 THz. Radio Frequency bandwidth (RF bandwidth) is a rare resource. Therefore, visible light communication can provide an alternative to wireless communication to meet strong demand. For example, visible light emitted from one or more Light Emitting Diodes (LEDs) is widely used in homes and offices, thus making visible light from one or more LEDs suitable for ubiquitous data transmitters. The first A and the first B are examples of two types of white LEDs. As shown in FIG. A, an example of a white LED uses a blue LED 110 and a yellow phosphor 115. The yellow phosphor 115 limits the modulation bandwidth to no more than About 10 Mbps. As shown in FIG. B, another example of a white LED uses a red, green, and blue triplet (RGB triplet), which may include a blue LED 121, a red LED 122, and a green LED 123, and the three LEDs are respectively issued. Blue light 131, red light 132, and green light 133. This RGB triplet provides a higher bandwidth than the white LED of Figure A, and the triplet mixture produces any desired color via any combination of blue, red, and green. Therefore, an RGB triplet LED array can simultaneously serve as a high-bit-rate data transmitter and a lighting device.

A second diagram is an exemplary diagram of a general transmitter of an RGB triplet LED using a single input data stream 212. In transmitter 200, a single input data stream 212 is received by an error correction encoder 214, and the output of a modulator 216 is applied directly to a triplet LED driver 218. The output powers P _R , P _G , and P _B of the three primary colors (i.e., red, green, and blue) are generated by the triplet LED driver 218. The second B diagram is an example of the output of a modulator utilizing an on-off keying modulation method. The bit stream output by the modulator 216 is distributed to the triplet LED, wherein R, G, and B represent three strings of three primary colors, respectively. The second C diagram is an example of the output power of this triplet LED driver.

The third A picture is a RGB triplet LED using multiple input data. An exemplary schematic diagram of a Wavelength Division Multiplexing (WDM) transmitter 300. In the transmitter 300, each of the plurality of input materials, such as the input data 0, the input data 1, and the input data 2, each has a separate error correction encoder and modulator. The outputs of the three modulators are directly coupled to the three LED drivers. Figure 3B is an example of the output power of a triplet LED driver.

The fourth figure is an example schematic diagram of a Visible Light Communication (VLC) technology. As shown in the fourth figure, a VLC device can include a transmitting device 410 and a receiving device 420. The transmitting end device 410 for transmitting one or more communication materials (for example, data 1, data 2, data 3, etc.) includes an illuminator 412 for generating illumination light; a traffic adjustment (communication amount adjuster) 413; and a modulator 411. The traffic conditioner 413 receives each communication data signal of one or more communication data signals and generates a corresponding virtual data for each respective light source of one or more respective light sources (dummy) Data), as such, the data transmitted via each source has equal amount of communication. The modulator 411 tunes each received communication data signal and the received virtual data into a driving signal for each of the plurality of light sources.

The fifth figure is an exemplary diagram of a data transfer device using visible light communication. As shown in the fifth figure, the data transfer device 510 can include a code generator 512, a code modulation unit 514, a plurality of LEDs 518, and a light source driver 516. The code generator 512 converts the transmitted data into a two-dimensional data code 520 having different colors and patterns according to the times T ₀ , T ₁ , ..., T _N-1 , T _N . The code modulation unit 514 modulates the two-dimensional data to generate a modulated signal. The plurality of LEDs 518 are arranged in a two-dimensional form and emit light. Light source driver 516 controls the conduction of LED 518 based on the modulated signal.

As can be seen from the above technique, if the output of the modulator or modulation unit is directly applied to the LED driver, the energy distributions corresponding to the three primary colors may be different from each other. Therefore, there may be cases where it is not necessary to adjust the color. Also, when the transmitter simultaneously functions as a lighting device, the brightness that changes with time may be sensed by the human eye. Optical communications remains a potential solution to the global wireless spectrum shortage. Recommendations for various solutions for visible light communication technology have been proposed. In these solutions, there are still various challenges in using a device to simultaneously perform image or video display and optical communication.

As can be seen from the above technique, if the output of the modulator or modulation unit is directly applied to the LED driver, the energy distributions corresponding to the three primary colors may be different from each other. Therefore, there may be cases where it is not necessary to adjust the color. Also, when the transmitter simultaneously functions as a lighting device, the brightness that changes with time may be sensed by the human eye. Optical communications remains a potential solution to the global wireless spectrum shortage. Recommendations for various solutions for visible light communication technology have been proposed. In these solutions In the solution, there are still various challenges in using a device to simultaneously perform image or video display and optical communication.

The disclosed embodiments can provide an apparatus and method for embedding optical communication data, and an optical communication system and method.

An embodiment of the present disclosure is directed to a device for embedding data in optical communication, adapted to a transmitter. The device may include a data embedding unit arranged between a transmitting communication data processing unit and a light emitting device driver in the transmitter, wherein the data embedding unit is based on a The modulation method embeds a communication processed data in a spatial domain of an original image, and obtains a plurality of red, green, and blue (RGB) values of a communication data embedded image. .

Another embodiment of the present disclosure is directed to a method of embedding data in optical communication adapted to a transmitter. The method comprises: arranging a data embedding unit between a transmitting end communication data processing unit and an illuminating device driver in the transmitter; using the data embedding unit to embed a communication processing data in a space according to a modulation method a domain to generate a communication modulated image; and performing an inverse transform and a domain transform, the domain transforms the communication modulated image from a frequency domain Convert to this spatial domain and get multiple red, green and blue (RGB) values embedded in a communication data.

Yet another embodiment of the present disclosure is directed to a receiving device for embedding data in optical communication. The receiving device can include an image sensing device, an image warping unit, and a data extraction unit. The image sensing device detects a transmitter-side communication data embedded image transmitted by an illumination device, and generates a receiver-side communication data embedded image. The image warping unit compensates for a deformation of the image embedded in the receiver communication data by performing image warping processing of the embedded communication data embedded image, and outputs a warped communication. The data is embedded in the image. The data acquisition unit embeds an image from the transformed communication data to retrieve a communication processing data.

Yet another embodiment of the present disclosure is directed to a method of receiving embedded data in optical communication. The receiving method may include: configuring an image deforming unit and a data capturing unit between an image sensing device and a receiving end communication data processing unit; and using the image sensing device to detect a transmitted by a light emitting device The transmitting end communication data is embedded in the image, and a receiving end communication data is embedded in the image; the image deforming unit is used to perform an image deformation processing on the transmitting end communication data embedded image, and output a deformed communication data embedded image; and use the image Data capture unit, from which the transformed communication data is embedded in the image to capture a communication Processing data.

Yet another embodiment of the present disclosure is directed to an optical communication system. The optical communication system can include a transmitter and a receiving device, the transmitter embedding a frequency coefficient of a frequency domain transform of the communication processing data in an original image, and executing An inverse conversion and a domain conversion of a communication modulated image, and a communication data embedded image formed by embedding a plurality of red, green, and blue (RGB) values in the original image. The receiving device detects the embedded data transmitted by the illuminating device and generates a receiving end (the communication data is embedded in the image, and the receiving end communication data is embedded in the image to perform an image morphing process to restore the communication data embedded image. And embedding the image from a transformed communication data to retrieve the communication processing data.

Yet another embodiment of the present disclosure is directed to an optical communication method. The optical communication method may include: embedding a communication processing data in a frequency domain to convert one or more frequency coefficients of a original image in a transmitter, performing an inverse conversion and a domain conversion of a communication modulated image, And forming a communication data embedded image by embedding a plurality of red, green and blue (RGR) values in the original image; and detecting, in a receiving device, the communication data transmitted by the light emitting device to embed the image, and generating a receiving end The communication data is embedded in the image, and the communication data embedded in the receiving end is used to perform an image deformation processing to restore the embedded data of the communication data, and the communication processing data is captured from a modified communication data.

The above and other advantages of the present invention will be described in detail below with reference to the following drawings, detailed description of the embodiments, and claims.

110‧‧‧Blue LED

115‧‧‧Yellow phosphor

121‧‧‧Blue LED

122‧‧‧Red LED

123‧‧‧Green

LED 131‧‧‧Blue

132‧‧‧Red light

133‧‧‧Green light

LED‧‧‧Light Emitting Diode

212‧‧‧ Input data stream

214‧‧‧Error Correction Encoder

216‧‧‧ modulator

218‧‧‧ Triplet LED Driver

Three-string stream of R, G, B‧‧‧ three primary colors

P _R , P _G , P _B ‧‧‧ output power of three primary colors

410‧‧‧Transport device

420‧‧‧ receiving device

411‧‧‧Transformer

413‧‧‧Communication regulator

412‧‧‧Red Light Blue Light Green

510‧‧‧ data transfer device

520‧‧‧2D data code

512‧‧‧Code Generator

514‧‧‧Modulation unit

516‧‧‧Light source driver

518‧‧‧LED

610‧‧‧Transport device

620‧‧‧ receiving device

612a‧‧‧Communication input data

612‧‧‧Transport communication data processing unit

614a‧‧‧Communication processing data

614b‧‧‧ original image

614c‧‧‧External indicator

614‧‧‧Data embedding unit

616‧‧‧Lighting device driver

618‧‧‧Lighting device

618b‧‧‧Communication data embedded in images

622‧‧‧Image sensing device

624‧‧‧Image Deformation Unit

626‧‧‧Information acquisition unit

628‧‧‧Receiver communication data processing unit

720‧‧‧Incorporating communication processed data into one or more frequency coefficients in a frequency domain conversion of the original image

722‧‧‧Communication modulation image

730‧‧‧Converting communication modulated images from frequency domain to spatial domain

732‧‧‧RGB values

RGB‧‧‧ three primary colors

810‧‧‧Preprocessor

812‧‧‧Pre-processing procedures

910‧‧‧RGB to YUV conversion

920‧‧‧Discrete cosine transform

930‧‧‧ Frequency factor of any combination of Y, U, and V parts embedded

940‧‧‧anti-discrete cosine transform

950‧‧‧YUV to RGB conversion

912‧‧‧Pixel array of original images

922‧‧‧Pixel array of YUV domain

924‧‧‧Pixel array of communication modulated images

932‧‧‧Three pixel arrays of frequency coefficients that have been embedded in communication processing data in a spatial domain

952‧‧‧RGB values

b ₀₀ , b ₀₁ ,...,b ₁₃ ‧‧‧ binary bit stream

Y ₀ , Y ₁ ‧‧‧Two Y components of a discrete cosine transform result of time 0 and 1

{b ₀₀ ,b ₀₁ ,...,b ₁₇ }‧‧‧Communication processing data

QPSK‧‧‧ four-phase phase shift key

BPSK‧‧‧biphase phase shift key

1510‧‧‧Communication modulation image

1520‧‧‧Communication data embedded in images

1620‧‧‧Communication data embedded in images (RGB spatial domain)

1710‧‧‧ Arranging a data embedding unit between a transmitting communication data processing unit and a lighting device driver in the transmitter

1720‧‧‧ By using the data embedding unit, a communication processing data is embedded in one or more frequency coefficients in a frequency domain of an original image according to a modulation method to generate a communication modulation image

1730‧‧‧ Performing an inverse conversion and a domain conversion, converting the communication modulated image from a frequency domain to a spatial domain, and obtaining a plurality of RGB values of a communication data embedded image

1822‧‧‧Image sensing device

1822a‧‧‧Transport communication data embedded in images

1822b‧‧‧ Receiver communication data embedded in the image

1824b‧‧‧Transformed communication data embedded in images

1828‧‧‧Communication data processing

1824‧‧•Image Deformation Unit

1826‧‧‧Information acquisition unit

1800‧‧‧ receiving device

2020‧‧‧Steps to calculate a corresponding point p= αa + βb + γc

2030‧‧‧ pixel value insertion step

2110‧‧‧Converting a plurality of data embedded in a deformed communication data from a first spatial representation to a second spatial representation

2120‧‧‧ Dividing the transformed communication data embedded in the second spatial representation into a plurality of blocks in a frequency domain, and performing a frequency domain conversion on each of the plurality of blocks

2130‧‧‧Draw a bit embedded in one or more frequency coefficients to determine the communication processing data

2210‧‧ An image deformation unit and a data acquisition unit are disposed between an image sensing device and a receiving communication data processing unit

2220‧‧. Using the image sensing device to detect a transmission communication data embedded in a transmitting device, and generating a receiving communication data embedded image

2230‧‧‧ by using the image warping unit, performing an image warping process on the transmitting end communication data embedded image, and outputting a deformed communication data embedded image; and using the data capturing unit to transform the communication Data embedded in the image to capture communication processing data

The first A and the first B are examples of two types of white LEDs.

Figure 2A is a schematic illustration of a general transmitter of an RGB triplet LED using a single input stream.

The second B diagram is an example of the output of a modulator utilizing an on-off keying modulation method.

The second C diagram is an example of the output power of this triplet LED driver.

Figure 3A is a schematic illustration of a wavelength division multiplexed transmitter of RGB triplet LEDs using multiple input data.

Figure 3B is an example of the output power of a triplet LED driver.

The fourth figure is a schematic diagram of an example of visible light communication technology.

The fifth figure is an exemplary diagram of a data transfer device using visible light communication.

The sixth figure illustrates a visible light communication system according to an embodiment of the present disclosure.

The seventh figure is a device for embedding data in optical communication according to an embodiment of the present disclosure, which is adapted to a transmitter.

The eighth figure is a device for embedding data in optical communication according to an embodiment of the present disclosure, the device comprising a pre-processor.

The ninth figure illustrates the operation of the apparatus for embedding data in optical communication using an original input image as an example in accordance with an embodiment of the present disclosure.

The tenth figure is a first example of communication processing data embedded by a Binary Phase Shift Keying (BPSK) modulation method according to an embodiment of the present disclosure.

The eleventh figure is a second example of communication processing data embedded in a BPSK modulation method according to an embodiment of the present disclosure.

Figure 12 is a third example of communication processing data embedded by a Quadrature Phase Shift Keying (QPSK) modulation method according to an embodiment of the present disclosure.

A thirteenth diagram is a fourth example of communication processing data embedded by a hybrid BPSK and QPSK modulation method according to an embodiment of the present disclosure.

The fourteenth embodiment is a fifth example of communication processing data embedded in a spread spectrum sequence modulation method according to an embodiment of the present disclosure.

The fifteenth figure illustrates the embedding of the communication modulated image and the original image in a YUV spatial domain according to an embodiment of the present disclosure.

FIG. 16 is a diagram illustrating embedding a communication modulated image and an original image in an RGB spatial domain according to an embodiment of the present disclosure.

Figure 17 is a diagram illustrating a method of embedding data in optical communication according to an embodiment of the present disclosure, adapted to a transmitter.

Figure 18 is a diagram showing a receiving device for embedding data in optical communication according to an embodiment of the present disclosure.

FIG. 19 is a diagram showing a barycentric coordinate conversion of a point in a triangle in image deformation processing according to an embodiment of the present disclosure.

Figure 20 is a diagram illustrating the operation of image warping processing in accordance with an embodiment of the present disclosure.

The twenty-first figure illustrates the operation of the data capture unit in accordance with an embodiment of the present disclosure.

The twenty-second figure is a method for receiving embedded data in optical communication according to an embodiment of the present disclosure.

The disclosed embodiments provide a technique for embedding data in optical communication to simultaneously perform image or video display and optical communication. The technology first uses a data embedding technique for communication processing data, and then applies the communication processing data to the illuminating device driver or the video/video display driver instead of directly applying the communication processing data to the illuminating device driver such as the LED driver. When the optical communication is performed, the disclosed embodiment embeds the communication processing data into a portion of the spatial domain of the video or video that is not sensitive to the eyes.

As shown in the sixth figure, an optical communication system 600 according to an embodiment of the present disclosure may include a transmitting end device 610 and a receiving end device 620. The transmitting end device 610 can include a transmitting end communication data processing unit 612, a data embedding unit 614, a lighting device driver 616, and a lighting device 618. The transmit end communication data processing unit 612 can perform a signal processing of the communication input data 612a. The data embedding unit 614 can embed the communication processing data 614a in a frequency domain converted one or more frequency coefficients of an original image 614b according to a modulation encoding method. Before embedding communication processing data 614a, An external indicator 614c can be used to indicate whether a pre-processing procedure is to be performed. The external indicator 614c can be generated by a software module or a hardware component. The illumination device driver 616 can drive the illumination device 618 based on the output data processed by the data embedding unit 614.

The receiving device 620 can include an image sensing device 622, an image deforming unit 624, a data capturing unit 626, and a receiving end communication data processing unit 628. The image sensing device 622 can detect a communication data embedded image 618b transmitted from the light emitting device 618 via a channel. The image warping unit 624 can perform an image warping function to compensate for deformation of a sensed image from the image sensing unit 622. The data capture unit 626 can retrieve the communication processing data 614a output from the image warping unit 624. The receiving end communication data processing unit 628 performs common communication material processing, such as demodulation and error correction, to recover the communication input data 612a from the communication processing data 614a retrieved by the data retrieval unit 626.

As mentioned in the sixth figure, the transmitting end communication data processing unit can perform common communication signal processing, such as error correction encoding and modulation, in the transmitting end device to generate communication processing data. The communication processing data may be, but not limited to, a bit stream of a stream of signals, such as a real imaginary pair (I/Q pair). The seventh figure is a device for embedding data in optical communication according to an embodiment of the present disclosure, which is adapted to a transmitter. Referring to the seventh figure, the device embedded in the optical communication may include a data embedding unit 614, which is Arranged between the transmitting end communication data processing unit 612 and the lighting device driver 616. The data embedding unit 614 may embed the communication processed data 614a in a frequency domain conversion of the original image 614b, such as one or more frequency coefficients of a discrete cosine transform (DCT), according to the modulation method (step 720). The original image 614b without embedded communication data may be a still image or a frame in a video sequence. After embedding one or more frequency coefficients of a frequency domain conversion, the data embedding unit performs a domain transform, such as inverse DCT (Inverse DCT, IDCT), to convert the communication modulated image from the frequency domain to a spatial domain ( Step 730), and obtaining a plurality of RGB values 732 of the communication data embedded image 618b, for example, by converting luminance and chrominance signals into RGB signals.

In other words, the data embedding unit 614 can generate a communication modulation image 722 and obtain a plurality of RGB values of the communication data embedded image. The data embedding unit may embed the communication processing data by inserting one or more pictures of one or more image intensities of the plurality of original pictures in the original image. The one or more pictures that are inserted are modulated by one or more intensities of one or more partial images of different regions in the original image.

The data embedding unit may generate a communication modulated image by embedding the communication processing data in one or more frequency coefficients of a frequency domain conversion of the original image. The data embedding unit can embed the communication modulation image in the frequency domain of the original image, perform frequency domain conversion, and convert multiple brightness and chrominance data into multiple RGB values to generate communication data embedded in the image. Alternatively, the data embedding unit may perform a domain conversion to convert the communication modulated image from a frequency domain to an RGB spatial domain, and convert the plurality of derived luminance and chrominance data into a plurality of RGB values. And generating the communication data embedded image by embedding a plurality of RGB values into the original image. Alternatively, the data embedding unit may perform a domain conversion to convert the communication modulated image from a frequency domain to a spatial domain, and embed a conversion result in the original image, and embed a data into the image (data embcdded Image) A plurality of derived luminance and chrominance data are converted into a plurality of RGB values to generate an embedded image of the communication data.

Prior to embedding the communication processing material, the device embedded in the optical communication can perform a pre-processing procedure based on the external indicator 614c. For example, the pre-processing program can include converting the pixel array 614b of the original image from a first domain, such as an RGB domain, to a second domain, such as a YUV (or YCbCr) domain, and performing pixel arrays in the YUV domain. DCT. The external indicator 614c indicates whether or not to execute this pre-processing procedure. The external indicator can be generated by a software module or a hardware component. The data embedding unit may embed the communication processing data into one or more predetermined frequency coefficients of the original image, such as discrete cosine transform (DCT). The illuminator driver drives the illuminating device based on signals processed by the data embedding unit. The output of the illumination device 618 in the transmitter is a communication data embedded image to be transmitted by the optical communication.

Accordingly, as shown in an embodiment of the eighth figure, the embedded data of the seventh figure is in the light. The device in communication may also include a pre-processor 810 configured to execute a pre-processing program 812 prior to embedding the communication processing material based on the external indicator 614c. After executing the pre-processing procedure, the data embedding unit 614 embeds one or more frequency coefficients of the communication processing material 614 in the spatial domain (eg, performing steps 720 and 730), and obtains a plurality of RGB values 732 of the communication material embedded image 618b. .

The ninth figure illustrates the operation of the apparatus for embedding data in optical communication using an original input image as an example in accordance with an embodiment of the present disclosure. In the present embodiment, the original input image is composed of an 8 x 8 RGB pixel array 912. When the external indicator 614c indicates that this pre-processing should be performed, the pre-processor 810 performs a pre-processing procedure, such as converting the pixel array 912 of the original image from one RGB domain to another, for example, prior to embedding the communication processing material. A YUV (or YCbCr) domain (i.e., step 910 of RGB to YUV conversion) is used to generate a pixel array 922 of the YUV (or YCbCr) domain, and a DCT is performed on the pixel array in the YUV domain 922 (ie, step 920), After the DCT is executed, a pixel array 924 of communication modulated images is generated. The external indicator 614c can be generated by using a software programming register or a hardware component.

The data embedding unit 614 may embed the communication processing data 614a in one or more frequency coefficients of any combination of the Y, U, and V portions of the DCT block according to a modulation coding method (ie, in step 930, embedding Y, U. And part V Any combination of frequency coefficients), in turn, produces, for example, three pixel arrays 932 of frequency coefficients that have been embedded in communication processing data 614a in a spatial domain. The data embedding unit 614 can remove the coefficients of the original input image and add at least one value according to the communication processing data 614a and the modulation type. The data embedding unit 614 can perform an inverse discrete cosine transform (IDCT) (ie, step 940) to restore the pixel array 922, and a YUV (YCbCr) to RGB conversion (ie, step 950) to sequentially acquire a communication data embedded image. Multiple RGB values of 952. In this example, the communication material embedded image 932 is formed by embedding the resulting RGB values 952 into the 8x8 RGB pixel array 912, and the communication material embedded image 932 is transmitted by the transmitter. The RGB value 952 will be applied to an illumination device driver that drives the illumination device to output a communication data embedded image.

The communication processing data is embedded by appropriately selecting one or more frequency coefficients, such as, but not limited to, low and medium frequency coefficients, and the human eye may not sense the distortion after embedding the communication processing data. . The following example illustrates some ways to embed communication processing data. The tenth figure is a first example of embedding communication processing data in a two-phase phase shift key (BPSK) modulation method according to an embodiment of the present disclosure. In the example of the tenth figure, an image is, for example, but not limited to, composed of a plurality of 8×8 pixel arrays, and each of the plurality of DCT blocks has a size of 8×8. The communication processing data is a binarv bit stream represented by {b ₀₀ , b ₀₁ , ..., b ₁₃ }, where b _ij represents the jth embedded in an i-th picture Bit. Let Y ₀ and Y ₁ represent the two Y components of a DCT result at times 0 and 1, respectively. Let {f _i0 ,f _i1 ,...,f _i(N-1) } be the N frequency coefficients embedded in the communication processing data, where N is the number of frequency coefficients in each DCT block. For this BPSK modulation method, the values of these f _i0 , f _i1 , . . . , f _i(N-1) are set to f _i0 =f _i1 =...=f _i according to the input bit of the communication processing data. _N-1) = +m or f _i0 = f _i1 =...=f _i(N-1) = -m. In the example of the tenth figure, three frequency coefficients respectively marked by three diagonal squares are used to embed the communication processing data in the BPSK modulation method. In this case, N=3 and m=4. The 12 low and medium frequency coefficients of the 1st row on the 4 DCT blocks are set to -4 or 4 according to the value of B ₀₀ , and the 4 DCTs The 12 low and medium frequency coefficients of the second row on the block are set to the value of b ₀₁ , and so on.

The eleventh figure is a second example of interleaving embedded communication processing data in a BPSK modulation method according to an embodiment of the present disclosure. In the example of the eleventh figure, the communication processing data {b ₀₀ , b ₀₁ , ..., b ₁₇ } are interleaved in the low and medium frequency coefficients of the DCT block by the BPSK modulation method. When the input bit value of the communication processing data is 1, the low and medium frequency coefficients (represented by a slanted square) of the associated DCT block are set to 4, otherwise, the coefficient is set to -4. In this example, the six low and medium frequency coefficients of the two DCT blocks on the first row are set according to the value of b ₀₀ , and the six other DCT blocks on the first row are low. The sum frequency coefficient is set according to the value of b ₀₁ , and so on.

Figure 12 is a third example of embedding communication processing data in a QPSK modulation method according to an embodiment of the present disclosure. In this example, each of the plurality of DCT blocks has a size of 8 x 8, and each small square represents a coefficient in a DCT block. The communication processing data is composed of QPSK symbols. {f _{i0_00} , f _{i1_00} ,...,f _{(N-1)_00} }, {f _{i0_01} , f _{i1_01} ,...,f _{(N-1)_01} }, {f _{i0_10} ,f _{i1_10} ,...,f _{(N-1 )_10} }, and {f _{i0_11} , f _{i1_11} ,...,f _{(N-1)_11} } are respectively 4 QPSK symbols, ie 00, 01, 10, and 11, N in each DCT block Frequency coefficients, where N is the number of frequency coefficients in each DCT block. In the example of the twelfth figure, N=3. When the QPSK symbols in the communication processing data are 00, 01, 10, and 11, the neutral and low frequency coefficients (represented by slanted squares) of a corresponding DCT block are respectively {-4, -4, -4} , {-4, 4, 4}, {4, -4, -4}, and {4, 4, 4} are replaced.

A thirteenth diagram is a fourth example of communication processing data embedded by a hybrid BPSK and QPSK modulation method according to an embodiment of the present disclosure. In this example, the size of the pixel array and the DCT block are both 8x8, and the two modulation methods are mixed in one block. When received from an image sensing device, the intermediate frequency coefficients are more reliable than those with higher frequency coefficients because an image may be subject to noise and geometric distortion. Therefore, the communication processing data can be embedded in a higher frequency coefficient that emphasizes the variable method, and an intermediate frequency coefficient embedded in a weaker modulation method. In this example, the communication processing data is embedded in the medium frequency coefficient with QPSK modulation, and is embedded in the high frequency coefficient with BPSK modulation.

The fourteenth embodiment is a fifth example of embedding communication processing data in a spread spectrum sequence modulation method according to an embodiment of the present disclosure. In this example, the size of the pixel array and DCT block are both 8x8. The communication processing data is represented by a binary bit stream. Let {f _{i0_0} , f _{i1_0} ,...,f _{(N-1)_0} } and {f _{i0_1} ,f _{i1_1} ,...,f _{(N-1)_1} } be used to embed each of bit 0 and bit 1, respectively. N frequency coefficients of a DCT block, where N is the number of frequency coefficients per DCT block, and the values of these f _{i_j} may be different. In the example of Fig. 14, N = 28, and communication processing data having a bit value of 0 is embedded into a frequency coefficient in a spread spectrum pattern (sequence) 1410, and communication processing with a bit value of 1 The data is embedded into a frequency coefficient in a spread spectrum pattern (sequence) 1420. Different combinations of these frequency coefficients can be used to represent this spread spectrum coding. The receiver can take the coefficients in the frequency domain and use them as input signals, and calculate the correlation of the two spreading sequences to recover the communication processing data. For example, when the correlation between an input signal and a sequence having a value of 0 is greater than the correlation between an input signal and a sequence having a value of 1, the spreading code is 0, otherwise the spreading code is 1.

In the transmitter, there are many different ways to embed communication processing data into the original image. The fifteenth and sixteenth figures illustrate two examples, respectively. The fifteenth figure illustrates the embedding of the communication modulated image and the original image in a YUV spatial domain according to an embodiment of the present disclosure. In the fifteenth example, before embedding the communication processing data, the pre-processor, for example, an RGB to YUV conversion 910, can convert the pixel array of the original image from a first spatial domain, such as an RGB domain, to A second spatial domain, such as a YUV (or YCbCr) domain. After performing this pre-processing, the data embedding unit 614 can embed the communication processing data in the frequency domain according to a modulation method, for example, embedded in the Y, U, and V parts. The combined frequency coefficient, labeled 930, produces a communication modulated image 1510 with embedded frequency coefficients and performs an IDCT conversion. The data embedding unit generates a spatial YUV domain communication data embedding image 1520 by embedding the communication modulation image 1510 into the spatial YUV domain of the original image. Finally, the data embedding unit converts the communication data embedded image 1520 from the YUV (YCbCr) spatial domain to the RGB spatial domain to obtain a plurality of RGB values embedded in the communication data in the RGB spatial domain for optical communication.

FIG. 16 is a diagram illustrating embedding a communication modulation image in an RGB spatial domain of an original image according to an embodiment of the present disclosure. In the example of the sixteenth figure, the pre-processing procedure is not executed. The data embedding unit 614 embeds the communication processing data in the frequency domain according to a modulation method to generate the communication modulation image 1510, and performs an IDCT conversion of the communication modulation image 1510, and the communication modulation image 1510 is The YUV (YCbCr) domain is converted to the RGB domain to sequentially acquire a plurality of RGB values of a communication modulated image 1620 in the RGB spatial domain. Finally, the data embedding unit 614 embeds the RGB values in the communication modulated image into the RGB values of the original image in the RGB spatial domain to generate a communication data embedded image 1620 in the RGB spatial domain for optical communication.

As described above, the seventeenth embodiment is a method for embedding data in optical communication according to an embodiment of the present disclosure, which is adapted to a transmitter. In the seventeenth figure, the method can arrange a data embedding unit between a transmitting end communication data processing unit and a lighting device driver in the transmitter (step 1710); And using the data embedding unit, embedding a communication processing data into one or more frequency coefficients in a frequency domain of the original image according to a modulation method to generate a communication modulation image (step 1720), and then Performing an inverse conversion and a domain conversion, converting the communication modulated image from a frequency domain to a spatial domain, and obtaining a plurality of RGB values of a communication data embedded image (step 1730), wherein the communication data embedded image is It is formed by a plurality of RGB values embedded in this original image.

As described earlier, when a pre-processing procedure is performed in accordance with an external indicator, the original image can be converted from an RGB spatial domain to a YUV spatial domain. After the pre-processing procedure is completed and the communication modulation image is generated, the method can embed the communication modulation image into the YUV space domain of the original image to generate the communication data embedded image, and convert the communication data into the image from the YUV space domain to The RGB spatial domain is used to obtain a plurality of RGB values of the communication data embedded in the image for optical communication. When no pre-processing program is executed, after performing an IDCT conversion, the method can convert the communication modulated image from the YUV (YCbCr) domain to the RGB domain, and sequentially obtain the RGB values of the communication modulated image in the RGB spatial domain. And embedding the RGB values of the communication modulated image into the RGB values in the original image in the RGB spatial domain to generate the communication data embedded in the RGB spatial domain for optical communication.

As described above, the method of embedding data in optical communication can embed communication processing data in one or more frequency coefficients of any combination of Y, U, and V portions of the DCT block according to a modulation coding method. Different modulation methods can be used to embed The processing data, for example, but not limited to the tenth to fourteenth embodiments, can be applied to this method.

When the illuminating device 618 transmits a communication data embedded image via a channel of optical communication, an embodiment of a receiving device embedded in the optical communication can refer to FIG. In the eighteenth figure, a receiving device 1800 embedded in the optical communication device can include an image sensing device 1822, an image deforming unit 1824, and a data capturing unit 1826. The image sensing unit 1822 can detect a transmitting end communication data embedded image 1822a transmitted by the light emitting device 618 via a channel, and generate a receiving end communication data embedded image 1822b. Because the size and shape of the receiving end communication data embedded image 1822b may be different from the transmitting end communication data embedded image 1822a, the image deforming unit 1824 is configured to perform an image deformation process on the transmitting end embedded image 1822a to compensate the receiving end communication data embedding. The image 1822b is deformed and a deformed communication material is output to the image 1824b. The data retrieval unit 1826 is configured to retrieve the communication processing data 614a from the transformed communication data embedded image 1824b. The receiving device can also perform a communication data processing 1828 on the communication processing data 614a to obtain recovered data.

The image deformation processing performed by the image warping unit 1824 may include a label conversion of a plurality of pixel data in an area of the transmission end communication data embedded image 1822a, and a label, such as a centroid coordinate, may be used for the image deformation program. in. The nineteenth embodiment is a centroid coordinate conversion of a point in a triangle in the image warping process according to an embodiment of the present disclosure. Let abc be a triangle defined by vertices a, b, and c. A point p in the triangle abc can be expressed as αa + βb + γc , where α , β , and γ can be calculated from the area ratio of each triangle, and must satisfy the condition of α + β + γ =1. In other words, the point p and the condition can be expressed by the following formula. p = αa + βb + γc , α = A _a /A, β = A _b /A, γ = A _c /A, α + β + γ =1, where A _a is the area of the triangle bcp, and A _b is The area of the triangle cap, and A _c is the area of the triangle abp, and A is the area of the triangle abc.

Based on this centroid coordinate, the twentieth diagram illustrates the operation of the image warping process in accordance with an embodiment of the present disclosure. Referring to FIG. 20, the image deforming unit may divide the transmitting end communication data embedded image 1822a into several triangles, wherein each of the triangles a'b'c' of the transmitting end communication data embedded in the image 1822a respectively corresponds to the receiving end communication data. Embedding a triangle abc of the image 1822b, and calculating a centroid coordinate ( α , β , γ ) _{p '} corresponding to each point p' in each triangle a'b'c _' , and embedding the image for the communication data at the transmitting end At each point p' of each triangle a'b'c' of 1822a, after the receiving end communication data embedding image 1822b is deformed, a step 2020 of calculating a corresponding point p = αa + βb + γc is performed. For each point p' of each triangle a'b'c' of the transmission end communication data embedded image 1822a, the image warping unit may also perform a pixel value insertion step 2030 to restore the pixel value of p', the inserted The pixel value is a pixel value of the pixel received within the periphery of point p. After performing the centroid coordinate conversion of the midpoint of the area of the transmission end communication data embedded in the image 1822a, the pixel value of the transmission end communication data embedded image 1822a can be obtained by the pixel value in the receiving end communication data embedded image 1822b in the image deformation processing. To recover.

The twenty-first figure illustrates the operation of the data capture unit 1826 in accordance with an embodiment of the present disclosure. Referring to the twenty-first figure, the data capture unit 1826 converts the plurality of data embedded in the image 1824b of the transformed communication data from a first spatial representation (eg, an RGB representation) to a second spatial representation (eg, a YUV (or YCbCr) notation) (step 211o), and then transforming the transformed communication data embedded in the second spatial representation (for example, YUV representation) into a plurality of blocks in a frequency domain, and Performing a frequency domain conversion (eg, discrete cosine transform or wavelet transform) on each of the plurality of blocks (step 2120), and extracting bits embedded in one or more frequency coefficients, The communication processing data 614a is determined (step 2130). The communication processing material 614a is determined by performing a majority voting, demapping, or pattern matching on the bits captured by the one or more frequency coefficients. The receiving device of the optical communication may further comprise a receiving end communication data processing unit, wherein the receiving end communication data processing unit may perform general communication data processing, such as demodulation and error correction, in the receiving device to process the data from the captured communication. Restore the communication data and output this recovery data.

Accordingly, the twenty-second figure is a method for receiving embedded data in optical communication according to an embodiment of the present disclosure. In the twenty-second figure, the receiving method of embedding data in the optical communication can communicate data between an image sensing device and a receiving end. Configuring an image deforming unit and a data capturing unit between the processing units (step 2210); detecting an embedded communication data embedded in the transmitting device by using the image sensing device, and generating a receiving communication data Embedding an image (step 2220); performing an image warping process on the transmitting end communication data embedded image by using the image deforming unit, and outputting a transformed communication data embedded image; and by using the data capturing unit, The transformed communication data is embedded in the image to retrieve the communication processing data (step 2230).

For the communication processing data embedded in a spread spectrum sequence, the receiving method of the embedded data in the optical communication can perform an image deformation of the embedded communication data embedded in the image and embed the deformed communication data into the image data point from an RGB representation. Converting to a YUV representation; performing a DCT for each block such as 8x8 and extracting one or more frequency coefficients for each block, and performing a sequence matching of each block And a majority vote for a group of blocks. The detected communication processing data can also be applied to a receiving communication data processing unit.

As has been described above, an optical communication system according to an embodiment may include a transmitter and a receiving device. The transmitter can be configured to embed one or more frequency coefficients of a communication processing data in a frequency domain of the original image to generate a communication modulated image, and perform an inverse conversion and a domain on the communication modulated image. Converting, and forming a communication data embedded image by embedding a plurality of RGB values in the original image. The receiving device can be configured to detect a pass transmitted by a light emitting device The data is embedded in the image, and a receiving end communication data is embedded in the image, and an image deformation processing is performed, thereby embedding the communication data of the receiving end to reconstruct the embedded communication data embedded image, and embedding the image from a deformed communication data. Capture this communication processing data.

The transmitter in the optical communication system may further include an illumination device driver for driving the illumination device to transmit the communication data embedded image. The transmitter may also include a pre-processor that executes a pre-processing procedure prior to embedding the communication processing material based on an external indicator. If the pre-processing procedure is not necessary, the communication image of the RGB spatial domain is embedded with the original image of the RGB spatial domain to form the communication data embedded image.

According to an embodiment, in a transmitter, an optical communication method can embed a communication processing data in one or more frequency coefficients of a frequency domain conversion of an original image to generate a communication modulation image in communication. An inverse transform and a domain transform are performed on the modulated image, and a communication data embedded image is formed by a plurality of RGB values embedded in the original image. In a receiving device, the optical communication method can detect the embedded data transmitted by the illuminating device, and generate a receiving end communication data embedded image, and perform an image morphing process, thereby embedding the receiving end communication data The image is used to restore the communication data embedded image, and the communication processing data is captured from a transformed communication data embedded in the image.

Execute a pre-processing program to form a communication before embedding communication processing data The details of embedding the image, performing the image warping process, and extracting the communication processing data have been described in the previous embodiments and are omitted here.

In summary, the disclosed embodiments provide an apparatus and method for embedding data in optical communication, and an optical communication system and method. This technology uses a data embedding technique for communication processing data, which is then applied to the illuminator driver or video/video display driver. Rather than applying the communication processing data directly to the illuminator driver using existing optical communication technology. When optical communication is performed, the disclosed embodiment embeds the communication processing data into an insensitive portion of the frequency coefficient of the image or video in the spatial domain to the eye. Therefore, the disclosed embodiments can simultaneously perform image or video display and optical communication.

The above is only the embodiment of the disclosure, and the scope of the disclosure is not limited thereto. All changes and modifications made to the scope of the present invention should remain within the scope of the present invention.

610‧‧‧Transport device

620‧‧‧ receiving device

612a‧‧‧Communication input data

612‧‧‧Transport communication data processing unit

614a‧‧‧Communication processing data

614b‧‧‧ original image

614c‧‧‧External indicator

614‧‧‧Data embedding unit

616‧‧‧Lighting device driver

618‧‧‧Lighting device

618b‧‧‧Communication data embedded in images

622‧‧‧Image sensing device

624‧‧‧Image Deformation Unit

626‧‧‧Information acquisition unit

628‧‧‧Receiver communication data processing unit

Claims (44)

A device for embedding data in an optical communication, adapted to a transmitter, the device comprising: a data embedding unit disposed between a transmitting communication data processing unit and a lighting device driver in the transmitter; wherein The data embedding unit embeds a communication processing data in a spatial domain of an original image according to a modulation method, and obtains a plurality of red, green and blue (RGB) values embedded in the image of the communication data. The device of claim 1, wherein the device further comprises a preprocessor that executes a pre-processing procedure based on an external indicator prior to embedding the communication processing material. The device of claim 1, wherein the data embedding unit generates a communication modulated image by embedding the communication processing data in one or more frequency coefficients of a frequency domain conversion of the original image. The device of claim 2, wherein the pre-processor converts the plurality of pixel arrays of the original image from a first spatial domain to a second spatial domain, and the plurality of second spatial domains A discrete cosine transform is performed on each pixel array. The device of claim 2, wherein the pre-processor converts the plurality of pixel arrays of the original image from an RGB spatial domain to a YUV or YCbCr spatial domain, and in the YUV or YCbCr spatial domain A discrete cosine transform is performed on the plurality of pixel arrays. The device of claim 3, wherein the data embedding unit embeds the communication modulated image in a frequency domain of the original image, performs a frequency domain conversion, and performs a plurality of luminance and chrominance Data is converted to the plurality of RGB values to generate the communication The data is embedded in the image. The device of claim 1, wherein the data embedding unit embeds the communication by inserting one or more pictures of one or more image intensities of the plurality of original pictures in the original image. Processing data. The device of claim 7, wherein the one or more pictures to be inserted are modulated by one or more intensities of one or more partial images of different regions of the original image. The device of claim 3, wherein the data embedding unit performs a domain conversion, converts the communication modulated image from a frequency domain to an RGB spatial domain, and uses a plurality of derived luminance and chrominance data. Converting to the plurality of RGB values and generating the communication data embedded image by embedding the plurality of RGB values into the original image. The device of claim 3, wherein the data embedding unit performs a domain conversion, converts the communication modulated image from a frequency domain to a spatial domain, and embeds a conversion result in the original image. And converting a plurality of derived luminance and chrominance data embedded in the image into the plurality of RGB values to generate the communication data embedded image. A method for embedding data in optical communication, adapted to a transmitter, the method comprising: arranging a data embedding unit between a transmitting end communication data processing unit and an illuminating device driver in the transmitter; embedding the data a unit, embedding a communication processing data in a spatial domain according to a modulation method to generate a communication modulation image; and performing an inverse conversion and a domain conversion, the domain conversion converting the communication modulated image from a frequency domain To the spatial domain, and obtain a plurality of red, green and blue (RGB) images embedded in the communication data value. The method of claim 11, wherein the method further comprises a pre-processing procedure according to an external indicator before embedding the communication processing material. The method of claim 12, wherein the pre-processing program further comprises: converting the plurality of pixel arrays of the original image from a first spatial domain to a second spatial domain. The method of claim 12, wherein the external indicator is generated using a software programming register or a hardware component. The method of claim 11, wherein the method further comprises: generating the communication modulated image by embedding the communication processing data in one or more frequency coefficients of a frequency domain conversion. The method of claim 11, wherein the method embeds the communication processing data in a YUV, a U, and a U in a YUV spatial domain of one or more discrete cosine transform blocks according to a modulation coding method. And one or more frequency coefficients of any combination of a V portion. The method of claim 16, wherein the communication processing data is embedded in one of a plurality of methods, including embedding a spread spectrum pattern and embedding a four-phase phase shift key (QPSK) The pattern uses a two-phase phase shift key (BPSK) modulation method in an interleaved manner and uses a hybrid BPSK and QPSK modulation method. The method of claim 11, wherein the method is inserted into an original One or more pictures of one or more image intensities of the plurality of original pictures in the original image are embedded to embed the communication processing material. The method of claim 18, wherein the one or more pictures inserted are modulated by one or more intensities of one or more partial images of different regions of the original image. The method of claim 15, wherein the method further comprises: embedding the communication modulated image in the frequency domain, performing a frequency domain conversion, and performing a plurality of luminance sums by the data embedding unit; The chrominance data is converted into the plurality of RGB values to generate the communication data embedded image. The method of claim 15, wherein the method further comprises: performing, by the data embedding unit, performing a domain conversion, converting the communication modulated image from the frequency domain to an RGB spatial domain, and The derived luminance and chrominance data are converted into the plurality of RGB values, and the communication data embedded image is generated by embedding the plurality of RGB values into an original image. The method of claim 15, wherein the method further comprises: performing, by the data embedding unit, performing a domain conversion, converting the communication modulated image from a frequency domain to a spatial domain, and A conversion result is embedded in the original image, and a plurality of derived luminance and chrominance data embedded in the image is converted into the plurality of RGB values to generate the communication data embedded image. A receiving device for embedding data in an optical communication, comprising: an image sensing device for detecting a transmission end communication data embedded by an illumination device, and generating a receiving end communication data embedded image; an image deformation unit, An image embedded in the image by executing the communication data of the transmitting end Deformation processing to compensate for a deformation of the receiver-side communication data embedded image, and outputting a deformed communication data embedded image; and a data capture unit embedding the image from the transformed communication data to retrieve a communication processing data. The device of claim 23, wherein the image deformation processing performed by the image deformation unit comprises a label conversion of a plurality of pixel data embedded in an area of the image of the transmission communication data. The device of claim 23, wherein the data capturing unit converts the plurality of pixel data embedded in the transformed communication data from a first spatial representation to a second spatial representation, and then In the second spatial representation, the modified communication data embedded image is divided into a plurality of blocks in a frequency domain, and a frequency domain conversion is performed on each of the plurality of blocks, and the capture is performed. A bit element embedded in one or more frequency coefficients is used to determine the communication processing data. The apparatus of claim 25, wherein the data acquisition unit performs a majority vote, solution correspondence or pattern matching on the bits captured by the one or more frequency coefficients. A receiving method for embedding data in an optical communication, comprising: configuring an image deforming unit and a data capturing unit between an image sensing device and a receiving end communication data processing unit; and using the image sensing device to detect A transmitting end communication data transmitted by an illuminating device is embedded in the image, and a receiving end communication data embedded image is generated; the image morphing unit is used to perform an image morphing process in the transmitting end communication data embedded image, and output a deformed communication Data embedded in the image; The data acquisition unit uses the transformed communication data embedded image to retrieve a communication processing data. The method of claim 27, wherein the image deformation processing further comprises: performing a label conversion on the plurality of pixel data in an area of the communication data embedded in the transmission end; and by using the receiving end The communication data is embedded in the plurality of pixel data of the image, and the plurality of pixel data embedded in the image of the communication data of the transmitting end is restored. The method of claim 27, wherein the extracting the communication processing data further comprises: converting the plurality of data points embedded in the transformed communication data from a first spatial representation to a second spatial representation Separating the transformed communication data embedded image of the second spatial representation into a plurality of blocks of a spatial domain, and performing a frequency domain conversion on each of the plurality of blocks; and capturing the embedded The communication processing data is determined by one or more of the one or more frequency coefficients. The method of claim 29, wherein a majority vote, a solution correspondence or a pattern match is performed on the one or more bits of the one or more frequency coefficients. An optical communication system comprising: a transmitter embedding a communication processing data in a frequency domain converted one or more frequency coefficients of an original image, performing an inverse transformation of a communication modulated image and a Domain conversion, and embedding a plurality of red, green and blue (RGB) values in the original image to form a communication data embedded image; and a receiving device that detects the communication data embedded image transmitted by an illumination device And generating a receiving end (the communication data is embedded in the image, and performing image deformation processing according to the receiving end communication data embedded image to recover the communication data embedded image, and embedding the image from the transformed communication data to retrieve the communication processing data . The system of claim 31, wherein the transmitter further comprises an illumination device driver that drives the illumination device to transmit the communication data embedded image. The system of claim 31, wherein the transmitter further comprises a pre-processor that executes a pre-processing procedure prior to embedding the communication processing material. The system of claim 33, wherein the transmitter performs the pre-processing according to an external program generated by a software programming register or a hardware component. The system of claim 33, wherein the preprocessor converts the plurality of pixel arrays of the original image from a first spatial domain to a second spatial domain, and the second spatial domain A plurality of pixel arrays perform a discrete cosine transform. The system of claim 31, wherein the communication data embedded image is formed by the communication modulated image embedded in an RGB spatial domain and the original image of the RGB spatial domain. The system of claim 31, wherein the receiving device performs a label conversion on the plurality of pixel data in an area of the communication data embedded image, and the receiving end is processed by the image deformation processing The communication data is embedded in the plurality of pixel data of the image to recover the plurality of pixel data embedded in the communication data. The system of claim 31, wherein the receiving device converts the transformed communication data into a plurality of data points of the image from a first spatial representation to a second spatial representation, and the second In the spatial representation, the transformed communication data is embedded in the image and divided into a plurality of blocks in a frequency domain. The system of claim 38, wherein the receiving device performs a frequency domain conversion on each of the plurality of blocks and extracts one or more embedded in one or more frequency coefficients A bit is used to determine the communication processing data. An optical communication method includes: embedding a communication processing data in a frequency domain to convert one or more frequency coefficients of an original image in a transmitter, performing an inverse conversion and a domain conversion of a communication modulated image, And forming a communication data embedded image by embedding a plurality of red, green and blue (RGB) values in the original image; and detecting, in a receiving device, the communication data transmitted by the light emitting device to embed the image, and generating a receiving end The communication data is embedded in the image, and the image is deformed according to the communication data of the receiving end to perform an image deformation process to restore the embedded image of the communication data, and the communication processing data is captured from a transformed communication data. The method of claim 40, wherein the method performs a pre-processing procedure prior to embedding the communication processing material based on an external indicator. The method of claim 40, wherein the image warping process comprises a label conversion on a plurality of pixel data in an area of the image in which the communication data is embedded in the transmission end. The method of claim 40, wherein in the receiving device, the method further comprises: Transmitting, by a first spatial representation, a plurality of pixel data of the transformed communication data embedded into the image to a second spatial representation; dividing a second spatial representation of the transformed communication data into the image into a plurality of squares of a spatial domain Performing a frequency domain conversion on each of the plurality of blocks; and extracting one or more bits embedded in one or more frequency coefficients to determine the communication processing data. The method of claim 41, wherein the performing the pre-processing further comprises: converting the plurality of pixel arrays of the original image from a first spatial domain to a second spatial domain.