WO2018198950A1 - 送信装置、送信方法、受信装置および受信方法 - Google Patents
送信装置、送信方法、受信装置および受信方法 Download PDFInfo
- Publication number
- WO2018198950A1 WO2018198950A1 PCT/JP2018/016231 JP2018016231W WO2018198950A1 WO 2018198950 A1 WO2018198950 A1 WO 2018198950A1 JP 2018016231 W JP2018016231 W JP 2018016231W WO 2018198950 A1 WO2018198950 A1 WO 2018198950A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- signal
- symbol
- mapping
- color space
- signal point
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B10/00—Transmission systems employing electromagnetic waves other than radio-waves, e.g. infrared, visible or ultraviolet light, or employing corpuscular radiation, e.g. quantum communication
- H04B10/11—Arrangements specific to free-space transmission, i.e. transmission through air or vacuum
- H04B10/114—Indoor or close-range type systems
- H04B10/116—Visible light communication
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04J—MULTIPLEX COMMUNICATION
- H04J14/00—Optical multiplex systems
- H04J14/02—Wavelength-division multiplex systems
- H04J14/0201—Add-and-drop multiplexing
- H04J14/0202—Arrangements therefor
- H04J14/0213—Groups of channels or wave bands arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B10/00—Transmission systems employing electromagnetic waves other than radio-waves, e.g. infrared, visible or ultraviolet light, or employing corpuscular radiation, e.g. quantum communication
- H04B10/25—Arrangements specific to fibre transmission
- H04B10/2575—Radio-over-fibre, e.g. radio frequency signal modulated onto an optical carrier
- H04B10/25752—Optical arrangements for wireless networks
- H04B10/25753—Distribution optical network, e.g. between a base station and a plurality of remote units
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04J—MULTIPLEX COMMUNICATION
- H04J14/00—Optical multiplex systems
- H04J14/02—Wavelength-division multiplex systems
- H04J14/0226—Fixed carrier allocation, e.g. according to service
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04J—MULTIPLEX COMMUNICATION
- H04J14/00—Optical multiplex systems
- H04J14/02—Wavelength-division multiplex systems
- H04J14/0227—Operation, administration, maintenance or provisioning [OAMP] of WDM networks, e.g. media access, routing or wavelength allocation
- H04J14/0228—Wavelength allocation for communications one-to-all, e.g. broadcasting wavelengths
- H04J14/023—Wavelength allocation for communications one-to-all, e.g. broadcasting wavelengths in WDM passive optical networks [WDM-PON]
- H04J14/0232—Wavelength allocation for communications one-to-all, e.g. broadcasting wavelengths in WDM passive optical networks [WDM-PON] for downstream transmission
- H04J14/0234—Wavelength allocation for communications one-to-all, e.g. broadcasting wavelengths in WDM passive optical networks [WDM-PON] for downstream transmission using multiple wavelengths
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04J—MULTIPLEX COMMUNICATION
- H04J14/00—Optical multiplex systems
- H04J14/02—Wavelength-division multiplex systems
- H04J14/0227—Operation, administration, maintenance or provisioning [OAMP] of WDM networks, e.g. media access, routing or wavelength allocation
- H04J14/0254—Optical medium access
- H04J14/0256—Optical medium access at the optical channel layer
- H04J14/0257—Wavelength assignment algorithms
Definitions
- the present disclosure relates to a transmission device, a transmission method, a reception device, and a reception method.
- One communication method is optical communication using visible light in a frequency band visible to humans.
- a terminal uses its own radio waves transmitted from an access point (AP (access point)) of a wireless LAN (Local Area Network). There is a method for estimating information such as location.
- AP access point
- LAN Local Area Network
- a transmitter modulates the intensity of light emitted from a light emitting element such as an LED (light emitting diode) based on transmission data, and transmits a signal according to a change in brightness.
- a light emitting element such as an LED (light emitting diode)
- One embodiment of the present disclosure promotes improvement in reception quality or transmission speed in optical communication using visible light or the like.
- a transmission apparatus includes a symbol generation unit that maps transmission data to signal points arranged in a two-dimensional or three-dimensional color space to generate a modulation symbol, and a response corresponding to the modulation symbol And an output unit for outputting the modulated optical signal.
- a transmission method is performed in a transmission device, generates transmission symbols by mapping transmission data to signal points arranged in a two-dimensional or three-dimensional color space, and the modulation symbols
- the optical signal modulated according to the above is output from an output unit provided in the transmission apparatus.
- a receiving apparatus includes a light receiving unit that receives an optical signal using a plurality of light receiving elements to generate a received signal, and a received signal that has a two-dimensional or three-dimensional color space for each symbol. And a demodulator that demaps and decodes the signal to generate received data.
- a reception method receives an optical signal using a plurality of light receiving elements to generate a reception signal, and the received signal is de-coded as a signal in a two-dimensional or three-dimensional color space for each symbol. Mapping and decoding to generate received data.
- FIG. 1 is a diagram for explaining the principle of line scan sampling.
- FIG. 2 is a diagram illustrating an example of a captured image when the exposure time is long.
- FIG. 3 is a diagram illustrating an example of a captured image when the exposure time is short.
- FIG. 4A is a diagram for explaining 4PPM.
- FIG. 4B is a diagram for explaining the Manchester encoding method.
- FIG. 5 is a diagram illustrating a configuration example of a visible light communication system.
- FIG. 6 is a diagram illustrating a configuration example of a transmission apparatus according to the first embodiment.
- FIG. 7 is a diagram illustrating a configuration example of the receiving device according to the first embodiment.
- FIG. 8 is a diagram illustrating a configuration example of a receiving unit according to the first embodiment.
- FIG. 1 is a diagram for explaining the principle of line scan sampling.
- FIG. 2 is a diagram illustrating an example of a captured image when the exposure time is long.
- FIG. 3 is a diagram
- FIG. 9 is a diagram illustrating a detailed configuration example of the transmission apparatus according to the first embodiment.
- FIG. 10 is a diagram illustrating a configuration example of a frame according to the first embodiment.
- FIG. 11 is a diagram illustrating another configuration example of the frame according to the first embodiment.
- FIG. 12 is a diagram illustrating an example of the relationship between the communication device and the communication partner according to the first embodiment.
- FIG. 13 is a diagram illustrating another example of the relationship between the communication device and the communication partner according to the first embodiment.
- FIG. 14 is a diagram illustrating an example of frame transmission according to the first embodiment.
- FIG. 15 is a diagram illustrating another example of frame transmission according to the first embodiment.
- FIG. 16 is a diagram illustrating a detailed configuration example of the receiving apparatus according to the first embodiment.
- FIG. 10 is a diagram illustrating a configuration example of a frame according to the first embodiment.
- FIG. 11 is a diagram illustrating another configuration example of the frame according to the first embodiment.
- FIG. 17 is a diagram illustrating an example of a color space (color system) in which signal points in the modulation scheme according to Embodiment 1 are arranged.
- FIG. 18 is a diagram illustrating an example of the arrangement of signal points in the modulation scheme according to the first embodiment.
- FIG. 19 is a diagram showing an example of signal point arrangement and received signal position in the modulation scheme according to Embodiment 1.
- FIG. 20 is a diagram showing an example of signal point arrangement in a three-dimensional space in the modulation scheme according to Embodiment 1.
- FIG. 21 is a diagram illustrating a configuration example of a frame according to the fifth embodiment.
- FIG. 22 is a diagram illustrating a detailed configuration example of a receiving apparatus according to the fifth embodiment.
- FIG. 23 is a diagram for explaining an operation example of the image sensor according to the fifth embodiment.
- FIG. 24 is a diagram for explaining another operation example of the image sensor according to the fifth embodiment.
- FIG. 25 is a diagram illustrating a detailed configuration example of a receiving apparatus according to the sixth embodiment.
- FIG. 26 is a diagram showing an example of signal point arrangement in the modulation scheme according to Embodiment 6.
- FIG. 27 is a diagram illustrating a configuration example of a frame according to the sixth embodiment.
- FIG. 28 is a diagram illustrating an example of reference symbol transmission according to Embodiment 6.
- FIG. 29 is a diagram illustrating an example of signal point arrangement and received signal position in the modulation scheme according to Embodiment 6.
- FIG. 30 is a diagram illustrating an example of the arrangement of signal points in a three-dimensional space in the modulation scheme according to the seventh embodiment.
- FIG. 31 is a diagram illustrating an example of arrangement of received signal points in a three-dimensional space in the modulation scheme according to Embodiment 7.
- FIG. 32 is a diagram illustrating an example of reference symbol transmission according to Embodiment 7.
- FIG. 33 is a diagram illustrating an example of the arrangement of true received signal points and the position of received signals in the modulation scheme according to the seventh embodiment.
- FIG. 34 is a diagram illustrating a configuration example of a communication system according to the eighth embodiment.
- FIG. 35 is a diagram illustrating an example of signal point arrangement in the modulation scheme at the time of transmission according to the eighth embodiment.
- FIG. 36 is a diagram illustrating an example of signal point arrangement and received signal position in the modulation method at the time of reception according to the eighth embodiment.
- FIG. 37 is a diagram illustrating an example of frame transmission according to the eighth embodiment.
- FIG. 38 is a diagram illustrating an example of signal point symbol transmission according to the eighth embodiment.
- FIG. 39 is a diagram illustrating an example of transmission of symbols of reception signal points according to Embodiment 8.
- FIG. 40 is a diagram illustrating an example of transmission by the mapping method according to Embodiment 10.
- FIG. 41 is a diagram illustrating an example of frame transmission according to the tenth embodiment.
- An image sensor such as a CMOS (Complementary Metal Oxide Semiconductor) sensor is mounted on a smartphone or a digital camera.
- the image captured by the CMOS sensor does not necessarily represent the scenery at exactly the same time.
- CMOS Complementary Metal Oxide Semiconductor
- a shutter operation is performed for each row.
- the amount of light received by the sensor is read out for each line by the rolling shutter method.
- the start and end control of light reception is performed with a time difference for each line by estimating the time required for reading. That is, the image captured by the CMOS sensor has a shape in which a large number of lines with a time lag are gradually overlapped.
- a method focusing on the properties of the CMOS sensor is considered, and the speed of visible light signal reception is increased. That is, in the visible light communication method, by utilizing the fact that the exposure time is slightly different for each line, as shown in FIG. 1, from one image (image sensor image), the light source at a plurality of points in time is displayed. Luminance and color can be measured for each line, and a signal modulated at a speed higher than the frame rate can be captured.
- CMOS complementary metal-oxide-semiconductor
- CMOS complementary metal-oxide-semiconductor
- Non-Patent Document 4 Non-Patent Document 4
- this sampling method is referred to as “line scan sampling”, and a column of pixels exposed at the same timing is referred to as an “exposure line”.
- the blinking does not appear as a striped pattern along the exposure line. This is because, in this setting, the exposure time is sufficiently longer than the blinking cycle of the light source. Therefore, as shown in FIG. 2, the change in luminance due to the blinking of the light source (light emission pattern) is averaged, and the pixel value between the exposure lines is This is because the change becomes smaller and the image becomes almost uniform.
- the blinking state (light emission pattern) of the light source can be observed as the luminance change of the exposure line.
- the exposure line is designed to be parallel to the long side direction of the image sensor.
- the frame rate is 30 fps (frames per second)
- at a resolution of 1920 ⁇ 1080, 32400 or more samples are obtained per second
- at a resolution of 3840 ⁇ 2160, 64800 or more samples per second are obtained. Is obtained.
- LED Light Emitting Diode
- LEDs are becoming popular as backlight sources for illumination or displays and can be blinked at high speed.
- the light source used as a transmitter for visible light communication it cannot be freely blinked for visible light communication. This is because if the change in brightness due to visible light communication can be recognized by humans, the function of the original light source such as illumination is impaired. For the above reasons, when performing visible light communication using a light source such as an illumination, the light source that transmits the transmission signal should illuminate with the desired brightness so that the human eye does not feel flicker. Is required.
- 4PPM 4-Pulse Position Modulation
- 4PPM is a method of expressing 2 bits by four combinations of light source and light source.
- 4PPM is more suitable than the Manchester code method as a modulation method for visible light communication.
- the transmitter (light source) generates a modulation signal using a modulation method such as ASK (Amplitude Shift Keying), PSK (Phase Shift Keying), or PAM (Pulse Amplitude Modulation), and turns on the light source. May be irradiated.
- ASK Amplitude Shift Keying
- PSK Phase Shift Keying
- PAM Pulse Amplitude Modulation
- a communication system that performs visible light communication includes at least a transmitter that transmits (irradiates) an optical signal and a receiver that receives (receives) an optical signal.
- a transmitter that transmits (irradiates) an optical signal includes at least a transmitter that transmits (irradiates) an optical signal and a receiver that receives (receives) an optical signal.
- a communication system using light can be configured even in a configuration in which either a variable optical transmitter or a fixed optical transmitter exists.
- the receiver can receive the optical signal from the transmitter, acquire the related information associated with the optical signal, for example, and provide it to the user.
- the communication system applicable to the optical communication demonstrated by the following embodiment is not limited to said system.
- the light emitting unit of the transmitter may perform data transmission using a plurality of light sources.
- the light receiving unit of the receiving device may be a communication method that can use a device that can convert an optical signal such as a photodiode into an electric signal, instead of an image sensor such as a CMOS.
- CMOS complementary metal-oxide-semiconductor
- a communication method using radio waves with frequencies other than visible light such as infrared rays and ultraviolet rays may be used.
- FIG. 6 shows an example of the configuration of the transmission apparatus 100 included in the transmitter according to the present embodiment.
- the transmission device 100 includes a visible light source such as an LED (Light Emitting Diode), illumination, or light (generally also referred to as a light source).
- a visible light source such as an LED (Light Emitting Diode), illumination, or light (generally also referred to as a light source).
- the signal generation unit 102 receives, for example, transmission data 101 stored in a storage unit such as a memory included in the transmitter, and signal points arranged in a color space designated from the transmission data 101. Mapping is performed based on the modulation scheme based on the arrangement, a modulation symbol is generated, and the generated modulation symbol is output as the transmission signal 103.
- the signal generation unit 102 receives, for example, transmission data 101 stored in a storage unit such as a memory included in the transmitter, and a table specified from the transmission data 101. Mapping is performed based on the modulation scheme based on the signal point arrangement arranged in the color system, a modulation symbol is generated, and the generated modulation symbol is output as the transmission signal 103.
- the color space or the color system is two-dimensional as the modulation method based on the signal point arrangement arranged in the color space or the modulation system based on the signal point arrangement arranged in the color system
- BPSK Binary Phase Shift Keying
- QPSK Quadrature Phase Shift Keying
- APSK Amplitude Phase Shift Keying
- 16QAM Quadrature Amplitude Modulation
- 64QAM 64QAM
- NU Nou-Uniform
- PAM a modulation system having 4 signal points, a modulation system having 16 signal points, a modulation system having 64 signal points, a modulation system having 256 signal points, and the like.
- Non-Patent Document 9 discloses a color space and the color system.
- a signal point arrangement method in the color space and a signal point arrangement method in the color system will be described later. Further, the color space may be selectable in the transmission apparatus 100.
- the color space can be handled in three dimensions.
- signal points can be arranged three-dimensionally as “signal point arrangement to be arranged in the color space” and “signal point arrangement to be arranged in the color system”.
- a modulation symbol corresponding to a signal point arranged in a three-dimensional color space, and a modulation symbol corresponding to a signal point arranged in a three-dimensional color system are expressed as a vector composed of three real values.
- the expression of the modulation symbol may be any expression as long as it indicates a point in a two-dimensional or three-dimensional color space and a point in a two-dimensional or three-dimensional color system.
- the color space and color system used here are, for example, Munsell color system, CIE (Commission Internationale de l'Eclairage) LAB, CIE XYZ, CIE LUV, sRGB (standard RGB) (see Non-Patent Document 5), Adobe RGB (see non-patent document 6), HSV (hue, saturation, value), HSB (hue, saturation, brightness), etc. can be used (see non-patent document 7, non-patent document 9, and non-patent document 10).
- the transmission unit 104 includes the light source described above, and irradiates or displays the optical signal 105 modulated based on the modulation symbol included in the transmission signal 103.
- the transmission unit 104 may generate, for example, an optical signal 105 by controlling three or three types of light sources corresponding to RGB (R: red, G: green, B: blue), respectively.
- the light signal 105 may be generated by controlling one light source and the liquid crystal panel. Note that the number of types of light sources in the case of using a plurality of light sources is not limited to the above three types, and two or four or more types of light sources may be used. For example, in addition to RGB, light sources such as white, black, cyan, magenta, and yellow may be used. That is, the light source configuration method is not limited to RGB.
- the transmitting unit 104 irradiates the receiver with light corresponding to the modulation symbol generated by performing mapping based on the (selected) color space and the (selected) color system.
- a process of converting a modulation symbol expressed in a color space format or a color system format into a signal used for irradiation control of each device may be performed.
- Such a conversion process is, for example, any one of a conversion process using a lookup table, a conversion process using a matrix operation, a conversion process using a TCR (tone production curve), and a conversion process using a function. Or a combination thereof.
- the signal generation unit 102 uses a constellation used for mapping modulation symbols, that is, As the signal point arrangement, a constellation (signal point arrangement) in which signal points are arranged in an area that can be reproduced by the transmission unit 104 in the selected color space or the selected color system is used.
- the format (color space or color system) of the input signal supported by the transmission unit 104 of the transmission apparatus 100 is the format of the modulation symbol (color space or color system) generated by the modulation method used by the signal generation unit 102.
- the transmission unit 104 may have a function of converting the modulation symbol into an input signal format (color space or color system) corresponding to the transmission unit 104.
- the signal generation unit 102 outputs the converted modulation symbol as the transmission signal 103.
- the conversion process performed by the signal generation unit 102 is, for example, the same process as the conversion process that may be performed by the transmission unit 104 described above.
- the conversion process performed by the signal generation unit 102 includes, for example, a conversion process using a lookup table, a conversion process using a matrix operation, a conversion process using a TCR, and a conversion process using a function. Or any combination thereof.
- FIG. 7 illustrates an example of a configuration of the receiving device 200 included in the receiver according to this aspect.
- the receiving unit 202 of the receiving device 200 (corresponding to a receiver for visible light communication) includes a light receiving element that receives light such as an image sensor and converts it into an electrical signal.
- the reception unit 202 receives the optical signal 201 transmitted from the transmission device 100 with a light receiving element, and outputs a reception signal 203.
- the received signal 203 includes a received symbol corresponding to the modulation symbol generated by the signal generation unit 102 of the transmission apparatus 100.
- the receiving unit 202 includes an image sensor (light receiving element) 801 and a color space signal processing unit (or color system signal processing unit) 803.
- Image sensor (light receiving element) 801 obtains, for example, three signals (hereinafter referred to as signal group 802) corresponding to each of RGB received by the light receiving element.
- the signal group 802 is composed of three RGB signals, but is not limited thereto. That is, the signal group 802 may include one or more signals. For example, when there is a signal other than RGB from the light receiving element 801, the signal group 802 may include this signal.
- the color space signal processing unit (or color system signal processing unit) 803 receives the signal group 802 and follows the color space format used by the transmission apparatus 100 from the signal group 802 or the color system format. Get signal group.
- This signal group is called a signal after color space signal processing or a signal after color system signal processing.
- the signal after the color space signal processing (or the signal after the color system signal processing) is a signal in the sRGB format, and therefore, the color space signal processing.
- the later signal (or the signal after the color system signal processing) is a reception symbol corresponding to the modulation symbol generated by the signal generation unit 102 of the transmission apparatus 100. Therefore, the signal after the color space signal processing (or The signal after color system signal processing corresponds to the received signal 203 in FIG.
- color space signal processing unit 803 when the transmission apparatus 100 uses a color space or color system other than sRGB, the color space or color space format for the color system Conversion and color system format conversion processing are performed. That is, when the transmission apparatus 100 uses the Adobe RGB color space or color system, the color space signal processing unit (or color system signal processing unit) 803 performs color space signal processing (color system signal processing). As a result, a signal after color space signal processing in Adobe RGB format (signal after color system signal processing) is generated and output as the received signal 203.
- color space signal processing and color system signal processing for example, any of conversion processing using a lookup table, conversion processing using matrix operation, conversion processing using TCR, conversion processing using a function, etc. Or a combination thereof.
- the signal processing unit 204 of the receiving device 200 in FIG. 7 demaps the received signal 203 based on the color space and the color system used by the signal generating unit 102 of the transmitting device 100 to generate the modulation symbol, and converts the baseband signal. Then, the log likelihood or log likelihood ratio of each received bit is generated. For example, when error correction coding is performed in the transmission apparatus 100, the log likelihood of each received bit, or Error correction decoding is performed using the log likelihood ratio, and reception data 205 corresponding to transmission data 101 is acquired and output.
- FIG. 9 shows an example of a detailed configuration of the transmission device 100 of FIG. 6 described above.
- Encoding section 902 receives transmission data 901 and control signal 910 as input, and transmits transmission data based on information related to an error correction coding scheme (for example, error correction code, code length, coding rate, etc.) included in control signal 910. Error correction coding processing is performed on the data 901 to generate encoded data 903 and output it.
- the encoding process performed on the transmission data 901 by the encoding unit 902 is, for example, an error correction encoding method such as LDPC (Low Density Parity Check) code, Turbo code, Polar code, block code, convolutional code, or the like. This is the error correction coding used.
- the encoding process performed on the transmission data 901 by the encoding unit 902 is not limited to the error correction code, and may be a process such as the above-described 4PPM or Manchester encoding method.
- the error correction encoding process performed by the encoding unit 902 on the transmission data 101 is not limited to the error correction code described above.
- the mapping unit 904 receives the encoded data 903, the control signal 910, and information on the color space method (or information on the color system method) 920 as input, and information on the color space method (or color system) Information on the color space included in 920 (information on the mapping method to the color system) and information on the modulation method included in the control signal 910 based on the information 903 after encoding Is mapped to one of a plurality of signal points defined on the color space for each one or a plurality of bits, modulated, and a modulation symbol (baseband signal) 905 is generated and output.
- the mapping process performed by the mapping unit 904 will be described later.
- the control information symbol generation unit 921 receives the control signal 910 and information about the color space method (or information about the color system method) 920 as input, and the transmission apparatus 900 generates a modulation symbol (baseband signal). In order to notify the receiving apparatus that is the communication partner of the information of the error correction coding method, the information of the modulation method, and the information on the mapping method in the color space, the information of the error correction coding method, the information of the modulation method Then, a control information symbol 922 including information relating to the mapping method in the color space (information relating to the mapping method to the color system) is generated and output.
- the signal processing unit 906 receives a modulation symbol (baseband signal) 905, a control information symbol 922, a preamble (and / or a reference symbol (reference signal), a pilot symbol (pilot signal)) 930, and a control signal 910 as inputs. Based on the frame configuration information included in the signal 910, a modulation symbol (baseband signal) 905, a control information symbol 922. A transmission signal 907 according to the frame configuration is generated from the preamble (and / or reference symbol (reference signal), pilot symbol (pilot signal)) 930 and output.
- the transmission unit 908 receives the transmission signal 907 and the control signal 910 according to the frame configuration, and irradiates the receiver with an optical signal 909 corresponding to the transmission signal 907 according to the frame configuration.
- the light irradiation method is controlled based on the color space information (or color system information) included in the control signal 910. Will be.
- FIG. 10 shows an example of the frame configuration of the transmission signal 907 transmitted by the transmission apparatus 900 of FIG. 9, and the horizontal axis is time.
- symbols are transmitted in the order of a preamble 1001, a control information symbol 1002, and a data symbol 1003.
- the preamble 1001 is a symbol for a receiving apparatus that is a communication partner of the transmitting apparatus 900 to perform signal detection and time synchronization.
- the control information symbol 1002 is transmitted to the receiving apparatus, which is a communication partner of the transmitting apparatus 900, for example, “error correction coding system information, modulation system information, color space information (or information used for generating the data symbol 1003 (or , Information on the color system) ”.
- the information included in the control information symbol 1002 is not limited to “information on error correction coding scheme, information on modulation scheme, information on color space (or information on color system)”.
- the control information symbol 1002 includes at least “information on color space (or information on color system)”, and does not necessarily include “information on error correction coding scheme, information on modulation scheme”. Also good.
- the “modulation method information” may be information on a modulation method based on a color space or information on a modulation method based on a color system.
- the “information about color space (or information about color system)” is, for example, which color space the data symbol 1003 transmitted by the transmission apparatus 900 is (a symbol based on the color system), It is assumed that the information is for notification.
- the “information about the color space (or information about the color system)” is “the data symbol 1003 is the sRGB color space”. It is included in (modulation) symbol based on.
- the data symbol 1003 is a symbol based on the Adobe RGB color space (color system)
- “information about color space (or information about color system)” is “data symbol 1003 is It is included that “Adobe is a (modulation) symbol based on the RGB color space”.
- the data symbol 1003 is a symbol based on a three-dimensional color space (color system)
- “information about color space (or information about color system)” is “data symbol 1003 is a three-dimensional color space”. It is included that it is a (modulation) symbol based on space.
- the data symbol 1003 is a symbol that can be demodulated by a luminance signal (brightness signal, signal amplitude) included in the received signal by the receiving device of the communication partner
- “information on color space (or color specification) "Information on the system)” includes information that "the data symbol 1003 is a symbol that can be demodulated by a luminance signal (brightness signal, signal amplitude)”.
- the method for “a symbol that can be demodulated by a luminance signal (brightness signal, signal amplitude)” is, for example, a PPM method such as 4PPM or a Manchester encoding method.
- the applied system, ASK system, BPSK system, and PAM system are examples.
- the data symbol 1003 is a symbol for transmitting data, and corresponds to, for example, the modulation symbol (baseband signal) 905 in FIG.
- Preamble 1001 is such that a receiving device that is a communication partner of transmitting device 900 can detect a signal and synchronize time with a luminance signal (brightness signal, signal amplitude) included in the received signal. . Therefore, as described above, the preamble 1001 is assumed to be a symbol based on any one of a PPM scheme such as 4PPM, a scheme to which a Manchester coding scheme is applied, an ASK scheme, a BPSK scheme, and a PAM scheme.
- a PPM scheme such as 4PPM
- 4PPM a scheme to which a Manchester coding scheme is applied
- the preamble 1001 can be identified regardless of the color space supported by the receiving device that is the communication partner of the transmitting device 900, that is, regardless of the corresponding color space.
- the receiving device that is the communication partner of the transmitting device 900 can obtain an effect that signal detection and time synchronization can be performed from the preamble 1001.
- the control information symbol 1002 is a symbol that can be demodulated by a receiving device, which is a communication partner of the transmitting device 900, with a luminance signal (brightness signal, signal amplitude) included in the received signal. Therefore, as described above, the control information symbol 1002 is a symbol based on any one of a PPM scheme such as PPM, a scheme to which Manchester encoding scheme is applied, an ASK scheme, a BPSK scheme, and a PAM scheme.
- control information symbol 1002 can be identified regardless of the color space supported by the receiving device that is the communication partner of the transmitting device 900, that is, in the corresponding color space. Regardless, it is possible to obtain an effect that the receiving device that is the communication partner of the transmitting device 900 can obtain the control information included in the control information symbol.
- control information symbol 1002 includes “information about the color space (or information about the color system)” used to generate the data symbol 1003.
- the receiving apparatus that is the communication counterpart of transmitting apparatus 900 can determine whether or not data symbol 1003 can be demodulated by obtaining control information symbol 1002. Therefore, by obtaining the control information symbol 1002, the receiving apparatus can accurately determine whether or not to demodulate the data symbol 1003. By controlling this, the receiving apparatus can reduce power consumption. You don't have to consume it unnecessarily.
- the data symbol 1003 can be demodulated by a luminance signal (brightness signal, signal amplitude) such as a PPM method such as PPM, a method applying the Manchester encoding method, an ASK method, a BPSK method, or a PAM method.
- Data transmission is realized by a transmission method or a symbol based on a modulation scheme based on a signal point arrangement arranged in a color space (color system).
- the data symbol 1003 transmission method and modulation method are switched based on the demodulation performance of the reception device that is the communication counterpart of the transmission device 900, thereby achieving both improvement in data transmission speed and improvement in data reception quality.
- the effect that it is possible can be acquired.
- FIG. 11 shows an example of a frame structure of a transmission signal transmitted by the transmission apparatus 900 of FIG. 9 different from FIG. 10, and the horizontal axis is time. 11 that operate in the same manner as in FIG. 10 are denoted by the same reference numerals and description thereof is omitted.
- a first control information symbol 1101 is a symbol that can be demodulated by a receiving device of a communication partner using a luminance signal (brightness signal, signal amplitude) included in the received signal, and at least “related to color space” Information (or information on the color system) ”is included.
- the second control information symbol 1102 is a symbol of the same system as the data symbol 1003, that is, a luminance signal (brightness) such as a PPM system such as PPM, a system using the Manchester encoding system, an ASK system, a BPSK system, or a PAM system.
- This symbol is based on a transmission method that can be demodulated by the signal, the amplitude of the signal), or a modulation scheme based on a signal point arrangement arranged in a color space (color system).
- the second control information symbol 1102 may include information on the error correction coding method used to generate the data symbol 1003 and information on the modulation scheme used to generate the data symbol 1003.
- the frame configuration in FIG. 10 includes a preamble 1001, a control information symbol 1002, and a data symbol 1003, but other symbols may be included. Further, other symbols may be included in the middle of the data symbol 1003. That is, the symbols may be arranged in the order of “data symbol”, “other symbol”, and “data symbol”. Other symbols include symbols such as pilot symbols, reference symbols, and control information symbols, but are not limited thereto.
- the frame configuration in FIG. 11 includes a preamble 1001, a first control information symbol 1101, a second control information symbol 1102, and a data symbol 1003, other symbols may be included. Further, other symbols may be included in the middle of the data symbol 1003. That is, the symbols may be arranged in the order of “data symbol”, “other symbol”, and “data symbol”. Other symbols include symbols such as pilot symbols, reference symbols, and control information symbols, but are not limited thereto.
- control information symbol 1002, the first control information symbol 1101, and the second control information symbol 1102 include the address of a transmitter including the transmission device 900 or the transmission device 900 and the reception device or reception device that is a communication partner.
- Other control information necessary for communication such as address information indicating the address of the receiver, may be included.
- the modulation signal transmitted by transmitting apparatus 900 is not limited to the frame configurations of FIGS. 10 and 11, and other symbols may be included in FIGS. 10 and 11, and the order in which the symbols are transmitted. Is not limited to the order of FIGS.
- FIG. 12 shows the relationship between the communication device 1201 including the transmission device 900 and the communication partner 1202 of the transmission device 900.
- the communication device 1201 including the transmission device 900 transmits (irradiates) a modulated signal to the communication partner 1202 of the transmission device 900. At this time, it is assumed that the communication device 1201 including the transmission device 900 does not receive feedback from the communication partner 1202 of the transmission device 900. At this time, the transmission method used in data symbol 1003 in FIGS. 10 and 11 is determined by communication device 1201 including transmission apparatus 900. At this time, as a transmission method, for example, “a transmission method that can be demodulated by a luminance signal (brightness signal, signal amplitude) included in a received signal”, “a signal arranged in a color space (color system)” Any one of the “modulation method based on point arrangement” is taken. Note that the communication device 1201 including the transmission apparatus 900 may select a color space (color system) when selecting “a modulation scheme based on signal point arrangement arranged in a color space (color system)”. Is possible.
- FIG. 13 shows a relationship different from FIG. 12 of the communication device 1201 including the transmission device 900 and the communication partner 1202 of the transmission device 900.
- the communication device 1201 including the transmission device 900 transmits (irradiates) a modulation signal to the communication partner 1202 of the transmission device 900. Further, the communication partner 1202 of the transmission device 900 includes a transmission device, and the transmission device included in the communication partner 1202 of the transmission device 900 transmits a modulated signal to the “communication device 1201 including the transmission device 900”. It shall be possible.
- the communication device 1201 including the transmission apparatus 900 uses the data symbol 1003 in FIGS. 10 and 11 based on the modulation signal transmitted from the communication counterpart 1202 of the transmission apparatus 900 and / or information included in the modulation signal.
- the transmission method to be used may be determined.
- the communication partner 1202 of the transmission device 900 transmits information on a transmission method that can be demodulated to the communication device 1201 including the transmission device 900
- the communication device 1201 including the transmission device 900 transmits the data symbol 1003 to be transmitted.
- the method can be determined based on “demodulatable transmission method information”.
- FIG. 14 shows an example of a frame of the transmission signal on the time axis when the communication device 1201 including the transmission device 900 of FIG. 12 or FIG. 13 transmits the transmission signal, for example.
- the horizontal axis represents time.
- the communication device 1201 including the transmission device 900 of FIGS. 12 and 13 transmits the first frame 1400_1, and then transmits the second frame 1400_2,..., The Nth frame 1400_N. think of. At this time, the first frame 1400_1, the second frame 1400_2,..., And the Nth frame 1400_N are assumed to have the frame configuration shown in FIG.
- the Nth frame 1400_N have the frame configuration of FIG. 10, for example, the transmission method such as the setting related to the color space (color system) of the data symbol 1003 Or, it is determined every several frames.
- the control information symbol 1002 includes transmission method information such as settings relating to the color space (color system).
- control information symbol 1002 By doing in this way, by demodulating the control information symbol 1002 and setting information of the color space (color system) of the data symbol 1003 transmitted by the communication device 1201 including the transmission device 900, the communication partner of the transmission device 900 Can know. At this time, there is an advantage that the control information symbol 1002 can be demodulated regardless of what color space (color system) the communication partner of the transmission apparatus 900 supports.
- the Nth frame 1400_N have the frame configuration of FIG. 11, for example, a transmission method such as a setting related to the color space (color system) of the data symbol 1003 Or, it is determined every several frames.
- the first control information symbol 1101 includes information on a transmission method such as settings related to a color space (color system).
- the setting information of the color space (color system) of the data symbol 1003 transmitted by the communication device 1201 including the transmission device 900 is demodulated from the first control information symbol 1101, thereby transmitting the transmission device 900.
- the first control information symbol 1101 can be demodulated regardless of what color space (color system) the communication partner of the transmission apparatus 900 supports.
- FIG. 15 shows an example of a frame of the transmission signal on the time axis when the communication device 1201 including the transmission device 900 of FIG. 12 or FIG. 13 transmits the transmission signal, for example.
- FIG. 15 shows an example of a frame configuration of a transmission signal on the time axis when a communication partner of the transmission apparatus 900 in FIG. 12 or FIG. 13 transmits a transmission signal.
- the communication device 1201 including the transmission device 900 of FIGS. 12 and 13 transmits the first frame 1400_1, and then transmits the second frame 1400_2,..., The Nth frame 1400_N.
- the first frame 1400_1, the second frame 1400_2,..., And the Nth frame 1400_N are assumed to have the frame configuration shown in FIG.
- FIG. 15 differs from FIG. 14 in that, for example, the communication device 1201 including the transmission device 900 has a frame # 1 (1500_1) between the first frame 1400_1 and the second frame 1400_2. ).
- the communication device 1201 including the transmission device 900 receives the frame # 1 (1500_1) transmitted by the communication partner of the transmission device 900, and the communication device 1201 including the transmission device 900 includes, for example, a frame Based on the information of # 1 (1500_1), the transmission method of the data symbol 1003 of the second frame 1400_2, for example, the setting of the color space (color system), the modulation method, the signal point arrangement, and the like are switched.
- the transmission method of the first frame 1400_1, the second frame 1400_2,..., The Nth frame 1400_N has been described in the description of FIG.
- the data symbol 1003 in FIGS. 10 and 11 is an area in which, for example, the modulation symbol generated by the mapping unit 904 in FIG. 9 is arranged.
- the receiving apparatus 200 in FIG. 7 needs to acquire information on the color space (color system) used to generate the modulation symbols in order to perform demapping of the received symbols.
- 9 transmits information indicating the color space (color system) of the modulation scheme used to generate the modulation symbol transmitted by data symbol 1003 in the control information symbol.
- the first modulation method uses four signal points arranged in the first color space (first color system), and the second modulation method uses the second color space (first color space).
- the transmission apparatus 900 in FIG. 9 generates the data symbol 1003 using either the first modulation scheme or the second modulation scheme.
- the receiving apparatus 200 of FIG. 7 may notify the color space (color system) used for demodulation of the received signal.
- the transmission apparatus 900 in FIG. 9 uses a modulation scheme used to generate the preamble 1001 and / or the control information symbol 1002 in FIG. 10 (or the preamble 1001 and / or the first control information symbol 1101 in FIG. 11), A case where the modulation scheme used for generating the data symbol 1003 is different will be described.
- the transmission apparatus 900 in FIG. 9 transmits a signal modulated using a modulation scheme in which brightness (luminance or amplitude) changes as a preamble and a control information symbol, and as a data symbol 1003, A signal modulated using a modulation scheme in which the color difference changes is transmitted.
- the receiving apparatus 200 of FIG. 7 can detect the preamble 1001 and detect the start of the frame by detecting a change in the brightness of the received signal. Therefore, for example, in order for the receiving apparatus 200 of FIG. 7 to detect the preamble 1001, the received signal is always converted into one or a plurality of color space signals (color system signals) to detect the preamble 1001. Compared with the case of performing the process, the process can be simplified. As for the simplification of this process, the same effect can be obtained when the receiving apparatus 200 of FIG. 7 receives the control information symbol 1002.
- FIG. 16 is an example of a detailed configuration of a receiving device 1600 that is a communication partner of the transmitting device 900 of FIG. 16 is an image sensor, for example, and receives an optical signal 1601 as an input.
- the receiving unit 1602 outputs the optical signal 1601 as, for example, three signals corresponding to RGB, that is, a signal group 1603.
- the timing estimation unit 1604 receives the signal group 1603 as an input. For example, when a transmission device that is a communication partner of the reception device 1600 transmits a modulated signal having the frame configuration of FIG. 10, signal detection is performed by detecting the preamble 1001. , And time synchronization is performed, and a timing estimation signal 1605 is output.
- the timing estimation unit 1604 detects the preamble 1001 to perform signal detection and time synchronization, and performs timing.
- An estimated signal 1605 is output.
- the control information symbol demodulator 1606 receives the signal group 1603 as an input. For example, when the transmitting apparatus that is the communication partner of the receiving apparatus 1600 transmits the modulation signal having the frame configuration shown in FIG. Information 1607 is output.
- control information symbol demodulation section 1606 receives signal group 1603 as an input and demodulates first control information symbol 1101. , Control information 1607 is output.
- control information 1607 includes color space information (color system information) of the data symbol 1003.
- the signal processing unit 1608 receives the signal group 1603, the timing estimation signal 1605, and the control information 1607 as input, extracts a data symbol 1003 from the signal group 1603 using the timing estimation signal 1605, and a color space included in the control information 1607. From the information (color system information), the color space and color system of the data symbol 1003 are recognized, the symbol configuration of the data symbol 1003 is recognized from the control information 1607, the data symbol 1003 is demodulated, and the received data 1609 is Output.
- the signal processing unit 1608 receives the signal group 1603, the timing estimation signal 1605, and the control information 1607 as inputs, extracts the second control information symbol 1102 and the data symbol 1003 from the signal group 1603 using the timing estimation signal 1605, and controls the control information.
- the color space and color system of the second control information symbol 1102 and the data symbol 1003 are recognized from the color space information (color system information) included in 1607.
- the second control information symbol 1102 is recognized. , Recognizes the symbol configuration of the data symbol 1003 from the information included in the control information 1607 and the second control information symbol 1102, demodulates the data symbol 1003, and outputs received data 1609.
- the receiving apparatus can demodulate the data included in the data symbol by performing the above operation. At this time, it is possible to obtain an effect that the receiving apparatus can accurately control the demodulation operation from the information on the color space (color system information) included in the control information symbol. For example, when a communication partner transmits a data symbol in a color space (color system) that is not supported by the receiver, the receiver obtains color space information (color system information) and demodulates the data symbol. It is possible not to perform. Thereby, the effect that the power consumption of a receiver can be reduced can be acquired.
- the color system is a systematic representation of colors (a system in which colors are represented by symbols and numerical values), and can be broadly classified into a developer system and a color mixture system.
- colors a system in which colors are represented by symbols and numerical values
- PCCS Nippon Color Research Coordination System: Practical Color Co-ordinate System
- CIE Commission International Color System, Eclairage
- CIE LUV CIE LUV
- CIE LAB International Lighting Commission
- Tristimulus values X, Y, and Z are obtained from the R (Red) signal, G (Green) signal, and B (Blue) signal. At this time, the tristimulus values of X, Y, and Z have a feature that they do not become negative at all wavelengths.
- the CIE XYZ color system represents colors using X, Y, and Z.
- tristimulus values X, Y, and Z normalized by the following equation are called chromaticity and are expressed as x, y, and z.
- FIG. 17 shows a color that can be perceived by humans in a two-dimensional plane, with the horizontal axis being x and the vertical axis being y. In FIG. 17, the horizontal axis is x and the vertical axis is y. The origin (0, 0) is 1700.
- FIG. 17 is called an xy chromaticity diagram, and the coordinates in the xy chromaticity diagram are called xy chromaticity coordinates.
- FIG. 18 is a diagram for explaining a modulation scheme having four signal points in the xy chromaticity diagram. As in FIG. 17, the horizontal axis is x and the vertical axis is y. Four black circles in FIG. 18 represent signal points.
- mapping section 904 has received bit bi0 and bit bi1 in symbol number i. Then, mapping section 904 performs mapping of the modulation scheme having the four signal points in FIG. 18 on bit bi0 and bit bi1.
- an optical signal of symbol number i is generated from xi, which is the value of x of symbol number i, and yi, which is the value of y of symbol number i.
- This processing is performed by the signal processing unit 906 and the transmission unit. 908 may be performed at either time.
- control information 1607 output from the control information symbol demodulator 1606 in FIG. 16 includes information indicating that “mapping based on the modulation scheme based on FIG. 18 has been performed”.
- the signal processing unit 1608 obtains information indicating that “mapping based on the modulation scheme based on FIG. 18 has been performed”, and starts the operation of demapping (demodulation) based on the modulation scheme based on FIG. It will be.
- the signal processing unit 1608 calculates the estimated values x ′ and y of the x signal from the R signal, the G signal, and the B signal. y 'is obtained. (An estimated value z ′ of z may be obtained.)
- the signal processing unit 1608 uses the X estimated value x from the X signal, the Y signal, and the Z signal. 'Estimated value y of y' is obtained. (An estimated value z ′ of z may be obtained.)
- the three signals in the sRGB format are represented as an R [sRGB] signal, a G [sRGB] signal, and a B [sRGB] signal.
- the reception unit 1602 outputs an R [sRGB] signal, a G [sRGB] signal, and a B [sRGB] signal as the signal group 1603, the signal processing unit 1608 includes an R [sRGB] signal, From the G [sRGB] signal and the B [sRGB] signal, the estimated value x ′ of x and the estimated value y ′ of y are obtained. (An estimated value z ′ of z may be obtained.)
- the three signals in AdobeRGB format are represented as R [A-RGB] signal, G [A-RGB] signal, and B [A-RGB] signal.
- the receiving unit 1602 outputs the R [A-RGB] signal, the G [A-RGB] signal, and the B [A-RGB] signal as the signal group 1603, the signal processing unit 1608 From the [A-RGB] signal, the G [A-RGB] signal, and the B [A-RGB] signal, the estimated value x ′ of x and the estimated value y ′ of y are obtained. (An estimated value z ′ of z may be obtained.)
- the signal processing unit 1608 obtains the estimated value xi 'of the symbol number i and the estimated value yi' of the symbol number i by performing the above-described operation.
- FIG. 19 shows the relationship between the four signal points 1801, 1802, 1803, and 1804 and the coordinates of (xi ′, yi ′) in the xy chromaticity diagram.
- reference numeral 1900 denotes a reception point of the symbol number i having the coordinates (xi ′, yi ′) in the xy chromaticity diagram.
- the log likelihood ratio (or log likelihood) of each bit (bi0, bi1) may be obtained, or the estimated value bi0 ′ of bi0, the estimated value bi1 of bi1. 'You may ask. That is, a hard decision may be made or a soft decision may be made.
- the above is an example of modulation and demodulation of a modulation method in which signal points are arranged on the xy chromaticity diagram.
- the modulation scheme in the case of four signal points has been described.
- the number of signal points may not be four, and for example, a modulation scheme having two signal points may be used.
- it may be a modulation scheme having 8 signal points, a modulation scheme having 16 signal points, a modulation scheme having 64 signal points, A modulation scheme having 256 signal points may be used. Therefore, the number of signal points is not limited to four.
- the modulation method may be a two-dimensional modulation scheme in which signal points are arranged instead of the xy chromaticity diagram.
- a modulation scheme in which signal points are arranged with respect to the u'v 'uniform chromaticity diagram defined by CIE may be used.
- signal points may be arranged in three dimensions instead of two dimensions.
- a modulation scheme may be used in which three dimensions are formed by tristimulus values X, Y, and Z, and signal points are arranged in these three dimensions.
- FIG. 20 shows an example when signal point arrangement is performed in three dimensions formed by stimulation values X, Y, and Z.
- X axis there are an X axis, a Y axis, and a Z axis.
- signal points are arranged at eight vertices of a cube or a rectangular parallelepiped formed on the X axis, the Y axis, and the Z axis.
- signal points are indicated by black circles.
- 3 bits can be transmitted per symbol. For example, as in FIG. 18, input bits are given as b0, b1, and b2.
- signal point 2000 in FIG. 20 will be described as an example.
- Signal point 2000 is assumed to be signal point # 0.
- the signal point 2000 that is, the X value of the signal point # 0, that is, the value of X0 is 0, the Y value of the signal point # 0, that is, Y0 is 0, and the Z value of the signal point # 0. That is, it is assumed that the value of Z0 is 0.
- mapping is performed on signal point 2000, that is, signal point # 0.
- signal point # 0 has been described as an example.
- the coordinates of (X, Y, Z) and [b0, b1, b2] are assigned to signal points # 1 to # 7, respectively. It has been broken. Therefore, signal point mapping is performed based on the input bits b0, b1, and b2, and output signals X, Y, and Z are obtained.
- mapping unit 904 in FIG. 9 performs three-dimensional mapping
- signal processing unit 1608 in FIG. 16 performs three-dimensional demapping (soft decision, hard decision). .
- the modulation scheme in the case where there are eight signal points has been described.
- the number of signal points may not be eight, for example, a modulation scheme having two signal points may be used. It may be a modulation scheme with 4 signal points, a modulation scheme with 16 signal points, a modulation scheme with 64 signal points, or 256. It may be a modulation scheme having the signal points. Therefore, the number of signal points is not limited to eight.
- the signal point may be arranged in any way in the three-dimensional space.
- the modulation method in which the signal points are arranged in the three dimensions formed by the stimulus values X, Y, and Z has been described, but the three dimensions may be formed by another signal. That is, the following method may be used.
- a modulation system may be used in which a three-dimensional shape is formed by the R signal, the G signal, and the B signal, and signal points are arranged in the three dimensions.
- R [sRGB], G [sRGB], and B [sRGB] May be a modulation method in which a three-dimensional signal is formed with a signal point arrangement in the three-dimensional signal.
- R [A-RGB] signal When three signals in AdobeRGB format are R [A-RGB] signal, G [A-RGB] signal, and B [A-RGB] signal, R [A-RGB] signal, G [ A modulation method may be used in which a three-dimensional shape is formed by the A-RGB] signal and the B [A-RGB] signal, and signal points are arranged in the three-dimensional manner.
- the data transmission speed can be improved by performing data transmission using a modulation method in which signal points are arranged two-dimensionally or three-dimensionally.
- mapping section 904 receives bit bi0, bit bi1, and bit bi2 as input for symbol number i. Then, the mapping unit 904 performs modulation scheme mapping having eight signal points as shown in FIG. 20 on the bit bi0, the bit bi1, and the bit bi2.
- bi1, bi2] [0, 0, 0]
- the value of Xi is 0.2
- the value of Yi is 0.2
- the value of Zi is 0.2
- the transmission apparatus transmits an optical modulation signal by the method as described above, an example of the configuration of the reception apparatus and an example of the reception operation are as described in the first embodiment.
- a signal point having an R [sRGB] value of 0.2, a G [sRGB] value of 0.2, and a B [sRGB] value of 0.2 is referred to as a signal point 2050, and R [sRGB], G
- R [sRGB] G
- B [sRGB] B
- a signal point having an R [sRGB] value of 0.2, a G [sRGB] value of 0.2, and a B [sRGB] value of 0.8 is referred to as a signal point 2060, and R [sRGB] and G [sRGB]. ],
- mapping section 904 receives bit bi0, bit bi1, and bit bi2 as input for symbol number i. Then, the mapping unit 904 performs modulation scheme mapping having eight signal points as shown in FIG. 20 on the bit bi0, the bit bi1, and the bit bi2.
- the mapping unit 904 performs the mapping as described above.
- the R [sRGB] value of the symbol number i is R [sRGB] i
- the G [sRGB] value of the symbol number i is G [sRGB] i
- the B [sRGB] value of the symbol number i is B [ sRGB] i.
- the transmission apparatus transmits an optical modulation signal by the method as described above, an example of the configuration of the reception apparatus and an example of the reception operation are as described in the first embodiment.
- signal point arrangement is performed based on R [A-RGB], G [A-RGB], and B [A-RGB].
- the stimulus value X shown in FIG. 20 is replaced with R [A-RGB], the stimulus value Y is replaced with G [A-RGB], and the stimulus value Z is replaced with B [A-RGB].
- the signal point arrangement should be considered.
- a signal point having a value of R [A-RGB] of 0.2, a value of G [A-RGB] of 0.2, and a value of B [A-RGB] of 0.2 is referred to as a signal point 2070.
- a signal point having a value of R [A-RGB] of 0.2, a value of G [A-RGB] of 0.8, and a value of B [A-RGB] of 0.2 is referred to as a signal point 2071, and R [
- a signal point having a value of R [A-RGB] of 0.8, a value of G [A-RGB] of 0.8, and a value of B [A-RGB] of 0.2 is referred to as a signal point 2072, and R [
- a signal point having a value of R [A-RGB] of 0.8, a value of G [A-RGB] of 0.2, and a value of B [A-RGB] of 0.2 is referred to as a signal point 2073, and R [
- a signal point having a value of R [A-RGB] of 0.2, a value of G [A-RGB] of 0.2, and a value of B [A-RGB] of 0.8 is referred to as a signal point 2080, and R [
- a signal point having a value of R [A-RGB] of 0.2, a value of G [A-RGB] of 0.8, and a value of B [A-RGB] of 0.8 is called a signal point 2081, and R [
- a signal point having a value of R [A-RGB] of 0.8, a value of G [A-RGB] of 0.8, and a value of B [A-RGB] of 0.8 is referred to as a signal point 2082, and R [
- mapping section 904 receives bit bi0, bit bi1, and bit bi2 as input for symbol number i. Then, the mapping unit 904 performs modulation scheme mapping having eight signal points as shown in FIG. 20 on the bit bi0, the bit bi1, and the bit bi2.
- the mapping unit 904 performs the mapping as described above.
- R [A-RGB] i is the value of R [A-RGB] i of symbol number i
- G [A-RGB] i is the value of G [A-RGB] of symbol number i
- B is the symbol number i.
- the value of [A-RGB] is represented as B [A-RGB] i.
- the transmission apparatus transmits an optical modulation signal by the method as described above, an example of the configuration of the reception apparatus and an example of the reception operation are as described in the first embodiment.
- mapping method in the sRGB format and the mapping method in the AdobeRGB format have been described.
- other color system and color space methods are the same as in the present embodiment. It is possible to perform three-dimensional mapping.
- Embodiment 5 In this embodiment, a structure of a receiving device different from the receiving device described in Embodiment 1 will be described.
- FIG. 21 shows an example of a frame configuration of an optical modulation signal transmitted by the transmission apparatus of FIGS. 6 and 9, for example, and the horizontal axis is time.
- a preamble 2101 is a symbol for a receiving apparatus that is a communication partner of a transmitting apparatus to perform signal detection and time synchronization.
- the symbol 2102 for transmitting information relating to the color space or color system transmits, for example, information relating to the color space or color system used for transmission of the “control information symbol 2103, data symbol 2104 in FIG. 21”. It is a symbol for.
- the control information symbol 2103 is a symbol including control information such as an error correction coding scheme and a modulation scheme used to generate the data symbol 2104, for example.
- the data symbol 2104 is a symbol for transmitting data.
- FIG. 22 shows an example of the configuration of a receiving apparatus that is a communication partner of the transmitting apparatus of FIGS.
- a characteristic point of FIG. 22 is that the color space or color system of the reception signal 2203 output from the image sensor 2202 is fixed.
- the signal of the reception signal 2203 may be composed of one or more signals.
- the received signal 2203 may be composed of “a signal based on red, a signal based on green, and a signal based on blue” or “a signal based on cyan, a signal based on yellow, and a signal based on magenta.
- the output signal of the image sensor may be composed of one or more signals, for example, “a signal based on red, a signal based on green, a signal based on blue” ⁇ May be composed of cyan-based signal, yellow-based signal, magenta-based signal '' and ⁇ red-based signal, green-based signal, blue-based signal, cyan-based signal '' It may consist of a signal, a signal based on yellow, and a signal based on magenta.
- the color system of the received signal 2203 that is the output signal of the image sensor 2202 is fixed to sRGB.
- the information demodulator 2204 for the color space or color system receives the received signal 2203 as an input, detects and demodulates the symbol 2102 for transmitting information about the color space or color system in FIG. System information 2205 is output.
- the color space or color system conversion unit 2206 receives the received signal 2203 and information 2205 related to the color space or color system, and is included in the received signal 2203 based on the information 2205 related to the color space or color system.
- the control information symbol 2103 and the data symbol 2104 are converted in the color space or color system, and the color space or color system converted symbol 2207 is output.
- the color space or color system conversion unit 2206 does not perform color space or color system conversion.
- the symbol 2207 after the system conversion becomes a control information symbol 2103 and a data symbol 2104 based on sRGB.
- the color space or color system conversion unit 2206 changes the color system of the control information symbol 2103 and the data symbol 2104 from sRGB to Adobe RGB. Convert to Therefore, the symbol 2207 after color space or color system conversion is a control information symbol 2103 and a data symbol 2104 based on Adobe RGB.
- the control symbol demodulator 2208 receives the information 2205 regarding the color space or color system and the symbol 2207 after the color space or color system conversion as input, and based on the information 2205 regarding the color space or color system, the control information in FIG. Symbol 2103 is demodulated and control information 2209 is output.
- the demodulator 2210 receives the information 2205 regarding the color space or color system, the symbol 2207 after the color space or color system conversion, and the control information 2209 as input, and stores the information 2205 regarding the color space or color system and the control information 2209. Based on this, the data symbol 2104 included in the symbol 2207 after color space or color system conversion is demodulated, and received data 2211 is output.
- the color system of the received signal 2203 that is an output signal from the image sensor 2202 can be set to either sRGB or Adobe RGB.
- the image sensor 2202 has an input signal other than the optical signal 2201 (however, not shown in FIG. 22), and the color system can be set to sRGB or Adobe RGB by the input signal. To do.
- the image sensor 2202 outputs the reception signal 2203 set to either sRGB or Adobe RGB.
- the information demodulator 2204 for the color space or color system receives the received signal 2203 as an input, detects and demodulates the symbol 2102 for transmitting information about the color space or color system in FIG. System information 2205 is output.
- the color space or color system conversion unit 2206 receives the received signal 2203 and information 2205 related to the color space or color system, and is included in the received signal 2203 based on the information 2205 related to the color space or color system.
- the control information symbol 2103 and the data symbol 2104 are converted in the color space or color system, and the color space or color system converted symbol 2207 is output.
- the image sensor 2202 receives information 2205 regarding the color space or color system, and the information 2205 regarding the color space or color system is “sRGB” or “Adobe RGB”. , The image sensor 2202 outputs a color system received signal 2203 indicated by the information 2205 regarding the color space or color system.
- the image sensor 2202 is either “sRGB” or “Adobe RGB”.
- the color signal received signal 2203 is output.
- the color space or color system conversion unit 2206 receives the received signal 2203 and information 2205 related to the color space or color system, and is included in the received signal 2203 based on the information 2205 related to the color space or color system.
- the control information symbol 2103 and the data symbol 2104 are converted in the color space or color system, and the color space or color system converted symbol 2207 is output.
- conversion of the color space or color system of the control information symbol 2103 and the data symbol 2104 included in the received signal 2203 may be performed. May not be done.
- the control symbol demodulator 2208 receives the information 2205 regarding the color space or color system and the symbol 2207 after the color space or color system conversion as input, and based on the information 2205 regarding the color space or color system, the control information in FIG. Symbol 2103 is demodulated and control information 2209 is output.
- the demodulator 2210 receives the information 2205 regarding the color space or color system, the symbol 2207 after the color space or color system conversion, and the control information 2209 as input, and stores information 2205 regarding the color space or color system and the control information 2209. Based on this, the data symbol 2104 included in the symbol 2207 after color space or color system conversion is demodulated, and received data 2211 is output.
- the preamble 2101 can be detected and time-synchronized by a receiving device, which is a communication partner of the transmitting device, with a luminance signal (brightness signal, signal amplitude) included in the received signal. Therefore, as described above, the preamble 2101 is assumed to be a symbol based on any one of a PPM scheme such as 4PPM, a scheme to which Manchester encoding scheme is applied, an ASK scheme, a BPSK scheme, and a PAM scheme.
- the preamble 2101 can be identified regardless of the color space and color system supported by the receiving apparatus that is the communication partner of the transmitting apparatus, that is, the corresponding color space. Regardless of the color system, the receiving apparatus which is the communication partner of the transmitting apparatus can obtain an effect that signal detection and time synchronization can be performed from the preamble 2101.
- the symbol 2102 for transmitting information relating to the color space or the color system can be demodulated by a receiving device, which is a communication partner of the transmitting device, with a luminance signal (brightness signal, signal amplitude) included in the received signal. It is assumed to be a symbol. Therefore, as described above, the symbol 2102 for transmitting information related to the color space or the color system can be any one of a PPM scheme such as PPM, a scheme to which Manchester encoding scheme is applied, an ASK scheme, a BPSK scheme, and a PAM scheme. It is a symbol based on crab.
- the receiving device that is the communication partner of the transmitting device can obtain information included in the symbol 2102 for transmitting information about the color space or the color system. Obtainable.
- the receiving apparatus which is the communication partner of the transmitting apparatus, determines whether it is possible to demodulate the data symbol 2104 by obtaining the symbol 2102 for transmitting information relating to the color space or the color system. be able to. Therefore, by obtaining the symbol 2102 for transmitting information related to the color space or the color system, the receiving apparatus can accurately determine whether or not to perform the demodulation operation of the data symbol 2104, and control this. As a result, the receiving apparatus does not need to consume power consumption unnecessarily.
- the image sensor related unit 2301 outputs a reception signal 2302 of a specific color space and color system (assuming that the color space and color system of the reception signal 2302 cannot be changed). Therefore, as shown in FIG. 22, a configuration in which a color space or color system conversion unit 2206 is installed is conceivable.
- the image sensor related unit 2301 outputs the received signal 2302 of the color space and color system selected by the control signal 2401. However, it is assumed that the color space and color system of the received signal 2302 correspond only to the color space and color system that the image sensor related unit 2301 supports in advance. Therefore, as shown in FIG. 22, a configuration in which a color space or color system conversion unit 2206 is installed is conceivable.
- the image sensor related unit 2301 in FIG. 24 can set the color space and the color system.
- the image sensor related unit 2301 in FIG. 24 can cope with a desired color space and color system.
- the image sensor related unit 2301 in FIG. 24 outputs the received signal 2302 corresponding to the desired color space and color system specified by the control signal 2401. .
- the transmission apparatus in FIG. 6 transmits an optical modulation signal based on the four signal points in the xy chromaticity diagram in FIG. Note that the specific description of FIG. 18 is omitted since it has already been performed in the first embodiment.
- FIG. 25 shows an example of the configuration of a receiving apparatus that receives an optical modulation signal transmitted by the transmitting apparatus of FIG. 25 that operate in the same manner as in FIG. 22 are denoted by the same reference numerals and description thereof is omitted.
- the signal processing unit 2601 has a function of “color space or color system conversion”, which is a function of the color space or color system conversion unit 2206 of FIG. 22, and an exposure adjustment function and white balance adjustment. It shall have a function.
- the signal processing unit 2601 has an exposure adjustment function and a white balance adjustment function.
- the exposure adjustment function and the white balance adjustment function are provided by the image sensor. It may be the configuration that has.
- the exposure adjustment may be automatically performed by the signal processing unit 2601 or the image sensor, or may be set by a user using the receiving apparatus.
- the white balance adjustment may be automatically performed by the signal processing unit 2601 and the image sensor, or may be set by a user using the receiving apparatus.
- FIG. 26 shows an example of the position of the reception signal point in the xy chromaticity diagram in the demodulator 2210 after exposure adjustment and white balance adjustment in the signal processing unit 2601 in FIG.
- the horizontal axis is x
- the vertical axis is y.
- reference numerals 2701, 2702, 2703, and 2704 indicate received signal points.
- the transmission apparatus has transmitted the signal at signal point 1802
- the signal processing unit 2601 has 2704 as the true reception signal point obtained after exposure adjustment and white balance adjustment.
- the reception device may have a reception signal point arrangement different from the signal point arrangement used by the transmission device. (As shown in FIG. 26, “where the four reception signal points exist” changes.) This is a phenomenon that occurs because the reception device receives light from the surrounding environment. .
- the reception signal point estimation unit 2602 of the reception apparatus in FIG. 25 needs to know the positions of the four true reception signal points in FIG.
- FIG. 27 shows an example of the frame structure of an optical modulation signal transmitted by the transmission apparatus.
- the same reference numerals are given to components that operate in the same manner as in FIG. 21, and the description has already been given. Description is omitted.
- the reference symbol 2801 is arranged before the data symbol 2104 is transmitted.
- a reference symbol it is not limited to this name.
- it may be called a pilot symbol or a reference signal.
- FIG. 28 shows an example of the configuration of the reference symbol 2801 in FIG.
- the transmitting apparatus first transmits an optical modulation signal corresponding to the signal point 1801 in FIG. 18 (2901).
- the transmitter then An optical modulation signal corresponding to the signal point 1802 in FIG. 18 is transmitted (2902), An optical modulation signal corresponding to the signal point 1803 in FIG. 18 is transmitted (2903), An optical modulation signal corresponding to the signal point 1804 in FIG. 18 is transmitted (2904), An optical modulation signal corresponding to the signal point 1801 in FIG. 18 is transmitted (2905), An optical modulation signal corresponding to the signal point 1802 in FIG. 18 is transmitted (2906), An optical modulation signal corresponding to the signal point 1803 in FIG.
- the reference symbol 2801 is configured.
- the configuration method of the reference symbol 2801 is not limited to the configuration of FIG.
- the symbol of each signal point is always transmitted in the reference symbol 2801, that is, “symbol of signal point 1801” and “symbol of signal point 1802” are transmitted. It is important to include “transmission”, “transmit symbol of signal point 1803”, and “transmit symbol of signal point 1804”.
- the received signal point estimation unit 2602 in FIG. 25 receives as input information 2205 regarding color space or color system, signal 2207 after signal processing, and control information 2209.
- the received signal point estimation unit 2602 knows the color space and color system of the signal 2207 after signal processing from the information 2205 on the color space or color system. Further, reception signal point estimation section 2602 knows the modulation scheme (or the number of modulation scheme signal points) of data symbol 2104 from control information 2209.
- the reception signal point estimation unit 2602 starts estimation of the position of the (true) reception signal point in the xy chromaticity diagram based on these pieces of information.
- the received signal point estimation unit 2602 obtains a (true) received signal point 2701 from, for example, the symbol of the signal point 1801 transmitted by the transmitting device, for example, 2901, 2905,.
- reception signal point estimation unit 2602 obtains a (true) reception signal point 2702 from the symbol of the signal point 1802 transmitted by the transmission device, for example, 2902, 2906,... Become.
- the reception signal point estimation unit 2602 obtains a (true) reception signal point 2703 from the symbol of the signal point 1803 transmitted by the transmission device, for example, 2903, 2907,...
- the reception signal point estimation unit 2602 obtains a (true) reception signal point 2704 from, for example, the symbol of the signal point 1804 transmitted by the transmission device, for example, 2904, 2908,.
- the reception signal point estimation unit 2602 outputs information on the reception signal points 2701, 2702, 2703, and 2704 as the reception signal point signal 2603.
- the demodulator 2210 receives as input information 2205 relating to the color space or color system, signal 2207 after signal processing, control information 2209, and received signal point signal 2603.
- the demodulation unit 2210 sets the color space or color system from the information 2205 on the color space or color system and the control information 2209, extracts the data symbol 2104 in FIG. 27, and starts demodulation of the data symbol 2104. To do.
- FIG. 29 is an xy chromaticity diagram, the horizontal axis is x, and the vertical axis is y.
- 3001 is a reception signal point of a data symbol, and this position is obtained from the signal 2207 after the signal processing of FIG.
- the log likelihood ratio of b0 and the log likelihood ratio of b1 are obtained by using (true) received signal points 2701, 2702, 2703, 2704 and received signal points 3001 of data symbols. Become.
- error correction decoding is performed to obtain received data.
- the receiving apparatus can obtain an effect of being able to obtain high data reception quality.
- a communication mode may exist in white balance adjustment. Further, a communication mode may exist in exposure adjustment.
- the transmission apparatus performs mapping as shown in FIG.
- the reception apparatus may be in a reception state as shown in FIG. 26, and the data reception quality may be poor.
- the signal processing unit 2601 has a white balance adjustment mode for communication.
- this mode is set, the state of the reception signal point is improved and the reception quality of data is improved (for communication).
- the white balance adjustment mode the white balance is adjusted so that the reception signal point state improves the reception quality of data).
- the signal processing unit 2601 has an exposure adjustment mode for communication.
- this mode is set, the state of the reception signal point is improved and the reception quality of data is improved (communication).
- the exposure adjustment mode the exposure signal point is adjusted so that the reception quality of data is improved).
- the signal processing unit 2601 of the receiving device in FIG. 25 when the mode is other than the white balance adjustment mode for communication and / or the mode other than the exposure adjustment mode for communication, Assume that the reception state is as shown in FIG. However, when the signal processing unit 2601 of the receiving apparatus in FIG. 25 is set to the white balance adjustment mode for communication and the exposure adjustment mode for communication, for example, white is set so that the communication state shown in FIG. The balance and exposure are adjusted, that is, the white balance and exposure are adjusted so that the reception state is good. In this case, the “image / moving image” is not necessarily an “image / moving image” that does not feel uncomfortable for humans.
- the signal processing unit 2601 may have an input signal for mode setting from the outside.
- the user sets the mode for communication as a mode for communication, and this setting information is input to the signal processing unit 2601 as an input signal for mode setting, and the signal processing unit 2601 White balance adjustment and exposure adjustment will be performed.
- the transmission device when the transmission device performs two-dimensional mapping and transmits an optical modulation signal, the transmission device transmits three-dimensional mapping as described in other embodiments and transmits the optical modulation signal. In either case, the same can be carried out.
- mapping is performed as shown in FIG. 18 using the xy chromaticity diagram
- mapping is performed using another color space or color system instead of the xy chromaticity diagram. It is possible to carry out the same in the same way.
- an example in which there are four signal points in the xy chromaticity diagram is described.
- the number of existing signal points is not limited to four. When there are two signal points, that is, when performing 3 bit transmission, “when there are 16 signal points, that is, when performing 4 bit transmission”, and when there are 64 signal points, That is, the case of “when performing 6-bit transmission” or the like can be similarly performed.
- the eight signal points are the first signal point, the second signal point, the third signal point, the fourth signal point, the fifth signal point, the sixth signal point, Signal points, seventh signal points, and eighth signal points
- the symbols of the respective signal points are always transmitted, that is,“ first signal ” "Send symbol of point”, “Send symbol of second signal point”, “Send symbol of third signal point”, “Send symbol of fourth signal point”, “Send symbol of fifth signal point”
- “send symbol”, “send symbol at sixth signal point”, “send symbol at seventh signal point”, “send symbol at eighth signal point” are included. .
- the transmission method as shown in FIG. 28 has been described as an example of the method of transmitting the reference symbol 2801 in FIG. At this time, a method is conceivable in which the transmitting apparatus and the receiving apparatus share the order of transmission of signal points in FIG. 28 and the number of symbols to be transmitted.
- the transmitting apparatus and the receiving apparatus may be a method in which the receiving apparatus estimates these without sharing the transmission order of the signal points in FIG. 28 and the number of symbols to be transmitted.
- two-dimensional mapping has been described as an example, but the same can be performed when three-dimensional mapping is performed.
- the transmission device in FIG. 6 performs “three-dimensional signal point arrangement with stimulation values X, Y, and Z as shown in FIG. 30. It is assumed that an optical modulation signal based on the eight signal points is transmitted. As shown in FIG. 30, the axes of stimulus value X, stimulus value Y, and stimulus value Z are set, and the coordinates of stimulus value X, stimulus value Y, and stimulus value Z of eight signal points. Since the relationship between each signal point and the transmitted 3 bits, bit b0, bit b1, and bit b2 is as described in the second embodiment, the description thereof is omitted.
- FIG. 25 shows an example of the configuration of a receiving apparatus that receives an optical modulation signal transmitted by the transmitting apparatus of FIG. 25 that operate in the same manner as in FIG. 22 are denoted by the same reference numerals and description thereof is omitted.
- the signal processing unit 2601 has a function of “color space or color system conversion”, which is a function of the color space or color system conversion unit 2206 of FIG. 22, and an exposure adjustment function and white balance adjustment. It shall have a function.
- the signal processing unit 2601 has an exposure adjustment function and a white balance adjustment function.
- the exposure adjustment function and the white balance adjustment function are provided by the image sensor. It may be the configuration that has.
- the exposure adjustment may be automatically performed by the signal processing unit 2601 or the image sensor, or may be set by a user using the receiving apparatus.
- the white balance adjustment may be automatically performed by the signal processing unit 2601 and the image sensor, or may be set by a user using the receiving apparatus.
- an example of the position of the reception signal point in the space formed by the stimulation values X, Y, and Z in the demodulation unit after exposure adjustment and white balance adjustment is performed. 31.
- eight black circles indicate reception signal points.
- the transmission device has transmitted a signal at signal point 2010, and the signal processing unit 2601 obtains after adjusting exposure and adjusting white balance.
- the signal point when it is assumed that there is no noise component (hereinafter referred to as a true signal point) is 3210.
- the value of X is 0.3
- the value of Y is 0.3
- the transmission device has transmitted a signal at signal point 2011, and after signal processing unit 2601 performs exposure adjustment and white balance adjustment.
- the obtained signal point (hereinafter referred to as a true signal point) assuming that there is no noise component is 3211.
- the value of X is 0.1 and the value of Y is 0.8.
- the transmission apparatus has transmitted the signal at the signal point 2012, and the signal processing unit 2601 is obtained after performing exposure adjustment and white balance adjustment, Assuming that there is no noise component, the signal point (hereinafter referred to as a true signal point) is 3212.
- the value of X is 0.7
- the value of Y is 0.5
- the transmission device has transmitted the signal at signal point 2013, and the signal processing unit 2601 is obtained after adjusting exposure and adjusting white balance.
- the signal point (hereinafter referred to as a true signal point) is 3213.
- the value of X is 0.75
- the value of Y is 0.1
- the transmission device has transmitted a signal at signal point 2020, and is obtained after adjusting exposure and white balance in the signal processing unit 2601.
- the signal point (hereinafter referred to as a true signal point) is 3220.
- the value of X is 0.1
- the value of Y is 0.1
- the transmission apparatus has transmitted the signal at the signal point 2021, and the signal processing unit 2601 is obtained after adjusting the exposure and adjusting the white balance, Assuming that there is no noise component, the signal point (hereinafter referred to as a true signal point) is 3221.
- the value of X is 0.2
- the value of Y is 0.75
- This is a signal point having a value of 0.75, that is, the coordinates of the X, Y, Z coordinate system are represented as (X, Y, Z) (0.2, 0.75, 0.75).
- the transmission apparatus has transmitted the signal at the signal point 2022, and the signal processing unit 2601 is obtained after adjusting exposure and adjusting white balance, Assuming that there is no noise component, the signal point (hereinafter referred to as a true signal point) is 3222.
- the value of X is 0.9
- the value of Y is 0.9
- the transmission apparatus has transmitted the signal at the signal point 2023, and the signal processing unit 2601 is obtained after adjusting the exposure and adjusting the white balance, Assuming that there is no noise component, the signal point (hereinafter referred to as a true signal point) is 3223.
- the value of X is 0.75
- the value of Y is 0.2
- This is a signal point having a value of 0.7, that is, the coordinates of the X, Y, Z coordinate system are expressed as (X, Y, Z) (0.75, 0.2, 0.7).
- the reception device may have a reception signal point arrangement different from the signal point arrangement used by the transmission device. (As shown in FIG. 31, “where the eight reception signal points are located” changes.) This is a phenomenon that occurs because the reception device receives light from the surrounding environment. .
- the reception signal point estimation unit 2602 of the reception device in FIG. 25 needs to know the positions of the eight true reception signal points in FIG.
- FIG. 27 shows an example of the frame structure of an optical modulation signal transmitted by the transmission apparatus.
- the same reference numerals are given to components that operate in the same manner as in FIG. 21, and the description has already been given. Description is omitted.
- the reference symbol 2801 is arranged before the data symbol 2104 is transmitted.
- a reference symbol it is not limited to this name.
- it may be called a pilot symbol or a reference signal.
- FIG. 32 shows an example of the configuration of the reference symbol 2801 in FIG.
- the transmitting apparatus first transmits an optical modulation signal corresponding to the signal point 2010 in FIG. 30 (3301).
- the transmitter then An optical modulation signal corresponding to the signal point 2011 in FIG. 30 is transmitted (3302),
- An optical modulation signal corresponding to the signal point 2012 in FIG. 30 is transmitted (3303),
- An optical modulation signal corresponding to the signal point 2013 in FIG. 30 is transmitted (3304),
- An optical modulation signal corresponding to the signal point 2020 in FIG. 30 is transmitted (3305),
- An optical modulation signal corresponding to the signal point 2021 in FIG. 30 is transmitted (3306),
- the reference symbol 2801 is configured.
- the configuration method of the reference symbol 2801 is not limited to the configuration of FIG.
- the symbol of each signal point is always transmitted in the reference symbol 2801, that is, “symbol of signal point 2010”, “symbol of signal point 2011” “Send”, “Send symbol at signal point 2012”, “Send symbol at signal point 2013”, “Send symbol at signal point 2020”, “Send symbol at signal point 2021”, “Symbol at signal point 2022” It is important that “transmission” and “transmit symbol of signal point 2023” are included.
- the received signal point estimation unit 2602 in FIG. 25 receives as input information 2205 regarding color space or color system, signal 2207 after signal processing, and control information 2209.
- the received signal point estimation unit 2602 knows the color space and color system of the signal 2207 after signal processing from the information 2205 on the color space or color system. Further, reception signal point estimation section 2602 knows the modulation scheme (or the number of modulation scheme signal points) of data symbol 2104 from control information 2209.
- the reception signal point estimation unit 2602 starts estimation of the position of the (true) reception signal point in three dimensions formed by the stimulus values X, Y, and Z, for example.
- the reception signal point estimation unit 2602 obtains a (true) reception signal point 3210 from the symbol of the signal point 2010 transmitted by the transmission device, for example, 3301 in FIG.
- reception signal point estimation unit 2602 obtains a (true) reception signal point 3211 from, for example, the symbol of the signal point 2011 transmitted by the transmission device, for example, 3302 in FIG.
- the reception signal point estimation unit 2602 obtains a (true) reception signal point 3212 from the symbol of the signal point 2012 transmitted by the transmission device, for example, 3303 in FIG.
- the reception signal point estimation unit 2602 obtains a (true) reception signal point 3213 from the symbol of the signal point 2013 transmitted by the transmission device, for example, 3304 in FIG.
- the reception signal point estimation unit 2602 obtains a (true) reception signal point 3220 from the symbol of the signal point 2020 transmitted by the transmission device, for example, 3305 in FIG.
- the reception signal point estimation unit 2602 obtains a (true) reception signal point 3221 from, for example, the symbol of the signal point 2021 transmitted by the transmission device, for example, 3306 in FIG.
- the reception signal point estimation unit 2602 obtains a (true) reception signal point 3222 from, for example, the symbol of the signal point 2022 transmitted by the transmission device, for example, 3307 in FIG.
- the reception signal point estimation unit 2602 obtains a (true) reception signal point 3223 from, for example, the symbol of the signal point 2023 transmitted by the transmission device, for example, 3308 in FIG.
- the received signal point estimation part 2602 outputs the information of the received signal points 3210, 3211, 3212, 3213, 3220, 3221, 3222, 3223 as the received signal point signal 2603.
- the demodulator 2210 receives as input information 2205 relating to the color space or color system, signal 2207 after signal processing, control information 2209, and received signal point signal 2603.
- the demodulation unit 2210 sets the color space or color system from the information 2205 on the color space or color system and the control information 2209, extracts the data symbol 2104 in FIG. 27, and starts demodulation of the data symbol 2104. To do.
- FIG. 33 shows a three-dimensional space formed by stimulus values X, Y, and Z.
- 3401 is a reception signal point of a data symbol, and this position is obtained from the signal 2207 after the signal processing of FIG.
- the demodulation unit 2210 performs demodulation using the (true) received signal points 3210, 3211, 3212, 3213, 3220, 3221, 3222, 3223 and the received signal points 3401 of the data symbols.
- error correction decoding is performed to obtain received data.
- the receiving apparatus can obtain an effect of being able to obtain high data reception quality.
- mapping is performed as shown in FIG. 30 using a three-dimensional space formed with stimulation values X, Y, and Z.
- 3 formed with stimulation values X, Y, and Z Even when mapping is performed using a color space or color system in a three-dimensional space using other parameters instead of the dimensional space, the same can be implemented.
- mapping using the three-dimensional space formed by the three signals in the sRGB format described in the third embodiment, the R [sRGB] signal, the G [sRGB] signal, and the B [sRGB] signal is performed.
- mapping using the three-dimensional space formed with the three signals RGBRGB the signal R [A-RGB], the signal G [A-RGB], and the signal B [A-RGB] described in the fourth embodiment. Can be implemented in the same manner. Needless to say, mapping using a color space and a color system in a three-dimensional space is not limited to this.
- the transmission method as shown in FIG. 32 has been described as an example of the method of transmitting the reference symbol 2801 in FIG. At this time, a method is conceivable in which the transmitting apparatus and the receiving apparatus share the order of transmission of signal points in FIG. 32 and the number of symbols to be transmitted.
- the transmission apparatus and the reception apparatus may estimate the signal points in FIG. 32 without sharing the transmission order of the signal points and the number of symbols to be transmitted.
- FIG. 34 shows an example of a communication system in the present embodiment. In FIG. 34, it is assumed that the first communication device 3590 and the second communication device 3591 are performing communication.
- a transmission device 3502 included in the first communication device 3590 is a device that transmits an optical modulation signal
- a reception device 3532 of the second communication device 3591 is a reception device that receives an optical modulation signal.
- the transmission device 3536 included in the second communication device 3591 may be a transmission device that transmits an optical modulation signal, may be a transmission device that transmits a modulation signal by radio waves, or may transmit a modulation signal. A transmission device that transmits data using a wire may be used.
- the first communication device 3590 includes a reception device 3505 that receives the modulated signal transmitted by the transmission device 3536 included in the second communication device 3591.
- the transmission device 3502 of the first communication device 3590 receives the data 3501 and the control signal 3507, performs signal processing such as mapping based on the control signal 3507, and outputs an optical modulation signal 3503. Note that the specific configuration and operation of the transmission apparatus have been described in Embodiments 1 to 7, but the operation unique to this embodiment will be described later.
- the receiving device 3532 of the second communication device 3591 receives the optical modulation signal 3503 transmitted by the transmitting device 3502 of the first communication device 3590 and receives the received signal 3531 as an input.
- the receiving device 3532 demodulates the received signal 3531 to obtain and output received data 3533, and outputs information 3534 for notifying the first communication device 3590 such as a reception state, for example.
- the transmission device 3536 of the second communication device 3591 receives the transmission data 3535 and the information 3534 for notification, and generates and outputs a modulation signal 3537.
- the reception device 3505 of the first communication device 3590 receives the modulation signal 3537 transmitted by the transmission device 3536 of the second communication device 3591 and receives the received signal 3504 as an input.
- the reception device 3505 demodulates the reception signal 3504, outputs reception data 3506, and outputs information related to the reception state of the second communication device 3591 as a control signal 3507.
- the transmission device 3502 of the first communication device 3590 in FIG. 34 generates and outputs an optical modulation signal 3503 with mapping as shown in FIG. This point is the same as described in the first and sixth embodiments.
- the reception state of the reception device 3532 of the second communication device 3591 in FIG. 34 is the reception state as shown in FIG. 29 as described in the sixth embodiment.
- the minimum value of the Euclidean distance formed by two of the four received signal points is small, the data reception quality is poor.
- the transmission device 3502 of the first communication device 3590 of FIG. 34 generates and outputs an optical modulation signal with mapping as shown in FIG.
- the transmission device 3502 of the first communication device 3590 of FIG. 34 has the configuration of FIG. 9 described in the first embodiment, for example.
- FIG. 35 is a diagram for explaining a modulation scheme having four signal points in the xy chromaticity diagram, as in FIG.
- the horizontal axis is x and the vertical axis is y.
- the four black circles in FIG. 35 represent signal points.
- the x value of the signal point 3604 is 0.15
- the mapping unit 904 in FIG. 9 performs the above operation, but the details of the operation have been described in the first embodiment, and thus description thereof is omitted.
- the transmission device 3502 of the first communication device 3590 in FIG. 34 generates and outputs an optical modulation signal 3503 with mapping as shown in FIG.
- the reception state of the reception device 3532 of the second communication device 3591 in FIG. 34 is as shown in FIG.
- the receiving device 3532 of the second communication device 3591 in FIG. 34 has, for example, a configuration as shown in FIG.
- 36 is an xy chromaticity diagram, the horizontal axis is x, and the vertical axis is y.
- 3710 is a reception signal point of a data symbol
- 3701, 3702, 3703, and 3704 are (true) reception signal points described in the sixth embodiment.
- the reception device 3532 of the second communication device 3591 in FIG. 34 When the reception device 3532 of the second communication device 3591 in FIG. 34 is in the reception state as shown in FIG. 36, the minimum value of the Euclidean distance formed by two reception signal points among the four (true) reception signal points is Since it is large, the data reception quality is good.
- the transmission device 3502 of the first communication device 3590 to transmit the optical modulation signal by mapping as shown in FIG.
- FIG. 37 shows an example of communication on the time axis between the first communication device 3590 and the second communication device 3591 in FIG.
- the horizontal axis represents time.
- the first communication device 3590 in FIG. 34 transmits “frame # 1”.
- the second communication device 3591 in FIG. 34 receives “frame # 1” and then transmits “frame ⁇ 1”.
- “Frame # 1”, “frame # 2”, and “frame # 3” in FIG. 37 are assumed to include the symbols in FIG. In FIG. 38, the horizontal axis is time, and 3901 is a symbol of each signal point.
- the first communication device 3590 of FIG. 34 transmits a symbol using the mapping of FIG. The symbol, the signal point 1802 symbol, the signal point 1803 symbol, and the signal point 1804 symbol are transmitted.
- the first communication device 3590 of FIG. 34 transmits a symbol using the mapping of FIG. 35, the symbol of the signal point 3601, the symbol of the signal point 3602, the symbol of the signal point 3603, and the symbol of the signal point 3604 are It transmits as symbol 3901 of each signal point.
- “Frame ⁇ 1” and “Frame ⁇ 2” in FIG. 37 include the symbols in FIG. In FIG. 39, the horizontal axis is time, and 4001 is a symbol of each received signal point.
- the transmission device 3502 of the first communication device 3590 in FIG. 34 transmits a symbol using the mapping in FIG.
- the receiving device 3532 of the second communication device 3591 in FIG. 34 estimates the received signal point using “symbol of each signal point” 3901 included in “frame # 1”, and as a result, FIG. It is assumed that the reception state is recognized.
- the “information indicating that the communication state is as shown in FIG. 29” may be “coordinates of four reception signal points in the chromaticity diagram xy” or “two reception signal points among the four reception signal points”. It may be “the minimum value of the Euclidean distance to be formed”, “reception state”, or information indicating “whether or not a packet (or frame or information) has been received” ( It is not limited to this example).
- the reception device 3505 of the first communication device 3590 receives “Frame 1” and knows the reception state of the second communication device 3591. At this time, it is assumed that first communication device 3590 has determined that second communication device 3591 has a poor reception state.
- the first communication device 3590 switches the mapping method from FIG. 18 to FIG. 35 and transmits “frame # 2” using the mapping method of FIG.
- the receiving device 3532 of the second communication device 3591 receives “frame # 2” and the mapping method is switched, the data reception quality is improved.
- the switching method shown in FIGS. 18 and 35 has been described as an example of the mapping method having four signal points.
- the mapping method is not limited to this example.
- the mapping method switching method for example, the following two methods can be mentioned.
- the first communication device 3590 can have a plurality of mapping methods having four signal points, selects a mapping method from the plurality of mapping methods, generates a symbol using the selected mapping method, and generates an optical signal. Transmit modulated signal. Note that the second communication device 3591 also knows a plurality of mapping methods having four signal points.
- mapping method 1 For example, assume that four mapping methods are prepared as a mapping method having four signal points. For example, it is assumed that there are mapping method 1, mapping method 2, mapping method 3, and mapping method 4.
- the first communication device 3590 selects any one of “mapping method 1, mapping method 2, mapping method 3, and mapping method 4”, and transmits a symbol.
- the first communication device 3590 may transmit information indicating which mapping method is used to the second communication device 3591 as control information.
- v0 and v1 are prepared as the control information, and the first communication device 3590 transmits control information including v0 and v1.
- the second communication device 3591 knows the mapping method used by the first communication device 3590 by knowing the values of v0 and v1.
- the first communication device 3590 may not transmit information on the mapping method. For example, when the reference symbol 2801 is transmitted as shown in FIG. 28, the second communication device 3591 can thereby estimate the position of the reception signal point.
- the first communication device 3590 determines the positions of the four signal points based on the “information regarding the reception state (communication state)” transmitted by the second communication device 3591, and the determined positions of the four signal points. Using the mapping method according to the above, a symbol is generated and an optical modulation signal is transmitted. At this time, for example, when the reference symbol 2801 is transmitted as shown in FIG. 28, the second communication device 3591 can estimate the position of the reception signal point.
- mapping method having four signal points has been described as an example, but the number of signal points is not limited to four.
- a mapping method having two signal points, a mapping method having eight signal points, a mapping method having sixteen signal points, a mapping method having sixty-four signal points, and the like can be similarly implemented.
- the figure constituted by the signal points 1801, 1802, 1803, and 1804 is a square.
- the transmission apparatus can select one of a plurality of mapping methods such as the mapping method of FIG. 18 and the mapping method of FIG.
- the signal point arrangements of the plurality of mapping methods may all be square.
- intersection of the diagonal of the square formed by the signal points 1801, 1802, 1803, and 1804 and the intersection of the square formed by the signal points 3601, 3602, 3603, and 3604 may be different in the xy chromaticity diagram. Is a characteristic point.
- the transmitting device selects a mapping method from a plurality of “mapping methods having four signal points” and generates a modulated signal.
- the signal point arrangements of the plurality of “mapping methods having four signal points” are all square as shown in FIGS. 18 and 35 (there are signal points at the corners), and the plurality of “four signal points”.
- the “mapping method having signal points” is characterized by the presence of the first mapping method and the second mapping method. Note that the intersection of the square diagonal lines formed by the signal points in the first mapping method and the intersection of the square diagonal lines formed by the signal points in the second mapping method are different points in the xy chromaticity diagram.
- mapping 6 or 9 is, for example, a mapping in which there are two signal points in the xy chromaticity diagram, a mapping in which there are four signal points, two, four, or eight in three dimensions.
- mapping with a small number of signal points such as mapping where there are two signal points, the light emitted from the transmitter may be biased in color, which may be uncomfortable to humans depending on the situation of use. Or may be inconvenient when combined with lighting such as advertisements.
- a transmission method for overcoming this problem will be described.
- a “data randomizing unit” or “scrambler” may be arranged after the encoding unit 902 to randomize the data.
- the receiving apparatus performs demodulation in consideration of data randomization.
- a “symbol randomizing unit” or “scrambler” may be arranged after the mapping unit 904 to randomize the symbols.
- the receiving apparatus performs demodulation in consideration of symbol randomization.
- the light emitted from the transmission device may become a biased color even if these randomizations are performed.
- Switching method 1 Switch the mapping method on a symbol basis.
- Switching method 2 Switch the mapping method in units of frames.
- Switching method 3 Switch the mapping method in units of multiple symbols.
- mapping method 1 will be described.
- a case where two mapping methods are switched will be described.
- the transmission apparatus of FIG. 6 transmits a symbol having a frame configuration as shown in FIG. 27. Note that the transmission apparatus in FIG. 6 performs mapping having four signal points.
- FIG. 40 shows an example of the configuration of the data symbol 2104 in the frame configuration of FIG.
- the horizontal axis represents time
- the symbol of the first mapping method 4101 is transmitted, and then the symbol of the second mapping method 4102, the symbol of the first mapping method 4103, and the second mapping method 4104 Symbols are transmitted in the order of symbols.
- the first mapping method and the second mapping method are mappings in which four signal points are arranged on the xy chromaticity diagram.
- the first mapping method is a mapping method as shown in FIG. 18, and the second mapping method is a mapping as shown in FIG.
- the intersection of the square diagonal lines formed by the signal points in the first mapping method and the square diagonal line formed by the signal points in the second mapping method is xy.
- “different” is a characteristic point.
- the three or more mapping methods include a third mapping method and a fourth mapping method. Note that an intersection of square diagonal lines formed by signal points in the third mapping method and an intersection of square diagonal lines formed by signal points in the fourth mapping method are different points in the xy chromaticity diagram.
- the fifth mapping method is a mapping method having four signal points in the xy chromaticity diagram
- the sixth mapping method is a four color system or color space that is not an xy chromaticity diagram.
- the mapping method has signal points.
- the symbols of the fifth mapping method are transmitted, and then the symbols of the sixth mapping method, as in FIG. , Symbols of the fifth mapping method, symbols of the sixth mapping method, and so on.
- the three or more mapping methods include a seventh mapping method and an eighth mapping method.
- the “color system or color space in which signal points are arranged in the seventh mapping method” is different from the “color system or color space in which signal points are arranged in the eighth mapping method”.
- mapping method when switching three or more mapping methods, it is not always necessary to switch the mapping method regularly.
- symbol of the ninth mapping method is transmitted, and then the symbol of the tenth mapping method, the symbol of the eleventh mapping method, the symbol of the ninth mapping method, the tenth mapping” ”, The eleventh mapping method symbol, the ninth mapping method symbol, the tenth mapping method symbol, the eleventh mapping method symbol, and so on.
- the symbols of the ninth mapping, the symbols of the tenth mapping, and the symbols of the eleventh mapping may be arranged in any manner.
- mapping method 2 will be described. As a simple example, a case where two mapping methods are switched will be described. However, this is merely an example, and three or more mapping methods may be switched.
- the transmission apparatus of FIG. 6 transmits a symbol having a frame configuration as shown in FIG. 27. Note that the transmission apparatus in FIG. 6 performs mapping having four signal points.
- the horizontal axis represents time, and the first frame 4201 is transmitted, and then the second frame 4202, the third frame 4203, the fourth frame 4204,... Shall be sent. At this time, it is assumed that the first frame 4201, the second frame 4202, the third frame 4203, the fourth frame 4204,...
- the first frame 4201 uses the first mapping method
- the second frame 4202 uses the second mapping method
- the third frame 4203 uses the first mapping method
- the fourth frame 4204 uses the second mapping method, and so on.
- the features of the first mapping method and the second mapping method are as described above. By doing in this way, the effect that the light which a transmitter emits can reduce possibility of becoming a color with a bias can be acquired.
- mappings may be switched on a frame basis.
- the three or more mapping methods include a third mapping method and a fourth mapping method. Note that an intersection of square diagonal lines formed by signal points in the third mapping method and an intersection of square diagonal lines formed by signal points in the fourth mapping method are different points in the xy chromaticity diagram.
- the two mapping methods of the fifth mapping method and the sixth mapping method may be switched on a frame basis.
- the effect that the light which a transmitter emits can reduce possibility of becoming a color with a bias can be acquired.
- the features of the fifth mapping method and the sixth mapping method are as described above. By doing in this way, the effect that the light which a transmitter emits can reduce possibility of becoming a color with a bias can be acquired.
- the three or more mapping methods include a seventh mapping method and an eighth mapping method.
- the “color system or color space in which signal points are arranged in the seventh mapping method” is different from the “color system or color space in which signal points are arranged in the eighth mapping method”.
- mapping method when switching three or more mapping methods, it is not always necessary to switch the mapping method regularly.
- symbol group of 9th mapping method when switching regularly, “symbol group of 9th mapping method is transmitted, then symbol group of 10th mapping method, symbol group of 11th mapping method, symbol group of 9th mapping method, Symbol group of tenth mapping method, symbol group of eleventh mapping method, symbol group of ninth mapping method, symbol of tenth mapping method, symbol group of eleventh mapping method,. Will do.
- the symbol group of the ninth mapping, the symbol group of the tenth mapping, and the symbol group of the eleventh mapping may be arranged side by side.
- mapping method 3 will be described. As a simple example, a case where two mapping methods are switched will be described. However, this is merely an example, and three or more mapping methods may be switched.
- the transmission apparatus of FIG. 6 transmits a symbol having a frame configuration as shown in FIG. 27. Note that the transmission apparatus in FIG. 6 performs mapping having four signal points.
- the mapping method is switched in units of frames.
- the mapping may be switched in units of a plurality of data symbols. Therefore, in contrast to the description in which switching method 2 switches the mapping method in units of frames, this can be realized by switching the mapping in units of a plurality of symbols. Therefore, detailed description is omitted.
- the features of the first to eleventh mapping methods are as described above. Thereby, the effect that the light which a transmitter emits can reduce the possibility of becoming a color with a bias can be acquired.
- mapping method in which four signal points are present has been described as an example.
- the present invention is not limited to this.
- a mapping method such as a mapping method having 16 signal points and a mapping method having 64 signal points can be implemented in the same manner, and similar effects can be obtained.
- the two-dimensional mapping method has been described as an example, but the three-dimensional mapping method can be similarly implemented. That is, a plurality of three-dimensional mapping methods are used, and the same implementation can be performed even if the mapping method is switched for each data symbol, each frame, or each data symbol. Furthermore, the present invention can be similarly implemented by switching between the two-dimensional mapping method and the three-dimensional mapping method for each data symbol, each frame, or each data symbol. Thereby, the effect that the light which a transmitter emits can reduce the possibility of becoming a color with a bias can be acquired.
- mapping method of arranging four signal points is applied to another color system or a mapping method in a color space can be similarly implemented. The effect of can be obtained.
- the transmission apparatus transmits an optical modulation signal in the frame configuration as shown in FIG. 27, if all the signal points that can be taken by the data symbol 2104 are transmitted in the reference symbol 2801, high data reception quality is obtained. The effect that it is possible can be acquired.
- each embodiment and other contents are merely examples.
- the same configuration can be used. Is possible.
- APSK Amplitude Phase Shift Keying
- PAM Pulse Amplitude Modulation
- PSK Phase Shift Keying
- QAM Quadrature Amplitude Modulation
- 2, 4, 8, 16, 64, 128, 256, 1024, etc. signal point arrangement methods in the IQ plane (2, 4, 8, 16,
- the modulation scheme having signal points of 64, 128, 256, 1024, etc.) is not limited to the signal point arrangement method of the modulation scheme shown in this specification. Therefore, the function of outputting the in-phase component and the quadrature component based on a plurality of bits is a function in the mapping unit.
- the data / information obtained by the receiving device is then converted into video or sound and displayed on a display (monitor) or sound is output from a speaker. Further, the data / information obtained by the receiving device is subjected to signal processing related to video and sound (signal processing may not be performed), and the RCA terminal (video terminal, sound terminal), USB ( It may be output from Universal (Serial Bus), HDMI (registered trademark) (High-Definition Multimedia Interface), a digital terminal, or the like.
- the transmission device is equipped with a communication / broadcasting device such as a broadcasting station, a base station, an access point, a terminal, a mobile phone, and the like.
- the receiving device is equipped with a communication device such as a television, a radio, a terminal, a personal computer, a mobile phone, an access point, and a base station.
- the transmission device and the reception device in the present invention are devices having a communication function, and the devices provide some interface to a device for executing an application such as a television, a radio, a personal computer, or a mobile phone. It is also conceivable that the connection is possible.
- symbols other than data symbols for example, pilot symbols (preamble, unique word, postamble, reference symbol, etc.), control information symbols, etc.
- pilot symbols preamble, unique word, postamble, reference symbol, etc.
- control information symbols etc.
- the pilot symbol and the control information symbol are named, but any naming method may be used, and the function itself is important.
- the pilot symbol is, for example, a known symbol modulated by using PSK modulation in a transmitter / receiver (or the receiver may know the symbol transmitted by the transmitter by synchronizing the receiver). .), And the receiver uses this symbol to perform frequency synchronization, time synchronization, channel estimation (for each modulated signal) (estimation of CSI (Channel State Information)), signal detection, and the like. Become.
- control information symbol is information (for example, a modulation method, an error correction coding method used for communication, a communication information symbol) that needs to be transmitted to a communication partner in order to realize communication other than data (such as an application).
- This is a symbol for transmitting an error correction coding method coding rate, setting information in an upper layer, and the like.
- a program for executing the above communication method may be stored in a ROM (Read Only Memory) in advance, and the program may be operated by a CPU (Central Processor Unit).
- ROM Read Only Memory
- CPU Central Processor Unit
- a program for executing the communication method is stored in a computer-readable storage medium, the program stored in the storage medium is recorded in a RAM (Random Access Memory) of the computer, and the computer is operated according to the program. You may do it.
- Each functional block used in the description of each of the above embodiments is partially or entirely realized as an LSI (Large Scale Integration) that is an integrated circuit, and each of the functional blocks described in each of the above embodiments.
- the process may be controlled in part or in whole by a single LSI or combination of LSIs.
- the LSI may be composed of individual chips, or may be composed of one chip so as to include a part or all of the functional blocks.
- the LSI may include data input and output.
- the LSI is sometimes referred to as an IC (Integrated Circuit), a system LSI, a super LSI, or an ultra LSI depending on the degree of integration.
- the method of circuit integration is not limited to LSI, and may be realized by a dedicated circuit, a general-purpose processor, or a dedicated processor. Further, an FPGA (Field Programmable Gate Array) that can be programmed after manufacturing the LSI or a reconfigurable processor that can reconfigure the connection and setting of the circuit cells inside the LSI may be used.
- the present disclosure may be implemented as digital processing or analog processing. Further, if integrated circuit technology comes out to replace LSI's as a result of the advancement of semiconductor technology or a derivative other technology, it is naturally also possible to carry out function block integration using this technology. There is a possibility of adaptation of biotechnology.
- One embodiment of the present disclosure is useful for, for example, a visible light communication system.
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- Electromagnetism (AREA)
- Optical Communication System (AREA)
Abstract
Description
まず、以下で説明する各実施の形態に適用可能な可視光を用いて送受信する可視光通信方式の一例の概要について説明する。
スマートフォンまたはデジタルカメラなどには、CMOS(Complementary Metal Oxide Semiconductor)センサなどのイメージセンサが搭載されている。CMOSセンサで撮像された画像は、全体が厳密に同じ時刻の風景を写しているわけではなく、例えば、非特許文献2、非特許文献3に示されているように、行ごとにシャッタ動作を行うローリングシャッタ方式により、1ライン毎にセンサが受光した光の量を読み出す。そのため、読み出しに要する時間を見計らって、1ライン毎に時間差をおいて受光の開始、終了の制御が行われる。つまり、CMOSセンサで撮像された画像は、少しずつタイムラグのある多数のラインを重ねた形になる。
なお、上記説明では、一ライン毎に受光した光の量を示す信号を読み出すラインスキャンサンプリングについて説明したが、CMOSなどのイメージセンサを用いた光信号のサンプリング方式はこれに限定されない。光信号の受信に用いるサンプリング方式としては、通常の動画の撮影に用いるフレームレートよりも高いサンプリングレートでサンプリングされた信号を取得できる様々な方式が適用可能である。例えば、非特許文献2、非特許文献3に示されている画素ごとにシャッタ機能を持たせるグローバルシャッタ方式により、ラインの信号を同時に読み出す方式や、ライン状ではない形状に配置された複数の画素単位で信号が読み出される方式を用いてもよい。また、通常の動画の撮影に用いるフレームレートにおける1フレームに相当する期間内に、同一の画素から複数回信号が読み出される方式を用いてもよい。
さらに、非特許文献2、非特許文献3に示されている画素ごとにシャッタ機能を持たせるフレームレート方式により、フレームレートを高速化した方式においても光信号をサンプリングすることは可能である。
可視光通信では、例えば、LED(Light Emitting Diode)を送信機として利用することができる。LEDは、照明またはディスプレイのバックライト光源として普及しつつあり、高速に点滅させることが可能である。
図5に示すように、可視光通信を行う通信システムは、少なくとも、光信号を送信(照射)する送信機と、光信号を受信(受光)する受信機とを含む。例えば、送信機には、表示する映像またはコンテンツに応じて送信内容を変更する可変光送信機と、固定の送信内容を送信し続ける固定光送信機の2種類がある。ただし、可変光送信機、固定光送信機のいずれかが存在するという構成でも、光による通信システムを構成することができる。
[本開示の主たる態様(第1の態様)]
以下では、本開示の主たる態様として、例えば色空間のような仮想的な空間上で定義されたコンステレーションを用いて行う通信の一例について説明する。なお、本態様における仮想的な空間は、色空間に限定されないが、以下では、送信機が色空間上に配置されたコンステレーションに基づいて光信号(送信機が色空間を表すために用いた表色系に配置されたコンステレーションに基づいて光信号)を提示し、受信機が受光した光信号を色空間上に配置されたコンステレーションに基づいて復調する(受信機が受光した光信号を表色系に配置されたコンステレーションに基づいて復調する)可視光通信を例に挙げて説明する。
送信装置100は、LED(Light Emitting Diode)などの可視光源、照明、あるいはライト(総称して、光源ともいう)を具備する。
図7は、本態様における受信機が備える受信装置200の構成の一例を示す。
以下では、上述した主たる態様と組み合わせて実施可能な本開示の第2の態様について説明する。
信号処理部1608は、信号群1603、タイミング推定信号1605、制御情報1607を入力とし、タイミング推定信号1605を用い、信号群1603からデータシンボル1003を抽出し、制御情報1607に含まれている色空間の情報(表色系の情報)から、データシンボル1003の色空間、表色系を認識し、制御情報1607からデータシンボル1003のシンボル構成を認識し、データシンボル1003を復調し、受信データ1609を出力する。
信号処理部1608は、信号群1603、タイミング推定信号1605、制御情報1607を入力とし、タイミング推定信号1605を用い、信号群1603から第2の制御情報シンボル1102、データシンボル1003を抽出し、制御情報1607に含まれている色空間の情報(表色系の情報)から、第2の制御情報シンボル1102とデータシンボル1003の色空間、表色系を認識し、まず、第2の制御情報シンボル1102を復調し、制御情報1607および第2の制御情報シンボル1102に含まれている情報から、データシンボル1003のシンボルの構成を認識し、データシンボル1003を復調し、受信データ1609を出力する。
本実施の形態では、実施の形態1で説明した「刺激値X、Y、Zで形成した3次元に信号点配置を行ったとき」の補足説明を行う。
本実施の形態では、色空間、表色系に配置された信号点に基づいた変調方式の例として、特に、3次元における実施の形態について説明する。
本実施の形態では、色空間、表色系に配置された信号点に基づいた変調方式の例として、特に、3次元における実施の形態について説明する。
本実施の形態では、実施の形態1で説明した受信装置と異なる受信装置の構成について説明する。
本実施の形態では、受信装置のデータの受信品質を向上させるための方法について説明を行う。
図18の信号点1802に相当する光変調信号を送信し(2902)、
図18の信号点1803に相当する光変調信号を送信し(2903)、
図18の信号点1804に相当する光変調信号を送信し(2904)、
図18の信号点1801に相当する光変調信号を送信し(2905)、
図18の信号点1802に相当する光変調信号を送信し(2906)、
図18の信号点1803に相当する光変調信号を送信し(2907)、
図18の信号点1804に相当する光変調信号を送信し(2908)、
・・・
というように、リファレンスシンボル2801を構成する。なお、リファレンスシンボル2801の構成方法は、図28の構成に限ったものではない。例えば、図18のように4つの信号点が存在した場合、リファレンスシンボル2801において、各信号点のシンボルを必ず送信する、つまり、「信号点1801のシンボルを送信」、「信号点1802のシンボルを送信」、「信号点1803のシンボルを送信」、「信号点1804のシンボルを送信」が含まれていることが重要となる。
本実施の形態では、受信装置のデータの受信品質を向上させるための実施の形態6の変形例の説明を行う。
図30の信号点2011に相当する光変調信号を送信し(3302)、
図30の信号点2012に相当する光変調信号を送信し(3303)、
図30の信号点2013に相当する光変調信号を送信し(3304)、
図30の信号点2020に相当する光変調信号を送信し(3305)、
図30の信号点2021に相当する光変調信号を送信し(3306)、
図30の信号点2022に相当する光変調信号を送信し(3307)、
図30の信号点2023に相当する光変調信号を送信し(3308)、
・・・
というように、リファレンスシンボル2801を構成する。なお、リファレンスシンボル2801の構成方法は、図32の構成に限ったものではない。例えば、図30のように8つの信号点が存在した場合、リファレンスシンボル2801において、各信号点のシンボルを必ず送信する、つまり、「信号点2010のシンボルを送信」、「信号点2011のシンボルを送信」、「信号点2012のシンボルを送信」、「信号点2013のシンボルを送信」、「信号点2020のシンボルを送信」、「信号点2021のシンボルを送信」、「信号点2022のシンボルを送信」、「信号点2023のシンボルを送信」が含まれていることが重要となる。
「信号点3210とデータシンボルの受信信号点3401のユークリッド距離」、
「信号点3211とデータシンボルの受信信号点3401のユークリッド距離」、
「信号点3212とデータシンボルの受信信号点3401のユークリッド距離」、
「信号点3213とデータシンボルの受信信号点3401のユークリッド距離」、
「信号点3220とデータシンボルの受信信号点3401のユークリッド距離」、
「信号点3221とデータシンボルの受信信号点3401のユークリッド距離」、
「信号点3222とデータシンボルの受信信号点3401のユークリッド距離」、
「信号点3223とデータシンボルの受信信号点3401のユークリッド距離」、
を求め、「信号点3210とデータシンボルの受信信号点3401のユークリッド距離」が最も小さいと判断し、データシンボルではb0=0、b1=0、b2=0が伝送されていると判断し、「b0=0、b1=0、b2=0」を得る。
本実施の形態では、高いデータの受信品質が得ることができ通信システムの構成について説明する。
第1の通信装置3590は、4つの信号点をもつマッピング方法を複数可能であり、この複数のマッピング方法の中からマッピング方法を選択し、選択したマッピング方法を用いて、シンボルを生成し、光変調信号を送信する。なお、4つの信号点を持つマッピング方法の複数の方法に関しては、第2の通信装置3591も知っているものとする。
第1の通信装置3590は、第2の通信装置3591が送信した「受信状態(通信状態)に関する情報」に基づいて、4つに信号点の位置を決定し、決定した4つの信号点の位置にしたがったマッピング方法を用いて、シンボルを生成し、光変調信号を送信する。このとき、例えば、図28のようにリファレンスシンボル2801を送信した場合、これにより、第2の通信装置3591は、受信信号点の位置を推定することができる。
実施の形態8において、一例として、送信装置が通信相手からの情報に基づき、マッピングの配置を切り替える方法について説明した。本実施の形態は4つの信号点をもつマッピング方法の例を説明する。
本実施の形態では、例えば、図6や図9の送信装置が、図21や図27のフレーム構成で、光変調信号を送信したときのデータシンボルの送信方法の例について説明する。
シンボル単位でマッピング方法を切り替える。
フレーム単位でマッピング方法を切り替える。
複数シンボル単位でマッピング方法を切り替える。
当然であるが、本明細書において説明した実施の形態、その他の内容を複数組み合わせて、実施してもよい。
101、901、3535 送信データ
102 信号生成部
103、907 送信信号
104、908 送信部
105、201、909、1601、2201 光信号
200、1600、3505、3532 受信装置
202、1602 受信部
203、2203、2302、3504、3531 受信信号
204、906、1608、2601 信号処理部
205、1609、2211、3506、3533 受信データ
801、2202 イメージセンサ(受光素子)
802、1603 信号群
803 色空間信号処理部(表色系信号処理部)
902 符号化部
903 符号化後のデータ
904 マッピング部
905 変調シンボル(ベースバンド信号)
910、2401、3507 制御信号
920 色空間の方法に関する情報(表色系の方法に関する情報)
921 制御情報シンボル生成部
922、1002、2103 制御情報シンボル
930、1001、2101 プリアンブル
1003、2104 データシンボル
1101 第1の制御情報シンボル
1102 第2の制御情報シンボル
1201 通信機器
1202 通信相手
1604 タイミング推定部
1605 タイミング推定信号
1606 制御情報シンボル復調部
1607、2209 制御情報
2102 色空間または表色系に関する情報を伝送するためのシンボル
2204 色空間または表色系に関する情報復調部
2205 色空間または表色系に関する情報
2206 色空間または表色系変換部
2207 色空間または表色系変換後のシンボル(信号処理後の信号)
2208 制御シンボル復調部
2210 復調部
2301 イメージセンサ関連部
2602 受信信号点推定部
2603 受信信号点信号
2801 リファレンスシンボル
3501 データ
3503 光変調信号
3534 通知するための情報
3537 変調信号
3590 第1の通信装置
3591 第2の通信装置
Claims (4)
- 送信データを2次元、または、3次元の色空間に配置された信号点へとマッピングして変調シンボルを生成するシンボル生成部と、
前記変調シンボルに応じて変調された光信号を出力する出力部と、
を具備する送信装置。 - 送信装置において実施される送信方法であって、
送信データを2次元、または、3次元の色空間に配置された信号点へとマッピングして変調シンボルを生成し、
前記変調シンボルに応じて変調された光信号を前記送信装置が備える出力部から出力する、送信方法。 - 光信号を複数の受光素子を用いて受光して受信信号を生成する受光部と、
前記受信信号をシンボル毎に2次元、または、3次元の色空間の信号としてデマッピングして復号し、受信データを生成する復調部と、
を具備する受信装置。 - 受信装置において実施される受信方法であって、
光信号を複数の受光素子を用いて受光して受信信号を生成し、
前記受信信号をシンボル毎に2次元、または、3次元の色空間の信号としてデマッピングして復号し、受信データを生成する、受信方法。
Priority Applications (8)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201880026781.8A CN110546896B (zh) | 2017-04-28 | 2018-04-20 | 发送装置、发送方法、接收装置、以及接收方法 |
JP2019514452A JP7304286B2 (ja) | 2017-04-28 | 2018-04-20 | 送信装置、送信方法、受信装置および受信方法 |
CN202310310121.5A CN116346225A (zh) | 2017-04-28 | 2018-04-20 | 发送装置、发送方法、接收装置、以及接收方法 |
EP18790364.6A EP3618310A4 (en) | 2017-04-28 | 2018-04-20 | TRANSMISSION DEVICE, TRANSMISSION METHOD, RECEPTION DEVICE, AND RECEPTION METHOD |
US16/665,597 US11606159B2 (en) | 2017-04-28 | 2019-10-28 | Transmission device, transmission method, reception device, and reception method |
US18/106,085 US12028152B2 (en) | 2017-04-28 | 2023-02-06 | Transmission device, transmission method, reception device, and reception method |
JP2023072372A JP2023083607A (ja) | 2017-04-28 | 2023-04-26 | 受信装置および受信方法 |
US18/669,806 US20240305398A1 (en) | 2017-04-28 | 2024-05-21 | Transmission device, transmission method, reception device, and reception method |
Applications Claiming Priority (6)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201762491306P | 2017-04-28 | 2017-04-28 | |
US62/491,306 | 2017-04-28 | ||
US201762518074P | 2017-06-12 | 2017-06-12 | |
US62/518,074 | 2017-06-12 | ||
US201762529819P | 2017-07-07 | 2017-07-07 | |
US62/529,819 | 2017-07-07 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/665,597 Continuation US11606159B2 (en) | 2017-04-28 | 2019-10-28 | Transmission device, transmission method, reception device, and reception method |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2018198950A1 true WO2018198950A1 (ja) | 2018-11-01 |
Family
ID=63920390
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2018/016231 WO2018198950A1 (ja) | 2017-04-28 | 2018-04-20 | 送信装置、送信方法、受信装置および受信方法 |
Country Status (5)
Country | Link |
---|---|
US (3) | US11606159B2 (ja) |
EP (1) | EP3618310A4 (ja) |
JP (2) | JP7304286B2 (ja) |
CN (2) | CN110546896B (ja) |
WO (1) | WO2018198950A1 (ja) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110781324A (zh) * | 2019-08-31 | 2020-02-11 | 中国科学院电子学研究所苏州研究院 | 一种基于三维标图系统的符号库 |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111492598B (zh) * | 2018-01-08 | 2021-07-09 | 华为技术有限公司 | 一种相机通信方法及装置 |
CN113728564B (zh) * | 2019-04-15 | 2024-04-09 | Oppo广东移动通信有限公司 | 采用可见光摄像机的不可见光通信的方法和系统 |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2011521546A (ja) * | 2008-05-06 | 2011-07-21 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | 発される光にデータを組み込む光モジュール、照明システム及び方法 |
JP2012114911A (ja) * | 2010-11-22 | 2012-06-14 | Pantech Co Ltd | 可視光通信システムにおいてクロミナンス情報を用いて通信を行う装置及び方法 |
Family Cites Families (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6590996B1 (en) * | 2000-02-14 | 2003-07-08 | Digimarc Corporation | Color adaptive watermarking |
JP4939024B2 (ja) * | 2005-09-27 | 2012-05-23 | 京セラ株式会社 | 光通信装置、及び光通信方法 |
JP5031427B2 (ja) * | 2007-03-30 | 2012-09-19 | 三星電子株式会社 | 可視光送信装置、可視光受信装置、可視光通信システム、及び可視光通信方法 |
JP5325526B2 (ja) * | 2008-10-17 | 2013-10-23 | 三星電子株式会社 | 可視光通信システム、及び可視光通信方法 |
JP5339049B2 (ja) * | 2008-11-28 | 2013-11-13 | カシオ計算機株式会社 | 情報復元装置、情報復元方法、及び、プログラム |
US20100247112A1 (en) * | 2009-03-31 | 2010-09-30 | Soo-Young Chang | System and Method for Visible Light Communications |
JP5410933B2 (ja) * | 2009-11-27 | 2014-02-05 | 三星電子株式会社 | 可視光通信システム、及び可視光通信方法 |
TWI581615B (zh) * | 2011-06-24 | 2017-05-01 | Sun Patent Trust | A decoding method, a coding method, a decoding device, an encoding device, and a coding / decoding device |
US8942571B2 (en) * | 2012-12-24 | 2015-01-27 | Industrial Technology Research Institute | Apparatus and method for data embedding in light communication and the light communication system and method thereof |
JP5606655B1 (ja) * | 2012-12-27 | 2014-10-15 | パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ | 情報通信方法 |
US20150155937A1 (en) * | 2013-09-16 | 2015-06-04 | Clutch Authentication Systems, Llc | System and method for communication over color encoded light patterns |
JP6490481B2 (ja) * | 2014-04-25 | 2019-03-27 | 学校法人東京電機大学 | 可視光通信システム |
-
2018
- 2018-04-20 EP EP18790364.6A patent/EP3618310A4/en active Pending
- 2018-04-20 WO PCT/JP2018/016231 patent/WO2018198950A1/ja active Application Filing
- 2018-04-20 CN CN201880026781.8A patent/CN110546896B/zh active Active
- 2018-04-20 CN CN202310310121.5A patent/CN116346225A/zh active Pending
- 2018-04-20 JP JP2019514452A patent/JP7304286B2/ja active Active
-
2019
- 2019-10-28 US US16/665,597 patent/US11606159B2/en active Active
-
2023
- 2023-02-06 US US18/106,085 patent/US12028152B2/en active Active
- 2023-04-26 JP JP2023072372A patent/JP2023083607A/ja active Pending
-
2024
- 2024-05-21 US US18/669,806 patent/US20240305398A1/en active Pending
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2011521546A (ja) * | 2008-05-06 | 2011-07-21 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | 発される光にデータを組み込む光モジュール、照明システム及び方法 |
JP2012114911A (ja) * | 2010-11-22 | 2012-06-14 | Pantech Co Ltd | 可視光通信システムにおいてクロミナンス情報を用いて通信を行う装置及び方法 |
Non-Patent Citations (8)
Title |
---|
"Adobe RGB(1998) Color Image Encoding (Technical report", 13 May 2005, ADOBE SYSTEMS INCORPORATED |
"Advanced Image Sensor", THE JOURNAL OF THE INSTITUTE OF IMAGE INFORMATION AND TELEVISION ENGINEERS, vol. 66, no. 3, 2012, pages 172 - 173 |
"Bayesian based location estimation system using wireless LAN", THIRD IEEE CONFERENCE ON PERVASIVE COMPUTING AND COMMON. WORKSHOPS, 2005, pages 273 - 278 |
"Computer Graphics: Principles and Practice", 2001, OHMSHA, LTD. |
"High Speed Technology Trends in CMOS Image Sensors", THE JOURNAL OF THE INSTITUTE OF IMAGE INFORMATION AND TELEVISION ENGINEERS, vol. 66, no. 3, 2012, pages 174 - 177 |
"Image Processing in Digital Camera", THE INSTITUTE OF IMAGE ELECTRONICS ENGINEERS OF JAPAN, 2012 |
"Multimedia systems and equipment - Colour measurement and management - Part 2-1: Colour management - Default RGB colour space - sRGB", IEC 61966-2-1 |
"Proposal of New Organic CMOS Image Sensor for Reduction in Pixel Size", FUJIFILM RESEARCH & DEVELOPMENT, 2010, pages 14 - 17 |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110781324A (zh) * | 2019-08-31 | 2020-02-11 | 中国科学院电子学研究所苏州研究院 | 一种基于三维标图系统的符号库 |
Also Published As
Publication number | Publication date |
---|---|
EP3618310A1 (en) | 2020-03-04 |
US11606159B2 (en) | 2023-03-14 |
CN110546896A (zh) | 2019-12-06 |
US12028152B2 (en) | 2024-07-02 |
JP7304286B2 (ja) | 2023-07-06 |
US20200067623A1 (en) | 2020-02-27 |
EP3618310A4 (en) | 2020-04-15 |
CN110546896B (zh) | 2023-04-04 |
JP2023083607A (ja) | 2023-06-15 |
CN116346225A (zh) | 2023-06-27 |
JPWO2018198950A1 (ja) | 2020-03-12 |
US20240305398A1 (en) | 2024-09-12 |
US20230188242A1 (en) | 2023-06-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US12028152B2 (en) | Transmission device, transmission method, reception device, and reception method | |
Chen et al. | Color-shift keying for optical camera communication using a rolling shutter mode | |
US20120128366A1 (en) | Apparatus and method for performing communication using chrominance information in visible light communication system | |
Chow et al. | Secure mobile-phone based visible light communications with different noise-ratio light-panel | |
JP7418503B2 (ja) | 受信方法および受信装置 | |
US20220182143A1 (en) | Reception device and reception method | |
Masaoka et al. | Algorithm design for gamut mapping from UHDTV to HDTV | |
US20240113781A1 (en) | Communication system, terminal, control method, and recording medium | |
Tian et al. | Design and experimental demonstration of a real-time 95kbps optical camera communication system | |
KR102162715B1 (ko) | 가시광 통신을 위한 수신 장치, 및 이를 이용한 가시광 통신 방법 | |
KR102162712B1 (ko) | 가시광 통신을 위한 송신 장치, 수신 장치, 및 이를 이용한 가시광 통신 방법 | |
Ishii et al. | Camera Parameters Division Multiplexing Signal Transmission for Optical Camera Communication | |
WO2022072102A1 (en) | System and method for a multi-primary wide gamut color system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 18790364 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2019514452 Country of ref document: JP Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2018790364 Country of ref document: EP |
|
ENP | Entry into the national phase |
Ref document number: 2018790364 Country of ref document: EP Effective date: 20191128 |