JP2010268264A - Imaging element and imaging apparatus - Google Patents
Imaging element and imaging apparatus Download PDFInfo
- Publication number
- JP2010268264A JP2010268264A JP2009118380A JP2009118380A JP2010268264A JP 2010268264 A JP2010268264 A JP 2010268264A JP 2009118380 A JP2009118380 A JP 2009118380A JP 2009118380 A JP2009118380 A JP 2009118380A JP 2010268264 A JP2010268264 A JP 2010268264A
- Authority
- JP
- Japan
- Prior art keywords
- communication
- image acquisition
- image
- signal
- receiving unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Solid State Image Pick-Up Elements (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
Abstract
Description
本発明は撮像素子及び撮像装置に関し、具体的には、可視光通信における受信装置としての機能を有する撮像素子及び撮像装置に関する。 The present invention relates to an imaging element and an imaging apparatus, and more specifically, to an imaging element and an imaging apparatus having a function as a receiving apparatus in visible light communication.
近年、可視光を利用した各種の情報伝送及び通信が注目されている。このような情報伝送及び通信は可視光通信と呼ばれ、可視光の波動性（明るさの強弱）を利用して情報を伝達し、通信を行うものである。 In recent years, various types of information transmission and communication using visible light have attracted attention. Such information transmission and communication is called visible light communication, and communicates by transmitting information using the wave nature (brightness and weakness) of visible light.
可視光を発する装置は、オフィスや家の中の照明、道路上の照明、交通信号機や広告用電光掲示板、ディスプレー、電子機器の表示など、様々な場所に設置されている。近年、これら装置において可視光発光素子としてＬＥＤが使用されるようになってきている。可視光発光素子にＬＥＤが使用されることにより、従来の蛍光灯ではできなかった高速での点滅が可能となる。可視光発光素子を人の目には感じられない程のスピードで高速に点滅させることにより、可視光通信の送信装置としてデータを送信できるようになる（例えば非特許文献１参照）。 Devices that emit visible light are installed in various places such as lighting in offices and homes, lighting on roads, traffic lights, electronic bulletin boards for advertisements, displays, and electronic devices. In recent years, LEDs have been used as visible light emitting elements in these devices. By using an LED for the visible light emitting element, it is possible to blink at a high speed that was not possible with a conventional fluorescent lamp. Data can be transmitted as a transmission device for visible light communication by causing the visible light emitting element to blink at a high speed that cannot be felt by human eyes (for example, see Non-Patent Document 1).
このような可視光通信における受信装置として、被写体を撮像するイメージセンサを使用することが提案されている。しかしながら、イメージセンサはサンプリング速度の高速化が難しいという欠点がある（例えば非特許文献２参照）。 As a receiving apparatus in such visible light communication, it has been proposed to use an image sensor that images a subject. However, the image sensor has a drawback that it is difficult to increase the sampling speed (see, for example, Non-Patent Document 2).
上記欠点を克服する方法として以下の方法が提案されている。 The following methods have been proposed as a method for overcoming the above drawbacks.
特許文献１では、イメージセンサを構成する複数の画素のうちの特定の画素をあらかじめ通信用画素と定め、専用の読み出し経路を設けることで読み出し速度を高速化する方法が提案されている。 Patent Document 1 proposes a method of increasing the readout speed by defining a specific pixel among a plurality of pixels constituting an image sensor as a communication pixel in advance and providing a dedicated readout path.
特許文献２では、イメージセンサを構成する複数の画素のうち、特定の画素をあらかじめ通信用画素と定め、イメージセンサからの読み出し時には通信用画素については１フレーム中で複数回の読み出しを行なうことにより読み出し速度を上げることが提案されている。 In Patent Document 2, a specific pixel among a plurality of pixels constituting an image sensor is determined in advance as a communication pixel, and when reading from the image sensor, the communication pixel is read a plurality of times in one frame. It has been proposed to increase the reading speed.
しかしながら、特許文献１に記載の方法では、一部の画素を専ら通信に使用してしまうので、その画素位置の画像データが取得できず、画像が劣化するという課題があった。 However, in the method described in Patent Document 1, since some pixels are exclusively used for communication, there is a problem in that image data at the pixel position cannot be acquired and the image deteriorates.
また、通信用として使用する画素は通常の撮像用として使用する画素よりも読み出しサイクルが短いので、露光時間が少なくなり、感度が足りなくなるという課題もあった。 In addition, since pixels used for communication have a shorter readout cycle than pixels used for normal imaging, there is a problem that exposure time is reduced and sensitivity is insufficient.
さらに、比較的小さいエリアの点光源から通信信号である光を受光する場合には、手ぶれ等により撮像位置が変化してしまうと、受光していた画素に光が入らなくなり、通信ができなくなってしまう。また、広告用電光掲示板が発する光を通信信号として受光する場合には、被写体である広告用電光掲示板の表している広告には絵柄があるため、手ぶれ等により撮像位置が変化してしまうと被写体の明暗を通信信号の明暗であると誤認識してしまい、通信精度が得られないという課題があった。 Furthermore, when receiving light as a communication signal from a point light source in a relatively small area, if the imaging position changes due to camera shake or the like, light cannot enter the received pixel and communication cannot be performed. End up. In addition, when receiving light emitted from an advertising electronic bulletin board as a communication signal, the advertisement represented by the advertising electronic bulletin board, which is the subject, has a pattern, so if the imaging position changes due to camera shake or the like, the subject There is a problem that the communication accuracy cannot be obtained due to misrecognizing the light and dark as the light and dark of the communication signal.
特許文献２に記載の方法では通常時と通信時とで読み出しモードを変更できるというメリットがあるものの、通信用に指定した画素は通信信号を読み出すごとにリセットされるため、通信時にはその位置の画像データが取得できず画像が劣化してしまうという課題があった。また、感度や手ぶれの影響に関しても特許文献１と同様の課題があった。 Although the method described in Patent Document 2 has an advantage that the reading mode can be changed between the normal time and the communication time, the pixel designated for communication is reset every time the communication signal is read. There was a problem that data could not be acquired and the image deteriorated. In addition, the same problems as in Patent Document 1 have been encountered with respect to the effects of sensitivity and camera shake.
本発明は上記課題を解決するためになされたものであり、画質を劣化させることなく画像を撮像しながら、画像を撮像するフレームレートより高速なサンプリングを行ないつつ、通信信号に対する感度の劣化を抑えることのできる撮像素子及び撮像装置を提供することを目的とする。また、本発明は、比較的小さいエリアの点光源から通信信号を受信する場合において手ぶれ等により撮像位置が変化してしまっても通信を確保できる撮像素子及び撮像装置を提供することを目的とする。さらに、本発明は、電光掲示板から通信信号を受信する場合において、手ぶれ等により電光掲示板の表している絵柄の撮像位置が変化してしまっても、絵柄の明暗の影響を受けにくく、通信精度を確保できる撮像素子及び撮像装置を提供することを目的とする。 The present invention has been made to solve the above-described problem, and while capturing an image without degrading the image quality, sampling at a speed higher than the frame rate at which the image is captured is performed, and deterioration in sensitivity to a communication signal is suppressed. It is an object of the present invention to provide an imaging device and an imaging apparatus that can perform such a process. It is another object of the present invention to provide an imaging device and an imaging apparatus that can ensure communication even when the imaging position changes due to camera shake or the like when receiving a communication signal from a point light source in a relatively small area. . Furthermore, when receiving a communication signal from an electronic bulletin board, the present invention is less affected by the brightness of the pattern, even if the imaging position of the pattern represented by the electronic bulletin board changes due to camera shake, etc. An object is to provide an image pickup device and an image pickup apparatus that can be secured.
本発明の撮像素子は、入力光を光電変換して電気信号に変換する撮像素子であって、被写体画像を撮像するための複数の画像取得用画素と、通信信号として発せられた可視光又は近赤外光を受光するための通信用受光部とを有し、前記複数の画像取得用画素は格子状に配列された画素配列であり、前記通信用受光部は、少なくとも２つの画像取得用画素を取り囲む領域よりも広範囲に広がっていると共に前記画像取得用画素の隙間に入り込む形状を有し、前記通信用受光部のサンプリングレートが前記画像取得用画素のサンプリングレートより速いという構成を有している。 The imaging device of the present invention is an imaging device that photoelectrically converts input light into an electrical signal, and includes a plurality of image acquisition pixels for capturing a subject image, and visible light or near light emitted as a communication signal. A communication light receiving unit for receiving infrared light, wherein the plurality of image acquisition pixels are arranged in a grid, and the communication light reception unit includes at least two image acquisition pixels. And has a configuration in which the sampling rate of the communication light receiving unit is faster than the sampling rate of the image acquisition pixel. Yes.
この構成により、通信用受光部が、画像取得用画素の隙間に入り込む形状を有しているので、画像取得用画素の配列を格子状に保つことができ、画像取得用画素による画像取得を妨げずに通信信号を受信できる。また、通信用受光部が少なくとも２つの画像取得用画素を取り囲む領域よりも広範囲に広がっているので、通信信号となる可視光又は近赤外光が小さい光源から発せられる場合に、当該小さい光源を広い範囲の通信用受光部において捉えることができる。さらに、通信用受光部が少なくとも２つの画像取得用画素を取り囲む領域よりも広範囲に広がっているので、通信信号となる可視光又は近赤外光が電光掲示板のように絵柄を有する画像である場合に、絵柄を構成する複数の画素からの光を広い範囲の通信用受光部で受光できる。 With this configuration, since the communication light receiving unit has a shape that enters the gap between the image acquisition pixels, the arrangement of the image acquisition pixels can be maintained in a lattice shape, which prevents image acquisition by the image acquisition pixels. Communication signals can be received. In addition, since the communication light-receiving unit extends over a wider area than the region surrounding at least two image acquisition pixels, the visible light or near-infrared light serving as a communication signal is emitted from a small light source. It can be captured in a wide range of communication light receiving units. Furthermore, since the communication light-receiving unit extends over a wider area than the region surrounding at least two image acquisition pixels, the visible light or near-infrared light serving as a communication signal is an image having a pattern such as an electric bulletin board In addition, light from a plurality of pixels constituting the pattern can be received by a wide range of communication light receiving units.
また、本発明の撮像素子において、前記通信用受光部は、１つの信号線によって通信信号が読み出される構成を有している。 In the imaging device of the present invention, the communication light receiving unit has a configuration in which a communication signal is read out by one signal line.
この構成により、通信用受光部により得られた通信信号を容易に取得できる。 With this configuration, the communication signal obtained by the communication light receiving unit can be easily acquired.
また、本発明の撮像素子において、前記通信用受光部は、前記複数の画像取得用画素の各々を囲むように形成されているという構成を有している。 In the imaging device of the present invention, the communication light receiving unit is configured to surround each of the plurality of image acquisition pixels.
この構成により、画像取得用画素による画像取得を妨げることなく通信用受光部の面積を広く確保できる。 With this configuration, a large area of the communication light receiving unit can be secured without hindering image acquisition by the image acquisition pixels.
さらに、本発明の撮像装置は、レンズと、前記レンズを通して入力される光を光電変換して電気信号に変換する撮像素子と、前記撮像素子からの画像読み出しデータを処理する画像信号処理部と、前記撮像素子から得られる通信信号を処理する通信信号処理部とを有し、前記撮像素子は被写体を撮像するための複数の画像取得用画素と、通信信号として発せられた可視光又は近赤外光を受光する通信用受光部とを有し、前記複数の画像取得用画素は格子状に配列された画素配列であり、前記通信用受光部は、少なくとも２つの画像取得用画素を取り囲む領域よりも広範囲に広がっていると共に前記画像取得用画素の隙間に入り込む形状を有し、前記通信用受光部のサンプリングレートが前記画像取得用画素のサンプリングレートより速いという構成を有している。 Furthermore, the imaging apparatus of the present invention includes a lens, an imaging device that photoelectrically converts light input through the lens to an electrical signal, an image signal processing unit that processes image read data from the imaging device, A communication signal processing unit that processes a communication signal obtained from the image sensor, and the image sensor includes a plurality of image acquisition pixels for imaging a subject, and visible light or near infrared light emitted as a communication signal. A plurality of image acquisition pixels arranged in a grid pattern, and the communication light reception unit includes a region surrounding at least two image acquisition pixels. Is spread over a wide area and has a shape that enters the gap between the image acquisition pixels, and the sampling rate of the communication light receiving unit is faster than the sampling rate of the image acquisition pixels. It has a configuration.
この構成により、通信用受光部が、画像取得用画素の隙間に入り込む形状を有しているので、画像取得用画素の配列を格子状に保つことができ、画像取得用画素による画像取得を妨げずに通信信号を受信できる。また、通信用受光部が少なくとも２つの画像取得用画素を取り囲む領域よりも広範囲に広がっているので、通信信号となる可視光又は近赤外光が小さい光源から発せられる場合に、当該小さい光源を広い範囲の通信用受光部において捉えることができる。さらに、通信用受光部が少なくとも２つの画像取得用画素を取り囲む領域よりも広範囲に広がっているので、通信信号となる可視光又は近赤外光が電光掲示板のように絵柄を有する画像である場合に、絵柄を構成する複数の画素からの光を広い範囲の通信用受光部で受光できる。 With this configuration, since the communication light receiving unit has a shape that enters the gap between the image acquisition pixels, the arrangement of the image acquisition pixels can be maintained in a lattice shape, which prevents image acquisition by the image acquisition pixels. Communication signals can be received. In addition, since the communication light-receiving unit extends over a wider area than the region surrounding at least two image acquisition pixels, the visible light or near-infrared light serving as a communication signal is emitted from a small light source. It can be captured in a wide range of communication light receiving units. Furthermore, since the communication light-receiving unit extends over a wider area than the region surrounding at least two image acquisition pixels, the visible light or near-infrared light serving as a communication signal is an image having a pattern such as an electric bulletin board In addition, light from a plurality of pixels constituting the pattern can be received by a wide range of communication light receiving units.
また、本発明の撮像装置では、画像取得用の信号経路と、通信用の信号経路とが互いに独立しているという構成を有している。 In addition, the imaging apparatus of the present invention has a configuration in which an image acquisition signal path and a communication signal path are independent of each other.
この構成により、画像取得用画素のサンプリングレートに影響を与えることなく通信用のサンプリングレートを高速化できる。 With this configuration, the communication sampling rate can be increased without affecting the sampling rate of the image acquisition pixels.
さらに、本発明の撮像装置は、通常時には通信通知信号として発せられた可視光又は近赤外光を前記画像取得用画素にて受け取り、前記通信通知信号に基づいて前記可視光又は近赤外光の中に高速通信信号が含まれると判断したときに前記通信用受光部の動作を開始するという構成を有している。 Furthermore, the imaging apparatus according to the present invention receives visible light or near infrared light emitted as a communication notification signal in a normal state at the image acquisition pixel, and based on the communication notification signal, the visible light or near infrared light. The operation of the light receiving unit for communication is started when it is determined that a high-speed communication signal is included.
この構成により、高速で転送されている情報があるときのみ撮像素子の通信用受光部を動作できる。 With this configuration, the communication light receiving unit of the image sensor can be operated only when there is information transferred at high speed.
さらに、本発明の撮像装置は、前記通信通知信号に含まれる送信速度の情報に応じて前記通信用受光部のサンプリングレートを設定するという構成を有している。 Furthermore, the imaging apparatus of the present invention has a configuration in which the sampling rate of the communication light receiving unit is set in accordance with transmission speed information included in the communication notification signal.
この構成により、転送されている情報の速度に合わせて撮像素子の通信用受光部の動作速度を設定できる。 With this configuration, the operation speed of the communication light receiving unit of the image sensor can be set according to the speed of the information being transferred.
本発明は、通信用受光部が、少なくとも２つの画像取得用画素を取り囲む領域よりも広範囲に広がっていると共に前記画像取得用画素の隙間に入り込む形状を有しているので、通信時にも画像の劣化はなく、感度が十分に確保できるとともに、比較的小さい光源との通信の場合において手ぶれ等により撮像位置が変化してしまっても通信を確保でき、電光掲示板との通信の場合において手ぶれ等により撮像位置が変化してしまっても、通信精度を確保できるという効果を有する撮像素子及び撮像装置を提供することができるものである。 In the present invention, the communication light receiving unit has a shape that extends in a wider range than the region surrounding at least two image acquisition pixels and enters the gap between the image acquisition pixels. There is no deterioration, sufficient sensitivity can be secured, communication can be secured even if the imaging position changes due to camera shake etc. when communicating with a relatively small light source, and camera shake etc. when communicating with an electric bulletin board It is possible to provide an imaging device and an imaging apparatus that have an effect of ensuring communication accuracy even if the imaging position changes.
以下、本発明の実施の形態について、図面を用いて説明する。 Hereinafter, embodiments of the present invention will be described with reference to the drawings.
（第１の実施の形態）
本実施の形態では、撮像装置として、電子カメラモジュールを例に説明する。電子カメラモジュール１００は、例えば携帯電話、デジタルカメラ、ＰＤＡ（Ｐｅｒｓｏｎａｌ Ｄｉｇｉｔａｌ Ａｓｓｉｓｔａｎｔ）等の携帯端末機器に搭載される。
(First embodiment)
In this embodiment, an electronic camera module will be described as an example of the imaging device. The electronic camera module 100 is mounted on a mobile terminal device such as a mobile phone, a digital camera, or a PDA (Personal Digital Assistant).
図１は、本発明の第１の実施の形態の撮像素子１０２の構成図であり、図２は、本発明の第１の実施の形態における電子カメラモジュール１００のブロック図である。最初に図２を参照して本実施の形態の電子カメラモジュール１００の全体構成について説明する。 FIG. 1 is a configuration diagram of the image sensor 102 according to the first embodiment of the present invention, and FIG. 2 is a block diagram of the electronic camera module 100 according to the first embodiment of the present invention. First, the overall configuration of the electronic camera module 100 of the present embodiment will be described with reference to FIG.
図２に示すように、第１の実施の形態の撮像装置である電子カメラモジュール１００は、レンズ１０１と、撮像素子１０２と、信号処理部１０３とを有する。撮像素子１０２は、複数の画像取得用画素１３２と水平読み出し部１３３とを有する画像取得部１３０と、通信用受信部１３１とを備えている。信号処理部１０３は、画像信号処理部１０４と通信信号処理部１２０とを有し、画像信号処理部１０４は、さらに前処理部１１０と、輝度系信号処理部１１２と色差系信号処理部１１３と出力制御部１１４とを有する。 As illustrated in FIG. 2, the electronic camera module 100 that is the imaging apparatus according to the first embodiment includes a lens 101, an imaging element 102, and a signal processing unit 103. The image sensor 102 includes an image acquisition unit 130 having a plurality of image acquisition pixels 132 and a horizontal readout unit 133, and a communication reception unit 131. The signal processing unit 103 includes an image signal processing unit 104 and a communication signal processing unit 120. The image signal processing unit 104 further includes a preprocessing unit 110, a luminance system signal processing unit 112, a color difference system signal processing unit 113, and the like. And an output control unit 114.
レンズ１０１は被写体からの光学像を撮像素子１０２に結像する。レンズ１０１を通った光学像は撮像素子１０２に照射される。 The lens 101 forms an optical image from the subject on the image sensor 102. The optical image that has passed through the lens 101 is irradiated to the image sensor 102.
図１を参照して、撮像素子１０２について説明する。図１に示すように、撮像素子１０２は、図の横方向に並べられて図の縦方向に伸びる複数の列読み出し線１３４１〜１３４８（以下、特に各線を区別しない場合は符号「１３４」を用いる。）と、図の縦方向に並べられて図の横方向に伸びる複数の行選択信号線１３５１〜１３５８（以下、特に各線を区別しない場合は符号「１３５」を用いる。）と、複数の列読み出し線１３４と複数の行選択信号線１３５のそれぞれの交点に対応して設けられた複数の画像取得用画素１３２と、複数の列読み出し線１３４が接続される水平読み出し部１３３とを有する。画像取得用画素１３２は格子状に２次元配列されている。画像取得用画素１３２は、Ｒ画素、Ｇｒ画素、Ｇｂ画素、及びＢ画素からなり、各画素は、Ｒ画素とＧｒ画素を持つラインとＢ画素とＧｂ画素を持つラインがライン毎に交互に配置されたベイヤー配列にて配列されている。水平読み出し部１３３から画像読み出し信号線１３６が引き出されている。なお、図１では、説明の便宜のために８行８列の画像取得用画素１３２を示しているが、より多くの画像取得用画素を有する撮像素子にも本発明を適用できることはもちろんである。 The image sensor 102 will be described with reference to FIG. As shown in FIG. 1, the image sensor 102 uses a plurality of column readout lines 1341 to 1348 arranged in the horizontal direction in the figure and extending in the vertical direction in the figure (hereinafter, the symbol “134” is used unless the lines are distinguished). .), A plurality of row selection signal lines 1351 to 1358 arranged in the vertical direction of the drawing and extending in the horizontal direction of the drawing (hereinafter, reference numeral “135” is used unless the lines are distinguished), and a plurality of columns. A plurality of image acquisition pixels 132 provided corresponding to respective intersections of the readout line 134 and the plurality of row selection signal lines 135, and a horizontal readout unit 133 to which the plurality of column readout lines 134 are connected. The image acquisition pixels 132 are two-dimensionally arranged in a grid pattern. The image acquisition pixel 132 includes an R pixel, a Gr pixel, a Gb pixel, and a B pixel. In each pixel, a line having an R pixel and a Gr pixel and a line having a B pixel and a Gb pixel are alternately arranged for each line. Arranged in a Bayer array. An image read signal line 136 is drawn from the horizontal read unit 133. In FIG. 1, the image acquisition pixels 132 of 8 rows and 8 columns are shown for convenience of explanation, but the present invention can of course be applied to an image sensor having a larger number of image acquisition pixels. .
撮像素子１０２には、１つの通信用受光部１３１が設けられている。通信用受光部１３１は、すべての画像取得用画素１３２のうちの少なくとも一部の複数の画像取得用画素が存在する撮像面上の２次元エリア（即ち複数の画像取得用画素を取り囲むエリア）よりも広範囲に広がって配置されている。図１の例では、４行４列の画素範囲に広がって通信用受光部１３１が配置されている。そして、通信用受光部１３１は、複数の画像取得用画素１３２の各々の隙間に入り込むように形成されることで、格子状を呈している。図１の例では、通信用受光部１３１は、第２の行選択信号線１３５２から第６の行選択信号線１３５６及び第３の列読み出し線１３４３から第７の列読み出し線１３４７によって囲まれる領域に２次元配列された画像取得用画素１３２の各々の間に形成されることで、格子状に形成されている。また、通信用受光部１３１は、すべての画像取得用画素１３２のうちの少なくとも一部の２次元配列された複数の画像取得用画素１３２の各々を囲むように形成されている。図１の例では、通信用受光部１３１は、第２の行選択信号線１３５２と第６の行選択信号線１３５６及び第３の列読み出し線１３４３と第７の列読み出し線１３４７によって囲まれる領域に２次元配列された画像取得用画素１３２の各々を囲むように形成されている。通信用受光部１３１からは通信読み出し信号線１３７が引き出されている。 The imaging device 102 is provided with one communication light receiving unit 131. The communication light receiving unit 131 is based on a two-dimensional area on the imaging surface in which at least some of the plurality of image acquisition pixels among all the image acquisition pixels 132 exist (that is, an area surrounding the plurality of image acquisition pixels). Is also widely spread. In the example of FIG. 1, the communication light receiving unit 131 is arranged so as to extend over a pixel range of 4 rows and 4 columns. The communication light receiving unit 131 has a lattice shape by being formed so as to enter the gaps between the plurality of image acquisition pixels 132. In the example of FIG. 1, the communication light receiving unit 131 is an area surrounded by the second row selection signal line 1352 to the sixth row selection signal line 1356 and the third column readout line 1343 to the seventh column readout line 1347. Are formed between each of the image acquisition pixels 132 that are two-dimensionally arranged in a two-dimensional array. Further, the communication light receiving unit 131 is formed so as to surround each of the plurality of image acquisition pixels 132 arranged in two dimensions in at least a part of all the image acquisition pixels 132. In the example of FIG. 1, the communication light receiving unit 131 is an area surrounded by the second row selection signal line 1352, the sixth row selection signal line 1356, the third column readout line 1343, and the seventh column readout line 1347. Are formed so as to surround each of the two-dimensionally arranged image acquisition pixels 132. A communication read signal line 137 is drawn from the communication light receiving unit 131.
Ｒ画素、Ｇｒ画素、Ｂ画素、Ｇｂ画素からなる画像取得用画素１３２の各画素で生成された信号は、各画素が行選択信号により選択さることで、列読み出し線１３４を通って水平読み出し部１３３に出力され、水平読み出し部１３３から画像読み出し信号として出力される。 A signal generated by each pixel of the image acquisition pixel 132 including the R pixel, the Gr pixel, the B pixel, and the Gb pixel is selected by the row selection signal, and the horizontal readout unit passes through the column readout line 134. 133 and output from the horizontal readout unit 133 as an image readout signal.
水平読み出し部１３３より出力された画像読み出し信号は、画像読み出し信号線１３６を介して信号処理部１０３の前処理部１１０に入力される。前処理部１１０に入力された信号は、前処理部１１０で前処理が施された後、輝度系信号処理部１１２及び色差系信号処理部１１３にそれぞれ入力される。輝度系信号処理部１１２では輝度に関する処理が施され、色差系信号処理部１１３では色差に関する処理が施される。輝度系信号処理部１１２で処理された信号及び色差系信号処理部１１３で処理された信号はそれぞれ出力制御部１１４に入力され、出力制御部１１４において同期信号とともに合成されて画像データとして外部へ出力される。 The image readout signal output from the horizontal readout unit 133 is input to the preprocessing unit 110 of the signal processing unit 103 via the image readout signal line 136. The signal input to the preprocessing unit 110 is preprocessed by the preprocessing unit 110 and then input to the luminance system signal processing unit 112 and the color difference system signal processing unit 113. The luminance system signal processing unit 112 performs processing related to luminance, and the color difference system signal processing unit 113 performs processing related to color difference. The signal processed by the luminance system signal processing unit 112 and the signal processed by the color difference system signal processing unit 113 are respectively input to the output control unit 114, and are combined with the synchronization signal by the output control unit 114 and output to the outside as image data. Is done.
通信用受光部１３１で受光された通信信号は、通信読み出し信号線１３７を介して通信信号処理部１２０に入力され、通信信号処理部１２０で処理されて、外部へ出力される。 The communication signal received by the communication light receiving unit 131 is input to the communication signal processing unit 120 via the communication readout signal line 137, processed by the communication signal processing unit 120, and output to the outside.
図３は、撮像素子１０２からの読み出し信号のタイミング図である。図３（ａ）に示すように、１枚の画像データ信号は垂直同期信号ごとに出力される。図３（ｂ）は図３（ａ）の点線で囲まれた部分を拡大した図である。図３（ｂ）に示すように、１枚の画像データはライン毎に１Ｈ、２Ｈ、３Ｈ・・・と順次出力される。通信データは、画像データの読み出し周期とは無関係に、１、２、３、４・・・と高速で読み出されて転送される。 FIG. 3 is a timing diagram of a readout signal from the image sensor 102. As shown in FIG. 3A, one image data signal is output for each vertical synchronization signal. FIG. 3B is an enlarged view of a portion surrounded by a dotted line in FIG. As shown in FIG. 3B, one image data is sequentially output as 1H, 2H, 3H... For each line. The communication data is read and transferred at a high speed of 1, 2, 3, 4,... Regardless of the image data read cycle.
図１に示すように、通信信号用の読み出し経路は、通信用受光部１３１から通信読み出し信号線１３７を経て通信信号処理部１２０に至るという経路で構成される。また、画像取得用の読み出し経路は、画像取得用画素１３２から水平読み出し部１３３、画像読み出し信号線１３６を経て画像信号処理部１０４に至るという経路で構成される。このように、両経路は互いに独立している。 As shown in FIG. 1, the communication signal readout path is configured by a path from the communication light receiving unit 131 to the communication signal processing unit 120 via the communication readout signal line 137. Further, the readout path for image acquisition includes a path from the image acquisition pixel 132 to the image signal processing unit 104 via the horizontal readout unit 133 and the image readout signal line 136. Thus, both paths are independent of each other.
図４は、電子カメラモジュール１００を搭載した携帯電話５００使用して、ＬＥＤで構成される電光掲示板を撮像している様子を示す図である。電光掲示板４０は例えば広告を表示するのに用いられる。電光掲示板４０は広告の表示とは別にユーザーに送りたい情報を通信信号として変調し、ＬＥＤの輝度の変化として発出している。電光掲示板４０では、各画素の光源としてＬＥＤを採用し、すべての画素のＬＥＤの輝度が通信信号に対応するように高速で点滅している。この点滅速度は、人の目では認識できない程度に十分に速い速度である。ユーザーは携帯電話５００を電光掲示板４０に向けることで、通信用受光部１３１を使用して高速で点滅するＬＥＤから情報を取得できる。 FIG. 4 is a diagram showing a state where an electronic bulletin board composed of LEDs is being imaged using a mobile phone 500 on which the electronic camera module 100 is mounted. The electronic bulletin board 40 is used, for example, to display advertisements. The electronic bulletin board 40 modulates information desired to be sent to the user separately from the advertisement display as a communication signal and emits it as a change in the brightness of the LED. The electronic bulletin board 40 employs LEDs as the light source of each pixel, and blinks at high speed so that the luminance of the LEDs of all the pixels corresponds to the communication signal. This blinking speed is sufficiently high that it cannot be recognized by human eyes. The user can acquire information from the LED blinking at high speed by using the communication light receiving unit 131 by pointing the mobile phone 500 toward the electronic bulletin board 40.
この際、通信用受光部１３１が広範囲に広がって配置されているので、電光掲示板４０の複数の画素の点滅を通信用受光部１３１で検知することになる。よって、手ぶれ等により携帯電話５００が揺れて撮像範囲が若干変わっても、電光掲示板４０が点灯しているときに通信用受光部１３１全体で受ける光量の変化は小さく、手ぶれの影響が少なくなる。これにより、通信精度が確保される。 At this time, since the communication light receiving unit 131 is spread over a wide range, the communication light receiving unit 131 detects blinking of a plurality of pixels of the electronic bulletin board 40. Therefore, even if the cellular phone 500 is shaken by camera shake or the like and the imaging range is slightly changed, the change in the amount of light received by the entire communication light receiving unit 131 when the electronic bulletin board 40 is lit is small, and the influence of camera shake is reduced. Thereby, communication accuracy is ensured.
なお、本実施の形態の撮像素子又は撮像装置は、通信信号を発する光源が点光源である場合にも有効である。光源が点光源である場合には、当該点光源は可視光又は近赤外光の強弱によって通信信号を伝達し、撮像装置では通信用受光部にてその可視光又は近赤外光を受光することで通信信号を受信する。 Note that the image sensor or the imaging device of the present embodiment is also effective when the light source that emits the communication signal is a point light source. When the light source is a point light source, the point light source transmits a communication signal by the intensity of visible light or near-infrared light, and the imaging device receives the visible light or near-infrared light at the communication light receiving unit. The communication signal is received.
また、本実施の形態では、４行４列の画像取得用画素１３２に対応して、外郭が正方形の通信用受光部１３１が形成されているが、これに限られない。通信用受光部１３１は、少なくとも２つの画像取得用画素を取り囲む領域よりも広範囲に広がっていればよい。例えば、３行４列や５行４列等の画像取得用画素１３２に対応して長方形の通信用受光部を形成してもよい。また、２行２列や３行３列の画像取得用画素１３２に対応するより小さな通信用受光部を形成してもよい。さらに、５行５列や６行６列の画像取得用画素１３２に対応するより大きな通信用受光部を形成してもよい。また、画像取得用画素１３２が形成された全面の領域にわたって、画像取得用画素１３２を避けるように格子状に通信用受光部を形成してもよい。さらに、このような通信用受光部１３１が複数設けられていてもよい。 In the present embodiment, the communication light receiving unit 131 having a square outline is formed corresponding to the image acquisition pixel 132 of 4 rows and 4 columns. However, the present invention is not limited to this. The communication light receiving unit 131 only needs to extend over a wider area than a region surrounding at least two image acquisition pixels. For example, a rectangular communication light receiving unit may be formed corresponding to the image acquisition pixels 132 such as 3 rows and 4 columns and 5 rows and 4 columns. In addition, a smaller communication light receiving unit corresponding to the image acquisition pixel 132 of 2 rows and 2 columns or 3 rows and 3 columns may be formed. Furthermore, a larger communication light receiving unit corresponding to the image acquisition pixels 132 of 5 rows and 5 columns and 6 rows and 6 columns may be formed. Further, the communication light receiving unit may be formed in a lattice shape so as to avoid the image acquisition pixel 132 over the entire area where the image acquisition pixel 132 is formed. Further, a plurality of such communication light receiving units 131 may be provided.
以上のように、本実施の形態によれば、通信用受光部１３１が画像取得用画素１３２とは別に、画像取得用画素１３２を避けるようにして形成されているので、画像の取得において画像を劣化させることはなく、通信用受光部１３１については画像取得用画素１３２のサンプリングレートよりも高速のレートでサンプリングできる。また、通信用受光部１３１が複数の画像取得用画素１３２を取り囲む領域よりも広範囲に広がっているので、通信信号を発する光源が点光源のように小さな光源である場合に、通信信号の受信において撮像素子１０２が手ぶれによって揺れたとしても、小さい光源を広い受光範囲の一部において捉えることができるので、確実に通信信号を通信用受光部１３１で捉えることができ、通信を確保できる。さらに、信用受光部１３１が複数の画像取得用画素１３２を取り囲む領域よりも広範囲に広がっているので、通信信号を発する光源が電光掲示板のように絵柄を有するものである場合に、通信信号の受信において撮像素子１０２が手ぶれによって揺れたとしても、絵柄を構成する複数の画素からの光を通信用受光部１３１で受光できるので、被写体の絵柄による明暗の変化を通信信号と誤認識しにくくなり、通信精度が確保できる。さらに、通信信号用の読み出し経路と画像取得用の読み出し経路とは互いに独立しているので、画像取得用画素のサンプリングレートに影響を与えることなく通信用のサンプリングレートを高速化でき、通信信号を、画像読み出しサイクルとは関係なく、画像読み出しのためのライン周波数よりも高速に読み出すことできる。 As described above, according to the present embodiment, the communication light receiving unit 131 is formed so as to avoid the image acquisition pixel 132 separately from the image acquisition pixel 132. The communication light receiving unit 131 can be sampled at a rate higher than the sampling rate of the image acquisition pixel 132 without being deteriorated. In addition, since the communication light receiving unit 131 extends over a wider area than the region surrounding the plurality of image acquisition pixels 132, when the light source that emits the communication signal is a small light source such as a point light source, Even if the image sensor 102 is shaken by camera shake, a small light source can be captured in a part of a wide light receiving range, so that a communication signal can be reliably captured by the communication light receiving unit 131 and communication can be ensured. Furthermore, since the trusted light receiving unit 131 is spread over a wider area than the region surrounding the plurality of image acquisition pixels 132, the communication signal is received when the light source that emits the communication signal has a pattern such as an electric bulletin board. Even if the image sensor 102 is shaken by camera shake, light from a plurality of pixels constituting the pattern can be received by the communication light receiving unit 131, so that it becomes difficult to misrecognize a change in brightness due to the pattern of the subject as a communication signal, Communication accuracy can be secured. Furthermore, since the communication signal readout path and the image acquisition readout path are independent of each other, the communication sampling rate can be increased without affecting the sampling rate of the image acquisition pixels, and the communication signal can be transmitted. Regardless of the image reading cycle, it is possible to read at a speed higher than the line frequency for reading the image.
（第２の実施の形態）
図５は、本発明の第２の実施の形態における撮像装置のブロック図である。第１の実施の形態と同様の構成については、同一の符号を付してその説明は省略する。第２の実施の形態の撮像装置には、第１の実施の形態の撮像装置の構成に加えて、低速通信信号処理部１４０が設けられている。
(Second Embodiment)
FIG. 5 is a block diagram of an imaging apparatus according to the second embodiment of the present invention. The same components as those in the first embodiment are denoted by the same reference numerals, and the description thereof is omitted. The imaging apparatus according to the second embodiment is provided with a low-speed communication signal processing unit 140 in addition to the configuration of the imaging apparatus according to the first embodiment.
この撮像装置２００も第１の実施の形態と同様に、電光掲示板を撮像することで、撮像素子１０２中の通信用受光部１３１によって電光掲示板のＬＥＤの輝度変化から通信情報を取得する。ただし、本実施の形態の撮像装置２００は、通信用受光部１３１での受光を開始する前に、撮像素子１０２中の画像取得用画素１３２によって、通信情報があることを検知する点で第１の実施の形態の撮像装置と異なる。このために、電光掲示板４０は画像取得用画素１３２のサンプリング周期で検知できる周期の低速のＬＥＤの輝度変化による信号を通信通知信号として発出する。 As in the first embodiment, the imaging apparatus 200 also captures the electronic bulletin board so that the communication light receiving unit 131 in the imaging element 102 acquires the communication information from the luminance change of the LED of the electronic bulletin board. However, the imaging apparatus 200 according to the present embodiment is first in that the image acquisition pixel 132 in the imaging element 102 detects that there is communication information before the light reception by the communication light receiving unit 131 is started. This is different from the imaging apparatus of the embodiment. For this purpose, the electronic bulletin board 40 issues as a communication notification signal a signal due to a change in luminance of the low-speed LED having a cycle that can be detected by the sampling cycle of the image acquisition pixel 132.
撮像装置２００の低速通信信号処理部１４０は、画像取得用画素１３２で得られたこの低速の輝度変化（通信通知信号）から、高速で転送されている情報があるか否かの情報を入手する。そして、低速通信信号処理部１４０にて高速で転送されている情報があると判断された場合にのみ、撮像素子１０２の通信用受光部１３１の読み出し動作を開始する。読み出された信号は、第１の実施の形態と同様に通信信号処理部１２０で処理される。 The low-speed communication signal processing unit 140 of the imaging device 200 obtains information on whether there is information transferred at high speed from the low-speed luminance change (communication notification signal) obtained by the image acquisition pixel 132. . Then, only when the low-speed communication signal processing unit 140 determines that there is information transferred at high speed, the reading operation of the communication light receiving unit 131 of the image sensor 102 is started. The read signal is processed by the communication signal processing unit 120 as in the first embodiment.
第２の実施の形態の撮像装置２００によれば、高速で転送されている情報があるときのみ撮像素子１０２の通信用受光部１３１が動作するので、消費電力が抑えられる。 According to the imaging apparatus 200 of the second embodiment, the communication light receiving unit 131 of the imaging element 102 operates only when there is information transferred at high speed, so that power consumption can be suppressed.
本実施の形態において、通信通知信号に通信速度に関する情報を含めてもよい。この場合、低速通信信号処理部１４０は、通信速度に関する情報を入手し、その速度に応じて撮像素子１０２の通信用受光部１３１の読み出し速度を最適化する。これにより、転送されている情報の速度に合わせて撮像素子１０２の通信用受光部１３１の動作速度を設定できるので、通信用受光部１３１を不必要に高速に動作させずに済み、消費電力が抑えられる。 In the present embodiment, information regarding the communication speed may be included in the communication notification signal. In this case, the low-speed communication signal processing unit 140 obtains information on the communication speed, and optimizes the reading speed of the communication light receiving unit 131 of the image sensor 102 according to the speed. As a result, the operation speed of the communication light receiving unit 131 of the image sensor 102 can be set in accordance with the speed of the transferred information, so that it is not necessary to operate the communication light receiving unit 131 at an unnecessarily high speed, and power consumption is reduced. It can be suppressed.
本発明にかかる撮像素子又は撮像装置は、通信時にも画像の劣化がなく、通信の感度の劣化や手ぶれ等による影響を少なくできるので、画像を取得しつつ、可視光や近赤外光による通信を行なうための撮像素子又は撮像装置等として有用である。 The image pickup device or the image pickup apparatus according to the present invention has no image deterioration even during communication, and can reduce the influence of communication sensitivity deterioration, camera shake, and the like. Therefore, communication using visible light or near infrared light while acquiring an image is possible. It is useful as an imaging device or an imaging device for performing the above.
１００ 電子カメラモジュール
１０１ レンズ
１０２ 撮像素子
１０３ 信号処理部
１０４ 画像信号処理部
１２０ 通信信号処理部
１３０ 画像取得部
１３１ 通信用受光部
１３２ 画像取得用画素
１４０ 低速通信信号処理部
DESCRIPTION OF SYMBOLS 100 Electronic camera module 101 Lens 102 Image pick-up element 103 Signal processing part 104 Image signal processing part 120 Communication signal processing part 130 Image acquisition part 131 Light-receiving part for communication 132 Pixel for image acquisition 140 Low-speed communication signal processing part
Claims (7)
前記撮像素子は、被写体画像を撮像するための複数の画像取得用画素と、通信信号として発せられた可視光又は近赤外光を受光するための通信用受光部とを有し、前記複数の画像取得用画素は格子状に配列された画素配列であり、前記通信用受光部は、少なくとも２つの画像取得用画素を取り囲む領域よりも広範囲に広がっていると共に前記画像取得用画素の隙間に入り込む形状を有し、前記通信用受光部のサンプリングレートが前記画像取得用画素のサンプリングレートより速いことを特徴とする撮像装置。 An imaging device, a lens, an image sensor that photoelectrically converts light input through the lens to an electrical signal, an image signal processing unit that processes image read data from the image sensor, and the image sensor A communication signal processing unit for processing a communication signal obtained from
The imaging device includes a plurality of image acquisition pixels for imaging a subject image, and a communication light receiving unit for receiving visible light or near infrared light emitted as a communication signal. The image acquisition pixels are arranged in a grid pattern, and the communication light-receiving unit extends over a wider area than the area surrounding at least two image acquisition pixels and enters the gap between the image acquisition pixels. An imaging apparatus having a shape, wherein a sampling rate of the communication light receiving unit is faster than a sampling rate of the image acquisition pixel.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2009118380A JP2010268264A (en) | 2009-05-15 | 2009-05-15 | Imaging element and imaging apparatus |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2009118380A JP2010268264A (en) | 2009-05-15 | 2009-05-15 | Imaging element and imaging apparatus |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| JP2010268264A true JP2010268264A (en) | 2010-11-25 |
Family
ID=43364873
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2009118380A Pending JP2010268264A (en) | 2009-05-15 | 2009-05-15 | Imaging element and imaging apparatus |
Country Status (1)
| Country | Link |
|---|---|
| JP (1) | JP2010268264A (en) |
Cited By (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013175804A1 (en) * | 2012-05-24 | 2013-11-28 | パナソニック株式会社 | Information communication method |
| US8908074B2 (en) | 2012-12-27 | 2014-12-09 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US8913144B2 (en) | 2012-12-27 | 2014-12-16 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US8922666B2 (en) | 2012-12-27 | 2014-12-30 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US8988574B2 (en) | 2012-12-27 | 2015-03-24 | Panasonic Intellectual Property Corporation Of America | Information communication method for obtaining information using bright line image |
| US9008352B2 (en) | 2012-12-27 | 2015-04-14 | Panasonic Intellectual Property Corporation Of America | Video display method |
| US9088363B2 (en) | 2012-12-27 | 2015-07-21 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US9085927B2 (en) | 2012-12-27 | 2015-07-21 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US9087349B2 (en) | 2012-12-27 | 2015-07-21 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US9094120B2 (en) | 2012-12-27 | 2015-07-28 | Panasonic Intellectual Property Corporaton Of America | Information communication method |
| US9262954B2 (en) | 2012-12-27 | 2016-02-16 | Panasonic Intellectual Property Corporation Of America | Visible light communication signal display method and apparatus |
| US9608725B2 (en) | 2012-12-27 | 2017-03-28 | Panasonic Intellectual Property Corporation Of America | Information processing program, reception program, and information processing apparatus |
| US9608727B2 (en) | 2012-12-27 | 2017-03-28 | Panasonic Intellectual Property Corporation Of America | Switched pixel visible light transmitting method, apparatus and program |
| US9646568B2 (en) | 2012-12-27 | 2017-05-09 | Panasonic Intellectual Property Corporation Of America | Display method |
| US10303945B2 (en) | 2012-12-27 | 2019-05-28 | Panasonic Intellectual Property Corporation Of America | Display method and display apparatus |
| US10523876B2 (en) | 2012-12-27 | 2019-12-31 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US10530486B2 (en) | 2012-12-27 | 2020-01-07 | Panasonic Intellectual Property Corporation Of America | Transmitting method, transmitting apparatus, and program |
| CN110708479A (en) * | 2018-07-10 | 2020-01-17 | 广州印芯半导体技术有限公司 | Image sensor with visible light communication function and image sensing system |
| US10951310B2 (en) | 2012-12-27 | 2021-03-16 | Panasonic Intellectual Property Corporation Of America | Communication method, communication device, and transmitter |
-
2009
- 2009-05-15 JP JP2009118380A patent/JP2010268264A/en active Pending
Cited By (90)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013175804A1 (en) * | 2012-05-24 | 2013-11-28 | パナソニック株式会社 | Information communication method |
| JP5405695B1 (en) * | 2012-05-24 | 2014-02-05 | パナソニック株式会社 | Information communication method and information communication apparatus |
| CN103650384A (en) * | 2012-05-24 | 2014-03-19 | 松下电器产业株式会社 | Information communication method |
| US8823852B2 (en) | 2012-05-24 | 2014-09-02 | Panasonic Intellectual Property Corporation Of America | Information communication method of obtaining information from a subject by demodulating data specified by a pattern of a bright line included in an obtained image |
| CN103650384B (en) * | 2012-05-24 | 2017-07-18 | 松下电器（美国）知识产权公司 | Information communicating method |
| US9083544B2 (en) | 2012-05-24 | 2015-07-14 | Panasonic Intellectual Property Corporation Of America | Information communication method of obtaining information from a subject by demodulating data specified by a pattern of a bright line included in an obtained image |
| US9456109B2 (en) | 2012-05-24 | 2016-09-27 | Panasonic Intellectual Property Corporation Of America | Information communication method of obtaining information from a subject by demodulating data specified by a pattern of a bright line included in an obtained image |
| US9300845B2 (en) | 2012-05-24 | 2016-03-29 | Panasonic Intellectual Property Corporation Of America | Information communication device for obtaining information from a subject by demodulating a bright line pattern included in an obtained image |
| US8994841B2 (en) | 2012-05-24 | 2015-03-31 | Panasonic Intellectual Property Corporation Of America | Information communication method for obtaining information specified by stripe pattern of bright lines |
| US9166810B2 (en) | 2012-05-24 | 2015-10-20 | Panasonic Intellectual Property Corporation Of America | Information communication device of obtaining information by demodulating a bright line pattern included in an image |
| US9143339B2 (en) | 2012-05-24 | 2015-09-22 | Panasonic Intellectual Property Corporation Of America | Information communication device for obtaining information from image data by demodulating a bright line pattern appearing in the image data |
| US9083543B2 (en) | 2012-05-24 | 2015-07-14 | Panasonic Intellectual Property Corporation Of America | Information communication method of obtaining information from a subject by demodulating data specified by a pattern of a bright line included in an obtained image |
| US10218914B2 (en) | 2012-12-20 | 2019-02-26 | Panasonic Intellectual Property Corporation Of America | Information communication apparatus, method and recording medium using switchable normal mode and visible light communication mode |
| US9591232B2 (en) | 2012-12-27 | 2017-03-07 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US9756255B2 (en) | 2012-12-27 | 2017-09-05 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US9019412B2 (en) | 2012-12-27 | 2015-04-28 | Panasonic Intellectual Property Corporation Of America | Information communication method for selecting between visible light communication mode and normal imaging mode |
| US9088363B2 (en) | 2012-12-27 | 2015-07-21 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US9085927B2 (en) | 2012-12-27 | 2015-07-21 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US9088362B2 (en) | 2012-12-27 | 2015-07-21 | Panasonic Intellectual Property Corporation Of America | Information communication method for obtaining information by demodulating bright line pattern included in an image |
| US9087349B2 (en) | 2012-12-27 | 2015-07-21 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US9088360B2 (en) | 2012-12-27 | 2015-07-21 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US9094120B2 (en) | 2012-12-27 | 2015-07-28 | Panasonic Intellectual Property Corporaton Of America | Information communication method |
| US9008352B2 (en) | 2012-12-27 | 2015-04-14 | Panasonic Intellectual Property Corporation Of America | Video display method |
| US8994865B2 (en) | 2012-12-27 | 2015-03-31 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US9184838B2 (en) | 2012-12-27 | 2015-11-10 | Panasonic Intellectual Property Corporation Of America | Information communication method for obtaining information using ID list and bright line image |
| US9203515B2 (en) | 2012-12-27 | 2015-12-01 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US9247180B2 (en) | 2012-12-27 | 2016-01-26 | Panasonic Intellectual Property Corporation Of America | Video display method using visible light communication image including stripe patterns having different pitches |
| US9252878B2 (en) | 2012-12-27 | 2016-02-02 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US9258058B2 (en) | 2012-12-27 | 2016-02-09 | Panasonic Intellectual Property Corporation Of America | Signal transmitting apparatus for transmitting information by bright line pattern in image |
| US9262954B2 (en) | 2012-12-27 | 2016-02-16 | Panasonic Intellectual Property Corporation Of America | Visible light communication signal display method and apparatus |
| US9281895B2 (en) | 2012-12-27 | 2016-03-08 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US8988574B2 (en) | 2012-12-27 | 2015-03-24 | Panasonic Intellectual Property Corporation Of America | Information communication method for obtaining information using bright line image |
| US9331779B2 (en) | 2012-12-27 | 2016-05-03 | Panasonic Intellectual Property Corporation Of America | Information communication method for obtaining information using ID list and bright line image |
| US9341014B2 (en) | 2012-12-27 | 2016-05-17 | Panasonic Intellectual Property Corporation Of America | Information communication method using change in luminance |
| US9380227B2 (en) | 2012-12-27 | 2016-06-28 | Panasonic Intellectual Property Corporation Of America | Information communication method for obtaining information using bright line image |
| US9407368B2 (en) | 2012-12-27 | 2016-08-02 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US9450672B2 (en) | 2012-12-27 | 2016-09-20 | Panasonic Intellectual Property Corporation Of America | Information communication method of transmitting a signal using change in luminance |
| US8965216B2 (en) | 2012-12-27 | 2015-02-24 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US9462173B2 (en) | 2012-12-27 | 2016-10-04 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US9467225B2 (en) | 2012-12-27 | 2016-10-11 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US9515731B2 (en) | 2012-12-27 | 2016-12-06 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US9560284B2 (en) | 2012-12-27 | 2017-01-31 | Panasonic Intellectual Property Corporation Of America | Information communication method for obtaining information specified by striped pattern of bright lines |
| US9564970B2 (en) | 2012-12-27 | 2017-02-07 | Panasonic Intellectual Property Corporation Of America | Information communication method for obtaining information using ID list and bright line image |
| US9571191B2 (en) | 2012-12-27 | 2017-02-14 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US8922666B2 (en) | 2012-12-27 | 2014-12-30 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US9608725B2 (en) | 2012-12-27 | 2017-03-28 | Panasonic Intellectual Property Corporation Of America | Information processing program, reception program, and information processing apparatus |
| US9608727B2 (en) | 2012-12-27 | 2017-03-28 | Panasonic Intellectual Property Corporation Of America | Switched pixel visible light transmitting method, apparatus and program |
| US9613596B2 (en) | 2012-12-27 | 2017-04-04 | Panasonic Intellectual Property Corporation Of America | Video display method using visible light communication image including stripe patterns having different pitches |
| US9635278B2 (en) | 2012-12-27 | 2017-04-25 | Panasonic Intellectual Property Corporation Of America | Information communication method for obtaining information specified by striped pattern of bright lines |
| US9641766B2 (en) | 2012-12-27 | 2017-05-02 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US9646568B2 (en) | 2012-12-27 | 2017-05-09 | Panasonic Intellectual Property Corporation Of America | Display method |
| US8913144B2 (en) | 2012-12-27 | 2014-12-16 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US9030585B2 (en) | 2012-12-27 | 2015-05-12 | Panasonic Intellectual Property Corporation Of America | Information communication method for obtaining information by demodulating bright line pattern included in image |
| US9768869B2 (en) | 2012-12-27 | 2017-09-19 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US9794489B2 (en) | 2012-12-27 | 2017-10-17 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US9859980B2 (en) | 2012-12-27 | 2018-01-02 | Panasonic Intellectual Property Corporation Of America | Information processing program, reception program, and information processing apparatus |
| US9918016B2 (en) | 2012-12-27 | 2018-03-13 | Panasonic Intellectual Property Corporation Of America | Information communication apparatus, method, and recording medium using switchable normal mode and visible light communication mode |
| US9998220B2 (en) | 2012-12-27 | 2018-06-12 | Panasonic Intellectual Property Corporation Of America | Transmitting method, transmitting apparatus, and program |
| US10051194B2 (en) | 2012-12-27 | 2018-08-14 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US10148354B2 (en) | 2012-12-27 | 2018-12-04 | Panasonic Intellectual Property Corporation Of America | Luminance change information communication method |
| US10165192B2 (en) | 2012-12-27 | 2018-12-25 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US10205887B2 (en) | 2012-12-27 | 2019-02-12 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US8908074B2 (en) | 2012-12-27 | 2014-12-09 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US10225014B2 (en) | 2012-12-27 | 2019-03-05 | Panasonic Intellectual Property Corporation Of America | Information communication method for obtaining information using ID list and bright line image |
| US10303945B2 (en) | 2012-12-27 | 2019-05-28 | Panasonic Intellectual Property Corporation Of America | Display method and display apparatus |
| US10334177B2 (en) | 2012-12-27 | 2019-06-25 | Panasonic Intellectual Property Corporation Of America | Information communication apparatus, method, and recording medium using switchable normal mode and visible light communication mode |
| US10354599B2 (en) | 2012-12-27 | 2019-07-16 | Panasonic Intellectual Property Corporation Of America | Display method |
| US10361780B2 (en) | 2012-12-27 | 2019-07-23 | Panasonic Intellectual Property Corporation Of America | Information processing program, reception program, and information processing apparatus |
| US10368006B2 (en) | 2012-12-27 | 2019-07-30 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US10368005B2 (en) | 2012-12-27 | 2019-07-30 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US10447390B2 (en) | 2012-12-27 | 2019-10-15 | Panasonic Intellectual Property Corporation Of America | Luminance change information communication method |
| US10455161B2 (en) | 2012-12-27 | 2019-10-22 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US10516832B2 (en) | 2012-12-27 | 2019-12-24 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US10521668B2 (en) | 2012-12-27 | 2019-12-31 | Panasonic Intellectual Property Corporation Of America | Display method and display apparatus |
| US10523876B2 (en) | 2012-12-27 | 2019-12-31 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US10531010B2 (en) | 2012-12-27 | 2020-01-07 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US10530486B2 (en) | 2012-12-27 | 2020-01-07 | Panasonic Intellectual Property Corporation Of America | Transmitting method, transmitting apparatus, and program |
| US10531009B2 (en) | 2012-12-27 | 2020-01-07 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US11659284B2 (en) | 2012-12-27 | 2023-05-23 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US10616496B2 (en) | 2012-12-27 | 2020-04-07 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US10638051B2 (en) | 2012-12-27 | 2020-04-28 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US10666871B2 (en) | 2012-12-27 | 2020-05-26 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US10742891B2 (en) | 2012-12-27 | 2020-08-11 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US10887528B2 (en) | 2012-12-27 | 2021-01-05 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US10951310B2 (en) | 2012-12-27 | 2021-03-16 | Panasonic Intellectual Property Corporation Of America | Communication method, communication device, and transmitter |
| US11490025B2 (en) | 2012-12-27 | 2022-11-01 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| US11165967B2 (en) | 2012-12-27 | 2021-11-02 | Panasonic Intellectual Property Corporation Of America | Information communication method |
| CN110708479B (en) * | 2018-07-10 | 2021-10-08 | 广州印芯半导体技术有限公司 | Image sensor with visible light communication function and image sensing system |
| TWI735904B (en) * | 2018-07-10 | 2021-08-11 | 大陸商廣州印芯半導體技術有限公司 | Image sensor and image sensing system with visible light communication function |
| CN110708479A (en) * | 2018-07-10 | 2020-01-17 | 广州印芯半导体技术有限公司 | Image sensor with visible light communication function and image sensing system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP2010268264A (en) | Imaging element and imaging apparatus | |
| US8284290B2 (en) | Synthetic image formation signal processing hardware for vignetted optoelectronic arrays, lensless cameras, and integrated camera-displays | |
| JP6183802B2 (en) | Visible light receiving method and apparatus thereof | |
| JP7331201B2 (en) | Imaging device, imaging system, vehicle driving control system, and image processing device | |
| US10666881B2 (en) | Solid-state image sensor and electronic device | |
| WO2008057278A3 (en) | An integrated display having multiple capture devices | |
| CN106358026A (en) | Image sensor including auto-focusing pixel and image processing system including the same | |
| US20140057676A1 (en) | Shared secret arrangements and optical data transfer | |
| CN103813156A (en) | Motion sensor array device and depth sensing system and methods of using the same | |
| WO2018201693A1 (en) | Array substrate, image collecting method and display apparatus | |
| MY180913A (en) | Imaging method, imaging device, and electronic device | |
| US20210067705A1 (en) | Phase detection autofocus (pdaf) sensor | |
| US10516859B2 (en) | Solid-state image sensor and electronic device | |
| TW200720643A (en) | Scintillation measuring method of display device and scintillation measuring device | |
| JP5482259B2 (en) | Optical communication device | |
| JP6480419B2 (en) | Visible light receiving method | |
| US10863165B2 (en) | Image processing apparatus and method | |
| WO2017104410A1 (en) | Image capturing device and method | |
| JP2011009805A (en) | Optical wireless communication terminal unit, optical wireless communication system, optical wireless communication method, and program | |
| CN110574368B (en) | Solid-state imaging device, imaging system, and object recognition system | |
| TW200607364A (en) | Image processing device and image processing method | |
| JP5414379B2 (en) | Optical wireless communication apparatus, optical wireless communication method, and program | |
| US20120170947A1 (en) | Apparatus and method for receiving light using multiple light receiving sensors | |
| US8681263B2 (en) | Imager capturing an image with a rolling shutter using flicker detection | |
| JP2010109863A (en) | Imaging apparatus and portable device |