JP5515472B2 - Imaging apparatus, imaging method, and program - Google Patents

Description

  The present invention relates to an imaging device, an imaging method, and a program using visible light communication technology.

  Arbitrary information is transmitted by using a light source such as an LED and flashing visible light at a high frequency to emit light, which is received by a light receiving element such as a photodiode or a solid-state image sensor, and superimposed on the light emission height. Various technologies related to visible light communication for demodulating information have been considered for practical use.

  The camera functions installed in digital cameras or mobile phone terminals that have been widely used in recent years use solid-state image sensors such as CCDs and CMOSs. If a solid-state image sensor achieves a visible light communication reception function, Applications of digital cameras or mobile phone terminals can be further expanded.

  By the way, in the above visible light communication, the luminance changes on the order of several thousand [Hz] which cannot be visually recognized by the human naked eye, and the solid-state image sensor also has a frame rate at least twice corresponding to the order. Scan driving is performed.

  In such a case, when scanning and driving at a frame rate sufficient to capture the luminance change on the light source side, the entire image is underexposed except for the position where the luminance is changed by visible light communication in the captured image. Cannot be displayed on the monitor screen.

  On the other hand, when shooting at a video frame rate intended to be displayed on the monitor screen, for example, 30 [frames / second], it is of course very difficult to perform a receiving operation using visible light communication. .

  In order to solve the above-mentioned problems, the inventor of the present application has two imaging units for visible light communication and image photographing, and controls the respective photographing operations in parallel, thereby allowing visible light communication and image photographing. We are making proposals that allow both. (For example, Patent Document 1)

JP 2006-020294 A

  In the technique described in the above-mentioned patent document, the resolution required for the solid-state imaging device is greatly different for visible light communication and for image capturing. Therefore, the light source in the image obtained by the imaging unit for visible light communication is different. Since the coordinate system differs between the position and the position of the light source in the image obtained by the image capturing unit for image capturing, a problem remains in that the positions of both light sources are matched.

  The present invention has been made in view of the above circumstances, and the object of the present invention is to accurately detect even if the imaging conditions of the two imaging units for visible light communication and for imaging are different. The information obtained by the imaging unit is accurately reflected in the other image.

According to the first aspect of the present invention, a location where a temporal luminance change is generated is specified from the images obtained by the first imaging unit and the first imaging unit, and information is demodulated from the luminance change at the location. Visible light communication receiving means, a second imaging unit arranged in close proximity with an imaging optical axis parallel to the first imaging unit, and the first and second imaging units according to the first and second imaging units . In the imaging field angle of the second imaging unit , correction of the position is omitted for a portion where a temporal luminance change occurs outside the imaging field angle of the second imaging unit , and within the imaging field angle of the second imaging unit . In the position where the luminance change occurs in time, the position correction means for correcting the position and the information demodulated by the visible light communication receiving means according to the ratio of the resolutions of the first and second imaging units. The image obtained by the second photographing unit according to the position corrected by the position correcting means. The image composition means for compositing above and the shooting angle of view of the second photographing unit as a display range, the image synthesized by the image composition means is displayed in this display range, and at a position outside this display range The location where the temporal luminance change occurs is provided with a display means for omitting the processing related to the display.

  According to a second aspect of the present invention, in the first aspect of the invention, the second photographing unit has a zoom function for changing a photographing field angle, and is set by a zoom function of the second photographing unit. An angle-of-view acquisition means for acquiring a current angle of view, wherein the position correction means is identified by the visible light communication receiving means using the angle of view of the second imaging unit obtained by the angle-of-view acquisition means. It is characterized in that the position of the portion where the temporal luminance change is corrected is corrected.

  According to a third aspect of the present invention, in the first aspect of the present invention, the position correcting unit refers to a temporal luminance change specified by the visible light communication receiving unit with reference to a lookup table stored in advance. It is characterized in that the position of the occurring portion is corrected.

According to a fourth aspect of the present invention, there is provided an imaging method in an imaging apparatus including a first imaging unit and a second imaging unit that is disposed in close proximity with an imaging optical axis parallel to the first imaging unit. A visible light communication receiving step of identifying a portion where a temporal luminance change is generated from the image obtained by the first photographing unit, and demodulating information from the luminance change at the portion; and the first and second steps The correction of the position is omitted for a portion where a temporal luminance change occurs outside the imaging field angle of the second imaging unit in the imaging field angle of the first imaging unit due to each imaging field angle of the imaging unit. , by the ratio of the resolutions of the first and second imaging section for the portion occurring temporal luminance change within the imaging field angle of the second imaging unit, and a position correcting step of correcting the position The information demodulated in the visible light communication reception step is corrected in the position correction step. An image composition step for composing on the image obtained by the second photographing unit according to the position, and a photographing field angle of the second photographing unit as a display range, and an image synthesized in the display composition step by the image composition step And a display step of displaying the portion where the temporal luminance change occurs at a position outside the display range by omitting the processing related to the display.

The invention according to claim 5 is executed by a computer built in an imaging apparatus including a first imaging unit and a second imaging unit that is arranged in close proximity with an imaging optical axis parallel to the first imaging unit. a program, the computer, the first specifies the sections from an image in which obtained by imaging unit are generated temporal luminance change, visible light communication receiving means for demodulating the information from the luminance change in the position The location where the temporal luminance change occurs outside the imaging field angle of the second imaging unit in the imaging field angle of the first imaging unit due to the imaging field angles of the first and second imaging units. It is omitted to correct the position, by the ratio of the resolutions of the first and second imaging section for the portion occurring temporal luminance change within the imaging field angle of the second imaging unit, its position Position correcting means for correcting the visible light communication receiver And the image synthesizing means for synthesizing the information demodulated in step (2) on the image obtained by the second photographing section in accordance with the position corrected by the position correcting means, and the photographing field angle of the second photographing section. In this display range, the image synthesized by the image synthesizing means is displayed, and the processing for the display is omitted for the portion where the temporal luminance change occurs at a position outside the display range. It is made to function as a display means to perform.

  According to the present invention, even when the imaging conditions of the two imaging units for visible light communication and imaging are different, the information obtained by one imaging unit is accurately reflected in the other image. Is possible.

The block diagram which shows the circuit structure of the mobile telephone terminal provided with the camera function which concerns on one Embodiment of this invention. The flowchart which shows the processing content at the time of visible light communication imaging which concerns on the embodiment. The figure which illustrates the relationship between each light source position coordinate of the picked-up image and communication image which concern on the embodiment. The figure which illustrates the relationship between each light source position coordinate of the picked-up image and communication image which concern on the embodiment. The figure which illustrates the relationship between each light source position coordinate of the picked-up image and communication image which concern on the embodiment. The figure which illustrates the relationship between each light source position coordinate of the picked-up image and communication image which concern on the embodiment. The figure which illustrates the synthesized display image which concerns on the same embodiment. The figure which illustrates the relationship of each light source position coordinate of the picked-up image at the time of zoom imaging | photography and communication image which concern on the same embodiment. The figure which illustrates the relationship of each light source position coordinate of the picked-up image at the time of zoom imaging | photography and communication image which concern on the same embodiment.

  Hereinafter, an embodiment in which the present invention is applied to a mobile phone terminal having a camera function will be described in detail with reference to the drawings.

FIG. 1 shows a functional circuit configuration of a mobile phone terminal 10 according to the present embodiment. The cellular phone terminal 10 includes two systems of imaging units IS1 and IS2 for visible light communication and image capturing.
In the imaging unit IS1 for visible light communication, an optical image of the subject is formed on the image sensor 12 by the optical lens unit 11. The image sensor 12 is configured by a CMOS image sensor having a shooting resolution of, for example, QVGA (1/4 VGA = vertical 240 pixels × horizontal 320 pixels) size.

  The image signal acquired by the image sensor 12 is amplified and digitalized via an amplifier and an A / D converter (Amp., A / D) 13 that operate in synchronization with a timing pulse from a timing generator (TG) 14. Is input to the matched filter 15.

  The matched filter 15 is called an autocorrelation peak at a pixel position where a luminance change of “1” and “0” occurs temporally by executing correlation processing on sequentially input image signals. Alternatively, a strong negative peak signal is output, and the output result is sent to the filter buffer 16. The autocorrelation peak corresponds to “1” “0” of luminance change.

  The filter buffer 16 sequentially holds autocorrelation peaks output from the matched filter 15 in association with position information in the image.

  In the other imaging unit IS2 for taking an image, the optical lens unit 17 forms an optical image of the subject on the image sensor 18. The image sensor 18 is constituted by a CMOS image sensor having a photographing resolution of, for example, a VGA size (480 vertical pixels × horizontal 640 pixels).

  The image signal acquired by the image sensor 18 is amplified and digitized through an amplifier and an A / D converter (not shown) and then held in the image buffer 19. The image signal held in the image buffer 19 is held in the display buffer 20 after being subjected to an image synthesis process described later if necessary. Based on the contents held in the display buffer 20, a monitor image based on the image captured by the image sensor 18 is displayed on the display unit 21.

  When a shutter key, which will be described later, is operated, an image of the subject is captured again by the image sensor 18, and after the image data is read from the image buffer 19, a data file process including data compression is appropriately performed. Records in the recording unit 22. The recording unit 22 includes a flash memory built in the mobile phone terminal 10 or a memory card using a flash memory that is detachably attached to the mobile phone terminal 10.

  The control unit 23 controls each circuit described above. The control unit 23 controls the overall operation of the mobile phone terminal 10 and includes a CPU, a main memory that functions as a work memory, and a program memory that stores an operation program of the CPU and various fixed data.

  In addition to the filter buffer 16, image buffer 19, display buffer 20, display unit 21, and recording unit 22 being connected to the control unit 23, the image sensor 12, the image sensor 18, the operation unit 24, and the data communication unit. 25, a communication data storage unit 26, a communication data analysis unit 27, a coordinate conversion processing unit 28, an audio processing unit 29, a display data processing unit 30, an image processing unit 31, and a stepping motor (M) 32 are also connected.

  The image sensor 12 constituting a part of the imaging unit IS1 for visible light communication reads and outputs an image signal at a sampling period of, for example, 60 [kHz] according to the instruction timing of the control unit 23 when receiving a signal of visible light communication. To do.

  The image sensor 18 constituting a part of the image capturing unit IS2 for image capturing reads and outputs an image signal at a sampling period of, for example, 30 [Hz] according to the instruction timing of the control unit 23 at the time of image capturing.

  The data communication unit 25 transmits / receives data to / from a nearby base station (not shown) via the antenna 33 in accordance with, for example, a CDMA (Code Division Multiple Access) system, so that voice communication and various digital signals can be made by the mobile phone terminal 10 Send and receive data.

  The communication data storage unit 26 stores the contents held in the filter buffer 16, while storing the received data of visible light communication demodulated by data analysis from the stored contents.

  The communication data analyzing unit 27 employs a predetermined modulation / demodulation method for contents stored in the communication data storage unit 26, for example, a 4-value PPM (Pulse-) using a subcarrier of 28.8 [kHz]. The communication data superimposed by performing demodulation processing according to position modulation) is analyzed, and the received data as the analysis result is stored in the communication data storage unit 26.

  The coordinate conversion processing unit 28 stores conversion formula data, which will be described later, in advance, and performs a coordinate conversion process based on an operation using the conversion formula data, thereby synthesizing the demodulated received data of visible light communication. Calculate the correct coordinate position.

  The voice processing unit 29 digitizes the voice signal input from the microphone 34 as a transmitter during voice call and sends it to the data communication unit 25, while receiving and decoding it via the data communication unit 25. The voice data is converted into an analog signal and a loud sound is emitted from the speaker 35 which is a receiver.

  The display data processing unit 30 converts the received data of visible light communication stored in the communication data storage unit 26 into display font data.

  The image processing unit 31 synthesizes the font data from the display data processing unit 30 on the coordinate position designated by the control unit 23 with respect to the image data obtained by the imaging unit IS1 for visible light communication, and the synthesis result The image data output from the display data processing unit 30 is displayed on the display unit 21.

  Under the control of the control unit 23, the stepping motor 32 changes the position of the zoom lens that can change the zoom angle (shooting angle of view) and the focus position among the plurality of optical lenses that constitute the optical lens unit 17. The position of the focusing lens to be moved is individually moved along the photographing optical axis.

  The drive positions of the zoom lens and focusing lens by the stepping motor 30 are fed back to the control unit 23. The control unit 23 can easily acquire the photographing field angle from the driving position of the zoom lens and the focusing distance from the driving position of the focusing lens.

Next, the operation of the above embodiment will be described.
In order to simplify the description in the present embodiment, the imaging angle of view by the optical lens unit 11 and the image sensor 12 constituting the imaging unit IS1 for visible light communication and the imaging unit IS2 for imaging are described. It is assumed that the photographing field angles by the optical lens unit 17 and the image sensor 18 are equal, and the photographing optical axes of the two imaging units IS1 and IS2 are parallel.

  Therefore, the images obtained by these two image pickup units IS1 and IS2 are affected by the difference in resolution between the image sensors 12 and 18 and parallax (parallax) when shooting a subject at a particularly close position. Except for, basically, the same subject range is photographed.

  FIG. 2 shows the processing contents at the time of image capturing involving visible light communication, and the control of the control is performed by the control unit 23.

At the beginning of the operation, the imaging operation at the imaging unit IS1 is executed, the position of the light source by visible light communication is extracted from the captured image, and the information is demodulated from the luminance change at the position (step S).
101).

  Note that details of the technology relating to luminance modulation and demodulation in the visible light communication are known in Japanese Patent Application Laid-Open No. 2003-179556, and detailed description thereof is omitted. For example, visible light communication in the image range of the subject is performed. Suppose that the light source is a four-value PPM employing a subcarrier of 28.8 [kHz], and that the cellular phone terminal 10 performs reception for visible light communication of that frequency.

  In this case, the image sensor 12 is driven at a frequency more than twice the carrier wave, for example, 60 [kHz] according to the sampling theorem, so that it is possible to demodulate temporal luminance change due to visible light communication from the image output. Become.

  The output of the matched filter 15 is held in the communication data storage unit 26 via the filter buffer 16. When a position causing a temporal luminance change is detected from a captured image for visible light communication, the communication data storage unit 26 sets the luminance change to “1” in association with the position coordinate in the image from the detection result. It is stored as an enumeration of “0” data.

  The control unit 23 causes the communication data analysis unit 27 to demodulate the original information by visible light communication based on the stored contents of the communication data storage unit 26, and stores the demodulation result in the communication data storage unit 26.

  In parallel with the imaging and demodulation operations on the imaging unit IS1 side, the imaging unit IS2 for imaging images captures an image at a predetermined frame rate, for example, 30 [frames / second], and the captured result is held in the image buffer 19. (Step S102).

  Next, it is determined whether or not the data by the visible light communication can be demodulated from the photographed image depending on whether or not the data is stored in the communication data storage unit 26 (step S103).

  Here, when it is determined that no data is stored in the communication data storage unit 26 and data demodulation by visible light communication is not performed, only the image data held in the image buffer 19 is displayed as it is. , The monitor display on the display unit 21 is executed (step S104), and the process returns to step S101 to continue photographing.

  If it is determined in step S103 that data is stored in the communication data storage unit 26 and data demodulation by visible light communication is being performed, first, image analysis is performed to communicate with a captured image using a signal light source as a base point. The coordinate system of the image is matched (step S105).

  FIG. 3A illustrates the image A acquired by the imaging unit IS2 for image capturing. As described above, the VGA size, that is, the size of the image data is horizontal (a) 640 dots × vertical (b). It is 480 dots. FIG. 2A shows an image A of only a visible light communication light source that is reflected in a photographed image for easy explanation. The coordinate positions of the two light sources are represented by (X1 ″, Y1 ″). (X2 ", Y2").

  FIG. 3B shows the image B acquired by the imaging unit IS1 for visible light communication. As described above, the QVGA (1/4 VGA) size, that is, the size of the image data is horizontal (a ′) 320. Dot × vertical (b ′) 240 dots. The coordinate positions of the two light sources of visible light communication reflected in the image B are (X1 ′, Y1 ′) and (X2 ′, Y2 ′).

As can be seen from FIG. 3A and FIG. 3B, the coordinate conversion for converting the arrangement in the image B for visible light communication into the arrangement of the image A for image capturing is an image in the X coordinate system. Using the correction coefficient a / a ′ and the image correction coefficient b / b ′ in the Y coordinate system
X ″ = X ′ * a / a ′,
Y ″ = Y ′ * b / b ′ (1)
It becomes. The two image correction coefficients are determined by the resolutions of the image sensor 12 and the image sensor 18 and are known values at the design stage of the mobile phone terminal 10, so that the conversion equation (1) is preliminarily converted into the coordinate conversion processing unit 28. It is possible to easily convert the position in the image by storing it in.

  Next, as shown in FIGS. 4A and 4B, the coordinate system of the captured image and the communication image is corrected using the position of the data light source as a base point. FIG. 4A shows the coordinates of the light source in the image A ′ acquired by the imaging unit IS2 for taking an image as (x1, y1), (x2, y2). This FIG. 4A side The position of the light source in the image B ′ acquired by the imaging unit IS1 for visible light communication shown in FIG. 4B is corrected using the position of the light source in the image A as a base point.

That is, using the image correction coefficient a / a ′ in the X coordinate system and the image correction coefficient b / b ′ in the Y coordinate system,
dx = | x * a / a′−p |,
dy = | y * b / b′−q | (2)
A conversion formula (2) is prepared in advance for performing coordinate correction of the coordinates (x1 ′, y1 ′) and (x2 ′, y2 ′) of the image A ′ with respect to the image B ′.

  Using the above conversion equation (2) with reference to the position coordinates of the light source in the image A ′ taken on the high-resolution imaging unit IS2 side, the image B ′ on the imaging unit IS1 side for low-viscosity visible light communication is used. The position coordinates of the light source are corrected (step S106).

  FIG. 5 shows two images A ″ and B ″ generated by correcting the coordinates. In the image A ″ shown in FIG. 5A, the position coordinates of the light source for visible light communication in the left chest portions of the two persons P1 and P2 are (x1, y1) and (x2, y2).

  In contrast, FIG. 5B shows an image B ″ on the imaging unit IS1 side for visible light communication. The position coordinates of the light source in the image B ″ are (x1 ′, y1 ′), (x2 ′, y2). ′), And the communication data obtained at the light source position is converted into an image and displayed on the image A ″.

  By associating the position coordinate of the light source in the image B ″ corresponding to the position coordinate in the image A ″ with the conversion formula (1), the combined display of the image can be realized.

  FIG. 6A shows an image A ° obtained by dividing the image A ″ into regions along the coordinate axes so as to match the image B ″ shown in FIG. Indicates.

  By performing the conversion formula (1) for the coordinates of the image B ″ and adapting it to the coordinate values of the image A °, the correct position coordinates in the image A ° of the light source for visible light communication can be obtained (step S108). ).

  Next, using the demodulated communication data stored in the communication data storage unit 26, the display data processing unit 30 converts it into a character font data string for image composition and outputs it to the image processing unit 31 (step S109).

  The image processing unit 31 uses this character font data string to generate a “speech balloon” image that surrounds the character font data sequence and synthesizes it on the image A ° to generate a composite image as shown in FIG. Is stored in the display buffer 20 as display data to be displayed on the display unit 21 (step S110).

  In FIG. 7, the character data “ABCD Employee No. 12345” by visible light communication is emitted with the first balloon against the light source at the position coordinate (x1 ″, y1 ″) of the left chest of the person P1 in the image. It is displayed.

  At the same time, the text data “ABCD Employee No. 23456” by visible light communication is displayed with a second balloon against the light source at the position coordinates (x2 ″, y2 ″) of the left chest of the person P2 in the image. ing.

  After displaying the synthesized pixels in this way, the process returns to the above-described step S101 to continue photographing.

  As described above, in the present embodiment, even if the resolutions of the two imaging units IS1 for visible light communication and the imaging unit IS2 for image capturing are different, one image is accurately captured by performing coordinate conversion. It is possible to accurately reflect the information obtained in the part on the other image.

  In the above embodiment, for ease of explanation, the imaging unit IS1 for visible light communication and the imaging unit IS2 for image shooting have the same shooting angle of view, and the subject range shot by both shooting units. However, the image pickup unit IS2 for image shooting has a zoom function, and the shooting angle of view can be arbitrarily varied within a predetermined range by operating the zoom key of the operation unit 24. .

  FIG. 8A shows an image D ′ obtained when the zoom magnification in the imaging unit IS2 for image capturing is “α” with the widest angle side as a reference. On the other hand, FIG. 6B shows an image B ″ obtained by the visible light communication imaging unit IS1 having the same imaging field angle as the widest angle side of the imaging unit IS2 for imaging.

  In this case, an image A ° as shown in FIG. 9A can be obtained by using the conversion equation (1) ′ in consideration of the zoom magnification α in addition to the conversion equation (1). Here, the zoom magnification α used in the conversion equation (1) ′ is acquired by the control unit 23 from the control content of the stepping motor 32 based on the position driving of the zoom lens in the optical lens unit 17 by the stepping motor 32, and coordinate conversion processing is performed. Given to part 28.

  In the conversion equation (1) ′, the image obtained by the imaging unit IS1 for visible light communication is subjected to a cutting process using only the 1 / α range as an effective area with reference to the center position coordinates of the image. A new coordinate system of the image for visible light communication is obtained by multiplying the cutting result by α.

  When the light source position in the initial visible light communication image is out of the cutout range, the position of the corresponding light source is out of the shooting range in the image acquired by the image pickup unit IS2. (It is not shown), so the conversion process will be omitted.

  In addition, the zoom function described above is based on the so-called “optical zoom” function, but the range of the captured image is limited, the limited range is expanded by image processing, and the image after expansion is displayed. In the case of performing the so-called “digital zoom” function, when the range of the photographed image is limited after performing the coordinate conversion by the conversion formula (1), the visible light depends on whether or not the light source is located within the limited range. It may be determined whether or not to display communication data by communication.

  As described above, when the imaging unit IS2 for image capturing has a zoom function, coordinate conversion of the light source position corresponding to the function is performed, so that the light source position can be accurately adjusted even if the shooting angle of view changes. The communication data corresponding to the above can be displayed, and the processing related to the display of the communication data can be made efficient with respect to the light source that is out of the display range by the zoom operation.

  Moreover, although the case where the coordinate conversion of the light source position is performed using the conversion formula in the above embodiment has been described, the present invention is not limited to this, and each of the imaging unit for visible light communication and the imaging unit IS2 for image capturing is previously provided. A lookup table created in consideration of the difference in imaging conditions is stored in the coordinate conversion processing unit 28 in advance, or a new lookup table is created each time the imaging conditions are changed, and the coordinate conversion processing unit 28 is created. It is also conceivable that the position coordinates after conversion are read out by using the lookup table by updating the setting.

  With such a configuration, since it is not necessary to perform an operation, it is possible to shorten the time from when the data for visible light communication is received until the received data is combined and displayed on the captured image.

  Further, in the above-described embodiment, the method of the imaging unit IS2 for image capturing has been described as having a higher resolution of the image to be acquired compared to the imaging unit IS1 for visible light communication. The imaging unit IS1 for visible light communication may have a higher resolution than the imaging unit IS2 for image capturing. In this case, the coordinate conversion formula or lookup table is based on the image with the higher resolution, and the position coordinates of the light source of the image with the lower resolution are converted to match the image with the higher resolution.

  In addition, although the said embodiment demonstrated the case where this invention was applied to the mobile telephone terminal provided with the camera function, this invention is not restricted to this, A digital (still) camera, a video movie camera, a surveillance camera The present invention can be applied to various imaging devices such as a telescope fixedly installed in a sightseeing spot or the like, or an image processing program executed by a computer mounted on the imaging device.

  In addition, the present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the invention in the implementation stage. Further, the functions executed in the above-described embodiments may be combined as appropriate as possible. The above-described embodiment includes various stages, and various inventions can be extracted by an appropriate combination of a plurality of disclosed constituent elements. For example, even if some constituent requirements are deleted from all the constituent requirements shown in the embodiment, if the effect is obtained, a configuration from which the constituent requirements are deleted can be extracted as an invention.

  DESCRIPTION OF SYMBOLS 10 ... Mobile phone terminal, 11 ... Optical lens part, 12 ... Image sensor, 13 ... Amplifier and A / D converter (Amp., A / D), 14 ... Timing generator (TG), 15 ... Matched filter, 16 ... Filter buffer, 17 ... Optical lens unit, 18 ... Image sensor, 19 ... Image buffer, 20 ... Display buffer, 21 ... Display unit, 22 ... Recording unit, 23 ... Control unit, 24 ... Operation unit, 25 ... Data communication unit, 26 ... Communication data storage unit, 27 ... Communication data analysis unit, 28 ... Coordinate conversion processing unit, 29 ... Audio processing unit, 30 ... Display data processing unit, 31 ... Image processing unit, 32 ... Stepping motor (M), 33 ... Antenna, 34... Microphone, 35. Speaker, IS1... (For visible light communication) imaging unit, IS2.

Claims (5)

A first imaging unit;
A visible light communication receiving means for identifying a location where a temporal luminance change has occurred in the image obtained by the first imaging unit, and demodulating information from the luminance change at the location;
A second imaging unit disposed close to the first imaging unit in parallel with the imaging optical axis;
With respect to the location where a temporal luminance change occurs outside the imaging field angle of the second imaging unit in the imaging field angle of the first imaging unit due to each imaging field angle of the first and second imaging units. omitting the correction of the position, by the ratio of the resolutions of the first and second imaging section for the portion occurring temporal luminance change within the imaging field angle of the second imaging unit, the position Position correcting means for correcting;
Image synthesizing means for synthesizing the information demodulated by the visible light communication receiving means on the image obtained by the second photographing unit according to the position corrected by the position correcting means;
The shooting angle of view of the second imaging unit is set as a display range, an image synthesized by the image synthesizing means is displayed in the display range, and the temporal luminance change occurs at a position outside the display range. An image pickup apparatus, comprising: a display unit configured to display a portion where the display is omitted while omitting processing related to the display. The second photographing unit has a zoom function for changing the photographing angle of view,
An angle of view acquiring means for acquiring an angle of view set by the zoom function of the second imaging unit;
The position correction unit corrects the position of the portion where the temporal luminance change specified by the visible light communication reception unit is generated, using the shooting field angle of the second imaging unit obtained by the field angle acquisition unit. The imaging apparatus according to claim 1. 2. The position correcting means corrects the position of a portion where a temporal luminance change is specified by the visible light communication receiving means with reference to a lookup table stored in advance. The imaging device described. An imaging method in an imaging apparatus including a first imaging unit and a second imaging unit that is disposed in close proximity with an imaging optical axis parallel to the first imaging unit,
A visible light communication receiving step of identifying a location where a temporal luminance change has occurred in the image obtained by the first imaging unit, and demodulating information from the luminance change at the location;
With respect to the location where a temporal luminance change occurs outside the imaging field angle of the second imaging unit in the imaging field angle of the first imaging unit due to each imaging field angle of the first and second imaging units. omitting the correction of the position, by the ratio of the resolutions of the first and second imaging section for the portion occurring temporal luminance change within the imaging field angle of the second imaging unit, the position A position correction process to be corrected;
An image synthesizing step for synthesizing the information demodulated in the visible light communication receiving step on the image obtained by the second imaging unit according to the position corrected in the position correcting step;
The image angle of view of the second imaging unit is set as a display range, the image synthesized in the image synthesis step is displayed in the display range, and the temporal luminance change occurs at a position outside the display range. And a display step of displaying the display portion by omitting processing related to the display. A program executed by a computer built in an imaging apparatus that includes a first imaging unit and a second imaging unit that is disposed in close proximity with an imaging optical axis parallel to the first imaging unit, the computer being ,
Visible light communication receiving means for identifying a location where a temporal luminance change occurs in the image obtained by the first imaging unit, and demodulating information from the luminance change at the location;
With respect to the location where a temporal luminance change occurs outside the imaging field angle of the second imaging unit in the imaging field angle of the first imaging unit due to each imaging field angle of the first and second imaging units. omitting the correction of the position, by the ratio of the resolutions of the first and second imaging section for the portion occurring temporal luminance change within the imaging field angle of the second imaging unit, the position Position correcting means for correcting,
Image synthesizing means for synthesizing the information demodulated by the visible light communication receiving means on the image obtained by the second photographing unit according to the position corrected by the position correcting means; and
The shooting angle of view of the second imaging unit is set as a display range, an image synthesized by the image synthesizing means is displayed in the display range, and the temporal luminance change occurs at a position outside the display range. A computer-readable program that functions as a display means for displaying a location where a process related to the display is omitted.

Images