JP2021026095A - Control method of display device, display device, and display system - Google Patents

Abstract

To display a high-quality image even when an image with improper color is input from an imaging apparatus.SOLUTION: A projector 200 acquires a first corrected image 271 obtained by applying first correction to a captured image during or after capturing the image, from a document camera 100, acquires a detection result D2 from an ambient light detection apparatus 400 for detecting ambient light in an imaging environment of the document camera 100, determines whether the first correction is proper or not, displays the first corrected image 271 from a projection unit 210 when it is determined that the first correction is proper, or applies second correction based on the detection result D2 to the first corrected image 271 or an image corresponding to the first corrected image 271 when it is determined that the first correction is improper, and displays a second corrected image 277 subjected to the second correction from the projection unit 210.SELECTED DRAWING: Figure 3

Description

The present invention relates to a display device control method, a display device, and a display system.

Conventionally, in an imaging device that captures an image, one that corrects the image according to the illumination light at the time of imaging is known (see, for example, Patent Document 1). Patent Document 1 describes an electronic still camera provided with a color temperature detection sensor and performing white balance correction in response to the color temperature of illumination light. It is also known that an imaging device not equipped with a color temperature detection sensor estimates the type of illumination light based on the hue of the captured image and adjusts the white balance.

Japanese Unexamined Patent Publication No. 2001-333432

When the conventional image pickup apparatus corrects an image corresponding to the color and type of illumination light, if there is an error in the determination or estimation of the illumination light, the corrected image will not be an image having an appropriate hue. For this reason, in a system that displays a captured image by a display device, an image having an inappropriate hue is displayed.

One aspect of solving the above-mentioned problems is to acquire a first corrected image in which the captured image is first corrected at the time of shooting or after shooting the captured image from the image pickup device, and in the imaging environment of the image pickup device. When the detection result is acquired from the detection device that detects the ambient light, it is determined whether or not the first correction is an appropriate correction, and when it is determined that the first correction is an appropriate correction, the first correction is performed. When the corrected image is displayed on the display unit and it is determined that the first correction is not an appropriate correction, the detection device for the first corrected image or the image corresponding to the first corrected image. This is a control method for a display device, in which a second correction is performed based on the detection result of the above, and the second corrected image to which the second correction is applied is displayed by the display unit.

In the control method of the display device, when it is determined that the first correction is not an appropriate correction, the type of the ambient light is determined based on the detection result of the detection device, and the type of the ambient light corresponds to the type of the ambient light. The second correction may be performed.

In the control method of the display device, when it is determined that the first correction is not an appropriate correction, a pre-correction image is generated based on the first corrected image acquired from the imaging device, and the generated image is generated. The method of applying the second correction to the image before correction may be used.

In the control method of the display device, a method may be used in which the condition of the first correction is estimated based on the image after the first correction and the image before the correction is generated based on the estimation result.

In the control method of the display device, the condition of the first correction is acquired from the image pickup device, and the image before the correction is generated from the image after the first correction by using the acquired condition of the first correction. It may be a method.

In the control method of the display device, when an image taken without the first correction is acquired from the image pickup device and it is determined that the first correction is not an appropriate correction, the acquired image is taken. The second correction may be applied to the above.

In the control method of the display device, the correction by the imaging device is performed by acquiring the condition of the first correction from the imaging device and comparing the condition of the first correction with the detection result of the detection device. It may be a method of determining whether or not the correction is appropriate.

One aspect of solving the above-mentioned problems is an image acquisition unit that acquires a first corrected image in which the captured image is first corrected during or after shooting the captured image from the display unit. A detection result acquisition unit that acquires a detection result from a detection device that detects ambient light in the imaging environment of the image pickup device, a determination unit that determines whether or not the first correction is an appropriate correction, and the first correction unit. When it is determined that the correction is an appropriate correction, an image based on the first corrected image is displayed by the display unit, and when it is determined that the first correction is not an appropriate correction, the first correction is performed. The corrected image or the image corresponding to the first corrected image is subjected to the second correction based on the detection result of the detection device, and the second corrected image to which the second correction is applied is displayed. It is a display device including a display processing unit for displaying by the unit.

The display device may be configured to include the detection device that detects ambient light in the imaging environment of the image pickup device.

One aspect of solving the above-mentioned problems is a display system including an image pickup device and a display device for displaying an image based on the captured image captured by the image pickup device by a display unit, wherein the image pickup device includes the image pickup. The imaging unit that captures the image and the ambient light in the imaging environment are estimated from the captured image during or after the imaging unit captures the captured image, and the first correction is made to the captured image based on the estimated ambient light. The display device includes an image acquisition unit that acquires the first corrected image from the image pickup device, and an image acquisition environment of the image pickup device, comprising a first correction unit that generates an image after the first correction. A detection device that detects ambient light, a detection result acquisition unit that acquires the detection result of the detection device, a determination unit that determines whether or not the first correction is an appropriate correction, and the first correction are appropriate. When it is determined that the correction is correct, the image based on the first corrected image is displayed by the display unit, and when it is determined that the first correction is not an appropriate correction, the first corrected image is displayed. Alternatively, the image corresponding to the first corrected image is subjected to a second correction based on the detection result of the detection device, and the second corrected image to which the second correction is applied is displayed by the display unit. It is a display system including a display processing unit for displaying.

The figure which shows an example of the structure of a display system. The figure which shows an example of the structure of a document camera. The figure which shows an example of the structure of a projector. The flowchart which shows the 1st operation example of a projector. The flowchart which shows the 2nd operation example of a projector. The flowchart which shows the 3rd operation example of a projector.

Hereinafter, embodiments will be described with reference to the drawings.
[1. Display system configuration]
FIG. 1 is a diagram showing an example of the configuration of the display system 1.
The display system 1 includes a document camera 100 and a projector 200.
The document camera 100 is communicatively connected to the projector 200 and transmits image information to the projector 200.

In this embodiment, a configuration in which the document camera 100 and the projector 200 are connected by a USB cable 109 is illustrated. The connection mode between the document camera 100 and the projector 200 is not limited, and may be a wired connection or a wireless connection. The document camera 100 and the projector 200 may be connected by a communication network including other devices, or may be connected one-to-one.

The projector 200 receives image information from the document camera 100 and displays an image based on the received image information on the screen SC. The document camera 100 corresponds to an example of an imaging device.

Although FIG. 1 illustrates an example of floor-standing installation in which the projector 200 is placed on the floor in front of the screen SC, the projector 200 may be suspended from the ceiling and installed. In the present embodiment, the case where the projector 200 projects onto a flat screen SC is illustrated, but the projection target is not limited to the screen SC, and may be a flat surface such as a wall surface of a building, or a curved surface or an uneven surface. Good.

The document camera 100 includes a base 102, a mounting surface 104, an arm 106, a camera head 108, and an operation panel 110. The base 102 is a flat plate-shaped base that supports the camera head 108, and the upper surface of the base 102 is a mounting surface 104 on which the subject TG is placed.

The arm 106 is erected on the base 102, and the camera head 108 is fixed to the tip of the arm 106. The camera head 108 includes an imaging unit 190 composed of a digital camera, and the imaging unit 190 images an imaging range including the mounting surface 104. The arm 106 may be fixed to the base 102 or may be rotatably connected to the base 102. Further, the arm 106 may be foldable toward the base 102. The imaging unit 190 will be described later with reference to FIG. The subject TG is, for example, a sheet such as paper on which characters or pictures are drawn, a bound book, or the like, but the size or shape is not limited as long as it can be placed on the mounting surface 104.

The operation panel 110 is provided on, for example, the upper surface of the base 102. The operation panel 110 includes a plurality of button switches operated by the user, and inputs an operation command to the document camera 100 by the user.
The document camera 100 receives an operation of the user by the operation panel 110, images the subject TG by the image pickup unit 190 in response to this operation, and outputs image information based on the captured image to the projector 200.

[2. Document camera configuration]
FIG. 2 is a diagram showing an example of the configuration of the document camera 100.
The document camera 100 includes a base 102 shown in FIG. 1, a mounting surface 104, an arm 106, a camera head 108, an operation panel 110, and other parts shown in FIG. That is, it includes a first control unit 120, a first storage unit 130, a first operation unit 140, a USB interface unit 160, an image pickup image processing unit 170, a resolution conversion unit 180, and an image pickup unit 190. The bus 128 communicatively connects the first control unit 120 and each unit of the document camera 100. Each part of the document camera 100 includes a first storage unit 130, a first operation unit 140, a USB interface unit 160, an image pickup image processing unit 170, and a resolution conversion unit 180. In the figure, the interface is abbreviated as I / F.

The first control unit 120 includes, for example, a processor that executes a control program and a memory that temporarily stores the program and data, and controls each unit of the document camera 100 in cooperation with hardware and software. For example, the first control unit 120 controls the image pickup unit 190 to execute imaging, and transmits the transfer data D1 including the captured image to the projector 200 via the USB interface unit 160.

The first control unit 120 may include a magnetic storage device that non-volatilely stores programs and data, a semiconductor storage element such as a flash ROM, or other types of non-volatile storage devices.

The first storage unit 130 stores various programs executed by the first control unit 120 and data processed by the first control unit 120. For example, the first storage unit 130 stores a USB module, a USB class driver, a program for controlling the image pickup unit 190, and the like.

The USB interface unit 160 is a device for transmitting and receiving control data, image data, and the like to and from an external device in accordance with the USB standard, and includes an interface circuit for processing signals to be transmitted and received. A USB cable 109 is connected to the USB interface unit 160.

The image pickup unit 190 includes an image pickup lens 191 and an image pickup element 192 made of a CCD, CMOS, or the like. The image pickup lens 191 is composed of a lens or a lens group, and constitutes an optical system for photographing the subject TG. The image pickup lens 191 is housed in a tubular lens barrel 193 and can move along the optical axis AX. CCD is an abbreviation for Charge Coupled Device, and CMOS is an abbreviation for Complementary MOS.

The imaging unit 190 includes a lens operating unit 198 that moves the imaging lens 191 along the optical axis AX. The lens operating unit 198 moves each lens housed in the lens barrel 193 in the optical axis AX direction integrally with the lens barrel 193. The lens operating unit 198 of the present embodiment has a motor 194 and a gear 199 that transmits the rotational force of the motor 194 to the lens barrel 193. The lens barrel 193 has, for example, a cylindrical shape, and has a configuration in which the distance between the lens barrel 193 and the image sensor 192 changes by rotating the lens barrel 193 in the circumferential direction about the optical axis AX. When the motor 194 operates, the lens barrel 193 connected via the gear 199 rotates, and the distance between the image pickup lens 191 and the image pickup element 192 changes. The moving directions of the lens barrel 193 are opposite when the motor 194 is rotated in the forward direction and when the motor 194 is rotated in the opposite direction. With this configuration, the focus of the imaging unit 190 is adjusted.
The image pickup unit 190 includes an output circuit 195 that detects a signal from the image pickup device 192 and outputs a captured image.

The document camera 100 may include a light source that illuminates the mounting surface 104 in conjunction with the image pickup unit 190, but is not shown here.

The image pickup image processing unit 170 is connected to the image pickup unit 190 and operates the image pickup unit 190 according to the control data input from the first control unit 120. Specifically, the captured image processing unit 170 outputs a drive signal to the lens operating unit 198 to operate the motor 194, thereby moving the lens barrel 193. The captured image processing unit 170 executes image processing such as converting the captured image output by the output circuit 195 into data that can be processed by the first control unit 120, and outputs the processed captured image.

The resolution conversion unit 180 converts the resolution of the captured image output by the captured image processing unit 170 according to the control of the first control unit 120. The resolution conversion unit 180 performs a process of converting the resolution of the captured image to the resolution specified by the first control unit 120. For example, the first control unit 120 determines a resolution suitable for the projector 200 based on the control data input from the projector 200 to the USB interface unit 160. The first control unit 120 causes the resolution conversion unit 180 to execute a process of converting the resolution of the captured image into a resolution suitable for the projector 200. The first control unit 120 stores the captured image processed by the resolution conversion unit 180 in the first storage unit 130 as the captured image 131.

The first operation unit 140 detects an operation on the operation panel 110 shown in FIG. 1 and outputs data indicating the operation content to the first control unit 120.

The first control unit 120 constitutes the image pickup control unit 121 and the first correction unit 122 by executing the control program.
The image pickup control unit 121 controls the image pickup unit 190 to image the subject TG. The image pickup control unit 121 controls the image pickup image processing unit 170 and the resolution conversion unit 180 to process the image pickup image, and stores the processed image pickup image in the first storage unit 130 as the image pickup image 131.

The first correction unit 122 executes the first correction process for adjusting the color tone of the captured image. The target of the first correction executed by the first correction unit 122 may be any of the image output by the captured image processing unit 170, the image output by the output circuit 195, and the captured image 131.
That is, the resolution conversion unit 180 may execute the resolution conversion process after the first correction unit 122 applies the first correction to the captured image, or the resolution conversion unit 180 may perform the resolution conversion process on the captured image. , The first correction unit 122 may perform the first correction process.

The color tone of the captured image of the document camera 100 is affected by the ambient light emitted to the mounting surface 104. The ambient light is, for example, the lighting in the room where the document camera 100 is installed or the sunlight that enters the room where the document camera 100 is installed from the outside. Therefore, the hue of the image of the subject TG in the captured image is affected by the ambient light at the time of imaging by the document camera 100. The first correction unit 122 adjusts the color tone of the captured image in the first correction process in order to compensate for the influence of the ambient light on the captured image and realize accurate color expression in the captured image. For example, when the color temperature of the ambient light is low, the first correction unit 122 corrects the captured image so that the color temperature is generally high. The process by the first correction unit 122 is a process generally called white balance adjustment. The first correction unit 122 may adjust the captured image so as to cancel the tint of the ambient light when the ambient light of the document camera 100 at the time of imaging is light having a specific tint.

The first correction unit 122 determines the first correction condition so that the captured image 131 has a predetermined white balance. The first correction process is, for example, a process of changing the pixel values of the pixels constituting the captured image 131. In this case, the first correction condition is a value indicating the amount of change in the pixel value, and can be called an adjustment value.

The first correction unit 122 changes the pixel value of each pixel so that the pixel value of each pixel constituting the captured image 131, that is, the average value of the R value, the G value, and the B value becomes a predetermined value. Specifically, the first correction unit 122 detects the image of the subject TG from the captured image 131. The first correction unit 122 captures the captured image 131 so that the brightness of the image of the subject TG is a predetermined brightness and the average value of the pixel values of the pixels constituting the image of the subject TG is gray. The pixel value of each pixel constituting the above is adjusted. Here, the first correction unit 122 shifts at least one of the R value, the G value, and the B value of each pixel according to the first correction condition. This shift amount is the adjustment value. The first correction condition may include a plurality of adjustment values according to the position in the captured image 131.
In the first correction process, the first correction unit 122 may consider the pixel at the center of the imaging range of the imaging unit 190 or at a preset position as a pixel constituting the image of the subject TG.

The conditions determined by the first correction unit 122 in the first correction process are stored in the first storage unit 130 as the first correction condition 132. Further, the image subjected to the first correction process by the first correction unit 122 is stored in the first storage unit 130 as the first corrected image 133.

The first correction unit 122 outputs the transfer data D1 including the first corrected image 133 from the USB interface unit 160. The first correction unit 122 may include the first correction condition 132 or the captured image 131 in the transfer data D1. The information included in the transfer data D1 is set in advance for the first control unit 120 by the operation of the operation panel 110 or the control data input from the projector 200.

In this way, the document camera 100 captures the subject TG placed on the mounting surface 104, generates an captured image, performs the first correction process on the captured image, and transfers data including the first corrected image 133. Output D1 to the projector 200.

[3. Projector configuration]
FIG. 3 is a diagram showing an example of the configuration of the projector 200. The projector 200 corresponds to an example of a display device.
The projector 200 includes a projection unit 210 and a drive unit 220 that drives the projection unit 210. The projection unit 210 includes a light source unit 211, an optical modulation device 212, and a projection optical system 213. The drive unit 220 includes a light source drive unit 221 and an optical modulator drive unit 222. The projection unit 210 is driven by the drive unit 220 to form an optical image and project the image on the screen SC. The operation of the projector 200 forming an image on the screen SC by the projection unit 210 is an example of display by the display device, and the projection unit 210 corresponds to an example of the display unit.

The light source unit 211 includes a lamp such as a halogen lamp, a xenon lamp, or an ultra-high pressure mercury lamp, or a solid-state light source such as an LED or a laser light source. LED is an abbreviation for Light Emitting Diode.
The light source driving unit 221 is connected to the internal bus 207, and turns on and off the light source of the light source unit 211 according to the instruction of the second control unit 250 also connected to the internal bus 207.

The optical modulation device 212 includes, for example, three liquid crystal panels 215 corresponding to the three primary colors of R, G, and B. R indicates red, G indicates green, and B indicates blue. That is, the optical modulation device 212 includes a liquid crystal panel 215 corresponding to R color light, a liquid crystal panel 215 corresponding to G color light, and a liquid crystal panel 215 corresponding to B color light. The light emitted by the light source unit 211 is separated into three colored colors of RGB and incident on the corresponding liquid crystal panel 215. Each of the three liquid crystal panels 215 is a transmissive liquid crystal panel, and modulates the transmitted light to generate an image light PL. The image light PL modulated through each liquid crystal panel 215 is synthesized by a synthetic optical system such as a cross dichroic prism and emitted to the projection optical system 213.

In the present embodiment, the case where the light modulation device 212 includes the transmissive liquid crystal panel 215 as the light modulation element will be described, but the present embodiment is not limited to this. The light modulation element may be a reflective liquid crystal panel or a DMD. DMD is an abbreviation for Digital Micromirror Device.

The optical modulation device 212 is driven by the optical modulation device drive unit 222. The optical modulator drive unit 222 is connected to the image processing unit 245.
Image data corresponding to each of the primary colors R, G, and B is input from the image processing unit 245 to the optical modulator driving unit 222. The optical modulator driving unit 222 converts the input image data into a signal suitable for the operation of the liquid crystal panel 215. The optical modulator driving unit 222 applies a voltage to each pixel of each liquid crystal panel 215 based on the converted signal, and draws an image on each liquid crystal panel 215.

The projection optical system 213 includes a lens, a mirror, and the like for forming an image of the incident image light PL on the screen SC. The projection optical system 213 may include a zoom mechanism for enlarging or reducing the image projected on the screen SC, a focus adjustment mechanism for adjusting the focus, and the like.

The projector 200 further includes a second operation unit 231, a remote control light receiving unit 233, an input interface 235, an image interface 241, a frame memory 243, an image processing unit 245, a second control unit 250, and a second storage unit 270. The input interface 235, the second storage unit 270, the image interface 241 and the image processing unit 245 and the second control unit 250 are connected to each other so as to be communicable with each other via the internal bus 207.

The second operation unit 231 includes various buttons and switches provided on the surface of the housing of the projector 200, generates operation signals corresponding to the operations of these buttons and switches, and outputs the operation signals to the input interface 235. The input interface 235 outputs the operation signal input from the second operation unit 231 to the second control unit 250.

The remote control light receiving unit 233 receives an infrared signal transmitted from the remote control 5, decodes the received infrared signal, and generates an operation signal. The remote control light receiving unit 233 outputs the generated operation signal to the input interface 235. The input interface 235 outputs the operation signal input from the remote control light receiving unit 233 to the second control unit 250.

The second storage unit 270 is, for example, a non-volatile storage device such as a hard disk drive or SSD. The second storage unit 270 stores a program executed by the second control unit 250, data processed by the second control unit 250, and the like. SSD is an abbreviation for Solid State Drive.

The image interface 241 is a device for transmitting and receiving signals to and from an external device, and includes an interface circuit for processing the transmitted and received signals. The image interface 241 may include a connector for connecting a cable. In the present embodiment, the image interface 241 is connected to the document camera 100 by the USB cable 109. The specific specifications of the image interface 241 are not limited, and may be, for example, an analog interface such as VGA, D terminal, or S terminal. The image interface 241 may be a digital interface such as DVI, HDMI, Display Port, HDBaseT or the like. The image interface 241 may be a communication interface such as Ethernet or IEEE1394. Further, it may be a wireless communication interface such as Wi-Fi.
Here, VGA is an abbreviation for Video Graphics Array. DVI is an abbreviation for Digital Visual Interface. HDMI is a registered trademark and is an abbreviation for High-Definition Multimedia Interface. HDBaseT is a registered trademark. Ethernet is a registered trademark and Wi-Fi is a registered trademark.

The transfer data D1 is input from the document camera 100 to the image interface 241. As described above, the transfer data D1 includes the first corrected image 133 processed by the document camera 100. Further, the transfer data D1 may include any one or more of the captured image 131 of the document camera 100 and the first correction condition 132. The type and content of the information included in the transfer data D1 are determined by the settings of the document camera 100.

The ambient light detection device 400 detects the ambient light of the document camera 100. More specifically, the ambient light detection device 400 detects external light that affects the captured image of the mounting surface 104 when the document camera 100 images the mounting surface 104. The ambient light detection device 400 is composed of, for example, a color chromaticity sensor, a spectrocolorimeter, a digital camera including a color image sensor, and the like. The ambient light detection device 400 measures the color of the ambient light and outputs the detection result D2 indicating the tristimulus value and the RGB value of the ambient light. The ambient light detection device 400 detects the ambient light at a preset cycle or according to the control data input from the second control unit 250. The ambient light detection device 400 corresponds to an example of the detection device.

The ambient light detection device 400 may be installed at a position where the ambient light of the document camera 100 can be detected. For example, when the projector 200 is installed close to the document camera 100, the ambient light can be detected by the configuration in which the projector 200 is equipped with the ambient light detection device 400. Further, if the document camera 100 is equipped with the ambient light detection device 400, the ambient light of the document camera 100 can be accurately detected without being affected by the distance and the positional relationship between the document camera 100 and the projector 200. Therefore, the position of the ambient light detection device 400 is arbitrary, and may be arranged on the outer surface of the housing of the projector 200, as shown in FIG. 1, and the document camera 100 may be arranged as shown by a virtual line in FIG. It may be arranged on the upper part of the camera head 108.

The ambient light detection device 400 and the second control unit 250 are not limited to the configuration in which they are connected by the internal bus 207. For example, it may be connected by a cable such as a USB cable, may be connected by a communication network, or may be wirelessly connected.

The second control unit 250 includes a second memory 251 and a processor 260 for executing a program. The second memory 251 is a storage device that non-volatilely stores programs and data executed by the processor 260. The second memory 251 is composed of a magnetic storage device, a semiconductor storage element such as a flash ROM, or another type of non-volatile storage device. The second memory 251 may include RAMs that make up the work area of the processor 260. The second memory 251 stores the data processed by the second control unit 250 and the second control program executed by the processor 260. ROM is an abbreviation for Read Only Memory, and RAM is an abbreviation for Random Access Memory.

The processor 260 may be configured by a single processor, or a plurality of processors may function as the processor 260. The processor 260 executes a control program and controls each part of the projector 200 in cooperation with hardware and software.

The second storage unit 270 is composed of a magnetic storage device, an optical storage device, a semiconductor storage element such as a flash ROM, or another type of non-volatile storage device. The second storage unit 270 stores a program executed by the processor 260 and various data processed by the second control unit 250.

The second storage unit 270 stores the first corrected image 271, the first correction condition 272, the uncorrected image 273, the detection result 274, the ambient light information 275, the second correction condition 276, and the second corrected image 277. To do.

The first corrected image 271 is an image extracted from the transfer data D1 by the second control unit 250, and is the first corrected image 133 processed by the document camera 100.
The first correction condition 272 is information extracted from the transfer data D1 by the second control unit 250, and is the first correction condition 132 used by the document camera 100 for the first correction process. When the transfer data D1 does not include the first correction condition, the second control unit 250 estimates the first correction condition as described later. In this case, the condition estimated by the second control unit 250 is stored in the second storage unit 270 as the first correction condition 272.
The uncorrected image 273 is an image extracted from the transfer data D1 by the second control unit 250, and is an captured image 131 captured by the document camera 100 or an image before the first correction process is performed. When the transferred data D1 does not include the captured image, the second control unit 250 generates the image before correction as described later. In this case, the image generated by the second control unit 250 is stored in the second storage unit 270 as the uncorrected image 273.

The detection result 274 is the detection result D2 output by the ambient light detection device 400 or the information extracted from the detection result D2.
Ambient light information 275 is information that defines the type of ambient light. For example, ambient light information 275 indicates A light source, B light source, C light source, D65 light source, etc., which are standard light sources defined by the International Commission on Illumination.

The second correction condition 276 is a condition for the second control unit 250 to perform a second correction process for correcting the uncorrected image 273 as described later. The second correction process is a process of correcting the uncorrected image 273 in accordance with the ambient light of the document camera 100. More specifically, the white balance of the uncorrected image 273 is corrected by adjusting the pixel values of the pixels constituting the uncorrected image 273, that is, the average values of the R value, the G value, and the B value to predetermined values. It is a process. The second correction condition 276 is a parameter that defines the amount of change that changes the pixel value in the second correction process.
The second correction condition 276 includes a parameter corresponding to each light source defined by the ambient light information 275. Therefore, the correction parameter suitable for the ambient light can be obtained by selecting the light source corresponding to the ambient light of the document camera 100 from the light sources defined in the ambient light information 275.

The second corrected image 277 is an image obtained by the second control unit 250 performing the second correction process based on the second correction condition 276.

The image processing unit 245 and the frame memory 243 can be configured by, for example, an integrated circuit. Integrated circuits include LSIs, ASICs, and PLDs. The PLD includes, for example, an FPGA. Further, an analog circuit may be included as a part of the configuration of the integrated circuit, or a combination of a processor and an integrated circuit may be used. The combination of a processor and an integrated circuit is called an MCU, a SoC, a system LSI, a chipset, or the like. ASIC is an abbreviation for Application Special Integrated Circuit, and PLD is an abbreviation for Programmable Logic Device. FPGA is an abbreviation for Field-Programmable Gate Array, MCU is an abbreviation for MicroController Unit, and SoC is an abbreviation for System-on-a-chip.

The image processing unit 245 expands the image displayed by the projection unit 210 into the frame memory 243 under the control of the second control unit 250. The frame memory 243 has a storage capacity capable of writing image data for one frame.

The image processing unit 245 performs image processing such as resolution conversion processing or resizing processing, distortion aberration correction, shape correction processing, digital zoom processing, and adjustment of image hue and brightness on the data expanded in the frame memory 243. Do.
The image processing unit 245 generates a vertical synchronization signal obtained by converting the input frame frequency of the vertical synchronization signal into a drawing frequency. The generated vertical sync signal is called an output sync signal. The image processing unit 245 outputs the generated output synchronization signal to the optical modulation device driving unit 222. As a result, the image processed by the image processing unit 245 is displayed on the liquid crystal panel 215 of the optical modulation device 212 and projected on the screen SC.

The processor 260 constitutes an image acquisition unit 261, a detection result acquisition unit 262, a determination unit 263, and a display processing unit 265 by executing the control program. The display processing unit 265 includes a second correction unit 266 and a display control unit 267.

The image acquisition unit 261 acquires the transfer data D1 input to the image interface 241, extracts the information contained in the transfer data D1, and stores it in the second storage unit 270. For example, the image acquisition unit 261 extracts and stores the first corrected image 271 from the transfer data D1. The image acquisition unit 261 may execute a process of extracting the first correction condition 272 from the transfer data D1 and storing it, and a process of extracting and storing the uncorrected image 273 from the transfer data D1. Whether or not to execute these processes may be set in advance for the second control unit 250 by an operation received by the remote controller 5 or the second operation unit 231 or the like.

The detection result acquisition unit 262 acquires the detection result D2 from the ambient light detection device 400, and stores the detection result 274 in the second storage unit 270.

The determination unit 263 determines whether or not the first correction process executed by the document camera 100 is an appropriate correction based on the first corrected image 271 or the detection result 274.

The display processing unit 265 has a second correction unit 266 and a display control unit 267.
The second correction unit 266 acquires the parameter corresponding to the light source determined by the determination unit 263 from the second correction condition 276, executes the second correction process according to the acquired parameter, and corrects the uncorrected image 273. The second correction unit 266 stores the image obtained by correcting the pre-correction image 273 in the second storage unit 270 as the second corrected image 277.
The second correction unit 266 estimates the first correction condition 272 when the image acquisition unit 261 does not extract the first correction condition 272 from the transfer data D1. When the image acquisition unit 261 does not extract the pre-correction image 273 from the transfer data D1, the second correction unit 266 generates the pre-correction image 273 based on the first correction condition 272 and the first corrected image 271.

The display control unit 267 controls the projection unit 210 to project an image. For example, the display control unit 267 controls the light source drive unit 221 to control the lighting and extinguishing of the light source unit 211, and also adjusts the brightness of the light source unit 211. The display control unit 267 operates the optical modulation device drive unit 222 to draw an image on the liquid crystal panel 215.

When the display control unit 267 determines that the first correction process of the document camera 100 is an appropriate correction, the display control unit 267 projects the first corrected image 271 onto the screen SC by the projection unit 210. When the display control unit 267 determines that the first correction process of the document camera 100 is not an appropriate correction, the display control unit 267 projects an image based on the second corrected image 277 by the projection unit 210.

The second control unit 250 executes, for example, a process of outputting an image processing execution instruction corresponding to an operation received by the second operation unit 231 or the remote controller 5 and a parameter used for the image processing to the image processing unit 245. To do. This parameter includes, for example, a geometric correction parameter for correcting the geometric distortion of the image projected on the screen SC.

[4. First operation example of the projector]
FIG. 4 is a flowchart showing a first operation example of the projector 200.
The first operation example is an example in which the transfer data D1 output by the document camera 100 includes the first corrected image 133 and does not include the captured image 131 and the first correction condition 132. The document camera 100 and the projector 200 operate in response to the transfer data D1 not including the captured image 131 and the first correction condition 132.

The document camera 100 generates the transfer data D1 including the first corrected image 133 and not including the captured image 131 and the first correction condition 132, and transmits the transfer data D1 to the projector 200. The projector 200 receives the transfer data D1 through the image interface 241 (step S11).

The second control unit 250 acquires the transfer data D1 by the second memory 251 (step S11). The image acquisition unit 261 extracts the first corrected image 271 from the transfer data D1 and stores it in the second storage unit 270 (step S12).

The determination unit 263 extracts an image of the subject TG from the first corrected image 271 (step S13). In step S12, the determination unit 263 considers, for example, a preset range in the center of the first corrected image 271 as the image of the subject TG, and acquires the pixel values of the pixels constituting the image of the subject TG. In step S12, the determination unit 263 performs edge detection processing in the first corrected image 271, cuts out an image of the object included in the first corrected image 271, and uses any of the cut out object images as an image of the subject TG. You may recognize it. In this case, the determination unit 263 recognizes the object image having the largest area, the object image having the highest brightness, the object image closest to the center of the first corrected image 271, and the like as the image of the subject TG.

The determination unit 263 detects the color tone of the image of the subject TG extracted in step S12 (step S14). In step S13, the determination unit 263 detects the color tone based on, for example, the average value or the median value of the pixel values of the pixels constituting the image of the subject TG.

The display processing unit 265 estimates the first correction condition 272 based on the color tone of the image of the subject TG (step S15). For example, when the color tone of the image of the subject TG is an image having a stronger redness than the preset reference range, it is estimated that the first correction condition 272 is a parameter for changing the pixel value so as to increase the redness of the image. To do.

Here, the detection result acquisition unit 262 acquires the detection result D2 from the ambient light detection device 400 (step S16). The detection result acquisition unit 262 may acquire the detection result D2 including the detection value of the ambient light detection device 400 at the time when the process of step S16 is executed. Further, the detection result D2 including the detection value of the ambient light detection device 400 at the time when the document camera 100 takes an image of the transfer data D1 acquired in step S11 may be acquired.

The display processing unit 265 refers to the ambient light information 275 based on the detection result D2 acquired by the detection result acquisition unit 262, and determines the type of the ambient light (step S17).

The determination unit 263 compares the type of ambient light determined by the display processing unit 265 in step S17 with the first correction condition 272 estimated by the display processing unit 265 (step S18), and based on the comparison result, the first It is determined whether or not the correction process is an appropriate correction (step S19).

When the determination unit 263 determines that the first correction process is an appropriate correction (step S19; YES), the display processing unit 265 projects the first corrected image 271 by the function of the display control unit 267. It is projected by 210 (step S20).

When the determination unit 263 determines that the first correction process is not an appropriate correction (step S19; NO), the display processing unit 265 makes a first correction based on the first correction condition 272 estimated in step S15. An uncorrected image 273 is generated from the corrected image 271 (step S21). In step S21, the first correction condition 272 is used to perform the reverse processing of the first correction processing on the first corrected image 271 to obtain the pre-correction image 273 equivalent to the captured image 131.

The display processing unit 265 refers to the second correction condition 276, acquires a parameter corresponding to the determined type of ambient light, and performs a second correction process on the uncorrected image 273 using the acquired parameter (step). S22). By the operation of step S22, the second corrected image 277 is generated. The display processing unit 265 projects the second corrected image 277 by the projection unit 210 by the function of the display control unit 267 (step S23).

In the first operation example, it can be accurately determined whether or not the first correction process is an appropriate correction based on the detection result of the ambient light detected by the ambient light detection device 400. Further, in the first operation example, even if the first correction process executed by the document camera 100 is not an appropriate process corresponding to the ambient light of the document camera 100, the first correction included in the transfer data D1. The post-image 271 can be used to generate an appropriate second corrected image 277. Further, even when the transfer data D1 does not include the first correction condition 272 and the pre-correction image 273, there is an advantage that the second corrected image 277 can be obtained.

[5. Second operation example of the projector]
FIG. 5 is a flowchart showing a second operation example of the projector 200.
The second operation example is an example in which the transfer data D1 output by the document camera 100 includes the first correction condition 132 and the first corrected image 133, and does not include the captured image 131. The document camera 100 and the projector 200 operate in response to the transfer data D1 not including the captured image 131.

The document camera 100 generates the transfer data D1 including the first correction condition 132 and the first corrected image 133 and does not include the captured image 131 and the first correction condition 132, and transmits the transfer data D1 to the projector 200.

In the operation of the projector 200, steps S11, S16-S20, and S22-S23 are common to the first operation example shown in FIG. 4, and therefore the same step numbers will be added and description thereof will be omitted.

The image acquisition unit 261 extracts the first correction condition 272 and the first corrected image 271 from the transfer data D1 acquired in step S11, and stores them in the second storage unit 270 (step S31). Therefore, in step S18, the determination unit 263 includes the first correction condition 272 acquired from the transfer data D1 by the image acquisition unit 261 and stored in the second storage unit 270, and the type of ambient light determined by the display processing unit 265. Is compared (step S18).

In the second operation example, when it is determined that the first correction process is not an appropriate correction (step S19; NO), the display processing unit 265 uses the first corrected image 271 and the first correction condition 272. The reverse process of the first correction is performed to generate the pre-correction image 273 (step S32). The uncorrected image 273 generated in step S32 is used for the second correction process in step S22.

In the first operation example described above, the process of estimating the first correction condition 272 is performed in step S15, but in the second operation example, the first correction condition 272 is extracted from the transfer data D1, so that step S15. Is omitted. Therefore, as compared with the first operation example, there is an advantage that the processing load for obtaining the uncorrected image 273 is light and the processing can be performed quickly. Further, a pre-correction image 273 that is closer to the captured image 131 of the document camera 100 can be obtained as compared with the case of processing using the first correction condition 272 estimated in the first operation example. Further, there is an advantage that the second corrected image 277 can be obtained even when the transferred data D1 does not include the pre-corrected image 273.

[6. Third operation example of the projector]
FIG. 6 is a flowchart showing a third operation example of the projector 200.
The third operation example is an example in which the transfer data D1 output by the document camera 100 includes the captured image 131, the first correction condition 132, and the first corrected image 133. The document camera 100 and the projector 200 operate in response to the transfer data D1 including the captured image 131, the first correction condition 132, and the first corrected image 133.

The document camera 100 generates the transfer data D1 including the captured image 131, the first correction condition 132, and the first corrected image 133, and transmits the transfer data D1 to the projector 200.

In the operation of the projector 200, steps S11, S13-S14, S16-S20, and S22-S23 are common to the first operation example shown in FIG. 4 and / or the second operation example shown in FIG. Therefore, the same step number will be added and the description will be omitted.

The image acquisition unit 261 extracts the first corrected image 271, the first correction condition 272, and the uncorrected image 273 from the transfer data D1 acquired in step S11 and stores them in the second storage unit 270 (step S41). ).

In the third operation example, when the determination unit 263 determines that the first correction process is not an appropriate correction (step S19; NO), the display processing unit 265 receives the pre-correction image 273 from the second storage unit 270. (Step S42). In the subsequent step S21, the second correction process is performed using the uncorrected image 273 acquired from the second storage unit 270.

In the third operation example, the transfer data D1 includes the uncorrected image 273. Therefore, as compared with steps S15 and S21 of the first operation example and step S32 of the second operation example, there is an advantage that the processing load is lighter and processing can be performed quickly.

[7. Summary]
As described above, the projector 200 to which the control method of the display device of the present invention is applied acquires the first corrected image to which the first correction is applied at the time of shooting or after shooting from the document camera 100. The projector 200 acquires a detection result from the ambient light detection device 400 that detects the ambient light in the imaging environment of the document camera 100, and determines whether or not the first correction is an appropriate correction. When the projector 200 determines that the first correction is an appropriate correction, the projector 200 displays the image after the first correction by the projection unit 210. When it is determined that the first correction is not an appropriate correction, the image corresponding to the first corrected image or the first corrected image is subjected to the second correction based on the detection result of the ambient light detection device 400. , The second corrected image 277 with the second correction is displayed by the projection unit 210.
The image corresponding to the first corrected image 271 is, for example, the uncorrected image 273 generated by the display processing unit 265 from the first corrected image 271 or extracted by the image acquisition unit 261 from the transfer data D1.

As a result, even if the image input from the document camera 100 to the projector 200 is an image to which an inappropriate first correction is applied, a high-quality image can be obtained by applying a second correction corresponding to ambient light. Is generated and displayed. Therefore, even if the image input from the document camera 100 is an image having an inappropriate hue, a high-quality image can be displayed.

When the projector 200 determines that the first correction is not an appropriate correction, the projector 200 determines the type of ambient light based on the detection result of the ambient light detection device 400, and the second correction corresponds to the type of ambient light. I do. As a result, an appropriate second correction process can be performed according to the type of ambient light, and a high-quality image can be displayed. Further, the second correction process suitable for the ambient light can be executed promptly by using the type of the ambient light as a reference.

In the first and second operation examples, when the projector 200 determines that the first correction is not an appropriate correction, the projector 200 obtains the uncorrected image 273 based on the first corrected image 271 acquired from the document camera 100. A second correction is applied to the generated and generated pre-correction image 273. As a result, the second correction process can be executed even when the pre-correction image 273 that has not been subjected to the first correction process cannot be acquired from the document camera 100.

In the first operation example, the projector 200 estimates the first correction condition 272 based on the first corrected image 271, and generates the uncorrected image 273 based on the estimation result. As a result, even if the first correction condition 272, which is the condition of the first correction processing, cannot be obtained from the document camera 100, the pre-correction image 273 can be generated and the second correction processing can be performed. ..

In the second operation example, the projector 200 acquires the first correction condition 272 from the document camera 100, and uses the acquired first correction condition 272 to generate the uncorrected image 273 from the first corrected image 271. As a result, even if the image that has not been subjected to the first correction process cannot be acquired from the document camera 100, the uncorrected image 273 can be quickly generated and the second correction process can be performed.

In the third operation example, the projector 200 acquires the captured image 131 without the first correction from the document camera 100 and stores it as the pre-correction image 273, and the first correction is not an appropriate correction. When it is determined, the second correction is applied to the uncorrected image 273. As a result, the second correction process can be performed quickly.

The projector 200 includes a projection unit 210 and an image acquisition unit 261 that acquires a first corrected image 271 that has been subjected to the first correction during or after shooting from the document camera 100. The projector 200 includes a detection result acquisition unit 262 that acquires a detection result from an ambient light detection device 400 that detects ambient light in the imaging environment of the document camera 100, and a determination unit that determines whether or not the first correction is an appropriate correction. It is equipped with 263. The projector 200 includes a display processing unit 265. When the display processing unit 265 determines that the first correction is an appropriate correction, the display processing unit 265 causes the projection unit 210 to display an image based on the first corrected image 271. When the display processing unit 265 determines that the first correction is not an appropriate correction, the detection result of the ambient light detection device 400 is obtained for the image corresponding to the first corrected image 271 or the first corrected image 271. A second correction is made based on. The display processing unit 265 causes the projection unit 210 to display the second corrected image 277 with the second correction applied.

The display system 1 includes a document camera 100 and a projector 200 that displays an image based on an image captured by the document camera 100 by a projection unit 210. The document camera 100 generates the first corrected image 133 by performing the first correction on the captured image 131 based on the ambient light in the imaging environment during or after the imaging unit 190 for imaging and the imaging unit 190. A first correction unit 122 is provided. The projector 200 includes an image acquisition unit 261 that acquires the first corrected image 271 from the document camera 100, and an ambient light detection device 400 that detects ambient light in the imaging environment of the document camera 100. The projector 200 includes a detection result acquisition unit 262 that acquires the detection result of the ambient light detection device 400, and a determination unit 263 that determines whether or not the first correction is an appropriate correction. The projector 200 includes a display processing unit 265. When it is determined that the first correction is an appropriate correction, the display processing unit 265 causes the projection unit 210 to display an image based on the first corrected image. When the display processing unit 265 determines that the first correction is not an appropriate correction, the detection result of the ambient light detection device 400 is obtained for the image corresponding to the first corrected image 271 or the first corrected image 271. A second correction is made based on. The display processing unit 265 causes the projection unit 210 to display the second corrected image 277 with the second correction applied.

According to the projector 200 and the display system 1 including the projector 200, a high-quality image can be displayed even if the image input from the document camera 100 to the projector 200 is an image having an inappropriate hue. That is, even if the image input from the document camera 100 to the projector 200 is an image to which an inappropriate first correction is applied, a high-quality image can be obtained by performing a second correction corresponding to ambient light. Generate and display.

The projector 200 may be configured to include an ambient light detection device 400 that detects ambient light in the imaging environment of the document camera 100. In this case, the image can be appropriately corrected and a high-quality image can be displayed based on the detection result D2 of the ambient light detected by the projector 200.

[8. Other embodiments]
The above-described embodiment is a preferred embodiment. However, the present invention is not limited to the above-described embodiment, and various modifications can be carried out within a range that does not deviate from the gist.

For example, the projector 200 has been described as selectively executing the first to fourth operation examples according to the preset settings, but the present invention is not limited thereto. For example, the image acquisition unit 261 of the projector 200 determines the content of the transfer data D1, and depending on the type of information included in the transfer data D1, a first operation example, a second operation example, and a third operation example. You may switch and execute. For example, the projector 200 executes the second operation example when the transfer data D1 includes the first correction condition 272, and the third operation example when the transfer data D1 includes the first correction condition 272 and the uncorrected image 273. Execute the operation example of. If neither the first correction condition 272 nor the pre-correction image 273 is included in the transfer data D1, the first operation example is executed. The projector 200 has a step of determining the information included in the transfer data D1 after step S11 of the flowchart shown in FIGS. 4, 5, and 6, and a first operation example and a second operation example based on the determination result. And the step of selecting the third operation example may be executed.

Further, the document camera 100, which is an image pickup device, may be integrally configured with the projector 200, or a plurality of image pickup devices may be connected to the projector 200.

Further, in the present embodiment, the case where the projector 200 is used as the display device has been described, but the present invention is not limited to this. The display device may be a liquid crystal monitor, a liquid crystal television, or the like that displays an image on a liquid crystal display panel. Further, the device may be provided with a plasma display panel and an organic EL display panel. In this case, for example, the display unit corresponds to the display panel.

Further, each functional unit shown in FIGS. 2 and 3 shows a functional configuration, and a specific mounting form is not particularly limited. That is, it is not always necessary to implement hardware corresponding to each functional unit individually, and it is of course possible to realize a configuration in which the functions of a plurality of functional units are realized by executing a program by one processor. Further, a part of the functions realized by the software in the above embodiment may be realized by the hardware, or a part of the functions realized by the hardware may be realized by the software. In addition, the specific detailed configuration of each other part of the display system 1 can be arbitrarily changed as long as the purpose is not deviated.

Further, the processing units of the flowchart shown in FIGS. 4 to 6 are divided according to the main processing contents in order to make the operation of the projector 200 easy to understand. It is not limited by the method and name of division of the processing unit shown in the flowchart of FIGS. 4 to 6, and can be further divided into more processing units according to the processing content, and one processing unit is further divided. It can also be divided to include many processes. Further, the processing order of the above flowchart is not limited to the illustrated example.

Further, the above-mentioned control method of the projector 200 can be realized by causing the processor 260 to execute a control program corresponding to the control method of the projector 200. The control program can also be recorded on a computer-readable recording medium. As the recording medium, a magnetic or optical recording medium or a semiconductor memory device can be used. Specific examples thereof include portable or fixed recording media such as flexible disk HDDs, CD-ROMs, DVDs, Blu-ray Discs, magneto-optical discs, flash memories, and card-type recording media. Blu-ray is a registered trademark. The recording medium may be a non-volatile storage device such as RAM, ROM, or HDD, which is an internal storage device included in the image processing device. The control method of the projector 200 can also be realized by storing the control program in a server device or the like and downloading the control program from the server device to the projector 200.

1 ... Display system, 5 ... Remote control, 100 ... Document camera (imaging device), 120 ... First control unit, 121 ... Imaging control unit, 122 ... First correction unit, 130 ... First storage unit, 131 ... Captured image, 132 ... 1st correction condition, 133 ... 1st corrected image, 190 ... Imaging unit, 200 ... Projector, 207 ... Internal bus, 210 ... Projection unit (display unit), 211 ... Light source unit, 212 ... Optical modulator, 213. ... Projection optical system, 215 ... Liquid crystal panel, 220 ... Drive unit, 221 ... Light source drive unit, 222 ... Optical modulator drive unit, 231 ... Second operation unit, 233 ... Remote control light receiving unit, 235 ... Input interface, 241 ... Image Interface, 243 ... frame memory, 245 ... image processing unit, 250 ... second control unit, 251 ... second memory, 260 ... processor, 261 ... image acquisition unit, 262 ... detection result acquisition unit, 263 ... judgment unit, 266 ... Second correction unit, 270 ... second storage unit, 271 ... first corrected image, 272 ... first correction condition, 273 ... uncorrected image, 274 ... detection result, 275 ... ambient light information, 276 ... second correction condition 277 ... Second corrected image, 400 ... Ambient light detection device (detection device), AX ... Optical axis, D1 ... Transfer data, D2 ... Detection result, PL ... Image light, SC ... Screen, TG ... Subject.

Claims (10)

From the image pickup apparatus, the first corrected image in which the first correction is applied to the captured image is acquired at the time of shooting the captured image or after the shooting.
The detection result is acquired from the detection device that detects the ambient light in the imaging environment of the image pickup device.
It is determined whether or not the first correction is an appropriate correction, and
When it is determined that the first correction is an appropriate correction, the image after the first correction is displayed on the display unit.
When it is determined that the first correction is not an appropriate correction, a second correction based on the detection result of the detection device is applied to the image after the first correction or the image corresponding to the first corrected image. The second corrected image that has been subjected to the second correction is displayed by the display unit.
How to control the display device. When it is determined that the first correction is not an appropriate correction, the type of the ambient light is determined based on the detection result of the detection device, and the second correction is performed according to the type of the ambient light. , The method for controlling a display device according to claim 1. When it is determined that the first correction is not an appropriate correction, a pre-correction image is generated based on the first corrected image acquired from the imaging device, and the generated pre-correction image is compared with the first correction. The method for controlling a display device according to claim 1 or 2, wherein the amendment of 2 is applied. The control method for a display device according to claim 3, wherein the condition of the first correction is estimated based on the image after the first correction, and the image before the correction is generated based on the estimation result. The display device according to claim 2, wherein an image before correction is generated from the image after the first correction by acquiring the condition of the first correction from the image pickup apparatus and using the acquired condition of the first correction. Control method. An image taken without the first correction is acquired from the image pickup apparatus.
The control method for a display device according to claim 1 or 2, wherein when it is determined that the first correction is not an appropriate correction, the second correction is applied to the acquired image. By acquiring the condition of the first correction from the image pickup apparatus and comparing the condition of the first correction with the detection result of the detection device, it is determined whether or not the correction by the image pickup apparatus is an appropriate correction. The method for controlling a display device according to any one of claims 1 to 6. Display and
An image acquisition unit that acquires a first corrected image in which the first correction is applied to the captured image during or after shooting the captured image from the image pickup device.
A detection result acquisition unit that acquires a detection result from a detection device that detects ambient light in the imaging environment of the image pickup device,
A determination unit that determines whether or not the first correction is an appropriate correction,
When it is determined that the first correction is an appropriate correction, an image based on the first corrected image is displayed by the display unit, and when it is determined that the first correction is not an appropriate correction. After the second correction, the first corrected image or the image corresponding to the first corrected image is subjected to the second correction based on the detection result of the detection device, and the second correction is applied. A display processing unit that displays an image by the display unit and
A display device. The display device according to claim 8, further comprising the detection device that detects ambient light in the imaging environment of the image pickup device. A display system including an image pickup device and a display device for displaying an image based on the captured image captured by the image pickup device on a display unit.
The image pickup device
An imaging unit that captures the captured image and
At the time of shooting or after shooting the captured image by the imaging unit, the ambient light in the imaging environment is estimated from the captured image, and the captured image is first corrected based on the estimated ambient light to obtain the first corrected image. With a first correction unit that generates
The display device is
An image acquisition unit that acquires the first corrected image from the image pickup device, and
A detection device that detects ambient light in the imaging environment of the image pickup device, and
A detection result acquisition unit that acquires the detection result of the detection device,
A determination unit that determines whether or not the first correction is an appropriate correction,
When it is determined that the first correction is an appropriate correction, an image based on the first corrected image is displayed by the display unit, and when it is determined that the first correction is not an appropriate correction. After the second correction, the first corrected image or the image corresponding to the first corrected image is subjected to the second correction based on the detection result of the detection device, and the second correction is applied. A display system including a display processing unit for displaying an image by the display unit.

Images