JP5172775B2 - Control method for liquid crystal display device and liquid crystal display device - Google Patents

Description

  The present invention relates to a liquid crystal display device having an imaging function.

  In recent years, many portable devices such as mobile phones have an imaging device. An imaging device provided in a portable device mainly includes an imaging device, a lens, an IR cut filter (between the imaging device and the lens or located on the subject side), a digital signal processor (DSP), and the like. Configured as Such an imaging device captures a still image such as a landscape or a person, captures a moving image, reads a matrix type two-dimensional code, recognizes information such as a homepage address on the Internet, and so on. It is used for various applications, such as being used to save the time and effort of directly inputting etc., or being used as an acceleration sensor in a game or the like by recognizing the movement of a subject in the moving image mode.

  In addition, a portable device is usually provided with a display device. As a display device in a portable device, a liquid crystal display device is often used. A liquid crystal display device mainly includes a liquid crystal display panel in which liquid crystal is injected and sealed between a pair of glass substrates, a semiconductor device that drives and controls the panel, a backlight, and light from the backlight is supplied to the liquid crystal panel. It is configured as a liquid crystal module including a light guide (reflecting plate) for uniform irradiation, and the like.

  In a device including an imaging device and a display device such as the above-described portable device, the display device displays an image of a landscape, a person or the like captured by the imaging device, or displays characters. To be used. Some display devices further have a touch panel function or the like, and are used for operations such as operation. Furthermore, many display devices in recent years are configured so that a high-luminance LED or the like is used as a backlight so that the display can be clearly displayed even under sunlight.

  In manufacturing a device including an imaging device and a display device, when a camera module or the like as an imaging device and a liquid crystal module or the like as a display device are individually manufactured and each is incorporated in a housing of the device, a process The number of parts, the number of parts, and the like are large, which increases the manufacturing cost and increases the size of the device. With respect to such a problem, Patent Document 1 discloses a liquid crystal display device in which a camera is attached to a liquid crystal display panel.

JP 2003-198990 A (published July 11, 2003)

  Patent Document 1 describes a liquid crystal display device in which a solid-state imaging device and a lens of a camera face each other with a transparent substrate constituting a liquid crystal display panel interposed therebetween. Thus, the purpose of integrating the camera and the liquid crystal display panel and miniaturizing the liquid crystal display device is achieved.

  However, in such a liquid crystal display device, since the transparent substrate of the liquid crystal display panel is sandwiched between the image sensor and the lens, it is not possible to shield the image sensor. Therefore, there is a high possibility that backlight light, external light, and the like irradiated on the liquid crystal display panel enter the light receiving surface of the imaging element through the transparent substrate. An image captured in such a state has a problem that the whole image becomes whitish. In addition, if intense backlight light enters the light receiving surface of the image sensor through the transparent substrate of the liquid crystal display panel, it will scatter brightly with dust, oil film, etc. adhering to the liquid crystal display panel, and it will shine greatly brightly. There is a high possibility that even a small amount of dust will be reflected in a captured image, and a good image cannot be obtained.

  The present invention has been made in view of the above-described problems, and an object of the present invention is to provide a control method capable of acquiring a good image in a liquid crystal display device in which an imaging unit and a liquid crystal display panel are integrated. And

In order to solve the above problems, a control method according to the present invention includes an imaging unit that acquires an image, a liquid crystal display panel that displays the image, a light source that irradiates light to the liquid crystal display panel, Output control means for controlling the output, the image pickup unit is composed of at least an image pickup element and a lens, and the liquid crystal display panel includes a pair of transparent substrates sandwiched between liquid crystals, the image pickup element and the above The lens is a method of controlling a liquid crystal display device that is disposed with at least one of the pair of transparent substrates interposed therebetween, wherein the output control means is in an image acquisition state in which the imaging unit is acquiring an image. And whether or not the liquid crystal display panel is in an image display state displaying an image, and the output of the light source in the image acquisition state is Kicking controlled smaller than the output, the liquid crystal display device, an opening ratio control means for controlling the aperture ratio of the pixel portion of the liquid crystal display panel, the opening ratio control means, the opening at the time of the image acquisition state The ratio is controlled to be smaller than the aperture ratio in the image display state .

With the above configuration, since the output of the light source can be reduced when the image capturing unit is acquiring an image, the amount of light derived from the light source that enters the light receiving surface of the image sensor can be reduced. Accordingly, it is possible to suppress a captured image from becoming white, or from causing irregular reflection light due to dust, an oil film, or the like in the liquid crystal display panel to be reflected in the image, so that a good image can be acquired. In addition, when the liquid crystal display panel displays an image, the output of the light source can be sufficiently increased, so that the image can be displayed satisfactorily. In addition, with the above configuration, when the imaging unit is acquiring an image, the aperture ratio of the pixel unit of the liquid crystal display panel can be reduced. Even when light is applied to the pixel portion, the amount of external light applied to the liquid crystal display panel can be reduced. Therefore, since the amount of external light entering the light receiving surface of the image sensor can be reduced, a better image can be acquired. Further, when the liquid crystal display panel displays an image, the aperture ratio of the pixel portion can be sufficiently increased, so that the image can be displayed better.

  In the control method according to the present invention, it is preferable that the output control unit controls the output to 0 when the image acquisition state is set.

  If it is said structure, since the light derived from the light source which enters into the light-receiving surface of an image pick-up element when the imaging part is acquiring the image can be eliminated, a more favorable image can be acquired.

  In the control method according to the present invention, it is preferable that the aperture ratio control means controls the aperture ratio to 0% in the image acquisition state.

  With the above configuration, it is possible to eliminate the external light that enters the light receiving surface of the image sensor when the imaging unit acquires an image, so that a better image can be acquired.

The control method according to the present invention includes an imaging unit that acquires an image, a liquid crystal display panel that displays the image, a light source that irradiates light to the liquid crystal display panel, an output control unit that controls an output of the light source, The image pickup unit includes at least an image pickup element and a lens, and the liquid crystal display panel includes a pair of transparent substrates sandwiched with liquid crystal, and the image pickup element and the lens include the pair of transparent substrates. In the liquid crystal display device arranged with at least one of them interposed therebetween, there is provided a control method for acquiring a moving image composed of a plurality of images, wherein the output control means is configured such that the imaging unit forms the moving image. Recognizing whether or not each image is in a moving image composition image acquisition state and recognizing whether or not the liquid crystal display panel is in a moving image composition image display state displaying each image, and The output of the light source at the time of the image configuration image acquisition state, controls less than the output at the time of the moving image constituting image display state, the liquid crystal display device controls the opening ratio of the pixel portion of the liquid crystal display panel openings Rate control means, wherein the aperture ratio control means controls the aperture ratio in the moving image constituent image acquisition state to be smaller than the aperture ratio in the moving image constituent image display state .

With the above configuration, since the output of the light source can be reduced when the image capturing unit acquires each image constituting the moving image, the amount of light derived from the light source that enters the light receiving surface of the image sensor is reduced. be able to. Accordingly, it is possible to suppress a captured image from being whitened or to cause irregular reflection light from dust, an oil film, or the like in the liquid crystal display panel to be reflected in the image, so that a good image can be acquired. In addition, when the liquid crystal display panel displays each image constituting the moving image, the output of the light source can be sufficiently increased, so that the image can be displayed favorably. Therefore, it is possible to obtain and display a moving image satisfactorily. In addition, with the above configuration, the aperture ratio of the pixel unit can be reduced when the imaging unit acquires each image constituting the moving image. For example, even when used in sunlight, the amount of external light entering from the opening of the pixel portion can be reduced. Accordingly, since light entering the light receiving surface of the image sensor can be reduced, a better image can be acquired. In addition, when the liquid crystal display panel displays each image constituting a moving image, the aperture ratio of the pixel portion can be sufficiently increased, so that the image can be displayed better. Therefore, a moving image can be displayed more favorably.

  In the control method according to the present invention, it is preferable that the output control unit controls the output to 0 when the moving image composing image is acquired.

  With the above configuration, it is possible to eliminate light derived from the light source that enters the light receiving surface of the image sensor when the image capturing unit acquires each image constituting the moving image, so that a better image can be acquired. . Therefore, a moving image can be displayed more favorably.

  In the control method according to the present invention, it is preferable that the aperture ratio control means controls the aperture ratio to 0% when the moving image composing image is acquired.

  If it is said structure, since the external light which enters into the light-receiving surface of an image pick-up element can be eliminated when the imaging part is acquiring each image which comprises a moving image, a more favorable image can be acquired. . Therefore, a moving image can be displayed more favorably.

The control how according to the present invention includes an imaging unit that acquires an image, the liquid crystal display panel for displaying the image, a light source for irradiating light to the liquid crystal display panel, an output control for controlling the output of the light source And the image pickup unit includes at least an image pickup element and a lens. The liquid crystal display panel includes a pair of transparent substrates sandwiched between liquid crystals, and the image pickup element and the lens include the pair. In the liquid crystal display device arranged with at least one of the transparent substrates sandwiched therebetween, a control method for acquiring a moving image composed of a plurality of images, wherein the output control means is configured such that the imaging unit is a moving image. And whether or not it is a moving picture constituent image acquisition state in which each of the images constituting the image is acquired, and whether or not the liquid crystal display panel is in a moving picture constituent image display state displaying each of the images. The output of the light source at the time of the moving image constituting an image acquisition condition, less controlled than the output at the time of the moving image constituting image display state, the liquid crystal display device, the images acquired by the imaging unit liquid crystal display panel The timing control means controls the acquired image to be displayed after at least one other image acquired after the image is acquired. It is preferable.

  With the above configuration, the acquired image is not displayed immediately, but is displayed after at least one other image is acquired. Even for an image having a large capacity, for example, a fine image having a large number of pixels, a sufficient time for transferring the image is ensured. Thereby, even if time is required for image transfer, the number of times of display per unit time is not reduced, and it is possible to suppress a moving image like frame advance. Therefore, the moving image can be displayed so as not to feel uncomfortable.

  In the control method according to the present invention, the liquid crystal display device includes image acquisition display time control means for controlling an image acquisition time by the imaging unit and an image display time by the liquid crystal display panel. It is preferable that the display time control means controls the display time longer than the acquisition time.

  With the above configuration, since the image display time is longer than the acquisition time, the image can be reliably displayed, and thus flickering of the moving image can be reduced.

  Further, in the control method according to the present invention, the liquid crystal display device controls image acquisition time by the imaging unit, and image acquisition time control means for recognizing whether the surrounding is bright or dark. It is preferable that the image acquisition time control means controls the acquisition time when the surrounding is dark longer than the acquisition time when the surrounding is bright.

  With the above configuration, it is possible to reliably acquire an image by controlling the acquisition time of the image when the surrounding is dark, and to obtain the image on the light receiving surface of the image sensor 5 when the surrounding is bright. The amount of incoming external light can be reduced. Therefore, the acquisition time can be appropriately adjusted for each image constituting the moving image depending on whether the surroundings are bright or dark, so that a good image can be acquired.

  Further, in the control method according to the present invention, the liquid crystal display device controls the display time of the image by the liquid crystal display panel, and image display time control means for recognizing whether the surrounding is bright or dark. It is preferable that the image display time control means controls the display time when the surrounding is dark longer than the display time when the surrounding is bright.

  With the above-described configuration, it is possible to display a dark image so that an afterimage remains in the eyes or the brain by extending the image display time when the surroundings are dark. Furthermore, since the display time can be appropriately adjusted for each image constituting the moving image depending on whether the surroundings are bright or dark, the image can be displayed favorably. Thereby, a moving image can be displayed so that a motion can be felt naturally.

The control how according to the present invention includes an imaging unit that acquires an image, the liquid crystal display panel for displaying the image, a light source for irradiating light to the liquid crystal display panel, an output control for controlling the output of the light source And the image pickup unit includes at least an image pickup element and a lens. The liquid crystal display panel includes a pair of transparent substrates sandwiched between liquid crystals, and the image pickup element and the lens include the pair. In the liquid crystal display device arranged with at least one of the transparent substrates sandwiched therebetween, a control method for acquiring a moving image composed of a plurality of images, wherein the output control means is configured such that the imaging unit is a moving image. And whether or not it is a moving picture constituent image acquisition state in which each of the images constituting the image is acquired, and whether or not the liquid crystal display panel is in a moving picture constituent image display state displaying each of the images. The output of the light source at the time of the moving image constituting image acquisition state, controls less than the output at the time of the moving image constituting image display state, the output control means, whether the illuminance is low or a high state of light on the subject And the output when the illuminance of light to the subject is low and the illuminance of light to the subject is the above-mentioned output when the illuminance of light to the subject is low. It is preferable to control to be smaller than the output in the high state.

  With the above configuration, the output of the light source can be reduced when the moving image configuration image is acquired and the illuminance of light to the subject is low, so even when the sensitivity of the image sensor increases The amount of light derived from the light source that enters the light receiving surface of the image sensor can be reduced. Further, by controlling the output of the light source according to the illuminance of light to the subject, the amount of light entering the light receiving surface of the image sensor can be adjusted appropriately. Therefore, a good image can be acquired.

  Further, in the control method according to the present invention, the aperture ratio control means recognizes whether the external light applied to the pixel unit is in a bright state or a dark state, and in the moving image constituent image acquisition state, The aperture ratio when the external light applied to the pixel unit is bright is smaller than the aperture ratio when the external light applied to the pixel unit is dark in the moving image constituent image acquisition state. It is preferable to control.

  With the above configuration, when the moving image constituent image is acquired and the external light applied to the pixel portion is bright, the aperture ratio of the pixel portion can be reduced, so that it enters the light receiving surface of the image sensor. The amount of external light can be reduced. In addition, the amount of light entering the light receiving surface of the image sensor can be adjusted appropriately by controlling the aperture ratio of the pixel portion in accordance with the brightness of the external light applied to the pixel portion. Therefore, a good image can be acquired.

  In the control method according to the present invention, the liquid crystal display device includes image display frequency control means for controlling the number of times the image acquired by the imaging unit is displayed on the liquid crystal display panel, and the image display frequency control means. However, it is preferable to control the acquired image to be displayed twice or more.

  With the above configuration, the acquired image is displayed twice or more, and this image is transferred even when the data capacity of the image is large and it takes time to transfer from the imaging unit to the liquid crystal display panel. In the meantime, the image that has already been transferred is displayed again. For this reason, there is no so-called waiting time during which no image is displayed until a large-capacity image is transferred, so that flickering of moving images can be suppressed.

The liquid crystal display device according to the present invention includes an imaging unit that acquires an image, a liquid crystal display panel that displays the image, a light source that irradiates light to the liquid crystal display panel, and an output control unit that controls the output of the light source. The image pickup unit includes at least an image pickup element and a lens, and the liquid crystal display panel includes a pair of transparent substrates with a liquid crystal sandwiched between the image pickup element and the lens. A liquid crystal display device arranged with at least one of the substrates interposed therebetween, wherein the output control means recognizes whether or not the image acquisition state represents an image acquisition state by the imaging unit and the liquid crystal The display panel recognizes whether or not the image display state represents an image display state, and the output of the light source in the image acquisition state corresponds to the output in the image display state. All SANYO controls smaller than the force, with an opening ratio control means for controlling the aperture ratio of the pixel portion of the liquid crystal display panel, the opening ratio control means, the opening ratio at the time of the image acquisition state, the Control is made smaller than the aperture ratio in the image display state .

With the above configuration, since the output control means is provided, the output of the light source can be reduced when the imaging unit acquires an image, so the amount of light derived from the light source that enters the light receiving surface of the imaging element can be reduced. Can be reduced. Accordingly, it is possible to suppress a captured image from becoming white, or from causing irregular reflection light due to dust, an oil film, or the like in the liquid crystal display panel to be reflected in the image, so that a good image can be acquired. Further, when displaying an image on the liquid crystal display panel, the output of the light source can be sufficiently increased, so that the image can be displayed satisfactorily. Further, since it is not necessary to increase the level of management for preventing dust from entering, the manufacturing cost can be reduced. In addition, with the above configuration, when the imaging unit is acquiring an image, the aperture ratio of the pixel unit of the liquid crystal display panel can be reduced. Even when light is applied to the pixel portion, the amount of external light applied to the liquid crystal display panel can be reduced. Therefore, since the amount of external light entering the light receiving surface of the image sensor can be reduced, a better image can be acquired. Further, when the liquid crystal display panel displays an image, the aperture ratio of the pixel portion can be sufficiently increased, so that the image can be displayed better.

As described above, the control method according to the present invention controls an imaging unit that acquires an image, a liquid crystal display panel that displays the image, a light source that emits light to the liquid crystal display panel, and an output of the light source. Output control means, the image pickup unit is composed of at least an image pickup element and a lens, the liquid crystal display panel includes a pair of transparent substrates sandwiched between liquid crystals, the image pickup element and the lens, In the control method of the liquid crystal display device arranged with at least one of the pair of transparent substrates interposed therebetween, the output control means recognizes whether or not the imaging unit is acquiring an image, And whether or not the liquid crystal display panel is in an image display state displaying an image, and the output of the light source in the image acquisition state is the output in the image display state. Ri small controlled, the liquid crystal display device, an opening ratio control means for controlling the aperture ratio of the pixel portion of the liquid crystal display panel, the opening ratio control means, the opening ratio at the time of the image acquisition state, Since the aperture ratio is controlled to be smaller than that in the image display state , a good image can be acquired.

It is a figure which shows one Embodiment of the liquid crystal display device based on this invention. It is a top view which shows the liquid crystal display unit in 1st Embodiment. It is the figure which looked at the liquid crystal display unit shown in FIG. 2 from the side. It is the figure which looked at the liquid crystal display unit in the liquid crystal display device concerning a 2nd embodiment from the side. It is a graph showing the relationship between time (t) and the output (w) of a light source which shows an example of the control pattern by the control method which concerns on this invention. It is a graph showing the relationship between time and the output of a light source which shows an example of the control pattern by the control method which concerns on this invention. It is a graph showing the relationship between time (t) and aperture ratio (f) which shows an example of the control pattern by the control method which concerns on this invention. It is a graph showing the relationship between time and an aperture ratio which shows an example of the control pattern by the control method which concerns on this invention. It is a graph showing the relationship between time and the output of a light source which shows an example of the control pattern by the control method which concerns on this invention. It is a graph showing the relationship between time and the output of a light source which shows an example of the control pattern by the control method which concerns on this invention. It is a graph showing the relationship between time and an aperture ratio which shows an example of the control pattern by the control method which concerns on this invention. It is a graph showing the relationship between time and an aperture ratio which shows an example of the control pattern by the control method which concerns on this invention. It is a graph showing the relationship between time and the output of a light source which shows an example of the control pattern by the control method which concerns on this invention. It is a graph showing the relationship between time and the output of a light source which shows an example of the control pattern by the control method which concerns on this invention. It is a graph showing the relationship between time and the output of a light source which shows an example of the control pattern by the control method which concerns on this invention. It is a graph showing the relationship between time and the output of a light source which shows an example of the control pattern by the control method which concerns on this invention. It is a graph showing the relationship between time and the output of a light source which shows an example of the control pattern by the control method which concerns on this invention. It is a graph showing the relationship between time and the output of a light source which shows an example of the control pattern by the control method which concerns on this invention. It is a graph showing the relationship between time and the output of a light source in the conventional control method. It is a graph showing the relationship between time and an aperture ratio in the conventional control method. It is a graph showing the relationship between time and the output of a light source in the conventional control method. It is a graph showing the relationship between time and an aperture ratio in the conventional control method.

[First Embodiment]
An embodiment of a liquid crystal display device according to the present invention will be described with reference to FIGS.

  FIG. 1 is a diagram showing an embodiment of a liquid crystal display device according to the present invention.

  As shown in FIG. 1, the liquid crystal display device in this embodiment includes a liquid crystal display unit 100 and a control unit (output control means, aperture ratio control means, timing control means, image acquisition display time control means, image acquisition time control means, Image display time control means, image display frequency control means) 30.

  First, the liquid crystal display unit 100 will be described in detail with reference to FIGS.

  FIG. 2 is a plan view showing the liquid crystal display unit in the first embodiment. FIG. 3 is a side view of the liquid crystal display unit shown in FIG.

  The liquid crystal display unit 100 mainly includes a liquid crystal display panel, an imaging unit, and a high-intensity LED (light source) 2 (hereinafter also simply referred to as “LED” or “light source”).

  The liquid crystal display panel mainly includes a pair of transparent substrates 1 and 6 and a liquid crystal 7 sandwiched therebetween. The liquid crystal 7 is injected and sealed in the transparent substrates 1 and 6. An image is displayed on the surface 12 side of the transparent substrate 1.

  The liquid crystal display panel is provided with a light guide plate 4 that guides light emitted from the LEDs 2 to the entire surface of the liquid crystal display panel. The light guide plate 4 may be, for example, a reflective plate.

  Further, the liquid crystal display panel is provided with a pixel portion (not shown) and a shutter (not shown) for adjusting the aperture ratio of the pixel portion. The aperture ratio of the pixel portion is an area ratio of a region effective for display per pixel.

  In this embodiment, the aperture ratio of the pixel portion is adjusted by a shutter provided in the pixel portion. However, the present invention is not particularly limited to this. In the liquid crystal display panel according to the present invention, the aperture ratio of the pixel unit may be adjusted by, for example, a method of changing the light transmittance of the pixel unit or a method of displaying the pixel in black. The light transmittance of the pixel portion can be changed by, for example, changing the alignment of the liquid crystal by applying a voltage or polarizing the liquid crystal.

  The transparent substrate 1 is formed to be larger than the transparent substrate 6, and the imaging unit and the LED 2 are provided in the large formed portion.

  The imaging unit has an imaging function for capturing and acquiring an image, and includes a lens 3 and an imaging element 5. Although not shown, the imaging unit is provided with a light guide plate that guides light incident from the lens 3 to the light receiving surface of the imaging element 5.

  The image sensor 5 is provided on the transparent substrate 1 on the transparent substrate 6 side, and the light receiving surface of the image sensor 5 faces the surface 11 of the transparent substrate 1. The image sensor 5 is provided by flip chip bonding (FCB) mounting on the surface 11, and is disposed on the projection substrate (not shown) disposed on the light receiving surface side of the image sensor 5 and the transparent substrate 1. Wiring (not shown) is electrically connected.

  The imaging element may be provided with an electrode on a surface opposite to the light receiving surface, and may be provided on the transparent substrate on this surface. In this case, the electrode in the imaging device is disposed on the electrode disposed on the transparent substrate. It may be connected by a method such as wire bonding mounting.

  The lens 3 is provided on the surface 12 of the transparent substrate 1 opposite to the transparent substrate 6. The lens 3 faces the surface 12 of the transparent substrate 1 and faces the image sensor 5 with the transparent substrate 1 interposed therebetween. That is, the image sensor 5 and the lens 3 are arranged with the transparent substrate 1 interposed therebetween. The optical center of the lens 3 and the center of the light receiving surface of the image sensor 5 are substantially coincident with each other.

  Note that the image sensor and the lens only need to be disposed with at least one of the pair of transparent substrates included in the liquid crystal display panel interposed therebetween.

  As described above, in the liquid crystal display device according to this embodiment, since the imaging unit and the liquid crystal display panel are integrated, the size of the device can be reduced. In addition, since it is not necessary to perform a process of incorporating a separately manufactured image pickup unit into a liquid crystal display device during manufacturing, the number of processes can be reduced, and manufacturing costs can be reduced.

  The transparent substrate 1 between the image sensor 5 and the lens 3 may be provided with a coating film for IR cut. As a result, a part of the transparent substrate 1 of the liquid crystal display panel can be made to function as an IR cut filter of the imaging unit, so that the number of parts of the liquid crystal display device can be reduced and the manufacturing cost can be reduced. The device can be further downsized.

  The LED 2 is provided on the surface 12 of the transparent substrate 1 in the vicinity of the imaging unit. The LED 2 functions as a backlight in the liquid crystal display panel, and light emitted from the LED 2 is guided by the light guide plate 4 and is irradiated almost uniformly on the entire surface of the liquid crystal display panel.

  Here, the area | region where the light of LED2 is radiated | emitted is demonstrated. As shown in FIG. 2, the LED 2 is provided with a reflecting surface 21. The light radiated from the LED 2 includes light traveling in the left direction in FIG. 2 (the direction in which the liquid crystal display panel is present) and light reflected by the reflecting surface 21 and proceeding in the left direction in FIG. The region where these lights are emitted is on the left side of the light emitting region interface 22 shown by the broken lines in FIGS.

  In the present embodiment, the LED 2 is provided in the vicinity of the imaging unit. However, in the liquid crystal display device according to the present invention, the position of the light source is not limited to the vicinity of the imaging unit.

  In addition, the light source included in the liquid crystal display device according to the present invention may be any light source as long as it irradiates the liquid crystal display panel. For example, the light source from the point light source, the linear light source, the point or the linear light source It may be a planar light guide, a planar light source, or the like that emits light in a planar shape from a planar light emitting surface. Moreover, the number of the point light source and the linear light source may be one, or a plurality may be provided.

  Next, the control unit 30 will be described.

  The control unit 30 is connected to the liquid crystal display unit 100 described above, and controls this by exchanging signals with the liquid crystal display unit 100.

  The control unit 30 controls at least the output of the LED 2 in the liquid crystal display unit 100. The control unit 30 receives from the liquid crystal display unit 100 an image acquisition signal indicating an image acquisition state in which the imaging unit is acquiring an image and an image display signal indicating an image display state in which the liquid crystal display panel is displaying an image. . When the image acquisition signal is received, the image acquisition state is recognized. When the image display signal is received, the image display state is recognized. Then, the control unit 30 controls the output of the LED 2 in the image acquisition state to be smaller than the output of the LED 2 in the image display state.

  Note that the output control means of the liquid crystal display device according to the present invention only needs to recognize whether or not it is in an image acquisition state and whether or not it is in an image display state, and the method is not limited to the above-described method. . For example, an image acquisition start signal indicating the start of image acquisition and an image acquisition end signal indicating the end of image acquisition are received, and from when the image acquisition start signal is received to when the image acquisition end signal is received May be recognized as being in an image acquisition state. Also, an image display start signal indicating the start of image display and an image display end signal indicating the end of image display are received, and from when the image display start signal is received to when the image display end signal is received. May be recognized as being in an image display state. For the image acquisition signal, the image display signal, the image acquisition start signal, the image acquisition end signal, the image display start signal, and the image display end signal described above, for example, an input unit is provided in the liquid crystal display device and input The unit may generate these signals when receiving an instruction for inputting whether the user acquires an image or whether to display an image.

  In the liquid crystal display unit 100 described above, the light of the LED 2 is emitted from the transparent substrate 1 between the imaging element 5 and the lens 3 in the imaging unit, as indicated by the light emission region interface 22 in FIGS. 2 and 3. Therefore, the light from the LED 2 may enter the light receiving surface of the image sensor 5.

  However, in the present embodiment, the control of the control unit 30 can reduce the output of the LED 2 in the image acquisition state, so that the amount of light derived from the LED 2 that enters the light receiving surface of the image sensor 5 can be reduced. it can. Accordingly, it is possible to suppress a captured image from becoming white, or from causing irregular reflection light due to dust, an oil film, or the like in the liquid crystal display panel to be reflected in the image, so that a good image can be acquired. Further, in the image display state, the output of the LED 2 can be sufficiently increased, so that the image can be displayed satisfactorily.

  Below, while explaining the example of the control pattern performed by the control part 30, the control method which concerns on this invention is demonstrated.

  First, an example of a control pattern when acquiring and displaying a still image is shown.

(Control pattern 1)
In the control pattern 1, the case where the control unit 30 controls the output of the LED 2 as described above will be described.

  The control pattern 1 will be described with reference to FIG. FIG. 5 is a graph showing the relationship between time (t) and the output (w) of the light source, showing an example of the control pattern by the control method according to the present invention.

  The time (t) may be anything previously input to a storage unit (not shown) connected to the control unit 30, and the control unit 30 extracts information related to the time (t) from the storage unit. It is possible to perform control.

  In the control pattern 1, as shown in FIG. 5, the imaging unit acquires and acquires an image between time t1 and t2, and the liquid crystal display panel displays the image after time t2.

  The control unit 30 receives an image acquisition signal from the liquid crystal display unit 100 between times t1 and t2, recognizes that it is in an image acquisition state, and controls the output of the LED 2 to be w1. Further, after time t2, an image display signal is received from the liquid crystal display unit 100, the image display state is recognized, and the output of the LED 2 is controlled to be w2.

  Thereby, since the output of LED2 can be made small when the imaging part is acquiring an image, the amount of light derived from LED2 entering the light receiving surface of imaging element 5 can be reduced. Accordingly, it is possible to suppress a captured image from becoming white, or from causing irregular reflection light due to dust, an oil film, or the like in the liquid crystal display panel to be reflected in the image, so that a good image can be acquired. Further, when the liquid crystal display panel is displaying an image, the output of the LED 2 can be made sufficiently large, so that the image can be displayed satisfactorily.

(Control pattern 2)
The control pattern 2 will be described with reference to FIG. FIG. 6 is a graph showing the relationship between time and the output of the light source, showing an example of the control pattern by the control method according to the present invention.

  As shown in FIG. 6, the control unit 30 controls the output of the LED 2 to be 0 in the image acquisition state in the control pattern 1 described above.

  Thereby, since the light derived from LED2 which enters into the light-receiving surface of the image sensor 5 when the imaging unit is acquiring an image can be eliminated, a better image can be acquired.

(Control pattern 3)
In the control pattern 3, a case will be described in which the control unit 30 further controls the aperture ratio of the pixel portion of the liquid crystal display panel. The control unit 30 controls the aperture ratio of the pixel portion in the image acquisition state to be smaller than the aperture ratio of the pixel portion in the image display state.

  The control pattern 3 will be described with reference to FIG. FIG. 7 is a graph showing the relationship between time (t) and aperture ratio (f), showing an example of a control pattern by the control method according to the present invention.

  In the control pattern 3, as shown in FIG. 7, the imaging unit acquires an image between time t1 and t2, and the liquid crystal display panel displays the image after time t2.

  The control unit 30 receives an image acquisition signal from the liquid crystal display unit 100 between times t1 and t2, recognizes that it is in an image acquisition state, and controls the aperture ratio of the pixel unit to be f1. In addition, after time t2, an image display signal is received from the liquid crystal display unit 100, the image display state is recognized, and the aperture ratio of the pixel portion is controlled to be f2.

  Thereby, when the imaging unit is acquiring an image, the aperture ratio of the pixel portion of the liquid crystal display panel can be reduced, so that the amount of external light applied to the liquid crystal display panel can be reduced. For example, when the above-described liquid crystal display device is used in sunlight or the like, strong external light is applied to the transparent substrate 1, and thus there is a high possibility that the external light will enter the light receiving surface of the image sensor 5. Even in such a case, according to the present control pattern, it is possible to reduce the amount of external light applied to the liquid crystal display panel. Therefore, since the amount of external light entering the light receiving surface of the image sensor 5 can be reduced, a better image can be acquired. In addition, when the liquid crystal display panel displays an image, the aperture ratio of the pixel portion can be sufficiently increased, so that the image can be displayed better.

(Control pattern 4)
The control pattern 4 will be described with reference to FIG. FIG. 8 is a graph showing the relationship between time and the aperture ratio, showing an example of a control pattern by the control method according to the present invention.

  As shown in FIG. 8, the control pattern 4 controls the aperture ratio of the pixel portion to be 0% in the image acquisition state in the control pattern 3 described above.

  Thereby, since the external light which enters into the light-receiving surface of the image pick-up element 5 can be eliminated when the imaging part is acquiring an image, a more favorable image can be acquired.

  In the above-described control patterns 1 to 4, when an image is acquired and then transferred to the liquid crystal display panel, the time required for this transfer (transfer time) is the time for acquiring the image, that is, the time. It may be included between t1 and t2, or may be included after time t2, that is, after time t2.

  Next, an example of a control pattern when acquiring and displaying a moving image is shown.

  Note that the moving image can be composed of a plurality of images. Here, each image constituting the moving image is referred to as a frame.

  The control unit 30 displays a frame acquisition signal indicating a state in which the imaging unit is acquiring a frame from the liquid crystal display unit 100 (moving image constituent image acquisition state, frame acquisition state), and a state in which the frame is displayed by the liquid crystal display panel. A frame display signal indicating (moving image constituent image display state, frame display state) is received. When the frame acquisition signal is received, it is recognized that the frame is being acquired. When the frame display signal is being received, it is recognized that the frame is being displayed. And the control part 30 controls the output of LED2 at the time of a flame | frame acquisition state smaller than the output of LED2 when the frame display signal is received.

  Note that the output control means of the liquid crystal display device according to the present invention recognizes whether or not the imaging unit is in a moving image constituent image acquisition state in which each image forming the moving image is acquired, and the liquid crystal display panel forms the moving image. What is necessary is just to recognize whether it is the moving image structure image display state which displays each image, and the method is not restricted to what was mentioned above. For example, a moving image constituent image acquisition start signal indicating the start of acquisition of each image constituting the moving image and a moving image constituent image acquisition end signal indicating the end of acquisition of each image constituting the moving image are received, and the moving image constituent image is acquired. The period from when the start signal is received to when the moving image composition image acquisition end signal is received may be recognized as the moving image composition image acquisition state. Also, a moving image constituent image display start signal indicating the start of display of each image constituting the moving image and a moving image constituent image display end signal indicating the end of display of each image constituting the moving image are received, and the moving image constituent image display is performed. A period from when the start signal is received to when the moving image constituent image display end signal is received may be recognized as the moving image constituent image display state. The frame acquisition signal, the frame display signal, the moving image configuration image acquisition start signal, the moving image configuration image acquisition end signal, the moving image configuration image display start signal, and the moving image configuration image display end signal described above, for example, in a liquid crystal display device An input unit is provided so that these signals are generated when the input unit receives an instruction to input whether to acquire a video by the user or whether to display the video. do it.

(Control pattern 5)
In the control pattern 5, the case where the control unit 30 controls the output of the LED 2 as described above will be described.

  The control pattern 5 will be described with reference to FIG. FIG. 9 is a graph showing the relationship between time and the output of the light source, showing an example of the control pattern by the control method according to the present invention.

  In the control pattern 5, as shown in FIG. 9, the imaging unit acquires the frame a1 during the time t1 to t2, and the liquid crystal display panel displays the frame a1 during the time t2 to t3. Next, the imaging unit acquires the frame a2 from time t3 to t4, and the liquid crystal display panel displays the frame a2 from time t4 to t5. In this way, by repeating the acquisition and display of each frame, a moving image is acquired and displayed.

  The control unit 30 receives a frame acquisition signal from the liquid crystal display unit 100 between time t1 and t2 and between time t3 and t4, recognizes that it is in the frame acquisition state, and sets the output of LED2 to w1. Control as follows. Also, during the time t2 to t3 and between the time t4 and t5, a frame display signal is received from the liquid crystal display unit 100, the frame display state is recognized, and the output of the LED 2 is controlled to be w2. .

  As described above, the control unit 30 controls the output of the LED 2 as the frame acquisition and display are repeated.

  Thereby, since the output of LED2 can be made small when the imaging part is acquiring a frame, the amount of light derived from LED2 entering the light receiving surface of imaging element 5 can be reduced. Therefore, it is possible to suppress a captured frame from being whitened, and to prevent irregular reflection light due to dust, an oil film, or the like in the liquid crystal display panel from being reflected in the frame, so that a favorable frame can be obtained. Further, when the liquid crystal display panel displays a frame, the output of the LED 2 can be made sufficiently large, so that the frame can be displayed satisfactorily. Therefore, it is possible to obtain and display a moving image satisfactorily.

(Control pattern 6)
The control pattern 6 will be described with reference to FIG. FIG. 10 is a graph showing the relationship between time and the output of the light source, showing an example of a control pattern by the control method according to the present invention.

  As shown in FIG. 10, the control pattern 6 controls the output of the LED 2 when the imaging unit acquires a frame in the control pattern 5 described above to 0.

  Thereby, since the light derived from LED2 which enters into the light-receiving surface of the image sensor 5 when the imaging unit acquires a frame can be eliminated, a better frame can be acquired. Therefore, a moving image can be acquired and displayed better.

(Control pattern 7)
In the control pattern 7, the case where the control unit 30 further controls the aperture ratio of the pixel portion of the liquid crystal display panel will be described. The control unit 30 controls the aperture ratio of the pixel unit in the frame acquisition state to be smaller than the aperture ratio of the pixel unit in the frame display state.

  The control pattern 7 will be described with reference to FIG. FIG. 11 is a graph showing the relationship between time and the aperture ratio, showing an example of a control pattern by the control method according to the present invention.

  In the control pattern 7, as shown in FIG. 11, the imaging unit acquires the frame a1 during the time t1 to t2, and the liquid crystal display panel displays the frame a1 during the time t2 to t3. Next, the imaging unit acquires the frame a2 from time t3 to t4, and the liquid crystal display panel displays the frame a2 from time t4 to t5. In this way, by repeating the acquisition and display of each frame, a moving image is acquired and displayed.

  The control unit 30 receives a frame acquisition signal from the liquid crystal display unit 100 between time t1 and t2 and between time t3 and t4, recognizes that it is in a frame acquisition state, and sets the aperture ratio of the pixel unit to f1. Control to Further, during the period from time t2 to t3 and from time t4 to t5, a frame display signal is received from the liquid crystal display unit 100, the frame display state is recognized, and the aperture ratio of the pixel portion is set to f2. Control.

  As described above, the control unit 30 controls the aperture ratio of the pixel unit as the frame acquisition and display are repeated.

  Thereby, when the imaging unit acquires a frame, the aperture ratio of the pixel unit can be reduced. For example, even when used in sunlight, the amount of external light entering from the opening of the pixel portion can be reduced. Therefore, since the amount of external light entering the light receiving surface of the image sensor 5 can be reduced, a better frame can be acquired. Further, when the liquid crystal display panel displays a frame, the aperture ratio of the pixel portion can be sufficiently increased, so that the frame can be displayed better. Therefore, a moving image can be acquired and displayed better.

(Control pattern 8)
The control pattern 8 will be described with reference to FIG. FIG. 12 is a graph showing the relationship between time and the aperture ratio, showing an example of a control pattern by the control method according to the present invention.

  As shown in FIG. 12, the control pattern 8 is for controlling the aperture ratio of the pixel portion to be 0% in the frame acquisition state in the control pattern 7 described above.

  Thereby, since the external light which enters into the light-receiving surface of the image sensor 5 can be eliminated when the imaging unit is acquiring a frame, a better frame can be acquired. Therefore, a moving image can be acquired and displayed better.

(Control pattern 9)
In the control pattern 9, the control unit 30 further controls the timing for displaying the frame acquired by the imaging unit on the liquid crystal display panel, and the acquired frame is at least one acquired after the frame. A case where control is performed so that other frames are displayed after they are acquired will be described.

  The control pattern 9 will be described with reference to FIG. FIG. 13 is a graph showing an example of a control pattern by the control method according to the present invention and showing a relationship between time and the output of the light source.

  In the control pattern 9, as shown in FIG. 13, the imaging unit acquires the frame a1 during the time t1 to t2, and the image transfer means (not shown) provided in the liquid crystal display device during the time t2 to t3. ) Transfers and writes the frame a1 to a buffer (not shown) provided in the liquid crystal display device. Further, the imaging unit acquires the frame a2 during the time t3 to t4, and the image transfer unit transfers the frame a2 to the buffer and writes it during the time t4 to t5.

  The control unit 30 controls the frame a1 to be displayed on the liquid crystal display panel during the time t4 to t5 without being displayed during the time t2 to t3 immediately after the acquisition. That is, the timing at which the frame a1 is displayed is after the frame a2 is acquired. Further, the control is performed so that the frame a2 is not displayed during the time t4 to t5 immediately after being acquired, but is displayed during the time t6 to t7. That is, the timing at which the frame a2 is displayed is after the frame a3 is acquired between the times t4 and t5.

  In addition, the control unit 30 receives a frame acquisition signal from the liquid crystal display unit 100 between time t1 and t2 and between time t3 and t4, recognizes that it is in the frame acquisition state, and outputs the output of LED2 to w1. Control to Further, during the period from time t4 to t5 and from time t6 to t7, the frame display signal is received from the liquid crystal display unit 100, the frame display state is recognized, and the output of the LED 2 is controlled to be w2. . In addition, since the control part 30 receives neither a frame acquisition signal nor a frame display signal between time t2 and t3, the output of LED2 is still w1.

  By controlling according to such a pattern, the acquired frame is not displayed immediately, but is displayed after at least one other frame is acquired. Therefore, even for a frame having a large data capacity, for example, a fine frame having a large number of pixels, sufficient time for transfer to a buffer or the like is ensured. Thereby, even if it takes time to transfer the frame, the number of times of display per unit time is not reduced, and it is possible to suppress a moving image like frame advance. Therefore, the moving image can be displayed so as not to feel uncomfortable.

  In the control pattern 9, by controlling the output of the LED 2, the amount of light entering the light receiving surface of the image sensor 5 can be reduced when the imaging unit acquires a frame, so the frame is white. Or irregular reflection light can be suppressed from appearing in the frame, and thus a good frame can be obtained.

  Note that information regarding the timing for displaying the frame may be input in advance to a storage unit (not shown), and the control unit 30 may control according to the input information by extracting this information from the storage unit. .

  Further, the control unit 30 may perform control so that the output of the LED 2 in the frame acquisition state is zero. Further, the aperture ratio of the pixel portion of the liquid crystal display panel in the frame acquisition state may be controlled to be smaller than the aperture ratio of the pixel portion in the frame display state.

  Further, the timing at which the acquired frame is displayed by the liquid crystal display panel is not particularly limited to the above-described pattern. For example, the control unit may perform control so that the acquired frame is displayed after two or more other frames acquired after the frame are acquired.

  Furthermore, in the above-described pattern, the image transfer means transfers and writes the frame a1 to the buffer between times t2 and t3, but is not limited to this. For example, the image transfer means may transfer the frame a1 to the buffer between the times t1 and t2, in which case the frame is transferred to the buffer and written, such as the time from the time t2 to t3. There is no need for time.

(Control pattern 10)
In the control pattern 10, the control unit 30 further controls the frame acquisition time by the imaging unit and the frame display time by the liquid crystal display panel, so that the frame display time is longer than the frame acquisition time. A case where the control is performed will be described.

  The control pattern 10 will be described with reference to FIG. FIG. 14 is a graph showing the relationship between time and the output of the light source, showing an example of a control pattern by the control method according to the present invention.

  In this pattern, the imaging unit acquires the frame a1 between the times t1 and t2, and the liquid crystal display panel displays the frame a1 between the times t2 and t3. Next, the imaging unit acquires the frame a2 from time t3 to t4, and the liquid crystal display panel displays the frame a2 from time t4 to t5. In this way, by repeating the acquisition and display of each frame, a moving image is acquired and displayed.

  As shown in FIG. 14, the controller 30 controls the time from time t2 to t3 to be longer than the time from time t1 to t2. Further, the time from time t4 to t5 is controlled to be longer than the time from time t3 to t4.

  In addition, the control unit 30 receives a frame acquisition signal from the liquid crystal display unit 100 between time t1 and t2 and between time t3 and t4, recognizes that it is in the frame acquisition state, and outputs the output of LED2 to w1. Control to Also, during the time t2 to t3 and between the time t4 and t5, a frame display signal is received from the liquid crystal display unit 100, the frame display state is recognized, and the output of the LED 2 is controlled to be w2. .

  As described above, the control unit 30 controls the acquisition time, the display time, and the output of the LED 2 as the frame acquisition and display are repeated.

  By controlling with such a pattern, the display time of the frame becomes longer than the acquisition time, so that the frame can be displayed with certainty, and flickering of the moving image can be reduced. Moreover, since the output of the LED 2 can be reduced when the imaging unit is acquiring a frame, the amount of light entering the light receiving surface of the imaging element 5 can be reduced, so that a good image is acquired. Can do.

  Note that the frame display time and acquisition time may be determined in advance. Further, information regarding the display time and the acquisition time of the frame may be input in advance to a storage unit (not shown), and the control unit 30 performs control according to the input information by extracting this information from the storage unit. May be.

  Further, the control unit 30 may perform control so that the output of the LED 2 in the frame acquisition state is zero. Further, the aperture ratio of the pixel portion of the liquid crystal display panel in the frame acquisition state may be controlled to be smaller than the aperture ratio of the pixel portion in the frame display state.

(Control pattern 11)
In the control pattern 11, a case will be described in which the control unit 30 further controls the image acquisition time by the imaging unit and the image display time by the liquid crystal display panel. Further, the control unit 30 in this pattern recognizes whether the surroundings are bright or dark. Then, the acquisition time of the image by the imaging unit when the surroundings are dark is controlled to be longer than the acquisition time when the surroundings are bright. Further, the display time of the image on the liquid crystal display panel when the surroundings are dark is controlled to be longer than the display time when the surroundings are bright.

  The image acquisition time by the imaging unit may be controlled, for example, by the control unit 30 transmitting a start signal for starting acquisition of an image and an end signal for ending the image acquisition to the imaging unit. Further, the display time of the image by the liquid crystal display panel may be controlled, for example, by transmitting a start signal for starting display of an image and an end signal for ending the display to the liquid crystal display panel.

  The periphery is the periphery of the liquid crystal display device, and may be, for example, around the place where the liquid crystal display device is placed. For example, the control unit 30 receives a signal indicating that the surroundings are bright or a signal indicating that the surroundings are dark from a sensor that senses ambient brightness provided in the liquid crystal display device. It may be recognized whether or not is bright or dark. Alternatively, the user using the liquid crystal display device may recognize whether the surroundings are in a bright state or a dark state.

  The control pattern 11 will be described with reference to FIG. FIG. 15 is a graph showing the relationship between time and the output of the light source, showing an example of a control pattern by the control method according to the present invention.

  As illustrated in FIG. 15, the imaging unit acquires the frame a1 during the time t1 to t2, and the liquid crystal display panel displays the frame a1 during the time t2 to t3. In addition, the imaging unit acquires the frame a2 from time t3 to t4, and the liquid crystal display panel displays the frame a2 from time t4 to t5. At this time, it is assumed that the surroundings are dark from time t1 to t3, and the surroundings are bright from time t3 to t5.

  The control unit 30 recognizes that the surroundings are dark between the times t1 and t3, and recognizes that the surroundings are bright between the times t3 and t5. As a result, the control unit 30 controls the acquisition time and display time of the frame a1 to be longer than the acquisition time and display time of the frame a2.

  In addition, the control unit 30 receives a frame acquisition signal from the liquid crystal display unit 100 between time t1 and t2 and between time t3 and t4, recognizes that it is in the frame acquisition state, and outputs the output of LED2 to w1. Control to Also, during the time t2 to t3 and between the time t4 and t5, a frame display signal is received from the liquid crystal display unit 100, the frame display state is recognized, and the output of the LED 2 is controlled to be w2. .

  In this manner, the control unit 30 controls the acquisition time, the display time, and the output of the LED 2 as the frame acquisition and display are repeated.

  As described above, the control unit 30 can reliably acquire a frame by controlling the frame acquisition time to be long when the surroundings are dark. For example, when the imaging device 5 is provided with a photodiode, it is difficult for charges to be accumulated in the photodiode when the surroundings are dark, but sufficient charge is accumulated by controlling the frame acquisition time to be long. It becomes. Further, when the surroundings are bright, external light entering the light receiving surface of the image sensor 5 can be reduced by shortening the frame acquisition time. As described above, since the frame acquisition time can be appropriately adjusted for each frame depending on whether the surroundings are bright or dark, a good frame can be acquired.

  Further, by controlling the display time of the frame longer when the surroundings are dark, the control unit 30 can display the image so that an afterimage remains in the eyes or the brain even in a dark frame. Furthermore, since the frame display time can be appropriately adjusted for each frame depending on whether the surroundings are bright or dark, the frame can be displayed well. Thereby, a moving image can be displayed so that a motion can be felt naturally.

  Furthermore, when the imaging unit acquires a frame, the output of the LED 2 is controlled to be small, so that the amount of light that enters the light receiving surface of the imaging element 5 can be reduced, so that a good frame can be acquired. .

  In this pattern, the control unit 30 controls both the frame acquisition time by the imaging unit and the frame display time by the liquid crystal display panel. However, in the present invention, only the image acquisition time or the image display time is controlled. Only the time may be controlled.

  Further, the control unit 30 may perform control so that the output of the LED 2 in the frame acquisition state is zero. Further, the aperture ratio of the pixel portion of the liquid crystal display panel in the frame acquisition state may be controlled to be smaller than the aperture ratio of the pixel portion in the frame display state.

(Control pattern 12)
In the control pattern 12, the control unit 30 further recognizes whether the illuminance of light to the subject is low or high, and is in the frame acquisition state and the illuminance of light to the subject is low. The case where the output of the LED 2 is controlled to be smaller than the output of the LED 2 when the illuminance of light to the subject is high in the frame acquisition state will be described.

  The control unit 30 is, for example, a signal indicating that the illuminance of light on the subject is low or a high state from a sensor that is provided in the liquid crystal display device and detects the illuminance of light on the subject. It may be recognized whether the illuminance of light to the subject is low or high by receiving a signal indicating the above. In addition, the liquid crystal display device is provided with an input unit for inputting whether the illuminance of light to the subject is low or high, and the input unit determines whether the illuminance of light from the user is low or high. It may be recognized by receiving an input, generating a signal indicating that the illuminance of light on the subject is low or a signal indicating that the illuminance is high, and receiving the signal by the control unit 30.

  The control pattern 12 will be described with reference to FIG. FIG. 16 is a graph showing the relationship between time and the output of the light source, showing an example of the control pattern by the control method according to the present invention.

  As illustrated in FIG. 16, the imaging unit acquires a frame a1 between times t1 and t2, acquires a frame a2 between times t3 and t4, and further acquires a frame a3 between times t5 and t6. To do. At this time, the illuminance of the light to the subject is about 100 lux between the times t1 and t2, about 5 lux between the times t3 and t4, and the subject is between the times t5 and t6. Assume that the illuminance of light on the subject is very high when irradiated with sunlight.

  The controller 30 recognizes that it is in the frame acquisition state and that the illuminance of the light to the subject is high during the time t1 to t2, and controls the output of the LED 2 to be w1. Between time t3 and t4, it is recognized that the frame is being acquired and that the illuminance of light on the subject is low, and control is performed so that the output of LED 2 is set to zero. Also, during the period from time t5 to t6, it is recognized that the frame is being acquired and that the illuminance of light on the subject is very high, and the output of the LED 2 is controlled to be w2. Further, during the period from time t2 to t3, from t4 to t5, and from t6 to t7, it is recognized that the frame is being displayed, and the output of LED2 is controlled to be w2.

  In this way, the control unit 30 controls the output of the LED 2 as the frame acquisition and display are repeated.

  Here, when the illuminance of the light to the subject is low, the sensitivity of the image sensor 5 may be increased in order to capture the subject reliably. In this case, in particular, it is derived from the LED 2 that enters the light receiving surface of the image sensor 5. The influence of light is great. On the other hand, when the illuminance of the light to the subject is high, the sensitivity of the image pickup device 5 may be lowered in order to reliably pick up the subject. In this case, it is derived from the LED 2 that enters the light receiving surface of the image pickup device 5. The effect of light is small. In particular, when the subject is irradiated with strong light such as sunlight, the influence of the LED 2 becomes smaller.

  In this pattern, by controlling as described above, the output of the LED 2 can be reduced when the imaging unit acquires a frame and the illuminance of light on the subject is low. Even when the sensitivity of the element 5 is high, the amount of light derived from the LED 2 entering the light receiving surface of the imaging element 5 can be reduced. Thus, by controlling the output of the LED 2 in accordance with the illuminance of light to the subject, the amount of light entering the light receiving surface of the image sensor 5 can be adjusted appropriately. Therefore, a good frame can be acquired.

(Control pattern 13)
In the control pattern 13, the control unit 30 recognizes whether the external light applied to the pixel unit of the liquid crystal display panel is in a bright state or a dark state. A description will be given of a case where the aperture ratio of the pixel portion when the light is bright is controlled to be smaller than the aperture ratio when the external light applied to the pixel portion is dark in the frame acquisition state.

  For example, the control unit 30 is in a state where the external light applied to the pixel unit is bright from a sensor provided in the liquid crystal display device that senses the intensity of external light applied to the pixel unit of the liquid crystal display panel. By receiving a signal indicating this or a signal indicating a dark state, it may be recognized whether the external light applied to the pixel portion is bright or dark. In addition, the liquid crystal display device is provided with an input unit for inputting whether the external light applied to the pixel unit is bright or low, and whether the input unit receives a bright external light applied to the pixel unit from the user. By receiving an input indicating whether it is in a dark state, generating a signal indicating that the external light applied to the pixel unit is in a bright state or a signal indicating that it is in a dark state, and the control unit 30 receives the signal You may recognize it.

  The control pattern 13 will be described with reference to FIG. FIG. 17 is a graph showing the relationship between time and the output of the light source, showing an example of the control pattern by the control method according to the present invention.

  As illustrated in FIG. 17, the imaging unit acquires a frame a1 between times t1 and t2, acquires a frame a2 between times t3 and t4, and further acquires a frame a3 between times t5 and t6. To do. At this time, the external light applied to the pixel portion is about 100 lux between times t1 and t2, about 5 lux between times t3 and t4, and between times t5 and t6. It is assumed that the pixel portion is irradiated with sunlight, and external light irradiated on the pixel portion is in a very bright state.

  The controller 30 recognizes that it is in the frame acquisition state and that the external light applied to the pixel unit is bright between time t1 and t2, and sets the aperture ratio of the pixel unit to f1. Control. During time t3 to t4, it is recognized that the frame is being acquired and that the external light applied to the pixel portion is in a dark state, and the aperture ratio is controlled to be f2. In addition, during the period from time t5 to t6, it is recognized that the frame is being acquired and that the external light applied to the pixel portion is very bright, and the aperture ratio is controlled to be zero. Further, during the period from time t2 to t3, from t4 to t5, and from t6 to t7, it is recognized that the frame is being displayed, and the aperture ratio is controlled to be f2.

  In this manner, the control unit 30 controls the aperture ratio of the pixel unit as the frame acquisition and display are repeated.

  In this pattern, by controlling as described above, the aperture ratio of the pixel unit can be reduced if the external light irradiated to the pixel unit is bright when the imaging unit acquires a frame. Therefore, the amount of external light that enters the light receiving surface of the image sensor 5 can be reduced. In addition, when the external light applied to the pixel portion is dark, the influence of the external light on the image sensor 5 is small, so the aperture ratio of the pixel portion may be large. As described above, when the imaging unit acquires a frame, the aperture ratio of the pixel unit is controlled according to the brightness of the external light applied to the pixel unit, thereby entering the light receiving surface of the imaging element 5. The amount of light can be adjusted appropriately. Therefore, a good frame can be acquired.

(Control pattern 14)
In the control pattern 14, the control unit 30 further controls the number of times that the frame acquired by the imaging unit is displayed on the liquid crystal display panel, and controls so that the acquired image is displayed twice or more. Will be described.

  The control pattern 14 will be described with reference to FIG. FIG. 18 is a graph showing an example of a control pattern by the control method according to the present invention and showing a relationship between time and the output of the light source.

  As illustrated in FIG. 18, the imaging unit acquires a frame a1 between times t1 and t2.

  The control unit 30 controls the frame a1 to be displayed on the liquid crystal display panel from time t2 to t3, from t4 to t5, and from t6 to t7. As described above, the control unit 30 performs control so that the acquired frame is displayed twice or more.

  In addition, the control unit 30 receives a frame acquisition signal from the liquid crystal display unit 100 between times t1 and t2, recognizes that it is in the frame acquisition state, and controls the output of the LED 2 to be w1. In addition, during the period from time t2 to t3, from t4 to t5, and from t6 to t7, the frame display signal is received from the liquid crystal display unit 100, the frame display state is recognized, and the output of LED2 is set to w2. Control to do.

  Note that the control unit 30 may display the acquired frame twice or more, and may adjust the number of times of display based on the data capacity of the frame, for example. Further, a predetermined number of times is input, and display may be performed according to this number of times.

  By controlling as described above, the acquired frame is displayed a plurality of times, so that even if the frame has a large data capacity and it takes time to transfer from the imaging unit to the liquid crystal display panel, the time that is not displayed is reduced. Can be eliminated. In addition, since the frame is displayed without waiting for the frame transfer time, the flickering of the moving image can be suppressed.

  Here, the conventional control method is demonstrated with reference to FIGS. 19-22, and is compared with the control method which concerns on this invention.

  First, a conventional control method when acquiring and displaying a still image will be described.

  FIG. 19 is a graph showing the relationship between time and light source output in a conventional control method.

  In the conventional control method, as shown in FIG. 19, when the imaging unit acquires an image between time t1 and t2 (hereinafter, also referred to as “image acquisition”), the liquid crystal display panel after time t2. When this image is displayed (hereinafter also referred to as “image display”), the output of the light source is set to w2.

  As described above, conventionally, since the output of the light source is not changed between when the image is acquired and when the image is displayed, intense light necessary for displaying the image by the light source is emitted to the liquid crystal display panel even when the image is acquired. Therefore, the possibility that this light enters the light receiving surface of the image sensor is very high.

  FIG. 20 is a graph showing the relationship between time and the aperture ratio in the conventional control method.

  In the conventional control method, as shown in FIG. 20, both when the imaging unit acquires an image between time t1 and t2, and when the liquid crystal display panel displays this image after time t2, The aperture ratio is f2.

  As described above, conventionally, since the aperture ratio of the pixel portion is not changed between image acquisition and image display, the amount of external light applied to the pixel portion in the liquid crystal display panel is determined during image acquisition and image display. It does not change. Therefore, there is a high possibility that external light will enter the light receiving surface of the image sensor during image acquisition.

  Therefore, when the above-described conventional control method is used, the image captured by the imaging unit becomes white, or irregularly reflected light due to minute dust, oil film, etc. attached to the liquid crystal display panel is reflected in the image. A good image cannot be obtained.

  On the other hand, the control method according to the present invention controls the output of the light source in the image acquisition state to be smaller than the output of the light source in the image display state. The amount of light entering the light receiving surface of the image sensor when acquiring the image can be reduced, and a good image can be acquired.

  Further, since the present invention controls the aperture ratio of the pixel portion in the image acquisition state to be smaller than the aperture ratio in the image display state, the pixel of the liquid crystal display panel can be used when the imaging unit acquires an image. The amount of external light irradiated to the part can be reduced. Therefore, compared to the conventional method, the amount of external light that enters the light receiving surface of the image sensor when the image capturing unit acquires an image can be reduced, and a better image can be acquired.

  Next, a conventional control method when acquiring and displaying a moving image will be described.

  FIG. 21 is a graph showing the relationship between time and light source output in a conventional control method.

  In the conventional control method, as shown in FIG. 21, the frame acquired by the imaging unit between time t1 and t2 is displayed on the liquid crystal display panel between time t2 and t3, and imaged between time t2 and t3. The liquid crystal display panel displays the frame acquired by the section from time t3 to t4, and the liquid crystal display panel displays the frame acquired by the imaging section from time t3 to t4. Thus, when repeating frame acquisition and display, the output of the light source is always set to w2.

  As described above, conventionally, the imaging unit acquires a frame (hereinafter also referred to as “frame acquisition”) and the liquid crystal display panel displays a frame (hereinafter also referred to as “frame display”). ) And the output of the light source is not changed, so that the intense light from the light source necessary for the LCD panel to display the frame is emitted to the LCD panel when the imaging unit acquires the frame. Light enters the light receiving surface of the image sensor.

  FIG. 22 is a graph showing the relationship between time and the aperture ratio in the conventional control method.

  In the conventional control method, as in the conventional control method shown in FIG. 21, when the frame acquisition and display are repeated, the aperture ratio of the pixel portion is always set to f2, as shown in FIG.

  As described above, conventionally, since the aperture ratio of the pixel portion is always constant during frame acquisition and frame display, external light applied to the liquid crystal display panel is also incident on the light receiving surface of the image sensor even during frame acquisition. Get in.

  Therefore, when the conventional control method shown in FIGS. 21 and 22 is used, the frame imaged by the imaging unit becomes white, or irregularly reflected light due to minute dust, oil film, etc. adhering to the liquid crystal display panel appears on the frame. As a result, a good frame cannot be obtained. Therefore, the moving image cannot be displayed favorably.

  On the other hand, the control method according to the present invention controls the output of the light source in the frame acquisition state to be smaller than the output of the light source in the frame display state. The amount of light entering the light receiving surface of the image sensor when acquiring the image can be reduced, and a good frame can be acquired. Therefore, if the present invention is used, a moving image can be displayed favorably.

  Further, according to the present invention, the aperture ratio of the pixel portion in the frame acquisition state is controlled to be smaller than the aperture ratio of the pixel portion in the frame display state, so that the imaging unit acquires the frame as compared with the conventional method. In this case, the amount of external light entering the light receiving surface of the image sensor can be reduced, and a better frame can be obtained. Therefore, if the present invention is used, a moving image can be displayed better.

  In the liquid crystal display device according to the present invention, the imaging unit and the liquid crystal display panel can be integrated, thereby obtaining the merit of manufacturing cost reduction. In addition, in order to perform the control as described above, when the imaging unit acquires an image, it is possible to reduce the influence of the light source that goes from the transparent substrate of the liquid crystal display panel to the imaging device, and to suppress the captured image from being whitish can do. Further, when the imaging unit acquires an image, it is possible to suppress the light source from being irregularly reflected by a minute dust or the like attached to the liquid crystal display panel and entering the imaging element. Therefore, since fine dust or the like does not appear in the image, a high quality image can be acquired. In addition, since it is not necessary to increase the level of managing dust in the manufacturing process, an enormous cost for measures relating to dust prevention is not generated, and the above-described merit of manufacturing cost reduction can be utilized as it is.

  In the present embodiment, one control unit 30 includes an output control unit, an aperture ratio control unit, a timing control unit, and an image acquisition display time control that are included in a liquid crystal display device that is a control target of the control method according to the present invention. Although the description has been given of the case where the device acts as the image acquisition time control means, the image display time control means, and the image display frequency control means, the output control means, the aperture ratio control means, the timing control means, the image acquisition display time control means, the image acquisition The time control means, the image display time control means, and the image display frequency control means may each be configured by separate control units.

[Second Embodiment]
Another embodiment of the liquid crystal display device according to the present invention will be described below with reference to FIG. FIG. 4 is a side view of the liquid crystal display unit in the liquid crystal display device according to the second embodiment.

  The liquid crystal display device according to the present embodiment is the liquid crystal display device according to the first embodiment only in that the liquid crystal display unit 100 does not have the LED 2 and the light guide plate 4 and has a planar light source (light source) 8. The other points are similarly configured. Therefore, here, only the points different from the first embodiment will be described, and the same constituent members will be denoted by the same member numbers, and the description thereof will be omitted.

  In the present embodiment, a planar light source 8 is provided on the surface 12 of the transparent substrate 1, and the planar light source 8 functions as a backlight of a liquid crystal display panel. The light emitted from the planar light source 8 is irradiated almost uniformly on the entire surface of the liquid crystal display panel.

  The area where the light from the planar light source 8 is emitted is below the light emission area interface 23 indicated by a broken line in FIG.

  As indicated by the light emitting region interface 23, the light from the planar light source 8 travels while spreading, and therefore enters the transparent substrate 1 between the imaging element 5 and the lens 3 in the imaging unit. May get into the surface. In particular, when used under sunlight, the transparent substrate 1 is irradiated with strong external light, and this external light may enter the light receiving surface of the image sensor 5.

  In the present embodiment, the control unit 30 (not shown) controls the liquid crystal display unit 100 as in the first embodiment.

  The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope shown in the claims, and the embodiments can be obtained by appropriately combining technical means disclosed in different embodiments. The form is also included in the technical scope of the present invention.

  The present invention can provide a control method capable of acquiring a good image in a liquid crystal display device in which an imaging unit and a liquid crystal display panel are integrated, and is therefore suitable for manufacturing a liquid crystal display device having an imaging function. Available.

1 Transparent substrate 2 LED (light source)
3 Lens 5 Image Sensor 6 Transparent Substrate 7 Liquid Crystal 8 Planar Light Source (Light Source)
30 control unit (output control means, aperture ratio control means, timing control means, image acquisition display time control means, image acquisition time control means, image display time control means, image display frequency control means)
100 LCD unit

Claims (14)

An imaging unit for acquiring an image;
A liquid crystal display panel for displaying the image;
A light source for irradiating the liquid crystal display panel with light;
Output control means for controlling the output of the light source,
The imaging unit includes at least an imaging element and a lens,
The liquid crystal display panel includes a pair of transparent substrates sandwiched with liquid crystal,
In the control method of the liquid crystal display device in which the imaging element and the lens are arranged with at least one of the pair of transparent substrates interposed therebetween,
The output control means recognizes whether the imaging unit is in an image acquisition state in which an image is acquired, and recognizes whether the liquid crystal display panel is in an image display state in which an image is displayed. Controlling the output of the light source in the acquisition state to be smaller than the output in the image display state ;
The liquid crystal display device includes an aperture ratio control means for controlling an aperture ratio of a pixel portion of the liquid crystal display panel,
The liquid crystal display device control method, wherein the aperture ratio control means controls the aperture ratio in the image acquisition state to be smaller than the aperture ratio in the image display state .   The control method according to claim 1, wherein the output control unit controls the output to 0 in the image acquisition state. 2. The control method according to claim 1, wherein the aperture ratio control means controls the aperture ratio to 0% in the image acquisition state. An imaging unit for acquiring an image;
A liquid crystal display panel for displaying the image;
A light source for irradiating the liquid crystal display panel with light;
Output control means for controlling the output of the light source,
The imaging unit includes at least an imaging element and a lens,
The liquid crystal display panel includes a pair of transparent substrates sandwiched with liquid crystal,
The imaging device and the lens are control methods for obtaining a moving image composed of a plurality of images in a liquid crystal display device arranged with at least one of the pair of transparent substrates interposed therebetween,
The output control means recognizes whether or not the imaging unit is acquiring a moving image constituting image in which each image constituting the moving image is acquired, and a moving image configuration in which the liquid crystal display panel displays the respective image Recognizing whether or not the image display state, and controlling the output of the light source in the moving image constituent image acquisition state to be smaller than the output in the moving image constituent image display state, The liquid crystal display device includes an aperture ratio control means for controlling an aperture ratio of a pixel portion of the liquid crystal display panel,
A method for controlling a liquid crystal display device, wherein the aperture ratio control means controls the aperture ratio in the moving image constituent image acquisition state to be smaller than the aperture ratio in the moving image constituent image display state. The control method according to claim 4, wherein the output control unit controls the output to 0 when the moving image composing image is acquired. The control method according to claim 4, wherein the aperture ratio control unit controls the aperture ratio to 0% when the moving image composing image is acquired. An imaging unit for acquiring an image;
A liquid crystal display panel for displaying the image;
A light source for irradiating the liquid crystal display panel with light;
Output control means for controlling the output of the light source,
The imaging unit includes at least an imaging element and a lens,
The liquid crystal display panel includes a pair of transparent substrates sandwiched with liquid crystal,
The imaging device and the lens are control methods for obtaining a moving image composed of a plurality of images in a liquid crystal display device arranged with at least one of the pair of transparent substrates interposed therebetween,
The output control means recognizes whether or not the imaging unit is acquiring a moving image constituting image in which each image constituting the moving image is acquired, and a moving image configuration in which the liquid crystal display panel displays the respective image Recognizing whether or not the image display state, and controlling the output of the light source in the moving image constituent image acquisition state to be smaller than the output in the moving image constituent image display state,
The liquid crystal display device includes timing control means for controlling the timing at which the liquid crystal display panel displays an image acquired by the imaging unit,
The timing control means performs control so that the acquired image is displayed after at least one other image acquired after the image is acquired. The liquid crystal display device includes image acquisition display time control means for controlling an image acquisition time by the imaging unit and an image display time by the liquid crystal display panel,
The control method according to claim 4, wherein the image acquisition display time control unit controls the display time longer than the acquisition time. The liquid crystal display device controls image acquisition time by the imaging unit, and includes image acquisition time control means for recognizing whether the surrounding is bright or dark,
The image acquisition time control means controls the acquisition time when the surroundings are in a dark state longer than the acquisition time when the surroundings are in a bright state. The control method described. The liquid crystal display device controls image display time by the liquid crystal display panel, and includes image display time control means for recognizing whether the surrounding is bright or dark,
8. The image display time control unit according to claim 4, wherein the display time when the surrounding is dark is controlled to be longer than the display time when the surrounding is bright. The control method described. An imaging unit for acquiring an image;
A liquid crystal display panel for displaying the image;
A light source for irradiating the liquid crystal display panel with light;
Output control means for controlling the output of the light source,
The imaging unit includes at least an imaging element and a lens,
The liquid crystal display panel includes a pair of transparent substrates sandwiched with liquid crystal,
The imaging device and the lens are control methods for obtaining a moving image composed of a plurality of images in a liquid crystal display device arranged with at least one of the pair of transparent substrates interposed therebetween,
The output control means recognizes whether or not the imaging unit is acquiring a moving image constituting image in which each image constituting the moving image is acquired, and a moving image configuration in which the liquid crystal display panel displays the respective image Recognizing whether or not the image display state, and controlling the output of the light source in the moving image constituent image acquisition state to be smaller than the output in the moving image constituent image display state,
The output control means recognizes whether the illuminance of light on the subject is low or high,
The output when the moving image constituent image is acquired and the illuminance of light to the subject is low. The output when the moving image constituent image is acquired and the illuminance of light to the subject is high. A control method characterized by performing control smaller. The aperture ratio control means recognizes whether the external light applied to the pixel portion is in a bright state or a dark state;
The aperture ratio when the moving image composing image acquisition state and the external light applied to the pixel unit is bright is the aperture ratio when the external light applied to the pixel unit is the moving image composing image acquisition state. The control method according to claim 4, wherein the control is performed to be smaller than the aperture ratio in a dark state. The liquid crystal display device includes image display frequency control means for controlling the number of times that the liquid crystal display panel displays an image acquired by the imaging unit,
The control method according to any one of claims 4 to 12, wherein the image display frequency control means performs control so that the acquired image is displayed twice or more. An imaging unit for acquiring an image;
A liquid crystal display panel for displaying the image;
A light source for irradiating the liquid crystal display panel with light;
Output control means for controlling the output of the light source,
The imaging unit includes at least an imaging element and a lens,
The liquid crystal display panel includes a pair of transparent substrates sandwiched with liquid crystal,
The imaging element and the lens are liquid crystal display devices arranged with at least one of the pair of transparent substrates interposed therebetween,
Recognizing whether or not the output control means is in an image acquisition state representing a state in which an image is being acquired by the imaging unit, and recognizing whether or not it is in an image display state representing a state in which an image is being displayed on the liquid crystal display panel The output of the light source in the image acquisition state is controlled to be smaller than the output in the image display state,
Comprising an aperture ratio control means for controlling the aperture ratio of the pixel portion of the liquid crystal display panel;
The liquid crystal display device, wherein the aperture ratio control means controls the aperture ratio in the image acquisition state to be smaller than the aperture ratio in the image display state.

Images