JP6794092B2 - Display device - Google Patents

Description

The present invention relates to a display device and the like.

The usage patterns of projectors have been diversified in recent years, and one of the projection methods of projectors is multi-projection using a plurality of projectors. Multi-projection is a projection method for forming one projected image (composite projected image) by joining a plurality of projected images of a plurality of projectors.

In multi-projection, it is necessary to adjust the projection area (display area) of each projection image in order to make the joint between the plurality of projection images difficult to see. For example, it is necessary to adjust the projection position (display position) of each projected image, the shape of each projected image, and the like. Generally, the user adjusts the projection area by operating the projector using a remote controller or the like. However, it is very difficult to adjust the projection area.

As a technique for simplifying the adjustment of the projection area, for example, there is a technique disclosed in Patent Document 1. In the technique disclosed in Patent Document 1, a projected image in which a marker that assists in adjusting the projection area is arranged is projected. According to the technique disclosed in Patent Document 1, the projected area may be adjusted so that the marker placed on the projected image overlaps the marker placed on the other projected image, so that the user can easily adjust the projected area. be able to.

Here, there is a brightness reduction process as an image process for making the joint between a plurality of projected images less visible. The brightness reduction process is an image process on the premise that a plurality of projected images are arranged so that a part of the projected image overlaps a part of another projected image. When a plurality of projected images are arranged by such an arrangement method, an image brighter than the non-blended area is displayed in the blended area, and the composite brightness (projected brightness (display brightness) of the composite projected image) is displayed between the blended area and the non-blended area. )) Steps occur. The blended region is a region of the projected image that overlaps the other projected image, and the non-blended region is a region of the projected image that does not overlap the other projected image. The display brightness of the blend region is increased because a plurality of projected images are superimposed. The brightness reduction process is an image process that reduces the brightness of the blend region so that the step is reduced.

However, if the image data in which the marker is arranged in the blend region is subjected to the brightness reduction processing, the visibility of the marker is lowered and it becomes difficult to adjust the projection region.

Japanese Unexamined Patent Publication No. 2011-29727

An object of the present invention is to provide a technique capable of suppressing a decrease in visibility of a marker due to a luminance reduction process.

The display device according to the present invention is
A display device that projects the first projected image.
Acquisition method for acquiring image data and
The image data acquired by the acquisition means is subjected to a brightness reduction process for reducing the brightness of the blend region, which is an region overlapping the second projected image projected by another display device in the region of the first projected image, and projected. Processing means to generate image data for
A projection means for projecting the first projected image based on the projection image data, and
Have,
The processing means
Prior to the luminance reduction process, it is possible to combine the marker data, which is a graphic image showing the blend region, with the image data acquired by the acquisition means.
When synthesis of the data before KOR manufacturers in the image data acquired by the acquisition unit, smaller compared with the case where the data of the markers did not synthesize the acquired image data by the acquisition unit The value is set to the amount of reduction of the brightness of the region in which the marker is synthesized in the blend region by the brightness reduction processing.

According to the present invention, it is possible to suppress a decrease in the visibility of the marker due to the luminance reduction process.

The figure which shows an example of the whole structure of the liquid crystal projector which concerns on this embodiment. A flow chart showing an example of the basic operation of the liquid crystal projector according to the present embodiment. The figure which shows an example of the internal structure of the image processing part which concerns on this embodiment. The figure which shows an example of the multi-projection which concerns on this embodiment A flow chart showing an example of the operation of the liquid crystal projector according to the present embodiment. The figure explaining an example of the normal parameter which concerns on this Embodiment The figure explaining an example of the edge blend processing which concerns on this Embodiment Flow chart showing an example of edge blending processing according to this embodiment The figure explaining an example of the adjustment parameter which concerns on this Embodiment The figure explaining an example of the adjustment parameter which concerns on this Embodiment The figure explaining an example of the adjustment parameter which concerns on this Embodiment Diagram showing an example of multi-projection The figure which shows an example of the projection image after edge blend processing The figure which shows an example of the composite projection image after edge blend processing The figure which shows an example of the projection image in which the auxiliary marker is arranged The figure which shows an example of the problem to be solved by this Embodiment The figure which shows an example of the problem to be solved by this Embodiment

Hereinafter, the display device and the control method thereof according to the embodiment of the present invention will be described with reference to the drawings. The configuration and processing described below are merely examples, and are not intended to limit the scope of the present invention.

The display device according to the present embodiment is a projection type display device that projects a projected image based on image data onto a projection object (wall, screen sheet, screen board, etc.). Hereinafter, an example will be described in which the display device according to the present embodiment is a transmissive liquid crystal projector (a projector using a transmissive liquid crystal panel as a display device). However, the display device according to this embodiment is not limited to the transmissive liquid crystal projector. The present invention can also be applied to a projector using a display device such as DLP or LCOS (reflective liquid crystal panel). Further, the present invention can be applied to both a single-plate type liquid crystal projector and a three-plate type liquid crystal projector. The image data may be still image data representing one image, or moving image data representing a plurality of images corresponding to a plurality of frames.

<Overall configuration>
First, the overall configuration of the liquid crystal projector according to the present embodiment will be described with reference to FIG. FIG. 1 is a diagram showing an example of the overall configuration of the liquid crystal projector 100 according to the present embodiment. As shown in FIG. 1, the liquid crystal projector 100 includes a CPU 110, a ROM 111, a RAM 112, an operation unit 113, an image input unit 130, and an image processing unit 140. Further, the liquid crystal projector 100 further includes a liquid crystal control unit 150, a liquid crystal panel 151R, 151G, 151B, a light source control unit 160, a light source 161, a color separation unit 162, a color synthesis unit 163, an optical system control unit 170, and projection optics. It has a system 171. Further, the liquid crystal projector 100 further includes a recording / reproducing unit 191, a recording medium 192, a communication unit 193, a photographing unit 194, a display control unit 195, and a display unit 196. In the following, the projected image projected by the liquid crystal projector 100 will be referred to as a “first projected image”, and the projected image projected by a display device other than the liquid crystal projector 100 will be referred to as a “second projected image”.

The liquid crystal projector 100 does not have to have a part of the above-mentioned functional unit. For example, the liquid crystal projector 100 may not have at least one of the recording / reproducing unit 191 and the recording medium 192, the communication unit 193, the photographing unit 194, the display control unit 195, and the display unit 196.

The CPU 110 controls each functional unit of the liquid crystal projector 100. The CPU 110 receives, for example, a control signal transmitted from the operation unit 113 or the communication unit 193, and controls each functional unit according to the received control signal. The ROM 111 stores a control program that describes the processing procedure of the CUP 110. The RAM 112 temporarily stores a control program and data as a work memory.

The operation unit 113 receives a user operation on the liquid crystal projector 100 and transmits a control signal corresponding to the performed user operation to the CPU 110. As the operation unit 113, for example, a switch, a dial, a touch panel provided on the display unit 196, or the like can be used. Further, as the operation unit 113, a signal receiving unit (infrared receiving unit or the like) that receives a signal from the remote controller and transmits a control signal corresponding to the received signal to the CPU 110 can also be used.

The image input unit 130 acquires image data from an external device and outputs the acquired image data to the image processing unit 140. When the image input unit 130 receives an analog signal as image data from an external device, the image input unit 130 converts the received analog signal into a digital signal and transmits the obtained digital signal to the image processing unit 140. As the image input unit 130, for example, a composite terminal, an S terminal, a D terminal, a component terminal, an analog RGB terminal, a DVI-I terminal, a DVI-D terminal, an HDMI (registered trademark) terminal, and the like can be used. The external device that outputs the image data to the image input unit 130 may be any device that can output the image data. As an external device that outputs image data to the image input unit 130, for example, a personal computer, a camera, a mobile phone, a smartphone, a hard disk recorder, a game machine, or the like can be used.

The image processing unit 140 generates projection image data (display image data) by performing predetermined image processing on the image data input to the image processing unit 140. Then, the image processing unit 140 outputs the generated image data for projection to the liquid crystal control unit 150. The predetermined image processing includes edge blending processing. The edge blending process is a luminance reducing process (dimming process) that reduces the luminance of the blended region. The blend region is a region of the first projected image that overlaps the second projected image. As the image processing unit 140, for example, a microprocessor for image processing can be used.

In addition, as a predetermined image processing, a plurality of image processing including a luminance reduction processing may be performed.
For example, the predetermined image processing may include at least one of a frame thinning process, a frame interpolation process, a resolution conversion process, and a distortion correction process. The distortion correction process is an image process that corrects image distortion, and is, for example, a keystone correction process that corrects trapezoidal distortion.

The image processing unit 140 does not have to be a dedicated microprocessor. For example, the function of the image processing unit 140 may be realized by the CPU 110 executing the processing according to the program stored in the ROM 111.

The light source control unit 160 controls on / off (lighting / extinguishing) of the light source 161 and controls the amount of light emitted from the light source. As the light source control unit 160, for example, a microprocessor for control can be used. The light source control unit 160 does not need to be a dedicated microprocessor. For example, the function of the light source control unit 160 may be realized by the CPU 110 executing the process according to the program stored in the ROM 111. As the light source 161, for example, a halogen lamp, a xenon lamp, a high-pressure mercury lamp, an LED, or the like can be used.

The color separation unit 162 separates the light emitted from the light source 161 into red light (R light), green light (G light), and blue light (B light). As the color separation unit 162, for example, a dichroic mirror, a prism, or the like can be used. When three light sources, an R light source that emits R light, a G light source that emits G light, and a B light source that emits B light, are used as the light source 161, the color separation unit 162 is unnecessary.

The liquid crystal panel 151R is a liquid crystal panel corresponding to red color, and has a plurality of liquid crystal elements. Of the three colors of light emitted from the color separation unit 162, the R light passes through a plurality of liquid crystal elements included in the liquid crystal panel 151R. The liquid crystal panel 151G is a liquid crystal panel corresponding to green, and has a plurality of liquid crystal elements. Of the three colors of light emitted from the color separation unit 162, G light passes through a plurality of liquid crystal elements included in the liquid crystal panel 151G. The liquid crystal panel 151B is a liquid crystal panel corresponding to blue color, and has a plurality of liquid crystal elements. Of the three colors of light emitted from the color separation unit 162, the B light passes through a plurality of liquid crystal elements included in the liquid crystal panel 151B.

The liquid crystal control unit 150 controls the transmittance of each liquid crystal element of the liquid crystal panels 151R, 151G, 151B based on the projection image data output from the image processing unit 140. The transmittance of the liquid crystal element can be controlled, for example, by controlling the voltage applied to the liquid crystal element, the current supplied to the liquid crystal element, or both of them. When the image data input to the image processing unit 140 is moving image data, the image processing unit generates projection image data for each frame. Then, the liquid crystal control unit 150 controls the transmittance of each liquid crystal element for each frame based on the projection image data of the frame. As the liquid crystal control unit 150, for example, a microprocessor for control can be used. The liquid crystal control unit 150 does not need to be a dedicated microprocessor. For example, the function of the liquid crystal control unit 150 may be realized by the CPU 110 executing the processing according to the program stored in the ROM 111.

The color synthesizing unit 163 synthesizes light transmitted through the liquid crystal panel 151R (transmitted R light), light transmitted through the liquid crystal panel 151G (transmitted G light), and light transmitted through the liquid crystal panel 151B (transmitted B light). As the color synthesizing unit 163, for example, a dichroic mirror, a prism, or the like can be used.

Further, the projection optical system 171 includes light (transmitted R light, transmitted G light, transmitted light) emitted from the color synthesis unit 163.
And, the light obtained by synthesizing the transmitted B light; the synthesized light) is projected onto the screen sheet. As described above, the transmittance of the liquid crystal panels 151R, 151G, 151B is controlled based on the projection image data. Therefore, by projecting the composite light, an image based on the projection image data is projected (displayed). The projection optical system 171 includes, for example, a plurality of lenses and an actuator for driving each lens. By changing the position and orientation of each lens, it is possible to enlarge, reduce, adjust the focus, etc. of the first projected image formed on the screen sheet.

The optical system control unit 170 controls the projection optical system 171. Specifically, the projection optical system 171 controls the position and orientation of each lens of the projection optical system 171 by issuing an instruction to the actuator of the projection optical system 171. For example, the optical system control unit 170 controls the projection optical system 171 in response to a user operation on the liquid crystal projector 100. As the optical system control unit 170, for example, a microprocessor for control can be used. The optical system control unit 170 does not have to be a dedicated microprocessor. For example, the function of the optical system control unit 170 may be realized by the CPU 110 executing the processing according to the program stored in the ROM 111.

The photographing unit 194 photographs the periphery of the liquid crystal projector 100. For example, the photographing unit 194 photographs the screen sheet side. Specifically, the photographing unit 194 photographs a projected image (first projected image, second projected image, or both of them) formed on the screen sheet. Then, the photographing unit 194 outputs the image data obtained by the photographing to the recording / reproducing unit 191. The photographing unit 194 includes, for example, a lens, an actuator, a microprocessor, an image sensor, and an AD conversion unit. The lens captures the optical image of the subject, the actuator drives the lens, and the microprocessor controls the actuator. The image sensor converts the optical image acquired through the lens into an image signal (analog signal), and the AD conversion unit converts the image signal obtained by the image sensor into a digital signal. The shooting direction of the shooting unit 194 is not limited to the screen direction (direction from the liquid crystal projector 100 toward the screen sheet). For example, the photographing direction of the photographing unit 194 may be the opposite direction to the screen direction. The photographing unit 194 may photograph the side of the viewer who sees the projected image.

The recording medium 192 can store various data. For example, the recording medium 192 can store image data, control data required for the liquid crystal projector 100, and the like. As the recording medium 192, for example, a magnetic disk, an optical disk, a semiconductor memory, or the like can be used. The recording medium 192 may be a recording medium built in the liquid crystal projector 100, or may be a recording medium that can be attached to and detached from the liquid crystal projector 100.

The communication unit 193 acquires (receives) various data from an external device. For example, the communication unit 193 acquires image data, control data required for the liquid crystal projector 100, and the like from an external device. The communication unit 193 outputs the acquired image data to the image processing unit 140 and the recording / playback unit 191. As the communication method of the communication unit 193, for example, wireless LAN, wired LAN, USB, Bluetooth (registered trademark), or the like can be used. An HDMI terminal may be used as the communication unit 193. In that case, the communication unit 193 performs CEC communication via the HDMI terminal. The external device that communicates with the communication unit 193 may be any device that can communicate with the communication unit 193. For communicating with the communication unit 193, for example, a personal computer, a camera, a mobile phone, a smartphone, a hard disk recorder, a game machine, or the like can be used.

The recording / playback unit 191 records the captured image data output from the photographing unit 194, the image data acquired by the communication unit 193, the image data acquired by the image input unit 130, and the like on the recording medium 192. Further, the recording / reproducing unit 191 can also acquire image data from the recording medium 192 and output the acquired image data to the image processing unit 140 (reproduction processing). Recording / playback unit 19
Reference numeral 1 denotes, for example, an interface electrically connected to the recording medium 192 and a microprocessor for communicating with the recording medium 192. The microprocessor included in the recording / playback unit 191 does not have to be a dedicated microprocessor. For example, the function of the microprocessor possessed by the recording / reproducing unit 191 may be realized by the CPU 110 executing the processing according to the program stored in the ROM 111.

The display unit 196 displays an operation screen that assists the user operation on the liquid crystal projector 100. The operation screen is, for example, an image in which a switch icon is arranged. The display unit 196 may have any structure as long as it can display an image. As the display unit 196, for example, a liquid crystal display panel, a CRT display panel, an organic EL display panel, an LED display panel, a plasma display panel, or the like can be used. A light emitting unit (for example, an LED) corresponding to each physical button may be used. By causing the light emitting unit to emit light, the user can easily recognize the physical button.

The display control unit 195 controls the image display by the display unit 196. It consists of a microprocessor that controls display. As the display control unit 195, for example, a microprocessor for control can be used. The display control unit 195 does not have to be a dedicated microprocessor. For example, the function of the display control unit 195 may be realized by the CPU 110 executing the process according to the program stored in the ROM 111.

The functions of the image processing unit 140, the liquid crystal control unit 150, the light source control unit 160, the optical system control unit 170, the recording / playback unit 191 and the display control unit 195 may be realized by one microprocessor. It may be realized by a plurality of microprocessors. Six microprocessors corresponding to these six functional parts may be used. The processing of one functional unit may be realized by one microprocessor or may be realized by a plurality of microprocessors. A common microprocessor may be used among a plurality of functional parts. A common microprocessor may be used between two or more of the above six functional parts.

<Basic operation>
Next, the basic operation of the liquid crystal projector 100 will be described with reference to FIG. FIG. 2 is a flow chart showing an example of the basic operation of the liquid crystal projector 100. Basically, the operation of FIG. 2 is realized by the CPU 110 controlling each functional unit based on the program stored in the ROM 111. The operation of FIG. 2 is started in response to the power of the liquid crystal projector 100 being turned on.

First, the CPU 110 supplies electric power to each functional unit of the liquid crystal projector 100 from a power supply unit (not shown), and executes a projection start process (S201). In the projection start process, an instruction to the light source control unit 160, an instruction to the liquid crystal control unit 150, an operation setting of the image processing unit 140, and the like are performed. The lighting control for lighting the light source 161 is performed according to the instruction to the light source control unit 160, and the drive control for driving the liquid crystal panels 151R, 151G, 151B (each liquid crystal element) is performed according to the instruction to the liquid crystal control unit 150. By performing the projection start processing, the projected image (first projected image) is projected.

Next, the CPU 110 determines whether or not the image data input to the image input unit 130 has changed (S202). If the image data changes, the process proceeds to S203, and if the image data does not change, the process proceeds to S204.

In S203, the CPU 110 executes the timing change process. In the timing change process, the resolution of the input image (the image represented by the image data input to the image input unit 130), the frame rate of the input image, and the like are detected. Then, the input image is sampled at the timing according to the detection result, and the sampled input image (data) is output. As a result, the image processing unit 140 performs image processing necessary for the input image. As a result, the projected image (first projected image) after the necessary image processing is performed is projected. Then, the process proceeds from S203 to S204.

In S204, the CPU 110 determines whether or not a user operation on the liquid crystal projector 100 has been performed. If no user operation is performed, the process proceeds to S208. When a user operation is performed, the CPU 110 determines whether or not the user operation is a termination operation (S205). The end operation is a user operation to end the projection. If the user operation is a termination operation, the process proceeds to S206. If the user operation is not an end operation, the CPU 110 executes a process (user process) according to the user operation (S207). Then, the process proceeds from S207 to S208. The user processing includes, for example, changing the installation setting, changing the input image, changing the image processing, displaying information, and the like.

In S208, the CPU 110 determines whether or not a command has been received by the communication unit 193. If the command is not received, the process is returned to S202. When a command is received, the CPU 110 determines whether or not the received command (received command) is an end command (S209). The end command is a command to end the projection. If the receive command is the end command, the process proceeds to S206. If the receive command is not an end command, the CPU 110 executes a process (command process) according to the receive command (S210). Then, the process is returned from S210 to S202. The command processing includes, for example, changing the installation setting, changing the input image, changing the image processing, displaying information, and the like.

As described above, when the end operation is performed or the end command is received, the process of S206 is performed. In S206, the CPU 110 executes the projection end process. In the projection end process, an instruction to the light source control unit 160, an instruction to the liquid crystal control unit 150, storage of necessary information (various set values) in the ROM 111, and the like are performed. The light source control unit 160 is instructed to turn off the light source 161, and the liquid crystal control unit 150 is instructed to turn off the liquid crystal panels 151R, 151G, 151B (each liquid crystal element). Will be done. By performing the projection end processing, the projection of the projected image (first projected image) is completed. Then, the operation flow of FIG. 2 is terminated.

Although the case where the projected image based on the image data input to the image input unit 130 is projected has been described, the liquid crystal projector 100 can also project the projected image based on other image data. For example, the liquid crystal projector 100 can read image data from the recording medium 192 and project a projected image based on the read image data. The liquid crystal projector 100 can also project a projected image based on the image data received by the communication unit 193. Which image data to project the projected image based on is determined (switched) according to, for example, the operation mode set in the liquid crystal projector.

<Problems to be solved in this embodiment>
Next, the problems to be solved in this embodiment will be described with reference to FIGS. 12 to 17.

FIG. 12 shows an example of multi-projection. Multi-projection is a projection method for forming one projected image (composite projected image) by joining a plurality of projected images of a plurality of projectors. FIG. 12 shows an example of multi-projection using two projectors 20a and 20b. The number of projectors used for multi-projection may be more than two.

In FIG. 12, the projector 20a projects the projected image 10a on the screen 10, and the projector 20b projects the projected image 10b on the screen 10. The right side portion of the projected image 10a overlaps the left side portion of the projected image 10b. In FIG. 12, reference numeral 30 indicates a blend region in which the projected image 10a and the projected image 10b overlap. When projection is performed without edge blending, an image brighter than the non-blended area is displayed in the blended area, and the combined brightness (projected brightness (display brightness) of the composite projected image) between the blended area and the non-blended area is displayed. There is a step. The non-blended region is a region of the projected image that does not overlap with other projected images. For example, when the brightness of the projected images 10a and 10b is uniform, as shown in FIG. 12, the combined brightness of the blended region 30 is increased to twice that of the non-blended region. As a result, a step in the combined brightness is generated.

By performing the edge blending process, it is possible to reduce the step in the combined brightness. FIG. 13 shows an example of the projected image after the edge blending process. In FIG. 13, the region 30a of the projected image 10a and the region 30b of the projected image 10b are both regions corresponding to the blend region 30 of FIG. In the example of FIG. 13, an example is shown in which an edge blending process for reducing the brightness of the region 30a is applied to the projected image 10a, and an edge blending process for reducing the brightness of the region 30b is applied to the projected image 10b. By performing such an edge blending process, as shown in FIG. 14, the combined brightness of the blended region 30 can be matched with the combined brightness of the non-blended region.

When performing multi-projection, the user adjusts the projection area (display area) of each projection image in order to make the joint between the plurality of projection images difficult to see. For example, the user adjusts the projection position (display position) of each projected image, the shape of each projected image, and the like. The projection position can be changed, for example, by changing the installation position of the projector. The shape of the projected image can be changed, for example, by changing the parameters used for keystone correction. Then, in order to simplify the adjustment of the projection area, as shown in FIG. 15, a marker indicating the blend area (an auxiliary marker that assists the adjustment of the projection area) may be displayed. Since the auxiliary marker is a marker indicating the blend region, at least a part of the auxiliary marker is included in the blend region. Therefore, when the edge blending process is applied to the image data in which the auxiliary marker is arranged, the brightness of a part of the auxiliary marker is unnecessarily reduced and the visibility of the auxiliary marker is lowered, as shown in FIG. If the visibility of the auxiliary marker is poor, the user cannot easily adjust the projection area.

The auxiliary marker may be drawn by a drawing process in which the graphic image is placed in the original image. For example, the auxiliary marker is an OSD (On Screen Display) image superimposed on the input image. If the drawing process is performed after the edge blend process, it is possible to suppress a decrease in the visibility of the auxiliary marker. However, a graphic image other than the auxiliary marker may be drawn by the drawing process. For example, menu images showing various setting values may be drawn by drawing processing. When the drawing process is performed after the edge blend process, as shown in FIG. 17, the edge blend process is not applied to the graphic image 40 to be subjected to the edge blend process, and the above-mentioned step in the composite brightness is formed in the graphic image 40. Occurs. Therefore, it is desirable that the edge blending process is performed after the drawing process.

Therefore, in the present embodiment, the edge blending process is performed after the drawing process is performed. Then, for the image data in which the auxiliary marker is arranged, the amount of reduction of the brightness of the blend region by the edge blending process is controlled to a value smaller than that of the other image data. As a result, the graphic image to be subjected to the edge blending process can be projected with high image quality, and the deterioration of the visibility of the auxiliary marker due to the edge blending process can be suppressed.

<Characteristics of this embodiment>
Next, the characteristic operation of the liquid crystal projector 100 will be described. FIG. 3 is a diagram showing an example of the internal configuration of the image processing unit 140. As shown in FIG. 3, the image processing unit 140 includes an OSD compositing unit 310 and various image processing units 320.

In FIG. 3, the original image data sig301 is input image data output from the image input unit 130, the recording / playback unit 191 or the communication unit 193, and is image data representing the original image (input image). The timing signal sig 302 is a signal output from the supply source of the original image data sig301 (the functional unit that outputs the original image data sig301), and is a signal synchronized with the original image data sig301. The timing signal sig 302 includes, for example, a vertical synchronization signal, a horizontal synchronization signal, a clock signal, and the like. Each functional unit of the image processing unit 140 operates in synchronization with the timing signal sig 302. Note that the image processing unit 140 may generate a timing signal without receiving the timing signal and use the generated timing signal.

The OSD synthesis unit 310 performs processing in cooperation with the CPU 110. Specifically, the OSD synthesizing unit 310 acquires the original image data sig301 and outputs the acquired image data sig303 to various image processing units 320. The OSD compositing unit 310 can output the original image data sig301 as the acquired image data sig303. Further, the OSD compositing unit 310 can acquire (generate) the composite image data in which the graphic image is superimposed on the original image by synthesizing the graphic image data representing the graphic image with the original image data sig301. The composite image data is generated in response to an instruction from the CPU 110. For example, one or more graphic image data are prepared in advance, and the composite image data is generated by synthesizing using the graphic image data according to the instruction from the CPU 110. Then, when the composite image data is generated, the OSD synthesis unit 310 outputs the composite image data as the acquired image data sig303.

The various image processing units 320 generate the projection image data sig 304 by performing predetermined image processing on the acquired image data sig 303. Then, the various image processing units 320 output the projection image data sig 304 to the liquid crystal control unit 150. As mentioned above, the predetermined image processing includes edge blending processing.

As described above, a plurality of image processes including an edge blend process may be performed as a predetermined image process. For example, the predetermined image processing may include acquisition of feature amounts of image data, IP conversion, frame rate conversion, resolution conversion, γ conversion, color gamut conversion, color correction, edge enhancement, and the like. The feature amount is, for example, a histogram of pixel values, a representative value of pixel values (mean value, an intermediate value, a mode value, a maximum value, a minimum value, etc.), a histogram of brightness values, a representative value of brightness values, and the like. .. Since known techniques can be used for these image processings, the description thereof will be omitted.

FIG. 4 shows an example of multi-projection according to the present embodiment. FIG. 4 shows an example of multi-projection using two projectors 400a and 400b. The projectors 400a and 400b have the same configuration as the liquid crystal projector 100 of FIG. The number of projectors used for multi-projection may be more than two.

In FIG. 4, the projected image 500a is projected on the screen 410 by the projector 400a, and the projected image 500b is projected on the screen 410 by the projector 400b. The projected image 500a and the projected image 500b form one projected image (composite projected image) when the adjustment of the projection area is completed. In FIG. 4, the projected image 500a is distorted into a trapezoidal shape and projected, and the projected image 500b is projected without distortion by the keystone correction process.

In such a case, for example, the user adjusts the projection area of the projected image 500a so that the composite projected image is formed. In the adjustment of the projection area, it is not always the case that only the projection area of one projected image corresponding to one projector is adjusted. The projection area may be adjusted (changed) for each of the plurality of projected images corresponding to the plurality of projectors. The method of adjusting the projection area is not particularly limited.

An example of the operation of the projector 400a will be described with reference to FIG. FIG. 5 is a flowchart showing an example of the operation of the projector 400a. The projector 400b also performs the same operation as that described below. In the present embodiment, the projector 400a can set any of a plurality of operation modes including the adjustment mode. The adjustment mode is an operation mode that should be set when adjusting the projection area of the projected image. The operation of FIG. 5 is triggered by the adjustment mode being set for the projector 400a.

First, in S601, the CPU 110 reads the auxiliary marker stored in advance in the RAM 112 from the RAM 112, and outputs the read auxiliary marker to the OSD synthesis unit 310. As a result, the OSD synthesis unit 310 performs synthesis using the auxiliary marker, and generates composite image data in which the auxiliary marker is arranged.

Next, in S602, the CPU 110 reads the adjustment parameter, which is an edge blend parameter stored in advance in the RAM 112, from the RAM 112, and sets the read adjustment parameter in the various image processing units 320. For example, the read adjustment parameters are written in the conversion data held by the various image processing units 320. The edge blend parameter is a parameter used for the edge blend process. The conversion data is data for converting the brightness value using the edge blend parameter. As the conversion data, a LUT (look-up table), a function, or the like is used.

Then, in S603, the CPU 110 instructs various image processing units 320 to execute the edge blending process. As a result, edge blending processing using the adjustment parameters is applied to the composite image data generated in S601. As a result, image data for projection is generated. After that, the projected image based on the projection image data generated in S603 is projected as the projected image 500a.

Next, in S604, the CPU 110 determines whether or not the adjustment mode setting has been canceled. The adjustment mode is released, for example, by a user operation on the projector 400a. The user operation is a user operation for canceling the adjustment mode, a user operation for changing the operation mode from the adjustment mode to another operation mode, and the like. When the adjustment mode is canceled, the process proceeds to S605, and when the adjustment mode is not canceled, the process returns to S601.

The method of canceling the adjustment mode is not limited to the above method. For example, the adjustment mode may be automatically canceled after a predetermined time (3 minutes, 5 minutes, 10 minutes, etc.) after the adjustment mode is set.

The timing at which the operation of FIG. 5 is started is not limited to the above timing. For example, the operation of FIG. 5 may be started with the power of the projector 400a being turned on as a trigger. Then, the process may proceed from S604 to S605 after a predetermined time from the timing when the power of the projector 400a is turned on.

In S605, the CPU 110 outputs an instruction to erase the auxiliary marker to the OSD synthesis unit 310. As a result, in the OSD synthesis unit 310, image data (input image data or composite image data) in which the auxiliary marker is not arranged can be obtained.

Next, in S606, the CPU 110 reads a normal parameter, which is an edge blend parameter stored in advance in the RAM 112, from the RAM 112, and sets the read normal parameter in the various image processing units 320.

Then, in S607, the CPU 110 instructs various image processing units 320 to execute the edge blending process. As a result, edge blending processing using normal parameters is applied to the image data obtained in S605. As a result, image data for projection is generated. Details will be described later, but normal parameters are different from adjustment parameters. As described above, in the present embodiment, the edge blend parameter is switched and used depending on whether the image data in which the auxiliary marker is arranged is acquired or not. After that, the projected image based on the projection image data generated in S607 is projected as the projected image 500a. Specifically, the projected image 500a is changed (updated) from the projected image based on the projection image data generated in S603 to the projected image based on the projection image data generated in S607.

<Normal parameters>
An example of normal parameters will be described. In the present embodiment, the edge blend parameter of FIG. 6 (b) is used as a normal parameter so that the projected image 500a shown in FIG. 6 (a) can be obtained from the input image data having uniform brightness. In FIG. 6A, reference numeral 510a indicates a blend region. In FIG. 6A, the image size of the input image data is W (the number of pixels in the horizontal direction) × H (the number of pixels in the vertical direction). The region for EB pixels is the blend region 510a from the right end to the left side. In FIG. 6B, the vertical axis represents the correction ratio R of the edge blending process, and the horizontal axis represents the pixel position (horizontal position) x in the horizontal direction. The correction ratio is the ratio of the brightness after the edge blending process to the brightness before the edge blending process, and is a value corresponding to the brightness after the edge blending process. In the example of FIG. 6B, the brightness continuously decreases from the boundary (x = W-EB) of the blended region and the non-blended region to the right end (x = W). The correction ratio in FIG. 6B does not depend on the pixel position (vertical position) y in the vertical direction.

In the present embodiment, the LUT 520 shown in FIG. 6C is prepared as the conversion data. FIG. 6 (c) shows the conversion data after the normal parameters of FIG. 6 (b) have been written. The LUT520 has a total of 90 data blocks, 9 in the horizontal direction and 10 in the vertical direction. The 90 data blocks correspond to a total of 90 divided regions of 9 in the horizontal direction and 10 in the vertical direction constituting the blend region 510a. A discretized value of the correction ratio R indicated by the edge blend parameter is written in each data block. In FIG. 6C, the numerical value described in each data block is the correction ratio R. The number of LUT data blocks is not particularly limited. As the number of data blocks increases, a more continuous distribution of correction ratios can be expressed, and more accurate edge blending processing can be realized.

The normal parameters are not limited to the parameters shown in FIG. 6B. For example, as a normal parameter, a parameter that reduces the brightness value of each pixel in the blend region by the same reduction amount may be used.

<Edge blend processing>
An example of edge blending processing will be described. Here, an example in which the normal parameter shown in FIG. 6B is used will be described, but when other edge blend parameters are used, the same processing as described below is performed.

FIG. 7A is the same as FIG. 6A. FIG. 7B shows an input luminance value (input pixel value) of each pixel in the blend region 510a. The input luminance value is the luminance value before the edge blending process. In the example of FIG. 7B, the blend region 510a has N pixels in the horizontal direction and M pixels in the vertical direction. In FIG. 7B, the number written on each pixel is the input luminance value. FIG. 7 (c) shows the LUT 520. FIG. 7 (c) shows the LUT 520 after the normal parameters of FIG. 6 (b) have been written. In the example of FIG. 7C, the LUT 520 has n data blocks in the horizontal direction × m data blocks in the vertical direction. Note that N and n do not always match, and M and m do not necessarily match.

The edge blending process will be described with reference to FIG. FIG. 8 is a flowchart showing an example of the flow of the edge blending process. FIG. 8 shows processing for one pixel (processing target pixel). In the edge blending process, the processing of FIG. 8 is performed for each pixel in the blending region. Hereinafter, an example in which the pixel 511 of FIG. 7B is a processing target pixel will be described.

First, in S610, various image processing units 320 extract a correction ratio from the LUT 520 in which the edge blend parameter is stored, based on the position of the processing target pixel 511. In the present embodiment, the correction ratio of the data block in which the divided region exists within a predetermined range is extracted from the position of the processing target pixel 511. Only the correction ratio of the data block in which the entire divided area is included in the predetermined range may be extracted, or the correction ratio of the data block in which at least a part of the divided area is included in the predetermined range may be extracted. The correction ratio of the data block whose center position of the divided region is included in the predetermined range may be extracted. Here, it is assumed that the correction ratios 530a, 530b, 530c, and 530d are extracted. The division area corresponding to each data block can be calculated from the number n and m of the data blocks and the sizes H and EB of the blend area 510a. The method for extracting the correction ratio is not limited to this. For example, the correction ratio corresponding to the divided region including the position of the processing target pixel 511 may be extracted.

Next, in S611, various image processing units 320 calculate the edge blend coefficient. In the present embodiment, linear interpolation is performed based on the position of the processing target pixel 511 and the position (for example, the center position) of the plurality of division regions for which the correction ratio is extracted in S610. As a result, the correction ratio corresponding to the position of the processing target pixel 511 is calculated as the edge blend coefficient from the plurality of correction ratios extracted in S610. Here, the edge blend coefficient is calculated from the correction ratios 530a, 530b, 530c, and 530d. In addition, nonlinear interpolation may be performed instead of linear interpolation. The above interpolation can also be referred to as "weighting synthesis in which a plurality of correction ratios are combined with weights according to the distance between the position of the processing target pixel 511 and the position of the division region". In this case, as the weight, the shorter the distance, the larger the weight is used. When only one correction ratio is extracted in S610, the extracted correction ratio is set as the edge blend coefficient.

Then, in S612, various image processing units 320 multiply the brightness value (pixel value) of the processing target pixel 511 by the edge blend coefficient calculated in S611. As a result, as shown in FIG. 7D, the brightness value of the processing target pixel 511 is reduced from 255 to 243. FIG. 7D shows the output luminance value (output pixel value) of each pixel in the blend region 510a. The output luminance value is the luminance value after the edge blending process.

By performing the above processing for all the pixels in the blend region 510a, the processing result of FIG. 7D can be obtained.

The method of edge blending processing is not limited to the above information. The brightness of the blended region may be reduced by any method as long as the step of the combined brightness between the blended region and the non-blended region can be reduced.

<Adjustment parameters>
An example of the adjustment parameter will be described. In the present embodiment, the adjustment parameters are shown in FIGS. 9 (b) and 9 (a) so that the projected image 500a shown in FIG. 9 (a) can be obtained from the composite image data in which the auxiliary marker is superimposed on the input image having uniform brightness. Edge blend parameters as shown in c) are used. In the example of FIG. 9A, the width of the auxiliary marker included in the blend region is WM pixels. 9 (b) shows the adjustment parameters for the vertical position 901 of FIG. 9 (a), and FIG. 9 (c) shows the adjustment parameters for the vertical position 902 of FIG. 9 (a). As described above, in the present embodiment, the correction ratio of the adjustment parameter depends on the vertical position y.

In FIG. 9B, since the auxiliary marker exists in the range from the horizontal position x = W-WM to the horizontal position x = W, the correction ratio of the range (marker range) is larger than that in FIG. 6B. The value is set. Specifically, as the correction ratio of the marker range, a correction ratio that does not reduce the brightness is set. Since there is no auxiliary marker in the range other than the marker range in FIG. 9B, the same value as in FIG. 6B is set as the correction ratio in the range other than the marker range. Since there is no auxiliary marker at the vertical position 902, the same edge blend parameter as in FIG. 6 (b) is used as the adjustment parameter (FIG. 9 (c)) for the vertical position 902.

FIG. 9 (d) shows the LUT 520 (conversion data) after the adjustment parameters of FIGS. 9 (b) and 9 (c) are written. In the data block (upper right and lower right) filled with dots in FIG. 9 (d), an auxiliary marker exists in the divided area, so that a correction ratio larger than that in FIG. 6 (c) is written. Specifically, a correction ratio "100" that does not reduce the brightness is written. By using the LUT520 of FIG. 9D, the reduction amount (reduction amount by the edge blending process) of the region where the auxiliary marker exists in the blend region is smaller than that when the normal parameter of FIG. 6B is used. It can be controlled to a value. Specifically, the reduction amount of the region in which the auxiliary marker exists in the blend region can be controlled to zero (0). Strictly speaking, the amount of reduction in the region where the auxiliary marker exists and the region around the blend region can be controlled to zero (0). Then, the reduction amount of the remaining region (the region of the blend region in which the auxiliary marker does not exist) can be controlled to the same value as when the normal parameter of FIG. 6B is used.

The edge blending process using the adjustment parameters is not limited to the above processing. For example, the amount of reduction in the region where the auxiliary marker is present in the blend region may be larger than 0. Further, the reduction amount of the entire blend region may be controlled to a value smaller than that when the normal parameter is used. The amount of reduction in the blend region may be controlled in any way as long as the decrease in visibility of the auxiliary marker can be suppressed.

Specifically, as shown in FIG. 10 (b), the adjustment parameters are such that the projected image 500a shown in FIG. 10 (a) can be obtained from the composite image data in which the auxiliary marker is superimposed on the input image having uniform brightness. Edge blend parameters may be used. Here, the correction ratio of the adjustment parameter does not depend on the vertical position y.

In FIG. 10B, a correction ratio that does not reduce the brightness is set for the entire blend region. FIG. 10 (c) shows the LUT 520 (conversion data) after the adjustment parameters of FIG. 10 (b) have been written. In FIG. 10C, a correction ratio “100” that does not reduce the brightness is written for all the data blocks. By using the LUT520 of FIG. 10C, the reduction amount of the entire blend region can be controlled to zero (0). That is, for all the pixels in the blend region, the same value as the pixel value before the edge blending process can be obtained as the pixel value after the edge blending process. As a result, it is possible to suppress a decrease in the visibility of the auxiliary marker.

Further, as an adjustment parameter, an edge blend as shown in FIG. 11B is used so that the projected image 500a shown in FIG. 11A can be obtained from the composite image data in which the auxiliary marker is superimposed on the input image having uniform brightness. Parameters may be used. Here, the correction ratio of the adjustment parameter does not depend on the vertical position y.

In FIG. 11B, the correction ratio continuously decreases from the boundary (x = W-EB) between the blended region and the non-blended region to the right end (x = W). However, in FIG. 11B, a value larger than that in FIG. 6B is set as the correction ratio at the right end (x = W). FIG. 11C shows the LUT520 (conversion data) after the adjustment parameters of FIG. 11B have been written. By using the LUT520 of FIG. 11C, it is possible to suppress a decrease in the brightness of the marker region and suppress a decrease in the visibility of the auxiliary marker.

As described above, according to the present embodiment, when the image data in which the auxiliary marker is arranged is acquired, the amount of reduction in the brightness of the blended region by the edge blending process is reduced to a smaller value than in the case where the auxiliary marker is not arranged. Be controlled. As a result, it is possible to suppress a decrease in visibility of the auxiliary marker due to the edge blending process. As a result, the user can easily adjust the projection area.

In the present embodiment, an example in which the image data in which the auxiliary marker is arranged is acquired (generated) by synthesizing the image data has been described, but the present invention is not limited to this. The image data may be combined by an external device different from the liquid crystal projector. Then, the liquid crystal projector may acquire the image data in which the auxiliary marker is arranged from the external device. The method for determining whether or not the auxiliary marker is arranged on the image input to the liquid crystal projector is not particularly limited. For example, image data including metadata indicating whether or not an auxiliary marker is arranged may be acquired from an external device. In that case, the metadata can be used to determine whether or not the auxiliary marker is placed.

In the present embodiment, the edge blend parameter is switched between the case where the image data in which the auxiliary marker is arranged is acquired and the case where the image data is not acquired, but the control method of the reduction amount is not limited to this. For example, the edge blending process may be omitted when the image data in which the auxiliary marker is arranged is acquired.

<Other Embodiments>
The present invention supplies a program that realizes one or more functions of the above-described embodiment to a system or device via a network or storage medium, and one or more processors in the computer of the system or device reads and executes the program. It can also be realized by the processing to be performed. As the processor, for example, a CPU or an MPU can be used. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.
In this case, the program code itself read from the storage medium realizes the function of the above-described embodiment, and the program code itself and the storage medium storing the program code constitute the present invention.
As the storage medium for storing the program code, for example, a flexible disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a CD-R, a magnetic tape, a non-volatile memory card, a ROM, or the like can be used.
Further, based on the instruction of the above-mentioned program code, the OS (basic system or operating system) running on the device performs a part or all of the processing, and the processing realizes the function of the above-described embodiment. The configuration is also included in the present invention.
Further, the program code read from the storage medium is written in the memory provided in the function expansion board inserted in the device or the function expansion unit connected to the computer, and the function of the above-described embodiment is realized. , Included in the present invention. At this time, based on the instruction of the program code, the function expansion board, the CPU provided in the function expansion unit, or the like performs a part or all of the processing.

100: LCD projector 140: Image processing unit 171: Projection optical system 310: OSD compositing unit 320: Various image processing units

Claims (6)

A display device that projects the first projected image.
Acquisition method for acquiring image data and
The image data acquired by the acquisition means is subjected to a brightness reduction process for reducing the brightness of the blend region, which is an region overlapping the second projected image projected by another display device in the region of the first projected image, and projected. Processing means to generate image data for
A projection means for projecting the first projected image based on the projection image data, and
Have,
The processing means
Prior to the luminance reduction process, it is possible to combine the marker data, which is a graphic image showing the blend region, with the image data acquired by the acquisition means.
When the marker data is combined with the image data acquired by the acquisition means, the value of the blend region is set to a smaller value than when the marker data is not combined with the image data acquired by the acquisition means. A display device characterized in that the amount of reduction of the brightness of the region in which the marker is synthesized by the brightness reduction processing is set. The processing means blends the case where the marker data is combined with the image data acquired by the acquisition means and the case where the marker data is not combined with the image data acquired by the acquisition means. The display device according to claim 1, wherein the amount of reduction of the brightness of the region in which the marker is not synthesized by the brightness reduction processing is not changed. The processing means synthesizes the marker data with the image data acquired by the acquisition means, and does not combine the marker data with the image data acquired by the acquisition means. The display device according to claim 1 or 2, wherein the parameters used for the reduction process are switched. The display device can set any one of a plurality of operation modes including an adjustment mode, which is an operation mode to be set when adjusting the projection area of the projected image.
The processing means according to any one of claims 1 to 3, wherein the processing means synthesizes the data of the marker with the image data acquired by the acquisition means when the adjustment mode is set. Display device. This is a control method for a display device that projects a first projected image.
The acquisition step to acquire the image data and
The image data acquired in the acquisition step is projected by applying a brightness reduction process for reducing the brightness of the blend region, which is an region overlapping the second projected image projected by another display device in the region of the first projected image. Processing steps to generate image data for
A projection step of projecting the first projected image based on the projection image data,
Have,
In the processing step
Prior to the luminance reduction process, it is possible to combine the marker data, which is a graphic image showing the blend region, with the image data acquired in the acquisition step.
When the marker data is combined with the image data acquired in the acquisition step, the value of the blend region is set to a smaller value than when the marker data is not combined with the image data acquired in the acquisition step. A method for controlling a display device, which comprises setting a reduction amount of the brightness of a region in which the marker is synthesized by the brightness reduction processing. A program for causing a computer to execute each step of the display device control method according to claim 5 .

Images