JP7238878B2 - DISPLAY DEVICE AND CONTROL METHOD OF DISPLAY DEVICE - Google Patents

Description

The present invention relates to a display device and a display device control method.

2. Description of the Related Art Conventionally, there has been known a projector that modulates a light flux emitted from a light source to form an image according to image information, enlarges the formed image, and projects the image onto a screen.
In recent years, as shown in Patent Document 1 below, a projector has been disclosed that receives image signals from a plurality of input sources and projects a plurality of images corresponding to the plurality of image signals onto a screen.

When a user wants to display a focused image from among multiple images projected by such a projector on the screen larger than the other images, the user can change the priority set for the focused image to the priority of the other images. set higher than Thereby, the projector displays the image of interest larger than the other images according to the set priority and the number of pixels of the image.

JP-A-2004-54134

However, with the above projector, it is possible to display a large image by increasing the priority, but the size of the displayed image is determined according to the priority and the number of pixels, so the user is projected on the screen. You couldn't explicitly indicate the size of the image.
SUMMARY OF THE INVENTION The present invention has been made in view of the above problems, and an object of the present invention is to indicate a desired size of an image to be projected when projecting a plurality of images.

The present invention has been made to solve at least part of the above problems, and can be implemented as the following forms or application examples.

[Application example 1]
A display device according to this application example provides a first image based on a first image signal, a second image based on a second image signal, and a boundary between the first image and the second image. a display unit for displaying the composite image generated by the image generation unit on a display surface; and a position of an indicator with respect to the display surface. and a control unit that causes the image generation unit to generate the composite image in which the boundary line has moved based on the position of the pointer detected by the detection unit.

According to such a configuration, the first image based on the first image signal, the second image based on the second image signal, and the position of the boundary between the first image and the second image are determined. By moving the indicator on the display surface on which the composite image including the indicated boundary line is projected, a composite image with the boundary line moved is generated and projected. The size can be explicitly indicated by moving the indicator.

[Application example 2]
In the display device according to the above application example, the control unit controls the division position closest to the boundary line among a plurality of division positions at which the first image and the second image can be divided in the synthesized image. It is preferable to cause the image generation unit to generate the composite image to which the reference line is added.

According to such a configuration, the reference line is displayed at the position closest to the position of the pointer among the division positions where the first image and the second image can be divided. You can visually see the position where you can split the two images at the same distance.

[Application Example 3]
In the display device according to the application example described above, the control unit causes the image generation unit to generate the composite image in which the indication area that can be indicated by the pointer is superimposed on the boundary, and the composite image displayed on the display surface is the composite image. When it is detected that the indicated region of the image is clicked by the pointer, the boundary line of the synthesized image is moved to a first divided position adjacent to the boundary among the plurality of divided positions. preferable.

According to such a configuration, by clicking the indication area displayed superimposed on the boundary, the boundary can be moved to the first division position adjacent to the division position corresponding to the reference line.

[Application example 4]
In the display device according to the application example, it is preferable that the indication area is movable along the boundary line.

According to such a configuration, since the indication area can be moved along the reference line, it can be moved to a position where the visibility is not lowered according to the projected image.

[Application example 5]
In the display device according to the application example, the first image signal is input from a first input source, the display unit displays the first image on the display surface, and the second image is displayed on the display surface. When the boundary line is not displayed on the plane, the control unit detects that the boundary line has moved to a position other than the end portion, and the control unit receives the input from a second input source different from the first input source. It is preferable to cause the image generator to generate the composite image including the second image based on the second image signal based on the moved boundary line.

According to such a configuration, when the display unit displays the first image and does not display the second image, the second image based on the second input source is displayed based on the position of the moved boundary. Furthermore, since a composite image is generated that includes a plurality of input sources, it is possible to generate a composite image in which images based on a plurality of input sources are combined based on the position of the reference line.

[Application example 6]
In the display device according to the application example described above, it is preferable that the control unit does not perform the signal determination processing on the first image signal and performs the signal determination processing on the second image signal. .

According to such a configuration, since the first image signal is not subjected to signal discrimination processing, the first image generated based on the first image signal can be displayed without being regenerated.

[Application example 7]
In the display device according to the application example described above, when the second input source is selectable from a plurality of sources including a first source and a second source, the control unit performs It is preferable to cause the image generation unit to generate the composite image in which the first indication area and the second indication area different from the first indication area according to the second source are arranged.

Such a configuration facilitates selection of an input source.

[Application example 8]
In the display device according to the above application example, the control unit, when arranging the second image in a partial area of the synthesized image in which the first image was arranged based on the boundary, sets It is preferable that a region in which the first image is preferentially displayed is determined based on the obtained information.

According to such a configuration, when the second image is arranged in a partial area of the synthesized image in which the first image has been arranged, it is possible to set the area in which the first image is preferentially displayed. can.

[Application example 9]
A display device control method according to this application example includes a first image based on a first image signal, a second image based on a second image signal, and a combination of the first image and the second image. displaying the generated synthetic image on a display surface; detecting the position of an indicator with respect to the display surface; and generating the synthetic image in which the boundary line is moved based on the position of the pointer.

According to such a method, the first image based on the first image signal, the second image based on the second image signal, and the position of the boundary between the first image and the second image are determined. By moving the indicator on the display surface on which the composite image including the indicated boundary line is projected, a composite image with the boundary line moved is generated and projected. The size can be explicitly indicated by moving the indicator.

FIG. 4 is a diagram showing a usage example of the projector according to the embodiment; 1 is a functional block diagram showing the configuration of a projector according to an embodiment; FIG. 4 is a flowchart showing the flow of processing for split display. 6 is a flowchart showing the flow of drag processing for a dual-screen button; 4 is a flowchart showing the flow of processing for split display. The figure which shows the position of several reference lines. The figure which shows the 1st projection screen by external input mode. FIG. 10 is a diagram showing movement of the guide line on the first projection screen in the external input mode; FIG. 10 is a diagram showing movement of the guide line on the first projection screen in the external input mode; FIG. 10 is a diagram showing movement of the guide line on the first projection screen in the external input mode; FIG. 10 is a diagram showing movement of the guide line on the first projection screen in the external input mode; FIG. 10 is a diagram showing movement of the guide line on the first projection screen in the external input mode; The figure which shows the example which split-displayed by the left enlarged size. The figure which shows the example divided into two by the size of the same size. The figure which shows the example which split-displayed by the size of the right expansion. The figure which shows the example projected by 1 screen. The figure which shows the movement of a guide line from the state divided into two. The figure which shows the movement of a guide line from the state divided into two. The figure which shows the movement of a guide line from the state divided into two. 4 is a flow chart showing the flow of processing for determining a source to be displayed in the case of split display. The figure explaining the direction which displays a 2nd projection screen. FIG. 4 is a diagram showing a first projection screen on which a plurality of indication areas are displayed;

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described with reference to the drawings.

(embodiment)
FIG. 1 is a diagram showing a usage example of a projector 10 according to an embodiment to which the invention is applied. The projector 10 is one of the display devices, and is a short focus type that is installed directly above the screen SC that is the display surface and projects an image obliquely downward. Further, the screen SC exemplified in this embodiment is a flat plate or curtain that is fixed to a wall surface or erected on a floor surface. It is also possible to use the wall surface as the screen SC. In this case, the projector 10 may be attached to the top of the wall surface used as the screen SC.
In the external input mode, the projector 10 can project an image onto the screen SC based on image data input from the outside.

Further, the projector 10 has a function (interactive function) for a user (operator) to instruct a predetermined operation using the indicator 70 on the screen SC for projecting an image. The indicator 70 is, for example, a pen-type input device, and is used by the operator by gripping the shaft portion 71 and pressing the tip against the screen SC. An operation switch 72 for detecting a pressing operation is provided at the tip of the indicator 70, and the operation switch 72 is turned on when the operator presses the tip of the indicator 70 against the screen SC. The operator can perform a position indication operation by pressing the tip of the indicator 70 against the screen SC at an arbitrary position on the screen SC.

The projector 10 has a function of detecting the position of the pointer 70 on the screen SC, as will be described later. When the operator performs a position indication operation, the projector 10 detects the position where the tip of the indicator 70 is in contact with the screen SC as the operation position, and receives the position indication operation performed by the operator with the indicator 70. , this operation can be reflected in the projection image. Specifically, the projector 10 draws a straight line, a curved line, a polygonal figure, or a figure based on the user's drawing operation, that is, the operation of moving the indicator 70 held by the user while being pressed onto the screen SC. , draws a drawn image 200 such as characters, and projects the drawn image 200 onto the screen SC.
For example, when there is no image projected on the screen SC as shown in FIG. 1, the projector 10 projects the second projection screen 220 on the screen SC with white light to make it look like a whiteboard. It has a function of drawing a drawn image 200 on the screen SC (whiteboard (WB) function). A mode of executing such a WB function is called a WB mode.

Further, the projector 10 has a function (annotation function) capable of drawing a drawing image 200 superimposed on the projection image when some projection image is projected on the screen SC.
Further, as will be described later, when the dual-screen button 230 for projecting onto the screen SC is designated by the indicator 70, the projector 10 divides the area projected onto the screen SC into two, and the divided areas have different modes, For example, images in WB mode and external input mode can be projected simultaneously.
Also, the projector 10 can save the image drawn on the screen SC as image data. In this case, only the drawn image 200 may be saved as image data, or a single image in which the projected image projected onto the screen SC at the time of drawing and the drawn image 200 overlap may be saved as image data. can.

This projector 10 is provided with an operation panel 19 on an exterior housing. The operation panel 19 has various switches and indicator lamps.
FIG. 2 is a functional block diagram of each part configuring the projector 10. As shown in FIG.
This projector 10 has an image data input unit 12 to which image data is input.
The image data input unit 12 may be a communication interface such as a USB interface, wired or wireless LAN interface, for example. For example, a computer device as an input source or another projector may be connected via a LAN interface provided in the image data input unit 12 .

The image data input section 12 may have an input terminal to which an analog video signal or a digital video signal is input. Input terminals include a VGA terminal, a DVI (Digital Visual Interface), an S video terminal, an RCA terminal, a D terminal, an HDMI connector conforming to the HDMI (registered trademark) standard, and the like. The image data input unit 12 may include interface circuits and image processing circuits corresponding to these input terminals.
Also, the image data input unit 12 may have a reading function for reading image data stored in a flash memory or the like. An image signal (first image signal) input to the image data input unit 12 is sent to the image processing unit 30 via the input signal switching unit 14 .
The projector 10 also includes a position detection unit 20 that detects the position of the pointer 70 with respect to the screen SC. The position detection section (detection section) 20 includes an imaging section 26 , a pointer detection section 24 and a coordinate calculation section 22 .

The imaging unit 26 has an imaging optical system, an imaging device, an interface circuit, etc., and images the projection direction of the projection optical system 96 . The imaging optical system of the imaging unit 26 is arranged facing the same direction as the projection optical system 96, and has an angle of view that covers the range in which the projection optical system 96 projects an image onto the screen SC. Moreover, CCD and CMOS are mentioned as an image pick-up element. The interface circuit reads and outputs the detection values of the imaging device.
The image capturing unit 26 captures the image projected on the screen SC and the pointer 70 being operated on or near the screen SC. The imaging element of the imaging unit 26 may have sensitivity in the wavelength range of visible light, or may have sensitivity in the wavelength range of infrared light or both infrared light and visible light. In this embodiment, the imaging unit 26 outputs captured image data of infrared light.

The pointer detection unit 24 detects the position of the pointer 70 based on the captured image data output by the imaging unit 26 . The pointer detection unit 24 detects a shape similar to the pointer 70 from the photographed image data, executes processing for extracting the image of the pointer 70, and specifies the position of the pointer 70 in the photographed image data. Here, the pointer detection unit 24 may specify the direction in which the tip of the pointer 70 is facing. Note that the method of detecting the indicator 70 is not limited to the method of detecting a shape similar to the indicator 70, and a method of detecting reflected light by a light curtain can also be assumed.
A method of detecting reflected light using a light curtain, for example, emits a layered (or curtain-shaped) detection light (for example, infrared light) over the entire surface of the screen SC, and uses an indicator having a portion that reflects the infrared light. The position of the indicator 70 may be detected from the position of the reflected light in the captured image by photographing the reflected light reflected by the body 70 . Details of the method for detecting reflected light by the light curtain are omitted because they are not the gist of the present invention (for such a method, see, for example, Japanese Patent Application Laid-Open No. 2015-159523).

The coordinate calculation unit 22 calculates the coordinates of the position indicated by the tip of the pointer 70 on the screen SC, that is, the coordinates of the operation position, based on the position of the pointer 70 in the captured image data specified by the pointer detection unit 24 . do. Specifically, the coordinate calculation unit 22 calculates the coordinates based on the area (projection range) in which the projection unit 90 projects the image on the screen SC based on the operation position in the captured image data. The coordinate calculation unit 22 outputs data indicating the calculated coordinates of the operation position and the operation state of the operation switch 72 to the WB function unit 16 , the annotation drawing unit 40 and the control unit 80 .
In the WB mode, the WB function unit 16 projects white light onto the screen SC like a so-called whiteboard, and generates a drawn image 200 on the screen SC based on the movement of the indicator 70 . In this embodiment, the WB function unit 16 assumes a mode in which the hardware and software for realizing the function are independent in the projector 10 . An image signal (second image signal) of the drawn image 200 generated by the WB function unit 16 is sent to the image processing unit 30 via the input signal switching unit 14 .

The input signal switching unit 14 switches the input source of the image signal processed by the image processing unit 30 based on the instruction from the control unit 80 . In this embodiment, the input signal switching unit 14 selects image data based on an instruction from the control unit 80 from among the image signals generated by the WB function unit 16 and the image signals input to the image data input unit 12. , the selected image data is sent to the image processing unit 30 .
The projector 10 can be roughly divided into a projection unit 90 that forms an optical image and an image processing system that processes image data.
The projection section 90 includes an illumination optical system 92 , an optical modulator 94 and a projection optical system 96 . Projection unit 90 corresponds to a display unit that displays an image on a display surface.
The illumination optical system 92 includes light sources such as a xenon lamp, an extra-high pressure mercury lamp, an LED (Light Emitting Diode), a laser light source, and the like. The illumination optical system 92 may also include a reflector and an auxiliary reflector that guide the light emitted by the light source to the light modulator 94 . In addition, a lens group (not shown) for enhancing the optical characteristics of the projected light, a polarizing plate, or a light control element for reducing the amount of light emitted by the light source on the path to the light modulation device 94 is provided. Also good.

The light modulation device 94 includes, for example, three transmissive liquid crystal panels corresponding to the three primary colors of RGB, and modulates light passing through the liquid crystal panels to generate image light. Light from the illumination optical system 92 is separated into three color lights of RGB, and each color light is incident on each corresponding liquid crystal panel. The color lights modulated by passing through each liquid crystal panel are synthesized by a synthesizing optical system such as a cross dichroic prism and emitted to the projection optical system 96 .
The projection optical system 96 includes a zoom lens for enlarging/reducing an image to be projected and adjusting the focus, a zoom adjustment motor for adjusting the degree of zoom, a focus adjustment motor for adjusting the focus, and directing projection light to the screen SC. It is equipped with a concave mirror or the like that reflects light. The projection optical system 96 adjusts the zoom and focus of the image light modulated by the light modulator 94, guides the light that has passed through the lens group toward the screen SC by a concave mirror, and forms an image on the screen SC. The projection unit 90 includes a projection optical system driving unit 64 that performs focus adjustment and zoom adjustment by driving motors included in the projection optical system 96 under the control of the control unit 80, and an illumination optical system under the control of the control unit 80. A light source driver 66 for driving the light source provided in 92 is connected. The specific configuration of the projection optical system 96 is not limited to the above example. For example, by a configuration that does not use a mirror including a concave mirror, the light modulated by the light modulation device 94 is projected onto the screen SC by a lens to form an image. It is also possible to let

On the other hand, the image processing system includes a control unit 80 that controls the entire projector 10, a storage unit 85, an operation detection unit 18, an image processing unit 30, an annotation drawing unit 40, a GUI generation unit 50, an image synthesis unit 60, and an optical system. A modulator driver 62 is provided.
The storage unit 85 stores a control program executed by the control unit 80 and data processed by each functional unit including the control unit 80 .
The operation detection unit 18 detects an operation instruction sent from the operation panel 19 or a remote controller (not shown), and sends information on the detected operation instruction to the control unit 80 .
The image processing unit 30 processes the image signal generated by the WB function sent via the input signal switching unit 14 and the image signal input to the image data input unit 12 .

The image processing unit 30 appropriately executes various conversion processes such as interlace/progressive conversion, resolution conversion, and color conversion on the input image signal, generates image data in a preset format, and stores the data in the frame memory 35. Expand the image for each frame. The image data developed in the frame memory 35 is output to the video synthesizing section 60 .
The annotation drawing unit 40 has a function of drawing an image object drawn with the pointer 70 so as to be superimposed on an image based on input image data. For example, when a computer device is the input source (first input source), lines, graphics (annotations), etc. are superimposed and drawn on a window displayed by an application program running on the computer device. The image data to which the image object has been added by the annotation rendering unit 40 is output to the video composition unit 60 .

The GUI generator 50 generates a GUI (Graphical User Interface) screen to be projected onto the screen SC. For example, when the projector 10 is in the WB mode or the external input mode and is projecting an image based on image data supplied from one of the input sources (second input source), the GUI generation unit 50 generates a plurality of input A 2-screen button 230 is generated as an instruction area (GUI screen) in which the 2-split display by the source can be indicated by the pointer 70 . The generated image data of the dual-screen button 230 is output to the video synthesizing section 60 .
Based on the image data for each frame sent from the image processing unit 30, the video synthesizing unit 60 synthesizes the image data sent from the annotation drawing unit 40 and the image data sent from the GUI generating unit 50 to create a synthesized image. Generate. The generated image data is output to the light modulation device driving section 62 .
The image processing unit 30, the annotation drawing unit 40, the GUI generating unit 50, and the image synthesizing unit 60 described above correspond to an image generating unit that synthesizes a plurality of images to generate a synthesized image.
Note that the control unit 80 may perform trapezoidal distortion correction and pincushion distortion correction on the image data generated by the video synthesizing unit 60 .

The light modulation device driving section 62 drives the light modulation device 94 based on the image data output from the image synthesizing section 60 to perform drawing.
Next, FIGS. 3 to 5 are flowcharts showing the flow of processing (control method) for split display. 6, 7A to 7F, 8A to 8D, and 9A to 9C will be referred to for easy understanding of the two-split display process.
For example, as shown in FIG. 7A, a first projection screen 210 including a UI image 215A is projected onto the screen SC, and the left end of the first projection screen 210 includes a first dual screen button 230A. It is assumed that the projection screen 210 includes a second two-screen button 230B at the right end. In the first projection screen 210 shown in FIG. 7A, an image (first image) generated based on an image signal (first image signal) output by the computer device in the external input mode is projected onto the screen SC. is the screen. Here, the second projection screen 220, which is an image (second image) generated based on the image signal (second image signal) output by the WB function unit 16, is not displayed.

In this state, when the indicator 70 operated by the operator clicks the dual-screen button 230 (first dual-screen button 230A, second dual-screen button 230B) projected on the screen SC, the screen is split into two. Display processing is performed.
When this process is executed, the control unit 80 first determines whether or not the user has moved beyond a predetermined distance while the dual screen button 230 is clicked (step S100).
Here, if it is determined that the 2-screen button 230 has been clicked and moved beyond a predetermined distance (Yes in step S100), a drag process of the 2-screen button 230 (step S120) is executed, and the process ends. . Details of the drag processing (step S120) of the dual screen button 230 will be described later.

On the other hand, if it is determined that the clicked dual-screen button 230 has not moved beyond the predetermined distance (No in step S100), the control unit 80 releases (drops) the clicked dual-screen button 230. It is determined whether or not it has been done (step S102).
Here, if it is determined that the clicked dual-screen button 230 has not been released (No in step S102), the process ends.
On the other hand, if it is determined that the clicked dual screen button 230 has been released (Yes in step S102), the control unit 80 determines whether or not the two screens are projected and displayed on the screen SC. (Step S104).
Here, when it is determined that two screens are projected and displayed on the screen SC (Yes in step S104), the release process (step S140) during the two-split display is executed, and the process ends. The details of the release process (step S140) during the two-split display will be described later.

On the other hand, when it is determined that the two screens are not projected on the screen SC (No in step S104), the control unit 80 determines whether the first two screen button 230A projected on the left end has been released. (step S106).
Here, if it is determined that the first dual-screen button 230A has been released (Yes in step S106), the control unit 80 selects the reference line 250D assumed second from the left of the plurality of reference lines 250 (FIG. 6). are displayed as boundaries (step S108), and the process ends.
On the other hand, if it is determined that the second dual-screen button 230B has been released (No in step S106), the control unit 80 selects the reference line 250B assumed second from the right of the plurality of reference lines 250 (FIG. 6). are displayed as boundaries (step S110), and the process ends.

Here, reference line 250 will be described with reference to FIG.
FIG. 6 is a diagram showing positions of a plurality of reference lines 250. As shown in FIG. In this embodiment, it is assumed that the number of pixels constituting the projected screen is 1280 pixels in the horizontal direction and 800 pixels in the vertical direction. However, the size of the screen and the number of pixels are not limited. The number of reference lines 250 is the number obtained by adding 2 (corresponding to both ends) to the number of divisions.
In this embodiment, the left end of the projected screen is the origin, and the position of the right end is 1280 degrees. Also, the position Mn indicating the n-th reference line 250 from the origin side (where n is a natural number within the range of 1 or more and (the number of divisions + 2) or less) is given by equation (1). This position Mn indicates a division position where two projection screens can be divided.

Therefore, the first reference line 250E is the origin from equation (1). Similarly, the position of the second reference line 250D is 320, the position of the third reference line 250C is 640, the position of the fourth reference line 250B is 960, and the position of the fifth reference line 250A is 1280.
Also, the switching range R for switching to the adjacent reference line 250 is given by equation (2).

Therefore, the switching range R is 160 in this embodiment. If this switching range R is applied to FIG.
Further, in the present embodiment, the relationship between the position PX of the dual screen button 230 and the displayed reference line 250 is given by Equation (3).

Therefore, when the position PX of the dual screen button 230 is within the range shown by the formula (3), the control section 80 displays the n-th reference line 250 from the origin side.
According to the above description, in step S108, as shown in FIG. 8C, the display is divided into two so that the position of the second reference line 250D becomes the boundary.
The control unit 80 generates the UI image 215D based on the size of the first projection screen 210 in the external input mode, and projects it onto the screen SC. Further, the control unit 80 projects the drawable area in the WB mode onto the screen SC in white with the size of the second projection screen 220 .

Further, the control unit 80 projects the third two-screen button 230C generated by the GUI generation unit 50 to the boundary position between the first projection screen 210 and the second projection screen 220 . It should be noted that the third dual-screen button 230C can be clicked with the indicator 70 and dragged in the horizontal direction, like the first dual-screen button 230A and the second dual-screen button 230B. Further, the third two-screen button 230C is generated so that it can be identified whether the clicked portion is on the left or right side of the user.
Similarly, in step S110, as shown in FIG. 8A, the display is divided into two so that the position of the fourth reference line 250B serves as a boundary.

The control unit 80 generates the UI image 215B based on the size of the first projection screen 210 in the external input mode, and projects it on the screen SC. Further, the control unit 80 projects the drawable area in the WB mode onto the screen SC in white with the size of the second projection screen 220 .
FIG. 4 is a flow chart showing the flow of the process of dragging the dual screen button 230 (step S120).
In the following description, in the state of FIG. 7A, the indicator 70 operated by the operator drags the second dual-screen button 230B projected on the right end of the first projection screen 210, and As shown in FIG. 7F, it is assumed that the robot has moved beyond a predetermined distance.
First, on the first projection screen 210, the control unit 80 places the second two-screen button 230B at the center position in the horizontal direction at a position that is the boundary between the first projection screen 210 and the second projection screen 220. A guide line 240, which is a boundary line indicating , is drawn in the vertical direction (step S122).

When the dual screen button 230 is clicked and dragged, the guide line 240 moves following the moving dual screen button 230 . Also, the dual-screen button 230 can move up and down along the guide line 240 .
Next, the control unit 80 draws the reference line 250 according to the position of the second dual screen button 230B that is moving (step S124). That is, the control unit 80 projects the first projection screen 210 with the reference line 250 added to the division position closest to the position of the guide line 240 .
When the second dual screen button 230B is positioned as shown in FIG. 7B, that is, it is on the right side of the branch position (1120) between the fourth reference line 250B and the fifth reference line 250A. Therefore, the control unit 80 draws the fifth reference line 250A.
Next, the control unit 80 determines whether or not the second dual screen button 230B has been released (step S126).
Here, if the second dual screen button 230B has not been released (No in step S126), the process ends. In this case, the drag process (step S120) of the dual-screen button 230 is executed again after a predetermined period of time has elapsed.

For example, as shown in FIG. 7C, while the second dual-screen button 230B is clicked, move further to the left and move from the branch position (1120) between the fourth reference line 250B and the fifth reference line 250A. When it becomes the left side, the control unit 80 draws the fourth reference line 250B instead of the fifth reference line 250A.
Further, as shown in FIG. 7D, while the second dual-screen button 230B is clicked, it moves further to the left, and moves further to the left than the branch position (480) of the second reference line 250D and the third reference line 250C. When it is on the right side, the control section 80 draws the third reference line 250C.

In addition, as shown in FIG. 7E, while the second dual-screen button 230B is clicked, it moves further to the left, and moves further to the left than the branch position (480) of the second reference line 250D and the third reference line 250C. When it becomes the left side, the control section 80 draws the second reference line 250D.
Further, as shown in FIG. 7F, while the second dual-screen button 230B is clicked, it moves further to the left, and moves further to the left than the branch position (160) between the first reference line 250E and the second reference line 250D. When it is on the left side, the control unit 80 draws the first reference line 250E.
Returning to FIG. 4, when the second dual screen button 230B is released in step S126 (Yes in step S126), the control unit 80 erases the drawn guide line 240 and reference line 250 (step S128).

Next, the control unit 80 determines whether or not the position of the erased reference line 250 is at the left end or the right end of the first projection screen 210 (step S130).
Here, if the position of the erased reference line 250 is the left end or the right end of the first projection screen 210 (Yes in step S130), the control unit 80 displays only the current external input mode on one screen ( Step S134), the process ends.
For example, when the second dual screen button 230B is released in the state shown in FIG. 7B, the controller 80 projects the first projection screen 210 onto the screen SC as shown in FIG. 7A.
When the second dual screen button 230B is released in the state shown in FIG. 7F, the controller 80 projects the second projection screen 220 onto the screen SC as shown in FIG. 8D.

A second projection screen 220 shown in FIG. 8D is a screen in which an image (second image) generated based on the image signal (second image signal) output by the WB function unit 16 is projected onto the screen SC. be.
In this embodiment, when the second projection screen 220 is displayed on one screen, the fourth dual screen button 230D is displayed at the left end, and the fifth dual screen button 230E is displayed at the right end. be.
On the other hand, if the position of the erased reference line 250 is neither the left end nor the right end of the first projection screen 210 (No in step S130), the control unit 80 displays two screens with a size corresponding to the position of the reference line 250. (step S132), and the process ends.

For example, when the second dual-screen button 230B is released while the fourth reference line 250B is displayed as shown in FIG. The screen 220 is divided into two left-enlarged sizes as shown in FIG. 8A and projected onto the screen SC.
Further, when the second two-screen button 230B is released while the third reference line 250C is being displayed as shown in FIG. The screen 220 is divided into two equal sizes as shown in FIG. 8B and projected onto the screen SC.
Further, when the second dual-screen button 230B is released while the second reference line 250D is displayed as shown in FIG. The screen 220 is divided into two halves of the right enlarged size as shown in FIG. 8C and projected onto the screen SC.

In this embodiment, a case has been described in which the second dual-screen button 230B is clicked and moved leftward from the right end. Since the flow of processing for the control unit 80 to control the projection is the same even when it is moved in the right direction from the top, the description will be omitted.
Further, the above-described drag processing (step S120) of the dual-screen button 230 is not limited to a mode starting from the single-screen display state as shown in FIG. 7A. It is also conceivable to start from a state in which one projection screen 210 and a second projection screen 220 are displayed in the same size and divided into two.
For example, as shown in FIG. 9A, with the third two-screen button 230C clicked, move leftward to the right of the branch position (480) between the second reference line 250D and the third reference line 250C. , the control unit 80 draws the third reference line 250C.

Also, as shown in FIG. 9B, while the third two-screen button 230C is clicked, it moves to the left and moves to the left of the branch position (480) between the second reference line 250D and the third reference line 250C. , the controller 80 draws the second reference line 250D instead of the third reference line 250C.
In addition, as shown in FIG. 9C, while the third dual-screen button 230C is clicked, it moves further to the left, and moves further to the left than the branch position (160) between the first reference line 250E and the second reference line 250D. When it becomes the left side, the control unit 80 draws the first reference line 250E instead of the second reference line 250D.

FIG. 5 is a flow chart showing the flow of the release process (step S140) of the third dual-screen button 230C displayed when two screens are displayed.
First, as shown in FIG. 8C, the control unit 80 determines whether or not the position where the third dual-screen button 230C is drawn is on the second reference line 250D (step S142).
Here, if the position where the third dual-screen button 230C is drawn is on the second reference line 250D (Yes in step S142), the control unit 80, in the case of leftward movement, moves as shown in FIG. 8D. The display is made on one screen, and in the case of rightward movement, the display is divided into two along the third reference line 250C as shown in FIG. 8B (step S146), and the process ends.
On the other hand, if the position where the third dual-screen button 230C is drawn is not on the second reference line 250D (No in step S142), the controller 80 determines that the third dual-screen button 230C is drawn. It is determined whether or not the position is on the (n-2)th reference line 250 (step S148).

Here, if the position where the third dual-screen button 230C is drawn is on the (n-2)-th reference line 250 (Yes in step S148), the control unit 80, in the case of left movement, ( The display is divided into two by the (n-3)th reference line 250, and in the case of rightward movement, the display is divided into two by the (n-1)th reference line 250 (step S150), and the process ends.
On the other hand, if the position where the third dual screen button 230C is drawn is not on the (n-2)th reference line 250 (No in step S148), the control unit 80, in the case of left movement, The display is divided into two at the n-2)-th reference line 250, and in the case of right movement, the display is made in one screen, and the process ends.
In the processing described above, by clicking and dragging the dual-screen button 230 with the indicator 70 and releasing it at a desired position, the guide line 240 and the reference line 250 are drawn, and switching between single-screen display and dual-split display is performed. However, it is not limited to this method.

For example, as shown in FIG. 8A, when the display is divided into two by the fourth reference line 250B, the control unit 80 detects one click on the right part of the third two-screen button 230C, and the display is as shown in FIG. 7A. transition to single-screen display in the external input mode.
On the other hand, when the control unit 80 detects one click on the left portion of the third two-screen button 230C, the control unit 80 makes a transition to the state of being divided into two by the third reference line 250C on the left as shown in FIG. 8B.
Similarly, when the control unit 80 detects one click on the left part of the third dual screen button 230C in FIG. 8B, it transitions to the state of being divided into two by the second reference line 250D on the left as shown in FIG. 8C. Let

Furthermore, when the control unit 80 detects one click on the left portion of the third two-screen button 230C in FIG. 8C, the control unit 80 makes a transition to the one-screen display in the WB mode as shown in FIG. 8D.
In this manner, the control unit 80 moves the boundary line to the first division position (reference line 250) adjacent to the reference line 250 indicating the current division position in response to the click of the dual screen button 230. FIG.
FIG. 10 is a flow chart showing the flow of processing for determining the source to be displayed in the case of two-split display.
First, the control unit 80 determines whether or not the current source displayed on one screen is the desired source (step S172). In this embodiment, the desired source is assumed to be an input source in WB mode, but is not limited to this. It is also conceivable that the desired source is changed by the user's setting.

Here, if the current source being displayed on one screen is the desired source (Yes in step S172), the control unit 80 acquires information about the last projected source before the desired source is projected. Then, the desired source and the last projected source are split left and right and displayed in two splits (step S176), and the process ends. Information about the last projected source may be stored in the storage unit 85 .
On the other hand, if the current source being displayed on one screen is not the desired source (No in step S172), the control unit 80 splits the current source and the desired source into left and right and displays them in two splits (step S174), the process ends.
In this embodiment, as shown in FIG. 8D, when single-screen display by the second projection screen 220 corresponding to the WB mode is selected, the fourth dual-screen button 230D or the fifth dual-screen button 230E is clicked. By moving it in the left-right direction, it is possible to display a first projection screen 210 and a second projection screen 220 by another source (external input mode, for example). In such a case, the projector 10 can set the direction in which the second projection screen 220 is preferentially displayed.

FIG. 11 is a diagram for explaining the direction in which the second projection screen 220 is preferentially displayed. The operator can set any one of "left direction", "right direction", and "no direction setting" as a region in which the second projection screen 220 is preferentially displayed. Information about the set display direction may be stored in the storage unit 85 .
First, the case where "left direction" is set will be described. The screen image SC1 shows a state in which the operator operates the indicator 70 and draws on the second projection screen 220 displayed in one screen.
Here, when the operator clicks the fourth dual-screen button 230D with the pointer 70 and moves it to the right, the control unit 80 displays the left side of the second projection screen 220 as in the screen image SC4. The second projection screen 220 is moved rightward while the area is displayed preferentially, and the first projection screen 210 is displayed on the left side according to the size of the area left by the movement of the second projection screen 220. Let
Further, when the operator clicks the fifth dual-screen button 230E with the pointer 70 and moves it leftward, the control unit 80 displays the area on the left side of the second projection screen 220 as in the screen image SC5. is displayed preferentially, the left end of the first projection screen 210 is moved leftward, and the first projection screen 210 is displayed on the right side according to the size of the moved area.

Next, a case where "right direction" is set will be described.
Similarly to the "leftward direction", when the operator clicks the fourth dual-screen button 230D with the indicator 70 to move it rightward from the state of the screen image SC1, the control unit 80 causes the screen image SC2 to move to the right. , while the right area of the second projection screen 220 is preferentially displayed, only the left end is moved rightward, and the size of the area determined by the movement of the left end of the second projection screen 220 is , the first projection screen 210 is displayed on the left side.
Further, when the operator clicks the fifth dual-screen button 230E with the pointer 70 and moves it leftward, the control unit 80 displays the area on the right side of the second projection screen 220 as in the screen image SC3. is displayed preferentially, the second projection screen 220 is moved leftward, and the first projection screen 210 is displayed on the right side in accordance with the size of the area vacated by the movement.

By setting the above-mentioned "rightward direction" or "leftward direction", it is useful when adding a note or the like to the right or left side of the second projection screen 220 in the WB mode.
Further, when "no direction setting" is set, when the operator clicks the fourth dual-screen button 230D with the indicator 70 and moves it rightward from the state of the screen image SC1, the controller 80 is to move only the left edge of the second projection screen 220 to the right in a state where the second projection screen 220 is displayed, as in the screen image SC2. Then, the first projection screen 210 is overwritten on the left side of the second projection screen 220 and displayed.
Further, when the operator clicks the fifth dual-screen button 230E with the pointer 70 and moves it leftward, the control unit 80 displays the second projection screen 220 like the screen image SC5. to match the size of the area determined by the movement of the right end of the second projection screen 220, and overwrite the first projection screen 210 on the right side of the second projection screen 220. to display.

Note that the GUI generation unit 50 generates the dual screen button 230 based on the data stored in the storage unit 85 . At that time, the GUI generation unit 50 determines the icon to be displayed on the dual-screen button 230 according to the display mode, that is, the single-screen display or the two-split display. For example, in the case of single-screen display in WB mode as shown in FIG. adopt. In the case of single-screen display in the external input mode as shown in FIG. 7A, the GUI generator 50 adopts an icon corresponding to the WB mode that is newly displayed by moving the double-screen button 230 .

When there are a plurality of selectable input sources, the GUI generation unit 50 generates dual-screen buttons 230 including icons corresponding to the respective input sources, and the control unit 80 distributes the generated dual-screen buttons 230 to the 2 may be arranged on the projection screen 220 and displayed so as to be selectable by the indicator 70 .
For example, as shown in FIG. 7A, when the single-screen display is performed in the external input mode, the selectable input source is the WB mode (first source), and the image that is the basis of the image displayed on the first projection screen 210. When the computer device (second source) connected to the input terminal other than the input terminal to which the computer device outputting the signal is connected can be selected, as shown in FIG. 12, the WB mode is selected. In addition to the first dual-screen button 230A and second dual-screen button 230B (first indication area) containing corresponding icons, the image signal that is the basis of the image displayed on the first projection screen 210 is displayed. A sixth dual-screen button 230F and a seventh dual-screen button 230G (second instruction area) including an icon corresponding to a computer device other than the computer device that is outputting (or an input terminal to which this computer device is connected) ) may be displayed.

According to the embodiment described above, the following effects are obtained.
(1) The operator holds the indicator 70 and clicks and moves the dual screen button 230 projected on the screen SC by the projector 10 with the indicator 70, so that the reference line 250 indicating the splittable position is drawn. It is displayed according to the moved position, and by releasing the indicator 70, two screens are displayed by two input sources with the displayed reference line 250 as the division position. Therefore, the operator can easily set the division position for two-screen display, and can display two screens divided at desired division positions.
(2) Every time the 2-screen button 230 is clicked with the indicator 70, the split position for the 2-screen display is changed, so the operator can easily change the split position for the 2-screen display.

(3) When the projector 10 performs two-screen display, an image from a desired source is projected on one of the screens, so the operator can easily display the image from the desired source.
(4) The operator can set any one of "left direction", "right direction", and "no direction setting" as the region in which the second projection screen 220 is preferentially displayed. According to the content to be displayed on the projection screen 220 of No. 2, the place to be displayed with priority can be flexibly set.

Although the present invention has been described above based on the illustrated embodiments, the present invention is not limited to these embodiments, and modifications such as those described below can be assumed.
(1) When the two-screen button 230 is instructed in the single-screen display state to switch to the two-screen display, the control unit 80 performs signal determination processing using the video signal from the input source displaying the single-screen as the main signal. is not applied, and the video signal to be added in the two-screen display is used as a sub-signal and subjected to signal discrimination processing for switching. As a result, it is possible to avoid deterioration in visibility due to flickering of the image from the input source that has been displayed on a single screen.

(2) The projector 10 is installed directly above the screen SC and employs a short focus type that projects an image obliquely downward, but is not limited to this as long as an interactive function can be realized. For example, it may be a long focus type that is installed facing the screen SC.
(3) When two screens are displayed, it is assumed that the two screens are arranged horizontally with respect to the screen SC, but it is also possible to arrange them vertically. Also, it is possible to assume a mode in which the operator instructs the arrangement direction. Moreover, division is not limited to two screens, and may be three or more screens.

(4) Although the light modulation device 94 has been described using three transmissive liquid crystal panels corresponding to each color of RGB as an example, it is not limited to this. For example, a configuration using three reflective liquid crystal panels may be used, or a system in which one liquid crystal panel and a color wheel are combined may be used. Alternatively, a system using three digital mirror devices (DMD), a DMD system combining one digital mirror device and a color wheel, or the like may be used. If only one liquid crystal panel or DMD is used as the light modulator, a member corresponding to the synthesizing optical system such as the cross dichroic prism is unnecessary. In addition to liquid crystal panels and DMDs, any light modulation device capable of modulating light emitted from a light source can be employed.

Moreover, the device that implements the above technique may be realized by a single device, or may be realized by combining a plurality of devices, and includes various modes.
Also, each functional unit of the image processing system shown in FIG. 2 shows a functional configuration realized by cooperation between hardware and software, and the specific implementation form is not particularly limited. Therefore, it is not always necessary to mount hardware corresponding to each functional unit individually, and it is of course possible to implement the functions of a plurality of functional units by one processor executing a program. Further, a part of the functions realized by software in the above embodiments may be realized by hardware, or a part of the functions realized by hardware may be realized by software.

DESCRIPTION OF SYMBOLS 10... Projector 12... Image data input part 14... Signal switching part 16... WB function part 18... Operation detection part 19... Operation panel 20... Position detection part 22... Coordinate calculation part 24... Indicator Detector 26 Imaging unit 30 Image processing unit 35 Frame memory 40 Annotation drawing unit 50 GUI generation unit 60 Video synthesizing unit 62 Light modulation device driving unit 64 Projection optical system Drive unit 66 Light source drive unit 70 Indicator 71 Axle 72 Operation switch 80 Control unit 85 Storage unit 90 Projection unit 92 Illumination optical system 94 Light modulation device , 96... Projection optical system 200... Drawing image 210... First projection screen 215A... UI image 215B... UI image 215C... UI image 215D... UI image 220... Second projection screen 230... Dual screen button 230A... 1st dual screen button 230B... 2nd dual screen button 230C... 3rd dual screen button 230D... 4th dual screen button 230E... 5th dual screen button 240 ... guide line, 250 ... reference line, 250A ... fifth reference line, 250B ... fourth reference line, 250C ... third reference line, 250D ... second reference line, 250E ... first reference line, SC …screen.

Claims (8)

A first image based on a first image signal input from a first input source, and a second image based on a second image signal input from a second input source different from the first input source ,
and an image generation unit that generates a composite image including a boundary line indicating a position serving as a boundary between the first image and the second image;
a display unit that displays the composite image generated by the image generation unit on a display surface;
a detection unit that detects a position of an indicator with respect to the display surface;
a control unit that causes the image generation unit to generate the composite image in which the boundary line has moved based on the position of the pointer detected by the detection unit;
The control unit
When the display unit displays the first image on the display surface and does not display the second image on the display surface, a position other than the edge of the synthesized image from the edge of the synthesized image when it is determined that the boundary line has moved to, causing the image generating unit to generate the composite image including the second image based on the moved boundary line;
A first indicating area, which can be indicated by the pointer, according to the first source when the second input source is selectable from a plurality of sources including a first source and a second source. and a second pointing area different from the first pointing area that can be pointed with the pointing body according to the second source. A display device characterized by: The display device according to claim 1,
The control unit adds a reference line to the dividing position closest to the boundary line among a plurality of division positions at which the first image and the second image can be divided in the composite image. is generated by the image generator. The display device according to claim 2,
The control unit causes the image generation unit to generate the synthesized image in which the first indication area is superimposed on the boundary, and the first indication area of the synthesized image displayed on the display surface corresponds to the indication object. and moving the boundary line of the composite image to a first division position adjacent to the boundary among the plurality of division positions, when the click is detected. The display device according to claim 3,
A display device, wherein the first indication area is movable along the boundary line. The display device according to claim 1,
When arranging the second image in a partial area of the synthesized image in which the first image was arranged based on the boundary, the control unit arranges the first image based on set information. A display device that determines an area in which an image is preferentially displayed. The display device according to claim 1,
The display device
an image data input unit;
and a whiteboard function unit,
The first image signal is an image signal input to the image data input unit,
The display device, wherein the second image signal is an image signal generated by the whiteboard function unit. A first image based on a first image signal input from a first input source, and a second image based on a second image signal input from a second input source different from the first input source ,
and a boundary line indicating a position of the boundary between the first image and the second image;
displaying the generated synthetic image on a display surface;
detecting a position of an indicator relative to the display surface;
generating the composite image in which the boundary line is moved based on the detected position of the indicator;
When the first image is displayed on the display surface and the second image is not displayed on the display surface, the boundary line extends from the edge of the synthesized image to a position other than the edge of the synthesized image. generating the composite image including the second image based on the boundary line that has moved if it is determined to have moved;
A first indicating area, which can be indicated by the pointer, according to the first source when the second input source is selectable from a plurality of sources including a first source and a second source. and generating the composite image in which a second pointing area different from the first pointing area, which can be pointed by the pointing body and which corresponds to the second source, is arranged. Display device control method. A first image based on a first image signal input from a first input source, and a second image based on a second image signal input from a second input source different from the first input source an image generator that generates a composite image including
a display unit that displays the composite image generated by the image generation unit on a display surface;
a detection unit that detects a position of an indicator with respect to the display surface;
the first image and the second image based on the position of the pointer detected by the detection unit;
a control unit that causes the image generation unit to generate the composite image in which the boundary of
The control unit
When the display unit displays the first image on the display surface and does not display the second image on the display surface, the position of the pointer detected by the detection unit is displayed in the synthesized image. causing the image generation unit to generate the composite image including the second image based on the position of the pointer that has moved from the end of the composite image to a position other than the end of the composite image;
A first indicating area, which can be indicated by the pointer, according to the first source when the second input source is selectable from a plurality of sources including a first source and a second source. and a second pointing area different from the first pointing area that can be pointed with the pointing body according to the second source. A display device characterized by:

Images