JP2017117020A - Display device, display system, and method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To perform a process, such as writing, on a target separate screen, without requiring a user to move to a writing position when writing by use of an interactive function during projection of a plurality of image screens.SOLUTION: A display device comprises: a video editing section that produces a plurality of separate display screens corresponding to a plurality of images input via a network from a plurality of image processing device, and an image including copied separate display screens; a writing area management section that displays the copied separate display screens, obtained by copying the separated display screens, in a predetermined interactive process target area; an interactive communication section that informs the image processing devices of the contents of an interactive process on the basis of an interactive process for the copied separate display screens displayed in the interactive process target area, and causes the image processing device to perform an interactive process; and a projecting section that displays, as a projection image, an image after the interactive process formed by the video editing section.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a display device, a display system, and a method.

Conventionally, an interactive function has been proposed in which characters and figures can be written on a projection screen by an instruction device such as a remote controller, and a computer as a projector or an image supply device can be controlled. This function is realized by controlling the computer side by detecting the position specified by the pointing device on the projector side with a camera, laser curtain, etc., and sending the information to a computer connected to the projector via a cable or network. Yes.
In such a projector having an interactive function, a projector that has received input from a plurality of computers divides the entire projection screen into a plurality of divided display screens, and assigns and displays video from the computer for each of the divided display screens. A projection method called multi-screen projection has also been proposed (see, for example, Patent Document 1).

  However, when multiple screens are projected, if the pen-type pointing device is used to write on the projection surface using interactive technology on the split display screen, the layout of the split display screen assigned to each image supply device is fixed. Therefore, there is a problem that the user has to move to a position where the divided display screen to be written is displayed. In particular, such a situation occurred remarkably when a large screen was projected.

  The present invention has been made in view of the above, and when performing writing using an interactive function when projecting a plurality of screens, the user can perform processing such as writing on the target divided screen without moving to the writing position. An object of the present invention is to provide a display system, method, and program having interactive functions that can be performed.

  In order to solve the above-described problems and achieve the object, the display device of the present invention includes a plurality of divided display screens and a duplicated divided display screen corresponding to a plurality of images input from a plurality of image processing devices via a network. A video editing unit that generates an image including the image, a writing area management unit that displays a duplicate divided display screen obtained by duplicating the divided display screen in a predetermined interactive processing target area, and a duplicate divided display screen displayed in the interactive processing target area Based on the interactive processing, the interactive processing unit that notifies the image processing device of the interactive processing content and causes the image processing device to perform the interactive processing, and the image after the interactive processing generated by the video editing unit as a projection image And a projection unit for displaying.

  According to the present invention, interactive processing can be performed on a duplicate split display screen displayed in the interactive processing target area separately from a plurality of split display screens, so that the target split screen can be obtained without the user moving to the writing position. This produces an effect that interactive processing such as writing can be performed.

FIG. 1 is a schematic configuration block diagram of an interactive projection system according to an embodiment. FIG. 2 is a schematic block diagram of the projector. FIG. 3 is a functional block diagram of the interactive projection system of the embodiment. FIG. 4 is a diagram for explaining a situation when the interactive function is used when projecting a plurality of screens. FIG. 5 is an explanatory plan view of the example of FIG. FIG. 6 is a processing flowchart when the interactive function of the entire interactive projection system of the embodiment is used. FIG. 7 is an explanatory diagram of the coordinate conversion process. FIG. 8 is a flowchart of basic control processing according to the embodiment. FIG. 9 is an explanatory diagram of the inquiry dialog screen for using the write area. FIG. 10 is an explanatory diagram of a normal projection result of a plurality of screens. FIG. 11 is an explanatory diagram of a display screen when a writing area is set. FIG. 12 is an explanatory diagram of a display screen after the replication division display screen is displayed. FIG. 13 is an explanatory diagram of an operation at the time of writing on the copy division display screen. FIG. 14 is an explanatory diagram of a first modification of the embodiment. FIG. 15 is an explanatory diagram of a second modification. FIG. 16 is a process flowchart of the third modification. FIG. 17 is a process flowchart of the fourth modified example. FIG. 18 is a process flowchart of the fifth modification. FIG. 19 is a process flowchart of the sixth modification. FIG. 20 is an explanatory diagram of a specific screen configuration example regarding the screen configuration of the writing area. FIG. 21 is an explanatory diagram of an eighth modification. FIG. 22 is a process flowchart of the ninth modification.

Next, preferred embodiments will be described with reference to the drawings.
FIG. 1 is a schematic configuration block diagram of an interactive projection system according to an embodiment.

  The interactive projection system 10 includes a plurality (four in the example of FIG. 1) of information processing devices (computers) 11-1 to 11-4 that function as video (image) data output devices, and an information processing device 11-1. To 11-4 via the communication network 12 and corresponding to the video data output from each of the information processing apparatuses 11-1 to 11-4 (corresponding to the divided display screens P1 to P4 in the case of FIG. 1). Are connected to the projector 13 via the wireless communication network 14, and communicates interactive control data to the operator (user). Includes a remote operation device (indicator) 15 for performing an interactive operation.

  The information processing apparatuses 11-1 to 11-4 are configured as so-called computers that include an external storage device such as an MPU, ROM, RAM, hard disk drive, SSD (Solid State Drive), communication interface, and the like (not shown). In the following description, when there is no need to identify the information processing apparatuses 11-1 to 11-4, the information processing apparatus 11 is described.

  The communication network 12 is configured by a wired communication line or a wireless communication line via a LAN cable or the like. Through the communication network 12, the information processing apparatuses 11-1 to 11-4 and the projector 13 can transmit / receive various data to / from each other.

FIG. 2 is a schematic block diagram of the projector.
The projector 13 is roughly divided into an MPU 22 that controls the entire projector via the system bus 21, a memory area that temporarily stores data, a RAM 23 that also functions as a work area of the MPU 22, and processing of the MPU 22. A ROM 24 that stores necessary programs and data in a nonvolatile manner, an operation reception unit 25 that functions as a human interface for receiving various operations performed by an operator (user), and a USB (Universal Serial Bus) cable are connected to each other in accordance with the USB standard. Wireless communication network 14 for various data (measurement data, interactive related data) between the USB I / F port 26 for performing the data communication and the remote operation device 15 and between the information processing devices 11-1 to 11-4. Wireless unit 27 for transmitting and receiving via A video signal I / F 28 for performing an input interface operation of video data output from the information processing apparatuses 11-1 to 11-4, a DMD, a color wheel, a liquid crystal display panel, an optical lens system, and the like are provided, and an image is predetermined. An optical unit 29 that projects onto the projection surface; and a video signal processing unit 30 that processes video data input via the video signal I / F 28 and outputs the processed data to the optical unit 28 to project the video. ing.

FIG. 3 is a functional block diagram of the interactive projection system of the embodiment.
The information processing apparatus 11 of the interactive projection system 10 functions as an operation means 31 for performing various operations by an operator, an interactive communication means 32 for performing interactive communication with other apparatuses, and a video output means 33 for outputting video data. To do.

  The projector 13 includes a video input receiving unit 41 for receiving video data output from the video data output device, a projection unit 42 for projecting an image based on the video data onto a projection plane, and editing such as scaling for the projection target video. Video editing means 43 for performing, position coordinate calculating means 44 for calculating the writing position (pen coordinate position) on the projection image based on the measurement data received from the remote operation device, and interactive communication with other devices. Interactive communication means 45 to perform, projector operation information conversion means 46 for converting operation of a writing position (pen coordinate position) on a projected image or an operation element such as a button into operation information of a projector such as menu operation, projector operation information conversion means The writing position information and the operation element operation information converted by 46 are used as the operation information of the information processing apparatus 11. In other words, the PC operation information conversion unit 47 that transmits information to the information processing apparatus 11 by the interactive communication unit, the creation position of the writing area for allowing the operator to perform the writing operation on the projection screen projected on the projection plane, and It functions as a writing area management means 48 for managing the size of the writing area and a duplicate divided display screen management means 49 for managing the position and size of the divided screen to be duplicated in the writing area on the projection screen.

  The remote operation device 15 is interactive between the position information measurement means 51 for acquiring measurement data for specifying the writing position (pen coordinate position) on the projection image of the remote operation device 15 and other devices. It functions as interactive communication means 52 that performs related communication.

Next, prior to describing the operation of the embodiment, problems to be solved by the present embodiment will be described.
FIG. 4 is a diagram for explaining a situation when the interactive function is used when projecting a plurality of screens.

  In FIG. 4, for ease of understanding, it is assumed that nine information processing apparatuses 11 are connected to the projector 13 and nine divided display screens P1 to P9 are projected onto the projection surface on the projection screen SCR.

  In the initial state, the user U makes, for example, an image (content) displayed on the divided projection screen P9 as interactive processing by bringing the tip of the remote operation device into contact with the projection surface on the divided projection screen P9. It is assumed that comments and additional explanations are written.

  Then, if the writing on the divided projection screen P9 is completed and then writing is attempted on the divided projection screen P4 in the same manner, the current user U stands on the right side toward the projection screen, but the divided projection screen To write to P4, it must move to the left side toward the projection screen.

FIG. 5 is an explanatory plan view of the example of FIG.
In the case of the example in FIG. 4, there is no way to use the remote operation device 15 as a laser pointer, for example, without actually moving the user U, and to specify and write the position pointed to by the remote operation device 15. However, even with this method, the moving distance can be reduced. However, as shown in FIG. 5, the user U moves slightly away from the projection plane and forms an angle with respect to the projection plane. Otherwise, there is a possibility that it cannot be visually confirmed whether the written character or position is appropriate.
Accordingly, the present embodiment aims to construct an interactive projection system that allows a user to easily and reliably perform interactive processing such as writing processing on a target divided projection unit while minimizing user movement. It is said.

FIG. 6 is a processing flowchart when the interactive function of the entire interactive projection system of the embodiment is used.
The information processing apparatus 11 functions as the video output unit 33 and outputs video data (video signal) to the projector 13 via the communication network 12 (step S11).
As a result, the projector 13 receives the video data as the video input accepting unit, functions as the video editing unit 43 and the projecting unit 42, and is a position for specifying the operation position on the projection screen for the input video data. The pattern data for identification is added to the image corresponding to the video data and projected (step S12).
On the other hand, the remote operation device 15 functions as position information measurement means, detects pattern data from the projection screen, and functions as interactive communication means to transmit the detected pattern data to the projector 13 (step S13).

Thereby, the projector 13 functions as the position coordinate calculation means 44, and calculates the search target position coordinates of the start of the remote operation based on the transmitted pattern data (step S14).
Subsequently, the projector 13 functions as the PC operation information converting unit 47 to convert the calculated operation target position coordinates into operation data, and functions as the interactive communication unit 45 to transmit the operation data to the corresponding information processing apparatus 11 (step). S15).
Thereby, the information processing apparatus 11 functions as an interactive communication unit to receive operation data, performs a process based on the operation data transmitted as a function of the operation unit, and executes an operation (step S16).
As a result, in the information processing apparatus 11, for example, if an application having a drawing function is valid, characters and figures are drawn on the image.

Here, coordinate conversion of an image between the projector 13 and the information processing apparatus 11 will be described.
FIG. 7 is an explanatory diagram of the coordinate conversion process.
As an example, it is assumed that the information processing apparatus 11-2 inputs an image having a resolution of 1280 × 800 pixels to the projector 13 having a resolution of 1280 × 800 pixels.
In this case, the remote operation device 15 detects the pattern data from the image to which the pattern data for specifying the position is added, so that any one of the position coordinates (0, 0) to (1280, 800) is detected. Is detected as a position coordinate designated by the user and notified to the projector 13.
By the way, as described above, when the resolution of the projector 13 is equal to the resolution of the image, the position coordinate corresponding to the projector 13 is used as it is when the image input by one information processing apparatus 11-2 is displayed at maximum. It can be used as position coordinates in the image of the information processing apparatus 11-2.
However, as shown in FIG. 7, when 2 × 2 (= 4 screens) is projected and an image corresponding to the information processing apparatus 11-2 is displayed as the split display screen P2, the position coordinates of the projector 13 are displayed. Is used as the position coordinates of the information processing apparatus 11-2 as it is, it becomes possible to control only the region (640, 0) to (1280, 400) of the information processing apparatus terminal B.
For this reason, when the screen corresponding to the information processing device 11-2 is controlled by the remote operation device 15, the coordinates (640, 0) in the projector 13 are set to the coordinates (0, 0) in the information processing device 11-2. The coordinate information is converted so that the coordinates (1280, 400) in the projector 13 become the coordinates (1280, 800) in the information processing apparatus 11-2, and then the position information is provided to the information processing apparatus 11-2.

Next, the basic processing operation in the embodiment will be described.
FIG. 8 is a flowchart of basic control processing according to the embodiment.
First, when the user enables the interactive function of multi-screen projection (step S21), the user U can select whether or not to use the writing area at the start of multi-screen projection.

FIG. 9 is an explanatory diagram of the inquiry dialog screen for using the write area.
Therefore, as shown in FIG. 9, the projector 13 displays a dialog DLG for inquiring the user U about the use of the writing area on the projection screen SCR, and determines whether or not to use the writing area. (Step S22).

As a result, the user U uses the remote operation device 15 to select whether or not to use the writing area.
If it is determined in step S22 that the user U selects not to use the writing area (step S22; No), the process proceeds to using the multi-screen interactive function without performing the writing area setting process. The normal multi-screen projection process will be started.

FIG. 10 is an explanatory diagram of a normal projection result of a plurality of screens.
As shown in FIG. 10, on the projection screen SCR, four divided screens P1 to P4 corresponding to the number of information processing apparatuses 11-1 to 11-4 functioning as image supply apparatuses are displayed.

On the other hand, when the user U selects to use the writing area in the determination in step S22 (step S22; Yes), the projector 13 functions as the writing area management unit 48, and first of all, The display position and size are determined and stored (step S23).
FIG. 10 is an explanatory diagram of a display state of a plurality of divided display screens before the writing area composition.
Subsequently, the projector 13 functions as the video editing unit 43, and projects and displays an image in which the writing area is combined in addition to the plurality of divided screens based on the determined display position and size of the writing area (step). S24).
FIG. 11 is an explanatory diagram of a display screen when a writing area is set.
As shown in FIG. 11, a writing area AWR is inserted and displayed in the projection image G projected on the projection screen SCR.

  Next, the user U duplicates and displays it in the writing area among the plurality of displayed divided display screens (in the case of the example of FIG. 10, four divided display screens P1 to P4). For this purpose, one of the divided display screens is selected (step S25). In the following description, it is assumed that the split display screen P1 is selected.

Thereby, the projector 13 functions as a duplicate split display screen management means, and duplicate split display based on the split display screen P1 selected by the user U and the information of the plurality of split display screens P1 to P4 currently displayed. The display position and size of the screen (P1A) are determined and stored (step S26).
FIG. 12 is an explanatory diagram of a display screen after the replication division display screen is displayed.
As a result, the projector 13 functions as the video editing unit 43 and the projection unit 42, and synthesizes the duplicate divided display screen P1A on the writing area AWR based on the information on the duplicate divided display screen P1A as shown in FIG. Are projected and displayed on the projection screen SCR (step S27).

FIG. 13 is an explanatory diagram of an operation at the time of writing on the copy division display screen.
Then, when the user U performs arbitrary writing (“aiueo” in the example of FIG. 13) on the copy division display screen P1A captured and displayed in the writing area AWR, the same As a result of writing, the original divided display screen P1 is also reflected.
As described above, according to the present embodiment, the user U performs processing such as writing on the target divided screen without moving to the writing position when writing using the interactive function during multi-screen projection. It can be performed.

Next, a modification of the embodiment will be described.
[1] First Modified Example First, a first modified example in which the writing area AWR is set based on the user's dominant arm will be described.
When the user U writes on a projection plane perpendicular to the ground, the user U often writes facing the projection plane (the plane of the projection screen SCR).
Under this assumption, it is assumed that a right-handed user U writes a scene using the interactive function at the right end and the left end of the projection image.

FIG. 14 is an explanatory diagram of a first modification of the embodiment.
When the user U writes on the left end of the projection surface on the projection screen SCR, the user U can write without disturbing most of the projection light as shown on the left side of FIG.
On the other hand, when the user U tries to write on the right end of the projection surface on the projection screen SCR, the body of the user U overlaps with the projection light, and a shadowed portion is greatly generated.

A similar phenomenon occurs when a left-handed user writes on the left side of the projected image.
In order not to reproduce the above situation, the writing area position determining means determines where on the projection screen to display the setting position of the writing area AWR based on the information on the user's dominant arm.

  As for the information on the dominant arm, for example, as disclosed in Japanese Patent Application Laid-Open No. 2009-048238, an identification number is allocated to each user U, and the information on the dominant arm is associated with the allocated number and stored in the memory. Can be considered.

For example, when the user is a right-handed user, the writing area AWR is set at the left end of the projection plane, and when the user is a left-handed user, the writing area AWR is set at the right end of the projection plane. .
With the configuration as described above, it is possible to easily perform processing such as writing while suppressing occurrence of a shadow portion.

[2] Second Modification Next, when the installation position of the projection screen SCR, and hence the installation position of the projector 13, is fixed, the user U of the projection image uses the projection light of the projection screen SCR and the projector 13 to Since the projection image is projected on the user U by being positioned in the optical path, a state in which the distortion of the projection image G is detected on the outer periphery of the projection image G (four sides of the rectangular projection image region) is detected. Assumed.

FIG. 15 is an explanatory diagram of a second modification.
FIG. 15 illustrates a case where distortion of the projection image G is detected on the right side SD of the projection image G.
In the present modification, a fixed camera 61 is installed in order to detect distortion in the sides around the rectangular projected image G.

First, the fixed camera 61 captures a projection image when there is no shielding object between the projector 13 and the projection plane, and transmits the projection image to the projector 13 as a distortion determination reference image.
Thereby, the projector 13 stores the reference image for distortion determination.
The fixed camera 61 periodically captures a projection image and transmits it to the projector 13.

  Thereby, the projector 13 functions as a writing area management unit, compares the image periodically transmitted from the fixed camera 61 with the distortion determination reference image, and generates a distortion when a difference occurs for a certain time. It is determined that the user U is located on the side where the occurrence of occurrence is the largest (the right side SD in FIG. 15).

The projector 13 functions as a writing area management unit, and creates the writing area AWR on the side where the distortion is the largest.
As described above, according to the second modification, the setting position of the writing area AWR can be automatically obtained, and the writing area AWR is dynamically changed even when the user U changes the standing position. Can be set, improving usability.

[3] Third Modification Next, a third modification of the embodiment will be described.
The third modified example is a modified example for simply determining the display positions of the write area AWR and the duplicate divided screen.

FIG. 16 is a process flowchart of the third modification.
First, when the user U selects the use of the writing area, the projector 13 informs and requests the user U to indicate the position where writing is easy with the indicator (step S31).

In this case, in order to determine how the user U is positioned with respect to the projection surface, the projector 13 does not give an instruction away like a laser pointer, but the remote operation device 15 is moved to the projection surface. It is made to give an instruction in the state pressed against.
Thereby, the user designates a desired position using the remote operation device 15 (step S32).

The projector 13 waits for a certain time until the position information is acquired in a state where the remote operation device 15 is pressed against the projection surface, and determines whether or not the desired writing position has been designated (step S33).
If it is determined in step S33 that the desired writing position cannot be acquired (step S33; No), the process proceeds to step S32 again.

  If it is determined in step S33 that the desired writing position has been acquired (step S33; Yes), the projector 13 functions as the writing area management unit 48, and based on the position information of the remote operation device 15, the writing is performed. The display position of the embedded area AWR is determined (step S34). Subsequently, the projector 13 functions as the copy division display screen management unit 49, and determines the display position information of the copy division display screen based on the position information of the remote operation device 15 (step S35).

  Specifically, for example, when the user U instructs the lower right of the projection screen with the remote operation device 15, the projector 13 functioning as the writing area management means sets the right of the projection screen to the writing area display position. In addition, the display location (duplication location) of the duplicate split screen is decided below the writing display area.

After that, when the user selects a split display screen to be copied (step S36), the projector 13 functions as a video editing unit, and acquires the display position of the write area AWR and the display position of the copy split display screen (step S36). S37) Based on the display position information, a projection screen is synthesized and displayed in the writing area AWR (step S38).
As described above, according to the third modification, the setting position of the writing area AWR and the copy division display screen can be easily set according to the user's instruction, and the usability is improved.

[4] Fourth Modified Example Next, a fourth modified example of the embodiment will be described.
The fourth modified example is a modified example for displaying a plurality of duplicate divided screens in the write area AWR.
FIG. 17 is a process flowchart of the fourth modified example.
In this case, it is assumed that one or a plurality of copy division display screens are already displayed in the write area AWR by any of the methods described above.

When the user U requests to add a copy of the split display screen and selects a split screen to be additionally displayed (step S41), the projector 13 functions as the copy split display screen management means 49, and displays the selected split display screen. It is determined whether or not the corresponding copy division display screen has already been copied to the write area AWR (step S42).
If it is determined in step S42 that the duplicate divided display screen corresponding to the selected divided display screen has already been duplicated in the write area AWR (step S42; Yes), the processing is ended as it is.

If it is determined in step S42 that the duplicate divided display screen corresponding to the selected divided display screen has not yet been duplicated in the write area AWR (step S42; No), the projector 13 writes the write area management means 48. To obtain the maximum rectangular area that can be secured in the free area of the writing area AWR (step S43).
Next, the projector 13 compares the size of the maximum rectangular area with the size of the divided display screen to be duplicated, and determines whether or not the size can be displayed as the duplicate divided display screen (step S44).

  If it is determined in step S44 that the size cannot be displayed as a duplicate split display screen, that is, if either the maximum rectangular area is smaller in width or height (step S44; No), the projector 13 Then, it functions as a duplicate divided display screen management means, and reduces the duplicated divided display screen to fit within the maximum rectangular area (step S45) and displays it within the write area AWR (step S46).

  On the other hand, in the determination of step S44, if the copy division display screen can be displayed in the same size, that is, if the maximum rectangular area is larger in both width and height (step S44; Yes), the copy division display screen is left as it is. The replication division display screen is generated and displayed in the write area AWR, and the process is terminated (step S46).

  As described above, according to the fourth modification, even when a sufficient space area cannot be secured by the copy division display screen in which the write area AWR is already displayed, a new copy division display screen is displayed. Can be displayed.

[5] Fifth Modification Next, a fifth modification of the embodiment will be described.
In the fifth modification, the size of the writing area AWR when the projector 13 functions as the writing area management unit and the size of the replication division display screen when the projector 13 functions as the replication division display screen management unit. It is a modification for determining each automatically.
By the way, it is generally known that the projection size of the projector 13 changes in proportion to the projection distance.

  Therefore, in the fifth modification, the size of the writing area AWR and the copy-divided display screen is automatically changed according to the projection size, so that the optimum size can be obtained without the user U setting the size. The writing area AWR and the copy division display screen are provided.

  In order to realize the fifth modification, the projector 13 includes a projection distance measurement sensor 71 (see FIG. 1), and the projection distance and the projection size are stored in advance in the ROM 24 based on the detection result of the projection distance measurement sensor 71. The screen size LUT (Look Up Table) describing the relationship with (screen size) is stored, and the projector 13 calculates the current projection screen size in consideration of the image correction value based on the projection distance. It functions as the changing unit 72 (see FIG. 3).

In this case, the projection distance measuring sensor 71 is configured as hardware that can measure the distance from the projector 13 to the projection surface by using a laser or ultrasonic waves.
The screen size LUT has a one-to-one correspondence between the projection screen size calculated by the projector 13 as the screen size changing unit 72 and the size of the optimum writing area and the area for displaying a plurality of divided display screens at that time. It is an attached information table.

Next, the operation of the fifth modification will be described.
FIG. 18 is a process flowchart of the fifth modification.
First, the projection distance measurement sensor 71 measures the projection distance at the start of use of the writing area (step S51), and the projector 13 functioning as the screen size changing unit 72 determines the current projection based on the measured projection distance. The screen size is calculated (step S52).
Then, referring to the screen size LUT 72A (see FIG. 3) based on the calculated value, the optimum write area AWR and the size of the copy division display screen are acquired (step S53).

  Then, the projector 13 functioning as the screen size changing unit 72 next writes the write area management unit 48, the copy division display screen management unit 49, and the video editing unit 43 based on the size of the write area AWR and the copy division display screen. And a plurality of divided display screens and a duplicate divided display screen located in the write area AWR are synthesized and displayed.

  As described above, according to the fifth modification, the projector 13 can automatically determine the size of the writing area AWR and the size of the copy-divided display screen according to the projection distance. Even in the case of moving and using, it is possible to perform display with an optimum size.

[6] Sixth Modification Next, a sixth modification of the embodiment will be described.
In the above description, the size of the write area AWR is automatically set. However, the sixth modification is a modification that allows the user to change the size of the write area AWR. It is an example.

FIG. 19 is a process flowchart of the sixth modification.
When the user requests to change the size of the writing area, first, the projector 13 functioning as the writing area creating means acquires the maximum value / minimum value of the specified coordinates that are allowed at the current display position as the coordinate information (step S61). ).
Here, the display position means which of the four sides of the rectangular projection plane is the writing area AWR.

  The specified coordinates are values for ensuring a minimum ratio of the divided display screen and the writing area AWR to the projection plane (screen). For example, the coordinates of the upper right corner of the projection screen when the coordinates of the upper left corner of the projection plane are the origin (0, 0) are (10, 0). It is assumed that the writing area AWR is located on the left side of the projection image. At this time, the maximum value of the prescribed coordinates in the x-axis direction (left and right direction of the projection plane) is 5, and the minimum value is 2. Then, the width of the writing area AWR in the x-axis direction is limited to a range of 2 to 5 from the origin. Similarly, the width of the x-axis of the split display screen is limited to 5-8.

Next, it is determined whether or not a duplicated divided display screen (duplicated divided display screen) exists in the write area AWR (step S62).
If it is determined in step S62 that there is no copy division display screen in the writing area AWR (step S62; No), the size of the writing area AWR is changed (enlarged / reduced) within the specified coordinate range (step S62; No). Step S65).

If it is determined in step S62 that the copy division display screen already exists (step S62; Yes), the coordinates of the copy division display screen that already exists are acquired (step S63), and the writing area is fixed. Even if the size of the AWR is changed, the maximum value / minimum value of the coordinate information is updated so that the boundary of the writing area AWR does not cover the copy division display screen (step S64).
Then, the size of the writing area AWR is changed (enlarged / reduced) based on the updated coordinate information (step S65).
As described above, according to the sixth modification, after the coordinate information range is determined, the projector 13 functioning as the writing area creation unit can write data from the user within the determined coordinate range. It becomes possible to accept a request to change the size of the area AWR.

[7] Seventh Modification Next, a seventh modification of the embodiment will be described.
By the way, when the writing area AWR is created, the projection image G has a configuration in which the plurality of divided display screens P1 to P4 and the writing area AWR are combined.

FIG. 20 is an explanatory diagram of a specific screen configuration example regarding the screen configuration of the writing area.
In the writing area AWR, a multi-divided display screen and a writing area AWR operation unit 81 are further provided.

  The write area AWR operation unit 81 mainly performs operations on the multi-divided display screens (P1 to P2). In the writing area AWR operation unit 81, a projection screen arrangement of a plurality of divided display screens P1 to P4 is displayed. The divided display screen selected by the user from the screen arrangement displayed here (in the example of FIG. 20, the divided display screen P1 is being selected) is duplicated as a duplicate divided display screen in the write area AWR.

  Another component is a screen size changing unit 82. By operating the screen size changing unit 82, the size of any selected copy division display screen or writing area AWR can be changed.

  As described above, according to the seventh modification, the screen size changing unit 72 is displayed in the writing area AWR, and the user U operates the screen size changing unit 72 via the remote operation device 15. Only the selected copy division display screen or the size of the writing area AWR can be changed, so that the usability of the user U is improved.

[8] Eighth Modification In the above description, the copy division display screen is displayed at a predetermined position in the write area AWR. However, in the eighth modification, the copy division display screen is displayed in the write area. It is a modification in the case of displaying an arbitrary one in the AWR.

FIG. 21 is an explanatory diagram of an eighth modification.
For example, it is assumed that the width and height of the copy division display screen PA are small with respect to the writing area AWR.

  In such a state, the divided display screen PA can be moved to an arbitrary position in the writing area AWR. For example, the remote display device 15 can be moved by dragging the divided display screen PA, or the divided display screen PA can be accommodated within the writing area AWR at the coordinates of the designated destination. This is performed by moving the center coordinates of the divided display screen PA so that they are closest.

  Thus, according to the eighth modification, even if the user who performs writing by the interactive function changes after copying the split display screen (in the case of the example in FIG. 21, the user U or the user UC), the writing area AWR The position of the split display screen can be adjusted in accordance with the height and arm length of each user within the range.

[9] Ninth Modification In the above description, one writing area AWR is provided. However, the ninth modification is a case where a plurality of writing areas AWR are created on the projection surface. It is a modification.
FIG. 22 is a process flowchart of the ninth modification.
First, when a request for creating a plurality of writing areas AWR is generated, the projector 13 functioning as the writing area creating means displays positional information on which side of the projected image the writing area AWR already displayed is located. Is acquired (step S71).

Then, the projector 13 functioning as the writing area position determining means determines whether or not the writing area AWR already exists at a position where a new writing area AWR is to be created (step S72).
If it is determined in step S72 that the write area AWR already exists at the position where the new write area AWR is to be created (step S72; Yes), the process is performed without creating a new write area AWR. Hunt.

  If it is determined in step S72 that the write area AWR does not already exist at the position where the new write area AWR is to be created (step S72; No), the processes of steps S21 to S27 shown in FIG. 8 are performed. By doing so, a new write area AWR is created (step S73).

As described above, according to the ninth modification, an arbitrary place and an arbitrary number of write areas AWR can be provided as long as the write areas AWR do not overlap.
Therefore, for example, it is possible to improve the usability of the user U by providing the writing areas AWR on the left and right sides of the projection plane.

  In the above description, when switching the copy split display screen, the user had to set the split display screen to be copied and displayed again. It is easy to provide an operator (such as a button) that is selected as a display screen or an operator (such as a numeric keypad) that directly selects the split display screen as a duplicate split display screen on the remote operation device 15. It is also possible to switch the copy division display screen displayed in the writing area AWR.

  A program executed by the projector 13 of the display system of the present embodiment is a file in an installable or executable format, such as a CD-ROM, a flexible disk (FD), a CD-R, a DVD (Digital Versatile Disk), or the like. The program is provided by being recorded on a computer-readable recording medium.

  In addition, the program executed by the projector 13 of the display system of the present embodiment may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. The program executed by the projector 13 of the display system according to the present embodiment may be provided or distributed via a network such as the Internet.

  In addition, the program of the projector 13 of the display system of the present embodiment may be provided by being incorporated in advance in a ROM or the like.

DESCRIPTION OF SYMBOLS 10 Interactive projection system 11 Information processing apparatus 12 Communication network 13 Projector 14 Wireless communication network 15 Remote operation device 25 Operation reception part 26 USB I / F port 27 Wireless unit 28 Optical part 29 Optical part 30 Video signal processing part 31 Operation means 32 Interactive Communication means 33 Video output means 41 Video input reception means 42 Projection means 43 Video editing means 44 Position coordinate calculation means 45 Interactive communication means 46 Projector operation information conversion means 47 PC operation information conversion means 48 Write area management means 49 Replication division display screen Management means 51 Position information measurement means 52 Interactive communication means 61 Fixed camera 71 Projection distance measurement sensor 72 Screen size change part 81 Write area AWR operation part 82 It's changing unit LUT72A screen size 1280 resolution AWR write area B information processing device terminal DLG dialog G projection image 72A screen size LUT
SCR projection screen SD side U, UC user

Japanese Patent Application Laid-Open No. 2014-120022

Claims (8)

A video editing unit for generating an image including a plurality of split display screens and a duplicate split display screen corresponding to a plurality of images input from a plurality of image processing apparatuses via a network;
A writing area management unit that displays a duplicate divided display screen obtained by duplicating the divided display screen in a predetermined interactive processing target area;
An interactive communication unit that notifies the image processing device of the interactive processing content based on interactive processing on the copy-divided display screen displayed in the interactive processing target area, and causes the image processing device to perform interactive processing;
A projection unit that displays the image after the interactive processing generated by the video editing unit as a projection image;
A display device comprising: The writing area management unit can change a display position or a display size of the interactive processing target area in the projection image based on an input from a remote operation device.
The display device according to claim 1. The writing area management unit sets the interactive processing target area on either the left side or the right side of the projection image based on pre-registered user dominant arm information, and displays a duplicate split display screen.
The display device according to claim 1 or 2. In the interactive processing target area, the copy division display screen management unit that enables the copy division display screen to be displayed at an arbitrary position,
The display device according to any one of claims 1 to 3. The copy division display screen management unit can change the size of the copy division display screen.
The display device according to claim 4. A plurality of image processing devices;
A display device capable of interactive communication for interactive processing with the plurality of image processing devices via a network;
A remote operation device for performing an operation for the interactive processing,
The display device generates an image including a plurality of split display screens and a duplicate split display screen corresponding to the plurality of images input via the network;
A writing area management unit that displays a duplicate divided display screen obtained by duplicating the divided display screen in a predetermined interactive processing target area;
Interactive that informs the image processing device of the interactive processing content based on an interactive processing instruction from the remote operation device for the duplicate split display screen displayed in the interactive processing target area, and causes the image processing device to perform interactive processing. A communication department;
A projection unit that displays the image after the interactive processing generated by the video editing unit as a projection image;
Display system with. An imaging device that captures a peripheral image including the projection image;
In the image captured by the imaging device, the writing area management unit is associated with a position where the distortion is detected when a predetermined amount of distortion of the projection image is detected around the projection image, Determining a display position of the interactive processing target area;
The display system according to claim 6. A method executed by a display device that displays a plurality of images input from a plurality of image processing devices via a network,
Generating an image including a plurality of split display screens and a duplicate split display screen corresponding to the plurality of images;
Displaying a duplicate split display screen obtained by duplicating the split display screen in a predetermined interactive processing target area;
A process of notifying the image processing device of the interactive processing content based on the interactive processing on the copy-divided display screen displayed in the interactive processing target area, and causing the image processing device to perform interactive processing;
Displaying the generated image after the interactive processing as a projected image;
With a method.

Images