JP2023025515A - Image display system, control unit, and data processing method - Google Patents

Abstract

To perform three-dimensional display with a plurality of screens by using three-dimensional shape data.SOLUTION: A data processing method includes: receiving the number of data sets in processing of generating cross-sectional shape data from three-dimensional shape data; generating a plurality of pieces of cross-sectional shape data from the three-dimensional shape data based on the number of data sets; generating a plurality of pieces of image data based on the plurality of pieces of cross-sectional shape data; and transmitting the plurality of pieces of image data to projectors projecting images on screens with light transmissivity.SELECTED DRAWING: Figure 1

Description

The present invention relates to an image display system, control device, and data processing method.

2. Description of the Related Art Conventionally, a system that displays an image by combining a plurality of projectors and screens is known. Japanese Unexamined Patent Application Publication No. 2002-200000 discloses a configuration in which a screen device for displaying a projected image of a projector includes a light diffusing means having a light transmissive property for transmitting light and a light diffusing property for diffusing light. Japanese Patent Application Laid-Open No. 2002-200000 describes that an image with a three-dimensional effect can be expressed by projecting images onto a screen device from different directions by a plurality of projectors.

JP 2008-268859 A

The system described in Japanese Patent Laid-Open No. 2002-200003 projects a plane image including characters and the like onto a screen device to display a stereoscopic image. On the other hand, it has been desired to perform more stereoscopic display using three-dimensional shape data.

According to one aspect of the present disclosure, a plurality of translucent screens, a plurality of projectors that project images onto each of the plurality of screens, a plurality of projectors connected to each of the plurality of projectors, and a a control device for transmitting to each of the projectors, wherein the control device receives three-dimensional shape data and the number of data sets in a process of generating a plurality of cross-sectional shape data from the three-dimensional shape data; , generating the plurality of cross-sectional shape data from the three-dimensional shape data based on the number of data sets; generating the plurality of image data based on the plurality of cross-sectional shape data; and transmitting image data to each of the plurality of projectors.

Another aspect of the present disclosure is to receive a number of data sets in a process of generating cross-sectional shape data from three-dimensional shape data, and based on the number of data sets, a plurality of cross-sectional shape data from the three-dimensional shape data , generating a plurality of image data based on the plurality of cross-sectional shape data, and transmitting the plurality of image data to a plurality of projectors that project an image on a translucent screen. and a control device.

Yet another aspect of the present disclosure is to receive a number of data sets in a process of generating cross-sectional shape data from three-dimensional shape data, and based on the number of data sets, a plurality of cross-sectional shapes from the three-dimensional shape data generating data; generating a plurality of image data based on the plurality of cross-sectional shape data; and transmitting the plurality of image data to a projector that projects an image onto a translucent screen. and a data processing method.

Yet another aspect of the present disclosure further comprises a plurality of detection devices, wherein the plurality of screens includes a second screen, corresponds to each of the plurality of screens, and detects a user's operation on each of the plurality of screens; The device generates first image data based on the operation when it is determined that the operation is for the first screen, and generates the first image data based on the operation when it is determined that the operation is for the second screen. generating second image data, which is one of the plurality of image data, using the image display system of claim 2.

1 is a diagram showing a schematic configuration of an image display system according to a first embodiment; FIG. The block diagram of the control apparatus of 1st Embodiment. Explanatory drawing of the process which produces|generates cross-sectional shape data. 4 is a flowchart showing the operation of the image display system of the first embodiment; The figure which shows schematic structure of the image display system which concerns on 2nd Embodiment. The block diagram of the control apparatus of 2nd Embodiment. 8 is a flowchart showing the operation of the image display system of the second embodiment;

[1. First Embodiment]
[1-1. Configuration of image display system]
FIG. 1 is a diagram showing a schematic configuration of an image display system 1 according to the first embodiment. The image display system 1 includes multiple screens 15 , multiple projectors 10 , and a control device 5 . FIG. 1 shows an example in which the image display system 1 includes five projectors 10A, 10B, 10C, 10D and 10E and five screens 15A, 15B, 15C, 15D and 15E.

Images 20A to 20E shown in FIG. 1 are projected images projected by the projectors 10A to 10E. The control device 5 transmits image data D1, D2, D3, D4 and D5 to each of the projectors 10A to 10E. The projector 10A receives image data D1 from the control device 5 and projects an image 20A on the screen 15A based on the image data D1. Similarly, projectors 10B, 10C, 10D and 10E project images 20B, 20C, 20D and 20E onto screens 15B, 15C, 15D and 15E based on image data D2, D3, D4 and D5, respectively.

In FIG. 1 and FIGS. 3 and 5, which will be described later, the positions in the installation space where the screens 15A to 15E are installed are shown by XYZ orthogonal coordinates. The X-axis is parallel to the horizontal direction of the screen 15, the Y-axis is parallel to the direction in which the screens 15A to 15E are arranged, and the Z-axis is parallel to the vertical direction of the screen 15. FIG. The origin of the XYZ orthogonal coordinates can be set arbitrarily. In this embodiment, one corner of the lower end of the screen 15A is set as the origin. In the installation space of the screen 15, the position within the plane of the screen 15 is represented by XZ coordinates. The position in the direction in which the screens 15A to 15E are arranged is represented by the Y coordinate.

In the following description, the projectors 10A to 10E are referred to as the projector 10 when not distinguished. Similarly, screens 15A to 15E are referred to as screen 15 when not distinguished. Further, when the images 20A to 20E are not distinguished, they are referred to as image 20, and when the image data D1 to D5 are not distinguished, they are referred to as image data D.

In the image display system 1, projection of an image onto the screen 15 by the projector 10 is shown as an example of displaying an image. That is, projection of an image described in this embodiment is an example of display.

The number of screens 15 that the image display system 1 has is not limited to five. Also, the number of projectors 10 is not limited to five. Although FIG. 1 shows an example in which one projector 10 projects an image 20 onto one screen 15, the correspondence between the projector 10 and the screen 15 is not limited to the example in FIG. For example, one projector 10 may project images 20 onto multiple screens 15 . In this case, the projector 10 projects the image in a time division manner by switching the screen 15 on which the image 20 is projected every unit time. For example, the projector 10A projects images 20A, 20B, 20C, 20D and 20E onto the screens 15A, 15B, 15C, 15D and 15E in order.

The image data D1 to D5 are data generated from one piece of three-dimensional shape data O, for example. The three-dimensional shape data O is three-dimensional data representing a shape such as a solid figure. For example, the three-dimensional shape data O includes data created by a 3D-CAD (Computer-Aided Design) application program. The data format of the three-dimensional shape data O is not restricted. For example, it may be STL data or OBJ data.

Since the images 20A to 20E are images generated from the three-dimensional shape data O, they represent one stereoscopic shape as a whole. Realize projection.
Processing for generating the image data D1 to D5 from the three-dimensional shape data O will be described later.

The screen 15 has translucency. Specifically, the screen 15 has a property of transmitting at least part of the wavelength range of visible light. The visible light transmittance of the screen 15 may be 100% or less than 100%. For example, the screen 15A has translucency such that at least the image 20B can be seen by the user U through the screen 15A. The screens 15B-15E also have translucency. The screens 15A to 15D preferably have translucency to the extent that the user U can see a plurality of the images 20B, 20C, 20D, and 20E through the screen 15A. Moreover, it is preferable that the user U can see more than one of the images 20D, 20C, 20B, and 20A through the screen 15E.

[1-2. Configuration of control device]
FIG. 2 is a configuration diagram of the control device 5. As shown in FIG.
The control device 5 has a CPU 25 (Central Processing Unit), a RAM 38 (Random Access Memory), a ROM 40 (Read Only Memory), a storage section 42 , an input section 53 , a display section 54 and a transmission section 55 . Each unit constituting the control device 5 is interconnected by a bus 56 .

The control device 5 is an information terminal device including, for example, a PC (Personal Computer), a smart phone, a tablet PC, or the like. In the present embodiment, a configuration will be described in which the control device 5 is a device independent of the projector 10 and the projector 10 is an external device when viewed from the control device 5 . The control device 5 does not need to be a device independent of the projector 10 , and for example, may be configured such that the functions of the control device 5 are realized by a processor included in a device integrated with the projector 10 .

The CPU 25 is composed of one or more processors, and implements various functions of the control device 5 by executing control programs stored in the storage unit 42 . A RAM 38 is a volatile semiconductor memory element and forms a work area for the CPU 25 . The ROM 40 is a semiconductor memory device, and non-volatilely stores programs executed by the CPU 25, data processed by the CPU 25, and the like.

The storage unit 42 includes a storage medium. The storage medium is, for example, a hard disk, an optical disk device, or a semiconductor storage device such as an SSD (Solid State Drive). The storage unit 42 nonvolatilely stores programs executed by the CPU 25, data processed by the CPU 25, and the like.

The storage unit 42 has a three-dimensional shape data storage area 44 , a data set number information storage area 46 , a position information storage area 48 , a cross-sectional shape data storage area 50 and an image data storage area 52 . These storage areas are, for example, logical storage areas provided in storage areas of a storage medium that constitutes the storage unit 42 . The three-dimensional shape data storage area 44 stores three-dimensional shape data O. FIG. The data set number information storage area 46 stores data set number information. Here, the number of data sets means the number of cross-sectional shape data CD generated from one piece of three-dimensional shape data O. FIG. The position information storage area 48 stores screen position information indicating the positions of the multiple screens 15 included in the image display system 1 . The cross-sectional shape data storage area 50 stores cross-sectional shape data CD. The image data storage area 52 stores the image data D. FIG.

The input unit 53 has an interface through which data is input. The input unit 53 includes a communication interface such as a LAN interface, wireless communication interface, or the like. In this case, the control device 5 performs data communication with an external computer connected to the input unit 53, and receives various data including the three-dimensional shape data O and data set number information. The input unit 53 may also include a USB (Universal Serial Bus) interface. In this case, the control device 5 acquires various data including the three-dimensional shape data O and data set number information from an external computer or USB memory connected to the input unit 53 . Also, the input unit 53 may include an input device. Input devices include keyboards and mice. When the user U or an operator who sets up the control device 5 inputs information such as data set number information by operating an input device, the control device 5 acquires the input information.

The display unit 54 has a display panel such as a liquid crystal display panel or an organic EL (Electro-Luminescence) panel. The display unit 54 displays the operating state of the image display system 1 and various information received by the reception unit 30 under the control of the CPU 25 . Moreover, the display unit 54 may display an operation screen for operating the control device 5 . The input unit 53 may be a touch panel integrated with the display unit 54 .

The transmission unit 55 has a communication interface such as a LAN interface and a wireless communication interface. The transmission unit 55 may also include an image output interface such as HDMI (High-Definition Multimedia Interface). Here, HDMI is a registered trademark.
The transmission unit 55 is connected to the projector 10 and transmits image data D to the projector 10 under the control of the CPU 25 . Specifically, the transmitter 55 is connected to each of the projectors 10A, 10B, 10C, 10D, and 10E. The CPU 25 transmits the image data D1 to the projector 10A through the transmission unit 55. FIG. Similarly, the CPU 25 transmits the image data D2, D3, D4 and D5 to the projectors 10B, 10C, 10D and 10E through the transmission unit 55. FIG.

The CPU 25 implements the functions of the reception unit 30 , the cross-sectional data generation unit 32 , the image data generation unit 34 , and the transmission control unit 36 by executing a control program (not shown) stored in the storage unit 42 . The receiving unit 30 receives the three-dimensional shape data O and data set number information through the input unit 53 .

The reception unit 30 acquires the three-dimensional shape data O input from the input unit 53 and stores the acquired three-dimensional shape data O in the three-dimensional shape data storage area 44 . The three-dimensional shape data O may be stored in the three-dimensional shape data storage area 44 in advance. Alternatively, the CPU 25 may acquire the three-dimensional shape data O by means other than the input unit 53 and store it in the three-dimensional shape data storage area 44 .

The reception unit 30 acquires data set number information based on data input to the input unit 53 from another computer or operation of the input device of the input unit 53 . The reception unit 30 stores the acquired data set number information in the data set number information storage area 46 .

The data set number information is a parameter referred to in the process of generating a plurality of cross-sectional shape data CD from the three-dimensional shape data O and generating the image data D based on the cross-sectional shape data CD. The data set number information indicates the number of data sets of the cross-sectional shape data CD generated from the three-dimensional shape data O. FIG.

Data set number information is associated with the three-dimensional shape data O. FIG. For example, when receiving the data set number information after receiving the three-dimensional shape data O, the receiving unit 30 performs a process of associating the three-dimensional shape data O with the data set number information. The reception unit 30 associates the three-dimensional shape data O with the data set number information and stores them in the three-dimensional shape data storage area 44 and the data set number information storage area 46 .
Further, the data set number information may not be associated with the three-dimensional shape data O. FIG. For example, one piece of data set number information may be applied to all three-dimensional shape data O processed by the cross-sectional data generation unit 32 .

The cross-sectional data generator 32 generates cross-sectional shape data CD based on the three-dimensional shape data O stored in the three-dimensional shape data storage area 44 . In this process, the cross-sectional data generator 32 refers to the data set number information stored in the data set number information storage area 46 and the position information stored in the position information storage area 48 . The cross-sectional data generator 32 stores the generated cross-sectional shape data CD in the cross-sectional shape data storage area 50 in association with the screen position information.

The screen position information is information indicating the position of each of the screens 15A, 15B, 15C, 15D and 15E. The screen position information may be information indicating relative positions of the screens 15A, 15B, 15C, 15D, and 15E. Further, the screen position information may be information indicating the absolute positions of the screens 15A, 15B, 15C, 15D, and 15E with reference to the origin set in the installation space of the screen 15. FIG. In this embodiment, as an example, the Y coordinates of the screens 15A, 15B, 15C, 15D, and 15E in the XYZ orthogonal coordinates described above are stored in the position information storage area 48 as screen position information.

The screen position information is received by the receiving unit 30 using the input unit 53, for example. The screen position information may be included in the three-dimensional shape data O, or may be added to the three-dimensional shape data O. In this case, the reception unit 30 receives the position information together with the three-dimensional shape data O, It is stored in the information storage area 48 . Alternatively, the screen position information may be generated by the control device 5 . For example, the receiving unit 30 acquires a photographed image of the installation space of the screens 15 and extracts the image of the screens 15 from the photographed image to specify the position of each screen 15 . In this case, screen position information indicating the position of each screen 15 can be easily obtained from the captured image data.

The image data generator 34 generates image data D based on the cross-sectional shape data CD generated by the cross-sectional data generator 32 . The number of image data D generated by the image data generator 34 and the number of cross-sectional shape data CD may be the same or may be different. That is, the image data generation unit 34 may generate a plurality of image data D from one cross-sectional shape data CD, or may perform processing for converting one cross-sectional shape data CD into one image data D. . The image data generator 34 generates image data D corresponding to each projector 10 based on the cross-sectional shape data CD. Specifically, the image data generation unit 34 generates image data D1, D2, D3, D4, and D5, and stores the respective image data D in the image data storage area 52 in association with the projectors 10A to 10E. .

The format of the image data D can adopt a known format for still image data. Examples include GIF (Graphics Interchange Format), JPEG (Joint Photographic Experts Group), and PNG (Portable Network Graphics).

The transmission control unit 36 transmits the image data D stored in the image data storage area 52 to the projectors 10 associated with each image data D. As shown in FIG. For example, the transmission control unit 36 transmits the image data D1 to the projector 10A, and transmits the image data D2 to D5 to the projectors 10B to 10E, respectively.

[1-3. Generation of cross-sectional shape data]
FIG. 3 is an explanatory diagram of the process of generating cross-sectional shape data CD.
The three-dimensional shape data O is, for example, three-dimensional figure data, and the three-dimensional shape is a cone in the example of FIG. The cross-sectional data generator 32 generates cross-sectional shape data CD representing a cross section of the cone from the three-dimensional shape data O of the cone. In FIG. 3, P1, P2, P3, P4, and P5 are cross sections cut out from the three-dimensional shape data O, respectively. The positions of the cross sections P1 to P5 correspond to the positions where the cross section data generator 32 cuts out the three-dimensional shape data O. FIG.

The number of pieces of cross-sectional shape data CD generated from the three-dimensional shape data O by the cross-sectional data generator 32 is determined by the data set number information stored in the data set number information storage area 46 . Here, an example is shown in which the number of cross-sectional shape data CD indicated by the data set number information, that is, the number of data sets is five. In this example, the number of data sets indicated by the data set number information matches the number of screens 15 .

The cross-sectional data generator 32 associates the three-dimensional shape data O with the XYZ orthogonal coordinates defined in the installation space of the screen 15 . Further, the cross-sectional data generator 32 determines the coordinates of each of the screens 15A-15E based on the screen position information. The slice data generator 32 determines the positions of the slices P1 to P5 based on the positions of the screens 15A to 15E. For example, the positions of cross-sections P1-P5 correspond to the positions of each of screens 15A-15E.

Here, the cross-sectional data generator 32 determines at least the Y coordinate of each of the screens 15A-15E. Further, when the screen position information does not include information corresponding to the installation space of the screen 15, the reception unit 30 performs processing for associating the screen position information with the Y axis. For example, if the screen position information is information specifying only the relative positions of the screens 15A to 15E, the reception unit 30 determines the Y coordinate of the screen 15A. Furthermore, reception unit 30 determines the Y coordinates of each of screens 15B to 15E based on the determined coordinates and the relative positions of screens 15B to 15E with respect to screen 15A.

The cross-sectional data generator 32 determines the position of the cross-section P1 for cutting out the image from the three-dimensional shape data O based on the Y coordinate of the screen 15A. For example, the Y coordinate of cross section P1 is equal to the Y coordinate of screen 15A. Similarly, the slice data generator 32 determines the positions of the slices P2 to P5 based on the Y coordinates of the screens 15B to 15E.

If the number of data sets of the cross-sectional shape data CD indicated by the data set number information does not match the number of screens 15 , the cross-sectional data generator 32 determines the Y coordinate of the cross section P regardless of the Y coordinate of the screen 15 . For example, the cross-sectional data generation unit 32 determines the position of the cross-section P with the smallest Y-coordinate and the position of the cross-section P with the largest Y-coordinate in the range where the three-dimensional shape data O and the Y coordinate overlap. Let these two cross sections P be the cross sections P of both ends. In the example of FIG. 3, the cross section P1 and the cross section P5 correspond to cross sections at both ends. The cross-sectional data generator 32 determines the positions of a plurality of cross-sections P between the cross-sections P at both ends in accordance with the data set number information. The positions of these cross sections P are determined, for example, at positions obtained by dividing the cross sections P at both ends by equal distances. According to this method, the positions of the cross-sections P are determined so that the cross-sections P are arranged at equal intervals so as to overlap the three-dimensional shape data O. FIG.

Further, the receiving unit 30 may receive division position information specifying the position of the cross section P together with the data set number information or instead of the data set number information. The reception unit 30 stores the division position information in the data set number information storage area 46 in association with the three-dimensional shape data O. FIG. The division position information is, for example, information specifying the relative position of the division position with respect to the three-dimensional shape data O, or information indicating the coordinates of the division position associated with the coordinates of the three-dimensional shape data O. FIG. When the cross-sectional data generation unit 32 cuts out the three-dimensional shape data O with a plurality of cross-sections P, the division position information is information specifying the positions of the plurality of cross-sections P, respectively. In this case, the cross-sectional data generator 32 determines the position of the cross-section P by referring to the division position information stored in the data set number information storage area 46 . Moreover, the division|segmentation position information may be the structure which is not matched with the three-dimensional shape data O. FIG. For example, one set of division position information may be applied to all three-dimensional shape data O processed by the cross-sectional data generator 32 .

The cross-sectional data generation unit 32 generates cross-sectional shape data CD1, which is planar image data obtained by cutting out the three-dimensional shape data O at the cross-section P1. The cross-sectional shape data CD1 is plane image data on the XZ plane corresponding to the cross section P1, and is vector image data expressed using X and Z coordinates, or raster image data. Similarly, the cross-sectional data generator 32 generates cross-sectional shape data CD2 to CD5, which are planar image data obtained by cutting out the three-dimensional shape data O at respective positions of cross-sections P2 to P5, and stores them in the cross-sectional shape data storage area 50. Let

The image data generator 34 generates image data D having a data format such as GIF, JPEG, PNG, etc. based on the cross-sectional shape data storage area 50 . When the number of data sets of the cross-sectional shape data CD is equal to the number of screens 15 , the image data D is data obtained by converting the cross-sectional shape data CD into a data format that can be processed by the projector 10 . When the number of data sets of the cross-sectional shape data CD is different from the number of screens 15, the image data generator 34 selects a cross-sectional shape whose Y-coordinate matches that of the screen 15 from a plurality of cross-sectional shape data CDs having Y-coordinates close to the screen 15. Data CD is generated by interpolation calculation or the like. Here, the image data generator 34 generates the image data D by converting the data format of the generated cross-sectional shape data CD.

The image data D is image data of an image obtained by cutting out the three-dimensional shape data O at the Y coordinate of the screen 15 . Therefore, a set of images 20 is displayed by projecting a plurality of image data D onto a plurality of screens 15 by a plurality of projectors 10 . A set of images 20 is a stereoscopic image corresponding to the three-dimensional shape data O. FIG. Further, since the screen 15 is translucent, the user U can simultaneously view the multiple images 20 formed on the multiple screens 15 . As a result, the image display system 1 can reproduce the three-dimensional shape data O by a set of the images 20 and allow the user U to visually recognize the three-dimensional image.

[1-4. Operation of Image Display System]
FIG. 4 is a flow chart showing the operation of the image display system 1. As shown in FIG.
In step S<b>1 , the reception unit 30 receives data set number information input to the input unit 53 and stores it in the data set number information storage area 46 . Further, in step S2, the reception unit 30 receives the screen position information and stores it in the position information storage area 48. FIG. The operations of step S1 and step S2 may be performed simultaneously or in reverse order.

In step S3, the cross-sectional data generator 32 reads the three-dimensional shape data O from the three-dimensional shape data storage area 44, and, as described with reference to FIG. The cross-sectional shape data CD is generated by referring to the number of sets information. The cross-sectional data generator 32 stores the generated cross-sectional shape data CD in the cross-sectional shape data storage area 50 .

In step S4, the image data generator 34 reads the cross-sectional shape data CD stored in the cross-sectional shape data storage area 50, and generates image data D based on the cross-sectional shape data CD. The image data generator 34 stores the generated image data D in the image data storage area 52 .

In step S<b>5 , the transmission control unit 36 transmits the image data D stored in the image data storage area 52 to the projector 10 via the transmission unit 55 .
Thereby, the projector 10 displays the image 20 based on the image data D on the screen 15 in step S6.

The transmission control unit 36 reads the image data D from the image data storage area 52 , selects the projector 10 to which the read image data D corresponds, and transmits the image data D to the selected projector 10 . Accordingly, an image 20 based on the image data D is displayed on the screen 15 installed at a position corresponding to the image data D. FIG.

[1-5. Action of the first embodiment]
As described above, the image display system 1 includes a plurality of translucent screens 15 and a plurality of projectors 10 that project images onto each of the plurality of screens 15 . The image display system 1 includes a control device 5 that is connected to each of the multiple projectors 10 and that transmits multiple image data to each of the multiple projectors 10 . The control device 5 receives the three-dimensional shape data and the number of data sets in the process of generating a plurality of pieces of cross-sectional shape data from the three-dimensional shape data. Based on the number of data sets, the control device 5 generates a plurality of cross-sectional shape data from the three-dimensional shape data, generates a plurality of image data based on the plurality of cross-sectional shape data, and generates a plurality of image data. to each of a plurality of projectors.

The control device 5 receives the number of data sets in the process of generating cross-sectional shape data CD from the three-dimensional shape data O, and generates a plurality of cross-sectional shape data CD from the three-dimensional shape data O based on the number of data sets. generating a plurality of image data D based on the plurality of cross-sectional shape data CD; and transmitting the plurality of image data D to a plurality of projectors 10 that project images onto a translucent screen. and including.

The data processing method according to the present embodiment includes receiving the number of data sets in the process of generating cross-sectional shape data CD from the three-dimensional shape data O, and obtaining a plurality of cross-sectional shapes from the three-dimensional shape data O based on the number of data sets. A projector 10 for generating a data CD, generating a plurality of image data D based on the plurality of cross-sectional shape data CD, and projecting the plurality of image data D onto a translucent screen 15. and sending to.

In the image display system 1, the plurality of screens 15 includes a first screen, and the control device 5 accepts screen position information indicating the position of the first screen, and based on the number of data sets, the three-dimensional shape data O Determining the position to cut out, generating cross-sectional shape data CD corresponding to the position, and based on the cross-sectional shape data CD corresponding to the position and screen position information, one of the plurality of image data D Generating some first image data.

According to the above configuration, a plurality of image data D generated by cutting out a cross section of the three-dimensional shape data O are displayed on a plurality of translucent screens 15 by a plurality of projectors 10 . As a result, a plurality of images representing cross sections of the three-dimensional shape data O can be used to reproduce the shape of the three-dimensional shape data O. FIG. The translucency of the screen 15 allows the user U to simultaneously view multiple images displayed by the multiple projectors 10 . Therefore, based on the three-dimensional shape data O, an image rich in stereoscopic effect can be displayed.

In the above configuration, the control device 5 receives screen position information indicating the positions of the multiple screens 15 . The cross-sectional data generation unit 32 determines the position of the cross-section from which the three-dimensional shape data O is extracted based on the number of data sets indicated by the number-of-data-sets information. The cross-sectional data generator 32 generates cross-sectional shape data CD of the determined position, and the image data generator 34 generates image data D based on the position of the cross-section and the screen position information.

As a result, the cross-sectional shape data CD representing the cross-section of the three-dimensional shape data O is generated at a plurality of positions of the three-dimensional shape data O, so that a three-dimensional display that reproduces the three-dimensional shape data O well is realized. can.

The controller 5 included in the screen display system determines the position based on the screen position information when the number of data sets and the number of screens 15 match. In this case, image data D suitable for the number of screens 15 is generated. Therefore, when the projector 10 performs display based on the image data D, stereoscopic display can be realized.

If the number of data sets and the number of screens 15 do not match, the control device 5 determines the positions by arranging cross sections corresponding to the number of data sets on the three-dimensional shape data O at regular intervals. In this case, the process of generating the cross-sectional shape data CD can be performed without depending on the number of screens 15, and the number of screens 15 can be changed.

[2. Second Embodiment]
[2-1. Configuration of image display system]
FIG. 5 is a diagram showing a schematic configuration of an image display system 1A according to the second embodiment.
The image display system 1A has a configuration including a control device 5A instead of the control device 5 in the image display system 1 described in the first embodiment. For convenience of explanation, FIG. 5 also illustrates the configuration of an image display system 1A that includes three projectors 10A, 10B, and 10C and projects images onto three screens 15A, 15B, and 15C. The number of projectors 10 and the number of screens 15 included in the image display system 1A are not limited. In 2nd Embodiment, the same code|symbol is attached|subjected to the structure which is common in 1st Embodiment, and description is abbreviate|omitted.

The image display system 1A detects an operation by the user U on the screen 15. FIG. The user U operates the screen 15 using an indicator UD such as a finger or a stick-shaped pointing device. For example, the user U brings the indicator UD into contact with the screen 15 and performs an operation of moving the indicator.

The detection device 60 is a device that detects the position of the pointer UD. The position of the tip of the indicator UD is hereinafter referred to as the position of the indicator UD. A detection range in which the detection device 60 can detect the position of the pointer UD is a range that includes the installation space of the screens 15 and includes at least a plurality of screens 15 .

The detection device 60 is, for example, a camera that captures visible light. In this case, the detection device 60 detects the position of the tip of the pointer UD by analyzing the captured image and extracting the image of the pointer UD. The detection range of the detection device 60 is the imaging range of the camera that constitutes the detection device 60, that is, the angle of view. In this configuration, the detection device 60 may include multiple cameras with different imaging ranges. For example, the detection device 60 may include cameras corresponding to each of the multiple screens 15 included in the image display system 1A.

The detection device 60 may be a camera that captures light outside the visible range, such as infrared light and ultraviolet light. This configuration is advantageous in that the projection light of the projector 10 hardly affects the detection of the pointer UD. In this case, the pointer UD may be a device that includes a light source that emits light in a wavelength range that can be detected by the detection device 60 from its tip. When the finger of the user U is used as the indicator UD, a light irradiation device (not shown) irradiates the detection range with detection light in a wavelength range detectable by the detection device 60, and the detection light is reflected by the indicator UD. A configuration in which the detection device 60 detects the reflected light may be used. In this configuration, the detection device 60 may comprise a plurality of light irradiation devices. Moreover, the detection device 60 may include a plurality of cameras with different imaging ranges. For example, the detection device 60 may include a light irradiation device and a camera corresponding to each of the plurality of screens 15 included in the image display system 1A.

Further, the detection device 60 may include a pressure-sensitive or capacitive contact sensor that detects contact of the indicator UD with the screen 15 and may be configured to detect the contact position of the indicator UD on the screen 15 . In this case, the detection device 60 includes sensors arranged on each of the plurality of screens 15 included in the image display system 1A.

The detection device 60 detects, for example, the X-coordinate, Y-coordinate, and Z-coordinate of the pointer UD. The detection device 60 can be configured to detect the position of the pointer UD at a preset sampling period. In this case, the image display system 1A can obtain the trajectory of the position of the pointer UD detected by the detection device 60 . For example, when the user U moves the indicator UD along the screen 15A as shown in FIG. 5, the image display system 1A detects the trajectory Q of the indicator UD on the surface of the screen 15A.

[2-2. Configuration of control device]
FIG. 6 is a configuration diagram of the control device 5A of the second embodiment.
In the configuration of the control device 5A, as described above, the same reference numerals are given to the configurations common to the control device 5 described in the first embodiment, and the description thereof is omitted.

5 A of control apparatuses are provided with the connection part 66. FIG. The connection unit 66 is an interface connected to the detection device 60 . The connection unit 66 is, for example, a communication interface such as a LAN interface or a wireless communication interface, or a device connection interface such as a USB interface.

The control device 5A has a determination section 62 and a calculation section 64 . The determination unit 62 and the calculation unit 64 are implemented by cooperation of hardware and software when the CPU 25 executes the control program.

The determination unit 62 acquires the position of the pointer UD detected by the detection device 60 . The determination unit 62 determines the screen 15 operated by the pointer UD based on the position of the pointer UD. For example, the determination unit 62 performs determination by comparing the coordinates of the position of the pointer UD detected by the detection device 60 and the Y coordinates of the screens 15A, 15B, and 15C. In the configuration example of FIG. 5, the determination unit 62 determines which one of the screens 15A, 15B, and 15C is the operation target of the pointer UD.

The calculation unit 64 performs processing for reflecting the position of the pointer UD detected by the detection device 60 in the projection image of the projector 10 . The calculation unit 64 identifies the projector 10 that projects the image 20 on the screen 15 determined by the determination unit 62 . The calculation unit 64 reflects the operation by the pointer UD on the projection image projected by the specified projector 10 . For example, the calculation unit 64 generates a display object based on the trajectory Q of the position of the pointer UD detected by the detection device 60 and causes the projector 10 to display the generated display object together with the image 20 .

As shown in FIG. 5, an example is assumed in which the user U draws a trajectory Q on the screen 15A using the pointer UD. In this example, the detection device 60 detects the position of the pointer UD that draws the trajectory Q, and outputs the position to the connection unit 66 . The determination unit 62 determines that the target of the operation using the pointer UD is the screen 15A. The calculation unit 64 generates the trajectory Q based on the position of the pointer UD output by the connection unit 66 . The calculation unit 64 performs a process of generating a line segment indicating the trajectory Q or a process of replacing the trajectory Q with characters, thereby generating a display object including an image or characters. The computing unit 64 identifies that the projector 10 that projects the image 20 onto the screen 15A that is the operation target is the projector 10A. The calculation unit 64 causes the projector 10A to display the display object together with the image 20A. Specifically, the calculation unit 64 combines the image data D1 corresponding to the projector 10A with the image data of the display object generated based on the trajectory Q, and the transmission unit 55 transmits the combined image data D1 to the projector 10A. Let

[2-3. Operation of Image Display System]
FIG. 7 is a flow chart showing the operation of the image display system 1A. In the operation shown in FIG. 7, steps S1 to S6 are common to the operation explained with reference to FIG. 4, so the explanation is omitted here.

In step S11, the detection device 60 detects an operation performed by the user U using the indicator UD. Specifically, the detection device 60 detects the position of the pointer UD.
Next, in step S<b>12 , the determination unit 62 determines the screen 15 that is the operation target detected by the detection device 60 . In step S<b>13 , the calculation unit 64 updates the image data D by reflecting the operation detected by the detection device 60 in the image data D corresponding to the screen 15 determined by the determination unit 62 . For example, the calculation unit 64 generates the display object as described above and causes the image data D to include the display object. Further, for example, the calculation unit 64 may edit the image data D so as to deform the image 20 based on the operation detected by the detection device 60 .

In step S<b>14 , the calculation unit 64 causes the transmission unit 55 to transmit the updated image data D to the projector 10 corresponding to the screen 15 determined by the determination unit 62 . In step S<b>15 , the projector 10 projects an image based on the updated image data D onto the screen 15 .

[2-4. Operation of Second Embodiment]
According to the image display system 1A described in the second embodiment, effects similar to those of the image display system 1 can be obtained.
Further, the image display system 1A includes a detection device 60 that detects user's operation on the screen 15 . The control device 5A has a calculation unit 64 that changes image data based on an operation, and a determination unit 62 that determines the screen 15 on which an operation has been performed among the plurality of screens 15 . The image display system 1A includes a first screen and a second screen as multiple screens 15 .
The image display system 1A includes a plurality of screens 15 including a second screen, corresponding to each of the plurality of screens 15, and further comprising a plurality of detection devices 60 for detecting user U's operation on each of the plurality of screens 15, The control device 5 generates the first image data based on the operation when it is determined that the operation is for the first screen, and performs the operation when it is determined that the operation is for the second screen. generating second image data, which is one of the plurality of image data D based on.

According to this configuration, a stereoscopic display can be realized by a plurality of screens 15, and the operation of the user U on this display can be reflected in the displayed image. Therefore, the user U can be provided with a novel interactive video experience.

[3. Other embodiments]
Each of the above embodiments shows a specific example to which the present invention is applied, and the present invention is not limited to this.

For example, in each of the above embodiments, the brightness of the images 20A to 20E may be different. As a specific example, it is assumed that the user U is between the screens 15A and 15B and visually recognizes images projected by the image display systems 1 and 1A. In this case, the controller 5 may control each projector 10 so that the image 20C projected onto the screen 15C is brighter than the images 20A, 20B, 20D, and 20E. According to this assumption, the user U sees the image 20C through the screen 15B, and thus may feel that the image 20C is darker than the images 20A and 20B. In this case, by brightening the luminance of the image 20C, it is possible to reduce the difference in brightness perceived by the user U, thereby providing a more immersive video experience. This configuration can be more easily realized by providing the image display systems 1 and 1A with a device that detects the position of the user U with respect to the screen 15, for example. This type of device includes, for example, a device that detects the user U using a visible light camera or an infrared light camera.

Further, in each of the above embodiments, the cross sections P1 to P5 do not have to be parallel to each other. Also, the distances between adjacent cross sections P may not be uniform.

Moreover, each functional unit shown in FIGS. 2 and 6 shows a functional configuration, and does not limit a specific implementation form. For example, in the control devices 5 and 5A, it is not necessary to implement hardware corresponding to each functional unit individually, and the configuration is such that one processor executes a program to realize the functions of a plurality of functional units. Of course, it is also possible. Further, part of the functions realized by software in each of the above embodiments may be realized by hardware, or part of the functions realized by hardware may be realized by software. In addition, the specific detailed configurations of other parts of the image display systems 1 and 1A can be arbitrarily changed without departing from the scope.

Further, for example, the step units of the operations shown in FIGS. 4 and 7 are divided according to the main processing contents in order to facilitate understanding of the operations of the image display systems 1 and 1A. The present disclosure is not limited by the division method or names of the . It may be divided into many steps depending on the processing contents. Also, one step unit may be divided so as to include many processes. Also, the order of the steps may be changed as appropriate within the scope of the present disclosure.

Reference Signs List 1, 1A... Image display system, 5, 5A... Control device, 10A to 10E... Projector, 15A to 15E... Screen, 20A to 20E... Image, 25... CPU, 30... Reception unit, 32... Cross-sectional data generation unit, 34 ... image data generation section 36 ... transmission control section 38 ... RAM 40 ... ROM 42 ... storage section 44 ... three-dimensional shape data storage area 46 ... data set number information storage area 48 ... position information storage area 50... Cross-sectional shape data storage area, 52... Image data storage area, 53... Input unit, 55... Transmission unit, 56... Bus, 60... Detection device, 62... Judgment unit, 64... Operation unit, 66... Connection unit, CD : cross-sectional shape data, D: image data, P: cross section, UD: indicator.

Claims (7)

a plurality of translucent screens;
a plurality of projectors that project images onto each of the plurality of screens;
a control device connected to each of the plurality of projectors and configured to transmit a plurality of image data to each of the plurality of projectors;
with
The control device is
receiving three-dimensional shape data and the number of data sets in a process of generating a plurality of cross-sectional shape data from the three-dimensional shape data;
generating the plurality of cross-sectional shape data from the three-dimensional shape data based on the number of data sets;
generating the plurality of image data based on the plurality of cross-sectional shape data;
transmitting the plurality of image data to each of the plurality of projectors;
image display system. the plurality of screens includes a first screen;
The control device receives screen position information indicating the position of the first screen;
Determining a position for clipping on the three-dimensional shape data based on the number of data sets, and generating cross-sectional shape data corresponding to the position;
2. The image display system according to claim 1, wherein first image data, which is one of the plurality of image data, is generated based on the cross-sectional shape data corresponding to the position and the screen position information. . 3. The image display system of claim 2, wherein the controller determines the position based on the screen position information when the number of data sets and the number of screens match. wherein, when the number of data sets and the number of screens do not match, the control device determines the positions by arranging cross sections corresponding to the number of data sets at equal intervals on the three-dimensional shape data. Item 3. The image display system according to item 2. the plurality of screens includes a second screen;
Further comprising a plurality of detection devices corresponding to each of the plurality of screens and detecting a user operation on each of the plurality of screens,
The control device is

generating the first image data based on the operation when determining that the operation is an operation on the first screen;
3. The method according to claim 2, comprising generating second image data, which is one of the plurality of image data, based on the operation when determining that the operation is an operation on the second screen. image display system. Receiving the number of data sets in the process of generating cross-sectional shape data from three-dimensional shape data;
generating a plurality of pieces of cross-sectional shape data from the three-dimensional shape data based on the number of data sets;
generating a plurality of image data based on the plurality of cross-sectional shape data;
transmitting a plurality of the image data to a plurality of projectors that project images onto a translucent screen;
a controller, including Receiving the number of data sets in the process of generating cross-sectional shape data from three-dimensional shape data;
generating a plurality of pieces of cross-sectional shape data from the three-dimensional shape data based on the number of data sets;
generating a plurality of image data based on the plurality of cross-sectional shape data;
transmitting the plurality of image data to a projector that projects an image onto a translucent screen;
data processing methods, including

Images