JP2017040685A - Image display system, information processor, image display method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To display an area which a user desires to display, when an image in which a wide range is photographed, or the like is displayed.SOLUTION: An image display system includes one or more display devices and one or more information processors connected to the display devices and displays a display image. The image display system comprises: inputting image data and an operation for changing an area, from among the image data, displayed by the display device as a display image; reducing the size of a portion or a whole of an image represented by the image data to generate a reduced image; generating, once the reduced image is generated and the operation is input, an almost equal magnification image, based on the image data or by nearly equal magnification of a portion or a whole of a place reduced in the reduced image; transmitting data representing the almost equal magnification image to the display device; and displaying the area on the basis of the almost equal magnification image.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an image display system, an information processing apparatus, an image display method, and a program.

  Conventionally, a method for generating an image showing a wide range such as an omnidirectional direction by combining a plurality of images is known.

  For example, in the generation of an omnidirectional image, the inclination of the imaging device with respect to the vertical direction is detected, and the conversion table used for image processing is corrected. Thus, a method for generating an omnidirectional image with a correct vertical direction corresponding to the inclination of an imaging apparatus that captures an omnidirectional image is known (for example, Patent Document 1).

  However, in the conventional method, when an image of a wide range, that is, a so-called omnidirectional image or the like is displayed, an area that the user wants to display may not be displayed.

  The present invention has been made in view of the above problems, and an object of the present invention is to be able to display an area that a user wants to display when displaying an image captured over a wide range.

  In one aspect, the image display system includes one or more display devices and one or more information processing devices connected to the display device, and displays a display image. The information processing device includes image data, An input unit that inputs an operation for changing a region to be displayed as a display image on the display device, and a reduction unit that generates a reduced image by reducing part or all of the image indicated by the image data; When the reduced image is generated and the operation is input, a partly or all of the portion reduced based on the image data or reduced by the reduced image is made to be substantially the same size, so that a substantially equal size image is obtained. A substantially equal-magnification unit to be generated; and a transmission unit that transmits data indicating the substantially equal-magnification image to the display device, and the display device displays the region based on the substantially equal-magnification image.

  According to each embodiment of the present invention, it is possible to display an area that the user wants to display when displaying an image captured over a wide range.

1 is a block diagram illustrating an example of an overall configuration of an image display system according to an embodiment of the present invention. It is a figure which shows an example of the display image displayed by the image display system which concerns on one Embodiment of this invention. It is a figure which shows an example of the omnidirectional camera and omnidirectional image which concern on one Embodiment of this invention. It is a block diagram which shows an example of the hardware constitutions of the information processing apparatus which concerns on one Embodiment of this invention. It is a block diagram which shows an example of the hardware constitutions of the display apparatus which concerns on one Embodiment of this invention. It is a flowchart which shows an example of the whole process by the image display system which concerns on one Embodiment of this invention. It is a figure which shows the production example of the reduction image by the image display system which concerns on one Embodiment of this invention. It is a figure which shows the example of rotation of the reduction image by the image display system which concerns on one Embodiment of this invention. It is a figure which shows the example of a production | generation of the substantially equal magnification image by the image display system which concerns on one Embodiment of this invention. It is a figure which shows an example of the display by the comparative example which concerns on one Embodiment of this invention. It is a flowchart which shows an example of the whole process by the image display system which concerns on one Embodiment of 2nd Embodiment of this invention. It is a figure which shows the example of a process result of the whole process by the image display system which concerns on one Embodiment of 2nd Embodiment of this invention. It is a flowchart which shows an example of the whole process by the image display system which concerns on one Embodiment of 3rd Embodiment of this invention. It is a figure which shows the example of a process result of the whole process by the image display system which concerns on one Embodiment of 3rd Embodiment of this invention. It is a functional block diagram which shows an example of a function structure of the image display system which concerns on one Embodiment of this invention.

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. In the present specification and drawings, components having substantially the same functional configuration are denoted by the same reference numerals, and redundant description is omitted.

<First Embodiment>
<Example of image display system and information processing apparatus>
First, an example of the overall configuration of the image display system according to the present embodiment will be described.

  FIG. 1 is a block diagram showing an example of the overall configuration of an image display system according to an embodiment of the present invention. As illustrated, for example, the image display system 1 includes a PC (Personal Computer) that is an example of an information processing apparatus, and a projector that is an example of a display apparatus. Hereinafter, as shown in the figure, the image display system 1 will be described as an example having one PC 11 and four projectors, ie, a first projector 1A, a second projector 1B, a third projector 1C, and a fourth projector 1D. To do.

  Image data D1 is input to the PC 11. For example, the image data D1 is an image captured by a so-called omnidirectional camera (hereinafter simply referred to as an “omnidirectional camera”) 3 (hereinafter referred to as an “omnidirectional image”) that can capture all directions of the user USR. It is the data which shows. When the image data D1 is input to the PC 11, the PC 11 displays an image on each projector based on the image data D1, and combines the images displayed on each projector (hereinafter referred to as “display image”). Display on screen 2.

  Note that the image data D1 is not limited to data indicating a still image, and may be data indicating a moving image.

  Further, as shown in the drawing, it is assumed that the projectors have different directions, that is, the directions of the optical axes are different. For example, the first projector 1A, the third projector 1C, and the fourth projector 1D have optical axes that are parallel to the horizontal direction, and the second projector 1B has a vertical direction that is orthogonal to the horizontal direction. Assume that the optical axes are parallel.

  In the description below, the horizontal direction (corresponding to the depth direction in the drawing) pointed to by the optical axis of the third projector 1C is defined as the front direction, and is defined as the Z axis. In addition, the right-hand direction (corresponding to the left-right direction in the figure) with respect to the Z axis is taken as the X axis. On the other hand, the vertical direction (corresponding to the vertical direction in the figure) perpendicular to the Z axis and the X axis is taken as the Y axis. Also, rotation around the X axis is Pitch rotation, rotation around the Y axis is Yaw rotation, and rotation around the Z axis is Roll rotation.

  FIG. 2 is a diagram illustrating an example of a display image displayed by the image display system according to the embodiment of the present invention. 2A is a plan view and FIG. 2B is a side view. In the following description, with respect to the horizontal direction, the angle that coincides with the optical axis of the third projector 1C is set as the origin of the horizontal angle related to Yaw rotation (hereinafter referred to as “Yaw angle”), and is 0 °. On the other hand, with respect to the vertical direction, the angle parallel to the horizontal direction is set to 0 ° as the origin of the vertical angle related to pitch rotation (hereinafter referred to as “pitch angle”). It is assumed that the state where the Pitch angle is 0 ° is a vertical state, and the optical axis of the second projector 1B has a Picth angle of 0 °.

  As shown in FIG. 2A, the first projector 1A, the third projector 1C, and the fourth projector 1D, for example, mainly display a range of 120 °, respectively, and display one display image on the screen 2. indicate.

  First, the horizontal direction will be described with reference to the example shown in FIG. In FIG. 2A, the third projector 1C mainly displays the range of 300 ° to 360 ° and 0 ° to 60 ° of the Yaw angle. The fourth projector 1D mainly displays a range of 60 ° to 180 °. Further, the first projector 1A mainly displays a range of 180 ° to 300 °. Each range displayed by each projector may have an overlapping range as shown in the figure.

  As described above, when the Yaw angles of 120 ° are respectively displayed by the three projectors, the image display system can display the display image in the horizontal direction of 360 °.

  On the other hand, the vertical direction will be described with reference to an example shown in FIG. In FIG. 2B, the first projector 1A, the third projector 1C, and the fourth projector 1D mainly display ranges of 30 ° to 90 ° and 270 ° to 330 °, respectively, among the pitch angles. Further, the second projector 1B mainly displays ranges of 0 ° to 30 ° and 330 ° to 360 ° among the pitch angles. Each range displayed by each projector may have an overlapping range as shown in the figure.

  As described above, when each projector displays the pitch angle of 60 °, the image display system can display the display image in the vertical direction of 180 °.

  Note that the range displayed by each projector may not be equal. The screen 2 may be a display.

  Furthermore, the number of display devices is not limited to four. That is, the number of display devices may be other numbers. The information processing apparatus is not limited to a PC, and may be a server, a mobile PC, a smartphone, a tablet, or the like. Furthermore, the information processing apparatus may be an information processing system having a plurality of information processing apparatuses, and the information processing system may have, for example, a PC and a tablet.

  The screen 2 is preferably hemispherical as shown. That is, the place where the display image is displayed is preferably a hemispherical place as shown. As shown in the figure, when the screen 2 is a so-called dome shape having a hemispherical shape, the image display system can display a display image in a horizontal direction 360 ° from the center of the hemisphere. However, the screen 2 is not limited to a hemispherical shape, and may have another shape.

<Example of spherical camera and spherical image>
FIG. 3 is a diagram illustrating an example of an omnidirectional camera and an omnidirectional image according to an embodiment of the present invention. For example, as shown in FIG. 3A, the omnidirectional camera 3 includes a first lens 3H1 and a second lens 3H2. The first lens 3H1 and the second lens 3H2 are each a wide-angle lens, a fish-eye lens, or the like that can capture a range of an angle of view of 180 °. That is, the omnidirectional camera 3 is an example of a camera that can image 360 ° in the horizontal direction and 360 ° in the vertical direction of the user USR, as shown in FIG. The omnidirectional camera 3 may be an omnidirectional camera, a wide-angle camera, a camera using a fisheye lens, or a combination thereof.

  The image data D1 indicating the omnidirectional image is generated by the omnidirectional camera 3, for example. For example, based on the operation by the user USR, the omnidirectional camera 3 first uses the first lens 3H1 and the second lens 3H2 to capture an image (hereinafter referred to as “captured image”) D2 that captures a range of 180 ° in the horizontal direction. Imaging is performed as shown in FIG. 3C and FIG. Next, the omnidirectional camera 3 combines the captured images D2 shown in FIGS. 3C and 3D, respectively, and the image of FIG. Data D1 is generated. When the image data D1 is captured by the omnidirectional camera 3 or the like, the image data D1 can indicate a wide range such as 360 ° in the horizontal direction.

<Hardware configuration example>
FIG. 4 is a block diagram illustrating an example of a hardware configuration of the information processing apparatus according to the embodiment of the present invention. Specifically, the PC 11 includes a CPU (Central Processing Unit) 11H1, a storage device 11H2, an input I / F (interface) 11H3, an input device 11H4, an output I / F 11H5, and an output device 11H6.

  The CPU 11H1 is a calculation device that performs various processes and processes various data, and a control device that controls each hardware and the like. The CPU 11H1 includes an arithmetic device or a control device that assists the CPU 11H1, and may be configured by a plurality of devices.

  The storage device 11H2 stores data, programs, setting values, and the like. The storage device 11H2 is a so-called memory or the like. The storage device 11H2 may include an auxiliary storage device such as a hard disk.

  The input I / F 11H3 is an interface for inputting data such as image data D1 and user operations. Specifically, the input I / F 11H3 is a connector and an external device to be connected. The input I / F 11H3 may use a network or wireless.

  The input device 11H4 is a device for inputting operations and data based on commands and the like. Specifically, the input device 11H4 is, for example, a keyboard and a mouse.

  The output I / F 11H5 is an interface that outputs data and the like. Specifically, the output I / F 11H5 is a connector and an external device to be connected. The output I / F 11H5 may use a network or wireless.

  The output device 11H6 is a device that outputs data and the like. Specifically, the output device 11H6 is, for example, a display.

  The input device 11H4 and the output device 11H6 may be a touch panel display in which the input device and the output device are integrated. Further, the input device 11H4 and the output device 11H6 may be configured by another information processing device such as a smartphone or a tablet.

  FIG. 5 is a block diagram illustrating an example of a hardware configuration of a display device according to an embodiment of the present invention. Specifically, the first projector 1A, the second projector 1B, the third projector 1C, and the fourth projector 1D have an input I / F 1AH1, an output device 1AH2, a storage device 1AH3, a CPU 1AH4, and an input device 1AH5. Have each. Hereinafter, an example in which each projector has the same hardware configuration will be described.

  The input I / F1AH1 is an interface for inputting data or signals from a PC or the like to each projector. Specifically, the input I / F 1 AH 1 is a connector, a driver, a processing IC (Integrated Circuit), or the like.

  The output device 1AH2 is an optical component such as a lens and a light source. The output device 1AH2 displays an image based on input data or signals.

  The storage device 1AH3 stores data, programs, setting values, and the like. The storage device 1AH3 is a main storage device such as a memory, an auxiliary storage device such as a hard disk, or a combination thereof.

  The CPU 1AH4 is an arithmetic device that performs various processes and processes various data, and a control device that controls each hardware and the like. Note that the CPU 1AH4 includes an arithmetic device or a control device that assists the CPU 1AH4, and may be configured by a plurality of devices.

  The input device 1AH5 is a device for inputting operations and data based on commands and the like. Specifically, the input device 1AH5 is, for example, a switch, a keyboard, a mouse, or the like.

  Each projector inputs data or a signal based on image data through an input I / F1AH1 by wireless such as a network, NFC (Near Field Communication), or a combination thereof, and displays an image. Each projector may input data using a recording medium such as a USB (Universal Serial Bus) memory.

<Example of overall processing>
FIG. 6 is a flowchart showing an example of overall processing by the image display system according to the embodiment of the present invention.

  In step S01, the image display system displays a display image based on the image data. Note that image data and the like are input in advance.

  In step S02, the image display system waits for an operation to be input by the user or the like. When the operation is input, the image display system proceeds to step S03.

  In step S03, it is determined whether or not a reduction operation in the vertical direction has been input. Next, when it is determined that a reduction operation in the vertical direction has been input (YES in step S03), the image display system proceeds to step S04. On the other hand, when it is determined that the reduction operation in the vertical direction has not been input (NO in step S03), the image display system proceeds to step S05.

  In step S04, the image display system reduces and displays part or all of the image indicated by the image data.

  In step S05, the image display system determines whether a rotation operation has been input. Next, when it is determined that a rotation operation has been input (YES in step S05), the image display system proceeds to step S06. On the other hand, when it is determined that the rotation operation has not been input (NO in step S05), the image display system ends the process. When it is determined that a rotation operation has not been input, the image display system may perform various processes based on the input operation.

  In step S06, the image display system determines whether or not the image display system has been reduced in the vertical direction. Next, when it is determined that the image has been reduced in the vertical direction (YES in step S06), the image display system proceeds to step S07. On the other hand, when it is determined that the image has not been reduced in the vertical direction (NO in step S06), the image display system proceeds to step S08.

  In step S07, the image display system sets a part or all of the image indicated by the image data to approximately the same magnification. Note that the image display system may allow the user to set whether or not to make the magnification approximately the same.

  In step S08, the image display system rotates and displays the display image.

<Example of processing results>
FIG. 7 is a diagram showing a processing result example of the entire processing by the image display system according to the embodiment of the present invention. FIG. 7 shows an example of the processing result of step S04 (FIG. 6). Hereinafter, an example in which an image (hereinafter referred to as “first image”) Img1 indicated by the image data of the omnidirectional image is the image shown in FIG. 7D will be described. In FIG. 7D, the output range OUT is displayed on the screen 2 as a display image. That is, the area that falls within the output range OUT is an example of an area that is displayed as a display image. On the other hand, it is assumed that the user wants to display the display image centered on the faces of people shown in the central portion.

  That is, as shown in FIG. 7D, when the first image Img1 is displayed as a display image, the subject may not be displayed on the screen 2 or only a part of the subject may be displayed. Specifically, as shown in FIG. 7D, since the faces and human bodies of the people shown in the central portion are below the output range OUT, all or part of the faces and human bodies are not displayed as display images. It is an example.

  Therefore, the user performs an operation of changing the area displayed on the display image. For example, the operation is performed in the vertical direction (Y-axis direction). Next, when a reduction operation in the vertical direction is input (YES in step S03 in FIG. 6), the image display system generates a reduced image Img2 as shown in FIG. 7B. Specifically, the reduced image Img2 is generated so that a part or the whole of the first image Img1 is reduced so that an area that the user wants to display can be displayed. That is, as shown in FIGS. 7D and 7E, the first image Img1 is reduced so that the subject that the user wants to display in the first image Img1 enters the output range OUT, and the reduced image Img2 is displayed. Is generated. In this way, as shown in FIG. 7E, since the area that the user wants to display falls within the output range OUT, the image display system can display the subject that the user wants to display as a display image (FIG. 6). Step S04).

  FIG. 8 is a diagram illustrating a rotation example of the reduced image by the image display system according to the embodiment of the present invention. As shown in the figure, in the image display system, the user can perform an operation of rotating the reduced image Img2. When a rotation operation is input (YES in step S05 in FIG. 6), the image display system displays an area that was not displayed as a display image before rotation or an area that was not large enough for display before rotation. Can be displayed as a display image.

  FIG. 9 is a diagram illustrating a generation example of a substantially equal-size image by the image display system according to the embodiment of the present invention. Thereafter, similarly to FIG. 7, a reduced image is generated (YES in step S06 of FIG. 6), and an operation for rotating the image is input as shown in FIG. 8 (YES in step S05 of FIG. 6). A case will be described as an example. The operation only needs to include an operation of rotating in the vertical direction (Pitch rotation). For example, a combination with an operation of rotating in the horizontal direction (Yaw rotation), that is, an operation of rotating in an oblique direction, etc. Good.

  In this example, the image display system generates an image (hereinafter, referred to as “substantially equal-sized image”) Img3 in which part or all of the portion reduced in the vertical direction is approximately equal-magnified. The substantially equal-magnification image Img3 is generated, for example, by resetting the reduced image Img2 shown in FIG. 7B to the same magnification as the first image Img1, that is, reducing the reduction (step S07 in FIG. 6). Note that the substantially equal magnification is not limited to the process of setting the reduced image Img2 to the same magnification as the first image Img1. For example, the substantially equal magnification may be a process of setting the magnification so that a predetermined pixel PIX (FIG. 7) is displayed to the extent that a person does not notice it even if it is displayed on the display image.

  Further, the approximately equal magnification may be performed based on input image data. Specifically, when a reduced image is generated, input image data, that is, data indicating an image before being reduced is copied and stored. Next, the substantially equal magnification may generate a substantially equal-magnification image Img3 using data indicating the copied image before being reduced. That is, the image display system leaves the original image data as it is at the time of reduction. In this case, when the generation of the substantially equal-sized image Img3 is performed based on the image data, the image display system can generate the approximately equal-sized image Img3.

  Next, as shown in FIG. 9B, the image display system displays a display image based on the substantially equal-sized image Img3 (step S08 in FIG. 6). Specifically, as shown in FIG. 9B, the image display system rotates the substantially equal-sized image Img3 based on the input rotation operation and displays it on the screen 2 as a display image.

  As shown in FIGS. 7B and 7E, the reduced image Img2 may include a predetermined pixel PIX. The predetermined pixel PIX is, for example, a pixel to which no data is input because it is outside the angle of view of the first lens 3H1 (FIG. 3) and the second lens 3H2 (FIG. 3). Further, the predetermined pixel may be a pixel in a range set by a user or the like.

  As shown in FIG. 9B, when a rotation operation is input, the image display system displays a predetermined pixel PIX (FIG. 7) displayed when a display image is displayed based on a substantially equal-magnification image Img3. ) Can be reduced so that the display image can be displayed.

  Note that enlargement may be performed in the process of approximately equal magnification.

<Comparative example>
FIG. 10 is a diagram illustrating an example of display according to a comparative example according to an embodiment of the present invention. Hereinafter, as in FIG. 9, a comparative example will be described in which a reduced image Img2 is generated and an operation for rotating the image is input as shown in FIG. Furthermore, it is assumed that a rotation operation as shown in FIG.

  As shown in FIG. 10D, when the display image is displayed based on the reduced image Img2, since the predetermined pixel PIX enters the output range OUT, the predetermined pixel PIX is displayed as the display image.

Second Embodiment
The second embodiment can be realized using, for example, the same image display system as the first embodiment. Hereinafter, an example using the same image display system as in the first embodiment will be described. Therefore, description of the image display system and hardware will be omitted, and different points will be mainly described. Compared to the first embodiment, the second embodiment differs in overall processing.

<Example of overall processing>
FIG. 11 is a flowchart showing an example of overall processing by the image display system according to the embodiment of the second embodiment of the present invention. Compared to FIG. 6, FIG. 11 differs in that steps S20 to S23 are added. Hereinafter, different points will be described.

  In step S20, the image display system determines whether or not a predetermined pixel is displayed. Next, when it is determined that the predetermined pixel is displayed (YES in step S20), the image display system proceeds to step S21. On the other hand, if it is determined that the predetermined pixel is not entered into the display area (NO in step S20), the image display system proceeds to step S08.

  In step S <b> 21, the image display system determines whether or not the entire predetermined pixel is displayed. Next, when it is determined that all of the predetermined pixels enter the display area (YES in step S21), the image display system proceeds to step S07. On the other hand, when it is determined that all of the predetermined pixels do not enter the display area (NO in step S21), the image display system proceeds to step S22.

  In step S <b> 22, the image display system determines whether or not a part of the predetermined pixel enters an area where it is displayed. Next, when it is determined that a part of the predetermined pixel enters the display area (YES in step S22), the image display system proceeds to step S23. On the other hand, when it is determined that a part of the predetermined pixel does not enter the display area (NO in step S22), the image display system proceeds to step S08.

  In step S23, the image display system changes the reduction ratio.

<Example of processing results>
FIG. 12 is a diagram illustrating a processing result example of the overall processing by the image display system according to the embodiment of the second embodiment of the present invention. For example, when the image is reduced and displayed in step S04 shown in FIG. 11 and a rotation operation or the like in the vertical direction is input thereto, the predetermined pixel PIX is displayed on the screen 2 as shown in FIG. May be displayed. This can be shown in FIG. 12D by a cross-sectional view taken along the line XY. As shown in FIG. 12D, the output range OUT includes some pixels (hereinafter referred to as “partial pixels”) PIXP included in the predetermined pixel PIX. Therefore, when the image in the state shown in FIG. 12D is displayed as a display image, some pixels PIXP are displayed.

  As described above, when the partial pixel PIXP is displayed, the image display system determines that a part of the predetermined pixel is displayed (YES in step S22 in FIG. 11). Next, the image display system changes the reduction ratio (step S23 in FIG. 11).

  In the example shown in FIG. 12D, the image display system changes the reduction ratio so that the image shown in FIG. 12E (hereinafter referred to as “changed image”) Img4 is displayed as the display image. Specifically, assuming that the angle in a range where the predetermined pixel PIX is present is “A” and the angle in a range other than the portion where the predetermined pixel PIX is present is “B”, the reduction ratio of the reduced image Img2 is “ (360 ° -A) / 360 ° ”.

  On the other hand, as shown in FIG. 12E, the image display system makes the portions related to the partial pixels PIXP substantially equal to each other so that the displayed partial pixels PIXP are reduced. That is, the image display system changes the reduction ratio so as to reduce the portion where the angle is “B”. In this case, the reduction ratio of the changed image Img4 can be expressed as “(360 ° −B) / 360 °”.

  In this way, when the reduction ratio is changed, the image display system can display the display image by making it difficult for some of the pixels PIXP to be displayed.

<Third Embodiment>
For example, the third embodiment can be realized by using the same image display system as that of the first embodiment. Hereinafter, an example using the same image display system as in the first embodiment will be described. Therefore, description of the image display system and hardware will be omitted, and different points will be mainly described. Compared to the first embodiment, the third embodiment differs in overall processing.

<Example of overall processing>
FIG. 13 is a flowchart showing an example of the overall processing by the image display system according to an embodiment of the third embodiment of the present invention. FIG. 13 differs from FIG. 6 in that steps S30 to S33 are added. Hereinafter, different points will be described.

  In step S30, the image display system stores the reduction ratio.

  In step S31, the image display system stores the rotation angle.

  In step S32, the image display system rotates the image based on the rotation angle.

  In step S33, after the rotation in step S32, the image display system reduces a part or all of the image toward the vertex position and displays the display image.

<Example of processing results>
FIG. 14 is a diagram illustrating a processing result example of the overall processing by the image display system according to the embodiment of the third embodiment of the present invention. As shown in FIG. 14A, it is assumed that a rotation operation is input to the first image Img1 in the input state or in a state of being approximately the same magnification (YES in step S05 in FIG. 13). As shown in FIG. 14B, the position displayed at the highest position (hereinafter referred to as “vertex”) PH is changed by such a rotation operation (step S32 in FIG. 13).

  In this example, after rotation, the image display system reduces the image toward a direction (hereinafter referred to as “vertex direction”) PHD toward the position where the vertex PH is reached (step S33 in FIG. 13).

  When the image is reduced in the vertex direction PHD, the predetermined pixel PIX is positioned directly below the vertex PH. That is, since the predetermined pixel PIX is difficult to enter the output range, the image display system can display a display image so that the partial pixel PIX is difficult to be displayed. Further, since the reduction is performed, the image display system can display an area that the user wants to display as a display image.

<Functional configuration example>
FIG. 15 is a functional block diagram illustrating an example of a functional configuration of an image display system according to an embodiment of the present invention. For example, the image display system 1 includes an input unit 1F1, a reduction unit 1F2, a substantially equal magnification unit 1F3, and a display unit 1F4.

  The input unit 1F1 inputs the image data D1 and an operation OPR that changes a region of the image data D1 that is displayed on the display device as a display image. The input unit 1F1 is realized by, for example, the input I / F 11H3 (FIG. 4) or the input device 11H4 (FIG. 4).

  The reduction unit 1F2 generates a reduced image Img2 by reducing part or all of the image such as the first image Img1 indicated by the image data D1. The reduction unit 1F2 is realized by, for example, the CPU 11H1 (FIG. 4).

  When the reduced image Img2 is generated and the operation OPR is input, the approximately equal-magnification unit 1F3 substantially equalizes a part or all of the portion reduced based on the image data D1 or the reduced image Img2. The substantially equal-magnification image Img3 is generated. Note that the substantially equal magnification unit 1F3 is realized by the CPU 11H1 or the like, for example.

  The display unit 1F4 displays a display image based on the substantially equal-sized image Img3. The display unit 1F4 is realized by, for example, the first projector 1A (FIG. 1), the second projector 1B (FIG. 1), the third projector 1C (FIG. 1), the fourth projector 1D (FIG. 1), and the like.

  When data such as an omnidirectional image indicating 360 ° in the horizontal direction is input by the input unit 1F1, the image display system 1 can display a display image in a hemispherical place such as the screen 2 shown in FIG. When a rotation operation or the like for changing the area displayed on the display image by the user is input to the display image, the image display system 1 generates a reduced image Img2 by the reduction unit 1F2.

  When the reduced image Img2 is generated and an operation OPR such as a rotation operation is input, when a display image is displayed based on the reduced image Img2 after the rotation, a predetermined pixel may be displayed. On the other hand, the image display system 1 generates a substantially equal-sized image Img3 by the approximately equal-magnification unit 1F3. Next, when the image display system 1 displays a display image based on the substantially equal-sized image Img3, the image display system 1 can reduce the display of predetermined pixels.

  Therefore, the image display system 1 can display an area that the user wants to display when displaying an image of a wide range such as an omnidirectional image.

  Note that all or part of each processing according to the present invention displays an image on a computer described in an assembler, a legacy programming language such as C and Java (registered trademark), an object-oriented programming language, or a combination thereof. It may be realized by a program for making it happen. That is, the program is a computer program for causing a computer such as an information processing apparatus or an image display system including the information processing apparatus to execute each process.

  The program can be stored and distributed in a computer-readable recording medium such as a ROM or an EEPROM (Electrically Erasable Programmable ROM). The recording medium may be an EPROM (Erasable Programmable ROM), a flash memory, a flexible disk, an optical disk, an SD (registered trademark) card, or an MO. Furthermore, the program may be distributed through a telecommunication line.

  Furthermore, the image display system has two or more information processing devices connected to each other via a network or the like, and a plurality of information processing devices perform processing in a distributed, parallel, or redundant manner, respectively, for all or part of various processes. May be. In the image display system, a device different from that described above may perform processing.

  The preferred embodiments of the present invention have been described in detail above. However, the present invention is not limited to specific embodiments, and various modifications or changes can be made within the scope of the gist of the present invention described in the claims. Is possible.

1 Image display system 11 PC
2 Screen 3 Spherical camera D1 Image data

JP 2013-214947 A

Claims (10)

An image display system that includes one or more display devices and one or more information processing devices connected to the display device, and displays a display image,
The information processing apparatus is
An input unit for inputting image data and an operation of changing a region of the image data to be displayed as a display image on the display device;
A reduction unit that generates a reduced image by reducing part or all of the image indicated by the image data;
When the reduced image is generated and the operation is input, a substantially equal-sized image is generated based on the image data or by partially magnifying a part or all of the portion reduced by the reduced image. An approximately equal magnification part,
A transmission unit for transmitting data indicating the substantially equal-sized image to the display device,
The display device displays the region based on the substantially equal-magnification image;
Image display system. An information processing apparatus connected to one or more display devices for displaying a display image,
An input unit for inputting image data and an operation of changing a region of the image data to be displayed as a display image on the display device;
A reduction unit that generates a reduced image by reducing part or all of the image indicated by the image data;
When the reduced image is generated and the operation is input, a substantially equal-sized image is generated based on the image data or by partially magnifying a part or all of the portion reduced by the reduced image. An approximately equal magnification part,
An information processing apparatus comprising: a transmission unit that transmits data indicating the substantially equal-sized image to the display device.   The information processing apparatus according to claim 2, wherein the image data is data indicating a horizontal direction of 360 °.   The information processing apparatus according to claim 2, wherein the reduction and the substantially equal magnification are performed in a vertical direction.   The information processing apparatus according to any one of claims 2 to 4, wherein the operation includes an operation of changing the region in a vertical direction.   The information processing apparatus according to claim 2, wherein when the predetermined pixel is included in the area due to the change by the operation, the approximately equal-magnification unit generates the approximately equal-magnification image.   The information processing apparatus according to any one of claims 2 to 5, wherein when the predetermined pixel is included in the area due to the change by the operation, the reduction unit changes a reduction ratio for generating the reduced image.   The information processing apparatus according to claim 2, wherein the reduction unit reduces the image toward a position displayed at a highest position by the change by the operation. An image display method performed by an image display system that includes one or more display devices and one or more information processing devices connected to the display device and displays a display image,
The image display system is configured to input image data and an operation for changing an area of the image data to be displayed as a display image on the display device;
A reduction procedure in which the image display system generates a reduced image by reducing a part or all of an image indicated by the image data;
When the reduced image is generated and the operation is input, the image display system sets a part or all of a portion reduced based on the image data or reduced by the reduced image to approximately the same magnification. An approximately equal magnification procedure for generating an approximately equal magnification image;
A transmission procedure in which the image display system transmits data indicating the substantially equal-sized image to the display device;
A display procedure in which the image display system includes a display procedure for displaying the region based on the substantially equal-sized image. A program having one or more display devices and one or more information processing devices connected to the display device, for causing a computer that displays a display image to execute image display,
An input procedure in which the computer inputs image data and an operation of changing a region of the image data to be displayed as a display image on the display device;
A reduction procedure in which the computer generates a reduced image by reducing a part or all of an image indicated by the image data;
When the reduced image is generated and the operation is input, the computer is substantially equal to a part or all of the portion reduced based on the image data or reduced by the reduced image. A substantially equal magnification procedure for generating a double image;
A transmission procedure in which the computer transmits data indicating the substantially equal-magnification image to the display device;
A program for causing the computer to execute a display procedure for displaying the area based on the substantially equal-magnification image.

Images