JP2012137581A - Image display control server - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a technique for extracting part of the whole of image data to display it on a display of a portable terminal device, so that an image displayed on a distant display and the image displayed on the display of the portable terminal device compose an image together.SOLUTION: An image display control server exerts control so that image data is divided and displayed on a display of a portable terminal device and an image display device, and includes: image data storage means; scale storage means; portable display information reception means; distance calculation means for calculating a distance between the portable terminal device and the image display device; azimuth difference calculation means for calculating an azimuth difference between the portable terminal device and the image display device; distance-of-vision reception means for receiving the distance of vision from the portable terminal device; division image generation means for generating a division image on the basis of a scale value, portable display information, the distance, the azimuth difference and the distance of vision; and division image transmission means for transmitting the division image to the portable terminal device.

Description

  The present invention relates to an image display control system that divides and displays an image on a plurality of displays.

  2. Description of the Related Art Conventionally, a technique has been proposed in which a plurality of displays are arranged side by side and image data is displayed as if the plurality of displays are one huge display by cooperative control by a display control device.

  In Patent Document 1, in a field such as an electronic signage (digital signage) for displaying an advertisement on a display device, a plurality of displays are arranged continuously or intermittently (actually, no display is arranged and a portion lacking an image). A technique has been proposed in which an image is divided and displayed in consideration of the sizes and resolutions of a plurality of displays in the virtual display area.

JP 2010-97491 A

  Japanese Patent Application Laid-Open No. 2004-228688 further provides a technique for displaying a part of an image on a mobile terminal possessed by a viewer in front of the plurality of displays.

  However, the technique proposed in Patent Document 1 uses the virtual display area as, for example, one huge wall surface, does not consider the distance between the viewer's mobile terminal and the wall surface, or uses a mobile terminal. Controls the display of partial images when placed on a wall, such as a distant display such as a display installed on a building and a short distance possessed by the viewer It does not consider factors such as the distance relationship of the display of the mobile terminal.

  The present invention relates to a case where a part of image data is displayed on a display at a long distance from the viewer, and an image displayed on the display at a long distance and a portable terminal held by the viewer. It is an object of the present invention to provide a technique for cutting out a part of the entire image data and displaying it on the display of the portable terminal so that the images displayed on the display cooperate to form an image.

  The present invention provides an image display control server that controls display by dividing image data on a display and an image display device of a mobile terminal device, and stores the image data in the image data storage unit and the image data storage unit. Further, scale storage means for storing a scale value when the image data is displayed on the image display device, and portable display information including a display size and resolution of the display of the portable terminal device are received from the portable terminal device. Portable display information receiving means; distance calculating means for calculating a distance between the portable terminal apparatus and the image display apparatus; azimuth difference calculating means for calculating an azimuth difference between the display of the portable terminal apparatus and the image display apparatus; The viewing distance from the eyes of the portable terminal device owner who views the portable terminal device to the display of the portable terminal device is determined as the portable terminal device. The image data stored in the image data storage unit based on the viewing distance receiving means, the scale value, the portable display information, the distance, the azimuth difference, and the viewing distance. Divided image generation means for generating a divided image to be displayed on the mobile terminal device, and divided image transmission means for transmitting the divided image generated by the divided image generation means to the mobile terminal device. Features.

  According to the present invention, even when a portable terminal held by a viewer and another display are at a long distance, an image suitable for display on the display of the portable terminal is cut out from the entire image data and displayed. It is possible to view linked images regardless of the distance and direction from other displays.

1 is a diagram illustrating an example of a system configuration including a mobile terminal device, an image display device, and an image display control server according to an embodiment of the present invention. It is a block diagram which shows an example of the hardware constitutions of an image display control server. It is a block diagram which shows an example of the hardware constitutions of a portable terminal device. It is a figure which shows an example of the external appearance of a portable terminal device. It is a figure which shows the concept of the relationship of the image displayed on the display of an image display apparatus and a portable terminal device in this invention. It is a figure which shows an example of the functional block of an image display control server. It is a figure for demonstrating the relationship between the size of the image in an image display apparatus, the size of the display of a portable terminal device, and distance. It is a figure for demonstrating the relationship between the size of the image in an image display apparatus, the size of the display of a portable terminal device, and a viewing distance. It is a figure for demonstrating the process which determines the image size displayed on the display of a portable terminal device. It is a figure for demonstrating the azimuth | direction difference of an image display apparatus and a portable terminal device. It is a figure for demonstrating the slant deformation process for giving a perspective to the image displayed on the display of a portable terminal device. It is a figure which shows the flowchart of the process which displays an image on a portable terminal device in 1st Embodiment. It is a figure for demonstrating an example of the relationship between the captured image by a portable terminal device, and the image displayed on the display of a portable terminal device. It is a figure for demonstrating the process which calculates the distance of an image display apparatus and a portable terminal device based on the captured image by a portable terminal device. It is a figure which shows the flowchart of the process which displays an image on a portable terminal device in 2nd Embodiment.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
[First Embodiment]

  FIG. 1 is a diagram illustrating an example of a system configuration including a mobile terminal device, an image display device, and an image display control server according to an embodiment of the present invention.

  The mobile terminal device 101 is connected to the image display control server 102 via the network 104, and transmits information such as a geographical current position of the mobile terminal device described later and a display size to the image display control server 102, and image display control. An image to be displayed on the display of the mobile terminal device 101 is received from the server 102.

  The protocol and connection method of the network 104 may be any method, and for example, information can be transmitted via the Internet or a telephone public line. A method of transmitting an image to be displayed on the display of the mobile terminal device 101 from the image display control server 102 may be broadcast such as so-called “one segment”.

  The image display devices 103a to 103c may be configured to receive and display a display image as a signal from the image display control server 102. In this case, reference numeral 105 denotes a cable for transmitting an image signal. As another method, the image display devices 103a to 103c are each connected to an information processing device (not shown), and the information processing device is further connected to the image display control server 102 by a communication technique such as a LAN. The display control server 102 may perform display control in cooperation to display an appropriate image on the image display devices 103a to 103c.

  FIG. 2 is a block diagram illustrating an example of a hardware configuration of the image display control server 102. A display device 201, an input device 202, a CPU 203, a RAM 204, a ROM 205, an external storage device 206, and a network interface 207 are provided.

  The CPU 203 reads and executes a control program stored in the ROM 205 and controls the information processing apparatus. The RAM 204 functions as a buffer and work area for temporarily storing data and the like, and is used as a work area for executing various programs including the OS.

  The external storage device 206 is a storage device such as a hard disk drive, and is used as a short-term and permanent storage device for various programs and various data including programs of the OS and file management system.

  The input device 202 is a user input device represented by a keyboard, a mouse, and the like, and the display device 201 is a device for displaying a processing result of the information processing apparatus. A bus 208 is a system bus that connects the above-described units to each other. In the image display control server 102, the display device 201 and the input device 202 are not essential.

  FIG. 3 is a block diagram illustrating an example of a hardware configuration of the mobile terminal device 101. Basically, it is the same as that of FIG. 2, and only the differences necessary for the description of the present invention will be described.

  The public line interface 308 enables the mobile terminal device 101 to communicate with and communicate with other communication and call devices via a mobile phone line and a mobile phone base station.

  The azimuth sensor 309 can detect, for example, an azimuth indicating which direction the mobile terminal device 101 is directed for each component of the X axis, the Y axis, and the Z axis. The GPS 310 has a GPS reception function, and calculates the longitude and latitude of the current position of the mobile terminal device 101 using the global positioning system.

The image capturing unit 311 includes a photographic lens and an image sensor, and captures a subject image to form image data. The formed image data can be stored in a RAM 304 described later. The above is the description of FIG.
FIG. 4 is a diagram illustrating an example of the appearance of the mobile terminal device.

  On the front surface 401 of the mobile terminal device, an operation panel, a display 402 and the like are arranged. A photographing lens 405 of the image capturing unit is disposed on the back surface 406. Reference numerals 403 and 404 denote vertical and horizontal sizes of the display.

  FIG. 5 is a diagram illustrating a concept of a relationship between images displayed on the display of the image display device and the mobile terminal device according to the present invention. In any case, a plurality of image display devices 103a to 103d are arranged at a long distance, and one image (in the example, an image of “fish and its surroundings”) is displayed. The image may not be displayed entirely by a plurality of image display devices.

  501 of a conceptual diagram is the figure which looked at the above-mentioned conceptual diagram from the back of the viewer who possesses the portable terminal device concerning this invention. The virtual display area 503 is the entire display area managed by the image display control server 102. Four image display devices 103a to 103d are installed. Since the entire virtual display area 503 is not covered by the four image display devices, even the image (“fish and its surroundings”) managed by the image display control server 102 is visible to the viewer 502. There is no part.

  When the portable terminal device 101 possessed by the viewer is directed in the direction of the virtual display area 503, the four image display devices 103a to 103d are image display devices at a long distance from the portable terminal device 101. Regardless, one image is displayed in cooperation. That is, the same portion of the image is displayed in the area where the display of the mobile terminal device 101 overlaps with the four image display devices 103a to 103d, and the portion which is linked to one image is displayed in the non-overlapping area. (508).

  A conceptual diagram 511 is a bird's-eye view of the viewer 502, the mobile terminal device 101, and the virtual display area 503 viewed from above. The black thick line represents the image display device, and the virtual display area 503 is configured in a straight line in the horizontal direction.

  FIG. 6 is a diagram illustrating an example of functional blocks of the image display control server.

  The image display control server 102 receives information to be described later from the mobile terminal device 101 by the receiving unit 603, and an image suitable for displaying on the display of the mobile terminal device 101 by the image generation / transmission unit 610 based on the information. And the image is transmitted to the mobile terminal device 101.

  The mobile display information receiving unit 604 receives display specifications such as the display size and resolution of the mobile terminal device 101.

  The viewing distance receiving unit 605 receives the viewing distance between the person holding the mobile terminal device 101 and the mobile terminal device 101. The viewing distance is precisely the distance between the eyes of the person and the display of the portable terminal device 101. However, since the distance between the eyes of the person and the display of the portable terminal device 101 cannot always be measured strictly, even if it is not an accurate distance, that is, there is an error, it is treated as a viewing distance in the present invention.

  The geographical current position receiving unit 606 receives the geographical current position of the mobile terminal device 101. The mobile terminal device 101 is detected by, for example, the GPS 310 in FIG. 3, but may be another method. For example, there is a technique for detecting based on the position of a wireless LAN base station, a public line base station, or the like. Further, in a building where the GPS 310 cannot be used, the geographical current position may be continuously calculated by the mobile terminal device 101 using an acceleration sensor or the like from the position last detected by the GPS 310 before entering the building.

  The direction receiving unit 607 receives the value of each component of the X-axis, Y-axis, and Z-axis as the direction of the mobile terminal device 101, that is, the direction indicating which direction the mobile terminal device 101 is facing.

  The viewing angle receiving unit 608 receives a viewing angle that can be captured by the image capturing unit (311 in FIG. 3) of the mobile terminal device 101 as, for example, an angle (see 1407 in FIG. 14 described later).

  The captured image receiving unit 609 receives an image captured by the image capturing unit (311 in FIG. 3) of the mobile terminal device 101.

  The distance calculation unit 611 calculates the distance of an image display device (for example, 103a to 103d in FIG. 5) located at a long distance from the mobile terminal device 101 based on information received by the reception unit 603. For this purpose, position information (information on geographical position) may be stored in the position storage unit 623 as information of the image display device. Alternatively, the image information apparatus may be equipped with a GPS or the like, and position information may be acquired as needed.

  The azimuth calculation unit 612 is a difference between the azimuth directed by the mobile terminal device 101 obtained from the information received by the reception unit 603 and the azimuth directed by the image display device (for example, 103a to 103d in FIG. 5) at a long distance. Is calculated. Therefore, the azimuth information may be stored in the azimuth storage unit 624 as information of the image display device. Or you may provide an azimuth | direction sensor etc. in the image information apparatus side, and may acquire azimuth | direction information at any time.

  The image data storage unit 621 stores image data to be displayed on the image display device and the mobile terminal device 101 according to the present invention.

  In the scale storage unit 622, the size (for example, inches) of the image displayed on the image display device at a long distance is set to the number of pixels of the size (for example, the number of pixels) of the image data stored in the image data storage unit 621. A scale value indicating whether it corresponds is stored. However, the unit is merely an example, and any unit may be used as long as the ratio can be calculated.

  The divided size calculating unit 613 and the divided region determining unit 614 are based on the values calculated by the distance calculating unit 611 and the azimuth calculating unit 612, the scale value, the position of the viewer (owner of the portable terminal device), and the like. The size to be divided from the image data stored in 621 and which area of the image data to be divided are determined.

  The divided image generation unit 615 actually cuts out the divided image from the image data based on the division size and the divided region determined by the divided size calculation unit 613 and the divided region determination unit 614 and displays the divided image on the display of the mobile terminal device 101. To adjust the size.

  The divided image transmission unit 616 transmits the image generated by the divided image generation unit 615 to the mobile terminal device 101.

  Next, as a concept for explaining the flowchart of FIG. 12, the relationship between the distance between the mobile terminal device and the image display device, the viewing distance, and the display size of the mobile terminal will be described with reference to FIGS.

  FIG. 7 is a diagram for explaining the relationship between the image size in the image display device, the display size of the display of the mobile terminal device, and the distance.

  Hereinafter, since an image displayed on the display of the image display device and the mobile terminal device is viewed, the owner of the mobile terminal device is referred to as a viewer. As for the viewer 701 and the viewer 711, it is assumed that the displays of the portable terminal device 101a and the portable terminal device 101b possessed by both are oriented in the same direction with respect to the distant image display device, and have the same size. It is also assumed that the viewing distance 704 and the viewing distance 714 are equal.

  As shown in FIG. 7, if both viewers hold the mobile terminal device in the same position (for example, horizontal from the eye position) and in the same orientation, the angle 703 and the angle 713 hidden by the viewer by the display of the mobile terminal device are also equal.

  For the viewer, the image displayed on the display of the mobile terminal overlaps with the display of the mobile terminal and the virtual display area 700. This corresponds to a portion hidden from the display of the mobile terminal device (not the main body of the mobile terminal device) from the viewpoint of the viewer. That is, for the viewer 701, when the area 706 is displayed on the display of the mobile terminal device 101a, and for the viewer 711, the area 716 is displayed on the display of the mobile terminal device 101b, the image display device in the virtual display area 700 is displayed. You can feel as if the display on the display of the mobile terminal device is properly divided.

  In the case of the viewer 701 in FIG. 7, the size of the area 706 is “(viewing distance 704 + distance 705) / viewing distance 704 × display size of the mobile terminal device 101a”.

  Here, since the display sizes of the mobile terminal device 101a and the mobile terminal device 101b are equal, and the viewing distance 704 and the viewing distance 714 are equal, the sizes of the area 706 and the area 716 are “viewing distance 704 + distance 705” and “viewing distance 714+”. The distance is 715 ″.

  That is, when the viewing distance does not change, the size of the area displayed on the display of the mobile terminal device is directly proportional to the distance from the viewer to the image display device in the virtual display area 700.

Next, FIG. 8 is a diagram for explaining the relationship between the image size in the image display device, the display size of the mobile terminal device, and the viewing distance.
The same calculation formula as in FIG. 7 can be used.

  In other words, since “(viewing distance + distance) / viewing distance × display size of portable terminal device” is an expression for calculating the size of the area, when only “viewing distance” is changed, “1 / viewing distance” is Proportional to the size of the region. That is, “viewing distance” and “region size” are inversely proportional.

  Referring to FIG. 8, it can be seen that the sizes of the region 806 and the region 816 are inversely proportional to the viewing distance 804 and the viewing distance 814.

  7 to 8 exemplify the size in the vertical direction, the same applies to the horizontal direction.

  FIG. 9 is a diagram for explaining processing for determining an image size to be displayed on the display of the mobile terminal device.

  Again, the above formula “(viewing distance + distance) / viewing distance × display size of portable terminal device” is used.

  This size is for obtaining the image size (for example, inch) of the region 904 that overlaps the display of the portable terminal device.

  Here, what size (for example, the number of pixels) the image size corresponds to in the image data stored in the image data storage unit 621 is represented by a scale value stored in the scale storage unit 622.

  Thus, the above expression is expressed as “(viewing distance + distance) / viewing distance × display size of mobile terminal device × scale value”.

  According to FIG. 9, if the viewing distance 901, the distance 902, and the size of the display of the mobile terminal device 101 are known, the size (for example, inch) of the area 904 can be determined. The size of the partial image 906 on the image data 905 is obtained by the above formula. (For example, pixel) is calculated.

  As described above, the portable terminal device and the image display device have been described for the distance. However, when there are a plurality of image display devices, a plurality of distances are calculated. In this case, for example, (1) one of the image display devices is defined as a reference, and the distance to the image display device is always measured and processed. (2) The image display device at a short distance is the most portable terminal device. (3) Position information stored in the position storage unit 623 in FIG. 3 as the position of the image display device (information on the geographical position) ) The value may be stored as position information experienced when viewing the displayed image from a long distance as a virtual display area instead of a specific image display device. Any of these or any other method may be used as long as the position of the image display device can be determined. The same applies to the direction stored in the direction storage unit 624. In the following description, any of the above-described methods (1) to (4) can be used even when the image display device is simply described.

  Next, as a concept for explaining the flowchart of FIG. 12, the concept of the azimuth and the azimuth difference will be described with reference to FIGS.

  FIG. 10 is a diagram for explaining the azimuth difference between the image display device and the mobile terminal device. In this figure, both the mobile terminal device 101a and the virtual display region 1002 or the display of the image display device included in the virtual display region are oriented in a direction perpendicular to the viewer. In this case, there is no difference in orientation between the two displays.

  On the other hand, the display of the mobile terminal device 101b is considered to have an orientation difference of an angle 1005 from the virtual display region 1004 or both displays of the image display device included in the virtual display region.

  This figure is a bird's-eye view from information and is a conceptual diagram of only one axis. However, in reality, three axes of the X axis, the Y axis, and the Z axis may be considered.

  The azimuth sensor 309 in FIG. 3, the azimuth receiving unit in FIG. 6, and the explanation of FIG. 10 described the azimuth as the three axes of the X axis, the Y axis, and the Z axis. It does not have to be the concept of an axis, and it is not always necessary to measure all three dimensions. For example, when the vertical size of the virtual display area is not larger than the vertical size of the display of the mobile terminal device, the mobile terminal device is moved up and down (the viewer looks up at the sky or looks at the ground) Such an angle) may not be necessary, and even a clockwise or counterclockwise azimuth can be sensed about the viewer's body, or other azimuths may or may not be used. The same applies to the horizontal size of the virtual display area and the horizontal size of the display of the mobile terminal device.

  FIG. 11 is a diagram for explaining oblique deformation processing for giving a sense of perspective to an image displayed on the display of the mobile terminal device.

  When the mobile terminal device 101a has no orientation difference with respect to the virtual display area 1101, c2 to c5 are displayed on the display of the mobile terminal device 101a as illustrated.

  Here, c1 to c3 are displayed when facing leftward like the mobile terminal device 101b. At this time, not only the display area is changed by changing the direction, but the farther (the left side in the display) is displayed in a reduced size in the vertical direction so that it is displayed on the display of the mobile terminal device 101c. An oblique deformation process for giving a sense of perspective may be performed so that a wider range is displayed.

  Based on the above concept, FIG. 12 will be described. FIG. 12 is a diagram illustrating a flowchart of processing for displaying an image on the mobile terminal device in the first embodiment.

  Steps S1201 to S1207 are on the processing side of the mobile terminal device. Steps S1211 to S1219 are processes on the image display control server side.

  Further, a portion surrounded by a dotted line 1200 has the same portion in the flowchart of FIG. 15, and a description thereof is omitted in FIG.

  In step S1201, display information on the display of the mobile terminal device, that is, size and resolution are acquired.

  In step S1202, the viewing distance is acquired. To be precise, this is the distance when the viewer's eyes and the display of the mobile terminal device are placed in front. Although the default value may be stored, it changes depending on the length of the arm and how the arm is stretched. The distance may be calculated at any time.

  In step 1203, the geographical current position of the mobile terminal device is acquired. The GPS may be used, or the geographical current position may be acquired based on a base station when the mobile terminal device is connected to a public line as the Internet or a telephone. In the case of the Internet and public lines, there are wireless LAN base stations in buildings and the like, and there is an advantage that they can be used even in buildings where GPS does not function.

  Further, GPS is normally used, and when GPS cannot be used, the position information may be continuously adjusted with an acceleration sensor.

  In step S1204, the azimuth | direction which the portable terminal device faces is acquired with an azimuth | direction sensor.

  In step S1205, the information acquired in steps S1201 to S1204, that is, the display information (size, resolution), viewing distance, current geographical position, and orientation of the mobile terminal device is transmitted from the mobile terminal device to the image display control server.

  In step S1211, the information transmitted in step S1205 in the mobile terminal device, that is, the display information (size, resolution), viewing distance, geographical current position, and orientation of the mobile terminal device is received.

  In step S1212, the distance between the mobile terminal device and the image display device is calculated based on the geographical current position of the mobile terminal device received in step S1211 and the value stored in the position storage unit of the image display control server.

  In step S1213, as described with reference to FIG. 10, the orientation difference between the mobile terminal device and the image display device is calculated.

  In step S1214, as described with reference to FIGS. 7 and 8, the size of the area in the virtual display area that overlaps with the mobile terminal device as viewed from the viewer is calculated. In the description of FIGS. 7 and 8, the display of the mobile terminal device is overlapped with the virtual display area. However, in practice, the display may be out of the virtual display area. This is because the size (such as inches) here is for calculating the size (such as the number of pixels) when the image data is divided from the image data in the next step S1215.

  In step S1215, as described in FIG. 9, the image size (for example, the number of pixels) to be divided from the image data is calculated using the scale value from the size of the area calculated in step S1214.

  In step S1216, based on the current position and orientation difference of the mobile terminal device, an image area to be divided for display on the mobile terminal device is determined from the image data stored in the image data storage unit 621. In this step, not only the position of the image area to be divided is determined, but also the distance is adjusted if necessary.

  That is, in FIG. 7 and FIG. 8, the linear distance between the mobile terminal and the image display device has been described, but when determining the area of the divided image, the distance in the overlapping direction using a trigonometric function or the like in consideration of the azimuth difference is determined. calculate. However, as an application example of the present invention, when the adjustment by the azimuth difference is unnecessary, the distance does not need to be adjusted.

  In step S1217, a divided image is extracted from the image data stored in the image data storage unit 621 based on the region (position and size) determined in step S1216.

  In step S1218, the divided image is adjusted to a size and resolution for display on the mobile terminal device.

  In step S1219, the image adjusted in step S1218 is transmitted to the mobile terminal device.

  In step S1206, the divided image data transmitted from the image display control server transmitted in step S1219 is received. In step S1207, the received divided image data is displayed on the display of the portable terminal device. Note that the flowchart of FIG. 12 is merely an example. This completes the description of the flowchart of FIG.

[Second Embodiment]
In the first embodiment, the azimuth difference and distance between the mobile terminal device and the image display device are obtained based on information acquired by an orientation sensor provided in the mobile terminal device, GPS that detects a geographical current position, and the like.

In the second embodiment, an image captured by an image capturing unit (digital camera; hereinafter simply referred to as a camera) included in a mobile terminal device is transmitted to an image display control server, and the image display control server is configured to use the mobile terminal device based on the image. And the orientation difference and distance of the image display device.
Hereinafter, the second embodiment will be described with reference to FIGS.

  FIG. 13 is a diagram for describing an example of a relationship between an image captured by the mobile terminal device and an image displayed on the display of the mobile terminal device.

  In the virtual display area 1301, there are four image display devices 103a to 103d. A captured image 1306 taken from the camera of the mobile terminal device 101 overlaps with the three image display devices 103b to 103d.

  The mobile terminal device 101 transmits the captured image 1306 and the viewing angle of the camera to the image display control server. The image display control server calculates the distance and azimuth difference between the mobile terminal device 101 and the image display device based on the captured image 1306 and the viewing angle of the camera.

  If the distance and the azimuth difference can be calculated, other processes are the same as in the first embodiment.

  FIG. 14 is a diagram for describing processing for calculating the distance between the image display device and the mobile terminal device based on a captured image by the mobile terminal device.

  The mobile terminal device 101 transmits the captured image to the image display control server and compares it with the image data 1403 stored in the image data storage unit 621 of the image display control server. That is, it is determined that the captured image received by the image display control server matches the area 1402 of the image data 1403.

  By using the scale value stored in the scale storage unit 622 for the size 1404 (pixels or the like) of the matching area 1402, a captured image is displayed in the virtual display area 1400 captured by the mobile terminal device 101. The size of the area 1406 (such as inches) is calculated.

  The image display control server receives the viewing angle 1407 of the camera of the mobile terminal device 101 in addition to the captured image. Since what was actually captured in the image captured by the camera with the viewing angle 1407 was calculated as described above, by using a trigonometric function or the like, the mobile terminal device 101 and the image display device in the virtual display area Can be calculated.

  In FIG. 14, there is no orientation difference between the mobile terminal device 101 and the image display device 103, but when there is an orientation difference, the captured image is distorted.

  In this case, for example, in the vertical direction, the captured image is divided into a plurality of vertical regions, and the distance is calculated for each region by the method described above. When there are azimuth differences on the left and right, the distances calculated corresponding to the plurality of vertical regions are different. Based on these values, it is possible to determine the orientation difference of the portable terminal device 101 with respect to the image display device 103 by known image processing. The same applies to the horizontal direction.

  If the azimuth difference is found, the linear distance between the mobile terminal device 101 and the image display device 103 is calculated using a trigonometric function or the like.

  Furthermore, depending on the application example, the orientation difference may be ignored as an error. In addition, when the portable terminal device 101 is supported by the viewer and the image is tilted (rotated) to the left or right, the area 1402 in the image data 1403 is also tilted in the same manner. This angle may also be included in the orientation difference.

  In the description of FIG. 14 and the description of the flowchart of FIG. 15 to be described later, the method of calculating the azimuth difference and the distance is an example. And the distance may be calculated.

  FIG. 15 is a diagram illustrating a flowchart of processing for displaying an image on the mobile terminal device in the second embodiment mobile phone. In this flowchart, the same processing as the flowchart described in FIG. 12 is performed, and the description of the portion indicated by 1200 in those steps is omitted.

  In the flowchart of FIG. 15, steps S1501 to S1505 are processing in the mobile terminal device. Steps S1511 to S1515 are processing in the image display control server.

  In step S1501, display information on the display of the mobile terminal device, that is, size and resolution are acquired.

  In step S1502, the viewing distance between the viewer and the display of the mobile terminal device is acquired.

  In step S1503, the viewing angle of the photographing device provided in the mobile terminal device, that is, the camera is acquired.

  In step S1504, a captured image captured by the camera is acquired.

  In step S1505, the information acquired in steps S1501 to S1504, that is, display information (size, resolution) of the mobile terminal device, viewing distance, viewing angle, and captured image are transmitted to the image display control server.

  In step S1511, the information transmitted in step S1505, that is, display information (size, resolution), viewing distance, viewing angle, and captured image of the mobile terminal device are received.

  In step S1512, the received captured image is compared with the image data stored in the image data storage unit 621 of the display control server, and the region of the captured image in the image data is specified.

  In step S1513, the size (number of pixels, etc.) of the area of the captured image in the image data is acquired.

  In step S1514, as described in FIG. 14, the size of the image in the virtual display area of the captured image (using the size of the area of the captured image acquired in step S1215 and the scale value stored in the scale storage unit 622). Inch).

  In step S1515, as described with reference to FIG. 14, the azimuth difference and the distance between the mobile terminal device and the image display device are calculated based on the image size (inch or the like) and the viewing angle.

  Further, the flowchart performs the same processing as 1200 in FIG. This completes the description of the flowchart of FIG.

  12 and 15 may be repeatedly executed while the viewer points the mobile terminal device toward the image display device. Thereby, even if the viewer moves the position of the mobile terminal device, the divided image displayed on the display of the mobile terminal device also changes appropriately according to the movement.

  In the above description, processing has been performed so that the viewer can experience that the size of the divided image is the same size as the image displayed in the overlapping area in the virtual display area.

  However, for example, it may be possible to experience viewing of an image according to a service with a process of changing the telephoto and the magnification by zooming while linking the image displayed on the display of the virtual display area with the mobile terminal.

  Further, the size of the divided image may be divided larger than the display of an actual mobile terminal device, and there may be a portion of an image that is not displayed vertically and horizontally when displayed on the mobile terminal device side.

  For example, since there is a portion that is not displayed, it is possible to adjust the position and size of the image displayed by the program on the mobile terminal side even if the mobile terminal device moves slightly.

  This completes the description of the image display control system, the portable terminal device that constitutes the image display control system, the image display control server, the processing method, and the program.

  The object of the present invention is achieved by executing the following processing. That is, a storage medium that records a program code of software that realizes the functions of the above-described embodiments is supplied to a system or apparatus, and a computer (or CPU, MPU, etc.) of the system or apparatus is stored in the storage medium. This is the process of reading the code.

  In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the program code and the storage medium storing the program code constitute the present invention.

  Moreover, the following can be used as a storage medium for supplying the program code. For example, floppy (registered trademark) disk, hard disk, magneto-optical disk, CD-ROM, CD-R, CD-RW, DVD-ROM, DVD-RAM, DVD-RW, DVD + RW, magnetic tape, nonvolatile memory card, ROM or the like. Alternatively, the program code may be downloaded via a network.

  Further, the present invention includes a case where the function of the above-described embodiment is realized by executing the program code read by the computer. In addition, an OS (operating system) running on the computer performs part or all of the actual processing based on an instruction of the program code, and the functions of the above-described embodiments are realized by the processing. Is also included.

  Furthermore, a case where the functions of the above-described embodiment are realized by the following processing is also included in the present invention. That is, the program code read from the storage medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. Thereafter, based on the instruction of the program code, the CPU or the like provided in the function expansion board or function expansion unit performs part or all of the actual processing.

  Further, the present invention includes a case where the functions of the above-described embodiments are realized by executing the program code read by the computer. In addition, there is a case where the OS running on the computer performs part or all of the actual processing based on the instruction of the program code, and the functions of the above-described embodiments are realized by the processing.

  In this case, the program is supplied by downloading directly from a storage medium storing the program or from another computer or database (not shown) connected to the Internet, a commercial network, a local area network, or the like.

The form of the program may be in the form of object code, program code executed by an interpreter, script data supplied to an OS (operating system), and the like.

DESCRIPTION OF SYMBOLS 101 Mobile terminal device 102 Image display control server 103 Image display device 104 Network 401 Front 402 Display 405 Image-capturing lens 406 Rear surface 503 Virtual display area 101 Mobile terminal device 102 Image display control server 603 Receiver 604 Portable display information receiver 605 Viewing distance receiving unit 606 Geographic current position receiving unit 607 Direction receiving unit 608 Viewing angle receiving unit 609 Captured image receiving unit 610 Image generation / transmission unit 611 Distance calculation unit 612 Direction difference calculation unit 613 Division size calculation unit 614 Division region determination Unit 615 divided image generation unit 616 divided image transmission unit 621 image data storage unit 622 scale storage unit 623 position storage unit 624 orientation storage unit

Claims (8)

An image display control server that controls display by dividing image data into a display of a mobile terminal device and an image display device,
Image data storage means for storing the image data;
Scale storage means for storing a scale value when the image data stored in the image data storage means is displayed on the image display device;
Portable display information receiving means for receiving portable display information including the display size and resolution of the display of the portable terminal device from the portable terminal device;
Distance calculating means for calculating a distance between the portable terminal device and the image display device;
An orientation difference calculating means for calculating an orientation difference between the display of the mobile terminal device and the image display device;
A viewing distance receiving means for receiving a viewing distance from an eye of a portable terminal device holder who views the portable terminal device to a display of the portable terminal device from the portable terminal device;
Division to display on the portable terminal device from the image data stored in the image data storage unit based on the scale value, the portable display information, the distance, the azimuth difference, and the viewing distance Divided image generating means for generating an image;
A divided image transmission unit that transmits the divided image generated by the divided image generation unit to the mobile terminal device;
An image display control server comprising: Division size calculation means for calculating an image size to be divided from the image data based on the display size of the portable terminal device included in the portable display information, the viewing distance, the distance, and the scale value; ,
A division image area determining unit that determines a position of an image to be divided from the image data based on the orientation difference, and determines an image area to be divided based on the image size calculated by the division size calculation unit;
The divided image generation means includes
2. The divided image is generated so that the image area determined based on the divided image area determining unit matches a display size and resolution of a display of the mobile terminal device included in the mobile display information. The image display control server described in 1. Position receiving means for receiving a geographical current position of the mobile terminal device;
Azimuth receiving means for receiving the azimuth facing the portable terminal device, and the distance calculating means at the geographical current position received by the position receiving means and the geographical position of the image display device. Based on the distance,
3. The azimuth difference calculating means calculates the azimuth difference based on the azimuth received by the azimuth receiving means and an azimuth in which the image display device is installed. The image display control server according to any one of the above. Viewing angle receiving means for receiving the viewing angle of the image capturing unit provided in the portable terminal device;
A captured image receiving unit configured to receive a captured image captured by the image capturing unit of the mobile terminal device;
The distance calculating unit compares the viewing angle received by the viewing angle receiving unit, the scale value, the captured image received by the captured image receiving unit, and the image data stored in the image data storage unit. And calculating the distance between the mobile terminal device and the image display device when the captured image is captured by the image capturing unit,
The azimuth difference calculating means calculates a azimuth difference in which the foreground image recording is captured based on a comparison between the captured image captured by the image capturing unit and the image data stored in the image data storage means. The image display control system according to any one of claims 1 and 2. An image display control system comprising a mobile terminal device, an image display device, a display of the mobile terminal device, and an image display control server that controls display by dividing image data into the image display device,
The image display control server
Image data storage means for storing the image data;
Scale storage means for storing a scale value when the image data stored by the image data storage means is displayed on the image display device;
Portable display information receiving means for receiving portable display information including the display size and resolution of the display of the portable terminal device from the portable terminal device;
Distance calculating means for calculating a distance between the portable terminal device and the image display device;
An orientation difference calculating means for calculating an orientation difference between the display of the mobile terminal device and the image display device;
A viewing distance receiving means for receiving a viewing distance from an eye of a portable terminal device holder who views the portable terminal device to a display of the portable terminal device from the portable terminal device;
Division to display on the portable terminal device from the image data stored in the image data storage unit based on the scale value, the portable display information, the distance, the orientation difference, and the viewing distance Divided image generating means for generating an image;
A divided image transmission unit that transmits the divided image generated by the divided image generation unit to the mobile terminal device;
The portable terminal device
Portable display information transmitting means for transmitting portable display information including the display size and resolution of the display of the portable terminal device to the image display control server;
Viewing distance transmission means for transmitting the viewing distance to the image display control server;
Split image receiving means for receiving the split image transmitted by the split image transmitting means from an image display control server;
An image display control system comprising: display means for displaying the divided images received by the divided image receiving means. An image display control method for controlling display by dividing image data into a display of a mobile terminal device and an image display device,
Image data storage means for storing the image data;
Scale storage means for storing a scale value when the image data stored in the image data storage means is displayed on the image display device;
A portable display information receiving unit receives portable display information including the display size and resolution of the display of the portable terminal device from the portable terminal device; and
A distance calculating step of calculating a distance between the portable terminal device and the image display device;
An azimuth difference calculating means for calculating an azimuth difference between the display of the mobile terminal device and the image display device;
A viewing distance receiving step for receiving a viewing distance from the eyes of a portable terminal device holder who views the portable terminal device to a display of the portable terminal device from the portable terminal device;
The divided image generation means is configured to generate the portable information from the image data stored in the image data storage means based on the scale value, the portable display information, the distance, the azimuth difference, and the viewing distance. A divided image generation step of generating a divided image to be displayed on the terminal device;
A divided image transmission step, wherein the divided image transmission means transmits the divided image generated by the divided image generation step to the mobile terminal device;
An image display control method comprising: A program that causes a computer to function as an image display control server that controls display by dividing image data on a display and an image display device of a mobile terminal device,
Image data storage means for storing the image data;
Scale storage means for storing a scale value when the image data stored in the image data storage means is displayed on the image display device;
Portable display information receiving means for receiving portable display information including the display size and resolution of the display of the portable terminal device from the portable terminal device;
Distance calculating means for calculating a distance between the portable terminal device and the image display device;
An orientation difference calculating means for calculating an orientation difference between the display of the mobile terminal device and the image display device;
A viewing distance receiving means for receiving a viewing distance from an eye of a portable terminal device holder who views the portable terminal device to a display of the portable terminal device from the portable terminal device;
Division to display on the portable terminal device from the image data stored in the image data storage unit based on the scale value, the portable display information, the distance, the orientation difference, and the viewing distance Divided image generating means for generating an image;
A divided image transmission unit that transmits the divided image generated by the divided image generation unit to the mobile terminal device;
A program for causing an image display control server to function.   A computer-readable recording medium on which the program according to claim 7 is recorded.

Images