JP5682170B2 - Display control apparatus, image distribution server, display terminal, image distribution system, and program - Google Patents

Description

  The present invention relates to a display control device, an image distribution server, a display terminal, an image distribution system, and a program.

  For example, in Patent Document 1, an image display unit that displays an image is joined to a main body so as to be rotatable, and is stored in a storage unit and a first image based on video data received by a tuner. When the hinge rotation detection unit detects rotation of the image display unit when the second image based on the text data is divided and displayed on the display screen, the display control unit deletes the second image from the display screen. A mobile phone device is disclosed.

JP 2009-69842 A

  According to Patent Document 1, the image displayed on the image display unit changes according to the rotation (displacement) of the image display unit, but the image is displayed so as to redisplay the image that was originally displayed. Only by switching, there was no interest in the image whose display is switched by the displacement of the image display unit.

  The present invention has been made in view of the above points, and a display control device, an image distribution server, a display terminal, an image distribution system, and a program for switching an image displayed on the display unit to be interesting as the display unit is displaced The purpose is to provide.

A display control device according to a first aspect of the present invention provides:
An image of the object in different positions, a plurality of images captured each subject existing in the different position from the different photographing direction on the display unit a table Shimesuru display control device,
It acquires the position and orientation of the display control device, among a plurality of images which the taken from different photographing direction of the subject at the position close to the position of the acquired display control device, and orientation of the acquired display control device the images taken from the same shooting direction comprises a table Shimesuru control unit on the display unit.

An image distribution server according to a second aspect of the present invention is:
Receiving means for receiving the position and orientation of the display terminal transmitted from the display terminal;
A plurality of images of subjects existing at different positions, each of the subjects existing at different positions taken from different directions, and a subject position and a shooting direction for each of the plurality of images correspond to each other. With reference to the correspondence table attached and recorded, the direction of the display terminal is the same among a plurality of images taken from different shooting directions of the subject present at a position close to the position of the display terminal received by the receiving means Image acquisition means for acquiring an image taken from the shooting direction ;
Transmitting means for transmitting the image acquired by the image acquiring means to the display terminal;
Is provided.

A display terminal according to the third aspect of the present invention provides:
A display terminal that displays images of subjects existing at different positions, each of the subjects present at the different positions taken from different shooting directions;
A display unit;
Position acquisition means for acquiring the position of the display terminal;
Orientation acquisition means for acquiring the orientation of the display terminal;
And the position where the position acquisition unit has acquired, and transmitting means for transmitting, and the orientation of the orientation obtaining unit has obtained,
Receiving means for receiving an image photographed from the same photographing direction as the direction of the display terminal among a plurality of images photographed from different photographing directions of the subject existing at a position close to the position of the display terminal transmitted by the transmitting means. When,
Display control means for displaying the image received by the receiving means on the display unit;
Is provided.

An image distribution system according to a fourth aspect of the present invention includes:
An image distribution system comprising: an image distribution server; and a display terminal capable of communicating with the image distribution server,
The display terminal is
A display unit;
Position acquisition means for acquiring the position of the display terminal;
Orientation acquisition means for acquiring the orientation of the display terminal;
Comprising a the position where the position acquisition unit has acquired, and the orientation of the orientation obtaining unit obtains, and a that transmit means to send,
The image distribution server
A receiving unit that will receive the position and orientation of the display terminal which is transmitted from the display terminal,
A plurality of images of subjects existing at different positions, each of the subjects existing at different positions taken from different directions, and a subject position and a shooting direction for each of the plurality of images correspond to each other. attached by referring to the correspondence table recorded, before among the plurality of images taken from different imaging directions of the subject Ki受 signal means is located at a position closer to the position of the display terminal which receives the orientation of the display terminal Image acquisition means for acquiring an image shot from the same shooting direction ;
And a transmit unit that sends the image by the image acquisition unit has acquired the display terminal,
The display terminal is
And receiving means and the image distribution server before Kioku signal means sends, you receiving an image captured from the same shooting direction as the direction of the display terminal,
Further comprising a display control means for displaying the image before Ki受 signal means receives of the display terminal on the display unit.

A program according to the fifth aspect of the present invention is:
An image of the object in different positions, a plurality of images captured each subject existing in the different position from the different photographing direction on the display unit To display computer,
The display unit acquires the position and orientation of the display unit, and displays the images obtained by capturing a plurality of images of the subject existing at positions close to the acquired position of the display unit from the same imaging direction as the acquired direction of the display unit. Table Shimesuru control step in part,
To do.

A program according to the sixth aspect of the present invention is:
On the computer,
A receiving step of receiving the position and orientation of the display terminal transmitted from the display terminal;
A plurality of images of subjects existing at different positions, each of the subjects existing at different positions taken from different directions, and a subject position and a shooting direction for each of the plurality of images correspond to each other. With reference to the correspondence table attached and recorded, the direction of the display terminal is the same among a plurality of images taken from different shooting directions of the subject existing at a position close to the position of the display terminal received in the receiving step An image acquisition step of acquiring an image taken from the shooting direction ;
A transmission step of transmitting the image acquired in the image acquisition step to the display terminal;
To do.

A program according to the seventh aspect of the present invention is:
A computer connected to a display unit that displays a plurality of images of subjects existing at different positions, each of the subjects present at different positions taken from different shooting directions ,
A position acquisition step of acquiring the position of the display unit;
A direction acquisition step of acquiring a direction of the display unit;
A transmission step of transmitting said position in which the position acquisition step has acquired, and the orientation obtained by the orientation obtaining step, a
A receiving step of receiving an image shot from the same shooting direction as the direction of the display unit among a plurality of images shot from different shooting directions of the subject existing at a position close to the position of the display unit transmitted in the transmission step. When,
A display control step of displaying the image received in the reception step on the display unit;
To do.

  According to the display control device, the image distribution server, the display terminal, the image distribution system, and the program according to the present invention, the image displayed on the display unit can be switched interestingly with the displacement of the display unit.

It is a figure which shows the structure of the image delivery system which concerns on one Embodiment of this invention. It is a figure which shows the structure of the image delivery server which concerns on one Embodiment of this invention. It is a figure which shows the content of the imaging | photography direction information and image correspondence table used in one Embodiment of this invention. It is a figure which shows the hardware constitutions of the image delivery server which concerns on one Embodiment of this invention. It is a figure which shows the structure of the display terminal which concerns on one Embodiment of this invention. It is a figure for demonstrating the direction of the display terminal which concerns on one Embodiment of this invention. It is a figure which shows the hardware constitutions of the display terminal which concerns on one Embodiment of this invention. It is a flowchart of the display control process and image delivery process which the display terminal and image delivery server which concern on one Embodiment of this invention perform. It is a figure for demonstrating the direction of the display terminal which concerns on one Embodiment of this invention, and the image displayed on a display terminal according to this direction. It is a figure for demonstrating the direction of the display terminal which concerns on one Embodiment of this invention, and the image displayed on a display terminal according to this direction. It is a figure for demonstrating the direction of the display terminal which concerns on one Embodiment of this invention, and the image displayed on a display terminal according to this direction.

  An embodiment according to the present invention will be described with reference to the drawings. In addition, this invention is not limited by description of the following description and drawing. It goes without saying that changes (including deletion of components) can be added to the contents of the following description and drawings. Further, in the following description, in order to facilitate understanding of the present invention, descriptions of known technical matters are omitted as appropriate.

  First, the configuration of the image distribution system 1 according to the present embodiment will be described with reference to FIG. The image distribution system 1 includes a first camera group including cameras 11 to 15, a second camera group including cameras 21 to 24, a display terminal (display control device) 100, and an image distribution server 200. And comprising. The cameras 11 to 15, the cameras 21 to 24, the display terminal 100, and the image distribution server 200 are connected to a network 300 such as the Internet. Note that there may be a plurality of image distribution servers 200 and display terminals 100. Further, it is sufficient that there is one or more camera groups. In particular, the number, arrangement, etc. of the cameras constituting the camera group are determined as appropriate.

  In the present embodiment, directions such as the orientation of the display unit and the shooting direction, which will be described later, are represented by orientations. In the present embodiment, the azimuth is expressed by an angle with respect to the north direction with the north direction as a reference (0 °) as shown in FIG. This angle is assumed to increase clockwise. That is, the east direction is 90 °, the northeast direction is 45 °, the south direction is 180 °, and the west direction is 270 °. The north direction is also 360 °.

  The cameras 11 to 15 constitute a first camera group that is a camera group for the subject 10. The cameras 11 to 13 are arranged at positions for photographing the subject 10 from different directions. Each of the cameras 14 and 15 is disposed in a direction other than the direction toward the subject 10 and shoots a landscape where the subject 10 is not captured.

  Each of the cameras 21 to 24 constitutes a second camera group that is a camera group for the subject 20. The cameras 21 to 23 are arranged at positions for photographing the subject 20 from different directions. The camera 24 is arranged in a direction other than the direction toward the subject 20 and shoots a landscape where the subject 20 is not captured.

  Note that each of the cameras 11 to 15 and cameras 21 to 25 is a fixed point camera, and the front (in the direction of the arrow in FIG. 1, hereinafter referred to as a shooting direction) is photographed every predetermined period. Image data representing an image (in this case, a still image) of the scenery is generated, and the generated image data is supplied to the image distribution server 200 via the network 300. At this time, each camera supplies identification data representing its own identification information set in advance to the image distribution server 200 together with the image data.

  Note that which camera belongs to which camera group is determined in advance. In the present embodiment, one camera group (first camera group or second camera group) is configured for one specific subject (subject 10 or subject 20). The subject is, for example, a mountain or a building such as Mt. Fuji or Tokyo Tower. In the present embodiment, for example, cameras within a predetermined distance from a specific subject constitute a camera group for this subject.

  The image distribution server 200 receives image data and identification data supplied from the cameras 11 to 15 and the cameras 21 to 24 and records them in the storage unit of the image distribution server 200. The image distribution server 200 records the image data for each identification information represented by the identification data, that is, for each camera. The image distribution server 200 overwrites the sequentially supplied image data on the old image data, and sequentially updates images taken by the same camera. That is, the image distribution server 200 records the latest image data captured by each camera in the storage unit.

  The display terminal 100 acquires predetermined image data from the image distribution server 200. The display terminal 100 displays the image represented by the acquired image data on the display unit. Here, the display terminal 100 acquires the orientation of the display unit, and is a camera to which a camera group close to the display terminal 100 belongs, and acquires image data representing an image captured by the camera according to the orientation acquired above. Then, an image representing the acquired image data is displayed on the display unit. The display terminal 100 displays an image corresponding to the orientation of the display unit.

  Next, the main configuration of the image distribution server 200 will be described with reference to FIG. As illustrated in FIG. 2, the image distribution server 200 includes an image recording unit 210, an image acquisition unit 215, a shooting direction information / image correspondence table 220, a reception unit 230, and a transmission unit 240. The image distribution server 200 is configured by various computers.

  The receiving unit 230 is controlled by the image recording unit 210 and the image acquisition unit 215 and receives data from the network 300. The transmission unit 240 is controlled by the image acquisition unit 215 and transmits data to the network 300. The shooting direction information / image correspondence table 220 is recorded in a storage unit described later of the image distribution server 200. The image recording unit 210 records the image data received from each camera by the receiving unit 220 in the shooting direction information / image correspondence table 220 of the storage unit. The image acquisition unit 215 acquires image data from the shooting direction information / image correspondence table 220 and transmits the image data via the transmission unit 240. The operation of each part will be appropriately described below.

  In the shooting direction information / image correspondence table 220, identification information, position information, attribute information, shooting direction information, and images are recorded in association with each other. Therefore, it is recorded in the shooting direction information / image correspondence table 220. The contents of the photographing direction information / image correspondence table 220 will be described with reference to FIG. Note that the shooting direction information / image correspondence table 220 shown in FIG. 3 is a correspondence table for each camera shown in FIG. 1, and the contents of the shooting direction information / image correspondence table 220 are naturally dependent on the arrangement and number of cameras. Different. Also, each data representing identification information, position information, attribute information, and shooting direction information recorded in the shooting direction information / image correspondence table 220 is recorded in the shooting direction information / image correspondence table 220 in advance. It is assumed that

  The identification information is information for identifying the camera. Here, it is assumed that the identification information is the same number as the reference numeral assigned to each camera in FIG. For example, the identification information of the camera 11 is “11”.

  The position information is information indicating the position of the subject of the camera group to which the camera belongs. For example, since the camera 11 belongs to the first camera group and the first camera group is a camera group for the subject 10, the position information associated with the identification information of the camera 11 is the position of the subject 10 (north latitude). : X1, East longitude: y1). The position information is represented by, for example, latitude and longitude, but may be represented by an address or the like. Note that the position represented by the position information may be a position where the subject can be specified, such as the position of the center of the subject.

  The attribute information is information indicating whether or not the camera is a camera that is photographing a subject (a subject of a camera group to which the camera belongs). If the camera is shooting a subject (for example, camera 11), the camera attribute is “1”. If the camera is not shooting the subject (for example, camera 15), the camera attribute is Assume that it is “2”. The attribute information is either “1” or “2”.

  The shooting direction information is information indicating the shooting direction of the camera. The shooting direction information may be information representing a predetermined range including the shooting direction of the camera as appropriate. In particular, when the camera is a camera that shoots a subject, the shooting direction information of the camera is information representing a predetermined range. For example, the shooting direction information of the camera 11 shooting the subject 10 is 216 ° ≦ θ1 <257 °. This range takes into account the positional relationship of the camera that shoots the subject, and the ranges in the direction in which the shooting directions are closest (for example, the shooting direction of the camera 11 and the shooting direction of the camera 12) do not overlap with each other, and the gap is empty. (See the dotted line in FIG. 1. This dotted line is the boundary between the ranges.) For example, since the shooting directions of the cameras 11 to 13 are relatively close, the above-described range (shooting direction ± 10 ° to about 20 °) is narrow. On the other hand, since the shooting directions of the cameras 21 to 23 are relatively far apart, the above range (shooting direction ± 45 °) is wide. Since the shooting direction information includes the shooting direction, the shooting direction information is associated with the image, the identification information, and the like by associating the shooting direction information with the image, the identification information, and the like.

  The image is an image taken by the camera. The image data representing this image is image data supplied from each camera. This image data is the image data supplied from each camera described above. As described above, the image distribution server 200 is supplied with image data (image) and identification data (identification information) from each camera. The receiving unit 230 of the image distribution server 200 receives image data and identification data supplied from each camera. When the receiving unit 230 receives these data, the image recording unit 210 uses the same identification information as the identification information represented by the identification data received by the receiving unit 230 among the identification information recorded in the shooting direction information / image correspondence table 220. Correspondingly, the image data received by the receiving unit 230 is recorded in the shooting direction information / image correspondence table 220. In this manner, the image data supplied from each camera is recorded in the shooting direction information / image correspondence table 220 of the storage unit 220 for each camera. If the image data is already recorded in the shooting direction information / image correspondence table 220, the image recording unit 210 overwrites the old image data with the image data newly received by the receiving unit 230, and the image data is updated. Update for each camera.

  Next, an example of the hardware configuration of the image distribution server 200 will be described with reference to FIG. The image distribution server 200 includes a CPU 201, a RAM (Random Access Memory) 202, a hard disk 203, and a communication unit 204.

  The hard disk 203 records a program, shooting direction information / image correspondence table 220, and various data. The RAM 202 functions as a main memory for the CPU 201. Data used by the CPU 201 (data supplied to the CPU 201), data supplied to other devices by the CPU 201, and the like appropriately pass through the RAM 202. In the present embodiment, the hard disk 203 and the RAM 202 constitute a storage unit of the image distribution server 200. Note that at least a part of the storage unit may be configured by another storage device such as a flash memory. That is, for example, the hard disk 203 can be changed to another storage device. Further, the shooting direction information / image correspondence table 220 may be appropriately read into the RAM 202.

  The communication unit 204 is configured by an appropriate communication device such as a network card and is connected to the network 300. The communication unit 204 is used for data transmission / reception via the network 300. The communication unit 204 is controlled by the CPU 201. The communication unit 204 constitutes a reception unit 230 and a transmission unit 240.

  The CPU 201 controls the entire image distribution server 200 according to a program recorded in the hard disk 203 and loaded into the RAM 202, and actually performs processing performed by the image recording unit 210 and the image acquisition unit 215 of the image distribution server 200. . That is, the image recording unit 210 and the image acquisition unit 215 are configured by a CPU 201 that performs processing described later according to a program. In addition, the part which processes each part is not restricted to CPU201, At least one part may be comprised by ASIC (Application Specific Integrated Circuit) or DSP (Digital Signal Processor).

  Next, a main configuration of the display terminal 100 will be described with reference to FIG. As shown in FIG. 5, the display terminal 100 includes a control unit 110, a reception unit 130, a transmission unit 140, an operation unit 150, a display unit 160, a position detection unit 170, and an orientation detection unit 180. Prepare. The display terminal 100 includes an appropriate device (display control device) such as a digital photo frame or a personal computer. Note that the display terminal 100 (display control device) may not include the display unit 160 or the like.

  The operation unit 150 receives a predetermined operation and supplies an operation signal corresponding to the received operation to the control unit 110. The display unit 160 displays an image represented by predetermined image data. The position detection unit 170 detects the position of the display terminal 100 and supplies position data representing this position to the control unit 110. The orientation detection unit 180 detects the orientation of the display terminal 100 and supplies orientation data representing this orientation to the control unit 110. The receiving unit 130 receives data via the network 300. The transmission unit 140 transmits data via the network 300. The control unit 110 controls each unit. In particular, the control unit 110 includes a position acquisition unit 110a, a direction acquisition unit 110b, and a display control unit 110c, and performs the processes described later. The detailed operation of each part will be described below as appropriate.

  In the present embodiment, the direction of the display terminal 100 refers to the direction of the display unit 160, and in particular, here, the direction opposite to the normal direction (display direction) of the display surface 160 a that displays an image on the display unit 160. (See FIG. 6). In addition, the position of the display terminal 100 refers to the position of the display unit 160. The display unit 160 may or may not be able to rotate relative to other members of the display terminal 100 (for example, the base of the display terminal 100). When the display unit 160 cannot rotate, the display unit 160 is incorporated in the display terminal 100, for example. In this case, when the display terminal 100 rotates, the display unit 160 rotates and the direction of the display unit 160 changes. The display terminal 100 in this case is, for example, a general digital photo frame or notebook computer in which the display panel cannot move independently. The rotation direction is the azimuth direction in FIG. 1 (see FIG. 6).

  The position detection unit 170 is configured to detect the position of the display unit 160 at a minimum. The orientation detection unit 180 is configured to detect the orientation of the display unit 160 at a minimum. When the display unit 160 is incorporated in the display terminal 100, the position detection unit 170 or the orientation detection unit 180 may be configured to detect the position or orientation of the display terminal 100.

  Next, an example of the hardware configuration of the display terminal 100 will be described with reference to FIG. The display terminal 100 includes a CPU 101, a RAM 102, a hard disk 103, a communication unit 104, an input device 105, a display device 106, a GPS (Global Positioning System) receiver 107, and an orientation sensor 108.

  The hard disk 103 records programs and various data. The RAM 102 functions as a main memory of the CPU 101. Data used by the CPU 101 (data supplied to the CPU 101), data supplied to the other devices by the CPU 101, and the like appropriately pass through the RAM 102. In the present embodiment, the storage unit of the display terminal 100 is configured by the hard disk 103 and the RAM 102. Note that at least a part of the storage unit may be configured by another storage device such as a flash memory. That is, for example, the hard disk 203 can be changed to another storage device.

  The communication unit 104 constitutes a reception unit 130 and a transmission unit 140. The communication unit 104 is configured by an appropriate communication device such as a network card and is connected to the network 300. The communication unit 104 is used for data transmission / reception via the network 300.

  The input device 105 constitutes the operation unit 150. The input device 105 includes operation keys and the like, and supplies an operation signal corresponding to a user operation input to the CPU 101.

  The display device 106 constitutes a display unit 160. The CPU 101 supplies predetermined image data to the display device 106 (note that the data format and the like are changed as appropriate). The display device 106 displays an image represented by the image data supplied from the CPU 101. In this way, the display device 106 displays an image represented by the image data under the control of the CPU 101. The display device 106 is configured by an appropriate type of device such as liquid crystal, EL (Electro-Luminescence), a cathode ray tube, or plasma.

  The GPS receiver 107 constitutes a position detection unit 170. The GPS receiver 107 generates position data indicating the position of the display terminal 100 and supplies it to the CPU 101. For example, the GPS receiver 107 is disposed inside the display device 106 or attached to the outer surface so as to detect the position of the display device 106. The position is represented by, for example, latitude and longitude.

  The direction sensor 108 constitutes a direction detection unit 180. The orientation sensor 108 generates orientation data indicating the orientation of the display terminal 100 and supplies it to the CPU 101. The orientation sensor 108 is arranged inside the display device 106 or attached to the outer surface so as to detect the orientation of the display device 106, for example.

  The CPU 101 controls the entire display terminal 100 (each device) according to a program recorded in the hard disk 103 and loaded into the RAM 102, and the control unit 110 (position acquisition unit 110a, orientation acquisition unit 110b, display control unit 110c) The processing to be performed is actually performed. That is, the control unit 110 (the position acquisition unit 110a, the orientation acquisition unit 110b, and the display control unit 110c) is configured by the CPU 101 that performs processing described later according to a program. The control unit 110 (the position acquisition unit 110a, the orientation acquisition unit 110b, and the display control unit 110c) is not limited to the CPU 101, and at least a part of the control unit 110 is configured by an ASIC (Application Specific Integrated Circuit) or a DSP (Digital Signal Processor). May be.

  Next, the image distribution and image display operations of the display terminal 100 and the image distribution server 200 will be described. The display terminal 100 performs display control processing. The image distribution server 200 performs image distribution processing. These processes will be described with reference to FIG. For example, the display terminal 100 starts the display control process in response to a user operation on the operation unit 150 (an operation requesting the start of the display control process). For example, the display terminal 100 ends the display control process in response to a user operation on the operation unit 150 (an operation requesting the end of the display control process). Further, the image distribution server 200 always performs image distribution processing and waits for reception of position data and orientation data.

  First, the position acquisition unit 110a of the display terminal 100 acquires position data supplied from the position detection unit 170, and the direction acquisition unit 110b acquires position data supplied from the direction detection unit 180 (step S101).

  Next, the position acquisition unit 110a and the direction acquisition unit 110b supply the acquired position data and direction data to the transmission unit 140, and transmit the acquired position data and direction data to the image distribution server 200 via the network 300 (step S102). ).

  The receiving unit 230 of the image distribution server 200 receives the position data and the orientation data transmitted from the display terminal 100 (Step S201). The position data and orientation data received by the reception unit 230 are supplied to the image acquisition unit 215. The image acquisition unit 215 acquires position data and orientation data supplied from the reception unit 230.

  The image acquisition unit 215 refers to the shooting direction information / image correspondence table 220, and based on the acquired position data and orientation data, the position information data indicating the position information and the shooting corresponding to the position and orientation indicated by these data, respectively. Image data associated with shooting direction information data indicating direction information is acquired from the storage unit (shooting direction information / image correspondence table 220) (step S202).

  For example, the image acquisition unit 215 first pays attention to each position information of the shooting direction information / image correspondence table 220 and positions closest to the position indicated by the acquired position data in the shooting direction information / image correspondence table 220 of FIG. A row including position information data indicating the position information (in a case where there are a plurality of pieces of position information data determined at random, for example) is specified (that is, a line in which the position information data is recorded). As a result, the camera group closest to the position of the display terminal 100 is specified.

  Then, in each identified row, the image acquisition unit 215 first identifies a row including attribute data whose attribute is “1”. As a result, the camera that captures the subject is identified from among the cameras in the camera group closest to the position of the display terminal 100. Further, the image acquisition unit 215 specifies and acquires image data corresponding to shooting direction information data indicating shooting direction information including the direction (orientation) indicated by the acquired direction data in the specified row. Thus, an image obtained by photographing the subject from the photographing direction in the direction within the predetermined range and the direction of the display terminal 100 among the cameras that photograph the subject included in the camera group closest to the display terminal 100, It is specified and acquired by the image acquisition unit 215.

  The image acquisition unit 215 has the attribute “2” when the shooting direction information data indicating the shooting direction information including the direction indicated by the acquired direction data is not included in the shooting direction information / image correspondence table 220. Identify rows that contain attribute data. As a result, when there is no camera that has photographed the subject from the photographing direction within the direction of the display terminal 100 and within a predetermined range among the cameras in the camera group, the camera that has photographed the scenery other than the subject is identified. It will be different. Then, the image acquisition unit 215 includes shooting direction information data indicating shooting direction information closest to the direction indicated by the acquired direction data in the specified row (for example, one shooting direction determined at random when there are a plurality of shooting direction information). Image data corresponding to (information data) is specified and acquired. As a result, the image acquisition unit 215 specifies and acquires an image captured by a camera that captures a shooting direction close to the direction of the display terminal 100 among the cameras that capture a landscape other than the subject. Note that if there is only one row identified above, that is, if there is only one camera that captures a landscape other than the subject (for example, in the case of the second camera group), the image acquisition unit 215 may select this one row. The image data included in is acquired.

  The image acquisition unit 215 supplies the acquired image data to the transmission unit 240, and transmits it as reply data to the position data and the orientation data from the transmission unit 240 to the display terminal 100 via the network 300 (step S203). Thereafter, the image distribution server 200 waits until it receives position data and orientation data.

  The receiving unit 130 of the display terminal 100 receives the image data transmitted by the image distribution server 200 (step S103). The image data received by the receiving unit 230 is supplied to the display control unit 110c. The display control unit 110c supplies the image data supplied from the receiving unit 130 to the display unit 160, and displays an image represented by the image data on the display unit 160 (step S104). In this way, the display control unit 110c displays the image represented by the image data on the display unit 160 until the next step S104 based on the acquired image data. When the display control unit 110c performs the process of step S104, the position acquisition unit 110a and the orientation acquisition unit 110b perform the process of step S101 again. Note that the position acquisition unit 110a and the orientation acquisition unit 110b may wait for a predetermined period when the process of step S101 is performed again. As a result, the processing burden on the control unit 110 is reduced. Further, when the image data supplied from the receiving unit 130 is the same as the image data representing the image currently displayed on the display unit 160, the display control unit 110c skips step S104, and the same image data is displayed. The display unit 160 may be controlled so as to continue displaying. This reduces the processing burden on the display control unit 110c.

  By repeating the process as described above, different images are displayed on the display unit 160 of the display terminal 100 according to the orientation of the display terminal 100.

  For example, in FIG. 1, when the position of the display terminal 100 is closer to the subject 10 than to the subject 20, position data indicating this position is supplied to the image distribution server 200. For this reason, the image acquisition unit 215 refers to the shooting direction information / image correspondence table 220 shown in FIG. 3, and in the correspondence table 220 includes a row including this position data (identification data indicating identification information 11 to 15). Identifies the line in which it was recorded). Then, the image acquisition unit 215 specifies a line including attribute data indicating an attribute “1” (a line in which identification data indicating identification information 11 to 13 is recorded) among the specified lines. .

  Furthermore, when the orientation of the display terminal 100 is in the direction of 270 ° (west orientation) as shown in FIG. 9, the orientation data indicating this orientation is supplied to the image distribution server 200 together with the position data. Is done. Therefore, the image acquisition unit 215 includes shooting direction information data indicating shooting direction information in the range including 270 ° in the row including the attribute data “1” specified above (in the row of the camera 12). The recorded shooting direction information data) is specified, and the row including the shooting direction information data is specified. Then, the image acquisition unit 215 acquires image data included in this row (image data representing the image 2 and image data associated with the shooting direction information data). The acquired image data is supplied to the display terminal 100, and an image represented by the image data (the image 12 taken by the camera 12) is displayed on the display unit 160 by the display control unit 110c (FIG. 9). reference).

  Furthermore, when the orientation of the display terminal 100 is in the direction of 45 ° (northeast direction) as shown in FIG. 10, the orientation data indicating the orientation is supplied to the image distribution server 200 together with the position data. Is done. For this reason, the image acquisition unit 215 attempts to specify shooting direction information data indicating shooting direction information in a range including 45 ° in the row including the attribute data “1” specified above. Such shooting direction information data is not recorded in the rows for the cameras 11 to 13. Therefore, the image acquisition unit 215 identifies shooting direction information data indicating shooting direction information at an angle closest to 45 ° in the row including the attribute data “2”, and includes the shooting direction information data. Is identified. Then, the image acquisition unit 215 acquires image data included in this row (image data representing the image 5 and image data associated with the shooting direction information data). The acquired image data is supplied to the display terminal 100, and an image represented by the image data (the image 5 taken by the camera 15) is displayed on the display unit 160 by the display control unit 110c (FIG. 10). reference).

  When the position of the display terminal 100 changes, position data indicating a new position is supplied to the image distribution server 200 according to the position, so that the camera group is changed and the displayed image is changed. Further, when the orientation of the display terminal 100 changes, orientation data indicating a new orientation is supplied to the image distribution server 200, so that the displayed image is changed according to the orientation. For example, the image 2 is changed to the image 3 (see FIG. 11). For example, the image 1 may be changed to the image 4.

  The position detection unit 170 or the orientation detection unit 180 may supply a predetermined signal (a signal before being processed into data) indicating the position or orientation to the position acquisition unit 110a or the orientation acquisition unit 110b. The position acquisition unit 110a or the direction acquisition unit 110b may acquire the position data or the direction data by generating the position data or the direction data based on the supplied predetermined signal.

  In the above description, the image is handled as a still image. However, the image may be a group of moving images or continuous shot images. In this case, each camera generates image data representing a group of moving images, continuous shot images, and the like for each predetermined period, and supplies the image data to the image distribution server 200. The image distribution server 200 handles this image data in the same manner as the image data of the still image.

  The data structure of the shooting direction information / image correspondence table 220 is a structure in which a plurality of images obtained by shooting the same subject from different directions and the shooting directions of the plurality of images are recorded in association with each other. In addition, the data structure of the shooting direction information / image correspondence table 220 is obtained by associating position information, shooting direction information, and images with each other, specifying and acquiring an image based on the position information and shooting direction information. It may be a data structure that can be stored. As the data structure of the photographing direction information / image correspondence table 220, an appropriate structure can be adopted. For example, the shooting direction information / image correspondence table 220 may include a plurality of correspondence tables obtained by dividing the shooting direction information / image correspondence table 220.

  Further, the position of the display terminal 100 and the position information of the shooting direction information / image correspondence table 220 may be represented by an address or the like instead of the latitude and longitude. The position data indicating the position of the display terminal 100 may be recorded in advance in the storage unit of the display terminal 100, and the position acquisition unit 110a may acquire the position data from the storage unit and supply the position data to the transmission unit 140. In this case, the position is registered by operating the operation unit 150, and the position data is recorded in the storage unit.

  Note that the image acquisition unit 215 may acquire images associated with all the shooting directions within the predetermined range with the orientation of the display terminal 100 in the same camera group. That is, the image acquisition unit 215, based on the orientation data, capture direction information data indicating the capture direction information including the direction indicated by the orientation data, or the capture direction within the predetermined range (for example, ± 15 °). A plurality of pieces of image data associated with shooting direction information data indicating information are included in a predetermined row of the shooting direction information / image correspondence table 220 (similar to the above, including position information specified as being closest to the position of the display terminal 100). Line), and may be transmitted from the transmission unit 240 to the display terminal 100. In this case, the receiving unit 130 receives a plurality of image data and supplies them to the display control unit 110c. Based on the supplied plurality of image data, the display control unit 110c displays, for example, a slide display of the plurality of images represented by these image data on the display unit 160. For example, in the case shown in FIG. 9, the display unit 160 slides and displays the image 12 and the image 14, which are the images taken by the camera 12 and the camera 14 within the predetermined range. The image acquisition unit 215 acquires, for all camera groups (that is, the shooting direction information / image correspondence table 220), images associated with all shooting directions within a predetermined range with the orientation of the display terminal 100. May be. In this case, the plurality of images are displayed as a slide. In such cases, not only the predetermined subject but also the image of the direction of the display terminal 100 and the shooting direction within the predetermined range is displayed on the display unit 160, so that an interesting display is realized.

  In the present embodiment, with the configuration as described above, the control unit 110 acquires the orientation of the display terminal 100, and switches a plurality of images obtained by capturing the same subject from different capturing directions in accordance with the acquired change in orientation. It is displayed on the display unit 160. In the present embodiment, when the orientation of the display terminal 100 is changed, the display is switched to an image obtained by photographing the same subject from different directions. For this reason, the user can move the display terminal 100 to observe the subject from a plurality of angles, so that the display terminal 100 (the control unit 110) can switch the image displayed on the display unit 160 to be interesting. Further, the display terminal 100 can be used like a simple window by placing it in a bathroom such as a condominium, a conference room without a window, a hospital waiting room, etc., and can be used like a simple window. A pseudo image can be displayed. Further, even when the display terminal 100 is replaced, the display terminal 100 can automatically display an image corresponding to the orientation of the replaced display terminal 100, and the shooting direction changes even if the display terminal 100 changes. As a result, the subject is maintained, and the display terminal 100 (control unit 110) can switch the image displayed on the display unit 160 to be interesting.

  In particular, the control unit 110 corresponds to the above-mentioned direction and the shooting direction within a predetermined range from the shooting direction information / image correspondence table 220 which is a correspondence table recorded in association with the image and the shooting direction of the image. The attached image (that is, the image associated with the shooting direction information including the direction described above) is acquired and displayed on the display unit 160. As a result, similarly to the above, the control unit 110 can switch the image displayed on the display unit 160 in an interesting manner.

  Note that the shooting direction information / image correspondence table 220 may be recorded in the storage unit of the display terminal 100. In this case, the image data may not be updated. Further, the shooting direction information / image correspondence table 220 may be recorded in a storage medium (not shown) connected to the display terminal 100. Even in such a case, the control unit 110 is within the predetermined range from the shooting direction information / image correspondence table 220, which is a correspondence table recorded in association with the image and the shooting direction of the image. An image associated with the photographing direction (that is, an image associated with the photographing direction information including the direction described above) is acquired and displayed on the display unit. As a result, the same effect as described above can be obtained.

  In addition, when the orientation satisfies a predetermined criterion (here, the orientation is not included in any shooting direction information of each camera of attribute 1), the control unit 110 has a predetermined relationship with the orientation. Images (images 4, 5, etc.) that are captured in a direction other than the subject that is associated with a certain direction (here, the shooting direction closest to the direction in the camera having the attribute “2”) is displayed. Displayed on the unit 160. As a result, not only the predetermined subject but also the image of the direction of the display terminal 100 and the shooting direction within the predetermined range is displayed on the display unit 160, so that an interesting display is realized. The image obtained by photographing other than the subject may be an image obtained by photographing the sky. That is, for the camera 14 or the like, the shooting direction may be the direction toward the sky.

  Further, the subject varies depending on the position of the display terminal 100 depending on the position data. For this reason, if the display terminal 100 moves, an image of another subject is displayed on the display unit 160, so that an interesting display is realized. In the above, in particular, since the display terminal 100 displays an image or the like of a subject at a position close to the display terminal 100, the display terminal 100 can display an image of the area, and an interesting image display is realized. The

  Furthermore, in the present embodiment, with the configuration as described above, the image acquisition unit 215 records a plurality of images obtained by photographing the same subject from different directions and the photographing directions of the plurality of images in association with each other. Referring to the obtained shooting direction information / image correspondence table 220, an image associated with the shooting direction corresponding to the orientation of the display terminal 100 received by the receiving unit 230 is acquired, and transmitted to the display terminal 100 by the transmission unit 240. . Accordingly, the user can observe the subject from a plurality of angles by moving the display terminal 100, and thus the display terminal 100 can switch the image displayed on the display unit 160 in an interesting manner.

  The program in the image distribution server 200 or the display terminal 100 may cause the CPU to perform the above process in cooperation with an OS (Operation System). In this case, the OS is also recorded in the storage unit. The program is recorded on a portable storage medium (for example, CD-ROM (Compact Disk Read Only Memory), DVD-ROM (Digital Versatile Disk Read Only Memory)) and supplied to the image distribution server 200 or the display terminal 100. And may be recorded in a storage unit (such as a hard disk). The program may be supplied to the image distribution server 200 or the display terminal 100 via the network 300 and recorded in the storage unit.

  A storage device or a portable storage medium in which the program is recorded becomes a computer-readable storage medium that stores the program. The program may operate the image distribution server 200 or the display terminal 100 in which at least a part of the functions is realized by a dedicated circuit. That is, the image distribution server 200 or the display terminal 100 may be anything as long as it can perform the above processing, and the program operates such an image distribution server 200 (computer) or the display terminal 100 (computer). I just need it.

DESCRIPTION OF SYMBOLS 1 ... Image delivery system, 10 ... Subject, 11-15 ... Camera, 20 ... Subject, 21-24 ... Camera, 100 ... Display terminal (display control apparatus), 101. ..CPU, 102 ... RAM, 103 ... hard disk, 104 ... communication unit, 105 ... input device, 106 ... display device, 107 ... GPS receiver, 108 ... azimuth Sensor 110... Control unit 110 a. Position acquisition unit 110 b. Orientation acquisition unit 110 c Display control unit 130 Reception unit 140 Transmission unit 150. Operation unit 160 ... display unit 160a ... display surface 170 ... position detection unit 180 ... orientation detection unit 200 ... image distribution server 201 ... CPU 202 ..RAM, 203 ... ,... Communication unit, 210... Image recording unit, 215... Image acquisition unit, 220... Photographing direction information / image correspondence table, 230. 300 network

Claims (8)

An image of the object in different positions, a plurality of images captured each subject existing in the different position from the different photographing direction on the display unit a table Shimesuru display control device,
It acquires the position and orientation of the display control device, among a plurality of images which the taken from different photographing direction of the subject at the position close to the position of the acquired display control device, and orientation of the acquired display control device display control device, characterized in that the images taken from the same shooting direction comprises a table Shimesuru control unit on the display unit. When the orientation satisfies a predetermined criterion, the control means acquires an image obtained by photographing other than the subject, which is associated with a direction having a predetermined relationship with the orientation, and displays the acquired image on the display unit.
The display control apparatus according to claim 1 . Receiving means for receiving the position and orientation of the display terminal transmitted from the display terminal;
A plurality of images of subjects existing at different positions, each of the subjects existing at different positions taken from different directions, and a subject position and a shooting direction for each of the plurality of images correspond to each other. With reference to the correspondence table attached and recorded, the direction of the display terminal is the same among a plurality of images taken from different shooting directions of the subject present at a position close to the position of the display terminal received by the receiving means Image acquisition means for acquiring an image taken from the shooting direction ;
Transmitting means for transmitting the image acquired by the image acquiring means to the display terminal;
An image distribution server comprising: A display terminal that displays images of subjects existing at different positions, each of the subjects present at the different positions taken from different shooting directions ;
A display unit;
Position acquisition means for acquiring the position of the display terminal;
Orientation acquisition means for acquiring the orientation of the display terminal;
And the position where the position acquisition unit has acquired, and transmitting means for transmitting, and the orientation of the orientation obtaining unit has obtained,
Receiving means for receiving an image photographed from the same photographing direction as the direction of the display terminal among a plurality of images photographed from different photographing directions of the subject existing at a position close to the position of the display terminal transmitted by the transmitting means. When,
Display control means for displaying the image received by the receiving means on the display unit;
A display terminal comprising: An image distribution system comprising: an image distribution server; and a display terminal capable of communicating with the image distribution server,
The display terminal is
A display unit;
Position acquisition means for acquiring the position of the display terminal;
Orientation acquisition means for acquiring the orientation of the display terminal;
Comprising a the position where the position acquisition unit has acquired, and the orientation of the orientation obtaining unit obtains, and a that transmit means to send,
The image distribution server
A receiving unit that will receive the position and orientation of the display terminal which is transmitted from the display terminal,
A plurality of images of subjects existing at different positions, each of the subjects existing at different positions taken from different directions, and a subject position and a shooting direction for each of the plurality of images correspond to each other. attached by referring to the correspondence table recorded, before among the plurality of images taken from different imaging directions of the subject Ki受 signal means is located at a position closer to the position of the display terminal which receives the orientation of the display terminal Image acquisition means for acquiring an image shot from the same shooting direction ;
And a transmit unit that sends the image by the image acquisition unit has acquired the display terminal,
The display terminal is
And receiving means and the image distribution server before Kioku signal means sends, you receive the images taken from the same shooting direction as the direction of the display terminal,
Further comprising a display control means for displaying the image before Ki受 signal means receives of the display terminal on the display unit, and
An image distribution system characterized by that. An image of the object in different positions, a plurality of images captured each subject existing in the different position from the different photographing direction on the display unit To display computer,
The display unit acquires the position and orientation of the display unit, and displays the images obtained by capturing a plurality of images of the subject existing at positions close to the acquired position of the display unit from the same imaging direction as the acquired direction of the display unit. Table Shimesuru control step in part,
A program characterized by having On the computer,
A receiving step of receiving the position and orientation of the display terminal transmitted from the display terminal;
A plurality of images of subjects existing at different positions, each of the subjects existing at different positions taken from different directions, and a subject position and a shooting direction for each of the plurality of images correspond to each other. With reference to the correspondence table attached and recorded, the direction of the display terminal is the same among a plurality of images taken from different shooting directions of the subject existing at a position close to the position of the display terminal received in the receiving step An image acquisition step of acquiring an image taken from the shooting direction ;
A transmission step of transmitting the image acquired in the image acquisition step to the display terminal;
A program characterized by having A computer connected to a display unit that displays a plurality of images of subjects existing at different positions, each of the subjects present at different positions taken from different shooting directions ,
A position acquisition step of acquiring the position of the display unit;
A direction acquisition step of acquiring a direction of the display unit;
A transmission step of transmitting said position in which the position acquisition step has acquired, and the orientation obtained by the orientation obtaining step, a
A receiving step of receiving an image shot from the same shooting direction as the direction of the display unit among a plurality of images shot from different shooting directions of the subject existing at a position close to the position of the display unit transmitted in the transmission step. When,
A display control step of displaying the image received in the reception step on the display unit;
A program characterized by having

Images