JP4185013B2 - Moving image reception display method, moving image transmission method, moving image reception display device, moving image transmission device, moving image reception display program, moving image transmission program, and program recording medium thereof - Google Patents

Description

  The present invention relates to a moving image receiving / displaying method, a moving image transmitting method, a moving image receiving / displaying device, a moving image transmitting device, a moving image receiving / displaying program, a moving image transmitting program, and a program recording medium thereof. This is a technology related to video communication, video distribution, and video storage that can be changed.

  In general, in video coding, inter-frame predictive coding is used in order to achieve high coding efficiency using temporal correlation. The frame encoding mode can be predicted from an I frame that is encoded without using correlation between frames, a P frame that is predicted from one previously encoded frame, and two previously encoded frames. There are B frames. In the P frame, the prediction can be performed from the I frame or the P frame, and in the B frame, the prediction can be performed from the I frame, the P frame, or the B frame. In particular, the video encoding method H.264. In 263, decoded images for a plurality of frames can be stored in the reference image memory, and the reference image can be selected and predicted from the memory.

  The P frame is predicted from the past frame in the input moving image, but the B frame can be predicted from the future frame as well as the past frame. FIG. 1A shows an example of a motion picture prediction relationship. In the case of predicting from two frames in B frame (bidirectional prediction), image information from two frames is interpolated to generate image information for one frame to generate a predicted image.

  When the encoding modes of the first frame to the seventh frame are encoded in the order of IBBPBBP, since there is a prediction relationship shown in FIG. 1A, when encoding is actually performed, FIG. The frames are encoded in the order of 1423756 as shown in FIG.

  Here, the interlaced video has a structure having two fields in one frame, but a prediction relationship can be similarly set for each field. In general, a frame and a field are collectively called a picture. In the bi-directional prediction of the B frame, it is also possible to predict from the past two frames or the future two frames. For example, the video encoding method H.264. In H.264, decoded images for a plurality of frames are stored in a reference image memory, and two frames of reference images can be selected from the memory and predicted. The display time of the frame selected here may be the future or the past of the encoding target frame.

  If there are a plurality of camera input images in advance, the viewpoint position and the line-of-sight direction can be changed by switching the input images. Although these images can be obtained at the position where the image was taken, a technique for generating an image at a viewpoint position or line-of-sight direction that has not been taken has been proposed.

  For example, in the following Non-Patent Document 1, there is a technique for generating a light space from a plurality of camera input images and taking out image information from the light space to generate a video of a viewpoint position or line-of-sight direction that has not been photographed. Proposed. The light space is defined as the light intensity Il in a space of up to 7 dimensions as introduced in Non-Patent Document 2 below. The definition is shown in Formula (1). Here, the arguments x, y, and z indicate the position of the light passing point in the three-dimensional space, the arguments θ and φ indicate the light beam direction, the argument λ indicates the wavelength, and the argument t indicates time. Here, the position information in the ray space is not necessarily the same as the position and scale in the real space.

Il = I (x, y, z, θ, φ, λ, t) (1)
Since it is difficult to actually observe such a physical quantity with a current device, in practice, a plurality of pieces of information obtained from a camera that captures image information of (spatial 2-dimension + temporal-dimension) are used to obtain the formula (1 ) Is defined (with reduced dimensions), and an image of an arbitrary viewpoint position and line-of-sight direction is generated.

  In general, in the technology for generating such an image, when the same subject is captured by a plurality of camera input images, the viewpoint position that is not captured for the subject using the captured image information is used. And image information in the line-of-sight direction is generated. Image information is generated for a subject photographed over a plurality of camera input images, that is, using a part of the plurality of camera input images.

  There is a US standard method "SMPTE 315M-1999 Camera Positioning Information Conveyed by Ancillary Data Packets" as a method for indicating the world coordinate system of a camera. According to this method, it is possible to express camera position information and camera parameters when an image is captured by the camera, and it is possible to store the position information together with the captured image information. As the position information, the position information in the world coordinates of the camera and the relative position from the reference position can be expressed in meters. In addition, the shooting direction of the camera can be expressed in degrees. As a camera parameter, the focus distance can be expressed in mail units.

If the camera is defined by a pinhole model, it can be considered that the image information captured by the camera captures a light beam as expressed by Expression (1). That is, the intensity I _c of the light beam that passes through the position information of the camera defined by “SMPTE 315M” is expressed by equation (2) as in equation (1). Here, the arguments x, y, and z indicate the position of the camera in the three-dimensional space, the arguments θ and φ indicate the shooting direction of the camera, and the argument t indicates the shooting time of the camera. The camera position information shown here is position information in real space.

I _c = I (x, y, z, θ, φ, t) (2)
In streaming video distribution, video data is distributed from the distribution server to the client, but it is necessary to stably distribute the video data to the client on time. If the distribution server from which the client requests data does not have video data, the video data is transferred from another content server on the network. At this time, unless the video data is stably transferred between these servers, it cannot be stably delivered to the client. In order to prevent this, a prefetch technology is applied between servers.

Prefetch is a data prefetching technique. In the case of normal video distribution, the distribution server requests the content server for video data of the future than the video data at the time requested by the client. By appropriately using this prefetch, even when the bandwidth of the distribution server and the content server is crowded, the distribution server can stably distribute video data to the client (for example, see Non-Patent Document 3). . In addition, the prefetch technique may be performed by the client on the distribution server. For example, in W3C recommendation SMIL 2.0, a prefetch tag is defined for prefetching content of a client.
Fujii, Kimoto, Tanimoto: “Compression of 3D spatial information in ray group representation”, 3D image conference '96, pp.1-6 (1996.7) Heung-Yeung Shun, Sing Bing Kang, Shing-Chow Chan, “Survey of Image-Based Representations and Compression Techniques”, IEEE Trans., Circuits Syst., Video Technol., Vol.13, no.11, pp.1020- 1037, 2003 Kobayashi et al., “Proposal of prefetch method using multi-connection for stream proxy server”, IEICE CQ2002-73, 2002

  In order to display an image of the viewpoint position and line-of-sight desired by the user, it is necessary to generate an image of the viewpoint position and line-of-sight direction from the camera input image in the vicinity thereof. When the user changes the viewpoint position and the line-of-sight direction from moment to moment, the camera input image necessary for generation also changes. Consider the realization of a communication service that applies this.

  For example, in the case of video distribution, a user receives video data stored in a remote server and reproduces the video. In the case of video communication, a plurality of camera input videos on the other user side are received and reproduced. At this time, if the viewpoint position or line-of-sight direction desired by the user changes, the necessary camera input image also changes.

  Here, when all camera input images are received from a remote place or other users, an image may be generated using only necessary images. However, there is a problem that enormous communication bandwidth is required to receive all camera images. For this reason, the method of receiving only the image information necessary for generation is more effective because the communication band can be reduced.

  However, in the conventional video distribution and video communication protocol, there is no mechanism for designating the camera input video, so it is not possible to instruct to send only necessary image information. In addition, since there is a round-trip propagation delay associated with transmission, when the user's viewpoint position or line-of-sight direction changes significantly, the timing at which the user sends a signal requesting data and the timing at which the user receives video data differ greatly. , The video desired by the user cannot be generated.

  The present invention solves the above-described problems of the prior art, and provides a technique capable of efficiently displaying the corresponding image information on the display device of the user when the user changes the viewpoint position or the line-of-sight direction. Objective.

  In order to solve the above-described problems, the present invention provides a viewpoint position that a user wants to see from a user's moving image receiving display device, for example, with respect to a server (moving image device device) capable of distributing images corresponding to a plurality of camera positions. When the moving image receiving display device receives and displays an image corresponding to the camera position from the server and displays it, the user receives the image and displays it. From the past viewpoint position and line-of-sight change history and the viewpoint position and line-of-sight direction requested at the present time, the viewpoint position and line-of-sight that the user is most likely to request after the round-trip propagation delay time The most important feature is to predict the direction and transmit the camera position information corresponding to the predicted viewpoint position and line-of-sight direction to the server.

  In addition to transmitting the predicted camera position information, the camera position information of the image that is actually displayed may be transmitted. Further, instead of transmitting the camera position information, light position information such as position information in the light space may be transmitted.

Specifically, the first aspect of the present invention is a moving image receiving and displaying method for receiving camera position information and moving image data indicating the position and direction of a camera and displaying an image, and displaying an image. When, by using the delay setting step of setting a delay amount, and camera position information of the image displayed in the past, and camera position information of the currently displayed image, the delay amount set by the delay setting step, the current from the past the movement amount corresponding to the delay amount from the current camera position by averaging the amount of movement of the plurality of camera positions to calculate a prediction camera position information by adding the movement amount to the current camera position a predicted camera position determination step that determine, and executes a predicted camera position transmission step that sends prediction camera position information. The delay amount is the round-trip propagation delay time of the signal from the transmission of the position information from the image reception display device to the reception of the image from the transmission device. However, the delay amount is not limited to the absolute time but substantially corresponds to the time. For example, the number of frames may be used.

The second aspect of the present invention is a moving image reception display method for receiving camera position information and moving image data indicating the position and direction of a camera and displaying an image, wherein an image display step for displaying an image and a delay amount are displayed. Multiple cameras from the past to the present using the delay setting step to be set, the camera position information of the image displayed in the past, the camera position information of the currently displayed image, and the delay amount set in the delay setting step on average the amount of movement of the position to calculate the movement amount corresponding to the delay amount from the current camera position, and determines the prediction camera position information by adding to the amount of movement the current camera position, the the predicted camera position determination step of determining an error prediction camera position information indicating an error range centered on the position of the predicted camera position information from the amount of movement of the statistical error of the plurality of camera positions, predict A predicted camera position transmission step that sends camera position information, and executes the error predicted camera position transmission step of transmitting an error prediction camera position information.

  The third aspect of the present invention is the moving image reception display method according to the first aspect of the present invention or the second aspect of the present invention, wherein the present camera position transmission is performed to transmit current camera position information indicating the camera position of the currently displayed image. The step is executed.

A fourth aspect of the present invention is a moving image transmitting method for transmitting camera position information and moving image data indicating the position and direction of a camera, and in the moving image receiving and displaying apparatus, camera position information of an image displayed in the past, Using the camera position information of the currently displayed image and the set delay amount, the movement amounts of multiple camera positions from the past to the present are averaged to correspond to the delay amount from the current camera position. the movement amount is calculated and the predicted camera position information determined by adding the movement amount to the current camera position, and predicted camera position receiving step that will receive from the moving image reception display apparatus, prediction camera position information A camera position moving image search step for searching the moving image data, and a moving image data transmission step for transmitting the moving image data and camera position information searched in the camera position moving image search step. Characterized in that row.

The fifth aspect of the present invention is a moving image transmission method for transmitting camera position information and moving image data indicating the position and direction of a camera, and in the moving image reception display device, camera position information of an image displayed in the past, Using the camera position information of the currently displayed image and the set delay amount, the movement amounts of multiple camera positions from the past to the present are averaged to correspond to the delay amount from the current camera position. the movement amount is calculated and the predicted camera position information determined by adding the movement amount to the current camera position, and predicted camera position receiving step that will receive from the moving image receiving display device, a moving image receiving display device in the error predicted camera position information indicating an error range centered on the position of the predicted camera position information determined from the statistical error of the amount of movement of said plurality of camera positions, from the moving image reception display device And an error predicted camera position receiving step of trust, the camera position moving picture searching step of searching for moving picture data corresponding to the camera position in the range specified by the error predicted camera position information about the prediction camera position information, camera A plurality of moving image data searched in the position moving image searching step and a moving image data transmitting step for transmitting camera position information are executed.

  The sixth aspect of the present invention is the moving picture transmission method according to the fourth aspect of the invention or the fifth aspect of the invention, wherein a current camera position receiving step for receiving current camera position information and a moving picture corresponding to the current camera position information A stationary position moving image data transmission step of transmitting data and camera position information.

The seventh aspect of the present invention is a moving image reception display method for receiving light position information and moving image data and displaying an image, an image display step for displaying an image, a delay setting step for setting a delay amount, Using the ray position information of the image displayed in the past, the ray position information of the currently displayed image, and the delay amount set in the delay setting step, the change amounts of a plurality of ray positions from the past to the present are averaged. Te to calculate the change amount corresponding to the delay amount from the current beam position, the pre-metering line position determination step that determine the pre photometric line position information by adding the amount of change in the current beam position, pre and executes the pre-metering line position transmission step that sends photometric line position information.

The eighth aspect of the present invention is a moving image reception display method for receiving light position information and moving image data and displaying an image, an image display step for displaying an image, a delay setting step for setting a delay amount, Using the ray position information of the image displayed in the past, the ray position information of the currently displayed image, and the delay amount set in the delay setting step, the change amounts of a plurality of ray positions from the past to the present are averaged. Te to calculate the change amount corresponding to the delay amount from the current beam position, and determines the pre-metering line position information by adding the amount of change in the current beam position, the variation of the plurality of ray position position prediction and the ray position determination step, pre photometric line position transmission step that sends pre photometric line position information that determines the error prediction ray position information indicating an error range centered on the predicted beam position information from the statistical error of , And then executes the error prediction ray position transmission step of transmitting an error prediction ray position information.

  The ninth aspect of the present invention is the moving image reception display method according to the seventh aspect of the present invention or the eighth aspect of the present invention, wherein the present light position transmission is performed to transmit the present light position information indicating the light position of the currently displayed image. Steps are executed.

A tenth aspect of the present invention is a moving image transmitting method for transmitting light beam position information and moving image data. In the moving image receiving and displaying apparatus, the light beam position information of a previously displayed image and the currently displayed image are transmitted. Using the ray position information and the set delay amount, the change amounts of a plurality of ray positions from the past to the present are averaged to calculate the change amount according to the delay amount from the current ray position, and the pre photometric line position information determined by adding the amount of change to the current beam position, the pre-metering line position receiving step that will receive from the moving image receiving display device, searching the moving image data of the pre-metering line position information A light beam position moving image searching step, and a moving image data transmitting step for transmitting the moving image data and the light beam position information searched in the light beam position moving image searching step.

An eleventh aspect of the present invention is a moving image transmission method for transmitting light beam position information and moving image data. In the moving image reception display device, the light beam position information of a previously displayed image and the currently displayed image are displayed. Using the ray position information and the set delay amount, the change amounts of a plurality of ray positions from the past to the present are averaged to calculate the change amount according to the delay amount from the current ray position, and the pre photometric line position information determined by adding the amount of change to the current beam position, the pre-metering line position receiving step that will receive from the moving image receiving display device, in the moving picture reception display device, the plurality of light beams error prediction ray position information indicating an error range centered on the position of the determined from the variation of the statistical error in the position the predicted light beam position information, and the error predicted ray position receiving step of receiving from the moving image receiving display device, A beam position moving picture searching step of searching the moving image data corresponding to the beam position in the range specified by the error prediction ray position information about the photometric line position information, a plurality of which is searched by the ray position moving image search step And a moving image data transmitting step for transmitting moving image data and light beam position information.

  A twelfth aspect of the present invention is the moving image transmission method according to the tenth aspect of the present invention or the eleventh aspect of the present invention, wherein a current light position receiving step for receiving current light position information and a moving image corresponding to the current light position information And a stationary position moving image data transmission step for transmitting data and light beam position information.

  According to the first aspect of the present invention, the camera position that the user will see after the delay time can be predicted on the receiving side (user side), and image information on the camera position can be requested to the transmitting side. As a prediction method, as shown in FIGS. 2 and 3, the movement amount of the camera position from the past to the present is measured, and the camera position when delayed by the round-trip propagation delay time from the reception side to the transmission side is determined. Calculate as the average predicted camera position. For example, the movement amounts from a plurality of camera positions calculated as average predicted camera positions in the past are averaged to calculate the movement amount from the current camera position. Then, the movement amount is added to the current camera position to calculate the average predicted camera position. Note that the method of calculating the average predicted camera position is not limited to this.

  According to the second aspect of the present invention, in addition to the first aspect of the present invention, the error of the predicted camera position can be calculated on the reception side and specified to the transmission side. As a calculation method of the error of the predicted camera position (error predicted camera position), as shown in FIG. 3, a statistical error of the moving amount of the camera position used for determining the average predicted camera position in the past can be used. . For example, the error prediction camera position is obtained by calculating the standard deviation of the movement amounts of the plurality of camera positions calculated as the average prediction camera position in the past. The calculation method is not limited to this.

  According to the third aspect of the present invention, in addition to the first aspect of the present invention or the second aspect of the present invention, the camera position currently viewed on the receiving side can be designated to the transmitting side. By combining with the moving image transmission method of the sixth aspect of the present invention corresponding to this, for example, immediately after the receiving side specifies the average predicted camera position information to the transmitting side, when the user stops changing the viewpoint position or the line-of-sight direction, The receiving side can receive the image information of the camera position at the specified time, and the user can continue to view the image at the same camera position.

  According to the seventh to tenth aspects of the present invention, instead of transmitting or receiving the camera position information at the same time as the moving image data, the position information in the light space mapping the image data can be transmitted or received. . As a result, it is possible to omit the conversion processing necessary for mapping the image data to the light space using the camera position information, and to reduce the processing amount for generating the image.

  The average predicted light position information in the seventh and eighth aspects of the present invention is determined by measuring the amount of movement of the light position from the past to the present, as shown in FIGS. 2 and 3, from the reception side to the transmission side. The ray position when delayed by the round-trip propagation delay time is set as the average predicted ray position, and the error predicted ray position information in the eighth aspect of the present invention is determined in the past as shown in FIG. This is performed using a statistical error (for example, standard deviation) of the moving amount of the light beam position used for the determination.

  The data format and encoding method of moving image data to which these inventions are applied are not limited to specific ones. Interframe predictive coding may be applied, or subband coding may be applied to an image.

  According to the present invention, the camera position that the user will see after the delay time can be predicted on the user side, and image information on the camera position can be requested to the transmission side. Accordingly, when the user changes the viewpoint position or the line-of-sight direction, the corresponding image information can be displayed to the user.

  Embodiments of the present invention will be described with reference to the drawings. As a first embodiment, a case will be described in which the Motion JPEG encoding method is applied to moving image data, and camera position information is encoded to each image data at the same time. A procedure for transmitting / receiving such moving image data will be described. Also, the current camera position information is transmitted and received between the transmission side and the reception side. The camera position is a total of five-dimensional information composed of a three-dimensional relative position when the initial position is the origin and two pieces of angle information indicating the camera imaging direction.

  An example of the configuration of the moving image transmission apparatus is shown in FIG. 4, and an example of the configuration of the moving image reception display apparatus is shown in FIG. The moving image transmitting apparatus 1 shown in FIG. 4 includes an average predicted camera position receiving unit 107 that receives average predicted camera position information, an error predicted camera position receiving unit 108 that receives error predicted camera position information, and current camera position information. A current camera position receiving unit 105 for receiving, a predicted camera position determining unit 104 for determining a predicted camera position that is a camera position within a range specified by the error predicted camera position information centered on the average predicted camera position information, and a camera position Corresponding to the camera position moving image search unit 101 for searching for moving image data corresponding to the moving image data transmitting unit 109 for transmitting a plurality of moving image data corresponding to the predicted camera position and camera position information, and corresponding to the current camera position information The still position moving image data transmitting unit 106 for transmitting the moving image data and the camera position information, and a camera storing the camera position information. Composed of the positional information storage memory 102, a video data storage memory 103 that accumulates the moving picture data. In the figure, 5 is a communication path.

  In the moving image reception display device 2 shown in FIG. 5, an image display unit 213 that displays an image, a delay setting unit 212 that sets a delay time, and a camera position recording memory 211 that stores camera position information of images displayed in the past. A display camera position specifying unit 210 for specifying the display camera position, a predicted camera position determining unit 208 for determining the average predicted camera position and the error predicted camera position, and an average predicted camera position transmitting unit for transmitting average predicted camera position information 203, an error prediction camera position transmission unit 204 that transmits error prediction camera position information, a current camera position transmission unit 201 that transmits current camera position information indicating the camera position of the currently displayed image, and a current camera in the past The position transmitting unit 201 receives image data and camera position information at the camera position designated on the transmission side and decodes moving image data. The position moving image data receiving unit 202, the still position moving image data storage memory 206 for storing the image information obtained by the still position moving image data receiving unit 202, the average predicted camera position transmitting unit 203 and the error predicted camera position transmitting in the past. A predicted position moving image data receiving unit 205 that receives image data and camera position information at the camera position designated on the transmission side in the unit 204 and decodes moving image data; and an image obtained by the predicted position moving image data receiving unit 205 A predicted position moving image data storage memory 207 that stores information; a display determination unit 209 that determines which of the moving images stored in the still position moving image data storage memory 206 and the predicted position moving image data storage memory 207 is to be displayed; Consists of.

  In the moving image transmitting apparatus 1, the prediction camera position determination unit 104 determines a camera position that falls within a five-dimensional sphere with the radius being the error prediction camera position with the average prediction camera position as the center, as shown in FIG. To do. The camera position moving image search unit 101 searches for a camera position corresponding to this range.

  In the moving image reception display device 2, the display camera position specifying unit 210 specifies a camera position specified by the user. As a method for specifying the camera position, for example, by using a GUI (Graphical User Interface), the user can specify the position of the space displayed on the display with a pointing device such as a mouse, or a button for changing the viewpoint position or the line-of-sight direction. For example, the direction may be specified by dragging the mouse. Alternatively, the user's movement may be detected to determine the camera position that the user thinks is desired. The camera position designation method is not limited to these, and any method may be used.

  The predicted camera position determination unit 208 calculates the movement amount from the current camera position by averaging the movement amounts of the plurality of camera positions calculated as the average predicted camera position in the past. Then, the movement amount is added to the current camera position to calculate the average predicted camera position. In addition, the error prediction camera position information is calculated by calculating the standard deviation of the movement amounts of the plurality of camera positions calculated as the average prediction camera position in the past.

  There are a plurality of pieces of image information received and decoded by the predicted position moving image data receiving unit 205, and each is distinguished by the camera position information.

The display determination unit 209 evaluates E _c between the camera position received by the predicted position moving image data receiving unit 205 and the camera position received by the still position moving image data receiving unit 202 and the current display camera position. The moving image data at the camera position with the smallest is determined as the display image. The evaluation value E _c here is calculated by the equation (3). Here, (x1, y1, z1) indicates the current display camera position (the camera position specified by the display camera position specifying unit 210 at the present time), and (x2, y2, z2) indicates the camera position to be evaluated. Indicates.

E _c = ((x1-x2) ² + (y1-y2) ² + (z1-z2) ² ) ^1/2 (3)
Here, it is assumed that the moving image reception display device 2 has already received moving image data. It is assumed that the round trip propagation delay time between the transmission side and the reception side set by the delay setting unit 212 is measured. Under such a premise, the moving image transmitting apparatus 1 and the moving image receiving / displaying apparatus 2 operate as follows.

  In the moving image reception display device 2, the still position moving image data receiving unit 202 receives and decodes moving image data, and stores the decoded image and camera position information in the still position moving image data storage memory 206. The predicted position moving image data receiving unit 205 receives and decodes moving image data, and stores the decoded image and camera position information in the predicted position moving image data storage memory 207.

The display camera position designation unit 210 designates the camera position to be displayed and accumulates the camera position in the camera position recording memory 211. The display determination unit 209 uses the camera position information stored in the still position moving image data storage memory 206 and the predicted position as the camera position having the smallest evaluation value E _c calculated by Expression (3) with respect to the camera position to be displayed. The determination is made from the camera position information stored in the moving image data storage memory 207. The image display unit 213 displays image information of the determined camera position.

  The predicted camera position determining unit 208 calculates the average predicted camera position and the error predicted camera position from the past camera position information stored in the camera position recording memory 211 and the camera position specified by the display camera position specifying unit 210. decide. The average prediction camera position transmission unit 203 transmits average prediction camera position information, and the error prediction camera position transmission unit 204 transmits error prediction camera position information. The current camera position transmission unit 201 transmits current camera position information. These camera position information may be transmitted regularly and regularly at a relatively short time interval, or may be transmitted only when there is a change.

  In the moving image transmitting apparatus 1, the current camera position receiving unit 105 receives current camera position information. The camera position moving image search unit 101 searches the camera position information storage memory 102 for the camera position specified by the current camera position. An evaluation value similar to that of Expression (3) is set, and a camera position having the smallest evaluation value is searched.

  The still position moving image data transmission unit 106 reads out the moving image data corresponding to the camera position obtained by the search from the moving image data storage memory 103, and transmits the moving image data and the camera position information. The average prediction camera position reception unit 107 receives average prediction camera position information, and the error prediction camera position reception unit 108 receives error prediction camera position information. The predicted camera position determination unit 104 determines the predicted camera position from the average predicted camera position information and the error predicted camera position information.

  The camera position moving image search unit 101 searches the camera position information storage memory 102 for a camera position within a range specified by the determined camera position. The moving image data transmission unit 109 reads out the moving image data corresponding to the camera position obtained by the search from the moving image data storage memory 103, and transmits the moving image data and the camera position information.

  Repeat the above steps. Thereby, when the user changes the viewpoint position and the line-of-sight direction, it is possible to display the most appropriate corresponding image information to the user.

  As a second embodiment, a case will be described in which the MPEG-1 encoding method is applied to moving image data, and ray position information is encoded simultaneously in each frame. It is assumed that moving picture data encoded by MPEG-1 constitutes a GOP and can be randomly accessed in GOP units. A procedure for transmitting / receiving such moving image data will be described. The light beam position is a total of six-dimensional information including a three-dimensional relative position, two angle information indicating the light beam direction, and time information when the initial position is the origin.

  An example of the configuration of the moving image transmission device is shown in FIG. 7, and an example of the configuration of the moving image reception display device is shown in FIG. In the moving image transmitting apparatus 3 shown in FIG. 7, an average predicted light position receiving unit 313 that receives average predicted light position information, a light position moving image search unit 311 that searches for moving image data corresponding to the light position, and a light position. Predicted ray search range designation unit 310 that designates the range of rays to be searched by moving image search unit 311, moving image data transmission unit 309 that transmits a plurality of moving image data corresponding to the ray position and camera position information, and ray position It comprises a ray position information storage memory 312 that stores information and a moving image data storage memory 303 that stores moving image data.

  In the moving image reception display device 4 shown in FIG. 8, an image display unit 413 that displays an image, a delay setting unit 412 that sets a delay time, and a light beam position recording memory 414 that stores light beam position information of images displayed in the past. A display light beam position specifying unit 417 for specifying a display light beam position, a predicted light beam position determining unit 415 for determining an average predicted light beam position, an average predicted light beam position transmitting unit 416 for transmitting average predicted light beam position information, A predicted position moving image data receiving unit 405 that receives the image data and light position information at the light position designated on the transmission side by the average predicted light position transmitting unit 416 and decodes moving image data; and a predicted position moving image data receiving unit Any one of a predicted position moving image data storage memory 407 for storing image information obtained in 405 and a plurality of moving images stored in the predicted position moving image data storage memory 407 Composed of the display determination unit 409 determines whether to display.

  In the moving image transmitting apparatus 3, the light position information storage memory 312 stores position information and time in the light space for the first frame of the GOP of moving image data encoded in MPEG-1 as light position information. It is assumed that information is accumulated. As shown in FIG. 9, the ray position moving image search unit 311 has the average predicted ray position as the center and the ray position that enters the 6-dimensional sphere with the search range specified by the predicted ray search range specifying unit 310 as the radius. Shall be searched.

  In the moving image reception display device 4, the display light beam position designation unit 417 designates a light beam position corresponding to the camera position designated by the user using, for example, a GUI. The predicted light position determination unit 415 calculates the amount of movement from the current light position by averaging the movement amounts of the plurality of light positions calculated as the average predicted light position in the past. Then, the movement amount is added to the current ray position to calculate the average predicted ray position. There are a plurality of pieces of image information obtained by receiving and decoding by the predicted position moving image data receiving unit 405, and each is distinguished by the light ray position information.

The display determining unit 409 evaluates the evaluation value E between the current display light beam position (the light beam position specified by the current display light beam position specifying unit 417) among the light beam positions received by the predicted position moving image data receiving unit 405. The moving image data at the light ray position having the smallest _l is determined as a display image. Here evaluation value E _l in can be expressed by equation (4). Here, (x1, y1, z1) indicates the current display light beam position, and (x2, y2, z2) indicates the light beam position to be evaluated.

_{E l = ((x1-x2} ) 2 + (y1-y2) 2 + (z1-z2) 2) 1/2 (4)
Here, it is assumed that the moving image reception display device 4 has already received moving image data. It is assumed that the round trip propagation delay time between the transmission side and the reception side set by the delay setting unit 412 is measured. Under such a premise, the moving image transmission device 3 and the moving image reception display device 4 operate as follows.

  In the moving image reception display device 4, the predicted position moving image data receiving unit 405 receives and decodes moving image data, and stores the decoded image and the ray position information in the predicted position moving image data storage memory 407. The display light beam position designation unit 417 designates the light beam position to be displayed and stores the light beam position in the light beam position recording memory 414.

Display determination unit 409 determines the smallest ray position evaluation value E _l which is calculated by the equation (4) with respect ray position to be displayed, from among the ray position information accumulated in the predicted position moving image data storage memory 407 To do. The image display unit 413 displays image information of the determined light beam position.

  The predicted light position determining unit 415 determines the average predicted light position from the past light position information stored in the light position recording memory 414 and the light position specified by the display light position specifying unit 417. The average predicted light position transmission unit 416 transmits average predicted light position information.

  In the moving image transmitting apparatus 3, the average predicted light beam position receiving unit 313 receives average predicted light beam position information. The predicted ray search range designation unit 310 designates a ray range search range. The light beam position moving image search unit 311 searches the light beam position information storage memory 312 for a light beam position within a designated range. The moving image data transmission unit 309 reads a plurality of moving image data corresponding to the camera position obtained by the search from the moving image data storage memory 303, and transmits the moving image data and the camera position information.

  Repeat the above steps. Accordingly, when the user changes the viewpoint position or the line-of-sight direction, the corresponding image information can be displayed to the user.

  The moving image transmitting apparatus 3 may further include a current light beam position receiving unit (corresponding to the current camera position receiving unit 105 in FIG. 4) that receives current light beam position information indicating the light beam position of the currently displayed image. In this case, the moving image reception display device 4 includes a current beam position transmission unit (corresponding to the current camera position transmission unit 201 in FIG. 5) that transmits current beam position information indicating the beam position of the currently displayed image.

  Further, the moving image transmitting apparatus 3 may further include an error predicted light beam position receiving unit (corresponding to the error predicted camera position receiving unit 108 in FIG. 4) that receives error predicted light beam position information. In this case, the moving image reception display device 4 includes an error prediction light beam position transmission unit (corresponding to the error prediction camera position transmission unit 204 in FIG. 5) that transmits error prediction light beam position information.

  The processing performed by the moving image transmitting apparatuses 1 and 3 and the moving image receiving and displaying apparatuses 2 and 4 described above can also be realized by a computer and a software program, and the program is recorded on a computer-readable recording medium. It can be provided or provided through a network.

It is a figure which shows the example of the prediction relationship of a moving image. It is a figure which shows the example of the determination method of an average estimated camera position. It is a figure which shows the example of the determination method of an average estimated camera position and an error estimated camera position. It is a figure which shows an example of a structure of a moving image transmitter. It is a figure which shows an example of a structure of a moving image reception display apparatus. It is a figure which shows the example of the determination method of an estimated camera position. It is a figure which shows an example of a structure of a moving image transmitter. It is a figure which shows an example of a structure of a moving image reception display apparatus. It is a figure which shows the example of the determination method of an estimated light ray position.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1,3 Moving image transmission apparatus 2,4 Moving image reception display apparatus 5 Communication path 101 Camera position moving image search part 102 Camera position information storage memory 103 Moving image data storage memory 104 Predictive camera position determination part 105 Current camera position receiving part 106 Still position moving image data transmission unit 107 Average prediction camera position reception unit 108 Error prediction camera position reception unit 109, 309 Moving image data transmission unit 201 Current camera position transmission unit 202 Still position moving image data reception unit 203 Average prediction camera position transmission unit 204 Error prediction camera position transmission unit 205, 405 Prediction position moving image data reception unit 206 Still position moving image data storage memory 207, 407 Prediction position moving image data storage memory 208 Prediction camera position determination unit 209, 409 Display determination unit 210 Display camera Position designation part 211 La position recording memory 212, 412 Delay setting unit 213, 413 Image display unit 310 Predicted ray search range specifying unit 311 Ray position moving image search unit 312 Ray position information storage memory 313 Average predicted ray position receiving unit 414 Ray position recording memory 415 Prediction Ray position determination unit 416 Average predicted beam position transmission unit 417 Display beam position designation unit

Claims (28)

A moving image receiving and displaying method in which a moving image receiving and displaying device receives camera position information and moving image data indicating a camera position and direction from a moving image transmitting device and displays an image,
The moving image receiving display device is
An image display step for displaying an image;
A delay setting step for setting a delay amount of a round-trip propagation delay related to transmission between the moving image reception display device and the moving image transmission device;
Using the camera position information of the image displayed in the past, the camera position information of the image currently displayed, and the delay amount set in the delay setting step, the movement amounts of a plurality of camera positions from the past to the present can be calculated. A predicted camera position determining step of calculating predicted camera position information by calculating an amount of movement corresponding to the delay amount from the current camera position on average and adding the amount of movement to the current camera position ;
A predicted camera position transmission step that sends the predicted camera position information to the moving picture transmission apparatus,
A moving image receiving and displaying method characterized in that: A moving image receiving and displaying method in which a moving image receiving and displaying device receives camera position information and moving image data indicating a camera position and direction from a moving image transmitting device and displays an image,
The moving image receiving display device is
An image display step for displaying an image;
A delay setting step for setting a delay amount of a round-trip propagation delay related to transmission between the moving image reception display device and the moving image transmission device;
Using the camera position information of the image displayed in the past, the camera position information of the image currently displayed, and the delay amount set in the delay setting step, the movement amounts of a plurality of camera positions from the past to the present can be calculated. On average, a movement amount corresponding to the delay amount from the current camera position is calculated, and the predicted camera position information is determined by adding the movement amount to the current camera position, and the movement of the plurality of camera positions is also performed. A predicted camera position determining step for determining error predicted camera position information indicating an error range centered on the position of the predicted camera position information from a statistical error in quantity ;
A predicted camera position transmission step that sends the predicted camera position information to the moving picture transmission apparatus,
And an error predicted camera position transmission step of transmitting the error predicted camera position information to the moving picture transmission apparatus,
A moving image receiving and displaying method characterized in that: The moving image receiving and displaying method according to claim 1 or 2,
The moving image reception display device further comprises:
A current camera position transmission step of transmitting current camera position information indicating a camera position of a currently displayed image to the moving image transmission device;
A moving image receiving and displaying method characterized in that: A moving image transmitting method in which a moving image transmitting apparatus transmits camera position information and moving image data indicating the position and direction of a camera to a moving image receiving display apparatus,
The moving image transmitting device is
In the moving image reception display device, a plurality of camera positions from the past to the present using the camera position information of the image displayed in the past, the camera position information of the currently displayed image, and the set delay amount. The movement amount according to the delay amount from the current camera position is calculated by averaging the movement amounts of the current camera position, and the predicted camera position information determined by adding the movement amount to the current camera position is used as the moving image. a predicted camera position receiving step is received from the receiving display device,
A camera position moving picture searching step of searching for moving picture data of the predicted camera position information,
A moving image data transmission step of transmitting the moving image data and camera position information searched in the camera position moving image search step to the moving image reception display device;
A moving image transmission method characterized in that A moving image transmitting method in which a moving image transmitting apparatus transmits camera position information and moving image data indicating the position and direction of a camera to a moving image receiving display apparatus,
The moving image transmitting device is
In the moving image reception display device, a plurality of camera positions from the past to the present using the camera position information of the image displayed in the past, the camera position information of the currently displayed image, and the set delay amount. The movement amount according to the delay amount from the current camera position is calculated by averaging the movement amounts of the current camera position, and the predicted camera position information determined by adding the movement amount to the current camera position is used as the moving image. a predicted camera position receiving step is received from the receiving display device,
In the moving image receiving and displaying apparatus, the error receiving camera position information indicating an error range centered on the position of the predicted camera position information determined from the statistical error of the movement amounts of the plurality of camera positions is displayed on the moving image receiving and displaying screen. An error prediction camera position receiving step received from the apparatus ;
A camera position moving picture searching step of searching for moving picture data corresponding to the camera position in the range specified by the error predicted camera position information about said predicted camera position information,
A moving image data transmission step of transmitting a plurality of moving image data and camera position information searched in the camera position moving image search step to the moving image reception display device;
A moving image transmission method characterized in that The moving image transmission method according to claim 4 or 5, wherein
The moving image transmitting device further includes:
A current camera position receiving step for receiving current camera position information;
A still position moving image data transmission step of transmitting moving image data corresponding to the current camera position information and camera position information to the moving image receiving display device;
A moving image transmission method characterized in that A moving image receiving and displaying method in which a moving image receiving and displaying device receives light beam position information and moving image data from a moving image transmitting device and displays an image,
The moving image receiving display device is
An image display step for displaying an image;
A delay setting step for setting a delay amount of a round-trip propagation delay related to transmission between the moving image reception display device and the moving image transmission device;
Using the ray position information of the image displayed in the past, the ray position information of the currently displayed image, and the delay amount set in the delay setting step, the amount of change in a plurality of ray positions from the past to the present is calculated. A predicted ray position determining step of calculating predicted ray position information by averaging, calculating a change amount according to the delay amount from the current ray position, and adding the change amount to the current ray position ;
A pre photometric line position transmission step that sends the predicted light beam position information to said moving picture transmission device,
A moving image receiving and displaying method characterized in that: A moving image receiving and displaying method in which a moving image receiving and displaying device receives light beam position information and moving image data from a moving image transmitting device and displays an image,
The moving image receiving display device is
An image display step for displaying an image;
A delay setting step for setting a delay amount of a round-trip propagation delay related to transmission between the moving image reception display device and the moving image transmission device;
Using the ray position information of the image displayed in the past, the ray position information of the currently displayed image, and the delay amount set in the delay setting step, the amount of change in a plurality of ray positions from the past to the present is calculated. On the average, a change amount according to the delay amount from the current ray position is calculated, and predicted ray position information is determined by adding the change amount to the current ray position, and changes in the plurality of ray positions A predicted light beam position determining step for determining error predicted light beam position information indicating an error range centered on the position of the predicted light beam position information from a quantity statistical error ;
A pre photometric line position transmission step that sends the predicted light beam position information to said moving picture transmission device,
An error prediction ray position transmission step of transmitting the error prediction ray position information to the moving picture transmission apparatus,
A moving image receiving and displaying method characterized in that: The moving image receiving and displaying method according to claim 7 or 8,
The moving image reception display device further comprises:
A current beam position transmitting step of transmitting current beam position information indicating the beam position of the currently displayed image to the moving image transmitting apparatus;
A moving image receiving and displaying method characterized in that: A moving image transmitting method in which a moving image transmitting apparatus transmits light beam position information and moving image data to a moving image receiving and displaying apparatus,
The moving image transmitting device is
In the moving image receiving and displaying apparatus, a plurality of light beam positions from the past to the present using the light beam position information of the image displayed in the past, the light beam position information of the currently displayed image, and the set delay amount. The amount of change is averaged to calculate the amount of change corresponding to the amount of delay from the current ray position, and the predicted ray position information determined by adding the amount of change to the current ray position is used as the moving image. a pre photometric line position receiving step of receiving from the receiving display device,
A beam position moving picture searching step of searching for moving picture data of the predicted light beam position information,
A moving image data transmission step of transmitting the moving image data and the light beam position information searched in the light beam position moving image search step to the moving image reception display device;
A moving image transmission method characterized in that A moving image transmitting method in which a moving image transmitting apparatus transmits light beam position information and moving image data to a moving image receiving and displaying apparatus,
In the moving image receiving and displaying apparatus, a plurality of light beam positions from the past to the present using the light beam position information of the image displayed in the past, the light beam position information of the currently displayed image, and the set delay amount. The amount of change is averaged to calculate the amount of change corresponding to the amount of delay from the current ray position, and the predicted ray position information determined by adding the amount of change to the current ray position is used as the moving image. a pre photometric line position receiving step of receiving from the receiving display device,
In the moving image receiving display device, an error prediction ray position information indicating an error range centered on the position of the predicted ray position information determined from the statistical error of the amount of change of said plurality of ray position, the moving image reception display An error predicted ray position receiving step for receiving from the apparatus ;
A beam position moving picture searching step of searching the moving image data corresponding to the beam position in the range specified by the error prediction ray position information about said predicted light beam position information,
A moving image data transmitting step of transmitting a plurality of moving image data searched in the light beam position moving image searching step and light beam position information to the moving image receiving display device;
A moving image transmission method characterized in that The moving image transmission method according to claim 10 or 11,
The moving image transmitting device further includes:
A current ray position receiving step for receiving current ray position information;
A stationary position moving image data transmission step for transmitting the moving image data corresponding to the current light beam position information and the light beam position information;
A moving image transmission method characterized in that A moving image receiving and displaying device for receiving camera position information and moving image data indicating the position and direction of a camera transmitted by a moving image transmitting device and displaying an image,
An image display unit for displaying an image;
A delay setting unit for setting a delay amount of a round-trip propagation delay for transmission to and from the moving image transmission device;
Using the camera position information of the image displayed in the past, the camera position information of the currently displayed image, and the delay amount set by the delay setting unit, the movement amounts of the plurality of camera positions from the past to the present can be calculated. A predicted camera position determination unit that calculates predicted camera position information by calculating a moving amount according to the delay amount from the current camera position on average and adding the moving amount to the current camera position ;
A predicted camera position transmission section that sends the predicted camera position information to the moving picture transmission apparatus,
A moving image receiving and displaying apparatus comprising: A moving image receiving display device for receiving camera position information and moving image data indicating a camera position and direction from a moving image transmitting device and displaying an image,
An image display unit for displaying an image;
A delay setting unit for setting a delay amount of a round-trip propagation delay for transmission to and from the moving image transmission device;
Using the camera position information of the image displayed in the past, the camera position information of the currently displayed image, and the delay amount set by the delay setting unit, the movement amounts of the plurality of camera positions from the past to the present can be calculated. On average, a movement amount corresponding to the delay amount from the current camera position is calculated, and the predicted camera position information is determined by adding the movement amount to the current camera position, and the movement of the plurality of camera positions is also performed. A predicted camera position determining unit that determines error predicted camera position information indicating an error range centered on the position of the predicted camera position information from a statistical error in quantity ;
A predicted camera position transmission section that sends the predicted camera position information to the moving picture transmission apparatus,
An error prediction camera position transmission unit for transmitting the error prediction camera position information to the moving image transmission device;
A moving image receiving and displaying apparatus comprising: 15. The moving image receiving display device according to claim 13 or 14,
A current camera position transmitting unit for transmitting current camera position information indicating the position and direction of the camera of the currently displayed image to the moving image transmitting apparatus;
A moving image receiving and displaying apparatus comprising: A moving image transmitting apparatus for transmitting camera position information and moving image data indicating the position and direction of a camera to a moving image receiving display apparatus,
In the moving image reception display device, a plurality of camera positions from the past to the present using the camera position information of the image displayed in the past, the camera position information of the currently displayed image, and the set delay amount. The movement amount according to the delay amount from the current camera position is calculated by averaging the movement amounts of the current camera position, and the predicted camera position information determined by adding the movement amount to the current camera position is used as the moving image. a predicted camera position receiving unit for receiving from the receiving display device,
A camera position moving picture searching unit for searching for a moving image data of the predicted camera position information,
A moving image data transmitting unit that transmits the moving image data and camera position information searched by the camera position moving image search unit to the moving image reception display device;
A moving image transmitting apparatus comprising: A moving image transmitting apparatus for transmitting camera position information and moving image data indicating the position and direction of a camera to a moving image receiving display apparatus,
In the moving image reception display device, a plurality of camera positions from the past to the present using the camera position information of the image displayed in the past, the camera position information of the currently displayed image, and the set delay amount. The movement amount according to the delay amount from the current camera position is calculated by averaging the movement amounts of the current camera position, and the predicted camera position information determined by adding the movement amount to the current camera position is used as the moving image. a predicted camera position receiving unit for receiving from the receiving display device,
In the moving image receiving and displaying apparatus, the error receiving camera position information indicating an error range centered on the position of the predicted camera position information determined from the statistical error of the movement amounts of the plurality of camera positions is displayed on the moving image receiving and displaying screen. An error prediction camera position receiving unit received from the apparatus ;
A camera position moving picture searching unit for searching for a moving image data corresponding to the camera position in the range specified by the error predicted camera position information about said predicted camera position information,
A moving image data transmitting unit that transmits a plurality of moving image data and camera position information searched by the camera position moving image search unit to the moving image reception display device;
A moving image transmitting apparatus comprising: The moving image transmitting apparatus according to claim 16 or 17,
A current camera position receiving unit for receiving current camera position information indicating the position and direction of the camera of the image currently displayed on the moving image receiving display device ;
The moving image data and the camera position information corresponding to the current camera position information, and a rest position moving image data transmission unit to be transmitted to the moving image receiving display device,
A moving image transmitting apparatus comprising: A moving image receiving and displaying device for receiving light beam position information and moving image data from a moving image transmitting device and displaying an image,
An image display unit for displaying an image;
A delay setting unit for setting a delay amount of a round-trip propagation delay for transmission to and from the moving image transmission device;
Using the ray position information of the image displayed in the past, the ray position information of the currently displayed image, and the delay amount set by the delay setting unit, the amount of change in a plurality of ray positions from the past to the present can be calculated. A predicted ray position determination unit that calculates an amount of change according to the amount of delay from the current ray position on average, and adds the change amount to the current ray position to determine predicted ray position information;
A pre photometric line position transmission section that sends the predicted light beam position information to said moving picture transmission device,
A moving image receiving and displaying apparatus comprising: A moving image receiving and displaying device for receiving light beam position information and moving image data from a moving image transmitting device and displaying an image,
An image display unit for displaying an image;
A delay setting unit for setting a delay amount of a round-trip propagation delay for transmission to and from the moving image transmission device;
Using the ray position information of the image displayed in the past, the ray position information of the currently displayed image, and the delay amount set by the delay setting unit, the amount of change in a plurality of ray positions from the past to the present can be calculated. On the average, a change amount according to the delay amount from the current ray position is calculated, and predicted ray position information is determined by adding the change amount to the current ray position, and changes in the plurality of ray positions A predicted light beam position determining unit that determines error predicted light beam position information indicating an error range centered on the position of the predicted light beam position information from a statistical error in quantity ;
A pre photometric line position transmission section that sends the predicted light beam position information to said moving picture transmission device,
An error prediction ray position transmitter for transmitting the error prediction ray position information to the moving picture transmission apparatus,
A moving image receiving and displaying apparatus comprising: A moving image receiving and displaying apparatus according to claim 19 or 20,
A current beam position transmitting unit for transmitting current beam position information indicating the beam position of the currently displayed image to the moving image transmitting device;
A moving image receiving and displaying apparatus comprising: A moving image transmitting device for transmitting light beam position information and moving image data to a moving image receiving display device,
In the moving image receiving and displaying apparatus, a plurality of light beam positions from the past to the present using the light beam position information of the image displayed in the past, the light beam position information of the currently displayed image, and the set delay amount. The amount of change is averaged to calculate the amount of change corresponding to the amount of delay from the current ray position, and the predicted ray position information determined by adding the amount of change to the current ray position is used as the moving image. a pre photometric line position receiving section for receiving from the receiving display device,
A beam position moving picture searching unit for searching for a moving image data of the predicted light beam position information,
A moving image data transmitting unit for transmitting the moving image data and the light beam position information searched by the light beam position moving image searching unit to the moving image receiving display device;
A moving image transmitting apparatus comprising: A moving image transmitting device for transmitting light beam position information and moving image data to a moving image receiving display device,
In the moving image receiving and displaying apparatus, a plurality of light beam positions from the past to the present using the light beam position information of the image displayed in the past, the light beam position information of the currently displayed image, and the set delay amount. The amount of change is averaged to calculate the amount of change corresponding to the amount of delay from the current ray position, and the predicted ray position information determined by adding the amount of change to the current ray position is used as the moving image. a pre photometric line position receiving section for receiving from the receiving display device,
In the moving image receiving display device, an error prediction ray position information indicating an error range centered on the position of the predicted ray position information determined from the statistical error of the amount of change of said plurality of ray position, the moving image reception display An error-predicted ray position receiving unit received from the apparatus ;
A beam position moving picture searching unit for searching for a moving image data corresponding to the beam position in the range specified by the error prediction ray position information about said predicted light beam position information,
A moving image data transmitting unit for transmitting a plurality of moving image data and light beam position information searched by the light beam position moving image search unit to the moving image receiving display device;
A moving image transmitting apparatus comprising: 24. The moving image transmitting apparatus according to claim 22 or 23, wherein:
A current beam position receiver for receiving the current beam position information;
A still position moving image data transmitting unit for transmitting moving image data and light beam position information corresponding to the current light beam position information to the moving image receiving display device;
A moving image transmitting apparatus comprising:   A moving image reception display for causing a computer included in the moving image reception display device to execute the moving image reception display method according to claim 1, claim 2, claim 3, claim 7, claim 8 or claim 9. program.   A moving image transmission program for causing a computer included in the moving image transmission apparatus to execute the moving image transmission method according to claim 4, claim 5, claim 6, claim 10, claim 11, or claim 12.   A program for causing a computer provided in a moving image reception display device to execute the moving image reception display method according to claim 1, claim 2, claim 3, claim 7, claim 8 or claim 9 A moving image reception display program recording medium recorded on a readable recording medium.   A computer-readable program for causing a computer included in the moving image transmitting apparatus to execute the moving image transmitting method according to claim 4, claim 5, claim 6, claim 10, 11 or claim 12 A moving image transmission program recording medium recorded on a non-transitory recording medium.

Images