JP4414708B2 - Movie display personal computer, data display system, movie display method, movie display program, and recording medium - Google Patents

Description

  The present invention can display a moving image or continuous still image obtained by photographing a wide angle of one or a plurality of subjects together with additional information, or can be distributed and displayed when requested, and can be displayed as desired. The present invention relates to the field of data display technology that can easily change the form or display position, or can easily search and display a moving image at a desired position among all moving images and all continuous still images. Specifically, it is possible to efficiently and easily perform the display operation, the display form changing operation, and the search operation by presenting an easy-to-understand image display and a display interface for operation to the user. The present invention relates to a moving image display personal computer, a data display system, a moving image display method, a moving image display program, and a recording medium.

  Conventionally, for example, first, there is a moving image display area for displaying a moving image on the right side of the display, and a triangular mark button for starting reproduction of a moving image as a display interface for operation below the moving image display area, and A square button for stopping is provided, and there is a so-called mark display area on the left side of the display. The mark display area displays the recording time (or relative time after the start of recording) on the left side, and when recording a video on the right side. The recorded horizontal line is displayed corresponding to each recording time, the contents of the key data are displayed on each horizontal line, and a thick horizontal line is displayed at the position corresponding to the current time when the moving image is played back. A recording / playback apparatus is known in which when a data area is clicked, video display is temporarily interrupted, jumping to a corresponding time, and playing back a moving image at that time (see, for example, Patent Document 1). .).

  In the recording / reproducing apparatus, an audio level graph is displayed corresponding to a sound source direction corresponding to a certain coordinate value in the horizontal direction determined by the left and right microphones in the image display area, and a time to be marked by clicking is determined, In addition, it is easy to identify individuals by recording key data. This makes it possible to mark and specify the target time while observing when and who speaks. If an arbitrary position is clicked, a dialog is displayed and a name can be written, and an area corresponding to an angle in a range specified in the image display area (one subject is selected). A configuration is provided in which a name of the name can be displayed on a box surrounded by a square.

  For example, secondly, an output video signal of a video camera having a wide-angle lens is written into a memory via a video capture device, the position and size of a range to be cut out from the memory are designated by a mouse, and the designated clipping is performed. The image data in the range is read from the memory, the pixel density is converted to fit the size of the video display area, and displayed in the video display window of the display. As a result, there is known a video processing apparatus that allows a single camera device to obtain an image in which the direction and zoom are instantaneously switched (see, for example, Patent Document 2).

  In the video processing apparatus, a video display window for displaying a part of the captured video on the display is set, an operation panel is set in a region on the right side of the video processing apparatus, and the video display window of the captured image is displayed on the operation panel. A position designation panel for designating a portion to be displayed and a magnification designation panel for designating the magnification of an image to be displayed in the video display window are provided. As another example, a camera window for displaying an image cut out from the cutout range is set at four positions on the display, and an operation panel similar to the above is provided on the right side of each camera window. A configuration is also disclosed.

  Also, for example, thirdly, a wide range of real-time video of a video camera equipped with a wide-angle lens is temporarily stored in a frame memory, and when there is a distribution request from a plurality of terminals, a predetermined partial area video or entire area of the frame memory Distribute video simultaneously, and on the other hand, when a distribution request for a region video of interest to a user is received from a plurality of terminals, the partial region is generated from the frame memory and generated in the same manner as the camera frame. . As a result, a video distribution method is known in which the same camera video can be controlled simultaneously from a plurality of terminals, and a variable area that can be viewed from different viewpoints for each user can be obtained (see, for example, Patent Document 3). .)

  In the video distribution method capable of obtaining the variable area, the interface for operating the partial area video distributed by the user is used for moving the display space in eight directions below the window for outputting the video in the display. A button, an entire display button, an enlargement button, a reduction button, a distribution start button, and a distribution end button are set.

Japanese Patent Application Laid-Open No. 2002-247489 JP-A-8-237590 JP-A-9-261522

  However, in the first conventional example, a so-called mark display area or a so-called mark display area is provided so that particularly important parts of audio and moving images that cannot be glanced because they change with time can be extracted accurately and easily. Although it is described that an audio level graph is set and displayed, in particular, regarding the display of a moving image, it is simply displayed within a preset moving image display area, and a plurality of images are displayed within the moving image display area. There is no provision for changing the display position of the subject to a desired position, and therefore, there is a drawback that the display of the subject is likely to be fixed and minor.

  In the second conventional example, images cut out from one captured image are displayed at four positions distant from each other on the display so that a single camera device can instantaneously switch the direction and zoom. Although it is disclosed that four camera windows are set, once a photographed image is defined by a tilt command, a pan command, and a zoom command, a cutout range is cut out, divided into four camera windows, and an image is displayed. In order to replace the display contents of the window, it is necessary to re-set the initial cutout range or use a technique such as drag and drop, which is very troublesome in terms of operation. .

  In the third conventional example, a partial area obtained by cutting out a partial area from a frame memory and generating the same as a camera frame in order to obtain a variable area that can be viewed from different viewpoints for each user by simultaneously controlling the same camera video from a plurality of terminals. Although the video is distributed, the video output window of the user side display can change the display position by, for example, enlarging one camera video and operating the button for movement. In particular, it is difficult to display a plurality of images in the video output window. For this reason, it is impossible to change the display position of the plurality of images in the video output window by easily changing the display position. There is a drawback.

  On the other hand, the present applicant presented a plurality of subjects with a plurality of display forms of moving image data obtained by photographing a wide range of scenes, and conducted a test for evaluating which is most preferable. As a result, An image showing the entire scene is more easily transmitted than a partial image. 2. Furthermore, we obtained an evaluation result that it was easier to understand when additional information such as the position of the speaker and the main subject that added explanation to the image of the entire scene was displayed at the same time. Considering this evaluation result, the first to third conventional examples are all configured to display a so-called designated partial video area, so that the display is always easy to understand and highly convenient for the user. It can be said that it is not a form.

  When displaying a wide range of images, for example, taking an example of a meeting taken with a camera having an imaging range of 360 degrees (omnidirectional camera), for example, the meeting organizer A participates in the other. When the communication items are transmitted to the persons B, C, D, etc., the image output at this time may cause the organizer A to be positioned at a halfway position depending on the installation direction of the omnidirectional camera. is there. In order to prevent this, it is necessary to install the camera so that the orientation of the omnidirectional camera is appropriate while paying attention to the location of each participant, which is troublesome and impairs convenience until it gets used to this point. Further, when the omnidirectional camera is fixed, it is required to predetermine the sitting position of the organizer so that the composition of the image is appropriate. This is also not preferable from the viewpoint of convenience.

  The present invention displays or displays a temporally changing image in a desired composition while assisting the user's understanding without forcing the user (viewer) to perform complicated work or consideration during or after scene shooting or recording. It is possible to change, and the first purpose is to provide a data display that is realistic, very easy to understand, easy to see, and excellent in convenience, and when changing the display of an image during shooting or after recording, To further improve the viewpoint of realizing extremely simple operability and making the additional information related to each subject for assisting image understanding extremely easy to understand, easy to see and easy to use without losing the correspondence with each subject. The second purpose is that the user can intuitively understand temporal changes in the display content and audio content of an image that has already been viewed or unviewed, during shooting or after recording. A third object to the dynamic image display for a personal computer, the data display system, video display method that makes it possible to, there is provided a moving picture display program, and a recording medium.

In order to solve the above-described problems and achieve the object, the personal computer for moving image display according to the present invention converts omnidirectional image data obtained by shooting a subject in a direction around 360 degrees into a panoramic image, and converts the panoramic image into an image. First display means for displaying in the image display area of the display means, second display means for displaying a position designation area for changing the display position of the panoramic image, and display of the panorama image on the position designation area When the designation means for designating position change and detecting that the position in the position designation area is designated by the designation means, the panorama image at the designated position is moved to one end of the image display area to move the moving image a display changing means for changing the display of the display area, wherein the display changing means, when the position is designated by said designating means, which is the designated location The subsequent image data is read out as the head, and the image data from the head position in the image display area to the designated position is read out, and the panorama image at the position relative to the position in the image display area is read as the head position. As a panorama image and a panorama image between the head position in the image display area and a destination of the image display area. It is characterized by linking to .

  The position designation area is displayed adjacent to an image display area displayed by the first display means.

  Further, when the position is designated by the designation means, a direction in a required space outside the subject is designated in the image display area.

  Further, when the position is designated by the designation means, the display change means moves the panoramic image at the position in the image display area to one end of the image display area together with a subsequent panoramic image as a head position, A panoramic image that protrudes from the one end with the movement of the head position is linked to the tail end of the subsequent panoramic image.

  Further, the omnidirectional image data includes at least one subject, and the moving image display personal computer further includes third display means for displaying additional information related to the subject in the additional information display area of the image display means. The third display means displays the additional information display area adjacent to the image display area, and subjects the additional information display area to a position for each subject in the image display area. The additional information related to each is displayed.

  In addition, the third display means displays a sound source position display mark for directing the subject who is a speaker corresponding to the sound source direction data as the additional information display area with respect to the image display area. The display area is adjacent to each other.

  Further, the second display means displays a participant ID or a participant name as additional information related to the subject in the vicinity of each subject displayed as an image in the image display area.

  In addition, a time chart in which the time of sound generation for each subject, the elapsed time after the start of the event, and the sound generation duration time are recorded is displayed in the vicinity of the image display area.

In addition, when the panorama image of the subject is moved with the position designated by the designation unit, the display changing unit is adapted to generate a sound when the subject is sounded in the time chart in accordance with the movement of each subject of the panoramic image. The recorded content of the elapsed time from the start of the event, the elapsed time after the start of the event, and the duration of sound generation is moved.

  Further, the display changing means outputs image data, audio data, and additional information from the position when the recording content at the required position in the time chart is designated.

  In addition, an operation interface including a playback button, a stop button, a pause button, a rewind button, a fast-forward button, and the like is displayed near the image display area.

  The moving image display personal computer further includes storage means for storing the omnidirectional image data.

  The storage means further stores additional information related to the subject.

  The moving image display personal computer is connected to a video server via a network, and the omnidirectional image data is acquired from the video server.

  Further, the additional information is acquired from the video server.

  The data display system according to the present invention is a data display system including any one of the above-described personal computers for displaying moving images and a video server connected via a network, wherein the video server includes at least one video server. The image data acquisition unit that acquires the omnidirectional image data including the subject, the additional information acquisition unit that acquires additional information related to the subject, and the acoustic that collects voice, sound, or musical sound of the subject. Collecting means; storage means for storing the image data, the additional information, audio data, sound data, or musical sound data; and distribution means for live distribution of the image data, the additional information, the audio data, and the like, The moving image display personal computer further includes the image data distributed by the video server, Serial additional information, the audio data, characterized by comprising the sound data or receiving means for receiving the musical tone data.

  The data display system according to the present invention is a data display system including any one of the above-described personal computers for displaying moving images and a video server connected via a network, wherein the video server includes at least one video server. The image data acquisition unit that acquires the omnidirectional image data including the subject, the additional information acquisition unit that acquires additional information related to the subject, and the acoustic that collects voice, sound, or musical sound of the subject. A collecting means; a storage means for storing the image data, the additional information, audio data, sound data, or musical sound data; and the moving picture display personal computer further includes the image data and the additional information distributed by the video server. Receiving the voice data, the sound data, or the musical sound data And transmitting means for transmitting a moving image distribution request to the video server, and the video data further receives the moving image distribution request from the moving image display personal computer, the image data, the additional information, And a distribution unit that reads out the audio data from the storage unit and distributes the data via the network.

The moving image display method of the present invention is a moving image display method for displaying a moving image on a personal computer for moving image display. The moving image display method converts omnidirectional image data obtained by shooting a subject in a direction around 360 degrees into a panoramic image. A first display step of displaying an image in an image display area of the image display means; a second display step of displaying a position designation area for changing the display position of the panorama image; and the panorama on the position designation area When the designation step for designating the change of the display position of the image and detecting that the position in the position designation area is designated by the designation means, the panorama image at the designated position is moved to one end of the image display area. the includes a display change step of changing the display of the moving image display area, wherein the display changing step, when the position is designated by said designation step Te, the designation The subsequent image data is read starting from the specified position, and the image data from the start position in the image display area to the designated position is read, and the panorama of the position relative to the position in the image display area The image is moved to one end of the image display area together with the subsequent panorama image with the image as the head position, and the panorama image between the head position in the image display area and the destination of the image display area is moved to the subsequent image. It is characterized by linking to the end of the data .

  A moving image display program according to the present invention causes a computer to execute the method described above.

  The recording medium of the present invention is characterized by recording the program described above.

  According to the present invention, it is possible to display a temporally changing image with a desired composition during shooting or after recording without forcing the user to perform complicated work or consideration during scene shooting, and during shooting or recording. Later, the image and its additional information are displayed with their corresponding relationship clearly displayed, the display form or display position can be changed while maintaining the corresponding relationship, and the user's understanding is intuitive including the time chart display. It is possible to assist, and it is very easy to understand, easy to handle and excellent in convenience.

  In other words, according to the present invention, the image data acquisition unit is configured to shoot a plurality of subjects in directions around 360 degrees, convert them into panoramic images (or panoramic images), and display the images. In addition, the entire 360-degree scene is displayed as a wide range of images, making it easy to convey a sense of realism, and providing a predetermined additional information display area adjacent to or close to the panoramic image (or panoramic image). For example, since a speaker position display mark (speaker display mark) indicated by a triangle is displayed in correspondence with the position of the participant who is the speaker, so-called explanations such as the position of the speaker and the position of the main subject are displayed on the entire scene image. A panoramic image (or panoramic image) is more easily understood and very easy to see and attracts, and a panoramic image (or panoramic image) is added. When a position designation area is provided adjacent to or close to the (ma- matic image) and a desired position is designated by, for example, designation means, the entire image is moved so as to be scrolled with the desired position (designated position) of the image as the head position. Therefore, it is possible to change to a favorite image by an extremely simple operation, and there is an effect that the operability is very good, the handling is easy, and the convenience is excellent.

  Further, according to the present invention, since the operation interface such as the position designation area is displayed, the user can compose the scene being photographed without performing adjustments such as changing the orientation of the image data acquisition means during photographing. Can be easily changed, and a composition that is always optimally balanced and very easy to see is set. As a result, it is possible to intuitively know who is speaking at a glance. This means that, for example, once the camera unit, which is a component of the image data acquisition means, is once placed at a certain position, for example, a certain position on a table such as an event venue, it is necessary to adjust the settings on the camera unit side. This means that nobody can use it at the event venue side without requiring advanced technology, and from this point of view, it is very easy to handle and has the advantage of excellent convenience.

(Embodiment 1)
The data display system according to Embodiment 1 of the present invention will be described below with reference to FIGS. FIG. 1 is an explanatory diagram schematically illustrating a data display system 10 according to the present embodiment. In FIG. 1, reference numeral 12 denotes a video server, and reference numeral 14 denotes a moving image display PC (Personal Computer), which are connected to each other through a network (or a LAN cable) 16. However, the video server 12 and the moving image display PC 14 do not need to be in the same place, and can be installed in any remote place as long as they are physically connected through the network 16.

  As shown in FIG. 2, the video server 12 is an EPROM (storage means: Erasable Programmable Read-only Memory) capable of recording, for example, an image conversion program, a speaker detection program, a moving image distribution program, a moving image display program, etc., which will be described later in detail. 22, a RAM (storage means: Random Access Memory) 24 capable of storing, for example, a participant ID, a participant name, a sound source position display mark (hereinafter referred to as a speaker position display mark 23), and the like as additional information described later, and a VRAM (Storage means: Video Random Access Memory) 26 and image data (moving picture data or continuous still picture data) taken by a camera (image data acquisition means) 28 are converted into a horizontally long rectangular shape using arithmetic processing described later in detail. Video for storing images (hereinafter referred to as panoramic images) in the VRAM 26 or HDD (storage means: Hard Disk Drive) 30 With a Yapucha 32. Also, voice data, sound data, or sound data generated by collecting sounds and sounds produced by a speaker (participant) whose microphone array (sound collecting means) 34 is a subject and musical sounds emitted by a speaker or a surrounding sound source, or the like Musical sound data can also be recorded in the HDD 30.

  In addition, an address control unit 38 that controls addresses of RAM 24, VRAM 26, and HDD 30, additional information, image data, audio data, and the like, a display 40 as an image display unit that displays panoramic images, additional information, and the like, and a keyboard 42, a sound reproducing unit (sound output means) 44 for reproducing and outputting sound data, sound data, or musical sound data collected and generated by the microphone array 34, and a speaker 46 constituting a part thereof, image data, sound data A transmission / reception unit (distribution means) 48 that performs transmission / reception via the network 16, a communication interface (for example, IEEE 1394) 50, and a CPU (Central Processing Unit) 52 that controls the whole.

  As shown in FIG. 3, the camera 28 is a so-called video camera (omnidirectional camera) placed in a state where the condenser lens 58 is directed vertically upward at a center position on a flat pedestal 56. Specifically, it has a cylindrical configuration and includes an image sensor (not shown) inside. On the outer peripheral side of the front surface facing the upper side of the camera 28 or the side surface forming a cylindrical shape, the front side including the condenser lens 58 of the camera 28 is surrounded in a cylindrical shape. A transparent envelope 60 that is colorless and has good light transmission is disposed. A hyperboloid mirror 62 is mounted on the upper front end side of the transparent enclosure 60 so as to project a hyperboloid as a whole from the front end side in the direction of the condenser lens 58 (ie, downward).

  A camera unit 64 is configured by the camera 28, the transparent enclosure 60, and the hyperboloid mirror 62. The distance between the condensing lens 58 and the hyperboloidal mirror 62 is that a subject (not shown) that exists in the direction of 360 degrees around the hyperboloidal mirror 62 substantially horizontally outward is photographed as an optimal subject. It is preferable that the distance is set as possible. In this relationship, the hyperboloidal mirror 62 may be adjusted so that it can move up and down so that an object of an optimal size can be photographed.

  The camera 28 can shoot a subject existing in a direction around 360 degrees (that is, omnidirectional) approximately horizontally outward by capturing an image reflected on the hyperboloidal mirror 62. The omnidirectional image captured by the camera 28 is a donut shaped image (hereinafter referred to as a donut image) as shown in FIG. The donut image is converted into a panoramic image by a calculation described in detail later.

  As shown in FIG. 3, the microphone array 34 includes four microphones 66 installed at, for example, four positions around the camera unit 64 on the flat base 56. Thus, by using a plurality of microphones 66, even when there are a plurality of participants who are subjects around 360 degrees, it is possible to detect the direction of the participant who is a so-called speaker who speaks. That is, the direction of the speaker can be detected by detecting the time difference between the sounds input to the plurality of microphones 66.

  As shown in FIG. 5, the moving image display PC 14 is acquired from the video server 12 via the EPROM (storage means: Erasable Programmable Read-only Memory) 72 capable of recording a moving image display program, which will be described in detail later, and the network 16. As additional information described later, for example, a RAM (storage means: Random Access Memory) 74 and a VRAM (storage means: Video Random Access Memory) 76 capable of storing a participant ID, a participant name, a speaker position display mark 23, and the like. In addition to storing the image data acquired from the video server 12 via the network 16 and changing with time in the VRAM 76, the video capture 80 is also stored in an HDD (storage means: Hard Disk Drive) 78 by a required operation. Have. Also, audio data, sound data, or musical sound data acquired from the video server 12 via the network 16 can be recorded in the HDD 78.

  The RAM 74, the VRAM 76, and the HDD 78 have an address control unit 84 for controlling addresses of image data, audio data, additional information, a display 86 as an image display means for displaying panoramic images and additional information, and a keyboard 88. In addition, a mouse (designating means) 92 for giving an operation input to a position designation area 90 as a display interface for operation described later in detail displayed on the display 86, and audio data acquired from the video server 12 via the network 16 , And a sound reproducing unit (sound output means) 94 for reproducing sound data or musical sound data and a speaker 96 constituting a part thereof, and necessary data including image data, sound data and the like are transmitted / received via the network 16. Transmission / reception unit (reception means, image data acquisition means, sound collection means, additional information And acquisition means) 98, a communication interface (e.g., IEEE1394 or the like) 100, and a CPU (Central Processing Unit) 102 that controls the entire.

  Note that the VRAM 76, the video capture 80, the display 86, the mouse 92, the moving image display program, the CPU 102 that executes the moving image display program, etc. Display means, designation means, display change means, and sound source direction identification means. Specifically, the first display means, the second display means, the third display means, the designation means, the display change means, etc. are executed by executing predetermined steps among the steps constituting the moving image display program. It is configured functionally.

  As shown in FIG. 6, for example, the moving image display PC 14 transmits a moving image distribution request to the video server 12 based on the moving image display program as shown in FIG. When the video server 12 receives the video distribution request, the video server 12 takes in the image data from the camera 28, the voice data from the microphone array 34, and the like based on the video distribution program, and executes the speaker detection program from the microphone array 34. The speaker direction data (sound source direction data) indicating the direction of the speaker is generated based on the voice data, and the speaker direction data is also captured, and the image data, the voice data, and the speaker direction based on the video distribution program Data and the like are distributed to the moving image display PC 14. Thus, the moving image display PC 14 generates a panoramic image 114 (see FIG. 7) including the participant who is the subject on the display 86 based on the moving image display program, displays the image, and outputs the speaker's voice from the speaker 96. That's it.

  On the other hand, the time-varying image data acquired from the video server 12 forms a donut image that can change with time as shown in FIG. 4 because the camera unit 64 captures a direction around 360 degrees. However, by executing the moving image display program, as shown in FIG. 7, this donut image is converted into a so-called horizontally long rectangular image, that is, a panoramic image 114. When converted to the panoramic image 114, participants as a plurality of subjects existing around the camera unit 64 so as to surround the camera unit 64 are displayed in a horizontal row. As a result, a number of evaluations are performed when a plurality of test forms are presented in which a plurality of display forms of moving image data obtained by photographing a wide range of scenes are presented to a plurality of subjects and which is most preferable is evaluated. The image showing the whole scene is more satisfying than the partial image, and the evaluation result that the sense of reality is more easily transmitted is satisfied.

  As shown in FIG. 8, the panoramic image 114 is displayed in a predetermined moving image display area 112 of the display 86 in the moving image display PC 14 when the first display unit is activated. When the second display means is activated, a predetermined additional information display area (sound source position display area) 116 is displayed adjacently. In this additional information display area 116, a participant who is a speaker among the subjects is displayed. As additional information to be displayed, for example, a speaker position display mark 23 with a triangle mark corresponds to the position of the speaker and is displayed by pointing to the speaker. This speaker position display mark 23 shows many evaluations when a plurality of subjects are presented with a plurality of display forms of moving image data obtained by photographing a wide range of scenes, and a test for evaluating which is most preferable is performed. 2 above. The evaluation result that the additional information that adds explanation to the image of the entire scene, such as the position of the speaker and the main subject, is displayed at the same time is easier to understand.

  As shown in FIG. 8, for example, a position designation area 90 is displayed adjacent to the upper boundary of the panoramic image 114 when the third display unit is activated. For example, as shown in FIG. 9A, when the head position E when the image is moved with the mouse 92 is designated and clicked in the position designation area 90, for example, in the panoramic image 114, as shown in FIG. The position indicated by the dotted line corresponding to the head position E is the head position, and an image that continues from the head position to the right side of the figure (that is, an image including the participants A and B) has a head position in the panoramic image 114. The image is moved until it coincides with the position of one end on the left side in the drawing, and an image located on the left side in the drawing from the tip position, that is, an image including the participants C and D, is linked to the end of the image including the moving participants A and B. Thus, the display position of the image data is changed so as to be scrolled.

  When the display position of the image data is changed, the speaker position display mark is placed at a position corresponding to the participant who is the speaker in the additional information display area 116 upon activation of the second display means. 23 also moves.

  However, when changing the display position of the image data of the panoramic image 114, if the head position E is designated and clicked with the mouse 92 in the position designation area 90 and then clicked, the destination position is designated with the mouse 92 and clicked. The image data following the position may be moved to the movement destination position by the second click. In this case, the image data can be moved so as to scroll in the right direction in the figure.

  When the field 120 displaying the Video Viewer is designated with the mouse 92 and dragging and dropping or the like is performed above the moving image display area 112, the entire moving image display area 112 can be moved to a required position. .

  Next, referring to the method described in the literature (AMBruckstein and TJRichardson: “Omniview Cameras with Curved Surface Mirrors”, Proc. Of the IEEE Workshop on Omnidirectional Vision 2000, pp. 79-84), An example of a method for converting to a panoramic image will be described. FIG. 10A is an explanatory diagram for explaining the principle of image conversion in the camera 28 using the hyperboloid mirror 62. As shown in FIG. 10A, the moving image display program coordinate-converts the donut image into a panoramic image projected on a curved surface having the horizontal axis as the azimuth and the vertical axis as the elevation angle. 10-2 is an explanatory diagram for explaining the geometric relationship of the camera 28 shown in FIG. 4, and the optical system of the camera 28 in FIG. 10-2 is a central projection model. Here, the meaning of each variable in FIGS. 10A and 10B is as follows.

(u, v): Coordinates in the donut image
(u ₀ , v ₀ ): coordinates of the center of the hyperboloidal mirror 62 in the donut image
(X, Y): Coordinates in panorama image 114
r: Distance in pixels from (u ₀ , v ₀ ) to (u, v)
r _max : Radius of the hyperboloidal mirror 62 in the donut image in pixel units θ: Azimuth angle (°)
φ: Elevation angle (°)
ψ: vertical angle from the optical axis of the camera 28 (°)
F: Focus of hyperboloid mirror 62
F ′: The focal point of the hyperboloid paired with the hyperboloidal mirror 62 coincides with the optical center of the camera 28.
At this time, the following relationship is established between the apex angle ψ and the elevation angle φ.

here,

It is. Φ _max is the value of the elevation angle φ corresponding to the position of the radius r _max on the donut image, and this represents the upper photographing allowable limit value of the camera 28 in the elevation angle direction. The values of r _max and φ _max are generally easily known.

  Here, a procedure for converting a donut image into a panoramic image 114 using the above relational expression will be described. When the panoramic image 114 is delivered at a time from shooting, the processing cost of the conversion process becomes a problem. Therefore, as shown in FIG. 11, it is preferable to create a coordinate conversion table based on the above procedure in advance. . In the coordinate conversion table of FIG. 11, the coordinates (u, v) of the donut image corresponding to the respective coordinates (X, Y) of the panoramic image 114 with θ = 0 ° as a reference are stored.

Hereinafter, a method for creating a coordinate conversion table will be described.
1. An azimuth angle θ and an elevation angle φ corresponding to the point (X, Y) are obtained by the following equations.

Here, X _max and Y _max represent the number of pixels in the horizontal direction and the vertical direction of the panorama 114 image, respectively, and this corresponds to the size of the moving image display area. Further, φ _min represents the lower photographing allowable limit value of the camera 28 in the elevation angle direction. In the coordinate conversion table shown in FIG. 11, the reason why θ is positive to the left is that the hyperboloidal mirror 62 is attached on the upper side in the camera 28 of FIG. 3, and the image needs to be reversed left and right.
2. The vertex angle ψ corresponding to the elevation angle φ is calculated using the equation (1).
3. A radius r corresponding to the apex angle ψ is obtained by the following equation.

here,

Ψ _max is the value of the apex angle ψ corresponding to the position of the radius r _max on the donut image. The value of ψ _max can be obtained by substituting φ _max into equation (1).
4). The coordinates (u, v) on the donut image corresponding to (r, θ) obtained above are obtained by the following equation.

5). Since (u, v) obtained by equation (7) is generally not an integer, the address used to refer to the nearest coordinates (u, v) (both u and v are integers) in the donut image is coordinate-transformed. Write to the table. 1 above. To 5. Operation, all of the (X, Y) by performing the _{(0 <X <X max,} 0 <Y <Y max), it is possible to create a coordinate conversion table.

  Next, a speaker detection program on the video server 12 side will be described with reference to FIG. First, after an activation command is recognized in step 1201, voice data is acquired from each microphone 66 of the microphone array 34 in step 1202. Subsequently, in step 1203 (sound source direction detection means), the speaker direction is detected from the time difference between the sounds input to the microphones 66, and the speaker direction data is generated and stored in the RAM 24, for example. Thereafter, in step 1204, it is determined whether or not to end this flow (step 1204: Yes). If not (step 1204: No), the process returns to step 1202. However, when detecting the speaker direction, for example, it is set to detect at the timing of every second.

  Next, the moving picture distribution program on the video server 12 side will be described with reference to FIG. First, when a moving image distribution request is received via the network 16 in step 1301, for example, by detecting whether or not there is data indicating that there is a moving image display program together with the moving image distribution request in step 1302, the current moving image distribution request is determined. It is determined whether or not there is a moving image display program in the transmitted moving image display PC 14, and the process proceeds to step 1304.

  However, in step 1302, whether or not the moving picture display PC 14 has a moving picture display program is actively determined by referring to data stored in a required memory (for example, the RAM 24 or a predetermined table) on the video server 12 side. You may make it determine to. Thus, when it is determined in step 1302 that the moving image display PC 14 does not have a moving image display program (step 1302: No), the moving image display program stored in, for example, the EPROM 22 is transmitted via the network 16 in step 1303. Download to the moving image display PC 14 and proceed to Step 1304.

  In step 1304, it is recognized that the current video distribution request is a request for live distribution, and in step 1305, current video data is acquired from the camera 28 and encoded (for example, including compression, the same applies hereinafter), for example, MMS. (Microsoft Media Server) The protocol is transmitted to the moving picture display PC 14 via the network 16 by the protocol, and the current audio data and the like are acquired and encoded from the microphone array 34 in step 1306, and the moving picture is displayed via the network 16 by the MMS protocol, for example. The additional information (including the participant ID, the participant name, the speaker direction data, etc. stored in the RAM 24) is acquired and encoded in step 1307 (additional information acquisition means), and encoded, for example, MMS protocol By The image is transmitted to the moving image display PC 14 via the network 16.

  However, when additional information is acquired during live distribution in step 1307, the above-described speaker detection program is executed to acquire speaker direction data indicating the current speaker direction. Then, after transmitting image data, audio data, additional information, etc., it is determined in step 1308 whether or not to end this flow. For example, the end command is not transmitted from the moving image display PC 14 or the event is continuing. If it is not finished (step 1308: No), the process returns to step 1305 and the above-described processing is repeated. If it is finished (step 1308: Yes), this flow is finished.

  In addition, when transmitting speaker direction data, it is not necessary to always transmit, for example, it can transmit by execution of an HTTP (Hyper Text Transfer Protocol) server program, for example for every predetermined time for every second.

  Next, a moving image display program on the moving image display PC 14 side will be described with reference to FIG. First, in step 1401, a moving image distribution request is transmitted to the video server 12 via the network 16.

  Subsequently, in step 1402, when an HTML document having a layout as shown in FIG. 8 is received from the video server, the HTML document is displayed as an image. Thereafter, in step 1403 (first display means, image conversion means), the image data transmitted from the video server 12 via the network 16 by the MMS protocol is acquired. At the same time, the image data is decoded (for example, including decompression, the same applies hereinafter), and converted into a panoramic image 114 so that θ = 0 ° becomes both ends using the conversion table as described above, and the display 86 An image is displayed in the predetermined moving image display area 112, and a display interface for changing the display form or display position of the panoramic image 114 adjacent to the upper end of the predetermined moving image display area 112 in step 1404 (third display means). The position designation area 90 to be a face is displayed as an image.

  Also, in step 1405, the audio data transmitted from the video server 12 via the network 16, for example, by the MMS protocol is acquired, decoded and output from the speaker 96 via the sound reproduction unit 94, and in step 1406 (second display means). The additional information transmitted from the video server 12 via the network 16 by, for example, the MMS protocol is acquired and decoded in the video server 12 to be adjacent to the moving image display area 112 of the display 86 according to the layout described above. Display area) 116 is displayed, and predetermined additional information is displayed in the predetermined additional information display area 116.

  However, when the speaker direction data is acquired from the additional information, as shown in FIG. 8, for example, a triangular speaker position display mark 23 is generated, and the mark 23 is displayed in a predetermined additional information display area 116. The display is made to correspond to the display position of the participant who is the speaker displayed as an image in the predetermined moving image display area 112 and to indicate the participant who is the speaker. In addition, when acquiring the speaker direction data transmitted from the video server 12 via the network 16 by the MMS protocol, for example, simultaneously with the display of the panoramic image 114, it is not always necessary to acquire the data, for example, a fixed time every second. It is acquired according to a request for transmission every time, or the video server 12 is set to transmit at regular intervals of, for example, every second.

  Thereafter, if it is detected in step 1407 (designating means) that a predetermined position in the position designation area 90 is designated and clicked by the mouse 92 to indicate a display form or display position change (step 1407: Yes), In step 1408 (display changing means), until the head position is located at one end (θ = 0 °) on the left side of the predetermined moving image display area 112 with the designated position in the predetermined moving image display area 112 as the head position. The image continuing from the head position to the right side in the figure is moved in the left direction in the figure, and the image located on the left side in the figure from the tip position is linked to the tail of the moved image.

Thus, for example at the location specified region 90, when the left click the position of the X ₀ from the left edge, and starts reading the image data in the rightward direction from the X ₀ column from the left edge of the coordinate conversion table (pixel data), the panoramic image 114 is read to the right end, returns to the left end, and continues to read image data (pixel data) up to the X ₀ -1 column, and performs the process of moving each image data, that is, changing the display position as described above. Display the image. Subsequently, in step 1409 (second display means: display change means), the speaker position display mark 23 displayed in the predetermined additional information display area 116 is also moved in the predetermined moving image display area 112. The display position is moved corresponding to the position where the participant is displayed. By comparing the direction of the participant who is the speaker with the azimuth angle of the speaker described in the speaker direction data, the participant who best matches the direction of the speaker can be identified. In this way, which participant is currently speaking is specified, and the speaker position display mark 23 is displayed at a position corresponding to the participant image as the speaker in the predetermined additional information display area 116.

  In step 1410, it is determined whether or not the current image data, audio data, and additional information are to be stored. If the image data, audio data, and additional information are to be stored (step 1410: Yes), the current image data, audio data, and additional information are stored in step 1411. After saving, the process proceeds to step 1412. If not saved (step 1410: No), the process directly proceeds to step 1412 to determine whether or not to end the flow. If not (step 1412: No). Then, the process returns to the above-described step 1403 and the above-described processing is repeated. If the current image data, audio data, and additional information are stored in step 1411, for example, as described above, the display form or display position of the panoramic image 114 displayed in the predetermined moving image display area 112 can always be changed. Therefore, it may be performed when there is no prior non-save designation.

  In the present embodiment, first, the camera 28 and the condensing lens 58 facing upward are used to shoot a subject in a direction around 360 degrees, and are converted into a panoramic image 114 and displayed as an image. In addition, the entire scene around 360 degrees is displayed as a wide range of images, and it is very easy to convey a sense of realism. Second, a predetermined additional information display area is provided adjacent to the panoramic image 114, for example, a triangle mark. The speaker position display mark 23 is displayed in correspondence with the position of the participant who is the speaker, so that a so-called explanation display such as the position of the speaker and the position of the main subject is added to the image of the entire scene. Is easy to understand and very easy to see, and thirdly, a position designation area 90 is provided adjacent to the panoramic image 114, for example, If the desired position is designated and clicked by the operation of the screen 92, the entire image can be moved so as to scroll so that the desired position (designated position) of the image is the top position. It is possible to move to an image of the above, and there is an advantage that the operability is very good, the handling is easy, and the convenience is excellent.

  In addition, the operation interface such as the position designation area 90 allows the user to easily change the composition of the scene being shot without changing the orientation of the camera 28 during shooting, so that it is always optimal in a balanced manner. You can set up a very easy-to-read composition and intuitively know who is speaking at a glance. This means that once the camera 28 on the pedestal 56 is placed at a certain position, there is no need to adjust the settings on the camera 28 side, and therefore, a high level of skill is required even on the event venue side. Anyone can use it, and from this point of view, it is very easy to handle and excellent in convenience.

(Embodiment 2)
Next, a data display system according to the second embodiment of the present invention will be described with reference to FIGS. FIG. 15 is an explanatory diagram schematically illustrating the data display system according to the present embodiment. That is, as shown in FIG. 15, the data display system of the present embodiment is basically the same as the system described in the first embodiment, and the video server 12 and the moving image display PC 14 are connected. Although it is configured to be connected through a network (or LAN cable) 16, the contents of the moving image display program are different as will be described in detail later.

  In the case of the present embodiment, as an outline of the operation, as shown in FIG. 16, when the moving image display PC 14 transmits a moving image display request to the video server 12 via the network 16 based on the moving image display program, 12 reads out the image data, audio data, and additional information (participant ID, participant name, speaker direction data, etc.) of the already recorded event from the HDD 30 based on the moving image distribution program, and sends them to the moving image display PC 14 via the network 16. As a result, the moving image display PC 14 converts the image data into the panoramic image 114 based on the moving image display program, displays the image, reproduces and outputs the sound data, and displays the additional information as an image. .

  In the case of the present embodiment, image data, audio data, and additional information (for example, speaker direction data) are stored in the HDD 30 of the video server 12 in the form of, for example, one media video file. In the video file, for example, by using the script embedding function of Windows (R) Media technology, a predetermined script according to the format (specified by Time, Type, Parameter) specified by the site is embedded, It is also possible to make the moving image display PC 14 as a transmission destination perform a required operation. FIG. 17 shows an example in which a script conforming to a format defined by Windows® Media technology is embedded as speaker position data in a media video file. As shown in the figure, the speaker position data includes the time from the left, the time when the top of the video is 0, the event type (“angle”), and parameters related to the type (ie, the position of the speaker position display mark 23). Corresponding azimuth) is listed every second. By doing so, the moving image display program can receive the position for displaying the speaker position display mark every second in the form of an event.

  On the other hand, in the case of the present embodiment, a predetermined additional information display area 116 is displayed in the predetermined moving picture display area 112 displayed on the display 86 of the moving picture display PC 14 by executing the moving picture display program as shown in FIG. The playback control operation interface 122 is displayed as an image below the operation interface 122. The operation interface 122 includes a playback button 124 for playing the panoramic image 114, a stop button 126, a pause button 128, a winding button. A return button 130, a fast-forward button 132, and the like are provided. The moving image display program includes processing steps for recognizing the operation of each button 124 and executing an operation corresponding to the operation of each button 124. It is.

  Next, a moving picture display program possessed by the moving picture display PC 14 in the present embodiment will be described with reference to FIG. First, in step 2001, a moving image distribution request is transmitted to the video server 12 via the network 16.

  Subsequently, in step 2002, when an HTML document having a layout as shown in FIG. 18 is received from the video server, the HTML document is displayed as an image. If there is requested image data (step 2003: Yes), the process proceeds to step 2005. If there is no requested image data (step 2003: No), a predetermined moving image display area is displayed in step 2004 as shown in FIG. A message such as “there is no specified data” is displayed in 112, and this flow is terminated.

  An event display area 142 is displayed on the HTML document. The event display area 142 includes a predetermined moving image (panoramic image) display area 112 and a predetermined additional information display area adjacent to the lower end of the predetermined moving image display area 112. (Sound source position display area) 116, a position designation area 90 adjacent to the upper end of the predetermined moving image display area 112, and an operation interface 122 positioned below the predetermined additional information display area 116 are provided. In step 2005, image data, audio data, and additional information (participant ID, participant name, speaker direction data, etc.) transmitted from the video server 12 via the network 16 by, for example, the MMS protocol are received, and the RAM 74 and VRAM 76 are received. Or stored in the HDD 78.

  Subsequently, in step 2006, it is determined whether or not the operation interface 122 has been clicked with designation by the mouse 92. If it is determined that the playback button 124 has been clicked, the image data is acquired from the VRAM 76 and decoded in step 2007 (first display means, image conversion means), and as described above. Using the conversion table, the image is converted into a panoramic image 114 that can change with time so that θ = 0 ° is at both ends, and is displayed in a predetermined moving image display area 112 of the display 86 according to the layout described above. If there is a script, the script is executed. In step 2008 (second display means), additional information (for example, speaker position display mark 23 based on speaker direction data) is displayed in a predetermined additional information display area 116. ) And the audio data is extracted from the HDD 78 in step 2009 and the speaker 96 To al output.

  However, if it is determined in step 2006 that the stop button 126 has been clicked, it is determined in step 2010 that the panoramic image 114 is stopped and the reproduction of the audio data is stopped, and the rewind button 130 is clicked. In step 2011, the panorama image 114 is rewound and the reproduction of the audio data is stopped. If it is determined that the fast-forward button 132 is clicked, the panorama image 114 is fast-forwarded in step 2012 and the audio data Stop playback. If there is no operation in step 2006, the process proceeds to step 2013.

  However, in the case of this example as well, when the speaker direction data is acquired from the video server 12 via the network 16, it is not always necessary to acquire the speaker direction data. Acquired according to the setting where the server 12 is set to transmit, for example, at regular intervals of one second.

  Thereafter, when it is detected in step 2013 (designating means) that a predetermined position in the position designation area 90 is designated and clicked by the operation of the mouse 92 in order to indicate the display form or display position change (step 2013: Yes). ) In step 2014 (display changing means), the head position is located at one end (θ = 0 °) on the left side of the predetermined moving image display area 112 with the designated position as the starting position in the predetermined moving image display area 112. The image continuing from the head position to the right side of the figure is moved in the direction of the left side of the figure, and the image located on the left side of the figure from the front end position is linked to the tail of the moved image.

Thus, for example at the location specified region 90, when the left click the position of the X ₀ from the left edge, and starts reading the image data in the rightward direction from the X ₀ column from the left edge of the coordinate conversion table (pixel data), the panoramic image subsequently returns to the left end with read out to the right end of the 114 reads the image data to the X ₀ -1 column (pixel data), and the movement of the image data as described above, i.e., the processing of the display position change made Display the image. Subsequently, the speaker direction detection mark 23 displayed in the predetermined additional information display area 116 in step 2015 (second display means: display change means) is also a speaker after moving in the predetermined moving image display area 112. A participant moves the display position corresponding to the displayed position.

  Thereafter, the process proceeds to step 2016 to determine whether or not to end this flow. If not (step 2016: No), the process returns to step 2005 described above and the above-described processing is repeated.

  In the present embodiment, since the operation interface 122 is displayed on the display 86 in addition to the advantages of the first embodiment, the panorama image 114 at an arbitrary time point among the panorama images 114 that can change over time. Can be displayed freely, and for example, even when the user is away from the moving image display PC 14 if necessary, the panoramic image 114 can be stopped at that point and the reproduction of the panoramic image 114 can be viewed later. There is an advantage of improving each stage.

(Embodiment 3)
Next, a data display system according to the third embodiment of the present invention will be described with reference to FIGS. The data display system of the present embodiment is basically the same as the system described in the above embodiment, and the video server 12 and the moving image display PC 14 are connected to a network (or LAN cable) 16. The video server 12 includes a participant specifying program, and the video display program provided in the video display PC 14 mainly includes a plurality of participant display areas (subject display areas) separated from each other at predetermined intervals. ) And a display order change button (that is, a left change button 144 and a right change button 146) are displayed as an operation interface.

  In the case of the present embodiment, as for the operational overview, as shown in FIG. 21, when the moving image display PC 14 transmits a moving image display request to the video server 12 via the network 16 based on the moving image display program, 12 executes the speaker detection program based on the moving image distribution program, captures the speaker direction data as additional information generated from the sound collection timing of the microphone array 34, executes the participant identification program, and shoots with the camera 28. The network 16 together with the image data captured from the camera 28 and the audio data captured from the microphone array 34 based on the participant distribution data for identifying the participant as the subject as the generated additional information is captured. To the moving image display PC 14, and as a result, the moving image display PC 14 is activated. It is that output audio and display the additional information described above in the vicinity of each participant display region which displays a plurality of participants display region spaced apart from each other on the display 86 based on the display program.

  As the layout of the participant specifying data, for example, as shown in FIG. 22, each participant ID (for example, A, B, C, D) is shown on the left side, and the center of each participant's face area is located on the right side. It is a text format of azimuth angle (°) and is described in ascending order of azimuth angle. However, for example, each participant A, B, C, D is assigned a numerical value such as a decimal number uniquely indicating the participant A, B, C, D. A person may be specified, and each numerical value may uniquely correspond to a participant ID and a participant name.

  On the other hand, when the image display program according to the present embodiment is executed, as shown in FIG. 23A, the event display area 142 includes a plurality of objects spaced apart from each other at predetermined intervals according to the number of participants as subjects, for example. Participant display area 148 is displayed, and one participant is image-displayed in each participant display area 148, and a participant ID or additional information is displayed below each participant display area 148, or The participant name is displayed. A display order change button, that is, a left change button 144 and a right change button 146 are displayed as operation interfaces below a part of the vicinity of a part of the plurality of participant display areas 148. Then, a speaker display mark 150 for marking the frame portion with a predetermined width and a predetermined color on a square frame portion of the participant display region 148 that displays a participant who is a speaker among the plurality of participant display regions 148. Is displayed.

  Next, the participant identification program possessed by the video server 12 in the present embodiment will be described with reference to FIG. First, when the output of the start command is detected in step 2401, the position of the face area of the participant as the subject is detected from the donut image photographed by the camera 28 in step 2402, and the image characteristics of the face area are detected from the HDD 30, for example. If there is face image data that matches the face image data (for example, a face photo), and data that uniquely identifies the face image data (for example, the participant ID corresponding to the decimal number described above, participation (Name of person, hereinafter referred to as participant identification data).

  However, if there is no matching face image data (face photo) in the HDD 30, for example, an image prompting the user to input the participant ID and participant name of the current participant is displayed on the display 40, and is input here. The participant ID and the participant name are associated with the current face image data as participant specifying data and stored together with the face image data, for example, in the HDD 30, and in this case, a new participant ID as new participant specifying data, The participant name is stored in the RAM 24. The reason why the participant specifying data is stored in the RAM 24 is to facilitate the access when the participant specifying data is transmitted to the moving image display PC 14 along with the execution of the image distribution program. In step 2403, it is determined whether or not there is a next search target participant. If there is a next search target participant (step 2403: Yes), the process returns to step 2402 and the above processing is repeated. However, when the next search target participant does not exist (step 2403: No), this flow ends.

  As shown in FIG. 22, the participant specifying data is, for example, a text format of a participant ID from the left and an azimuth angle (°) where the center of the participant's face area is located. The azimuth angle at is opposite to θ shown in FIGS. 10 and 11 so that the left end is 0 ° when the donut image is converted to the panoramic image 114 later. On the other hand, the speaker specifying program does not need to be repeatedly executed at all times. For example, the speaker specifying program may be executed at regular intervals of one second.

  Next, a moving picture display program possessed by the moving picture display PC 14 in the present embodiment will be described with reference to FIG. First, in step 2501, a moving image distribution request is transmitted to the video server 12 via the network 16.

  Subsequently, in step 2502, when an HTML document having a layout as shown in FIG. 23-1 is received from the video server, the HTML document is displayed as an image. If there is requested image data (step 2503: Yes), the process proceeds to step 2505. If there is no requested image data (step 2503: No), as shown in FIG. A message stating “There is no specified data” is displayed in the moving image display area 112, and this flow is finished. In step 2505, image data, audio data, additional information and the like following the information indicating the start of moving image distribution are received. In step 2506, the image data is stored in the VRAM 76, the audio data is stored in the HDD 78, and the additional information is stored in the RAM 74. Remember me.

  Further, in step 2507 (first display means, image conversion means), as shown in FIG. 23-2, a plurality of participant display areas 148 that are separated from each other at predetermined intervals based on the layout and coordinate conversion table are displayed as images. At the same time, the image data is acquired, and each participant who is a subject is displayed as an image in the participant display area 148. When displaying a plurality of participant display areas 148 as images, the number of participants described in the participant specifying data is recognized and the same number of participant display areas 148 are generated and displayed. On the other hand, when each participant is displayed in the plurality of participant display areas 148, the participant specifying data is read for each row, and the corresponding participant image is displayed as an image.

  For example, consider the case where the first participant C shown in FIG. If the display range in the horizontal direction of the total image display area is 60 °, the upper end of the column corresponding to the azimuth angle 22 ° of the coordinate conversion table is the read start position and the column corresponding to the azimuth angle 82 ° of the coordinate conversion table. The lower end is defined as the reading end position. By reading the conversion table in accordance with the read range thus obtained, it is possible to extract and convert and display the area where the participant C is shown in the donut image. By executing the above operation for each participant D, A, B, all participant images can be displayed. At this time, each participant image is displayed in order from the left according to the order described in the participant specifying data.

  In step 2508 (second display means), for example, a participant ID, which is additional information, is displayed at a position corresponding to each participant near the lower part of the plurality of participant display areas 148, and in step 2509, a plurality of participants are displayed. For example, display order change buttons (left change button 144 and right change button 146) as an operation interface are displayed in a position below the leftmost participant display area 148 in the person display area 148, for example. In addition, when it is detected in step 2510 that one of the participants as the subjects displayed in the plurality of participant display areas 148 speaks, the voice data of the participant who is the speaker is reproduced. In step 2511 (second display means), the speaker display mark 150 as additional information is displayed in the square frame portion of the participant display area 148 that displays the participant as the speaker at this time. Also in this case, it is possible to identify the participant who best matches the direction of the speaker by checking the direction of the participant who is the speaker and the azimuth angle of the speaker described in the speaker direction data. In this way, it is specified which participant is currently speaking, and the speaker display mark 150 is displayed in the participant display area 148 in which the participant who is the speaker among the plurality of participant display areas 148 is displayed as an image. To do.

  Thereafter, when it is determined in step 2512 that the left change button 144 has been clicked, in step 2513 (image conversion means), for example, as shown in FIG. 23-2, the speaker is in the participant display area 148. The image displaying the participant is moved to the participant display area 148 on the left side of the figure, and the speaker display mark 150 is displayed in the participant display area 148. Similarly, the participants in each participant display area 148 are displayed. The image is moved so as to scroll in the left direction in the figure, and the image displaying the participant in the leftmost participant display area 148 is moved to the rightmost participant display area 148.

  Specifically, for example, the reading range of the coordinate conversion table in the leftmost participant display area 148 is changed from that of the participant C to that of the participant D, thereby participating in the donut image based on the image conversion method described above. The area where the person D is displayed is extracted and converted and displayed. By executing this processing for all the participant display areas 148, the display order can be changed from the left in the figure to the participants D, A, B, and C from the participants C, D, A, and B. . In this process, while the left change button 144 is continuously clicked, the image displaying the participant is continuously moved in the left direction in the figure so as to further scroll. The speaker display mark 150 also changes the display position following the movement of the image of the participant who is the speaker.

  On the other hand, if it is determined in step 2512 that the right change button 146 has been clicked, movement in the direction opposite to that described above is executed in step 2514 (image conversion means). If it is not determined in step 2512 that the display order change button (left change button 144, right change button 146) has been clicked (No in step 2512), the process proceeds to step 2515 to determine whether or not the process is completed. If not (step 2515: No), the process returns to step 2505 and the above-described processing is repeated. If it is completed (step 2515: Yes), this flow is terminated.

  In the present embodiment, first, for example, a plurality of participant display areas 148 corresponding to the number of participants are displayed in a panoramic image, so that the entire scene around 360 degrees as a wide range image as a whole. It is equivalent to what is displayed, and it is very easy to convey a sense of reality, and since a plurality of participant display areas 148 are displayed side by side in a row, it is easier to understand along with the transmission of the sense of reality, and secondly, the speaker display mark 150 Is displayed so as to encircle the participant display area 148, making it easier to identify the speaker. From this point of view, there is an interest that is more understandable and interesting, and third, the display order is changed. Since the buttons (the left change button 144 and the right change button 146) are displayed, the image is moved to a desired position simply by repeating the click or continuing the click. Rukoto can, there is an advantage that further excellent operability is good and easy to handle convenience.

(Embodiment 4)
Next, a data display system according to the fourth embodiment of the present invention will be described with reference to FIGS. The data display system of the present embodiment is basically the same as the system described in the above embodiment, and the video server 12 and the moving image display PC 14 are connected to a network (or LAN cable) 16. However, it is different in that the moving image display program includes a process for displaying the time chart. Here, in the on-demand data display system shown in the second embodiment, an example will be described in which changes in speaker position are displayed together with moving image data as a time chart.

  As shown in FIG. 26, the time chart 156 has a time axis on the vertical axis, and a horizontal axis showing an azimuth angle with the left end being 0 ° and a rightward direction being positive, and a panoramic image (or a plurality of participation images). (Participant display area) 114 has a length (for example, a predetermined width of 60 ° so as to coincide with the horizontal axis of the participant), and the time when each participant speaks at a position corresponding to each participant and The speech continuation time or the elapsed time after the start of the event and the speech continuation time are displayed as a belt-like line 158 of a predetermined color with a predetermined width. This time chart 156 is image data generated by the video server after the end of recording, and is stored in the HDD 30 of the video server.

  In the time chart 156, as shown in FIGS. 27-1 and 27-2, in the event display area 142, each band-like line 158 is located at the position of each participant at a position below the predetermined moving image display area 112. The images are displayed in correspondence with each other. The time chart 156 indicates the current utterance position by the reproduction position display bar 160, and a scroll bar 162 for scrolling the time chart 156 in the up and down directions in the figure is provided on the right end side in the figure.

  Here, a method for generating the time chart 156 will be described below with reference to FIG. First, when an activation command is detected in step 2801, the speaker direction data is read from the HDD 30 in step 2802, and the size of the time chart to be generated is calculated. The size of the time chart 156 in the horizontal direction is made to match the horizontal width of the panoramic image. That is, when the number of pixels in the horizontal direction of the panoramic image 114 is 720, the size of the time chart 156 in the horizontal direction is also 720 pixels. Further, the vertical size of the time chart 156 is calculated by the time length of the speaker direction data. For example, when the vertical resolution of the time chart 156 is 1 pixel / second and the time length of the speaker direction data is 1 hour (= 3600 seconds), the vertical size of the time chart 156 is calculated as 3600 pixels. .

  In step 2803, the entire time chart is once filled with white pixels. Subsequently, in step 2804, processing for drawing a band-like line 158 corresponding to the speaker position described in the speaker direction data is performed. Specifically, each time one line of the speaker direction data in FIG. 17 is read, an area to be filled with a predetermined color (in this case, dark blue) is calculated from the time and the speaker position, and the area is filled. Process. For example, when the read time is 30 seconds and the speaker position is 231 degrees, the vertical resolution is 1 pixel / second, the horizontal resolution is 2 pixels / °, and the width of the strip line is 60 °. A range indicated by upper left coordinates (30, 402) −lower right coordinates (30, 522) is calculated as a filled area. By repeating the above processing, a time chart 156 is generated.

  Next, a moving picture display program possessed by the moving picture display PC 14 in the present embodiment will be described with reference to FIG. First, in step 2901, a moving image distribution request is transmitted to the video server 12 via the network 16.

  On the other hand, when an HTML document having a layout as shown in FIG. 27 is received from the video server in step 2902, the HTML document is displayed as an image.

  That is, the event display area 142 is adjacent to the predetermined moving image (panoramic image) display area 112, the predetermined additional information display area 116 adjacent to the lower end of the predetermined moving picture display area 112, and the upper end of the predetermined moving picture display area 112. A position designation area 90, an operation interface 122 located above the position designation area 90, and a time chart display area 164 located below a predetermined additional information display area (sound source position display area) 116 are provided.

  Subsequently, in step 2903, the image data transmitted from the video server 12 via the network 16 using the MMS protocol, the voice data transmitted via the network 16 using the HTTP protocol, and additional information (participant ID, participant name, speaker direction). Data, time chart, etc.).

  Thereafter, in step 2904, it is determined whether or not the operation interface 122 has been clicked with designation by the mouse 92. If it is determined that the playback button 124 has been clicked, the image data is decoded in step 2905 (first display means, image conversion means), and θ = 0 ° using the conversion table as described above. Is converted into a panoramic image 114 that can be changed with time so that the two are at both ends, and an image is displayed in a predetermined moving image display area 112 of the display 86 according to the layout. In step 2906 (second display means), the additional information, that is, the speaker position display mark 23 based on the speaker direction data is displayed in the predetermined additional information display area 116. In step 2907, audio data is output from the speaker 96.

  However, if it is determined in step 2904 that the stop button 126 has been clicked, it is determined in step 2908 that the panoramic image 114 is stopped and the reproduction of the audio data is stopped, and the rewind button 130 is clicked. If it is determined that the panorama image 114 has been rewound in step 2909 and it is determined that the fast-forward button 132 has been clicked, the panorama image 114 is fast-forwarded in step 2910. When there is no operation in step 2904 (step 2904: No), the process proceeds to step 2911.

  Thereafter, when it is detected in step 2911 (designating means) that a predetermined position in the position designation area 90 is designated and clicked by the operation of the mouse 92 in order to indicate the display form or display position change (step 2911: Yes). 27-2, as shown in FIG. 27-2, in step 2912 (display changing means), the specified position in the predetermined moving image display area 112 is set as the starting position, and the head position is one end on the left side of the predetermined moving image display area 112 in the figure. The image following the right side in the figure is moved from the head position to the left side in the figure until it is located at (θ = 0 °), and the image located on the left side from the tip position is linked to the tail of the moved image. . If there is no change in the display form or the display position in step 2911 (step 2911: No), the process proceeds to step 2915.

Thus, for example at the location specified region, it starts reading in the case of left-click the position of X ₀ from the left end, the image data in the rightward direction from the X ₀ column from the left edge of the coordinate conversion table (pixel data), the panoramic image 114 The image data (pixel data) up to the X ₀ -1 column is read out and the image data is moved, that is, the display position is changed as described above. Display an image. In addition, the speaker position display mark 23 displayed in the predetermined additional information display area 116 in step 2913 (second display means) also displays the participant who is the speaker after moving in the predetermined moving image display area 112. The display position is moved corresponding to the selected position.

  Subsequently, as shown in FIG. 27-2, the time chart 156 displayed in the time chart display area 164 in step 2914 (display changing means) also follows the movement of each participant in the panoramic image 114. The display position of each band-like line 158 indicating the so-called utterance history of each participant is moved. The movement of the display position of each band-like line 158 can be uniquely determined sequentially by changing the coordinate system of the display position of each band-like line 158 using, for example, a time chart coordinate conversion table.

  On the other hand, if it is determined in step 2915 (display changing means) that the band-like line 158 at an arbitrary position in the time chart 156 has been clicked with, for example, the mouse 92 (step 2915: Yes), it corresponds to the clicked position in step 2916. The panoramic image 114 from the time to the time elapsed or the time elapsed after the start of the event is displayed and the audio data from that time is reproduced. If the band 158 has not been clicked, the process proceeds to step 2917.

  As for the image display and audio output of the panoramic image 114 from the point of time when the mouse 92 is clicked, data relating to the click position by the mouse 92 is transmitted to the video server 12 via the network 16 and the image according to the request is sent from the HDD 30 of the video server 12. Data and voice data are retrieved and acquired via the network 16. Next, in step 2917, it is determined whether or not to end. If not (step 2917: No), the process returns to the above-described step 2903 or step 2904 and the above-described processing is repeated, but if it is completed (step 2917: Yes), this flow ends.

  In the present embodiment, a band-shaped line 158 of a predetermined color is displayed with a predetermined width for the time and the speech continuation time of each participant or the elapsed time and the speech continuation time after the start of the event at a position corresponding to each participant. Since the time chart 156 is displayed, first, it is possible to determine the speech status of each participant at a glance, and it is possible to provide a more easily understandable and easy-to-understand video. Second, each band line of the time chart 156 Clicking an arbitrary position in 158 can play back the image and sound from that point, so that the time to use can be arbitrarily determined, and if there is a scene or the like to be repeatedly viewed, it can be repeatedly viewed. From this point of view, there is an advantage that convenience is improved in each stage.

  Of the various programs described above, the image display program and the like have been described by way of example as being downloaded from the video server 12 to the video display PC 14 via the network 16. As shown in the figure, a CD-ROM reader is generally provided as a recording medium (storage medium). Therefore, it is needless to say that the EPROM 72 or the HDD 78 may be installed from the CD-ROM.

  Further, each of the above-described embodiments is merely an example of the technical idea of the present invention, that is, the scope of rights of the present invention is limited to the above-described embodiments, and should be interpreted in a reduced manner. Instead, examples in which the constituent elements of the present invention are changed to other elements as described below are also included in the scope of the present invention as equivalent to the present invention.

  In other words, for example, in each of the above-described embodiments, the camera (omnidirectional camera) 28 and the 4-channel microphone 66 are used. However, these input forms may be other than those described above. For example, a case where the same operation as described above is realized by using an already-used imaging device such as a wide-angle camera using a wide-angle lens or the like is also included in the scope of the right of the present application.

  In the above embodiments, the moving image display program has been described as being downloaded or installed in the moving image display PC 14, but the present invention is not necessarily limited to such a form. For example, when the moving image display PC 14 transmits a distribution request to the video server 12 via a web browser, the video server 12 loads a moving image display program implemented as an ActiveX (R) component on the moving image display PC 14, for example, as moving image data. Alternatively, the program may be transmitted together with the HTML data and executed on the web browser of the moving image display PC 14. With such a configuration, if the user has only a PC with a network connection function, the above-described operation can be realized without installing a special program in advance, which is very suitable.

  In each of the above embodiments, the donut image is transmitted from the video server 12 and converted to the panoramic image 114 by the moving image display program, and then displayed on the display 86 of the moving image display PC 14. The operations up to the display of may be other than the above. For example, when the video server 12 originally transmits the panoramic image 114, the moving image display program may be in another form such as only changing the display form.

  Further, in each of the embodiments described above, it has been described that the moving image display program displays the panoramic image 114 so that the position designated by the user in the position designation area is the left end. However, the moving image display program may be displayed so that the position is centered. I do not care. In addition, in order for the user to specify the display form of the panoramic image 114, the following 1. ~ 3. Even if another interface is provided as described above, it is included in the scope of rights of the present application.

  That is: In the position designation area, the movement source is designated by the first left click, and the movement destination of the movement source is designated by the second left click. 2. A method by drag and drop of the mouse 92. In the position designation area, the left button is pressed in a state where the mouse cursor is overlapped with the position of the movement source, and the mouse cursor is moved to the movement destination of the movement source as it is, and the left button is released there. 3. As shown in FIG. 31, a position designation button is prepared instead of the position designation area. For example, when a button marked with a left triangle is pressed, the moving image display program pans the panoramic image and the speaker position display mark to the left by a predetermined amount, for example, an amount corresponding to an azimuth angle of 30 °. Display, etc.

  In the first embodiment, the camera 28 and the microphone array 34 are connected to the video server 12, and the data acquired by these devices is live-distributed to the moving image display PC 14. As can be seen, the invention described in the present application is not limited by the live distribution by the video server 12. Therefore, the camera 28 and the microphone 66 are connected to the moving image display PC 14, and the moving image display program is executed on the PC 14. Even when the data acquired by the device is displayed as described above, it is included in the scope of rights of the present application.

  Further, in the second embodiment, it has been described that image data, audio data, and the like are stored in the video server 12 and are distributed on demand in response to a distribution request from the moving image display PC 14. As can be seen, the on-demand distribution by the video server 12 does not limit the invention described in the present application. Therefore, image data, audio data, etc. are stored in the moving image display PC 14, and an image display program is stored on the PC 114. Even when these data are read and displayed as described above, they are within the scope of the present application. In the second embodiment, the image distribution program is described as taking the relative time with the recording start time as 0 as a parameter, but it may be an absolute time.

  Further, the operation of the participant specifying program described in the third embodiment is not limited as described above, and may be completely different. For example, hardware or a program that transforms a donut image into a panoramic image 114 may be installed in the video server 12, and the participants may be identified and tracked after being transformed into the panoramic image 114. Each participant wears an IC card with a radio wave transmission function, reads the radio wave sent from each IC card, acquires the participant ID and position, and collates the result with the image data. By doing so, the configuration may be completely different, such as specifying the participants in the image data.

  Further, the operation of the speaker detection program described in the third embodiment is not limited as described above, and may be completely different. For example, by identifying voice data input from one microphone with the voice of a participant registered in the video server 12 in advance, the speaker is identified, and the result is collated with the output of the participant identification program. You may comprise so that the position of a speaker may be detected. In the fourth embodiment, it has been described that the moving image distribution program transmits the time chart 156 to the moving image display PC 14 as image data. However, the moving image distribution program may have a different form. For example, speaker direction data as shown in FIG. 17 may be transmitted, and the time chart 156 may be generated and displayed in real time when displaying a moving image.

  Further, the fourth embodiment can be applied to an application in which image data and audio data acquired by the camera 28 and the microphone array 34 are distributed live. For example, a case where the moving image display program stores the history of the direction of the speaker received from the video server 12 and displays it while updating the time chart 156 at the time of image display is also included in the scope of rights of the present application. Further, when a moving image is displayed on the moving image display PC 14 side, it may be arbitrarily switched between the predetermined moving image display area 112 and a plurality of participant display areas 148.

  In the data display system, the data display method, the program, and the recording medium according to the present invention, an image obtained by photographing a direction around 360 degrees is converted into a panorama image or a panoramic image that can be changed with time, and displayed on the display. Since the image display and the display form or the display position can be freely changed by a simple operation such as one click, it is very easy to understand and easy to see. Excellent convenience in all electronic conference fields where many participants from remote locations watch live events such as in-house conferences, occasional round-table conferences, and international ethnic conferences and talk shows. It provides added value and can be used by many people.

1 is an explanatory diagram illustrating a configuration of a data display system according to a first embodiment. 1 is a block diagram illustrating a configuration of a video server according to Embodiment 1. FIG. FIG. 3 is a perspective view illustrating the configuration of a camera unit and a microphone array according to the first embodiment. It is explanatory drawing explaining an example of the image image | photographed with the said camera part. 3 is a block diagram illustrating a configuration of a moving image display PC according to Embodiment 1. FIG. FIG. 3 is an explanatory diagram for explaining a program configuration of the data display system according to the first embodiment. 6 is an explanatory diagram illustrating an example of a panoramic image in Embodiment 1. FIG. 6 is an explanatory diagram illustrating a specific example of an image display layout according to Embodiment 1. FIG. It is explanatory drawing explaining an example of designation | designated operation of the display position change of the said panoramic image. It is explanatory drawing explaining an example after the display form change of the said panoramic image. It is explanatory drawing explaining the element of the one principle converted into the said panoramic image. It is explanatory drawing explaining another element of the one principle converted into the said panorama image. It is explanatory drawing explaining the coordinate conversion table at the time of changing the display form of the said panoramic image. 4 is a flowchart showing processing of a speaker detection program in the first embodiment. 4 is a flowchart showing processing of a moving image distribution program in the first embodiment. 3 is a flowchart illustrating processing of a moving image display program according to Embodiment 1. 6 is an explanatory diagram illustrating a configuration of a data display system according to Embodiment 2. FIG. 10 is an explanatory diagram illustrating a program configuration of a data display system according to Embodiment 2. FIG. FIG. 11 is an explanatory diagram for explaining a format of speaker direction data in the second embodiment. 10 is an explanatory diagram illustrating a specific example of an image display layout in Embodiment 2. FIG. 10 is an explanatory diagram illustrating an image display example at the time of non-moving image distribution in Embodiment 2. FIG. 10 is a flowchart illustrating processing of a moving image display program according to Embodiment 2. 10 is an explanatory diagram illustrating a program configuration of a data display system according to Embodiment 3. FIG. 10 is an explanatory diagram illustrating a specific example of a layout of participant specifying data in Embodiment 3. FIG. 10 is an explanatory diagram illustrating a specific example of an image display layout according to Embodiment 3. FIG. FIG. 10 is an explanatory diagram for explaining an example after a display form change of a plurality of participant display images in the third embodiment. 10 is a flowchart showing processing of a participant specifying program in the third embodiment. 10 is a flowchart illustrating processing of a moving image display program according to Embodiment 3. FIG. 10 is an explanatory diagram illustrating an example of a time chart generated by the data display system according to the fourth embodiment. FIG. 16 is an explanatory diagram for explaining a specific example of an image display layout in a fourth embodiment. FIG. 10 is an explanatory diagram illustrating an example after changing the display form of a panoramic image and a time chart in the fourth embodiment. 14 is a flowchart showing processing of a time chart generation program in the fourth embodiment. 10 is a flowchart illustrating processing of a moving image display program according to Embodiment 4. It is explanatory drawing explaining the case where a moving image display program etc. are installed in PC for moving image display. It is explanatory drawing explaining the other specific example of an operation interface.

Explanation of symbols

10 Data Display System 12 Video Server 14 Video Display PC
16 Network 22, 72 EPROM
23 Speaker position indication mark 24, 74 RAM
26,76 VRAM
28 Camera 30, 78 HDD
32, 80 Video capture 34 Microphone array 38, 84 Address control unit 40, 86 Display 42, 88 Keyboard 44, 94 Sound reproduction unit 46, 96 Speaker 48, 98 Transmission / reception unit 50, 100 Communication interface 52, 102 CPU
56 pedestal 58 condensing lens 60 transparent enclosure 62 hyperboloid mirror 64 camera unit 66 microphone 90 position designation area 92 mouse 112 moving image display area 114 panoramic image 116 predetermined additional information display area 120 field 122 operation interface 124 reproduction button 126 Stop button 128 Pause button 130 Rewind button 132 Fast forward button 142 Event display area 144 Left change button 146 Right change button 148 Participant display area 150 Speaker display mark 156 Time chart 158 Band-shaped line 160 Playback position display bar 162 Scroll bar 164 Time chart display area

Claims (20)

A personal computer for displaying video,
First display means for converting omnidirectional image data obtained by photographing a subject around 360 degrees into a panoramic image and displaying the panoramic image in an image display area of the image display means;
Second display means for displaying a position designation area for changing the display position of the panoramic image;
A designation means for designating a change in the display position of the panoramic image on the position designation area;
When it is detected that the position in the position designation area is designated by the designation means, a display change is performed in which the panoramic image at the designated position is moved to one end of the image display area and the display of the moving image display area is changed. includes a means, a,
The display changing means, when the position is designated by the designation means,
Read the subsequent image data with the designated position as the head, and read out the image data from the head position in the image display area to the designated position,
A panoramic image at a position relative to the position in the image display area is moved to one end of the image display area together with a subsequent panorama image as a head position, and the head position and the image display area in the image display area are moved. A personal computer for displaying a moving image, wherein a panoramic image between the first and the last is linked to the last of the subsequent image data .   2. The moving image display personal computer according to claim 1, wherein the position designation area is displayed adjacent to an image display area displayed by the first display means.   3. The moving picture display personal computer according to claim 1, wherein when the position is designated by the designation means, a direction in a required space outside the subject is designated in the image display area. When the position is designated by the designation means, the display changing means moves the panoramic image at the position in the image display area to one end of the image display area together with the following panoramic image as a head position, and The personal computer for moving image display according to any one of claims 1 to 3, wherein a panoramic image that protrudes from the one end with the movement of the position is linked to the tail of the subsequent panoramic image. The omnidirectional image data includes at least one subject,
The moving image display personal computer further includes:
Third display means for displaying additional information related to the subject in the additional information display area of the image display means;
The third display means displays the additional information display area adjacent to the image display area, and is related to each subject in accordance with the position of each subject in the image display area in the additional information display area. The moving image display personal computer according to claim 1, wherein the additional information to be displayed is displayed. The third display means is a sound source position display area for displaying a sound source position display mark pointing to the subject who is a speaker corresponding to the sound source direction data as the additional information display area with respect to the image display area. The personal computer for displaying moving images according to claim 5, wherein: The second display means displays a participant ID or a participant name as additional information related to the subject in the vicinity of each subject displayed as an image in the image display area. Personal video display personal computer. 8. The moving image display according to claim 6, wherein a time chart in which the time of sound generation for each subject, the elapsed time after the start of the event, and the sound generation duration time are recorded is displayed in the vicinity of the image display area. Personal computer. The display changing means includes
When the position is designated by the designation means and the panoramic image of the subject is moved, the time at which the subject is sounded in the time chart or the time after the start of the event in accordance with the movement of each subject of the panoramic image 9. The moving picture display personal computer according to claim 8, wherein the recorded contents of the time and the pronunciation duration are moved. The moving image according to claim 9, wherein the display change unit outputs image data, audio data, and additional information from the position when a recording content at a required position in the time chart is designated. Personal computer for display. 11. An operation interface including a playback button, a stop button, a pause button, a rewind button, a fast-forward button, and the like is displayed in the vicinity of the image display area. The personal computer for moving image display as described in one. The moving image display personal computer further includes:
The personal computer for moving image display according to claim 1, further comprising storage means for storing the omnidirectional image data. 13. The moving image display personal computer according to claim 12, wherein the storage means further stores additional information related to the subject. The video display personal computer is connected to a video server via a network,
13. The moving image display personal computer according to claim 12, wherein the omnidirectional image data is acquired from the video server. 14. The moving image display personal computer according to claim 13, wherein the additional information is acquired from the video server. A data display system comprising a moving image display personal computer according to any one of claims 1 to 11 and a video server connected via a network,
The video server is
The image data acquisition means for acquiring the omnidirectional image data including at least one subject;
The additional information acquisition means for acquiring additional information related to the subject;
The sound collecting means for collecting voice, sound or music of the subject;
Storage means for storing the image data, the additional information, audio data, sound data, or musical sound data;
Distribution means for live distribution of the image data, the additional information, the audio data, and the like,
The moving image display personal computer further includes:
A data display system comprising receiving means for receiving the image data, the additional information, the audio data, the sound data, or the musical sound data distributed by the video server. A data display system comprising a moving image display personal computer according to any one of claims 1 to 11 and a video server connected via a network,
The video server is
  The image data acquisition means for acquiring the omnidirectional image data including at least one subject;
The additional information acquisition means for acquiring additional information related to the subject;
The sound collecting means for collecting voice, sound or music of the subject;
Storage means for storing the image data, the additional information, audio data, sound data, or musical sound data;
The moving image display personal computer further includes:
Receiving means for receiving the image data, the additional information, the audio data, the sound data, or the musical sound data distributed by the video server;
Transmission means for transmitting a moving image distribution request to the video server,
The video data further comprises distribution means for reading out the image data, the additional information, the audio data, and the like from the storage means and distributing them via the network when a video distribution request is received from the video display personal computer. A data display system characterized by that. A video display method for displaying a video on a personal computer for video display,
A first display step of converting omnidirectional image data obtained by photographing a subject in a direction around 360 degrees into a panoramic image and displaying the panoramic image in an image display area of an image display unit;
A second display step of displaying a position designation area for changing the display position of the panoramic image;
A designation step for designating a change in the display position of the panoramic image on the position designation area;
When it is detected that the position in the position designation area is designated by the designation means, a display change is performed in which the panoramic image at the designated position is moved to one end of the image display area and the display of the moving image display area is changed. Including a process,
In the display change step, when the position is designated in the designation step,
Read the subsequent image data with the designated position as the head, and read out the image data from the head position in the image display area to the designated position,
A panoramic image at a position relative to the position in the image display area is moved to one end of the image display area together with a subsequent panorama image as a head position, and the head position and the image display area in the image display area are moved. A moving image display method characterized by linking a panoramic image between the previous image data and the last image data. A moving image display program for causing a computer to execute the method according to claim 18. A recording medium on which the program according to claim 19 is recorded.

Images