JP2004289224A - Moving picture distribution server and moving picture distribution system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a moving picture distribution server capable of simply magnifying and reproducing a moving picture in real time without losing the image quality and to provide a moving picture distribution system. <P>SOLUTION: The moving picture distribution server 10 is characterized in to include: a high resolution magnification moving picture file 14 provided with a frame related to a magnified moving picture with higher resolution than that of a moving picture reproduced by a client machine 30; a means 11b for editing the frame of the high resolution magnification moving picture file 14 into a frame with a magnification designated area on the basis of information of the magnification designated area of the moving picture reproduced by and received from the client machine 30; and a means 11c for transmitting the edited high resolution magnification moving picture file provided with the frame after the edit to the client machine 30. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a system for distributing a moving image from a moving image distribution server to a client machine, and more particularly to a moving image distribution server and a moving image distribution system suitable for enlarging and reproducing a moving image reproduced on a client machine.
[0002]
[Prior art]
Conventionally, there is a moving image distribution system that distributes moving images on the Internet. In this moving image distribution system, a moving image file prepared in advance in a moving image distribution server is transmitted to a client machine based on a distribution request, and reproduced on the client machine.
[0003]
Here, the user of the distribution moving image sometimes wants to enlarge and display only a certain portion of the moving image being reproduced. As a conventional enlarged reproduction method in such a case, there is a method of enlarging the moving image being reproduced on the client machine side frame by frame. In addition, in addition to the above-mentioned normal moving image file, a high-resolution (higher resolution than a normal moving image) moving image file prepared in advance is prepared in the moving image distribution server, and distributed in response to a distribution request. There is a method in which the operator clips the created high-resolution enlarged moving image file to a desired area on the client machine side and reproduces the enlarged moving image.
[0004]
[Patent Document 1]
JP-A-11-205786
[Patent Document 2]
JP-A-2002-44629
[0005]
[Problems to be solved by the invention]
However, in the former conventional enlarged reproduction method, there is a disadvantage that image quality is impaired. Also, in the latter enlarged reproduction method, the video is distributed to an area that does not need to be watched, in other words, the size of the video file to be downloaded becomes large, so that it takes time to download wastefully. The inconvenience that enlargement reproduction cannot be performed in real time occurs. Further, in the latter case, since the operator needs to perform clipping, it is troublesome and lacks consideration for unfamiliar persons.
[0006]
Therefore, an object of the present invention is to provide a moving image distribution server and a moving image distribution system that can improve the inconvenience of the conventional example and can easily enlarge and reproduce a moving image in real time without deteriorating image quality.
[0007]
[Means for Solving the Problems]
In order to achieve the above object, the moving image distribution server according to the present invention includes a high-resolution enlarged moving image file including a frame related to an enlarged moving image having a higher resolution than the moving image being reproduced on the client machine, and the moving image file received from the client machine. Means for editing a frame of the high-resolution enlarged moving image file into a frame of the enlarged designated region based on the information of the enlarged designated region of the moving image being reproduced on the client machine, and an edited high-resolution enlarged moving image file having the edited frame. Means for transmitting to the client machine.
[0008]
In order to achieve the above object, in the moving image distribution system according to the present invention, a means for detecting an enlargement designated area of a moving picture being reproduced and a means for transmitting information of the designated enlargement area to a moving picture distribution server are provided by a client machine. Has. The moving image distribution server further includes a high-resolution enlarged moving image file having a frame related to the enlarged moving image having a higher resolution than the moving image being reproduced on the client machine, and the high-resolution enlarged moving image based on the enlarged designated area information received from the client machine. It has means for editing a frame of the file into a frame of the enlargement designated area, and means for transmitting an edited high-resolution enlarged moving image file including the edited frame to the client machine.
[0009]
BEST MODE FOR CARRYING OUT THE INVENTION
An embodiment of a moving image distribution system according to the present invention will be described with reference to FIGS.
[0010]
First, the configuration of the moving image distribution system according to the present embodiment will be described with reference to FIG. As shown in FIG. 1, this moving image distribution system is connected to a moving image distribution server 10 that distributes moving images via the Internet 20, and plays back moving images distributed from the moving image distribution server 10. And a client machine 30.
[0011]
Here, the moving image distribution server 10 of the present system will be described. The moving image distribution server 10 is a server that distributes a moving image based on a moving image distribution request from the client machine 30, and has a control unit 11 shown in FIG. The control means 11 of this embodiment is provided with a low-resolution moving image distribution function 11a, a high-resolution enlarged moving image editing function 11b, and a high-resolution enlarged moving image distribution function 11c as its processing functions. Hereinafter, each of these functions will be described in detail.
[0012]
First, the low resolution moving image distribution function 11a is a function of transmitting the low resolution moving image file 12 and the low resolution moving image reproducing program 13 shown in FIG. 1 to the client machine 30 based on a moving image distribution request from the client machine 30. It is.
[0013]
Here, the low-resolution moving image file 12 is a file having a plurality of one image (hereinafter, referred to as “frame”) representing one frame of the low-resolution moving image, and is arranged in the order of the frame number assigned to each frame. A moving image is formed by displaying each frame on the monitor of the client machine 30. Further, the low-resolution moving image file 12 is provided with a table indicating the correspondence between the frame number and information on the time when the frame is displayed on the monitor. This time information corresponds to the playback time of one moving image. Further, the frame of the low-resolution moving image has information of XY coordinates as shown in FIG. 2, for example.
[0014]
In the present embodiment, the moving image of the file 12 is expressed as a low-resolution moving image. However, this is an expression used for convenience to indicate a difference in resolution between a high-resolution enlarged moving image described later. It does not necessarily indicate a moving image with poor image quality.
[0015]
The low-resolution moving image reproduction program 13 is a program having various processing instructions for operating a central processing unit (CPU) of the client machine 30, and performs the following processing functions on the client machine 30. It is something to be executed.
[0016]
First, in the present embodiment, as one of such processing functions, a low-resolution moving image reproducing function for reproducing and displaying a low-resolution moving image composed of the low-resolution moving image file 12 on a monitor of the client machine 30 is provided. The low-resolution video playback function of the low-resolution video playback program 13 is based on called time information (for example, “00h00m00s” corresponding to the first frame when a video is played from the beginning). It has a function of retrieving the table of the moving image file 12, extracting the frame of the corresponding frame number from the low-resolution moving image file 12, and displaying it on the monitor. Similarly, the subsequent frames are sequentially displayed on the monitor. To go.
[0017]
The processing function of the low-resolution moving image reproduction program 13 includes an enlarged frame Ef shown in FIG. 2 for the operator of the client machine 30 to specify a desired enlarged area in the low-resolution moving image being reproduced. An enlarged frame display function to be displayed is provided. This enlarged frame display function may start displaying the low-resolution moving image and display the enlarged frame Ef on the moving image, or may display the enlarged frame Ef on the instruction of the operator. In this embodiment, since the description is made assuming that the enlargement ratio is constant, the size of the enlargement frame Ef is not changed. However, the size can be changed.
[0018]
Here, the enlarged frame Ef is set so that the mouse pointer P of the client machine 30 is located at the center thereof as shown in FIG. 2, for example, and moves on the moving image in conjunction with the movement of the mouse. I do. For this reason, the enlargement frame Ef has a fixed state and a moving state, and in order to clearly indicate such a state to the operator, the enlargement frame display function displays the enlargement frame Ef in a different color according to the state (for example, the fixed state). (Displayed in blue if in the state and red in the moving state). The switching of the enlarged frame Ef to the fixed state or the moving state in the present embodiment is alternately performed by the enlarged frame display function every time the mouse is clicked. In the present embodiment, the enlarged frame Ef displayed first is set to the moving state. Although a mouse is exemplified as the pointing device (input means) as described above, for example, a trackball, a cursor key of a keyboard, or the like can be used.
[0019]
Further, the other processing functions of the low-resolution moving image reproduction program 13 include an enlargement target information detecting function of detecting information of a frame to be enlarged and a designated enlargement region in a low-resolution moving image being reproduced, and an enlarged target information detecting function. An enlargement target information transmission function for transmitting information to the moving image distribution server 10 is provided.
[0020]
The enlargement target information detection function includes frame information (frame numbers at the start and end of the fixed state in the present embodiment) while the enlargement frame Ef is in the fixed state, and enlargement designated area information (this embodiment). In the embodiment, it is a function of detecting the XY coordinate information of the position of the pointer P and the width information and the height information of the enlarged frame Ef). Here, the frame number is obtained from the table of the low-resolution moving image file 12 based on the reproduction time (elapsed time from the start of reproduction) when the low-resolution moving image is clicked with the mouse.
[0021]
Further, the enlargement target information detection function includes the detected enlargement target information in a start frame number column 31a, an end frame number column 31b, an X coordinate column 31c, a Y coordinate column 31d, a width information column 31e, and a height information column 31f. A function of storing the information in the temporary storage device (memory) of the client machine 30 as the enlargement target information table 31 shown in FIG.
[0022]
According to FIG. 3, frame numbers “00 to 20” and “35 to 50” indicate that the enlarged frame Ef is in a fixed state, and frame numbers “20 to 35” indicate that the enlarged frame Ef is in a moving state. Here, in the present embodiment, the frame in the fixed state is enlarged in the fixed state, and the frame in the moving state is enlarged in the moving state. The enlarged position in the fixed state is the frame of the mouse position at the start of the fixed state, and the enlarged position in the moving state is the key frame of the frame of the previous fixed mouse position and the frame of the next fixed mouse position. Decide.
[0023]
Further, the enlargement target information transmission function of the present embodiment is called when the operator makes a distribution request of the enlarged moving image (for example, presses an enlarged moving image reproduction button displayed on the screen). This is a function of linking the history information of the enlargement target information table 31 into a character string, adding this to a URL address for accessing the moving image distribution server 10, and transmitting the character string. For example, taking the enlargement target information table 31 in FIG. 3 as an example, a URL address “http://www.abc” where the character strings “0020360240240160” and “3550300280240160” are added to the URL address “http: //www.abc ...”. .. / 0020360240240160/3550300280240160 ”, the enlargement target information converted into a character string is transmitted to the moving image distribution server 10.
[0024]
Subsequently, the high-resolution enlarged moving image editing function 11b of the control means 11 includes the enlargement target information sent from the client machine 30, the high-resolution enlarged moving image file 14 and the high-resolution enlarged moving image management table 15 shown in FIG. To create a high-resolution enlarged moving image file (hereinafter referred to as “edited high-resolution enlarged moving image file”) in the designated enlargement area.
[0025]
Here, the high-resolution enlarged moving image file 14 is a file that stores an enlarged high-resolution frame in which each frame of the low-resolution moving image file 12 is enlarged and the resolution is increased. Because of this, the size of the high-resolution enlarged moving image file 14 becomes large, so that a plurality of file groups 14 in which each frame is subdivided into a grid shape are provided. _k (K = 1, 2,..., N). In the present embodiment, each of the subdivided files 14 _k Coordinate information is managed in the high-resolution enlarged moving image management table 15, and based on the coordinate information, each file 14 _k One rectangular area is formed by laying down the images of the same frame number included in.
[0026]
For example, the high-resolution enlarged moving image file 14 according to the present embodiment has nine files 14 as shown in FIG. ₁ ~ 14 ₉ (001.avi to 009.avi), and each of these files 14 ₁ ~ 14 ₉ Are registered as shown in FIG. Here, the high-resolution enlarged moving image management table 15 of the present embodiment _k , A file name 15a, an X coordinate 15b and a Y coordinate 15c at the lower left corner, and a width 15d and a height 15e from these XY coordinates. _k Manages coordinate information of. For convenience, the XY coordinates of the high-resolution enlarged moving image file 14 of the present embodiment are obtained by multiplying the X and Y coordinate axes of the low-resolution moving image file 12 by a value (enlargement ratio / 100) corresponding to the magnification of the moving image. Shall be.
[0027]
Specifically, the high-resolution enlarged moving image editing function 11b of the present embodiment acquires enlargement target information from the additional information of the URL address described above, and, based on the enlargement target information, an enlargement designation area for each frame (for example, as shown in FIG. 6). It has a function of calculating (shaded portion). Also, the file 14 overlapping the calculated enlargement designation area _k (In FIG. 6, 004.avi, 005.avi, 007.avi, 008.avi) has a function of specifying the coordinate information of the enlargement designated area and the information of the high-resolution enlarged moving image management table 15. The high-resolution enlarged moving image editing function 11b further includes the specified file 14 _k A function of acquiring the image of the frame to be edited from the above, arranging and combining the acquired images of the same frame number based on the high-resolution enlarged moving image management table 15, and It has a function of creating a frame image by clipping the protruding region, and a function of creating a file (edited high-resolution enlarged moving image file) in which the created frame images are arranged in the order of frame numbers.
[0028]
Note that the high-resolution enlarged moving image editing function 11b according to the present embodiment creates an edited high-resolution enlarged moving image file after creating the frame image with the youngest frame number in the enlargement target information, and then creates the frame image Is stored at the end of the edited high-resolution enlarged moving image file. Thereafter, the creation of the frame image and the storage in the edited high-resolution enlarged moving image file are repeated in the order of the frame number.
[0029]
Subsequently, the high-resolution enlarged moving image distribution function 11c of the control means 11 transmits the edited high-resolution enlarged moving image file created by the high-resolution enlarged moving image editing function 11b together with the high-resolution enlarged moving image reproduction program 16 to the client machine 30. Function.
[0030]
Here, the high-resolution enlarged moving image reproduction program 16 is a program having various processing instructions for operating the CPU of the client machine 30, and displays a high-resolution enlarged moving image composed of an edited high-resolution enlarged moving image file on a monitor. The high-resolution enlarged moving image reproduction function for reproduction and display is executed on the client machine 30.
[0031]
Next, the operation of the present system configured as described above will be described with reference to the flowchart of FIG.
[0032]
First, when the moving image distribution server 10 receives a moving image distribution request (step ST1) from the client machine 30, the low resolution moving image distribution function 11a of the control unit 11 sends the low resolution moving image file 12 and the low resolution moving image file to the client machine 30. The moving image reproduction program 13 is transmitted (step ST2).
[0033]
Subsequently, the client machine 30 that has received the low-resolution moving image file 12 and the low-resolution moving image reproducing program 13 generates a low-resolution moving image file 12 based on the low-resolution moving image reproducing function by the low-resolution moving image reproducing program 13. The moving image is reproduced on the monitor (step ST3).
[0034]
Here, the reproduction process of the low-resolution moving image will be described with reference to the flowchart of FIG. In the description here, when the low-resolution moving image file 12 and the low-resolution moving image reproducing program 13 have been received, the low-resolution moving image reproducing program 13 calls the time information of the first frame to reproduce. However, when the operator presses the reproduction start button, the time information is called up and reproduction is started.
[0035]
The client machine 30 receives the low-resolution moving image file 12 and the low-resolution moving image reproducing program 13 as described above (step ST3A), and is called based on the low-resolution moving image reproducing function by the low-resolution moving image reproducing program 13. A frame corresponding to the time information is extracted from the low resolution moving image file 12 (step ST3B). Then, this frame is displayed on the monitor (step ST3C). Thereafter, the same processing is repeated until the last frame.
[0036]
The operator watches the low-resolution moving image reproduced in this manner, and moves the enlarged frame Ef displayed on the screen with the mouse to specify an area to be enlarged and reproduced (step ST4). Note that, here, it is assumed that the moving image is started to be reproduced and the enlarged frame Ef is displayed in a state in which the moving image can be moved on the moving image (that is, red).
[0037]
Here, the processing related to the designation of the enlargement designated area will be described with reference to the flowchart of FIG. First, the operator moves the mouse to move the enlarged frame Ef to a desired position, and clicks the mouse at this position to determine the fixed position of the enlarged frame Ef (step ST4A). Thereby, the control means of the client machine 30 changes the enlargement frame Ef to blue based on the enlargement frame display function by the low-resolution moving image reproduction program 13 to fix it (step ST4B), and enlarges the image by the low-resolution moving image reproduction program 13. The enlargement target information is obtained based on the target information detection function (step ST4C). Thereafter, the client machine 30 uses the enlargement target information detection function to create an enlargement target information table 31 including records of the acquired enlargement target information and store the table in the memory (step ST4D).
[0038]
For example, the enlargement target information acquired in step ST4C includes the frame number (start frame number) acquired from the above-described table of the low-resolution moving image file 12 based on the information of the moving image reproduction elapsed time at the time of the mouse click in step ST4A, and Information on the XY coordinates, width, and height of the center of the enlarged frame Ef in the fixed state. Based on the acquired information, the enlargement target information table 31 including records in which the fields other than the end frame number field 31b shown in FIG. 3 are filled is created.
[0039]
The reproduction of the low-resolution moving image is continued in the display state of the enlarged frame Ef. If the operator does not want to enlarge the reproduced image thereafter or wants to enlarge another area, the operator clicks the mouse to fix the enlarged frame Ef. A state release instruction is issued (step ST4E). Accordingly, the control means of the client machine 30 changes the enlargement frame Ef to red based on the enlargement frame display function to make it move (step ST4F), and performs the mouse click of step ST4E based on the enlargement target information detection function. The time frame number is obtained (step ST4G). Thereafter, the client machine 30 stores the acquired frame number in the end frame number column 31b of the record of the enlargement target information table 31 created in step ST4D by the enlargement information detection function (step ST4H).
[0040]
Here, if the operator also wants to enlarge and reproduce another area, the steps ST4A to ST4H are performed again.
[0041]
After the designation of the enlarged area is completed as described above, the operator presses the enlarged moving image reproduction button displayed on the screen to request the distribution of the enlarged moving image (step ST5). Thereby, the control means of the client machine 30 reads out the enlargement target information table 31 from the memory based on the enlargement target information transmission function by the low resolution moving picture reproduction program 13 and stores the history information (enlargement target information of each record) in one character. The columns are linked (step ST6). Thereafter, this character string is added to the URL address of the moving image distribution server 10 (step ST7), and transmitted to the moving image distribution server 10 (step ST8). Note that the distribution request of the enlarged moving image by the operator may be performed during the reproduction of the low-resolution moving image or may be performed after the reproduction is completed.
[0042]
Subsequently, the moving image distribution server 10 creates an edited high-resolution enlarged moving image file using the high-resolution enlarged moving image editing function (step ST9). Hereinafter, the editing high-resolution enlarged moving image file creation processing by the high-resolution enlarged moving image editing function will be described in detail with reference to the flowchart of FIG.
[0043]
First, the moving image distribution server 10 reads the additional information from the received URL address to acquire enlargement target information by using the high resolution enlarged moving image editing function (step ST9A), and designates enlargement for each frame based on the enlargement target information. An area is calculated (step ST9B).
[0044]
Subsequently, the moving image distribution server 10 starts editing in order from the frame having the lower frame number in the enlargement target information. First, the high-resolution enlarged moving image editing function refers to the high-resolution enlarged moving image management table 15, and refers to the file 14 overlapping the enlargement designated area of the frame to be edited. _k Is read from the high-resolution enlarged moving image file 14 (step ST9C). Then, the read file 14 _k Then, the image of the frame to be edited is obtained from (step ST9D), and the respective images are arranged based on the high-resolution enlarged moving image management table 15 and combined into one image (step ST9E).
[0045]
Thereafter, the moving image distribution server 10 compares the composite image with the enlargement designated area, and clips a region of the composite image that protrudes from the enlargement designated area to create a frame image (step ST9F). Here, if the frame image is the first frame, an edited high-resolution enlarged moving image file is created and the frame image is stored. The frame images are stored (in the order of the frame numbers) (step ST9G). Thereafter, the processing of steps ST9C to ST9G is repeated until the last frame in the order of the frame numbers in the enlargement target information.
[0046]
When the creation of the edited high-resolution enlarged moving image file is completed in this manner, the moving image distribution server 10 then uses the high-resolution enlarged moving image distribution function 11c to convert the created edited high-resolution enlarged moving image file into a high-resolution enlarged moving image reproduction program. 16 and the client machine 30 (step ST10). Thereby, on the client machine 30, a high-resolution enlarged moving image relating to the edited high-resolution enlarged moving image file is reproduced (step ST11).
[0047]
As described above, in the moving image distribution system according to the present embodiment, an enlarged moving image with higher image quality than the moving image being reproduced on the client machine 30 is prepared in the moving image distribution server 10, and the high-quality enlarged moving image is further provided by the operator. The moving image distribution server 10 edits and distributes the enlarged moving image of only the designated enlarged designated area to the client machine 30. Therefore, by using such a moving image distribution system or the moving image distribution server 10, a desired enlarged moving image can be reproduced without deteriorating the image quality. Furthermore, since the file size of the enlarged video to be distributed can be kept to a minimum, it is possible to shorten the time required for downloading compared to the conventional one, thereby enabling the reproduction of the enlarged video in real time. Can be.
[0048]
Also, an enlarged frame Ef is displayed on the screen, and an enlarged area can be designated by operating an input unit such as a mouse in conjunction with the enlarged frame Ef. Since the enlarged moving image of the area can be reproduced, the convenience for the operator is excellent.
[0049]
In the above embodiment, the low-resolution moving image reproducing program 13 and the high-resolution enlarged moving image reproducing program 16 are illustrated as being transmitted to the client machine 30 together with the respective moving image files. However, the present invention is not limited to this. . For example, such a program may be installed in a client machine in advance before distributing a moving image. According to this, the volume of transmitted / received data at the time of distributing a moving image can be reduced, so that a more real-time playback of an enlarged moving image can be performed. Will be possible.
[0050]
【The invention's effect】
According to the moving image distribution server and the moving image distribution system according to the present invention, a desired enlarged moving image can be easily reproduced on a client machine in real time without deteriorating image quality.
[Brief description of the drawings]
FIG. 1 is a block diagram showing a configuration of an embodiment of a moving image distribution system according to the present invention.
FIG. 2 is a diagram illustrating a low-resolution moving image and an enlarged frame displayed on the low-resolution moving image according to the embodiment.
FIG. 3 is a diagram illustrating an example of an enlargement target information table according to the embodiment.
FIG. 4 is a diagram illustrating a high-resolution enlarged moving image file according to the embodiment.
FIG. 5 is a diagram illustrating a high-resolution enlarged moving image management table of the high-resolution enlarged moving image file illustrated in FIG. 4;
FIG. 6 is a diagram illustrating a relationship between a high-resolution enlarged moving image file of the present embodiment and an enlarged designated area designated on a low-resolution moving image being reproduced.
FIG. 7 is a flowchart illustrating an operation of the moving image distribution system of the embodiment.
FIG. 8 is a flowchart illustrating a reproduction process of a low-resolution moving image in the flowchart illustrated in FIG. 7;
FIG. 9 is a flowchart illustrating an enlarged area designation process in the flowchart shown in FIG. 7;
FIG. 10 is a flowchart illustrating a process of creating an edited high-resolution enlarged moving image file in the flowchart shown in FIG. 7;
[Explanation of symbols]
10. Video distribution server
11 control means
11a Low resolution video distribution function
11b High-resolution enlarged video editing function
11c High-resolution enlarged video distribution function
12. Low-resolution video files
13. Low-resolution video playback program
14. High resolution enlarged video file
15 High-resolution enlarged video management table
16 High-resolution video playback program
20 Internet
30 client machines
31 Enlargement target information table
Ef expansion frame
P pointer

Claims (2)

A video distribution server that distributes a video to a client machine via the Internet,
The moving image distribution server includes a high-resolution enlarged moving image file having a frame related to an enlarged moving image having a higher resolution than the moving image being reproduced on the client machine, and an enlargement of the moving image being reproduced on the client machine received from the client machine. Means for editing the frame of the high-resolution enlarged moving image file into a frame of the enlarged designated area based on the information of the designated area; and means for transmitting an edited high-resolution enlarged moving image file including the edited frame to the client machine. A moving image distribution server, comprising: A video distribution system that distributes a video from a video distribution server to a client machine via the Internet,
The client machine has means for detecting an enlargement designated area of a moving image being reproduced, and means for transmitting information on the enlargement designated area to the moving image distribution server,
The moving image distribution server includes a high-resolution enlarged moving image file including a frame related to an enlarged moving image having a higher resolution than the moving image being reproduced on the client machine, and the high-resolution moving image file based on the enlarged designated area information received from the client machine. A moving image distribution comprising: means for editing a frame of an enlarged moving image file into a frame of the enlargement designated area; and means for transmitting an edited high-resolution enlarged moving image file including the edited frame to the client machine. system.

Images