JP2002344925A - Moving picture distributor, moving picture distribution method, moving picture distribution program, moving picture distribution program storage medium, picture designation device, picture designation method, picture designation program, picture designation program storage medium, and moving picture providing system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a moving picture providing system that can properly provide an extract image in response to a request from a transmission destination transmitting coded data. SOLUTION: In the moving picture providing system 1, an extracted image 50 is traced over past frame data Dp1 by a delay corresponding to a frame image when a personal computer 3 designates extraction of the extracted image 50 and a frame image during processing by a frame coding section 10 of a moving picture distribution server 2, after the tracing result exceeds the frame image during processing of the frame coding section 10, the extracted image 50 is sequentially extracted and the extracted image 50 is properly extracted as if a delay between the moving picture distribution server 2 and the personal computer 3 were cancelled out so that the system can properly provide the extracted image 50 in response to the request of the personal computer 3 thereby spreading the provision of the moving picture.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to a moving picture distribution apparatus, a moving picture distribution method, a moving picture distribution program, a moving picture distribution program storage medium, an image designation device, an image designation method, an image designation program, and an image designation program storage medium. The moving image providing system is suitably applied to, for example, a moving image providing system constructed by connecting a moving image distribution server and a personal computer via the Internet.

[0002]

2. Description of the Related Art In recent years, moving image data obtained while a subject is imaged by a video camera or the like is transmitted from a moving image distribution server to a personal computer via the Internet so that a moving image based on the moving image data can be personalized in real time. 2. Description of the Related Art A moving image providing system designed to be displayed on a display unit of a computer has been widely used.

In this moving image providing system, since the data transfer rate of the Internet is relatively low,
For example, MPEG2 (Moving Picture Experts Group phas
e) A compression coding method called 2) is applied, and the moving image data to be distributed is compressed and coded at a relatively high compression rate, so that the data amount is significantly reduced and distributed.

[0004]

In the moving image providing system, the moving image distribution server compresses and encodes the moving image data at a relatively high compression rate to thereby provide the resolution (moving image) of the moving image to be provided to the user. The degree of roughness and the like and the image quality (degree of presence and absence of noise and the like) are degraded, and there is a demand for providing high-resolution and high-quality moving images.

For this reason, in a moving image providing system, the ISO / IEC (International Organization for International
Standardization / International Electrotechnical Com
mission4) and MPEG4 (MPE)
It has been proposed to apply a compression coding method called G phase 4) to a moving image distribution server.

[0006] In the MPEG4 system, almost in the same manner as the MPEG2 system, a process of compressing and coding moving image data by motion compensation inter-frame prediction in frame data units (hereinafter referred to as a simple profile process) can be executed. In addition, an image of an arbitrary shape (hereinafter, referred to as an extracted image) is extracted from a frame image based on continuous frame data of moving image data while tracking the extracted image data, and data of the extracted image ( Hereinafter, it is defined that a process (hereinafter, referred to as a core profile process) of sequentially compressing and encoding the extracted image data by motion compensation inter-frame prediction (hereinafter, referred to as a core profile process) can also be executed.

Therefore, in the moving image providing system, the moving image distribution server is provided with two processing paths, one for simple profile processing and the other for core profile processing, and the moving image distribution server processes the moving image data to be distributed by the two processing paths. In the path, the simple profile processing is executed in one processing path to compress and encode the frame data of the moving image data sequentially at a high compression rate, and the core profile processing is executed in the other processing path to compare the frame data. Then, only the extracted image data having a small data amount is sequentially compression-encoded at a low compression ratio, and the obtained two types of encoded data are transmitted to a personal computer via the Internet.

When the personal computer receives the two types of encoded data transmitted via the Internet, the personal computer decodes the received two types of encoded data, respectively, and converts the obtained frame data and extracted image data. By transmitting the extracted image data to the display unit, the extracted image based on the extracted image data is superimposed on the frame image based on the frame data and displayed.

Thus, in the moving image providing system,
A part of a low-resolution and low-quality moving image can be provided to a user in real time as a high-resolution and high-quality extracted image.

In the moving image providing system having such a configuration, a simple profile process is first executed by a moving image distribution server by utilizing the fact that a part of a moving image can be distributed as a high-resolution and high-quality extracted image. Provides a low-resolution and low-quality moving image to a personal computer, and in this state, when a desired extracted image is specified from the personal computer, the moving image obtained by executing a core profile process in addition to the simple profile process It has been proposed to provide an extracted image along with.

However, in such a moving image providing system, the buffering for maintaining the quality on the Internet and the moving image distribution are actually delayed due to the data transfer rate. When extracting the frame data to be extracted together with the image, the moving image distribution server performs compression encoding on different frame data after the frame data, so that the extracted image desired by the user can be appropriately qualified. It is difficult to provide, and as a result, it is still insufficient to popularize the provision of moving images.

[0012] The present invention has been made in view of the above points, and a moving image distribution apparatus, a moving image distribution method, a moving image distribution program, a moving image distribution program storage medium, and an image designation that can popularize the provision of moving images. An apparatus, an image designation method, an image designation program, an image designation program storage medium, and a moving image providing system are proposed.

[0013]

According to the present invention, in order to solve the above-mentioned problems, moving image data is sequentially compressed and encoded in units of frame data from a moving image distribution device and transmitted to an image specifying device. When a moving image based on the moving image data is displayed via an image specifying device, when an extracting image is specified by the specifying means of the image specifying device, frame identification information indicating the specified frame data and the extracting image are specified. And the extracted image designation information to be transmitted from the image designation device to the moving image distribution device.

As a result, of the frame data already compressed and encoded by the frame encoding means by the tracking means having received the frame identification information and the extracted image designation information, the frame identification information is obtained from the frame data indicated by the frame identification information. After receiving the extracted image specified by the extracted image specification information until the frame data to be compression-encoded by the frame encoding means at the time of receiving, the extracted image is sequentially tracked between adjacent frame data thereafter. Each time, the extracted image is extracted from the frame data by the image extracting means, and is sequentially compressed and encoded at a low compression rate by the extracted image encoding means, and is transmitted from the moving image distribution device to the image designation device.

Therefore, in the moving image providing system, the delay data corresponding to the frame data when the extraction of the extracted image is designated by the image designating device and the frame data being processed by the frame encoding means of the moving image distribution device at that time. The extracted image is sequentially traced over the frame data of the frame, and the extracted image is sequentially extracted after the traced result exceeds the frame data being processed by the frame encoding means. By appropriately extracting the extracted image as if canceling the delay, it is possible to appropriately provide the extracted image according to the request of the image specifying device.

[0016]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will be described below in detail with reference to the drawings.

In FIG. 1, reference numeral 1 denotes a moving image providing system to which the present invention is applied as a whole.
And the personal computer 3 are connected to each other via the Internet 4 and constructed.

Upon receiving a moving image distribution request from the personal computer 3, the moving image distribution server 2 sequentially converts the moving image data MD obtained while the video camera 5 captures an image of a subject into a plurality of frames in units of frame data. Is taken into the distribution side frame memory 6 having the information amount of

When the frame data is taken into the distribution-side frame memory 6, the motion vector detecting section 9 reads out the frame data to be encoded (hereinafter referred to as target frame data) D1 from the distribution-side frame memory 6. By performing the division processing on a plurality of macroblocks, the divided frame data (hereinafter, referred to as division processing frame division data) D1a is generated.

The motion vector detecting section 9 reads, for example, temporally past frame data from the distribution side frame memory 6 with respect to the divided frame data D1a, and reads the divided frame data D1a and the reference frame data. The motion vector data D2 of each macroblock is detected between the data and the block by a block matching method.

The motion vector detecting section 9 associates the motion vector data D2 with the frame number of the target frame data D1 and generates the shared data D3 as shared data D3.
A, and the motion vector data D2,
The division processing frame data D1a and the frame encoding unit 1
Send to 0.

The frame encoding section 10 reduces the block size by thinning out the pixels for each macroblock from the divided processing frame data D1a sent from the motion vector detecting section 9, thereby obtaining the frame data based on the divided processing frame data. Data in which the size of the frame image is reduced (hereinafter, referred to as reduction target data) is generated.

The frame encoder 10 also generates a reduced motion vector by reducing the motion vector data D2 sent from the motion vector detector 9 in accordance with the image size of the data to be reduced.

The frame encoding unit 10 subjects the data to be reduced to compression encoding at a relatively high compression rate by motion-compensated inter-frame prediction using a reduced motion vector, thereby converting the frame encoded data D4. It is generated and distributed to the personal computer 3 via the distribution-side transmission unit 11 and the Internet 4 sequentially.

As described above, the moving image distribution server 2 sequentially compresses and encodes the moving image data MD obtained while the subject is imaged by the video camera 5 in units of target frame data D1, and converts the obtained frame coded data D4. The content is distributed to the personal computer 3.

The personal computer 3 receives the encoded frame data D4 distributed from the moving image distribution server 2 via the Internet 4 and receives the encoded frame data D4 each time the receiving unit 15 receives the encoded frame data D4. To 16.

The moving picture decoding unit 16 restores the original target frame data D1 by performing a decoding process on the coded frame data D4 sent from the receiving unit 15 and receives the decoded data. 17 and temporarily stored, and then sequentially transmitted to the display unit 18 to display a frame image based on the target frame data D1 on the display unit 18.

As a result, the personal computer 3
A moving image based on the moving image data MD distributed from the moving image distribution server 2 can be provided to the user via the display unit 18.

By the way, the personal computer 3 operates the operation input unit while displaying a moving image on the display unit 18 (ie, receiving the frame coded data D4 transmitted from the moving image distribution server 2). When a predetermined area (for example, a person) on the display screen desired by the user is designated via the interface 19, the moving image distribution server 2 changes the only the designated area to a high-resolution and high-quality display pattern. It is designed to provide an image.

That is, as shown in FIG. 2, the designated data generator 20 of the personal computer 3
For example, in the 25th frame image GR25 displayed in FIG. 1 (hereinafter referred to as a user-specified image), a rectangular shape including the person 24 as an extraction area desired by the user using the operation input unit 19 (Hereinafter, referred to as a tracking area) 30, a predetermined designation operation is performed to generate the tracking area 30 as tracking area data D5.

At this time, the designated data generating unit 20 converts the frame number data D6 indicating the frame number of the user designated image GR25 displayed on the display unit 18 into the moving image decoding unit 16
, And the read frame number data D6
Then, the generated tracking area data D5 and the generated tracking area data D5 are transmitted as designated data D7 to the moving image distribution server 2 via the receiving side transmitting unit 21 and the Internet 4 sequentially.

Upon receiving the designated data D7 transmitted from the personal computer 3 via the distribution-side receiving unit 12, the moving image distribution server 2 sends it to the motion tracking / shape extracting unit 7.

The motion tracking / shape extracting unit 7 transmits the designated data D7 from the personal computer 3 to the distribution-side receiving unit 1.
2, the motion vector detection unit 9 reads out the same target frame data D1 as the target frame data D1 to be read out from the distribution-side frame memory 6 and stores the frame number of the target frame data D1 in the internal counter ( (Not shown), only the counting is performed, whereby the power consumption of the moving image distribution server 2 as a whole can be reduced as much as possible.

Accordingly, upon receiving the designated data D7, the motion tracking / shape extracting unit 7 shifts to the normal mode, and as shown in FIG. 3, from the user designated image GR25 indicated by the frame number data D6 of the designated data D7, For example, the 50th frame image counted by the internal counter at the time of mode transition (that is, processed by the frame encoding unit 10) (hereinafter, referred to as a currently processed image)
By executing a tracking process of tracking the tracking area 30 based on the tracking area data D5 of the designated data D7 on each frame image (hereinafter referred to as a difference image group) GRG up to GR50, the current processing is performed. Medium image GR50
The movement position of the tracking area 30 at the position is detected.

Here, the distribution-side frame memory 6 stores the frame data constituting the moving image data MD in, for example, 300 frames.
A frame having a storage capacity capable of storing the number of frames is selected, so that the motion tracking / shape extracting unit 7 generates past frame data (hereinafter referred to as past frame data) D1p for the target frame data and D1. Are set in a readable state.

The shared memory 9A is made readable as needed by the motion tracking / shape extraction unit 7 which requires the motion vector data D2. The processing for detecting the data D2 can be avoided, so that the processing speed of the entire moving image distribution server 2 can be improved.

That is, the motion tracking / shape extracting unit 7 transmits the past frame data D1p and the shared data D3 (the motion vector data D2 and the frame number) corresponding to the frame number data D6 of the user-specified image GR25 to the corresponding delivery-side frames. Read from the memory 6 and the shared memory 9A.

The motion tracking / shape extracting unit 7 uses the motion vector data of all the macroblocks related to the tracking area 30 based on the tracking area data D5 in the user-specified image GR25 among the motion vector data D2 of the shared data D3. Then, between the past frame data D1p of the user-specified image GR26 adjacent to the past frame data D1p of the user-specified image GR25 read from the distribution-side frame memory 6, the movement positions of all macroblocks related to the tracking area 30 are roughly detected. I do.

Further, the motion tracking / shape extraction unit 7 uses the line data to roughly detect the movement position of the tracking area 30 between the past frame data D1p of the user-specified image GR25 and the past frame data D1p of the user-specified image GR26. By detecting again in detail by the matching method, the moving position of the tracking area 30 can be detected with high accuracy.

Further, the motion tracking / shape extracting unit 7 executes a tracking process on the difference image group GRG after the user-specified image GR25 in the same manner as the tracking process on the user-specified image GR25.

Thus, the motion tracking / shape extracting unit 7
Each time the past frame data D1p corresponding to each frame number of the differential image group GRG is sequentially read from the distribution side frame memory 6, the motion vector detection is performed in advance without detecting the motion vector data D2 requiring a large processing capability. By using the motion vector data D2 stored in the shared memory 9A by the unit 9 and roughly detecting the moving position of the tracking area 30 in the differential image group GRG, detecting again in detail by the line matching method,
The moving position of the tracking area 30 in the currently processed image GR50 can be detected with high processing accuracy with a small processing capability.

Accordingly, the motion tracking / shape extraction unit 7 sets the user-specified image GR25 when receiving the specified data D7,
At that time, it is possible to shorten the processing time for detecting the moving position of the tracking area 30 in the difference image group GRG generated between the current image GR50 and the currently processed image GR50 that is being processed by the frame encoding unit 10. The tracking area motion vector data in the currently processed image GR50 can be detected immediately before the compression processing of the currently processed image GR50 is completed.

Accordingly, the motion tracking / shape extracting unit 7 performs the tracking process on the target frame data D1 of the frame images after the currently processed image GR50 and the frame encoding unit 1.
It can be performed almost in parallel with the detection processing of the motion vector data D2 by 0.

In this state, the motion tracking / shape extraction unit 7 stores the target frame data D1 and the shared data D3 (the motion vector data D2 and the frame number) corresponding to the frame numbers of the frame images after the currently processed image GR50, respectively. The data is read from the corresponding delivery-side frame memory 6 and shared memory 9A.

Each time the motion tracking / shape extracting unit 7 detects tracking motion vector data of the tracking area 30, the motion tracking / shape extracting unit 7 shown in FIG.
As shown in (1), the tracking area 30 is cut out, and the cut-out tracking area 30 is overlapped with a frame 40 designated in advance for extracting an extracted image of an arbitrary shape (for example, an ellipse) from the cut-out tracking area 30. The extracted image 50 surrounded by the frame 40 so that the original pattern is left as it is, and the original image is left as it is inside the frame 40 from the tracking area 30 and is replaced with a pixel representing black, for example, so as not to be displayed on the receiving side outside. Is extracted.

In addition, the motion tracking / shape extracting unit 7
As shown in FIG. 5, every time the tracking area 30 is extracted,
A mask pattern image 35 for exposing the extracted image 50 to the tracking area 30 and covering the peripheral portion of the extracted image 50 to present the shape of the extracted image 50 to the receiving side is also generated.

Then, the motion tracking / shape extracting unit 7 extracts the data of the extracted image 50 (in this case, also includes the peripheral part replaced with black pixels in the tracking area 30) and the data of the generated mask pattern image 35 ( Hereinafter, this will be referred to as mask pattern data) and the tracking motion vector data as extracted image data D9.
To send to.

Here, when the extracted image data D9 is not supplied from the motion tracking / shape extracting unit 7, the arbitrary shape encoding unit 8 performs only a standby operation for waiting for an output from the motion tracking / shape extracting unit 7. Is performed, whereby the power consumption of the moving image distribution server 2 can be reduced as much as possible.

Therefore, the arbitrary shape encoding unit 8 performs motion tracking /
When the coded extracted image data D9 is given from the shape extracting unit 7, the mode shifts to the normal mode, and the extracted image data of the extracted coded image data D9 is extracted in units of macroblocks having the original image size. The compression coding is performed at a relatively low compression rate by motion compensation inter-frame prediction using vector data, and similarly, the mask pattern data of the extracted image coded data D9 is also compression-coded at a relatively low compression rate, whereby the compression coding is performed. Extracted image data and mask pattern data are converted into extracted image compressed data D10.
To the personal computer 3 via the distribution-side transmission unit 11 and the Internet 4 sequentially.

As described above, when the moving image distribution server 2 receives the designated data D7, the moving image distribution server 2 waits for the frame encoding unit 10 to finish encoding the currently processed image GR50.
The tracking motion vector data of the tracking area 30 up to the currently processed image GR50 is immediately detected, and thereafter, the target frame data D1 of the frame images after the currently processed image GR50.
Each time the frame encoding unit 10 and the arbitrary shape encoding unit 8 perform compression encoding substantially in parallel, the frame encoding data D4 obtained by compressing and encoding the extracted image compressed data D10 and the extracted compressed image data D10 are both transmitted to the distribution side. The data is distributed to the personal computer 3 via the transmission unit 11 and the Internet 4 sequentially.

In this case, the personal computer 3
While the differential image group GRG is sequentially displayed on the display unit 18, the frame encoded data D 4 and the extracted image compressed data D 10 distributed from the moving image distribution server 2 via the Internet 4 are received by the receiving unit 15. Each time it is performed, it is sequentially transmitted to the video decoding unit 16.

The moving image decoder 16 decodes the frame coded data D4 and the extracted compressed image data D10 to sequentially restore the original target frame data D1, the extracted image data and the mask pattern data. This is sent to the receiving side frame memory 17, temporarily stored, and then sent out to the display unit 18 sequentially, as shown in FIG. 6, into a low-resolution and low-quality frame image based on the target frame data D1. A frame image (hereinafter, referred to as a superimposed image) 60 having a display pattern that superimposes a high-resolution and high-quality extracted image 30 based on the extracted image data and the mask pattern data can be provided.

FIG. 7A shows a summary of the display pattern changing processing procedure in the moving image providing system 1 of the moving image distribution processing by the moving image distribution server 2 and the image designation processing by the personal computer 3. As shown, first, the receiving personal computer 3
Step SP1 following the start step of the routine RT1
Move on to

In step SP1, the personal computer 3 makes a distribution request to the moving image distribution server 2 and proceeds to step SP2.

In step SP2, the personal computer 3 restores the original target frame data D1 by sequentially decoding the coded frame data D4 distributed from the moving image distribution server 2, and restores the target frame data D1. The frame images based on D1 are sequentially displayed via the display unit 18, and the process proceeds to step SP3.

In step SP3, the personal computer 3 operates the operation input unit 19 while displaying a frame image based on the target frame data D1 on the display unit 18.
It is determined whether or not the tracking area 30 desired by the user has been designated via the.

If a negative result is obtained here, this indicates the user's intention to want to view the moving image based on the frame coded data D4 distributed from the moving image distribution server 2 as it is. The personal computer 3 returns to step SP2 and
Until is designated, the frame images based on the target frame data D1 are sequentially displayed via the display unit 18.

On the other hand, if a positive result is obtained, this means that the user who wants to view only a specific area of the moving image based on the frame coded data D4 distributed from the moving image distribution server 2 with high image quality. The intention of
At this time, the personal computer 3 proceeds to step S
Move to P4.

In step SP4, the personal computer 3 sets the tracking area data D5 representing the tracking area 30 specified on the display screen of the display unit 18 via the operation input unit 19 and the target of the frame image at the time of the specification. The frame number data D6 indicating the frame number corresponding to the frame data is transmitted to the moving image distribution server 2 as the designated data D7, and the process proceeds to step SP5.

In step SP5, the personal computer 3 sequentially decodes the encoded frame data D4 and the extracted compressed image data D10 distributed from the moving image distribution server 2 to obtain the original target frame data D1, The image data and the mask image data are restored, the superimposed images 60 are sequentially displayed via the display unit 18 based on these data, and the process proceeds to step SP6 to end the image designation processing.

On the other hand, as shown in FIG. 7B, the moving image distribution server 2 proceeds from the start step of the routine RT2 to the subsequent step SP11.

In step SP11, the moving image distribution server 2 compresses and encodes the moving image data MD obtained while the subject is captured by the video camera 5 in units of target frame data D1 by motion compensation inter-frame prediction in order to perform frame coding. Generates the encrypted data D4 and distributes it to the personal computer 3, following step SP12
Move on to

In step SP12, the moving image distribution server 2 determines whether or not the designated data D7 transmitted from the personal computer 3 has been received.

If a negative result is obtained here, the moving image distribution server 2 returns to step SP11 and continues to transmit only the frame coded data D4 until receiving the designated data D7 from the personal computer 3.

On the other hand, if a positive result is obtained, the moving image distribution server 2 executes the image extraction processing shown in FIG.
That is, the moving image distribution server 2 proceeds to the subsequent step SP21 from the start step of the subroutine SRT.

In step SP21, the moving image distribution server 2 sets the frame number to be processed by the arbitrary shape coding unit 8 (that is, the frame number being processed by the frame coding unit 10, hereinafter referred to as the frame number being processed). Is changed to the frame number indicated by the frame number data D6 of the designated data D7 (hereinafter, referred to as the past frame number), and the routine goes to the subsequent step SP22.

In step SP22, the moving image distribution server 2 deletes the past frame number from the designated data D7, thereby avoiding erroneous operation by leaving the past frame number, and following step SP23. Move on to

In step SP23, the moving image distribution server 2 reads out the past frame data D1p corresponding to the past frame number from the distribution side frame memory 6, and proceeds to step SP24.

In step SP24, the moving image distribution server 2 reads the motion vector data D2 corresponding to the past frame number from the shared memory 9A, and reads the past frame data D1p read from the distribution frame memory 6 using the motion vector data D2. Then, the movement position of the tracking area 30 based on the tracking area data D5 of the designated data D7 is tracked, and the routine goes to step SP25.

In step SP25, the moving image distribution server 2 determines whether or not the past frame number matches the frame number being processed by the frame encoding unit 10 (hereinafter, referred to as the frame number being processed). I do.

Here, if a negative result is obtained, this means that the past frame number whose changed frame number is being processed is:
This indicates that the current frame number currently being processed by the frame encoding unit 10 has not been reached. At this time, the moving image distribution server 2 proceeds to step SP26.

In step SP26, the moving image distribution server 2 increments the past frame number by one frame, and returns to step SP23 to return the past frame data D1 corresponding to the past frame number incremented by one frame.
p is read from the distribution side frame memory 6, and the tracking area 30 based on the tracking area data D5 of the specified data D7 is tracked with respect to the read past frame data D1p.

As described above, the moving image distribution server 2 performs tracking based on the tracking area data D5 of the designated data D7 each time the past frame number is sequentially incremented by one frame in step SP26 until a positive result is obtained in step SP25. An area 30 is tracked.

If a positive result is obtained in step SP25, this means that the past frame number whose frame number being processed has been changed has reached the current frame number being processed by the frame encoding unit 10. At this time, the moving image distribution server 2 proceeds to the subsequent step SP27.

In step SP27, the moving image distribution server 2 extracts the extracted image 50 every time the target frame data D1 after the currently processed frame number is read out.
A mask pattern image 35 is generated, and extracted image coded data D9 composed of extracted image data and mask pattern data obtained based on these and extracted image motion vector data is generated, and step SP13 (FIG. 7B) Move on to

In step SP13, the moving image distribution server 2 converts the extracted image data of the extracted image coded data D9 into macroblock units having the original image size.
Compression encoding at a relatively low compression rate by motion compensated inter-frame prediction using extracted image motion vector data, and similarly, mask coding of extracted image encoded data D9 at a relatively low compression rate. To generate extracted image compressed data D10 from the compressed and encoded extracted image data and mask image data, and
Move to 4.

In step SP 14, the moving image distribution server 2 adds the extracted image compression data D 4 to the frame encoded data D 4 distributed to the personal computer 3.
10 is also started, and the process moves to step SP15 to end the moving image distribution process.

In the moving image providing system 1 described above,
When the moving image data MD is sequentially compressed and encoded in units of frame data from the moving image distribution server 2 and transmitted to the personal computer 3, and a moving image based on the moving image data MD is displayed via the personal computer 3, the personal computer 3 When the tracking area 30 is designated by the operation input unit 19 of the computer 3, frame number data D6 indicating the frame number of the user-specified image GR25 at which the tracking of the tracking area 30 is started by the designated data generating unit 20 of the personal computer 3. And the tracking area data D5 that specifies the tracking area 30 is transmitted from the personal computer 3 to the moving image distribution server 2.

As a result, the frame number data D6 of the target frame data D1 already compressed and encoded by the frame encoding unit 10 by the motion tracking and shape extracting unit 7 of the moving image distribution server 2 receiving the designated data D7 The tracking area designated as the tracking area data D5 from the indicated past frame data D1p to the target frame data D1 of the currently processed image GR50 to be compression-encoded by the frame encoding unit 10 when the designated data D7 is received. After tracing the tracking area 30, the arbitrarily-shaped encoding unit 8 sequentially extracts the extracted image data from the target frame data D1 at a low compression rate every time the tracking area 30 is tracked between adjacent frame data. The data is compressed and coded and transmitted from the moving image distribution server 2 to the personal computer 3.

Therefore, in the moving image providing system 1, even when a delay corresponding to the difference image group GRG occurs when the moving image data MD is distributed between the moving image distribution server 2 and the personal computer 3, the motion tracking is performed.・ Shape extraction unit 7
By sequentially tracking the movement of the tracking area 30 from the designated past frame data Dp1 along the time axis, reflecting the tracking result on the target frame data D1 from the current time onward, and sequentially extracting the extracted image 50 Thus, the extracted image 50 according to the request of the personal computer 3 can be provided appropriately.

According to the moving image providing system 1 described above, the frame image when the extraction of the extracted image 50 is designated by the personal computer 3 and the moving image distribution server 2
The extracted image 50 is sequentially traced over the past frame data Dp1 corresponding to the delay corresponding to the frame image being processed by the frame encoding unit 10 of FIG. After that, the extracted images 50 are sequentially extracted, and the extracted images 50 are appropriately extracted so as to cancel the delay between the moving image distribution server 2 and the personal computer 3, thereby meeting the requirements of the personal computer 3. The corresponding extracted image 50 can be provided appropriately, and thus the provision of the moving image can be spread.

In the above embodiment, the case where the personal computer 3 specifies the tracking area 30 only once has been described. However, the present invention is not limited to this, and the tracking area 30 may be specified many times.

In this case, the moving image distribution server 2 includes a plurality of new motion tracking / shape extraction units and an arbitrary shape encoding unit in addition to the motion tracking / shape extraction unit 7 and the arbitrary shape encoding unit 8. Tracking / shape extraction unit 7 and arbitrary shape encoding unit 8
Are provided in parallel with each other.
8 so that a tracking image can be designated.

In practice, the designated data generating unit 20 of the personal computer 3 performs the tracking area data D every time the specifying operation for specifying the tracking area is performed through the operation input unit 19.
5 and the designated data D7 including the frame number data D6 are transmitted to the moving image distribution server 2.

Each time the plurality of motion tracking / shape extracting units 7 receives the designated data D7 from the personal computer 3, it sequentially shifts from the standby mode to the normal mode.
Performs the above-described image extraction processing, and sends the result to the corresponding arbitrary shape encoding unit 8 at the subsequent stage.

When the plurality of arbitrary shape encoding units 8 are provided with the extracted image encoded data D9 from the corresponding preceding stage motion tracking / shape extracting unit 7, the plurality of arbitrary shape encoding units 8 shifts from the standby mode to the normal mode, and Generate D10.

In this way, in the moving image distribution image distribution system 1, a plurality of extracted images corresponding to a plurality of requests from the personal computer 3 can be provided appropriately.

In the above-described embodiment, the case has been described where the moving image distribution server 2 distributes the moving image data MD obtained while capturing the image with the video camera 5 to the personal computer 3. Not limited to, for example, D connected to the outside of the moving image distribution server 2
The moving image data MD obtained while reading from a recording medium such as a VD (Digital Versatile Disk) may be distributed to the personal computer 3.

In this case, the moving image distribution server 2 sends the frame number data D5 of the designated data D7 from the distribution side frame memory 6 having a storage capacity capable of storing 300 frames, for example, by the motion tracking / shape extraction unit 7.
Can be read out from the externally connected recording medium without reading out the past frame data D1p that matches the above, so that the distribution side frame memory 6 can be avoided.

Further, in the above embodiment, FIG.
As shown in the figure, the elliptical frame 40 is the moving image distribution server 2
However, the present invention is not limited to this, and as shown in FIG.
5 is automatically selected, or a frame of various other shapes such as a star shape or a round shape other than the elliptical shape is designated to the motion tracking / shape extraction unit 7. Shapes can be widely applied.

Further, in the above-described embodiment, the generated data generating unit 20 uses the frame number (frame number data D
Although the case 5) has been described, the present invention is not limited to this. For example, a frame image when a designation operation is performed using various other frame identification information such as a time stamp may be shown.

Further, in the above-described embodiment, the transmitting side transmitting section 11 as the frame transmitting means and the extracted image transmitting means transmits the frame coded data D4 and the extracted image coded data D10 via separate transmission lines. And
The case has been described where the receiving side receiving unit 15 as the frame receiving unit and the extracted image receiving unit receives the encoded frame data D4 and the extracted image encoded data D10 through separate transmission lines, respectively. Not limited to, the frame encoded data D4 and the extracted image encoded data D1
0 may be multiplexed and transmitted / received on one transmission line.

Further, in the above-described embodiment, the distribution-side transmission unit 11 as the frame transmission unit and the extracted image transmission unit and the distribution-side reception unit 12 as the reception unit have separate circuit configurations. Although a case has been described where the receiving side receiving unit 15 as the extracted image receiving unit and the receiving side transmitting unit 21 as the transmitting unit have separate circuit configurations, the present invention is not limited to this. Each of the distribution-side receiving unit 12, the receiving-side receiving unit 15, and the receiving-side transmitting unit 21 may have one circuit configuration.

Further, in the above-described embodiment, FIG.
When the rectangular tracking area 30 is specified by the operation input unit 19 as shown in FIG. 7, the designated data generating unit 20 as generating means for generating tracking area data D5 as extracted image specifying information representing the tracking area 30 is set. Although the description has been given of the case where the present invention is applied, the present invention is not limited to this, and the operation input unit 1 is provided as shown in FIG.
For example, when an arbitrary point 41 on the person 24 is designated in the frame image GR25 by the frame image 9, the peripheral edge (about the pixel of the point 41) based on the pixel information indicating the luminance, the color difference, and the like of the pixel of the point 41 That is, the outline of a person or the like) 4
Generating means for extracting extracted image designation information representing a rectangular tracking area having an arbitrary size so as to include the extracted edge, or extracting image designation information representing a coordinate position of the edge 43; Various other generating means for generating other extracted image specifying information, such as generating means for generating, or generating means for generating extracted image specifying information representing the person 24 itself including the edge 43, can be widely applied. .

Further, in the above-described embodiment, the frame encoding section 10 as a frame encoding means for compression-encoding at a relatively high compression rate, and the extracted image encoding means for compression-encoding at a relatively low compression rate However, the present invention is not limited to this case. If the amount of data transmitted from the distribution-side transmission unit 11 falls within the transfer rate to the reception side, the comparison is performed. Various other frame encoding means and extracted image encoding means, such as a frame encoding means for compressing and encoding at an extremely low compression rate, and an extracted image encoding means for compressing and encoding at a relatively high compression rate, are widely applied. be able to.

Further, in the above-described embodiment, the moving picture decoding section 16 as the frame decoding means and the extracted picture decoding means has the same circuit configuration. However, the present invention is not limited to this, and the present invention is not limited to this. good.

Further, in the above-described embodiment, a case is described in which a motion vector detecting section 9 for detecting a motion vector in macroblock units is applied as a motion vector detecting means for detecting a motion vector between frame images of moving image data. As described above, the present invention is not limited to this. If a motion vector between frame images of moving image data can be detected, various other motion vector detection means such as a motion vector detecting means for detecting a motion vector by an optical flow, etc. The means can be widely applied.

Further, in the above-described embodiment, the motion tracking / shape extracting unit 7 as the tracking means uses the designated data D7.
Past frame data D1p (frame data already compressed and encoded by the frame encoding unit 10) and subsequent frame data D1 that match the frame number data D6
Each time 1p is sequentially read from the distribution side frame memory 6,
The case where the tracking area 30 is sequentially tracked at one frame interval (loop processing of SP24-SP25-SP26 in the image processing procedure shown in FIG. 8) using the motion vector data D2 corresponding to the past frame data D1p has been described. The present invention is not limited to this. For example, every time the past frame data D1p is read from the distribution-side frame memory 6 at an arbitrary interval such as a two-frame interval or a five-frame interval,
The tracking area 30 may be tracked using the motion vector data D2 corresponding to the past frame data D1p.

In this case, the motion tracking / shape extracting unit 7 can track the tracking area 30 at a much lower processing speed.

Further, in the above-described embodiment, each time the motion tracking / shape extracting unit 7 as the image extracting means sequentially reads out the past frame data D1p after the past frame data D1p that matches the frame number data D5 of the designated data D7. Next, the tracking area 30 is sequentially tracked using the motion vector data D2 corresponding to the past frame data D1p, and when the tracking area 30 catches up with the currently processed image GR50 being processed by the frame encoding unit 10 (that is, as shown in FIG. 8). (When a positive result is obtained in SP25 in the image processing procedure)
Has been described in which the tracking area 30 is extracted from the data and compressed and encoded by the arbitrary shape encoding unit 8. However, the present invention is not limited to this. Image G currently being processed by the conversion unit 10
The tracking area 30 may be compression-encoded by the arbitrary shape encoding unit 8 after catching up with R50.

In this case, the motion tracking / shape extracting unit 7 can appropriately perform the tracking of the tracking area 30 in which the shape, the luminance and the chromaticity do not change. Thus, the tracking processing and the extracting processing with higher accuracy can be achieved. It can be performed.

Further, in the above-described embodiment, each time the motion tracking / shape extracting unit 7 as the tracking means detects the moving position of the extracted image in each frame image based on arbitrary frame data using the motion vector. Although the case where the moving position is re-detected by the line matching method has been described, the present invention is not limited to this. For example, the moving position may be re-detected by the pixel-by-pixel block matching method. The state may be detected again by the block matching method.

Further, in the above-described embodiment, the moving image distribution server 2 as the moving image distribution device and the personal computer 3 as the image designation device are constructed by being connected to each other via the Internet 4 as the transmission path. The present invention is not limited to this case. For example, a moving image constructed by connecting a video camera-integrated personal computer and a mobile phone to each other via the Internet is described. An image providing system or a moving image providing system constructed by connecting a mobile phone connected to a video camera and a PDA (Personal Digital Assistants) to each other via a dedicated line, and furthermore, a television broadcasting apparatus and a television apparatus Other types such as a moving image providing system connected to each other via satellite broadcasting Of the moving image distribution apparatus, an image specifying device and the transmission path can be widely applied to the moving picture providing system comprising various combinations.

In this case, the moving image distribution device and the image designating device may execute the moving image distribution process and the image designation process with the hardware of each corresponding circuit block described above with reference to FIG. Instead of FIG.
A moving image distribution device and an image corresponding to the moving image distribution program for executing the moving image distribution process described above with respect to FIG. 8A and the image designation program for executing the image designation process described above with reference to FIG. The moving image distribution device and the image designation device may execute the corresponding moving image distribution process and the image designation process, respectively, by being installed in the designated device and using the software of each program.

Further, in order to install the moving image distribution program and the image designation program in the corresponding moving image distribution device and image designation device, respectively, the moving image distribution program and the image designation program or a program storing either one of the programs are stored. A storage medium may be used, a wired or wireless communication medium such as a local area network, the Internet, or digital satellite broadcasting may be used. Alternatively, the storage medium may be installed via various communication interfaces such as a router and a modem.

In order to install the moving image distribution program and / or the image designation program in the moving image distribution device and / or the image designation device so that the moving image distribution program and / or the image designation program can be executed. For example, a floppy (registered trademark) disk, a CD-ROM
(Compact Disc-Read Only Memory), DVD (Digita
l Versatile Disc) or other package media, as well as a semiconductor memory or a magnetic disk in which a program is temporarily or permanently stored. Also,
As a means for storing the program in these program storage media, a wired or wireless communication medium such as a local area network, the Internet, or digital satellite broadcasting may be used, and the program may be stored via various communication interfaces such as a router or a modem. You may do it.

[0107]

As described above, according to the present invention, moving image data is sequentially compressed and encoded in units of frame data from the moving image distribution device and transmitted to the image specifying device, and the moving image data is transmitted via the image specifying device. When an extracted image is specified by the specifying means of the image specifying device while displaying a moving image based on the extracted image, frame identification information indicating the specified frame data and extracted image specifying information specifying the extracted image Are transmitted from the image designation device to the moving image distribution device.

As a result, of the frame data already compressed and encoded by the frame encoding means by the tracking means having received the frame identification information and the extracted image designation information, the frame identification information is obtained from the frame data indicated by the frame identification information. After receiving the extracted image specified by the extracted image specification information until the frame data to be compression-encoded by the frame encoding means at the time of receiving, the extracted image is sequentially tracked between adjacent frame data thereafter. Each time, the extracted image is extracted from the frame data by the image extracting means, and is sequentially compressed and encoded at a low compression rate by the extracted image encoding means, and is transmitted from the moving image distribution device to the image designation device.

Therefore, in the moving image providing system, the frame when the extraction of the extracted image is specified by the image specifying device is equal to the delay corresponding to the frame data being processed by the frame encoding means of the moving image distribution device at that time. The extracted image is sequentially traced over the frame data of every minute, the extracted image is sequentially extracted after the tracking result exceeds the frame data being processed by the frame encoding means, and the extracted image is sequentially extracted between the moving image distribution device and the image designation device. By appropriately extracting the extracted image as if canceling out the delay of the extracted image, it is possible to appropriately provide the extracted image according to the request of the image designation device, and thus,
The provision of moving images can be spread.

[Brief description of the drawings]

FIG. 1 is a block diagram showing an overall configuration of a moving image providing system to which the present invention is applied.

FIG. 2 is a schematic diagram used for describing tracking area designation.

FIG. 3 shows a frame image in which a user designates a tracking image;
FIG. 9 is a schematic diagram used to explain a frame image being processed on the moving image distribution server side at this time.

FIG. 4 is a schematic diagram for explaining extraction of an extracted image;

FIG. 5 is a schematic diagram illustrating a configuration of a mask image that specifies a shape of an extracted image.

FIG. 6 is a schematic diagram for explaining a superimposed image displayed on a display unit.

FIG. 7 is a flowchart illustrating a display pattern change processing procedure in the moving image providing system.

FIG. 8 is a flowchart illustrating an image extraction processing procedure.

FIG. 9 is a schematic diagram for explaining a shape designation for displaying an extracted image according to another embodiment;

FIG. 10 is a schematic diagram used for describing tracking area designation according to another embodiment.

[Explanation of symbols]

1 ... moving image providing system, 2 ... moving image distribution server,
3 ... Personal computer, 4 ... Internet, 6 ... Distribution side frame memory, 7 ... Motion tracking / shape extraction unit, 8 ... Arbitrary shape encoding unit, 9 ... Motion vector detection unit, 10 ... Frame Encoding unit, 11 ... distribution side transmission unit, 12 ... distribution side reception unit, 15 ... reception side reception unit, 16 ... video decoding unit, 17 ... reception side frame memory, 18 ... display unit, 19 ... operation input section, 20 ...
Designation information generation unit, 21 receiving side transmission unit, 30 tracking area, 35 mask pattern image, 40 frame, 50
...... Extracted image, MD ... Moving image data, D1 ... Target frame data, D1p ... Past frame data, D1a
... Divided frame data D2 Motion vector data D3 Shared data D4 Frame encoded data D5 Tracking area data D6 Frame number data D7 Designated information D9 ... Extracted image coded data, D10 ... Extracted image compressed data, GR25 ... User specified image, GR50 ... Currently processed image, GRG ...
... Difference image group.

 ──────────────────────────────────────────────────続 き Continued on the front page F term (reference) 5C059 KK37 LB05 MA00 MB01 MB11 MB16 MB22 MB27 NN01 NN21 PP04 PP28 RA08 RB01 RC16 RC40 SS08 SS20 TA00 TA06 TC45 UA02 UA05 UA33 UA34 UA39 5C064 BA07 BC16 BC18 BC20 BD02 BD08 (54) Title of the invention] Moving image distribution device, moving image distribution method, moving image distribution program, moving image distribution program storage medium, image designation device, image designation method, image designation program, image designation program storage medium, and moving image distribution system

Claims (12)

[Claims] 1. A frame encoding means for sequentially compressing and encoding moving image data to be transmitted in units of frame data to generate frame encoded data, and a frame transmitting means for sequentially transmitting the frame encoded data to an image specifying device. And frame identification information indicating the frame data designated to start extraction of an extracted image among the frame data obtained by decoding the frame encoded data transmitted from the image specifying device; and Receiving means for receiving extracted image designation information for designating an image; and any of the above-mentioned frame data indicated by the frame identification information among the frame data already compressed and encoded by the frame encoding means. The extracted image in each frame image based on the arbitrary frame data using the frame data Tracking means for tracking the extracted image specified by the constant information; image extracting means for extracting extracted image data of the extracted image tracked by the tracking means from any of the frame data; tracking by the tracking means The extracted image data is sequentially compression-encoded at a compression rate different from that of the frame-encoded data from the time when the frame data used for the frame-encoding and the frame data to be compression-encoded by the frame-encoding transmission means coincide with each other. A moving image distribution device comprising: an extracted image encoding unit that generates extracted image encoded data; and an extracted image transmitting unit that transmits the extracted image encoded data to the image specifying device. 2. The apparatus according to claim 1, wherein said frame encoding means includes a motion vector detecting means for detecting a motion vector between the continuous frame data, and said tracking means uses said motion vector in common with said frame encoding means. The moving image distribution apparatus according to claim 1, wherein the extracted image specified by the extracted image specifying information is tracked in each frame image based on the arbitrary frame data. 3. The tracking means re-detects the moving position at least in pixel units each time the moving position of the extracted image is detected in each frame image based on any of the frame data using the motion vector. The moving image distribution apparatus according to claim 2, wherein the extracted image is tracked. 4. The moving picture distribution apparatus according to claim 1, wherein the extracting means extracts the extracted image every time the tracking means tracks the extracted image data of the extracted image. . 5. A frame encoding step of sequentially compressing and encoding moving image data to be transmitted in units of frame data to generate encoded frame data, and a frame transmitting step of sequentially transmitting the encoded frame data to an image designating apparatus. And frame identification information indicating the frame data designated to start extraction of an extracted image among the frame data obtained by decoding the frame encoded data transmitted from the image specifying device; and A receiving step of receiving extracted image designation information for designating an image; and any one of the above-mentioned frame data indicated by the frame identification information among the frame data already compressed and encoded among the moving image data. The above extraction is performed in each frame image based on the arbitrary frame data using the frame data. A tracking step of tracking the extracted image specified by the image specifying information; an image extracting step of extracting extracted image data of the tracked extracted image from any of the frame data; and a tracking step of tracking the extracted image. The extracted image data is sequentially compressed and encoded at a compression rate different from that of the frame encoded data from the time when the frame data and the frame data to be compression encoded of the moving image data match. A moving image distribution method, comprising: an extracted image encoding step of generating encoded data; and an extracted image transmitting step of transmitting the extracted image encoded data to the image specifying device. 6. A frame encoding step of sequentially compressing and encoding moving image data to be transmitted in units of frame data to a moving image distribution apparatus to generate frame encoded data; Transmitting a frame to a designated device; and transmitting the frame data designated to start extraction of an extracted image among the frame data transmitted from the image designation device and obtained by decoding the frame encoded data. Receiving the frame identification information indicating the extracted image and the extracted image designation information for designating the extracted image; and indicating the frame identification information among the frame data already compressed and encoded in the moving image data. Based on each of the arbitrary frame data using any of the above frame data after the frame data A tracking step of tracking the extracted image specified by the extracted image specifying information in each frame image; and an image extracting step of extracting extracted image data of the tracked extracted image from any of the frame data. From the time when the frame data used for tracking the extracted image and the frame data to be compression-encoded in the moving image data coincide with each other, the extracted image data is sequentially converted at a compression rate different from that of the frame-encoded data. A moving image distribution program for executing an extracted image encoding step of compressing and encoding to generate extracted image encoded data, and an extracted image transmitting step of transmitting the extracted image encoded data to the image specifying device. 7. A frame encoding step of sequentially compressing and encoding moving image data to be transmitted in units of frame data to generate frame encoded data, and a frame transmitting step of sequentially transmitting the frame encoded data to an image specifying device. And frame identification information indicating the frame data designated to start extraction of an extracted image among the frame data obtained by decoding the frame encoded data transmitted from the image specifying device; and A receiving step of receiving extracted image designation information for designating an image; and any one of the above-mentioned frame data indicated by the frame identification information among the frame data already compressed and encoded among the moving image data. Using the frame data, the extraction is performed in each frame image based on the arbitrary frame data. A tracking step of tracking the extracted image specified by the image specifying information; an image extracting step of extracting extracted image data of the tracked extracted image from any of the frame data; and a tracking step of tracking the extracted image. The extracted image data is sequentially compressed and encoded at a compression rate different from that of the frame encoded data from the time when the frame data and the frame data to be compression encoded of the moving image data coincide with each other. Executing a moving image distribution program on a moving image distribution device, comprising: an extracted image encoding step of generating encoded data; and an extracted image transmitting step of transmitting the extracted image encoded data to the image designation device. A moving image distribution program storage medium to be executed. 8. A frame receiving means for receiving frame encoded data transmitted from a predetermined moving image distribution device for sequentially compressing and encoding moving image data to be transmitted in units of frame data, and decoding the frame encoded data Decoding means for decoding, and an extraction image to be extracted from within a frame image based on frame data using a decoding result of the frame encoded data, and designation means for designating the frame data to start extracting the extraction image Transmitting means for transmitting, to the moving image distribution apparatus, frame identification information indicating the frame data specified by the specifying means, and extracted image specifying information for specifying the extracted image; and transmitting from the moving image distribution apparatus. The frame data indicated by the frame identification information among the frame data already compressed and encoded. The extracted image specified by the extracted image designation information is tracked for each frame image based on the arbitrary frame data using the arbitrary frame data thereafter, and the extracted image of the tracked extracted image is tracked. Data is extracted from each of the frame data, and after the time when the frame data to be compression-encoded among the moving image data coincides with each other, the extracted image data tracked and extracted from the frame data is sequentially extracted from the frame data. Extracted image receiving means for receiving extracted image encoded data obtained by compression encoding at a compression rate different from data, and extracted image decoding means for sequentially decoding each of the extracted image encoded data. Characteristic image designation device. 9. A frame receiving step of receiving frame encoded data transmitted from a predetermined moving image distribution apparatus for sequentially compressing and encoding moving image data to be transmitted in units of frame data, and decoding the frame encoded data A decoding step to specify an extracted image to be extracted from within a frame image based on the frame data using a decoding result of the frame encoded data, and a frame data to start extracting the extracted image. Transmitting the frame identification information indicating the specified frame data, and the extracted image designation information that designates the extracted image to the video distribution device, transmitted from the video distribution device, The frame data indicated by the frame identification information among the frame data already compressed and encoded. The extracted image specified by the extracted image designation information is tracked for each frame image based on the arbitrary frame data using the arbitrary frame data subsequent to the extracted data, and the extracted extracted image is extracted. Image data is extracted from each of the frame data, and after the time when the frame data to be compression-encoded in the moving image data coincides with each other, the extracted image data sequentially tracked and extracted from the frame data is An extracted image receiving step of receiving extracted image encoded data obtained by compression encoding at a compression rate different from frame data, and an extracted image decoding step of sequentially decoding each of the extracted image encoded data An image designating method characterized by the following. 10. A frame receiving step of receiving frame-encoded data transmitted from a predetermined moving image distribution apparatus for sequentially compressing and encoding moving image data to be transmitted in units of frame data to a reproduction designating apparatus; A decoding step of decoding the frame-encoded data; an extracted image to be extracted from within a frame image based on the frame data using a decoding result of the frame-encoded data; and the frame data to start extracting the extracted image. A transmitting step of transmitting frame identification information indicating the specified frame data and extracted image specifying information specifying the extracted image to the moving image distribution apparatus; and The frame identification information of each of the already compressed and encoded frame data transmitted from the distribution device. The extracted image specified by the extracted image designation information is tracked for each frame image based on the arbitrary frame data using the arbitrary frame data after the frame data indicated by The extracted image data of the extracted image is extracted from any of the frame data, and after the time when the frame data to be compression-encoded in the moving image data coincides with each other, the extracted and traced sequentially from the frame data are extracted. An extracted image receiving step of receiving extracted image encoded data obtained by compressing and encoding the extracted image data at a compression ratio different from that of the frame data; and an extracted image decoding step of sequentially decoding each of the extracted image encoded data And an image designation program for executing 11. A frame receiving step of receiving frame encoded data transmitted from a predetermined moving image distribution apparatus for sequentially compressing and encoding moving image data to be transmitted in units of frame data, and decoding the frame encoded data A decoding step to specify an extracted image to be extracted from within a frame image based on the frame data using a decoding result of the frame encoded data, and a frame data to start extracting the extracted image. Transmitting the frame identification information indicating the specified frame data, and the extracted image designation information that designates the extracted image to the video distribution device, transmitted from the video distribution device, The frame data indicated by the frame identification information among the frame data already compressed and encoded. The extracted image specified by the extracted image designation information is tracked for each frame image based on the arbitrary frame data using the arbitrary frame data after the data, and the extracted extracted image Extracted image data is extracted from each of the frame data, and from the time when the moving image data and the frame data to be compression-encoded match, the extracted image data sequentially tracked and extracted from the frame data is An extracted image receiving step of receiving extracted image encoded data obtained by compression encoding at a compression rate different from that of the frame data; and an extracted image decoding step of sequentially decoding each of the extracted image encoded data. An image designation program storage medium for causing an image designation device to execute the image designation program. 12. A moving image providing system in which a moving image distribution apparatus and an image designating apparatus are connected to each other via a predetermined transmission path, wherein the moving image distribution apparatus transmits moving image data to be transmitted. Frame encoding means for sequentially compressing and encoding frame data to generate frame encoded data; frame transmitting means for sequentially transmitting the frame encoded data to an image specifying device; Receiving frame identification information indicating the frame data designated to start extraction of an extracted image among the frame data obtained by decoding frame encoded data, and extracted image designation information designating the extracted image; Receiving means; and the frame identification information among the frame data already compressed and encoded by the frame encoding means. Tracking means for tracking the extracted image specified by the extracted image designation information in each frame image based on the arbitrary frame data using the arbitrary frame data after the frame data shown in the above, Image extraction means for extracting the extracted image data of the extracted image tracked by the tracking means from any of the frame data; frame data used for tracking by the tracking means; and compression codes by the frame encoding transmission means. Extracting image encoding means for sequentially compressing and encoding the extracted image data at a compression rate different from that of the frame encoded data from a point in time when the frame data to be encoded coincides with the frame encoded data to generate extracted image encoded data; Extracting image transmitting means for transmitting the encoded image data to the image specifying device, A frame receiving unit that receives the frame-encoded data; a decoding unit that decodes the frame-encoded data; and extracting from a frame image based on frame data using a decoding result of the frame-encoded data. The extracting image to be specified, and specifying means for specifying the frame data to start extracting the extracted image; transmitting means for transmitting the frame identification information and the extracted image specifying information to the moving image distribution device; An image specifying apparatus comprising: an extracted image receiving unit that receives the extracted image encoded data transmitted from the moving image distribution device; and an extracted image decoding unit that decodes the extracted image encoded data. .