JP5180667B2 - Image processing apparatus and image processing method - Google Patents

Description

  The present invention relates to a moving image reproduction technique.

  In recent years, video playback apparatuses that play back input video on a display employ the following two modes. That is, a mode for reproducing video on the entire surface of the display (full-screen mode) and a mode for displaying video in a partial area on the display and reproducing the video in the video window (sub-screen mode). .

  A method for realizing the small-screen mode will be described with reference to FIG. FIG. 2 is a diagram showing a configuration for realizing a small-screen mode in a conventional video reproduction apparatus.

  The main control unit 201 controls the entire video reproduction apparatus.

  When receiving a video stream encoded by the MPEG2 method or the like, the video decoding unit 202 decodes the video stream and outputs frame data as a decoding result.

  The video conversion unit 203 identifies video data in an area designated by the main control unit 201 from the frame data output from the video decoding unit 202, and performs predetermined conversion processing (in this case, reduction) on the identified video data. Processing or enlargement processing). Then, the video conversion unit 203 outputs a video signal based on the video data to the display 204 so that a video based on the converted video data is displayed in the video window 205 on the screen of the display 204.

  Next, processing performed by the main control unit 201 to reproduce a moving image based on the video stream in the video window 205 will be described.

  First, the main control unit 201 instructs the video decoding unit 202 to start decoding.

  When receiving a decoding start instruction from the main control unit 201, the video decoding unit 202 starts its operation. When detecting the sequence header of the input video stream, the video decoding unit 202 notifies the main control unit 201 of the detected sequence header.

  Based on the “video size of the video stream” described in the sequence header notified from the video decoding unit 202, the main control unit 201 performs video conversion on an area where the video conversion unit 203 performs conversion processing (video conversion processing). Set in the unit 203.

  Further, the main control unit 201 sets the coordinates of the video window 205 on the display 204 in the video conversion unit 203.

  Then, the main control unit 201 instructs the video conversion unit 203 to start processing.

  Through the above processing, a video processing flow is formed in which the video stream is processed in the order of the video decoding unit 202 and the video conversion unit 203. As a result, a moving image is reproduced in the video window 205.

  After this video processing flow is formed, moving image reproduction is executed without the intervention of the main control unit 201.

  Here, consider changing the size of the video window 205 over time. For example, in order to change the size of the video window 205 at a frame rate of 60 fps (frame / cycle), it is necessary to change the setting content in the video conversion unit 203 at a frame cycle corresponding to 60 fps.

  In the main control unit 201, when a plurality of application programs are operating simultaneously in addition to the application program for controlling the video window 205, the main control unit 201 changes the setting to the video conversion unit 203 at a constant cycle. It can be difficult.

  Therefore, the main control unit 201 supplies the video conversion unit 203 with a script describing “setting procedure for the video conversion unit 203 necessary for changing the size of the video window 205 over time”.

As a result, the video conversion unit 203 executes the frame data size conversion processing from the video decoding unit 202 and the output processing to the display 204 based on the supplied script at a cycle described in the script.
JP 2000-78569 A

  Video streams such as MPEG2 have specifications that allow the video size to be changed in the middle.

  When the video size of the video stream is changed in the middle, the video decoding unit 202 detects a change in the sequence header and notifies the main control unit 201 of the detected sequence header.

  The main control unit 201 needs to perform region setting processing on the video conversion unit 203 again based on the changed video size described in the sequence header notified from the video decoding unit 202.

  However, if the video size of the video stream changes in the middle of changing the size of the video window 205 over time, the setting to the video conversion unit 203 cannot be changed according to this size change. was there.

  For example, assume that the video size of the video stream has changed from 1920 × 1080 to 1440 × 1080 while the size of the video window 205 is being changed over time. In this case, if the setting change corresponding to this change is not correctly reflected in the video conversion unit 203, the video conversion unit 203 will read video data from outside the effective area 1440 × 1080, and a part of the video window 205 will be read. Unintended data is displayed on the screen.

  The present invention has been made in view of the above problems, and even if the image attribute of a frame that is in the process of being reproduced by changing the image of each frame over time is changed, the change in the image attribute is changed. An object is to provide a technique for seamlessly playing back and forth frames.

  In order to achieve the object of the present invention, for example, an image processing apparatus of the present invention comprises the following arrangement.

In other words, in each frame image constituting the moving image, means for holding a first script that describes the processing content to be performed on the partial image in the designated area of the image;
Image size of the processing target frame, a second script to be applied to the processing target frame only when different from the image size of the previous frame of the processing target frame, in the image of the processing target frame Means for holding the second script in which area information for designating an area corresponding to the designated area is described for each image size that can be taken by the image of the processing target frame;
Means for inputting an image of each frame constituting the moving image;
Image size of the input frame image, determination means for determining whether changes from the image size of the image of the frame immediately before the frame that is the input,
If it is determined that the determination means has not changed, a partial image in the designated area is extracted from the input frame, and the extracted partial image is described in the first script. Process the processing contents,
If it is determined that the determination means has changed, region information corresponding to the image size of the image of the input frame is specified from the second script, and the input that the specified region information indicates is input. An area in the image of the selected frame is set as the specified area, a partial image in the set specified area is extracted, and processing of the processing content described in the first script is performed on the extracted partial image Processing means for performing
Means for outputting an image processed by the processing means.

  In order to achieve the object of the present invention, for example, an image processing method of the present invention comprises the following arrangement.

That is, an image processing method performed by the image processing apparatus,
A first holding unit of the image processing apparatus holding a first script describing a processing content to be performed on a partial image in a specified region of the image in each frame image constituting the moving image; ,
Second holding means of the image processing apparatus, an image size of the processing target frame, a second script to be applied to the processing target frame only when different from the image size of the previous frame of the frame to be processed The second script in which region information for designating a region corresponding to the designated region in the image of the processing target frame is described for each image size that can be taken by the image of the processing target frame Holding the
An input unit of the image processing apparatus inputs an image of each frame constituting the moving image;
Determination means of the image processing apparatus, an image size of the input frame image, a determination step of determining whether or not change from image size of the image of the frame immediately before the frame that is the input,
If the processing means of the image processing apparatus determines that there is no change in the determination step, the partial image in the designated area is extracted from the input frame, and the extracted partial image , Processing the processing content described in the first script,
If the processing means of the image processing apparatus determines that the change has occurred in the determination step, the area information corresponding to the image size of the image of the input frame is specified from the second script, An area in the image of the input frame indicated by the specified area information is set as the specified area, a partial image in the set specified area is extracted, and the first image is extracted from the extracted partial image. Processing steps for processing the processing contents described in the script of
The output unit of the image processing apparatus includes a step of outputting an image processed by the processing step.

  According to the configuration of the present invention, even if the image attribute of a frame that is in the process of being reproduced while changing the image of each frame with the passage of time changes, the frame is seamlessly reproduced before and after the change of the image attribute. be able to.

  Preferred embodiments of the present invention will be described below with reference to the accompanying drawings. The embodiment described below shows an example when the present invention is specifically implemented, and is one of the specific examples of the configurations described in the claims.

[First Embodiment]
FIG. 1 is a block diagram illustrating a functional configuration example of an image processing apparatus 100 according to the present embodiment. As shown in FIG. 1, the image processing apparatus 100 according to the present embodiment includes a main control unit 101, a video decoding unit 102, a video conversion unit 103, a display 104, and a memory 113.

  The main control unit 101 controls the entire image processing apparatus 100 and controls the operation of each unit constituting the image processing apparatus 100.

  Video data is input to the video decoding unit 102. Such moving image data is, for example, moving image stream data such as MPEG2. Therefore, the video decoding unit 102 decodes the moving image stream and sequentially outputs the image data of each frame. The image data of each frame output from the video decoding unit 102 is stored in a frame buffer 106 provided in the memory 113.

  The frame buffer 106 is a FIFO (First In First Out) format memory, and is read out to the video conversion unit 103 in order from the previously stored image data.

  In addition, the moving image stream data includes information (image attribute information) indicating image attributes of image data of each frame in the moving image stream. In the present embodiment, the image attribute information is information indicating the image size. That is, in this embodiment, it is assumed that the moving image stream includes information indicating the size of the image of each frame included in the moving image stream as image attribute information.

  The video decoding unit 102 extracts the image attribute information of the decoded frame from the moving image stream, and stores the extracted image attribute information in the frame management information buffer 108.

  When obtaining the image data from the frame buffer 106, the video conversion unit 103 extracts data (partial image data) in the image region (designated region) designated by the main control unit 101 from the image data. The image area is an area designated by the main control unit 101 in the image indicated by the image data acquired from the frame buffer 106 by the video conversion unit 103. Note that the image area specified by the main control unit 101 may be the entire area of the frame.

  The video conversion unit 103 performs a predetermined conversion process on the extracted partial image data based on the script (video conversion script 111) specified by the main control unit 101. In the present embodiment, the conversion process is an image reduction process. However, the conversion process is not limited to this, and may be an image enlargement process, a process of deforming the contour of an image, or the like. Processing such as affine transformation or the like for transforming the image itself may be used.

  Then, the video conversion unit 103 creates frame data in which an image based on the converted partial image data is arranged at the position of the video window 105 displayed on the display screen of the display 104. The created frame data is stored in the plane buffer 107 in the memory 113.

  The video conversion unit 103 generates a video signal based on the frame data stored in the plane buffer 107 and outputs the video signal to the display 104. As a result, an image based on the partial image data is displayed in the video window 105 on the display screen of the display 104.

  On the other hand, data of two scripts is stored (held) in the memory in the main control unit 101. One is a video conversion script 111 (first script), and the other is a corresponding script 112 (second script).

  The video conversion script 111 is data describing the content of processing (processing content) performed on the partial image data extracted by the video conversion unit 103, and the content of the processing is described for each frame. FIG. 4 is a diagram illustrating a configuration example of information described in the video conversion script 111.

  In the “frame number” column, the number of each frame included in the moving image stream is registered. The number of the first frame is “1”.

  In the “conversion target area” column, information indicating an image area that the main control unit 101 designates to the video conversion unit 103 in each frame included in the moving image stream is registered. In FIG. 4, “Area A” is the image area concerned. Actually, the main control unit 101 registers position information of “region A” in the image indicated by the image data read from the frame buffer 106. Therefore, this position information may be registered in the column of “conversion target area”.

  In the column of “conversion processing”, information indicating the content of processing performed on the image area A in the image of each frame included in the moving image stream is registered. For example, according to the “conversion process” corresponding to the frame number 2, for the area A in the image of the frame number 2, the process of reducing the original image size to 95% (reduction rate) (process 2) is performed. Do. Further, according to the “conversion process” corresponding to the frame number N, the process (process 2) for reducing the original image size to 85% is performed on the area A in the image of the frame number N.

  That is, the video conversion script 111 shown in FIG. 4 shows a conversion process in which the image size of the area A is reduced in the later frame in the reproduction order.

  The correspondence script 112 is applied only when the image attribute of the image of the processing target frame is changed from the image attribute of the image in the frame immediately before the processing target frame. The correspondence script 112 describes information indicating an area in the image of the processing target frame corresponding to the area from which the partial image has been extracted up to the frame immediately before the processing target frame. A detailed description of the correspondence script 112 will be described later.

  Here, an outline of a moving image reproduction process performed by the image processing apparatus 100 will be described with reference to FIG. FIG. 3 is a diagram illustrating an image of each frame and a partial image extracted from the image of each frame.

  Reference numerals 301 to 305 denote images of respective frames, which are reproduced in the order of an image 301, an image 302, an image 303, an image 304, and an image 305. Further, the horizontal size of the images 301 to 303 is 1920 pixels, and the horizontal size of the images 304 and 305 is 1440 pixels.

  311 to 315 are partial images extracted from the images 301 to 305, respectively. More specifically, the partial image 311 is a partial image extracted from the region 306 in the image 301. The partial image 312 is a partial image extracted from the area 307 in the image 302. The partial image 313 is a partial image extracted from the region 308 in the image 303. The partial image 314 is a partial image extracted from the region 309 in the image 304. The partial image 315 is a partial image extracted from the area 310 in the image 305.

  Here, when extracting the partial images 311 to 313 from each of the images 301 to 303, the regions (306 to 308) having the same size and the same position may be extracted from the respective images 301 to 303.

  However, when extracting the partial image 314 from the image 304, since the horizontal size of the image 304 is different from the horizontal size of the images 301 to 303 so far, the size and position of the region extracted so far are used. However, partial images having the same contents cannot be extracted. Therefore, in the present embodiment, the size and position of the region to be extracted are changed according to the change in size from the image 303 to the image 304. In the case of the image 304, the partial image 314 is obtained by performing extraction from the region 309 having a position and size different from those of the images 301 to 303. In the case of the image 305, the partial image 315 is obtained by performing extraction from the region 310 having a position and size different from those of the images 301 to 303. Since the image 304 and the image 305 are images having the same size, the region 309 and the region 310 are regions having the same position and size.

  Next, the moving image reproduction process performed by the image processing apparatus 100 will be described with reference to the flowchart of FIG. FIG. 6 is a flowchart showing details of the moving image reproduction process performed by the image processing apparatus 100.

  In step S601, the video decoding unit 102 decodes the input moving image stream and sequentially outputs the image data of each frame. The image data of each frame output from the video decoding unit 102 is stored in a frame buffer 106 provided in the memory 113. In addition, the video decoding unit 102 extracts the image attribute information of the decoded frame from the moving image stream, and stores the extracted image attribute information in the frame management information buffer 108.

  In step S602, the video conversion unit 103 refers to the frame management information buffer 108. Then, it is determined whether or not the image attribute indicated by the image attribute information of the image data of the processing target frame has changed from the image attribute indicated by the image attribute information of the image data of the frame immediately before the processing target frame. As a result of the determination, if it has changed, that is, if the image size has changed, the process proceeds to step S604. On the other hand, if the result of the determination is that there is no change, that is, there is no change in the image size, the process proceeds to step S603.

  In step S <b> 603, the main control unit 101 refers to the video conversion script 111 and instructs the video conversion unit 103 as an area for extracting a partial image from the image of the processing target frame. When designating an image region to be extracted from the image of the processing target frame, the main control unit 101 specifies a “conversion target region” corresponding to the processing target frame in the video conversion script 111 managed by the main control unit 101. Then, the specified area is designated as the designated area.

  On the other hand, in step S604, the main control unit 101 refers to the corresponding script 112 and performs processing for specifying an area for extracting a partial image in the image of the processing target frame.

  FIG. 5 is a diagram illustrating a configuration example of information described in the correspondence script 112.

  In the corresponding script 112, area information for designating an area corresponding to the designated area in the image of the processing target frame is described for each size (image attribute) that the image of the processing target frame can take.

  For example, it is assumed that the image size of the frame before the processing target frame is w × h (identifiable from the image attribute information of the image). When the image size of the image of the processing target frame is 1440 × 1080 (identifiable from the image attribute information of the image), the coordinate value of the upper left corner of the region for extracting the partial image from the processing target frame is (xx 1440 / w, y × 1080 / h). Here, x and y are respectively the x coordinate value and the y coordinate value of the upper left corner of the area where the partial image data has been extracted from the image of the frame immediately before the processing target frame. Similarly, the coordinate value of the lower right corner of the region for extracting the partial image from the processing target frame is (x ′ × 1440 / w, y ′ × 1080 / h). Here, x ′ and y ′ are the x-coordinate value and the y-coordinate value of the lower right corner of the region in which the partial image is extracted from the image of the frame immediately before the processing target frame, respectively.

  That is, x, y, x ′, and y ′ are all information set as position information of the current designated area.

  When the image size of the image of the processing target frame is 720 × 480 (identifiable from the image attribute information of the image), the coordinate value of the upper left corner of the region for extracting the partial image from the processing target frame is ( x × 720 / w, y × 480 / h). Here, x and y are respectively the x-coordinate value and the y-coordinate value of the upper left corner of the region in which the partial image is extracted from the image of the frame immediately before the processing target frame. Similarly, the coordinate value of the lower right corner of the region for extracting the partial image from the processing target frame is (x ′ × 720 / w, y ′ × 480 / h). Here, x ′ and y ′ are the x-coordinate value and the y-coordinate value of the lower right corner of the area where the partial image has been extracted from the image of the frame immediately before the processing target frame, respectively.

  Thus, even if the size of the image of the processing target frame changes from the immediately preceding frame, it corresponds to the area from which the partial image was extracted in the immediately preceding frame (the image contents are substantially the same), and the portion in the image of the processing target frame An image can be specified.

  In addition, when the position and size of the area for extracting the partial image data are changed in this way, the “position information of the designated area” used in the previous frame is changed to the position of the area after the change. Update with information (here, upper left corner coordinate value, lower right corner coordinate value). As a result, in subsequent frames, partial images are extracted from the changed designated area.

  Then, the main control unit 101 instructs the video conversion unit 103 to designate a region for extracting a partial image in the image of the processing target frame as a designated region.

  In step S <b> 605, the main control unit 101 refers to the video conversion script 111 and identifies “conversion processing” to be performed on the partial image in the designated area. For example, when the process target frame is the second frame, the “conversion process” is a process of reducing the size of the partial image extracted from the image of the process target frame to 95%. Then, the main control unit 101 instructs the video conversion unit 103 on the specified conversion processing content. Thereby, the video conversion unit 103 performs the conversion process instructed by the main control unit 101 on the partial image in the designated area instructed by the main control unit 101 in either step S603 or step S604.

Since the size of the designated area designated by the main control unit 101 in step S604 is different from the size of the designated area designated by the main control unit 101 in step S603, the size of the partial image extracted from each designated area is also set. Will be different. Therefore, regardless of which partial image is extracted from any designated area, the size of the partial image after the processing in step S605 is performed on the extracted partial image is set to a predetermined size (for example, the size of the video window 105). Preferably converted,
Next, in step S606, the video conversion unit 103 creates frame data in which an image based on the partial image data processed in step S605 is arranged at the position of the video window 105 displayed on the display screen of the display 104. To do. The created frame data is stored in the plane buffer 107 in the memory 113.

  In step S <b> 607, the video conversion unit 103 generates a video signal based on the frame data stored in the plane buffer 107 and outputs the video signal to the display 104.

  Next, in step S608, the main control unit 101 determines whether or not the above processing has been performed for all the frames included in the moving image stream. If it is determined as a result of such determination, the present process is terminated. On the other hand, if it is determined as a result of such determination that the process is not performed, the process returns to step S602, and the subsequent process is performed with the next unprocessed frame as the frame of interest.

  As described above, according to the present embodiment, when the partial image extracted from each frame is reduced and displayed at a different reduction ratio for each frame, even if the image size of a certain frame changes from the image size of the previous frame, Images can be played seamlessly before and after the change.

[Second Embodiment]
This embodiment is the same as the first embodiment except for the points described below.

  In the first embodiment, the correspondence script 112 describes area information for designating an area corresponding to the designated area in the image of the processing target frame for each image size that the image of the processing target frame can take. It was a thing. However, if the number of types of image sizes that can be taken by the image of the processing target frame is large, the data size of the corresponding script 112 increases accordingly, so that the memory capacity for storing the data of the corresponding script 112 is large. Necessary. On the other hand, there may be a case where the memory capacity for storing the corresponding script 112 is limited.

  Therefore, in the present embodiment, a changing image size is predicted in advance, and the corresponding script 112 is created only for the predicted image size.

  For example, consider a case where the moving image stream input to the video decoding unit 102 is based on a broadcast wave. At this time, it is possible to determine the change mode and the change time of the image attribute from the EIT (Event Information Table) component descriptor that can be obtained from the broadcast wave.

  The main control unit 101 determines from the EIT that the image size changes at the time of switching of the event (program) of the currently viewed service (channel). Then, the main control unit 101 creates a correspondence script 112 corresponding to the changed image size determined from the EIT.

  As described above, according to the second embodiment, the changing image size is predicted in advance, and the corresponding script 112 is created only for the predicted image size. Therefore, the memory capacity for storing the corresponding script 112 is limited. It works effectively in some cases.

[Third Embodiment]
In each of the embodiments described above, when a case occurs in which the image size of the image of the input frame is changed from the image size of the image of the frame immediately before the input frame, the corresponding script 112 is used to cope with the case. Was. However, when such a case occurs, the moving image reproduction process by the image processing apparatus 100 may be interrupted until the frame of the image size before the change is input again. In this case, the corresponding script 112 is not used. Further, when such a case occurs, a message indicating standby may be displayed on the display screen of the display 104 until the frame of the image size before the change is input again.

  Thus, when such a case occurs, the moving image reproduction process may be waited without using the corresponding script 112. There is no particular limitation on what operation is performed during standby.

[Fourth Embodiment]
The video decoding unit 102 and the video conversion unit 103 illustrated in FIG. 1 may be configured by dedicated hardware, but may be configured by a computer program for causing the main control unit 101 to implement each function. good. In this case, a general PC (personal computer) can be applied to the image processing apparatus 100.

  FIG. 7 is a block diagram illustrating a hardware configuration example of a computer applicable to the image processing apparatus 100.

  The CPU 701 uses the programs and data stored in the RAM 702 and the ROM 703 to control the entire computer, and performs the various processes described above as performed by the image processing apparatus 100. That is, when this computer is applied to the image processing apparatus 100, the CPU 701 corresponds to the main control unit 101. Therefore, the video conversion script 111 and the corresponding script 112 are stored in the memory in the CPU 701.

  The RAM 702 has an area for temporarily storing programs and data loaded from the external storage device 706 and data received from the outside via an I / F (interface) 707 (for example, moving image stream data). . Further, the RAM 702 has a work area used when the CPU 701 executes various processes. That is, the RAM 702 can provide various areas as appropriate. That is, when this computer is applied to the image processing apparatus 100, the RAM 702 corresponds to the memory 113.

  The ROM 703 stores a boot program, computer setting data, and the like.

  The operation unit 704 is configured by a keyboard, a mouse, and the like, and various instructions can be input to the CPU 701 by an operator of the computer.

  The display unit 705 is configured by a CRT, a liquid crystal screen, or the like, and can display a processing result by the CPU 701 using an image, text, or the like. That is, when this computer is applied to the image processing apparatus 100, the display unit 705 corresponds to the display 104.

  The external storage device 706 is a large-capacity information storage device represented by a hard disk drive device. The external storage device 706 stores various data used in the above description, such as an OS (Operating System), a computer program for causing the CPU 701 to execute the functions of the video decoding unit 102 and the video conversion unit 103. Further, each of the video conversion script 111 and the corresponding script 112 may be stored in the external storage device 706. Further, part or all of the information described as being stored in the RAM 702 may be stored in the external storage device 706.

  Programs and data stored in the external storage device 706 are appropriately loaded into the RAM 702 under the control of the CPU 701 and are processed by the CPU 701.

  The I / F 707 is for connecting to a device that transmits moving image stream data. The moving image stream data sent from the device is input to the RAM 702 and the external storage device 706 via the I / F 707. Is done. Of course, the device for connecting to the I / F 707 is not limited to this, and a device for displaying a moving image to be played back by the computer may be connected to the I / F 707. In this case, the information described as being displayed on the display 104 is output to an external device via the I / F 707.

[Other Embodiments]
Needless to say, the object of the present invention can be achieved as follows. That is, a recording medium (or storage medium) that records a program code (computer program) of software that implements the functions of the above-described embodiments is supplied to the system or apparatus. Needless to say, such a storage medium is a computer-readable storage medium. Then, the computer (or CPU or MPU) of the system or apparatus reads and executes the program code stored in the recording medium. In this case, the program code itself read from the recording medium realizes the functions of the above-described embodiment, and the recording medium on which the program code is recorded constitutes the present invention.

  Further, by executing the program code read by the computer, an operating system (OS) or the like running on the computer performs part or all of the actual processing based on the instruction of the program code. Needless to say, the process includes the case where the functions of the above-described embodiments are realized.

  Furthermore, it is assumed that the program code read from the recording medium is written in a memory provided in a function expansion card inserted into the computer or a function expansion unit connected to the computer. After that, based on the instruction of the program code, the CPU included in the function expansion card or function expansion unit performs part or all of the actual processing, and the function of the above-described embodiment is realized by the processing. Needless to say.

  When the present invention is applied to the recording medium, program code corresponding to the flowchart described above is stored in the recording medium.

It is a block diagram which shows the function structural example of the image processing apparatus 100 which concerns on the 1st Embodiment of this invention. It is the figure which showed the structure for implement | achieving subscreen mode in the conventional video reproduction apparatus. It is a figure which shows the image of each frame, and the partial image extracted from the image of each frame. It is a figure which shows the structural example of the information described in the video conversion script. 4 is a diagram illustrating a configuration example of information described in a correspondence script 112. FIG. 4 is a flowchart illustrating details of a moving image reproduction process performed by the image processing apparatus 100. 2 is a block diagram illustrating an example of a hardware configuration of a computer applicable to the image processing apparatus 100. FIG.

Claims (8)

Means for holding a first script describing processing contents to be performed on a partial image in a specified area of the image in each frame image constituting the moving image;
Image size of the processing target frame, a second script to be applied to the processing target frame only when different from the image size of the previous frame of the processing target frame, in the image of the processing target frame Means for holding the second script in which area information for designating an area corresponding to the designated area is described for each image size that can be taken by the image of the processing target frame;
Means for inputting an image of each frame constituting the moving image;
Image size of the input frame image, determination means for determining whether changes from the image size of the image of the frame immediately before the frame that is the input,
If it is determined that the determination means has not changed, a partial image in the designated area is extracted from the input frame, and the extracted partial image is described in the first script. Process the processing contents,
If it is determined that the determination means has changed, region information corresponding to the image size of the image of the input frame is specified from the second script, and the input that the specified region information indicates is input. An area in the image of the selected frame is set as the specified area, a partial image in the set specified area is extracted, and processing of the processing content described in the first script is performed on the extracted partial image Processing means for performing
An image processing apparatus comprising: means for outputting an image processed by the processing means.   The image processing apparatus according to claim 1, wherein the first script includes a reduction rate of an image size with respect to a partial image in the designated area extracted from an image of each frame. The processing means includes
If it is determined that the determination means has not changed, a partial image in the designated area is extracted from the input frame, and the extracted partial image is described in the first script. The image processing apparatus according to claim 2, wherein a reduction process is performed according to a reduction ratio. If the processing means determines that the determination means has changed, the processing section specifies area information corresponding to the image size of the image of the input frame from the second script, and the specified area information Is set as the specified area, a partial image in the set specified area is extracted, and the extracted partial image is reduced according to the reduction ratio described in the first script. The image processing apparatus according to claim 1 , wherein: Furthermore,
The image processing apparatus according to claim 1, further comprising: a unit that waits for an operation performed by the processing unit when it is determined that the determination unit has changed. An image processing method performed by an image processing apparatus,
A first holding unit of the image processing apparatus holding a first script describing a processing content to be performed on a partial image in a specified region of the image in each frame image constituting the moving image; ,
Second holding means of the image processing apparatus, an image size of the processing target frame, a second script to be applied to the processing target frame only when different from the image size of the previous frame of the frame to be processed The second script in which region information for designating a region corresponding to the designated region in the image of the processing target frame is described for each image size that can be taken by the image of the processing target frame Holding the
An input unit of the image processing apparatus inputs an image of each frame constituting the moving image;
Determination means of the image processing apparatus, an image size of the input frame image, a determination step of determining whether or not change from image size of the image of the frame immediately before the frame that is the input,
If the processing means of the image processing apparatus determines that there is no change in the determination step, the partial image in the designated area is extracted from the input frame, and the extracted partial image , Processing the processing content described in the first script,
If the processing means of the image processing apparatus determines that the change has occurred in the determination step, the area information corresponding to the image size of the image of the input frame is specified from the second script, An area in the image of the input frame indicated by the specified area information is set as the specified area, a partial image in the set specified area is extracted, and the first image is extracted from the extracted partial image. Processing steps for processing the processing contents described in the script of
An image processing method comprising: an output unit of the image processing apparatus including a step of outputting an image processed by the processing step. A computer program for causing a computer to function as each unit of the image processing apparatus according to any one of claims 1 to 5 . A computer-readable storage medium storing the computer program according to claim 7 .

Images