JP2007271908A - Multi-image creating device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To attain a multi-image creating device which synthesizes two or more dynamic images input at different frame frequencies, and creates a high definition dynamic image synthesized at a different frame frequency. <P>SOLUTION: The image creating device is configured comprising: a buffer memory part 14 which stores two or more sheets of images for insertion to be input at different frame frequency; a controller part 21 which reads out a low definition frame image written just before from the buffer memory, performing positioning to superimpose the low definition frame image on the high definition image, and sequentially reading out the two or more images for insertion; and an image creating part 17 which superimposes the two or more images for insertion on the high definition image to form a multi-synthesized image. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a multi-image generation apparatus that inserts a plurality of moving images input at different frame rates into an ultra-high definition screen and outputs an ultra-high-definition moving image that is multi-synthesized at an arbitrary frame rate.

Recently, digital high-definition video broadcasting has also been put into practical use. For business use, an ultra-high-definition moving image display system having 4000 × 2000 pixels has also been realized.
On the other hand, imaging devices and editing devices for ultra high definition moving images are in the development stage. It is desirable to be able to easily produce and present a program of high-definition moving images and display software.

Patent Document 1 discloses an image processing apparatus in which image processing for combining a plurality of types of different images for display via a memory is performed at an increased processing speed. Separate from the CPU memory, both the foreground data and the background data are stored in different memory areas, and these images are synthesized by a dedicated image synthesis circuit, thereby speeding up the image synthesis process. Transfer of image data from the image composition circuit to the display memory is performed via a dedicated bus different from the CPU bus. As a result, there has been disclosed an image processing apparatus capable of promptly displaying an image on the screen of the display apparatus.
JP 2003-274137 A

  However, the image processing apparatus disclosed in Patent Document 1 uses a plurality of dedicated image memories for each object to be displayed, generates and stores a composite image in each memory area, and stores those image signals. Then, the image obtained by the addition is stored in the display memory. No consideration is given to storing moving images having different frame frequencies in the respective image memories and further generating a composite image at different frame frequencies. Furthermore, it has not been possible to realize an image processing apparatus that can synthesize moving images having different frame frequencies or generate and output a synthesized moving image as a moving image having a frame frequency different from that of the input image.

  Therefore, the present invention has been made to solve the above-described problems, and combines a plurality of moving images input at different frame frequencies or the frame frequency of an input moving image. An object of the present invention is to provide a multi-image generation apparatus capable of generating a high-resolution moving image synthesized at a different frame frequency.

According to a first aspect of the present invention, a display area is formed in an original image having a predetermined resolution generated at a predetermined frame rate, and the display area is generated at a frame rate different from the predetermined frame rate. In a multi-image generating apparatus that inserts an image for insertion having a resolution lower than a predetermined resolution to create a multi-synthesized image, the image for insertion is temporarily stored and a switching position for each frame of the image for insertion is detected. Among the plurality of frame data areas of the buffer memory section, a buffer memory section that forms a plurality of frame data areas capable of securing the amount of image data per frame of the insertion image, A write position in the frame data area for writing the insertion image for each frame in one of the frames. The insertion image is written in the frame data area at the writing position of the frame data area determined by the control unit, and the insertion image already written in any of the plurality of frame data areas At the time of reading, the writing position of the frame data area becomes the reading position of the frame data area based on the predetermined frame rate, the different frame rate, and the switching position for each frame detected by the moving image data generation unit. An arithmetic unit that determines the reading position of the frame data area secured in the buffer memory unit so as not to exceed or the reading position of the frame data area does not exceed the writing position of the frame data area; The insertion image is displayed in the display area formed in the original image. In order to create the multi-synthesized image, the insertion image for each line is read out based on the reading position of the frame data area determined by the arithmetic unit, and the one line of the frame data area is read out. There is provided a multi-image generation apparatus comprising: a line synthesis unit that generates a line superimposed image by inserting the read insertion image at a corresponding line position of the original image.
In the second invention, a first plurality of display areas are formed in an original image having a predetermined resolution created at a predetermined frame rate, and the first plurality of display areas are different from the predetermined frame rate. In a multi-image generating apparatus for creating a multi-composite image by inserting a plurality of first plurality of insertion images having a resolution lower than the predetermined resolution created at a frame rate, the first plurality of insertion images A moving image data generation unit that temporarily stores and detects a switching position for each frame of the first plurality of insertion images; and an amount of image data for each frame of the first plurality of insertion images. A buffer memory unit that respectively forms a second plurality of frame data areas that can be secured, and one of the second plurality of frame data areas of the buffer memory unit A control unit for determining a writing position of the frame data area for writing the first plurality of insertion images for each frame; and the frame at the writing position of the frame data area determined by the control unit. When the first plurality of insertion images are written in the data area and the first plurality of insertion images already written in any of the second plurality of frame data areas are read, Based on the frame rate, the different frame rate, and the switching position for each frame detected by the moving image data generation unit, the writing position of the frame data area does not exceed the reading position of the frame data area, or The reading position of the frame data area does not exceed the writing position of the frame data area As described above, the calculation unit for determining the reading position of the frame data area secured in the buffer memory unit, and the first plurality of insertions in the first plurality of display areas formed in the original image In order to create the multi-synthesized image by inserting an image, the first plurality of insertion images for each line is read based on the reading position of the frame data area determined by the calculation unit, A line compositing unit that generates a line-superimposed image by inserting each of the read first plurality of insertion images into a line position of the original image corresponding to one line of a frame data area. A multi-image generation apparatus characterized by the above is provided.

  According to the present invention, the insertion image is temporarily stored, the moving image data generation unit that detects the switching position of each frame of the insertion image, and the image data amount of the frame of the insertion image are ensured. A buffer memory section for forming a plurality of possible frame data areas, and a frame data area for writing the insertion image for each frame in one of the plurality of frame data areas of the buffer memory section. A controller that determines a writing position; and the image for insertion is written in the frame data area at the writing position of the frame data area determined by the controller, and is already written in any of a plurality of frame data areas When reading the inserted image, the frame rate of the original image is different from the frame rate of the original image. And the reading position of the frame data area so that the writing position of the frame data area does not exceed the reading position of the frame data area based on the switching position for each frame detected by the moving image data generation unit. A calculation unit for determining a reading position of the frame data area secured in the buffer memory unit so that a position does not exceed a writing position of the frame data area; and the insertion in the display area formed in the original image In order to create a multi-synthesized image by inserting an image for use, the insertion image for each line is read out based on the reading position of the frame data region determined by the arithmetic unit, and 1 in the frame data region is read out. The read image for insertion is inserted into the line position of the original image corresponding to the line to And a line synthesis unit for generating a superimposed image, so that a plurality of moving images input at different frame frequencies can be combined or a frame different from the frame frequency of the input moving image. A multi-image generation apparatus that can generate a high-resolution moving image synthesized at a frequency can be realized.

A multi-image generating apparatus according to an embodiment of the present invention will be described below with reference to FIGS.
FIG. 1 is a block diagram illustrating a configuration example of a multi-image generation apparatus according to an embodiment of the present invention. FIG. 2 is a diagram showing a display example of a multi-image according to the embodiment of the present invention. FIG. 3 is a diagram illustrating a configuration of a main part of the multi-image generation apparatus according to the embodiment of the present invention. FIG. 4 is a diagram for explaining the operation of the multi-image generation apparatus according to the embodiment of the present invention. FIG. 5 is a diagram for explaining a read command of the multi-image generation apparatus according to the embodiment of the present invention. FIG. 6 is a diagram for explaining the writing / reading operation of the multi-image generating apparatus according to the embodiment of the present invention. FIG. 7 is a diagram for explaining a read address generation method of the multi-image generation apparatus according to the embodiment of the present invention. FIG. 8 is a diagram for explaining a read command of the multi-image generation apparatus according to the embodiment of the present invention.

  The multi-image generation apparatus designates a plurality of window areas in a super high definition screen of horizontal 4096 pixels and vertical 2400 pixels, and for example, a horizontal 1920 pixels, vertical 1080 pixels high definition video, horizontal 640 pixels, It generates and outputs an ultra-high-definition moving image signal that combines and displays a moving image signal of vertical 480 pixels, a horizontal image of 2,816 pixels, and a vertical image of 2112 pixels together with a background color. The moving image synthesized in the window is a moving image having a frame frequency of 60 Hz, 30 Hz, 29.94 Hz, or 24 Hz. The multi-synthesized image is output as a moving image having a frame frequency of 120 Hz or 60 Hz. An input moving image having an arbitrary image size less than ultra-high definition and an arbitrary frame frequency is generated and output as an ultra-high-definition moving image having an arbitrary frame frequency.

  In other words, the multi-image generation device synthesizes a plurality of moving images input at different frame frequencies, or generates a high-resolution moving image synthesized at a frame frequency different from the frame frequency of the input moving images. The purpose of realizing an enabling device is to temporarily store an image for insertion and detect a switching position for each frame of the image for insertion, and for each frame of the image for insertion A buffer memory section for forming a plurality of frame data areas capable of securing an amount of image data; and writing the insertion image for each frame in one of the plurality of frame data areas of the buffer memory section. A controller that determines a writing position of the frame data area; and writing of the frame data area determined by the controller When writing the insertion image in the frame data area and reading the insertion image already written in any of the plurality of frame data areas, the frame rate of the original image, the frame rate of the original image, and Based on the different frame rates and the switching position of each frame detected by the moving image data generation unit, the writing position of the frame data area does not exceed the reading position of the frame data area, or the frame data area A calculation unit for determining a reading position of the frame data area secured in the buffer memory unit so that a reading position does not exceed a writing position of the frame data area, and a display area formed in the original image In order to create a multi-synthesized image by inserting an insertion image, The image for insertion is read for each line based on the read position of the frame data area determined by the unit, and the read image is read at the line position of the original image corresponding to one line of the frame data area. This is realized by including a line synthesis unit that inserts an image for insertion and generates a line superimposed image.

The configuration of the multi-image generation apparatus will be described.
A multi-image generation apparatus 1 shown in FIG. 1 includes moving image data generation units 11a to 11d, a still image input unit 12, a background color register unit 13, a buffer memory unit 14, a line synthesis unit 15, a line memory unit 16, and a moving image signal generation unit. 17, an output synchronization signal generation unit 19, a CPU (Central Processing Unit) 21, a RAM (Random Access Memory) 22, a ROM (Read Only Memory) 23, an address calculation unit 24, an offset register unit 25, a read instruction group storage memory unit 26 The read sequencer unit 27 and the operation unit 29 are configured. A moving image for a small screen is input to each of the moving image data generation units 11a to 11d. A multi-image is output from the moving image signal generator 16.

The operation of the multi-image generation device will be described.
First, the initial setting of the multi-image generating device 1 will be described.
The format of each moving image input to the moving image data generation units 11a to 11d by operating the operation unit 29, the position of the window to be displayed in combination, the format and display of the still image input to the still image input unit 12 The position, the hue and brightness of the background color generated by the background color register unit 12 are designated. The CPU 21 has a plurality of windows displayed on an ultra-high-definition screen of horizontal 4096 pixels and vertical 2400 pixels (hereinafter, sometimes referred to as a screen of 4096 × 2400 pixels. The same applies to screens having other pixel numbers). Identify the size and position of the region. The CPU 21 is driven by a computer program stored in the ROM 23 in advance, and performs area setting for storing the moving image data generated by the moving image data generation units 11 a to 11 d in the buffer memory unit 14. Area setting for storing still image data input to the still image input unit 12 in the buffer memory unit 14 is performed in the same manner. The CPU 21 obtains an address value for reading each moving image data stored in the buffer memory unit 14 and stores the obtained address value in the offset register unit 25. Further, by referring to the determined address value, a read instruction command for reading out moving image data and still image data stored in the buffer memory unit 14 to generate an ultra-high definition screen is generated, and a read instruction group storage memory Store in the unit 26. The RAM 22 temporarily stores parameters for generating a read command command generated during the calculation of the CPU 21.

Next, storage of image data in the buffer memory unit 14 will be described.
A still image signal having a predetermined number of pixels is input to the still image input unit 12. The still image signal is stored in a predetermined set area of the buffer memory unit 14. The moving image data generation units 11a to 11d receive moving image signals having the same or different display pixel numbers. Each moving image signal has the same or different frame frequency and number of pixels. Even if the frame frequency and the number of pixels are the same, the video signal is not frame-synchronized. Each moving image signal is input to each area set for inputting each moving image area in the buffer memory unit 14. A plurality of frame images can be stored in each area. Each moving image is sequentially stored in an area where a plurality of frame images can be stored.

The reading of the image data stored in the buffer memory unit 14 will be described.
The start time information of the ultra high definition video generated by the output synchronization signal generator 19 is input to the CPU 21. The CPU 21 issues a read command for each line to the read command group storage memory unit 26. The address calculation unit 24 generates an address signal for reading an image signal stored in each area of the buffer memory unit 14 according to the issued instruction.
The read sequencer unit 27 designates a read address to the buffer memory unit 14. The line synthesizing unit 15 arranges the image signals read from the buffer memory unit 14 at positions designated on the scanning lines. The line memory unit 16 temporarily stores an image signal for one scanning line in the line memory. The moving image signal generator 17 adds the horizontal and vertical synchronization signals generated by the output synchronization signal generator 19 to the image signal for one scanning line.
Thereafter, the moving image signal generation unit 17 generates signals of 2040 scanning lines constituting one frame, and outputs an ultra high definition moving image signal therefrom.

Here, the buffer memory unit 14 stores a plurality of frames of moving images input from the moving image data generation units 11a to 11d. In the designated window of the ultra-high-definition image, among the images of a plurality of frames, the images of the frames that are not written during the readout period are designated and read out. Even when the frame frequencies of the ultra-high definition images are different, images of different frames are not read out in the image displayed in the window. An ultra-high definition multi-image that is displayed with high quality is generated.
Here, as the moving image data to be stored in the moving image data generation units 11a to 11d, there are a method of storing moving image data of one frame and a method of storing moving image data of several lines or one line and appropriately storing them in the buffer memory unit 14. is there. Data writing from the moving image data generation units 11 a to 11 d to the buffer memory unit 14 is performed under the control of the CPU 21. When the CPU 21 can sufficiently secure the time for data writing, the data writing to the buffer memory unit 14 can be executed without overflowing the data amount stored in the moving image data generation units 11a to 11d.

Next, this will be described in detail.
With reference to FIG. 2 to FIG. 4, a description will be given of multi-images to be displayed as ultra-high-definition moving images, and storage and reading of these images in the buffer memory unit 14.
2 is a moving image window A51 to a moving image window D54, a still image window 55, and a background color screen 56 that are generated and displayed by the moving image data generation units 11a to 11d.
The storage area map shown in FIG. 3 shows the storage areas of the respective images in the buffer memory unit 14 in the order of memory addresses. Images of the moving image window A to moving image window D are stored in order from the smallest address. In these storage areas, four frame images of frames 0 to 3 of the four moving image data input from the moving image data generation units 11a to 11d are stored. Next to the moving image window D is a still image area, a read command group area for storing a read command, and an empty area.

  In FIG. 2, the moving picture window B has a larger number of display pixels than the other moving picture windows. The moving image window B in FIG. 3 has a larger area than the other moving image windows A, C, and D. The CPU 21 designates an address value relating to the width of an area in which data for one frame relating to the storage capacity of each moving image window A to D is stored as a frame offset address. In FIG. 3, the width of the frame offset is shown on the right side of the frame area 0. These frame offset values are stored in the offset register unit 25 shown in FIG. By using the frame offset value stored in the offset register unit 25, the address calculation unit 24 can obtain the memory address where the image is stored in relation to the moving image window to be read.

The generation of an ultra-high definition image of the scanning line (Line) to be displayed shown in FIG. 2 will be described with reference to FIG.
In FIG. 6A, the contents of the image data stored in the line memory unit 16 are composed of segments of a background color 56, a moving image window A51, a still image 55, a moving image window 52, and a background color 56 in order from the left side. Is shown. One segment data is image data read by a read command once or a plurality of times. The reading of these segment data will be described.
For the background color image data, the image data stored in the background color register unit 13 is read. As the image data of the moving image window A, frame 0 image data is read. Frame 0 is a frame for which writing by the moving image data generation unit 11a has been completed immediately before. In the next segment, of the still image data stored in the still image area, the data of the displayed portion is read out. Next, the image data of the moving image window B immediately after the completion of writing is read, and finally the image data of the background color register unit 13 is read. The read image data is synthesized by the line synthesis unit 15, and the obtained image data for one scanning line is stored in the line memory unit 16.

The read command group storage memory unit 26 stores a read command stored in the storage area of the read command group of the buffer memory unit 14. The read sequencer unit 27 and the line synthesis unit 15 are controlled by the read command.
With reference to FIG. 5, the control of the read sequencer unit 27 by the read command group will be described.
FIG. 6A shows a description example of a read command. (B) shows the contents of the mode quoted by the read command. The read command is described in the order of mode, enlargement ratio, start address, and data length.
Mode 0 is a nop (no operation) state in which no instruction is issued. Modes 1 to 4 are commands relating to the moving image windows A to D, respectively. Mode 5 is a still image, mode 6 is a command related to the background color, and mode 7 is an end command. The segment is composed of image data read by a plurality of read commands. A mode 7 End command is issued when all of the image data of the scanning line has been read.

The enlargement ratio in FIG. 3A is a command for enlarging and displaying an image stored in the buffer memory unit 14 in a window. One-pixel image data is used as image display data for a plurality of pixels. There are a method of designating an integer multiple as an enlargement ratio and a method of generating and displaying an enlarged image having a specific ratio by providing an interpolation image generation unit (not shown).
The start address value is determined based on the frame offset value stored in the offset register unit 25, the frame number to be displayed among the frames 0 to 3, and the image position to be read in the frame. 24, the address value of the image read from the buffer memory unit 14 is obtained. The read sequencer unit 27 causes the read operation to be performed using the address value obtained as the start address portion of the read command. The data length specifies the number of pixels read by the command.

With reference to FIG. 6, writing of image data to a moving image frame and reading of the written image data will be described.
In the moving image window A, four frame images of frame 0 to frame 3 can be written. After writing to frame 3 in the order of frame 0, frame 1, and frame 2, the next write from frame 0 is repeated. The storage area of 4 frames operates as a ring buffer. When the image being written is read, a discontinuous portion exists in the image at the location being written and is displayed as noise. In particular, the four moving images input to the multi-image generating device 1 are not only in a synchronous relationship, but also handle images having different frame frequencies, so it is necessary to prevent reading of images of different frames during image reading.
Therefore, the CPU 21 detects the frame number in the writing state of each moving image. When reading a moving image, a frame immediately after writing is designated and read. In that case, even if a computer graphics image having a frame frequency more than twice the frame frequency of the ultra-high-definition image, for example, is input as moving image data, the writing operation to the frame image being read is performed. Never happen. A discontinuous image, that is, an image including noise is not read out.
In the above-described example, the case where four frames are stored for one moving image has been described. When moving image input with a frame rate exceeding 3 times is assumed, there is a method of expanding the storage area of 4 frames to 8 frames, for example. How many frames are set is a matter of design.

With reference to FIG. 7, the address calculation in the address calculation unit 24 will be described.
First, a calculation start command for a screen read position start address for reading a screen in a predetermined frame 2, for example, in a predetermined window C is issued from the read command group storage memory unit 26 to the address calculation unit 24. . The multiplier 241 multiplies the frame offset value of the window C acquired from the offset register unit 25 by 2 related to the display frame number. The adder 242 adds the address value related to the screen reading position, the window address value related to the start address of the frame 0 of the window C, and the address value obtained by multiplication by the multiplier 241. An address value for reading a specified image stored in the buffer memory unit shown in FIG. 3 is obtained as a calculation result. The obtained address value is input to the read sequencer unit 27.

The read instruction group stored in the read instruction group storage memory unit 26 will be described with reference to FIG.
In the figure, read commands for lines 0, 799, and 2399 related to the screen shown in FIG. 2 are shown.
Since line 0 is a screen with only background color 56, the background color data stored in background color register 13 is read (mode 6), and the next 1H (scan line) end (mode 7) is issued. Thereafter, it becomes nop (mode 0).
A line 799 is a command for reading the line to be displayed shown in FIG. 2. First, the background color data is read, and then the image data of the window A is read. Next, still image data and window B are read out. Thereafter, after reading the background color, the reading of the line 799 is ended (End). The last line 2399 reads only background color data.

  As described above, according to the multi-image generating device 1 described in the present embodiment, the moving image data generating unit 11a that temporarily stores the inserting image and detects the switching position for each frame of the inserting image; A buffer memory unit 14 that forms a plurality of frame data areas capable of securing the amount of image data for each frame of the insertion image, and one of the plurality of frame data areas of the buffer memory unit A control unit 21 that determines a writing position of the frame data area for writing the insertion image for each frame, and the insertion image in the frame data area at the writing position of the frame data area determined by the control unit When reading the insertion image already written in any of the plurality of frame data areas, The frame data area write position exceeds the frame data area read position based on the frame rate of the frame image, the frame rate different from the frame rate of the original image, and the switching position for each frame detected by the moving image data generation unit. A calculation unit 24 that determines the reading position of the frame data area secured in the buffer memory unit so that the reading position of the frame data area does not exceed the writing position of the frame data area, In order to create a multi-synthesized image by inserting the image for insertion into the display area formed in the original image, the insertion for each line based on the reading position of the frame data area determined by the arithmetic unit The image for reading is read and the one corresponding to one line of the frame data area Since there is a configuration of the line synthesizing unit 15 that generates the line superimposed image by inserting the read image for insertion at the line position of the image, a plurality of moving images input at different frame frequencies are synthesized. Or a multi-image generation apparatus capable of generating a high-resolution moving image synthesized at a frame frequency different from the frame frequency of the input moving image.

It is a block diagram which shows the structural example of the multi image production | generation apparatus which concerns on implementation of this invention. It is a figure which shows the example of a display of the multi image which concerns on implementation of this invention. It is a figure which shows the structure of the principal part of the multi image generation apparatus which concerns on implementation of this invention. It is a figure for demonstrating operation | movement of the multi image generation apparatus which concerns on implementation of this invention. It is a figure explaining the read command of the multi image generation apparatus which concerns on implementation of this invention. It is a figure for demonstrating the writing-reading operation | movement of the multi-image production | generation apparatus concerning implementation of this invention. It is a figure for demonstrating the read address production | generation method of the multi-image production | generation apparatus which concerns on implementation of this invention. It is a figure for demonstrating the read command of the multi image generation apparatus which concerns on implementation of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Multi image production | generation apparatus 11a-11d Movie data production | generation part 12 Still image input part 13 Background color register part 14 Buffer memory part 15 Line composition part 16 Line memory part 17 Movie signal generation part 19 Output synchronous signal generation part 21 CPU
22 RAM
23 ROM
A24 Address calculation unit 25 Fset register unit 26 Read instruction group storage memory unit 27 Read sequencer unit 29 Operation units 51 to 54 Movie windows A to D
55 Still image window 56 Background color screen 241 Multiplier 242 Adder

Claims (2)

A display area is formed in an original image having a predetermined resolution created at a predetermined frame rate, and a lower resolution than the predetermined resolution created at a frame rate different from the predetermined frame rate is inserted into the display area. In a multi-image generating device that inserts an image and creates a multi-synthesized image,
A moving image data generation unit that temporarily stores the insertion image and detects a switching position for each frame of the insertion image;
A buffer memory unit for forming a plurality of frame data areas capable of securing the amount of image data for each frame of the insertion image;
A control unit for determining a writing position of the frame data region for writing the insertion image for each frame in one of the plurality of frame data regions of the buffer memory unit;
When writing the insertion image into the frame data area at the writing position of the frame data area determined by the control unit, and reading the insertion image already written in any of the plurality of frame data areas The writing position of the frame data area does not exceed the reading position of the frame data area based on the predetermined frame rate, the different frame rate, and the switching position for each frame detected by the moving image data generation unit. Or a calculation unit for determining a reading position of the frame data area secured in the buffer memory unit so that a reading position of the frame data area does not exceed a writing position of the frame data area;
In order to create the multi-synthesized image by inserting the insertion image into the display area formed in the original image, a line-by-line basis is determined based on the readout position of the frame data area determined by the arithmetic unit. A line synthesizer that reads the insertion image and inserts the read insertion image at a line position of the original image corresponding to one line of the frame data region to generate a line superimposed image;
A multi-image generating apparatus comprising: A first plurality of display areas are formed in an original image having a predetermined resolution generated at a predetermined frame rate, and the first plurality of display areas are generated at a frame rate different from the predetermined frame rate. In a multi-image generating apparatus for creating a multi-synthesized image by inserting a plurality of first insertion images having a resolution lower than the predetermined resolution,
A moving image data generation unit for temporarily storing the first plurality of insertion images and detecting a switching position for each frame of the first plurality of insertion images;
A buffer memory unit that respectively forms a plurality of second frame data areas capable of securing the amount of image data for each frame of the first plurality of insertion images;
Control for respectively determining write positions of the frame data areas for writing the first plurality of insertion images for each frame in one of the second plurality of frame data areas of the buffer memory unit And
The first plurality of insertion images are written to the frame data area at the writing position of each of the frame data areas determined by the control unit, and already written to any one of the second plurality of frame data areas. The frame data based on the predetermined frame rate, the different frame rate, and the switching position for each frame detected by the moving image data generation unit when reading the first plurality of insertion images. The frame secured in the buffer memory unit so that the writing position of the area does not exceed the reading position of the frame data area, or the reading position of the frame data area does not exceed the writing position of the frame data area A calculation unit for determining the reading position of each data area;
The frame data area determined by the arithmetic unit to create the multi-composite image by inserting the first plurality of insertion images into the first plurality of display areas formed in the original image The first plurality of insertion images for each line is read based on the read position of the first image, and the first plurality of images read out at the line position of the original image corresponding to one line of the frame data area A line compositing unit that inserts each of the insertion images to generate a line superimposed image;
A multi-image generating apparatus comprising:

Images