JPH02281879A - Digital image editing device - Google Patents

Abstract

PURPOSE:To execute the editing processing of an image formed by fitting a foreground image into a background image in a real time by moving freely the foreground image in a state it is brought to overlay display to the background image by a window whose shape, size and position are arbitrary in a real time. CONSTITUTION:By background image data from a display memory 1, a background image displayed and a window by a window memory 2 and a mask memory 7 is brought to overlay display on this background image, so that the read-out timing of foreground image data by the window memory 2 and mask data by the mask memory 7 can be changed. Accordingly, a position, a shape and a size of the window can be changed arbitrarily on the background image in a real time. In such a way, editing of an image can be executed in a real time.

Description

[Detailed Description of the Invention] [Industrial Application Field] The present invention relates to an editing device that uses one natural image as a background image and inserts another image into it as a foreground image for composition. In particular, the present invention relates to a digital image editing device that digitizes and edits images.

[Conventional technology]

Devices that import digitized image data such as computer graphics, natural drawings, and character fonts, process them, edit the images, and record them on external storage devices are used in some workstations. ing. An example of this type of device is the Nikkei New Media Technology Latest Report ■rCD-ROM, CD-1 Development Site Report J (1988) published by Nikkei McGraw-Hill.
7.5) pp. 36-45. this is,
The video signal captured from the video camera is digitized for one frame, written as image data to a display memory with 24 bits in depth (8 bits for each ROB), read out from this display memory, and displayed on the monitor. Editing and processing are performed on the image data in the display memory while displaying the image based on the data.

Editing/processing processing includes noise removal, changing color tone and contrast, contour extraction, image enlargement/reduction, mask composition, etc., and these can be performed while checking on the monitor. Here, mask compositing is a process of inserting and compositing another image as a foreground image into a part of the background image, and for this purpose, in addition to the display memory, a mask memory whose address corresponds to this display memory is required. is provided, and mask data for masking unnecessary portions of image data on the display memory is stored therein. The image data read from the display memory is masked with this mask data, so that a part of the image data is inserted into the background image as a foreground image.

As a method for forming mask data, there is a chromakey method that uses blue as a background color, but mask data for any mask can be formed using a digital tablet, and mask data for already formed mask data can be created using a digital tablet. Processing is also possible. Thereby, the shape and size of the fitting range (window) of the foreground image on the background image can be arbitrarily determined.

In addition, as another example, a multi-window method that can display multiple foreground images is known (Japanese Unexamined Patent Application Publication No. 1983-1989-1).
127790).

The background image display area is also one window, and different image data is stored in one or more frame buffers, and a priority memory with addresses in one-to-one correspondence with these frame buffers is provided, and any It stores selection information that determines whether the dot data (image sample data) of the image data read out from the frame buffer has the highest priority. Dot data at the same address is read out from each frame buffer at the same time, and at the same time, selection information is read out from the address corresponding to this address in the priority memory, and based on this selection information, it is read out from each frame buffer at the same time. The highest priority dot data is selected and supplied to the display device.

In this way, only one of the dot data simultaneously read out from each frame buffer is selected based on the selection information and supplied to the display device, so that the image data in each frame buffer is displayed according to the II amount information. A range is determined, and a window corresponding to each frame buffer on the display device is determined. Therefore, by appropriately setting selection information in the priority memory, the shape, size, and position of each window on the display screen of the display device can be arbitrarily set.

[Problem to be solved by the invention]

By the way, when processing image data such as natural images or computer graphics and editing by inserting a foreground image into a background image, the background image data and foreground image data are imported using a video camera or scanner, and the necessary information is extracted from the foreground image data. By extracting an arbitrary part, the foreground image is inserted into the background image using an arbitrarily shaped window and displayed as an overlay. In addition, the foreground image can be moved freely in real time while being overlaid on the background image, and once the optimal position for inserting the parentheses is determined, the image data of the foreground image to be overlaid is transferred to the memory of the background image data. It is desirable that the image data of the composite image to be displayed on the display device be obtained.

However, in any of the above conventional techniques, although it is possible to set the window to any shape, size, and position, it is not possible to freely move the window in real time while displaying the foreground image as an overlay on the background image. , and how to quickly write image data of a necessary portion of the foreground image into a desired range of the memory where the background image is stored.

An object of the present invention is to solve such problems, to allow the foreground image to be freely moved in real time while being overlaid on the background image using an arbitrarily shaped window, and to have the foreground image embedded in the background image. An object of the present invention is to provide a digital image editing device that can obtain image data of an image.

[Means to solve the problem]

In order to achieve the above object, the present invention provides a display memory that stores background image data, a display address generation means that generates a display address for reading data from the display memory, and a window memory that stores foreground image data. , a rewritable mask memory that stores mask data for the foreground image data stored in the window memory in a one-to-one address correspondence with the window memory, and generates arbitrary mask data and writes it in the mask memory. window data extraction means; address conversion means for converting the display address to generate a window address for reading data from the window memory and the mask memory; and the window address of the display address in the address conversion means. a register in which window display position data that defines the conversion processing operation is stored; and the window memory within a desired range determined by the mask data read from the mask memory every read cycle of the background image data from the display memory. and selecting means for selecting the foreground image data read from the display memory and selecting the background image data read from the display memory outside the desired range and supplying the selected background image data to the display means.

Further, the present invention further includes a transfer control means for transferring and writing the foreground image data within the predetermined range determined by the mask data read from the mask memory to the display memory.

[Effect]

The dot data of the background image data read out from the display memory and the foreground image dot data read out from the window memory are selected by the selection means according to the mask data read out from the mask memory, and are supplied to the display means. The desired range determined by the mask data from which the means selects the foreground image data determines the size and shape of the window on the display means. Since arbitrary mask data is generated by the window data cutting means, a window having an arbitrary shape and size can be set.

Further, the window display position data determines the conversion processing operation of the address conversion means, and thereby the correspondence relationship between the window address and the display address is determined.

This determines the readout timing of the foreground image data from the window memory and the mask data from the mask memory with respect to the readout period of the background image data in the display memory. The display position will be specified. Since the registers mentioned above are rewritable, the window display position data can be sequentially rewritten, thereby allowing the foreground image to be overlaid on the displayed background image and effectively freely changing the window of the foreground image. It can be moved.

Furthermore, when the displayed window is set at the optimal position, the foreground image data through the mask data is written to the display memory by the transfer control means, so that the foreground image is inserted and synthesized at the optimal position on the background image. The image data obtained will be obtained in the display memory.

〔Example〕

Embodiments of the present invention will be described below with reference to the drawings.

FIG. 1 is a block diagram showing an embodiment of a digital image editing device according to the present invention, in which 1 is a display memory, 2 is a window memory, 3 is a data input/output section, 4 is a display address generation section, and 5 is a window. Display position register, 6 is an address conversion section, 7 is a mask memory, 8 is a window data extraction section, 9 is a transfer control section, 10 is a data switching section, 11
12 is a display device, 12 is a coordinate reading device, and 100 is a CPU that controls reading and writing of data to each memory.

In the figure, the data input/output unit 3 inputs and outputs image data, and when the image data input from the outside is image data representing the background on the display screen of the display device 11 (background image data), , this is supplied to the display memory 1, and image data representing the foreground (foreground image data)
If so, it is supplied to the window memory 2.

The display memory 1 has a storage capacity of image data for one image, and assuming that one image consists of 14×9 dots, the display memory 1 has a storage area for image data consisting of 126 addresses. ing. Here, the addresses of the image data storage area are 0 to 125.

Also, one image consists of 4 dots at 1° in the horizontal scanning direction (X direction) and 9 dots in the vertical scanning direction (Y direction), and the image data of this image consists of the data of these dots (dot data). , this image data does not include the horizontal blanking period and the vertical blanking period. Here, each dot data of the image data is DO, DI, . . . in the order of dots arranged in the horizontal and vertical scanning directions of the image.
・, D124°D125. At this time, dot data DO corresponds to the dot at the upper left corner of the image, and D125 similarly corresponds to the dot at the lower right corner.

The background image data supplied to the display memory 1 is shown in FIG.
As shown in a>, it is image data for one image, and 12
6 dot data Do, DI.

. . . The 0 display address generation unit 4, which is composed of D125, generates a series of display addresses equal to the number of dots for one image, including horizontal and vertical scanning periods, in synchronization with the scanning of the display device 11. is occurring repeatedly.

When the scanning point of the display device 11 is located at the pixel portion at the upper left corner, the display address generation unit 4 generates display address 0,
Thereafter, as the scanning point advances, display addresses 1, 2, 3, . . . are sequentially output for each pixel. When the data input/output unit 3 inputs background image data, the data input/output unit 3
A request is issued to O to generate a write address for display memory 1. The CPU 100 outputs a write address to the display memory 1 in accordance with a request from the data input/output unit 3 during a period when the display memory 1 is not performing a read operation (for example, during a vertical and horizontal flyback period). In synchronization with this, background image data is supplied from the data input/output section 3 to the display memory 1. As a result, the dot data Do, D
1. D2. . . . are addresses 0, 1, 2, . . . of display memory 1, respectively. It will be written in...

FIG. 3(a) shows the background image data and the display address generation section 4.
FIG. 3B shows the storage state of the background image data in the display memory 1.

In the display memory 1, the background image data is read out in response to the display address from the display address generator 4. The data switching unit 10 is normally closed to the display memory 1 side, and the background image data read from the display memory 1 is supplied to the display device 11 via the data switching unit 10. As a result, the background image is displayed on the display device M at 1°1.

The window memory 2 has a storage capacity determined by the set size of the foreground image to be displayed, and here it is assumed that it has a storage area for image data consisting of addresses 0 to 8. Therefore, the background image data stored in this is X.

The image data is an image of a square range of three dots each in the Y direction.

When foreground image data is input to the data input/output unit 3, C
A request is issued to the PU 100 to generate a write address for the window memory 2. cpuloo outputs a write address to the window memory 2 in accordance with a request from the data input/output unit 3 during a period when the window memory 2 is not performing a read operation (for example, during a vertical/horizontal flyback period). In synchronization with this, background image data is supplied from the data input/output section 3 to the display memory 1. As a result, the dot data DAO, DAI, DA2°...
..., the foreground image data consisting of DA8 is stored at addresses 0.1, 2, . . . in the window memory 2.・・・・・・・・・
・Memorized in 8. Here, as shown in FIG. 2(b), the image corresponding to this foreground image data is 0.1.2nd in the X direction and the same <0.1.2nd in the Y direction at the upper left corner of the screen.
If it consists of the second dot, dot data D
AO, DAI, .

The storage state of foreground image data in the window memory 2 is shown in FIG. 3(d).

When the writing of the foreground image data in the window memory 2 is completed, the window data cutting unit 8 determines whether or not each piece of dot data stored in the window memory 2 actually needs to be displayed. Based on this, mask data is set in the mask memory 7 so that only the dot data that actually needs to be displayed can be selected. The mask memory 7 has a pair of addresses corresponding to the window memory 2, and the mask data is composed of a pattern of dot data of "1" and "0". When the dot data of the mask data is '1', this -
The dot data of the foreground image data at the address of the window memory 2 corresponding to the address of the mask memory 7 where the dot data is written is to be displayed, and when the dot data of the mask data is "0", The corresponding dot data of the foreground image data should be prohibited from being displayed.

The address converter 6 also generates a window address as a read address for the window memory 2 and mask memory 7. This window address is obtained by converting the display address from the display address generating section 4 according to the window display position data set in the window display position register 5. The window display position data defines the range of the foreground image on the screen of the display device 11 based on the foreground image data stored in the window memory 2. However, this "range of the foreground image" refers to the range of the foreground image displayed on the screen when the entire foreground image data stored in the window memory 2 is supplied to the display device 11, as will be described later. The actual display area of the foreground image on the screen of the display device 11 is this “display range”.
The window is defined by the mask data in the mask memory 7 within the range of the foreground image. The address conversion unit 6 generates a window address at the timing of the supplied display address when the supplied display address represents a scanning point included within the range of this foreground image on the screen of the display bag 211. window memory 2
In the mask memory 7, the dot data of the foreground image data and the dot data of the mask data written at the address indicated by the generated window address are read simultaneously.

According to the window display position data in the window display position register 5, when the display address supplied from the display address generation unit 4 represents a scanning point outside the range of the foreground image on the screen of the display device 11, the address is The converter 6 does not generate a window address.

The dot data of the background image data sequentially read from the display memory 1, the dot data of the foreground image data, and the dot data of the mask data read simultaneously from the window memory 2 and the mask memory 7 are controlled by the data switching unit 1.
0. The data switching unit 10 includes a mask memory 7
When the dot data of the mask data from window memory 2 is "1", the dot data of the foreground image data from window memory 2 is selected, and when the dot data of the mask data is "0" and when the dot data of the mask data is not supplied. (At this time as well, it is equivalent to the mask data "0" dot data being supplied, so below, the data switching unit 1
0, the dot data of the mask data is "0", unless otherwise specified, includes the case where no dot data is supplied from the mask memory 7)
In this case, the dot data of the background image data from the display memory 1 is selected and supplied to the display device 11, respectively.

In this way, on the screen of the display device 11, the dot data read out from the window memory 2 when the dot data '1'' is read out from the mask memory 7 is
Dots of the image are displayed at the scanning points corresponding to the display addresses generated at this time, and dots based on the dot data read from the display memory 1 are displayed at other scanning points. Therefore, the area on the screen of the display bag 211 that includes only image dots based on the dot data read from the window memory 2 becomes the window in which the foreground image is displayed, and the background image is displayed in the other area. In other words, the foreground image is inserted into the background image and synthesized.

However, as is clear from the previous explanation, the entire foreground image is not displayed based on the foreground image data stored in the window memory 2 (the display range (i.e. window) is set in the mask memory 7). It is determined by the mask data. In other words, the size and shape of the window are determined by this mask data. The mask data pattern can be arbitrarily set by the window data cutting section 8, and thereby the window size and shape are determined by the mask data. , the shape can be arbitrarily determined.It goes without saying that the window display position data set in the window display position register 5 is determined by the position of the window on the background image to be displayed.

Here, the method of generating the window address in the address conversion section 6 will be explained in more detail.

Now, in FIG. 2, it is assumed that one image is a dot matrix with 9 rows and 14 columns, and the position of each dot is expressed by coordinate values (X, Y) in the X and Y directions. In this way, the background image shown in FIG. 2(a) consists of a dot matrix of 9 rows and 14 columns, and the foreground image of FIG. 2(b) consists of a dot matrix of 3 rows and 3 columns.

Here, the foreground image is replaced by dots (5, 2) and (7, 2) in the background image, as shown in FIG. 2(C).

Assuming that the window is to be fitted into a square area surrounded by (4, 7) and (4, 5), window display position data representing this fitting area is written to the window display position register 5 in FIG.

This window display position data may be any data that represents this inset area; for example, the coordinates of the dots at the upper left corner and lower right corner of the inset area, as shown in FIG.
In example C) (5,2).

(7, 4). As a result, the inset area is from X-5 to
It is defined by the range of 7 in the X direction and the range of Y-2 to Y-4 in the Y direction.

The address converter 6 generates a window read address when the display address from the display address generator 4 represents a dot position within the embedded area set in the window display position register 5, and thereby stores the address in the window memory 2. As shown in FIG. 3(d), the stored dot data DAO, DA1, . . . , DA8 are sequentially read out. In this case, the display addresses are generated in the scanning order of the display device 11, and the address converter 6 converts the display addresses 0.1, 2, .・Old...
Window read addresses are generated in the order of 8.

Note that FIG. 3(c) is a diagram showing the generation timing of the window read address by the address converter 6 with respect to the background image.

In this way, the window display position register 5 sets the inset area (window) of the foreground image in the background image, as shown in FIG. 2(c), and the display device 1
Foreground image data and mask data are read out from the window memory 2 and the mask memory 7 in synchronization with the scanning of the embedded area on the first screen.

The coordinate reading device 12 reads the coordinates of sequentially moving scanning points on the display device 11, and when the window position convertible mode is set, the coordinate reading device 12 reads the coordinates of scanning points that sequentially move on the display device 11. When data is created and the window shape setting mode is set, the user can change the area or position on the screen of the display device 11.
Create mask data based on instructions. These window display position data and mask data are written into the window display position register 5 and mask memory 7, respectively.

The shape and size of the range of the entire foreground image data stored in the window memory 2 on the background image is determined by the window memory 2, and the shape of this range is usually square or rectangular. Therefore, in order to set the position of this range on the background image, it is sufficient to specify one point on the background image. For example, when trying to set the position of a foreground image with the shape and size shown in Figure 2(b) on the background image as shown in Figure 2(c), the position on the background image is set by the user. The instruction indicates the position of the upper left corner of this square-shaped foreground range, and the point indicated by the user is on the screen in the X, Y coordinate system (
5,2), the size of the range of this foreground image is X,
Since it is 2 in the Y coordinate system, the coordinate reading device 12 detects this indicated coordinate (5°2) and extracts the window display position data of (5, 2) and (7, 4) from the display address at the time of this detection. is created and written to the window display position register 5.

This allows the user to display device 1! ! When the indicated points on the screen 11 are sequentially moved, the coordinates of these indicated points are sequentially detected and window display position data is created, and each time this data is created, it is rewritten in the window display position register 5. . Therefore, in the display device 11, the foreground image displayed within the window moves as the user moves the pointing point while being overlaid on the background image.

In the window shape setting mode, for example, when the user specifies an arbitrary range or arbitrary dot on the screen of the display device 11 while checking the currently displayed window, the CPU 100 , or convert the position into an address of the mask memory 7 and write mask data "1" to the mask memory 7.

The write timing at this time is performed during a period when the read operation of the mask memory 7 is not performed (for example, during a vertical/horizontal blanking period). As a result, the mask memory 7
can store mask data of any pattern. Furthermore, if the mask memory 7 is set to display foreground image data when mask data "11" is written and to display background image data when mask data "0" is written, the display device It is possible to modify the shape and size of the window while looking at the 11 screen.

In the above manner, window shapes and sizes other than those set by the window data cutting section 8 itself as described above can also be set.

Once the position, shape, and size of the window on the display devices 1 and 1 are determined, the editing work of the foreground image on the background image is completed.
By operating the transfer control unit 9, the mask memory 7
Window memory through mask by 2. The foreground image data of is transferred to and written into the display memory l. In this case, reading from the window memory 2 is also performed based on the window continuation address from the address converter 6 controlled by the window display position register 5, and writing to the display memory 1 is also performed from the display address generator 4. This is done based on the display address of , and the display memory I is in the write mode only when the dot data of the foreground image data is supplied. Therefore, in the display memory 1, each dot of this foreground image data is displayed on the display device 1.
This means that the image data is written to the address corresponding to the position of the window displayed in step 1, and the foreground image is inserted into the window whose position is set by the window display position register 5 in the background image. The image data is then read from the display memo IJ1 by the data input/output section 3, and supplied to an external device, for example, an external recording device, where it is subjected to predetermined processing such as recording.

With the above configuration, when only one image is to be monitored, image data for one image is input from the data input/output section 3,
What is necessary is to store it in the display memory 1.

This image data is repeatedly read out from the display memory 1 and supplied to the display device 11 via the data switching section 10 for image display.

If you want to edit the foreground image into the background image, select 1.
Background image data is stored in a display memory 1, and foreground image data is stored in a window memory 2.

As a result, the foreground image is inserted into the background image and displayed on the display device 11, but the size and shape of the window that determines the area of the foreground image are set by the mask data in the mask memory 7, and the position of the window is It is set by the window display position data in the window display position register 5. At this time, by operating the coordinate reading device 12 while checking the window on the display device 11, it is possible to modify the mask based on the mask data in the mask memory 7 and change the shape and size of the window. The window position can be changed by modifying the window display position data in the display position register 5. After the window of the desired shape and size is set at the desired position, when the transfer control unit 9 is operated. , the foreground image data in the window memory 2 is read out and written into the display memory 1 via a mask set in the mask memory 7. Editing is now complete, and the image data is read from the display memory 1 and transferred from the data input/output unit 3 to an external device (not shown).

As described above, in this embodiment, the shape and size of the window can be set arbitrarily and in real time.
Furthermore, the position of the window on the background image can be changed arbitrarily and in real time, and editing can be performed quickly and accurately.

Next, specific examples of each part in FIG. 1 will be explained.

FIG. 4 is a block diagram showing a specific example of the address conversion unit 6 in FIG.
15 is a Y-direction counter, 15 is an X-direction comparison circuit, 16 is a Y-direction comparison circuit, 17 is a conversion address counter, 18 is an X-direction display range register, and 19 is a Y-direction display range register.

In the same figure, the address converter 6 is an X-direction counter 13.
, a Y-direction counter 14, an X-direction comparison circuit 15, a Y-direction comparison circuit 16, and a conversion address counter 17.
(Figure).

The X-direction counter 13 is connected to the display address generator 4 (Fig. 1).
The count is incremented by 1 each time the display address AD is supplied from , and is reset each time the horizontal blanking period signal HBLK synchronized with the scanning of the display device 11 (FIG. 11) is supplied. Further, the Y-direction counter 14 outputs a horizontal retrace period signal H.
It counts up by one each time BLK is supplied, and is reset each time a vertical blanking period signal VBLK synchronized with the scanning of the display device 11 is supplied. Therefore, the count value of the X direction counter 13 represents the dot position in the X direction in the dot matrix of one image, and the count value of the Y direction counter 14 similarly represents the dot position in the Y direction. An arbitrary dot position in this dot matrix is expressed as (X, Y) as described above, assuming that the count values of the X direction counter 13 and the Y direction counter 14 are integers X and Y, respectively.

Below, taking the example of Fig. 2, 0≦X≦13.0≦Y≦9
shall be.

The count value X of the X direction counter 13 is the X direction comparison circuit 1.
5 and is compared with the X-direction display range data XA stored in the X-direction display range register 18. This X
The direction display range data X indicates the range in the X direction of the foreground image according to the foreground image data stored in the window memory 2 in the background image displayed on the display device 11, and
In the case of the example shown in the figure, 5≦Xmu≦7. The X-direction comparison circuit 15 is X-XA, and outputs an active signal when this counter value X represents the position of the display area of the foreground image in the X-direction. The Y-direction comparison circuit 16 is similar, and compares the count value Y of the Y-direction counter 14 with the Y-direction display range data YA stored in the Y-direction display range register 19, and outputs an active signal when Y-Y is The output is complete. The Y-direction display range data Y represents the range of the foreground image in the displayed background image in the Y-direction, and in the case of the example shown in FIG. 2, 2≦X≦4.

The conversion address counter 17 is connected to the X-direction comparison circuit 15 and the Y-direction comparison circuit 15.
When the direction comparator circuit 16 is outputting an active signal, the display address AD supplied is incremented by 1, and the count value is set as the window address AW.
Output as . However, when the horizontal blanking period signal HBLK is supplied, the output of the window address AW is prohibited, and when the vertical blanking period signal VBLK is supplied, it is reset and the output of the window address is prohibited. Due to the configuration and operation, in the case of the example shown in FIG. 2, the dot positions (X, Y) determined by the X direction counter 13 and the X direction counter 14 are (C2), (6, 2), (7, 2).
, (5,3) , (6,3), (7,3), (5,4)
, (6, 4), (7, 4), the conversion address counter 17 sets the window address AW to 0 in this order.
．． 1.2. ..., 7.8 occurs in the order. As a result, as shown in FIG. 3(d), the dot data DA of the foreground image data stored in the window memory 2 is
O to DA8 are read out at the timing when they are displayed at the above-mentioned dot positions on the display device 11, respectively.

In this specific example, the count inputs of the X-direction counter 13 and the conversion address counter 17 are used as the display address AD, but the display address AD in this case is the display address AD that is synchronized with the display address generated by the display address generation section 4, respectively. This is a pulse, and at the same time as this display address is generated, this pulse is sent to the X direction counter 13 and the conversion address counter 1.
In this case, the conversion address counter 17 may be supplied with the vertical blanking period signal VB.
It is reset by LK, and the reset value at this time is the maximum value. In the example shown in FIGS. 2 and 3, a 4-bit counter can be used as the conversion address counter 17, and all bits are reset to the maximum value 15 of 1'' by the vertical blanking period signal VBLK. .and,
After that, the X-direction comparison circuit 15 and the Y-direction comparison circuit 16 simultaneously output active signals to display the first display address A.
When D is input, window address AW becomes 0, and dot data DAO is read from address 0 in window memory 2 shown in FIG. 3(d).

In this specific example, if the active signals from the X-direction comparison circuit 15 and the Y-direction comparison circuit 16 are @H'', their AND output is used, and if the active signals are "Ll", the NOR output is used to control the readout of the window memory 2. It can also be used as a signal.

Furthermore, in the case of the example shown in FIG. 2, as explained earlier, the event 9 display position register 5 contains the dot position (5, 2) at the upper left corner of the range of the foreground image in the background image. and the position of the dot in the lower right corner (7°4) are set,
As a result, the X-direction display range register 18 contains 5 X-direction display range data X^ from the X coordinates of these dot positions.
≦X＾≦7 -0 In this case, the X-direction display range data XA may be set to a value of 5.7, and in the X-direction comparison circuit 15, the count value X of the X-direction counter 13 is set to 5.
It is determined whether ≦X≦7. This also applies to the Y-direction comparison circuit 16 and the Y-direction display range register 19.

As described above, the positions of all areas of the window memory 2 with respect to all areas of the display memory 1 are determined by the window address from the address converter 6, as shown in FIG. Also, the mask memory 7 is also the window memory 2.
is the same number of addresses, each address corresponds one-to-one with each address of the window memory 2, and is written using the window address from the address conversion unit 6.
Reading is performed. Therefore, as shown in FIG. 5, the entire area of the mask memory 7 also overlaps the entire area of the window memory 1 at the same position in the entire area of the display memory 1. This allows window memory 2
The foreground image stored in the foreground image will be positioned in the background image in the display memory 1 through a mask set in the mask memory 7.

FIG. 6 is a block diagram showing an example of the window cutting section 8 in FIG. 1 for setting mask data in the mask memory 7, in which 20 is a readout circuit, 21 is a transparent color range register, and 22 is a comparison circuit. , 23 are write circuits, which are given the same reference numerals as the parts corresponding to FIG.

In this specific example, a case will be described in which a foreground image is inserted into a background image by chromakey processing.

In the same figure, the foreground image for embedding and synthesis is obtained by capturing an image of a foreground object using a camera with a uniform blue background, for example, and using image information in a certain range including this foreground object image as A.
/D conversion to foreground image data and store it in window memory 2.
Then, according to the window address from the address converter 6, the readout circuit 20 reads out the dot data from the window memory 2 in address order.
It is supplied to the comparison circuit 22. The transparent color range register 21 stores the dot data D read out from the window memory 2.
AI (in the case of Figure 3(d), l-0°1.2...
..., 8), transparent color range data BA representing the value of the dot data representing the background color (blue) is stored, and the comparison circuit 22 compares the dot data DAi with the transparent color range data BA. Then, it is determined whether the dot data DAI is dot data representing a background color.

When taking an image of a foreground object, depending on the lighting condition at the time of imaging and the shadow of the object, even if the background is uniformly blue, the background may be bright blue or dark blue. Even in such a case, the comparator circuit 22
In order to be able to detect dot data that accurately represents the background color, the transparent color range data BA has a width corresponding to this background color range.

The comparison circuit 22 receives the dot data D from the readout circuit 20.
When Ai is not included in the range set by the transparent color range data BD, it is determined that it is dot data representing an image of a foreground object, a signal of "1" is output, and the range set by the transparent color range data BD is determined. When it is included in the background color, an "O" signal is output as dot data representing the background color. The output signals of these comparison circuits 22 are written into the mask memory 7 by the write circuit 23, but the addresses of the mask memory 7 and the window memory 2 correspond to each other. Moreover, the write address of the mask memory 7 at this time is also the address converter 6.
The window address from the window memory 2 is used, so that the address of the mask memory 7 corresponding to the read address of the window memory 2 is set to "1" or An output signal of 0'' is written.

In this way, in the mask memory 7, data of "0" is stored in the address corresponding to the address of the dot data representing the background color in the window memory 2, and data of "1" is stored in the other addresses, respectively. Mask data for the foreground image data in the window memory 2 is set.

Also, when the user performs a predetermined operation while checking the mask on the display device 11, “
Signals of ``1'' and ``0'' can be supplied to the write circuit 23, and these signals are written into the mask memory 7 to change the shape and size of the mask in the mask memory 7.

FIG. 7 is a block diagram showing an example of the transfer control section 9 in FIG. 1, in which 24 and 25 are latch circuits, 26 is a selection switch, and parts corresponding to those in FIG. 1 are given the same reference numerals. ing.

In the figure, the transfer control section 9 is composed of latch circuits 24 and 25 and a selection switch 26.

During an editing operation for setting a window on the display device 11, the write mode signal WM is not active, and the above window read address is supplied from the address converter 6 to the window memory 2 and mask memory 7, and the read signal R3 is supplied. The dot data of the foreground image data is read out from the window memory 2, and the dot data of the mask data is read out from the mask memory 7 correspondingly. At this time, the latch circuits 24 and 25 do not perform a latching operation, but instead pass the dot data from the window memory 2 and the dot data from the mask memory 7 as they are, and supply them to the data switching section 10 and the display memory 1.

Also, at this time, the selection switch 26 selects the read signal R3 supplied in synchronization with the display address output timing of the display address generation section 4 and supplies it to the display memory 1.

As a result, the dot data of the background image data is sequentially read out from the display memory l and supplied to the data switching section 10.

When the dot data of the mask data from the mask memory 7 supplied via the latch circuit 25 is 11', the data switching unit 10 selects the dot data of the foreground image data supplied from the window memory 2 via the latch circuit 24. is selected, and when the dot data of the mask data is @Om or when no dot data is supplied from the mask memory 7,
The dot data of the background image data from the display memory 1 is selected and supplied to the display device 11, respectively.

When editing is completed and the user performs a predetermined operation, write mode signal WM becomes active, and latch circuit 24.
25 starts a latch operation for latching the dot data from the window memory 2 and the mask memory 7 for one read period of the dot data, respectively.

In addition, since the write mode signal WM became active, in the window memory 2 and the mask memory,
The window read address generation operation of the address conversion unit 6 is performed so that reading of the display memory 1 is performed at the address one address before the address corresponding to the address specified by the display address from the display address generation unit 4. is set. The dot data read out from the window memory 2 and the mask memory 7 in this manner are each latched by latch circuits 24 and 25 for one dot data read cycle, and the dot data from the latch circuit 24 is supplied to the display memory 1. be done. - side, write mode signal WM
When activated, the selection switch 26 is controlled by the output dot data of the latch circuit 2°5, and when this output dot data is 1'', the selection switch 26 selects the write signal WS supplied in synchronization with the read signal R3. When the output dot data is 03, MO'' is latched in the latch circuit 25 even when the dot data is not read out from the mask memory 7) Read signal R3
is selected and supplied to the display memory 1. For this purpose, when the read signal R3 is supplied and the dot data are read from the window memory 2 and the mask memory 7, and are latched in the latch circuits 24 and 25, respectively, the dot data is latched in the latch circuit 25. When the dot data of the mask data is '11', the dot data is latched by these latch circuits 24 and 25, and then the selection switch 26 closes to select the write signal WS for one read period of the dot data. Then, the next write signal WS is supplied during the period of one successive output cycle, and this is supplied to the display memory l via the selection switch 26, and the dot data of the foreground and both image data latched in the latch circuit 24 is displayed. memory 1
is written to the address specified by the display address.

Therefore, from the perspective of display memory 1, the latch times written there! The dot data from 24 becomes the dot data of the foreground image data read from the address in the window memory 2 that corresponds one-to-one to the address in the display memory 1 designated for writing by the display address.

When the data "θ'" is latched in the latch circuit 25, the selection switch 26 selects the read signal R3.

Therefore, even if the dot data of the foreground image data is read out from the window memory 2, it is not written into the display memory l.

Note that the data switching unit 10 performs a selection operation in synchronization with the read signal R3 and the write signal WS. For this reason, even if the dot data of "1" is latched in the latch circuit 25, the dot data of the foreground image data latched in the latch circuit 24 is selected at the timing of the next read signal R8 and write signal WS. It is supplied to the display device 11. therefore,
Even if the write mode signal WM becomes active and the read address of the window memory 2 is advanced by one with respect to the display memory 1, the position of the window on the display device 11 does not change.

As described above, the transfer control unit 9 can have a simple circuit configuration consisting of only a latch circuit and a selection switch, and can transfer the image data of the edited foreground image into the set shape without disturbing the display. It can be transferred to the display memory 1 with the same size and at the set window position.

In the above embodiment, the window memory 2 and the mask memory 7 are separate memories, but they may be the same memory.For example, if a memory with a depth of 8 pits is used, 7 bits of the 8 bits are used as the window memory 7. It is used as a memory for dot data of foreground image data, and the remaining 1 bit is used as a mask memory for dot data of mask data.

In addition, in this embodiment, the mask data was created by chromakey processing, but the window memory 2
Other methods may be used, such as extracting the outline of the foreground image from the foreground image data stored in the image data and creating mask data based on this.

Furthermore, the size of the range of the foreground image stored in the window memory 2 can be set to any size within the capacity of the window memory, but in order to do this, the reading position and window size of the window memory 2 must be set. All you need to do is to provide registers and output the window address according to the settings of these registers.Also, by appropriately converting the window address, you can scroll, enlarge, reduce, rotate, etc. the displayed foreground image. can be easily realized.

FIG. 8 is a block diagram showing another embodiment of the digital image editing apparatus according to the present invention, in which 2a to 2C are window memories and 5a to 5c are window display position registers.
6a to 6c are address conversion units, 73 to 7c are mask memories, 27 is a data input unit, 28 is a data write control unit, 2
9 is a window data extraction section; 30 is a display switching circuit;
31 is a display priority register, and parts corresponding to those in FIG. 1 are given the same reference numerals.

In this embodiment, three foreground images can be displayed in any window shape at any position of the background image.

In the figure, when writing background image data to the display memory 1, this background image data is input to the data input section 27, and the data write control section 28 uses the display address from the display address generation section 4 to write the background image data to the display memory 1. is written to display memory l.

The foreground image data is written into any of the window memories 2a to 2c, but when writing this foreground image data, the foreground image data input to the data input section 27 is used to extract window data via the data write control section 28. It is temporarily sent to Department 29. Window data extraction section 2
At step 9, mask data is created from the input foreground image data by chromakey processing or the like, and the created mask data and foreground image data are sent back to the data write control section 28. The data write control unit 28 simultaneously writes the input mask data and foreground image data to one of the window memories 2a to 2C and a mask memory 'that is paired with the window memories 2a to 2C.
7 Write in a to 7C.

In this way, each time foreground image data is input to the data input section 27, it is written into one of the window memories 2a to 2c, and a mask is paired with the window memory to which writing is performed among the mask memories 7a to 7c. Mask data is written to memory. Therefore, in this embodiment, up to three pieces of foreground image data can be written.

As in the previous embodiment, the coordinate reading device 12 determines the range of the foreground image on the display device 11 in the window display position registers 5a, 5b, 5c based on the foreground image data stored in the window memories 2a, 2b, 2c. Window display position data is stored. Address conversion parts 6a, 6
Similarly to the previous embodiment, the window readout addresses are output at timings according to the window display position data set in the window display position registers 5a, 5b, and 5c. According to these window read addresses, the window memories '1m and 2b are read.

Foreground image data is read out from 2c via the mask data of mask memories 7a, 7b, and 7c, respectively, and is supplied to the display switching circuit 30 together with the background image data read out from display memory 1.

On the other hand, the display priority register 31 contains a display priority that defines the display priority on the display device 11 of a background image based on the background image data from the display memory l and a foreground image based on the foreground image data from the window memories 2a to 2c. Ranking data is set, and as a result, for each scanning position on the display device 11, either one of the background image data and the foreground image data is given priority to the display switching circuit 30.
is selected and supplied to the display device 11.

Here, this display priority data determines the priority of display memory 1 and window memories la to 2c. For example, this display priority data determines the priority of display memory 1, window memory 2as, window memory 2b,
c s Assuming that the priority is determined in the order of display memory 1, when all the dot data of the mask data from mask memories 7a to 7c are 11 (“1” from mask memory
When dot data of "" is output, it indicates that the corresponding dot data of the foreground image data in the window memory is valid, and when dot data of "0" is output from the mask memory, the corresponding dot data of the foreground image data is output. (indicating that the dot data of the foreground image data in the window memory is invalid), the display switching circuit 30 selects the dot data from the window memory 2a corresponding to the mask memory 7a according to the display priority data described above. When 1'' dot data is being output from only two mask memories, the display switching circuit 30 selects the dot data from the window memory corresponding to the mask memory with higher priority among these two. 0 For example,
When 11" dot data is output from mask memory 7b and mask memory 7C, mask memory 7b
The display switching circuit 30 selects the dot data from the window memory 2a corresponding to the dot data. If only one mask memory is outputting l''' dot data,
The display switching circuit 30 selects dot data from the window memory corresponding to the mask memory outputting this "1" dot data. Furthermore, when no mask memory is outputting dot data of "1", the dot data from display memory 1 is selected and the dot data selected by switching circuit 30 is sent to display device 11. displayed.

Note that the coordinate reading device 12 reads the scanning position of the display device 11 according to a user's instruction, and supplies the read position to the window display position registers 58 to 5C and the display priority register 31. Thereby, the foreground image display position and display priority order based on the foreground image data written in each of the window memories 2a to 2C can be freely changed according to the user's will.

In this manner, in this embodiment, three types of arbitrarily shaped foreground images can be moved and superimposed in any order of priority to any position in real time while being overlaid on the background image.

Of course, by adding a window memory, a mask memory, an address converter, and a window display position register as necessary, it becomes possible to display even more arbitrary-shaped windows in a superimposed manner. In addition, data writing between window memories or between window memory and display memory was not specified, but Figures 1-
By providing a circuit like the transfer control section 9 of the embodiment shown in FIG.
It is obvious that it becomes possible to write foreground image data in arbitrary shaped windows of a to 2C.

〔Effect of the invention〕

As explained above, according to the present invention, a background image is displayed using the background image data from the display memory, a window formed by the window memory and the mask memory is overlaidly displayed on the background image, and the foreground image data in the window memory is Since it is possible to change the read timing and mask data in the mask memory, it is possible to change the window position, shape, and size of the window on the foreground image in real time. You can get excellent effects by being able to edit images.

[Brief explanation of drawings]

FIG. 1 is a block diagram showing an embodiment of a digital image editing device according to the present invention, FIG. 2 is a diagram showing the relationship between overlapping background images and foreground images, and FIG. 3 is a diagram showing the display memory and windows in FIG. 1. Figure 4 is a block diagram showing the relationship between address and display in memory. Figure 4 is a block diagram showing an example of the address conversion section in Figure 1. Figure 5 is the address positions of display memory, window memory, and mask memory in Figure 1. FIG. 6 is a block diagram showing an example of the window data extraction section in FIG. 1, and FIG.
FIG. 8 is a block diagram showing an example of a transfer control unit in the figure, and FIG. 8 is a block diagram showing another embodiment of the digital image editing apparatus according to the present invention. 1...Display memory, 2, 2a to 2C...
・・・・・・Window memory, 4・・・・・・・・・
・Display address generation section, 5.5a to 5C...
・・Window display position register, 6, 6a to 6C・・
・・・・・・Address conversion section, 7°7a to 7C...
......Mask memory, 8......Window data cutting section, 10......Data switching section, 11......Display device , 29...
...Window data extraction section, 30...
...Display switching circuit, 31...Display priority register. Ward arrow q1 Niyo S Figure 5 X direction Figure 6 Figure 8

Claims (1)

[Scope of Claims] 1. A digital image editing device in which a foreground image is embedded and displayed in a background image by a display means, which comprises a display memory for storing background image data representing the background image, and a display memory for storing background image data representing the background image; display address generation means for generating a display address for reading data; a window memory for storing foreground image data representing the foreground image; and a window memory for storing foreground image data representing the foreground image; A rewritable mask memory that stores mask data for foreground image data, a window data cutting unit that generates the mask data of an arbitrary pattern and writes it into the mask memory, and converts the display address into the window memory and the mask memory. address converting means for generating a window address for reading data; a register storing window display position data that defines the conversion processing operation of the address converting means; Window display position data generation means for writing into a register, and foreground image data read from the window memory within a predetermined range determined by a pattern of the mask data read from the mask memory every background image data read cycle of the display memory. 1. A digital image editing device comprising: selecting means for selecting the background image data read out from the display memory outside the predetermined range. 2. In claim 1, transfer control reads the foreground image data from the window memory via mask data of the mask memory and writes it into an area of the display memory corresponding to a display position of the foreground image on the display means. 1. A digital image editing device comprising: means. 3. In claim 2, the transfer control means advances the output timing of the window address in the address conversion means by one period of the display address;
a first latch circuit that delays dot data of the foreground image data read out from the window memory according to the window address by one period of the display address; and the mask read out from the mask memory according to the window address. a second latch circuit that delays dot data of data by one cycle of the display address; and a second latch circuit that selects either a read signal or a write signal according to the dot data output from the second latch circuit; and a selection switch that supplies data to a display memory, and when the selection switch selects the write signal, the dot data output from the first latch circuit is written to the address specified by the display address of the display memory. A digital image editing device characterized by being configured as follows. 4. A digital image editing device in which a display means displays a plurality of foreground images embedded in a background image, comprising: a single display memory for storing background image data representing the background image; and a display memory for reading data from the display memory. a single display address generation means for generating a display address for the foreground image; a window memory for storing foreground image data representing the foreground image; and a window memory for storing foreground image data representing the foreground image; A rewritable mask memory for storing mask data for foreground image data, an address conversion means for converting the display address to generate a window address for reading data from the window memory and the mask memory, and the address conversion means. a plurality of foreground image memory means each including a window display position register in which window display position data defining a conversion processing operation is stored; window data cutting means for writing the mask data into the window memory and the mask memory of any of the foreground image memory means; and window data cutting means for generating arbitrary window display position data of the foreground image memory means. window display position data generation means for writing into the window display position register; a display priority register for setting display priority between the display memory and the plurality of foreground image memory means; and the background read from the display memory. Either one of the dot data of the image data and the dot data of the foreground image data read from the window memory of each of the foreground image memory means is converted into the mask data of the foreground image data read from the mask memory of each of the foreground image memory means. A digital image editing device comprising a selection means for selecting dot data and a display priority set in the display priority register and supplying the selected data to the display means.