JP2002084457A - Image processing unit and method, and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processing unit that pastes a moving picture to an input image so as to generate a composite image with a plurality of patterns from the one input image. SOLUTION: A camera 61 photographs a moving picture or a still picture and supplies a video signal configuring the moving picture or the still picture to a filter 62 through prescribed processing (not shown). The filter 62 extracts a generated image (moving picture) having already been generated and stored in e.g. a storage medium such as a HDD as sown in Figure 1 (b) and pastes the generated image to the original photographing image by using a mask pattern.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing apparatus and method for effecting an externally input image, and a recording medium.

[0002]

2. Description of the Related Art Conventionally, as an effect function performed by an image processing apparatus, there has been a function of pasting a still image to a captured image called a "frame".

[0003]

Conventionally, only one pattern can be generated for one picture (photographed image) because the image to be pasted is a still image.

SUMMARY OF THE INVENTION The present invention has been made in view of the above circumstances, and has an image processing apparatus capable of generating a composite image of a plurality of patterns from one input image by using an image to be pasted as a moving image. It is intended to provide a method and a recording medium.

[0005]

In order to solve the above-mentioned problems, an image processing apparatus according to the present invention performs an effect processing on an image input from the outside in an image processing apparatus. The image processing apparatus includes a storage unit that stores the image and a combining unit that pastes the moving image read from the storage unit to the image input from the outside.

Here, the synthesizing unit separately pastes each of the still images constituting the moving image read from the storage unit to the image.

The image input from the outside is a moving image or a still image. Then, when the image input from the outside is a moving image, the synthesizing unit includes, for each still image constituting the moving image, one still image constituting the moving image read from the recording unit. Paste each one separately.

[0008] Further, the synthesizing means filters a predetermined area of the moving image to be pasted on the image input from outside using a mask pattern.

In order to solve the above-mentioned problems, an image processing method according to the present invention is directed to an image processing method for effect processing an externally input image. A combining step of pasting the moving image read from the storage unit that stores the generated moving image.

A recording medium according to the present invention is a recording medium for recording an image processing program for performing an effect process on an image input from the outside in order to solve the above-mentioned problem. A program having a synthesizing step of pasting a moving image read from a storage unit that stores a previously generated moving image to an image is recorded.

[0011]

Embodiments of the present invention will be described below with reference to the drawings. This embodiment is an image processing system that simultaneously displays a moving character on a moving image, a still image, or the like captured by a digital camera or the like.

This image processing system has an effect function in moving image and still image capturing (shooting) software such as Smart Capture (trademark) which is a still image and moving image capturing tool of a digital video camera. Applicable when performing

Conventionally, the effect function has a function of pasting a still image to a captured image called a "frame". However, in the conventional "frame", only one pattern can be generated for one picture (captured image) because the image to be pasted is a still image.

In this embodiment, the function of "frame" is applied to a moving image so that various pictures can be generated according to the shooting timing.

That is, for a moving image input or a still image input, a generated image (moving image) generated as, for example, a bitmap image is synthesized by the filter means. Then, by capturing a still image of each frame of the generated image with the moving image input or the still image input, the combined image of a plurality of patterns can be obtained.

FIG. 1A shows the configuration of an image processing system for generating a composite image of a plurality of patterns. This system includes a camera 61 as shown in FIG.
And moving image filter 6 for still image and moving image shooting software
And outputs a composite image of a plurality of patterns as the filter output 63.

The camera 61 shoots a moving image or a still image,
The video signal forming the moving image or the still image is supplied to the filter 62 through a predetermined process (not shown). In the filter 62, as shown in FIG. 1B, a generated image (moving image) that has already been generated and stored in a storage medium such as an HDD is taken out, and the original image captured using a mask pattern is taken out. Paste on the image.

FIG. 2 schematically shows a pattern in which the generated image (image B to be superimposed) is combined with the original image A by using a mask pattern C. In particular, here, the image to be superimposed and the mask pattern are generated for each frame of the generated image (moving image), and are pasted on the original image.

As a result, as shown in FIGS. 3A, 3B and 3C, the photographed building 73 is displayed in the application diagram 71 on the desktop screen 71.
And the generated image having more motion, that is, the characters T72a, 72b, and 72c can be combined and displayed.

The processing up to this point will be described together with reference to the flowchart of FIG. First, it is assumed that the smart capture effect function is selected in step S11, for example. Next, in step S12, if the effect (character T) of the present invention is selected, step S1
The process proceeds to step 3 and subsequent steps. If not selected, the process ends.

In step S13, an image file of the character T stored in a storage medium such as the HDD is read. Here, a plurality of bitmap images prepared in advance are read. As a specific example, it is assumed that there are five images.

In step S14, the order i of the images from the camera 61 is initialized to 0, and the order j of the bitmap images from the image file is initialized to 0. Thereafter, the following processing is repeated until the end button is operated or another effect is selected in step S15.

Next, in step S16, one still image taken by the camera 61 is read. For example, 1 in 1/10 second
Assume that you read times. The j-th bitmap image (effect image) is combined with the read still image (step S17). The j-th one of the five bitmap images read in step S13 is combined with a still image from the camera 61 and output.

Then, steps S18 to S20
, The order of the still images from the camera is incremented, and when i becomes 10, ie, 0.1 × 10 = 1
Switch the bitmap image to be synthesized (every second). Further, through the processing of steps S20 to S22,
Since the number of bitmap images is 5, when j becomes 5, it is reset to 0.

Next, a method of laminating the bitmap images will be described. When a bitmap image is pasted onto a “still image from a camera”, the bitmap image is usually superimposed from the left end in the same range as the range of the still image from the camera. In order to make it look like a moving image, the stuck bitmap image is slightly shifted rightward from the left end. Then, the created image looks as if it moves to the left. If you shift it to the left, it appears to be moving up and down if you shift it to the right by the width of the screen.

In the case where one bitmap image is created,
Although it appears that the character T is simply moving, the character T appears to be walking when some of the images are repeatedly displayed in order. Here, about five bitmap images are repeatedly used. There is an advantage that the number of images to be created can be reduced even when the operation is repeated, for example, when walking.

The process of FIG. 4 executed by the image processing system may be recorded as an image processing program on a recording medium such as an optical disk or a semiconductor memory. For example, the computer device reads the recording medium shown in FIG.
By reading out an image processing program based on the above and executing the program on the CPU, it is possible to function as the image processing system.

The image processing system is applied to a technique for displaying a captured image and a character together in a computer device described below.

FIG. 5 schematically shows the computer 1. In FIG. 5, a computer device 1 communicates with application software 2, 3, and 4 executed on a CPU, which will be described later, and with application software 2, 3, and 4, and transmits character data, which will be described later, based on scenario information of the application software. And a character data storage unit 7 and a scenario information storage unit 6 connected to the character control unit 5 and providing character data and scenario information to be described later.

Specific examples of the application software 2, 3, and 4 will be described. Application software 2
Examples of digital still cameras
Smart capture (Smar
t Capture) (trademark). As a specific example of the application software 3, there is a picture gear (PicthreGear) (trademark) which is an image viewer & image shaping tool. Images captured by smart capture can be displayed as a slide show using picture gear. A specific example of the application software 4 is an agent program for displaying the character itself.

The character data storage unit 7 stores a desktop screen after starting basic software (Operating System: OS), application software 2, 3 and 4
The data of the character which appears in each application window by executing is stored. In the computer device, for example, a hard disk drive (HDD), a magnetic disk, an optical disk, a magneto-optical disk, and a semiconductor memory mounted on the drive serve as the character data storage unit 7.

The scenario information storage section 6 stores scenario information of each application software. In the computer device, for example, a hard disk drive (HDD), a magnetic disk, an optical disk, a magneto-optical disk, and a semiconductor memory mounted on the drive play a role similarly to the character data storage unit 7.

The character control unit 5 controls the character data stored in the character data storage unit 7 based on the scenario information stored in the scenario information storage unit 6, and controls the character in the application software 2, 3, and 4. Of the application window and the desktop screen with a story. That is, the character control unit 5
The character data from the character data storage unit 7 is
Based on the scenario information from the scenario information storage unit 6,
It is provided to the application software 2, 3, and 4 and the above basic software. The character control unit 5 is operated by a CPU of a computer device.

The application software 2, 3 and 4 communicate scenario information to the character control unit 5 by communicating with the character control unit 5 and obtain the character data. Then, the state and image information of the character are obtained and displayed in each application window based on the scenario information.

Communication between the character control unit 5 and the application software will be described later.

Next, the detailed configuration of the computer device 1 schematically shown in FIG. 5 is newly shown in FIG. CPU (Cental Processin
The unit 11 executes an image processing program based on the image processing method of the present invention, a plurality of application software, and an OS (Operating System). It also functions as the character control unit 2 shown in FIG.

The ROM 12 generally stores basically fixed data of programs used by the CPU 11 and calculation parameters. The RAM 13 is a CPU 1
1 stores a program used in the execution and parameters that change as appropriate in the execution. These are CP
They are interconnected by a host bus 14 such as a U bus.

The host bus 14 is connected to a PCI (Periphera1 Component Interconnect / Inte
rface) bus and the like. The keyboard 18 is operated by the user when inputting various commands to the CPU 11. The mouse 19 is used when pointing or selecting a point on the screen of the display 20.
Operated by the user. The display 20 is composed of a liquid crystal display device or a CRT (Cathode Ray Tube), and displays various information as text or images. HDD
A (Hard Disk Drive) 21 drives a hard disk and records or reproduces a program or information executed by the CPU 11 on the hard disk. In the present embodiment, an image processing program based on the above-described image processing method, software for allowing a character to freely move between a plurality of applications, or a plurality of application software are recorded in advance. Then, the program is reproduced and supplied to the RAM 13. Also, it functions as the character data storage unit 7 and the scenario information storage unit 6 shown in FIG.

The drive 22 includes a mounted magnetic disk 23, an optical disk (including a CD), and a magneto-optical disk 2.
4, or reads out data or a program recorded in the semiconductor memory 25, and supplies the data or the program to the RAM 13 connected via the interface 17, the external bus 16, the bridge 15, and the host bus 14. An image processing program based on the image processing method of the present invention, a program based on the application software execution method, a plurality of programs, and the like, are stored in the magnetic disk 23, optical disk (including CD), magneto-optical disk 24, or semiconductor memory 25. Application software may be recorded in advance. Further, it may function as the character data storage unit 7 and the scenario information storage unit 6.

USB (Universal Serial Bus) port 2
6, a portable device (not shown) is connected via a USB cable. The USB port 26 is data (including, for example, content or a command of a portable device) supplied from the HDD 21, the CPU 11, or the RAM 13 via the interface 17, the external bus 16, the bridge 15, or the host bus 14.
To a portable device.

The keyboard 18 to the USB port 26 are connected to the interface 17, and the interface 17 is connected to the CPU 11 via the external bus 16, the bridge 15, and the host bus 14.

The audio input / output interface 27 executes interface processing of digital audio input / output supplied from the input terminal 28 or analog audio input / output. The speaker 29 outputs a predetermined sound corresponding to the content based on the sound signal supplied from the sound input / output interface 27.

The communication unit 30 is connected to the network 31 and stores data (for example, a registration request or a content transmission request) supplied from the CPU 11 or the HDD 21 in a packet of a predetermined format, and CPU 31 transmits data (for example, an authentication key or content) stored in a packet received via network 31 to CPU
11, to the RAM 13 or the HDD 21.

Next, communication between the character control unit 5 and the application software 2 such as the smart capture and the application software 3 such as the picture gear will be described with reference to FIG. The character control unit 5 starts the application software 2 and 3 (S1). Then, a command to display the captured image in a slide show is issued to the application software 2 (S2).

Then, the application software 2
Or, 3 inquires of the character control unit 5 about the current position of the character (S3). In response to this inquiry,
The character control unit 5 determines the current position, shape,
An emotion parameter, a motion pattern, and voice information are provided as character data (S5).

Next, the application software 2 or 3 sends to the character control unit 5 specification information on its own display capabilities, such as color expression and gradation, and audio capabilities (S
5). Further, the usage of the application software is passed to the character control unit 5 as a series of scenario information (S
6). The character control unit 5 stores the scenario information in, for example, an HDD or another medium, and based on the scenario information, sends a command such as “select smart capture” or “select an effect” to the application software 2. To instruct.

Computer apparatus 1 will be described with reference to FIGS.
The following describes the operation performed when the user drives a program based on the application software execution method. HD
The application software execution program is read from a medium such as D, stored in the RAM 13, and executed by the CPU 11. Also, the CPU 11
It also functions as the character control unit 5 described above. Here, it is assumed that after the OS is driven, the user inputs an instruction to display a slide show. Application software 2 for slide show display
"Smart capture" and application software 3 "picture gear" need to be executed. In addition, since a still image of a character combined with a captured image is captured and displayed as a slide show, it is necessary to activate still image capturing software “Still View”. Here, as a specific example of executing a plurality of application software in cooperation with each other, “Smart Capture” and software for still image shooting “Still View” are started according to the instruction of the character, and “Picture Gear” is automatically set. Here is an example to be executed.

First, in FIG. 8A, a character T42 appears from the lower part of the desktop screen 41 so as to lean on a half body. Then, as shown in FIG. 8 (b), the whole body is displayed on the desktop screen 41, and a character frame 43 of "raise the smart capture" is displayed. According to this instruction, the user clicks “Smart Capture” on the task bar.

Next, as shown in FIG. 8C, a character frame 43 "Select an effect!" Is displayed on the desktop screen 41, as if the character T42 had spoken. (D), the effect setting screen 45 is displayed on the smart capture dialog 44.
Is displayed, and the type of the effect is displayed in the down display area 46 therein. Then, the character T42 instructs “select a character!” In the character frame 43.

Then, as shown in FIG. 9 (e), the character T2 climbs to the upper part of the dialog 44 and operates as if entering the dialog. Dialog 4
In FIG. 4, for example, one frame of a moving image captured by a digital camera is displayed. The moving image captured by the digital camera is taken into the computer device 10 via the semiconductor memory 25, the magnetic disk 23, and the optical disk 24 mounted on the drive 22 shown in FIG.
Further, the data may be stored in the HDD 21. Here, the pole vault player is shown in this one frame as state 47a. Character T during the next frame
42 enters as shown in (f) of FIG. 9 and is displayed together with the player's state 47b (character T42a).

Then, the character T42 starts moving as shown in FIG. 10G together with the motion of the moving image.
The character T42b has moved its position. A technique for simultaneously displaying the moving character T42 on a moving image, a still image, or the like captured by a digital camera or the like will be described later.

In FIG. 10 (g), the player's state 47c
In the case of the character T42b, still image shooting application software called still view is executed, and still image shooting is performed. Next, the desktop screen 41
In the above, the character T42 gives an instruction using the character frame 43 to “insert a comment in the photographed picture”. On the other hand, when the user enters a comment "Gambare" using a keyboard or the like as shown in FIG. 10 (i), the character T42 has a character frame 43 "Please close the still view if you enter a comment!" Is displayed and the still view is closed.

Then, from the desktop screen 41, FIG.
As shown in FIG. 1 (j), the character T42 is "OK,
Look at it! 11 (k) and FIG. 1 using a picture gear, which is a specific example of the application software 3 showing a slide show of a captured image obtained by the smart capture and the still view.
This is executed as shown in 1 (l).

Then, as shown in FIG. 12 (m), the picture gear 50a is displayed in the picture gear dialog 50, and the images 51a, 51b and 51c displayed in the slide show are displayed together. At this time, the character T4
2 uses a character frame 43 "How was it?" Finally, in FIG. 8 (m), "Jay again, bye-by!" Is displayed in a character frame 43, and the processing ends.

The character control unit 5 controls the character data on the application software programs 2, 3 and 4 so that the same character does not exist in a plurality of application windows and the desktop screen at the same time. FIG. 13 is a diagram showing the character T42 displayed in the application windows 55 and 56 of the two application softwares A and B. First, in FIG. 13A, the application software A is activated, and the character T42d is displayed. Next, when the application software B is activated, the character T42e starts to appear in the application window 56 as shown in FIG. 13 (b), and then completely appears as shown in FIG. 13 (c) ( Character T42f).

That is, in the computer device 1, it is possible to make one character appear to be freely moving on the desktop screen and the plurality of application windows.

Further, in the computer device 1, the operation procedure is displayed on the application window or the desktop screen using the character in accordance with the execution of the predetermined application software.

[0058]

According to the present invention, a combined image of a plurality of patterns can be generated from one input image by making the image to be pasted a moving image. In the case of an operation that repeats, the number of images to be created can be reduced.

[Brief description of the drawings]

FIG. 1 is a configuration diagram of a system that simultaneously displays a moving character on a moving image, a still image, or the like captured by a digital camera or the like.

FIG. 2 is a diagram schematically illustrating a pattern in which a generated image (image B to be superimposed) is combined with an original image A using a mask pattern C;

FIG. 3 is a diagram showing a combined image in an application diagram on a desktop screen.

FIG. 4 is a flowchart illustrating a process of a system for simultaneously displaying a moving character T on a moving image, a still image, or the like captured by a digital camera or the like.

FIG. 5 is a functional block diagram schematically showing a computer device.

FIG. 6 is a block diagram showing a configuration of the computer device in detail.

FIG. 7 is a diagram illustrating a communication process between a character control unit and application software.

FIG. 8 is a first operation explanatory diagram illustrating an operation when a computer device drives a program based on an application software execution method.

FIG. 9 is a second operation explanatory diagram illustrating an operation when the computer device drives a program based on the application software execution method.

FIG. 10 is a third operation explanatory diagram illustrating an operation when the computer device drives a program based on the application software execution method.

FIG. 11 is a fourth operation explanatory diagram illustrating an operation when the computer device drives a program based on the application software execution method.

FIG. 12 is a fifth operation explanatory diagram illustrating an operation when the computer device drives a program based on the application software execution method.

FIG. 13 is a sixth operation explanatory diagram illustrating an operation when the computer device drives a program based on the application software execution method.

[Explanation of symbols]

1, 10 computer device, 2, 3, 4 application software, 5 character control unit, 6 scenario storage unit, 7 character data storage unit, 61 camera, 62 filter

 ──────────────────────────────────────────────────続 き Continued on the front page F-term (reference)

Claims (7)

[Claims] 1. An image processing apparatus for performing an effect process on an image input from the outside, comprising: storage means for storing a moving image generated in advance; And a synthesizing unit for pasting the moving image read from the unit. 2. The image according to claim 1, wherein the synthesizing unit separately pastes each of the still images constituting the moving image read from the storage unit to the image. Processing equipment. 3. The image processing apparatus according to claim 1, wherein the image input from the outside is a moving image or a still image. 4. When the image input from the outside is a moving image, the synthesizing means includes a still image constituting the moving image read from the recording means for each still image constituting the moving image. 4. The image processing apparatus according to claim 3, wherein each of the images is separately attached. 5. The apparatus according to claim 1, wherein the synthesizing unit filters a predetermined area of the moving image to be pasted on the image input from outside using a mask pattern.
The image processing apparatus according to any one of the preceding claims. 6. An image processing method for performing an effect process on an image input from the outside, wherein the moving image read from a storage unit storing a moving image generated in advance for the image input from the outside. An image processing method comprising a combining step of pasting an image. 7. A recording medium for recording an image processing program for performing an effect process on an image input from the outside, wherein a moving image generated in advance is stored for the image input from the outside. A recording medium storing a program having a synthesizing step of pasting a moving image read from a storage means.