WO2008130069A1 - Real-time multilayer image synthesis recording system and method, and a recording medium using the system and method - Google Patents

Real-time multilayer image synthesis recording system and method, and a recording medium using the system and method Download PDF

Info

Publication number
WO2008130069A1
WO2008130069A1 PCT/KR2007/001985 KR2007001985W WO2008130069A1 WO 2008130069 A1 WO2008130069 A1 WO 2008130069A1 KR 2007001985 W KR2007001985 W KR 2007001985W WO 2008130069 A1 WO2008130069 A1 WO 2008130069A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
file
system
sound
motion image
Prior art date
Application number
PCT/KR2007/001985
Other languages
French (fr)
Inventor
Sang-Hwan Cho
Original Assignee
Oasismedia Co., Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oasismedia Co., Ltd. filed Critical Oasismedia Co., Ltd.
Priority to PCT/KR2007/001985 priority Critical patent/WO2008130069A1/en
Publication of WO2008130069A1 publication Critical patent/WO2008130069A1/en

Links

Classifications

    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/031Electronic editing of digitised analogue information signals, e.g. audio or video signals
    • G11B27/034Electronic editing of digitised analogue information signals, e.g. audio or video signals on discs
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B2220/00Record carriers by type
    • G11B2220/20Disc-shaped record carriers
    • G11B2220/25Disc-shaped record carriers characterised in that the disc is based on a specific recording technology
    • G11B2220/2537Optical discs
    • G11B2220/2545CDs

Abstract

Real-time multilayer image synthesis recording system and method, and a recording medium using the system and method are disclosed. The system comprises an image synthesizing unit which synthesizes a chromachannel, background separation image, with a motion image, and further synthesizes with a real-time alpha channel which reacts with sound for thereby generating a 3D multilayer motion image and converting into video and audio files, and a recording unit which stores the video and audio files and a control program into a storing medium in real time, with the control program being able to selectively control the video and audio files.

Description

Title: REAL-TIME MULTILAYER IMAGE SYNTHESIS

RECORDING SYSTEM AND METHOD, AND A RECORDING MEDIUM USING THE SYSTEM AND

METHOD

Technical Field

The present invention relates to a real-time multilayer image synthesis recording system and method, and a recording medium using the system and method, and in particular to a real-time multilayer image synthesis recording system and method, and a recording medium using the system and method in which a motion image generated using an image input apparatus such as a green screen, a common screen, a CCD camera, a web camera, etc. is synthesized with a chroma channel, which is a background separation image, and an a channel, which generates in response to a sound inputted into a sound input apparatus(microphone, audio system, MP3, song accompaniment unit, etc) is synthesized in real time for thereby producing a 3D multilayer image multimedia CD in real time.

Background Art Generally, as the internet, ultra high speed communication network, and computer processing ability are enhanced, a multimedia process method using a motion image recorded with a camera, camcorder, etc. is diversified. The motion image is recorded on various storing mediums and is used as an information transfer means. So, the method of manufacturing motion images is considered as a key technology.

According to a method for manufacturing such motion images, a background screen and a photography object are synthesized using a chroma- key technique. Here, the chroma-key technique is a special effect method in which the synthesis of screen is electrically performed. A keying signal is made using RGB colors in a television camera. A blue color, which is a complementary color in a skin color of a human being, is processed as a filter color. First, a blue color background and an output signal of a camera, which records a photography subject, are divided into two level signals and are applied as a control voltage of two gate circuits. A photography subject is extracted from an output signal of a camera, which records a background image, and is combined with an output signal of a camera using a mixing circuit.

Since the above all procedures are performed using an electronic circuit, it is possible to fast perform synthesis. The image synthesis based on the above principle is generally performed using a color film in a movie field. In this case, a worker needs a very special skill and needs to work for days.

The above motion image production technique is performed depending on software included in a motion image capture board. Namely, the function of a motion image capture board, which has been conventionally used, is directly used. Since the conventional motion image file is formed of one motion image data, it is possible only to play back after the motion image file is finished.

The motion image file may be edited. The procedure that a second motion image is finished and played back via the edition of the motion image file is just the same procedure as the playing back procedure after the finishing work. The image quality and sound of the motion image generated with only the electronic circuits are not clean.

Even though equipments and software for manufacturing a motion image using a computer are diversified, it is not easy for a non-expert to produce a motion image. In addition, an apparatus for processing a camera image and an apparatus for processing sounds should be additionally equipped.

So, there are many limitations in cost and space. For various industrial applications, functions for a real-time control and edition and play-back of motion image files are needed, but are not available.

Disclosure of Invention

Accordingly, it is an object of the present invention to provide a real-time multilayer image synthesis recording system and method, and a recording medium using the system and method which overcome the problems encountered in the conventional art.

It is another object of the present invention to provide a real-time multilayer image synthesis recording system and method, and a recording medium using the system and method in which a layer of an a channel, which responses to a sound, is added to a motion image file in real time, and a 3D multilayer motion image having multiple layers is finally synthesized in real time by synthesizing a chroma channel, which is a background separation image.

The above motion image is played back using various play-back apparatuses.

It is further another object of the present invention to provide a real-time multilayer image synthesis recording system and method, and a recording medium using the system and method in which a 3D multilayer motion image can be played back irrespective of the types of play-back apparatuses by recording a control program when a 3D multilayer motion image is recorded on a storing medium after it is converted and compressed into a video file and an audio file, with the control program being designed to selectively play back irrespective of the type of a play-back apparatus.

It is still further another object of the present invention to provide a realtime multilayer image synthesis recording system and method, and a recording medium using the system and method in which it is very easy for a common person, not expert, to produce a 3D multilayer motion image of a clean image quality and sound by combining a hardware and software in real time using a motion image which is produced using a conventional hardware.

To achieve the above objects, in an integration type system which produces a multimedia CD by synthesizing a 3D motion image and an a channel in real time, there is provided a real-time multilayer synthesis recording system which comprises an integration type image synthesis apparatus which includes an image synthesis means which synthesizes an inputted motion image with a chroma channel of a background separation image and synthesizes the same with a real time a channel responding to a sound for thereby generating a 3D multilayer motion image and converts into video and audio files and stores the same, and a recording means which stores the video and audio files and a control program, which selectively controls the video and audio files, on a storing medium in real time; and a control apparatus which remotely control the image synthesis means the recording means.

To achieve the above objects, in a method for producing a multimedia CD by synthesizing a 3D motion image and an a channel in real time, there is provided a real-time multilayer image synthesis recording method which comprises a) a step in which a user selects a previously stored project file in which a motion image story is designed; b) a step in which a previously set background image, screen switch, still image and 3D image are synthesized in accordance with the project contents by receiving a user's image and sound for thereby generating a motion image file; c) a step in which a real time a channel responding to a sound is synthesized with the motion image in real time for thereby generating a 3D multilayer image; d) a step in which the 3D multilayer motion image is converted into a video file in real time, and is compressed and stored in a temporal storing space, and the video file is copied and converted into an audio signal when a control, signal of informing an end of image or song is detected; and e) a step in which the video and audio files are recorded on the storing medium in real time along with the control program.

To achieve the above objects, in an integration system for producing a multimedia CD by synthesizing a 3D motion image and an a channel in real time and a method for the same, there is provided a recording medium which is executable by a computer as a recording medium having a program of providing the functions of A) a function in which a user selects a previously stored project file having a designed motion image story or designs a motion image story using a project program and stores the same; B) a function in which user's image and sound data inputted using a plurality of cameras and sound input apparatuses are separated into images and sounds and are processed; C) a function in which the inputted user's image is synthesized with a previously set background screen, screen switch effect, still image process and 3D effect are synthesized in accordance with the project contents for thereby generating a motion image file; D) a function in which the motion image file is combined with various a images responding to a sound inputted for thereby generating a finally rendered 3D motion image file; E) a function in which the finally rendered 3D multilayer motion image file is converted into a video file of a streaming file, and is compressed and stored in a temporal storing space; and F) a function in which when a signal of informing an end of image or song is detected, the video file is automatically copied and converted into an audio file, and is stored in a storing medium along with a control program which allows the play-back apparatus to selectively executes the video and audio files.

Brief Description of the Drawings

The present invention will become better understood with reference to the accompanying drawings which are given only by way of illustration and thus are not limitative of the present invention, wherein;

Figure 1 is a view illustrating a construction of a real-time multilayer image synthesis recording system according to an embodiment of the present invention;

Figure 2 is a block diagram of an image synthesis apparatus according to the present invention;

Figure 3 is a block diagram of an image synthesis unit according to the present invention; and

Figure 4 is a flow chart of a real-time multilayer image synthesis recording method according to an embodiment of the present invention.

Best Mode for Carrying Out the Invention

The real-time multilayer image synthesis recording system and method, and a recording medium using the system and method according to an embodiment of the present invention will be described with reference to the accompanying drawings. Figure 1 is a view illustrating a construction of a real-time multilayer image synthesis recording system according to an embodiment of the present invention.

The real-time multilayer image synthesis recording system according to the present invention is an integration type system and comprises an image synthesis apparatus 200, and a control apparatus 300 for controlling the same.

Here, the image synthesis apparatus 200 is an integration type system and comprises an image synthesis unit 210 and a recording unit 250 which overcome a space limitation and significantly enhance sound and image qualities by improving the conventional motion image system which is generally used in a Karaoke singing room, and consists of an image process apparatus for processing an image inputted into a camera, a sound process apparatus for processing a sound inputted.

In the image synthesis unit 210, an image of a user's dance, song accompaniment, etc. recorded using a green screen, a common screen, a CCD camera, a web camera, etc., which are various input apparatuses 100, is received. A motion image is generated in real time using a soft chroma key technique, which is a background separation image technique, along with a screen switch method in which various background images such as a nature background, a city background, a tale background, a stage background and a special background, and a 3D special effect and a mathematical algorithm of the present invention are applied. A transparent, semi-transparent, non- transparent a channel, which is generated in response to a sound inputted via a microphone, an audio system, MP3, song accompaniment unit, etc., is synchronized with the above generated motion image and is synthesized in real time. The 3D multilayer motion image is converted and compressed into a video file and an audio file with the help of a streaming technique.

The soft chroma key technique is made by improving the conventional soft chroma key technique and is adapted to the present invention. In case that chroma key is used based on the conventional method, a jitter phenomenon may occur at a boundary of synthesized potion disconnected with a blue color component or a blue color component, which is used for obtain a key signal, is covered on the foreground. Namely, the synthesis is unnatural.

However, in the present invention, a large size waveform generated by providing a key signal waveform with a certain slant is used in consideration with a dissolve property of an image waveform, and a circuit able to overcome a color fog phenomenon, is adapted in the present invention. So, it is possible to obtain a natural screen synthesis which does not generate a jitter problem or a blue color fog phenomenon. In the above circuit, a key signal changes depending on a change of lighting condition and a change of photography subject. Namely, in the present invention, a circuit able to resolve the above change is installed. So, when a certain change occurs, it is automatically detected, so that the optimum value is outputted. When the above a channel is combined with the background image, when the a channel has a non-transparent property, the image except the transparent portion of the a channel is filly covered on the background image. When the a channel has the non-transparent property, the background image can be seen on the portions where the a channel and the background image are overlapped. The above technique is actually adapted to the still image, but is not currently adapted to the motion image.

In the present invention, the a channel, which can be adapted to the motion image, is developed and applied to the image synthesis unit.

The image synthesis unit 210 temporarily stores a video file in which the streaming technique is adapted. When a signal informing the end of a user's image and song is detected, the video file, which is the streaming file, is converted into an audio file and is copied.

The recording unit 250 judges whether the inserted storing medium is an exclusive storing medium and automatically record on various storing medium such as a CD, DVD, Audio CD, VCD, etc. in real time in one sector along with a control program which is able to selectively play back the video and audio files. Here, the control program judges the kinds of play back apparatus in which the storing medium is inserted and played, and provides the position information of the video and audio files. A certain mark is inserted into the CD, DVD, Audio CD, VCD, etc. for recognizing that the above recoding medium is an exclusive storing medium used in the real-time multilayer image synthesis recording system according to the present invention. The video and audio files stored in various storing mediums such as CD,

DVD, Audio CD, VCD, etc. are automatically selected and played in the play back apparatus such as CD, DVD, Audio CD, VCD, etc. by the above program.

The control apparatus 300 controls various input apparatuses 100 connected with the image input apparatus of the present invention, the image synthesis unit and a recording unit such as a CD ROM recording apparatus using a wireless communication such as infrared ray, RF, bluetooth, ZigBee, etc.

The control apparatus 300 is able to optimize the performance by preventing an error operation of the system which may occur owing to the mixing of frequencies of other electronic appliances using its inherent frequency bandwidth. It can be charged via a USB port or can be charged using an AAA battery. The control apparatus 300 is able to freely control the real-time multilayer image synthesis recording apparatus within 15m in a radius distance.

Figure 2 is a block diagram of an image synthesis apparatus according to the present invention. The image synthesis apparatus according to the present invention comprises an image synthesis unit 210 and a recording unit 250.

The image synthesis unit 210 is an integration system and comprises a system control unit 215, a background image input unit 211 , a camera source input unit 2123, a 3D special effect unit 213, an audio source input unit 214, an image synthesis unit 216, a voice recognition unit 217, and a file compression conversion unit 218.

The system controller 215 receives an input signal from the control apparatus 300 and remotely controls an input apparatus, image synthesis unit and a recording unit.

The background image input unit 211 generates a project for implementing a special effect, inherent screen switch effect, 3D image, etc. using an edit(EDIT) program with the help of a nature background, city background, tale background, stage background, and special background and produces various theme-based images and stores the produced data.

The camera source input unit 212 selects a certain camera of the input apparatus 100 in a previously set sequence and records a video image of a user and performs a natural switching operation by adapting an inherent screen switch effect stored in the image synthesis apparatus 200 while the cameras are switched from a first camera to second, third or fourth cameras in sequence.

The 3D special effect unit 213 previously stores the data of a 3D special effect and properly combines with a previously stored background image using an exclusive editor and generates a subject-based and theme-based project file.

It further synthesizes a 3D image by adding a special effect to a user's image data recorded using a CCD camera before the green screen.

The audio source input unit 214 controls an input signal of an analog and digital sound inputted via a microphone, audio system, CD player, MP3, song accompaniment unit which are the sound input apparatus and converts the inputted analog signal into a digital signal. The image synthesis unit 216 synthesizes a previously stored background screen, a 3D effect and an inherent screen switch effect with a user's image recorded by a camera for thereby generating a motion image file and supports various synthesis techniques including a simple synthesis technique as well as an a channel in the course of a motion image synthesis.

The voice recognition unit 217 analyzes and extracts an inputted signal information and retrieves an a channel which visually formats a previously stored sound information and adapts a transparent, semi-transparent and non- transparent a image to a user's image recorded using a camera and a 3D image effect for thereby producing and synthesizing an image which responses to a sound and music.

The file compression and conversion unit 218 synchronizes a motion image file generated by the image synthesis unit 216 with an inputted sound signal and a special effect and converts a 3D multilayer motion image, which is synthesized and rendered in real time, into a video file(*.asf) of a streaming file and compresses and stores the same. It extracts a photo and graphic file from the synthesized 3D multilayer motion image in accordance with a set time and stores into a temporal memory and transmits to the recording unit 250.

The file compression and conversion unit 218 extracts the finally rendered 3D multilayer motion image at a designated time interval and stores in an inherent player and transmits to the cellular phone or the internet network.

The recording unit 250 comprises a sensor light emitting unit 252, a sensor light receiving unit 25, a detection circuit 256, and a controller 256.

The sensor light emitting unit 252 emits light on a marked portion of a surface of a storing medium inserted in the recording unit 250.

The sensor light receiving unit 254 receives a value when light emitted from the sensor light emitting unit 252 is reflected by a certain mark inserted in the surface of the storing medium and amplifies the value and transmits to the detection circuit 256.

The detection circuit judges whether the medium is an exclusive storing medium using a value transmitted from the sensor light receiving unit 254.

The control unit 258 controls an ejection and/or recording of the storing medium inserted in the recording unit 250 in accordance with a result value of the detection circuit 256.

The method for judging whether the storing medium inserted in the recording unit 250 is an exclusive storing medium or not is performed using a line tracer. The line tracer is implemented based on a simple digital principle that the white color of the floor line corresponds to a reflection(O), and the block color corresponds to an absorption(1). The sensor light receiving unit 254 receives a value when light from the sensor light emitting unit 252 is reflected on the surface of the storing medium and amplifies the value and transmits to the detection circuit 256. When the received value is 0, the detection circuit 256 ejects the inserted storing medium, and when 1 , the recording is performed. Figure 3 is a block diagram of a program included in the image synthesis unit 210 according to the present invention.

The program installed in the image synthesis unit 210 comprises a project D/B 290, a project interpretation module 291 , an image control module 292, a special effect generation module 293, a screen switch process module 294, a still image process module 295, an image sound combining module 296, and a sound recording process module 297.

The program may be mounted in the image synthesis unit 210 or may be installed in a certain storing medium that can be read by a computer. The project D/B 290 stores a story of the motion image what a user wants to produce.

The motion image story sets the whole contents of the motion image that a user wants to produce. It may set a background screen, a screen process, a special effect, etc. using a project program provided from the image synthesis unit.

The project interpretation module 291 controls various image control modules 292 based on the project contents, a special effect generation module 293, a screens switch module 294, a still image process module 295, etc.

The image control module 292 synthesizes a special effect, a motion image screen switch, a still image and a motion image with various a images in accordance with a song accompaniment sound inputted or an audio sound of a music file and controls the above operations.

The special effect generation module 293 generates a special effect based on the contents of the project in accordance with a control of the project interpretation module 291 and synthesizes the same.

The screen switch process module 294 generates a screen switch effect based on the contents of the project in accordance with a control of the project interpretation module 291 and synthesizes the same.

The screen switch process module 294 sets two critical values and judges as a fast screen switch when a feature value is above a higher critical value, and accumulates the feature values in a section having the values higher than a lower critical value when the feature value is above a lower critical value. When the accumulated feature value is larger than the given critical value, it is judged as a slow screen switch.

According to a basic method for detecting screen switch detection, when a feature value between continuous frames is larger than a previously set critical value, it is judged that a screen switch occurs. With this method, it is possible to detect a fast screen switch, but it is not impossible to detect a slow screen switch. Namely, when the critical value is set too high, it is impossible to detect a slow screen switch. On the contrary, when the critical value is set too low, too many screen switches are detected in one slow screen switch or a change of an image occurring owing to a fast motion of an object may be detected as a screen switch by mistake, so that the image quality is worsened. However, in the present invention, since a method for detecting a slow screen switch by checking the change of feature values within the section of the slow screen switch and before and after the above section is used, it is not sensitive to an instant change of a feature value. In addition, it is possible to adaptively deal with the different images. A HSV color histogram was used as the above feature values. Each component of the histogram is 4-bit quantized so that it is not too sensitive to a small change. The χ1 method is used for obtaining the difference between frames. The screen switch detection method implemented based on a critical value has a result which is determined largely depending on the critical value used. An adaptive critical value is needed so as to decrease the above dependence with respect to the critical value.

A local window having a length of N is covered on the portion before and after the current frame so as to set an adaptive critical value, so that the critical value is set using an average value of the feature values in the window with the equation of mτ=Tpμ N where rτiτ is a selected adaptive critical value and

Tp is a previously selected critical value, and μ N is an average value in the local window. When the feature value of the current frame is larger than the obtained adaptive critical value and is the maximum value in the window, it is judged that the screen switch occurred.

In the above method, two critical values are set. When the feature value is larger than the higher critical value, it is judged as a fast screen switch, and when it is larger than the lower critical value, the feature values are accumulated in the section having the values larger than the lower critical value. When the accumulated feature value is larger than the given critical value, it is judged as a slow screen switch.

According to the above method, the present invention is well adapted to a slow screen switch and is adaptively corresponded with respect to various images. Since it is not sensitive to an instant change such as noise, a motion image of good image quality can be obtained.

The still image process module 295 processes a still image corresponding to the project in accordance with a control of the project interpretation module 291.

The image sound combining module 296 combines the motion image generated by the image control module 292 with a sound and converts into the streaming file of the final video file and compresses the same.

The sound recording process module 297 allows a user to input his voice and to insert into a video file. When it is recorded on the storing medium using the recording unit 250, it is possible to input video and audio files as well as to record his voice and to input an advertisement message of a certain company.

Figure 4 is a flow chart of a method of a real-time multilayer synthesis recording method according to an embodiment of the present invention.

A user sets the image synthesis apparatus 200 using the control apparatus 300 in order to produce a multimedia CD using a green screen, a common screen, a CCD camera, a web camera, a sound input apparatus(microphone, audio system, MP3, song accompaniment unit) etc. in a step S502.

The user may select a project file that is provided by previously designing the motion image story for users in the image synthesis unit 210 in a step S504 and may design the motion image story in a desired method using the project editor(EDIT) program provided from the image synthesis unit 210 and stores the same as a project file in a step S506.

When the user selects the project file, the image synthesis unit 210 records a user's accompaniment, dance or appearance, and the sound is received using a microphone, audio system, song accompaniment unit, etc. in a step S508.

The images of the inputted user's accompaniment, dance and appearance are synthesized with a previously set background screen, screen switch effect, still image process, 3D effect, etc. in accordance with the project contents selected by the user using a soft chroma key channel, which is a background separation image technique in a step S510, and a motion image file is generated in a step S512. In addition, it is analyzed whether the user's selected project contains an a channel. When the a channel exists, various a images such as transparent, non-transparent and semi-transparent images are generated in response to the inputted user's sound via the a channel mixing process and are applied to the user's synthesized motion image file in real time in a step S514.

Various a images applied in real time to the motion image file are synchronized and combined for thereby generating a 3D multilayer motion image which is finally rendered in a step S516.

The finally rendered 3D multilayer motion image is converted into the video file of an inherent streaming file and is compressed and stored in a temporal storing space for recording on a storing medium in a step S518.

When a signal of informing the end of a user's image and song accompaniment, song and dance, etc. is detected, the video file stored in the temporal storing space is automatically copied as an audio file by the program and is converted in a step S522.

The video and audio files are automatically recorded on various storing mediums such as CD, DVD, Audio CD, VCD, etc. Here, a control program able to play back using the play back apparatus such as CD, DVD, Audio CD, VCD, etc. is stored as well, so that the production of the multimedia CD is finished. The thusly-produced storing mediums can be executed irrespective of different play-back mediums.

Industrial Applicability As described above, according to the real-time multilayer image synthesis recording system and method of the present invention, a layer of an a channel responding to a sound is added to a motion image, and a chroma channel of a background separation image is synthesized, so that it is possible to synthesize a 3D multilayer image in real time having multiple layers. In addition, when the video and audio files of 3D multilayer images are recorded on various storing mediums, a control program is stored together so that the play-back apparatus can selectively read a corresponding data, whereby it is possible to execute the program irrespective of the types of playback apparatuses. As a soft chroma-key technique and an inherent screen switch algorithm are adapted in real time to the inputs of the motion image and sound, a clean image and sound quality and reliable 3D multilayer image can be produced.

In the present invention, an integration type system controllable with less chips and software is provided as compared to a conventional motion image system which consists of multiple hardware, and has complicated construction, and needs more space, so that the costs for a system installation and workers is decreased, and a non-expert person can easily produce a 3D multilayer image.

As the present invention may be embodied in several forms without departing from the spirit or essential characteristics thereof, it should also be understood that the above-described examples are not limited by any of the details of the foregoing description, unless otherwise specified, but rather should be construed broadly within its spirit and scope as defined in the appended claims, and therefore all changes and modifications that fall within the meets and bounds of the claims, or equivalences of such meets and bounds are therefore intended to be embraced by the appended claims.

Claims

Claims:
1. In an integration type system which produces a multimedia CD by synthesizing a 3D motion image and an a channel in real time, a real-time multilayer synthesis recording system, comprising: an integration type image synthesis apparatus which includes an image synthesis means which synthesizes an inputted motion image with a chroma channel of a background separation image and synthesizes the same with a real time a channel responding to a sound for thereby generating a 3D multilayer motion image and converts into video and audio files and stores the same, and a recording means which stores the video and audio files and a control program, which selectively controls the video and audio files, on a storing medium in real time; and a control apparatus which remotely control the image synthesis means the recording means.
2. The system of claim 1 , wherein said image synthesis means comprises: a camera source input unit which records an external image recorded by a camera in a previously set sequence and performs a natural switching effect by adapting a screen switch effect and converts the external image of an analog signal into a digital signal; an audio source input unit which controls an analog signal and/or digital signal inputted via a sound input apparatus and converts the inputted analog signal and/or digital signal into a digital signal; a system control unit which receives a control signal of the control apparatus, and remotely controls the image synthesis means and the recording means, and synthesizes with the inputted external image and sound and records on a storing medium; an image synthesis unit which synthesizes the previously stored background screen, 3D effect and screen switch effect with an external image recorded by a camera and a chroma channel of a background separation channel for thereby generating a motion image; a voice recognition unit which retrieves an a channel responding to a previously stored sound information by analyzing and extracting the inputted sound information and produces and/or synthesizes an image responding to the sound by adapting an a channel to the motion image in real time; and a file compression and conversion unit which generates a 3D multilayer motion image by synthesizing and rendering the motion image and the a channel in real time, and converts into a video file of a streaming file, and compresses and stores in a temporal memory, and converts the stored video file into an audio file and compresses the same with the help of the system control unit and transmits to the recording means along with the control program.
3. The system of claim 1 , wherein said image synthesis means comprises: a background image input unit which stores a nature background, a city background, a tale background, a stage background and a special background and produces and stores a project file able to implement a special effect, screen switch and 3D image based on a theme image and transmits the same; a camera source input unit which records an external image using a camera in a previously set sequence, and performs a natural switching by adapting a screen switch effect, and converts an external image of analog signal into a digital signal; a 3D special effect unit which stores a data of a 3D special effect, and combines with a previously stored background image, and produces a subject- based and/or theme-based project file, and adds a special effect to the external image; an audio source input unit which controls an analog and/or digital signal inputted via the sound input apparatus and converts the inputted analog and/or digital signal into a digital signal; a system control unit which remotely controls the image synthesis means and the recording means by receiving a control signal of the control apparatus, and controls the operations that the inputted external image and the sound are synthesized and recorded on a storing medium; an image synthesis unit which synthesizes a previously stored background screen, 3D effect, screen switch effect with an external image recorded using a camera and a chroma channel of a background separation image for thereby generating a motion image; a voice recognition unit which analyzes and extracts the inputted sound information, and retrieves an a channel responding to a previously stored sound information, and produces and/or synthesizes an image responding to the sound by adapting an a channel to the motion image in real time; and a file compression and conversion unit which generates a 3D multilayer motion image by synthesizing and rendering the motion image and the a channel in real time, and converts into a video file of a streaming file and compresses the same, and stores in a temporal file, and converts the stored video file into an audio file with the help of the system control unit, and compresses and transmits to the recording means along with a control program.
4. The system of either claim 2 or claim 3, wherein said image synthesis unit adapts a large size waveform formed by providing a key signal wave with a slant and a soft chroma key formed of a circuit which is able to resolve a color fog phenomenon.
5. The system of either claim 2 or claim 3, wherein said file compression and conversion unit extracts a 3D multilayer motion image, which is finally synthesized and rendered, at a set time interval, and stores the same.
6. The system of claim 1 , wherein said image synthesis means comprises a project program which includes: a project D/B which stores a project content of a 3D multilayer motion image that a user wants to produce; a project interpretation module which controls an image control module, special effect generation module, screen switch process module and still image process module in accordance with the project contents; an image control module which synthesizes a special effect, motion image screen switch, still image and image motion image with an a channel in accordance with a sound inputted, and controls the same; a special effect generation module which generates and synthesizes a special effect corresponding to the project content in accordance with a control of the project interpretation module; a screen switch process module which generates and synthesizes a screen switch effect corresponding to the project contents in accordance with a control of the project interpretation module; a still image process module which process a still image corresponding to the project contents in accordance with a control of the project interpretation module; an image sound combining module which combines the 3D multilayer motion image generated by the image control module with a sound and converts into a video file of a streaming file and compresses the same; and a sound recording process module which inserts a voice into the video file of the streaming file.
7. The system of claim 6, wherein said screen switch module sets two critical values and judges as a fast screen switch when a feature value is above a higher critical value, and accumulates a feature value in a section having a value higher than a lower critical value when the feature value is above a lower critical value, and judges as a slow screen switch when the accumulated feature value is larger than a given critical value.
8. The system of claim 1 , wherein said recording means comprises: a sensor light emitting unit which emits light on a surface of the storing medium inserted in the recording means; a sensor light receiving unit which receives a value when the light from the sensor light emitting unit reflects on a surface of the storing medium, and amplifies the values and transmits to a detection circuit; a detection circuit which judges a storing medium using the value transmitted from the sensor light receiving unit; and a controller which ejects the storing medium inserted in the recording means and/or performs a recording in accordance with a result value judged by the detection circuit.
9. The system of claim 8, wherein said sensor is formed of an optical sensor and/or a magnetic sensor.
10. The system of claim 8, wherein said detection circuit is judged by using a line trace method and/or a magnetic mark method.
11. The system of either claim 1 or claim 8, wherein said recording means records a video file of a streaming file, which is temporally stored when there is a control signal from the control apparatus or a signal of informing an end of image or song, on a storing medium.
12. The system of either claim 1 or claim 8, wherein said recording means records video and audio files and a control program, which is used for a selective execution in the play-back apparatus, in one sector together with each other.
13. The system of claim 12, wherein said control program judges the kinds of the play-back apparatus and executes the same by providing a position information of a video file and/or audio file stored in the storing medium.
14. In a method for producing a multimedia CD by synthesizing a 3D motion image and an a channel in real time, a real-time multilayer image synthesis recording method, comprising: a) a step in which a user selects a previously stored project file in which a motion image story is designed; b) a step in which a previously set background image, screen switch, still image and 3D image are synthesized in accordance with the project contents by receiving a user's image and sound for thereby generating a motion image file; c) a step in which a real time a channel responding to a sound is synthesized with the motion image in real time for thereby generating a 3D multilayer image; d) a step in which the 3D multilayer motion image is converted into a video file in real time, and is compressed and stored in a temporal storing space, and the video file is copied and converted into an audio signal when a control, signal of informing an end of image or song is detected; and e) a step in which the video and audio files are recorded on the storing medium in real time along with the control program.
15. The method of claim 14, wherein in said e) step, said program allows the video and audio files stored in various storing mediums to be selectively executed in various play-back apparatuses.
16. In an integration system for producing a multimedia CD by synthesizing a 3D motion image and an a channel in real time and a method for the same, a recording medium which is executable by a computer as a recording medium having a program of providing the functions of: A) a function in which a user selects a previously stored project file having a designed motion image story or designs a motion image story using a project program and stores the same;
B) a function in which user's image and sound data inputted using a plurality of cameras and sound input apparatuses are separated into images and sounds and are processed;
C) a function in which the inputted user's image is synthesized with a previously set background screen, screen switch effect, still image process and 3D effect are synthesized in accordance with the project contents for thereby generating a motion image file; D) a function in which the motion image file is combined with various a images responding to a sound inputted for thereby generating a finally rendered 3D motion image file;
E) a function in which the finally rendered 3D multilayer motion image file is converted into a video file of a streaming file, and is compressed and stored in a temporal storing space; and
F) a function in which when a signal of informing an end of image or song is detected, the video file is automatically copied and converted into an audio file, and is stored in a storing medium along with a control program which allows the play-back apparatus to selectively executes the video and audio files.
PCT/KR2007/001985 2007-04-24 2007-04-24 Real-time multilayer image synthesis recording system and method, and a recording medium using the system and method WO2008130069A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/KR2007/001985 WO2008130069A1 (en) 2007-04-24 2007-04-24 Real-time multilayer image synthesis recording system and method, and a recording medium using the system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/KR2007/001985 WO2008130069A1 (en) 2007-04-24 2007-04-24 Real-time multilayer image synthesis recording system and method, and a recording medium using the system and method

Publications (1)

Publication Number Publication Date
WO2008130069A1 true WO2008130069A1 (en) 2008-10-30

Family

ID=39875586

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2007/001985 WO2008130069A1 (en) 2007-04-24 2007-04-24 Real-time multilayer image synthesis recording system and method, and a recording medium using the system and method

Country Status (1)

Country Link
WO (1) WO2008130069A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103714565A (en) * 2013-12-31 2014-04-09 广州市久邦数码科技有限公司 Method and system for generating dynamic image with audio

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20010036585A (en) * 1999-10-09 2001-05-07 손동주 3-LAYER PICTURE COMPOSITION APPARATUS AND METHOD USING α-CHANNEL AND MOVING PICTURES
US20030112863A1 (en) * 2001-07-12 2003-06-19 Demos Gary A. Method and system for improving compressed image chroma information
KR20050067109A (en) * 2005-02-05 2005-06-30 주식회사 스타씨엠 A method for manufacuturing and displaying a real type 2d video information program including a video, a audio, a caption and a message information, and a memory devices recorded a program for displaying thereof
KR20070016902A (en) * 2005-08-05 2007-02-08 주식회사 오아시스미디어 Real-time multilayer image synthesis recording system and method, and the store device which records a method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20010036585A (en) * 1999-10-09 2001-05-07 손동주 3-LAYER PICTURE COMPOSITION APPARATUS AND METHOD USING α-CHANNEL AND MOVING PICTURES
US20030112863A1 (en) * 2001-07-12 2003-06-19 Demos Gary A. Method and system for improving compressed image chroma information
KR20050067109A (en) * 2005-02-05 2005-06-30 주식회사 스타씨엠 A method for manufacuturing and displaying a real type 2d video information program including a video, a audio, a caption and a message information, and a memory devices recorded a program for displaying thereof
KR20070016902A (en) * 2005-08-05 2007-02-08 주식회사 오아시스미디어 Real-time multilayer image synthesis recording system and method, and the store device which records a method

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103714565A (en) * 2013-12-31 2014-04-09 广州市久邦数码科技有限公司 Method and system for generating dynamic image with audio

Similar Documents

Publication Publication Date Title
US6351222B1 (en) Method and apparatus for receiving an input by an entertainment device
US7239348B2 (en) Digital camera with a music playback function
CN1068131C (en) Apparatus and method for recording/playing back broadcasting signal
US7952535B2 (en) Electronic visual jockey file
US5548346A (en) Apparatus for integrally controlling audio and video signals in real time and multi-site communication control method
JP4263217B2 (en) It generates audio representation of an audio scene, and stored, apparatus and method for editing
CN1178469C (en) Method for editing video information and editing device
US20110190913A1 (en) System and method for automatically creating an atmosphere suited to social setting and mood in an environment
US9743033B2 (en) Method for displaying image combined with playing audio in an electronic device
JP4292891B2 (en) Imaging device, an image recording apparatus and image recording method
JP4712804B2 (en) Image display control device and an image display device
JP4980018B2 (en) The subtitle generation apparatus
US7706663B2 (en) Apparatus and method for embedding content information in a video bit stream
KR101189861B1 (en) Apparatus, method, and computer program for processing information
JP4599244B2 (en) Device and method for creating a subtitle from movie data, programs, and storage media
US8212922B2 (en) Information display apparatus, information display method and program therefor
JP4449987B2 (en) Audio processing apparatus, sound processing method, and program
US20090287650A1 (en) Media file searching based on voice recognition
US20100183280A1 (en) Creating a new video production by intercutting between multiple video clips
US20140233917A1 (en) Video analysis assisted generation of multi-channel audio data
CN102209184B (en) Electronic apparatus, reproduction control system, reproduction control method
JP2016517641A (en) Image Summary of video
JP2004194338A (en) Method and system for producing slide show
CN100546367C (en) Signal processing apparatus, signal processing method
JPH11234560A (en) Multimedia edit method and device therefor

Legal Events

Date Code Title Description
DPE2 Request for preliminary examination filed before expiration of 19th month from priority date (pct application filed from 20040101)
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 07746147

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase in:

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC - EPO FORM 1205A OF 10.02.2010

122 Ep: pct application non-entry in european phase

Ref document number: 07746147

Country of ref document: EP

Kind code of ref document: A1