KR101695209B1 - A system and method for composing real-time image and chroma-key Image of subject - Google Patents

A system and method for composing real-time image and chroma-key Image of subject Download PDF

Info

Publication number
KR101695209B1
KR101695209B1 KR1020150095670A KR20150095670A KR101695209B1 KR 101695209 B1 KR101695209 B1 KR 101695209B1 KR 1020150095670 A KR1020150095670 A KR 1020150095670A KR 20150095670 A KR20150095670 A KR 20150095670A KR 101695209 B1 KR101695209 B1 KR 101695209B1
Authority
KR
South Korea
Prior art keywords
image
chroma key
real
phone
file
Prior art date
Application number
KR1020150095670A
Other languages
Korean (ko)
Inventor
고창용
함지호
안익수
Original Assignee
고창용
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 고창용 filed Critical 고창용
Priority to KR1020150095670A priority Critical patent/KR101695209B1/en
Application granted granted Critical
Publication of KR101695209B1 publication Critical patent/KR101695209B1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/265—Mixing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8146—Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Tourism & Hospitality (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Resources & Organizations (AREA)
  • Primary Health Care (AREA)
  • Strategic Management (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Marketing (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Graphics (AREA)
  • Economics (AREA)
  • Health & Medical Sciences (AREA)
  • Image Processing (AREA)
  • Studio Circuits (AREA)

Abstract

The present invention relates to a system and method for producing a real-time image and a chroma key object image, and more particularly, to a real-time image and a chroma key object image reproducible on a web and a mobile terminal, It is possible to create natural composite video by adjusting frame area and camera zoom in and zoom out of real-time video, and automatically combine chroma key object image and real time video using specific video using chroma key technique, There are effects that can be applied to video letters or UCC.

Description

Technical Field [0001] The present invention relates to a system and a method for composing a real-time image and a chroma key image,

The present invention synthesizes a real-time image and a chroma key object image reproducible on a web and a mobile terminal. It can produce a natural composite image by adjusting a frame area of a real-time image, a camera zoom in and zoom out, System and method of composing real time image and chroma key object image which can utilize the video that automatically combines the chroma key image and real time image with specific video using Marki technique to self introduction, wedding invitation, video letter or UCC .

Image processing techniques for video production include image synthesis techniques that are widely used in the fields of computer art, advertising, and entertainment by combining or modifying actual image images with composite images of artificial images, Image Analysis technology that refers to a series of tasks that identify the objects that appear and Image Pattern Recognition technology that refers to recognizing and recognizing objects such as characters, .

Among image processing techniques described above, image synthesis techniques that are mainly utilized by users in the production of video-based contents such as UCC or PCC include a method of synthesizing other types of images using a chroma-key method .

The chroma-key technique is one of image synthesis methods. It is a method widely used when a specific color portion is removed and only other elements are extracted and synthesized with other images. For example, in a television station, It is mainly used to combine the weather caster and the weather screen to show a single screen when broadcasting the forecasting progress scene.

In order to produce a composite video using the chroma key technique, a desired part of the video is taken after a video is captured, and then the image is synthesized with a background image, a foreground image, or a background music to be synthesized.

However, in the related art, there is a problem that equipment for the above-mentioned operation is expensive and a work process is manually performed, so that it takes a lot of time and cost to be utilized by general users.

In order to produce an image using the chroma key, a photographing equipment such as a background screen, a camera, an infrared sensor, and a microphone is required, and a conventional apparatus and method for producing a video image using a chroma key are disclosed in Korean Patent Registration No. 10-0934471 .

The mobile terminal is used for taking pictures, photo decodings, moving pictures, etc. by using a camera. Various services are provided using a GPS, a sensor, and a camera mounted on the mobile terminal.

The existing augmented reality service remains in a simple display of the augmented reality information by using the real view, and there is no function of storing and reusing the composite video information of the real time image and the chroma keyed object image, There is no purpose or purpose to use.

Therefore, it is possible to produce a natural composite video by adjusting the frame area, camera zoom in and zoom out of the real time image to fit the subject image in the case of producing the real time image and the chroma key object image, There is a need to develop a system and method for composing real-time images and chroma key object images that can be used for self-introduction, wedding invitation, video letter, or UCC by automatically compositing images of real-time and real-time images.

KR 10-2008-0035743 (Apr. 17, 2008)

In order to solve the above problems, the present invention provides a real-time image and a chroma key object image that can be played back on the web and a mobile terminal. The real time image frame region, the camera zoom in and zoom out, The present invention provides a system and method for composing a real-time image and a chroma-key object image that can produce a natural composite image by adjusting the image.

Another object of the present invention is to provide a real-time image and a chroma-keyed object image that can be utilized for self-introduction, wedding invitation, video letter, or UCC by automatically synthesizing a chroma key image and a real time image using a specific video using the chroma key technique And a method of manufacturing the same.

According to another aspect of the present invention, there is provided a system for composing a real-time image and a chroma key image according to an embodiment of the present invention includes a function of requesting and acquiring a chroma key image stored in an image synthesis server, A function of synthesizing the real-time image recorded by using the actual camera module, and a function of requesting the image synthesizing server to synthesize the image when the size of the chromic-key object image is large, A mobile terminal having a function of receiving a composite image obtained by combining a chroma key object image selected by a user and a real time image with a mobile terminal and providing the obtained composite image to a user through a playback module, Or a user PC); An internet / mobile communication network for connecting the mobile terminal (or a user PC) and the image synthesis / production server; A control unit connected to the Internet / mobile communication network and operating the modules included in the interface unit, the database, the chroma key image processing unit, and the image synthesizing unit; An interface unit for allowing a manager to easily produce an image through manipulation of a keyboard and a mouse, a graphical user interface for providing input, output, and progress necessary for time and chroma key object image production on a monitor; A chroma key image DB storing one or more original chroma key image data, a real time image DB storing one or more real time image data, a chroma key image DB storing one or more original chroma key image data, A database composed of a composite image DB for storing image data, and a user information DB for storing one or more pieces of user information data; A file processing module for loading a chromakey object image created by the program and setting a file name and a path for storing the chromakey object image database in the original chromakey image file, A background color changing module for changing a chroma key background color in order to extract a chroma key image and speed up processing speed in image synthesis and to sharpen a border boundary of a chroma key object; A chroma key image processing unit configured to generate a chroma key object image by deleting a chroma keyed area in an image file and store the chroma key image in the chroma key image DB by a file processing module; A video file processing module for bringing a chroma key object image file from the chroma key subject image DB under control of the control unit, and a real-time image file stored from the chroma key image and the real time image DB, An image synthesis module for synthesizing images and storing the synthesized image file in a synthetic image DB, a frame processing module for processing the border thickness to smooth the boundary between the background and the subject of the chromakey object image, And a synthesizing information processing module configured to call the image file and control the control unit to transmit the synthesized image to the mobile terminal through the interface unit and to provide the synthesized image on the screen through the virtual camera module in the mobile terminal, Real-time video and chroma key A chroma key image processing unit, and a video synthesizing unit, wherein the interface unit, the database, the chroma key image processing unit, and the image synthesizing unit are each operated by a signal of the control unit, An image synthesizing server having a function of producing an image; A manager PC having a function of storing the original chromakey image file in the original chromakey image DB and confirming the chromakey object image on the screen through the chromakey editor and editing the necessary moving image section; .

In the present invention, the mobile terminal may include a wireless communication unit for performing wireless communication; A controller for driving and controlling each of the configuration modules of the mobile terminal; An input unit for controlling an input of the mobile terminal; An output unit indicating a processing state of the mobile terminal; An actual camera module for acquiring an actual view coming through a lens of an actual camera and displaying the acquired real view on a screen; A virtual camera module for providing, on the screen, a chromakey subject image stored in a phone database and an actual view acquired from an actual camera module as an application module executed in response to an actual camera module when a user presses a record button on the mobile terminal; A storage module for storing various chromakey object images, real-time images, and composite images in a phone database; A phone image DB storing one or more chroma key image data by the storage module, a phone real image DB storing one or more real time image data, and a phone compound image DB storing one or more composite image data A phone database; A playback module for reading and playing back a composite image stored in the phone database and providing the combined image to a screen; In order to naturally and real-time record the images of the chroma key image and the real image view using the virtual camera module, information on the size of the subject in the chroma key image is read from the subject image DB, A frame area adjustment module automatically provided; A camera magnification adjustment module for automatically adjusting a magnification of the camera; A phone image file processing module for receiving a chroma key image file stored in the phone image DB under the control of the controller, a chroma key object image and a real time image captured by the actual camera module in the mobile terminal, A phone image synthesizing module for synthesizing a chromakey object image and a real time image and storing the synthesized image in a phone synthesized image DB, a process of reading a synthesized image stored from a phone synthesized image DB and providing the synthesized image on a screen through a virtual camera module A phone image synthesizer configured by a synthesizing information processing module; .

delete

According to another aspect of the present invention, there is provided a method of composing a real-time image and a chroma key image, comprising the steps of: (A) managing the original chroma key image file managing the original chroma key image file; A chroma key object image processing step (b) of extracting a chroma key object image from the original chroma key image file after performing the original chroma key image file management; After performing the chromakey object image processing, the mobile terminal captures a real time image, and when the size of the chromakey object image selected by the user is small, the mobile terminal synthesizes the chromakey object image and the real time image, (C) a real-time image management step of transmitting the image to the image synthesis production server without synthesizing the image from the mobile terminal so that the image synthesis server can perform image synthesis processing; The image file processing module of the image compositing unit performs the image file processing step of loading the original chroma key image file from the original chroma key image DB by the command on the program and calling the real time image file from the real time image DB after performing the real time image management, If the frame processing is performed after the image file processing step, the frame processing module performs the frame processing step. If the frame processing is not performed, the image synthesizing module performs image synthesis processing (D) an image synthesis processing step of synthesizing the real-time image and the chroma key object image, which is composed of a synthetic information processing step in the synthetic information processing module after performing the image synthesis processing step; A synthesized image file storing step (e) for storing the synthesized real time image and the chroma key object image as a synthesized file after performing the image synthesizing process; Storing the synthesized image file, uploading the created file to the image synthesis server, inquiring the synthesized image through the user PC or the mobile terminal, and requesting the synthesized image file; .

In the chroma key image processing step (b), the file processing module of the chroma key image processing unit processes the chroma key image in the chroma key editor by a command in the program, A chroma key extraction module of the chroma key image processing module extracts a chroma key image from the original chroma key image in a chroma key editor by a command on a program, Changing the background color to change the chroma key background color so as to speed up the processing speed at the time of image synthesis and to sharpen the border boundary of the chroma key object and storing the chroma key subject image if the background color is not processed in the chroma key extraction step ; .

In the present invention, in the real-time image management step (c), the image file processing module of the mobile terminal loads the chroma key image file from the phone image DB by the command on the program, A phone object image selecting step of selecting a desired image; A phone real time image recording step of recording the selected real time image 101 using the selected chroma key image file and the actual camera module of the mobile terminal; Determining whether to synthesize a phone image in a mobile terminal according to a size of a chroma key object image selected by the user in the phone real time image recording step; If the size of the chroma key object image selected in the step of determining whether to synthesize the phone image is small, a phone image synthesizing process of synthesizing the chroma key image and the real time image in the phone image synthesizing module of the phone image synthesizer, ; After the phone image synthesis process is performed, the synthesized image obtained by synthesizing the real-time image and the chroma key object image is stored in a phone synthesizing image database using a storage module in a phone image file processing module, A file storage step; When the size of the chroma key object image selected in the step of determining whether or not the phone image is synthesized is large, the control unit controls the mobile terminal not to synthesize the image to transmit the real time image to the image synthesis production server through the wireless communication unit A real-time image file transmission step; The mobile terminal receives the synthesized file obtained by synthesizing the chroma key image and the real time image in the video synthesis server, and transmits the synthesized file to the mobile terminal using the storage module in the phone image file processing module. A synthesized image file reception step of storing synthesized images in the synthetic image database; After the synthesized image file storage step and the phone synthesized image file reception step are performed, the synthesized image is uploaded to the mobile terminal, and the synthesized image is retrieved, and the synthetic image is retrieved from the phone synthesized image DB of the mobile terminal A phone synthesized image file requesting step of providing a screen through a virtual camera module using a playback module; .

delete

The system and method for composing a real-time image and a chroma key object image according to the present invention have the following effects.

First, the present invention synthesizes a real-time image and a chroma key object image that can be reproduced on the web and a mobile terminal, and can produce a natural composite image by adjusting the frame area of the real-time image, zooming in and zooming out the camera, .

Second, the present invention can utilize a video that automatically combines a chromakey subject image and a real-time image by using a specific video using a chroma key technique in a self-introduction document, a wedding invitation card, a video letter, or a UCC.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a block diagram illustrating a system for composing a real-time image and a chroma key object image according to an embodiment of the present invention. FIG.
BACKGROUND OF THE INVENTION 1. Field of the Invention [0001]
3 is a diagram illustrating an example of a chroma key image extraction screen according to an embodiment of the present invention.
4 is a view showing an example of a real-time image screen according to an embodiment of the present invention;
5 is a view illustrating an example of a chroma key image and a real-time image composite screen according to an embodiment of the present invention.
6 is a diagram illustrating a configuration of a mobile terminal in a composite production system of a real-time image and a chroma key object image according to an embodiment of the present invention.
FIG. 7 illustrates a configuration of a video synthesis server in a system for producing a real-time video and a chroma key object according to an embodiment of the present invention; FIG.
FIG. 8 is an overall flowchart of a real-time image and a chroma key object image synthesis method according to an embodiment of the present invention; FIG.
FIG. 9 is a detailed flowchart of a chroma key object image processing step of FIG. 8 according to an embodiment of the present invention; FIG.
10 is a detailed flowchart of the real-time image management step of FIG. 8 according to an embodiment of the present invention; FIG.
11 is a detailed flowchart of the image synthesis processing step of FIG. 8 according to an embodiment of the present invention;

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description of the present invention, when it is determined that a detailed description of related art or configuration may unnecessarily obscure the gist of the present invention, The description will be omitted and terms to be described below are defined in consideration of the functions of the present invention and may vary depending on the intention or the custom of the user or the operator and therefore the definition is a combination of the real time image and the chroma key image Based on the contents of the description of the production system and method thereof.

Hereinafter, a system for synthesizing a real-time image and a chroma key object image according to a preferred embodiment of the present invention will be described in detail with reference to the accompanying drawings.

FIG. 1 is a block diagram illustrating a system for composing a real-time image and a chroma key object image according to an embodiment of the present invention.

1, the system for composing a real-time image and a chroma key object image according to the present invention includes a mobile terminal 100, a user PC 110, an Internet / mobile communication network 200, a video synthesis / production server 300, And a manager PC 120.

The mobile terminal 100 is connected to the Internet / mobile communication network 200 through one or both of which can communicate with each other. The mobile terminal 100 includes at least a camera, a GPS module, and a sensor module. It can be configured as an interlocked tablet PC.

FIG. 2 is a diagram illustrating an example of a chromakey subject image screen according to an exemplary embodiment of the present invention, and FIG. 3 is a view illustrating an exemplary chromakey subject image screen according to an exemplary embodiment of the present invention.

As shown in FIGS. 2 and 3, in a system for producing a real-time image and a chroma key object image, a video shot by the chroma key technique is transmitted from the manager PC 120 to the original chroma key image 122, After the image is stored in the image DB 331, the chroma key object image 123 can be confirmed on the screen through the chroma key editor 121 and the necessary moving image section can be edited.

Also, the system for composing a real-time image and a chroma key object image can extract the chroma key image 123 from the original chroma key image 122 using the chroma key editor 121, The composite production system of the subject image stores the extracted chromakey subject image 123 in the chromakey subject image DB 332.

FIG. 4 is a view showing an example of a real-time image screen according to an embodiment of the present invention, and FIG. 5 is a view illustrating an example of a chroma key image and a real-time image composite screen according to an embodiment of the present invention.

4 and 5, in the system for composing a real-time image and a chroma key image according to the present invention, the mobile terminal 100 includes a real-time image 101, a zoom-in / zoom-out 103, 104, recording (105), and frame area (102).

The real-time image 101 is an actual view seen through a camera when the mobile terminal 100 drives a camera to take a photograph or photograph an image, and the zoom-in / zoom-out 103 adjusts the magnification of the camera Function.

The capturing of the subject image 104 may inquire the chroma key subject image 123 managed by the image synthesizing and manufacturing system.

The recording 105 is a button for recording the chroma key image 123 and the real time image 101 to be synthesized.

The frame area 102 informs the user of the photographing standard of the photographee at the time of photographing so that the chroma key image 123 and the real-time image 101 can be produced as a natural composite image. For example, if the chromakey subject image 123 is the upper half of the body, the size of the frame area 102 is automatically adjusted and displayed on the screen so that the subject can record the upper body. The frame region 102 may be provided by adjusting a space in the frame region 102 according to necessity, such as two, four, or the like based on the whole body.

The system for synthesizing a real-time image and a chroma key object image reads the chroma key image 123 stored in the phone image DB 151 using the retrieved object image 104, ) And the real-time image 101 and displays them on the screen of the mobile terminal.

6 is a diagram illustrating a configuration of a mobile terminal in a composite production system of a real-time image and a chroma key image according to an embodiment of the present invention.

6, the mobile terminal 100 includes a wireless communication unit 131, a control unit 132, an input unit 133, an actual camera module 135 A virtual camera module 136, an output unit 134, a storage module 137, a reproduction module 138, a frame area adjustment module 139, a camera scale adjustment module 140, a phone database 150, And an image synthesizing unit 160. FIG.

The mobile terminal 100 has a function of requesting and acquiring a chroma key image 123 stored in the image synthesis production server 300 and a function of designating the chroma key image 123 to be synthesized by the user, A function of synthesizing the real time image 101 recorded using the camera module 135 and a function of requesting the image synthesizing production server 300 to synthesize the image when the size of the chroma key object image 123 is large And a synthesized image 106 obtained by combining a chroma key image 123 and a real time image 101 selected by the user in the image synthesis server 300 to the mobile terminal 100, And a function of providing the user with the image 106 through the playback module 138.

The mobile terminal 100 includes a wireless communication unit 131 for processing for performing wireless communication, a controller 132 for driving and controlling the respective modules of the mobile terminal 100, Real-time image 101 and real-time image 101 by using the input unit 133 for controlling the input of the input image data, the output unit 134 for indicating the processing state of the mobile terminal 100, and the storage module 137, An actual camera module 135 for acquiring an actual view coming through a lens of an actual camera and displaying the obtained real view on the screen, When a recording button is pressed, a chroma key object image 123 stored in the phone database 150 as an application module executed in response to the actual camera module 135 and a real image view obtained from the actual camera module 135 are provided on the screen A virtual camera module 136, A reproduction module 138 for reading and reproducing the synthesized image 106 and providing the combined image 106 to the screen by using the virtual camera module 136, A frame area adjustment module 139 that reads information on the size of a subject from the chroma key image 123 and automatically provides frame area information on the screen of the mobile terminal 100 by reading the information from the subject image DB 151, And a camera magnification adjustment module 140 that automatically adjusts the magnification of the camera.

At this time, the size of the subject in the chroma key subject image 123 refers to the expression of the whole body, upper body, lower body, face, etc. of the subject.

The phone database 150 stores a chromakey object image selected by the user, a real-time image, and a composite image. That is, the phone database 150 includes a phone object image DB 151, a phone real image DB 152, and a phone composition image DB 153.

The phone object image DB 151 is a phone database 150 for storing one or more chromakey object image data.

The phone real image DB 152 is a phone database 150 for storing one or more real time image data.

The phone synthesis image DB 153 is a phone database 150 for storing one or more composite image data.

The phone image synthesizer 160 synthesizes the chroma key image and the real time image when the size of the chroma key image selected by the user is small. For example, when the size of the chromakey object image is small, it means a short image provided within a specific time such as 30 seconds, 1 minute, and so on.

If the size of the chromakey object image is large, the control unit 132 controls the real-time image 101 without combining the image with the mobile terminal 100, and transmits the real-time image 101 to the image synthesis / production server 300 through the wireless communication unit 131 So that the image synthesis server 300 can perform image synthesis processing.

That is, the phone image synthesizing unit 160 includes a phone image file processing module 161, a phone image synthesizing module 162, and a phone composition information processing module 163.

The phone image file processing module 161 serves to fetch a chromakey object image file stored from the phone object image DB 151 under the control of the controller 132.

The phone image synthesizing module 162 stores the chroma key image and the real time image captured by the actual camera module 135 in the mobile terminal 100 in the phone real image DB 152 and outputs the chroma key image and real time image And stores the synthesized image in the synthesized image DB 152. [

The phone composition information processing module 163 reads the synthesized image stored in the phone synthesized image DB 152 and provides the synthesized image on the screen through the virtual camera module 136. [

7 is a view showing a configuration of a video synthesis server according to an embodiment of the present invention.

7, the image synthesis server 300 includes a control unit 310, an interface unit 320, a database 330, a chroma key image generation unit 330, A processing unit 340, and an image synthesis unit 350.

The control unit 310 is located in the image synthesis and production server 300 to drive and control the respective constituent modules on the program, processes the data, and stores the generated file in the database 330 or commands do.

That is, the image synthesis / production server 300 includes a related program for synthesizing the real-time image 101 and the chroma key image of the present invention, and each module of the program is operated by the control unit 310.

The interface unit 320 is a graphic user interface for providing input / output and progress information required for real-time image and chroma key subject image production on a monitor, and enables an administrator to easily produce an image through operations such as a keyboard and a mouse do.

When the size of the chroma key image 123 is large in the mobile terminal 100, the real time image 101 transmitted to the image synthesizing server 300 without being processed by the phone image synthesizer 160 is transmitted to the controller The real time image DB 333 and stores the mobile terminal 100 and the user information in the user information DB 335. [

The database 330 stores original chromakey images, chromakey object images, real-time images, composite images, and user information.

That is, the database 330 includes a chroma key image DB 331, a chroma key image DB 332, a real time image DB 333, a composite image DB 334, and a user information DB 335 .

The original chroma key image DB 331 is a database 330 for storing one or more original chroma key image data 122.

The chroma key object image DB 332 is a database 330 for storing one or more chroma key object image data.

The real-time image DB 333 is a database 330 for storing one or more real-time images 101 data.

The composite image DB 334 is a database 330 for storing at least one composite image 106 data.

The user information DB 335 is a database 330 for storing one or more pieces of user information data.

The chroma key image processing unit 340 uses the chroma key editor 121 in the manager PC 120 to cause the file processing module 341 to read the original chroma key image 122 file (332) file, or to change the background color of the chroma key to speed up the processing speed and sharpen the boundaries of the border of the chroma key. Extracts it, and stores it in a specific directory and temporarily stores it.

That is, the chroma key image processing unit 340 includes a file processing module 341, a background color changing module 342, and a chroma key extracting module 343.

The file processing module 341 invokes a file of the original chroma key image 122 to be produced by a command in the program and stores the file name and the path to be stored in the chroma key image DB 332, Setting.

The background color changing module 342 may change the chroma background color in order to extract the chroma key image from the original chroma key image 122 and to speed up the processing speed in the image synthesis and to sharpen the border boundary of the chroma key object .

The chroma key extraction module 343 deletes the chroma keyed area from the original chroma key image 122 retrieved by the file processing module 341 to generate a chroma key image 123, 341 in the chroma key image DB 332. The chroma key image DB 332 stores the chroma key image.

The image synthesizer 350 reads the chroma key image 123 from the chroma key image DB 332 and displays the frame thickness and the like in order to smooth the boundary between the background and the subject of the chroma key image 123 And composes the chroma key image 123 and the real time image 101 to produce a composite image file and transmits the synthesized image file to the mobile terminal 100.

That is, the image synthesis unit 350 includes an image file processing module 351, a video synthesis module 352, a border processing module 353, and a composite information processing module 354.

The image file processing module 351 serves to fetch the chromakey subject image 123 file stored from the chromakey subject image DB 332 under the control of the control unit 310.

The image synthesis module 352 invokes the stored real-time image 101 file from the chroma-keyed object image 123 and the real-time image DB 333 to synthesize the chroma-keyed object image 123 and the real- And stores the image file in the composite image DB 334.

The frame processing module 353 processes the frame thickness and the like to smooth the background of the chromakey subject image 123 and the boundary of the subject.

The synthesis information processing module 354 calls the synthesized image file stored in the phone synthesized image DB 152 and controls the control unit 310 to transmit the synthesized image to the mobile terminal 100 through the interface unit 320, And performs processing so that the terminal 100 can provide it on the screen through the virtual camera module 136.

FIG. 8 is a flowchart illustrating a method of composing a real-time image and a chroma key object image according to an exemplary embodiment of the present invention. FIG. 9 is a flowchart illustrating a chroma key object image processing method according to an exemplary embodiment of the present invention. FIG. 10 is a detailed flowchart of the real-time image management step of FIG. 8 according to an embodiment of the present invention. FIG. 11 is a flowchart illustrating the image synthesis processing of FIG. 8 according to an embodiment of the present invention. And Fig.

As shown in Figs. 8 to 11, first, a chroma key image file (original chroma key image) 122 for managing a original chroma key image 122 file is generated from a original chroma key image DB 331 so as to synthesize a real- Management step S100 is performed.

After performing the original chromakey image file management step S100, a chromakey object image processing step S200 of extracting a chromakey object image 123 from the original chromakey image 122 is performed.

9, the file processing module 341 of the chroma key image processing unit 340 first reads the original chroma key image DB 331 from the original chroma key image DB 331 in the chroma key editor 121 by a command on the program, A chroma key file processing step (S210) for loading a chroma key image 122 file is performed.

The original chroma key image (122) file is stored in the image synthesis production server (300), and the directory in which the file is stored is searched for and opened.

Next, the chroma key extraction module 342 of the chroma key image processing unit 340 extracts the chroma key image 123 from the original chroma key image 122 in the chroma key editor 121 by a command on the program, Step S220 is performed.

In step S230, the background color changing step S240 is performed to change the background color of the chroma key in order to increase the processing speed at the time of image synthesis and sharpen the boundaries of the edges of the chromakey subject.

If the background color process (S230) is not performed in the above step, the chroma key image storage step (S250) is performed.

After the background color is changed (S240), a chroma key image (step S250) is performed to store the chroma key image (123) in the chroma key image DB S200), and stores the result in the chroma key image DB 332 of the database 330. [0051]

After performing the chroma key image processing step S200, when the mobile terminal 100 photographs the real time image 101 and the size of the chroma key image 123 selected by the user is small, the mobile terminal 100 And if the size is large, the mobile terminal 100 transmits the synthesized image to the image synthesis server 300 without synthesizing the image, and the image synthesis server 300 performs image synthesis processing The real-time image management step S300 is performed.

10, first, the image file processing module 161 of the mobile terminal 100 calls the chroma key subject image 123 file from the phone subject image DB 151 by a command on the program (S310) of selecting a video image to be synthesized by the user on the screen of the mobile terminal (100).

A phone real time image recording step S320 of recording the real time image 101 using the selected chroma key image 123 and the actual camera module 135 of the mobile terminal 100 is performed.

In this step, the user can grasp the information of the selected chroma key image 123 so that the user can shoot natural moving images, and automatically adjusts the subject image using the camera magnification adjustment module 140 according to the situation of the whole body, upper body, The camera zoom-in / zoom-out process is performed or the frame area 102 is displayed on the screen of the mobile terminal 100 on the screen of the mobile terminal 100 using the frame area adjustment module 139.

The mobile terminal 100 determines whether to synthesize a phone image (S330) according to the size of the chroma key image 123 selected by the user.

When the size of the selected chroma key image 123 is small, the image synthesizing module 162 of the image synthesizer 160 synthesizes the chroma key image 123 and the real time image 101, Processing step S340 is performed.

The synthesized image obtained by synthesizing the real-time image 101 and the chroma key object image may be synthesized by the image file processing module 161 using the storage module 137, A phone synthesized image file storing step S350 for storing the synthesized image in the image DB 153 is performed.

If the size of the chroma key object image 123 selected in the above step is large, the control unit 132 controls the real time image 101 to be transmitted to the mobile terminal 100 through the wireless communication unit 131 Real-time image file transmission step S370 of transmitting the real-time image file to the image synthesis production server 300 is performed.

In the phone real-time image file transmission step S370, the chroma key image 123 is managed in the chroma key image DB 332 of the image synthesis server 300, so that the user information and the real- Only to the image synthesis production server 300.

After the phone real-time image file transmission step S370 is performed, the image synthesis server 300 synthesizes the chroma key image 123 and the real-time image 101 to the mobile terminal 101 (S380) for storing the synthesized image in the phone synthesized image DB 153 by using the storage module 137 in the image file processing module 161. [0053] FIG.

After the phone synthesized image file storage step S350 and the phone synthesized image file reception step S380 are performed, the created composite file is uploaded to the mobile terminal 100 to display a synthesized image. A phone synthesized image file requesting step S360 of calling the synthesized image in the phone synthesized image DB 153 of the mobile terminal 100 and providing the synthesized image to the screen through the virtual camera module 136 using the reproduction module 138 ).

After performing the real-time image management step (S300), an image synthesis processing step (S400) of synthesizing a real-time image and a chroma key object image is performed.

11, the image file processing module 351 of the image composing unit 350 first extracts the original chroma key image 122 (file) from the original chroma key image DB 331 by a command on the program, And the image file processing step S410 of loading the real-time image 101 file from the real-time image DB 333 is performed.

After performing the image file processing step S410, the border processing module 353 performs a border processing step S430.

If the border processing is not performed in step S420, the image combining module 352 performs an image combining processing step S440 of loading a composite image in the composite image DB 334.

After performing the image synthesis processing step S440, the composite information processing module 354 performs a composite information processing step S450.

After performing the above-described image synthesis processing step (S400), a synthesized image file storing step (S500) for storing the prepared real-time image and the chroma key object image as a combined file is performed.

In this step, the image file processing module 351 stores the real-time image and the chroma key object image as a combined file, which is temporarily stored in the administrator's computer, the image synthesis production server, and the like.

The synthesized image file obtained by synthesizing the real-time image and the chroma key image temporarily stored through the file storage step (S500) can be viewed or modified at any time.

After the synthesized image file storing step S500 is performed, the generated file is uploaded to the image synthesizing server, and when the users inquire the synthesized image through the user PC 110 or the mobile terminal 100, As described above, since the composite image file request step S600 is performed, the entire process of the method of composing the real-time image and the chroma key object image of the present invention is completed.

As described above, the system and method for synthesizing a real-time image and a chroma key object image according to the present invention can be applied to the field of image synthesis.

It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined in the appended claims.

100: mobile terminal 110: user PC
120: administrator PC 131: wireless communication unit
132: control unit 133: input unit
134: output section 135: actual camera module
136: Virtual camera module 137: Storage module
138: playback module 139: frame area adjustment module
140: camera scale adjustment module 150: phone database
151: Phone object image DB 152: Phone real image DB
153: Phone Composite Image DB 160: Phone Composite
161: Phone image file processing module 162: Phone image composition module
163: Phone composition information processing module 200: Internet network and mobile communication network
300: image synthesis production server 310:
320: interface unit 330: database
331: original chroma key image DB 332: chroma key image DB
333: Real-time image DB 334: Composite image DB
335: User information DB 340: Chroma key image processing unit
341: File processing module 342: Background color change module
343: chroma key extraction module 350:
351: Image file processing module 352: Image synthesis module
353: Border processing module 354: Composite information processing module

Claims (7)

A system for composing a real-time image and a chroma key image,
A function of requesting and acquiring a chroma key image stored in the image synthesis production server, a function of specifying the chroma key image to be synthesized by a user, synthesizing the real time image recorded using an actual camera module, A function of requesting the image synthesis server to perform image synthesis when the size of the chromakey object image is large; a synthesized image obtained by synthesizing a chroma key image and a real time image selected by the user in the image synthesis server, A mobile terminal (or a user PC) having a function of providing the synthesized image received and obtained to a user through a playback module;
An internet / mobile communication network for connecting the mobile terminal (or a user PC) and the image synthesis / production server;
A control unit connected to the Internet / mobile communication network and operating the modules included in the interface unit, the database, the chroma key image processing unit, and the image synthesizing unit; An interface unit for allowing a manager to easily produce an image through manipulation of a keyboard and a mouse, a graphical user interface for providing input, output, and progress necessary for time and chroma key object image production on a monitor; A chroma key image DB storing one or more original chroma key image data, a real time image DB storing one or more real time image data, a chroma key image DB storing one or more original chroma key image data, A database composed of a composite image DB for storing image data, and a user information DB for storing one or more pieces of user information data; A file processing module for loading a chromakey object image created by the program and setting a file name and a path for storing the chromakey object image database in the original chromakey image file, A background color changing module for changing a chroma key background color in order to extract a chroma key image and speed up processing speed in image synthesis and to sharpen a border boundary of a chroma key object; A chroma key image processing unit configured to generate a chroma key object image by deleting a chroma keyed area in an image file and store the chroma key image in the chroma key image DB by a file processing module; A video file processing module for bringing a chroma key object image file from the chroma key subject image DB under control of the control unit, and a real-time image file stored from the chroma key image and the real time image DB, An image synthesis module for synthesizing images and storing the synthesized image file in a synthetic image DB, a frame processing module for processing the border thickness to smooth the boundary between the background and the subject of the chromakey object image, And a synthesizing information processing module configured to call the image file and control the control unit to transmit the synthesized image to the mobile terminal through the interface unit and to provide the synthesized image on the screen through the virtual camera module in the mobile terminal, Real-time video and chroma key A chroma key image processing unit, and a video synthesizing unit, wherein the interface unit, the database, the chroma key image processing unit, and the image synthesizing unit are each operated by a signal of the control unit, An image synthesizing server having a function of producing an image;
A manager PC having a function of storing the original chromakey image file in the original chromakey image DB and confirming the chromakey object image on the screen through the chromakey editor and editing the necessary moving image section; And generating a composite image of the real-time image and the chroma key image. The method according to claim 1,
The mobile terminal comprises: a wireless communication unit for processing for performing wireless communication; A controller for driving and controlling each of the configuration modules of the mobile terminal; An input unit for controlling an input of the mobile terminal; An output unit indicating a processing state of the mobile terminal; An actual camera module for acquiring an actual view coming through a lens of an actual camera and displaying the acquired real view on a screen; A virtual camera module for providing, on the screen, a chromakey subject image stored in a phone database and an actual view acquired from an actual camera module as an application module executed in response to an actual camera module when a user presses a record button on the mobile terminal; A storage module for storing various chromakey object images, real-time images, and composite images in a phone database; A phone image DB storing one or more chroma key image data by the storage module, a phone real image DB storing one or more real time image data, and a phone compound image DB storing one or more composite image data A phone database; A playback module for reading and playing back a composite image stored in the phone database and providing the combined image to a screen; In order to naturally and real-time record the images of the chroma key image and the real image view using the virtual camera module, information on the size of the subject in the chroma key image is read from the subject image DB, A frame area adjustment module automatically provided; A camera magnification adjustment module for automatically adjusting a magnification of the camera; A phone image file processing module for receiving a chroma key image file stored in the phone image DB under the control of the controller, a chroma key object image and a real time image captured by the actual camera module in the mobile terminal, A phone image synthesizing module for synthesizing a chromakey object image and a real time image and storing the synthesized image in a phone synthesized image DB, a process of reading a synthesized image stored from a phone synthesized image DB and providing the synthesized image on a screen through a virtual camera module A phone image synthesizer configured by a phone composition information processing module for performing a phone composition; And generating a composite image of the real-time image and the chroma-key object image. delete A method for composing a real-time image and a chroma key object image,
(A) managing the original chroma key image file from the original chroma key image DB so that the real time image and the chroma key image can be synthesized;
A chroma key object image processing step (b) of extracting a chroma key object image from the original chroma key image file after performing the original chroma key image file management;
After performing the chromakey object image processing, the mobile terminal captures a real time image, and when the size of the chromakey object image selected by the user is small, the mobile terminal synthesizes the chromakey object image and the real time image, (C) a real-time image management step of transmitting the image to the image synthesis production server without synthesizing the image from the mobile terminal so that the image synthesis server can perform image synthesis processing;
The image file processing module of the image compositing unit performs the image file processing step of loading the original chroma key image file from the original chroma key image DB by the command on the program and calling the real time image file from the real time image DB after performing the real time image management, If the frame processing is performed after the image file processing step, the frame processing module performs the frame processing step. If the frame processing is not performed, the image synthesizing module performs image synthesis processing (D) an image synthesis processing step of synthesizing the real-time image and the chroma key object image, which is composed of a synthetic information processing step in the synthetic information processing module after performing the image synthesis processing step;
A synthesized image file storing step (e) for storing the synthesized real time image and the chroma key object image as a synthesized file after performing the image synthesizing process;
Storing the synthesized image file, uploading the created file to the image synthesis server, inquiring the synthesized image through the user PC or the mobile terminal, and requesting the synthesized image file; And generating a composite image of a real-time image and a chroma key object image. 5. The method of claim 4,
The chroma key image processing step (b) includes a chroma key file processing step of causing the file processing module of the chroma key image processing unit to fetch the original chroma key image file from the original chroma key image DB in the chroma key editor by a command on the program, The chroma key extraction module of the chroma key image processing module extracts the chroma key image from the original chroma key image in the chroma key editor by the command in the program and the background color process in the chroma key extraction step, Changing a background color for changing the chroma key background color so as to speed up the processing speed of the chroma key subject and sharpening the border boundary of the chrome key object; and storing the chroma key subject image if the background color is not processed in the chroma key extraction step; And generating a composite image of a real-time image and a chroma key object image. 5. The method of claim 4,
In the real-time image management step (c), the phone image file processing module of the mobile terminal loads the chroma key object image file from the phone object image DB by the command on the program and provides the chroma key object image file to the mobile terminal screen, A phone-object image selecting step of selecting a phone-object image; A phone real time image recording step of recording the selected real time image 101 using the selected chroma key image file and the actual camera module of the mobile terminal; Determining whether to synthesize a phone image in a mobile terminal according to a size of a chroma key object image selected by the user in the phone real time image recording step; A phone image synthesizing processing step of synthesizing the chroma key image and the real time image in the phone image synthesizing module of the image synthesizing part when the size of the chroma key image selected in the step of determining whether the phone image is synthesized is small; After the phone image synthesis process is performed, the synthesized image obtained by synthesizing the real-time image and the chroma key object image is stored in a phone synthesizing image database using a storage module in a phone image file processing module, A file storage step; When the size of the chroma key object image selected in the step of determining whether or not the phone image is synthesized is large, the control unit controls the mobile terminal not to synthesize the image to transmit the real time image to the image synthesis production server through the wireless communication unit A real-time image file transmission step; After the phone real-time image file transmission step, the image synthesis server receives the composite file obtained by synthesizing the chroma key image and the real-time image at the mobile terminal, A phone synthesized image file receiving step of storing the synthesized image in the image DB; After the synthesized image file storage step and the phone synthesized image file reception step are performed, the synthesized image is uploaded to the mobile terminal, and the synthesized image is retrieved, and the synthetic image is retrieved from the phone synthesized image DB of the mobile terminal A phone synthesized image file requesting step of providing a screen through a virtual camera module using a playback module; And generating a composite image of a real-time image and a chroma key object image. delete
KR1020150095670A 2015-07-06 2015-07-06 A system and method for composing real-time image and chroma-key Image of subject KR101695209B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020150095670A KR101695209B1 (en) 2015-07-06 2015-07-06 A system and method for composing real-time image and chroma-key Image of subject

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020150095670A KR101695209B1 (en) 2015-07-06 2015-07-06 A system and method for composing real-time image and chroma-key Image of subject

Publications (1)

Publication Number Publication Date
KR101695209B1 true KR101695209B1 (en) 2017-01-11

Family

ID=57832975

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020150095670A KR101695209B1 (en) 2015-07-06 2015-07-06 A system and method for composing real-time image and chroma-key Image of subject

Country Status (1)

Country Link
KR (1) KR101695209B1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108989833A (en) * 2017-06-02 2018-12-11 北京视联动力国际信息技术有限公司 A kind of generation method and device of video cover image
CN112235520A (en) * 2020-12-07 2021-01-15 腾讯科技（深圳）有限公司 Image processing method and device, electronic equipment and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20070064082A (en) * 2005-12-16 2007-06-20 주식회사 피알존 System and method for producing moving image using chroma-key
JP2007240887A (en) * 2006-03-08 2007-09-20 Make Softwear:Kk Automatic photographing device and method thereof
KR20080035743A (en) 2006-10-20 2008-04-24 삼성전자주식회사 Mold frame and liquid crystaldisplay device having the same
KR101334881B1 (en) * 2013-05-28 2013-11-29 장연환 User selective high definition composite video generation system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20070064082A (en) * 2005-12-16 2007-06-20 주식회사 피알존 System and method for producing moving image using chroma-key
JP2007240887A (en) * 2006-03-08 2007-09-20 Make Softwear:Kk Automatic photographing device and method thereof
KR20080035743A (en) 2006-10-20 2008-04-24 삼성전자주식회사 Mold frame and liquid crystaldisplay device having the same
KR101334881B1 (en) * 2013-05-28 2013-11-29 장연환 User selective high definition composite video generation system

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108989833A (en) * 2017-06-02 2018-12-11 北京视联动力国际信息技术有限公司 A kind of generation method and device of video cover image
CN108989833B (en) * 2017-06-02 2021-02-09 视联动力信息技术股份有限公司 Method and device for generating video cover image
CN112235520A (en) * 2020-12-07 2021-01-15 腾讯科技（深圳）有限公司 Image processing method and device, electronic equipment and storage medium

Similar Documents

Publication Publication Date Title
CN101189869B (en) Imaging device, imaging result processing method, image processing device
US20130083215A1 (en) Image and/or Video Processing Systems and Methods
CN109218630B (en) Multimedia information processing method and device, terminal and storage medium
CN103297682A (en) Moving image shooting apparatus and method of using a camera device
US20130162672A1 (en) Image processing device, image processing method, and program
EP1377045A3 (en) Content creation
CN104023172A (en) Shooting method and shooting device of dynamic image
JP5393237B2 (en) Image display apparatus, control method therefor, program, and storage medium
KR101663085B1 (en) System for producing video card in a portable smart device using alpha channel image composition based on video and method therefor
KR20100017242A (en) Method of creating and reproducing a panoramic sound image, and apparatus for reproducing such an image
CN105814905A (en) Method and system for synchronizing usage information between device and server
JP2006060653A (en) Image editing apparatus, method and program
KR101695209B1 (en) A system and method for composing real-time image and chroma-key Image of subject
JP6314427B2 (en) Imaging apparatus, information processing apparatus, control method, and program
CN110248207B (en) Image reality display server, image reality display method, recording medium and image reality display system
KR100776433B1 (en) Mobile communication terminal with the improved image composing
US10582135B2 (en) Computer generated imagery compositors
JP2006018384A (en) Imaging device and image processing method
JP2009081592A (en) Video image recording apparatus
JP2000261657A (en) Method for photographing video image for editing with object trimming function, its system and storage medium with program describing the same function stored therein
KR101285382B1 (en) A device having function editting of image and Method thereof
KR20230148284A (en) A system and method for composing real-time image and chroma-key Image of subject
KR20180124539A (en) Chroma key remote synthesis synchronization system and method
CN113615156A (en) Image processing apparatus, image processing method, computer program, and storage medium
JP2020188417A (en) Image processing apparatus, image processing method, and computer program

Legal Events

Date Code Title Description
GRNT Written decision to grant