WO2014108102A1

WO2014108102A1 - Image and video synthesis system and synthesis method

Info

Publication number: WO2014108102A1
Application number: PCT/CN2014/070531
Authority: WO
Inventors: 林艳
Original assignee: 北京友维科软件科技有限公司
Priority date: 2013-01-11
Filing date: 2014-01-13
Publication date: 2014-07-17
Also published as: CN103079040A

Abstract

A synthesis system for synthesizing an image effect onto a video and a synthesis method are disclosed. Said synthesis system comprises: an image conversion unit, for converting one or a plurality of images into a single image supplemental-effect file; a video editing unit, for reading both the image supplemental-effect file and a video and then synthesizing said file onto a video frame and outputting the final video file. The synthesis system and synthesis method of the present invention allow for the synthesis of video and image effects, thereby diversifying and enriching the color effects of a video.

Description

Image and video video synthesis system and synthesis method

The present invention relates to a system and method for synthesizing an image having a specific effect into an image video, and belongs to the field of image processing technology.

Background technique

With the popularity of digital cameras, such as video recording and image capture, cameras, mobile phones, etc., in daily life, more and more video recording functions are used to facilitate recording or to commemorate specific scenes and occasions. Therefore, people have also developed a strong interest in video editing, including video cutting, combination, etc., but the video editing processing software currently available on the market is the processing of the video file itself, such as the encoding and compression of the team video file. Mosaic of video files, enhancement of lake surface brightness of video files, reduction of picture noise, etc. These functions are based on video post-processing software such as ULEAD, PRIMER, VEGAS, etc., based on the software's own function to process video files, can not be The external part of the picture effect is inserted into the image editing program for editing. The video made by the existing video post-processing software is relatively monotonous, only the editing process of the video file itself, and the production fun is lacking in the video editing process. It also limits the effect of the video.

Summary of the invention

In view of the deficiencies of the prior art, the present invention discloses an image and video synthesis system and a synthesis method. Based on the system and method of the present invention, it is possible to add effects to the original video and video in the form of transparent static and dynamic images to achieve different The source realizes the synthesis of video and image effects, making the video visual effects colorful and rich in content.

In order to achieve the above object, the present invention is achieved by the following technical solutions:

First, the present invention discloses an image and video and video synthesizing system for synthesizing one or more images into a video image by overlaying, specifically including:

The image conversion unit is configured to convert one or more images into a single image supplement effect file; the video editing unit is configured to read the image supplement effect file and the image video, and synthesize the image supplement effect file onto the image video and Output the final video and video file.

The image used is preferably any image format with an alpha channel that can be set in the current image field, such as JPG, PNG, PSD, etc. By setting the alpha channel value of these images, the transparency of the image can be adjusted to facilitate application to the image. Cover synthesis at a later stage of the invention, preferably, the image conversion The unit replaces one or more PNG format images into a single image supplemental effect file. Compared to other types of files, PNG format images support high-level lossless compression, fully native support for alpha channel transparency adjustment, and support for gamma correction, support for interlacing and many other adjustable features.

Among them, one PNG can be imported to create a single image supplement effect file for static effects, and multiple PN images can be imported for conversion into a single image supplement effect file of dynamic effects. Preferably, a minimum of 20 PNGs is used. Up to 30 PNG images are used as a single image supplement effect file with dynamic effects and can be played back in a dynamic cycle, that is, the number of PNG format images used by the image conversion unit is 20-30 sheets.

The implementation of the single image supplement effect file can be implemented in various manners, and the file format currently available in the field can be used, or the file format can be customized according to the technical needs. The former is a GIF image widely used in the field. File, multi-frame PNG image file, FLASH file container, etc., the latter is mainly for the need to increase the file's other needs to customize the scalable features, for example, the applicant of the present invention based on the above-mentioned functions need to implement an EFS (EFfect Supplementary) specific file format. Although different single image supplemental effect files need to be implemented by different software or hardware codes, as long as they can be used in the present invention, they are covered by the technical solutions of the present invention.

The working principle of the synthesis system of the invention is that the image conversion unit inputs one or more images of PNG format or images of other formats (the image used at this time may be transparent, that is, the alpha channel is defined as 0, or may be non-transparent. , that is, the alpha channel is not 0, and the transparent or partially transparent image is obtained by adjusting the alpha channel value later), and it is made into a single image supplement effect file with static effect or dynamic effect, and output to the video editing unit for use; video editing unit Importing a single image replenishment effect file will complement the single image with the desired effect (such as a layer of portrait or landscape or calendar on the original video file or a specific photo on a portion of the original video file) The single or multi-frame image in the effect file is read into the video editing unit, and its characteristics such as size, position, transparency, rotation angle, etc. displayed in the original video image are adjusted to meet specific needs, and are covered. The original image video needs to be inserted into the corresponding image effect Position (on the timeline or in the spatial position), and consider the need for motion pictures or still images contained in the video interval to which this effect is applied, and adjust the PNG format effect image or other format image included in the single image supplement effect file. The transparent part is covered.

When it is necessary to cover the animation effect, the motion effect is achieved by overlaying multiple images, such as 2CT30, PNG format or other formats, onto the original video file screen in sequence. At the same time based on The length of this implementation time.

After the above processing is completed, the moving image or the still image superimposed by the image of the PNG format (or other format) is continuously encoded to complete the final video and video file output.

As described above, the original video and video may be a moving image (such as a camera, a camera, a video of a avi, mov, etc.), or a still image (such as a camera, a camera, a jpg, or a mobile phone). Raw format image).

Further, the image conversion unit of the present invention further inputs a BMP image or an image without an alpha channel in another format, and converts one or more images of the PNG format or other formats when converted into a single image supplemental effect file. The alpha channel image is combined with the image without the alpha channel (ie, opaque), and the resulting single image supplemental effect file can preview one or more PNG format images or other formats with alpha channel. The synthetic effect of the image.

Similarly, in the above case, the video editing unit separates the image (i.e., opaque) that does not have the alpha channel after entering the single image supplemental effect file described above, and does not enter the final image.

As described above, in order to satisfy various parameters such as the position of the image included in the single image supplemental effect file on the video video file screen, the video editing unit includes an image adjustment module, and the image adjustment module is used for reading the video editing unit. After the image supplement effect file is input, the attributes of the image included in the image supplement effect file on the image video file screen are adjusted, and the attributes include size, position, transparency, and rotation angle.

Among them, a particularly important function is that the image adjustment module adjusts the transparency of the image contained in the image supplement effect file, and the video editing unit overlays it onto the image video screen.

Further, in order to prevent the single image supplement effect file from being stolen by other users or vendors to meet the needs of copyright protection, the synthesizing system further includes an encryption and decryption unit for encrypting a single image supplement effect file generated by the image conversion unit. And decryption.

The specific encryption and decryption algorithms can be implemented using any available method.

Through the above technical solution, the synthesizing system of the present invention can generate a continuous motion effect file or a static image of a specific form in one or more PNG formats or other format images, and can import the effect of the effect file into the video according to the needs of the video and video files. The editing unit adjusts the size, position, transparency, rotation angle and other characteristics of the PNG format image displayed on the video and video screen to use the image when editing the video. Enrich the content by adding a clip that is freed on the video and video file screen by overlay.

Further, based on the above synthesizing system, the present invention also discloses a method for synthesizing images and video images, which includes the following steps:

(1) Converting one or more images with alpha channels into a single image supplemental effect file;

(2) reading the original video and video file and the single image supplemental effect file of step (1);

(3) Read in the image of the image and video file screen included in the single image supplement effect file, and adjust its size, position, transparency, rotation angle, etc., and overlay the image into the original video file. Upper

(4) Encode the synthesized video and video files and output the final video and video files.

As described above for the synthesis system, the synthesis method of the present invention can realize the synthesis of the image file and the video and video file picture having the specific desired effect in an overlaid manner, thereby making the video picture more colorful.

Further, the above step (1) further includes the step of synthesizing the image having no alpha channel and the one or more images having the alpha channel into a single image supplemental effect file, so as to cover the composite image having the alpha channel. The effect is previewed; correspondingly, corresponding to the additional step, step (3) further includes reading a single image supplement effect file, separating the image without the alpha channel, thereby applying the image display suitable for the video and video file display. The steps for an image with an alpha channel.

Further, the synthesizing method further includes the step of encrypting and decrypting the single image supplement effect file of the step (1), and encrypting the single image supplement effect file after the step (1) is completed, in the step (2) A single image supplemental effect file is decrypted while reading.

In particular, the software or hardware implementation of the encryption and decryption used may employ any method that can be used in the present invention.

Further, the synthesizing method further comprises the steps of superimposing a plurality of images in order to realize an action effect and synthesizing the same into the original video file, thereby realizing an animation effect in the original video file.

Similar to the above, the original video and video can be either a moving image (such as a camera, a camera, a video in a format such as avi, mov, or the like), or a still image (such as a camera, a camera, or a jpg taken by a mobile phone). Raw format image). Through the above-mentioned synthesis system and synthesis method, the present invention can convert an image (multiple picture connection including PNG format or other format) into a single file format with image supplement effect, and then insert the file into an image effect form. The image editing unit adjusts its size, position, transparency, rotation adjustment, etc. on the original video file screen to achieve the combination of the two.

DRAWINGS

Figure 1 is a schematic structural view of a synthesis system of the present invention;

2a and 2b are partial flow charts of the synthesis method of the present invention, respectively.

detailed description

The invention and its technical spirit are better understood in conjunction with the specific embodiments and the accompanying drawings, but the scope of the invention is not limited thereto. The modifications, alterations, substitutions, etc., which are made by those skilled in the art in the light of the present invention, which are in the form of the invention, are intended to be included in the scope of the invention.

1 is a structure of an image and video and video synthesizing system of the present invention, including an image converting unit and a video editing unit, wherein the image converting unit is configured to use one or more transparent images of an image format having a settable alpha channel. (There are four images, those skilled in the art can understand that other numbers of images are also feasible; it is also feasible to use a non-transparent image to adjust the transparency during post-synthesis) to convert into a single image supplement effect file; the video editing unit reads in The file and the original image and video file to be processed, and the image contained in the single image supplemental effect file is overlaid at a specific time or space of the original video and video file after being adjusted in transparency, size, position, and rotation angle. On the screen.

Referring to FIG. 2a, an implementation process of converting an image into a single image supplemental effect file is shown, which combines a BMP image with a specific image content to preview a single image supplemental effect file effect and a png image composition that meets the needs of the synthetic effect. Supplement the effect file for a single image (the illustration is the applicant's custom EFS format file, other file types such as gif, multi-frame png, etc. are all available), in order to facilitate classification management, add this when the file is generated. The basic type of effect, the name of the clip file, the setting of the effect name, and the effect on the actual screen can be previewed.

Referring to Figure 2b, a single image supplement effect file (shown as the applicant's custom EFS format file, other file types such as gif, multi-frame png, etc.) is displayed, and the video editing unit reads the image. Video file (motion image, still image), and according to the basic type of the single image supplement effect file, the insertion effect classification, the clip file name, the effect name, etc. The single image supplement effect file first separates the BMP image without the alpha channel, and then adjusts the position of the PNG format file in the single image supplement effect file on the image video file screen according to the required effect, Parameters such as size, angle, transparency, etc., so that the PNG image is overlaid on the screen of the original video file, and after the synthesis is completed, the code is output as the final video file.

Specifically, the manner in which the image is adjusted on the screen can be implemented by any geometric algorithm. The applicant has given an implementation method as follows. This is not a limitation, and other geometric transformations can be implemented by those skilled in the art.

1) Image movement

The image I (X, y) moves Δχ in the X-axis direction and Δ y in the y-axis direction. The image / ₂ (^) is indicated as follows.

The table matrix is as follows.

2) The image is enlarged and reduced

The image I(x, y) is enlarged (or reduced) in the X-axis direction, and enlarged (or reduced) in the y-axis direction. The image / ₂ (ϋ) is indicated as follows

{ — Sx (3)

y = yxSy

In the expression (3), the coordinate conversion relationship is indicated as a matrix as follows.

X Sx 0

0 Sy 0 (4)

0 0 1

3) Rotation of the image

Image I (X, y) rotates α degrees clockwise and the image / ₃ (^) is marked as follows

X = cos -x-sma · y

(5)

y = sma - + cos - y

In the expression (5), the coordinate conversion relationship is marked as follows

4) Mirror conversion

In the case of X-axis mirror conversion, the coordinate transformation matrix is labeled as follows.

X 1 0 0Yx,

0 1 0 (7)

0 0 1

X 1 0 ΟΥ χ,

0 -1 0 (8)

0 0 1

5) Compound conversion

First convert and then convert Τ2, then convert Τ3, the conversion from the original coordinates to the new coordinates is as follows

(9)

Here is

Τ = Ί ·Ί ·Τ, (10)

That is to say, the overall coordinate transformation matrix of various geometric transformations is obtained by the inverse sequential matrix multiplication of individual transformation matrix transformations.

For example, in the case of expanding the transformation (Sx, Sy) and then rotating the transformation (α), the coordinate transformation matrix is

X cos a sin a 0 Y Sx Sx-cosa -Sy- sin a θΥ

=

y sin 0 ^ 0 •sin Sy -cosa

, o 乂 V 0 0 1

(u).

Claims

Claim

1. Image and video synthesis system, including:

The image conversion unit is configured to convert one or more images into a single image supplement effect file; the video editing unit is configured to read the image supplement effect file and the image video, and synthesize the image supplement effect file onto the image video screen And output the final video and video files.

2. A composition system according to claim 1, wherein said image conversion unit converts one or more PNG format images into a single image supplemental effect file.

3. The composition system according to claim 2, wherein the number of PNG format images used by said image conversion unit is 20-30 sheets.

4. The compositing system according to claim 1, wherein the video editing unit comprises an image adjustment module, and the image adjustment module is configured to: after the video editing unit reads the image supplement effect file, adjust the image included in the image supplement effect file in the image. Properties on the video file screen, including properties such as size, position, transparency, and rotation angle.

5. The composition system of claim 4, wherein the image adjustment module adjusts transparency of an image included in the image supplement effect file, and the video editing unit overlays the image on the video video surface.

6. The composition system according to claim 1, further comprising an encryption and decryption unit for encrypting and decrypting a single image supplemental effect file generated by the image conversion unit.

7. The composition system of claim 1 wherein the image video is a motion image or a static image.

8. Image and video synthesis method, including the following steps:

(1) converting one or more images into a single image supplemental effect file;

(3) Read in the image of the video and video file screen included in the single image supplement effect file, and adjust its size, position, transparency, rotation angle, etc., and overlay the image into the original video file. Upper

9. The method according to claim 8, further comprising the step of encrypting and decrypting the single image supplemental effect file of step (1), and supplementing the effect file with a single image after step (1) is completed. Encryption, solve the single image supplement effect file when reading in step (2) The claims are confidential.

The compositing method according to claim 8, further comprising the step of superimposing a plurality of images in order to realize an action effect and synthesizing the same into the original video file.