1308706 玖、發明說明： 【發明所屬之技術領域】 本發明係關於一種動態影像製作系統及方法，特別是 一種配合音樂製作動態影像的系統及方法。 【先前技術】 利用電腦來製作動態影像的技術已經是現在被廣泛應 鲁 用的技術，動態捕捉系統的技術也日趨進步。利用動態捕 捉系統可以直接製作出人體運動的動態影像，並且在應用 上也包括了與音樂結合的技術。但在先前技術當中，要製 作一種能夠配合音樂的動態影像，只能靠製作者本身對於 音樂及動態影像的敏感度來製作，而沒有一種完善的系統 與方式來製作動態影像。所製作出的動態影像可能會在與 音樂的結合上有所偏差。因此需要一種完整的製作系統以 及製作方法，來解決先前技術所發生的問題。 【發明内容】 本發明之主要目的係在提供一種可以配合音樂來製作 合成之動態影像的系統及製作方法。 為達成上述之目的，本發明提供一種動態影像製作系 統，包括聲音分析模組、動態影像資料庫、動態影像分析 模組以及動態影像合成模組。聲音分析模組包括偵測模組 及編輯模組。偵測模組偵測並分析原始音樂，接著編輯模 5 1308706 資：始音樂，使其成為編輯過之音樂。動態影像 同區段之材，動態影像分析模組用來將不 成模組接收編輯過之音樂與動態影像後，形成ί 成之動態影像。 风口 聲音外提供—種導引動g影像製作方法，先利用 編輯i之音;入的原始音樂，並用編輯模組處理成 ,,^ ^接者從動態影像資料庫讀取動態影像素 旦用動_影像分析模組，將不同區段之複數之動態 晝面的相似程度來建構處理成為動態影 立挪也象口成模組接收來自聲音分析模組之編輯過之 ‘：:;像自動態影像分析模組之動態影像後，形成合成之 【實施方式】1308706 发明, 发明发明: [Technical Field] The present invention relates to a dynamic image production system and method, and more particularly to a system and method for producing dynamic images in conjunction with music. [Prior Art] The technology of making a moving image using a computer has been widely used now, and the technology of the dynamic capturing system is also progressing. With the dynamic capture system, dynamic images of human motion can be directly produced, and techniques combined with music are also included in the application. However, in the prior art, to create a dynamic image that can match music, it can only be made by the producer's own sensitivity to music and motion images, and there is no perfect system and method for making motion pictures. The motion pictures produced may be biased in combination with music. There is therefore a need for a complete production system and method of fabrication to solve the problems of the prior art. SUMMARY OF THE INVENTION A primary object of the present invention is to provide a system and a method of making a synthesized dynamic image that can be combined with music. To achieve the above object, the present invention provides a motion picture production system including a sound analysis module, a motion picture database, a motion picture analysis module, and a motion picture synthesis module. The sound analysis module includes a detection module and an editing module. The detection module detects and analyzes the original music, and then edits the mode 1 1308706: the original music, making it the edited music. Motion Picture In the same section, the motion picture analysis module is used to receive the edited music and motion pictures without the module, and form a dynamic image. The sound of the tuyere is provided as a method of guiding the g-image, firstly using the edited i sound; the original music is entered, and processed by the editing module, and the ^^ is used to read the dynamic image from the dynamic image database. The motion image analysis module constructs the degree of similarity of the dynamic surface of the plurality of segments into a dynamic image, and the image module receives the edited from the sound analysis module. Dynamic image analysis of the dynamic image of the module, forming a synthesis [Embodiment]
，能讓貴審查判能更瞭解本發明之技術内容， 一個較佳具體實施例說明如下。 -立:先參考圖1係本發明之動態影像製作系統1G的架構 =:。如严1所示，本發明之動態影像製作系統工。包括 模組21、動態影像資料庫22、動態影像分析模組 23以及動恶影像合成模組24。 一聲曰刀析模組21包括偵測模組211及編輯模組212。 田聲曰刀析;^組21接收來自外部的音樂資料庫或其他來 源的：原始音樂31時（請參考圖3關於原始音樂31之波 I示思圖）’債測換組211即偵測並分析原始音樂Η的節 6 1308706 、 奏及/或強度。接著編輯模組212即可依照偵測模組211所 ' 偵測及分析出的節奏及/或強度來編輯該原始音樂31，使其 - 成為編輯過之音樂32 (請參考圖4關於編輯過之音樂32 之波形示意圖），並且輸出至動態影像合成模組24，以供 作進一步之處理。 動態影像資料庫22内至少含有一種動態影像素材51 (請參考圖5關於動態影像素材51之示意圖），動態影像 素材51包含複數之動態影像區段52 (請參考圖6關於複 φ 數之動態影像區段52之示意圖），可利用動態影像分析模 組23來將不同區段之複數之動態影像區段52依照影像晝 面的相似程度來建構處理成為動態影像53 (請參考圖8關 於動態影像53之示意圖），並且輸出至動態影像合成模組 24，以供作進一步之處理。 動態影像合成模組24接收來自聲音分析模組21之編 輯過之音樂32與來自動態影像分析模組23之動態影像53 後，即可將兩者予以合成，而形成合成之動態影像。 φ 本發明另提供一種利用上述之動態影像製作系統10來 製作動態影像之動態影像製作方法。以下請一併參考圖2 到圖8關於本發明之動態影像製作方法。 請先參考圖2係本發明動態影像製作方法的步驟流 程。如圖2所示，本發明之方法包含以下步驟： 步驟201 :分析輸入之原始音樂31。原始音樂31之波 形如圖3所示。圖3係本發明原始音樂31之波形示意圖。 本發明係利用聲音分析模組21接收原始音樂31，並且分 析原始音樂31。音樂的表現可包括節奏、旋律、曲調或是 7 1308706 節拍強度等，本發明的具體實施例是以分析原始音樂31的 ' 節奏為例，但本發明並不以此為限。 • 一般而言，若要找出音樂的節奏，則要先找出音樂的 重音之處。而大部分的音樂的重音都發生在低音聲部，低 音聲部則多出現在低頻處。因此本發明的偵測模組211先 利用低通濾波器擷取原始音樂31的低頻處，再找出重音之 處，就可以得到原始音樂31之波形，如圖3所示。 步驟202 :處理原始音樂31成編輯過之音樂32。本發 • 明係利用編輯模組212，先將原始音樂31之波形依照固定 時間分成複數個音框，如圖3中的第一音框41、第二音框 42及第三音框43。要編輯音樂時則利用刪減音框來編輯。 例如在本實施例中將第二音框42刪除，接著尋找第一音框 41及第三音框43内的音框之音樂波形適合的銜接點。必 要時可將音框位移一段很短的時間，例如位移到新的第三 音框44，來銜接音樂的波形，形成編輯過之音樂32。就如 圖4所示，圖4係為本發明編輯過之音樂32之波形示意 φ 圖。最後再輸出編輯過之音樂32。 在本發明的音樂波形當中，若波形的最大值有超過一 設定音量值之處，則將超過的時間點設定為拍點。因此， 如圖4所示，編輯過之音樂32中會有複數的拍點61，並 且在複數的拍點61中，拍點與拍點之間的間距不盡相同。 步驟203 :讀取動態影像素材51。如圖5本發明動態 影像素材51示意圖所示，在動態影像資料庫22内含有動 態影像素材51。要製作動態影像時，就先讀取動態影像資 料庫22内的複數之動態影像素材51，再傳送到動態影像 8 1308706 分析模組23進行步驟204。 另一方面，為了要確保最後的合成之動態影像的影像 . 流暢度，動態影像資料庫22中可以存放不同類型的動態影 像素材51，來配合原始音樂31的節奏。若原始音樂31的 節奏是屬於快速的，就讀取影像變化快速的動態影像素材 51 ;若是原始音樂31的節奏是屬於缓慢的，就讀取影像變 化緩慢的動態影像素材51。 步驟204 :處理動態影像素材51成動態影像53。即利 • 用動態影像分析模組23處理。請參考圖6，圖6係本發明 複數之動態影像區段52之示意圖。動態影像素材51可以 分割成複數之動態影像區段52，分割的原則係依照動態影 像素材51中影像晝面的動作幅度來分段。在複數之動態影 像區段52的每一組區段中都會有一個完整的單位動作，並 且最多只能有一個大的動作變化幅度，因此複數之動態影 像區段52的各個區段長度不盡相同。 接者依照編輯過之音樂32之波形選出能配合編輯過之 • 音樂32之複數的拍點61間隔長度的複數之動態影像區段 52。如圖7所示，圖7係本發明複數之動態影像區段52連 結之示意圖。在本實施例中複數之動態影像區段52區分為 動態影像起始區段521、第一動態影像間隔區段522、第二 動態影像間隔區段523及第三動態影像間隔區段524，並 依照各個動態影像區段的影像晝面中的影像動作相似程度 連接起來。最後輸出圖8的動態影像53，圖8係本發明動 態影像53之示意圖。 需注意的是，在影像編輯的過程中，複數之動態影像 9 Ι3Ό8706 .-段52可能擁有許多動態影像區段的長度能分別與編輯 過之音樂32之波形中的複數的拍點61間隔長度相對應. 並且複數之動態影像區段52之間的聯結關係可能不^ 一 種。若是從所有的可能組合去排列，將會使得树明的系 統計算量過於龐大。 ’、 因此要先任意選擇一個動態影像的區段（如動態影像 起始區段521) ’接著尋找能夠與複數的拍點61之間隔時 間的長度類似的另一動態影像的區段（如第一動態影像間 _ 隔區段522)。接著依據各個動態影像區段的影像晝面之相 似程度排列可能的連接路徑，影像晝面之相似程^較高的 優先排列。若是在其中某一可能的連接路徑中發現影像書 面有超過一個以上的大的動作變化幅度，就要把該路徑刪 除。最後選取一條最合適的連接路徑，將其中各個動態影 像的區段連接起來，就成為動態影像53。 最後進行步驟205 .結合編輯過之音樂32與動態影像 53成為合成之動態影像。利用動態影像合成模組24來依 • 照編輯過之音樂32之節奏’安排與動態影像53的結合時 間點，最後成為合成之動態影像。 此外，雖然在本發明之具體實施例中，本發明係先進 行步驟201及202，接著才進行步驟203及204，然而實際上 本發明也可先進行步驟203及204，接著才進行步驟201及 202。或者，本發明也可在進行步驟201及202之同時進行步 驟203及204。因此，本發明之申請專利範圍並不以各個步 驟之先後次序為限。 Ι3Ό8706 \ 綜上所陳，本發明無論就目的、手段及功效，在在均 _ 顯示其迥異於習知技術之特徵，懇請貴審查委員明察， - 早日賜准專利，俾嘉惠社會，實感德便。惟應注意的是， 上述諸多實施例僅係為了便於說明而舉例而已，本發明所 主張之權利範圍自應以申請專利範圍所述為準，而非僅限 於上述實施例。 【圖式簡單說明】 • 圖1係本發明動態影像製作系統的架構示意圖。 圖2係本發明動態影像製作方法的步驟流程圖。 圖3係本發明原始音樂之波形示意圖。 圖4係本發明編輯過之音樂之波形示意圖。 圖5係本發明動態影像素材示意圖。 圖6係本發明複數之動態影像區段之示意圖。 圖7係本發明複數之動態影像區段連結之示意圖。 φ 圖8係本發明動態影像之示意圖。 【元件代表符號說明】 動態影像製作系統10 聲音分析模組21 動態影像資料庫22 偵測模組211 編輯模組212 1308706 動態影像分析模組23 " 動態影像合成模組24 * 原始音樂31 編輯過之音樂32 第一音框41 第二音框42 第三音框43 新的第三音框44 *動H影像素材51 複數之動態影像區段52 動態影像起始區段521 第一動態影像間隔區段522 第二動態影像間隔區段523 第三動態影像間隔區段524 動態影像53 # 複數的拍點61The technical content of the present invention can be better understood by a review, and a preferred embodiment is described below. -Li: First referring to Fig. 1 is the architecture of the motion picture production system 1G of the present invention =:. As shown in Yan 1, the motion picture production system of the present invention works. The module 21, the dynamic image database 22, the motion image analysis module 23, and the motion image synthesis module 24 are included. A squeegee module 21 includes a detection module 211 and an editing module 212. Tian Sheng's knife analysis; ^ group 21 receives music from the outside or other sources: original music 31 (please refer to Figure 3 on the original music 31 wave I map) 'debt test group 211 detection And analyze the original music Η section 6 1308706, sound and/or intensity. The editing module 212 can then edit the original music 31 according to the detected and analyzed rhythm and/or intensity of the detection module 211, so that it becomes the edited music 32 (please refer to FIG. 4 for editing) The waveform diagram of the music 32 is output to the motion image synthesis module 24 for further processing. The motion picture database 22 includes at least one motion picture material 51 (refer to FIG. 5 for a schematic diagram of the motion picture material 51), and the motion picture material 51 includes a plurality of motion picture segments 52 (refer to FIG. 6 for the dynamics of the complex φ number). The motion image analysis module 23 can use the motion image analysis module 23 to construct a plurality of dynamic image segments 52 of different segments into a motion image 53 according to the degree of similarity of the image planes (refer to FIG. 8 for dynamics). The image 53 is schematic and output to the motion image synthesis module 24 for further processing. After receiving the edited music 32 from the sound analysis module 21 and the motion image 53 from the motion image analysis module 23, the motion image synthesis module 24 can combine the two to form a synthesized motion image. φ The present invention further provides a method for creating a motion picture of a motion picture using the above-described motion picture production system 10. Hereinafter, please refer to FIG. 2 to FIG. 8 together with respect to the motion picture producing method of the present invention. Please refer to FIG. 2 firstly for the flow of the method for creating a motion picture of the present invention. As shown in FIG. 2, the method of the present invention comprises the following steps: Step 201: Analyze the input original music 31. The waveform of the original music 31 is shown in Fig. 3. 3 is a waveform diagram of the original music 31 of the present invention. The present invention receives the original music 31 using the sound analysis module 21, and analyzes the original music 31. The performance of the music may include rhythm, melody, tune or 7 1308706 beat strength, etc., and a specific embodiment of the present invention is an example of analyzing the 'rhythm of the original music 31, but the invention is not limited thereto. • In general, if you want to find out the rhythm of the music, you must first find out the accent of the music. Most of the accent of the music occurs in the bass part, while the low part appears in the low frequency. Therefore, the detecting module 211 of the present invention first uses the low-pass filter to capture the low frequency of the original music 31, and then finds the accent, and the waveform of the original music 31 can be obtained, as shown in FIG. Step 202: Process the original music 31 into the edited music 32. The present invention uses the editing module 212 to first divide the waveform of the original music 31 into a plurality of sound frames according to a fixed time, such as the first sound frame 41, the second sound box 42, and the third sound box 43 in FIG. To edit the music, use the cut-out box to edit. For example, in the present embodiment, the second sound box 42 is deleted, and then the matching points of the music waveforms of the sound box in the first sound box 41 and the third sound box 43 are searched for. If necessary, the frame can be shifted for a short period of time, such as by shifting to a new third frame 44 to engage the waveform of the music to form the edited music 32. As shown in Fig. 4, Fig. 4 is a schematic diagram of a waveform of the edited music 32 of the present invention. Finally, the edited music 32 is output. In the music waveform of the present invention, if the maximum value of the waveform exceeds a set volume value, the time point that is exceeded is set as the beat point. Therefore, as shown in Fig. 4, there are a plurality of beat points 61 in the edited music 32, and in the plurality of beat points 61, the pitch between the beat points and the beat points is not the same. Step 203: Read the dynamic image material 51. As shown in the schematic view of the dynamic image material 51 of the present invention, the dynamic image material 51 is contained in the motion picture database 22. To create a motion picture, the plurality of motion picture material 51 in the motion picture library 22 is first read and then transmitted to the motion picture 8 1308706 analysis module 23 for step 204. On the other hand, in order to ensure the image of the final synthesized moving image, the dynamic image database 22 can store different types of dynamic image pixels 51 to match the rhythm of the original music 31. If the rhythm of the original music 31 is fast, the moving image material 51 with fast image changes is read; if the rhythm of the original music 31 is slow, the moving image material 51 with slow image changes is read. Step 204: Process the moving image material 51 into a motion image 53. That is, it is processed by the motion picture analysis module 23. Please refer to FIG. 6, which is a schematic diagram of a plurality of dynamic image segments 52 of the present invention. The motion picture material 51 can be divided into a plurality of motion picture segments 52, and the principle of segmentation is segmented according to the motion amplitude of the image planes in the dynamic image pixels 51. There is a complete unit action in each group segment of the plurality of dynamic image segments 52, and there can be at most one large motion variation range, so that the lengths of the various segments of the complex dynamic image segment 52 are inexhaustible. the same. The player selects a plurality of motion picture segments 52 that match the length of the beat 61 of the edited music 32 in accordance with the edited music 32 waveform. As shown in Fig. 7, Fig. 7 is a schematic diagram showing the connection of a plurality of dynamic image segments 52 of the present invention. In the embodiment, the plurality of motion picture segments 52 are divided into a motion picture start section 521, a first motion picture interval section 522, a second motion picture interval section 523, and a third motion picture interval section 524, and Connected according to the degree of similarity of image motion in the image plane of each motion picture segment. Finally, the motion picture 53 of Fig. 8 is output, and Fig. 8 is a schematic diagram of the motion picture 53 of the present invention. It should be noted that in the process of image editing, the plurality of dynamic images 9 Ι 3 Ό 8706 . - segment 52 may have a plurality of dynamic image segments of a length that can be separated from the complex beats 61 of the edited music 32 waveforms. Corresponding. And the connection relationship between the plurality of dynamic image segments 52 may not be one. If you arrange it from all possible combinations, it will make the statistic calculation of the tree too large. ', therefore, you must first select a section of a motion picture (such as the motion picture start section 521)' and then search for a section of another motion picture that can be similar in length to the interval of the plurality of beat points 61 (such as A dynamic image interval _ compartment 522). Then, according to the similarity degree of the image planes of the respective motion image segments, the possible connection paths are arranged, and the similarity of the image planes is preferentially arranged. If there is more than one large movement change in the image book in one of the possible connection paths, the path is deleted. Finally, a most suitable connection path is selected, and the segments of each of the dynamic images are connected to become a motion picture 53. Finally, step 205 is performed. The combined music 32 and the motion picture 53 are combined into a synthesized motion picture. The motion picture synthesis module 24 is used to arrange the time point of the combination with the motion picture 53 according to the rhythm of the edited music 32, and finally to form a synthesized motion picture. In addition, in the specific embodiment of the present invention, the present invention performs steps 201 and 202 first, and then steps 203 and 204 are performed. However, in practice, the present invention may also perform steps 203 and 204 before proceeding to step 201 and 202. Alternatively, the present invention may perform steps 203 and 204 while performing steps 201 and 202. Therefore, the scope of the patent application of the present invention is not limited to the order of the steps. Ι3Ό8706 \ In summary, the present invention, regardless of its purpose, means and efficacy, shows its characteristics different from the conventional technology, so please review the examination committee, - grant patents at an early date, 俾嘉惠社会,实感德Will. It is to be noted that the various embodiments described above are intended to be illustrative only, and the scope of the invention is intended to be limited by the scope of the appended claims. BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a schematic structural view of a motion picture production system of the present invention. 2 is a flow chart showing the steps of the method for producing a moving image of the present invention. Figure 3 is a waveform diagram of the original music of the present invention. 4 is a waveform diagram of the edited music of the present invention. Figure 5 is a schematic diagram of the motion picture material of the present invention. Figure 6 is a schematic illustration of a plurality of dynamic image segments of the present invention. Figure 7 is a schematic diagram of a plurality of dynamic image segment links of the present invention. φ Figure 8 is a schematic illustration of the motion picture of the present invention. [Description of Component Symbols] Motion Picture Production System 10 Sound Analysis Module 21 Motion Picture Library 22 Detection Module 211 Editing Module 212 1308706 Dynamic Image Analysis Module 23 " Motion Picture Synthesis Module 24 * Original Music 31 Edit Music 32 first sound box 41 second sound box 42 third sound box 43 new third sound box 44 * moving H image material 51 plural moving image segment 52 moving image starting segment 521 first moving image Interval section 522 Second motion picture interval section 523 Third motion picture interval section 524 Motion picture 53 # Complex number of beats 61