TWI513287B - Automatic media editing apparatus, editing method, broadcasting method and system for broadcasting the same - Google Patents

Automatic media editing apparatus, editing method, broadcasting method and system for broadcasting the same Download PDF

Info

Publication number
TWI513287B
TWI513287B TW100123541A TW100123541A TWI513287B TW I513287 B TWI513287 B TW I513287B TW 100123541 A TW100123541 A TW 100123541A TW 100123541 A TW100123541 A TW 100123541A TW I513287 B TWI513287 B TW I513287B
Authority
TW
Taiwan
Prior art keywords
feature
multimedia
media
content
request
Prior art date
Application number
TW100123541A
Other languages
Chinese (zh)
Other versions
TW201304519A (en
Inventor
Sih Ping Koh
Feng Shiuh Song
Sze Yao Ni
Bo Zhou Lin
Original Assignee
Gorilla Technology Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Gorilla Technology Inc filed Critical Gorilla Technology Inc
Priority to TW100123541A priority Critical patent/TWI513287B/en
Publication of TW201304519A publication Critical patent/TW201304519A/en
Application granted granted Critical
Publication of TWI513287B publication Critical patent/TWI513287B/en

Links

Landscapes

  • Television Signal Processing For Recording (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Description

媒體自動剪輯裝置、媒體自動剪輯方法、媒體播送方法與其播送系統Media automatic editing device, media automatic editing method, media broadcasting method and broadcasting system thereof

本揭露書提出一種媒體自動剪輯裝置、媒體自動剪輯方法、媒體播送方法與其播送系統,特別是利用剪輯或標記方法將符合媒體特徵而由不同區域擷取的影音文字片段經再製後播送的裝置與相關方法。The disclosure provides a media automatic editing device, a media automatic editing method, a media broadcasting method and a broadcasting system thereof, and particularly, a device for reproducing a video text segment captured by different regions according to a media feature by using a editing or marking method and Related methods.

利用電視機觀看節目的方式一般是透過有線電視或是無線電視將影像訊號傳遞至家中觀看,其中無線方式主要以電視台直接發送訊號,由架設於家中的天線直接收看;另一方式主要是由有線頻道業者透過連線於各用戶家中的電纜傳遞有線頻道訊號。The way to watch a program on a TV is usually to transmit the video signal to the home through cable TV or wireless TV. The wireless mode mainly uses the TV station to directly send the signal, and the antenna is directly viewed by the antenna installed in the home; the other way is mainly by cable. Channel operators transmit cable channel signals through cables that are connected to each user's home.

網際網路盛行與用戶端漸漸擁有較足夠的網路頻寬,開始有內容提供業者(content provider)透過網路架設網路電視頻道,用戶可以看到即時透過網路傳遞的電視節目,更可以以隨選視訊(video on demand,VOD)隨時隨地觀看所需的電視節目。The Internet prevails and the user gradually has more network bandwidth. Beginning with content providers to set up Internet TV channels through the Internet, users can see TV programs that are instantly transmitted through the Internet. Watch the TV shows you want, anytime, anywhere with video on demand (VOD).

在各式媒體資訊眾多的現代,利用上述網路方式遞送的媒體數量龐大,觀眾往往需要花費許多時間才能搜尋、整合與接收到所需要的內容,若需對既有媒體內容做摘要、剪接與再利用,只能使用人工方式,從內容擷取、剪輯、分類、群組化、再製成新的內容,此流程每一步驟均需要花費大量人力與時間完成。In the modern world where there is a large amount of media information, the amount of media delivered by the above-mentioned network method is huge, and viewers often need to spend a lot of time to search, integrate and receive the required content, if necessary, to summarize, splicing and Reuse can only be done manually, from content capture, editing, grouping, grouping, and re-creating new content. Each step of the process requires a lot of manpower and time to complete.

本揭露書提出一種媒體自動剪輯裝置、媒體自動剪輯方法、媒體播送方法與其播送系統,透過一種媒體自動剪輯的技術,根據媒體特徵比對的結果剪輯或是標記特定來源的媒體,經再製後形成新的多媒體片段,以提供使用者。其中特別是可由不同地區(如國家)取得的多媒體檔案,能夠快速有效地獲得需要的多媒體內容。The disclosure proposes a media automatic editing device, a media automatic editing method, a media broadcasting method and a broadcasting system thereof, which are formed by a media automatic editing technology, according to a result of media feature comparison, or marking a specific source of media, after being re-formed. New multimedia clips to provide users. In particular, multimedia files that can be obtained from different regions (such as countries) can quickly and efficiently obtain the required multimedia content.

根據揭露書所描述的實施例,媒體自動剪輯裝置中具有一個記載多樣媒體特徵的特徵資料庫,其中特徵值包括系統設定的,更可由使用者的喜好中學習更新資料庫。特徵資料庫記載的特徵值包括影像特徵、聲音特徵與文字特徵。According to the embodiment described in the disclosure, the media automatic editing device has a feature database for recording various media features, wherein the feature values include system settings, and the update database can be learned by the user's preferences. The feature values recorded in the feature database include image features, sound features, and text features.

媒體自動剪輯裝置包括可接收一或多個多媒體片段的內容擷取模組,再利用內容分類模組匯入特徵資料庫之特徵值並執行特徵比對,以分類所接收之多媒體片段。裝置中具有一個暫存多媒體片段的記憶體模組。The media automatic editing device includes a content capturing module that can receive one or more multimedia segments, and then uses the content classification module to import feature values of the feature database and perform feature comparison to classify the received multimedia segments. The device has a memory module that temporarily stores multimedia clips.

經特徵比對,裝置內的內容再製模組將根據某用戶端的請求取得對應之一或多個多媒體片段,請求所對應之特徵係為上述影像特徵、聲音特徵與文字特徵之一,或其組合。之後經再製後形成一新的多媒體片段,再由內容播送模組將對應請求之新的多媒體片段播送至發出請求之用戶端。After the feature comparison, the content re-modulation module in the device obtains one or more multimedia segments according to the request of a certain client, and the corresponding feature is requested to be one of the image features, the sound features and the text features, or a combination thereof. . After the re-production, a new multimedia segment is formed, and then the content-casting module broadcasts the corresponding new multimedia segment to the requesting client.

根據本揭露書媒體自動剪輯方法之實施例,步驟包括先擷取一或多個多媒體片段,接著匯入一或多個特徵值,同樣,特徵值包括影像特徵、聲音特徵與文字特徵。方法繼續執行媒體特徵分析,分析出多媒體片段之特徵,之後根據用戶端的請求比對符合請求所記載之特徵的一或多個多媒體片段,並暫存至一記憶體,記憶體暫存的內容包括原始接收或經篩選而分類的多媒體片段。再將符合請求之一或多個多媒體片段形成一新的多媒體片段。在特徵比對得出符合的一或多個多媒體片段之後,將以一剪輯或是標記方式再製為新的多媒體片段。According to an embodiment of the automatic media editing method of the disclosure, the steps include first capturing one or more multimedia segments, and then importing one or more feature values. Similarly, the feature values include image features, sound features, and text features. The method continues to perform media feature analysis, analyzes the characteristics of the multimedia segment, and then compares one or more multimedia segments that meet the characteristics of the request according to the request of the user terminal, and temporarily stores the data into a memory, and the temporary storage of the memory includes Multimedia clips that were originally received or filtered. Then, one or more multimedia segments that meet the request are formed into a new multimedia segment. After the feature comparisons result in one or more multimedia segments, the new multimedia segments will be re-created in a clip or markup manner.

本揭露書更提出一種媒體播送方法,特別是播送上述經特徵比對而再製的多媒體內容。根據實施例,先建立主伺服器與複數個設置不同地區的地區伺服器之連線,各地區伺服器擷取所處之地區的多媒體內容,對各片段進行分類與標記,之後主伺服器再根據設定的特徵,針對用戶端產生之請求,主伺服器輪詢各地區伺服器,以取得符合請求之多媒體內容的片段或標記。之後,主伺服器再製形成一新的多媒體內容,並播送多媒體內容至用戶端。The disclosure further proposes a media broadcast method, in particular, broadcasting the multimedia content reproduced by the feature comparison. According to an embodiment, a connection between a main server and a plurality of regional servers in different regions is first established, and each regional server captures multimedia content of the region in which it is located, classifies and marks each segment, and then the main server Based on the set characteristics, the primary server polls the regional servers for requests generated by the client to obtain segments or tags that conform to the requested multimedia content. After that, the main server re-forms a new multimedia content and broadcasts the multimedia content to the client.

而媒體播送系統實施例包括一主伺服器,為提供使用者管理功能、使用者登入介面、節目選單、收集熱門關鍵字功能,並接收一用戶端之請求,與複數個地區伺服器。The media broadcast system embodiment includes a main server for providing user management functions, a user login interface, a program menu, collecting popular keyword functions, and receiving a request from a client, and a plurality of regional servers.

複數個地區伺服器可設置於多個不同的區域,比如不同的國家,各地區伺服器擷取所在地區之多媒體內容,如測錄該地區的電視節目或是網路交換封包,能夠經分析後根據多媒體內容之特徵分類與標記,地區伺服器之間可交換分類與標記的記錄。Multiple regional servers can be set up in different regions, such as different countries. Each region's servers capture multimedia content in the region, such as recording TV programs or network exchange packets in the region, which can be analyzed. According to the characteristics of the multimedia content classification and marking, the regional server can exchange the records of classification and marking.

主伺服器可取得複數個地區伺服器之分類與標記的記錄,使之能夠根據用戶端之請求比對出對應之多媒體內容所在的地區伺服器,之後再連結用戶端與對應之地區伺服器。The main server can obtain the records of the classification and marking of the plurality of regional servers, so that the local server where the corresponding multimedia content is located can be compared according to the request of the user, and then the user terminal and the corresponding regional server are connected.

實施例之一的地區伺服器可包括媒體自動剪輯裝置,媒體自動剪輯裝置包括記載特徵值的特徵資料庫、接收多媒體內容的內容擷取模組、經比對特徵後分類多媒體內容的內容分類模組、記憶體模組、再製符合特徵比對的片段形成新的多媒體內容的內容再製模組,之後透過內容播送模組將對應請求之新的多媒體內容播送至用戶端。The regional server of one embodiment may include a media automatic editing device including a feature database for recording feature values, a content capture module for receiving multimedia content, and a content classification module for classifying multimedia content after comparing features. The group, the memory module, and the re-made feature matching segment form a new multimedia content content re-modulation module, and then the corresponding multimedia content is broadcasted to the user end through the content broadcast module.

本揭露書提出一種媒體自動剪輯裝置、媒體自動剪輯方法、媒體播送方法與其播送系統,針對內容剪輯、摘要與再製之完整流程提出自動化之解決方案,可針對不同內容來源作自動擷取與轉檔,以檔案實體或虛擬方式剪輯所需內容與去除不需要片段,自動分類與群組化,進而將組合完成之片段重製成新的內容。因此內容匯集與製作者可以最低人力成本將龐大的內容作整理與再利用,提供給觀眾。觀眾不需要從龐大的來源尋找內容,而可在短時間以精華與摘要的方式瀏覽到所有需要的內容。The disclosure proposes a media automatic editing device, a media automatic editing method, a media broadcasting method and a broadcasting system thereof, and an automated solution for the complete process of content editing, summarization and re-production, which can automatically capture and convert for different content sources. Editing the desired content in a file entity or virtual mode and removing unwanted segments, automatically sorting and grouping, and then recomposing the combined segments into new content. Therefore, the content collection and producers can organize and reuse the huge content at the lowest labor cost and provide it to the audience. Viewers don't need to look for content from a huge source, but can browse through all the content they need in a short time with the essence and abstract.

本揭露書所描述的媒體自動剪輯技術可參考圖1所示的示意圖。執行此媒體自動剪輯的裝置從各種媒體來源取得原始多媒體片段101,將經過影像特徵、聲音特徵或/與文字特徵的特徵條件103篩選,利用剪輯的方式將符合特徵條件的片段剪錄下來,或是標記(如利用片段的時間戳記)符合特徵比對的片段,以圖中的剪輯或標記片段105表示,之後再製形成一個新的多媒體片段107,這新的多媒體片段107即為最後播送至各用戶端的影片。特別的是,媒體來源可以為多種型式,包括利用網路傳遞的多媒體內容、利用視頻網路傳遞的電視節目等,本發明利用媒體自動剪輯的技術可以持續不斷地擷取新的多媒體片段、自動篩選、再製為新的多媒體片段,藉此提供用戶端持續不斷的多媒體內容。The media automatic editing technique described in the disclosure may refer to the schematic diagram shown in FIG. 1. The device performing the automatic editing of the media obtains the original multimedia segment 101 from various media sources, and filters the feature conditions 103 of the image feature, the sound feature or/and the character feature, and clips the segment that meets the feature condition by using the editing method, or Is a mark (such as using the time stamp of the clip) that matches the feature alignment, is represented by a clip or mark segment 105 in the figure, and then forms a new multimedia clip 107, which is the last broadcast to each User-side movie. In particular, the media source can be of various types, including multimedia content transmitted by using a network, television programs transmitted by using a video network, etc. The present invention utilizes the technology of automatic media editing to continuously capture new multimedia segments and automatically Filtering and re-creating into new multimedia clips to provide continuous multimedia content on the client side.

媒體自動剪輯的裝置可參考圖2所示之媒體自動剪輯裝置之實施例方塊示意圖。For the device for automatic media editing, reference may be made to the block diagram of the embodiment of the media automatic editing device shown in FIG. 2.

圖中顯示的媒體自動剪輯裝置20包括有輸入多媒體內容的多媒體輸入與經過剪輯後輸出的多媒體輸出,根據實施例,媒體自動剪輯裝置20可以根據用戶端輸入的需求形成相應的多媒體內容,如圖示右方的需求輸入。The media automatic editing device 20 shown in the figure includes a multimedia input for inputting multimedia content and a multimedia output output after being edited. According to an embodiment, the media automatic editing device 20 can form corresponding multimedia content according to the input of the user terminal, as shown in the figure. Show the demand input on the right.

裝置20內的內容擷取模組201用於取得由外部接收的多媒體片段,包括影、音與文字,或其組合,多媒體片段之來源至少包括影像、視訊、聲音檔案、電視頻道、網路串流以及攝影機。記憶體模組207則用來儲存這些多媒體片段,或是用於暫存處理中的媒體訊號。內容分類模組203則接著取得經內容擷取模組201接收的多媒體片段,先經分析取得多媒體片段的特徵,再根據從特徵資料庫205得到的各樣特徵值,內容分類模組203接著比對多媒體片段與特徵值,予以分類。The content capturing module 201 in the device 20 is configured to obtain multimedia segments received by the external, including video, audio and text, or a combination thereof. The source of the multimedia segment includes at least an image, a video, a voice file, a TV channel, and a network string. Stream and camera. The memory module 207 is used to store these multimedia segments or for media signals in the temporary processing. The content classification module 203 then obtains the multimedia segments received by the content capture module 201, and first obtains the features of the multimedia segments through analysis, and then according to the various feature values obtained from the feature database 205, the content classification module 203 then compares Classify multimedia clips and feature values.

上述特徵資料庫205中記載一或多個特徵值,媒體自動剪輯裝置20將根據這些特徵值處理各樣的多媒體內容,特徵值主要有包括影像特徵、聲音特徵與文字特徵。記載於特徵資料庫205的特徵值可被更新,而用於取得多媒體內容的特徵值則可建制於特徵資料庫205內,更可收集由用戶端產生的特徵描述。由用戶端產生的請求可包括影像特徵、聲音特徵與文字特徵之一,或其組合。The feature database 205 records one or more feature values, and the media automatic editing device 20 processes various multimedia content according to the feature values. The feature values mainly include image features, sound features, and character features. The feature values recorded in the feature database 205 can be updated, and the feature values used to obtain the multimedia content can be built in the feature database 205, and the feature description generated by the client can be collected. The request generated by the client may include one of an image feature, a sound feature, and a text feature, or a combination thereof.

根據實施例,影像特徵可為媒體片段中各幀之影像顏色分佈,當多媒體影像中的多個幀(frame)符合一特定影像顏色分佈,則可將相關片段歸類為一種內容,甚至將有關的部份標記或是剪輯出來。舉例來說,在一足球比賽中,畫面有一定的大比例是草綠色,若事後要排除掉進入廣告的片段,則可將草綠色所佔比例小於一門檻值的連續幾個幀刪除,則會留下足球比賽的內容。此例中,多媒體影像中的特徵值可再包括一時間資訊,要取得的多媒體片段可能是在特定節目時段進行播放,因此時間參數為可以提供更準確得到所需內容的參數。According to an embodiment, the image feature may be an image color distribution of each frame in the media segment. When multiple frames in the multimedia image conform to a specific image color distribution, the related segment may be classified into a content, or even related. Part of the mark or clip it out. For example, in a football game, a certain proportion of the picture is grass green. If you want to exclude the segments that enter the advertisement afterwards, you can delete the consecutive frames of grass green that are less than a threshold. Will leave the content of the football match. In this example, the feature value in the multimedia image may further include a time information, and the multimedia segment to be obtained may be played during a specific program time period, so the time parameter is a parameter that can provide more accurate content to obtain the desired content.

再一實施例中,聲音特徵可為聲音波形、振幅與頻率變化,根據特定內容的聲音波形與振幅的樣本,經分析可以得到符合這些樣本的多媒體內容。舉例來說,音樂節目通常具有一定範圍的音量與頻率變化,進入廣告後則通常有較高的音頻,而且頻率變化較不規則,因此聲音波形、振幅與頻率可以作為有效篩選多媒體片段的根據。同樣,此類特徵值將可搭配時間資訊,在準確的時間內取得用戶端有興趣的內容。In still another embodiment, the sound characteristics may be sound waveforms, amplitudes, and frequency changes. According to samples of sound waveforms and amplitudes of specific content, multimedia content conforming to the samples may be obtained by analysis. For example, music programs usually have a range of volume and frequency changes. After entering an advertisement, they usually have higher audio, and the frequency changes are less irregular. Therefore, the sound waveform, amplitude and frequency can be used as a basis for effectively screening multimedia segments. Similarly, such feature values will be matched with time information to obtain content of interest to the client in an accurate time.

再根據另一實施例,特徵值可為文字特徵,若多媒體片段具有字幕或是文字說明,利用關鍵字,可以取得符合特徵的多媒體片段。同樣也可搭配時間資訊的特徵值作為篩選的參數。According to another embodiment, the feature value may be a character feature. If the multimedia segment has a caption or a caption, the keyword may be used to obtain a multimedia segment that conforms to the feature. It is also possible to use the feature value of the time information as a parameter for screening.

經比對特徵值對多媒體片段分類後,對應各端用戶請求的特徵,媒體自動剪輯裝置20中的內容再製模組209經輸入模組211取得請求,即對應請求取得對應之一或多個多媒體片段,經再製後形成一新的多媒體片段。After the multimedia segments are classified by the matching feature values, the content re-manufacturing module 209 in the media automatic editing device 20 obtains the request through the input module 211, that is, corresponding to the request to obtain one or more multimedia corresponding to the features requested by the end users. The fragment is reconstructed to form a new multimedia segment.

之後由裝置20內容播送模組213將對應請求之新的多媒體片段播送至發出請求之用戶端。Then, the device 20 content broadcast module 213 broadcasts the corresponding requested new multimedia segment to the requesting client.

根據揭露書所描述的媒體自動剪輯裝置20的實施例之一,此媒體自動剪輯裝置20可連接於電視播放裝置上,比如機上盒、視頻轉換裝置等,裝置20之內容擷取模組201如一個影像擷取裝置,連接於電視播放的相關裝置上,利用軟體或是硬體電路的手段自動側錄取得數位影像檔,並轉檔為所需格式。According to one embodiment of the media automatic editing device 20 described in the disclosure, the media automatic editing device 20 can be connected to a television playing device, such as a set-top box, a video conversion device, etc., and the content capturing module 201 of the device 20 For example, an image capturing device is connected to a related device for television broadcasting, and automatically captures a digital image file by means of a software or a hardware circuit, and converts the image into a desired format.

在接著比對多媒體片段特徵時,執行自動內容剪輯與分類時,其中引用的技術包括中華民國專利第I319179號(申請號:095133800;申請日:2006/09/13)所揭露的利用音訊辨別場景之演算法、或中華民國專利公開第201018198號揭露影片字幕辨識方法(申請號:097140019;申請日:2008/10/17)。之後,經特徵辨識與剪輯後,將每個節目內容分為標記為數個片段或實際儲存為數個影音檔案,可同時去除廣告部分。上述每個片段在產生時即可以節目表、字幕與語音內容辨識建立相關標籤,因此儲存時可自動進行分類與群組化。In the case of performing automatic content editing and categorization when the multimedia clip features are subsequently compared, the techniques cited therein include the use of audio discrimination scenes disclosed in the Republic of China Patent No. I319179 (Application No.: 095133800; Application Date: 2006/09/13). The algorithm, or the Republic of China Patent Publication No. 201018198, discloses a film subtitle identification method (application number: 097140019; application date: 2008/10/17). After the feature recognition and editing, each program content is divided into several segments or actually stored as several audio and video files, and the advertising portion can be simultaneously removed. Each of the above segments can be associated with the program list, subtitles and voice content recognition when generated, so that classification and grouping can be automatically performed when storing.

最後在節目摘要重製時,可根據特徵資料庫205中的特徵值、分類、日期時間等參數,以及用戶端的屬性資料等,自動將數個相關片段以序列編排方式帶入含有片頭片尾的樣版庫,或編排成多分割畫面的版面,產出新的影片內容,再傳遞給收視用戶端。Finally, in the program summary re-creation, according to the feature value, classification, date and time parameters in the feature database 205, and the attribute data of the user end, a plurality of related segments are automatically brought into the slice-containing end by the sequence arrangement. The library, or layout into a multi-split screen, produces new video content, which is then passed to the viewing client.

[媒體自動剪輯實施例之一]應用上述媒體自動剪輯裝置的媒體自動剪輯方法實施例可參閱圖3所描述的流程圖。[One of the media automatic editing embodiments] The embodiment of the media automatic editing method applying the above-described media automatic editing device can refer to the flowchart described in FIG.

流程一開始,如步驟S301,媒體自動剪輯裝置透過內容擷取模組取得擷取一或多個多媒體片段,並接著匯入由特徵資料庫或是根據用戶屬性、搜尋關鍵字所整合產生的特徵值(步驟S303),匯入的特徵值如影(31)、音(32)、文字(33)或其組合。At the beginning of the process, in step S301, the media automatic editing device obtains one or more multimedia segments through the content capturing module, and then imports the features generated by the feature database or integrated according to the user attributes and the search keywords. The value (step S303), the imported feature values such as shadow (31), sound (32), text (33), or a combination thereof.

經媒體自動剪輯裝置內軟體或是硬體實現的手段進行所擷取的媒體特徵分析(步驟S305),取得各多媒體片段中的特徵,比如影片中各幀的顏色分佈、亮度等特徵,聲音中的波形、振幅與頻率變化,或是其中文字的關鍵字特徵。Performing media feature analysis by means of software or hardware implemented in the media automatic editing device (step S305), obtaining features in each multimedia segment, such as color distribution and brightness of each frame in the movie, in the sound Waveform, amplitude and frequency changes, or keyword characteristics of the text.

接著如步驟S307,對於各用戶端產生的需求進行比對,由用戶端的請求訊息中可以記載有相對應的特徵值,經比對後產生符合該請求所記載之特徵的一或多個多媒體片段。Then, in step S307, the requirements generated by the UEs are compared, and the corresponding feature values may be recorded in the request message of the UE, and the one or more multimedia segments that meet the features described in the request are generated after the comparison. .

之後將比對出的多媒體片段暫存在記憶體中(步驟S309),以提供之後裝置針對需要的片段剪輯(步驟S311),經剪輯的片段將暫存於記憶體中(步驟S313),之後再製形成另一個多媒體片段(步驟S315),剪輯過程中可引入一校正手段(步驟S319),核對是否符合用戶端的需求,再進行播送(步驟S317)。Then, the compared multimedia clips are temporarily stored in the memory (step S309) to provide the clips for the desired clips (step S311), and the clips are temporarily stored in the memory (step S313), and then reproduced. Another multimedia segment is formed (step S315), and a correction means (step S319) can be introduced during the editing process to check whether the user's needs are met and then broadcast (step S317).

上述經剪輯的多媒體片段可以是排除掉不需要內容的媒體內容,並對應用戶端所需的內容。比如,用戶端提出的請求是一個足球比賽,經影像(如顏色)、聲音(如播報的波形、振幅與頻率變化)、文字特徵(相關播報內容的字幕)與時間(播報時間)比對後,將符合特徵的片段剪輯出來,取得複數個與足球相關的片段,之後再經組合後形成新的多媒體片段。The clipped multimedia clip may be a media content that excludes unnecessary content and corresponds to content required by the client. For example, the request made by the client is a football match, after the image (such as color), sound (such as the waveform of the broadcast, amplitude and frequency changes), text features (subtitles of the related broadcast content) and time (posting time) are compared. The clips that match the feature are clipped out to obtain a plurality of clips related to the football, and then combined to form a new multimedia clip.

根據本揭露書所提出的媒體自動剪輯方法,經特徵比對後,可以如上述圖3的剪輯方式將對應的多媒體片段剪輯出來,擷取出符合該請求之一或多個多媒體片段,經結合再製為新的多媒體片段。According to the media automatic editing method proposed by the disclosure, after the feature comparison, the corresponding multimedia segment can be edited as in the above-mentioned editing mode of FIG. 3, and one or more multimedia segments conforming to the request are extracted and combined. For new multimedia clips.

根據另一實施例,可以不用將符合特徵的片段剪輯出來,而是利用一種標記方式,將符合請求的一或多個多媒體片段予以標記,記載其中時間戳記,於之後再製時即將各標記之片段結合起來形成新的多媒體片段。According to another embodiment, instead of clipping the segments that match the feature, one or more multimedia segments that meet the request may be marked by a tagging method, and the timestamps are recorded, and the segments of the tags are to be recorded later. Combine to form new multimedia clips.

[媒體自動剪輯實施例之二]可參閱圖4所示之媒體自動剪輯方法實施例之二流程圖。[Second Media Automatic Clipping Embodiment 2] Referring to the flowchart of the second embodiment of the media automatic editing method shown in FIG.

開始如步驟S401,透過媒體自動剪輯裝置揭露擷取多媒體內容,並接著匯入包括影(41)、音(42)或文字(43),或其組合的特徵值(步驟S403),包括建制於特徵資料庫的特徵值,亦包括由各用戶端屬性與使用上收集的特徵資訊。Beginning in step S401, the multimedia content is revealed by the media automatic editing device, and then the feature value including the shadow (41), the sound (42) or the text (43), or a combination thereof is imported (step S403), including The feature value of the feature database also includes the feature information collected by each client attribute and usage.

接著執行媒體特徵分析(步驟S405),將所擷取的多媒體片段的特徵,並與上述匯入的特徵值進行比對,取得符合特定用戶端所發出的需求的多媒體片段(步驟S407)。Then, the media feature analysis is performed (step S405), and the captured feature of the multimedia segment is compared with the imported feature value to obtain a multimedia segment that meets the requirements issued by the specific client (step S407).

此例中,並非擷取所需片段,而是對符合特徵的多媒體片段予以標記(步驟S409),比如是符合的片段的時間戳記,並記載於記憶體中,之後再將同類的標記片段結合起來(步驟S411),才將對應的多媒體片段組合而暫存在記憶體中(步驟S413)。其中同樣可以透過校正程序確認內容(步驟S417)。最後再將組合後的新的多媒體片段播送至發出請求的用戶端(步驟S415)。In this example, instead of capturing the desired segment, the multimedia segment matching the feature is marked (step S409), such as the time stamp of the matching segment, and is recorded in the memory, and then the same type of marker segment is combined. When it is up (step S411), the corresponding multimedia segments are combined and temporarily stored in the memory (step S413). The content can also be confirmed by the correction program (step S417). Finally, the combined new multimedia clip is broadcast to the requesting client (step S415).

根據本揭露書的實施例,上述描述的媒體自動剪輯裝置與方法特別可以應用於一種如圖5所示之媒體播送系統上。圖5顯示的實施例描述一種包括主伺服器503、多個地區伺服器(51,52,53)與使用者端裝置501形成的播送系統,各端可以一網際網路50相互連接。According to an embodiment of the present disclosure, the media automatic editing apparatus and method described above are particularly applicable to a media distribution system as shown in FIG. The embodiment shown in FIG. 5 describes a broadcast system including a main server 503, a plurality of regional servers (51, 52, 53) and a client device 501, each of which can be interconnected by an internet 50.

根據圖5顯示的實施例,具有多個設置於各地的地區伺服器,如圖示的設置於地區一511的第一伺服器51、設置於地區二512的第二伺服器52與設置於地區三513的第三伺服器53,主伺服器503與各地區的地區伺服器(51,52,53)形成一個雲端架構的媒體播送系統。複數個地區伺服器透過網際網路50連結於主伺服器503,並能相互交換資訊與相互備援。主伺服器503能夠提供使用者管理功能、使用者登入介面、節目選單、收集熱門關鍵字功能,並接收一用戶端之請求。According to the embodiment shown in FIG. 5, there are a plurality of regional servers installed in various places, such as the first server 51 disposed in the area 511, the second server 52 disposed in the area 512, and the area server. The third server 53 of the third 513, the main server 503 and the regional servers (51, 52, 53) of each region form a cloud-based media broadcast system. A plurality of regional servers are connected to the main server 503 via the Internet 50, and can exchange information and support each other. The main server 503 can provide user management functions, a user login interface, a program menu, collect popular keyword functions, and receive a request from a client.

上述設於各地的地區伺服器建立一個雲端運作的多媒體系統,藉由主伺服器提供用戶端多媒體下載服務。主伺服器與複數個地區伺服器之間為一個主從(master-slave)架構的系統,而且,主伺服器的角色可由複數個地區伺服器中之一所擔任,負責多媒體檔案屬性、權限的管理與儲存,並可包括用戶端使用者管理與付費機制的管理。複數個地區伺服器則可能由數以百計的網路節點形成,多媒體資料將可以多個區塊(block)儲存在不同的節點之上,能夠互相備援與達到分散處理的目的。The above-mentioned local area server establishes a cloud-operated multimedia system, and provides a client-side multimedia download service by the main server. The master server and a plurality of regional servers are a master-slave architecture system, and the role of the master server can be performed by one of a plurality of regional servers, which is responsible for multimedia file attributes and permissions. Management and storage, and can include management of user-side user management and payment mechanisms. Multiple regional servers may be formed by hundreds of network nodes. Multimedia data can be stored in multiple blocks on different nodes, and can be mutually redundant and distributed.

經各地區伺服器擷取與處理當地的多媒體片段之後,將整合儲存在一個多媒體伺服器(未顯示)中,此通常可為一關聯式資料庫(relational database),每一筆資料都有時間戳記,因此能夠快速地透過標記取得相關的多媒體片段。After the local media segments capture and process the local multimedia clips, the integration is stored in a multimedia server (not shown), which can usually be a relational database, each of which has a time stamp. Therefore, it is possible to quickly obtain related multimedia clips through the mark.

在實施例之一中,各地區伺服器將使用擷取所在地區之多媒體內容,比如利用側錄的方式將該地區的電視頻道、網路媒體內容擷取下來,再根據其中多媒體內容之特徵分類與標記,而且,不同地區的地區伺服器之間也可以交換分類與標記的記錄。In one of the embodiments, the regional server will use the multimedia content in the region, for example, using the side recording method to extract the TV channel and the network media content of the region, and then classify the multimedia content according to the characteristics of the multimedia content. With the mark, and the regional servers in different regions can also exchange records of classifications and marks.

在此媒體播送系統中,使用者端裝置501可經由主伺服器503提供的使用者登入介面登入系統,透過其中介面與選單,可以選擇所需的多媒體內容,比如是特定運動項目、特定國家的媒體內容、自己的興趣,經由介面產生的請求將載入符合特定需求的多樣特徵值,主伺服器503或各地區伺服器接著利用上述媒體自動剪輯方法與包括特徵資料庫、內容擷取模組、內容分類模組、內容再製模組與內容播送模組的媒體自動剪輯裝置,匯入特徵值,比對符合特徵值的多媒體片段,包括影、音、文字或其組合。In the media distribution system, the user terminal device 501 can log in to the system through the user login interface provided by the main server 503, and through the interface and the menu, the desired multimedia content can be selected, for example, a specific sport, a specific country. The media content, the self-interest, and the request generated via the interface will load various feature values that meet the specific requirements, and the main server 503 or the regional server then uses the media automatic editing method and the feature database and the content capture module. The media automatic editing device of the content classification module, the content re-creation module and the content broadcast module, import feature values, and compare the multimedia segments that meet the feature values, including shadows, sounds, characters or a combination thereof.

媒體播送系統中,主伺服器503連結著設置於各地區、各國家的地區伺服器,各個地區伺服器將持續著側錄當地的多媒體內容,包括該地的電視頻道與網路,而且複數個地區伺服器(51,52,53)也透過網際網路50相互連線,並互為備援。In the media distribution system, the main server 503 is connected to regional servers installed in various regions and countries, and each regional server will continue to record local multimedia content, including the TV channels and networks in the area, and a plurality of The regional servers (51, 52, 53) are also interconnected via the Internet 50 and are mutually redundant.

主伺服器503將透過網路取得複數個地區伺服器(51,52,53)之分類與標記的記錄,當接收到用戶端(使用者端裝置501)請求後,請求同樣可以對應出影像特徵、聲音特徵與/或文字特徵,並可包括特定時間資訊,再根據使用者端裝置501之請求比對出對應之多媒體內容所在的地區伺服器,連結使用者端裝置501與對應之地區伺服器,讓使用者端裝置501直接透過網際網路50載入經過再製的多媒體片段。The main server 503 will obtain the records of the classification and marking of the plurality of regional servers (51, 52, 53) through the network. When receiving the request from the user terminal (the user terminal device 501), the request can also correspond to the image features. And the sound feature and/or the character feature, and may include the specific time information, and then the user server 501 and the corresponding regional server are connected according to the request of the user device 501 to compare the regional server where the corresponding multimedia content is located. The user device 501 directly loads the reworked multimedia segments through the Internet 50.

藉此,媒體播送系統可以取得龐大的影音文字內容,用戶端可以透過網路取得所需的多媒體片段,而且是經過特徵比對與篩選的內容。In this way, the media broadcast system can obtain a large amount of audio and video content, and the user can obtain the required multimedia clips through the network, and the content is compared and filtered by the features.

圖6則接著描述應用於上述媒體播送系統之節目表產生方法流程。媒體播送系統經各地區伺服器自動取得所在區域的多媒體片段,並予以分類、標記與自動剪輯後,形成一個節目表,可供各用戶端選擇,節目表的產生可參考圖6的流程描述。Fig. 6 is next a flow chart showing a method of generating a program table applied to the above-described media distribution system. The media broadcast system automatically obtains the multimedia clips of the local area by the local area server, and classifies, marks and automatically edits them to form a program list, which can be selected by each user terminal. The generation of the program list can be described with reference to the flow chart of FIG. 6.

開始步驟如S601,各地區伺服器擷取該地區多媒體內容,透過媒體自動剪輯技術,進行分類與標記,並且,各伺服器可交換分類標記(步驟S603),以此建構一個龐大與內容豐富的媒體播送系統。The first step is as follows: S601, the regional server captures the multimedia content of the region, and performs classification and labeling through the media automatic editing technology, and each server can exchange the classification mark (step S603), thereby constructing a large and content-rich Media broadcast system.

各地區伺服器將透過網路傳送分類標記至主伺服器(步驟S605),主伺服器將接著匯入用戶端常用分類標記(步驟S607),藉此對應出擷取到的多媒體內容與用戶端需求,產生一節目表(步驟S609),這個節目表即提供傳送至用戶端(步驟S611)。The regional server will transmit the classification mark to the main server through the network (step S605), and the main server will then import the common classification mark of the user end (step S607), thereby correspondingly capturing the captured multimedia content and the client end. At the request, a program list is generated (step S609), and the program list is provided for transmission to the client (step S611).

上述媒體播送系統引用了如圖7所述之媒體播送方法實施例流程。The above media broadcast system refers to the flow of the embodiment of the media broadcast method as described in FIG.

步驟首先建立一主伺服器與複數個設置不同地區的地區伺服器之連線,再如步驟S701,各地區伺服器擷取所處的地區的多媒體內容,包括電視節目、網路媒體內容等,甚至包括類比、數位廣播、各樣網路上傳播的影音文字資訊等,經彙整,可以建立一個多樣性的媒體資料庫。The first step is to establish a connection between a main server and a plurality of regional servers in different regions, and then, in step S701, each regional server captures multimedia content of the region, including television programs and network media contents. It even includes analogies, digital broadcasts, audio and video information disseminated on various networks, etc. Through the integration, a diverse media database can be established.

再如步驟S703,各地區伺服器將根據設定的特徵執行分類與標記所擷取的多媒體內容,其中自動分類所接收的多媒體片段包括由系統提供的預設條件(71),亦參考各地用戶端屬性或其常用內容所產生的常用條件(72)。Further, in step S703, each regional server performs classification and marking of the captured multimedia content according to the set features, wherein the automatically segmented multimedia segments include preset conditions provided by the system (71), and also refer to local users. Common conditions generated by attributes or their common content (72).

在步驟S705中,各地區伺服器將執行自動媒體內容剪輯或標記,可參考上述圖3,4之描述,將符合各樣特徵的多媒體片段剪輯而儲存,或是標記出符合的多媒體片段,並記錄形成資料庫。In step S705, each regional server will perform automatic media content editing or marking. Referring to the descriptions of FIG. 3 and FIG. 4 above, the multimedia clips matching various features may be clipped or marked, or the corresponding multimedia segments may be marked. Records form a database.

當主伺服器接收到用戶端的請求訊號(步驟S707),主伺服器取得請求所記載的特徵與需求,將接著輪詢各地區伺服器(步驟S709),比對所需內容所在的地區伺服器,並由各地區伺服器取得符合請求訊號之多媒體內容的片段或標記(步驟S711),由主伺服器重新編排影音文字內容再製形成一新的多媒體內容(步驟S713),並播送內容至發出請求的用戶端(步驟S715)。When the primary server receives the request signal from the client (step S707), the primary server obtains the features and requirements recorded in the request, and then polls the regional servers (step S709), and compares the regional server where the desired content is located. And obtaining, by each regional server, a segment or mark of the multimedia content that meets the request signal (step S711), and the main server re-arranges the video text content to form a new multimedia content (step S713), and broadcasts the content to issue a request. User terminal (step S715).

圖8則顯示本揭露書所提之用戶端、主伺服器與多個地區伺服器間的媒體播送流程。FIG. 8 shows the media broadcast process between the client, the main server and multiple regional servers mentioned in the disclosure.

設置於不同地區的地區伺服器將隨時擷取到該地區的多媒體內容,並針對特徵進行分類與標記,而各地區伺服器(如圖示的第一伺服器與第二伺服器)之間亦能彼此交換這些分類與標記資訊(步驟801,802),第一伺服器與第二伺服器並分別將這些資訊傳送給主伺服器(步驟803,804)。Regional servers set up in different regions will capture the multimedia content of the region at any time, and classify and mark the features, and the regional servers (such as the first server and the second server shown) These classification and tag information can be exchanged with each other (steps 801, 802), and the first server and the second server respectively transmit the information to the host server (steps 803, 804).

經由主伺服器整合各地區的多媒體內容之資訊後,可如圖6描述的內容,建立一個提供給用戶端的節目表或是利用網路介面提供的選單。After integrating the information of the multimedia content of each region via the main server, a program list provided to the client or a menu provided by the network interface may be established as described in FIG. 6.

其中用戶端可以各樣型式的多媒體播放器、通訊裝置或是電腦系統產生請求(步驟805),發送給主伺服器。接著主伺服器比對此請求所載之特徵資料,並對各地區伺服器發送請求訊息,如步驟806,807,分別將請求訊息傳送至第一伺服器與第二伺服器。再由第一伺服器與第二伺服器分別回應訊息(步驟808,809)。The client can generate a request (step 805) to each type of multimedia player, communication device or computer system, and send it to the host server. Then, the main server sends a request message to the regional server than the feature data contained in the request, and sends a request message to the first server and the second server respectively according to steps 806 and 807. The first server and the second server respectively respond to the message (steps 808, 809).

這些由第一伺服器與第二伺服器回應的訊息包括是否有符合用戶端請求的內容,主伺服器再回應給用戶端(步驟810),並由主伺服器媒合具有符合請求的特定地區伺服器,用戶端接著確認由該地區伺服器(此例為第一伺服器)可以傳送內容(步驟811),再由該地區伺服器傳送經再製的多媒體片段(步驟812)。The messages replied by the first server and the second server include whether there is content that meets the request of the client, and the host server responds to the client again (step 810), and the host server mediates the specific region that meets the request. The server, the client then confirms that the local server (in this case the first server) can transfer the content (step 811), and the re-made multimedia segment is transmitted by the regional server (step 812).

綜上所述,本揭露書提出的自動剪輯方法與媒體播送的技術特別是應用媒體內容自動摘要、重製與再利用的流程,可讓使用者以減少人力成本的方式,擷取、剪輯與整理現有的大量媒體內容,有效提供用戶端可以取得所需的多媒體內容。In summary, the automatic editing method and media broadcast technology proposed by the present disclosure, in particular, the process of automatically summarizing, re-manufacturing and reusing the media content, allows the user to capture, edit and edit in a manner that reduces labor costs. Organize a large amount of existing media content, and effectively provide the multimedia content that the user can obtain.

惟以上所述僅為本發明之較佳可行實施例,非因此即侷限本發明之專利範圍,故舉凡運用本發明說明書及圖示內容所為之等效結構變化,均同理包含於本發明之範圍內,合予陳明。However, the above description is only a preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Therefore, equivalent structural changes that are made by using the specification and the contents of the present invention are equally included in the present invention. Within the scope, it is combined with Chen Ming.

101...原始多媒體片段101. . . Original multimedia clip

103...特徵條件103. . . Characteristic condition

105...剪輯或標記片段105. . . Clip or mark a clip

107...新的多媒體片段107. . . New multimedia clip

20...媒體自動剪輯裝置20. . . Media automatic editing device

201...內容擷取模組201. . . Content capture module

203...內容分類模組203. . . Content classification module

205...特徵資料庫205. . . Feature database

207...記憶體模組207. . . Memory module

209...內容再製模組209. . . Content remanufacturing module

211...輸入模組211. . . Input module

213...內容播送模組213. . . Content delivery module

31,41...影31,41. . . Shadow

32,42...音32,42. . . sound

33,43...文字33,43. . . Text

50...網際網路50. . . Internet

501...使用者端裝置501. . . User terminal device

503...主伺服器503. . . Master server

511...地區一511. . . Area one

512...地區二512. . . District II

513...地區三513. . . Area three

51...第一伺服器51. . . First server

52...第二伺服器52. . . Second server

53...第三伺服器53. . . Third server

71...預設條件71. . . Preset condition

72...常用條件72. . . Common conditions

步驟S301~S319 媒體自動剪輯流程之一Steps S301 to S319 One of the media automatic editing processes

步驟S401~S417 媒體自動剪輯流程之二Step S401~S417 Media automatic editing process 2

步驟S601~S611 節目表產生流程Step S601 to S611 program list generation process

步驟S701~S715 媒體播送流程之一Steps S701 to S715 One of the media broadcast processes

步驟801~812 媒體播送流程之二Steps 801-812 Second of the media broadcast process

圖1顯示本發明媒體自動剪輯之實施例示意圖;1 is a schematic view showing an embodiment of automatic media editing of the present invention;

圖2顯示為本發明媒體自動剪輯裝置之實施例方塊示意圖;2 is a block diagram showing an embodiment of a media automatic editing device of the present invention;

圖3顯示為本發明媒體自動剪輯方法實施例之一流程圖;3 is a flow chart showing an embodiment of a method for automatically editing a medium according to the present invention;

圖4顯示為本發明媒體自動剪輯方法實施例之二流程圖;4 is a flow chart showing the second embodiment of the automatic media editing method of the present invention;

圖5所示為本發明媒體播送系統實施例示意圖;FIG. 5 is a schematic diagram of an embodiment of a media broadcast system according to the present invention; FIG.

圖6所示為應用於本發明媒體播送系統之節目表產生方法流程;6 is a flow chart showing a method for generating a program table applied to the media broadcast system of the present invention;

圖7所述為本發明媒體播送方法實施例流程之一;FIG. 7 is a flowchart of an embodiment of a media broadcast method according to the present invention;

圖8所述為本發明媒體播送方法實施例流程之二。FIG. 8 is a second flowchart of an embodiment of a media broadcast method according to the present invention.

20...媒體自動剪輯裝置20. . . Media automatic editing device

201...內容擷取模組201. . . Content capture module

203...內容分類模組203. . . Content classification module

205...特徵資料庫205. . . Feature database

207...記憶體模組207. . . Memory module

209...內容再製模組209. . . Content remanufacturing module

211...輸入模組211. . . Input module

213...內容播送模組213. . . Content delivery module

Claims (38)

一種媒體自動剪輯裝置,包括:一特徵資料庫,係記載一或多個特徵值;一內容擷取模組,接收一或多個多媒體片段;一內容分類模組,取得該接收之多媒體片段,匯入該特徵資料庫之該特徵值以及用戶端之屬性與使用上收集的特徵資訊,執行特徵比對,分類該接收之多媒體片段;一記憶體模組,為暫存所接收或經分類之該一或多個多媒體片段;一輸入模組,用以取得一用戶端之一請求;一內容再製模組,對應該請求取得對應之一或多個多媒體片段,經再製後形成一新的多媒體片段;以及一內容播送模組,將對應該請求之新的多媒體片段播送至發出該請求之一用戶端。 A media automatic editing device includes: a feature database for recording one or more feature values; a content capture module for receiving one or more multimedia segments; and a content classification module for obtaining the received multimedia segments, Importing the feature value of the feature database and the attribute of the user end and the feature information collected by using, performing feature comparison, classifying the received multimedia segment; and a memory module for receiving or classifying the temporary storage The one or more multimedia segments; an input module for obtaining a request from one of the users; and a content re-manufacturing module, corresponding to requesting to obtain one or more multimedia segments, and reconstituting to form a new multimedia a segment; and a content delivery module that broadcasts a new multimedia segment corresponding to the request to the client that issued the request. 如申請專利範圍第1項所述之媒體自動剪輯裝置,其中該特徵資料庫所記載之特徵值包括影像特徵、聲音特徵與文字特徵。 The media automatic editing device according to claim 1, wherein the feature values recorded in the feature database include image features, sound features, and text features. 如申請專利範圍第2項所述之媒體自動剪輯裝置,其中該特徵值包括一時間資訊。 The media automatic editing device of claim 2, wherein the feature value comprises a time information. 如申請專利範圍第2項所述之媒體自動剪輯裝置,其中該影像特徵為該多媒體片段中各幀之影像顏色分佈。 The media automatic editing device of claim 2, wherein the image feature is an image color distribution of each frame in the multimedia segment. 如申請專利範圍第2項所述之媒體自動剪輯裝置,其中該聲音特徵為聲音波形,振幅與頻率變化。 The media automatic editing device of claim 2, wherein the sound feature is a sound waveform, amplitude and frequency change. 如申請專利範圍第2項所述之媒體自動剪輯裝置,其中該 文字特徵為該多媒體片段之字幕。 The media automatic editing device according to claim 2, wherein the The text feature is the subtitle of the multimedia clip. 如申請專利範圍第4項、第5項或第6項所述之媒體自動剪輯裝置,其中該請求所對應之特徵係為該影像特徵、該聲音特徵與該文字特徵之一或其組合。 The media automatic editing device of claim 4, wherein the request corresponds to the image feature, the sound feature and the text feature, or a combination thereof. 如申請專利範圍第1項所述之媒體自動剪輯裝置,其中該多媒體片段之來源包括影像、視訊、聲音檔案、電視頻道、網路串流以及攝影機。 The media automatic editing device of claim 1, wherein the source of the multimedia segment comprises an image, a video, a sound file, a television channel, a network stream, and a camera. 一種媒體自動剪輯方法,包括:擷取一或多個多媒體片段;匯入一或多個特徵值以及用戶端之屬性與使用上收集的特徵資訊;執行媒體特徵分析,分析該擷取之一或多個多媒體片段之特徵;根據一請求,比對符合該請求所記載之特徵的一或多個多媒體片段;暫存符合該請求之該一或多個多媒體片段至一記憶體;以及將符合該請求之一或多個多媒體片段形成一新的多媒體片段。 A method for automatically editing a medium, comprising: capturing one or more multimedia segments; importing one or more feature values and attribute information of the user end and feature information collected by using; performing media feature analysis, analyzing one of the captures or Characterizing a plurality of multimedia segments; comparing, according to a request, one or more multimedia segments conforming to the features recited in the request; temporarily storing the one or more multimedia segments conforming to the request to a memory; and Requesting one or more multimedia segments to form a new multimedia segment. 如申請專利範圍第9項所述之媒體自動剪輯方法,其中該特徵值為影像特徵、聲音特徵、文字特徵或其組合。 The media automatic editing method according to claim 9, wherein the feature value is an image feature, a sound feature, a character feature, or a combination thereof. 如申請專利範圍第10項所述之媒體自動剪輯方法,其中該特徵值包括一時間資訊。 The media automatic editing method of claim 10, wherein the feature value comprises a time information. 如申請專利範圍第10項所述之媒體自動剪輯方法,其中該影像特徵為該多媒體片段中各幀之影像顏色分佈。 The media automatic editing method according to claim 10, wherein the image feature is an image color distribution of each frame in the multimedia segment. 如申請專利範圍第10項所述之媒體自動剪輯方法,其中該聲音特徵為聲音波形、振幅與頻率變化。 The media automatic editing method of claim 10, wherein the sound feature is a sound waveform, an amplitude, and a frequency change. 如申請專利範圍第10項所述之媒體自動剪輯方法,其中該文字特徵為該多媒體片段之字幕。 The media automatic editing method according to claim 10, wherein the character feature is a subtitle of the multimedia segment. 如申請專利範圍第12項、第13項或第14項所述之媒體自動剪輯方法,其中該請求所對應之特徵係為該影像特徵、該聲音特徵與該文字特徵之一,或其組合。 The media automatic editing method of claim 12, wherein the request corresponds to the image feature, the sound feature and the text feature, or a combination thereof. 如申請專利範圍第9項所述之媒體自動剪輯方法,其中該多媒體片段之來源包括影像、視訊、聲音檔案、電視頻道、網路串流以及攝影機。 The media automatic editing method according to claim 9, wherein the source of the multimedia segment comprises an image, a video, a sound file, a television channel, a network stream, and a camera. 如申請專利範圍第9項所述之媒體自動剪輯方法,其中該請求為透過一網路所接收之用戶端需求。 The media automatic editing method according to claim 9, wherein the request is a client demand received through a network. 如申請專利範圍第9項所述之媒體自動剪輯方法,其中經比對得出符合該請求所記載之特徵的一或多個多媒體片段之後,係以一剪輯方式,擷取符合該請求之一或多個多媒體片段,經結合再製為該新的多媒體片段。 The media automatic editing method according to claim 9, wherein after comparing one or more multimedia segments that meet the features described in the request, the one of the requests is captured in a clipping manner. Or a plurality of multimedia segments, combined and re-created into the new multimedia segment. 如申請專利範圍第9項所述之媒體自動剪輯方法,其中經比對得出符合該請求所記載之特徵的一或多個多媒體片段之後,係以一標記方式,標記符合該請求之一或多個多媒體片段;經結合標記之多媒體片段後形成該新的多媒體片段。 The media automatic editing method according to claim 9, wherein after comparing one or more multimedia segments that meet the features described in the request, the marking is marked by one of the requests or a plurality of multimedia segments; the new multimedia segments are formed after the combined multimedia segments are combined. 一種媒體播送系統,包括:一主伺服器,提供使用者管理功能、使用者登入介面、節目選單、收集熱門關鍵字功能,並接收一用戶端之請求; 複數個地區伺服器,透過網際網路連結於該主伺服器,各地區伺服器擷取所在地區之多媒體內容,並根據多媒體內容之特徵分類與標記,各地區伺服器之間交換分類與標記的記錄;其中,該主伺服器取得該複數個地區伺服器之分類與標記的記錄,並根據該用戶端之請求與該複數個地區伺服器之分類與標記的記錄比對出對應之多媒體內容所在的地區伺服器,連結該用戶端與該對應之地區伺服器。 A media broadcast system includes: a main server, providing user management functions, a user login interface, a program menu, collecting popular keyword functions, and receiving a request from a client; A plurality of regional servers are connected to the main server through the Internet, and the regional servers capture the multimedia content in the region, and classify and mark according to the characteristics of the multimedia content, and exchange classification and markup between servers in each region. Recording, wherein the main server obtains the records of the classification and marking of the plurality of regional servers, and compares the corresponding multimedia content according to the classification of the plurality of regional servers and the marked records according to the request of the user end The regional server connects the client to the corresponding regional server. 如申請專利範圍第20項所述之媒體播送系統,其中該地區伺服器連結所在之地區的電視頻道與地區網路。 For example, the media distribution system described in claim 20, wherein the regional server is connected to the television channel of the region where the server is located and the regional network. 如申請專利範圍第20項所述之媒體播送系統,其中該複數個地區伺服器透過網際網路相互連線,並互為備援。 For example, the media distribution system described in claim 20, wherein the plurality of regional servers are connected to each other through the Internet and are mutually redundant. 如申請專利範圍第20項所述之媒體播送系統,其中該地區伺服器包括一媒體自動剪輯裝置,該媒體自動剪輯裝置包括:一特徵資料庫,係記載一或多個特徵值;一內容擷取模組,接收該多媒體內容;一內容分類模組,取得該接收之多媒體內容,匯入該特徵資料庫之該特徵值,執行特徵比對,分類該接收之多媒體內容;一記憶體模組,為暫存該多媒體內容;一內容再製模組,對應該請求取得對應之多媒體內容內一或多個片段,經再製後形成一新的多媒體內容;以及 一內容播送模組,將對應該請求之新的多媒體內容播送至該用戶端。 The media broadcast system of claim 20, wherein the regional server comprises a media automatic editing device, the media automatic editing device comprises: a feature database, which records one or more feature values; Taking a module, receiving the multimedia content; a content classification module, obtaining the received multimedia content, importing the feature value of the feature database, performing feature comparison, classifying the received multimedia content; and a memory module For temporarily storing the multimedia content; a content re-manufacturing module, corresponding to requesting to obtain one or more segments in the corresponding multimedia content, and reconstituting to form a new multimedia content; A content delivery module broadcasts the new multimedia content that should be requested to the client. 如申請專利範圍第23項所述之媒體播送系統,其中該特徵資料庫所記載之特徵值包括影像特徵、聲音特徵與文字特徵。 The media broadcast system of claim 23, wherein the feature values recorded in the feature database include image features, sound features, and text features. 如申請專利範圍第24項所述之媒體播送系統,其中該特徵值包括一時間資訊。 The media distribution system of claim 24, wherein the feature value comprises a time information. 如申請專利範圍第24項所述之媒體播送系統,其中該影像特徵為該多媒體片段中各幀之影像顏色分佈。 The media distribution system of claim 24, wherein the image feature is an image color distribution of each frame in the multimedia segment. 如申請專利範圍第24項所述之媒體播送系統,其中該聲音特徵為聲音波形、振幅與頻率變化。 The media distribution system of claim 24, wherein the sound feature is a sound waveform, an amplitude, and a frequency change. 如申請專利範圍第24項所述之媒體播送系統,其中該文字特徵為該多媒體片段之字幕。 The media distribution system of claim 24, wherein the character feature is a subtitle of the multimedia segment. 如申請專利範圍第26項、第27項或第28項所述之媒體播送系統,其中該請求所對應之特徵係為該影像特徵、該聲音特徵與該文字特徵之一,或其組合。 The media distribution system of claim 26, claim 27 or claim 28, wherein the feature corresponding to the request is one of the image feature, the sound feature and the text feature, or a combination thereof. 一種媒體播送方法,包括:建立一主伺服器與複數個設置不同地區的地區伺服器之連線;各地區伺服器擷取所處之地區的多媒體內容;根據設定的特徵,各地區伺服器分類與標記所擷取的該多媒體內容;各地區伺服器之間交換分類與標記的記錄;各地區伺服器傳送分類與標記的記錄至該主伺服器; 該主伺服器根據所接收之分類與標記的記錄以及個別用戶端常用之分類標記,藉此對應出擷取到的多媒體內容與該個別用戶端之需求以產生一適合該個別用戶端之節目表,並傳送該節目表至該個別用戶端;該主伺服器接收該個別用戶端根據該節目表所產生之一請求;該主伺服器輪詢各地區伺服器;該主伺服器取得符合該請求之該多媒體內容的片段或標記;該主伺服器再製形成一新的多媒體內容;以及播送該多媒體內容至該用戶端。 A media broadcast method includes: establishing a connection between a main server and a plurality of regional servers setting different regions; each regional server extracts multimedia content of a region in which it is located; and classifying servers according to the set characteristics And the multimedia content captured by the mark; the records of the classification and the mark are exchanged between the servers of each area; the servers of each area transmit the records of the classification and the mark to the main server; The main server is configured according to the received classification and markup records and the classification marks commonly used by the individual users, thereby correspondingly selecting the captured multimedia content and the requirements of the individual client to generate a program list suitable for the individual client. And transmitting the program list to the individual client; the primary server receives a request generated by the individual client according to the program table; the primary server polls each regional server; the primary server obtains the request a segment or mark of the multimedia content; the main server re-forms a new multimedia content; and broadcasts the multimedia content to the client. 如申請專利範圍第30項所述之媒體播送方法,其中各地區伺服器連結所在之地區的電視頻道與地區網路,複數個地區伺服器透過網際網路相互連線,並互為備援。 For example, in the media broadcasting method described in claim 30, in which the television channels of the regions in which the servers are connected are connected to the regional network, a plurality of regional servers are connected to each other through the Internet, and are mutually redundant. 如申請專利範圍第30項所述之媒體播送方法,其中該特徵包括影像特徵、聲音特徵與文字特徵。 The media broadcast method of claim 30, wherein the feature comprises an image feature, a sound feature, and a text feature. 如申請專利範圍第32項所述之媒體播送方法,其中該特徵包括一時間資訊。 The media broadcast method of claim 32, wherein the feature comprises a time information. 如申請專利範圍第32項所述之媒體播送方法,其中該影像特徵為該多媒體片段中各幀之影像顏色分佈。 The media broadcast method of claim 32, wherein the image feature is an image color distribution of each frame in the multimedia segment. 如申請專利範圍第32項所述之媒體播送方法,其中該聲音特徵為聲音波形、振幅與頻率變化。 The media broadcast method of claim 32, wherein the sound feature is a sound waveform, an amplitude, and a frequency change. 如申請專利範圍第32項所述之媒體播送方法,其中該文字特徵為該多媒體片段之字幕。 The media broadcast method of claim 32, wherein the character feature is a subtitle of the multimedia clip. 如申請專利範圍第34項、第35項或第36項所述之媒體播送方法,其中該請求所對應之特徵係為該影像特徵、該聲音特徵與該文字特徵之一或其組合。 The media broadcast method according to claim 34, claim 35 or claim 36, wherein the feature corresponding to the request is one of the image feature, the sound feature and the text feature or a combination thereof. 如申請專利範圍第30項所述之媒體播送方法,其中該地區伺服器擷取所處之地區的多媒體內容係側錄所在地區的電視頻道內容,與擷取該地區網路的網路交換封包。 The media broadcast method according to claim 30, wherein the regional server captures the content of the television channel in the area where the multimedia content of the region is located, and exchanges the network packet with the network of the region. .
TW100123541A 2011-07-04 2011-07-04 Automatic media editing apparatus, editing method, broadcasting method and system for broadcasting the same TWI513287B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW100123541A TWI513287B (en) 2011-07-04 2011-07-04 Automatic media editing apparatus, editing method, broadcasting method and system for broadcasting the same

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW100123541A TWI513287B (en) 2011-07-04 2011-07-04 Automatic media editing apparatus, editing method, broadcasting method and system for broadcasting the same

Publications (2)

Publication Number Publication Date
TW201304519A TW201304519A (en) 2013-01-16
TWI513287B true TWI513287B (en) 2015-12-11

Family

ID=48138300

Family Applications (1)

Application Number Title Priority Date Filing Date
TW100123541A TWI513287B (en) 2011-07-04 2011-07-04 Automatic media editing apparatus, editing method, broadcasting method and system for broadcasting the same

Country Status (1)

Country Link
TW (1) TWI513287B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI514861B (en) * 2013-04-19 2015-12-21 Chih Yao Lin Method for advertising in streaming media
TWI554090B (en) 2014-12-29 2016-10-11 財團法人工業技術研究院 Method and system for multimedia summary generation
CN112291574B (en) * 2020-09-17 2023-07-04 上海东方传媒技术有限公司 Large-scale sports event content management system based on artificial intelligence technology

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW200426726A (en) * 2001-06-25 2004-12-01 Nova Co Ltd System for multimedia information communication service, program for user terminal, and recording media
US20070260634A1 (en) * 2006-05-04 2007-11-08 Nokia Corporation Apparatus, system, method, and computer program product for synchronizing the presentation of media content

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW200426726A (en) * 2001-06-25 2004-12-01 Nova Co Ltd System for multimedia information communication service, program for user terminal, and recording media
US20070260634A1 (en) * 2006-05-04 2007-11-08 Nokia Corporation Apparatus, system, method, and computer program product for synchronizing the presentation of media content

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
Wen-Nung Lie ; Chen-Kang Su, "News video classification based on multi-modal information fusion," Proc. of IEEE International Conference on ^&rn^Image Processing, ICIP 2005, Page(s): I - 1213-16 *
Wen-Nung Lie ; Kuo-Chiang Hsu, "Video Summarization Based on Semantic Feature Analysis and User Preference," Proc. of IEEE International Conference on Sensor Networks, Ubiquitous and Trustworthy Computing, 2008. SUTC '08, Page(s): 486 - 491 *

Also Published As

Publication number Publication date
TW201304519A (en) 2013-01-16

Similar Documents

Publication Publication Date Title
US10349125B2 (en) Method and apparatus for enabling a loudness controller to adjust a loudness level of a secondary media data portion in a media content to a different loudness level
CN102890950B (en) Media automatic editing device, method, media transmissions method and its broadcasting system
DE60021443T2 (en) Management system and procedures for audiovisual information
US9264471B2 (en) Method and apparatus for segmenting media content
CN102804797B (en) The correlation for the media metadata collected from separate sources
JP4187011B2 (en) Information processing system, information processing apparatus and method, and program
US8589995B2 (en) Server and method for providing synchronization information, client apparatus and method for synchronizing additional information with broadcast program
CN106454493A (en) Method for inquiring currently played television program information and smart TV
US20070199037A1 (en) Broadcast program content retrieving and distributing system
CN105981399A (en) Receiving device, receiving method, transmission device, and transmission method
CN105791949A (en) Program recording method and device
TWI513287B (en) Automatic media editing apparatus, editing method, broadcasting method and system for broadcasting the same
CN105338379B (en) Soft broadcast data monitoring and mining system and method thereof
US9172983B2 (en) Automatic media editing apparatus, editing method, broadcasting method and system for broadcasting the same
CN106506483A (en) Video source group synchronized playback method and device based on ONVIF
JP3474459B2 (en) Transmission device and transmission method, reception device and reception method, transmission / reception device and transmission / reception method
KR20140134100A (en) Method for generating user video and Apparatus therefor
KR101749420B1 (en) Apparatus and method for extracting representation image of video contents using closed caption
CN106851331B (en) Easy broadcast processing method and system
KR20140134126A (en) Content creation method and apparatus
EP2587829A1 (en) Video analysis information upload apparatus and video viewing system and method
KR102247532B1 (en) Method, server and system for providing video scene collection
US10148984B2 (en) Terminal device, server device, data management system, and recording medium on which program is recorded
KR102623618B1 (en) metadata processing platform of NG acting video by use of participation of OTT viewers
JP7302829B2 (en) Broadcast service communication network distribution apparatus and method