KR20020059969A - method for providing multimedia service - Google Patents

Abstract

PURPOSE: A method for supplying a multimedia service is provided to transmit a partial multimedia including a specific image to a specific group by extracting the partial multimedia according to various conditions in multimedia contents being streamed in real time. CONSTITUTION: A service server performs a service registration with respect to a specific group(an association of like-minded persons, club, and a party)(S1). The service server stores a keyword for displaying a characteristic of each group being service-registered and other keyword, and a user terminal number of each member(S2). At least one Full-Multimedia is streamed to a specific user terminal from a cooperated server or a service server(S3). The service server judges whether a Partial-Multimedia is extracted from the Full-Multimedia streamed from the cooperated server(S4). The service server extracts and collects a Partial-Multimedia of a partial length in the Full-Multimedia(S5). The service server transmits the extracted and collected Partial-Multimedia to user terminals of each member possessed in a fixed specific group(S6).

Description

Method for providing multimedia service

The present invention provides an information service for each group, and in particular, a multimedia that collects and extracts some multimedia streams from real-time media contents such as famous scenes, important scenes, or breaking news and simultaneously provides them to a specific group (club, club, group). It relates to a service providing method.

In general, multimedia may be defined as a simultaneous use of text, voice, video (movies, still images, etc.) in a computer.

In the conventional computer, only the characters were simply displayed, but multimedia was made possible by the development of computer applications.

Such multimedia, combined with communication technology, has become a more important communication medium.

Communication was the exchange of information with remotely located people. Initially, they exchanged low-quality voices, exchanged low-quality images such as fax, or exchanged only text, such as computer communication. However, due to the recent development of communication technology, high-speed information communication networks have been put into practical use, and multimedia has been combined with the high-speed information communication networks to enable high-quality multimedia communication.

Accordingly, development of high quality multimedia utilization technology continues, and the representative is a real-time video transmission technology.

Real-time video transmission technology starts from the problem that data volume increases due to the combination of video and audio due to the characteristics of multimedia. Such an excessive amount of data has a disadvantage in that the load of the communication network increases, thereby reducing the utility of the communication network. Accordingly, a video transmission technology for splitting and transmitting a large amount of multimedia has been developed so that a large amount of multimedia can be utilized without difficulty. That is the streaming technology.

Currently, there are a growing number of sites that provide real-time services using streaming technology on the Internet. These sites provide users with multimedia streaming of news, sports, and movies that have been broadcast over the air.

To this end, site operators maintain a large number of multimedia content in a database, and when a user connected to the site requests the multimedia content, the content is streamed to the user's computer.

Multimedia streaming starts playback even if a part of the multimedia file is received but not all of it, and continuously receives a portion of the multimedia file even during playback.

Conventionally, in providing multimedia contents using streaming technology as described above, only multimedia services are provided to a user computer as a unit of content, and only partial multimedia streams are extracted from the multimedia contents under specific conditions, and the extracted partial multimedia There is no service that provides a stream to a user's computer.

SUMMARY OF THE INVENTION An object of the present invention is to provide a method for providing a multimedia service suitable for extracting some multimedia including a specific video from a multimedia content streamed in real time according to various conditions and transmitting it to a specific group. It is.

It is another object of the present invention to extract only partial media streams such as a famous scene of a movie, an important scene of a game, or a news article for a specific person from real media contents such as a movie, news, or sports that are streamed in real time. By providing a method of providing multimedia services suitable for simultaneous service to members of a specific group (clubs, clubs, organizations).

A feature of the method for providing a multimedia service according to the present invention for achieving the above objects includes: a first step of streaming various multimedia files; Extracting and collecting a plurality of multimedia streams of a predetermined length from the streamed multimedia files; A third step of transmitting the collected multimedia stream to the user terminal of each member belonging to a predetermined feature group.

More preferably, the second step may be performed by analyzing an audio stream in the streamed multimedia file and determining that the audio stream is streamed as continuous music, the multimedia stream corresponding to the streaming length of the continuous music. There is a first case of extracting.

In the second step, the streaming multimedia file is decoded on a frame-by-frame basis, and if the frame of the decoded multimedia file is matched with a previously stored first video frame, extraction of the multimedia stream is performed. There is a second case of starting and terminating the extraction of the multimedia stream when the frame of the multimedia file to be decoded and the second video frame previously stored are matched again.

In the second step, there is a third case of extracting a multimedia stream of a predetermined length that is repeatedly streamed from the streamed multimedia file. In this case, the video stream is analyzed in the streamed multimedia file, and when it is determined that the analyzed video stream is repeatedly streamed, the multimedia stream corresponding to the repeated streaming length is extracted.

Finally, in the second step, each characteristic of the groups and each keyword inputted at the time of service registration of each group are stored in advance, and voice analysis of the audio stream is performed on the streamed multimedia file. There is a fourth case in which a multimedia stream including the voice analysis word is extracted by a predetermined length when the voice analysis word according to voice analysis is compared with each other by comparing the pre-stored group feature word and the keyword.

1 is a diagram showing an overall system configuration for providing a multimedia service according to the present invention.

2 is a flowchart illustrating a multimedia service providing procedure according to the present invention.

3 is a flowchart illustrating a procedure for providing a real media streaming service of a movie according to the first embodiment of the present invention.

4 is a flowchart illustrating a procedure for providing a real media streaming service of a movie according to a second embodiment of the present invention.

5 is a flowchart illustrating a procedure for providing a real media streaming service in a sports game according to a third embodiment of the present invention.

6 is a flowchart illustrating a procedure for providing a real media streaming service for news broadcasting according to a fourth embodiment of the present invention.

7 is a flowchart illustrating a procedure for providing a real media streaming service for news broadcasting according to a fifth embodiment of the present invention.

Explanation of symbols for the main parts of drawings

10: service server 20 to 23: affiliate server

30: user terminal (MT1-MTn, DTV1-DTVn, PC1-PCn)

Hereinafter, a preferred embodiment of a method of providing a multimedia service according to the present invention will be described with reference to the accompanying drawings.

1 is a diagram showing an overall system configuration for providing a multimedia service according to the present invention.

Referring to Fig. 1, the system of the present invention includes a service server 10, affiliated servers 20 to 23 that hold a plurality of multimedia contents, and various types of user terminal 30. It consists of.

The affiliated servers 20 to 23 provide each multimedia to the user terminal 30 in units of contents. That is, the affiliated servers 20 to 23 stream multimedia files (FM) of specific content to each user terminal 30.

In addition, the affiliated servers 20 to 23 transmit the multimedia file FM streamed to each user terminal 30 to the service server 10. In this case, the service server 10 extracts a multimedia stream (PM) of a partial length from the received multimedia file.

In another case, the affiliate servers 20 to 23 transmit the multimedia stream PM having a part length in the multimedia file of the specific content to the service server 10. In this case, the service server 10 determines to which group of the user terminal 30 to receive the received partial multimedia stream (PM) and then the partial multimedia stream (PM) to the user terminal 30 in the corresponding group Send it.

The user terminal 30 receives the multimedia file FM from the affiliate server 20 to 23. The user terminal 30 is capable of multimedia playback of the wired / wireless Internet and audio / video. Examples of the user terminal 30 include mobile communication terminals MT1 to MTn, digital TVs DTV1 to DTVn, and personal computers PC1 to PCn.

The service server 10 receives a plurality of multimedia contents FM from the affiliated servers 20 to 23 while retaining a plurality of multimedia contents FM, thereby providing the multimedia service of the present invention.

The service server 10 performs the following various operations.

First, the retained multimedia file FM is streamed to the user terminal 30 in units of content.

Second, the partial multimedia stream PM having a part length is extracted from the multimedia file FM received from the affiliated servers 20 to 23, and sent or streamed to the plurality of user terminals 30.

Third, after producing a mail including a partial multimedia stream (PM) of a predetermined length received from the affiliate server (20 to 23) and sends the produced mail to the plurality of user terminals (30).

Fourth, the partial multimedia stream PM having a partial length is extracted, and a specific advertisement is pushed to the extracted partial multimedia stream and transmitted to the plurality of user terminals 30.

Fifth, the multimedia file received from the affiliated servers 20 to 23, whether the audio stream of the audio stream through the stream analysis and whether the video stream is repeated streaming, whether the data in the frame unit through the decoding of the multimedia stream, whether the voice It is determined whether the voice analysis word of the audio stream and the pre-registered keyword match through the analysis, and extract a partial multimedia stream of a predetermined length.

Sixth, service registration is performed for a specific group (club, club, group), and through the service registration of the group, registration information (user terminal number of each member) of members belonging to each group is stored. In particular, it also stores keywords that represent the characteristics of the group being registered, and other keywords required by that group.

The following describes the multimedia service providing procedure of the present invention, which further embodies the operations of the above-described service server 10.

2 is a flowchart illustrating a multimedia service providing procedure according to the present invention.

Referring to FIG. 2, the service server registers a service to a specific group (club, club, group) (S1). Accordingly, the service server stores a keyword (key-word) indicating the characteristics of each group registered service and other keywords, and also stores the user terminal number of each member as individual information of the members belonging to each group ( S2). For example, when a soccer club is registered for service, "football" or "world cup" is stored as a keyword, and when a celebrity fan club is registered with a service, a celebrity name is stored as a keyword.

Next, one or more pre-multimedia (FM) is streamed to the specific user terminal from the affiliate server or the service server (S3). In particular, the affiliate server streams the pre-multimedia (FM) to the service server as well as the user terminal. The pre-multimedia (FM) here is a multimedia file in units of content, and movies, dramas, sporting events, news and entertainment news are streamed to the pre-multimedia (FM).

The service server determines whether to extract the partial multimedia (PM) from the pre-multimedia (FM) streamed from the affiliate server (S4). The part-multimedia (PM) here is a multimedia stream of a shorter part length for a multimedia file in a content unit, and is a scene of a movie, a scene of a drama, a highlight of a sports event, or a news. Corresponds to one article.

The service server extracts and collects part-multimedia (PM) of a partial length from the pre-multimedia (FM) streamed through the following determination criteria (S5).

First, the service server analyzes the audio stream in the pre-multimedia (FM) that is streamed to determine whether music is being streamed. If it is determined that the audio stream is streamed to the continuous music, the service server extracts the multimedia stream of the portion of the music stream from the pre-multimedia (FM) that is streamed.

Second, the service server decodes the streamed pre-multimedia (FM) in a buffering unit. In the present invention, a system is designed such that buffering is performed in units of frames of an image. Therefore, decoding is performed frame by frame. Thereafter, the service server compares the frame that is continuously decoded with the frame of the first image stored in advance, and starts extracting the multimedia stream. Then, the multimedia stream extraction is terminated by comparing the frame which is subsequently decoded with a frame of another second image stored in advance. To this end, the service server prestores the first image and the last image of the scene of each movie as frame data.

Third, the service server determines whether the multimedia stream is repeatedly streamed in the pre-multimedia (FM) that is streamed. If it is determined that the video stream or audio stream is repeatedly streamed, the service server extracts the multimedia stream that is repeatedly streamed.

Fourth, the service server performs voice analysis on the audio stream in the pre-multimedia (FM) that is streamed, and determines whether or not the voice analysis word corresponding to each other is pre-stored. If the analysis word according to the voice analysis matches with a specific keyword, the service server extracts a multimedia stream including the analysis word. In this case, the pre-multimedia (FM) is one multimedia file including the multimedia streams of several items (items), the service server in advance the length of the entire item of the multi-media (FM) and the multimedia stream for each item in advance As is known, the extraction of partial-multimedia (PM) is easy. As will be described later, in this case, the extracted multimedia stream is transmitted to each member of the group whose keywords match the voice analysis word as registration information.

In other cases except for the fourth case, the service server determines whether to extract the streaming pre-multimedia (FM) in a buffering unit of the service server. In addition, since the extraction of the partial multimedia (PM) is terminated and transmitted to a specific group of user terminals, a large amount of memory for extracting the multimedia stream is not required, and thus the collecting step is omitted. However, in the fourth case, although the service server determines whether to extract the streaming-all-multimedia (FM) in the buffering unit of the service server, it needs to store the multimedia stream of one item that is currently being streamed. A certain amount of memory is required.

Finally, the service server transmits the partial-multimedia (PM) extracted from the above to the user terminal of each member belonging to the predetermined specific group (S6). In particular, the service server pushes and transmits specific advertisement media to the extracted and collected partial-multimedia (PM).

The following describes a more practical example of the above-described multimedia service providing procedure of the present invention. In particular, the following examples are based on real media streaming technology that provides real media with real-time as multimedia, and also a service server or affiliate server that streams real media to a user terminal as a single integrated server concept. see.

3 is a flowchart illustrating a procedure for providing a real media streaming service of a movie according to the first embodiment of the present invention.

Referring to FIG. 3, when a movie content is provided, a movie is started to stream a real media file of the movie (S10).

The server continuously observes the real audio stream of the streamed real media file (S11). The meaning of observation here is to decode the real audio stream to determine whether it is music with continuous waveform characteristics. In fact, it is known that the waveform characteristics of the real audio stream corresponding to the dialogue voice and the real audio stream corresponding to the music are different.

If it is determined that the observed real audio stream is streamed into the music, the server starts to extract the real media stream that is currently being streamed (S12, S13).

After the real media stream extraction starts, if the server continues to observe the real audio stream and determines that the music streaming is finished, the server ends the extraction of the real media stream (S14, S15).

Thereafter, the server transmits the extracted real media stream to the user terminal numbers of the members belonging to a specific group (movie related group) (S16). At this time, the server transmits the extracted real media stream to each member of the group who registered "movie" as a keyword among the keywords representing the characteristics of each group stored at the time of group registration.

This procedure of FIG. 3 continues until the end of streaming of the movie real media file.

4 is a flowchart illustrating a process for providing a real media streaming service of a movie according to a second embodiment of the present invention.

Referring to FIG. 4, the server may store, in advance, various scenes known for each movie as data in frame units for various movies (S20). In more detail, the server prestores each image data of the decoded start frame and the last frame of the scene for each movie.

After the provision of the movie content is requested to stream the real media file of the movie (S21).

The server decodes the streamed real media stream on a frame-by-frame basis (S22), and compares the decoded image of one frame with the image data of a previously stored start frame (S23).

In this case, when the video of the decoded real media stream and the previously stored start frame video data coincide with each other, the server starts to extract the currently streamed real media stream (S24, S25).

Even after extraction of the real media stream starts, the server continues decoding the streamed real media stream, and simultaneously compares the video of one frame to be decoded with the video data of the last frame previously stored (S26). In this case, when the video of the decoded real media stream and the last frame image data stored in advance match each other, the server ends the extraction of the currently streamed real media stream (S27, S28).

Thereafter, the server transmits the extracted real media stream to the user terminal number of each member belonging to a specific group (movie related group) (S29), and the procedure of FIG. 4 continues until the streaming of the movie real media file is finished. do. To this end, the server holds in advance image data of each start frame and image data of end frames of various scenes known for each movie.

However, in the procedure of FIG. 4, the real media stream currently decoded is pre-stored in units of frames until the time when the extraction of the real media stream starts. When the extraction starts, the decoded real media stream is not stored. After the extraction ends again, the real media stream decoded from that point is stored in units of frames. The reason for storing the decoded real media stream in units of frames is to connect the real media stream of one frame to the real media stream to be extracted and transmit the same. This is to prevent the loss of one frame image at the beginning during the comparison operation in the extraction procedure. In particular, in the present invention, the real media stream of one decoded frame prestored is connected to the first frame of the real media stream to be extracted and transmitted.

5 is a flowchart illustrating a procedure for providing a real media streaming service of a sports game according to a third embodiment of the present invention.

Referring to FIG. 5, the server streams a real media file of a sports game according to the start of the relay of the sports game (S40).

If it is determined that the real video stream of a predetermined length is repeatedly streamed from the streamed real media file, the server extracts a real media stream including the repeatedly streamed video stream (S41, S42).

Thereafter, the server transmits the extracted real media streams to user terminal numbers of respective members belonging to a specific group (sports related groups) (S43). At this time, the server transmits the extracted real media stream to each member of the group who registered "sport" as a keyword among the keywords representing the characteristics of each group stored at the time of group registration. As another example, if the server is streaming a real media file of a football match, the server sends the extracted real media stream to each member of the group that registered "football" as a keyword.

This procedure of FIG. 5 continues until the end of streaming of the real media file of the sporting event.

6 is a flowchart illustrating a procedure of providing a real media streaming service for news broadcasting according to a fourth embodiment of the present invention.

Referring to FIG. 6, the server is provided with the articles of each article for the entire article of the news broadcast and the streaming length of the articles of each article, and the information is preset in the server as a length coefficient for extraction (S50).

Thereafter, the real media file is streamed according to the start of the news broadcast (S51).

The server performs voice analysis on the audio stream for each news article of the currently streamed real media file, and compares the voice analysis word according to the voice analysis with a keyword stored in advance (S52).

At this time, when the voice analysis word and the keyword coincide with each other, a real media stream of a news article item including the matching voice analysis word is extracted (S53 and S54). At this time, since the server has already started storing the real media stream when the news article item including the voice analysis is started, it is not difficult for the server to extract the entire news article item. To this end, when the streaming of a news article starts, the server starts to store the real media stream of the news article, and when the streaming of the corresponding news article ends, deletes the real media stream that has been stored up to that point. Then again, the real media stream of the next news article starts to be saved. The storage / deletion of the real media stream for each news article item is repeatedly performed using the length coefficient for each news article item preset in the server.

Next, the server transmits the extracted real media streams to various user terminal numbers of a group in which keywords corresponding to the voice parser are input as registration information (S55). As an example, if a real media file of entertainment news is being streamed, and the voice parser from the newscast's voice analysis is the name of a particular entertainer, the server is the fan club of the entertainer (the fanclub is the name of the entertainer). The registered real media stream is transmitted to each member of the (registered as a keyword).

This procedure of FIG. 6 continues until the end of the streaming of the real media file of the news broadcast.

FIG. 7 is a flowchart illustrating a procedure for providing a real media streaming service of a news broadcast according to a fifth embodiment of the present invention, which is substantially the same as the procedure of FIG. 6, but includes a keyword that is compared with a voice analysis word through voice analysis. It differs from FIG. 6 in that it is.

Referring to FIG. 7, the server pre-stores the keyword "breaking news" in advance. Thereafter, the real media file is streamed according to the start of the news broadcast (S60).

The server performs analysis on the real media stream of the real media file currently being streamed (S61). In this case, the real media stream is analyzed using voice analysis of the real audio stream or other analysis method that can distinguish breaking news.

At this time, if it is determined that the real media stream being streamed is breaking news, the server extracts the real media stream corresponding to the breaking news (S62 and S63). In general, the breaking news that is inserted during the news broadcast can know the breaking news in advance, so that the server does not need a separate analysis to extract the breaking news. However, in the present invention, the keyword "breaking news" is stored in advance, and after the real audio stream which is locally streamed is analyzed by voice, if the voice analysis word through the analysis is "breaking news", the real media stream of the news article. Extract

Next, the server transmits the extracted real media stream for breaking news to various user terminal numbers belonging to the group requesting the breaking news service, such as a news club (S64).

This procedure of FIG. 7 continues until the end of streaming of the real media file of the news broadcast.

As a separate example, in the multimedia service providing procedure of the present invention, an e-mail containing the extracted part of the multimedia stream is separately produced and transmitted to the user terminal of each member of each group.

According to the present invention described above, providing the famous scene of the movie to each member of the film-related group in real time, providing the highlights of the current sports events to each member of the sports-related group in real time, or news that is currently broadcast In the present invention, only a related article of a specific entertainer is extracted and provided to fan club members of the entertainer. The present invention provides a multimedia service that is differentiated from the prior art by providing a partial multimedia stream of a certain length for a specific group.

In addition, through the present invention, it is possible to improve the quality of member services by sending the main scoring scene of the sports game, the interview scene of a specific player, the news of a specific celebrity, the famous scene of the movie, etc. to the related fan club members.

In addition, the present invention provides an extracted partial multimedia stream and simultaneously pushes and transmits an advertisement in the partial multimedia stream, thereby relatively reducing the user's rejection of receiving the advertisement.

Those skilled in the art will appreciate that various changes and modifications can be made without departing from the spirit of the present invention.

Therefore, the technical scope of the present invention should not be limited to the contents described in the embodiments, but should be defined by the claims.

Claims (18)

A first step of streaming various multimedia files; Extracting and collecting a plurality of multimedia streams of a predetermined length from the streamed multimedia files; And a third step of transmitting the collected multimedia streams to user terminals of respective members belonging to a specific specific group. The method of claim 1, wherein the second step, In the streaming multimedia file, analyze an audio stream, And if it is determined that the audio stream is streamed with continuous music, extracting a multimedia stream corresponding to the streaming length of the continuous music. The method of claim 1, wherein the second step, Decode the streamed multimedia file frame by frame, If the frame of the decoded multimedia file is compared with the previously stored first video frame and is matched, extraction of the multimedia stream is started, And extracting the multimedia stream when the frame of the multimedia file to be decoded and the second video frame previously stored are matched again. The method of claim 1, wherein the second step, The multimedia service providing method of extracting a multimedia stream of a predetermined length that is repeatedly streamed from the streamed multimedia file. The method of claim 4, wherein the multimedia stream is analyzed, and when the video stream is determined to be repeatedly streamed, the multimedia stream corresponding to the repeated streaming length is extracted. How to Provide Multimedia Services. The method of claim 1, wherein the second step, Storing the characteristics of each group and each keyword inputted at the time of service registration of each group, In the streamed multimedia file, perform a voice analysis on the audio stream, And comparing the voice analysis word according to the voice analysis with the prestored group feature word and the keyword, and extracting the multimedia stream including the voice analysis word by a predetermined length. The method of claim 1, wherein the third step, And inserting specific advertisement media into the collected multimedia streams and transmitting the specific advertisement media to user terminals of respective members belonging to the determined specific group. The method of claim 1, wherein the third step, Producing a mail containing the collected multimedia streams, and the multimedia service providing method characterized in that sent to the user terminal of each member belonging to the specified specific group. A first step of streaming the real media file of the movie; Observing a real audio stream of the streamed real media file; A third step of starting to extract the real media stream if it is determined that the observed real audio stream is streamed into music; A fourth step of terminating extraction of the real media stream when it is determined that the music streaming is finished; And a fifth step of transmitting the extracted real media stream to user terminal numbers of respective members belonging to a movie related group. A first step of previously storing image data of the decoded start frame and the end frame of each known scene for each movie; A second step of streaming the real media file of the specific movie; Decoding the streamed real media stream on a frame-by-frame basis; Comparing the previously stored video data of the start frame with the decoded real media stream and starting to extract the streamed real media stream when the video frames match each other; A fifth step of comparing the previously stored video data of the last frame with the decoded real media stream and ending the extraction of the real media stream which has started the extraction when the video frames coincide with each other; And a sixth step of transmitting the extracted real media stream to user terminal numbers of respective members belonging to a movie related group. The method of claim 10, wherein the third step, And storing a real media stream decoded in units of frames in advance. 12. The method of claim 11, wherein the storing of the real media stream is performed until a point at which extraction of the real media stream is started. The method of claim 11, wherein the pre-stored real media stream of one frame is connected to the extracted real media stream and transmitted together with each user terminal number. The method of claim 13, wherein the pre-stored real media stream of one frame is transmitted as the first frame of the transmitted real media stream. A first step of streaming the real media file according to the start of the sports relay; If it is determined that the stream of a predetermined length is repeated in the real media file, extracting the repeated streaming real media stream; And a third step of transmitting the extracted real media stream to user terminal numbers of respective members belonging to a sports related group. A first step of streaming the real media file according to the start of the news broadcast; Performing a voice analysis on an audio stream of each news article of the streamed real media file; A third step of extracting a real media stream of a news article including the voice analysis word when the voice analysis word according to the voice analysis is compared with a previously stored keyword and matched with each other; And a fourth step of transmitting the extracted real media stream to various user terminal numbers of a group in which the keyword is inputted as registration information. 17. The method of claim 16, wherein all the news article items of the news broadcast and the streaming length of each item are preset, and in the third step, a news article item of the corresponding streaming length including the speech analysis word is extracted. Method of providing a multimedia service of news broadcasting. A first step of streaming the real media file according to the start of the news broadcast; Performing a voice analysis on an audio stream of the streamed real media file; If it is determined that the breaking news is to be streamed through the voice analysis, extracting the corresponding breaking news real media stream; And transmitting the extracted real media stream to user terminal numbers of respective members belonging to a specific specific group.