KR102429830B1 - Media management server and user terminal communicating with the same to play media - Google Patents

Abstract

In a method for managing information related to media according to an embodiment of the present invention, first metadata sets associated with a plurality of media fragment files are received, and each of the first metadata sets includes a time interval of the corresponding media fragment file. a second metadata set having time intervals included in the selected time interval among the first metadata sets in response to the request message including the information indicating the information, receiving a request message indicating the selected time interval from the user terminal, and in response to the request message and feeding them back to the user terminal.

Description

MEDIA MANAGEMENT SERVER AND USER TERMINAL COMMUNICATING WITH THE SAME TO PLAY MEDIA

The present invention relates to a media management server and a user terminal communicating with it to play media.

Real-time streaming is a method in which media data is transmitted to a user terminal in real time and the user terminal reproduces the transmitted media data. For example, Real-Time Streaming Protocol (RTSP), Realtime Transport Protocol (RTP), Real-Time Messaging Protocol (RTMP), etc. are used for communication of media data. Since the transmitting end and the receiving end must include configurations suitable for using these protocols, the construction cost of the system is relatively high.

On the other hand, when media data is communicated without a real-time streaming method, for example, based on HTTP (Hypertext Transfer Protocol) or FTP (File Transfer Protocol), the receiving end reproduces media data of a desired time period among media files within a short waiting time. It can be difficult to do.

The above description is only for helping the understanding of the background of the technical spirit of the present invention, and therefore it cannot be understood as the content corresponding to the prior art known to those skilled in the art.

Embodiments of the present invention allow a user terminal to efficiently reproduce media while reducing resources in a network system required for efficient media reproduction.

A method for managing information related to media according to an embodiment of the present invention receives first metadata sets associated with a plurality of media fragment files, wherein each of the first metadata sets is a time interval of a corresponding media fragment file. comprising information indicating Receiving a request message indicating the selected time period from the user terminal; and feeding back second metadata sets having time intervals included in the selected time interval among the first metadata sets to the user terminal in response to the request message.

The first meta data sets may be associated with at least one media storage to which the plurality of media fragment files are uploaded.

The request message may further include a selected event type.

Each of the first metadata sets may further include an event type of a corresponding media fragment file, and the second metadata sets may have the selected event type.

The method includes: receiving a request from the user terminal to change an event type of at least one of the first metadata sets; and updating the at least one of the first meta data sets to have the requested event type.

According to an embodiment of the present invention, a method for controlling a user terminal that plays media by communicating with a network includes: requesting metadata sets of media fragment files corresponding to a selected time period from a media management server; and downloading and playing the media fragment files through the network from at least one media storage determined according to the metadata sets, wherein the playing includes: a first media fragment among the media fragment files. Playing while downloading the file; downloading a part of a second media fragment file from among the media fragment files while a part of the first media fragment file is played and the remaining part of the first media fragment file is played; and starting playback of the part of the downloaded second media fragment file when the playback of the remaining part of the first media fragment file is completed.

Each of the media fragment files may be based on MP4.

The downloading of the part of the second media fragment file may include playing the part of the second media fragment file in a hidden state on the display of the user terminal.

A network server according to an embodiment of the present invention includes a communicator for communicating with a user terminal through a network; and at least one processor providing, via the communicator, from a database to the user terminal sets of instructions to be executed by the user terminal. The instruction sets include: a first instruction set for requesting a media management server for metadata sets of media fragment files corresponding to a selected time period; and a second instruction set for downloading and playing the media fragment files through the network from at least one media storage determined according to the meta data sets, wherein the second instruction set includes: first instructions for playing while downloading a first media piece file; second instructions for downloading a part of a second media fragment file from among the media fragment files while the remaining part of the first media fragment file is played after a part of the first media fragment file is played; and third instructions for starting playback of the part of the downloaded second media fragment file when the playback of the remaining part of the first media fragment file is completed.

The second instructions may include instructions for playing the part of the second media fragment file in a hidden state on the display of the user terminal.

The second instructions may include instructions for playing the part of the second media fragment file in a muted state on the display.

On the display, a position where the part of the second media fragment file is played may overlap a position where the remaining part of the first media fragment file is played.

The second commands may include a command for setting a progress point of the second media fragment file to 0 after the part of the second media fragment file is reproduced in the hidden state.

The third instructions may include instructions for playing the second media fragment file in a visible state from the set progress time point.

The instruction sets may include a third instruction set for receiving an input for selecting an event type, and the metadata sets may correspond to the selected time interval and the selected event type.

The instruction sets may further include a fourth instruction set for requesting the media management server to change an event type included in at least one of the meta data sets.

According to embodiments of the present invention, while allowing a user terminal to efficiently reproduce media, resources in a network system required for efficient media reproduction are reduced.

1 is a block diagram showing a network system according to an embodiment of the present invention.
2 is a flowchart illustrating a method of operating a media uploader according to an embodiment of the present invention.
3 is a flowchart illustrating a method of operating a media management server according to an embodiment of the present invention.
4 is a conceptual diagram illustrating an embodiment of any one of first to mth metadata sets stored in a media management server.
5 is a flowchart illustrating a method of operating a media management server according to another embodiment of the present invention.
6 is a conceptual diagram illustrating another embodiment of any one of first to mth metadata sets stored in a media management server.
7 is a flowchart illustrating a method of reproducing media fragment files in a user terminal according to an embodiment of the present invention.
8 is a flowchart illustrating step S440 of FIG. 7 in more detail.
9 is a flowchart illustrating an embodiment of step S540 of FIG. 8 .
10 to 14 are conceptual diagrams illustrating some steps of downloading and playing the kth media fragment file and the k+1th media fragment file.
15 is a flowchart illustrating a method of operating a media management server according to another embodiment of the present invention.
16 is a block diagram illustrating an exemplary computer system for implementing a user terminal.
17 is a block diagram illustrating an exemplary server system for implementing a media management server and/or network server.

In the following description, for purposes of explanation, numerous specific details are set forth to aid in understanding various embodiments. It will be evident, however, that various embodiments may be practiced without these specific details or in one or more equivalent manners. In other instances, well-known structures and devices are shown in block diagram form in order to avoid unnecessarily obscuring the various embodiments.

When it is stated that an element or layer is “connected” with another element or layer, this includes not only the case where it is directly connected, but also the case where it is indirectly connected with another element or layer interposed therebetween. However, if a part is described as "directly connected" to another part, it means that there is no other element between the part and the other part. “At least any one of X, Y, and Z” and “at least any one selected from the group consisting of X, Y, and Z” means one X, one Y, one Z, or two of X, Y, and Z or It can be interpreted as any combination of more (eg, XYZ, XYY, YZ, ZZ). Herein, “and/or” includes any combination of one or more of the components.

The terminology used herein is for the purpose of describing particular embodiments and not limitation. Throughout the specification, when a part "includes" a certain element, it means that other elements may be further included, rather than excluding other elements, unless otherwise stated. Unless otherwise specified, terms used herein have the same meanings as commonly understood by those of ordinary skill in the art to which the present invention pertains.

1 is a block diagram showing a network system 100 according to an embodiment of the present invention.

Referring to FIG. 1 , a network system 100 includes a network 105 , Network, a media uploader 110 , Media Uploader, at least one media storage 120 , Media Storage, and a media management server 130 , Media Management Server. ), a user terminal (140, User Terminal), and a network server (150, Network Server).

Each of the media uploader 110 , the media storage 120 , the media management server 130 , the user terminal 140 , and the network server 150 includes program codes or data stored in a computer-readable medium. The various applications and steps described herein may be performed by including one or more processors, memories, and other suitable components for executing instructions. For example, the instructions may be stored on a computer-readable medium internal to or external to the configuration.

The network 105 connects the media uploader 110 , the media storage 120 , the media management server 130 , the user terminal 140 , and the network server 150 . Network 105 may include at least one of a public network, at least one private network, a wired network, a wireless network, another suitable type of network, and combinations thereof. Each of the media uploader 110, the media storage 120, the media management server 130, the user terminal 140, and the network server 150 may include at least one of a wired communication function and a wireless communication function, Accordingly, they can communicate with each other via the network 105 .

The media uploader 110 communicates with the media storage 120 and the media management server 130 via the network 105 . The media uploader 110 receives media data MD (or multimedia data) from the camera CMR. The camera CMR includes, for example, an image sensor that converts optical signals input through a lens into electronic signals, and a microphone that converts voice into electronic signals, thereby providing media data MD. can The photographing by the camera CMR is turned on/off according to various methods, and the camera CMR may provide the media data MD when the camera CMR is in an on state. Hereinafter, for convenience of description, it is assumed that the media data MD is acquired during a continuous time period, for example, when the photographing by the camera CMR is kept on. However, embodiments of the present invention are not limited thereto.

The media uploader 110 divides the media data MD into first to m-th media fragment files MSF1 to MSFm respectively corresponding to successive time sections, and divides the media data MD into first to m-th media fragment files (MSF1 to MSFm). MSF1 to MSFm) may be uploaded to the media storage 120 (m is a natural number equal to or greater than 1). For example, the media uploader 110 may generate first to m-th media fragment files MSF1 to MSFm by dividing the media data MD in units of 10 seconds. In this case, each of the first to mth media fragment files MSF1 to MSFm may be independently played. In an embodiment, each of the first to mth media fragment files MSF1 to MSFm may have a container format MP4.

In an embodiment, the media uploader 110 and the camera CMR are at least one having a function of transmitting the media data MD through the network 105, such as an Internet Protocol (IP) camera, a network video recorder, a web camera, and the like. It can be included as a component of the device of In another embodiment, the media uploader 110 may communicate with the camera CMR via the network 105 . In this case, the camera CMR may be a device having a function of transmitting the media data MD through the network 105 .

Although one media storage 120 is illustrated in FIG. 1 , embodiments of the present invention are not limited thereto. For example, the media uploader 110 may upload the first to mth media fragment files MSF1 to MSFm to a plurality of media storages.

The media uploader 110 generates first to mth meta data sets MDST1 to MDSTm respectively corresponding to the first to mth media fragment files MSF1 to MSFm. The media uploader 110 uploads the generated first to mth meta data sets MDST1 to MDSTm to the media management server 130 .

Each of the first to mth meta data sets MDST1 to MDSTm may indicate properties of a corresponding media fragment file. For example, each meta data set may include information such as a time interval, a frame rate, a resolution, a file size, and a codec as properties. Each of the first to mth meta data sets MDST1 to MDSTm may include information on content of a corresponding media fragment file. For example, each metadata set may include information such as a thumbnail and an event type as information about content. For example, each metadata set may include information associated with an address where a corresponding media fragment file is stored, for example, a uniform resource locator (URL).

User terminal 140 communicates with media storage 120 and media management server 130 via network 105 . The user terminal 140 includes a personal computer (PC), a desktop computer, a laptop computer, a portable computer, a personal digital assistant (PDA), a smart phone, a tablet PC, a video At least one device capable of downloading and playing the first to m-th media fragment files MSF1 to MSFm through the network 105 such as a game device may be included.

The user terminal 140 first accesses the media management server 130 . The user terminal 140 requests the media management server 130 for metadata sets of the selected time interval. For example, a time interval may be selected by a user input. As another example, the time section may be selected by a command provided from or included in the user terminal 140 . In this case, the selected time interval may include a continuous time interval. As another example, the selected time interval may include consecutive time intervals that are separated from each other.

The user terminal 140 receives at least some of the first to mth meta data sets MDST1 to MDSTm. Based on each of the received metadata sets, an address on the network 105 in which the corresponding media fragment file is stored, for example, a URL may be specified. Such a URL may point to media storage 120 . In this way, the user terminal 140 downloads and plays the media fragment files specified by the received meta data sets from the media storage 120 .

The media storage 120 and the media management server 130 communicate with the network 105 based on at least one communication protocol, for example, Hypertext Transfer Protocol (HTTP), File Transfer Protocol (FTP).

The media storage 120 receives the first to m-th media fragment files MSF1 to MSFm from the media uploader 110 , and responds to a request from the user terminal 140 to create the first to m-th media fragment files. At least some of (MSF1 to MSFm) may be transmitted.

The media management server 130 receives the first to mth meta data sets (MDST1 to MDSTm) from the media uploader 110 , and responds to a request from the user terminal 140 , the first to mth meta data sets At least some of the ones (MDST1 to MDSTm) may be provided.

2 is a flowchart illustrating an operation method of the media uploader 110 according to an embodiment of the present invention.

1 and 2 , in step S110 , the first to mth media fragment files MSF1 to MSFm obtained in successive time intervals are uploaded to the media storage 120 . For example, the media uploader 110 divides the media data MD into predetermined time units to create first to m-th media fragment files MSF1 to MSFm, and stores them in the media storage 120 . can be uploaded.

In step S120 , first to mth metadata sets MDST1 to MDSTm corresponding to the uploaded first to mth media fragment files MSF1 to MSFm, respectively, are generated. After the first to mth media fragment files MSF1 to MSFm are successfully uploaded, the media uploader 110 may generate a metadata set indicating properties of each media fragment file. Each metadata set may be associated with an address of each media fragment file stored in the media storage 120 .

In step S130 , the generated first to mth meta data sets MDST1 to MDSTm are uploaded to the media management server 130 .

3 is a flowchart illustrating an operation method of the media management server 130 according to an embodiment of the present invention. 4 is a conceptual diagram illustrating an embodiment MDST of any one of the first to mth meta data sets MDST1 to MDSTm stored in the media management server 130 .

1 and 3 , in step S210 , first to mth meta data sets MDST1 to MDSTm provided from the media uploader 110 are stored. Each metadata set includes properties of the corresponding media fragment file. Referring to FIG. 4 , the metadata set MDST includes an ID of the media uploader 110 (Media Uploader ID), an ID of a media fragment file (Media Segment File ID), and a timestamp at which the media fragment file is obtained. , the duration of the media fragment file, the resolution of the media fragment file, the size of the media fragment file (File Size), the container format of the media fragment file, and the video codec of the media fragment file (Video). codec) and an audio codec (Audio Codec). Here, the timestamp and the playback time indicate a time period in which the media fragment file was obtained.

In an embodiment, an address, eg, a URL, at which a media fragment file is stored may be specified using attributes included in the meta data set (MDST). For example, an address in which a media fragment file is stored may be generated using attributes included in the meta data set MDST according to a predetermined method. In an embodiment, the meta data set (MDST) may further include a URL where the media fragment file is stored. That is, the meta data set (MDST) is associated with the address where the media fragment file is stored.

Referring back to FIG. 3 , in step S220 , it is determined whether a request message indicating the selected time period is received from the user terminal 140 . If so, step S230 is performed.

In step S230 , metadata sets corresponding to the selected time period are fed back to the user terminal 140 . The media management server 130 may search for a meta data set having a time section belonging to a selected time section from among the first to mth meta data sets MDST1 to MDSTm. The media management server 130 transmits the retrieved metadata sets to the user terminal 140 .

Thereafter, as described with reference to FIG. 1 , the user terminal 140 may play the media fragment files while sequentially downloading them from the media storage 120 with reference to the received metadata sets.

According to an embodiment of the present invention, the downloaded media fragment files are files in which the media data MD is divided. The user terminal 140 plays the media fragment files of the selected time section, but downloads the next media fragment file while the previous media fragment file is being played, so that when the playback of the previous media fragment file is completed, there is no initial time delay. You can start playing the next media fragment file. In addition, since each media fragment file has a container format such as MP4, for example, it can be independently downloaded and played back. Accordingly, without introducing a streaming server function for transmitting media in a streaming manner to the media storage 120 and a streaming client function for receiving media in a streaming manner in the user terminal 140 , the user terminal Unit 140 may continuously play the media corresponding to the selected time period within a short time from the time when the playback is requested. Accordingly, the user terminal 140 can efficiently reproduce the media corresponding to the selected time period, and resources in the network system 100 required for this can be reduced.

Meanwhile, the time period selected by the user terminal 140 may be variously changed. If the plurality of media fragment files MSF1 to MSFm correspond to one meta data set, the user terminal 140 is configured to display the above data even if the selected time interval corresponds to some of the plurality of media fragment files MSF1 to MSFm. All media fragment files MSF1 to MSFm may be sequentially downloaded according to the metadata set. This may mean that a relatively long time is required to play the media of the selected time period. Alternatively, if the user terminal 140 processes information included in the received meta data set according to a predetermined method to determine media fragment files corresponding to the selected time period, the user terminal 140 performs the processing according to the predetermined method. It should include an additional module supporting the processing according to this, which means that compatibility with the user terminal 140 is relatively low.

According to an embodiment of the present invention, the media management server 130 stores a plurality of metadata sets MDST1 to MDSTm respectively corresponding to the plurality of media fragment files MSF1 to MSFm. The media management server 130 provides metadata sets corresponding to the selected time period to the user terminal 140 . This enables the user terminal 140 to play the desired media only by downloading and playing the media fragment files from addresses (eg, 120 in FIG. 1 ) respectively corresponding to the received meta data sets. . Accordingly, while compatibility with the user terminal 140 is improved, the time required for the user terminal 140 to play media in the selected time period may be relatively reduced. Furthermore, by appropriately changing the order of the metadata sets provided to the user terminal 140 , the order of the media fragment files reproduced in the user terminal 140 may also be flexibly changed while maintaining the compatibility.

5 is a flowchart illustrating an operation method of the media management server 130 according to another embodiment of the present invention. 6 is a conceptual diagram illustrating another embodiment MDST′ of any one of the first to mth metadata sets MDST1 to MDSTm stored in the media management server 130 .

Referring to FIG. 5 , in step S310 , first to mth meta data sets MDST1 to MDSTm provided from the media uploader 110 are stored. The first to mth meta data sets MDST1 to MDSTm correspond to the first to mth media fragment files MSF1 to MSFm, respectively. Referring to FIG. 6 , the meta data set MDST' further includes information about content, for example, an event type indicated in the content of the media fragment file when compared to the meta data set MDST of FIG. 4 . do. For example, as the event type, various types such as motion detection, audio detection, face detection, body detection, fire detection, crying sound detection, gun sound detection, and shock sound detection may be defined. The event type field of the meta data set MDST' may indicate at least one of various types. The media uploader 110 and/or the camera CMR detects an event appearing in the content using various methods known in the art, determines the event type, and includes the event type in the metadata set MDST'. can

Referring back to FIG. 5 , in step S320 , it is determined whether a request message is received from the user terminal 140 . If so, step S330 is performed. When the user selects one of various event types, the user terminal 140 may include the selected event type in the request message. Accordingly, in step S330, it is determined whether the request message includes the selected event type as well as the selected time period. If so, step S340 is performed. If not, step S350 is performed.

In step S340 , the metadata sets having the selected event type among the metadata sets corresponding to the selected time period are fed back. This may enable the user terminal 140 to play the media of the selected time period and the selected event type by downloading and playing the media fragment files from addresses respectively corresponding to the received meta data sets.

In step S350 , the metadata sets corresponding to the selected time period are fed back to the user terminal 140 .

7 is a flowchart illustrating a method of reproducing media fragment files in the user terminal 140 according to an embodiment of the present invention.

Referring to FIG. 7 , in step S410, a time interval is selected. For example, a time interval may be selected by a user input. As another example, the time section may be selected by a command provided from or included in the user terminal 140 . In this case, the selected time interval may include a continuous time interval. As another example, the selected time interval may include consecutive time intervals that are separated from each other. In addition, an event type may be further selected. In step S420 , the user terminal 140 transmits a request message to the media management server 130 . In step S430 , the media management server 130 feeds back corresponding metadata sets in response to the request message. If the selected time interval is a continuous time interval, sequential k to nth meta data sets (MDSTk to MDSTn) may be provided to the user terminal 140 as shown in FIG. 7 (where k is greater than 1). a natural number greater than or equal to, n is a natural number less than or equal to m). If the selected time interval includes consecutive time intervals separated from each other, the metadata sets provided to the user terminal 140 may not be sequential. For example, kth to pth meta data sets MDSTk to MDSTp and q to nth meta data sets MDSTq to MDSTn may be provided to the user terminal 140 (where p is greater than n). small natural number, where q is a natural number greater than p and less than n). Hereinafter, for convenience of description, it is assumed that sequential k to nth meta data sets MDSTk to MDSTn are provided to the user terminal 140 .

In step S440 , the user terminal 140 downloads and plays the media fragment files MSFk to MSFn respectively corresponding to the received metadata sets.

In an embodiment, an application driven by the user terminal 140 may perform operations described with reference to FIGS. 7 to 9 and 15 . An application driven by the user terminal 140 may perform commands that cause the above operations. In an embodiment, the commands may be received from an external network server 150 (refer to FIG. 1 ). For example, when an application such as a web browser of the user terminal 140 accesses the network server 150 , the network server 150 may provide the above commands. In addition, the application of the user terminal 140 may perform the operations described with reference to FIGS. 7 to 9 and FIG. 15 by executing the provided commands. In another embodiment, the user terminal 140 may store and run a dedicated application for performing the operations described with reference to FIGS. 7 to 9 and 15 . In this case, a dedicated application may include the above instructions. In this case, the network server 150 may be a server for providing the dedicated application.

8 is a flowchart illustrating step S440 of FIG. 7 in more detail.

Referring to FIG. 8 , in step S510 , the kth media fragment file MSFk starts to be played. In an embodiment, the media fragment file may be based on MP4. The user terminal 140 may support a function of playing the downloaded media fragment file in parallel with the download of the media fragment file.

In step S520, it is determined whether the k-th media fragment file MSFk is the last media fragment file. If not, step S530 is performed.

In step S530, up to the first part of the k-th media fragment file MSFk is played. In step S540 , a part of the k+1th media fragment file MSFk+1 is downloaded while the remaining second part of the kth media fragment file MSFk is played. That is, the download of the k+1th media fragment file MSFk+1 is performed in parallel with playback of the second part of the kth media fragment file MSFk.

In step S550, playback of up to the second part of the k-th media fragment file MSFk is completed. Thereafter, the k+1th media fragment file (MSFk+1) starts to be played (S560).

According to an embodiment of the present invention, a part of the k+1th media fragment file MSFk+1 is downloaded while the remaining second part of the kth media fragment file MSFk is played. A part of the downloaded k+1th media fragment file (MSFk+1) will be loaded into the internal memory of the user terminal 140 . Considering that the downloaded data4 is a part of the media fragment file in which the media data (MD) is divided, the space of the internal memory required to load the downloaded data may be relatively small. Furthermore, since a part of the k+1th media fragment file (MSFk+1) is loaded in the internal memory, the k+1th media fragment file (MSFk+1) is the k+1th media fragment file (MSFk+1) when the reproduction of the kth media fragment file (MSFk) is completed. It can be played at any point in time with no start delay. Accordingly, media fragment files can be continuously played while using a relatively small amount of internal memory.

9 is a flowchart illustrating an embodiment of step S540 of FIG. 8 . The steps described below with reference to FIG. 9 are performed while the remaining second part of the k-th media fragment file MSFk is reproduced in a visible state.

Referring to FIG. 9 , in step S541, the k+1th media fragment file (MSFk+1) is played in a hidden state. Additionally, the k+1th media fragment file MSFk+1 may be played in a muted state. By causing the application of the user terminal 140 to execute a command to play the k+1th media fragment file MSFk+1, the k+1th media fragment file MSFk+1 may be played while being downloaded.

In step S542, it is determined whether the k+1th media fragment file (MSFk+1) has been reproduced by a predetermined portion. Steps S541 and S542 are repeated until the k+1th media fragment file (MSFk+1) is reproduced by a predetermined portion.

In step S543, playback of the k+1th media fragment file (MSFk+1) is stopped. By causing the application of the user terminal 140 to execute a command to stop playback, the download for the k+1th media fragment file MSFk+1 may be stopped. By performing steps S541 to S543, the user terminal 140 may download a part of the k+1th media fragment file MSFk+1. For example, a part of the downloaded k+1th media fragment file MSFk+1 may be loaded into the internal memory of the user terminal 140 .

In step S544, the progress point of the k+1th media fragment file (MSFk+1) is set to 0. Thereafter, when the reproduction of the kth media fragment file MSFk is completed, the user terminal 140 reproduces the k+1th media fragment file MSFk+1 in a visible state from the set progress time point. Accordingly, playback of the k+1th media fragment file MSFk+1 may be started at substantially the same time point as when the playback of the kth media fragment file MSFk is completed without start delay.

10 to 14 are conceptual diagrams illustrating some steps of downloading and playing the kth media fragment file (MSFk) and the k+1th media fragment file (MSFk+1). 10 to 14 , a downloaded portion of the media fragment file is indicated by a solid line, and a portion of the media fragment file that has not yet been downloaded is indicated by a dotted line.

First, referring to FIG. 10 , the k-th media fragment file MSFk is downloaded and played in a visible state. The kth media fragment file MSFk is being played back at the first progress point T1. The kth media fragment file MSFk includes a first part MSFk_1 and a second part MSFk_2. The first progress time point T1 is located in the first part MSFk_1 . The download for the k+1th media fragment file (MSFk+1) has not yet started.

The first image IMG1 shows an image displayed on the user terminal 140 when the k-th media fragment file MSFk is played back at the first progress time T1 .

Subsequently, referring to FIG. 11 , the k-th media fragment file MSFk is continuously downloaded and reproduced in a visible state. The kth media fragment file MSFk is being played back at the second progress point T2. The second progress time point T2 is located in the second part MSFk_2 of the kth media fragment file MSFk. When the second part MSFk_2 of the kth media fragment file MSFk is reproduced, the k+1th media fragment file MSFk+1 may be reproduced in a hidden state and a mute state for a predetermined time. Accordingly, a part PDWN of the k+1th media fragment file MSFk+1 may be downloaded and loaded into the internal memory. In an embodiment, since the download speed is faster than the playback speed, the pre-downloaded part (PDWN) of the k+1th media fragment file (MSFk+1) has a hidden state of the k+1th media fragment file (MSFk+1) and It may be longer than the part played in muted state.

The second image IMG2 shows an image displayed on the user terminal 140 when the kth media fragment file MSFk is played back at the second progress time T2, and the third image IMG3 shows the kth media fragment file MSFk. Shows an image displayed in a hidden state when the +1 media fragment file (MSFk+1) is played back at the third progress point T3. In this case, as shown in FIG. 11 , the position on the display where the k+1th media fragment file MSFk+1 is reproduced may overlap with the position where the kth media fragment file MSFk is reproduced.

Referring to FIG. 12 , the k-th media fragment file MSFk is continuously played until the fourth progress time T4, and the playback of the k-th media fragment file MSFk is completed. On the other hand, after the k+1th media fragment file (MSFk+1) is reproduced in the hidden state and muted state for a predetermined time, the progress time of the k+1th media fragment file MSFk+1 is 0, that is, the 5 may be set to a progress time point T5. And, until the reproduction of the kth media fragment file MSFk is completed, the reproduction of the k+1th media fragment file MSFk+1 may be held.

The fourth image IMG4 shows an image displayed on the user terminal 140 when the k-th media fragment file MSFk is played back at the fourth progress time T4, and the fifth image IMG5 shows the k-th media fragment file MSFk. +1 Shows an image displayed in a hidden state when playback of the media fragment file MSFk+1 is held at the fifth progress time T5. Considering that the kth media fragment file (MSFk) and the k+1th media fragment file (MSFk+1) have consecutive time sections, the fourth image IMG4 and the fifth image IMG5 are similar to each other or may be substantially the same. If time sections of the kth media fragment file MSFk and the k+1th media fragment file MSFk+1 are not consecutive, the fourth image IMG4 and the fifth image IMG5 may be different from each other.

Referring to FIG. 13 , while the pre-downloaded part PDWN of the k+1th media fragment file MSFk+1 is played in a visible state, the k+1th media fragment file MSFk+1 continues to be downloaded. The sixth progress time T6 is located in the pre-downloaded part PDWN of the k+1th media fragment file MSFk+1.

The sixth image IMG6 shows an image displayed on the user terminal 140 when the k+1th media fragment file MSFk+1 is played back at the sixth progress time T6.

Referring to FIG. 14 , the k+1th media fragment file (MSFk+1) is continuously played in a visible state. The seventh image IMG7 shows an image displayed on the user terminal 140 when the k+1th media fragment file MSFk+1 is reproduced at the seventh progress time T7. The k+1th media fragment file MSFk+1 may include a first part MSFk+1_1 and a second part MSFk+1_2. Although not shown, when the k+1th media fragment file (MSFk+1) is continuously played and the progress point is located in the second part (MSFk+1_2), the k+2th media fragment file (MSFk+2) It can be played back in a hidden state and a mute state for this predetermined time.

15 is a flowchart illustrating an operation method of the media management server 130 according to another embodiment of the present invention.

Referring to FIG. 15 , in step S610 , a change request for an event type of at least one metadata set is received from the user terminal 140 . As described above, the user terminal 140 may download and play the media fragment files based on the metadata sets provided from the media management server 130 . In this case, the user terminal 140 may receive a user input for changing at least one event type among the provided metadata sets. For example, when the user terminal 140 plays the media fragment files of the selected time period and the selected event type, the user may determine that at least one media fragment file to be played does not correspond to the selected event type. In this case, the user may provide an input for changing the event type. When the user provides an input for changing the event type, the user terminal 140 may request the media management server 130 to change the event type of the corresponding metadata set.

In step S620 , the media management server 130 may update the corresponding metadata set to have the requested event type (see MDST' and Event Type in FIG. 6 ).

Accordingly, the reliability of the event type in the metadata set stored in the media management server 130 may be improved. When the user terminal 140 or another user terminal requests metadata sets corresponding to the selected event type as well as the selected time period as described with reference to FIG. 5 , the media management server 130 provides the metadata set with improved reliability. can provide

16 is a block diagram illustrating an exemplary computer system 1000 for implementing a user terminal 140 .

Referring to FIG. 16 , the computer system 1000 includes a processor 1100 , a memory 1200 , Memory, a nonvolatile storage medium 1300 , a communicator 1400 , a Communicator, and a display 1500 , Display ), and a user interface 1600 (User Interface).

The processor 1100 may run an application that executes instructions that cause operations described with reference to FIGS. 7 to 9 and 15 . The processor 1100 may drive the application by loading program codes corresponding to the application and executing the loaded program codes.

The memory 1200 may include at least one of various types of memories such as static RAM (SRAM), dynamic RAM (DRAM), and synchronous DRAM (SDRAM). In an embodiment, the memory 1200 may be used to download and play the k-th to n-th media fragment files MSFk to MSFn of FIG. 7 . In an embodiment, the memory 1200 may be used as a working memory of the processor 1100 . In another embodiment, the processor 1100 may include a working memory that is distinct from the memory 1200 .

The nonvolatile storage medium 1300 may include various types of storage media that retain stored data even when power is cut off, for example, storage media such as a flash memory and a hard disk.

The communicator 1400 (or transceiver) sends and receives signals between the computer system 1000 and other devices over the network 105 .

The display 1500 displays information processed by the computer system 1000 under the control of the processor 1100 . For example, the display 1500 displays the first to seventh images IMG1 to IMG7 illustrated in FIGS. 1 to 14 .

The user interface 1600 detects a user's input for controlling the operation of the computer system 1000 and generates corresponding input data. The user interface 1600 may include a keypad, a mouse, a fingerprint recognition sensor, a dome switch, a touch pad, which can detect a command or information by a user's manipulation. It may include an input device such as a jog wheel.

17 is a block diagram illustrating an exemplary server system 2000 for implementing media management server 130 and/or network server 150 .

The server system 2000 includes a communicator 2100, Communicator, a processor 2200, Processor, and a database 2300, Database. The communicator 2100 transmits and receives signals between the server system 1000 and other devices connected to the network 105 . The processor 2200 may transmit data stored in the database 2300 to the user terminal 140 (refer to FIG. 1 ) through the communicator 2100 . For example, when a web browser of the user terminal 140 accesses the server system 2000 , the server system 2000 may provide instructions to the user terminal 140 from the database 2300 to be executed by the web browser. . The web browser of the user terminal 140 may perform the operations described with reference to FIGS. 7 to 9 and 15 by executing the provided commands. For example, the server system 2000 may provide a dedicated application from the database 2300 to the user terminal 140 . The dedicated application of the user terminal 140 may perform operations described with reference to FIGS. 7 to 9 and FIG. 15 .

Although FIG. 17 shows that the server system 2000 includes the database 2300, embodiments of the present invention are not limited thereto. For example, the server system 2000 may access a database located externally through the network 105 using the communicator 2100 .

Although specific embodiments and application examples have been described herein, these are provided only to help a more general understanding of the present invention, and the present invention is not limited to the above embodiments, and those of ordinary skill in the art to which the present invention pertains Various modifications and variations are possible from this substrate as it grows.

Therefore, the spirit of the present invention should not be limited to the described embodiments, and not only the claims to be described later, but also all those with equivalent or equivalent modifications to the claims will be said to belong to the scope of the spirit of the present invention. .

110: media uploader
120: media source
130: media management server
140: user terminal
150: network server
MD: media data
MSF1-MSFm: 1st to mth media fragment files
MDST1 to MDSTm: first to mth meta data sets

Claims (36)

delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete A system for playing media through real-time streaming, comprising:
The media data is divided into first to m-th media fragment files respectively corresponding to successive time sections, and first meta data corresponding to the first to m-th media fragment files, respectively. generating sets to mth meta data sets, transmitting the first media fragment file to the mth media fragment files to a media storage, and sending the first meta data set to the mth meta data sets to a media management server a media uploader;
Receives a request for at least one metadata set related to a specific time interval among the first to mth metadata sets from a user terminal, and transmits at least one metadata set related to the specific time interval to the user Media management server for transmitting to the terminal;
a media storage for receiving a request for at least one media fragment file corresponding to the at least one metadata set from the user terminal, and transmitting the at least one media fragment file to the user terminal in response to the request; and
and a user terminal configured to sequentially receive at least one media fragment file received from the media storage based on the at least one metadata set received from the media management server, and play the received at least one media fragment file. but,
The first to the mth meta data sets are transmitted to the media management server after the first to the mth media fragment files are transmitted to the media storage,
The system of claim 1, wherein each of the first meta data set to the mth meta data set includes information related to an address at which a corresponding media fragment file is stored. 18. The method of claim 17,
The first media fragment file to the mth media fragment file are acquired at successive time intervals,
Each of the first to mth meta data sets includes information indicating a time interval of a corresponding media fragment file,
the first to mth meta data sets are respectively associated with at least one characteristic of the first to the mth media fragment files,
wherein the at least one characteristic comprises a selected time interval. 18. The method of claim 17,
the at least one characteristic comprises a selected event type;
each of the first to mth metadata sets includes an event type of a corresponding media fragment file, and wherein the at least one metadata set has a selected event type. 18. The method of claim 17,
The system in which the first media fragment file to the mth media fragment file are divided in predetermined time units. The method of claim 20, wherein the media management server,
A system for searching for a metadata set related to the specific time interval from among the first to the mth metadata sets.

delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete

Images