KR100926420B1 - Method For Indexing Of Play Position Of Streaming File And Portable Terminal Having The Same - Google Patents

Abstract

Disclosed are a playback position indexing method of a streaming file capable of playing a streaming file from a user's desired position, and a portable terminal having a playback position indexing function of a streaming file. A wireless transceiver for receiving a streaming file from the streaming content server and transmitting a playback control signal of the streaming file to the streaming content server, and transmitting a playback time and a playback control signal to the streaming content server based on preset indexing criteria. And a control unit for generating a playback position index using the provided streaming data. Therefore, the user can easily select the playback position, and the user can play the streaming file from the desired position.

Handhelds, Indexing, Streaming, VOD

Description

Method for Indexing Of Play Position Of Streaming File And Portable Terminal Having The Same}

The present invention relates to a portable terminal, and more particularly, to a portable terminal having a playback position indexing method of a streaming file and a playback position indexing function of a streaming file applicable to a portable terminal having a playback function of a streaming file. will be.

With the commercialization of the video call service, it is possible to make a call while looking at the other party's appearance using a portable terminal, away from the existing voice and short message-oriented calls. Downlink Packet Access) service has been commercialized.

In addition, in recent years, the mobile Internet service has been commercialized, so that the user can use the Internet at high speed on the go by using a portable terminal, and the user can stream such as video on demand (VOD) through the mobile Internet service. ) The service is available.

In general, when using a streaming service using a mobile terminal, when a user first connects to a streaming server where content is stored and selects a predetermined content to play, the selected content is downloaded to the user's portable terminal in real time and playback of the downloaded content is performed. Begins.

Here, when the streaming content is played, if the reception speed is faster than the transmission speed of the content, data of a predetermined size is buffered and reproduced in order to prevent a playback error due to a difference in the transmission and reception speed of the content.

In the conventional streaming service as described above, since the content is downloaded in real time from the streaming server, and the content is played after buffering the downloaded data by a predetermined size, it is not easy to play the content from a desired location or scene. There are disadvantages.

For example, if you play a video with a total playing time of one hour through a streaming service, if the video is played for about 30 minutes and then stops playing and then plays again after a predetermined time has elapsed, the video is restarted from the beginning. In order to find the position that the user has watched because it is played back, it is necessary to repeat the fast forward (FF) and / or rewind (REW) to find the desired playback position, and when performing the fast forward and / or rewind, Since buffering is performed every time, the reproduction delay time becomes long, which makes the use uncomfortable.

Accordingly, a first object of the present invention is to provide a playback position indexing method of a streaming file that enables a user to play a streaming file from a desired position.

In addition, a second object of the present invention is to provide a portable terminal having a playback position indexing function of a streaming file that allows a user to play the streaming file from a desired position.

In accordance with an aspect of the present invention, there is provided a method of indexing a playback position of a streaming file, the method including: transmitting playback start information and a playback control signal to a streaming content server based on a predetermined indexing criterion; And receiving streaming data corresponding to the playback start information from the streaming content server and generating a playback position index by using the provided streaming data. Generating a playback position index by using the provided streaming data may include generating a screenshot by decoding the streaming data provided from the streaming content server, and storing a playback time of the generated screenshot and the generated screenshot. It may include the step. The play position index may include at least one screen shot generated by the preset indexing criteria and a play time of each of the at least one screen shot. The indexing criterion may be any one of a predetermined time interval and a predetermined number of times set by a user. The play position indexing method of the streaming file may further include storing the generated play position index and reading and displaying the stored play position index when a predetermined streaming file corresponding to the stored play position index is selected. Can be.

In addition, a portable terminal having a playback position indexing function of a streaming file according to an aspect of the present invention for achieving the second object of the present invention receives the streaming file from a streaming content server, the playback control signal of the streaming file Transmits a playback start information and a playback control signal to the streaming content server based on a wireless transceiver for transmitting the streaming content server to a streaming content server and a predetermined indexing criterion, and uses the streaming data provided from the streaming content server to generate a playback position index. It includes a control unit for generating. The control unit may generate a screenshot by decoding the streaming data provided from the streaming content server. The play position index may include at least one screen shot generated by the preset indexing criteria and a play time of each of the at least one screen shot. The indexing criterion may be any one of a predetermined time interval and a predetermined number of times set by a user. The controller may store the generated reproduction position index and read and display the stored reproduction position index when a predetermined streaming file corresponding to the stored reproduction position index is selected. The controller may display the generated playback position index, and when a predetermined playback position is selected from the displayed playback position index, the controller may transmit a playback time and a playback control signal corresponding to the selected playback position to the streaming content server.

According to the portable terminal having the playback position indexing method of the streaming file as described above and the playback position indexing function of the streaming file, the playback time and the playback control signal are transmitted to the streaming content server based on the indexing setting criteria set by the user. After generating a screenshot using the streaming data provided from the streaming content server, the generated location and indexing time of the screen shot are displayed on the display unit to perform playback position indexing of the streaming file.

Therefore, the user can easily select the playback position, and the user can play the streaming file from the desired position. In addition, since the user can easily select a desired position and play the streaming file from the selected position, unnecessary buffering of the streaming file can be reduced, thereby reducing the playback latency of the streaming file.

As the present invention allows for various changes and numerous embodiments, particular embodiments will be illustrated in the drawings and described in detail in the written description.

However, this is not intended to be limited to the specific embodiment of the present invention, it should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present invention.

Hereinafter, with reference to the accompanying drawings, it will be described in detail a preferred embodiment of the present invention. Hereinafter, the same reference numerals are used for the same components in the drawings, and duplicate descriptions of the same components are omitted.

Terms such as first and second may be used to describe various components, but the components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as the second component, and similarly, the second component may also be referred to as the first component. The term and / or includes a combination of a plurality of related items or any item of a plurality of related items.

1 is a block diagram illustrating a configuration of a portable terminal having a playback position indexing function of a streaming file according to an embodiment of the present invention.

Referring to FIG. 1, a portable terminal according to an embodiment of the present invention includes a wireless transceiver 110, a controller 120, a storage 130, a display 140, a key input 150, and a speaker 160. ) And microphone 170.

The wireless transceiver 110 may include a duplexer, a high frequency processor, and an intermediate frequency processor, and may receive a radio frequency (RF) induced by an antenna through a duplexer and receive the received radio frequency signal at an intermediate frequency. After converting to a baseband signal and converting it to a baseband signal and providing it to the control unit 120, and converts the baseband signal provided from the control unit 120 to an intermediate frequency and then converts the signal of the intermediate frequency into a radio frequency signal again. To the antenna through the duplexer.

Alternatively, the wireless transceiver 110 directly demodulates a direct signal from a received high frequency signal without frequency conversion, instead of a heterodyne reception method for demodulating the high frequency signal into a baseband signal through intermediate frequency conversion. You can also use the method.

In particular, the wireless transmission and reception unit 110 receives predetermined streaming data from the streaming content server when the streaming file is played and provides it to the control unit 120, and provides a streaming file reproduction control signal provided from the control unit 120 to the streaming content server. do.

The controller 120 performs control and processing for performing a voice call and a unique function of the portable terminal. To this end, the controller 120 may include a baseband processor for processing the baseband signal provided from the wireless transceiver 110, and may include a vocoder for digital processing of the transmitted and received voice. have.

The control unit 120 provides a user interface for indexing the playback position of the streaming file to the user through the display unit 140 and performs the playback position indexing of the streaming file based on the indexing criteria set by the user. In addition, the indexed result is stored in the storage 130 and displayed on the display 140 so that the streaming file can be played from a desired playback position desired by the user.

The controller 120 includes a multimedia playback module 121 and an indexing module 123 for playing the streaming file and indexing the play position of the streaming file.

The multimedia playback module 121 includes at least one codec and plays various multimedia files in a video, music, and streaming format.

When the multimedia event module 121 receives a key event signal for controlling the playback of the streaming file from the key input unit 150, the multimedia playback module 121 transmits a control signal corresponding to the key event signal for controlling the playback. ) To the streaming content server. The key event signal for controlling the playback of the streaming file may be, for example, Play, Stop, Fast Forward, Rewind, Pause, etc. It can be the same control signal.

In addition, the multimedia playback module 121 receives predetermined streaming data from the streaming content server through the wireless transmission / reception unit 110 in the process of indexing the playback position of the multimedia file, and generates a predetermined image frame using the provided streaming data. The generated image frame is provided to the indexing module 123. Here, the predetermined image frame refers to a screen shot of capturing a reproduction screen of a predetermined time.

When the indexing process for the playback position of the multimedia file is finished by the indexing module 123, the multimedia playback module 121 receives the playback position index of the multimedia file from the indexing module 123 and displays the playback position index. Display through 140.

In addition, when the user selects a predetermined playback position from the playback position index displayed on the display unit 140, the multimedia playback module 121 transmits the selected playback position information (eg, playback start time) to the wireless transceiver unit ( By providing to the streaming content server through the 110, the streaming file is played from the location selected by the user.

The indexing module 123 provides a user with a setting menu of indexing criteria for indexing the playback position of the streaming file through the user interface, and performs the playback position indexing of the streaming file based on the indexing criteria set by the user. Here, the indexing criteria may be, for example, a predetermined time interval or a predetermined number of times.

In addition, the indexing module 123 stores the performed playback position index in the storage 130 and simultaneously provides the multimedia playback module 121 to be displayed on the display.

For example, when the user sets indexing criteria at predetermined time intervals, the indexing module 123 transmits the reproduction start information and the reproduction control signal including the time information corresponding to the predetermined predetermined time interval to the streaming content server.

Thereafter, the indexing module 123 receives the video frame corresponding to the predetermined time interval from the multimedia playback module 121 and stores the provided video frame and the playback time corresponding thereto, that is, the playback time of the video frame in the storage unit 130. Save it. Here, the multimedia playback module 121 receives the streaming data corresponding to the predetermined time interval from the streaming content server, generates an image frame, that is, a screenshot, and provides the indexing module 123 with the received data.

The indexing module 123 may provide the playback position index to the multimedia playback module 121 to be displayed on the display 140 when indexing of the playback position of all streaming files is completed by the indexing criteria set by the user.

In addition, the indexing module 123 stores the playback position index for the predetermined streaming file, and when the user selects the playback of the indexed streaming file, the playback position index corresponding to the streaming file selected by the user in the storage unit 130. By reading the and providing the same to the multimedia playback module 121, the playback position index of the streaming file is quickly displayed without performing duplicate indexing on the same streaming file.

The multimedia playback module 121 may be implemented as a software program and configured to be executed by a processor (for example, a baseband processor) included in the controller 120 or a processor (for example, an application processor) separately provided. May be configured to perform.

In addition, the indexing module 123 may be implemented as a software program so that a processor included in the controller 120 or a processor separately provided may perform a playback position indexing function of the streaming file.

In addition, the multimedia playback module 121 and the indexing module 123 may be configured as one software program so that a processor included in the controller 120 or a processor provided separately may be executed. And a separate processor chip that performs an indexing function.

The storage unit 130 may be a nonvolatile memory such as a flash memory, an electrically erasable and programmable read only memory (EEPROM), a system program (eg, an operating system) and / or required for basic operation of the portable terminal. Other applications are saved. In addition, the storage unit 130 may store data input by a user, and may store data generated during execution of the system program and / or application program.

In particular, the storage unit 130 stores at least one image frame (ie, screenshot) and a corresponding time generated during the indexing of the playback position of the streaming file, and when the playback position indexing process of the streaming file is completed. The playback position index of the streaming file is stored.

The display unit 140 may be, for example, a display device such as a liquid crystal display (LCD) or an organic light emitting diode (OLED), and may be connected to an image signal provided from the controller 120. On the basis of this, a user interface such as a menu, an operation state, an application program execution screen, etc. of the portable terminal is displayed.

In particular, the display 140 receives and displays a series of image frames for playing the streaming file from the multimedia playback module 121 when the predetermined streaming file is played. In addition, the graphics processor displays a playback position index for the predetermined streaming file provided from the multimedia playback module 121.

The key input unit 150 includes a plurality of numbers, character input keys, and function keys for performing a special function, and provides a corresponding key input signal to the controller 120 when a key manipulation occurs by the user.

In particular, the key input unit 150 provides the control unit 120 with a key event signal corresponding to the manipulated key when a key for controlling the playback of the streaming file is manipulated by the user when the streaming file is played.

The speaker 160 outputs a voice signal provided from the controller 120 during a voice call, and outputs an audio signal provided from a multimedia playback module as an audio signal in an audio frequency band when the streaming file is played.

The microphone 170 receives a user's voice during a voice call, converts the input voice into an electric signal corresponding thereto, and provides the same to the controller 120.

2 is a flowchart illustrating a playback position indexing process of a streaming file according to an embodiment of the present invention, and FIG. 3 illustrates a user interface screen for executing the indexing reference setting step shown in FIG. 2. FIG. 4 is a conceptual diagram illustrating a playback position indexing process of the streaming file illustrated in FIG. 2.

2 to 4, a user first connects to a streaming content server providing a streaming file and selects a predetermined streaming file to be played (step 201). Here, the streaming content server may be a web server including the reproduction information and the location information of the streaming content, or may be a server for transmitting a streaming file that provides a streaming file.

Next, the indexing module of the controller determines whether a playback position index corresponding to the streaming file selected by the user exists in the storage unit (step 203). If the playback position index corresponding to the streaming file selected by the user exists in the storage unit, the process proceeds to step 215, after reading the playback position index stored in the storage unit and displaying the read playback position index on the display unit.

If it is determined in step 203 that the playback position index corresponding to the streaming file selected by the user does not exist, the indexing module displays the user interface screen as shown in FIG. 3 in order to receive indexing setting criteria from the user. (Step 205).

Here, the indexing setting criterion may be set among time or number of times as shown in FIG. 3. In addition, when the user selects any one of the time or the number of times, a user interface for selecting one of the preset time intervals or the preset number of times or allowing the user to directly set the time interval and the number of times is provided to facilitate indexing setting criteria. To be set.

Next, the indexing module provides the streaming content server with the playback start information and the playback control signal of the streaming file based on the indexing criteria set by the user (step 207). Herein, the playback start information means a playback time of each of at least one screen shot to be indexed according to the indexing criteria set by the user.

The streaming content server provides streaming data corresponding to the file playback time to the multimedia playback module based on the playback start information (ie, file playback time) and playback control information provided from the indexing module, and the multimedia playback module is provided from the streaming content server. The provided streaming data is decoded to generate an image frame corresponding to the reproduction time, that is, a screenshot, and provide the image frame to the indexing module (step 209).

When the indexing module receives the screen shot from the multimedia playback module, the indexing module may pause the transmission of streaming data by transmitting a pause signal as a playback control signal to the streaming content server.

For example, if the user selects a predetermined streaming file whose total playing time is 60 minutes, selects number of times based on the indexing setting, and selects number of times as the number of items of the number, the indexing module selects 60 as shown in FIG. The minutes are divided by 11, and a reproduction time and reproduction control signal having a 327 second interval are transmitted to the streaming content server.

That is, the indexing module transmits 327 seconds of play time information and a Play signal, which is a play control signal, to the streaming content server to acquire the first screen shot. After the first screen shot is generated, the indexing module generates a second screen shot by transmitting the play time information 654 seconds and the play control signal Play signal to the streaming content server to acquire the second screen shot. Repeat this process to create 10 screenshots.

The indexing module then stores the screenshot and the playback time corresponding to the screenshot from the multimedia playback module in the storage (step 211).

Next, the indexing module determines whether indexing is complete (step 213). That is, the indexing module determines whether all screenshots corresponding to the indexing criteria set by the user have been generated, and if it is determined that no screenshots corresponding to the indexing criteria set by the user have been generated, the process returns to step 207 and the By performing the steps sequentially, all screen shots corresponding to the indexing criteria set by the user are generated.

If it is determined in step 213 that all screen shots corresponding to the indexing setting criteria set by the user have been generated, the indexing module reads the playback position index of the streaming file stored in the storage unit and provides the multimedia playback module to display on the display unit. (Step 215).

Before all screen shots corresponding to the index setting criteria set by the user are generated in the playback position indexing process of the streaming file according to the exemplary embodiment of FIG. May be displayed.

5 is a flowchart illustrating a playback process of a streaming file according to an embodiment of the present invention, and FIG. 6 illustrates a user interface screen displaying a playback location index of a streaming file according to an embodiment of the present invention. In FIG. 5, it is assumed that playback position indexing for a predetermined streaming file selected by a user is completed.

5 and 6, first, the portable terminal 100 accesses the streaming content server 300 by using address information (URL: Uniform Resource Locator) of a predetermined streaming file selected by a user (step 401). ).

The streaming content server 300 provides the mobile terminal 100 with content information about the predetermined streaming file through the Session Description Protocol (SDP) so that the portable terminal 100 can access the predetermined streaming file (SDP). Step 403).

Here, the information provided by the streaming content server 300 includes a title of a streaming file, a codec type (eg, H.264, MPEG-4, AAC +, EVRC, QCELP, etc.), a play time, a file size, and the like. Can be.

The controller of the portable terminal 100 provides a setup request signal for initializing a session to the streaming content server 300 using a Real Time Streaming Protocol (RTSP) (step 405), and the streaming content server 300. In response thereto, a session between the portable terminal 100 and the streaming content server 300 is established by providing a setup response signal to the portable terminal 100 (step 407).

Thereafter, the user of the portable terminal 100 selects a desired position (or playback time) for playback using the playback location index of the streaming file displayed on the user interface screen as shown in FIG. 6 (step 409).

The controller of the portable terminal 100 provides a playback time and a playback control signal (eg, Play) corresponding to the playback position (or playback time) selected by the user to the streaming content server 300 using RTSP. In operation 411, the streaming content server 300 transmits the streaming data after the reproduction time to the user datagram protocol (UDP) and the real time protocol (RTP) in response to the reproduction time and the reproduction control signal provided from the portable terminal 100. (I.e., RTP over UDP) to the mobile terminal 100 (step 413).

The portable terminal 100 receives the streaming data after the playback time set by the user from the streaming content server 300, decodes the received streaming data, and plays the received decoding data (step 415).

Thereafter, the portable terminal 100 determines whether playback of the streaming file has ended (step 417), and if it is determined that playback has not ended, the portable terminal 100 returns to step 413 to sequentially perform subsequent steps.

When it is determined that playback is finished, the portable terminal 100 provides a connection release request signal TEARDOWN to the streaming content server 300 (step 419), and the streaming content server 300 is the portable terminal 100. The playback process of the streaming file is terminated by receiving the connection release request signal from the mobile terminal 100 and correspondingly providing the connection release response signal to the portable terminal 100 (step 421).

In an embodiment of the present invention, for example, a method of indexing a playback position of a streaming file is described as being executed in a portable terminal. However, in another embodiment of the present invention, in addition to the portable terminal, it may be executed in various devices having a multimedia playback function such as a TV. Of course you can.

Although described with reference to the embodiments above, those skilled in the art will understand that the present invention can be variously modified and changed without departing from the spirit and scope of the invention as set forth in the claims below. Could be.

1 is a block diagram illustrating a configuration of a portable terminal having a playback position indexing function of a streaming file according to an embodiment of the present invention.

2 is a flowchart illustrating a playback position indexing process of a streaming file according to an embodiment of the present invention.

FIG. 3 illustrates a user interface screen for executing the indexing reference setting step shown in FIG. 2.

FIG. 4 is a conceptual diagram illustrating a playback position indexing process of the streaming file illustrated in FIG. 2.

5 is a flowchart illustrating a playback process of a streaming file according to an embodiment of the present invention.

6 illustrates a user interface screen displaying a playback position index of a streaming file according to an embodiment of the present invention.

<Explanation of symbols for the main parts of the drawings>

100: wireless transceiver 120: control unit

121: multimedia playback module 123: indexing module

130: storage unit 140: display unit

150: key input unit

Claims (11)

In the multimedia processing device having a playback function of streaming files, A wireless transceiver for receiving the streaming file from a streaming content server and transmitting a reproduction control signal of the streaming file to the streaming content server; And And a controller configured to transmit playback start information and a playback control signal to the streaming content server based on a preset indexing criterion, and to generate a playback position index using the streaming data provided from the streaming content server. The indexing criterion is set by any one of a predetermined time interval and a predetermined number of times set by a user, and the playback position index is at least one screenshot and the at least one screenshot automatically generated by the preset indexing criterion. A portable terminal comprising each play time. The method of claim 1, wherein the control unit And decoding the streaming data provided from the streaming content server to generate a screenshot. delete delete The method of claim 1, wherein the control unit And storing the generated reproduction position index and reading and displaying the stored reproduction position index when a predetermined streaming file corresponding to the stored reproduction position index is selected. The method of claim 1, wherein the control unit And displaying the generated reproduction position index and transmitting a reproduction time and a reproduction control signal corresponding to the selected reproduction position to the streaming content server when a predetermined reproduction position is selected among the displayed reproduction position indexes. terminal. In the multimedia processing apparatus having a playback function of the streaming file, the streaming file processing method, Transmitting reproduction start information and a reproduction control signal to the streaming content server based on preset indexing criteria; Receiving streaming data corresponding to the reproduction start information from the streaming content server; Decoding the streaming data provided from the streaming content server to generate a screenshot; And Generating a playback position index by storing the generated screen shot and the playing time of the generated screen shot, The indexing criterion is set by any one of a predetermined time interval and a predetermined number of times set by a user, and the playback position index is at least one screenshot and the at least one screenshot automatically generated by the preset indexing criterion. A playback position indexing method of a streaming file, characterized in that each playback time is included. delete delete delete 8. The method of claim 7, wherein the playback position indexing method of the streaming file is Storing the generated playback position index and if the predetermined streaming file corresponding to the stored playback position index is selected, reading and displaying the stored playback position index, wherein the playback position of the streaming file is further included. Indexing method.

Images