WO2007079631A1

WO2007079631A1 - Method, system and media server to perform caption function

Info

Publication number: WO2007079631A1
Application number: PCT/CN2006/002488
Authority: WO
Inventors: Huangwei Wu
Original assignee: Huawei Technologies Co., Ltd.
Priority date: 2006-01-09
Filing date: 2006-09-22
Publication date: 2007-07-19
Also published as: CN1863278A

Abstract

This invention discloses a method to perform caption function which includes: A. corresponding to media resources, caption resources and the characteristic information of the caption resources are established in a media server; B. the said characteristic information of the caption resources is transmitted to a media player; and C. the media server displays the caption resources designated by the characteristic information of the caption resources on the media player to users, when the media server receives the user’s output request of the media resources transmitted by the media player. The caption function is thus performed in this invention, enabling users to view the synchronous caption as well as the media when needed, advancing the user experience and ensuring the reliability of caption display. This invention also discloses a media server and a system to perform the caption function. The media server includes a module of the characteristic information of the caption resources and an interface module while the system includes the media server and the media player.

Description

A method for implementing subtitle function, 'system and media server

Technical field

The present invention relates to the field of Universal Plug and Play (UPnP) audio video (AV) system technology, and in particular, to a method, a system and a body server for implementing a caption function. Background of the invention

UPnP is a universal plug-and-play technology for home networks. The complete UPnP service system consists of a UPnP-enabled network and UPnP-compliant devices. UPnP transparently connects PCs, various smart devices and wireless devices, and supports network and peer-to-peer auto-discovery. With the development of digital technology, more and more home devices are beginning to support UPnP technology. With UPnP AV system technology, users can easily use the media player that supports the UPnP AV system to play media resources on the media server without any configuration. The UPnP AV architecture defined in the existing UPnP device architecture framework specifies the functions that must be supported by devices that conform to the UPnP AV architecture, including the CDS (Content Directory Service) feature. The media server responds to the media player's browsing request via CDS. ';

The user queries the media resource on the media server through the media player, and selects the media resource to play. Figure 1 is a block diagram of a media player and a media server, which are connected by a home network and communicate using the UPnP protocol.

When playing media resources, users sometimes want to be able to display the subtitles when they are watching media content. For example, when watching a foreign movie, the user wants to display the subtitles synchronously because they cannot understand the foreign language.

In existing media storage and transmission formats, some formats can directly carry subtitle information. For example, in the MKV format, if the media is stored and transmitted in the format, after receiving the media transport stream, the media player can display the subtitles synchronously on the media if the format and subtitle display are supported.

It can be seen that, according to the current standard, the UPnP AV system needs to display subtitles while playing media resources; the storage and transmission format of the media resource must be required to directly carry the subtitle information format. If the storage or transmission format of the media resource cannot be directly With subtitle information, the function of displaying subtitles synchronously cannot be realized.

In addition, even for a media resource whose caption information is directly carried in the storage and transport format, if the caption component and the media file are stored separately, the function of synchronously displaying the caption cannot be realized.

In summary, the prior art cannot effectively implement the function of playing media resources while displaying subtitles. Summary of the invention

In view of this, the present invention provides a method for realizing a caption function, which realizes a function of effectively synchronizing display of subtitles when playing media resources.

The invention also provides a media server for realizing the function of subtitles, which realizes the function of effectively synchronizing the display of subtitles when playing media resources.

The device also provides a system for realizing subtitle functions, in which the function of playing the media time to simultaneously display subtitles can be realized.

In order to achieve the above first object of the invention, the following technical solutions are adopted:

A method for implementing a caption function, comprising:

A. Establishing subtitle resources and subtitle resource feature information corresponding to the media resource in the media server;

B. Send the caption resource feature information to the media player.

C. When the media server receives the output media resource sent by the user through the media player, please When the time is up, the body server displays the caption resource specified by the caption resource feature information to the user through the media player.

Preferably, the subtitle resource feature information includes: location information of the subtitle resource, language information of the subtitle resource, and index information of the language in the subtitle file.

Preferably, the subtitle resource is set as the subtitle resource in the media server.

Subtitle file corresponding to the media resource retrieved by the media server through the information of the media resource as a subtitle resource; or

The media server retrieves and downloads the local subtitle file as a subtitle resource through the information of the media resource at the remote end.

Preferably, if the media server retrieves the subtitle file at the remote end, and the subtitle file is not downloaded to the local, the location in the subtitle resource feature information is the address information of the subtitle file at the remote end. Preferably, the subtitle resource is established. The feature information can be:

The feature information of the caption resource is automatically established by the media server or the feature information of the caption resource is manually input by the user according to the caption resource corresponding to the media resource.

Preferably, the method for the media server to automatically establish the feature information of the caption resource may be: the media server searches for a caption file having the same name as the media resource according to the name of the media resource, and edits the caption resource according to the content attribute of the caption file. Characteristic information.

Preferably, the step Β includes:

The B1U media player requests the media server to query the media resource;

The media server queries the media resource, and includes feature information of the caption resource corresponding to the media resource, and returns the query result to the media player.

Preferably, in step C, the caption resource specified by the caption resource feature information is played through the media; the display to the user may be The media player determines the subtitle resource according to the priority of the subtitle resource feature information, and displays the subtitle resource to the user through the media player; or

The media server determines the subtitle resource according to the subtitle resource feature information specified by the user, and displays the subtitle source to the user through the media player.

In order to achieve the above second object of the invention, the following technical solutions are adopted:

A media server implementing a caption function, the media server at least comprising: a caption resource feature information module and an interface module;

The caption resource feature information module is configured to establish corresponding caption resource feature information for the media resource, and send the information to the interface module;

The interface module is configured to send the subtitle resource feature information, receive an externally sent output subtitle resource request, and send the subtitle resource specified by the subtitle resource feature information.

Preferably, the media server may further include: a caption resource storage module and a caption resource search module;

The caption resource storage module is configured to save a caption resource corresponding to the media resource; the caption resource search module is configured to retrieve the caption resource at a remote location according to the information of the media resource, and send the downloaded caption resource to the caption Resource storage module;

The caption resource feature information module is configured to read a caption resource from the caption resource storage module, and establish caption resource feature information according to the read caption resource.

For example, the subtitle resource feature information module may include: a query submodule and a feature information subblock, where

The query sub-module is configured to save a correspondence between the media resource and the subtitle resource, and after receiving the media resource information request sent by the interface module, send the subtitle resource feature information request corresponding to the requested media resource to the Characteristic information sub-module;

The feature information sub-module is configured to establish subtitle resource feature information, and receive the After the subtitle resource feature information request sent by the query submodule is requested, the requested subtitle resource feature information is sent to the interface module.

In order to sell the above-mentioned third invention purpose, the following technical solutions are used:

A system for implementing a caption function, the system comprising: a media player and a media server, wherein

The media server is configured to establish a subtitle resource and subtitle resource feature information corresponding to the media resource, and send the subtitle resource feature information to the media player, and receive a request for outputting the subtitle resource sent by the media player, and The media player outputs a caption resource specified by the caption resource feature information;

And the media player is configured to receive the subtitle resource feature information sent by the media server, and send a request for outputting the subtitle resource to the media server, and receive and play the subtitle resource sent by the media server.

As can be seen from the technical solution provided by the present invention, the present invention establishes corresponding subtitle resource and subtitle resource feature information for the media resource on the media server, and sends the subtitle resource feature information to the media player. Users can use media resources according to need to choose the ^right: the subtitles synchronized display, effectively achieve the subtitle function to enhance the user experience, to ensure the reliability of subtitles. BRIEF DESCRIPTION OF THE DRAWINGS

Figure: 1 is a connection structure diagram of a prior art media player and a media server;

2 is a schematic overall structural diagram of a subtitle function system and a media server based on the inventive concept;

The figure is a schematic overall flowchart of a method for implementing a caption function based on the idea of the present invention; FIG. 4 is a structural diagram of a system and a media server for implementing a caption function according to an embodiment of the present invention; FIG. 5 is a flowchart of a method for implementing a caption function according to an embodiment of the present invention. Mode for carrying out the invention

The embodiments of the present invention will be described in detail with reference to the accompanying drawings.

The core idea of Benquanming is: by establishing corresponding subtitle and subtitle resource feature information for the media resource on the media server, so that the user can select the subtitle resource corresponding to the media resource when using the media resource provided by the media server, thereby The subtitle function is implemented.

2 is a schematic overall flow chart of a method for implementing a caption function based on the inventive concept. As shown in Figure 2, the method includes:

Step 201: Establish a subtitle resource and subtitle resource feature information corresponding to the media resource in the media server.

Step 202: Send the caption resource feature information obtained in step 201 to the media player. '

Step 203: When the user sends a request for outputting a media resource to the media server through the media player, the media server displays the caption resource specified by the caption resource feature information to the user through the media player.

Fig. 3 is a schematic overall composition of a system and a media server implementing a caption function based on the inventive concept. As shown in FIG. 3, the system includes a media server 310 and a media player 320.

In the system, the media server 310 is configured to establish a caption resource and caption resource feature information corresponding to the media resource, and send the caption resource feature information to the media player 320, and further used to connect the output caption resource sent by the media player 320. a request, and output the caption resource specified by the caption resource feature information to the media player 320. The media player 320 is configured to receive the caption resource feature information sent by the media server 310, and send the caption resource feature information to the media server 310. The request for outputting the subtitle resource receives and plays the subtitle resource sent by the media server 310. Specifically, the media server 310 includes a caption resource feature information 311 module and an interface module 312.

In the media server 310, the caption resource feature information module 311 is configured to establish feature information of the caption resource for the media resource, and send the information to the interface module 312. The interface module 312 is configured to use the caption resource feature. The information is sent out, and is also used to receive a request for outputting the subtitle resource sent externally, and send the subtitle resource specified by the subtitle resource feature information.

The foregoing is a general overview of the method, system, and media server for implementing the caption function of the present invention. The specific embodiments of the present invention are further described in detail below with reference to the embodiments.

FIG. 4 is a specific implementation process of a method for implementing a caption function according to an embodiment of the present invention. As shown in FIG. 4, the method specifically includes:

Step 401: The media server establishes corresponding subtitle resources and subtitle resource feature information for the media resource when the media resource is newly added.

In this step, the subtitle resource corresponding to the media resource may be: the subtitle file existing in the media server is used as the subtitle resource; or the media server may retrieve the subtitle file corresponding to the media resource according to the information of the media resource, The subtitle file is used as the subtitle resource. In addition, the media server may further search the subtitle file according to the information of the media resource, and then download the subtitle file to the local as the subtitle resource.

The subtitle resource feature information includes: location information of the subtitle resource, language included, index information of the language in the font file, and the like.

When the caption resource feature information is established, the caption resource feature information may be automatically created by the media server ^: or the caption resource feature information is manually input.

Specifically, when the subtitle resource is a subtitle file existing by the media server, the subtitle resource information may be directly obtained according to the media resource name, and the subtitle resource feature information is established. The address information is a storage location of the subtitle resource in the media server;

When the subtitle resource is retrieved from the Internet by the media server through the information of the media resource itself, and the subtitle file has been downloaded to the local, the subtitle resource feature information may be established according to the content of the subtitle file, and the address information thereof is also That is, the storage location of the subtitle resource in the media service:

When the subtitle resource is retrieved from the Internet by the media server according to the information of the media resource itself, but the subtitle file is not downloaded to the local, the corresponding location information in the subtitle resource feature information may be the subtitle on the Internet. The address information of the file.

If Ruquan wants to retrieve subtitles from the Internet, it needs to have a server on the Internet that stores subtitle files corresponding to the media resources for retrieval, location and download.

Step 402: Determine whether the media player establishes a connection with the media server. If yes, execute step 403 and subsequent steps, otherwise the process ends.

Step 403: Determine whether the media player requests the media resource information to be queried, and if yes, execute step 404; otherwise, the process ends.

After the media player establishes a connection with the media server, the media player sends a query media resource request to the media server, requesting to obtain the feature information of the media resource on the media server. :

Step 404: Determine whether the media server finds the corresponding media resource. If yes, perform step 405 and subsequent steps. Otherwise, the process ends.

After receiving the query request, the media server searches for the corresponding media resource, and queries the subtitle resource feature information corresponding to the media resource according to the media resource.

Step 405: Provide the query result to the media player.

In this step, the provided query result includes the subtitle resource feature information corresponding to the media resource, such as the location where the media resource is stored, the size of the media resource, and the subtitle information.

Step 406: Determine whether the media player requests to output the media resource, and if yes, execute Step 407 and its subsequent steps, otherwise, the process ends.

Step 407: The media server starts to output the media resource requested by the media player to the media player according to the output request of the media player.

Step 408: Determine whether the media player requests to output the subtitle resource corresponding to the media resource. If yes, execute step 409; otherwise, end the process.

The media player may request to output a subtitle resource corresponding to the media resource according to the subtitle element information in the query result returned by the media server, where the request for outputting the subtitle resource may be sent together with the request for outputting the media resource, or in the output media resource. Before or after the request.

Step 409: The media server outputs the subtitle resource corresponding to the media resource, and ends the process.

A specific process of the method for implementing the caption function provided by the embodiment is provided. The embodiment also provides a media server and system for implementing a caption function to apply the above-described method of implementing a caption function. Figure 5 is a structural diagram of a media server and system for implementing a caption function in an embodiment of the present invention.

As shown in FIG. 5, the system includes: a media server 510 and a media player 320. The media server 510 includes a subtitle resource feature information module 511, a subtitle resource storage module 512, a subtitle resource search module 513, and an interface module 514. The subtitle resource feature information module 511 includes a query submodule 511a and a feature information submodule 511b.

In the media server 510, the caption resource search module 513 is configured to search for a caption resource corresponding to the media resource on the Internet, and store the caption resource downloaded to the local caption resource storage module 512; the caption resource storage module 512, Saving the word power resource in the media server;

In the screen resource feature information module 511, the query sub-module 511a is configured to save the correspondence between the media resource and the caption resource, and receive the media resource sent by the interface module 514. After the information request, the subtitle resource feature information request corresponding to the requested media resource is sent to the feature information sub-module 511b. The feature information sub-module 511b is configured to create the subtitle resource according to the subtitle resource read from the caption resource storage module 5i2. After receiving the subtitle resource feature information request sent by the query submodule 511a, the feature information is sent to the interface module 514.

The module 514 is configured to send the caption resource feature information to the media player 320, and further configured to ^: receive the request for outputting the caption resource sent by the media player 320, and send the caption resource specified by the caption resource feature information to the media player. 320.

The media server 510 and the media player 320 can be connected through a home network or other network.

On the basis of the media server 310 shown in FIG. 3, in the media server 510 provided in this embodiment, the caption resource feature information module is embodied as a query sub-module and a feature information sub-module, and the media server automatically adds the caption resource feature. The function of information. Of course, in practical applications, if the feature information of the caption resource in the media server is manually input, the feature information sub-module only needs to receive the caption resource feature information sent by the interface module, and store it, without requiring itself. Create subtitle resource feature information.

The above is a specific embodiment of the method, media server and system of the present invention. The process of the present invention is specifically illustrated by a specific example.

In this example, assume that you want to add a media resource 1 to the media server.

First, corresponding subtitle resources and subtitle resource feature information are established for the media resource 1. Assuming that the subtitle resource corresponding to the media resource 1 does not exist in the media server, the media server retrieves the corresponding subtitle file on the Internet and downloads it to the local as a subtitle resource. - The method for establishing subtitle resource feature information may be: In the UPnP AV system defined in the UPnP device architecture framework, the CDS function is extended by the subtitle attribute defined in the CDS. Or the subtitle element describes the subtitle resource feature information, which includes information such as the location of the subtitle resource, so as to display the subtitle synchronously. Since elements can have multiple sub-attributes, from the perspective of future scalability, the use of increased subtitle elements is more scalable.

In this example, a subtitle element is taken as an example. The same media resource may correspond to multiple subtitle elements, such as a subtitle resource, a subtitle file included in each subtitle resource, a translation included in each subtitle file, and each language in each language. There are a variety of indexes that can be included, they can be zoned with different numbers, and priority can be set.

It is assumed that the media resource 1 corresponds to two subtitle elements, namely a subtitle element 1 and a subtitle element 2. The subtitle element 1 contains a subtitle file medial_CHNSubtitle.sub, corresponding to one language: French; subtitle element 2 contains two subtitle files medial_ENGSubtMe.sub and medial_ENGSubtitle.idx, corresponding to two languages: Chinese and English.

When creating the preview resource feature information, set the value of the subtitle element corresponding to the media resource 1 as follows:

Media resources 1. Subtitles 1. Location =

"http:〃192.168.0.1/medial-CHNSubtitle.sub" , indicating the location information of the subtitle 1 corresponding to the media resource 1, wherein there is only one subtitle file;

Media resource 1. Subtitle element 1. Language = "FRENCH", indicating the language information of the subtitle element 1 corresponding to the media resource 1, wherein the subtitle file has only one language, corresponding to the French subtitle; Media resource 1. Subtitle element 1. Language. Index = 0, indicating index information of the language of the subtitle element 1 corresponding to the media resource 1, which has only one index number;

Media Resources 1. Subtitles 2. Location 1 =

"http://192.168.0.1/medial_ENGSubtitle.sub'% indicates the information of position 1 of the subtitle element 2 corresponding to the media resource 1, wherein the corresponding subtitle is composed of two files, which is the first" Media Resources 1. Subtitle Elements 2. Position 2 =

"http://192.168.0.1/medial_ENGSubtitle.idx", the corresponding subtitle of media resource 1; the location 2 information, where the corresponding subtitle consists of two files, this is the second.

Media resources 1. Subtitle elements 2. Language 1 = "CHINESE", indicating the language 1 information of the subtitle element 2 corresponding to the media resource 1, wherein the subtitle file contains two languages, which is the corresponding Chinese language;

Media resource 1. Subtitle element 1. Language 1. Index 1 = 0, indicating index information 1 of language 1 of subtitle element 2 corresponding to media resource 1, for example, subtitle index number of cylinder Chinese; media resource 1. subtitle element 1 Language 1. Index 2 = 1 , indicating the index information 2 of the language 1 of the subtitle element 2 corresponding to the media resource 1, for example, the index number of the subtitle of the traditional Chinese; media resource 1. subtitle element 2. language 2 = "ENGLISH" , the language 1 information of the subtitle element 2 corresponding to the media resource 1, wherein the subtitle file contains two languages, which is the corresponding English language;

Media resources 1. Subtitle elements 1. Language 2. Index = 2, media resource 1 The corresponding subtitle element 2 is the index information of the language 2, for example, the index number of the English subtitle;

This 395, the completion of the media resource 1 subtitle resources and subtitle resource feature information. Next, the caption resource feature information is sent to the media player.

When the media player sends a message requesting output of the caption resource, the media server sends the caption resource corresponding to the caption resource feature information to the media player for playback according to the user request. If the user does not select the subtitle resource, the subtitle resource with the highest priority may be output according to the priority of the subtitle element; if the user selects the corresponding subtitle resource, the subtitle resource selected by the user is output according to the user's needs.

In the embodiment of the present invention, the caption element is used as the feature information of the caption resource as an example. In fact, you can also use the subtitle attribute as a feature letter for the subtitle resource. Interest. The difference between the subtitle attribute and the subtitle element is the same as the difference between the attribute and the element in the CDS. The subtitle attribute can only have one attribute value belonging to itself, which can represent the position information or language information of the subtitle resource, but a subtitle attribute can only represent the subtitle. A piece of information about a resource, and not a subtitle element, a plurality of pieces of information of a subtitle resource are represented by a subtitle element. However, multiple subtitle attributes can be set in the CDS to represent a variety of different information for the subtitle resource. When the subtitle attribute is used as the feature information of the subtitle resource, other editing methods of the subtitle attribute, the manner of obtaining the subtitle resource, and the like are the same as those of the subtitle element, and will not be described herein.

It can be seen from the above description of the embodiments of the present invention that the method, the media server and the system of the present invention can implement the caption function in the framework of the UPnP device system, and the user can watch the synchronized subtitles as needed while using the media resources. , improve the user experience, and ensure the reliability of the subtitle display.

The present invention is only a preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily think of changes within the technical scope disclosed by the present invention. Or, the replacement should be covered by the scope of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

Claims

Claim

A method for implementing a caption function, the method comprising:

B J sends the caption resource feature information to the media player;

C. When the media server receives the output media resource request sent by the user through the media player, the media server displays the caption resource specified by the caption resource feature information to the user through the media player.

The method according to claim 1, wherein the subtitle resource feature information comprises: location information of the subtitle resource, language information of the subtitle resource, and index information of the language in the subtitle file. -

The method according to claim 1, wherein the subtitle resource is set in step A; and the subtitle file existing in the media server is used as a subtitle resource; or

The subtitle resource is retrieved and downloaded to the local subtitle file by the media server through the information of the media resource.

The method according to claim 3, wherein if the media server retrieves the subtitle file at the remote end and the subtitle file is not downloaded to the local, the location information in the subtitle resource feature information is the remote subtitle file. Address information.

The method according to claim 1, wherein the establishing the caption resource feature information is:

The subtitle resource feature information is automatically established by the media server or the caption resource feature information is manually input by the user according to the subtitle resource corresponding to the media resource. The method of claim 5, wherein the media server automatically sets the feature information of the caption resource to: the media server searches for a caption file having the same name as the media resource according to the name of the media resource, according to The content attribute of the subtitle file establishes subtitle resource feature information.

The method according to any one of claims 1 to 6, wherein the step B comprises:

Bl, the media player requests the media server to query the media resource;

B2. The media server queries the media resource, and includes subtitle resource feature information corresponding to the media resource, and returns the query result to the media player.

The method according to claim 7, wherein in step C, the caption resource specified by the caption resource feature information is displayed to the user through the media player:

The media player determines the subtitle resource according to the priority of the subtitle resource feature information, and displays the subtitle resource to the user through the media player; or

The media server determines the subtitle resource according to the subtitle resource feature information specified by the user, and displays the subtitle resource to the user through the media player.

A media server that implements a caption function, wherein the media server includes at least: a caption resource feature information module and an interface module;

The interface module is configured to send the subtitle resource feature information, receive an externally sent request for outputting a subtitle resource, and send the subtitle resource specified by the subtitle resource feature information.

The media server according to claim 9, wherein the media server further comprises: a caption resource storage module and a caption resource search module;

The caption resource storage module is configured to save a caption resource corresponding to the media resource; The caption resource searching module is configured to retrieve a caption resource at a remote end according to the information of the media resource, and send the downloaded caption resource to the caption resource storage module;

The subtitle resource feature information module is configured to read the subtitle resource from the subtitle resource storage module and establish subtitle resource feature information according to the read subtitle resource.

The media server according to claim 9 or 10, wherein the caption resource feature information module comprises: a query submodule and a feature information submodule, wherein

The feature information sub-module is configured to establish caption resource feature information, and send the requested caption resource feature information to the interface module after receiving the caption resource feature information request sent by the query sub-module.

12. A system for implementing a caption function, the system comprising: a media player and a media server, wherein

The media server is configured to establish a subtitle resource and subtitle resource feature information corresponding to the media resource: and send the subtitle resource feature information to the media player, and receive a request for outputting the subtitle resource sent by the media player, and The media player outputs a caption resource donated by the caption resource feature information;

The media player is configured to receive the subtitle resource feature information sent by the media server, and the media server sends a request for outputting the subtitle resource, and receives and plays the subtitle resource sent by the media server.