CN113727153A - Server, display equipment and media asset playlist caching method - Google Patents

Server, display equipment and media asset playlist caching method Download PDF

Info

Publication number
CN113727153A
CN113727153A CN202111006311.5A CN202111006311A CN113727153A CN 113727153 A CN113727153 A CN 113727153A CN 202111006311 A CN202111006311 A CN 202111006311A CN 113727153 A CN113727153 A CN 113727153A
Authority
CN
China
Prior art keywords
media asset
server
list
network element
playing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202111006311.5A
Other languages
Chinese (zh)
Other versions
CN113727153B (en
Inventor
滕健
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Juhaokan Technology Co Ltd
Original Assignee
Juhaokan Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Juhaokan Technology Co Ltd filed Critical Juhaokan Technology Co Ltd
Priority to CN202111006311.5A priority Critical patent/CN113727153B/en
Publication of CN113727153A publication Critical patent/CN113727153A/en
Application granted granted Critical
Publication of CN113727153B publication Critical patent/CN113727153B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/262Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
    • H04N21/26258Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists for generating a list of items to be played back in a given order, e.g. playlist, or scheduling item distribution according to such list
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/482End-user interface for program selection
    • H04N21/4825End-user interface for program selection using a list of items to be played back in a given order, e.g. playlists
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/482End-user interface for program selection
    • H04N21/4828End-user interface for program selection for searching program descriptors

Abstract

The application provides a server, a display device and a media asset play list caching method, and the method can trigger the display device to send a media asset caching instruction to the server when a user controls the play of media assets. After receiving the media asset caching instruction, the server can search a target play list meeting the playing capability of the display device in the local cache of the network element according to the media asset ID in the media asset caching instruction, and feed back the target play list to the display device. And the display equipment displays a media asset detail interface according to the target play list to play the media assets. The method can enable the media asset data cached in the local cache of the network element to meet more display equipment with different playing capabilities through the list code combination, so that the display equipment can more easily acquire the play list from the local cache of the network element, the concurrency capability of the server is improved, and the playing delay is reduced.

Description

Server, display equipment and media asset playlist caching method
Technical Field
The application relates to the technical field of intelligent display equipment, in particular to a server, display equipment and a media asset playlist caching method.
Background
The display device is a terminal device capable of outputting a specific display picture, and may be a terminal device such as a smart television, a mobile terminal, a smart advertisement screen, and a projector. Taking an intelligent television as an example, the intelligent television is based on an Internet application technology, is provided with an open operating system and a chip, is provided with an open application platform, can realize a bidirectional man-machine interaction function, integrates multiple functions of video, entertainment, data and the like, and is a television product for meeting diversified and personalized requirements of users.
Through accessing the internet, the display equipment can play multimedia resources on line. Before playing the multimedia resource, the display device needs to acquire the media asset data from the server according to the play list. The playlist may include a plurality of media asset dimensions, including different definitions, encoding and decoding modes, and the like. The multimedia resource in the server generates a plurality of play addresses according to the different dimensions and forms a play list. After the playlist is generated, it is not easily changed and is cached by the server for the display device to call.
However, due to the application of the new dimension of the media asset data, such as a video effect and an audio effect, the playlist caching method cannot cover all the media asset attributes, so that when the display device plays the media asset data with the new attributes, the media asset data cannot be obtained through caching, and needs to be extracted from the data storage unit of the server.
Disclosure of Invention
The application provides a server, a display device and a media asset playlist caching method, and aims to solve the problem that the traditional playlist caching method is high in starting delay.
In a first aspect, the present application provides a server comprising: the system comprises a storage module, a communication module and a control module, wherein the storage module is configured to store media asset data, and the media asset data comprises a plurality of media asset attributes; the communication module is configured to establish a communication connection with a display device; the control module is configured to perform the following program steps:
acquiring a media asset caching instruction sent by a user through the display equipment;
responding to the media asset caching instruction, and analyzing a media asset ID and the playing capacity information of the display equipment from the media asset caching instruction;
searching a target play list in a local cache of a network element according to the media asset ID, wherein the target play list comprises a list code combination and a play address which accord with the play capability information;
and sending the target play list to the display equipment.
Based on the server, the first aspect of the present application further provides a media asset playlist caching method, including the following steps:
acquiring a media asset caching instruction sent by a user through the display equipment;
responding to the media asset caching instruction, and analyzing a media asset ID and the playing capacity information of the display equipment from the media asset caching instruction;
searching a target play list in a local cache of a network element according to the media asset ID, wherein the target play list comprises a list code combination and a play address which accord with the play capability information;
and sending the target play list to the display equipment.
In a second aspect, the present application also provides a display device, comprising: a display, a communicator, and a controller. Wherein the display is configured to display a user interface; the communicator is configured to establish a communication connection with a server; the controller is configured to perform the following program steps:
acquiring a control instruction which is input by a user and used for playing media assets;
responding to the control instruction, and sending a media asset caching instruction to the server, wherein the media asset caching instruction comprises a media asset ID and playing capacity information of the display equipment;
receiving a target play list fed back by the server according to the media asset caching instruction, wherein the target play list comprises a list code combination and a play address which are searched in a local cache of a network element of the server according to the media asset ID and accord with the play capability information;
and displaying a media asset detail interface according to the list code combination, and playing the media asset according to the playing address.
Based on the foregoing display device, a second aspect of the present application further provides a media asset playing method, including the following steps:
acquiring a control instruction which is input by a user and used for playing media assets;
responding to the control instruction, and sending a media asset caching instruction to the server, wherein the media asset caching instruction comprises a media asset ID and playing capacity information of the display equipment;
receiving a target play list fed back by the server according to the media asset caching instruction, wherein the target play list comprises a list code combination and a play address which are searched in a local cache of a network element of the server according to the media asset ID and accord with the play capability information;
and displaying a media asset detail interface according to the list code combination, and playing the media asset according to the playing address.
According to the technical scheme, the server, the display device and the media asset playlist caching method can trigger the display device to send the media asset caching instruction to the server when the user controls the playing of the media assets. After receiving the media asset caching instruction, the server can search a target play list meeting the playing capability of the display device in the local cache of the network element according to the media asset ID in the media asset caching instruction, and feed back the target play list to the display device. And the display equipment displays a media asset detail interface according to the target play list to play the media assets. The method can enable the media asset data cached in the local cache of the network element to meet more display equipment with different playing capabilities through the list code combination, so that the display equipment can more easily acquire the play list from the local cache of the network element, the concurrency capability of the server is improved, and the playing delay is reduced.
Drawings
In order to more clearly explain the technical solution of the present application, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious to those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a schematic diagram of an operation scenario between a display device and a control apparatus in an embodiment of the present application;
fig. 2 is a block diagram of a hardware configuration of a display device in an embodiment of the present application;
FIG. 3 is a schematic diagram illustrating a data interaction relationship between a display device and a server in an embodiment of the present application;
FIG. 4 is a schematic diagram illustrating a communication connection relationship between a display device and a server according to an embodiment of the present application;
FIG. 5 is a schematic diagram of a detailed interface of the medium asset in the embodiment of the present application;
fig. 6 is a schematic diagram illustrating a process of caching a media asset playlist at a server in an embodiment of the present application;
fig. 7 is a sequence diagram illustrating a flow of caching a media asset playlist at a server in an embodiment of the present application;
FIG. 8 is a schematic diagram of a server-side system framework in an embodiment of the present application;
fig. 9 is a schematic diagram illustrating a flow of caching a media asset playlist at a display device end in an embodiment of the present application;
fig. 10 is a timing diagram illustrating a flow of caching a media asset playlist at a display device side according to an embodiment of the present application.
Detailed Description
Reference will now be made in detail to embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following examples do not represent all embodiments consistent with the present application. But merely as exemplifications of systems and methods consistent with certain aspects of the application, as recited in the claims.
Fig. 1 is a schematic diagram of a usage scenario of a display device according to an embodiment. As shown in fig. 1, the display apparatus 200 is also in data communication with a server 400, and a user can operate the display apparatus 200 through the smart device 300 or the control device 100.
In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes at least one of an infrared protocol communication or a bluetooth protocol communication, and other short-distance communication methods, and controls the display device 200 in a wireless or wired manner. The user may control the display apparatus 200 by inputting a user instruction through at least one of a key on a remote controller, a voice input, a control panel input, and the like.
In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display apparatus 200. The server 400 may be a cluster or a plurality of clusters, and may include one or more types of servers.
Fig. 2 shows a hardware configuration block diagram of a display device 200 according to an exemplary embodiment.
In some embodiments, the display apparatus 200 includes at least one of a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, a user interface.
In some embodiments, communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display apparatus 200 may establish transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.
In some embodiments, the external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, and the like. The interface may be a composite input/output interface formed by the plurality of interfaces.
In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command for selecting a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.
In some embodiments, a user may enter user commands on a Graphical User Interface (GUI) displayed on display 260, and the user input interface receives the user input commands through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.
In some embodiments, a "user interface" is a media interface for interaction and information exchange between an application or operating system and a user that enables conversion between an internal form of information and a form that is acceptable to the user. A commonly used presentation form of the User Interface is a Graphical User Interface (GUI), which refers to a User Interface related to computer operations and displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in the display screen of the electronic device, where the control may include at least one of an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc. visual interface elements.
As shown in fig. 3, the display device 200 may communicate with the server 400 to realize data interaction during use. For example, the user may trigger the display device 200 to display a media asset recommendation interface through the interactive instruction, where the media asset recommendation interface may include a plurality of media asset items, and each media asset item corresponds to one network link. The display device 200 may retrieve a retrieval request for the information of the asset item from the server 400 in response to an interactive instruction input by the user in order to determine the asset item included in the asset recommendation interface.
After receiving the acquisition request, the server 400 may extract, in the memory, the asset items suitable for the current display device 200 to display according to the acquisition request, and feed back the extracted asset items to the display device 200. The display device 200 adds the media asset items to the media asset recommendation interface according to the media asset items fed back by the server 400, so that the media asset items can be displayed in a specific layout mode.
In order to realize data interaction between the display apparatus 200 and the server 400, the display apparatus 200 needs to establish a communication connection with the server 400. For example, the display apparatus 200 and the server 400 may each be connected to the internet and transfer interactive data between the display apparatus 200 and the server 400 through an internet transfer protocol.
In some embodiments, it is desirable to have means for establishing a communication connection on the display device 200 and the server 400, respectively. That is, as shown in fig. 5, the communicator 220 may be provided in the display device 200, and the communication module 410 may be provided in the server 400, and the communicator 220 and the communication module 410 may simultaneously support at least one of the same communication methods to establish a communication connection relationship. For example, the communicator 220 on the display apparatus 200 includes a fiber interface, so that the display apparatus 200 can be connected to a network through the fiber interface; meanwhile, the communication module 410 of the server 400 also includes an optical fiber interface, and may also be connected to a network through the optical fiber interface to implement a communication connection between the display device 200 and the server 400.
It should be noted that the display device 200 and the server 400 may also establish a communication connection relationship by using other connection manners. Such as wired broadband, wireless local area network, cellular network, bluetooth, infrared, radio frequency communication, etc.
The display device 200 and the server 400 may be in a "many-to-one" connection relationship, that is, a plurality of display devices 200 may establish a communication connection with the same server 400, so that the server 400 may provide services for the plurality of display devices 200. A "many-to-many" connection relationship may be established between the display apparatuses 200 and the servers 400, that is, the plurality of display apparatuses 200 may establish a communication connection with the plurality of servers 400, so that the plurality of servers 400 can provide different services for the display apparatuses 200, respectively. Obviously, in an individual application scenario, there may also be a "one-to-one" connection relationship between the display devices 200 and the servers 400, i.e., one server 400 exclusively serves one display device 200.
In order to be able to provide services for the display apparatus 200, a storage module 420 may be further included in the server 400, and the storage module 420 may store various resource data, information files, and control programs. Along with the interaction process of the user, the display device 200 may obtain different data in the storage module 420 of the server 400, for example, when the display device 200 plays a certain asset item, a playing data obtaining request may be sent to the server 400, and after receiving the request, the server 400 may extract the asset data to be played in the storage module 420 and transmit the asset data to the display device 200, so that the display device 200 may decode and display the asset data. The control program stored in the storage module 420 may be executed by the control module 430 of the server 400, so that the control module 430 may perform corresponding functions according to the control program.
The various user interfaces presented on the display device 200 need to communicate with the server 400 before they can be displayed. For example, when the user selects one of the assets in the asset recommendation interface for playing, the display device 200 will typically jump to the asset detail interface. In the media resource detail interface, media resource description information related to the selected playing media resource and different media resource attributes aiming at the same media resource content can be included. For example, as shown in fig. 5, for a media asset project, an operator may provide multiple definitions, such as standard definition, high definition, super definition, 1080P, 4K, etc., where each definition corresponds to a media asset data file, i.e., corresponds to a play address. Therefore, a plurality of definition options can be set in the media asset detail interface, and when a user selects any one of the definition options, the display device 200 can access the playing address corresponding to the option to play the media asset with the definition.
In some embodiments, the asset items may include other types of attributes in addition to the above-described clarity attributes, such as video effect attributes and audio effect attributes. For example, video effects may include standard dynamic effects (SDR), high dynamic range effects (HDR10), advanced high dynamic range (HDR10+), hua-ji high dynamic range effects (HDRVIVID), and dolby vision effects (dolby vision), among others; the audio effects may include advanced audio decoding effects (AAC), DOLBY 5.1(DOLBY51), digital cinema system 5.1 effects (DTS51), panoramic sound effects (WANOS), and the like. Different media asset attributes can be combined, so that more forms of media asset data can be provided.
It should be noted that, for convenience of description, in the embodiment of the present application, a specific form under each asset attribute is referred to as an attribute value. That is, the attribute values of the video effect may include: standard dynamic effect, high dynamic range effect, advanced high dynamic range, hua is high dynamic range effect, dolby vision effect, and the like. For the same asset item, a plurality of different asset attribute forms can be included, such as definition, video effect, audio effect and the like, and each asset attribute form can include a plurality of attribute values.
The server 400 may store a plurality of asset data in the storage module 420 for one asset item, where each asset data is stored in a separate file for the display device 200 to call to play. For example, when the display device 200 selects a specific definition of a asset item and plays the asset with a specific video effect and audio effect, the display device 200 may send an asset acquisition request to the server 400, and after receiving an asset caching request of the display device 200, the server 400 extracts corresponding asset data from the storage module 420 and feeds the asset data back to the display device 200, so that the display device 200 may play the asset on line.
Since the server 400 can provide the online playing service for the plurality of display devices 200 under normal conditions, that is, the number of the display devices 200 connected to the server 400 is large, when the plurality of display devices 200 play the same asset item, the server 400 needs to repeatedly call the asset data corresponding to the same asset item, so that the server 400 performs a large amount of repeated work. Therefore, in some embodiments, a caching mechanism may be established in the server 400, and the media asset item is cached in the server 400 by using the caching mechanism, so as to reduce the number of times that the server 400 calls the storage module 420 and improve the acquisition speed of the media asset data.
In order to facilitate the caching of the media asset data, a playlist may be constructed in the server 400, and the playlist may include a plurality of media asset attributes, that is, different definitions, encoding and decoding modes, and the like. The multimedia resources in the server 400 will generate a plurality of playing addresses and compose a playing list according to these different media asset attributes. After the playlist is generated, the playlist cannot be easily changed, and the server 400 performs caching so that the display device 200 can directly obtain the media asset data through the playlist without frequently accessing the storage module 420 of the server 400.
However, due to the application of the new dimension of the asset data, such as a video effect and an audio effect, the playlist caching method cannot cover all the asset attributes, that is, when the display device 200 plays the asset data with the new attribute, the asset data cannot be obtained through caching, and the corresponding asset data needs to be extracted from the storage module 420 of the server 400 again, such a data obtaining manner may increase the start-up delay of the asset, and when a plurality of display devices 200 concurrently access the server 400, the feedback speed of the server 400 will be further slowed down, thereby reducing the user experience.
In order to reduce the delay in starting the playing of the media asset data and enable the playlist cached by the server 400 to cover all media asset attributes of the media asset items as much as possible for the display devices 200 of different types to call, in some embodiments of the present application, a media asset playlist caching method is provided, which can be applied to the server 400, and obviously, the server 400 should establish a communication connection with the display device 200. In order to implement the media asset playlist caching method, the server 400 should at least include the following functional modules, namely, a storage module 420, a communication module 410, and a control module 430. Wherein the storage module 420 is configured to store the asset data, the asset data comprising a plurality of asset attributes. The communication module 410 is configured to establish a communication connection with the display apparatus 200. As shown in fig. 6 and 7, the control module 430 is configured to execute the media asset playlist caching method, which specifically includes the following steps:
and acquiring a media asset caching instruction sent by the user through the display device 200. After the display device 200 and the server 400 establish a communication connection relationship, a user may input various control instructions through the display device 200, wherein a part of the control instructions may be used to control the display device 200 to play the media asset item. When the user inputs a control instruction for controlling playing of the asset item, the display device 200 may transmit an asset data acquisition request to the server 400 to acquire asset data to be played. While the media asset data is acquired, the media asset acquisition request of the display device 200 may further trigger the server 400 to cache the media asset data, so as to construct a playlist of the media asset item in the server 400.
The user may control the display device 200 to transmit the media asset caching instruction to the server 400 through various interactive manners. For example, the operating system of the display device 200 may provide an independent asset detail interface or asset play interface, and the user may control the focus cursor to move in the asset list interface and select any asset option through the direction key and the determination key on the control device 100 associated with the display device 200. When the user controls the focus cursor to move to the to-be-played media asset item icon and presses the enter key, the display device 200 may be controlled to display a media asset detail interface or a media asset playing interface. When the displayed interface is a media asset detail interface, the user can select one group of media asset attributes to play based on the media asset detail interface. For example, when the user selects movie a in the media asset recommendation interface and selects 4K definition, H265 codec format, HDR10+ video effect, and WANOS audio effect in the media asset detail interface corresponding to movie a, the display device 200 may transmit a media asset acquisition request to the server 400 based on the user selection to acquire corresponding media asset data from the server 400.
After receiving the media asset acquisition request sent by the display device 200, the server 400 may detect the media asset data required to be acquired in the media asset acquisition request to detect whether the corresponding media asset data is currently cached. When the server 400 has cached the media asset data, the media asset data stored in the cache can be directly sent to the display device 200, so as to complete the online playing service. When the media asset data is not cached in the server 400, the server 400 needs to be triggered to cache the media asset data corresponding to the media asset acquisition request, that is, a media asset caching instruction is triggered to be generated.
Since the user can control the display device 200 to display the asset detail interface and the asset play interface in multiple interactive manners, any interactive action triggering the display of the asset detail interface or the asset play interface can control the display device 200 to send an asset caching instruction to the server 400.
In some embodiments, for the display device 200 supporting the intelligent voice interaction operation, the user may also control the display device 200 to send a media asset caching instruction to the server 400 through the voice interaction instruction. For example, a user may input contents such as "play movie a" through voice, so that the intelligent voice system built in the display device 200 may convert the voice contents into text information after receiving the voice contents, and input the converted text information into the recognition model, so as to convert the text information into a specific control instruction, and control the display device 200 to display a media asset detail interface or a media asset play interface.
After the user inputs a command for controlling the display device 200 to send a media asset cache to the server 400 in any one of the manners described above, the server 400 may parse the media asset ID and the playing capability information of the display device 200 from the media asset cache command in response to the media asset cache command. The server 400 may determine the asset ID in the asset caching instruction by reading a specific format field at a specific edit location in the asset caching instruction.
The asset ID is unique identification string information for representing an asset item, and may be a name of the asset item, and a combination of the name and information such as a release date, an author, a release platform, a brief description, a play address, and the like of the item. Through the asset ID, the display device 200 and the server 400 may determine an asset item to be played or cached.
While acquiring the media asset ID, the server 400 may also acquire playback capability information of the display device 200, where the playback capability information refers to a degree of support of the display device 200 on media asset attributes such as definition, video effect, and audio effect. For example, for high-definition media asset items such as 4K or 8K, the controller 250 of the display device 200 needs to have a strong data decoding capability to be able to meet the decoding requirement of the high-definition media asset data.
In some embodiments, the server 400 may acquire the playback capability information of the current display apparatus 200 by reading the apparatus identification information of the display apparatus 200. The device identification information may include information such as a device name, a model, and a device type. After parsing the device identification information, the server 400 may match the playing capability of the current display device 200 according to the device identification information. In this regard, in the server 400, a database may be constructed in advance, and identification information of a plurality of display apparatuses 200 and a playback capability corresponding to each display apparatus 200 may be stored in the database. For example, the following entries may be included in the database, including device identification information "Hisense 75E 8G", and the corresponding playback capabilities include: the display device 200 supports 8k definition, supports HDR, supports DTS virtual X surround sound, and the like, so that when the display device 200 sends a media asset caching instruction to the server 400, the entry can be matched in the database through the device identification information of the display device 200 to determine the playing capability of the display device 200.
After parsing out the media asset ID and the playing capability information of the display device 200, the server 400 may search for the playlist in the cache space according to the media asset ID and the playing capability information, that is, search for the target playlist in a network element local cache according to the media asset ID, where the network element local cache is a cache unit in the server 400 and may directly send media asset data to the display device 200.
As shown in fig. 8, in some embodiments, the control module 430 of the server 400 may be further configured with a asset synchronization network element (mpssync), a database element (redis), and an asset interface network element (mpsapi). The database unit is connected with the storage module (db) through the medium resource synchronization network element, so that the medium resource synchronization network element is used for reading the medium resource data from the storage module and sending the read medium resource data to the database unit. The database unit is connected with a plurality of media resource interface network elements, network element local caches are arranged in the media resource interface network elements, and the database unit is used for distributing media resource data sent by the media resource synchronization network elements to the media resource interface network elements so as to cache the media resource data in the network element local caches of the media resource interface network elements. The server 400 may directly send the media asset data in the local cache of the network element to the display device 200, thereby skipping the process of acquiring the media asset data from the storage module 420, reducing the time consumption of the data extraction process, and reducing the start-up delay of the media asset data.
The target playlist includes a list code combination and a playback address that conform to the playback capability information. Multiple listing code combinations may be covered in the target playlist, each listing code combination may represent a particular combination of attribute values for the asset item. For example, the media asset attributes of a definition of 4K, a video effect of HDR10 (high dynamic range effect), and an audio effect of DOLBY51 (DOLBY 5.1 effect) may be represented by a list code "5110", and a specific list code combination rule will be described in detail in the following embodiments.
It should be noted that, because different display apparatuses 200 support different media asset attributes, the content included in the target playlist corresponding to the playback capability information is different for different display apparatuses 200. That is, after each display device 200 sends a media asset caching instruction to the server 400, if the media asset item corresponding to the media asset ID has cached corresponding media asset data in the network element local cache of the server 400, at least one list code combination and play address may be directly extracted from the network element local cache. When the number of media asset attribute items supported by the playing capability information corresponding to the display device 200 is large, a plurality of list code combinations can be extracted from the local cache of the network element. For example, for the display device 200 supporting 8K definition, it is necessary to support standard definition, high definition, super definition, 1080P, and 4K definition. And each definition comprises at least one list code combination.
After finding the target playlist, the server 400 may send the media asset data in the local cache of the network element to the display device 200, and since the media asset data stored in the local cache of the network element includes the list code combination and the play address, the server 400 may send the target playlist to the display device 200.
As can be seen, in the above embodiment, after receiving the media asset caching instruction, the server 400 may search, according to the media asset ID in the media asset caching instruction, a target playlist that meets the playing capability of the display device 200 in the network element local cache, and feed back the target playlist to the display device 200. And the display device 200 displays the media asset detail interface according to the target play list or directly plays the media asset. The media asset data cached in the local cache of the network element can meet more display equipment 200 with different playing capabilities through the list code combination, so that the display equipment 200 can more easily acquire a play list from the local cache of the network element, the concurrency capability of the server is improved, and the play starting delay is reduced.
In some embodiments, in order to facilitate searching for the play address of the asset data corresponding to a certain attribute type and attribute value of a certain asset item from the local cache of the network element, before the server 400 caches the play list, a list code policy may be set, so as to represent the asset data corresponding to each attribute value through a list code combination. That is, the server 400 may first obtain the media asset attribute information, where the media asset attribute information includes multiple attribute classifications, and each attribute classification includes at least one attribute value.
After obtaining the asset attribute information, the server 400 may traverse the number of attribute classifications in the asset attribute information and the number of attribute values of each attribute classification. For example, for a video asset item, it includes three attribute categories of sharpness, video effect, and audio effect, i.e., the number of attribute categories is 3. Meanwhile, through traversing the specific content in each media asset attribute classification, the definition attribute classification can be determined to comprise five attribute values of standard definition, high definition, super definition, 1080P and 4K, namely the number of the attribute values is 6, and similarly, the number of the attribute values corresponding to the video effect can be determined to be 5 according to the traversing result; the number of attribute values corresponding to an audio effect is 4.
The server 400 then defines a list code for each attribute value based on the attribute classification number and the attribute value number. For example, based on the number of traversed attribute classifications and the number of attribute values under the attribute classifications, the following list code may be defined:
for the definition attribute classification definition:
encoding 11 21 31 41 51 91
Definition of Standard definition High definition Super clean 1080P 4K HIMAX
Generally, for a common media asset, definition types of the common media asset may include standard definition, high definition, super definition, 1080P, and 4K, and then, according to an H264/H265 coding manner, definition codes correspondingly included are "11, 21, 31, 41, and 51", respectively, and an audio effect of the common media asset is AAC and a video effect of the common media asset is SDR, so as to meet media asset playing requirements of the conventional display device 200. However, with the continuous update of the hardware facilities of the display device 200, the playing capability of the display device 200 becomes stronger, and a new media asset attribute classification is generated. Thus, to enable the list code to override new attribute classifications and attribute values, in some embodiments, specific attribute values may also be defined for the new attribute classifications and attribute values. For example, based on the H265 encoding scheme, the definition may be at least 4K, and at least one special video effect or audio effect may be superimposed to define HIMAX, the corresponding list code is "91", and the superimposed video effect or audio effect code is as follows.
For video effect attribute classification definition:
encoding 0 1 2 3 4
Definition of SDR HDR10 HDR10+ HDRVIVID DOLBYVISION
Description of the invention Standard dynamic range High dynamic range High dynamic range plus Huacheng high dynamic Range The Dolby world
For audio effect attribute classification definitions:
Figure BDA0003237314890000081
Figure BDA0003237314890000091
through the above, after the attribute values are defined, the server 400 may generate a list code combination by combining the list codes, so that after the server 400 receives a media asset caching instruction sent by the display device 200, the list code combination may be determined according to the media asset ID in the caching instruction and the playing capability information of the display device 200. For example, when the display device 200 supports 4K definition, HDR10 visual effect, DOLBY51 sound effect, it is possible to query the list code combination as: 5111, the specific coding results are as follows:
MPS coding Definition of Video effects Audio effects
5101 4K SDR DOLBY51
5102 4K SDR DTS51
5103 4K SDR WANOS
5110 4K HDR10 AAC
5111 4K HDR10 DOLBY51
5112 4K HDR10 DTS51
5113 4K HDR10 WANOS
…… …… …… ……
Obviously, since the playing capability of the display device 200 can be generally downward compatible, that is, the display device 200 supporting 8K definition video playing also supports 4K video playing, the media asset playlist sent by the server 400 to the display device 200 may be composed of multiple definitions, and each definition may include a playing address, and codes of different video effects and audio effects may not be combined in the same list.
For example, the medium asset A adopts an H264 coding mode and has definition codes of 11, 21, 31, 41 and 51, so that an H264 playlist is generated; then transcoding by adopting an H265 coding mode, thereby generating an H265 playlist; after increasing the HIMAX capability, video effect uses HDR10, and audio effect uses DOLBY51, then by permutation and combination, 3 new attribute classification combinations of assets can be generated: 4K + DOLBY51, 4K + HDR10, 4K + DOLBY51+ HDR10, therefore, the server 400 can expand 5101 list, 5110 list, 5111 list based on the H265 playlist, that is, the playlist with 5 capabilities in total is the asset a at this time.
Figure BDA0003237314890000092
After finding the obtained list code combination, the server 400 may generate and cache a playlist according to the found list code combination, that is, in some embodiments, the server 400 may extract a play address of the asset data from the storage module 420 according to the asset ID; and then establishing a mapping relation between the list code combination and the playing address in the playing list to generate the playing list, and caching the playing list into the database unit so that the local cache of the network element can acquire the playing list from the database unit. For example, after receiving a media asset caching instruction of a user, the server 400 may obtain all playing addresses of the media asset from db by mpsync according to a media asset ID, classify the playing addresses according to attributes such as definition, an encoding mode, an audio/video effect, and the like, generate a playlist with multiple capabilities according to the above-mentioned method, and write the playlist into redis, so that multiple mpspii connected to the redis are called, so that the mpspii reads the media asset playlist from the redis and caches the playlist to a network element cache, so as to respond to a request of the display device 200 to complete issuing of the playlist.
In some embodiments, during the next playlist transmission, the server 400 may search the target subset in the network element local cache according to the media asset ID; then according to the playing capability information, searching a list code combination which accords with the playing capability information in the target subset; and extracting the play address corresponding to the list code combination to obtain the target play list.
For example, a media asset caching instruction sent by display device 200 to server 400 may trigger mpspi in server 400 to request a playlist based on the media asset ID. The server 400 searches for a playlist conforming to the playing capability of the current display device 200 from the network element local cahce according to the playing capability information of the model of the display device 200 and the like. For example, model 1 has the capability of playing DOLBY51 audio effect and HDR10 video effect, when the display device 200 of this model requests to play asset a, the server 400 can search the cache according to the playing capability information, and obtain the MPS code corresponding to the highest specification list code combination supported by the cache as 5111. Meanwhile, the server 400 also needs to match other playlists supported by the display apparatus 200. After the matching is completed, the playlist including 6 resolutions 11, 21, 31, 41, 51, 91 may be returned to the display device 200.
It can be seen that, in this embodiment, the server 400 may define a code in a specific form for a new asset attribute classification based on the form of the above list code, and in the caching process, the server 400 may cover all asset attribute classifications and attribute values in an asset item based on the defined code, and determine a play address in the form of a list code combination after the display device 200 sends an asset caching instruction, so that when a large number of display devices 200 have high concurrent requests, operations of parsing and requesting data do not need to be repeatedly performed, and the acquisition efficiency of asset data is improved.
In some embodiments, if the target playlist is not found in the network element local cache, the server 400 may read the target playlist from the database unit and store the read target playlist in the network element local cache. For example, when the requested asset ID in the asset caching instruction sent by the display device 200 is the first request of the asset item, the query cannot be performed in the mpspii cache of the server 400, and at this time, mpspai is triggered to read the playlist from redis and write the playlist into the cache local to the network element, so that subsequent cache lookup performed by the display device 200 for the asset ID can be obtained from the cache.
Since one media asset item is accessed in the latest time period, the probability of being accessed in a future time period is higher, namely the media asset item is used as a hot spot media asset, and therefore, for convenience of subsequent access, when the read target playlist is stored in the local cache of the network element, the media asset data can be cached at the head of the linked list of the local cache of the network element. I.e., new data or accessed data will move to the head of the linked list.
In some embodiments, the server 400 may further monitor the memory usage amount of the local cache of the network element, and delete the playlist data stored at the tail of the linked list of the local cache of the network element when the memory usage amount reaches the upper limit. That is, after the set cache media resources reach the upper limit, the server 400 automatically eliminates the data at the tail of the linked list, and since the data stored at the tail of the linked list is not the hotspot media resource data generally, or the number of times of calling the hotspot media resource data is low, the media resources at the current hotspot can be ensured to be obtained quickly by setting the storage of the media resource data in the linked list, and the upper limit of the network element memory can be controlled not to be expanded infinitely, so that the utilization rate of the local cache is improved.
In some embodiments, after the step of searching for the list code combination according to the playing capability information, the server 400 may detect the cached playlist data in the local cache of the current network element to determine whether the current cache contains the playlist according to the playing capability of the current display apparatus 200. If there is no playlist in the target subset that matches the playback capability information, the preset compatibility priority may be extracted, and a portion of the capability items may be deleted in the playback capability information according to the preset compatibility priority, so that a list code combination may be searched for in the target subset according to the playback capability information from which the portion of the capability items are deleted.
For example, for asset B, which may not support the overlay audio effect, only the video effect HDR10 is overlaid, then its list of assets cached at server 400 includes H264, H265, 5110. When model 1 has the playback capability of DOLBY51+ HDR10, if the display device 200 of this model requests to play media asset B, the server 400 cannot obtain the corresponding list by looking up the cache. At this time, the server 400 may be downward compatible in accordance with the principle of the priority video effect. I.e. after deleting the playing capability of DOLBY51, this model can still play the HDR10 type of assets, so the server 400 can search the cache again to obtain the MPS encoding 5110 list playing address and return. Similarly, if the playlist conforming to the current playing capability information is not found, part of capability items can be continuously deleted in the playing capability information, so that the machine model can also play DOLBY51 type media assets, and continue to be downward compatible, that is, the H265 list and the H264 list can be continuously searched subsequently.
Based on the foregoing media asset list caching method, in some embodiments of the present application, a server 400 is further provided, where the server 400 includes: a storage module 420, a communication module 410, and a control module 430. Wherein the storage module 420 is configured to store asset data, the asset data comprising a plurality of asset attributes; the communication module 410 is configured to establish a communication connection with the display apparatus 200; the control module is configured to perform the following program steps:
acquiring a media asset caching instruction sent by a user through display equipment; responding to the media asset caching instruction, and analyzing the media asset ID and the playing capacity information of the display equipment from the media asset caching instruction; searching a target play list in a local cache of the network element according to the media asset ID, wherein the target play list comprises a list code combination and a play address which accord with the play capability information; and sending the target play list to the display device.
In correspondence with the above-mentioned server 400, in some embodiments of the present application, there is also provided a display apparatus 200, the display apparatus 200 including: a display 260, a communicator 220, and a controller 250. Wherein the display 260 is configured to display a user interface; the communicator 220 is configured to establish a communication connection with the server 400; as shown in fig. 9 and 10, the controller 250 is configured to execute the following program steps:
acquiring a control instruction which is input by a user and used for playing media assets; responding to the control instruction, and sending a media asset caching instruction to the server, wherein the media asset caching instruction comprises a media asset ID and playing capacity information of the display equipment; receiving a target play list fed back by the server according to the media asset caching instruction, wherein the target play list comprises a list code combination and a play address which are searched in a local cache of a network element of the server according to the media asset ID and accord with the play capability information; and displaying a media asset detail interface according to the list code combination, and playing the media asset according to the playing address.
As can be seen from the above technical solutions, based on the server 400 and the display device 200 provided in the above embodiments, the above embodiments may trigger the display device 200 to send a media asset caching instruction to the server 400 when the user controls playing of media assets. After receiving the media asset caching instruction, the server 400 may search, according to the media asset ID in the media asset caching instruction, a target playlist that meets the playing capability of the display device 200 in the network element local cache, and feed back the target playlist to the display device 200. And the display device 200 displays a media asset detail interface according to the target play list to play the media asset. According to the method, the media asset data cached in the local cache of the network element can meet more display equipment 200 with different playing capabilities through the list code combination, so that the display equipment 200 can more easily acquire the playlist from the local cache of the network element, the concurrency capability of the server 400 is improved, and the playing delay is reduced.
The embodiments provided in the present application are only a few examples of the general concept of the present application, and do not limit the scope of the present application. Any other embodiments extended according to the scheme of the present application without inventive efforts will be within the scope of protection of the present application for a person skilled in the art.

Claims (10)

1. A server, comprising:
a storage module configured to store asset data, the asset data comprising a plurality of asset attributes;
a communication module configured to establish a communication connection with a display device;
a control module configured to:
acquiring a media asset caching instruction sent by a user through the display equipment;
responding to the media asset caching instruction, and analyzing a media asset ID and the playing capacity information of the display equipment from the media asset caching instruction;
searching a target play list in a local cache of a network element according to the media asset ID, wherein the target play list comprises a list code combination and a play address which accord with the play capability information;
and sending the target play list to the display equipment.
2. The server according to claim 1, wherein a media asset synchronization network element, a database unit and a media asset interface network element are further configured in the control module;
the database unit is connected with the storage module through the media asset synchronization network element; the media asset synchronization network element is used for reading media asset data from the storage module and sending the read media asset data to the database unit;
the database unit is connected with a plurality of media resource interface network elements; a network element local cache is arranged in the media resource interface network element; the database unit is used for distributing the media asset data sent by the media asset synchronization network element to the media asset interface network element so as to cache the media asset data in a network element local cache of the media asset interface network element.
3. The server of claim 1, wherein the control module is further configured to:
acquiring media asset attribute information, wherein the media asset attribute information comprises a plurality of attribute classifications, and each attribute classification comprises at least one attribute value;
traversing the number of attribute classifications in the media asset attribute information and the number of attribute values of each attribute classification;
defining a list code for each attribute value according to the attribute classification number and the attribute value number;
combining the list codes to generate the list code combination.
4. The server of claim 3, wherein the control module is further configured to:
extracting a playing address of the media asset data from the storage module according to the media asset ID;
establishing a mapping relation between a list code combination in the play list and the play address to generate the play list;
and caching the playlist into a database unit so that the local cache of the network element can acquire the playlist from the database unit.
5. The server of claim 1, wherein the control module is further configured to:
in the step of searching a target play list in a local cache of the network element according to the media asset ID, searching a target subset in the local cache of the network element according to the media asset ID;
according to the playing capability information, searching a list code combination which accords with the playing capability information in the target subset;
and extracting the play address corresponding to the list code combination to obtain a target play list.
6. The server of claim 5, wherein the control module is further configured to:
after the step of searching for the list code combination which accords with the playing capability information, if no playing list which accords with the playing capability information exists in the target subset, extracting a preset compatible priority;
deleting part of capability items in the playing capability information according to the preset compatible priority;
and searching a list code combination in the target subset according to the playing capacity information after deleting part of the capacity items.
7. The server of claim 1, wherein the control module is further configured to:
in the step of searching a target play list in a local cache of the network element according to the media asset ID, if the target play list is not searched in the local cache of the network element, reading the target play list from a database unit;
and storing the read target play list in the head of the local cache linked list of the network element.
8. The server of claim 7, wherein the control module is further configured to:
monitoring the memory usage amount of the local cache of the network element;
and when the usage amount of the memory reaches the upper limit, deleting the playlist data stored at the tail part of the local cache linked list of the network element.
9. A display device, comprising:
a display configured to display a user interface;
a communicator configured to establish a communication connection with a server;
a controller configured to:
acquiring a control instruction which is input by a user and used for playing media assets;
responding to the control instruction, and sending a media asset caching instruction to the server, wherein the media asset caching instruction comprises a media asset ID and playing capacity information of the display equipment;
receiving a target play list fed back by the server according to the media asset caching instruction, wherein the target play list comprises a list code combination and a play address which are searched in a local cache of a network element of the server according to the media asset ID and accord with the play capability information;
and displaying a media asset detail interface according to the list code combination, and playing the media asset according to the playing address.
10. A media asset playlist caching method is applied to a server, the server establishes communication connection with a display device, and the media asset playlist caching method comprises the following steps:
acquiring a media asset caching instruction sent by a user through the display equipment;
responding to the media asset caching instruction, and analyzing a media asset ID and the playing capacity information of the display equipment from the media asset caching instruction;
searching a target play list in a local cache of a network element according to the media asset ID, wherein the target play list comprises a list code combination and a play address which accord with the play capability information;
and sending the target play list to the display equipment.
CN202111006311.5A 2021-08-30 2021-08-30 Server, display equipment and media asset play list caching method Active CN113727153B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111006311.5A CN113727153B (en) 2021-08-30 2021-08-30 Server, display equipment and media asset play list caching method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111006311.5A CN113727153B (en) 2021-08-30 2021-08-30 Server, display equipment and media asset play list caching method

Publications (2)

Publication Number Publication Date
CN113727153A true CN113727153A (en) 2021-11-30
CN113727153B CN113727153B (en) 2023-10-13

Family

ID=78679234

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111006311.5A Active CN113727153B (en) 2021-08-30 2021-08-30 Server, display equipment and media asset play list caching method

Country Status (1)

Country Link
CN (1) CN113727153B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113938741A (en) * 2021-12-08 2022-01-14 聚好看科技股份有限公司 Server and media asset playing exception handling method

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110143732A1 (en) * 2008-08-15 2011-06-16 Jian Yang Method and system for receiving and delivering a media service
CN104159132A (en) * 2014-08-22 2014-11-19 华为软件技术有限公司 Method and device of implementing customized service of video
US20140379823A1 (en) * 2013-06-19 2014-12-25 Twilio, Inc. System and method for transmitting and receiving media messages
CN105141569A (en) * 2014-05-30 2015-12-09 华为技术有限公司 Media processing method and device
CN106101744A (en) * 2016-06-23 2016-11-09 深圳创维-Rgb电子有限公司 A kind of method and device of online broadcasting TV
CN112199521A (en) * 2020-12-03 2021-01-08 浙江岩华文化科技有限公司 Automatic media asset arranging method, device and system, electronic device and storage medium
CN112367550A (en) * 2020-10-30 2021-02-12 Vidaa美国公司 Method for realizing multi-title dynamic display of media asset list and display equipment
CN113242444A (en) * 2021-06-10 2021-08-10 聚好看科技股份有限公司 Display device, server and media asset playing method

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110143732A1 (en) * 2008-08-15 2011-06-16 Jian Yang Method and system for receiving and delivering a media service
US20140379823A1 (en) * 2013-06-19 2014-12-25 Twilio, Inc. System and method for transmitting and receiving media messages
CN105141569A (en) * 2014-05-30 2015-12-09 华为技术有限公司 Media processing method and device
CN104159132A (en) * 2014-08-22 2014-11-19 华为软件技术有限公司 Method and device of implementing customized service of video
CN106101744A (en) * 2016-06-23 2016-11-09 深圳创维-Rgb电子有限公司 A kind of method and device of online broadcasting TV
CN112367550A (en) * 2020-10-30 2021-02-12 Vidaa美国公司 Method for realizing multi-title dynamic display of media asset list and display equipment
CN112199521A (en) * 2020-12-03 2021-01-08 浙江岩华文化科技有限公司 Automatic media asset arranging method, device and system, electronic device and storage medium
CN113242444A (en) * 2021-06-10 2021-08-10 聚好看科技股份有限公司 Display device, server and media asset playing method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
杨海生;: "大数据技术在高清媒资系统中的应用研究", 广播与电视技术, no. 02 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113938741A (en) * 2021-12-08 2022-01-14 聚好看科技股份有限公司 Server and media asset playing exception handling method
CN113938741B (en) * 2021-12-08 2023-08-11 聚好看科技股份有限公司 Server and media asset playing exception handling method

Also Published As

Publication number Publication date
CN113727153B (en) 2023-10-13

Similar Documents

Publication Publication Date Title
US11812189B2 (en) Smart television and method for displaying graphical user interface of television screen shot
US11601719B2 (en) Method for processing television screenshot, smart television, and storage medium
EP1672920B1 (en) Searching electronic program guide data
US8966546B2 (en) Method and apparatus for reproducing content through integrated channel management
US11789960B2 (en) Systems and methods for grouping search results from multiple sources
US20150289024A1 (en) Display apparatus and control method thereof
KR101638190B1 (en) Apparatus and method of digital media server's contents flip listing caching using user input feedback
CN113727153B (en) Server, display equipment and media asset play list caching method
US20050165941A1 (en) Methods and apparatuses for streaming content
WO2021139045A1 (en) Method for playing back media project and display device
CN111654753B (en) Application program starting method and display device
CN114173167A (en) Display device, content distribution network system, and server
CN112052376A (en) Resource recommendation method, device, server, equipment and medium
CN114173176B (en) Server, display equipment and media asset filtering method
WO2022166349A1 (en) Media asset push method and smart terminal
US20230119195A1 (en) Display apparatus
WO2023246157A1 (en) Display device and channel processing method
CN117812350A (en) Display equipment and media recording method
CN117812414A (en) Display equipment and video recording method of multipath media assets
WO2022198082A1 (en) Display apparatus and method for displaying channel list
CN117806746A (en) Display equipment and audio playing interface display method
CN115866313A (en) Display device, server and recommendation window display method
CN115270030A (en) Display device and media asset playing method
KR102051541B1 (en) Display apparatus and control method thereof
CN117812278A (en) Display equipment and search display method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant