CN113365116B - Audio and video resource management method and device - Google Patents

Abstract

The application discloses an audio and video resource management method and device, and belongs to the technical field of multimedia. In the method, a resource application request is received, and a target record containing an identifier of a resource to be applied is searched from a resource management table according to the identifier of the resource to be applied carried by the resource application request, wherein the resource management table comprises a plurality of records, and each record is used for indicating the use condition of one audio and video resource. And then, managing the resources to be applied according to the resource application request and the target record. Therefore, each audio and video resource can be managed respectively, the resource to be applied can be distributed to the application or physical channel of the current resource application without waiting for the closing of the multimedia application or multimedia physical channel occupying the resource to be applied, the time spent in switching the application or physical channel is reduced, and the switching efficiency is improved.

Description

Audio and video resource management method and device

Technical Field

The present application relates to the field of multimedia technologies, and in particular, to a method and an apparatus for managing audio and video resources.

Background

Currently, people can use display devices to play audio and video for viewing. The display device can receive and play audio and video data through the multimedia physical channel, or the display device can acquire and play audio and video data from the server through the installed multimedia application. However, in both the multimedia application and the multimedia physical channel, after the audio and video data is acquired, the audio and video data needs to be processed and played by using hardware resources of the display device. The hardware resources include audio and video resources such as audio decoders, video decoders, and other processing resources.

In the related art, when detecting that a multimedia application or a multimedia physical channel is opened, a display device may allocate a hardware resource for processing playing audio/video data to the multimedia application or the multimedia physical channel. Subsequently, when other multimedia applications or multimedia physical channels need to be switched, the display device may control the multimedia application or multimedia physical channel currently occupying the audio/video resources to be closed, so as to release the hardware resources previously allocated to the multimedia application or multimedia physical channel, and further allocate the released hardware resources to other multimedia applications or multimedia physical channels again.

Since, in the related art, the display device can determine that the allocated hardware resources are released after detecting that the multimedia application or the multimedia physical channel is closed. That is, the display device needs to wait until the multimedia application or the multimedia physical channel is closed before allocating the hardware resource to another application or physical channel again, which results in a long time spent on switching the application or physical channel and a low switching efficiency.

Disclosure of Invention

The embodiment of the application provides an audio and video resource management method, an audio and video resource management device and a storage medium, which can shorten the time spent in switching multimedia applications or multimedia physical channels and improve the switching efficiency. The technical scheme is as follows:

in one aspect, a method for managing audio and video resources is provided, where the method includes:

receiving a resource application request, wherein the resource application request carries a first identifier, an identifier of a resource to be applied, an exclusive identifier and a preemption identifier, the first identifier is an identifier of a multimedia application or a multimedia physical channel which sends the resource application request, the exclusive identifier is used for indicating whether the resource to be applied is exclusive, and the preemption identifier is used for indicating whether the resource to be applied is preempted;

searching a target record containing the identifier of the resource to be applied from a resource management table, wherein the resource management table comprises a plurality of records, and each record is used for indicating the use condition of one audio and video resource;

and managing the resources to be applied according to the resource application request and the target record.

In another aspect, there is provided a display device including:

a display;

a controller in communication with the display, the controller configured to perform the audiovisual resource management method provided previously.

In another aspect, a computer readable storage medium is provided, in which a computer program is stored, and the computer program, when executed by a processor, implements the steps of the audio and video resource management method provided in the foregoing.

The beneficial effects brought by the technical scheme provided by the embodiment of the application at least comprise:

in the embodiment of the application, the resources to be applied can be managed according to the resource application request and the resource management table. Because the resource application request carries the identifier of the resource to be applied, and each record included in the resource management table is used for indicating the use condition of one audio/video resource, the respective management of each audio/video resource can be realized. Therefore, after the display equipment determines that the resources to be applied are released according to the resource management table, the resources to be applied can be distributed to the multimedia application or the multimedia physical channel of the currently applied resources, the user does not need to wait for the multimedia application or the multimedia physical channel occupying the resources to be applied to be closed and then distribute the resources to be applied to the application or the physical channel of the currently applied resources, time spent in switching the application or the physical channel is reduced, and switching efficiency is improved.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the description below are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.

Fig. 1 is a system architecture diagram related to an audio and video resource management method provided in an embodiment of the present application;

fig. 2 is a flowchart of an audio and video resource management method provided in an embodiment of the present application;

fig. 3 is a schematic structural diagram of a display device provided in an embodiment of the present application;

fig. 4 is a schematic structural diagram of another display device provided in an embodiment of the present application.

Detailed Description

To make the objects, technical solutions and advantages of the exemplary embodiments of the present application clearer, the technical solutions in the exemplary embodiments of the present application will be clearly and completely described below with reference to the drawings in the exemplary embodiments of the present application, and it is obvious that the described exemplary embodiments are only a part of the embodiments of the present application, but not all the embodiments.

All other embodiments, which can be derived by a person skilled in the art from the exemplary embodiments shown in the present application without inventive effort, shall fall within the scope of protection of the present application. Moreover, while the disclosure herein has been presented in terms of exemplary embodiment or embodiments, it is to be understood that each aspect of the disclosure can independently be implemented as a single unitary embodiment.

It should be understood that the terms "first," "second," "third," and the like in the description and in the claims of the present application and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used are interchangeable under appropriate circumstances and can be implemented in sequences other than those illustrated or otherwise described herein with respect to the embodiments of the application, for example.

Furthermore, the terms "comprises" and "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or device that comprises a list of elements is not necessarily limited to those elements explicitly listed, but may include other elements not expressly listed or inherent to such product or device.

The term "module," as used herein, refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the functionality associated with that element.

Before explaining the embodiments of the present application in detail, an application scenario related to the embodiments of the present application will be described.

Currently, a user may play audio and video through a multimedia application or a multimedia physical channel on a display device, and when the multimedia application or the multimedia physical channel plays audio and video data, the display device may directly allocate hardware resources for processing and playing video data, including audio and video resources, to the multimedia application or the multimedia physical channel. In this case, when a plurality of multimedia applications or multimedia applications and multimedia physical channels need to be switched, the display device can learn that all hardware resources are completely released after detecting that the multimedia application or multimedia physical channel occupying the resources is closed, and then can reallocate the released resources to other applications or physical channels. However, in some scenarios, for the multimedia application or multimedia physical channel to be switched, the resource that may be needed by the multimedia application or multimedia physical channel to be switched is only audio/video resource, and in this case, if the display device releases reallocation after waiting for the multimedia application or multimedia physical channel occupying the resource to release all hardware resources, the unnecessary waiting time will be increased, and the switching efficiency will be reduced. The audio and video resource management method provided by the embodiment of the application can be used for distributing audio and video resources for multimedia applications or multimedia physical channels in the scene so as to improve the resource utilization efficiency.

For example, when an audio and video is played through a multimedia physical channel of a display device, an advertisement is inserted in the process of playing the audio and video, however, the inserted advertisement is usually played through a multimedia application, and at this time, the resource manager needs to reallocate audio and video resources allocated to the multimedia physical channel to the multimedia application. The audio and video resource management method provided by the embodiment of the application can be used for allocating audio and video resources according to the resource application request and the resource management table in the scene so as to realize management of the audio and video resources.

For another example, when a video corresponds to audio in multiple languages, the resource manager needs to control the video resource and the audio resource separately, in this case, the audio and video resource management method provided in this embodiment may also be adopted to allocate the video resource to a multimedia application, so that the multimedia application plays the video, and allocate the audio resource to another multimedia application, or a multimedia physical channel, so that the multimedia application or the multimedia physical channel plays the audio in the language selected by the user.

Next, a system architecture related to the audio and video resource management method provided in the embodiment of the present application is introduced.

Fig. 1 is a system structure diagram of a display device related to an audio and video resource management method provided in an embodiment of the present application. As shown in fig. 1, the display device 100 includes a resource manager 101, an installed multimedia application 102, a multimedia object channel 103, and an audio-video resource 104. The resource manager 101 may communicate with the multimedia application 102, the multimedia object channel 103, the audio video resource 104.

Wherein, the resource manager 101 may receive the resource application request sent by the multimedia application 102 and the multimedia object channel 103. Then, the resource manager 101 may search the target record from the resource record table according to the identifier of the resource to be applied carried in the resource application request, and further determine whether to allocate the resource to be applied to the multimedia application or the multimedia physical channel identified by the first identifier, that is, the multimedia application or the multimedia physical channel that sends the resource application request, according to the preemption identifier carried in the resource application request and the exclusive identifier included in the target record. The resource management table includes a plurality of records, and each record is used to indicate the usage of one audio/video resource 104.

After allocating the resource to be applied to the multimedia application or the multimedia physical channel identified by the first identifier according to the resource application request and the target record, the resource manager 101 may update the target record according to the resource application request.

It should be noted that the resource manager 101 may be a hardware device in the display device, such as a controller or a processor of the display device. Optionally, the resource manager 101 may also be a software module in the display device, which is not limited in this embodiment of the application.

The multimedia application 102 is an application installed on the display device 100 and used for playing audio and video, and the multimedia physical channel 103 is a physical channel on the display device 100 and capable of playing audio and video. The multimedia application 102 and the multimedia physical channel 103 may send a resource acquisition request to the resource manager 101.

The audio/video resources 104 are hardware resources for processing and playing audio/video in the display device 100, and may include a video decoder, an audio decoder, a modulation decoder, and the like.

Next, an audio and video resource management method provided in this embodiment of the present application is described.

Fig. 2 is a flowchart of an audio and video resource management method provided in an embodiment of the present application, where the method may be applied to a resource manager, and the resource manager may refer to the resource manager 101 in fig. 1. As shown in fig. 2, the method comprises the steps of:

step 201: a resource application request is received.

In the embodiment of the application, after the multimedia application or the multimedia physical channel is opened, when the multimedia application or the multimedia physical channel needs to acquire the audio and video resource, the resource application request may be sent to the resource manager, and the resource application request may carry an identifier of the resource to be applied, the first identifier, the preemption identifier, and the exclusive identifier. The first identifier is an identifier of a multimedia application or a multimedia physical channel which sends a resource application request, the exclusive identifier is used for indicating whether to monopolize the resource to be applied, and the preemption identifier is used for indicating whether to preempt the resource to be applied. The resource to be applied is an audio/video resource to be acquired by a multimedia application or a multimedia physical channel, and illustratively, the resource to be applied may include an audio decoder, a video decoder, and a modulation decoder. Accordingly, the resource manager may receive a resource application request.

Optionally, after the multimedia application is started, the controller of the display device may control the display to display a configuration interface, where the configuration interface includes an item of whether to preempt and monopolize the configuration, and the controller may obtain the preempt identifier and the monopolize identifier selected by the user and store the obtained preempt identifier and monopolize identifier in the memory. Similarly, each multimedia physical channel in the display device also corresponds to a configuration interface, the configuration interface includes whether to preempt and whether to monopolize the configuration item, and the controller can obtain the preempt identifier and the monopolize identifier selected by the user and store the preempt identifier and the monopolize identifier into the memory.

Optionally, the memory of the display device may store a multimedia application and a corresponding relationship between the multimedia physical channel and a default configuration, where the default configuration includes whether to preempt or monopolize. When the controller does not obtain the configuration selected by the user, the controller may obtain a default configuration corresponding to the multimedia application or the multimedia physical channel from the corresponding relationship, and use a preemption identifier for indicating whether to preempt and an exclusive identifier for indicating whether to monopolize, which are included in the default configuration, as the preemption identifier and the exclusive identifier of the multimedia application or the multimedia physical channel.

As an example, the preemption identification and the exclusive identification may be "yes or no", that is, whether to preempt the resource or to monopolize the resource is directly indicated by "yes or no". Optionally, a specified identifier may be preset to indicate whether to preempt the resource or to monopolize the resource through the specified identifier, for example, a number 1 may be set to indicate to preempt the resource or monopolize the resource, and a number 0 may be set to indicate to not preempt the resource or to not monopolize the resource, which is not limited herein in the embodiment of the present application.

Step 202: and searching a target record containing the identifier of the resource to be applied from a resource management table, wherein the resource management table comprises a plurality of records, and each record is used for indicating the use condition of one audio and video resource.

The resource management table is a management table stored in a memory of the display device, and the resource management table may include a plurality of records, where each record is used to indicate a use condition of an audio/video resource, that is, each record corresponds to one audio/video resource, for example, an audio decoder 1 corresponds to one record, an audio decoder 2 corresponds to one record, a video decoder 1 corresponds to one record, and a video decoder 2 corresponds to one record.

It should be noted that each record may include a resource identification field, an occupier identification field, and an exclusive identification field, where a resource identification included in the resource identification field may be used to identify an audio/video resource. And the identifier in the occupation party identifier field is used for identifying the multimedia application or the multimedia physical channel occupying the audio and video resources. And the identifier in the exclusive identifier field is used for indicating whether the multimedia application or the multimedia physical channel occupying the audio and video resources has exclusive resources.

After receiving the resource application request, the resource manager can obtain the identifier of the resource to be applied carried in the resource application request, compare the identifier of the resource to be applied with the resource identifier included in the resource identifier field in each record in the resource management table, and take one record in which the resource identifier included in the resource identifier field is the same as the identifier of the resource to be applied as a target record.

Exemplarily, the identifier of the resource to be applied carried by the resource application request is assumed to be: video, the first identifier is: applying 1, wherein the preemption identification is as follows: if, the exclusive flag is: is. The resource management table stored in memory is shown in table 1, where Video is used to identify the Video decoder, audio is used to identify the Audio decoder, and Tuner/demux is used to identify the modulation decoder. Then, the resource manager can search the target record, which includes the resource identifier that is also the video, from the resource management table according to the identifier video of the resource to be applied.

TABLE 1

Resource identification wordSegment of	Identity field of occupier	Exclusive identification field
			Video	Application 2	Whether or not
Audio	Application 3	Is that
			Tuner/demux

It should be noted that, when a resource is not currently occupied, an occupied party identifier field corresponding to a resource identifier of the resource in the resource record table may be null. Optionally, a designated identifier may also be preset to indicate that the resource is unoccupied, and the embodiment of the present application is not limited herein. Moreover, when the occupied party identifier field is empty or is a designated identifier for indicating that the occupied party identifier field is not occupied, the exclusive identifier field corresponding to the occupied party identifier field may also be empty or an exclusive identifier for indicating that the exclusive identifier field is not exclusive.

Step 203: and managing the resources to be applied according to the resource application request and the target record.

After finding the target record, the resource manager may first detect whether the resource to be applied is occupied according to an owner identifier field included in the target record.

In some embodiments, the resource manager may detect whether the tenant identity field of the target record is empty, or may detect whether the tenant identity field of the target record is a specified identity. If the occupied party identifier field in the target record is empty or is a designated identifier, it indicates that the resource to be applied is not occupied currently, and at this time, the resource manager may directly allocate the resource to be applied to the multimedia application or multimedia physical channel currently applying for the resource, that is, the multimedia application or multimedia physical channel identified by the first identifier.

Exemplarily, the identifier of the resource to be applied carried by the resource application request is assumed to be: tuner/demux, the first identifier is: application 4, the preemption identification is: if, the exclusive flag is: and if not. As shown in table 1, the resource management table stored in the display device may be configured such that the resource manager may acquire that the tenant identification field in the target record is empty, and may allocate the resource Tuner/demux to be applied to the application identified as application 4.

After allocating the resource to be applied to the multimedia application or the multimedia physical channel identified by the first identifier, the resource manager may add the first identifier to an owner identifier field of the target record, and add the exclusive identifier carried in the resource application request to an exclusive identifier field of the target record, so as to complete updating of the resource management table.

It should be noted that, since the resource to be applied for before is not occupied, the target record includes an occupied party identification field and an exclusive identification field that are null. After the resource to be applied is allocated to the multimedia application or the multimedia physical channel identified by the first identifier, the multimedia application or the multimedia physical channel identified by the first identifier occupies the resource to be applied, so that the resource manager can write the first identifier carried in the resource application request into an identifier field of an occupier included in the target record, and write the exclusive identifier carried in the resource application request into an exclusive identifier field included in the target record, thereby updating the target record, that is, updating the resource management table.

Illustratively, continuing with the foregoing example, after the resource manager allocates the resource Tuner/demux to be applied to the application identified as application 4, the application 4 carried in the resource application request may be written into the tenant identification field of the target record, and the exclusive identifier carried in the resource application request may be: and if not, writing the exclusive identification field of the target record to obtain the updated resource management table shown in the table 2.

TABLE 2

Resource identification field	Identity field of occupier	Exclusive identification field
			Video	Application 2	Whether or not
Audio	Application 3	Is that
			Tuner/demux	Applications 4	Whether or not

Optionally, if the occupier identification field in the target record is not empty or is not a designated identification, it indicates that the resource to be applied is currently occupied, and at this time, the resource manager may further obtain a preemption identification carried in the resource application request, and then manage the resource to be applied according to the preemption identification carried in the resource application request.

The resource manager may detect whether the preemption identifier carried in the resource application request indicates resource preemption or resource non-preemption. Exemplarily, the resource manager may detect whether the preemption identifier carried in the application request is a first keyword, indicate that the multimedia application or the multimedia channel currently requesting the resource to be applied allows preemption of the resource when the preemption identifier carried in the application request is the first keyword, and indicate that the multimedia application or the multimedia channel currently requesting the resource to be applied does not allow preemption of the resource when the preemption identifier carried in the application request is not the first keyword. The first keyword is a preset preemption identification used for indicating resource preemption.

And if the preemption identification carried by the resource application request is used for indicating that the resource is not preempted, indicating that the multimedia physical channel currently applying the resource to be applied is not allowed to preempt the resource to be applied. Based on this, the resource manager may not allocate the resource to be applied to the multimedia application or the multimedia physical channel identified by the first identifier, and send an application failure message to the multimedia application or the multimedia physical channel identified by the first identifier. The application failure message is used for notifying the failure of the multimedia application or multimedia physical channel application of the current application resource to be applied.

If the preemption identification carried by the resource application request is used for indicating resource preemption, it indicates that the multimedia application or the multimedia physical channel currently applying for the resource to be applied can preempt the resource to be applied, and in this case, the resource manager can further manage the resource to be applied according to the exclusive identification field included in the target record.

It should be noted that, when the resource to be applied is managed according to the exclusive identification field included in the target record, whether the exclusive identification in the exclusive identification field included in the target record is used to indicate an exclusive resource may be detected. For example, the resource manager may detect whether an exclusive identifier in an exclusive identifier field included in the target record is a second keyword, and when the exclusive identifier in the exclusive identifier field included in the target record is the second keyword, it indicates that the exclusive resource of the multimedia application or the multimedia channel occupying the resource to be applied is occupied, that is, the resource is not allowed to be preempted, and when the exclusive identifier in the exclusive identifier field included in the target record is not the second keyword, it indicates that the exclusive resource of the multimedia application or the multimedia channel occupying the resource to be applied is not occupied, that is, the resource is allowed to be preempted. The second keyword may be a preset keyword for indicating an exclusive resource. It should be noted that the first keyword and the second keyword may be the same or different.

If the exclusive identifier in the exclusive identifier field included in the target record indicates that the resource is exclusive, even if the multimedia application or the multimedia physical channel currently applying for the resource has the right to preempt the resource, the multimedia application or the multimedia physical channel currently occupying the resource is not allowed to preempt the resource to be applied because the multimedia application or the multimedia physical channel currently applying for the resource has the exclusive right to preempt the resource. On the basis, the resource manager can send an application failure message to the multimedia application or the multimedia physical channel applying for the resource so as to inform that the resource application to be applied fails.

Optionally, if the exclusive identifier in the exclusive identifier field of the target record is used to indicate that the resource is not occupied exclusively, the resource manager may send a resource release message to the multimedia application or the multimedia physical channel identified by the second identifier in the tenant identifier field of the target record, where the resource release message carries an identifier of the resource to be applied; and when a release completion message sent by the multimedia application or the multimedia physical channel identified by the second identifier is received, allocating the resource to be applied to the multimedia application or the multimedia physical channel identified by the first identifier.

It should be noted that, when the exclusive id in the exclusive id field of the target record is used to indicate that the resource is not occupied exclusively, it indicates that the multimedia application or the multimedia physical channel occupying the resource to be applied is not exclusive of the resource to be applied, and allows other multimedia applications or multimedia physical channels to occupy the resource to be applied. In this way, the resource manager may determine, according to the second identifier, the multimedia application or the multimedia physical channel that occupies the resource to be applied, and send a resource release message to the multimedia application or the multimedia physical channel that occupies the resource to be applied, so as to instruct the resource manager to release the resource to be applied. After receiving the release resource message, the multimedia application or multimedia physical channel occupying the resource to be applied can release the resource to be applied, and after the release is completed, a release completion message can be returned to the resource manager. The resource manager may determine that the resource to be applied has been unoccupied after receiving the release completion message. Thus, the resource manager can allocate the resource to be applied to the multimedia application or the multimedia physical channel which currently requests the resource to be applied.

Illustratively, the resource application request illustrated in step 202 and the resource management table shown in table 1 are still taken as an example. The resource manager acquires that the second identifier included in the identifier field of the occupier in the target record is application 2, that is, the Video of the resource to be applied is occupied by the application identified as application 2, and the preemption identifier carried in the resource application request is yes. Then, the resource manager acquires whether the exclusive identification field in the target record is negative, that is, whether the application identified as application 2 allows the to-be-applied resource Video to be preempted. Thus, the resource manager can send a resource release message to the application identified as application 2, where the resource release message carries the identifier Video of the resource to be applied. After receiving the release resource message, the application 2 may release the Video of the resource to be applied according to the identifier Video of the resource to be applied carried in the release resource message, and after the release is completed, the application 2 may send a release completion message to the resource manager. After receiving the release completion message sent by the application identified as application 2, the resource manager may allocate the to-be-applied resource Video to the application identified as application 1.

After the resource manager allocates the resource to be applied to the multimedia application or the multimedia physical channel identified by the first identifier, the resource manager may replace the second identifier in the tenant identifier field of the target record with the first identifier, and replace the exclusive identifier in the exclusive identifier field of the target record with the exclusive identifier carried in the resource application request.

It should be noted that, since the resource to be applied for before is occupied by the multimedia application or the multimedia physical channel identified by the second identifier, the target record includes the tenant identification field as the second identifier. After the resource manager allocates the resource to be applied to the multimedia application or multimedia physical channel identified by the first identifier, because the multimedia application or multimedia physical channel occupying the audio/video resource changes to the multimedia application or multimedia physical channel identified by the first identifier, the resource manager can delete the second identifier and the exclusive identifier included in the occupied party identifier field and the exclusive field in the target record, write the first identifier carried in the resource application request into the occupied party identifier field of the target record, and write the exclusive identifier carried in the resource application request into the exclusive identifier field of the target record, thereby updating the target record, that is, updating the resource management table.

Continuing with the foregoing example, after the resource manager allocates the Video to be applied to the application identified as application 1, it may delete application 2 included in the tenant identification field in the target record, write application 1 carried in the resource application request into the tenant identification field, delete no included in the exclusive identification field, and write the "yes" of the exclusive identification carried in the resource application request into the exclusive identification field of the target record, thereby obtaining the updated resource management table shown in table 3.

TABLE 3

Resource identification field	Identity field of occupier	Exclusive identification field
			Video	Applications 1	Is that
Audio	Application 3	Is that
			Tuner/demux	Application 4	Whether or not

Optionally, after allocating the resource to be applied to the multimedia application or the multimedia physical channel identified by the first identifier, the resource manager may send an application success message to the multimedia application or the multimedia physical channel identified by the first identifier, so as to notify that the resource to be applied to the multimedia application or the multimedia physical channel identified by the first identifier has been allocated.

Optionally, in this embodiment of the present application, after the multimedia application or the multimedia physical channel occupying a certain resource uses up the resource, the resource may be released, and a release completion message may be sent to the resource manager. At this time, the release completion message carries the identifier of the released resource, and then the resource manager may update the resource management table according to the release completion message.

Specifically, the resource manager may search the resource management table for the target record according to the identifier of the released resource carried in the release completion message, and delete the identifier of the tenant included in the tenant identifier field in the target record and the exclusive identifier included in the exclusive field, so as to update the target record, that is, update the resource management table.

Optionally, in another possible implementation manner, after a multimedia application or a multimedia physical channel that occupies a certain resource exits, an exit message may also be sent to the resource manager, where the exit message carries an identifier of the resource that is occupied by the multimedia application or the multimedia physical channel, or carries an identifier of the multimedia application or the multimedia physical channel. The resource manager, upon receiving the exit message, may determine that the multimedia application or multimedia physical channel has released the occupied resources. In this case, the resource manager may update the resource management table according to the exit message.

If the exit message carries the identifier of the occupied resource, the resource manager may refer to the method described above to update the resource management table, which is not described herein again. Optionally, if the exit message carries an identifier of the multimedia application or the multimedia physical channel, the resource manager may update the record corresponding to the identifier of the multimedia application or the multimedia physical channel, where the identifier of the tenant is included in the identifier field of the tenant in the resource management table. The updating method can refer to the related contents, and the embodiment of the application is not described herein again.

For example, the resource manager may search the resource management table for the target record according to the identifier of the resource carried in the release completion message. After the target record is found, the resource manager may delete the contents included in the tenant identification field and the exclusive identification field in the target record, thereby updating the resource management table.

In the embodiment of the application, the resources to be applied can be managed according to the resource application request and the resource management table. Because the resource application request carries the identifier of the resource to be applied, and each record included in the resource management table is used for indicating the use condition of one audio/video resource, the respective management of each audio/video resource can be realized. In this way, after determining that the resource to be applied is released according to the resource management table, the display device can allocate the resource to be applied to the multimedia application or the multimedia physical channel of the current resource to be applied, and does not need to allocate the resource to be applied to the application or the physical channel of the current resource to be applied after waiting for the multimedia application or the multimedia physical channel occupying the resource to be applied to be closed, thereby reducing the time spent in switching the application or the physical channel and improving the switching efficiency.

Next, the present application will take the application scenario described above as an example to explain the beneficial effects of the present application.

Illustratively, when audio and video is played through a multimedia physical channel of a display device, an advertisement is inserted during the playing of the audio and video, however, the inserted advertisement is usually played through a multimedia application. In the related art, when an advertisement is inserted, the display device needs to close the multimedia physical channel, so that the multimedia physical channel releases all hardware resources such as audio and video resources and other processing resources occupied by the multimedia physical channel, and then the display device can allocate the hardware resources to the multimedia application of the inserted advertisement again. Therefore, by the method in the related art, when the multimedia channel is switched to the multimedia application in the scene, the waiting time required for switching is the time for the multimedia channel to close and release all hardware resources.

In the present application, in the above scenario, the resource manager may not need to close the multimedia channel, but only need to control the multimedia physical channel to release the audio/video resource by the method provided in the embodiment of the present application, and then may reallocate the audio/video resource to the multimedia application. That is, by the method provided in the embodiment of the present application, the waiting time required for switching is the time for releasing the audio/video resources in the hardware resources in the multimedia channel. Therefore, the audio and video resource management method provided by the embodiment of the application can shorten the switching time and improve the switching efficiency.

Optionally, in some scenarios, after the multimedia application is started, it is possible that the multimedia application does not play the audio and video data, but the display device still wants the multimedia application to allocate all the hardware resources, so that the multimedia application occupies the hardware resources. At this time, if there is another multimedia application that needs to use the audio/video resource, in the related art, the display device needs the multimedia application of the currently occupied resource to release all the hardware resources, and then the hardware resources can be allocated to the multimedia application again, otherwise, the current multimedia application cannot use the audio/video resource. In the embodiment of the present application, the resource manager only needs to release the audio and video resources by the multimedia application occupying the resources. Therefore, the switching efficiency between the multimedia applications is shortened, and the utilization rate of audio and video resources can be improved.

Referring to fig. 3, an embodiment of the present application provides a display device 300, where the device 300 includes:

the receiving module 301 is configured to receive a resource application request, where the resource application request carries a first identifier, an identifier of a resource to be applied, an exclusive identifier, and a preemption identifier, where the first identifier is an identifier of a multimedia application or a multimedia physical channel that sends the resource application request, the exclusive identifier is used to indicate whether the resource to be applied is exclusive, and the preemption identifier is used to indicate whether the resource to be applied is preempted;

the searching module 302 is configured to search a resource management table for a target record containing an identifier of a resource to be applied, where the resource management table includes a plurality of records, and each record is used to indicate a use condition of an audio/video resource;

the management module 303 manages the resource to be applied according to the resource application request and the target record.

Optionally, the management module 303 includes:

and the management unit is used for managing the resource to be applied according to the exclusive identification field included in the target record if the occupier identification field in the target record is not empty and the preemption identification carried by the resource application request is used for indicating resource preemption, wherein the identification in the occupier identification field is the identification of a multimedia application or a multimedia physical channel occupying the audio and video resources.

Optionally, the management unit comprises:

a sending subunit, configured to send a resource release message to the multimedia application or the multimedia physical channel identified by the second identifier in the tenant identifier field of the target record if the exclusive identifier in the exclusive identifier field of the target record is used to indicate that the resource is not occupied, where the resource release message carries an identifier of the resource to be applied;

and the allocation subunit allocates the resource to be applied to the multimedia application or the multimedia physical channel identified by the first identifier when receiving the release completion message of the multimedia application or the multimedia physical channel identified by the second identifier.

Optionally, the management unit further comprises:

the first replacement subunit replaces a second identifier in the occupier identifier field of the target record with the first identifier;

and the second replacement subunit replaces the exclusive identifier in the exclusive identifier field of the target record with the exclusive identifier carried by the resource application request.

Optionally, the management module 303 is specifically configured to:

and if the occupation party identification field in the target record is empty, allocating the resource to be applied to the multimedia application or the multimedia physical channel identified by the first identification.

Optionally, the management module 303 is further specifically configured to:

adding the first identifier to an occupier identifier field of the target record;

and adding the exclusive identification carried by the resource application request into an exclusive identification field of the target record.

In summary, in the embodiment of the present application, the resource to be applied may be managed according to the resource application request and the resource management table. Because the resource application request carries the identifier of the resource to be applied, and each record included in the resource management table is used for indicating the use condition of one audio/video resource, the respective management of each audio/video resource can be realized. In this way, after determining that the resource to be applied is released according to the resource management table, the display device can allocate the resource to be applied to the multimedia application or the multimedia physical channel of the current resource to be applied, and does not need to allocate the resource to be applied to the application or the physical channel of the current resource to be applied after waiting for the multimedia application or the multimedia physical channel occupying the resource to be applied to be closed, thereby reducing the time spent in switching the application or the physical channel and improving the switching efficiency.

It should be noted that: in the display device provided in the above embodiment, when managing audio and video resources, only the division of the above functional modules is used as an example, and in practical applications, the above function allocation may be completed by different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the above described functions.

A hardware configuration block diagram of a display device 400 according to an exemplary embodiment is exemplarily shown in fig. 4. As shown in fig. 4, the display device 400 includes a controller 410, a tuner demodulator 420, a communication interface 430, a detector 440, an input/output interface 450, a video processor 460-1, an audio processor 460-2, a display 480, an audio output 470, a memory 490, a power supply, and an infrared receiver.

A display 480 for receiving the image signal from the input of the video processor 460-1, displaying the video content and images, and components of the menu manipulation interface. The display 480 includes a display screen component for presenting a picture, and a driving component for driving the display of an image. The video content may be displayed from broadcast television content, or may be a variety of broadcast signals that may be received via a wired or wireless communication protocol. Alternatively, various image contents received from a network communication protocol and transmitted from a network server side can be displayed.

Meanwhile, the display 480 simultaneously displays a user manipulation UI interface generated in the display apparatus 400 and used to control the display apparatus 400.

And, depending on the type of display 480, a driving component for driving the display is also included. Alternatively, a projection device and projection screen may be included, provided display 480 is a projection display.

The communication interface 430 is a component for communicating with an external device or an external server according to various communication protocol types. For example: the communication interface 430 may be a Wifi chip 431, a bluetooth communication protocol chip 432, a wired ethernet communication protocol chip 433, or other network communication protocol chips or near field communication protocol chips, and an infrared receiver (not shown in the figure).

The display apparatus 400 may establish control signal and data signal transmission and reception with an external control apparatus or a content providing apparatus through the communication interface 430. And an infrared receiver, an interface device for receiving infrared control signals of a control device (such as an infrared remote controller).

The detector 440, which is a signal used by the display device 400 to collect an external environment or interact with the outside. The detector 440 includes a light receiver 442, a sensor for collecting the intensity of the ambient light, and a display for adaptively displaying the parameter change, etc. by collecting the ambient light.

And an image collector 441, such as a camera, a video camera, etc., which can be used to collect external environment scenes, and to collect attributes of the user or interact gestures with the user, and can adaptively change display parameters, and also can recognize user gestures, so as to implement the function of interaction with the user.

In some other exemplary embodiments, the detector 440, a temperature sensor, etc., may also be used, such as by sensing the ambient temperature, and the display device 400 may adaptively adjust the displayed color temperature of the image. For example, the display apparatus 400 may be adjusted to display a cool tone when the temperature is in a high environment, or the display apparatus 400 may be adjusted to display a warm tone when the temperature is in a low environment.

In other exemplary embodiments, the detector 440, and a sound collector, such as a microphone, may be used to receive a user's voice, a voice signal including a control instruction from the user to control the display device 400, or to collect an ambient sound for identifying an ambient scene type, and the display device 400 may adapt to the ambient noise.

The input/output interface 450 controls data transmission between the display device 400 of the controller 410 and other external devices. Such as receiving video and audio signals or command instructions from an external device.

The input/output interface 450 may include, but is not limited to, the following: any one or more of high definition multimedia interface HDMI interface 451, analog or data high definition component input interface 453, composite video input interface 452, USB input interface 454, RGB ports (not shown in the figures), etc.

In some other exemplary embodiments, the input/output interface 450 may also form a composite input/output interface with the above-mentioned plurality of interfaces.

The tuning demodulator 420 receives the broadcast television signals in a wired or wireless receiving manner, may perform modulation and demodulation processing such as amplification, mixing, resonance, and the like, and demodulates a television audio/video signal carried in a television channel frequency selected by a user and an EPG data signal from a plurality of wireless or wired broadcast television signals.

The tuner demodulator 420 is responsive to a user selected television signal frequency and to the television signal carried by the frequency, as selected by the user and controlled by the controller 410.

The tuner demodulator 420 may receive signals in various ways according to the broadcasting system of the television signal, such as: terrestrial broadcast, cable broadcast, satellite broadcast, or internet broadcast signals, etc.; and according to different modulation types, the digital modulation mode and the analog modulation mode can be realized. Depending on the type of television signal received, both analog and digital signals are possible.

In other exemplary embodiments, the tuner/demodulator 420 may be in an external device, such as an external set-top box. In this way, the set-top box outputs television audio and video signals after modulation and demodulation, and the television audio and video signals are input into the display device 400 through the input/output interface 450.

The video processor 460-1 is configured to receive an external video signal, and perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis, and the like according to a standard codec protocol of the input signal, so as to obtain a signal that can be displayed or played on the direct display device 400.

Illustratively, the video processor 460-1 includes a demultiplexing module, a video decoding module, an image synthesizing module, a frame rate conversion module, a display formatting module, and the like.

The demultiplexing module is used for demultiplexing the input audio and video data stream, and if the input MPEG-2 is input, the demultiplexing module demultiplexes the input audio and video data stream into a video signal, an audio signal and the like.

And the video decoding module is used for processing the demultiplexed video signal, including decoding, scaling and the like.

And the image synthesis module, such as an image synthesizer, is used for performing superposition mixing processing on the GUI signal input by the user or generated by the user and the video image after the zooming processing by the graphics generator so as to generate an image signal for display.

The frame rate conversion module is configured to convert an input video frame rate, such as a 60Hz frame rate into a 120Hz frame rate or a 240Hz frame rate, and the normal format is implemented in, for example, an interpolation frame mode.

The display format module is used for converting the received video output signal after the frame rate conversion, and changing the signal to conform to the signal of the display format, such as outputting an RGB data signal.

The audio processor 460-2 is configured to receive an external audio signal, decompress and decode the received audio signal according to a standard codec protocol of the input signal, and perform noise reduction, digital-to-analog conversion, and amplification processing to obtain an audio signal that can be played in the speaker.

In other exemplary embodiments, the video processor 460-1 may comprise one or more chips. The audio processor 460-2 may also comprise one or more chips.

And, in other exemplary embodiments, the video processor 460-1 and the audio processor 460-2 may be separate chips or may be integrated together with the controller 410 in one or more chips.

An audio output 472 for receiving sound signals output from the audio processor 460-2 under the control of the controller 410, such as: the speaker 472, and the external sound output terminal 474 of the generating device that can output to the external device in addition to the speaker 472 carried by the display device 400 itself, such as: an external sound interface or an earphone interface and the like.

In the embodiment of the present application, the tuner demodulator 420, the video processor 460-1 and the audio processor 460-2 are audio-video resources of the display device described in the foregoing embodiment.

The power supply provides power supply support for the display apparatus 400 from power input from the external power source under the control of the controller 410. The power supply may include a built-in power supply circuit installed inside the display apparatus 400, or may be a power supply interface installed outside the display apparatus 400 to provide an external power supply in the display apparatus 400.

A user input interface for receiving an input signal of a user and then transmitting the received user input signal to the controller 410. The user input signal may be a remote controller signal received through an infrared receiver, and various user control signals may be received through the network communication module.

For example, a user inputs a user command through a remote controller or a mobile display device, a user input interface is provided according to the user input, and the display device 400 responds to the user input through the controller 410.

In some embodiments, a user may enter user commands on a Graphical User Interface (GUI) displayed on display 480, and the user input interface receives the user input commands through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.

The controller 410 controls the operation of the display device 400 and responds to user operations through various software control programs stored in the memory 490. In the embodiment of the present application, the resource manager in the foregoing embodiment may be implemented as the controller 410.

As shown in fig. 4, the controller 410 includes a RAM413 and a ROM414, and a graphic processor 416, a CPU processor, a communication interface, such as: a first interface 418-1 through an nth interface 418-n, and a communication bus. The RAM413, the ROM414, the graphic processor 416, the CPU processor, and the communication interface are connected via a bus.

The ROM414 is used to store instructions for various system boots. If the display device 400 is powered on when a power-on signal is received, the CPU processor executes the system boot instructions in the ROM and copies the operating system stored in the memory 490 into the RAM413 so that the boot operating system is started. After the start of the operating system is completed, the CPU processor copies the various application programs in the memory 490 to the RAM413 and then starts running the various application programs.

A graphics processor 416 for generating various graphics objects, such as: icons, operation menus, user input instruction display graphics, and the like. The display device comprises an arithmetic unit which carries out operation by receiving various interactive instructions input by a user and displays various objects according to display attributes. And a renderer for generating various objects based on the arithmetic unit, and displaying the rendered result on the display 480.

A CPU processor for executing operating system and application program instructions stored in memory 490. And executing various application programs, data and contents according to various interactive instructions received from the outside so as to finally display and play various audio and video contents.

In some exemplary embodiments, the CPU processor may include a plurality of processors. The plurality of processors may include one main processor and a plurality of or one sub-processor. A main processor for performing some operations of the display apparatus 400 in a pre-power-up mode and/or operations for displaying a screen in a normal mode. A plurality of or one sub-processor for one operation in a standby mode or the like.

The controller 410 may control the overall operation of the display apparatus 400. For example: in response to receiving a user command for selecting a UI object displayed on the display 480, the controller 410 may perform an operation related to the object selected by the user command.

Wherein the object may be any one of selectable objects, such as a hyperlink or an icon. Operations related to the selected object, such as: displaying an operation connected to a hyperlink page, document, image, or the like, or performing an operation of a program corresponding to the icon. The user command for selecting the UI object may be a command input through various input means (e.g., a mouse, a keyboard, a touch pad, etc.) connected to the display apparatus 400 or a voice command corresponding to a voice spoken by the user.

The memory 490 includes memory storing various software modules for driving the display device 400. Such as: various software modules stored in memory 490, including: the controller 410 may implement management of the audio and video resources by executing the software modules described above through the receiving module 301, the searching module 302, and the managing module 303 shown in fig. 3. The memory 490 may include, among other things, a base module, a detection module, a communication module, a display control module, a browser module, and various service modules.

Wherein the base module is a bottom layer software module for signal communication between the various hardware in the postpartum care display device 400 and for sending processing and control signals to the upper layer module. The detection module is used for collecting various information from various sensors or user input interfaces, and the management module is used for performing digital-to-analog conversion and analysis management.

For example: the voice recognition module comprises a voice analysis module and a voice instruction database module. The display control module is a module for controlling the display 480 to display image content, and may be used to play information such as multimedia image content and UI interface. And the communication module is used for carrying out control and data communication with external equipment. And the browser module is used for executing a module for data communication between the browsing servers. And the service module is used for providing various services and modules including various application programs.

Meanwhile, the memory 490 may be used to store visual effect maps for receiving external data and user data, images of various items in various user interfaces, and focus objects, etc.

An embodiment of the present application further provides a non-transitory computer-readable storage medium, and when a processor of a server executes an instruction in the storage medium, the server is enabled to execute the audio and video resource management method provided in the embodiment shown in fig. 2.

An embodiment of the present application further provides a computer program product containing instructions, which when run on a computer, causes the computer to execute the audio and video resource management method provided in the embodiment shown in fig. 2.

It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, where the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.

The above description is intended only to illustrate the alternative embodiments of the present application, and should not be construed as limiting the present application, and any modifications, equivalents, improvements and the like made within the spirit and principle of the present application should be included in the protection scope of the present application.

Claims (6)

1. An audio and video resource management method, characterized in that the method comprises:

receiving a resource application request, wherein the resource application request carries a first identifier, an identifier of a resource to be applied, an exclusive identifier and a preemption identifier, the first identifier is an identifier of a multimedia application or a multimedia physical channel which sends the resource application request, the exclusive identifier is used for indicating whether the resource to be applied is exclusive or not, and the preemption identifier is used for indicating whether the resource to be applied is preempted or not;

searching a target record containing the identifier of the resource to be applied from a resource management table, wherein the resource management table comprises a plurality of records, and each record is used for indicating the use condition of one audio and video resource;

managing the resources to be applied according to the resource application request and the target record;

the managing the resource to be applied according to the resource application request and the target record comprises:

if the occupier identification field in the target record is not empty, the preemption identification carried by the resource application request is used for indicating resource preemption, and the exclusive identification in the target record is used for indicating non-exclusive resource, sending a resource release message to the multimedia application or multimedia physical channel identified by the second identification in the occupier identification field of the target record, wherein the resource release message carries the identification of the resource to be applied; when a release completion message sent by the multimedia application or multimedia physical channel identified by the second identifier is received, allocating the resource to be applied to the multimedia application or multimedia physical channel identified by the first identifier, wherein the identifier in the identifier field of the occupier is the identifier of the multimedia application or multimedia physical channel occupying the audio and video resources;

and if the occupier identification field in the target record is not empty, the preemption identification carried by the resource application request is used for indicating resource preemption, and the exclusive identification in the target record is used for indicating exclusive resource, sending a request failure message to the multimedia application or the multimedia physical channel identified by the first identification, wherein the request failure message is used for indicating that the application for the resource to be applied fails.

2. The method of claim 1, wherein after allocating the resource to be applied for to the multimedia application or multimedia physical channel identified by the first identifier, the method further comprises:

replacing a second identifier in an occupier identifier field of the target record with the first identifier;

and replacing the exclusive identification in the exclusive identification field of the target record with the exclusive identification carried by the resource application request.

3. The method of claim 1, wherein the managing the resource to be applied according to the resource request and the target record comprises:

and if the occupation party identification field in the target record is empty, allocating the resource to be applied to the multimedia application or the multimedia physical channel identified by the first identification.

4. The method of claim 3, wherein after the allocating the resource to be applied for to the multimedia application or multimedia physical channel identified by the first identifier, the method further comprises:

adding the first identifier to an occupant identifier field of the target record;

and adding the exclusive identification carried by the resource application request into an exclusive identification field of the target record.

5. A display device, comprising:

a display;

a controller in communication with the display, the controller specifically to:

receiving a resource application request, wherein the resource application request carries a first identifier, an identifier of a resource to be applied, an exclusive identifier and a preemption identifier, the first identifier is an identifier of a multimedia application or a multimedia physical channel which sends the resource application request, the exclusive identifier is used for indicating whether the resource to be applied is exclusive or not, and the preemption identifier is used for indicating whether the resource to be applied is preempted or not;

searching a target record containing the identifier of the resource to be applied from a resource management table, wherein the resource management table comprises a plurality of records, and each record is used for indicating the use condition of one audio and video resource;

if the occupier identification field in the target record is not empty, the preemption identification carried by the resource application request is used for indicating resource preemption, and the exclusive identification in the target record is used for indicating that the resource is not exclusive, sending a resource release message to the multimedia application or the multimedia physical channel identified by the second identification in the occupier identification field of the target record, wherein the resource release message carries the identification of the resource to be applied; when a release completion message sent by the multimedia application or multimedia physical channel identified by the second identifier is received, allocating the resource to be applied to the multimedia application or multimedia physical channel identified by the first identifier, wherein the identifier in the identifier field of the occupier is the identifier of the multimedia application or multimedia physical channel occupying the audio and video resources;

and if the occupier identification field in the target record is not empty, the preemption identification carried by the resource application request is used for indicating resource preemption, and the exclusive identification in the target record is used for indicating exclusive resource, sending a request failure message to the multimedia application or the multimedia physical channel identified by the first identification, wherein the request failure message is used for indicating that the application of the resource to be applied fails.

6. The apparatus of claim 5, wherein the controller is specifically configured to:

replacing a second identifier in an occupier identifier field of the target record with the first identifier;

and replacing the exclusive identification in the exclusive identification field of the target record with the exclusive identification carried by the resource application request.

Images