CN114727051A

CN114727051A - Media resource transmission device, system and method

Info

Publication number: CN114727051A
Application number: CN202210629184.2A
Authority: CN
Inventors: 刘江; 刘伟
Original assignee: Hongjing Microelectronics Technology Co ltd
Current assignee: Hongjing Microelectronics Technology Co ltd
Priority date: 2022-06-06
Filing date: 2022-06-06
Publication date: 2022-07-08
Anticipated expiration: 2042-06-06
Also published as: CN114727051B

Abstract

The invention discloses a media resource transmission device, a system and a method, comprising the following steps: a receiving circuit, a first transmitting circuit and a second transmitting circuit; the receiving circuit is configured to receive media resource information and send the media resource information to the first transmission circuit and the second transmission circuit, wherein the media resource information includes media resource data and a first timing signal; the first transmission circuit is configured to receive the media resource information, generate a second timing signal identical to the first timing signal according to the first timing signal, generate new media resource information according to the second timing signal and the media resource data, and send the new media resource information to a receiving circuit of a next-stage media resource transmission device; the second transmission circuit is configured to generate local media resource information according to the media resource information, and transmit the local media resource information to the external display device. The media resource transmission device provided by the invention ensures the synchronism and quality of media resource transmission.

Description

Media resource transmission device, system and method

Technical Field

The present invention relates to the field of data transmission technologies, and in particular, to a device, a system, and a method for transmitting media resources.

Background

A media resource transmission system (e.g., a multimedia conference system) includes a plurality of media resource transmission devices (e.g., a conference client), and generally during a media resource transmission process, media resource information needs to be sent to the plurality of media resource transmission devices to implement application scenarios such as a multimedia conference, a group presentation, and the like.

Currently, the general way of transmitting media resources is: the plurality of media resource transmission devices are sequentially connected in series, the original media resource information provided by the signal source is sequentially transmitted to the last media resource transmission device by the first media resource transmission device, and the transmission mode can lead the quality of the time sequence signal in the original media resource information to be reduced and the delay to be larger after the original media resource information is transmitted in multiple stages.

Disclosure of Invention

Therefore, the embodiments of the present disclosure provide a device, a system, and a method for media resource transmission, which can ensure the synchronization and quality of each media resource transmission device in a media resource transmission system.

In a first aspect, an embodiment of the present disclosure provides a media resource transmission device, where the media resource transmission device is applied in a multi-level media resource transmission system, and the system includes multiple levels of media resource transmission devices connected in sequence; one of the media resource transmission devices comprises: a receiving circuit, a first transmitting circuit and a second transmitting circuit; wherein, the first and the second end of the pipe are connected with each other,

the receiving circuit is configured to receive media resource information and send the media resource information to the first transmission circuit and the second transmission circuit, wherein the media resource information includes media resource data and a first timing signal;

the first transmission circuit is configured to receive the media resource information, generate a second timing signal identical to the first timing signal according to the first timing signal, generate new media resource information according to the second timing signal and the media resource data, and send the new media resource information to a receiving circuit of a next-stage media resource transmission device;

the second transmission circuit is configured to generate local media resource information according to the media resource information, and transmit the local media resource information to an external display device.

In some examples, the first timing signal includes a horizontal synchronization timing;

the first transmission circuit includes: the time sequence synchronization circuit comprises a time sequence synchronization sub-circuit, a first-in first-out sub-circuit and a first sending sub-circuit, wherein the input end of the time sequence synchronization sub-circuit is connected with the output end of the receiving circuit, and the output end of the time sequence synchronization sub-circuit is connected with the time sequence input end of the first-in first-out sub-circuit and the first input end of the first sending sub-circuit; the input end of the first-in first-out sub-circuit is connected with the output end of the receiving circuit, and the output end of the first-in first-out sub-circuit is connected with the second input end of the first transmitting sub-circuit; the output end of the first sending sub-circuit is connected with the input end of the receiving circuit of the next-stage media resource transmission device; wherein the content of the first and second substances,

the timing synchronization sub-circuit is configured to receive the first timing signal, generate a second timing signal identical to the first timing signal from the first timing signal in response to the horizontal synchronization timing, and transmit the second timing signal to the first-in first-out sub-circuit and the first transmission sub-circuit;

the first-in first-out sub-circuit is configured to receive the media asset data and to send the media asset data to the first sending sub-circuit under control of the second timing signal;

the first sending sub-circuit is configured to generate new media resource information according to the second timing signal and the media resource data, and send the new media resource information to a receiving circuit of a next-stage media resource transmission device.

In some examples, the first timing signal includes vertical synchronization timing;

the second transmission circuit includes: the frame buffer circuit comprises a frame buffer sub-circuit, a retiming sub-circuit and a second transmitting sub-circuit, wherein the input end of the frame buffer sub-circuit is connected with the output end of the receiving circuit, the output end of the frame buffer sub-circuit is connected with the first input end of the second transmitting sub-circuit, and the time sequence input end of the frame buffer sub-circuit is connected with the output end of the retiming sub-circuit; an output terminal of the retiming sub-circuit is coupled to a second input terminal of the second transmit sub-circuit; the output end of the second sending sub-circuit is connected with the external display device; wherein the content of the first and second substances,

the retiming subcircuit is configured to generate a third timing signal in response to a retiming enable signal and transmit the third timing signal to the frame buffer subcircuit and the second transmit subcircuit;

the frame buffer sub-circuit is configured to receive the media resource information, buffer the media resource data therein, and transmit the media resource data to the second transmitting sub-circuit under control of the third timing signal in response to the vertical synchronization timing;

the second transmitting sub-circuit is configured to generate local media asset information from the third timing signal and the media asset data and transmit the local media asset information to the external display device.

In some examples, the apparatus further comprises: the first transmission circuit generates the second timing signal according to a first clock signal and the first timing signal provided by the first clock source.

In some examples, the apparatus further comprises: the first clock source is connected with the clock input end of the time sequence synchronization sub-circuit, the time sequence synchronization sub-circuit is configured to receive the first time sequence signal, respond to the horizontal synchronization time sequence, generate a second time sequence signal identical to the first time sequence signal according to the first time sequence signal and the first clock signal provided by the first clock source, and send the second time sequence signal to the first-in first-out sub-circuit and the first sending sub-circuit.

In some examples, the apparatus further comprises: a first clock source connected to a clock input of the timing synchronization sub-circuit and a clock input of the retiming sub-circuit;

the timing synchronization sub-circuit is configured to receive the first timing signal, generate a second timing signal identical to the first timing signal according to the first timing signal and a first clock signal provided by the first clock source in response to the horizontal synchronization timing, and transmit the second timing signal to the first-in first-out sub-circuit and the first transmission sub-circuit;

the retiming sub-circuit is configured to generate a third timing signal from a first clock signal provided by the first clock source in response to a retiming enable signal, and to transmit the third timing signal to the frame buffering sub-circuit and the second transmitting sub-circuit; the second timing signal is the same as the third timing signal.

In a second aspect, an embodiment of the present disclosure provides a multi-level media resource transmission system, including the above media resource transmission devices connected in sequence in multiple levels; wherein the content of the first and second substances,

if one media resource transmission device is the first-level media resource transmission device, the media resource information received by the receiving circuit is the original media resource information provided by the signal source; if a media resource transmitting device is not the first-level media resource transmitting device, the media resource information received by the receiving circuit is the media resource information provided by the previous-level media resource transmitting device.

In some examples, each stage of the media resource transmitting device is provided with a first clock source, the first clock source is connected with the first transmitting circuit of the media resource transmitting device to which the first clock source belongs, and the first clock source is used for providing a first clock signal, so that the first transmitting circuit generates a second timing signal which is the same as the first timing signal according to the first clock signal and the received first timing signal.

In a third aspect, an embodiment of the present disclosure provides a media resource transmission method, which is applied to the media resource transmission device or the multi-level media resource transmission system; the method comprises the following steps:

the receiving circuit receives media resource information and sends the media resource information to the first transmission circuit and the second transmission circuit, wherein the media resource information comprises media resource data and a first time sequence signal;

the first transmission circuit receives the media resource information and generates a second time sequence signal which is the same as the first time sequence signal according to the first time sequence signal;

generating new media resource information according to the second time sequence signal and the media resource data, and sending the new media resource information to a receiving circuit of a next-stage media resource transmission device;

the second transmission circuit generates local media resource information according to the media resource information and sends the local media resource information to an external display device.

In some examples, the media resource transmitting device to which the method applies is the media resource transmitting device described above; the first transmission circuit receives the media resource information, and generating a second timing signal identical to the first timing signal according to the first timing signal includes:

the time sequence synchronization sub-circuit receives the first time sequence signal, responds to a horizontal synchronization time sequence, generates a second time sequence signal which is the same as the first time sequence signal according to the first time sequence signal, and sends the second time sequence signal to the first-in first-out sub-circuit and the first sending sub-circuit;

the first-in first-out sub-circuit receives the media resource data and sends the media resource data to the first sending sub-circuit under the control of the second time sequence signal;

and the first sending sub-circuit generates new media resource information according to the second time sequence signal and the media resource data, and sends the new media resource information to a receiving circuit of a next-stage media resource transmission device.

In some examples, the media resource transmitting device to which the method is applied is the above-mentioned media resource transmitting device; the second transmission circuit generates local media resource information according to the media resource information, and the sending of the local media resource information to an external display device comprises:

the retiming sub-circuit generates a third timing signal in response to a retiming enable signal and transmits the third timing signal to the frame buffering sub-circuit and the second transmitting sub-circuit;

the frame buffer sub-circuit is configured to receive the media resource information and buffer the media resource data therein;

transmitting the media resource data to the second transmit sub-circuit under control of the third timing signal in response to a vertical synchronization timing;

the second sending sub-circuit generates local media resource information according to the third time sequence signal and the media resource data, and sends the local media resource information to the external display device.

In a fourth aspect, an embodiment of the present disclosure provides an electronic device, including:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,

the memory stores instructions executable by the at least one processor to cause the at least one processor to perform the method described above.

In a fifth aspect, the disclosed embodiments provide a non-transitory computer readable storage medium having stored thereon computer instructions for causing a computer to perform the above-described method.

The embodiment of the disclosure has the following advantages:

according to the media resource transmission device, the system and the method provided by the embodiment of the disclosure, after any stage of the media resource transmission device receives the media resource information, the same new time sequence signal (the second time sequence signal) is generated according to the original time sequence signal, and then the new time sequence signal is transmitted to the next stage of the media resource transmission device, so that the time sequence signal in the media resource information received by each stage of the media resource transmission device is transmitted only by one stage, thereby avoiding the quality reduction and delay increase of the time sequence signal in the process of multi-stage transmission, ensuring the consistency of the time sequence signal in the media resource information received by each media resource transmission device in the media resource transmission system, and further ensuring the synchronization and quality of each media resource transmission device in the media resource transmission system.

Drawings

The accompanying drawings, which are included to provide a further understanding of the disclosed embodiments and are incorporated in and constitute a part of this specification, illustrate embodiments of the disclosure and together with the detailed description serve to explain the embodiments, but do not limit the embodiments;

fig. 1 is an architecture diagram of an exemplary media asset delivery system in the related art;

fig. 2 is an architecture diagram of a media resource transmission system provided in an embodiment of the present disclosure;

fig. 3 is a schematic structural diagram of a media resource transmission apparatus according to an embodiment of the disclosure;

fig. 4 is a second schematic structural diagram of a media resource transmission apparatus according to a second embodiment of the disclosure;

fig. 5 is a flowchart of a media resource transmission method provided by an embodiment of the present disclosure;

fig. 6 is an electronic device provided in an embodiment of the present disclosure.

Detailed Description

In order to make the objects, technical solutions and advantages of the present invention clearer, the present invention will be described in further detail with reference to the accompanying drawings, and it is obvious that the described embodiments are only some embodiments of the present invention, not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

The shapes and sizes of the various elements in the drawings are not to scale and are merely intended to facilitate an understanding of the contents of the embodiments of the invention.

Unless defined otherwise, technical or scientific terms used herein shall have the ordinary meaning as understood by one of ordinary skill in the art to which this disclosure belongs. The use of "first," "second," and similar terms in this disclosure is not intended to indicate any order, quantity, or importance, but rather is used to distinguish one element from another. Also, the use of the terms "a," "an," or "the" and similar referents do not denote a limitation of quantity, but rather denote the presence of at least one. The word "comprising" or "comprises", and the like, means that the element or item listed before the word covers the element or item listed after the word and its equivalents, but does not exclude other elements or items. The terms "connected" or "coupled" and the like are not restricted to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "upper", "lower", "left", "right", and the like are used merely to indicate relative positional relationships, and when the absolute position of the object being described is changed, the relative positional relationships may also be changed accordingly.

Referring to fig. 1, taking an exemplary media resource transmission system in the related art as an example, the media resource transmission system includes a signal source providing original media resource information and multiple stages of media resource transmission devices connected in series, where the signal source transmits the original media resource information to a first stage media resource transmission device, the original media resource information includes an original time sequence signal and original media resource data, the first stage media resource transmission device transmits the original media resource data to a display device connected to the first stage media resource transmission device according to a time sequence of the original time sequence signal for display, and transmits the original media resource information to each stage of media resource transmission devices … … of a second stage media resource transmission device … … to sequentially transmit the original media resource information to a last stage media resource transmission device according to the above-mentioned manner. In the multi-level transmission process, the original media resource information has a certain loss, which results in the quality of the original timing signal therein being degraded and the delay being large, so that each media resource transmission device has a low synchronization rate and a poor quality for receiving the media resource information.

In order to solve the above problem, in a first aspect, the present disclosure provides a media resource transmission apparatus, where the media resource transmission apparatus is applied to a multi-level media resource transmission system, referring to fig. 2, fig. 2 shows an exemplary architecture diagram of the multi-level media resource transmission system provided in the present disclosure, the system includes a signal source 1 and a plurality of levels of media resource transmission apparatuses 2 connected in sequence, each level of the media resource transmission apparatus 2 is connected to a display apparatus 3, the signal source 1 is configured to provide original media resource information, and the display apparatus 3 is configured to receive local media resource information transmitted by the media resource transmission apparatus 2 connected thereto for displaying. For any one of the levels of the media resource transmission device 2, referring to fig. 3, the media resource transmission device includes: the receiving circuit 01 is connected with the first transmission circuit 02 and the second transmission circuit 03.

Specifically, the receiving circuit 01 is configured to receive media resource information and transmit the media resource information to the first transmitting circuit 02 and the second transmitting circuit 03. The media resource information is media resource information under any transmission standard, for example, the media resource information is one of the following: high Definition Multimedia Interface (HDMI) information, Video Graphics Array (VGA) information, and the like, where the media resource information at least includes media resource data and a first timing signal, where the media resource data is a display parameter of the display device, and the media resource data includes a display parameter such as luminance information and color information of each pixel point, and the first timing signal is used to indicate an effective period of each display parameter matching the media resource data, and if the media resource information is applied to the display device, the effective period of each display parameter is a working sequence of each display unit (e.g., pixel unit) in the display device; the media resource information may further include a clock signal transmitted by a previous stage circuit, and the clock signal is used to provide a reference period for the first timing signal.

The first transmission circuit 02 is configured to receive the media resource information sent by the receiving circuit 01, generate a second timing signal identical to the first timing signal according to the first timing signal in the media resource information, generate new media resource information according to the second timing signal and the media resource data in the media resource information, and send the new media resource information to the receiving circuit of the next-stage media resource transmission apparatus.

The second transmission circuit 03 is configured to generate local media resource information according to the received media resource information sent by the receiving circuit 01, and send the local media resource information to the external display device for display by the external display device.

It should be noted that, if a media resource transmission device is a first-stage media resource transmission device in a media resource transmission system applied by the media resource transmission device, media resource information received by a receiving circuit 01 of the first-stage media resource transmission device is original media resource information provided by a signal source 1, a first timing signal of the original media resource information is an original timing signal, and a clock signal is an original clock signal; if a media resource transmitting device is not the first-stage media resource transmitting device in the media resource transmitting system to which the media resource transmitting device is applied, the media resource information received by the receiving circuit 01 of the first-stage media resource transmitting device is the new media resource information sent by the first transmitting circuit 02 of the previous-stage media resource transmitting device, the first timing signal of the new media resource information is the timing signal regenerated by the first transmitting circuit 02, and the clock signal is the clock signal sent by the first transmitting circuit 02 of the previous-stage media resource transmitting device.

In the media resource transmission device provided in the embodiment of the present disclosure, after receiving the media resource information, the media resource transmission device at any stage generates the same new timing signal (second timing signal) according to the original timing signal, and then transmits the new timing signal to the media resource transmission device at the next stage, so that the timing signal in the media resource information received by each stage of the media resource transmission device is transmitted only at one stage, thereby avoiding the quality degradation and delay increase of the timing signal in the multi-stage transmission process, ensuring the consistency of the timing signal in the media resource information received by each media resource transmission device in the media resource transmission system, and further ensuring the synchronization and quality of each media resource transmission device in the media resource transmission system. And the media resource information is divided into two paths, one path is transmitted to the next-stage media resource transmission device for processing, and the other path is transmitted to the local for displaying, so that two paths of signals can be processed respectively to meet the requirements of multi-stage transmission signals and local transmission signals respectively.

In some examples, the media resource transmission apparatus provided by the embodiments of the present disclosure further includes: the first clock source is connected to the first transmission circuit 02, the first clock source is used as a local clock of the media resource transmission device, a reference period is provided for the first transmission circuit 02 to generate a new timing signal (i.e., a second timing signal), and the first transmission circuit 02 generates the second timing signal according to the first clock signal CLK1 provided by the first clock source and the first timing signal. It should be noted that the clock frequency of the first timing signal CLK1 provided by the first clock source is substantially the same as the clock frequency of the original clock signal provided by the signal source 1, so as to ensure that the first timing signal generated based on the reference period is substantially the same as the second timing signal.

In some examples, the second transmission circuit 03 in the media resource transmission apparatus provided in the embodiment of the present disclosure is specifically configured to generate local media resource information including a third timing signal according to the received media resource information sent by the receiving circuit 01, and send the local media resource information to the external display apparatus, so that the external display apparatus displays the local media resource information according to the timing of the third timing signal. In this embodiment, the media resource transmission apparatus provided in this embodiment of the disclosure further includes: the second clock source is used for providing a second clock signal, the second clock source is used as a local clock of the media resource transmission device to provide a reference period for the second transmission circuit 03 to generate a new timing signal (i.e., a third timing signal), a timing of the third timing signal generated by the second transmission circuit 03 can be arbitrarily generated according to requirements, and a timing thereof can be the same as or different from the first timing signal or the second timing signal, and correspondingly, a clock frequency of the second clock signal can be the same as or different from a clock frequency of the original clock signal.

It should be noted that the first timing signal at least includes a horizontal synchronization timing (hs), a Vertical synchronization timing (vs), and a valid Data Enable signal (Data Enable, de), where the horizontal synchronization timing is used to indicate a timing reference of each line of media resource Data, that is, after transmission of one line of media resource Data (i.e., display parameters of one line of pixels) is finished, a horizontal synchronization timing is generated to indicate that transmission of the next line of media resource Data is started; the vertical synchronization time sequence is used for indicating the time sequence reference of each frame of media resource data, namely after the transmission of one frame of media resource data (namely the display parameters of the whole display picture) is finished, the vertical synchronization time sequence is generated to indicate the start of the transmission of the next frame of media resource data; the valid data enable signal is used for indicating that the currently transmitted media resource data is valid media transmission data.

In some examples, referring to fig. 4, fig. 4 illustrates an exemplary structural diagram of a media resource transmission apparatus provided by an embodiment of the present disclosure. The first transmission circuit 02 in the media resource transmission apparatus may specifically include: a timing synchronization sub-circuit 021, a First In First Out (FIFO) circuit 022, and a first transmit sub-circuit 023. Wherein, the input terminal of the timing synchronization sub-circuit 021 is connected to the output terminal of the receiving circuit 01, and the output terminal of the timing synchronization sub-circuit 021 is connected to the timing input terminal of the first-in first-out sub-circuit 022 and the first input terminal of the first transmitting sub-circuit 023; an input terminal of the first-in first-out sub-circuit 022 is connected to an output terminal of the receiving circuit 01, and an output terminal of the first-in first-out sub-circuit 022 is connected to a second input terminal of the first transmitting sub-circuit 023; the output terminal of the first transmitting sub-circuit 023 is connected to the input terminal of the receiving circuit 01 of the next-stage media resource transmitting device.

Specifically, the timing synchronization sub-circuit 021 is configured to receive the first timing signal, generate a second timing signal identical to the first timing signal from the first timing signal in response to the horizontal synchronization timing, and transmit the second timing signal to the first-in first-out sub-circuit 022 and the first transmitting sub-circuit 023.

The first-in-first-out sub-circuit 022 is configured to receive the media resource data and to send the media resource data to the first transmit sub-circuit 023 under control of the second timing signal.

The first transmitting sub-circuit 023 is configured to generate new media resource information according to the second timing signal and the media resource data, and transmit the new media resource information to the receiving circuit 01 of the next-stage media resource transmitting device.

The horizontal synchronization timing is provided by the receiving circuit 01, that is, when each line of media resource information starts to be transmitted, the timing synchronization sub-circuit 021 receives the horizontal synchronization timing, generates a new timing signal (a second timing signal) which is the same as the original timing signal (a first timing signal) in response to the horizontal synchronization timing, and sends the second timing signal to the fifo sub-circuit 022, and the fifo sub-circuit 022 transmits the line of media resource information buffered in the fifo sub-circuit 022 to the first transmitting sub-circuit 023 according to the timing indicated by the second timing signal under the control of the second timing signal; the timing synchronization sub-circuit 021 further transmits a second timing signal to the first transmitting sub-circuit 023, and the second timing signal is transmitted to the next-stage media resource transmitting device through the first transmitting sub-circuit 023 and is used as the first timing signal received by the timing synchronization sub-circuit 021 of the next-stage media resource transmitting device. By adopting the mode, when each line of media resource information begins to be transmitted, a new time sequence signal is generated by any one stage of media resource transmission device according to the received time sequence signal, and the new time sequence signal is transmitted to the next stage of media resource transmission device, so that the time sequence signal received by each stage of media resource transmission device is transmitted by only one stage, the degradation and delay increase of the time sequence signal in the process of multi-stage transmission are avoided, the consistency of the time sequence signal in the media resource information received by each media resource transmission device in the media resource transmission system is ensured, and the synchronism and quality of each media resource transmission device in the media resource transmission system are further ensured.

In some examples, with continued reference to fig. 4, in an embodiment where the first transmission circuit 02 in the media resource transmission apparatus includes the timing synchronization sub-circuit 021, the first-in first-out sub-circuit 022, and the first transmission sub-circuit 023, the media resource transmission apparatus provided by the embodiments of the present disclosure may further include: the first clock source 001, which is a local clock of the media resource transmission device, provides a reference period for the first transmission circuit 02 to generate a new timing signal (i.e., the second timing signal). Specifically, the first clock source 001 is connected to a clock input of a timing synchronization sub-circuit 021, the timing synchronization sub-circuit 021 is configured to receive the first timing signal, generate a second timing signal identical to the first timing signal according to the first timing signal and a first clock signal CLK1 provided by the first clock source 001 in response to the horizontal synchronization timing, and transmit the second timing signal to the first-in first-out sub-circuit 022 and the first transmission sub-circuit 023. It should be noted that the clock frequency of the first timing signal CLK1 provided by the first clock source is substantially the same as the clock frequency of the original clock signal provided by the signal source 1, so as to ensure that the first timing signal generated based on the reference period is substantially the same as the second timing signal.

In some examples, with continued reference to fig. 4, the second transmitting circuit 03 in the media resource transmitting device may include: a frame buffer (frame buffer) sub-circuit 031, a retiming sub-circuit 032, and a second transmit sub-circuit 033. Wherein, the input terminal of the frame buffer sub-circuit 031 is connected to the output terminal of the receiving circuit 01, the output terminal of the frame buffer sub-circuit 031 is connected to the first input terminal of the second transmitting sub-circuit 033, and the timing input terminal of the frame buffer sub-circuit 031 is connected to the output terminal of the retiming sub-circuit 032; the output of the retiming sub-circuit 032 is connected to the second input of the second transmitting sub-circuit 033; the output of the second transmitting sub-circuit 033 is connected to an external display device.

In particular, the retiming sub-circuit 032 is configured to generate a third timing signal in response to the retiming enable signal and to transmit the third timing signal to the frame buffering sub-circuit 031 and the second transmitting sub-circuit 033.

The frame buffer sub-circuit 031 is configured to receive the media asset information and buffer the media asset data therein, and to send the media asset data to the second sending sub-circuit 033 under control of a third timing signal in response to the vertical synchronization timing.

The second transmitting sub-circuit 033 is configured to generate local media asset information from the third timing signal and the media asset data, and transmit the local media asset information to the external display device 3.

The vertical synchronization timing is provided by the receiving circuit 01, that is, the frame buffer sub-circuit 031 receives each line of media resource information, and transmits a frame of media resource information buffered in the frame buffer sub-circuit 031 to the second sending sub-circuit 033 according to the timing indicated by the third timing signal under the control of the third timing signal when a complete frame of media resource information is received. The frame Buffer sub-circuit 031 may receive the media resource information by using a Double Buffer (Double Buffer) mechanism, so as to eliminate the tearing phenomenon of the media resource data during the frame rate conversion process. Further, the retiming enable signal of the retiming sub-circuit 032 may be provided by the receiving circuit 01 or an external command input device, and under the control of the retiming enable signal, the retiming sub-circuit 032 starts to operate and generates a third timing signal in a retiming (re-timing) manner, where the third timing signal is used to indicate the operation timing of the frame buffer sub-circuit and the external display apparatus 3, and the third timing signal may be independent of the timing of the first timing signal and the timing of the second timing signal, that is, the third timing signal may be different from the first timing signal and the second timing signal, and of course, the third timing signal may also be the same as the first timing signal and the second timing signal. The second sending sub-circuit 033 generates local media resource information according to the third timing signal and the media resource data, and sends the local media resource information to the display device 3, and the display device 3 sequentially displays the media resource data in the local media resource information under the control of the third timing signal. By adopting the mode, namely, the frame buffer is combined with re-timing technology to process the media resource information, the quality of the media resource data is ensured, the display quality is good, and the re-timing technology is adopted to adjust the time sequence signal of the standard period matched with the media resource data, so that the quality of the time sequence signal of local display is ensured, and the display is convenient for a display device to display.

By the circuit, the media resource information is divided into two paths, one path is transmitted to the next level media resource transmission device for processing in a behavior cycle through the FIFO sub-circuit 021, and the other path is transmitted to the local for displaying in a frame cycle through the frame cache circuit, so that two paths of signals can be respectively processed to respectively meet the requirements of multi-level transmission signals and local transmission signals.

In some examples, with continued reference to fig. 4, a media resource transmitting device provided by an embodiment of the present disclosure further includes: the second clock source 002, the second clock source 002 is used to provide the second clock signal, the output end of the second clock source 002 is connected to the clock input end of the retiming sub-circuit 032, the second clock source 002 is used as the local clock of the media resource transmission device to provide the reference cycle for the retiming sub-circuit 032 to generate the new timing signal (i.e. the third timing signal), the timing sequence of the third timing signal generated by the retiming sub-circuit 032 can be generated arbitrarily according to the requirement, the timing sequence can be the same as the first timing signal or the second timing signal, or can be different, correspondingly, the clock frequency of the second clock signal can be the same as or different from the clock frequency of the original clock signal.

In some examples, in an embodiment where the first transmission circuit 02 in the media resource transmission apparatus includes a timing synchronization sub-circuit 021, a first-in first-out sub-circuit 022, and a first transmission sub-circuit 023, and the second transmission circuit 03 includes a frame buffer (frame buffer) sub-circuit 031, a retiming sub-circuit 032, and a second transmission sub-circuit 033, the media resource transmission apparatus provided by the embodiments of the present disclosure further includes: a first clock source 001, the first clock source 001 connecting the clock input of the timing synchronization sub-circuit 021 and the clock input of the retiming sub-circuit 032. The timing synchronization sub-circuit 021 is configured to receive the first timing signal, generate a second timing signal identical to the first timing signal according to the first timing signal and a first clock signal CLK1 provided by the first clock source 001 in response to the horizontal synchronization timing, and transmit the second timing signal to the first-in-first-out sub-circuit 022 and the first transmitting sub-circuit 023. And, the retiming sub-circuit 032 is configured to generate a third timing signal from the first clock signal CLK1 provided by the first clock source 001 in response to the retiming enable signal, and to transmit the third timing signal to the frame buffer sub-circuit 031 and the second transmitting sub-circuit 033, the second timing signal being the same as the third timing signal. In this embodiment, the first clock source 001 is multiplexed as the second clock source 002, and only one clock source needs to be set, so that the first clock signal CLK1 is the same as the second clock signal CLK2, and correspondingly, the second timing signal and the third timing signal may also be the same, thereby reducing the setting of the clock source, and being beneficial to reducing the circuit area and simplifying the setting of the connection lines.

In some examples, according to the different transmission standards of the media asset information, correspondingly, the receiving circuit 01 is a receiving circuit matched with the transmission standard of the media asset information, and similarly, the first transmitting sub-circuit 023 and the second transmitting sub-circuit 033 are transmitting circuits matched with the transmission standard of the media asset information, for example, if the media asset information is HDMI information, the receiving circuit 01 is a receiving circuit capable of receiving the HDMI information, and the first transmitting sub-circuit 023 and the second transmitting sub-circuit 033 are transmitting circuits capable of transmitting the media asset information according to the transmission standard of the HDMI.

In some examples, the receiving circuit 01 is a receiving circuit that can receive media resource information whose horizontal synchronization timing is aperiodic. If the horizontal synchronization timing in the first timing signal received by the receiving circuit 01 in the media resource information is non-periodic, the retiming sub-circuit 032 generates a new third timing signal with a standard period to avoid affecting the display of the display apparatus 3.

In a second aspect, referring to fig. 2, an embodiment of the disclosure provides a multi-level media resource transmission system, including a signal source 1 and multiple levels of the media resource transmission devices 2 connected in sequence, where each level of the media resource transmission device 2 is connected to a display device 3, where if one of the media resource transmission devices 2 is a first level of the media resource transmission device, media resource information received by a receiving circuit 01 of the first level of the media resource transmission device is original media resource information provided by the signal source 1, a first time sequence signal is an original time sequence signal, and media resource data is original media resource data; if a media resource transmitting device 2 is not the first-stage media resource transmitting device, the receiving circuit 01 receives the media resource information provided by the previous-stage media resource transmitting device 2, and the first timing signal is the second timing signal generated by the previous-stage media resource transmitting device 2.

In some examples, each stage of the media asset transmission device 2 is independently provided with a first clock source 001, the first clock source 001 is connected to a clock input terminal of the first transmission circuit 02 (specifically connected to the timing synchronization sub-circuit 021) of the media asset transmission device 2 to which the first clock source 001 belongs, and the first clock source 001 is configured to provide a first clock signal CLK1, so that the first transmission circuit 02 (specifically the timing synchronization sub-circuit 021) generates a second timing signal identical to the first timing signal according to the first clock signal CLK1 and the received first timing signal. Each stage of the media resource transmission device 2 is independently provided with the first clock source 001 to provide a reference period for the second timing signal, so that each stage of the media resource transmission device generates a new timing signal (the second timing signal) according to the local clock, thereby avoiding generating a timing according to the clock signal corresponding to the first timing signal and ensuring the stability of the generated second timing signal.

In a third aspect, an embodiment of the disclosure provides a media resource transmission method, which is applied in the media resource transmission apparatus or the multi-level media resource transmission system described above with reference to fig. 5. The media resource transmission device comprises: the receiving circuit is connected with the first transmission circuit and the second transmission circuit. The method comprises the following steps:

s1, the receiving circuit receives the media resource information and sends the media resource information to the first transmitting circuit and the second transmitting circuit, where the media resource information includes the media resource data and the first timing signal.

The media resource information is media resource information under any transmission standard, for example, the media resource information is one of the following: high Definition Multimedia Interface (HDMI) information, Video Graphics Array (VGA) information, and the like, where the media resource information at least includes media resource data and a first timing signal, where the media resource data is a display parameter of the display device, and the media resource data includes a display parameter such as luminance information and color information of each pixel point, and the first timing signal is used to indicate an effective period of each display parameter matching the media resource data, and if the media resource information is applied to the display device, the effective period of each display parameter is a working sequence of each display unit (e.g., pixel unit) in the display device; the media resource information may further include a clock signal transmitted by a previous stage circuit, and the clock signal is used to provide a reference period for the first timing signal.

S2, the first transmission circuit receives the media resource information and generates a second timing signal identical to the first timing signal according to the first timing signal.

The media resource transmission apparatus provided by the embodiment of the present disclosure may further include a first clock source, where the first clock source is connected to the first transmission circuit 02, the first clock source is a local clock of the media resource transmission apparatus, and provides a reference period for the first transmission circuit 02 to generate a new timing signal (i.e., a second timing signal), that is, the first transmission circuit 02 generates the second timing signal according to the first clock signal CLK1 and the first timing signal provided by the first clock source. It should be noted that the clock frequency of the first timing signal CLK1 provided by the first clock source is substantially the same as the clock frequency of the original clock signal provided by the signal source 1, so as to ensure that the first timing signal generated based on the reference period is substantially the same as the second timing signal.

The first timing signal at least comprises a horizontal synchronous timing, a vertical synchronous timing and a valid data enable signal. The horizontal synchronization timing sequence is used for indicating the timing reference of each line of media resource data, namely after one line of media resource data (namely the display parameters of one line of pixels) is transmitted, the horizontal synchronization timing sequence is generated to indicate that the transmission of the next line of media resource data is started; the vertical synchronization time sequence is used for indicating the time sequence reference of each frame of media resource data, namely after the transmission of one frame of media resource data (namely the display parameters of the whole display picture) is finished, the vertical synchronization time sequence is generated to indicate the start of the transmission of the next frame of media resource data; the valid data enable signal is used for indicating that the currently transmitted media resource data is valid media transmission data.

And S3, generating new media resource information according to the second time sequence signal and the media resource data, and sending the new media resource information to a receiving circuit of a next-stage media resource transmission device.

Specifically, the first transmission circuit generates a same second time sequence signal according to the first time sequence signal, and transmits the media resource information to the receiving circuit of the next-stage media resource transmission device according to the newly generated second time sequence signal, so that the time sequence signal received by the next-stage media resource transmission device is only subjected to one-stage transmission, and the signal quality of the time sequence signal is further ensured.

And S4, the second transmission circuit generates local media resource information according to the media resource information and sends the local media resource information to the external display device.

Specifically, S4 includes: and generating local media resource information containing a third timing signal according to the received media resource information sent by the receiving circuit 01, and sending the local media resource information to the external display device for the external display device to display according to the timing of the third timing signal.

In the media resource transmission method provided in the embodiment of the present disclosure, after receiving the media resource information, the media resource transmission device at any stage generates the same new timing signal (second timing signal) according to the original timing signal, and then transmits the new timing signal to the media resource transmission device at the next stage, so that the timing signal in the media resource information received by each stage of the media resource transmission device is transmitted only at one stage, thereby avoiding the quality degradation and delay increase of the timing signal in the multi-stage transmission process, ensuring the consistency of the timing signal in the media resource information received by each media resource transmission device in the media resource transmission system, and further ensuring the synchronization and quality of each media resource transmission device in the media resource transmission system. And the media resource information is divided into two paths, one path is transmitted to the next-stage media resource transmission device for processing, and the other path is transmitted to the local for displaying, so that two paths of signals can be processed respectively to meet the requirements of multi-stage transmission signals and local transmission signals respectively.

In some examples, the first transmission circuit 02 of the media resource transmission apparatus to which the method is applied may specifically include: a timing synchronization sub-circuit 021, a First In First Out (FIFO) circuit 022, and a first transmit sub-circuit 023. Wherein, the input terminal of the timing synchronization sub-circuit 021 is connected to the output terminal of the receiving circuit 01, and the output terminal of the timing synchronization sub-circuit 021 is connected to the timing input terminal of the first-in first-out sub-circuit 022 and the first input terminal of the first transmitting sub-circuit 023; an input terminal of the first-in first-out sub-circuit 022 is connected to an output terminal of the receiving circuit 01, and an output terminal of the first-in first-out sub-circuit 022 is connected to a second input terminal of the first transmitting sub-circuit 023; the output terminal of the first transmitting sub-circuit 023 is connected to the input terminal of the receiving circuit 01 of the next-stage media resource transmitting device. Wherein S2 includes a plurality of sub-steps:

and the first sub-step, the time sequence synchronization sub-circuit receives the first time sequence signal, responds to the horizontal synchronization time sequence in the first time sequence signal, generates a second time sequence signal which is the same as the first time sequence signal according to the first time sequence signal, and sends the second time sequence signal to the first-in first-out sub-circuit and the first sending sub-circuit.

The media resource transmission apparatus provided by the embodiment of the present disclosure may further include a first clock source, where the first clock source is connected to the first transmission circuit 02, and the first clock source is a local clock of the media resource transmission apparatus, and provides a reference period for the first transmission circuit 02 to generate a new timing signal (i.e., a second timing signal), that is, the first transmission circuit 02 generates the second timing signal according to the first clock signal CLK1 and the first timing signal provided by the first clock source. It should be noted that the clock frequency of the first timing signal CLK1 provided by the first clock source is substantially the same as the clock frequency of the original clock signal provided by the signal source 1, so as to ensure that the first timing signal generated based on the reference period is substantially the same as the second timing signal.

And the second sub-step, the first-in first-out sub-circuit receives the media resource data and sends the media resource data to the first sending sub-circuit under the control of the second time sequence signal.

And the third substep is that the first sending sub-circuit generates new media resource information according to the second time sequence signal and the media resource data, and sends the new media resource information to a receiving circuit of a next-stage media resource transmission device.

In some examples, the second transmission circuit 03 of the media resource transmission apparatus to which the method is applied may include: a frame buffer (frame buffer) sub-circuit 031, a retiming sub-circuit 032, and a second transmit sub-circuit 033. Wherein, the input end of the frame buffer sub-circuit 031 is connected to the output end of the receiving circuit 01, the output end of the frame buffer sub-circuit 031 is connected to the first input end of the second transmitting sub-circuit 033, and the timing input end of the frame buffer sub-circuit 031 is connected to the output end of the retiming sub-circuit 032; an output terminal of the retiming sub-circuit 032 is connected to a second input terminal of the second transmitting sub-circuit 033; the output of the second transmitting sub-circuit 033 is connected to an external display device. Wherein S3 includes a plurality of sub-steps:

the first sub-step, the retiming sub-circuit generates a third timing signal in response to the retiming enable signal, and transmits the third timing signal to the frame buffer sub-circuit and the second transmitting sub-circuit.

The media resource transmission device provided by the embodiment of the present disclosure further includes: the second clock source 002, the second clock source 002 is used to provide the second clock signal, the output end of the second clock source 002 is connected to the clock input end of the retiming sub-circuit 032, the second clock source 002 is used as the local clock of the media resource transmission device to provide the reference cycle for the retiming sub-circuit 032 to generate the new timing signal (i.e. the third timing signal), the timing sequence of the third timing signal generated by the retiming sub-circuit 032 can be generated arbitrarily according to the requirement, the timing sequence can be the same as the first timing signal or the second timing signal, or can be different, correspondingly, the clock frequency of the second clock signal can be the same as or different from the clock frequency of the original clock signal.

And the second sub-step, the frame buffer sub-circuit is configured to receive the media resource information and buffer the media resource data in the received media resource information.

And a third sub-step of transmitting the media resource data to the second transmitting sub-circuit under control of a third timing signal in response to the vertical synchronization timing.

And the sub-step four, the second sending sub-circuit generates local media resource information according to the third time sequence signal and the media resource data, and sends the local media resource information to the external display device.

The vertical synchronization timing is provided by the receiving circuit 01, that is, the frame buffer sub-circuit 031 receives each line of media resource information, and transmits a frame of media resource information buffered in the frame buffer sub-circuit 031 to the second transmitting sub-circuit 033 under the control of the third timing signal when a complete frame of media resource information is received. The frame Buffer sub-circuit 031 may receive the media resource information by using a Double Buffer (Double Buffer) mechanism, so as to eliminate the tearing phenomenon of the media resource data during the frame rate conversion process. Further, the retiming enable signal of the retiming sub-circuit 032 may be provided by the receiving circuit 01 or may be provided by an external command input device, under the control of the retiming enable signal, the retiming sub-circuit 032 starts to operate, and a retiming (re-timing) method is used to generate a third timing signal, which is used to indicate the operation timing of the frame buffer sub-circuit and the external display apparatus 3, and the third timing signal may be independent of the timing of the first timing signal and the second timing signal, that is, the third timing signal may be different from the first timing signal and the second timing signal, and of course, the third timing signal may also be the same as the first timing signal and the second timing signal. The second transmitting sub-circuit 033 generates local media resource information according to the third timing signal and the media resource data, and transmits the local media resource information to the display device 3, and the external display device 3 sequentially displays the media resource data in the local media resource information under the control of the third timing signal. By adopting the mode, namely the frame buffer is combined with the re-timing technology to process the media resource information, the quality of the media resource data is ensured, the display quality is good, and the re-timing technology is adopted to adjust the time sequence signal of the standard period matched with the media resource data, so that the quality of the time sequence signal of the local display is ensured, and the display of the display device is convenient.

By the circuit, the media resource information is divided into two paths, one path is transmitted to the next-stage media resource transmission device for processing in a behavior period through the FIFO sub-circuit 021, and the other path is transmitted to the local for displaying in a frame period through the frame cache circuit, so that two paths of signals can be respectively processed to respectively meet the requirements of multi-stage transmission signals and local transmission signals.

Fourth aspect, referring to fig. 6, the present embodiment provides an electronic device, including:

one or more processors 501;

a memory 502 having one or more programs stored thereon that, when executed by the one or more processors, cause the one or more processors to implement the method of any one of the above;

one or more I/O interfaces 503 coupled between the processor and the memory and configured to enable information interaction between the processor and the memory.

The processor 501 is a device with data processing capability, which includes but is not limited to a Central Processing Unit (CPU), etc.; memory 502 is a device having data storage capabilities including, but not limited to, random access memory (RAM, more specifically SDRAM, DDR, etc.), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), FLASH memory (FLASH); an I/O interface (read/write interface) 503 is connected between the processor 501 and the memory 502, and can realize information interaction between the processor 501 and the memory 502, which includes but is not limited to a data Bus (Bus) and the like.

In some embodiments, the processor 501, memory 502, and I/O interface 503 are connected to each other and to other components of the computing device by a bus.

In a fifth aspect, the present embodiments provide a computer readable medium having a computer program stored thereon, which when executed by a processor, performs any of the methods described above.

It will be understood by those of ordinary skill in the art that all or some of the steps of the above inventive method, systems, functional modules/units in the apparatus may be implemented as software, firmware, hardware, and suitable combinations thereof. In a hardware implementation, the division between functional modules/units mentioned in the above description does not necessarily correspond to the division of physical components; for example, one physical component may have multiple functions, or one function or step may be performed by several physical components in cooperation. Some or all of the physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit. Such software may be distributed on computer readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media). The term computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data, as is well known to those of ordinary skill in the art. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, Digital Versatile Disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by a computer. In addition, communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media as known to those skilled in the art.

Example embodiments have been invented herein, and although specific terms are employed, they are used and should be interpreted in a generic and descriptive sense only and not for purposes of limitation. In some instances, features, characteristics and/or elements described in connection with a particular embodiment may be used alone or in combination with features, characteristics and/or elements described in connection with other embodiments, unless expressly stated otherwise, as would be apparent to one skilled in the art. It will, therefore, be understood by those skilled in the art that various changes in form and details may be made therein without departing from the scope of the invention encompassed by the appended claims.

Claims

1. A media resource transmission device is characterized in that the media resource transmission device is applied to a multilevel media resource transmission system, and the system comprises a plurality of levels of media resource transmission devices which are connected in sequence; one of the media resource transmission devices comprises: a receiving circuit, a first transmitting circuit and a second transmitting circuit; wherein the content of the first and second substances,

2. The apparatus according to claim 1, wherein the first timing signal comprises a horizontal synchronization timing;

3. The apparatus according to claim 2, wherein the first timing signal comprises a vertical synchronization timing;

the retiming sub-circuit is configured to generate a third timing signal in response to a retiming enable signal and to transmit the third timing signal to the frame buffer sub-circuit and the second transmit sub-circuit;

4. The apparatus for media resource transmission according to claim 1, wherein the apparatus further comprises: the first transmission circuit generates the second timing signal according to a first clock signal and the first timing signal provided by the first clock source.

5. The apparatus for media resource transmission according to claim 2, wherein said apparatus further comprises: the first clock source is connected with the clock input end of the time sequence synchronization sub-circuit, the time sequence synchronization sub-circuit is configured to receive the first time sequence signal, respond to the horizontal synchronization time sequence, generate a second time sequence signal identical to the first time sequence signal according to the first time sequence signal and the first clock signal provided by the first clock source, and send the second time sequence signal to the first-in first-out sub-circuit and the first sending sub-circuit.

6. The apparatus for media resource transmission according to claim 3, wherein said apparatus further comprises: a first clock source connected to a clock input of the timing synchronization sub-circuit and a clock input of the retiming sub-circuit;

7. A multi-stage media resource transmission system, comprising a plurality of stages of media resource transmission apparatuses according to any one of claims 1 to 6 connected in series; wherein the content of the first and second substances,

8. The multi-level media asset delivery system of claim 7, wherein each level of media asset delivery device is provided with a first clock source connected to the first delivery circuit of its associated media asset delivery device, said first clock source being configured to provide a first clock signal, such that said first delivery circuit generates a second timing signal identical to said first timing signal based on said first clock signal and a received first timing signal.

9. A media resource transmission method, which is applied to the media resource transmission apparatus of any one of claims 1-6 or the multi-level media resource transmission system of any one of claims 7-8; the method comprises the following steps:

10. The method according to claim 9, wherein the media resource transmission device applied by the method is the media resource transmission device according to claim 2; the first transmission circuit receives the media resource information, and generating a second timing signal identical to the first timing signal according to the first timing signal includes:

and the first sending sub-circuit generates new media resource information according to the second time sequence signal and the media resource data and sends the new media resource information to a receiving circuit of a next-stage media resource transmission device.

11. The method according to claim 10, wherein the media resource transmission apparatus applied by the method is the media resource transmission apparatus according to claim 3; the second transmission circuit generates local media resource information according to the media resource information, and the sending of the local media resource information to an external display device includes:

12. An electronic device, comprising:

at least one processor; and

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 9-11.

13. A non-transitory computer readable storage medium having stored thereon computer instructions for causing a computer to perform the method of any one of claims 9-11.