CN113316022B - Video playing method, device, equipment, system and storage medium - Google Patents
Video playing method, device, equipment, system and storage medium Download PDFInfo
- Publication number
- CN113316022B CN113316022B CN202110051083.7A CN202110051083A CN113316022B CN 113316022 B CN113316022 B CN 113316022B CN 202110051083 A CN202110051083 A CN 202110051083A CN 113316022 B CN113316022 B CN 113316022B
- Authority
- CN
- China
- Prior art keywords
- display
- target
- card
- playing window
- determining
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440218—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
- G06F3/1446—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display display composed of modules, e.g. video walls
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/4508—Management of client data or end-user data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
- H04N21/4621—Controlling the complexity of the content stream or additional data, e.g. lowering the resolution or bit-rate of the video stream for a mobile client with a small screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47205—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Abstract
The application provides a video playing method, a video playing device, video playing equipment, a video playing system and a storage medium. The method comprises the following steps: determining a target display card to which a playing window belongs from display cards connected with equipment according to the position information of the playing window of the video to be played; the display card connected with the equipment is provided with a corresponding decoding module and a display module; a first target decoding module corresponding to the control target display card decodes the video to be played; and controlling a first target display module corresponding to the target display card to render and display the decoded video data, wherein the number of the first target display modules is not less than that of the first target decoding modules. In the scheme, the decoding module corresponding to the target display card is adopted for decoding, and the display module corresponding to the target display card is directly adopted for displaying after decoding, so that the time delay and the performance consumption of data transmission are reduced, and the decoding performance is better.
Description
The present application claims priority of chinese patent application having application number 202010125452.8, entitled "video playing method, apparatus, device, system, and storage medium" filed by the chinese patent office on 27/2/2020, which is incorporated herein by reference in its entirety.
Technical Field
The present application relates to the field of video playing technologies, and in particular, to a video playing method, apparatus, device, system, and storage medium.
Background
At present, for large-size and high-resolution image information display, a common standard display cannot meet the requirement, and a plurality of displays need to be spliced to form a similar wall structure, namely a television wall. The television wall system consists of a signal source device, a processor, a display and the like. The decoding of the signal source is usually performed by adopting a display card, and the workload of the processor and the power consumption can be reduced by using the display card for decoding. And rendering by using a display card after decoding and playing on a display.
If capacity expansion is needed, the number of the external displays can be expanded by expanding the number of the display cards. For example, one display card is externally connected with 4 displays, the 4 displays form one display unit, and the double display card can be externally connected with 8 displays, namely, the double display card comprises two display units. Because of the multiple video cards, how to reasonably schedule the video card resources when decoding the received code stream data, thereby improving the decoding performance, is a technical problem that needs to be solved urgently by technical personnel in the field.
Disclosure of Invention
The application provides a video playing method, a video playing device, video playing equipment, a video playing system and a storage medium, so that the scheduling of video card resources under the condition of a plurality of video cards is realized, and the decoding performance is improved.
In a first aspect, the present application provides a video playing method, including:
determining a target display card to which a playing window belongs from display cards connected with equipment according to the position information of the playing window of the video to be played; the display card connected with the equipment is provided with a corresponding decoding module and a display module;
controlling a first target decoding module corresponding to the target display card to decode the video to be played;
and controlling a first target display module corresponding to the target display card to render and display the decoded video data, wherein the number of the first target display modules is not less than that of the first target decoding modules.
In a second aspect, the present application provides a video playing apparatus, including:
the determining module is used for determining a target display card to which the playing window belongs from display cards connected with equipment according to the position information of the playing window of the video to be played; the display card connected with the equipment is provided with a corresponding decoding module and a corresponding display module;
the control module is used for controlling a first target decoding module corresponding to the target display card to decode the video to be played;
the control module is further configured to control a first target display module corresponding to the target graphics card to render and display the decoded video data, where the number of the first target display modules is not less than the number of the first target decoding modules.
In a third aspect, the present application provides an electronic device, comprising:
the display system comprises a processor, a memory and at least two display cards connected with the processor;
wherein the memory is configured to store executable instructions of the processor;
the processor is configured to perform the method of any of the first aspects via execution of the executable instructions.
In a fourth aspect, the present application provides a video playback system, including:
an electronic device and at least two displays;
the electronic equipment comprises at least two display cards, and each display card is connected with at least one display;
the electronic equipment is used for determining a target display card to which the playing window belongs from the at least two display cards according to the position information of the playing window of the video to be played; each of the at least two display cards is provided with a corresponding decoding module and a corresponding display module;
controlling a first target decoding module corresponding to the target display card to decode the video to be played;
and controlling a first target display module corresponding to the target display card to render the decoded video data, and displaying the video data on a display occupied by the playing window in the at least two displays.
In a fifth aspect, the present application provides a computer-readable storage medium, on which a computer program is stored, the computer program, when executed by a processor, implementing the method of any one of the first aspect.
According to the video playing method, the video playing device, the video playing equipment, the video playing system and the storage medium, the display card connected with the video playing equipment is provided with the corresponding decoding module and the corresponding display module, the first target decoding module used for decoding is the decoding module corresponding to the target display card to which the playing window belongs, and the display module corresponding to the target display card is directly adopted for displaying after decoding.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.
Fig. 1 is a schematic view of a video playing system according to an embodiment of the present application;
fig. 2 is a schematic flowchart of a video playing method according to an embodiment of the present disclosure;
FIG. 3 is a schematic diagram of an embodiment of a method provided herein;
FIG. 4 is a schematic diagram of another embodiment of the method provided herein;
FIG. 5 is a schematic structural diagram of an embodiment of an electronic device provided herein;
fig. 6 is a schematic structural diagram of an electronic device according to another embodiment of the present application;
FIG. 7 is a schematic block diagram of an embodiment of a television wall system provided by the present application;
fig. 8 is a schematic structural diagram of an embodiment of a video playback device provided in the present application.
With the foregoing drawings in mind, certain embodiments of the disclosure have been shown and described in more detail below. These drawings and written description are not intended to limit the scope of the disclosed concepts in any way, but rather to illustrate the concepts of the disclosure to those skilled in the art by reference to specific embodiments.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
The terms "comprising" and "having," and any variations thereof, in the description and claims of this application and the drawings described herein are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
Firstly, the application scenario related to the present application is introduced:
the method provided by the embodiment of the application can be applied to a video playing system. The video playing system decodes the received video data, usually using a display card to decode, and the display card uses a decoding program to realize decoding. And rendering through a display card and playing on a display after decoding.
The video playing system can comprise an electronic device and a display connected with a display card of the electronic device. The electronic equipment can comprise a processor and a display card connected with the processor, and 1 or more displays can form a display unit. The display is connected to the Video card through a Video output Interface, which includes, for example, a Video Graphics Array (VGA), a Digital Video Interface (DVI), and a High Definition Multimedia Interface (HDMI).
In order to enlarge the display area of the video playing system, the number of the display cards can be increased, so that the number of the externally connected displays is increased. As shown in fig. 1, the video playback system may include an electronic device including at least two graphics cards and a display including a display connected to each graphics card. In fig. 1, an electronic device, two display cards and two displays are taken as an example.
After the display and the display card are added, when the video is played, how to schedule the display card resources is achieved, the decoding capability of the display card is fully exerted, and the key point for paying attention to the application is to improve the overall decoding performance of the equipment.
According to the method, the video card resource used for decoding is dynamically scheduled according to the position of the playing window of the video to be played, namely, the target video card to which the playing window belongs is determined by the position of the playing window, so that the target decoding module corresponding to the target video card used for decoding is scheduled by the information of the target video card to which the playing window belongs, the decoding capability of the video card is fully exerted, and the overall decoding performance of the device is improved.
The video playing system can be applied to a television wall system, for example, the television wall system includes a signal source device and a video playing system, and the signal source device may include any one or more of the following: cameras, Digital Video Recorders (DVRs), storage servers, and the like. The signal source equipment can generate a coding code stream through video acquisition, image processing and video compression, and transmits the coding code stream to a video playing system through a network.
The technical solution of the present application will be described in detail below with specific examples. The following several specific embodiments may be combined with each other, and details of the same or similar concepts or processes may not be repeated in some embodiments.
Fig. 2 is a schematic flowchart of an embodiment of a video playing method provided in the present application, and as shown in fig. 2, the method of the present embodiment is applied to an electronic device, and the method includes:
In an embodiment, before step 101, the following operations may also be performed:
acquiring the position information of a playing window according to the position information input by a user; or the like, or, alternatively,
acquiring position information of a playing window according to the parameter information of the video to be played; the parameter information includes at least one of: the size and resolution of the occupied storage space.
Specifically, as shown in fig. 1, it is assumed that there are two display cards, each of which is connected to a display, and before the video to be played is played, the processor determines the current position of the playing window for playing the video, for example, the current position may be a position specified by a user, or a position automatically determined according to parameters such as the size of the storage space occupied by the video to be played, the frame rate, and the resolution.
In an embodiment, a display matched with the frame rate of the video to be played can be selected for playing, for example, if the frame rate of the video to be played is higher, the display with a higher frame rate is used for playing, so as to prevent pause, and improve the display effect.
In an embodiment, a display matched with the resolution of the video to be played may be selected for playing, for example, if the resolution of the video to be played is higher, a display with a higher resolution is used for playing, so as to improve the display effect.
In an embodiment, for videos to be played with the same playing duration, the larger the occupied storage space is, the higher the frame rate and/or resolution of the video may be, and the higher the frame rate and/or resolution of the video is, the display with the higher frame rate and/or resolution is adopted for playing, so as to improve the display effect.
And further, according to the position of the playing window, such as coordinate information, determining a target display card to which the playing window belongs from the display cards connected with the equipment. As shown in fig. 3, if the play window is, for example, a play window 1, it is determined that the play window 1 is displayed on the display unit 1, the display unit 1 includes a plurality of displays (for example, 4 displays in fig. 3), and if the display card associated with the displays is a display card 1, it is determined that the target display card to which the play window 1 belongs is the display card 1.
For example, if the playing window is the playing window 2, it is determined that the playing window 2 is displayed on the display unit 2, the display unit 2 includes a plurality of displays, and if the display card associated with the displays is the display card 2, it is determined that the target display card to which the playing window 2 belongs is the display card 2.
In an embodiment, before step 101, the following steps are further included:
detecting the number of display cards connected with equipment;
generating a corresponding number of decoding modules and a corresponding number of display modules according to the number of the display cards;
and respectively associating each display card with the corresponding decoding module and display module.
Before the method of step 101-103 is executed, the number of the video cards connected to the device may be identified; and (3) creating decoding modules and display modules corresponding to the number of the display cards, for example, if the number of the display cards is 2, creating two decoding modules and two display modules. Each graphics card is associated with a respective decoding module and display module, for example by means of a graphics card number. In an embodiment, the decoding module decodes the video to be played into YUV video data by using a decoding library, and the video data decoded by the decoding module is rendered and displayed by the display module.
The decoding modules and the display modules can be utilized when the video data is decoded and displayed subsequently, and if the hardware environment of the equipment is changed, for example, the number of the display cards is increased or reduced, the corresponding decoding modules and the corresponding display modules can be created again.
And 102, controlling a first target decoding module corresponding to the target display card to decode the video to be played.
And 103, controlling a first target display module corresponding to the target display card to render and display the decoded video data, wherein the number of the first target display modules is not less than that of the first target decoding modules.
Further, after the target graphics card to which the playing window belongs is determined, a first target decoding module and a first target display module may be determined from a decoding module and a display module associated with the target graphics card, which are created before, the video to be played is decoded by the first target decoding module, and the decoded video data is rendered and displayed by the first target display module.
As shown in fig. 3, for the playing window 1, if the target display card to which the playing window 1 belongs is the display card 1, the first target decoding module corresponding to the display card 1 is used for decoding, and the first target display module corresponding to the display card 1 is used for rendering and displaying. And one display card corresponds to one decoding module and one display module, and the number of the first target display modules corresponding to the target display card is not less than the number of the first target decoding modules.
For the play window 3, the play window 3 is displayed on the display unit 1 and the display unit 2 at the same time, that is, the display unit 1 and the display unit 2 are occupied at the same time, the display card to which the display unit 1 belongs is the display card 1, and the display card to which the display unit 2 belongs is the display card 2, then the decoding module corresponding to the display card 1 may be selected for decoding, or the decoding module corresponding to the display card 2 may be selected for decoding (specific strategies may refer to the following embodiments), the display modules corresponding to the display card 1 and the display card 2 are used for rendering and displaying, and at this time, the number of the first target display modules is greater than the number of the first target decoding modules.
In the method of this embodiment, the device includes a plurality of display cards, a display card resource to be decoded needs to be determined during decoding, the plurality of display cards have a decoding module and a display module corresponding to each display card, and since the first target decoding module used for decoding is the decoding module corresponding to the target display card to which the play window belongs, the display module corresponding to the target display card is directly used for displaying after decoding, compared with the decoding module corresponding to another display card except the decoding module corresponding to the target display card, the decoding performance is better because the decoding module corresponding to the target display card is used for decoding, the delay and the performance consumption of data transmission are reduced.
On the basis of the above embodiment, step 101 may be implemented as follows:
determining at least one first display unit occupied by the playing window according to the position information of the playing window;
and determining the display card of each display unit in at least one first display unit occupied by the playing window as a target display card.
As shown in fig. 3, if the playing window is, for example, the playing window 1, it is determined that the playing window 1 is displayed on the display unit 1, the display unit 1 includes a plurality of displays, that is, occupies the display unit 1, and if the display card to which the display unit 1 belongs is the display card 1, it is determined that the target display card to which the playing window 1 belongs is the display card 1.
For example, if the playing window is the playing window 2, it is determined that the playing window 2 is displayed on the display unit 2, the display unit 2 includes a plurality of displays, that is, the display unit 2 is occupied, and if the display card to which the display unit 2 belongs is the display card 2, it is determined that the target display card to which the playing window 2 belongs is the display card 2.
For example, if the playing window is the playing window 3, it is determined that the playing window 3 is simultaneously displayed on the display unit 1 and the display unit 2, that is, the display unit 1 and the display unit 2 are simultaneously occupied, the display card to which the display unit 1 belongs is the display card 1, the display card to which the display unit 2 belongs is the display card 2, and it is determined that the target display card to which the playing window 2 belongs is the display card 1 and the display card 2.
In an embodiment, after step 101, the method may further include:
determining a first target decoding module corresponding to a target display card according to the occupied area of the playing window in at least one first display unit; or the like, or a combination thereof,
and determining a first target decoding module corresponding to the target display card according to the load of the display card of each display unit in at least one first display unit occupied by the playing window.
Wherein the first target display module includes: and the display module corresponds to each display card of each first display unit in at least one first display unit occupied by the playing window.
Specifically, as shown in fig. 3, the playback window 3 occupies both the display unit 1 and the display unit 2, for example, the playback window 3 occupies both a part of the display unit 1 and a part of the display unit 2. The target display cards are a display card 1 and a display card 2.
Determining the area of the display unit 1 occupied by the playing window 3 and the area of the display unit 2 occupied by the playing window 3, and determining a first target decoding module corresponding to the target graphics card according to the determined areas, for example, using the decoding module corresponding to the graphics card 1 as the first target decoding module. The display modules corresponding to the display cards 1 and 2 are used as first target display modules, the display module corresponding to the display card 1 is used for rendering and displaying data displayed on the display unit 1, and the display module corresponding to the display card 2 is used for rendering and displaying data displayed on the display unit 2.
In an embodiment, if the number of the first display units occupied by the playback window is at least two, the decoding module corresponding to the graphics card to which the first display unit occupying the largest area in the at least two first display units belongs is used as the first target decoding module.
The decoding module corresponding to the display card to which the first display unit with the largest area occupied by the selected playing window belongs decodes, and compared with the method that the decoding modules corresponding to the display cards to which the plurality of first display units belong and occupied by the playing window are used for decoding together, the method does not need to shunt the data of the video to be played, is simple to implement, can reduce the consumption of hardware resources of other display cards, and saves power consumption.
For example, the area of the display unit 1 occupied by the playing window 3 is larger than the area of the display unit 2, and the decoding module corresponding to the display card 1 connected to the display unit 1 is used as the first target decoding module.
Most of decoded data after being decoded by the decoding module corresponding to the display card 1 needs to be rendered by the display card 1 and displayed on the display unit 1, and the other part of decoded data is sent to the display card 2 through the display card 1 to be rendered and displayed on the display unit 2, so that the decoding module corresponding to the display card of the display unit with the largest occupied area is selected for decoding, data delay can be reduced, and decoding performance is improved.
In another embodiment, as shown in fig. 3, the playback window 3 occupies both the display unit 1 and the display unit 2, e.g. the playback window 3 occupies both a part of the display unit 1 and a part of the display unit 2. The target display cards are a display card 1 and a display card 2.
Determining the load of the display card 1 connected to the display unit 1 and the load of the display card 2 connected to the display unit 2, and determining a first target decoding module card corresponding to a target display card according to the determined loads of the two display cards, for example, using a decoding module corresponding to the display card 1 connected to the display unit 1 as the first target decoding module.
The display modules corresponding to the display cards 1 and 2 are used as first target display modules, the display module corresponding to the display card 1 is used for rendering and displaying data displayed on the display unit 1, and the display module corresponding to the display card 2 is used for rendering and displaying data displayed on the display unit 2.
In an embodiment, if the number of the first display units occupied by the playing window is at least two, the decoding module corresponding to the display card with the smallest load in the display cards to which the at least two first display units belong is taken as the first target decoding module.
For example, the load of the display card 1 connected to the display unit 1 is smaller than the load of the display card 2 connected to the display unit 2, and the decoding module corresponding to the display card 1 connected to the display unit 1 is used as the first target decoding module, so that the operation efficiency can be improved, and the decoding performance can be improved.
In other embodiments, the two manners may also be used in combination, for example, when the areas are the same, the decoding module corresponding to the display card with the smaller load may be selected to decode, or when the loads are the same, the decoding module corresponding to the display card connected to the display unit with the smaller occupied area may be selected to decode.
On the basis of the foregoing embodiment, the method of this embodiment may further include:
receiving a moving instruction of a user; the moving instruction is used for indicating that the playing window is moved from the current position to the target position;
determining at least one second display unit occupied by the playing window according to the target position, and determining a second target decoding module and a second target display module corresponding to the display card to which each display unit belongs in the at least one second display unit;
controlling a second target decoding module to decode the video to be played;
and controlling a second target display module to render and display the decoded video data.
In an embodiment, a target graphics card to which a playing window belongs may be determined according to a target position, a second target decoding module corresponding to the target graphics card is controlled to decode a video to be played, and the second target display module corresponding to the target graphics card is controlled to render and display decoded video data.
Specifically, the user may instruct the play window to move, for example, by touching the display unit, or by inputting a movement instruction to the play window through a remote controller or the like. The information of the target position includes, for example: the number and identification of the display units occupied by the target position, the display card information associated with the display units and the like.
As shown in fig. 4, the playing window 1 moves from the position of the display unit 1 to the target position, that is, moves to the display unit 2, determines that the second display unit occupied by the playing window after moving is the display unit 2, further uses the display card connected to the display unit 2 as the target display card, and determines the second target decoding module and the second target display module corresponding to the target display card, for example, uses the decoding module corresponding to the display card 2 connected to the display unit 2 as the second target decoding module for decoding, and uses the display module corresponding to the display card 2 connected to the display unit 2 as the second target display module for displaying.
If the moved playing window occupies a plurality of display units, for example, the display unit 1 and the display unit 2 are included, the second target decoding module and the second target display module corresponding to the target display card may be determined by the area occupied by the display units or the load of the display card connected to the display units. This scheme is similar to that of the previous embodiment and is not described here again.
In this embodiment, when the playing window is moved, because the device includes a plurality of display cards, each display card corresponds to a different display unit, the position of the moved playing window needs to be determined, and decoded display card resources are reasonably scheduled, if the previous first target decoding module is still used for decoding, since the display module corresponding to the target display card to which the moved playing window belongs needs to be used for displaying after decoding, data needs to be transmitted between the display cards, and there are data delay and performance consumption.
As shown in fig. 1, the video playing system provided in this embodiment includes:
an electronic device and at least two displays;
the electronic equipment comprises at least two display cards, and each display card is connected with at least one display;
the electronic device is adapted to perform the method as any of the method embodiments.
In one embodiment, according to position information of a playing window of a video to be played, a target display card to which the playing window belongs is determined from the at least two display cards; each of the at least two display cards is provided with a corresponding decoding module and a corresponding display module;
controlling a first target decoding module corresponding to the target display card to decode the video to be played;
and controlling a first target display module corresponding to the target display card to render the decoded video data, and displaying the video data on a display occupied by the playing window in the at least two displays.
Further, the principle of the above embodiment is described in conjunction with the following scenarios:
in a scenario, if a playing window only occupies one display unit (as shown in fig. 3, one display unit may include multiple displays), a display card connected to the display unit is used as a target display card, a decoding module corresponding to the target display card is used as a first target decoding module, and a display module corresponding to the target display card is used as a first target display module.
As shown in fig. 3, if the playing window is, for example, the playing window 1, it is determined that the playing window 1 is displayed on the display unit 1, the display unit 1 includes a plurality of displays, that is, occupies the display unit 1, and if the display card to which the display unit 1 belongs is the display card 1, it is determined that the target display card to which the playing window 1 belongs is the display card 1. The decoding module corresponding to the display card 1 serves as a first target decoding module, and the display module corresponding to the display card 1 serves as a first target display module.
In this embodiment, since the decoding module corresponding to the display card to which the display unit occupied by the play window belongs is used for decoding, and the display module corresponding to the display card to which the display unit occupied by the play window belongs is directly used for displaying after decoding, compared with the decoding module corresponding to the target display card, the decoding module reduces the delay and performance consumption of data transmission, and thus the decoding performance is better.
In another scenario, the playing window occupies multiple display units, and may be implemented in several ways:
one implementation is as follows:
and respectively determining the occupied areas of the playing window in the at least two display units, and determining a first target decoding module corresponding to the target display card according to the occupied areas of the playing window in the at least two display units.
For example, the area of the display unit 1 occupied by the playing window 3 is larger than the area of the display unit 2, and the decoding module corresponding to the display card 1 connected to the display unit 1 is used as the first target decoding module.
Most of decoded data after being decoded by the decoding module corresponding to the display card 1 needs to be rendered by the display card 1 and displayed on the display unit 1, and the other part of decoded data is sent to the display card 2 through the display card 1 to be rendered and displayed on the display unit 2, so that the decoding module corresponding to the display card of the display unit with the largest occupied area is selected for decoding, data delay can be reduced, and decoding performance is improved.
The other realization mode is as follows:
respectively determining the loads of the display cards connected with the at least two display units, and determining a first target decoding module corresponding to the target display card according to the loads of the display cards connected with the at least two display units.
As shown in fig. 3, determining the load of the display card 1 connected to the display unit 1 and the load of the display card 2 connected to the display unit 2 may determine a first target decoding module card corresponding to a target display card according to the determined loads of the two display cards, for example, using a decoding module corresponding to the display card 1 connected to the display unit 1 as the first target decoding module.
For example, the load of the display card 1 connected to the display unit 1 is smaller than the load of the display card 2 connected to the display unit 2, and the decoding module corresponding to the display card 1 connected to the display unit 1 is used as the first target decoding module, so that the operation efficiency can be improved, and the decoding performance can be improved.
The system of this embodiment is similar to the technical solution of the above method embodiment in the implementation principle and technical effect, and is not described herein again.
Fig. 5 is a structural diagram of an embodiment of an electronic device provided in the present invention, and as shown in fig. 5, the electronic device includes:
the system comprises a processor 501, a memory 502 for storing executable instructions of the processor 501, and at least two display cards connected with the processor 501.
The above components may communicate over one or more buses.
The processor 501 is configured to execute the corresponding method in the foregoing method embodiment by executing the executable instruction, and the specific implementation process thereof may refer to the foregoing method embodiment, which is not described herein again.
On the basis of the foregoing embodiment, as shown in fig. 6, the above-mentioned scheme implemented by the processor of the electronic device may be implemented by combining hardware of the electronic device through the following functional modules, for example, the following embodiment is described by taking two display cards as an example:
the code stream receiving module 201 is configured to receive a video code stream transmitted by a signal source.
The display card resource management module 202 is configured to identify the number of display cards of the device; and judging the target display card corresponding to the playing window according to the position of the playing window, for example, obtaining the number of the target display card.
The decoding resource scheduling module 203 dynamically calls a decoding module corresponding to the target graphics card according to the serial number of the target graphics card, decodes the code stream into a YUV signal by using the decoding module through the target graphics card, and calls a display module corresponding to the target graphics card to display the YUV signal.
The decoding module in this embodiment includes: the display card comprises a decoding module 204 and a decoding module 205, wherein the decoding module 204 corresponds to the display card 1, and the decoding module 205 corresponds to the display card 2.
The embodiment further comprises the following steps: the display module 206 and the display module 207, the display module 206 corresponds to the display card 1, the display module 207 corresponds to the display card 2, and the code stream is rendered and played through the display module after being decoded by the decoding module. For example, after being decoded by the decoding module 204, the decoded image is displayed by the display module 206, or after being decoded by the decoding module 205, the decoded image is displayed by the display module 207; or after being decoded by the decoding module 204, the display is displayed by the display module 206 and the display module 207, or after being decoded by the decoding module 205, the display is displayed by the display module 206 and the display module 207.
For example, if the target graphics card is graphics card 1, the decoding module 204 corresponding to the graphics card 1 is called, the graphics card 1 decodes the video card by using the decoding module 204, and decodes the encoded code stream into YUV signals, and then the video card 1 displays the YUV signals by using the display module 206.
When the electronic device is started, the display card resource management module 202 identifies the number of display cards of the device, the decoding resource scheduling module 203 obtains the number of display cards, for example, the number of display cards is 2, and the electronic device creates two decoding modules 204 and 205, and two display modules 206 and 207. The decoding modules and the display modules can be utilized when the video is decoded and displayed subsequently, and if the hardware environment of the equipment is changed, for example, the number of the display cards is increased or reduced, the corresponding decoding modules and the corresponding display modules can be created again.
Illustratively, as shown in fig. 7, the television wall system includes a signal source device 10, an electronic device including two display cards, a display card 1 and a display card 2, and two display units.
The display unit 1 comprises four displays, and each display is connected with the display card 1 through a video output interface; the display unit 2 also comprises four displays, each display being connected to the graphics card 2 via a video output interface. The two display units are spliced into a large-screen television wall by 8 displays.
The signal source 10 generates a code stream through video acquisition, image processing, and video compression, and transmits the code stream to the electronic device through a network.
The user may specify to play in a certain play window, such as play window 1, play window 2, or play window 3, before playing the video.
The playing window 1 is rendered and displayed on the display unit 1 through the display card 1. The playing window 2 is displayed on the display unit 2 through rendering by the display card 2. The playback window 3 spans the display unit 1 and the display unit 2, and is rendered and displayed by using the two display cards 1 and 2.
If the user specifies to play on the play window 1, the corresponding display unit is judged to be the display unit 1 according to the position of the play window 1, and the display card 1 is used for rendering and displaying after the decoding module 204 of the display card 1 connected with the display unit 1 is selected for decoding.
If the user designates to play on the play window 2, the corresponding display unit is judged to be the display unit 2 according to the position of the play window 2, and the display card 2 is used for rendering and displaying after the decoding module 205 of the display card 2 connected with the display unit 2 is selected for decoding.
If the user designates to play on the play window 3, the corresponding display units are judged to be the display unit 1 and the display unit 2 according to the position of the play window 3, the display card 1 connected with the display unit 1 with a large occupied area of the play window 3 is selected, and after decoding is performed by using the decoding module 204 of the display card 1, the display card 1 and the display card 2 are used for rendering and displaying together.
As shown in fig. 4, during the playing process, the playing window is moved, and the display unit occupied by the playing window may change. The corresponding decoding resources should also be switched.
For example, the play window 1 is dragged from the display unit 1 to the display unit 2.
And monitoring the positions of the playing windows before and after dragging, wherein the occupied display unit is changed from the display unit 1 to the display unit 2. The corresponding display card for decoding is changed from the display card 1 to the display card 2.
The decoding module 204 corresponding to the display card 1 stops decoding the code stream, and the decoding resource scheduling unit stops transmitting the code stream to the display card 1. The decoding module 205 corresponding to the display card 2 decodes the code stream, and the decoding resource scheduling unit transmits the code stream to the display card 2 for decoding.
In this embodiment, because the device includes a plurality of display cards, the display card resources to be decoded need to be determined during decoding, the plurality of display cards have their respective decoding modules and display modules, and the first target decoding module used for decoding is the decoding module corresponding to the target display card to which the play window belongs, and the display module corresponding to the target display card is directly used for displaying after decoding.
Fig. 8 is a schematic structural diagram of an embodiment of a video playing apparatus provided in the present application, and as shown in fig. 8, the apparatus of the present embodiment is applied to the video playing system of the above embodiment, and the video playing apparatus includes:
the determining module is used for determining a target display card to which the playing window belongs from display cards connected with equipment according to the position information of the playing window of the video to be played; the display card connected with the equipment is provided with a corresponding decoding module and a corresponding display module;
the control module is used for controlling a first target decoding module corresponding to the target display card to decode the video to be played;
the control module is further configured to control a first target display module corresponding to the target graphics card to render and display the decoded video data, where the number of the first target display modules is not less than the number of the first target decoding modules.
In a possible implementation manner, the determining module is specifically configured to:
determining at least one first display unit occupied by the playing window according to the position information of the playing window;
determining the display card to which each display unit belongs in at least one first display unit occupied by the playing window as the target display card;
in a possible implementation manner, the determining module is specifically configured to:
determining a first target decoding module corresponding to the target display card according to the occupied area of the playing window in at least one first display unit; or the like, or, alternatively,
and determining a first target decoding module corresponding to the target display card according to the load of the display card of each display unit in at least one first display unit occupied by the playing window.
In a possible implementation manner, the determining module is specifically configured to:
if the number of the first display units occupied by the playing window is at least two, taking a decoding module corresponding to a display card to which the first display unit with the largest area occupied by the playing window in the at least two first display units belongs as the first target decoding module;
in a possible implementation manner, the determining module is specifically configured to:
if the number of the first display units occupied by the playing window is at least two, taking a decoding module corresponding to a display card with the minimum load in the display cards to which the at least two first display units belong as the first target decoding module;
in one possible implementation, the first target display module includes: and the display module corresponds to each display card of each first display unit in at least one first display unit occupied by the playing window.
In one possible implementation manner, the method further includes: the receiving module is used for receiving a moving instruction of a user; the moving instruction is used for indicating that the playing window is moved from the current position to the target position;
the determining module is specifically configured to:
determining at least one second display unit occupied by the playing window according to the target position, and determining a second target decoding module and a second target display module corresponding to a display card to which each display unit in the at least one second display unit belongs;
the control module is specifically configured to:
controlling the second target decoding module to decode the video to be played;
and controlling the second target display module to render and display the decoded video data.
In a possible implementation manner, the determining module is further configured to:
acquiring the position information of the playing window according to the position information input by a user; or the like, or a combination thereof,
acquiring the position information of the playing window according to the parameter information of the video to be played; the parameter information includes at least one of: the size, frame rate, resolution of the occupied memory space.
In one possible implementation, the determining module is further configured to:
detecting the number of display cards connected with equipment;
generating a corresponding number of decoding modules and a corresponding number of display modules according to the number of the display cards;
and respectively associating each display card with the corresponding decoding module and display module.
The method of this embodiment is similar to the technical solutions of the above embodiments in the implementation principle and technical effect, and is not described herein again.
In an embodiment of the present application, a computer-readable storage medium is further provided, where a computer program is stored, and when the computer program is executed by a processor, the method in the foregoing method embodiment is implemented.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims (9)
1. A video playback method, the method comprising:
determining a target display card to which a playing window belongs from display cards connected with equipment according to the position information of the playing window of the video to be played; the display card connected with the equipment is provided with a corresponding decoding module and a corresponding display module;
controlling a first target decoding module corresponding to the target display card to decode the video to be played;
controlling a first target display module corresponding to the target display card to render and display the decoded video data, wherein the number of the first target display modules is not less than that of the first target decoding modules;
the determining, from display cards connected to a device, a target display card to which the play window belongs according to the position information of the play window of the video to be played includes:
determining at least one first display unit occupied by the playing window according to the position information of the playing window;
determining the display card to which each display unit belongs in at least one first display unit occupied by the playing window as the target display card;
after determining the target display card to which the playing window belongs from the display cards connected to the slave device, the method further includes:
determining a first target decoding module corresponding to the target display card according to the occupied areas of the playing window in at least two first display units; or the like, or, alternatively,
and determining a first target decoding module corresponding to the target display card according to the load of the display card of each display unit in the at least two first display units occupied by the playing window.
2. The method according to claim 1, wherein the determining a first target decoding module corresponding to the target graphics card according to the occupied area of the playing window in at least one first display unit comprises:
if the number of the first display units occupied by the playing window is at least two, taking a decoding module corresponding to a display card to which the first display unit with the largest area occupied by the playing window in the at least two first display units belongs as the first target decoding module;
the determining, according to the load of the display card to which each display unit belongs in the at least one first display unit occupied by the play window, a first target decoding module corresponding to the target display card includes:
if the number of the first display units occupied by the playing window is at least two, taking the decoding module corresponding to the display card with the minimum load in the display cards to which the at least two first display units belong as the first target decoding module;
the first target display module includes: and the display module corresponds to each display card of each first display unit in at least one first display unit occupied by the playing window.
3. The method according to claim 1 or 2, wherein after controlling the first target display module corresponding to the target graphics card to render and display the decoded video data, the method further comprises:
receiving a moving instruction of a user; the moving instruction is used for indicating that the playing window is moved from the current position to the target position;
determining at least one second display unit occupied by the playing window according to the target position, and determining a second target decoding module and a second target display module corresponding to a display card to which each display unit in the at least one second display unit belongs;
controlling the second target decoding module to decode the video to be played;
and controlling the second target display module to render and display the decoded video data.
4. The method according to claim 1 or 2, wherein before determining a target video card to which the playing window belongs from video cards connected to a device according to the position information of the playing window of the video to be played, the method further comprises:
acquiring the position information of the playing window according to the position information input by a user; or the like, or a combination thereof,
acquiring the position information of the playing window according to the parameter information of the video to be played; the parameter information includes at least one of: the size, frame rate, resolution of the occupied memory space.
5. The method according to claim 1 or 2, wherein before determining a target graphics card to which the playing window belongs from graphics cards connected to a device according to the position information of the playing window of the video to be played, the method further comprises:
detecting the number of display cards connected with equipment;
generating a corresponding number of decoding modules and a corresponding number of display modules according to the number of the display cards;
and respectively associating each display card with the corresponding decoding module and display module.
6. A video playback apparatus, comprising:
the determining module is used for determining a target display card to which the playing window belongs from display cards connected with equipment according to the position information of the playing window of the video to be played; the display card connected with the equipment is provided with a corresponding decoding module and a corresponding display module;
the control module is used for controlling a first target decoding module corresponding to the target display card to decode the video to be played;
the control module is further configured to control a first target display module corresponding to the target graphics card to render and display the decoded video data, where the number of the first target display modules is not less than the number of the first target decoding modules;
the determining module is specifically configured to:
determining at least one first display unit occupied by the playing window according to the position information of the playing window;
determining the display card to which each display unit belongs in at least one first display unit occupied by the playing window as the target display card;
the determining module is specifically configured to:
determining a first target decoding module corresponding to the target display card according to the occupied areas of the playing window in at least two first display units; or the like, or, alternatively,
and determining a first target decoding module corresponding to the target display card according to the load of the display card of each display unit in the at least two first display units occupied by the playing window.
7. A video playback system, comprising:
an electronic device and at least two displays;
the electronic equipment comprises at least two display cards, and each display card is connected with at least one display;
the electronic equipment is used for determining a target display card to which the playing window belongs from the at least two display cards according to the position information of the playing window of the video to be played; each of the at least two display cards is provided with a corresponding decoding module and a corresponding display module;
controlling a first target decoding module corresponding to the target display card to decode the video to be played;
controlling a first target display module corresponding to the target display card to render the decoded video data, and displaying the video data on a display occupied by the playing window in the at least two displays;
the determining, from display cards connected to a device, a target display card to which the play window belongs according to the position information of the play window of the video to be played includes:
determining at least one first display unit occupied by the playing window according to the position information of the playing window;
determining the display card to which each display unit belongs in at least one first display unit occupied by the playing window as the target display card;
after determining the target display card to which the playing window belongs from the display cards connected to the slave device, the method further includes:
determining a first target decoding module corresponding to the target display card according to the occupied areas of the playing window in at least two first display units; or the like, or, alternatively,
and determining a first target decoding module corresponding to the target display card according to the load of the display card of each display unit in the at least two first display units occupied by the playing window.
8. An electronic device, comprising:
the display system comprises a processor, a memory and at least two display cards connected with the processor;
wherein the memory is configured to store executable instructions of the processor;
the processor is configured to perform the method of any of claims 1-5 via execution of the executable instructions.
9. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the method of any one of claims 1-5.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2020101254528 | 2020-02-27 | ||
| CN202010125452 | 2020-02-27 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113316022A CN113316022A (en) | 2021-08-27 |
| CN113316022B true CN113316022B (en) | 2022-07-08 |
Family
ID=77370602
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110051083.7A Active CN113316022B (en) | 2020-02-27 | 2021-01-14 | Video playing method, device, equipment, system and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113316022B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117475013A (en) * | 2023-12-21 | 2024-01-30 | 杭州海康威视数字技术股份有限公司 | Computer equipment and video data processing method |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106168893A (en) * | 2016-07-18 | 2016-11-30 | 合肥盈川信息技术有限公司 | A kind of video-splicing data distribution system |
| CN110099224A (en) * | 2018-01-31 | 2019-08-06 | 杭州海康威视数字技术股份有限公司 | Premonitoring display methods, apparatus and system, computer equipment and storage medium |
| CN110572622A (en) * | 2019-09-30 | 2019-12-13 | 威创集团股份有限公司 | Video decoding method and device |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9047040B2 (en) * | 2007-06-25 | 2015-06-02 | International Business Machines Corporation | Method for running computer program on video card selected based on video card preferences of the program |
| CN101587431B (en) * | 2009-04-08 | 2011-03-16 | 广东威创视讯科技股份有限公司 | Method for realizing multi-screen playing video |
| CN102098544B (en) * | 2010-12-09 | 2013-02-27 | 南京中兴力维软件有限公司 | Image display method of television wall |
| CN105487834B (en) * | 2015-12-14 | 2018-08-07 | 广东威创视讯科技股份有限公司 | Combination echoes method and system |
| CN106598526B (en) * | 2016-12-20 | 2020-01-10 | 广东威创视讯科技股份有限公司 | Method, device and system for displaying PPT on spliced wall |
| TWI615772B (en) * | 2017-01-25 | 2018-02-21 | 精英電腦股份有限公司 | Method for synchronously controlling displays |
| CN109062528A (en) * | 2018-08-07 | 2018-12-21 | 威创集团股份有限公司 | A kind of mosaic screen shows the method, device and equipment of office file |
-
2021
- 2021-01-14 CN CN202110051083.7A patent/CN113316022B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106168893A (en) * | 2016-07-18 | 2016-11-30 | 合肥盈川信息技术有限公司 | A kind of video-splicing data distribution system |
| CN110099224A (en) * | 2018-01-31 | 2019-08-06 | 杭州海康威视数字技术股份有限公司 | Premonitoring display methods, apparatus and system, computer equipment and storage medium |
| CN110572622A (en) * | 2019-09-30 | 2019-12-13 | 威创集团股份有限公司 | Video decoding method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113316022A (en) | 2021-08-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112004086B (en) | Video data processing method and device | |
| US9621866B2 (en) | Image processing apparatus, image processing method, and program | |
| US9832421B2 (en) | Apparatus and method for converting a frame rate | |
| US8203649B2 (en) | Image processing apparatus and image processing method | |
| US10033969B2 (en) | Semiconductor device, video display system, and method of processing signal | |
| US9761202B2 (en) | Seamless video transitions | |
| KR20140044840A (en) | Media encoding using changed regions | |
| US10191712B2 (en) | Display apparatus and recording medium | |
| CN111813490A (en) | Method and device for processing interpolation frame | |
| CN109640180B (en) | Method, device, equipment, terminal, server and storage medium for 3D display of video | |
| CN113835656A (en) | Display method and device and electronic equipment | |
| CN113316022B (en) | Video playing method, device, equipment, system and storage medium | |
| CN110187858B (en) | Image display method and system | |
| CN113038273B (en) | Video frame processing method and device, storage medium and electronic equipment | |
| CN112804410A (en) | Multi-display-screen synchronous display method and device, video processing equipment and storage medium | |
| CN104837046A (en) | Multi-media file processing method and device | |
| CN113835657A (en) | Display method and electronic equipment | |
| CN109791755B (en) | Image processing apparatus, display apparatus, and control method thereof | |
| CN110753194B (en) | Dual-screen different display method, storage medium and electronic equipment | |
| CN115567754A (en) | Video playing method, device, equipment and storage medium | |
| JP7420239B2 (en) | Display control device, display control system, display control method, and display control program | |
| CN103902395A (en) | Information input control method and electronic terminal | |
| CN103002346A (en) | Video processing device, television equipment and video processing method | |
| US9386059B2 (en) | Apparatus and method for providing time shift function in cloud computing system | |
| CN101657851A (en) | Method for controlling output of display unit and system enabling of the method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |