CN114666628A - Multimedia remote play control method, device and system - Google Patents
Multimedia remote play control method, device and system Download PDFInfo
- Publication number
- CN114666628A CN114666628A CN202210254676.8A CN202210254676A CN114666628A CN 114666628 A CN114666628 A CN 114666628A CN 202210254676 A CN202210254676 A CN 202210254676A CN 114666628 A CN114666628 A CN 114666628A
- Authority
- CN
- China
- Prior art keywords
- remote
- user
- control
- playing
- instruction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 79
- 230000004044 response Effects 0.000 claims abstract description 28
- 238000004806 packaging method and process Methods 0.000 claims abstract description 18
- 239000000463 material Substances 0.000 claims description 112
- 230000005540 biological transmission Effects 0.000 claims description 30
- 238000005538 encapsulation Methods 0.000 claims description 5
- 230000006870 function Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 4
- 230000007547 defect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000006698 induction Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/482—End-user interface for program selection
- H04N21/4825—End-user interface for program selection using a list of items to be played back in a given order, e.g. playlists
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Computer Networks & Wireless Communication (AREA)
- Telephonic Communication Services (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a multimedia remote play control method, a device and a system; wherein the method comprises the following steps: generating a user remote play control request instruction on a remote user control end; packaging a user remote play control request instruction and sending the user remote play control request instruction to a remote play end; the remote playing end analyzes, identifies and processes the packaged user remote playing control request instruction and sends request feedback information to the remote user control end; generating a user remote playing control instruction on a user sending program of a remote user control end; packaging a user remote playing control instruction, and sending the user remote playing control instruction to a remote playing terminal built-in device; and the remote playing end carries out response control processing according to the packaged user remote playing control instruction and feeds back a response control processing result to the remote user control end. In the embodiment of the invention, the remote real-time playing control of the multimedia of the remote playing end is realized, the control response speed is high, and the user experience is good.
Description
Technical Field
The invention relates to the technical field of multimedia control, in particular to a method, a device and a system for controlling multimedia remote playing.
Background
The method can realize material management and play control of the multimedia material by considering the control of the multimedia material on the receiving end equipment under the condition of non-real-time and remote (local area network or non-local area network). The material management includes upload and delete functions for multimedia material. The playing control comprises the control of playing, pausing, stopping, playing modes and the like of the multimedia material at the receiving end, meanwhile, the management of a play list can be realized, the playing sequence of the multimedia material is controlled, the mixed playing of the multimedia material (video, audio and picture) and the timed playing of the material are realized, and the like.
The current common multimedia playing control method in the market is as follows:
(1) the first method is as follows: one mobile device shares a multimedia material link address on the mobile device in a local area network in a DLNA (digital living network alliance) mode (only in the local area network), controls the playing of the multimedia material in a real-time pushing mode after being connected with a large-screen device, cannot store the multimedia material in the large-screen device, needs to be always connected with the large-screen device, and fails in multimedia control once being disconnected.
(2) The second method comprises the following steps: and the large-screen equipment is inserted into the U disk, and after the large-screen equipment identifies the operation of inserting the U disk, the related multimedia material is identified and played. If the effect of the playlist is to be realized, the playlist file needs to be written in advance and put into the U disk.
(3) The third method comprises the following steps: a mobile device simply sends a control command to a large-screen device in a network transmission mode, and the large-screen device is controlled to play local multimedia materials without the management function of a playlist.
(4) The traditional mode is as follows: and one remote controller realizes the multimedia playing control of the large-screen equipment through infrared induction. Moreover, the functionality of the remote controller is single, which wastes the hardware cost of the remote controller.
By combining the above common multimedia play control modes in the market, the method and system for multimedia remote play control are extended and extended on their respective disadvantages, and the mobile device needs to implement the material management function of the remote receiving end, including the functions of uploading, deleting, previewing and the like, and also needs to implement the material play control of the remote receiving end, including the common play, pause, stop, play mode control, and the management of the play list (creation of a customized list, sequential adjustment of list materials, mixed play of materials, timed play of materials and the like). And the large-screen device needs to receive and execute the material instructions uploaded and deleted by the mobile device and play multimedia materials. On the basis, the system can be used under the condition of ensuring local area network and non-local area network, realizes non-real-time remote control and releases your mobile equipment.
Disclosure of Invention
The invention aims to overcome the defects of the prior art, and provides a multimedia remote play control method, device and system, which can realize remote real-time play control of multimedia at a remote play end, and have the advantages of high control response speed and good user experience.
In order to solve the above technical problem, an embodiment of the present invention provides a multimedia remote play control method, which is applied to a user side, and the method includes:
receiving a user operation and generating a user remote playing control request instruction on a user sending program of a remote user control end;
packaging the user remote playing control request instruction based on a flatBuffers network transmission protocol, and sending the user remote playing control request instruction to a receiving end program built in a remote playing end;
receiving request feedback information of the receiving end program based on the user remote play control request instruction;
receiving user operation on the basis of the request feedback information on a user sending program of the remote user control end to generate a user remote playing control instruction;
and packaging the user remote playing control instruction based on a flatBuffers network transmission protocol, sending the user remote playing control instruction to a receiving end program built in a remote playing end to control the remote playing end, and keeping the remote user control end in communication connection with the remote playing end.
Optionally, the user remote play control request instruction includes a combination of one or more request instructions not limited to a play control request instruction, a multimedia material upload/delete request instruction, and a playlist management request instruction;
the user remote playing control instruction comprises a combination of one or more instructions of a playing control instruction, a multimedia material uploading/deleting instruction and a playlist management instruction; the multimedia material uploading instruction comprises multimedia material data.
Optionally, the sending to a receiving end program built in the remote playing end includes:
determining that the connection mode of the remote user control end and the remote playing end is a local area network connection mode or an internet connection mode;
when the connection mode of the remote user control end and the remote playing end is a local area network connection mode, the remote user control end sends a packaged user remote playing control request instruction to a receiving end program built in the remote playing end based on a local area network gateway;
when the connection mode of the remote user control end and the remote playing end is an internet connection mode, the remote user control end sends the packaged user remote playing control request instruction to a centralized control server, and the centralized control server forwards the packaged user remote playing control request instruction to a centralized control server client program of the remote playing end and forwards the packaged user remote playing control request instruction to the receiving end program based on the centralized control server client program.
Optionally, the playlist management instruction includes an instruction to create a playlist, delete the playlist, query the playlist, modify a playlist name, add a material to the playlist, delete a material from the playlist, adjust a material sequence, set a timed play, and set one or more contents of a play interval;
the playing control instruction comprises one or more of playing, pausing, stopping, switching and adjusting the sequence.
In addition, an embodiment of the present invention further provides a multimedia remote play control method, which is applied to a remote play side, and the method includes:
after receiving the packaged user remote playing control request instruction, a receiving end program built in the remote playing end analyzes, identifies and processes the packaged user remote playing control request instruction, and sends request feedback information to the remote user control end according to a first analysis, identification and processing result;
receiving a packaged user remote play control instruction sent by the remote user control terminal based on the request feedback information;
and analyzing and identifying the packaged user remote playing control instruction, responding and controlling according to a second analysis and identification result, and feeding back a response control processing result to the remote user control end, wherein the remote user control end is in communication connection with the remote playing end.
Optionally, the performing response control processing according to the second parsing and identifying result includes:
when the user remote playing control instruction is obtained according to the second analysis result and is a playing control instruction, playing, pausing, stopping, switching or sequential adjustment control operation is carried out on multimedia materials in an appointed file in a remote playing end based on the playing control instruction, the control operation result is displayed through a large screen of the remote playing end, and the control operation result is fed back to the remote user control end;
when the user remote playing control instruction is obtained as a multimedia material uploading/deleting instruction according to the second analysis result, uploading multimedia material data contained in the multimedia material uploading instruction to a specified path folder or deleting corresponding multimedia material data in a specified folder path according to the multimedia material deleting instruction, and feeding back the multimedia material data to the remote user control end;
and when the user remote playing control instruction is obtained as a playlist management instruction according to the second analysis result, analyzing the playlist management instruction, performing operation processing on the playlist of the remote playing terminal based on the analysis result, and feeding back the playlist to the remote user control terminal.
Optionally, the performing, based on the analysis result, an operation on the playlist of the remote playback end includes:
and operating the database of the remote playing end based on the analysis result, and performing operation processing on the playlist of the remote playing end, such as creating, deleting, name modifying, material adding, material deleting, material sequence adjusting, timed playing setting or playing interval time setting.
In addition, an embodiment of the present invention further provides a multimedia remote play control method, where the method includes:
receiving a user operation and generating a user remote playing control request instruction on a user sending program of a remote user control end;
packaging the user remote playing control request instruction based on a flatBuffers network transmission protocol, and sending the user remote playing control request instruction to a receiving end program built in a remote playing end;
after receiving the packaged user remote playing control request instruction, a receiving end program built in the remote playing end analyzes, identifies and processes the packaged user remote playing control request instruction, and sends request feedback information to the remote user control end according to a first analysis, identification and processing result;
after the remote user control end receives the request feedback information, a user remote playing control instruction is generated on a user sending program of the remote user control end based on the request feedback information receiving user operation;
packaging the user remote playing control instruction based on a flatBuffers network transmission protocol, and sending the user remote playing control instruction to a receiving end program built in a remote playing end to control the remote playing end;
after the remote playing end receives the packaged user remote playing control instruction, analyzing and identifying the packaged user remote playing control instruction, performing response control processing according to a second analysis and identification result, and feeding back the response control processing result to the remote user control end, wherein the remote user control end is in communication connection with the remote playing end.
In addition, an embodiment of the present invention further provides a multimedia remote play control apparatus, where the apparatus includes:
a first generation module: the remote play control system is used for receiving user operation on a user sending program of a remote user control end to generate a user remote play control request instruction;
a first encapsulation module: the remote play control request command is used for packaging the user remote play control request command based on a flatBuffers network transmission protocol and is sent to a receiving end program built in a remote play end;
a feedback module: after receiving the packaged user remote play control request instruction, a receiving end program arranged in the remote play end analyzes, identifies and processes the packaged user remote play control request instruction, and sends request feedback information to the remote user control end according to a first analysis, identification and processing result;
a second generation module: the remote user control end is used for receiving the request feedback information and then receiving user operation on the basis of the request feedback information on a user sending program of the remote user control end to generate a user remote playing control instruction after receiving the request feedback information;
a second package module: the remote playing control instruction is used for encapsulating the user remote playing control instruction based on a flatBuffers network transmission protocol and sending the encapsulated user remote playing control instruction to a receiving end program built in a remote playing end to control the remote playing end;
a control module: the remote playing terminal is used for analyzing and identifying the packaged user remote playing control command after receiving the packaged user remote playing control command, responding and controlling according to a second analysis and identification result, and feeding back a response control processing result to the remote user control terminal, wherein the remote user control terminal is in communication connection with the remote playing terminal.
In addition, an embodiment of the present invention further provides a multimedia remote play control system, where the system includes a remote user control end and a remote play end, where the remote user control end is connected to the remote play end based on a local area network or the internet, and the system is configured to execute the multimedia remote play control method according to any one of the above items.
In the embodiment of the invention, the problems of non-real-time, local area network limitation and playlist management are solved. The user can perform material management and play control management on the multimedia material on the remote play end in a non-real-time manner under the condition of a local area network or a public network through the mobile equipment; the cost for producing the remote controller hardware is saved, the original application scene is widened, and the method can be applied to the common display fields of meetings, education, advertisements, markets and the like; the remote real-time playing control of the multimedia of the remote playing end is realized, the control response speed is high, and the user experience is good.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a flowchart illustrating a multimedia remote play control method on a user side according to an embodiment of the present invention;
fig. 2 is a flowchart illustrating a multimedia remote play control method on a remote play side according to an embodiment of the present invention;
FIG. 3 is a flowchart illustrating a multimedia remote play control method according to an embodiment of the present invention;
FIG. 4 is a schematic structural diagram of a multimedia remote playback control apparatus according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a multimedia remote play control system according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Example one
In the multimedia remote play control method, the corresponding preparation work is required as follows: (1) selecting a proper data packaging format and defining a transmission protocol; firstly, the data format selects the flatBuffers because of small volume, small occupied memory and high transmission speed; the transmission protocol content comprises: A. instructions (requests, responses); B. control authority (allow operation, stop operation); C. various operation instructions (such as uploading, creating, deleting, playing, pausing and other operation instructions); D. file data (video, audio, pictures, etc.); (2) and constructing a client and a webpage end of the mobile equipment by adopting a Netty network framework to form a receiving end of a remote user control end and a remote playing end.
Referring to fig. 1, fig. 1 is a flowchart illustrating a multimedia remote play control method of a user side according to an embodiment of the present invention.
As shown in fig. 1, a multimedia remote play control method is applied to a user side, and the method includes:
s11: receiving a user operation and generating a user remote playing control request instruction on a user sending program of a remote user control end;
in the specific implementation process of the invention, the remote user control end is connected with the remote playing end through a local area network or a public network; the remote user control end can be a mobile end, the webpage end comprises a client sending program, and the client sending program is mainly used for sending related operations of multimedia control; when the remote user control end is connected with the remote playing end through a public network, a centralized control server is needed to realize the instruction forwarding function, namely, a request and data are forwarded to a centralized control service client program of the receiving end, and then the request and the data are forwarded to the receiving end program through the centralized control service client program; namely, a user remote play control request instruction is generated by receiving user operation on a user sending program of a remote user control end; the user remote play control request command includes a combination of one or more request commands of a play control request command, a multimedia material uploading/deleting request command and a play list management request command.
S12: packaging the user remote playing control request instruction based on a flatBuffers network transmission protocol, and sending the user remote playing control request instruction to a receiving end program built in a remote playing end;
in a specific implementation process of the present invention, the sending to a receiving end program built in the remote playing end includes: determining that the connection mode of the remote user control end and the remote playing end is a local area network connection mode or an internet connection mode; when the connection mode of the remote user control end and the remote playing end is a local area network connection mode, the remote user control end sends a packaged user remote playing control request instruction to a receiving end program built in the remote playing end based on a local area network gateway; when the connection mode of the remote user control end and the remote playing end is an internet connection mode, the remote user control end sends the packaged user remote playing control request instruction to a centralized control server, and the centralized control server forwards the packaged user remote playing control request instruction to a centralized control server client program of the remote playing end and forwards the packaged user remote playing control request instruction to the receiving end program based on the centralized control server client program.
Specifically, after a user remote play control request instruction is obtained, the user remote play control request instruction is packaged through a flatBuffers network transmission protocol and sent to a receiving end program built in a remote play end; the data encapsulation processing is carried out by using a flatBuffers network transmission protocol, so that the encapsulated data has small volume, high transmission speed and small occupied memory and can be transmitted in a network format.
Meanwhile, the connection mode of the remote user control end and the remote playing end needs to be determined to be a local area network connection mode or an internet connection mode; when the connection mode of the remote user control end and the remote playing end is a local area network connection mode, the remote user control end sends a packaged user remote playing control request instruction to a receiving end program built in the remote playing end according to a local area network gateway; when the connection mode between the remote user control end and the remote playing end is an internet connection mode, the remote user control end sends the packaged user remote playing control request instruction to the centralized control server, and the centralized control server forwards the packaged user remote playing control request instruction to the centralized control server client program of the remote playing end and forwards the packaged user remote playing control request instruction to the receiving end program according to the centralized control server client program.
S13: receiving request feedback information of the receiving end program based on the user remote play control request instruction;
in the specific implementation process of the invention, the remote user control end receives the request feedback information of the receiving end program according to the user remote play control request instruction; after receiving a user remote play control request instruction, a receiving end program built in the remote play end performs corresponding analysis, judges whether the request passes or not according to the current condition of the receiving end program, and feeds back request feedback information to the remote user control end according to whether the request passes or not.
S14: receiving user operation on the basis of the request feedback information on a user sending program of the remote user control end to generate a user remote playing control instruction;
in the specific implementation process of the invention, the user remote play control instruction comprises a combination of one or more instructions of a play control instruction, a multimedia material uploading/deleting instruction and a playlist management instruction; the multimedia material uploading instruction comprises multimedia material data.
Specifically, a user sending program at a remote user control end receives user operation according to request feedback information to generate a user remote playing control instruction; the user remote playing control instruction comprises a combination of one or more instructions in a playing control instruction, a multimedia material uploading/deleting instruction and a playlist management instruction; the multimedia material uploading instruction comprises multimedia material data.
Meanwhile, the playlist management instruction is an instruction including one or more of creating a playlist, deleting the playlist, inquiring the playlist, modifying a playlist name, adding a material to the playlist, deleting the material from the playlist, adjusting a material sequence, setting a timed play, and setting a play interval time; the playing control instruction comprises one or more of playing, pausing, stopping, switching and adjusting the sequence.
S15: and packaging the user remote playing control instruction based on a flatBuffers network transmission protocol, sending the user remote playing control instruction to a receiving end program built in a remote playing end to control the remote playing end, and keeping the remote user control end in communication connection with the remote playing end.
In the specific implementation process of the invention, the user remote playing control instruction is packaged according to a flitbuffers network transmission protocol, and after being packaged, the user remote playing control instruction is sent to a receiving end program built in a remote playing end to control the remote playing end, and meanwhile, the remote user control end and the remote playing end keep communication connection.
In the embodiment of the invention, the problems of non-real-time, local area network limitation and playlist management are solved. The user can perform material management and play control management on the multimedia material on the remote play end in a non-real-time manner under the condition of a local area network or a public network through the mobile equipment; the cost for producing the remote controller hardware is saved, the original application scene is widened, and the method can be applied to the common display fields of meetings, education, advertisements, markets and the like; the remote real-time playing control of the multimedia of the remote playing end is realized, the control response speed is high, and the user experience is good.
Example two
Referring to fig. 2, fig. 2 is a flowchart illustrating a multimedia remote play control method of a remote play side according to an embodiment of the present invention.
As shown in fig. 2, a multimedia remote play control method is applied to a remote play side, and the method includes:
s21: after receiving the packaged user remote playing control request instruction, a receiving end program built in the remote playing end analyzes, identifies and processes the packaged user remote playing control request instruction, and sends request feedback information to the remote user control end according to a first analysis, identification and processing result;
in the specific implementation process of the invention, after receiving the packaged user remote play control request instruction, a receiving end program built in the remote play end needs to analyze, identify and process the packaged user remote play control request instruction, and then sends request feedback information to the remote user control end according to a first analysis and identification result obtained by analysis and identification.
S22: receiving a packaged user remote play control instruction sent by the remote user control terminal based on the request feedback information;
in the specific implementation process of the invention, the packaged user remote play control instruction sent by the remote user control end according to the request feedback information is received.
S23: analyzing and identifying the packaged user remote playing control instruction, responding and controlling according to a second analysis and identification result, and feeding back the responding and controlling result to the remote user control end, wherein the remote user control end is in communication connection with the remote playing end.
In a specific implementation process of the present invention, the performing response control processing according to the second parsing identification result includes: when the user remote playing control instruction is obtained according to the second analysis result and is a playing control instruction, playing, pausing, stopping, switching or sequential adjustment control operation is carried out on multimedia materials in an appointed file in a remote playing end based on the playing control instruction, the control operation result is displayed through a large screen of the remote playing end, and the control operation result is fed back to the remote user control end; when the user remote playing control instruction is obtained as a multimedia material uploading/deleting instruction according to the second analysis result, uploading multimedia material data contained in the multimedia material uploading instruction to a specified path folder or deleting corresponding multimedia material data in a specified folder path according to the multimedia material deleting instruction, and feeding back the multimedia material data to the remote user control end; and when the user remote playing control instruction is obtained as a playlist management instruction according to the second analysis result, analyzing the playlist management instruction, performing operation processing on the playlist of the remote playing terminal based on the analysis result, and feeding back the playlist to the remote user control terminal.
Further, the performing operation processing on the playlist of the remote play end based on the analysis result includes: and operating the database of the remote playing end based on the analysis result, and performing operation processing on the playlist of the remote playing end, such as creating, deleting, name modifying, material adding, material deleting, material sequence adjusting, timed playing setting or playing interval time setting.
Specifically, analyzing, identifying and processing the packaged user remote playing control instruction, and performing response control processing according to a second analysis and identification result, namely when the user remote playing control instruction is obtained according to the second analysis result and is the playing control instruction, performing playing, pausing, stopping, switching or sequential adjustment control operation on a multimedia material in an appointed file in a remote playing end according to the playing control instruction, displaying a control operation result through a large screen of the remote playing end, and feeding back the control operation result to the remote user control end; when the user remote playing control instruction is obtained as a multimedia material uploading/deleting instruction according to the second analysis result, uploading multimedia material data contained in the multimedia material uploading instruction to a specified path folder or deleting corresponding multimedia material data in a specified folder path according to the multimedia material deleting instruction, and feeding back the multimedia material data to a remote user control end; and when the user remote playing control instruction is obtained as a playlist management instruction according to the second analysis result, analyzing the playlist management instruction, performing operation processing on the playlist of the remote playing end according to the analysis result, and feeding back the playlist to the remote user control end.
Namely, operating a database of the remote playing end according to the analysis result, and performing operation processing on the playlist of the remote playing end, such as creating, deleting, modifying names, adding materials, deleting materials, adjusting material sequence, setting timed playing or setting playing interval time.
In the embodiment of the invention, the problems of non-real-time, local area network limitation and playlist management are solved. A user can perform material management and play control management on a multimedia material on a remote play end in a non-real-time manner under the condition of a local area network or a public network through mobile equipment; the cost for producing the remote controller hardware is saved, the original application scene is widened, and the method can be applied to the common display fields of meetings, education, advertisements, markets and the like; the remote real-time playing control of the multimedia of the remote playing end is realized, the control response speed is high, and the user experience is good.
EXAMPLE III
Referring to fig. 3, fig. 3 is a flowchart illustrating a multimedia remote play control method according to an embodiment of the present invention.
As shown in fig. 3, a multimedia remote play control method includes:
s31: receiving a user operation and generating a user remote playing control request instruction on a user sending program of a remote user control end;
in the specific implementation process of the invention, the remote user control end is connected with the remote playing end through a local area network or a public network; the remote user control end can be a mobile end, the webpage end comprises a client sending program, and the client sending program is mainly used for sending related operations of multimedia control; when the remote user control end is connected with the remote playing end through a public network, a centralized control server is needed to realize the instruction forwarding function, namely, a request and data are forwarded to a centralized control service client program of the receiving end, and then the request and the data are forwarded to the receiving end program through the centralized control service client program; namely, a user remote play control request instruction is generated by receiving user operation on a user sending program of a remote user control end; the user remote play control request command includes a combination of one or more request commands of a play control request command, a multimedia material uploading/deleting request command and a playlist management request command.
S32: packaging the user remote playing control request instruction based on a flatBuffers network transmission protocol, and sending the user remote playing control request instruction to a receiving end program built in a remote playing end;
in a specific implementation process of the present invention, the sending to a receiving end program built in the remote playing end includes: determining that the connection mode of the remote user control end and the remote playing end is a local area network connection mode or an internet connection mode; when the connection mode of the remote user control end and the remote playing end is a local area network connection mode, the remote user control end sends a packaged user remote playing control request instruction to a receiving end program built in the remote playing end based on a local area network gateway; when the connection mode of the remote user control end and the remote playing end is an internet connection mode, the remote user control end sends the packaged user remote playing control request instruction to a centralized control server, and the centralized control server forwards the packaged user remote playing control request instruction to a centralized control server client program of the remote playing end and forwards the packaged user remote playing control request instruction to the receiving end program based on the centralized control server client program.
Specifically, after a user remote play control request instruction is obtained, the user remote play control request instruction is encapsulated through a flatBuffers network transmission protocol and is sent to a receiving end program built in a remote play end; and related data encapsulation processing is carried out by using a flatBuffers network transmission protocol, so that the encapsulated data has small volume, high transmission speed and small occupied memory and can be transmitted in a network format.
Meanwhile, the connection mode of the remote user control end and the remote playing end needs to be determined to be a local area network connection mode or an internet connection mode; when the connection mode of the remote user control end and the remote playing end is a local area network connection mode, the remote user control end sends a packaged user remote playing control request instruction to a receiving end program built in the remote playing end according to a local area network gateway; when the connection mode between the remote user control end and the remote playing end is an internet connection mode, the remote user control end sends the packaged user remote playing control request instruction to the centralized control server, and the centralized control server forwards the packaged user remote playing control request instruction to the centralized control server client program of the remote playing end and forwards the packaged user remote playing control request instruction to the receiving end program according to the centralized control server client program.
S33: after receiving the packaged user remote playing control request instruction, a receiving end program built in the remote playing end analyzes, identifies and processes the packaged user remote playing control request instruction, and sends request feedback information to the remote user control end according to a first analysis, identification and processing result;
in the specific implementation process of the invention, after receiving the packaged user remote play control request instruction, a receiving end program built in the remote play end needs to analyze, identify and process the packaged user remote play control request instruction, and then sends request feedback information to the remote user control end according to a first analysis and identification result obtained by analysis and identification.
S34: after the remote user control end receives the request feedback information, a user remote playing control instruction is generated on a user sending program of the remote user control end based on the request feedback information receiving user operation;
in the specific implementation process of the invention, after the remote user control end receives the request feedback information, a user sending program of the remote user control end receives user operation according to the request feedback information to generate a user remote playing control instruction; the user remote playing control instruction comprises a combination of one or more instructions in a playing control instruction, a multimedia material uploading/deleting instruction and a playlist management instruction; the multimedia material uploading instruction comprises multimedia material data.
Meanwhile, the playlist management command is a command including one or more of creating a playlist, deleting the playlist, inquiring the playlist, modifying a playlist name, adding materials to the playlist, deleting materials from the playlist, adjusting a material sequence, setting a timed play, and setting a play interval time; the playing control instruction comprises one or more of playing, pausing, stopping, switching and adjusting the sequence.
S35: packaging the user remote playing control instruction based on a flatBuffers network transmission protocol, and sending the user remote playing control instruction to a receiving end program built in a remote playing end to control the remote playing end;
in the specific implementation process of the invention, the user remote playing control instruction is packaged according to the flatBuffers network transmission protocol, and after being packaged, the user remote playing control instruction is sent to a receiving end program built in the remote playing end to control the remote playing end.
S36: after the remote playing end receives the packaged user remote playing control instruction, analyzing and identifying the packaged user remote playing control instruction, performing response control processing according to a second analysis and identification result, and feeding back the response control processing result to the remote user control end, wherein the remote user control end is in communication connection with the remote playing end.
In the specific implementation process of the invention, after the remote playing end receives the packaged user remote playing control instruction, the packaged user remote playing control instruction is analyzed, identified and processed, and response control processing is carried out according to a second analysis and identification result, namely when the user remote playing control instruction obtained according to the second analysis result is the playing control instruction, the playing, pausing, stopping, switching or sequential adjustment control operation is carried out on the multimedia material in the appointed file in the remote playing end according to the playing control instruction, the control operation result is displayed through the large screen of the remote playing end and is fed back to the remote user control end; when the user remote playing control instruction is obtained as a multimedia material uploading/deleting instruction according to the second analysis result, uploading multimedia material data contained in the multimedia material uploading instruction to a specified path folder or deleting corresponding multimedia material data in a specified folder path according to the multimedia material deleting instruction, and feeding back the multimedia material data to a remote user control end; and when the user remote playing control instruction is obtained as a playlist management instruction according to the second analysis result, analyzing the playlist management instruction, performing operation processing on the playlist of the remote playing end according to the analysis result, and feeding back the playlist to the remote user control end.
Namely, the database of the remote playing end is operated according to the analysis result, and the operation processing of creating, deleting, name modifying, material adding, material deleting, material sequence adjusting, timing playing setting or playing interval time setting is carried out on the play list of the remote playing end.
In the embodiment of the invention, the problems of non-real-time, local area network limitation and playlist management are solved. The user can perform material management and play control management on the multimedia material on the remote play end in a non-real-time manner under the condition of a local area network or a public network through the mobile equipment; the cost for producing the remote controller hardware is saved, the original application scene is widened, and the method can be applied to the common display fields of meetings, education, advertisements, markets and the like; the remote real-time playing control of the multimedia of the remote playing end is realized, the control response speed is high, and the user experience is good.
In a fourth embodiment, please refer to fig. 4, fig. 4 is a schematic structural component diagram of a multimedia remote play control apparatus according to an embodiment of the present invention;
as shown in fig. 4, a multimedia remote play control apparatus includes:
the first generation module 41: the remote play control system is used for receiving user operation on a user sending program of a remote user control end to generate a user remote play control request instruction;
first encapsulation module 42: the remote play control request instruction is used for packaging the user remote play control request instruction based on a flatBuffers network transmission protocol and is sent to a receiving end program built in a remote play end;
the feedback module 43: after receiving the packaged user remote play control request instruction, a receiving end program arranged in the remote play end analyzes, identifies and processes the packaged user remote play control request instruction, and sends request feedback information to the remote user control end according to a first analysis, identification and processing result;
the second generation module 44: the remote user control end is used for receiving the request feedback information and then receiving user operation on the basis of the request feedback information on a user sending program of the remote user control end to generate a user remote playing control instruction after receiving the request feedback information;
second package module 45: the remote playing control instruction is used for encapsulating the user remote playing control instruction based on a flatBuffers network transmission protocol and sending the encapsulated user remote playing control instruction to a receiving end program built in a remote playing end to control the remote playing end;
the control module 46: the remote playing terminal is used for analyzing and identifying the packaged user remote playing control command after receiving the packaged user remote playing control command, performing response control processing according to a second analysis and identification result, and feeding back the response control processing result to the remote user control terminal, wherein the remote user control terminal is in communication connection with the remote playing terminal.
In the specific implementation process of the present invention, detailed embodiments of the apparatus part may refer to the specific implementation of the method part, and are not described herein again.
EXAMPLE five
Referring to fig. 5, fig. 5 is a schematic structural composition diagram of a multimedia remote play control system according to an embodiment of the present invention.
As shown in fig. 5, a multimedia remote playing control system includes a remote user control end and a remote playing end, wherein the remote user control end is connected to the remote playing end based on a local area network or the internet, and the system is configured to execute the multimedia remote playing control method according to any one of the above items.
In the specific implementation process of the present invention, the detailed implementation of the system part may refer to the detailed implementation of the method part, and will not be described herein again.
In the embodiment of the invention, the problems of non-real-time, local area network limitation and playlist management are solved. The user can perform material management and play control management on the multimedia material on the remote play end in a non-real-time manner under the condition of a local area network or a public network through the mobile equipment; the cost for producing the remote controller hardware is saved, the original application scene is widened, and the method can be applied to the common display fields of meetings, education, advertisements, markets and the like; the remote real-time playing control of the multimedia of the remote playing end is realized, the control response speed is high, and the user experience is good.
Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by associated hardware instructed by a program, which may be stored in a computer-readable storage medium, and the storage medium may include: a Read Only Memory (ROM), a Random Access Memory (RAM), a magnetic or optical disk, or the like.
In addition, the foregoing describes in detail a multimedia remote play control method, apparatus and system provided in the embodiments of the present invention, and a specific example should be adopted herein to explain the principle and implementation manner of the present invention, and the description of the foregoing embodiments is only used to help understanding the method and core ideas of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.
Claims (10)
1. A multimedia remote play control method is applied to a user side, and is characterized by comprising the following steps:
receiving a user operation and generating a user remote playing control request instruction on a user sending program of a remote user control end;
packaging the user remote playing control request instruction based on a flatBuffers network transmission protocol, and sending the user remote playing control request instruction to a receiving end program built in a remote playing end;
receiving request feedback information of the receiving end program based on the user remote play control request instruction;
receiving user operation on the basis of the request feedback information on a user sending program of the remote user control end to generate a user remote playing control instruction;
and packaging the user remote playing control instruction based on a flatBuffers network transmission protocol, sending the user remote playing control instruction to a receiving end program built in a remote playing end to control the remote playing end, and keeping the remote user control end in communication connection with the remote playing end.
2. The multimedia remote play control method according to claim 1, applied to a user side, wherein the user remote play control request command includes a combination of one or more request commands not limited to a play control request command, a multimedia material upload/delete request command, and a playlist management request command;
the user remote playing control instruction comprises a combination of one or more instructions of a playing control instruction, a multimedia material uploading/deleting instruction and a playlist management instruction; the multimedia material uploading instruction comprises multimedia material data.
3. The multimedia remote play control method according to claim 2, applied to a user side, wherein the sending to a receiving end program built in a remote play end comprises:
determining that the connection mode of the remote user control end and the remote playing end is a local area network connection mode or an internet connection mode;
when the connection mode of the remote user control end and the remote playing end is a local area network connection mode, the remote user control end sends a packaged user remote playing control request instruction to a receiving end program built in the remote playing end based on a local area network gateway;
when the connection mode of the remote user control end and the remote playing end is an internet connection mode, the remote user control end sends the packaged user remote playing control request instruction to a centralized control server, and the centralized control server forwards the packaged user remote playing control request instruction to a centralized control server client program of the remote playing end and forwards the packaged user remote playing control request instruction to the receiving end program based on the centralized control server client program.
4. The multimedia remote play control method according to claim 2, applied to a user side, wherein the play list management command is a command including one or more of creating a play list, deleting a play list, querying a play list, modifying a name of a play list, adding a material to a play list, deleting a material from a play list, adjusting a sequence of materials, setting a timed play, and setting a play interval time;
the playing control instruction comprises one or more of playing, pausing, stopping, switching and adjusting the sequence.
5. A multimedia remote play control method is applied to a remote play side, and is characterized by comprising the following steps:
after receiving the packaged user remote playing control request instruction, a receiving end program built in the remote playing end analyzes, identifies and processes the packaged user remote playing control request instruction, and sends request feedback information to the remote user control end according to a first analysis, identification and processing result;
receiving a packaged user remote play control instruction sent by the remote user control terminal based on the request feedback information;
and analyzing and identifying the packaged user remote playing control instruction, responding and controlling according to a second analysis and identification result, and feeding back a response control processing result to the remote user control end, wherein the remote user control end is in communication connection with the remote playing end.
6. The multimedia remote play control method according to claim 5, applied to a remote play side, wherein the performing response control processing according to the second parsing identification result comprises:
when the user remote playing control instruction is obtained according to the second analysis result and is a playing control instruction, playing, pausing, stopping, switching or sequential adjustment control operation is carried out on multimedia materials in an appointed file in a remote playing end based on the playing control instruction, the control operation result is displayed through a large screen of the remote playing end, and the control operation result is fed back to the remote user control end;
when the user remote playing control instruction is obtained as a multimedia material uploading/deleting instruction according to the second analysis result, uploading multimedia material data contained in the multimedia material uploading instruction to a specified path folder or deleting corresponding multimedia material data in a specified folder path according to the multimedia material deleting instruction, and feeding back the multimedia material data to the remote user control end;
and when the user remote playing control instruction is obtained as a playlist management instruction according to the second analysis result, analyzing the playlist management instruction, performing operation processing on the playlist of the remote playing terminal based on the analysis result, and feeding back the playlist to the remote user control terminal.
7. The media remote play control method according to claim 6, applied to a remote play side, wherein the performing operation processing on the play list of the remote play side based on the analysis result includes:
and operating the database of the remote playing end based on the analysis result, and performing operation processing on the playlist of the remote playing end, such as creating, deleting, name modifying, material adding, material deleting, material sequence adjusting, timed playing setting or playing interval time setting.
8. A multimedia remote play control method is characterized by comprising the following steps:
receiving a user operation and generating a user remote playing control request instruction on a user sending program of a remote user control end;
packaging the user remote playing control request instruction based on a flatBuffers network transmission protocol, and sending the user remote playing control request instruction to a receiving end program built in a remote playing end;
after receiving the packaged user remote play control request instruction, a receiving end program built in the remote play end analyzes, identifies and processes the packaged user remote play control request instruction, and sends request feedback information to the remote user control end according to a first analysis, identification and processing result;
after the remote user control end receives the request feedback information, a user remote playing control instruction is generated on a user sending program of the remote user control end based on the request feedback information receiving user operation;
packaging the user remote playing control instruction based on a flatBuffers network transmission protocol, and sending the user remote playing control instruction to a receiving end program built in a remote playing end to control the remote playing end;
after the remote playing end receives the packaged user remote playing control instruction, analyzing and identifying the packaged user remote playing control instruction, performing response control processing according to a second analysis and identification result, and feeding back the response control processing result to the remote user control end, wherein the remote user control end is in communication connection with the remote playing end.
9. A multimedia remote play control apparatus, the apparatus comprising:
a first generation module: the remote play control system is used for receiving user operation on a user sending program of a remote user control end to generate a user remote play control request instruction;
a first encapsulation module: the remote play control request instruction is used for packaging the user remote play control request instruction based on a flatBuffers network transmission protocol and is sent to a receiving end program built in a remote play end;
a feedback module: after receiving the packaged user remote play control request instruction, a receiving end program arranged in the remote play end analyzes, identifies and processes the packaged user remote play control request instruction, and sends request feedback information to the remote user control end according to a first analysis, identification and processing result;
a second generation module: the remote user control end is used for receiving the request feedback information and then receiving user operation on the basis of the request feedback information on a user sending program of the remote user control end to generate a user remote playing control instruction after receiving the request feedback information;
a second package module: the remote playing control instruction is used for encapsulating the user remote playing control instruction based on a flatBuffers network transmission protocol and sending the encapsulated user remote playing control instruction to a receiving end program built in a remote playing end to control the remote playing end;
a control module: the remote playing terminal is used for analyzing and identifying the packaged user remote playing control command after receiving the packaged user remote playing control command, performing response control processing according to a second analysis and identification result, and feeding back the response control processing result to the remote user control terminal, wherein the remote user control terminal is in communication connection with the remote playing terminal.
10. A multimedia remote play control system, characterized in that the system comprises a remote user control terminal and a remote play terminal, wherein the remote user control terminal is connected with the remote play terminal based on a local area network or the internet, and the system is configured to execute the multimedia remote play control method according to any one of claims 1-8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210254676.8A CN114666628B (en) | 2022-03-11 | 2022-03-11 | Multimedia remote play control method, device and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210254676.8A CN114666628B (en) | 2022-03-11 | 2022-03-11 | Multimedia remote play control method, device and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114666628A true CN114666628A (en) | 2022-06-24 |
| CN114666628B CN114666628B (en) | 2024-03-12 |
Family
ID=82028680
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210254676.8A Active CN114666628B (en) | 2022-03-11 | 2022-03-11 | Multimedia remote play control method, device and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114666628B (en) |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101710474A (en) * | 2009-11-19 | 2010-05-19 | 刘梦妍 | Remote control electronic display screen |
| CN104093049A (en) * | 2013-10-12 | 2014-10-08 | 腾讯科技（深圳）有限公司 | Multimedia playing control method and system |
| US20140372565A1 (en) * | 2013-06-14 | 2014-12-18 | Microsoft Corporation | Directing a Playback Device to Play a Media Item Selected by a Controller from a Media Server |
| CN105323628A (en) * | 2014-07-30 | 2016-02-10 | 腾讯科技（深圳）有限公司 | DLNA multi-screen playback method and system, browser-side device and playback device |
| US20160134942A1 (en) * | 2014-11-10 | 2016-05-12 | Ali Corporation | Multimedia playing system, multimedia file sharing method and control method thereof |
| CN106411649A (en) * | 2016-10-18 | 2017-02-15 | 广州视睿电子科技有限公司 | Control method and device for remote play system |
| CN107508849A (en) * | 2016-08-10 | 2017-12-22 | 广东小天才科技有限公司 | Long-range control method and system, the mobile terminal of a kind of mobile terminal |
| CN108810124A (en) * | 2018-06-02 | 2018-11-13 | 上海清鹤科技股份有限公司 | The remote access control system of a large amount of multimedia terminals under a kind of environment to public network |
| CN113867660A (en) * | 2021-08-24 | 2021-12-31 | 深圳市宝泽科技有限公司 | Method and system for multi-device cooperative remote synchronous annotation |
| CN113867667A (en) * | 2021-09-18 | 2021-12-31 | 深圳市宝泽科技有限公司 | Method and system for multi-device cooperative remote synchronous erasing |
| CN113938714A (en) * | 2020-06-29 | 2022-01-14 | 阿里巴巴集团控股有限公司 | Play control method and device, electronic equipment and storage medium |
-
2022
- 2022-03-11 CN CN202210254676.8A patent/CN114666628B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101710474A (en) * | 2009-11-19 | 2010-05-19 | 刘梦妍 | Remote control electronic display screen |
| US20140372565A1 (en) * | 2013-06-14 | 2014-12-18 | Microsoft Corporation | Directing a Playback Device to Play a Media Item Selected by a Controller from a Media Server |
| CN104093049A (en) * | 2013-10-12 | 2014-10-08 | 腾讯科技（深圳）有限公司 | Multimedia playing control method and system |
| CN105323628A (en) * | 2014-07-30 | 2016-02-10 | 腾讯科技（深圳）有限公司 | DLNA multi-screen playback method and system, browser-side device and playback device |
| US20160134942A1 (en) * | 2014-11-10 | 2016-05-12 | Ali Corporation | Multimedia playing system, multimedia file sharing method and control method thereof |
| CN107508849A (en) * | 2016-08-10 | 2017-12-22 | 广东小天才科技有限公司 | Long-range control method and system, the mobile terminal of a kind of mobile terminal |
| CN106411649A (en) * | 2016-10-18 | 2017-02-15 | 广州视睿电子科技有限公司 | Control method and device for remote play system |
| CN108810124A (en) * | 2018-06-02 | 2018-11-13 | 上海清鹤科技股份有限公司 | The remote access control system of a large amount of multimedia terminals under a kind of environment to public network |
| CN113938714A (en) * | 2020-06-29 | 2022-01-14 | 阿里巴巴集团控股有限公司 | Play control method and device, electronic equipment and storage medium |
| CN113867660A (en) * | 2021-08-24 | 2021-12-31 | 深圳市宝泽科技有限公司 | Method and system for multi-device cooperative remote synchronous annotation |
| CN113867667A (en) * | 2021-09-18 | 2021-12-31 | 深圳市宝泽科技有限公司 | Method and system for multi-device cooperative remote synchronous erasing |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114666628B (en) | 2024-03-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8510441B2 (en) | Transmission apparatus, transmission method, content delivery system, content delivery method, and program | |
| CN102571979B (en) | Multi-screen interactive equipment and its binding method | |
| US20030140343A1 (en) | Remote wireless device with EPG display, intercom and emulated control buttons | |
| US8655404B1 (en) | Systems and methods for distributing content with a portable electronic device | |
| CN102790921B (en) | Method and device for choosing and recording partial screen area of multi-screen business | |
| US20030097408A1 (en) | Communication method for message information based on network | |
| CN100589552C (en) | System and method for transmitting multimedia message in network television system | |
| US20060195545A1 (en) | Information processing apparatus and content information processing method | |
| EP2804357A1 (en) | Method, apparatus and system for processing and controlling media play | |
| CN104602098A (en) | Video barrage display method and equipment thereof | |
| CN113099258A (en) | Cloud director system, live broadcast processing method and device, and computer readable storage medium | |
| CN104247438B (en) | Distributing device and dissemination method | |
| CN111866603B (en) | Video file production method based on SRS, background server and system | |
| CN103501329A (en) | Intelligent electronic photo frame system | |
| WO2017028655A1 (en) | Screenshot capturing method, terminal and set-top box | |
| CN106998490A (en) | A kind of multi-medium data synchronous method and device | |
| US20060269220A1 (en) | Reproducing system, reproducing apparatus, receiving and reproducing apparatus, and reproducing method | |
| CN107534793A (en) | Reception device, transmitting device and data processing method | |
| CN111182342A (en) | Media data playing method, device, equipment and storage medium based on DLNA | |
| CN104618738A (en) | Method and device for playing programs of intelligent TV | |
| CN105955111A (en) | Equipment control method, equipment control device and equipment control system | |
| EP2560343A1 (en) | Method, apparatus and system for displaying picture | |
| WO2024104423A1 (en) | Image processing method and apparatus, electronic device, and storage medium | |
| CN101106497B (en) | Display service method, network device, and storage medium | |
| CN104469414A (en) | Information system, information put-in method and IPTV system based on multi-screen interaction |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |