CN112333492B - Video return control method and device, intelligent large-screen equipment and storage medium - Google Patents
Video return control method and device, intelligent large-screen equipment and storage medium Download PDFInfo
- Publication number
- CN112333492B CN112333492B CN202011029197.3A CN202011029197A CN112333492B CN 112333492 B CN112333492 B CN 112333492B CN 202011029197 A CN202011029197 A CN 202011029197A CN 112333492 B CN112333492 B CN 112333492B
- Authority
- CN
- China
- Prior art keywords
- mobile terminal
- return
- communication channel
- instruction
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 53
- 238000004891 communication Methods 0.000 claims abstract description 132
- 230000005540 biological transmission Effects 0.000 claims description 46
- 238000012544 monitoring process Methods 0.000 claims description 7
- 230000000977 initiatory effect Effects 0.000 claims 1
- 230000008569 process Effects 0.000 abstract description 9
- 230000007547 defect Effects 0.000 abstract description 4
- 238000005516 engineering process Methods 0.000 abstract description 3
- 230000006870 function Effects 0.000 description 10
- 238000010586 diagram Methods 0.000 description 7
- 230000003993 interaction Effects 0.000 description 5
- 238000012545 processing Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 230000004044 response Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000000779 smoke Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4131—Peripherals receiving signals from specially adapted client devices home appliance, e.g. lighting, air conditioning system, metering devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
- H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
- H04N21/4222—Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/43615—Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/488—Data services, e.g. news ticker
- H04N21/4882—Data services, e.g. news ticker for displaying messages, e.g. warnings, reminders
Abstract
The invention discloses a video backhaul control method, a device, an intelligent large screen device and a storage medium. Compared with the existing video feedback technology, the method and the system have the advantages that when the large-screen intelligent equipment and the mobile terminal carry out video feedback, the system resources are coordinated by selecting the proper communication channel, the defect that problems occur due to uncoordinated system resources is overcome, and therefore the probability of faults in the video feedback process is reduced.
Description
Technical Field
The invention relates to the technical field of intelligent large screens, in particular to a video return control method and device, intelligent large screen equipment and a storage medium.
Background
In the age of large screen intelligent interaction, large screens are not limited to televisions only, and development of large screens has wider imagination space. Users expect to see the figure of the intelligent large screen, such as the refrigerator large screen, the smoke machine large screen, and the like, on any intelligent home. The intelligent large screen has more and more wide functions and has functions of entertainment and service. In this time of live broadcasting of the whole population, live programs are becoming more popular, and users expect to watch live programs, such as live programs of a ball game, a concert, and the like, on an intelligent large screen.
At present, the functions are mainly realized through interaction between the large-screen intelligent equipment and the mobile terminal, but various problems caused by the fact that the recording resource coordination recording service is difficult to control between the large-screen intelligent equipment and the mobile terminal are prone to faults when video is transmitted back.
The foregoing is provided merely for the purpose of facilitating understanding of the technical solutions of the present invention and is not intended to represent an admission that the foregoing is prior art.
Disclosure of Invention
The invention mainly aims to provide a video feedback control method, a device, intelligent large-screen equipment and a storage medium, and aims to solve the technical problem that in the prior art, live programs are easy to fail when watched on an intelligent large-screen system through video feedback.
In order to achieve the above objective, the present invention provides a video backhaul control method, which includes the following steps:
when a return start instruction is received, generating return information according to the return start instruction, and selecting a target communication channel from a communication channel set according to the return start instruction, wherein the communication channel set comprises communication channels respectively established with all mobile terminals;
determining a target mobile terminal according to the target communication channel;
And sending the feedback information to the target mobile terminal so that the target mobile terminal starts video feedback based on the feedback information.
In addition, in order to achieve the above object, the present invention provides a video backhaul control device, including:
The communication channel set comprises communication channels respectively established with each mobile terminal;
The feedback information module is used for generating feedback information according to the feedback start instruction and determining a target mobile terminal according to the target communication channel;
and the video feedback module is used for sending the feedback information to the target mobile terminal so that the target mobile terminal starts video feedback based on the feedback information.
In addition, in order to achieve the above object, the present invention provides an intelligent large screen apparatus, comprising: the video backhaul control method comprises the steps of a memory, a processor and a video backhaul control program stored on the memory and capable of running on the processor, wherein the video backhaul control program realizes the video backhaul control method when being executed by the processor.
In addition, in order to achieve the above object, the present invention provides a computer readable storage medium, on which a video backhaul control program is stored, which when executed by a processor, implements the steps of the video backhaul control method as above.
According to the video backhaul control method provided by the invention, communication channels are respectively established with each mobile terminal through the large-screen intelligent equipment, and are combined into the communication channel set, and when a backhaul starting instruction is received, a target communication channel is selected from the communication channel set so as to determine the target mobile terminal. Compared with the existing video feedback technology, the method and the system have the advantages that when the large-screen intelligent equipment and the mobile terminal carry out video feedback, the system resources are coordinated by selecting the proper communication channel, the defect that problems occur due to uncoordinated system resources is overcome, and therefore the probability of faults in the video feedback process is reduced.
Drawings
FIG. 1 is a schematic diagram of an intelligent large screen device in a hardware operating environment according to an embodiment of the present invention;
FIG. 2 is a flowchart of a video backhaul control method according to a first embodiment of the present invention;
FIG. 3 is a flowchart illustrating a video backhaul control method according to a second embodiment of the present invention;
FIG. 4 is a schematic diagram illustrating interaction between a mobile terminal and an intelligent large screen device according to an embodiment of the video backhaul control method of the present invention;
FIG. 5 is a schematic diagram illustrating an embodiment of a video backhaul control method according to the present invention;
fig. 6 is a schematic functional block diagram of a video backhaul control device according to a first embodiment of the present invention.
The achievement of the objects, functional features and advantages of the present invention will be further described with reference to the accompanying drawings, in conjunction with the embodiments.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
Referring to fig. 1, fig. 1 is a schematic structural diagram of an intelligent large screen device of a hardware running environment according to an embodiment of the present invention.
As shown in fig. 1, the intelligent large screen device may include: a processor 1001, such as a central processing unit (Central Processing Unit, CPU), a communication bus 1002, a user interface 1003, a network interface 1004, a memory 1005. Wherein the communication bus 1002 is used to enable connected communication between these components. The user interface 1003 may include a Display, an input unit such as keys, and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed random access memory (Random Access Memory, RAM) memory or a stable memory (non-volatile memory), such as a disk memory. The memory 1005 may also optionally be a storage device separate from the processor 1001 described above.
Those skilled in the art will appreciate that the device structure shown in fig. 1 is not limiting of the intelligent large screen device and may include more or fewer components than shown, or may combine certain components, or may be a different arrangement of components.
As shown in fig. 1, an operating system, a network communication module, a user interface module, and a video backhaul control program may be included in the memory 1005 as one type of storage medium.
In the intelligent large screen device shown in fig. 1, the network interface 1004 is mainly used for connecting to an external network and performing data communication with other network devices; the user interface 1003 is mainly used for connecting user equipment and communicating data with the user equipment; the apparatus of the present invention invokes the video backhaul control program stored in the memory 1005 through the processor 1001 and executes the video backhaul control method provided by the embodiment of the present invention.
Based on the hardware structure, the embodiment of the video backhaul control method is provided.
Referring to fig. 2, fig. 2 is a flowchart of a first embodiment of a video backhaul control method according to the present invention.
In a first embodiment, the video backhaul control method includes the steps of:
step S10, when a return start instruction is received, the intelligent large screen device generates return information according to the return start instruction and selects a target communication channel from a communication channel set according to the return start instruction, wherein the communication channel set comprises communication channels respectively established with each mobile terminal.
It should be understood that the intelligent large screen apparatus is an apparatus having a large screen display system, wherein the large screen display system may include a large-sized display screen, and in this embodiment, a display screen of 10 inches or more may be referred to as a large-sized display screen, and other division manners may be used, which is not limited in this embodiment. For example, the intelligent large screen device may be a television, a projector, a refrigerator with a large screen display system, or other home appliances, on which a large-sized display screen may be configured for displaying images and videos, or other devices with large screen display systems, which is not limited in this embodiment. The mobile terminal may be a mobile phone, a tablet computer, a smart watch, or other devices, which is not limited in this embodiment, and in this embodiment, the mobile terminal is taken as an example of the mobile phone.
It should be understood that the communication channel set includes communication channels respectively established by the intelligent large screen device and each mobile terminal, and the communication channels may be Socket command channels. When a connection request sent by a mobile terminal is received, equipment information corresponding to the mobile terminal is determined according to the connection request, communication channels are respectively established with each mobile terminal according to the equipment information, whether communication handshake is completed between the large-screen system and the mobile phone system is verified, and when the communication handshake is completed, a communication channel set is generated according to the communication channels.
Upon receipt of the return start instruction, a determination may be made as to from which communication channel the return start instruction was received, thereby selecting a target communication channel from the set of communication channels. For example, the receiving port number of the return start instruction may be detected, and the communication channel from which the return start instruction is received may be determined according to the receiving port number, which is not limited in this embodiment.
In this embodiment, the intelligent large screen device includes two modules, that is, recordService function cores and Control, and RecordService is a power-on self-starting background service program of the intelligent large screen device. The Control module directly communicates and interacts with the mobile phone client, and calls RecordService other functional modules to provide services for the mobile phone client in response to the command request. The core of the Control is a SocketServer server which monitors the connection request of the mobile phone terminal at any time, after receiving the request, the Control establishes a SocketClient for the mobile phone terminal to maintain the current command channel, and the Control can simultaneously accept the connection requests of a plurality of devices and establish an independent Socket command channel for each device. After receiving the command of the mobile phone client, the Control requests RTSP SEVER or WebServer, which coordinate system resources and provide specific services for the mobile phone client.
It should be understood that the mobile phone system of the mobile phone may include a mobile phone client monitoring end module, where the mobile phone system and the large screen device system start a normal working mode and are connected to a wireless network, where the mobile phone system and the large screen device system may be connected to the same wireless network, or may be connected to different wireless networks, respectively, and the embodiment is not limited thereto.
The mobile phone system starts a mobile phone client monitoring module, the mobile phone system detects a command of recording a screen, which is sent by touch time, then generates a return start command, determines a port address of a communication channel connected with the intelligent large screen device, and sends the return start command to the intelligent large screen device through the communication channel according to the port address.
And step S20, the intelligent large screen equipment determines a target mobile terminal according to the target communication channel.
It should be understood that when the intelligent large screen device receives the feedback start instruction, the intelligent large screen device may start the feedback service according to the feedback start instruction, detect the start result, and generate feedback information according to the start result. For example, when the start-up is successful, start-up success information is generated; and when the starting fails, generating starting failure information, and taking the starting success information as return information.
Further, before receiving the return start instruction, the method further includes:
when receiving a plurality of connection requests sent by a plurality of mobile terminals, establishing communication channels with the plurality of mobile terminals respectively according to the plurality of connection requests, wherein the plurality of connection requests are in one-to-one correspondence with the plurality of mobile terminals, generating a communication channel set according to the plurality of communication channels, and the plurality of communication channels are in one-to-one correspondence with the plurality of mobile terminals.
It can be understood that, because the communication channels respectively established with each mobile terminal are included in the communication channel set, the mobile terminals and the communication channels can be in a one-to-one correspondence, and thus, after determining the target communication channel, the target mobile terminal corresponding to the target communication channel can be searched.
Further, selecting a target communication channel from the communication channel set according to the return start instruction, including:
and determining transmission information according to the return starting instruction, and selecting a target communication channel from the communication channel set according to the transmission information.
It should be understood that each communication channel has its corresponding mobile terminal, and the transmission information may be determined according to the backhaul start instruction, and 1 is determined from which communication channel it is transmitted according to the transmission information, so that the communication channel on which transmission is performed is regarded as the target communication channel. After the target communication channel is determined, a target mobile terminal corresponding to the target communication channel can be searched. For example, there are 3 mobile terminals that send connection requests to the intelligent large screen device, and these 3 mobile terminals are respectively: the intelligent large screen device establishes a first communication channel with the mobile terminal A, a second communication channel with the mobile terminal B and a third communication channel with the mobile terminal C according to the connection request. When the target communication channel is the first communication channel, the corresponding target mobile terminal is the mobile terminal A. Similarly, when the target communication channel is the third communication channel, the corresponding target mobile terminal is the mobile terminal C.
In step S30, the intelligent large screen device sends the feedback information to the target mobile terminal, so that the target mobile terminal starts video feedback according to the feedback information.
It should be appreciated that the intelligent large screen device may send the backhaul information to the target mobile terminal, receive the backhaul information by the target mobile terminal, and begin video backhaul based on the backhaul information.
In this embodiment, communication channels are respectively established with each mobile terminal through the large-screen intelligent device, and are combined into a communication channel set, and when a return start instruction is received, a target communication channel is selected from the communication channel set, so that a target mobile terminal is determined. Compared with the prior art, the embodiment coordinates system resources by selecting a proper communication channel when the large-screen intelligent device and the mobile terminal carry out video backhaul, overcomes the defect that problems occur due to uncoordinated system resources, and reduces the probability of faults in the video backhaul process.
Further, generating backhaul information according to the backhaul start instruction includes:
The intelligent large screen device starts the return service according to the return start instruction and detects the starting result of the return service.
It should be understood that the large screen system starts the background service, receives the request information sent by the mobile phone, establishes a Socket channel, and feeds back the available feedback start command of the mobile phone system. The large screen system monitors a return start instruction sent by the mobile phone system, requests a command for starting a return frame to the recording service function module according to the return start instruction, the large screen system records the coordination resource of the function service module, tries to start the return service, returns a result to the control service layer, and the control service layer returns whether the service is available to the mobile phone client. Therefore, the return service can be started according to the return start instruction, and the starting result is detected.
And the intelligent large screen device generates feedback information according to the starting result.
It can be understood that after the starting result is detected, whether the backhaul service is started successfully can be judged according to the starting result, and backhaul information is generated when the backhaul service is started successfully.
Further, in order to better generate the feedback information, so as to improve the generation effect of the feedback information, generating the feedback information according to the starting result includes:
And when the return service is successfully started, the intelligent large-screen equipment searches an access link corresponding to the RTSP server, and generates return information according to the access link.
It should be understood that when the feedback service is started successfully, it is indicated that the large screen system meets the condition of video feedback at this time, and the video feedback can be performed between the large screen system and the mobile phone terminal, so as to achieve the effect of playing the television program on the large screen system. Therefore, the access link corresponding to the RTSP server can be searched, and the feedback information can be generated according to the access link. The preset real-time streaming protocol RTSP server may be a server for transmitting video data between the large-screen system and the mobile phone end, the access link may be URL (Uniform Resource Locator ), or may be another link, which is not limited in this embodiment.
In this embodiment, when a command to start returning frames is requested to the recording service function module according to the returning start command, the returning service is tried to be started, the starting result is detected, and returning information is generated according to the starting result. Compared with the prior art, in the embodiment, the intelligent large screen device starts the backhaul service according to the backhaul start instruction, generates backhaul information according to the starting result, and performs video backhaul according to the backhaul information and the mobile terminal, so that the failure rate of data transmission in the video backhaul process is reduced, and the video backhaul effect is improved.
In an embodiment, as shown in fig. 3, a second embodiment of the video backhaul control method according to the present invention is provided based on the first embodiment, and after step S30, the method further includes:
and step S40, the intelligent large screen equipment receives a transmission request sent by the target mobile terminal according to the access link extracted from the feedback information, and generates a data transmission instruction according to the transmission request.
It should be understood that the intelligent large screen device sends the feedback information to the target mobile terminal, and the target mobile terminal extracts the access link from the feedback information after receiving the feedback information, and sends the transmission request according to the access link. In a specific implementation, for example, the mobile phone client may send an RTSP request according to the access link, and start the backhaul mode to perform data transmission.
It can be understood that the intelligent large screen device receives the transmission request sent by the target mobile terminal, can check the transmission request, and generates a data transmission instruction according to the transmission request when the check passes, so that the safety and the stability of data transmission are further ensured.
And step S50, the intelligent large screen equipment sends the data transmission instruction to the target mobile terminal so that the target mobile terminal starts video feedback according to the data transmission instruction.
It should be appreciated that the intelligent large screen device may send a data transmission instruction to the target mobile terminal, and the target mobile terminal starts video backhaul according to the data transmission instruction, so as to achieve the purpose of playing the television program on the intelligent large screen device.
Further, after step S30, the method further includes:
The intelligent large screen equipment receives video data returned by the target mobile terminal and takes the video data as resources to be processed; when a return stop instruction sent by a target mobile terminal is received, the intelligent large screen device stops the return service according to the return stop instruction, and stores the resources to be processed in a preset database; and when receiving an exit instruction sent by the target mobile terminal, the intelligent large screen device closes the target communication channel according to the exit instruction and displays preset prompt information.
It should be understood that after the mobile phone receives all the commands, the mobile phone can send a return stop instruction to the intelligent large screen device, and the intelligent large screen device stops the return service according to the return stop instruction and stores the resources to be processed in the preset database. The preset database is a database of the intelligent large-screen device, which is not limited in this embodiment.
It can be understood that the intelligent large screen device further comprises a large screen system return state display module, the mobile phone end can also send an exit instruction when stopping using the video return function, and the intelligent large screen device can close the target communication channel according to the exit instruction when receiving the exit instruction and display preset prompt information to remind a user of completing the return function. The preset prompting information may be a prompting information set in advance, for example, "the return is completed", or may be other prompting information, which is not limited in this embodiment.
In a specific implementation, as shown in fig. 4 and fig. 5, fig. 4 is an interaction schematic diagram of a mobile terminal and an intelligent large screen device, fig. 5 is an interaction schematic diagram, recordService is a power-on self-start, and after Control completes initialization, monitoring commands is started. When the mobile phone return program is started, a connection request is sent to the large screen end. After the Control successfully receives the request, an independent Socket command channel is established for the client. The mobile phone end sends a command to start returning, after the Control receives the command, the Control calls RecordService a lower layer service module to complete a series of resource initialization work, after the processing is finished, the Control execution result is returned to the mobile phone end, and the Control execution result is returned to the mobile phone end. The mobile phone end sends a command to start returning, after the Control receives the command, the Control calls RecordService a lower layer service module to complete a series of resource initialization work, after the processing is finished, the Control execution result is returned to the mobile phone end, and the Control execution result is returned to the mobile phone end. After the Control receives the feedback stop command sent by the mobile phone end, the Control informs RecordService the lower module to stop service and recovers the corresponding resources of the system. When the program of the mobile phone terminal exits, the Control receives the offline notification and closes the Socket channel.
In the embodiment, when the target mobile terminal receives the feedback information, the access link can be extracted from the feedback information, the transmission request is sent based on the access link, the intelligent large screen device checks the transmission request when receiving the transmission request, generates a data transmission instruction when the check passes, and sends the data transmission instruction to the target mobile terminal, and the target mobile terminal starts video feedback based on the data transmission instruction, so that data transmission between the mobile terminal and the intelligent large screen system is more stable, and the situation of faults when video feedback is carried out is avoided.
In addition, the embodiment of the invention also provides a storage medium, wherein the storage medium is stored with a video backhaul control program, and the video backhaul control program realizes the steps of the video backhaul control method when being executed by a processor.
Because the storage medium adopts all the technical schemes of all the embodiments, the storage medium has at least all the beneficial effects brought by the technical schemes of the embodiments, and the description is omitted here.
In addition, referring to fig. 6, an embodiment of the present invention provides a video backhaul control device, where the video backhaul control device includes:
The backhaul start module 10 is configured to generate backhaul information according to a backhaul start instruction and select a target communication channel from a communication channel set according to the backhaul start instruction when a backhaul start instruction is received, where the communication channel set includes communication channels respectively established with each mobile terminal.
It should be understood that an intelligent large screen device is a device having a large screen display system. For example, various home appliances such as a television, a projector, and a refrigerator equipped with a large-screen display system may be other devices having a large-screen display system, and the present embodiment is not limited thereto. The mobile terminal may be a mobile phone, a tablet computer, a smart watch, or other devices, which is not limited in this embodiment, and in this embodiment, the mobile terminal is taken as an example of the mobile phone.
It should be understood that the communication channel set includes communication channels respectively established by the intelligent large screen device and each mobile terminal, and the communication channels may be Socket command channels. When a connection request sent by a mobile terminal is received, equipment information corresponding to the mobile terminal is determined according to the connection request, communication channels are respectively established with each mobile terminal according to the equipment information, whether communication handshake is completed between the large-screen system and the mobile phone system is verified, and when the communication handshake is completed, a communication channel set is generated according to the communication channels.
Upon receipt of the return start instruction, a determination may be made as to from which communication channel the return start instruction was received, thereby selecting a target communication channel from the set of communication channels. For example, the receiving port number of the return start instruction may be detected, and the communication channel from which the return start instruction is received may be determined according to the receiving port number, which is not limited in this embodiment.
In this embodiment, the intelligent large screen device includes two modules, that is, recordService function cores and Control, and RecordService is a power-on self-starting background service program of the intelligent large screen device. The Control module directly communicates and interacts with the mobile phone client, and calls RecordService other functional modules to provide services for the mobile phone client in response to the command request. The core of the Control is a SocketServer server which monitors the connection request of the mobile phone terminal at any time, after receiving the request, the Control establishes a SocketClient for the mobile phone terminal to maintain the current command channel, and the Control can simultaneously accept the connection requests of a plurality of devices and establish an independent Socket command channel for each device. After receiving the command of the mobile phone client, the Control requests RTSP SEVER or WebServer, which coordinate system resources and provide specific services for the mobile phone client.
It should be understood that the mobile phone system of the mobile phone may include a mobile phone client monitoring end module, where the mobile phone system and the large screen device system start a normal working mode and are connected to a wireless network, where the mobile phone system and the large screen device system may be connected to the same wireless network, or may be connected to different wireless networks, respectively, and the embodiment is not limited thereto.
The mobile phone system starts a mobile phone client monitoring module, the mobile phone system detects a command of recording a screen, which is sent by touch time, then generates a return start command, determines a port address of a communication channel connected with the intelligent large screen device, and sends the return start command to the intelligent large screen device through the communication channel according to the port address.
And the backhaul information module 20 is configured to determine the target mobile terminal according to the target communication channel.
It should be understood that when the intelligent large screen device receives the feedback start instruction, the intelligent large screen device may start the feedback service according to the feedback start instruction, detect the start result, and generate feedback information according to the start result. For example, when the start-up is successful, start-up success information is generated; and when the starting fails, generating starting failure information, and taking the starting success information as return information.
It can be understood that, because the communication channels respectively established with each mobile terminal are included in the communication channel set, after determining the target communication channel, the target mobile terminal corresponding to the target communication channel can be searched.
The video backhaul module 30 is configured to send backhaul information to the target mobile terminal, so that the target mobile terminal starts video backhaul according to the backhaul information.
It should be appreciated that the intelligent large screen device may send the backhaul information to the target mobile terminal, receive the backhaul information by the target mobile terminal, and begin video backhaul based on the backhaul information.
In this embodiment, communication channels are respectively established with each mobile terminal through the large-screen intelligent device, and are combined into a communication channel set, and when a return start instruction is received, a target communication channel is selected from the communication channel set, so that the target mobile terminal is determined. Compared with the existing video backhaul technology, the embodiment coordinates system resources by selecting the proper communication channel when the large-screen intelligent device and the mobile terminal carry out video backhaul, overcomes the defect that problems occur due to uncoordinated system resources, and reduces the probability of faults in the video backhaul process.
In an embodiment, the video backhaul control device further includes a communication channel module, configured to, when receiving a plurality of connection requests sent by a plurality of mobile terminals, respectively establish a communication channel with each mobile terminal according to the plurality of connection requests, where the plurality of connection requests are in one-to-one correspondence with the plurality of mobile terminals; and generating a communication channel set according to the plurality of communication channels, wherein the plurality of communication channels are in one-to-one correspondence with the plurality of mobile terminals.
In one embodiment, the backhaul information module 20 is further configured to start a backhaul service according to the backhaul start instruction, and detect a start result of the backhaul service; and generating feedback information according to the starting result.
In an embodiment, the backhaul information module 20 is further configured to search an access link corresponding to the RTSP server according to the preset real-time streaming protocol when the startup result is that the backhaul service is started successfully, and generate backhaul information according to the access link.
In one embodiment, the backhaul start module 10 is further configured to determine transmission information according to a backhaul start instruction; and selecting a target communication channel from the communication channel set according to the transmission information.
In one embodiment, the video backhaul module 30 is further configured to; receiving a transmission request sent by a target mobile terminal according to an access link extracted from the feedback information, and generating a data transmission instruction according to the transmission request; and sending the data transmission instruction to the target mobile terminal so that the target mobile terminal starts video feedback according to the data transmission instruction.
In an embodiment, the video backhaul control device further includes a backhaul stopping module, configured to receive video data that is backhaul by the target mobile terminal, and use the video data as a resource to be processed; when a return stopping instruction sent by a target mobile terminal is received, stopping the return service according to the return stopping instruction, and storing the resources to be processed into a preset database; and when receiving an exit instruction sent by the target mobile terminal, closing the target communication channel according to the exit instruction, and displaying preset prompt information.
Other embodiments or specific implementation methods of the video backhaul control device of the present invention may refer to the above method embodiments, and are not described herein.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The foregoing embodiment numbers of the present invention are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in an estimator readable storage medium (e.g. ROM/RAM, magnetic disk, optical disk) as above, comprising instructions for causing a smart device (which may be a mobile phone, estimator, smart screen device, air conditioner, or network smart screen device, etc.) to perform the method of the embodiments of the present invention.
The foregoing description is only of the preferred embodiments of the present invention, and is not intended to limit the scope of the invention, but rather is intended to cover any equivalents of the structures or equivalent processes disclosed herein or in the alternative, which may be employed directly or indirectly in other related arts.
Claims (9)
1. The video backhaul control method is characterized by comprising the following steps:
The mobile phone system starts a mobile phone client monitoring module, generates a return starting instruction according to a command of a recording screen sent by the mobile phone system for detecting touch time, generates return information according to the return starting instruction when the return starting instruction is received, and selects a target communication channel from a communication channel set according to the return starting instruction, wherein the communication channel set comprises communication channels respectively established with each mobile terminal;
Determining a target mobile terminal according to the target communication channel;
Transmitting the feedback information to the target mobile terminal so that the target mobile terminal starts video feedback according to the feedback information;
The generating the return information according to the return start instruction and selecting the target communication channel from the communication channel set according to the return start instruction includes:
detecting the return starting instruction to obtain a receiving port number;
determining the selected target communication channel according to the port number;
after the feedback information is sent to the target mobile terminal, the method further comprises:
receiving a transmission request sent by the target mobile terminal according to the access link extracted from the feedback information, and generating a data transmission instruction according to the transmission request;
And generating a command channel based on the Control module according to the equipment connection request, and sending the data transmission instruction to the target mobile terminal so that the target mobile terminal starts video feedback according to the data transmission instruction.
2. The method of claim 1, wherein prior to receiving the return start instruction, the method further comprises:
When receiving a plurality of connection requests sent by a plurality of mobile terminals, establishing communication channels with the plurality of mobile terminals according to the plurality of connection requests, wherein the plurality of connection requests are in one-to-one correspondence with the plurality of mobile terminals;
And generating a communication channel set according to a plurality of communication channels, wherein the communication channels are in one-to-one correspondence with the mobile terminals.
3. The method of claim 2, wherein generating backhaul information based on the backhaul start instruction comprises:
starting a return service according to the return starting instruction, and detecting a starting result of the return service;
And generating feedback information according to the starting result.
4. The method of claim 3, wherein the generating the feedback information based on the initiation result comprises:
And when the starting result is that the feedback service is successfully started, searching an access link corresponding to a preset real-time streaming protocol (RTSP) server, and generating feedback information according to the access link.
5. The method according to any one of claims 1-4, wherein selecting a target communication channel from a set of communication channels according to the backhaul start instruction comprises:
Determining transmission information according to the return starting instruction;
and selecting a target communication channel from the communication channel set according to the transmission information.
6. The method according to any one of claims 1-4, wherein after the sending the backhaul information to the target mobile terminal, the method further comprises:
receiving video data returned by the target mobile terminal, and taking the video data as resources to be processed;
When a return stopping instruction sent by the target mobile terminal is received, stopping return service according to the return stopping instruction, and storing the resource to be processed into a preset database;
And closing the target communication channel according to the exit instruction when the exit instruction sent by the target mobile terminal is received, and displaying preset prompt information.
7. A video backhaul control device, comprising:
The mobile phone system is used for starting a mobile phone client monitoring module, generating a return starting instruction according to a command of a recording screen, which is sent by the mobile phone system for detecting touch time, generating return information according to the return starting instruction when the return starting instruction is received, and selecting a target communication channel from a communication channel set according to the return starting instruction, wherein the communication channel set comprises communication channels respectively established with each mobile terminal;
the feedback information module is used for determining a target mobile terminal according to the target communication channel;
The video feedback module is used for sending the feedback information to the target mobile terminal so that the target mobile terminal starts video feedback according to the feedback information;
The generating the return information according to the return start instruction and selecting the target communication channel from the communication channel set according to the return start instruction includes:
detecting the return starting instruction to obtain a receiving port number;
determining the selected target communication channel according to the port number;
After the feedback information is sent to the target mobile terminal, the method further comprises:
receiving a transmission request sent by the target mobile terminal according to the access link extracted from the feedback information, and generating a data transmission instruction according to the transmission request;
And generating a command channel based on the Control module according to the equipment connection request, and sending the data transmission instruction to the target mobile terminal so that the target mobile terminal starts video feedback according to the data transmission instruction.
8. An intelligent large screen device, characterized in that the intelligent large screen device comprises: a memory, a processor and a video backhaul control program stored on the memory and executable on the processor, the video backhaul control program when executed by the processor implementing the steps of the video backhaul control method of any one of claims 1 to 6.
9. A computer readable storage medium, wherein a video backhaul control program is stored on the computer readable storage medium, the video backhaul control program implementing the steps of the video backhaul control method according to any one of claims 1 to 6 when executed by a processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011029197.3A CN112333492B (en) | 2020-09-25 | 2020-09-25 | Video return control method and device, intelligent large-screen equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011029197.3A CN112333492B (en) | 2020-09-25 | 2020-09-25 | Video return control method and device, intelligent large-screen equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112333492A CN112333492A (en) | 2021-02-05 |
| CN112333492B true CN112333492B (en) | 2024-04-30 |
Family
ID=74304262
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011029197.3A Active CN112333492B (en) | 2020-09-25 | 2020-09-25 | Video return control method and device, intelligent large-screen equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112333492B (en) |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH0254646A (en) * | 1988-08-19 | 1990-02-23 | Hitachi Ltd | Multi-medium two-way broadcast system |
| CA2351831A1 (en) * | 2000-06-29 | 2001-12-29 | Touchtunes Music Corporation | Audiovisual information distribution system and process |
| CN102595239A (en) * | 2012-02-24 | 2012-07-18 | 深圳创维－Rgb电子有限公司 | Multi-screen interactive method, device and intelligent television for terminal system |
| CN103442304A (en) * | 2013-07-31 | 2013-12-11 | 康佳集团股份有限公司 | Smart television and mobile phone double-channel control method and system based on intelligent grouping and resource sharing protocol |
| CN103501453A (en) * | 2013-09-29 | 2014-01-08 | 中山大学 | Interaction system based on Android and Linux smart television |
| WO2015070796A1 (en) * | 2013-11-15 | 2015-05-21 | 乐视致新电子科技（天津）有限公司 | Method and device for pushing resources to mobile communication terminal by smart television |
| WO2015127598A1 (en) * | 2014-02-26 | 2015-09-03 | 华为技术有限公司 | Network device and data postback implementation system and method |
| CN105791351A (en) * | 2014-12-23 | 2016-07-20 | 深圳Tcl数字技术有限公司 | DLNA technology-based screen push implementation method and system |
| CN108513154A (en) * | 2018-04-16 | 2018-09-07 | 惠州Tcl家电集团有限公司 | Intelligent home furnishing control method, smart television based on smart television and storage medium |
| CN108958682A (en) * | 2018-06-11 | 2018-12-07 | 广州视源电子科技股份有限公司 | Matching method, device, equipment and the storage medium of wireless screen transmission device |
| CN109711117A (en) * | 2017-10-26 | 2019-05-03 | 美国科视数字系统有限公司 | For distributing the equipment, system and method for digital content |
| CN109982053A (en) * | 2019-04-02 | 2019-07-05 | 珠海全志科技股份有限公司 | Audio and video playing method, computer installation and computer readable storage medium |
-
2020
- 2020-09-25 CN CN202011029197.3A patent/CN112333492B/en active Active
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH0254646A (en) * | 1988-08-19 | 1990-02-23 | Hitachi Ltd | Multi-medium two-way broadcast system |
| CA2351831A1 (en) * | 2000-06-29 | 2001-12-29 | Touchtunes Music Corporation | Audiovisual information distribution system and process |
| CN102595239A (en) * | 2012-02-24 | 2012-07-18 | 深圳创维－Rgb电子有限公司 | Multi-screen interactive method, device and intelligent television for terminal system |
| CN103442304A (en) * | 2013-07-31 | 2013-12-11 | 康佳集团股份有限公司 | Smart television and mobile phone double-channel control method and system based on intelligent grouping and resource sharing protocol |
| CN103501453A (en) * | 2013-09-29 | 2014-01-08 | 中山大学 | Interaction system based on Android and Linux smart television |
| WO2015070796A1 (en) * | 2013-11-15 | 2015-05-21 | 乐视致新电子科技（天津）有限公司 | Method and device for pushing resources to mobile communication terminal by smart television |
| WO2015127598A1 (en) * | 2014-02-26 | 2015-09-03 | 华为技术有限公司 | Network device and data postback implementation system and method |
| CN105791351A (en) * | 2014-12-23 | 2016-07-20 | 深圳Tcl数字技术有限公司 | DLNA technology-based screen push implementation method and system |
| CN109711117A (en) * | 2017-10-26 | 2019-05-03 | 美国科视数字系统有限公司 | For distributing the equipment, system and method for digital content |
| CN108513154A (en) * | 2018-04-16 | 2018-09-07 | 惠州Tcl家电集团有限公司 | Intelligent home furnishing control method, smart television based on smart television and storage medium |
| CN108958682A (en) * | 2018-06-11 | 2018-12-07 | 广州视源电子科技股份有限公司 | Matching method, device, equipment and the storage medium of wireless screen transmission device |
| CN109982053A (en) * | 2019-04-02 | 2019-07-05 | 珠海全志科技股份有限公司 | Audio and video playing method, computer installation and computer readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112333492A (en) | 2021-02-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110602087B (en) | Intelligent screen projection method and device, intelligent terminal and server | |
| CN108513154A (en) | Intelligent home furnishing control method, smart television based on smart television and storage medium | |
| US20170300914A1 (en) | Method, client, server and computer storage medium for processing information | |
| CN111770355B (en) | Media server determination method, device, server and storage medium | |
| CN103067776A (en) | Program-pushing method and system, intelligent display device, cloud server | |
| WO2014183427A1 (en) | Method and apparatus for displaying webcast rooms | |
| CN108847976B (en) | Distribution network control method, mobile terminal, device and computer readable storage medium | |
| US20170279748A1 (en) | Information processing method and terminal, and computer storage medium | |
| KR20200037415A (en) | Information pushing method, storage medium, terminal device, and server | |
| CN113518247A (en) | Video playing method, related equipment and computer readable storage medium | |
| CN112057846B (en) | Interaction method, device, equipment and storage medium for cloud game service scheduling | |
| CN111427527A (en) | Screen projection method, device, equipment and computer readable storage medium | |
| CN113141531B (en) | Method and device for cross-device play control and play device | |
| US11778442B2 (en) | Screen projection method, receiving end device, and sending end device | |
| JP2017539103A (en) | Method, apparatus, server, and system for synchronizing member gain among multiple apparatuses | |
| WO2021042612A1 (en) | Wireless screen projection method and apparatus, device and storage medium | |
| CN113438527A (en) | Video screen projection method, device, equipment and storage medium | |
| CN113741762A (en) | Multimedia playing method, device, electronic equipment and storage medium | |
| US20160285949A1 (en) | Wireless login-based remote control method and device | |
| CN112684995B (en) | Cross-screen input method and device | |
| CN104301400A (en) | Multi-screen cooperation and resource sharing method on basis of Samba protocol | |
| CN112333492B (en) | Video return control method and device, intelligent large-screen equipment and storage medium | |
| CN105573180A (en) | Control method and system of terminal | |
| CN111048087A (en) | Shared voice interaction method, device, equipment and storage medium | |
| EP4002860A1 (en) | Method and device for processing public event by means of key distribution, and set top box |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant |