CN113141517A - First terminal, second terminal, remote operation control method, and readable storage medium - Google Patents

First terminal, second terminal, remote operation control method, and readable storage medium Download PDF

Info

Publication number
CN113141517A
CN113141517A CN202110380786.4A CN202110380786A CN113141517A CN 113141517 A CN113141517 A CN 113141517A CN 202110380786 A CN202110380786 A CN 202110380786A CN 113141517 A CN113141517 A CN 113141517A
Authority
CN
China
Prior art keywords
terminal
image
user
control signal
operation function
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110380786.4A
Other languages
Chinese (zh)
Other versions
CN113141517B (en
Inventor
蔡苗
宋蕾
杨道国
梁永湖
张华林
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guilin Xuyan Electromechanical Technology Co ltd
Guilin University of Electronic Technology
Original Assignee
Guilin Xuyan Electromechanical Technology Co ltd
Guilin University of Electronic Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guilin Xuyan Electromechanical Technology Co ltd, Guilin University of Electronic Technology filed Critical Guilin Xuyan Electromechanical Technology Co ltd
Priority to CN202110380786.4A priority Critical patent/CN113141517B/en
Publication of CN113141517A publication Critical patent/CN113141517A/en
Application granted granted Critical
Publication of CN113141517B publication Critical patent/CN113141517B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • H04N21/2187Live feed
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/637Control signals issued by the client directed to the server or network components
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02ATECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
    • Y02A40/00Adaptation technologies in agriculture, forestry, livestock or agroalimentary production
    • Y02A40/80Adaptation technologies in agriculture, forestry, livestock or agroalimentary production in fisheries management

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Selective Calling Equipment (AREA)
  • Telephonic Communication Services (AREA)

Abstract

The invention provides a first terminal, a second terminal, a remote operation control method and a readable storage medium. Wherein, the first terminal includes: the first communication device is in communication connection with the second terminal and is used for sending a control signal to the second terminal so as to enable the execution device of the second terminal to execute the operation function, enable the image acquisition device of the second terminal to acquire an image of the execution device executing the operation function and receive information of the image sent by the second terminal; and the display device is connected with the first communication device and is used for displaying images. According to the technical scheme provided by the invention, the real-time information interaction between the first terminal and the second terminal is realized through the communication connection between the first terminal and the second terminal, and the immersive interaction experience is provided for the user, so that the user can personally experience the participation interest, and the participation sense of the user is improved.

Description

First terminal, second terminal, remote operation control method, and readable storage medium
Technical Field
The invention relates to the technical field of remote control, in particular to a first terminal, a second terminal, a remote operation control method and a readable storage medium.
Background
The network live broadcast mode in the current market is a one-way audio and video live broadcast mode, namely, a server transmits live broadcast audio and video information to a client, a user can only perform online communication in a text mode, the live broadcast interaction mode is single, the possibility that the user can interact and the enjoyable participation sense cannot be met, the experience sense of the user is poor, and the user stickiness is reduced.
Disclosure of Invention
The present invention is directed to solving at least one of the problems of the prior art or the related art.
To this end, a first aspect of the invention provides a first terminal.
The second aspect of the present invention also provides a second terminal.
The third aspect of the present invention further provides a remote operation control method, which is applied to the first terminal.
The fourth aspect of the present invention further provides a remote operation control method, which is suitable for the second terminal.
The fifth aspect of the present invention also provides a readable storage medium.
In view of the above, a first aspect of the present invention provides a first terminal, including: the first communication device is in communication connection with the second terminal and is used for sending a control signal to the second terminal so as to enable the execution device of the second terminal to execute the operation function, enable the image acquisition device of the second terminal to acquire an image of the execution device executing the operation function and receive information of the image sent by the second terminal; and the display device is connected with the first communication device and is used for displaying images.
The first terminal comprises a first communication device and a display device, wherein the first communication device is in communication connection with the second terminal, and the display device is connected with the first communication device. And sending the control signal to the second terminal through the first communication device, so that the execution device of the second terminal executes corresponding operation according to the control signal, and simultaneously, the image acquisition device of the second terminal acquires the image of the operation function executed by the execution device. Further, after the first communication device receives the image information sent by the second terminal, the image is displayed through the display device. Through the communication connection of the first terminal and the second terminal, the real-time information interaction of the first terminal and the second terminal is realized, so that a user can watch a real-time picture of the second terminal from the first terminal and control the second terminal to execute an operation function, the user is provided with an immersive interaction experience, the user can experience the participation fun personally, and the participation sense of the user is improved.
According to the first terminal provided by the invention, the following additional technical features can be provided:
in the above technical solution, further, the first terminal further includes: an operation device for receiving an operation input for controlling the second terminal to execute an operation function; and the first control device is respectively connected with the operating device and the first communication device and is used for responding to the operation input and generating the control signal.
In the technical scheme, the first terminal comprises an operating device and a first control device, wherein the operating device is used for receiving and controlling operation input of the second terminal, a user remotely performs operation input through the operating device, and then sends a control signal to the second terminal through the first communication device, so that remote interaction with the second terminal is realized, for example, the user uses touch gestures such as touch clicking and touch dragging to complete interaction operation on the second terminal, so that the user can conveniently and flexibly perform remote interaction with the second terminal, the operation input for controlling the second terminal is received through the operating device, the operation experience of being personally on the scene can be brought to the user, the operation habit of the user on the terminal equipment is consistent, and the use experience of the user is improved. Furthermore, two ends of the first control device are respectively connected with the operation device and the first communication device, after the operation device receives operation input of a user, the first control device responds to the operation input to generate a control signal, the first communication device sends the control signal to the second terminal to execute a corresponding operation function, and the first control device is connected with the operation device and the first communication device, so that the user can watch a real-time picture of the operation executed by the second terminal and send the control signal to the second terminal, and the interaction efficiency of the first terminal and the second terminal is improved.
In any of the above technical solutions, further, the operation input is input by a user according to an image.
According to the technical scheme, after the user views the image operated by the second terminal through the display device, the next operation of the second terminal is input according to the real-time image, so that the interaction between the operation and the image is completed, the remote interactive connection between the user and the second terminal is realized, and the participation sense of the user is improved.
Furthermore, when a user watches a real-time image of the second terminal through the display device, if the user wants to switch the angle of image acquisition of the second terminal, the user can input and control the rotation of the image acquisition device through the operation device, so that the angle of image acquisition of the second terminal in the field is switched, the user can also set the image acquisition device to follow the operation executed by the second terminal execution device all the time, all key details of the second terminal are tracked, and the viewing experience of the user is improved.
According to the second aspect of the present invention, there is also provided a second terminal, comprising: the second communication device is in communication connection with the first terminal and is used for receiving the control signal sent by the first terminal; the execution device is connected with the second communication device and is used for executing the operation function corresponding to the control signal; the image acquisition device is connected with the second communication device and is used for acquiring an image of the execution operation function of the execution device; and the second communication device is also used for sending the information of the image to the first terminal.
In the technical scheme, the second terminal comprises a second communication device, an execution device and an image acquisition device, specifically, the second communication device is in communication connection with the first terminal, the execution device and the image acquisition device are respectively connected with the second communication device, the second communication device receives a control signal sent by the first terminal, the execution device can execute an operation corresponding to the control signal, the image acquisition device acquires an image of the execution operation of the execution device, and the second communication device sends acquired image information to the first terminal, so that a user can view a real-time picture of the operation of the second terminal. The interaction between the operation and the image is realized through the real-time information interaction between the second terminal and the first terminal, so that the user can operate and control the second terminal while watching the real-time picture of the second terminal, and the participation sense of the user is enhanced.
Furthermore, the image acquisition device can record the video of the content of the operation process of the second terminal, and the video is sent to the first terminal through the second communication device, so that the user can watch and store the video conveniently, and the practicability of the second terminal is improved.
According to the second terminal provided by the invention, the following additional technical features can be provided:
in any of the above technical solutions, further, the second terminal further includes: and the second control device is respectively connected with the execution device and the second communication device and is used for acquiring the user information and carrying out authority verification on the operation function according to the user information.
In the technical scheme, two ends of the second control are respectively connected with the execution device and the second communication device, after the second communication device receives the control signal sent by the first terminal, the second control device judges whether the user has the authority to control the operation of the second terminal according to the identity information of the user, and the interaction can be effectively controlled, so that the interaction between the first terminal and the second terminal is more orderly and standard.
According to the third aspect of the present invention, there is further provided a remote operation control method, adapted to a first terminal, where the first terminal is in communication connection with a second terminal, the method including: sending a first control signal to the second terminal to enable an execution device of the second terminal to execute a first operation function, and enabling an image acquisition device of the second terminal to acquire an image of the execution device executing the first operation function; receiving information of an image sent by a second terminal; and displaying the image.
In the technical scheme, the first terminal receives operation input of a user and sends a control signal to the second terminal, so that the execution device of the second terminal executes corresponding operation according to the control signal, and meanwhile, the image acquisition device of the second terminal acquires an image of an operation function executed by the execution device. Further, after the first terminal receives the image information sent by the second terminal, the image is displayed through the display device. Through first terminal and second terminal communication connection, realized the real-time information interaction at first terminal and second terminal for the user can be from the real-time picture of first terminal viewing second terminal, control second terminal execution operating function, for the user provides the interactive experience of being personally on the scene, make the user can experience the enjoyment of participation in person, improved user's use and experienced.
According to the remote operation control method provided by the invention, the following additional technical characteristics can be provided:
in any of the above technical solutions, further, after displaying the image, the method further includes: receiving an input for controlling a second terminal to execute a second operation function according to the image; in response to the input, a second control signal is transmitted to the second terminal.
In the technical scheme, after a user views a first operation of the second terminal according to a display image, the first terminal receives an input which is sent by the user according to image content and controls the second terminal to execute a second operation function, and sends a second control signal to the second terminal in response to the operation input, so that the second terminal can further operate according to the second control signal. The operation of the second terminal is further controlled through the display image, so that the interaction of the image and the operation is realized, the interaction of the first terminal and the second terminal is more consistent with the current situation, and the interaction effect is improved.
In any of the above technical solutions, further, before sending the first control signal to the second terminal, the method further includes: acquiring user information; and performing authority verification according to the user information.
In the technical scheme, before the first terminal sends the first control signal to the second terminal, the identity information of the user is obtained, and the authority verification is carried out according to the identity information of the user. The interaction is effectively controlled, so that the interaction between the first terminal and the second terminal is more orderly and normative.
According to the fourth aspect of the present invention, there is also provided a remote operation control method, adapted to a second terminal, the second terminal being in communication connection with a first terminal, the control method including: receiving a first control signal sent by a first terminal, executing a first operation function according to the first control signal, and collecting an image for executing the first operation function; and sending information of the image to the first terminal.
In the technical scheme, the second terminal receives a first control signal sent by the first terminal, the execution device executes corresponding first operation according to the first control signal, the image acquisition device acquires an image of the execution device executing the first operation, and the second terminal sends image information to the first terminal, so that a user can know the real-time situation of the second terminal, the user can conveniently remotely participate in relevant field activities of the second terminal, direct interaction between the user and the second terminal is realized, and the participation sense of the user is improved.
According to the remote operation control method provided by the invention, the following additional technical characteristics can be provided:
in any of the above technical solutions, further, after sending the information of the image to the first terminal, the method further includes: receiving a second control signal sent by the first terminal according to the image of the operation function; and executing a second operation function according to the second control signal.
In the technical scheme, after the second terminal sends the image information to the first terminal, the user inputs the second operation of the second terminal according to the observed image of the first operation performed by the second terminal, and the second terminal receives the second control signal sent by the first terminal according to the operation input and then executes the second operation according to the second control signal. The interaction between the operation and the image is realized, so that the interaction between the first terminal and the second terminal is more consistent with the current situation, the interaction effect is improved, and the experience of the user is further improved.
In any of the above technical solutions, further, before executing the first operation function according to the first control signal, the method further includes: acquiring user information; and performing authority verification on the first operation function according to the user information.
In the technical scheme, before the second terminal executes the first operation function according to the first control signal, the identity information of the user is acquired, and whether the user has the operation authority to control the second terminal to execute the first operation function is judged. The interaction between the first terminal and the second terminal is effectively controlled, so that the interaction between the first terminal and the second terminal is more orderly and normative.
According to a fifth aspect of the present invention, there is provided a readable storage medium having stored thereon a program or instructions which, when executed by a processor, performs the steps of the remote operation control method set forth in the third aspect or the steps of the remote operation control method set forth in the fourth aspect. Therefore, the computer-readable storage medium has all the advantages of the remote operation control method proposed in the third aspect and the remote operation control method proposed in the fourth aspect, and redundant description is omitted for avoiding redundancy.
Additional aspects and advantages of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.
Drawings
The above and/or additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
fig. 1 shows a schematic block diagram of a first terminal and a second terminal of one embodiment of the invention;
FIG. 2 is a flow chart of a remote operation control method according to an embodiment of the third aspect of the present invention;
FIG. 3 is a flow chart of a remote operation control method according to a further embodiment of the third aspect of the present invention;
FIG. 4 is a flow chart illustrating a remote operation control method according to yet another embodiment of the third aspect of the present invention;
FIG. 5 is a flow chart of a remote operation control method according to a fourth aspect of the present invention;
FIG. 6 is a flow chart illustrating a remote operation control method according to a further embodiment of the fourth aspect of the present invention;
FIG. 7 is a flow chart illustrating a remote operation control method according to a further embodiment of the fourth aspect of the present invention;
FIG. 8 shows a schematic block diagram of a remote operation control system in accordance with a specific embodiment of the present invention.
Wherein, the correspondence between the reference numbers and the component names in fig. 1 to 8 is:
100 a first terminal, 102 a first communication device, 104 a display device, 106 an operating device, 108 a first control device, 110 a second terminal, 112 a second communication device, 114 an image acquisition device, 116 an execution device, 118 a second control device, 120 a remote control device, 122 a communication unit, 124 a control unit, 130 an information processing device.
Detailed Description
In order that the above objects, features and advantages of the present invention can be more clearly understood, a more particular description of the invention will be rendered by reference to the appended drawings. It should be noted that the embodiments and features of the embodiments of the present application may be combined with each other without conflict.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention, however, the present invention may be practiced in other ways than those specifically described herein, and therefore the scope of the present invention is not limited by the specific embodiments disclosed below.
The first terminal 100, the second terminal 110, the remote operation control method, and the readable storage medium according to some embodiments of the present invention are described below with reference to fig. 1 to 8.
Example 1:
as shown in fig. 1, according to an embodiment of the present invention, there is provided a first terminal 100 including: a first communication device 102 and a display device 104.
In detail, the first communication device 102 is in communication connection with the second terminal 110, and is configured to send a control signal to the second terminal 110 to enable the executing device 116 of the second terminal 110 to execute the operation function, and enable the image capturing device 114 of the second terminal 110 to capture an image of the executing device 116 executing the operation function, and receive information of the image sent by the second terminal 110; and a display device 104 connected to the first communication device 102 for displaying images.
In this embodiment, the first terminal 100 includes a first communication device 102 and a display device 104, wherein the first communication device 102 is communicatively connected to the second terminal 110, and the display device 104 is connected to the first communication device 102. The first communication device 102 sends a control signal to the second terminal 110, so that the executing device 116 of the second terminal 110 performs a corresponding operation according to the control signal, and at the same time, the image capturing device 114 of the second terminal 110 captures an image of an operation function performed by the executing device 116. Further, the first communication device 102 receives the image information transmitted from the second terminal 110, and displays the image through the display device 104. Through the communication connection between the first terminal 100 and the second terminal 110, the real-time information interaction between the first terminal 100 and the second terminal 110 is realized, so that a user can control the second terminal 110 to execute an operation function while watching a real-time picture of the second terminal 110 from the first terminal 100, an immersive interaction experience is provided for the user, the user can personally experience the participation fun, and the participation sense of the user is improved.
In a specific embodiment, the interactive scene of the second terminal 110 may be a scene for performing a live event or entertaining, for example, the interactive scene of the second terminal 110 may be fishing, and the performing device 116 includes a fishing rod. The user views the real-time image of fishing in the second terminal 110 through the display device 104 of the first terminal 100, and then sends a control signal for retracting the fishing rod to the second terminal 110 through the first communication device 102 according to the viewed real-time image of the fishing process, so that the execution device 116 of the second terminal 110 retracts the fishing rod according to the control signal. Through the communication connection between the first terminal 100 and the second terminal 110, the interaction between the operation and the image is realized, so that the user can participate in the entertainment instead of watching the entertainment picture singly, and the richness and the interest of the interaction are improved.
Example 2:
as shown in fig. 1, according to an embodiment of the present invention, on the basis of the above embodiment, further: the first terminal 100 further includes: an operation device 106 for receiving an operation input for controlling the second terminal 110 to perform an operation function; a first control means 108, connected to the operating means 106 and the first communication means 102, respectively, for generating control signals in response to operating inputs.
In this embodiment, the first terminal 100 includes an operation device 106 and a first control device 108, where the operation device 106 is configured to receive an operation input for controlling the second terminal 110, a user performs the operation input through the operation device 106 remotely, and then sends a control signal to the second terminal 110 through the first communication device 102, so that remote interaction with the second terminal 110 is achieved, for example, the user uses a touch gesture such as touch click or touch drag to complete an interaction operation on the second terminal 110, so that the user can conveniently and flexibly perform remote interaction with the second terminal 110, and the operation device 106 receives the operation input for controlling the second terminal 110, so that an in-person operation experience can be brought to the user, and the operation experience is consistent with an operation habit of the user on a terminal device, and the use experience of the user is improved. Furthermore, both ends of the first control device 108 are respectively connected with the operation device 106 and the first communication device 102, after the operation device 106 receives an operation input of a user, the first control device 108 generates a control signal in response to the operation input, the first communication device 102 sends the control signal to the second terminal 110 to execute a corresponding operation function, and the first control device 108 is connected with the operation device 106 and the first communication device 102, so that the user can view a real-time image of the operation executed by the second terminal 110 and send the control signal to the second terminal 110, thereby improving the interaction efficiency between the first terminal 100 and the second terminal 110.
The user can directly touch the execution device 116 of the second terminal 110 in the real-time image in the display device 104 to realize the operation input to the execution device 116 of the second terminal 110, so as to provide an immersive operation experience for the user, and improve the efficiency of interactively operating the second terminal 110.
Further, the first control device 108 can process the image information sent by the second terminal 110, so that the real-time image displayed by the display device 104 is clearer, and the viewing experience of the user is improved.
Further, the first control means 108 is capable of performing a rights verification of the identity of the user. For example, when the second terminal 110 performs live broadcast, the first control device 108 obtains the user identity information and determines whether the user has the right to enter the live broadcast room for viewing. In addition, according to the user identity information, live broadcast rooms which can be watched by the user can be displayed on the display device 104 for the user to select, and the user can select the live broadcast room which is interested by the user to enter into watching. For example, the active live broadcast room opened by the common user is a fixed live broadcast room, the member user opens more live broadcast rooms according to the member level, and the user clicks the interested live broadcast room through the operation device 106 to enter the viewing, so as to establish the interactive connection with the active scene of the second terminal 110.
Example 3:
according to an embodiment of the present invention, on the basis of the above embodiment, further: the operation input is input by the user according to the image.
In this embodiment, after the user views the image operated by the second terminal 110 through the display device 104, the user inputs the next operation of the second terminal 110 according to the real-time image, thereby completing the interaction between the operation and the image, realizing the interactive connection between the user and the second terminal 110 in a remote manner, and improving the participation of the user.
Further, when the user views the real-time image of the second terminal 110 through the display device 104, if the user wants to switch the angle of image capture of the second terminal 110, the user can input and control the rotation of the image capture device 114 through the operation device 106, so as to switch the angle of image capture of the second terminal 110 in the operation field, and the user can set the image capture device 114 to always follow the operation executed by the execution device 116 of the second terminal 110, track each important detail of the activity field of the second terminal 110, and improve the viewing experience of the user.
In a specific embodiment, if the second terminal 110 performs a fishing activity, the user views the live real-time image of the second terminal 110 through the display device 104, and if the user observes that the fishing rod shakes, it is considered that a fish is hooked, an operation input of a rod retracting action can be performed on the operation device 106, the first control device 108 converts the operation input of the rod retracting action into a control signal, and transmits the control signal to the second terminal 110 through the first communication device 102, so that the execution device 116 on the second terminal 110 executes the rod retracting operation, the user can remotely participate in the live activity of the second terminal 110, the interaction effect is improved, and further the user stickiness is improved.
Example 4:
as shown in fig. 1, according to a second aspect of the present invention, there is provided a second terminal 110, comprising: a second communication device 112, communicatively connected to the first terminal 100, for receiving the control signal sent by the first terminal 100; an executing device 116, connected to the second communication device 112, for executing the operation function corresponding to the control signal; the image acquisition device 114 is connected with the second communication device 112 and is used for acquiring an image of the execution operation function of the execution device 116; the second communication device 112 is further configured to send information of the image to the first terminal 100.
In this embodiment, the second terminal 110 includes a second communication device 112, an execution device 116, and an image capturing device 114, specifically, the second communication device 112 is in communication connection with the first terminal 100, the execution device 116 and the image capturing device 114 are respectively connected with the second communication device 112, a control signal sent by the first terminal 100 is received through the second communication device 112, so that the execution device 116 can execute an operation corresponding to the control signal, and the image capturing device 114 captures an image of the operation executed by the execution device 116 and sends the captured image information to the first terminal 100 through the second communication device 112, so that a user can view a real-time picture of the operation of the second terminal 110. The second terminal 110 interacts with the first terminal 100 in real time, so that the interaction between the operation and the image is realized, the user can control the operation of the second terminal 110 while watching the real-time picture of the second terminal 110, and the user participation sense is enhanced.
Further, the image capturing device 114 can record the content of the operation process of the second terminal 110, and send the recorded video to the first terminal 100 through the second communication device 112, so that the user can watch and store the recorded video conveniently, and the practicability of the second terminal 110 is improved.
Example 5:
as shown in fig. 1, according to an embodiment of the present invention, on the basis of the above embodiment, further: the second terminal 110 further includes: the second control device 118 is connected to the executing device 116 and the second communication device 112, respectively, and is configured to obtain the user information and perform authorization verification on the operation function according to the user information.
In this embodiment, two ends of the second control are respectively connected to the executing device 116 and the second communication device 112, and after the second communication device 112 receives the control signal sent by the first terminal 100, the second control device 118 determines whether the user has the authority to control the operation of the second terminal 110 according to the identity information of the user, so as to effectively control the interaction, and make the interaction between the first terminal 100 and the second terminal 110 more orderly and normative.
In a specific embodiment, the user information is obtained, and different interactive connection manners are established for the common user and the member user, for example, the first terminal 100 of the member user may be simultaneously connected with the image capturing device 114 and the executing device 116 of the second terminal 110, while the first terminal 100 of the common user may only be connected with the image capturing device 114 of the second terminal 110, or the first terminal 100 may be allowed to be simultaneously connected with the image capturing device 114 and the executing device 116, but the user is only allowed to perform a part of operations on the executing device 116.
Example 6:
as shown in fig. 2, according to a third aspect of the present invention, a remote operation control method is provided, which is applied to a first terminal, and the first terminal is in communication connection with a second terminal, and the method includes:
step 202, sending a first control signal to the second terminal to enable an execution device of the second terminal to execute a first operation function, and enabling an image acquisition device of the second terminal to acquire an image of the execution device executing the first operation function;
step 204, receiving the information of the image sent by the second terminal;
step 206, displaying the image.
In this embodiment, the first terminal receives an operation input from a user, and sends a control signal to the second terminal, so that the execution device of the second terminal executes a corresponding operation according to the control signal, and the image acquisition device of the second terminal acquires an image of an operation function executed by the execution device. Further, after the first terminal receives the image information sent by the second terminal, the image is displayed through the display device. Through first terminal and second terminal communication connection, realized the real-time information interaction at first terminal and second terminal for the user can be from the real-time picture of first terminal viewing second terminal, control second terminal execution operating function, for the user provides the interactive experience of being personally on the scene, make the user can experience the enjoyment of participation in person, improved user's use and experienced.
Example 7:
as shown in fig. 3, according to an embodiment of the present invention, there is provided a remote operation control method including:
step 302, sending a first control signal to the second terminal to enable an execution device of the second terminal to execute a first operation function, and enabling an image acquisition device of the second terminal to acquire an image of the execution device executing the first operation function;
step 304, receiving the information of the image sent by the second terminal;
step 306, displaying the image;
step 308, receiving an input for controlling the second terminal to execute a second operation function according to the image;
step 310, in response to the input, transmits a second control signal to the second terminal.
In this embodiment, after the user views the first operation of the second terminal according to the display image, the first terminal receives an input for controlling the second terminal to perform the second operation function transmitted by the user according to the image content, and transmits a second control signal to the second terminal in response to the operation input, so that the second terminal can perform further operation according to the second control signal. The operation of the second terminal is further controlled through the display image, so that the interaction of the image and the operation is realized, the interaction of the first terminal and the second terminal is more consistent with the current situation, and the interaction effect is improved.
In a specific embodiment, if the activity scene of the second terminal is fishing, the execution device of the second terminal includes a fishing rod, after the user sends an operation input of throwing out the fishing rod, the second terminal controls the fishing rod to complete the action of throwing out according to a control signal of throwing out the fishing rod, the user views a real-time picture through the display device, and if the user observes that the fishing rod has a sign that a fish is hooked, the operation input of withdrawing the fishing rod can be sent, so that the fishing rod of the second terminal executes the action of withdrawing according to the control signal. Furthermore, the user can send the operation input for switching the image acquisition device of the second terminal to acquire panoramic images or special images such as water surfaces according to the display images, so that the image acquisition device of the second terminal switches the acquisition images according to the control signal, the user can observe the water surface fluctuation condition in a close range, and the use experience of the user is improved.
Example 8:
as shown in fig. 4, according to an embodiment of the present invention, there is provided a remote operation control method including:
step 402, acquiring user information;
step 404, performing authority verification according to the user information;
step 406, sending a first control signal to the second terminal, so as to enable an execution device of the second terminal to execute the first operation function, and enable an image acquisition device of the second terminal to acquire an image of the execution device executing the first operation function;
step 408, receiving the information of the image sent by the second terminal;
step 410, displaying the image.
In this embodiment, before the first terminal sends the first control signal to the second terminal, the identity information of the user is acquired, and the authority verification is performed according to the identity information of the user. The interaction is effectively controlled, so that the interaction between the first terminal and the second terminal is more orderly and normative.
In a specific embodiment, when the second terminal performs live broadcast, the identity information of the user is acquired, and the authority authentication is performed on the user. For example, only viewing is allowed. In addition, the live broadcast rooms which can be watched by the user can be displayed on the display device according to the identity information of the user for the user to select, and the user can select the live broadcast room which is interested by the user to enter the watching. For example, an active live broadcast room opened for a common user is a fixed live broadcast room, a member user opens more live broadcast rooms according to the member level, and the user clicks the interested live broadcast room through the operating device to enter the live broadcast room for watching, so that the interactive connection with the second terminal active scene is established.
Example 9:
as shown in fig. 5, according to a fourth aspect of the present invention, a remote operation control method is provided, which is applied to a second terminal, the second terminal being in communication connection with a first terminal, the method including:
step 502, receiving a first control signal sent by a first terminal, executing a first operation function according to the first control signal, and collecting an image for executing the first operation function;
step 504, sending information of the image to the first terminal.
In the embodiment, the second terminal receives the first control signal sent by the first terminal, the execution device executes corresponding first operation according to the first control signal, the image acquisition device acquires an image of the execution device executing the first operation, and the second terminal sends image information to the first terminal, so that a user can know the real-time situation of the second terminal, the user can conveniently remotely participate in relevant field activities of the second terminal, direct interaction between the user and the second terminal is realized, and the participation sense of the user is improved.
Further, after the second terminal receives the first control signal sent by the first terminal, the second control device obtains the user information, authenticates whether the user has the operation authority, if the user has the operation authority, the control execution device executes corresponding first operation according to the first control signal, and if the user does not have the operation authority, the second control device rejects the first control signal.
In a specific embodiment, when the activity scene of the second terminal is fishing, the executing device includes a fishing rod, the second terminal receives a fishing rod throwing-out signal sent by the first terminal, if the user has an operation right, the fishing rod executes a corresponding throwing-out action according to the first control signal, the image acquiring device acquires a real-time picture in the activity scene, and sends information of the picture to the first terminal, so that the user can observe specific conditions in the activity scene in real time.
Example 10:
as shown in fig. 6, according to an embodiment of the present invention, there is provided a remote operation control method including:
step 602, receiving a first control signal sent by a first terminal, executing a first operation function according to the first control signal, and collecting an image for executing the first operation function;
step 604, sending the information of the image to the first terminal;
step 606, receiving a second control signal sent by the first terminal according to the image of the operation function;
step 608, a second operation function is executed according to the second control signal.
In this embodiment, after the second terminal sends the information of the image to the first terminal, the user inputs the second operation of the second terminal according to the viewed image of the first operation performed by the second terminal, and the second terminal receives the second control signal sent by the first terminal according to the operation input, and then executes the second operation according to the second control signal. The interaction between the operation and the image is realized, so that the interaction between the first terminal and the second terminal is more consistent with the current situation, the interaction effect is improved, and the experience of the user is further improved.
Example 11:
as shown in fig. 7, according to an embodiment of the present invention, there is provided a remote operation control method including:
step 702, acquiring user information;
step 704, performing authority verification on the first operation function according to the user information;
step 706, receiving a first control signal sent by the first terminal, executing a first operation function according to the first control signal, and collecting an image for executing the first operation function;
step 708, sending information of the image to the first terminal.
In this embodiment, after the second terminal sends the information of the image to the first terminal, the user inputs the second operation of the second terminal according to the viewed image of the first operation performed by the second terminal, and the second terminal receives the second control signal sent by the first terminal according to the operation input, and then executes the second operation according to the second control signal. The interaction between the operation and the image is realized, so that the interaction between the first terminal and the second terminal is more consistent with the current situation, the interaction effect is improved, and the experience of the user is further improved.
Example 12:
as shown in fig. 8, according to an embodiment of the present invention, a remote operation control system is provided.
In this embodiment, the present invention provides a remote operation control system including: a first terminal 100, a remote control device 120, an information processing device 130, and a second terminal 110. Wherein, the first terminal 100 includes a display device and an operation device, the remote control device 120 includes a communication unit 122 and a control unit 124, and the second terminal 110 includes an image capture device and an execution device.
Specifically, the remote operation control system realizes real-time information interaction between the first terminal 100 and the second terminal 110 through the remote control device 120 and the information processing device 130, so that a user can observe a real-time picture of the second terminal 110 from the first terminal 100, and controls one or more execution devices in the second terminal 110 to move in real time through the operation device, thereby improving user experience.
Example 13:
according to an embodiment of the present invention, a remote operation control method is provided.
In this embodiment, the image acquisition device of the second terminal acquires a real-time image, and the image information is transmitted to the information processing device for processing, further transmitted to the remote control device, and then transmitted to the display device of the first terminal. The user receives the image information through the display device, operates the operation device according to the image information, performs real-time information interaction on operation input through the communication unit and the control unit of the remote control device, transmits the operation input to the second terminal after processing through the information processing device, and controls the image acquisition device and the execution device to move.
Example 14:
according to a fifth aspect of the present invention, there is provided a readable storage medium having stored thereon a program or instructions which, when executed by a processor, performs the steps of the remote operation control method set forth in the third aspect or the steps of the remote operation control method set forth in the fourth aspect. Therefore, the computer-readable storage medium has all the advantages of the remote operation control method proposed in the third aspect and the remote operation control method proposed in the fourth aspect, and redundant description is omitted for avoiding redundancy.
In the present invention, the term "plurality" means two or more unless explicitly defined otherwise. The terms "mounted," "connected," "fixed," and the like are to be construed broadly and include, for example, fixed connections, detachable connections, or integral connections; "coupled" may be direct or indirect through an intermediary. The specific meanings of the above terms in the present invention can be understood by those skilled in the art according to specific situations.
In the description herein, the description of the terms "one embodiment," "some embodiments," "specific embodiments," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (12)

1. A first terminal, comprising:
the first communication device is in communication connection with a second terminal and is used for sending a control signal to the second terminal so as to enable an execution device of the second terminal to execute an operation function, enable an image acquisition device of the second terminal to acquire an image of the execution device executing the operation function and receive information of the image sent by the second terminal;
and the display device is connected with the first communication device and is used for displaying the image.
2. The first terminal of claim 1, further comprising:
the operating device is used for receiving an operation input for controlling the second terminal to execute the operation function;
first control means connected to the operation means and the first communication means, respectively, for generating the control signal in response to the operation input.
3. The first terminal of claim 2,
the operation input is input by a user according to the image.
4. A second terminal, comprising:
the second communication device is in communication connection with the first terminal and is used for receiving the control signal sent by the first terminal;
the execution device is connected with the second communication device and is used for executing an operation function corresponding to the control signal;
the image acquisition device is connected with the second communication device and is used for acquiring the image of the execution function executed by the execution device;
the second communication device is further configured to send information of the image to the first terminal.
5. The second terminal of claim 4, further comprising:
and the second control device is respectively connected with the execution device and the second communication device and is used for acquiring user information and carrying out authority verification on the operation function according to the user information.
6. A remote operation control method is applied to a first terminal which is in communication connection with a second terminal, and comprises the following steps:
sending a first control signal to the second terminal to enable an execution device of the second terminal to execute a first operation function, and enabling an image acquisition device of the second terminal to acquire an image of the execution device executing the first operation function;
receiving the information of the image sent by the second terminal;
and displaying the image.
7. The remote operation control method according to claim 6, further comprising, after said displaying the image:
receiving an input for controlling the second terminal to execute a second operation function according to the image;
in response to the input, transmitting a second control signal to the second terminal.
8. The remote operation control method according to claim 6 or 7, wherein before the transmitting the first control signal to the second terminal, further comprising:
acquiring user information;
and performing authority verification according to the user information.
9. A remote operation control method is applied to a second terminal which is in communication connection with a first terminal, and comprises the following steps:
receiving a first control signal sent by the first terminal, executing a first operation function according to the first control signal, and collecting an image for executing the first operation function;
and sending the information of the image to the first terminal.
10. The remote operation control method according to claim 9, further comprising, after the transmitting the information of the image to the first terminal:
receiving a second control signal sent by the first terminal according to the image of the operation function;
and executing a second operation function according to the second control signal.
11. The remote operation control method according to claim 9 or 10, wherein before the performing of the first operation function according to the first control signal, further comprising:
acquiring user information;
and performing authority verification on the first operation function according to the user information.
12. A readable storage medium on which a program or instructions are stored, the program or instructions, when executed by a processor, implementing the remote operation control method according to any one of claims 6 to 8, or the remote operation control method according to any one of claims 9 to 11.
CN202110380786.4A 2021-04-09 2021-04-09 First terminal, second terminal, remote operation control method, and readable storage medium Active CN113141517B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110380786.4A CN113141517B (en) 2021-04-09 2021-04-09 First terminal, second terminal, remote operation control method, and readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110380786.4A CN113141517B (en) 2021-04-09 2021-04-09 First terminal, second terminal, remote operation control method, and readable storage medium

Publications (2)

Publication Number Publication Date
CN113141517A true CN113141517A (en) 2021-07-20
CN113141517B CN113141517B (en) 2023-08-11

Family

ID=76810746

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110380786.4A Active CN113141517B (en) 2021-04-09 2021-04-09 First terminal, second terminal, remote operation control method, and readable storage medium

Country Status (1)

Country Link
CN (1) CN113141517B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023050522A1 (en) * 2021-09-28 2023-04-06 歌尔股份有限公司 Interaction method, terminal device, and readable storage medium

Citations (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20070033511A (en) * 2005-09-21 2007-03-27 에스케이 텔레콤주식회사 Remote fishing system and method using a mobile communication terminal
KR20080035788A (en) * 2006-10-20 2008-04-24 엘지전자 주식회사 Method of video telephony in mobile terminal
CN102419583A (en) * 2011-11-17 2012-04-18 西北农林科技大学 System for acquiring crop digital image remotely in real time
KR20120081698A (en) * 2011-01-12 2012-07-20 (주)살구넷 Remote fishing system
CN202720496U (en) * 2012-05-23 2013-02-06 陈光红 Remote control system of online fishing
CN103444670A (en) * 2013-08-26 2013-12-18 杨文宇 Fishing system assembly and method based on network video remote control
CN103858837A (en) * 2014-03-13 2014-06-18 重庆远钓科技有限公司 Unattended fishing system and method
CN105357262A (en) * 2015-09-29 2016-02-24 小米科技有限责任公司 Device control method and device control apparatus
CN106488334A (en) * 2015-09-01 2017-03-08 天脉聚源(北京)科技有限公司 A kind of net cast interactive approach and system
CN206313870U (en) * 2016-11-02 2017-07-07 徐文波 Live terminal servicing unit, control device and remote living broadcast control system
CN206413622U (en) * 2016-10-14 2017-08-18 谭军 A kind of automatic hooking fish equipment that can be controlled based on internet
CN207117819U (en) * 2017-05-18 2018-03-16 吴彦桥 A kind of long-range view equipment
CN108935365A (en) * 2018-06-25 2018-12-07 王斌 A kind of long-range fishing control system
CN109889855A (en) * 2019-01-31 2019-06-14 南京理工大学 Intelligent panoramic net cast networked shopping system and method based on mobile APP
CN209995176U (en) * 2019-04-14 2020-01-31 黄海锋 multifunctional fishing lamp support
CN112106007A (en) * 2019-08-29 2020-12-18 深圳市大疆创新科技有限公司 Unmanned aerial vehicle management method, equipment, unmanned aerial vehicle, system and storage medium

Patent Citations (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20070033511A (en) * 2005-09-21 2007-03-27 에스케이 텔레콤주식회사 Remote fishing system and method using a mobile communication terminal
KR20080035788A (en) * 2006-10-20 2008-04-24 엘지전자 주식회사 Method of video telephony in mobile terminal
KR20120081698A (en) * 2011-01-12 2012-07-20 (주)살구넷 Remote fishing system
CN102419583A (en) * 2011-11-17 2012-04-18 西北农林科技大学 System for acquiring crop digital image remotely in real time
CN202720496U (en) * 2012-05-23 2013-02-06 陈光红 Remote control system of online fishing
CN103444670A (en) * 2013-08-26 2013-12-18 杨文宇 Fishing system assembly and method based on network video remote control
CN103858837A (en) * 2014-03-13 2014-06-18 重庆远钓科技有限公司 Unattended fishing system and method
CN106488334A (en) * 2015-09-01 2017-03-08 天脉聚源(北京)科技有限公司 A kind of net cast interactive approach and system
CN105357262A (en) * 2015-09-29 2016-02-24 小米科技有限责任公司 Device control method and device control apparatus
CN206413622U (en) * 2016-10-14 2017-08-18 谭军 A kind of automatic hooking fish equipment that can be controlled based on internet
CN206313870U (en) * 2016-11-02 2017-07-07 徐文波 Live terminal servicing unit, control device and remote living broadcast control system
CN207117819U (en) * 2017-05-18 2018-03-16 吴彦桥 A kind of long-range view equipment
CN108935365A (en) * 2018-06-25 2018-12-07 王斌 A kind of long-range fishing control system
CN109889855A (en) * 2019-01-31 2019-06-14 南京理工大学 Intelligent panoramic net cast networked shopping system and method based on mobile APP
CN209995176U (en) * 2019-04-14 2020-01-31 黄海锋 multifunctional fishing lamp support
CN112106007A (en) * 2019-08-29 2020-12-18 深圳市大疆创新科技有限公司 Unmanned aerial vehicle management method, equipment, unmanned aerial vehicle, system and storage medium

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
向稳新;: "移动视频监控技术现状与架构", 中国公共安全(综合版), no. 09 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023050522A1 (en) * 2021-09-28 2023-04-06 歌尔股份有限公司 Interaction method, terminal device, and readable storage medium

Also Published As

Publication number Publication date
CN113141517B (en) 2023-08-11

Similar Documents

Publication Publication Date Title
CN108632633B (en) Live webcast data processing method and device
CN108632632B (en) Live webcast data processing method and device
US8990842B2 (en) Presenting content and augmenting a broadcast
CN106303555B (en) A kind of live broadcasting method based on mixed reality, device and system
US8012023B2 (en) Virtual entertainment
RU2518940C2 (en) Method, apparatus and system for interlinking video image and virtual network environment
US20030079218A1 (en) Remote collaborative control and direction
CN110703913B (en) Object interaction method and device, storage medium and electronic device
CN108635863B (en) Live webcast data processing method and device
WO2014094537A1 (en) Immersion communication client and server, and method for obtaining content view
JP7228338B2 (en) System, method and program for distributing videos
CN111147911A (en) Video clipping method and device, electronic equipment and storage medium
CN108076379B (en) Multi-screen interaction realization method and device
CN108939533A (en) Somatic sensation television game interactive approach and system
CN109195003A (en) Interactive approach, system, terminal and the device of game are carried out based on live streaming
CN113141517A (en) First terminal, second terminal, remote operation control method, and readable storage medium
CN106412617B (en) Remote debugging control method and device
CN105100080B (en) It is a kind of based on the board class interactive approach, relevant device and the system that are broadcast live online
CN113784180A (en) Video display method, video pushing method, video display device, video pushing device, video display equipment and storage medium
CN116980706A (en) Video playing method and device, storage medium and electronic equipment
CN115174953B (en) Event virtual live broadcast method, system and event live broadcast server
CN101794543B (en) Self-adaption interactive video terminal
Wolff et al. Communicating eye gaze across a distance without rooting participants to the spot
CN103905777A (en) Meeting minute obtaining method and providing method, device and system
KR101915065B1 (en) Live streaming system for virtual reality contents and operating method thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant