CN115643365A - Remote operation control method and device and electronic equipment - Google Patents
Remote operation control method and device and electronic equipment Download PDFInfo
- Publication number
- CN115643365A CN115643365A CN202211670504.5A CN202211670504A CN115643365A CN 115643365 A CN115643365 A CN 115643365A CN 202211670504 A CN202211670504 A CN 202211670504A CN 115643365 A CN115643365 A CN 115643365A
- Authority
- CN
- China
- Prior art keywords
- target
- remote
- camera
- video
- waiting user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Abstract
The invention discloses a remote operation control method, a remote operation control device and electronic equipment. The method comprises the following steps: displaying a waiting user list, wherein the camera is a camera in the operation site of the waiting user; responding to camera selection operation triggered by a remote expert, and displaying a target operation video acquired by a target camera in real time in a video preview area; responding to a display screen selection operation triggered by a remote expert, and sending a target operation video to a first currently selected display screen for displaying; responding to the posture adjustment operation triggered by the remote expert, sending a posture adjustment instruction corresponding to the target camera to an operation control end corresponding to the target waiting user, so that the operation control end adjusts the target camera; the microphone and the loudspeaker are started in response to audio starting operation triggered by the remote expert, so that the remote expert conducts remote operation guidance on the target waiting user, autonomous control of the remote expert is achieved, the control freedom is improved, and remote operation efficiency is improved.
Description
Technical Field
The invention relates to the technical field of computers, in particular to a remote operation control method, a remote operation control device and electronic equipment.
Background
The remote operation is based on computer technology, remote sensing, remote measuring and remote control technology, and the experts in large hospitals or special medical centers conduct remote operation guidance on patients with poor medical conditions, so that smooth completion of the operation is guaranteed.
At present, the control flow of the video conference for remote operation has strong specialty, and a background dispatcher is required to carry out video conference technical dispatching according to the requirements of remote experts and replace the remote experts to complete operation control operation. Therefore, the existing remote operation control mode highly depends on a third-party dispatcher, so that a remote expert only serves as an operation participant, but not as a master controller of the operation, and the dispatcher needs to be called continuously to make an action to obtain the correct response of the whole consultation system, so that the control flow is complicated and low in efficiency, and the remote operation efficiency is reduced.
Disclosure of Invention
The invention provides a remote operation control method, a remote operation control device and electronic equipment, which are used for realizing the autonomous operation of a remote expert, simplifying the control operation and improving the operation freedom degree, thereby improving the remote operation efficiency.
According to an aspect of the present invention, there is provided a remote operation control method applied to a remote control end, including:
displaying a waiting user list, wherein each waiting user in the waiting user list corresponds to at least one camera, and the camera is a camera in an operation site of the waiting user;
responding to camera selection operation triggered by a remote expert, and displaying a target operation video acquired by a currently selected target camera in real time in a video preview area;
responding to a display screen selection operation triggered by a remote expert, and sending the target operation video to a first currently selected display screen for displaying, wherein the remote control end is connected with a plurality of display screens;
responding to a posture adjustment operation triggered by a remote expert, generating a posture adjustment instruction corresponding to the target camera, and sending the posture adjustment instruction to an operation control end corresponding to a target waiting user, so that the operation control end adjusts the target camera based on the posture adjustment instruction;
and responding to an audio starting operation triggered by a remote expert, and starting a microphone and a loudspeaker of the remote control end so that the remote expert can conduct remote operation guidance on the operation site of the target waiting user.
According to another aspect of the present invention, there is provided a telesurgical control apparatus, integrated in a remote control end, comprising:
the system comprises a waiting user list display module, a waiting user selection module and a waiting user selection module, wherein the waiting user list display module is used for displaying a waiting user list, each waiting user in the waiting user list corresponds to at least one camera, and the camera is a camera in an operation site of the waiting user;
the target operation video preview module is used for responding to camera selection operation triggered by a remote expert and displaying a target operation video acquired by a currently selected target camera in real time in a video preview area;
the display screen display module is used for responding to display screen selection operation triggered by a remote expert and sending the target operation video to a first display screen selected currently for display, wherein the remote control end is connected with a plurality of display screens;
the posture adjusting module is used for responding to posture adjusting operation triggered by a remote expert, generating a posture adjusting instruction corresponding to the target camera, and sending the posture adjusting instruction to an operation control end corresponding to a target waiting user, so that the operation control end adjusts the target camera based on the posture adjusting instruction;
and the audio starting module is used for responding to an audio starting operation triggered by a remote expert and starting a microphone and a loudspeaker of the remote control end so that the remote expert can conduct remote operation guidance on the operation site of the target waiting user.
According to another aspect of the present invention, there is provided an electronic apparatus including:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores a computer program executable by the at least one processor to enable the at least one processor to perform the telesurgical control method of any of the embodiments of the present invention.
According to the technical scheme of the embodiment of the invention, the waiting user list is displayed in the remote control terminal, each waiting user in the waiting user list corresponds to at least one camera, and the camera is a camera in the operation site of the waiting user; responding to camera selection operation triggered by a remote expert, and displaying a target operation video acquired by a currently selected target camera in real time in a video preview area; responding to a display screen selection operation triggered by a remote expert, and sending a target operation video to a currently selected first display screen for displaying, wherein a remote control end is connected with a plurality of display screens; responding to the posture adjustment operation triggered by the remote expert, generating a posture adjustment instruction corresponding to the target camera, and sending the posture adjustment instruction to the operation control terminal corresponding to the target waiting user, so that the operation control terminal adjusts the target camera based on the posture adjustment instruction; the method has the advantages that the voice frequency starting operation triggered by the remote expert is responded, the microphone and the loudspeaker of the remote control end are started, so that the remote expert can conduct remote operation guidance on the operation site of the target waiting user, the independent operation and control of the remote expert are achieved, the participation of a dispatcher is not needed, the control operation is greatly simplified, the operation and control freedom degree is improved, and the remote operation efficiency is further improved.
It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present invention, nor do they necessarily limit the scope of the invention. Other features of the present invention will become apparent from the following description.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the description below are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a flow chart of a method for remote surgical control according to an embodiment of the present invention;
FIG. 2 is a diagrammatic view of a telesurgical control interface in accordance with an embodiment of the present invention;
FIG. 3 is a flow chart of a telesurgical control method according to a second embodiment of the present invention;
FIG. 4 is a diagrammatic view of a telesurgical control interface in accordance with a second embodiment of the present invention;
FIG. 5 is a schematic structural diagram of a telesurgical control apparatus according to a third embodiment of the present invention;
fig. 6 is a schematic structural diagram of an electronic device for implementing the remote operation control method according to the embodiment of the present invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Example one
Fig. 1 is a flowchart of a remote operation control method according to an embodiment of the present invention, which is applicable to a remote expert for performing remote control on a remote operation site. The method can be executed by a remote operation control device, the device can be realized in a hardware and/or software mode, the remote operation control device is integrated in a remote control end, and the remote control end can refer to any electronic equipment, such as a mobile phone, a computer and the like. As shown in fig. 1, the method includes:
and S110, displaying a waiting user list, wherein each waiting user in the waiting user list corresponds to at least one camera, and the camera is a camera in the operation site of the waiting user.
The waiting user can be a user who needs a remote expert to conduct remote operation guidance. For example, the waiting user may refer to a hospital that requires remote surgical instruction. The waiting users can be characterized by the hospital names so as to distinguish different waiting users. The number of waiting users can be one or more. The surgical site of the waiting user may refer to an operating room site where the patient is operated. The camera may be a camera deployed in a surgical field. The number of the cameras can be one or more, and the specific number of the cameras is specifically determined based on actual requirements. Every camera can be used for gathering the operation video of shooing different angles to make remote expert can look over the operation condition from different angles, and then guarantee the accuracy of operation.
Specifically, fig. 2 shows a schematic view of a telesurgical control interface of a remote control. As shown in fig. 2, each of the waiting users who the remote specialist needs the remote surgery may be presented in a waiting user list so that the remote specialist can clearly view each waiting user who needs the remote surgery.
Illustratively, S110 may include: acquiring a current user state corresponding to each waiting user in a waiting user list; displaying the online waiting users with the current user states being online states based on a first display mode so that a remote expert can select a target waiting user from the online waiting users; and displaying the offline waiting user with the current user state being an offline state based on a second display mode, wherein the first display mode is different from the second display mode.
The current user state may refer to a state of a surgical control end of the waiting user. The operation control terminal can be control equipment in an operation site of a waiting user to control the posture of a camera in the operation site and realize the functions of communication between personnel in the operation site and a remote expert and the like. The current user state includes an online state or an offline state. The online state means that the operation control end of the waiting user is online and can be in remote communication with the remote control end. The off-line state means that the operation control end of the waiting user is not on line and cannot be in remote communication with the remote control end.
Specifically, the online waiting user and the offline waiting user are respectively displayed by using different first display modes and second display modes, for example, the online waiting user is displayed in a highlight top-placing mode, and the offline waiting user is displayed in a gray scale mode, so that a remote expert can more clearly and quickly know the waiting user who can currently perform remote operation guidance, and the remote operation efficiency is further improved.
And S120, responding to the camera selection operation triggered by the remote expert, and displaying the target operation video acquired by the currently selected target camera in real time in a video preview area.
The video preview area may be an area in the remote control interface for previewing a surgical video frame, such as the video preview area shown in fig. 2.
Specifically, the remote expert may select a current waiting user needing remote waiting and a camera in the surgical site of the waiting user in a click manner. For example, if a certain waiting user corresponds to a plurality of cameras, after the remote expert clicks the waiting user, all the cameras corresponding to the waiting user can be displayed, as shown in fig. 2, the remote expert triggers a camera selection operation by clicking one of the cameras, so as to obtain a target camera currently selected by the remote expert. If a certain waiting user only corresponds to one camera, after the remote expert clicks the waiting user, the only camera of the waiting user can be directly determined as the currently selected target camera, and the remote expert does not need to click the camera again, so that the convenience of the camera selection operation is further improved. In the video preview area, the target surgery video acquired by the target camera in real time is displayed in real time, so that a remote expert can probably know the situation of the surgery site in the video preview area. By responding to the camera selection operation triggered by the remote expert, the remote expert can autonomously select the operation video collected by the camera to be checked.
It should be noted that the display content of the video preview area may be changed in real time based on the camera selection operation triggered by the remote expert, so that the video preview area always displays the operation video corresponding to the camera currently selected by the remote expert.
S130, responding to a display screen selection operation triggered by a remote expert, and sending the target operation video to a first currently selected display screen for displaying, wherein the remote control end is connected with the plurality of display screens.
The display screen can be a large screen display in front of the remote expert, so that the remote expert can more carefully and clearly view the operation picture through the larger display screen, and the accuracy of operation guidance is ensured. For example, the remote control end in fig. 2 is connected with 4 display screens, so that the remote expert can watch four different video pictures at the same time. Each picture can only be pushed to one display screen and cannot be presented on multiple display screens simultaneously.
Specifically, the remote expert may trigger a display screen selection operation in a click manner for the target surgery video displayed in the video preview area, for example, click a button of the display screen 2 in fig. 2, and may send the target surgery video to the first display screen currently selected, that is, the display screen 2 is displayed. By responding to the display screen selection operation triggered by the remote expert, the remote expert can autonomously select the operation video which is required to be viewed on a large screen.
S140, responding to the posture adjustment operation triggered by the remote expert, generating a posture adjustment instruction corresponding to the target camera, and sending the posture adjustment instruction to the operation control end corresponding to the target waiting user, so that the operation control end adjusts the target camera based on the posture adjustment instruction.
The posture adjusting instruction can be an instruction for adjusting the posture of the camera position. Specifically, as shown in fig. 2, navigation keys in four directions of up, down, left and right and a magnifying glass for magnifying and reducing the magnification can be displayed on the remote control terminal interface. The navigation key can be used for adjusting the position and the posture of the camera position up, down, left and right. The magnifying glass is used for adjusting the front-back distance of the camera, namely adjusting the magnification. Remote expert can trigger gesture adjustment operation through the mode of clicking navigation key and magnifying glass, remote control end can generate corresponding gesture adjustment instruction based on the gesture adjustment operation that triggers, and with this gesture adjustment instruction send the operation control end that target waiting user corresponds, operation control end can be based on the corresponding adjustment target camera of gesture adjustment instruction, make the camera gesture in remote expert can the independent control operation scene, thereby gather the operation video that oneself wants to look over the angle, need not the operation of third person substitute, remote operation efficiency has been improved greatly.
And S150, responding to the audio starting operation triggered by the remote expert, starting a microphone and a loudspeaker of the remote control end, so that the remote expert can conduct remote operation guidance on the operation site of the target waiting user.
Specifically, as shown in fig. 2, an icon of a microphone and a speaker may be displayed beside the name of each waiting user, and the remote expert may control the activation of the microphone and the speaker by clicking on the icon of the microphone and the speaker. When the audio starting operation triggered by the remote expert is detected, the microphone and the loudspeaker of the remote control end can be started, so that the remote expert can hear the sound of the personnel in the operation site and can also hear the sound of the remote expert, the remote expert can smoothly conduct remote operation guidance on the operation site of the target waiting user, the independent operation and control of the remote expert are realized, the operation and control freedom degree is improved, and the remote operation efficiency is further improved.
It should be noted that the present embodiment does not limit the execution sequence of steps S110-S150, and the sequence may be determined based on the sequence of remote expert triggered operations. For example, when viewing an operation video acquired by the camera 1 of the candidate user 1, the remote expert may switch to the operation video acquired by the camera 2 of the candidate user 1 or the operation video acquired by the camera 1 of the candidate user 2 at any time, and the like, and the remote expert may perform autonomous operation based on its own requirements, thereby improving the degree of freedom of operation to the maximum extent and greatly enhancing the control ability of the operation.
Exemplarily, as shown in fig. 2, a current time and a start timing button can be displayed on the remote control terminal interface, when the operation starts, the remote expert can click the start timing button to trigger the start timing operation, and the timing time is displayed in real time, so that the remote expert can know the current operation duration more conveniently, and the remote operation effect is further ensured.
Illustratively, the method may further comprise: responding to the microphone volume adjustment operation triggered by the remote expert, and adjusting the volume of the microphone at the remote control end so as to adjust the remote expert guidance volume in the operation site of the target waiting user; and responding to the volume adjustment operation of the loudspeaker triggered by the remote expert, and adjusting the volume of the loudspeaker at the remote control end so as to adjust the volume of the operation site of the target waiting user.
Specifically, as shown in fig. 2, a microphone volume adjustment frame and a speaker volume adjustment frame may be exhibited. The remote expert can trigger the microphone volume adjustment operation in a mode of sliding the microphone volume adjustment frame, and the remote control end can correspondingly adjust the microphone volume based on the microphone volume adjustment operation, so that personnel in the operation site can more clearly hear the remote expert guidance sound. The remote expert can trigger the loudspeaker volume adjustment operation through the mode of sliding the loudspeaker volume adjustment frame, and the remote control end can correspondingly adjust the loudspeaker volume based on the loudspeaker volume adjustment operation, so that the remote expert can more clearly hear the sound of the operation site personnel site, and the remote operation effect is further ensured.
According to the technical scheme of the embodiment of the invention, the waiting user list is displayed in the remote control terminal, each waiting user in the waiting user list corresponds to at least one camera, and the camera is a camera in the operation site of the waiting user; responding to camera selection operation triggered by a remote expert, and displaying a target operation video acquired by a currently selected target camera in real time in a video preview area; responding to a display screen selection operation triggered by a remote expert, and sending a target operation video to a currently selected first display screen for displaying, wherein a remote control end is connected with a plurality of display screens; responding to the posture adjustment operation triggered by the remote expert, generating a posture adjustment instruction corresponding to the target camera, and sending the posture adjustment instruction to the operation control terminal corresponding to the target waiting user, so that the operation control terminal adjusts the target camera based on the posture adjustment instruction; the method has the advantages that the voice frequency starting operation triggered by the remote expert is responded, the microphone and the loudspeaker of the remote control end are started, so that the remote expert can conduct remote operation guidance on the operation site of the target waiting user, the independent operation and control of the remote expert are achieved, the participation of a dispatcher is not needed, the control operation is greatly simplified, the operation and control freedom degree is improved, and the remote operation efficiency is further improved.
On the basis of the above technical solution, the method may further include: responding to resolution selection operation triggered by a remote expert, sending the currently selected target resolution to an operation control end corresponding to a target waiting user, so that the operation control end performs resolution adjustment on the acquired target operation video based on the target resolution, and returning the target operation video with the target resolution; and responding to a bandwidth selection operation triggered by a remote expert, sending the currently selected target bandwidth to a surgery control end corresponding to the target waiting user, so that the surgery control end performs bandwidth adjustment on the acquired target surgery video based on the target bandwidth, and returning the target surgery video with the target bandwidth.
Specifically, as shown in fig. 2, a resolution selection box and a bandwidth selection box may be exhibited on the remote control-side interface. The remote expert may select the desired video resolution to view in the resolution selection box and select the appropriate bandwidth in the bandwidth selection box. When the network communication quality is poor, a remote expert can automatically adjust the resolution and the bandwidth of the video and reduce the network speed requirement, so that the situation of audio and video blockage caused by poor network is avoided, and the optimal effect of audio and video interaction is further ensured.
On the basis of the above technical solution, the method may further include: displaying a plurality of preset bit identifications; and responding to the posture storage operation and the preset bit identifier selection operation triggered by the remote expert, and performing associated storage on the currently adjusted posture information of the first camera and the currently selected first preset bit identifier.
The preset position identifier may be preset identifier information displayed on the remote control terminal interface. For example, 3 different preset bit identifications, "1", "2" and "3", are shown in FIG. 2. The number of preset bit identifications can be set based on service requirements.
Specifically, as shown in fig. 2, a plurality of preset bit identifiers and a setting button may be displayed on the remote control interface, and the gesture storage operation may be triggered by selecting the setting button, and the preset bit identifier selection operation may be triggered by clicking a specific preset bit identifier. The remote control terminal can store the currently adjusted first camera attitude information and the currently selected first preset bit identifier in an associated manner, that is, a mapping relation between the first camera attitude information and the first preset bit identifier is established, so that the currently adjusted first camera attitude information can be stored.
Illustratively, the method may further comprise: responding to preset bit identification selection operation triggered by a remote expert, and determining second camera attitude information corresponding to a currently selected second preset bit identification based on an incidence relation between the preset bit identification and the camera attitude information; and generating a corresponding posture adjusting instruction based on the posture information of the second camera, and sending the posture adjusting instruction to the operation control end corresponding to the current waiting user, so that the operation control end adjusts the current camera based on the posture adjusting instruction.
The current waiting user may refer to a waiting user currently selected by a remote expert. The current camera may refer to a camera currently selected by the remote expert among the current waiting users.
Specifically, when the camera posture needs to be adjusted, the remote expert can trigger the preset bit identifier selection operation in a mode of clicking the preset bit identifier. And the remote control terminal determines second camera attitude information corresponding to the currently selected second preset bit identifier from the mapping relation between the prestored camera attitude information and the preset bit identifier based on the preset bit identifier selection operation, generates an attitude adjusting instruction corresponding to the second camera attitude information, and sends the attitude adjusting instruction to the operation control terminal corresponding to the current waiting user, and the operation control terminal can adjust the current camera based on the attitude adjusting instruction. Through triggering the preset position identification selection operation, the original preset machine position can be adjusted by one key, the repeated adjustment of a remote expert is not needed, and the remote operation efficiency is greatly improved.
Example two
Fig. 3 is a flowchart of a remote surgery control method according to a second embodiment of the present invention, and this embodiment describes in detail a screen-combining manner of multiple surgery videos based on the second embodiment. Wherein explanations of the same or corresponding terms as those of the above embodiments are omitted.
Referring to fig. 3, the remote operation control method provided in this embodiment specifically includes the following steps:
s310, displaying a waiting user list, wherein each waiting user in the waiting user list corresponds to at least one camera, and the camera is a camera in an operation site of the waiting user.
And S320, responding to the camera selection operation triggered by the remote expert, and displaying the target operation video acquired by the currently selected target camera in real time in a video preview area.
S330, responding to a display screen selection operation triggered by a remote expert, and sending the target operation video to a first currently selected display screen for displaying, wherein the remote control end is connected with the plurality of display screens.
S340, responding to the posture adjustment operation triggered by the remote expert, generating a posture adjustment instruction corresponding to the target camera, and sending the posture adjustment instruction to the operation control end corresponding to the target waiting user, so that the operation control end adjusts the target camera based on the posture adjustment instruction.
And S350, responding to the audio starting operation triggered by the remote expert, starting a microphone and a loudspeaker of the remote control end, so that the remote expert can conduct remote operation guidance on the operation site of the target waiting user.
S360, responding to a first screen-closing picture operation triggered by a remote expert, performing screen-closing processing on the operation video acquired by each camera corresponding to the target waiting user in real time based on first preset screen-closing layout information, covering the screen-closing operation video on the target operation video, and displaying the screen-closing operation video in a video preview area.
The first preset screen-closing layout information can be preset display layout information corresponding to all the operation videos collected by all the cameras of the same waiting user. For example, the video preview area is divided based on the maximum number of cameras corresponding to the same waiting user, and the position information for displaying the operation video acquired by each camera is determined. Fig. 4 shows a schematic view of a telesurgical control interface of a remote control. As shown in fig. 4, if there are at most 4 cameras, the video preview area is divided into 4 blocks on average, and each block shows the operation video captured by one camera.
Specifically, as shown in fig. 4, a first screen-closing picture button can be displayed on the remote control terminal interface, a remote expert can trigger a first screen-closing picture operation by clicking the first screen-closing picture button, and based on first preset screen-closing layout information, the screen-closing processing is performed on the operation video acquired by each camera corresponding to the target waiting user in real time, so as to obtain a screen-closing operation video, the screen-closing operation video covers the originally displayed target operation video, and the video is displayed in the video preview area, so that the display content of the video preview area is always consistent with the trigger operation of the remote expert, thereby avoiding the display disorder of the operation video, and further ensuring the remote operation effect. The lower right corner position of each operation video in the screen-closed operation videos can show the source information of the operation video so as to clearly prompt a remote expert. The operation videos collected by all the cameras of the same waiting user are displayed in a screen-closing mode, so that a remote expert can know the shooting angle of each camera simultaneously, the operation videos with the appropriate angles can be selected more quickly, and the remote operation efficiency is further improved.
For example, as shown in fig. 4, if the remote expert currently selects the waiting user 1, and the waiting user 1 has only 2 cameras, the operation video collected by the video head 1 of the waiting user 1 is displayed at the position of the first operation video 1, the operation video collected by the video head 2 of the waiting user 1 is displayed at the position of the second operation video 2, and the positions of the other operation videos 3 and 4 are subjected to the emptying processing.
It should be noted that the execution sequence of S360 is not limited in this embodiment, and it may be executed after any one step, and the determination is performed based on the trigger time of the remote expert.
Exemplarily, after S360, the method may further include: responding to a display screen selection operation triggered by a remote expert, and acquiring a currently selected second display screen; if the second display screen is different from the first display screen, sending the screen-combination operation video to the second display screen for displaying; and if the second display screen is the same as the first display screen, stopping displaying the target operation video, and sending the screen-closed operation video to the first display screen for displaying.
Specifically, the remote expert may project a currently displayed video picture in the video preview area onto a different display screen by selecting the different display screen. The remote specialist can directly show the video picture currently shown in the video preview area in the display screen when selecting the display screen without the operation video. When the remote expert selects the display screen with the operation video already projected, the remote expert can stop the operation video being displayed in the display screen and start displaying the video picture currently displayed in the video preview area.
According to the technical scheme, through responding to the first screen-closing picture operation triggered by the remote expert, on the basis of first preset screen-closing layout information, the operation videos acquired by each camera corresponding to the target waiting user in real time are subjected to screen-closing processing to obtain screen-closing operation videos, the screen-closing operation videos cover the originally displayed target operation videos and are displayed in a video preview area, the display content of the video preview area and the triggering operation of the remote expert are always kept consistent, the disorder of the display of the operation videos is avoided, and the remote operation effect is further guaranteed. And the operation videos collected by all cameras of the same waiting user are displayed in a screen-closing mode, so that a remote expert can know the shooting angles of all the cameras simultaneously, the operation videos with the appropriate angles can be selected more quickly, and the remote operation efficiency is further improved.
On the basis of the technical scheme, the method further comprises the following steps: responding to a second screen-closing picture operation triggered by a remote expert, carrying out screen-closing processing on an operation video acquired by a preset camera of each online waiting user in the waiting user list in real time based on second preset screen-closing layout information, and displaying the screen-closing operation video in a video preview area.
The second preset screen-closing layout information may be preset display layout information corresponding to the operation video acquired by the preset camera of each candidate user in the waiting user list. The preset camera can be a randomly selected camera or can be set as the first camera in a camera list. For example, the video preview area may be divided based on the number of waiting users, and the position information for displaying the operation video acquired by one camera of each waiting user is determined.
Specifically, as shown in fig. 4, a second screen-closing picture button may be displayed on the remote control terminal interface, a remote expert may trigger a second screen-closing picture operation by clicking the second screen-closing picture button, and based on second preset screen-closing layout information, the operation video acquired in real time by the preset camera of each online waiting user in the waiting user list is subjected to screen-closing processing to obtain a screen-closing operation video, and the screen-closing operation video is overlaid on the originally displayed operation video and displayed in the video preview area, so that the display content of the video preview area is always consistent with the trigger operation of the remote expert, thereby avoiding the displaying confusion of the operation video and further ensuring the remote operation effect. The lower right corner position of each operation video in the screen-closed operation videos can show the source information of the operation video so as to prompt the remote expert more clearly. The operation videos collected by one camera of all the online waiting users are displayed in a screen-closing mode, so that a remote expert can know the operation preparation conditions of different online waiting users at the same time, the waiting user most suitable for starting to perform the operation at present can be selected more quickly, and the remote operation efficiency is further improved.
Illustratively, the remote expert can automatically call and switch the waiting users, so that multiple operations can be performed alternately, guidance time is comprehensively distributed under the condition that the progress of each operation is not interfered with each other, and the comprehensive operation efficiency is further ensured. For example, the remote expert first previews and knows the overall scheduling status of the remote operation on the same day through the candidate user list and the second screen-closing screen operation. And then starting timing, starting the first operation audio (the default audio initial state is silent) to communicate with site personnel in the first operation site by voice, simultaneously pushing the operation video to a display screen in front, and obtaining the optimal machine position angle by adjusting the posture of the camera. When a first operation is carried out to a non-guidance stage, a remote expert can check the preparation condition of the next operation through a preview picture, if the preparation is finished, the first operation audio can be closed, the second operation audio is opened for voice communication, and meanwhile, the operation live-action video picture is pushed to a display screen in front for operation guidance. When the second operation is carried out to the non-guidance stage, the remote expert can estimate the time according to the clock and the timer and return the verification result after the first examination. After verification is finished, a third operation guide can be cut in, and the rest can be done in the same way, so that the interaction of multiple operations is realized, and the efficiency and the safety of the remote operation are further improved.
The following is an embodiment of a remote operation control device provided in an embodiment of the present invention, which belongs to the same inventive concept as the remote operation control method in each of the above embodiments, and reference may be made to the above embodiment of the remote operation control method for details that are not described in detail in the embodiment of the remote operation control device.
EXAMPLE III
Fig. 5 is a schematic structural diagram of a remote operation control device according to a third embodiment of the present invention. As shown in fig. 5, the apparatus is integrated in a remote control terminal, and specifically includes: a waiting user list display module 510, a target operation video preview module 520, a display screen display module 530, a posture adjustment module 540 and an audio starting module 550.
The waiting user list display module 510 is configured to display a waiting user list, where each waiting user in the waiting user list corresponds to at least one camera, and the camera is a camera in an operation site of the waiting user; a target surgery video preview module 520, configured to display a target surgery video acquired by a currently selected target camera in real time in a video preview area in response to a camera selection operation triggered by a remote expert; a display screen display module 530, configured to send the target surgery video to a currently selected first display screen for display in response to a display screen selection operation triggered by a remote expert, where the remote control end is connected to multiple display screens; the posture adjusting module 540 is configured to generate a posture adjusting instruction corresponding to the target camera in response to a posture adjusting operation triggered by a remote expert, and send the posture adjusting instruction to an operation control terminal corresponding to a target waiting user, so that the operation control terminal adjusts the target camera based on the posture adjusting instruction; and the audio starting module 550 is configured to start a microphone and a speaker of the remote control end in response to an audio starting operation triggered by the remote expert, so that the remote expert performs remote surgical guidance on the surgical site of the target waiting user.
Optionally, the waiting user list display module 510 is specifically configured to:
acquiring a current user state corresponding to each waiting user in a waiting user list; displaying the online waiting users with the current user states being online states based on a first display mode so that a remote expert can select a target waiting user from the online waiting users; and displaying the offline waiting user of which the current user state is an offline state based on a second display mode, wherein the first display mode is different from the second display mode.
Optionally, the apparatus further comprises:
and the first screen-combining module is used for responding to a first screen-combining picture operation triggered by a remote expert, combining the operation videos acquired by each camera corresponding to the target waiting user in real time based on first preset screen-combining layout information, covering the combined screen operation videos on the target operation videos, and displaying the combined screen operation videos in the video preview area.
Optionally, the display screen displaying module 530 further has:
after the screen-closed operation video is overlaid on the target operation video and displayed in the video preview area, responding to a display screen selection operation triggered by a remote expert, and acquiring a currently selected second display screen; if the second display screen is different from the first display screen, sending the screen-combination operation video to the second display screen for displaying; and if the second display screen is the same as the first display screen, stopping displaying the target operation video, and sending the screen-closed operation video to the first display screen for displaying.
Optionally, the apparatus further comprises:
and the second screen-combining module is used for responding to a second screen-combining picture operation triggered by the remote expert, performing screen-combining processing on the operation video acquired by the preset camera of each online waiting user in the waiting user list in real time based on second preset screen-combining layout information, and displaying the screen-combined operation video in a video preview area.
Optionally, the apparatus further comprises:
the preset bit identifier display module is used for displaying a plurality of preset bit identifiers;
and the association storage module is used for responding to the posture storage operation and the preset bit identifier selection operation triggered by the remote expert and performing association storage on the currently adjusted first camera posture information and the currently selected first preset bit identifier.
Optionally, the posture adjusting module 540 is further specifically configured to:
responding to preset bit identification selection operation triggered by a remote expert, and determining second camera attitude information corresponding to a currently selected second preset bit identification based on an incidence relation between the preset bit identification and the camera attitude information; and generating a corresponding posture adjusting instruction based on the second camera posture information, and sending the posture adjusting instruction to the operation control terminal corresponding to the current waiting user, so that the operation control terminal adjusts the current camera based on the posture adjusting instruction.
Optionally, the apparatus further comprises:
the resolution adjustment module is used for responding to resolution selection operation triggered by a remote expert, sending the currently selected target resolution to an operation control end corresponding to the target waiting user, so that the operation control end performs resolution adjustment on the acquired target operation video based on the target resolution, and returning the target operation video with the target resolution;
and the bandwidth adjusting module is used for responding to a bandwidth selecting operation triggered by a remote expert, sending the currently selected target bandwidth to the operation control end corresponding to the target waiting user, so that the operation control end performs bandwidth adjustment on the acquired target operation video based on the target bandwidth, and returning the target operation video with the target bandwidth.
The remote operation control device provided by the embodiment of the invention can execute the remote operation control method provided by any embodiment of the invention, and has corresponding functional modules and beneficial effects for executing the remote operation control method.
It should be noted that, in the embodiment of the remote operation control device, the included units and modules are merely divided according to the functional logic, but are not limited to the above division, as long as the corresponding functions can be realized; in addition, specific names of the functional units are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the present invention.
Example four
FIG. 6 illustrates a schematic structural diagram of an electronic device 10 that may be used to implement an embodiment of the present invention. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital assistants, cellular phones, smart phones, wearable devices (e.g., helmets, glasses, watches, etc.), and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the inventions described and/or claimed herein.
As shown in fig. 4, the electronic device 10 includes at least one processor 11, and a memory communicatively connected to the at least one processor 11, such as a Read Only Memory (ROM) 12, a Random Access Memory (RAM) 13, and the like, wherein the memory stores a computer program executable by the at least one processor, and the processor 11 can perform various suitable actions and processes according to the computer program stored in the Read Only Memory (ROM) 12 or the computer program loaded from a storage unit 18 into the Random Access Memory (RAM) 13. In the RAM 13, various programs and data necessary for the operation of the electronic apparatus 10 may also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other via a bus 14. An input/output (I/O) interface 15 is also connected to bus 14.
A number of components in the electronic device 10 are connected to the I/O interface 15, including: an input unit 16 such as a keyboard, a mouse, or the like; an output unit 17 such as various types of displays, speakers, and the like; a storage unit 18 such as a magnetic disk, an optical disk, or the like; and a communication unit 19 such as a network card, modem, wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information/data with other devices via a computer network such as the internet and/or various telecommunication networks.
In some embodiments, the telesurgical control method may be implemented as a computer program tangibly embodied in a computer-readable storage medium, such as storage unit 18. In some embodiments, part or all of the computer program may be loaded and/or installed onto the electronic device 10 via the ROM 12 and/or the communication unit 19. When the computer program is loaded into RAM 13 and executed by processor 11, one or more steps of the telesurgical control method described above may be performed. Alternatively, in other embodiments, the processor 11 may be configured to perform the telesurgical control method by any other suitable means (e.g., by means of firmware).
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), system on a chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
The computer program for implementing the telesurgical control method of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the computer programs, when executed by the processor, cause the functions/acts specified in the flowchart and/or block diagram block or blocks to be performed. A computer program can execute entirely on a machine, partly on a machine, as a stand-alone software package partly on a machine and partly on a remote machine or entirely on a remote machine or server.
In the context of the present invention, a computer-readable storage medium may be a tangible medium that can contain, or store a computer program for use by or in connection with an instruction execution system, apparatus, or device. A computer readable storage medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. Alternatively, the computer readable storage medium may be a machine readable signal medium. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the electronic device. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form, including acoustic, speech, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), blockchain networks, and the Internet.
The computing system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also called a cloud computing server or a cloud host, and is a host product in a cloud computing service system, so that the defects of high management difficulty and weak service expansibility in the traditional physical host and VPS service are overcome.
It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present invention may be executed in parallel, sequentially, or in different orders, and are not limited herein as long as the desired results of the technical solution of the present invention can be achieved.
The above-described embodiments should not be construed as limiting the scope of the invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (10)
1. A remote operation control method is applied to a remote control end and comprises the following steps:
displaying a waiting user list, wherein each waiting user in the waiting user list corresponds to at least one camera, and the camera is a camera in an operation site of the waiting user;
responding to camera selection operation triggered by a remote expert, and displaying a target operation video acquired by a currently selected target camera in real time in a video preview area;
responding to a display screen selection operation triggered by a remote expert, and sending the target operation video to a first currently selected display screen for displaying, wherein the remote control end is connected with a plurality of display screens;
responding to a posture adjustment operation triggered by a remote expert, generating a posture adjustment instruction corresponding to the target camera, and sending the posture adjustment instruction to an operation control terminal corresponding to a target waiting user, so that the operation control terminal adjusts the target camera based on the posture adjustment instruction;
and responding to an audio starting operation triggered by a remote expert, and starting a microphone and a loudspeaker of the remote control end so that the remote expert can conduct remote operation guidance on the operation site of the target waiting user.
2. The method of claim 1, wherein said presenting a list of waiting users comprises:
acquiring a current user state corresponding to each waiting user in a waiting user list;
displaying the online waiting users with the current user states being online states based on a first display mode so that a remote expert can select a target waiting user from the online waiting users;
and displaying the offline waiting user of which the current user state is an offline state based on a second display mode, wherein the first display mode is different from the second display mode.
3. The method of claim 1, further comprising:
responding to a first screen-closing picture operation triggered by a remote expert, carrying out screen-closing processing on an operation video acquired by each camera corresponding to the target waiting user in real time based on first preset screen-closing layout information, covering the target operation video with the screen-closing operation video, and displaying the screen-closing operation video in the video preview area.
4. The method of claim 3, wherein after overlaying the target procedure video with a closed-screen procedure video for presentation in a video preview area, further comprising:
responding to a display screen selection operation triggered by a remote expert, and acquiring a currently selected second display screen;
if the second display screen is different from the first display screen, sending the screen-combination operation video to the second display screen for displaying;
and if the second display screen is the same as the first display screen, stopping displaying the target operation video, and sending the screen-closed operation video to the first display screen for displaying.
5. The method of claim 1, further comprising:
responding to a second screen-closing picture operation triggered by a remote expert, performing screen-closing processing on the operation video acquired by the preset camera of each online waiting user in the waiting user list in real time based on second preset screen-closing layout information, and displaying the screen-closing operation video in a video preview area.
6. The method of claim 1, further comprising:
displaying a plurality of preset bit identifications;
and responding to the posture storage operation and the preset bit identifier selection operation triggered by the remote expert, and performing associated storage on the currently adjusted posture information of the first camera and the currently selected first preset bit identifier.
7. The method of claim 6, further comprising:
responding to a preset bit identifier selection operation triggered by a remote expert, and determining second camera attitude information corresponding to a currently selected second preset bit identifier based on an incidence relation between the preset bit identifier and the camera attitude information;
and generating a corresponding posture adjusting instruction based on the second camera posture information, and sending the posture adjusting instruction to the operation control terminal corresponding to the current waiting user, so that the operation control terminal adjusts the current camera based on the posture adjusting instruction.
8. The method according to any one of claims 1-7, further comprising:
responding to resolution selection operation triggered by a remote expert, sending the currently selected target resolution to a surgery control end corresponding to the target waiting user, so that the surgery control end performs resolution adjustment on the acquired target surgery video based on the target resolution, and returning the target surgery video with the target resolution;
and responding to a bandwidth selection operation triggered by a remote expert, sending the currently selected target bandwidth to an operation control end corresponding to the target waiting user, so that the operation control end performs bandwidth adjustment on the acquired target operation video based on the target bandwidth, and returning the target operation video with the target bandwidth.
9. A telesurgical control device, integrated in a remote control terminal, comprising:
the system comprises a waiting user list display module, a waiting user selection module and a waiting user selection module, wherein the waiting user list display module is used for displaying a waiting user list, each waiting user in the waiting user list corresponds to at least one camera, and the camera is a camera in an operation site of the waiting user;
the target operation video preview module is used for responding to camera selection operation triggered by a remote expert and displaying a target operation video acquired by a currently selected target camera in real time in a video preview area;
the display screen display module is used for responding to display screen selection operation triggered by a remote expert and sending the target operation video to a first display screen selected currently for display, wherein the remote control end is connected with a plurality of display screens;
the posture adjusting module is used for responding to a posture adjusting operation triggered by a remote expert, generating a posture adjusting instruction corresponding to the target camera, and sending the posture adjusting instruction to an operation control terminal corresponding to a target waiting user, so that the operation control terminal adjusts the target camera based on the posture adjusting instruction;
and the audio starting module is used for responding to an audio starting operation triggered by a remote expert and starting a microphone and a loudspeaker of the remote control end so that the remote expert can conduct remote operation guidance on the operation site of the target waiting user.
10. An electronic device, characterized in that the electronic device comprises:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores a computer program executable by the at least one processor to enable the at least one processor to perform the telesurgical control method of any one of claims 1-8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211670504.5A CN115643365B (en) | 2022-12-26 | 2022-12-26 | Remote operation control method and device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211670504.5A CN115643365B (en) | 2022-12-26 | 2022-12-26 | Remote operation control method and device and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115643365A true CN115643365A (en) | 2023-01-24 |
| CN115643365B CN115643365B (en) | 2023-03-28 |
Family
ID=84949919
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211670504.5A Active CN115643365B (en) | 2022-12-26 | 2022-12-26 | Remote operation control method and device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115643365B (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5537153A (en) * | 1992-11-16 | 1996-07-16 | Kabushiki Kaisha Toshiba | Television signal transmission and reception system with multi-screen display for tuning operation |
| CN101742222A (en) * | 2009-12-30 | 2010-06-16 | 华为终端有限公司 | Operation method for camera position and video conference terminal |
| US20160127712A1 (en) * | 2013-06-27 | 2016-05-05 | Abb Technology Ltd | Method and video communication device for transmitting video to a remote user |
| CN106210764A (en) * | 2015-04-29 | 2016-12-07 | 北京视联动力国际信息技术有限公司 | The conjunction screen processing method of a kind of multichannel media stream and system |
| CN106254383A (en) * | 2016-09-13 | 2016-12-21 | 上海市徐汇区中心医院 | Hospital's remote diagnosis method |
| CN107224332A (en) * | 2017-06-02 | 2017-10-03 | 青岛大学附属医院 | Digital Operating Room automatic control system |
| US20170316705A1 (en) * | 2016-04-27 | 2017-11-02 | David Paul Schultz | System, Apparatus and Methods for Telesurgical Mentoring Platform |
| US20200120308A1 (en) * | 2017-06-14 | 2020-04-16 | Roborep Inc. | Telepresence Management |
| CN112185541A (en) * | 2020-09-28 | 2021-01-05 | 上海群医信息科技有限公司 | High-reliability remote real-time operation guidance platform |
| CN115134523A (en) * | 2022-06-20 | 2022-09-30 | 阿波罗智联(北京)科技有限公司 | Remote control method, device, operation terminal, control device and storage medium |
-
2022
- 2022-12-26 CN CN202211670504.5A patent/CN115643365B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5537153A (en) * | 1992-11-16 | 1996-07-16 | Kabushiki Kaisha Toshiba | Television signal transmission and reception system with multi-screen display for tuning operation |
| CN101742222A (en) * | 2009-12-30 | 2010-06-16 | 华为终端有限公司 | Operation method for camera position and video conference terminal |
| US20160127712A1 (en) * | 2013-06-27 | 2016-05-05 | Abb Technology Ltd | Method and video communication device for transmitting video to a remote user |
| CN106210764A (en) * | 2015-04-29 | 2016-12-07 | 北京视联动力国际信息技术有限公司 | The conjunction screen processing method of a kind of multichannel media stream and system |
| US20170316705A1 (en) * | 2016-04-27 | 2017-11-02 | David Paul Schultz | System, Apparatus and Methods for Telesurgical Mentoring Platform |
| CN106254383A (en) * | 2016-09-13 | 2016-12-21 | 上海市徐汇区中心医院 | Hospital's remote diagnosis method |
| CN107224332A (en) * | 2017-06-02 | 2017-10-03 | 青岛大学附属医院 | Digital Operating Room automatic control system |
| US20200120308A1 (en) * | 2017-06-14 | 2020-04-16 | Roborep Inc. | Telepresence Management |
| CN112185541A (en) * | 2020-09-28 | 2021-01-05 | 上海群医信息科技有限公司 | High-reliability remote real-time operation guidance platform |
| CN115134523A (en) * | 2022-06-20 | 2022-09-30 | 阿波罗智联(北京)科技有限公司 | Remote control method, device, operation terminal, control device and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115643365B (en) | 2023-03-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10334002B2 (en) | Communication device and method | |
| US10057542B2 (en) | System for immersive telepresence | |
| EP3430802B1 (en) | Selectable interaction elements in a 360-degree video stream | |
| US9049341B2 (en) | Method and apparatus for video resource management in video conference | |
| CN110326290A (en) | It is watched while live content and the content of recording | |
| US20150201162A1 (en) | Displaying information about at least one participant in a video conference session | |
| CN109068161B (en) | Equipment connection establishing method and device | |
| AU2013236158A1 (en) | Teleconference system and teleconference terminal | |
| JP2016500983A (en) | Method and system for managing virtual meetings (virtual meetings) | |
| JP6684952B1 (en) | Content distribution device, content distribution program, content distribution method, content display device, content display program, and content display method | |
| CN112416284A (en) | Method, apparatus, device and storage medium for sharing screen | |
| CN112911190A (en) | Remote assistance method, electronic equipment and system | |
| US20160294892A1 (en) | Storage Medium Storing Program, Server Apparatus, and Method of Controlling Server Apparatus | |
| CN107888965A (en) | Image present methods of exhibiting and device, terminal, system, storage medium | |
| JP2023073359A (en) | Information output method, information output device and program | |
| US11294474B1 (en) | Controlling video data content using computer vision | |
| CN115643365B (en) | Remote operation control method and device and electronic equipment | |
| JP2018036844A (en) | Information processing system, information processing method, and program | |
| JP2019117997A (en) | Web conference system, control method of web conference system, and program | |
| CN112528052A (en) | Multimedia content output method, device, electronic equipment and storage medium | |
| EP3570187A1 (en) | Display control apparatus, display control method, and display control server | |
| JP7178015B2 (en) | online meeting system | |
| CN115665398B (en) | Image adjusting method, device, equipment and medium based on virtual reality technology | |
| CN113823283B (en) | Information processing method, apparatus, storage medium, and program product | |
| US20240155009A1 (en) | Conference terminal and control method and apparatus thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |