WO2015131577A1 - 一种远程协助方法、装置和计算机存储介质 - Google Patents
一种远程协助方法、装置和计算机存储介质 Download PDFInfo
- Publication number
- WO2015131577A1 WO2015131577A1 PCT/CN2014/092501 CN2014092501W WO2015131577A1 WO 2015131577 A1 WO2015131577 A1 WO 2015131577A1 CN 2014092501 W CN2014092501 W CN 2014092501W WO 2015131577 A1 WO2015131577 A1 WO 2015131577A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- terminal
- video
- remote assistance
- screenshot
- video call
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 39
- 238000003860 storage Methods 0.000 title claims abstract description 13
- 230000000977 initiatory effect Effects 0.000 claims abstract description 10
- 239000000284 extract Substances 0.000 claims description 6
- 230000006870 function Effects 0.000 description 10
- 238000010586 diagram Methods 0.000 description 8
- 238000004590 computer program Methods 0.000 description 6
- 238000004891 communication Methods 0.000 description 3
- 238000010295 mobile communication Methods 0.000 description 2
- 238000003825 pressing Methods 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
- H04L65/1083—In-session procedures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
- H04L65/1069—Session establishment or de-establishment
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/40—Support for services or applications
- H04L65/401—Support for services or applications wherein the services involve a main real-time session and one or more additional parallel real-time or time sensitive sessions, e.g. white board sharing or spawning of a subconference
- H04L65/4015—Support for services or applications wherein the services involve a main real-time session and one or more additional parallel real-time or time sensitive sessions, e.g. white board sharing or spawning of a subconference where at least one of the additional parallel sessions is real time or time sensitive, e.g. white board sharing, collaboration or spawning of a subconference
Definitions
- the present invention relates to the field of mobile communications, and in particular, to a remote assistance method, apparatus, and computer storage medium.
- embodiments of the present invention are expected to provide a remote assistance method, apparatus, and computer storage medium.
- An embodiment of the present invention provides a remote assistance method, where the method includes:
- the first terminal After the first terminal establishes a video call with the second terminal, the first terminal initiates a remote assistance request to the second terminal;
- the first terminal acquires a screenshot of the user and sends the screenshot to the second terminal through the video channel established in the video call, and simultaneously passes through the voice channel.
- the second terminal sends voice data.
- the first terminal acquires a screenshot of itself, including:
- the first terminal switches the screen to the standby screen, and acquires a screenshot according to the preset rate, and saves the screenshot in the buffer area.
- the operation instruction is received, and the corresponding operation is performed according to the operation instruction.
- the first terminal sends the obtained screenshot to the second terminal through the video channel established in the video call, including:
- the first terminal extracts a screenshot from the buffer as the video data is sent to the second terminal through the video channel according to the code rate and the number of frames used by the video channel in the video call.
- the method further includes:
- the first terminal When the first terminal receives the instruction to end the remote assistance, it stops sending the screenshot from the video channel to the second terminal, starts the camera to acquire the camera data, and sends the local camera data to the second terminal through the video channel.
- the embodiment of the present invention provides a remote assistance device, which is located on a first terminal, and includes: a first video call setup module, a remote assistance request initiation module, and a first video processing module;
- the first video call establishing module is configured to establish a video call with the second terminal
- the remote assistance request initiating module is configured to initiate a remote assistance request to the second terminal after establishing a video call with the second terminal;
- the first video processing module is configured to: after receiving the remote assistance request, the second terminal acquires a screenshot of the first terminal and sends the screenshot to the second terminal by using a video channel established in the video call.
- the first video processing module is further configured to obtain a screenshot of the first terminal by:
- the device also includes a control module,
- It is configured to receive an operation instruction, and perform a corresponding operation according to the operation instruction.
- the first video processing module is further configured to send the acquired screenshot to the second terminal by using a video channel established in the video call by:
- the first terminal extracts a screenshot from the buffer as the video data is sent to the second terminal through the video channel according to the code rate and the number of frames used by the video channel in the video call.
- the first video processing module is further configured to receive an instruction to end the remote assistance, and when receiving the instruction to end the remote assistance, stop sending a screenshot from the video channel to the second terminal, and start the camera to obtain the camera data. And transmitting local camera data to the second terminal through the video channel.
- Embodiments of the present invention also provide a computer storage medium, the storage medium comprising a set of computer executable instructions for performing the remote assistance method described above.
- the remote assistance method, device and computer storage medium provided by the embodiment of the present invention, after the first terminal establishes a video call with the second terminal, the first terminal initiates a remote assistance request to the second terminal; when the second terminal accepts the After the remote assistance request, the first terminal acquires its own screenshot and sends it to the second terminal through the video channel established in the video call, and simultaneously transmits the voice data to the second terminal through the voice channel.
- the second terminal user can obtain the screenshot of the first terminal in real time, and perform voice communication with the first terminal user through the voice channel in the video communication, so that the first terminal is timely and accurate.
- the user provides operational instructions.
- FIG. 1 is a flowchart 1 of a remote assistance method according to an embodiment of the present invention
- FIG. 2 is a schematic diagram of processing of a terminal in a video call according to an embodiment of the present invention
- FIG. 3 is a schematic diagram of processing of a terminal in a remote assistance method according to an embodiment of the present disclosure
- FIG. 4 is a second flowchart of a remote assistance method according to an embodiment of the present invention.
- FIG. 5 is a first structural diagram 1 of a remote assistance apparatus according to an embodiment of the present invention.
- FIG. 6 is a second structural diagram of a remote assistance device according to an embodiment of the present invention.
- FIG. 7 is a schematic structural diagram of a terminal according to an embodiment of the present invention.
- the first terminal after the first terminal establishes a video call with the second terminal, the first terminal initiates a remote assistance request to the second terminal; after the second terminal accepts the remote assistance request, the first terminal acquires a screenshot of the user.
- the video channel established in the video call is sent to the second terminal, and the voice data is sent to the second terminal through the voice channel.
- a first embodiment of the present invention provides a remote assistance method. As shown in FIG. 1, the method includes the following steps:
- Step 101 After the first terminal establishes a video call with the second terminal, the first terminal initiates a remote assistance request to the second terminal.
- the first terminal After the first terminal establishes a video call with the second terminal, the video channel and the voice channel establish a connection at the same time, the first terminal sends the camera data to the second terminal through the video channel, and sends the voice data to the second terminal through the voice channel; the camera The data refers to the video data captured by the first terminal camera; the voice data refers to the first terminal refers to the voice data collected by the first terminal microphone; at this time, as shown in FIG. 2, the first terminal and the second terminal The voice data is transmitted between each other through the voice channel, and the video data (that is, the picture captured by the respective cameras) is transmitted through the video channel. Therefore, the first terminal and the second terminal user see the video content are captured by the camera of the other user terminal.
- the first terminal user initiates a remote assistance request to the second terminal user when the first terminal user needs the remote assistance of the second terminal user; in a specific implementation, the first terminal user can select the screen during the video call Corresponding option or pressing a specific button on the terminal to trigger the first terminal to initiate to the second terminal Cheng request for assistance; or, a first end-user prior to initiating a video call request to the second end user, by selecting the appropriate option on the screen or
- the remote assistance function is activated by pressing a specific button on the terminal. After the video call is established, the first terminal determines whether the remote assistance function is enabled, and if so, initiates a remote assistance request to the second terminal.
- Step 102 After the second terminal accepts the remote assistance request, the first terminal acquires a screenshot of the user and sends the screenshot to the second terminal through the video channel established in the video call.
- the second terminal user After receiving the remote assistance request sent by the first terminal user, the second terminal user selects whether to accept the remote assistance request according to the actual situation, and returns a response message to the first terminal when confirming that the remote assistance request of the second terminal is accepted;
- the voice channel between the first terminal and the second terminal user is always connected, and the first terminal sends voice data to the second terminal through the voice channel;
- the first terminal After receiving the response message sent by the second terminal, the first terminal confirms that the first terminal has received the remote assistance request. At this time, the first terminal runs the video call process in the background, and simultaneously switches the screen to the standby interface, and receives the The operation command is executed to perform corresponding processing; at this time, the first terminal user can switch back and forth between the video call interface and the standby interface according to actual needs; in addition, the first terminal user can also perform video without affecting the operation of the terminal.
- the call interface is placed on the main screen of the terminal, and the video call interface is panned and zoomed, that is, the video call community is placed on the main screen as a small window, and is dragged and dropped by the first terminal user to the corresponding position;
- the first terminal After the first terminal switches to the standby interface, the first terminal receives the operation instruction, and performs corresponding processing according to the operation instruction; in the process of executing the operation instruction by the first terminal, the screen of the first terminal is constantly changing, and the first The terminal continuously obtains a screenshot of the user and saves the screenshot in the local buffer area. At the same time, the first terminal continuously extracts the screenshot from the buffer area and sends the video data as video data through the video channel that has been established in the previous video call.
- the second terminal the first terminal obtains a screenshot according to the preset rate, and the preset rate can be set according to actual needs. For example, the rate can be set to 1/1 second; as shown in FIG.
- the first terminal continuously transmits the voice data to the second terminal through the voice channel, and continuously sends the screenshot to the second terminal through the video channel; and the second terminal continues to pass the same as before establishing the remote assistance. Transmitting voice data to the first terminal through the voice channel, and transmitting the camera data to the first terminal through the video channel;
- the first terminal can obtain the screenshot by various methods.
- the screenshot function in the surface class provided by the Android system can be called to obtain the screenshot;
- the first terminal needs to extract screenshots from the buffer area according to the code rate and the number of frames used by the previously established video channel; thus, by using the same code rate and frame number for image transmission with the previously established video channel, the current video can be directly utilized.
- the video channel that has been established during the call without the need to create another video channel by other means.
- the first terminal continuously pushes the screenshot to the second terminal, the code rate and the number of frames pushed by the screenshot are used by the video channel.
- the code rate and the number of frames are the same, and the second end user visually sees a smooth video picture;
- the second terminal user sees the actual situation of the first terminal user's screen, and guides the first terminal user to operate the first terminal through the voice channel already established in the video call, so as to achieve the purpose of remote assistance;
- the process of changing the screen during the operation of the first terminal user is continuously transmitted to the second terminal in a screenshot manner, and the second terminal user can track the operation of the first terminal user, thereby realizing efficient and fast remote assistance.
- One of the first terminal or the second terminal user may terminate the current remote assistance process as needed; when the second terminal user determines to terminate the current remote assistance process, the second terminal sends an instruction to terminate the remote assistance to the first terminal; When the first terminal user determines to terminate the current remote assistance process, inputting an instruction to terminate the remote assistance to the first terminal;
- the first terminal receives the instruction to end the remote assistance, stopping sending a screenshot from the video channel to the second terminal, starting the camera to acquire the camera data, and transmitting the local camera data to the second terminal through the video channel; in the process
- the voice channel remains connected and transmits voice data to the second terminal.
- a second embodiment of the present invention provides a remote assistance method. As shown in FIG. 4, the method includes the following steps:
- Step 401 After the second terminal establishes a video call with the first terminal, the second terminal receives the remote assistance request sent by the first terminal.
- Step 402 When the second terminal confirms accepting the remote assistance request, stop transmitting video data through the video channel, and receive the picture data only through the video channel.
- the picture data received by the second terminal is actually the screenshot data obtained by the first terminal for the screenshot of the first terminal.
- the third embodiment of the present invention provides a remote assistance device, which is located on the first terminal.
- the device includes: a first video call establishing module 51, a remote assistance request initiating module 52, and a first video processing module. 53; Among them,
- the first video call establishing module 51 is configured to establish a video call with the second terminal
- the remote assistance request initiating module 52 is configured to initiate a remote assistance request to the second terminal after establishing a video call with the second terminal;
- the first video processing module 53 is configured to: after receiving the remote assistance request, the second terminal acquires a screenshot of the first terminal and sends the screenshot to the second terminal through a video channel established in the video call.
- the first video processing module 53 is further configured to obtain a screenshot of the first terminal by:
- the preset rate can be set according to actual needs.
- the first terminal screenshot can be obtained at a rate of 1 frame/second.
- the first video processing module 53 is further configured to send the acquired screenshot to the second terminal by using a video channel established in the video call by:
- the first terminal extracts from the buffer area according to the code rate and the number of frames used by the video channel in the video call.
- a screenshot is taken as video data to be sent to the second terminal through the video channel.
- the first video processing module 53 is further configured to receive an instruction to end the remote assistance, and when receiving the instruction to end the remote assistance, stop sending a screenshot from the video channel to the second terminal, start the camera to obtain the camera data, and pass the video.
- the channel sends local camera data to the second terminal.
- the fourth embodiment of the present invention provides a remote assistance device, which is located on the second terminal.
- the device includes: a second video call establishing module 61, a remote assistance request receiving module 62, and a second video processing module. 63; Among them,
- the second video call establishing module 61 is configured to establish a video call with the first terminal
- the remote assistance request receiving module 62 is configured to receive a remote assistance request sent by the first terminal after the second terminal establishes a video call with the first terminal, and confirm whether to accept the remote assistance request;
- the second video processing module 63 is configured to stop transmitting video data through the video channel and receive image data only through the video channel when the remote assistance request receiving module 62 confirms accepting the remote assistance request, and the image data is the first
- the fifth embodiment of the present invention provides a terminal, and the structure thereof is as shown in FIG. 7 , which includes the remote assistance device provided in the third embodiment and the fourth embodiment.
- the first video call establishing module is provided. 51 and the second video call establishing module 52 may be integrated in one video call establishing module; the first video processing module 53 and the second video processing module 63 may be integrated in one video processing module.
- the first video call establishing module 51, the remote assistance request initiating module 52, the first video processing module 53, the second video call establishing module 61, the remote assistance request receiving module 62 and the second video processing module 63 It can be implemented by a central processing unit (CPU), a microprocessor (MPU, a Micro Processing Unit), a digital signal processor (DSP), or a programmable logic array (FPGA, Field-Programmable Gate). Array) to achieve.
- CPU central processing unit
- MPU Microprocessor
- DSP digital signal processor
- FPGA Field-Programmable Gate
- the embodiment of the present invention further provides a computer storage medium, the storage medium comprising a set of computer executable instructions for performing the remote assistance method according to any of the above embodiments of the present invention.
- embodiments of the present invention can be provided as a method, system, or computer program product. Accordingly, the present invention can take the form of a hardware embodiment, a software embodiment, or a combination of software and hardware. Moreover, the invention can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) including computer usable program code.
- the computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device.
- the device is implemented in a flow chart A function specified in a block or blocks of a process or multiple processes and/or block diagrams.
- These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device.
- the instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
本发明公开了一种远程协助方法，第一终端与第二终端建立视频通话后，第一终端向第二终端发起远程协助请求（101）；第二终端接受所述远程协助请求后，第一终端获取自身屏幕截图并通过视频通话中建立的视频通道发送给第二终端（102），同时通过语音通道向第二终端发送语音数据。本发明同时还公开了一种远程协助装置和计算机存储介质。
Description
本发明涉及移动通信领域，具体涉及一种远程协助方法、装置和计算机存储介质。
在移动通讯技术高速发展的今天，手机，尤其是智能手机等移动终端几乎成了人手必备工具，给人们带来了很大的方便，同时，也给很多使用者尤其是中老年人带来不便，由于智能手机的功能不断多样化，很多复杂的功能需要在他人的指导下才能使用，另外，由于人为误操作导致的问题也常常需要在他人指导下解决。但是，当能够给予指导的人不在身边时，仅通过通话进行沟通，通常很难形象地描述清楚问题，导致问题解决的效率低下，甚至不能被解决。
例如，大多数老年人仅会使用智能手机的一些简单功能，甚至一些简单功能都不熟练，这时候，第二方通过远程协助方式为老人提供及时、准确的操作指导和帮助成为了亟待解决的问题。
发明内容
为了解决现有存在的技术问题，本发明实施例期望提供一种远程协助方法、装置和计算机存储介质。
本发明实施例提供了一种远程协助方法，所述方法包括：
第一终端与第二终端建立视频通话后，第一终端向第二终端发起远程协助请求；
当第二终端接受所述远程协助请求后，第一终端获取自身屏幕截图并通过视频通话中建立的视频通道发送给第二终端，同时通过语音通道向第
二终端发送语音数据。
上述方案中，所述第一终端获取自身屏幕截图，包括：
第一终端将屏幕画面切换到待机画面，并根据预设速率获取自身屏幕截图，并将所述截图保存于缓存区，同时，接收操作指令，根据所述操作指令执行相应操作。
上述方案中，第一终端将获取的屏幕截图通过视频通话中建立的视频通道发送给第二终端，包括：
第一终端按照所述视频通话中视频通道使用的码率和帧数从缓存区提取截图作为视频数据通过所述视频通道发给第二终端。
上述方案中，第二终端接受所述远程协助请求后，所述方法还包括：
当第一终端接收到结束远程协助的指令时，停止从视频通道向第二终端发送屏幕截图，启动摄像头获取摄像头数据，并通过视频通道向第二终端发送本地的摄像头数据。
本发明实施例提供了一种远程协助装置，位于第一终端上，所述装置包括：第一视频通话建立模块，远程协助请求发起模块、第一视频处理模块；其中，
所述第一视频通话建立模块，配置为与第二终端建立视频通话；
所述远程协助请求发起模块，配置为在与第二终端建立视频通话后，向第二终端发起远程协助请求；
所述第一视频处理模块，配置为第二终端接受所述远程协助请求后，获取第一终端屏幕截图并通过视频通话中建立的视频通道发送给第二终端。
上述方案中，所述第一视频处理模块还配置为通过以下方式获取第一终端屏幕截图：
将屏幕画面切换到待机画面，根据预设速率获取自身屏幕截图，并将所述截图保存于缓存区。
所述装置还包括控制模块，
配置为接收操作指令，根据所述操作指令执行相应操作。
上述方案中，所述第一视频处理模块还配置为通过以下方式将获取的屏幕截图通过视频通话中建立的视频通道发送给第二终端：
第一终端按照所述视频通话中视频通道使用的码率和帧数从缓存区提取截图作为视频数据通过所述视频通道发给第二终端。
上述方案中，所述第一视频处理模块还配置为接收结束远程协助的指令，并在接收到结束远程协助的指令时，停止从视频通道向第二终端发送屏幕截图，启动摄像头获取摄像头数据，并通过视频通道向第二终端发送本地的摄像头数据。
本发明实施例还提供了一种计算机存储介质，所述存储介质包括一组计算机可执行指令，所述指令用于执行上述的远程协助方法。
本发明实施例所提供的一种远程协助方法、装置和计算机存储介质，第一终端与第二终端建立视频通话后，第一终端向第二终端发起远程协助请求；当第二终端接受所述远程协助请求后，第一终端获取自身屏幕截图并通过视频通话中建立的视频通道发送给第二终端，同时通过语音通道向第二终端发送语音数据。如此，借助已经建立的视频通信连接，第二终端用户可以实时获取第一终端的屏幕截图，并通过视频通信中的语音通道与第一终端用户进行语音沟通，从而及时、准确的为第一终端用户提供操作指导。
图1为本发明实施例提供的远程协助方法流程图一；
图2为本发明实施例的视频通话中终端处理示意图；
图3为本发明实施例提供的远程协助方法中终端处理示意图；
图4为本发明实施例提供的远程协助方法流程图二；
图5为本发明实施例提供的远程协助装置的基本结构图一；
图6为本发明实施例提供的远程协助装置的基本结构图二；
图7为本发明实施例提供的终端的基本结构图。
本发明实施例中，第一终端与第二终端建立视频通话后，第一终端向第二终端发起远程协助请求；当第二终端接受所述远程协助请求后，第一终端获取自身屏幕截图并通过视频通话中建立的视频通道发送给第二终端，同时通过语音通道向第二终端发送语音数据。
下面通过附图及具体实施例对本发明做进一步的详细说明。
实施例一
本发明实施例一提供了一种远程协助方法，如图1所示，该方法包括以下步骤：
步骤101：第一终端与第二终端建立视频通话后，第一终端向第二终端发起远程协助请求；
第一终端与第二终端建立视频通话后，视频通道及语音通道同时建立连接，第一终端通过视频通道向第二终端发送摄像头数据，并通过语音通道向第二终端发送语音数据；所述摄像头数据是指第一终端摄像头拍摄到的视频数据；所述语音数据是指第一终端是指第一终端话筒收集到的语音数据；此时，如图2所示，第一终端和第二终端之间通过语音通道互相传输语音数据，同时通过视频通道传输视频数据(即，各自摄像头拍摄到的画面)，因此，第一终端和第二终端用户看到视频内容均为对方用户终端摄像头拍摄到的画面；当第一终端用户需要第二终端用户的远程协助时，第一终端用户向第二终端用户发起远程协助请求；具体实现中，第一终端用户可以通过在视频通话过程中选择屏幕上的相应选项或按下终端上的特定按钮来触发第一终端向第二终端发起远程协助请求；或者，第一终端用户在向第二终端用户发起视频通话请求之前，通过选择屏幕上的相应选项或
按下终端上的特定按钮来开启远程协助功能，之后，在建立视频通话以后，第一终端判断远程协助功能是否已开启，如果是，则向第二终端发起远程协助请求。
步骤102：第二终端接受所述远程协助请求后，第一终端获取自身屏幕截图并通过视频通话中建立的视频通道发送给第二终端。
第二终端用户接收到第一终端用户发送的远程协助请求之后，根据自身实际情况选择是否接受所述远程协助请求，当确认接受第二终端的远程协助请求时，向第一终端返回响应消息；在这一过程中，第一终端与第二终端用户之间的语音通道一直保持连接，第一终端通过语音通道向第二终端发送语音数据；
第一终端接收到第二终端发送的响应消息之后，确认第一终端已经接收所述远程协助请求，此时，第一终端将视频通话进程后台运行，同时将屏幕画面切换到待机界面，并接收操作指令，执行相应处理；此时，第一终端用户可以根据实际需要在视频通话界面和待机界面之间来回切换；另外，第一终端用户还可以在不影响对终端操作的情况下，将视频通话界面置顶于终端主屏幕上，对视频通话界面进行平移和缩放操作，即将视频通话界作为小窗口置于主屏幕上，并由第一终端用户拖放至相应的位置；
当第一终端切换到待机界面后，第一终端接收操作指令，并根据所述操作指令执行相应处理；在第一终端执行操作指令的处理过程中，第一终端屏幕画面不断变化，而第一终端不断获取自身屏幕截图，并将所述屏幕截图保存于本地缓存区中，同时，第一终端不断从缓存区中提取所述截图并作为视频数据通过之前视频通话中已经建立的视频通道发送给第二终端，第一终端根据可以预设速率获取自身屏幕截图，该预设速率可以根据实际需要进行设置，例如，可以将该速率设置为1张/1秒；如图3所示，第一终端通过语音通道向第二终端传输语音数据的同时，通过视频通道不断向第二终端发送屏幕截图；而第二终端则如建立远程协助之前一样，继续通
过语音通道向第一终端传输语音数据，通过视频通道向第一终端发送摄像头数据；
第一终端可以通过各种方法实现屏幕截图的获取，例如，在安卓系统中，可以调用安卓系统提供的surface类中的screenshot函数进行屏幕截图的获取；
第一终端需要按照之前建立的视频通道使用的码率和帧数从缓存区提取截图；这样，以与之前建立的视频通道使用相同的码率和帧数进行图片传输，则可以直接利用当前视频通话中已经建立的视频通道，而不需要通过其它方式新建其它视频通道，同时，虽然第一终端是将截图不断推送给第二终端，但是由于截图推送的码率和帧数与视频通道使用的码率和帧数相同，第二终端用户视觉上看到的仍然是流畅的视频画面；
通过这种方式，第二终端用户看到的将是第一终端用户屏幕的实际情况，并通过视频通话中已经建立的语音通道指导第一终端用户操作第一终端，以实现远程协助的目的；第一终端用户操作过程中屏幕的变化过程以截图的方式不断的传送给第二终端，第二终端用户可以追踪第一终端用户的操作，从而实现高效、快捷的远程协助。
第一终端或第二终端用户其中一方可以根据需要终止当前的远程协助过程；当第二终端用户确定终止当前的远程协助过程时，通过第二终端向第一终端发送终止远程协助的指令；当第一终端用户确定终止当前的远程协助过程时，向第一终端输入终止远程协助的指令；
当第一终端接收到结束远程协助的指令时，停止从视频通道向第二终端发送屏幕截图，启动摄像头获取摄像头数据，并通过视频通道向第二终端发送本地的摄像头数据；在这一过程中，语音通道一直保持连接，并向第二终端传送语音数据。
实施例二
本发明实施例二提供了一种远程协助方法，如图4所示，所述方法包括以下步骤：
步骤401：第二终端与第一终端建立视频通话后，第二终端接收第一终端发送的远程协助请求；
步骤402：第二终端确认接受所述远程协助请求时，停止通过视频通道传输视频数据，仅通过视频通道接收图片数据。
第二终端接收到的图片数据实际上为第一终端对自身屏幕截图获得的截图数据。
实施例三
本发明实施例三提供了一种远程协助装置，位于第一终端上，如图5所示，所述装置包括：第一视频通话建立模块51，远程协助请求发起模块52、第一视频处理模块53；其中，
所述第一视频通话建立模块51，配置为与第二终端建立视频通话；
所述远程协助请求发起模块52，配置为在与第二终端建立视频通话后，向第二终端发起远程协助请求；
所述第一视频处理模块53，配置为第二终端接受所述远程协助请求后，获取第一终端屏幕截图并通过视频通话中建立的视频通道发送给第二终端。
其中，所述第一视频处理模块53还配置为通过以下方式获取第一终端屏幕截图：
根据预设速率获取自身屏幕截图，并将所述截图保存于缓存区；
该预设速率，可以根据实际需要进行设置，例如，在实际应用中可以以1张/秒的速率获取第一终端屏幕截图。
所述第一视频处理模块53，还配置为通过以下方式将获取的屏幕截图通过视频通话中建立的视频通道发送给第二终端：
第一终端按照所述视频通话中视频通道使用的码率和帧数从缓存区提
取截图作为视频数据通过所述视频通道发给第二终端。
所述第一视频处理模块53还配置为接收结束远程协助的指令，并在接收到结束远程协助的指令时，停止从视频通道向第二终端发送屏幕截图，启动摄像头获取摄像头数据，并通过视频通道向第二终端发送本地的摄像头数据。
实施例四
本发明实施例四提供了一种远程协助装置，位于第二终端上，如图6所示，所述装置包括：第二视频通话建立模块61，远程协助请求接收模块62、第二视频处理模块63；其中，
所述第二视频通话建立模块61，配置为与第一终端建立视频通话；
所述远程协助请求接收模块62，配置为在第二终端与第一终端建立视频通话后，接收第一终端发送的远程协助请求，并确认是否接受所述远程协助请求；
所述第二视频处理模块63，配置为在远程协助请求接收模块62确认接受所述远程协助请求时，停止通过视频通道传输视频数据，仅通过视频通道接收图片数据，该图片数据即为第一终端发送的对自身屏幕进行截图获得的截图数据。
实施例五
本发明实施例五提供了一种终端，其结构如图7所示，包括上述实施例三和实施例四提供的远程协助装置，需要说明的是，在实际实施中，第一视频通话建立模块51和第二视频通话建立模块52可以集成在一个视频通话建立模块中；第一视频处理模块53和第二视频处理模块63可以集成在一个视频处理模块中。
在具体实施过程中，上述第一视频通话建立模块51，远程协助请求发起模块52、第一视频处理模块53、第二视频通话建立模块61，远程协助请求接收模块62及第二视频处理模块63可以由终端内的中央处理器(CPU，Central Processing Unit)、微处理器(MPU，Micro Processing Unit)、数字信号处理器(DSP，Digital Signal Processor)或可编程逻辑阵列(FPGA，Field －Programmable Gate Array)来实现。
本发明实施例还提供了一种计算机存储介质，所述存储介质包括一组计算机可执行指令，所述指令用于执行本发明上述任一实施例所述的远程协助方法。
本领域内的技术人员应明白，本发明的实施例可提供为方法、系统、或计算机程序产品。因此，本发明可采用硬件实施例、软件实施例、或结合软件和硬件方面的实施例的形式。而且，本发明可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器和光学存储器等)上实施的计算机程序产品的形式。
本发明是参照根据本发明实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器，使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中，使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品，该指令装置实现在流程图一个
流程或多个流程和/或方框图一个方框或多个方框中指定的功能。
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上，使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理，从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。
以上所述，仅为本发明的较佳实施例而已，并非用于限定本发明的保护范围。
Claims (10)
- 一种远程协助方法，所述方法包括：第一终端与第二终端建立视频通话后，第一终端向第二终端发起远程协助请求；当第二终端接受所述远程协助请求后，第一终端获取自身屏幕截图并通过视频通话中建立的视频通道发送给第二终端，同时通过语音通道向第二终端发送语音数据。
- 根据权利要求1所述的远程协助方法，其中，所述第一终端获取自身屏幕截图，包括：第一终端将屏幕画面切换到待机画面，并根据预设速率获取自身屏幕截图，并将所述截图保存于缓存区，同时，接收操作指令，根据所述操作指令执行相应操作。
- 根据权利要求2所述的方法，其中，第一终端将获取的屏幕截图通过视频通话中建立的视频通道发送给第二终端，包括：第一终端按照所述视频通话中视频通道使用的码率和帧数从缓存区提取截图作为视频数据通过所述视频通道发给第二终端。
- 根据权利要求1所述的方法，其中，第二终端接受所述远程协助请求后，所述方法还包括：当第一终端接收到结束远程协助的指令时，停止从视频通道向第二终端发送屏幕截图，启动摄像头获取摄像头数据，并通过视频通道向第二终端发送本地的摄像头数据。
- 一种远程协助装置，位于第一终端上，所述装置包括：第一视频通话建立模块，远程协助请求发起模块、第一视频处理模块；其中，所述第一视频通话建立模块，配置为与第二终端建立视频通话；所述远程协助请求发起模块，配置为在与第二终端建立视频通话后， 向第二终端发起远程协助请求；所述第一视频处理模块，配置为第二终端接受所述远程协助请求后，获取第一终端屏幕截图并通过视频通话中建立的视频通道发送给第二终端。
- 根据权利要求5所述的装置，其中，所述第一视频处理模块还配置为通过以下方式获取第一终端屏幕截图：将屏幕画面切换到待机画面，根据预设速率获取自身屏幕截图，并将所述截图保存于缓存区。
- 根据权利要求6所述的装置，其中，所述装置还包括控制模块，配置为接收操作指令，根据所述操作指令执行相应操作。
- 根据权利要求6或7所述的装置，其中，所述第一视频处理模块还配置为通过以下方式将获取的屏幕截图通过视频通话中建立的视频通道发送给第二终端：第一终端按照所述视频通话中视频通道使用的码率和帧数从缓存区提取截图作为视频数据通过所述视频通道发给第二终端。
- 根据权利要求5所述的装置，其中，所述第一视频处理模块还配置为接收结束远程协助的指令，并在接收到结束远程协助的指令时，停止从视频通道向第二终端发送屏幕截图，启动摄像头获取摄像头数据，并通过视频通道向第二终端发送本地的摄像头数据。
- 一种计算机存储介质，所述存储介质包括一组计算机可执行指令，所述指令用于执行权利要求1-4任一所述的远程协助方法。
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410487866.X | 2014-09-22 | ||
| CN201410487866.XA CN105516883A (zh) | 2014-09-22 | 2014-09-22 | 一种远程协助方法和装置 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2015131577A1 true WO2015131577A1 (zh) | 2015-09-11 |
Family
ID=54054458
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2014/092501 WO2015131577A1 (zh) | 2014-09-22 | 2014-11-28 | 一种远程协助方法、装置和计算机存储介质 |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN105516883A (zh) |
| WO (1) | WO2015131577A1 (zh) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112995299A (zh) * | 2021-02-06 | 2021-06-18 | 建信金融科技有限责任公司 | Ar远程协助方法、装置、设备及存储介质 |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10243691B2 (en) * | 2016-09-06 | 2019-03-26 | Mediatek Singapore Pte. Ltd. | Apparatuses and methods for avoiding video artifacts introduced by a handover or out-of-service (OOS) condition during a video call |
| CN107872426A (zh) * | 2016-09-26 | 2018-04-03 | 中兴通讯股份有限公司 | 一种基于volte的远程控制建立方法和装置 |
| CN106954099A (zh) * | 2017-03-31 | 2017-07-14 | 青岛海信移动通信技术股份有限公司 | 第一终端显示第二终端的屏幕界面的方法及系统 |
| CN107707862A (zh) * | 2017-05-25 | 2018-02-16 | 北京小米移动软件有限公司 | 视频远程协助的处理方法和装置、第一终端、第二终端 |
| CN109408168B (zh) * | 2018-09-25 | 2021-11-19 | 维沃移动通信有限公司 | 一种远程交互方法和终端设备 |
| CN109145878B (zh) * | 2018-09-30 | 2022-02-15 | 北京小米移动软件有限公司 | 图像提取方法及装置 |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101627389A (zh) * | 2007-03-08 | 2010-01-13 | 皇家飞利浦电子股份有限公司 | 用于从远程健康护理监控服务台提供言语和图形指示的系统和方法 |
| CN102158681A (zh) * | 2011-02-16 | 2011-08-17 | 中兴通讯股份有限公司 | 一种可视电话中协同拍照的方法及移动终端 |
| CN102752727A (zh) * | 2012-05-30 | 2012-10-24 | 北京三星通信技术研究有限公司 | 终端远程向导方法及装置 |
| CN103414890A (zh) * | 2013-07-08 | 2013-11-27 | 宇龙计算机通信科技(深圳)有限公司 | 远程桌面的实现方法及装置 |
| CN103873578A (zh) * | 2014-03-21 | 2014-06-18 | 深圳市东方拓宇科技有限公司 | 一种终端之间发送和共享内容的方法及对应终端 |
-
2014
- 2014-09-22 CN CN201410487866.XA patent/CN105516883A/zh active Pending
- 2014-11-28 WO PCT/CN2014/092501 patent/WO2015131577A1/zh active Application Filing
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101627389A (zh) * | 2007-03-08 | 2010-01-13 | 皇家飞利浦电子股份有限公司 | 用于从远程健康护理监控服务台提供言语和图形指示的系统和方法 |
| CN102158681A (zh) * | 2011-02-16 | 2011-08-17 | 中兴通讯股份有限公司 | 一种可视电话中协同拍照的方法及移动终端 |
| CN102752727A (zh) * | 2012-05-30 | 2012-10-24 | 北京三星通信技术研究有限公司 | 终端远程向导方法及装置 |
| CN103414890A (zh) * | 2013-07-08 | 2013-11-27 | 宇龙计算机通信科技(深圳)有限公司 | 远程桌面的实现方法及装置 |
| CN103873578A (zh) * | 2014-03-21 | 2014-06-18 | 深圳市东方拓宇科技有限公司 | 一种终端之间发送和共享内容的方法及对应终端 |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112995299A (zh) * | 2021-02-06 | 2021-06-18 | 建信金融科技有限责任公司 | Ar远程协助方法、装置、设备及存储介质 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105516883A (zh) | 2016-04-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2015131577A1 (zh) | 一种远程协助方法、装置和计算机存储介质 | |
| EP3038397B1 (en) | Method and device for p2p wifi connection | |
| TWI536855B (zh) | 內容分享方法與裝置 | |
| JP2019505117A5 (zh) | ||
| CN105635625B (zh) | 视频通话方法和装置 | |
| CN106488335B (zh) | 直播控制方法及装置 | |
| EP3054717A1 (en) | Methods and apparatuses for binding with device | |
| WO2012136024A1 (zh) | 移动终端及其远程控制方法 | |
| EP3223147A2 (en) | Method for accessing virtual desktop and mobile terminal | |
| CN104461290B (zh) | 一种拍照控制方法及设备 | |
| KR102265931B1 (ko) | 음성 인식을 이용하는 통화 수행 방법 및 사용자 단말 | |
| TWI477108B (zh) | 視訊會議建立方法 | |
| WO2015066949A1 (zh) | 人机交互系统、方法及其装置 | |
| US20150296167A1 (en) | Method and system for communication | |
| CN106713418B (zh) | 重置结果确认方法、装置、服务器和移动终端 | |
| US20160182624A1 (en) | Method and device for wireless connection | |
| EP4099690A1 (en) | Enhanced video call method and system, and electronic device | |
| WO2016008209A1 (zh) | 一种移动终端的工具及智能整合音视频的服务器 | |
| CN111988555B (zh) | 一种数据处理方法、装置、设备和机器可读介质 | |
| EP3095233B1 (en) | Devices and methods for telephone call sharing using a direct wireless connection | |
| CN103957330A (zh) | 处理呼叫占线的方法、装置和系统 | |
| CN104243288B (zh) | 消息传输方法及装置、电子设备 | |
| DE102014100961A1 (de) | Rückrufoptionen mittels einem drahtlosen Gerät | |
| CN111385349B (zh) | 通信处理方法、装置、终端、服务器及存储介质 | |
| US11076429B2 (en) | Method and apparatus for acquiring system information, and method and apparatus for transmitting system information |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 14884658 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 14884658 Country of ref document: EP Kind code of ref document: A1 |