WO2018219022A1 - 一种视频处理方法、终端和计算机存储介质 - Google Patents

一种视频处理方法、终端和计算机存储介质 Download PDF

Info

Publication number
WO2018219022A1
WO2018219022A1 PCT/CN2018/079675 CN2018079675W WO2018219022A1 WO 2018219022 A1 WO2018219022 A1 WO 2018219022A1 CN 2018079675 W CN2018079675 W CN 2018079675W WO 2018219022 A1 WO2018219022 A1 WO 2018219022A1
Authority
WO
WIPO (PCT)
Prior art keywords
terminal
touch
state
preset
instruction
Prior art date
Application number
PCT/CN2018/079675
Other languages
English (en)
French (fr)
Inventor
肖磊
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2018219022A1 publication Critical patent/WO2018219022A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working

Definitions

  • the present invention relates to the field of electronic applications, and in particular, to a video processing method, a terminal, and a computer storage medium.
  • mobile terminals can not only implement basic functions such as making calls and texting, but also realize extended functions such as document sharing, video calling, and watching video.
  • extended functions such as document sharing, video calling, and watching video.
  • the contact switches the video call mode to the shooting mode to take a picture, and then The picture is sent to the user, the user marks the picture and sends it back to the contact. After the contact obtains the marked picture, the user switches back to the video call mode with the user and continues the video call with the user.
  • the embodiments of the present invention are directed to providing a video processing method, a terminal, and a computer storage medium, which are capable of operating and displaying the content of the other party in a video call mode in time.
  • An embodiment of the present invention provides a video processing method, which is applied to a first terminal, where the method includes:
  • the method further includes:
  • the state of the preset first operation lock includes an activation state, and the preset first operation lock is configured to determine whether to generate the corresponding first touch according to the touch operation Control instruction
  • the first touch instruction is generated according to the touch operation.
  • the state of the preset first operation lock further includes a prohibition state, and after the detecting the state of the first operation lock, the method further includes:
  • the state of the preset first operation lock is changed to the activation state, the touch operation is acquired from the preset operation sequence, and corresponding operations are generated according to the touch operation.
  • a first touch command wherein the preset time is used to determine whether to change a state of the preset first operation lock.
  • the responding to the first touch command generated by the touch operation includes:
  • the state of the preset second operation lock further includes a release state, and after the detecting the state of the preset second operation lock corresponding to the first video frame, the method further includes:
  • the responding to the first touch command generated by the touch operation, and displaying the response result in a first display area corresponding to the current display interface that triggers the touch operation include:
  • the first function of the first video frame is implemented on the first display area, where the first display area is a display area corresponding to the first video frame in the current display interface.
  • the first function comprises at least one of a function of enlarging display, reducing display, stopping, starting or image marking of the first video frame.
  • the method before the receiving the touch operation on the current display interface, the method further includes:
  • the first display instruction is configured to display a virtual operation list on the current display interface
  • Receiving a touch operation on the current display interface including:
  • the detecting the state of the preset first operation lock comprises:
  • the state indicating the preset first operation lock is the prohibited state.
  • the method before the receiving the touch operation on the current display interface, the method further includes:
  • the embodiment of the invention further provides a video processing method, which is applied to a second terminal, and the method includes:
  • the responding to the first touch instruction includes:
  • the state of the preset first operation lock includes a prohibition state, and the preset first operation lock is configured to determine whether to respond to the first touch instruction;
  • the method before the receiving the first touch instruction sent by the first terminal, the method further includes:
  • the state of the preset second operation lock is changed to the release state, and a release response command is sent to the first terminal.
  • the responding to the first touch instruction and displaying the response result in the second display area that triggers the first touch instruction comprises:
  • the embodiment of the present invention further provides a first terminal, where the first terminal includes:
  • the first receiving unit is configured to receive a touch operation on the current display interface when performing video communication with the second terminal;
  • the response unit is configured to respond to the first touch instruction generated by the touch operation
  • the first display unit is configured to display the response result in a first display area corresponding to the current display interface that triggers the touch operation;
  • the first sending unit is configured to send the first touch command to the second terminal, so that the second terminal synchronously responds to the first touch command, and displays the response result in the triggering manner a second display area corresponding to the second terminal of the first touch command.
  • the first terminal further includes: a first detecting unit and a generating unit;
  • the first detecting unit is configured to detect a state of the preset first operation lock, the state of the preset first operation lock includes an activation state, and the preset first operation lock is used to determine whether the touch is according to the touch The operation generates the corresponding first touch instruction;
  • the generating unit is configured to generate the first touch instruction according to the touch operation when detecting that the state of the preset first operation lock is the activated state.
  • the state of the preset first operation lock further includes a prohibition state
  • the terminal further includes: a storage unit and an acquisition unit;
  • the storage unit is configured to store the touch operation into a preset operation sequence when detecting that the state of the preset first operation lock is the prohibition state;
  • the acquiring unit is configured to change the state of the preset first operation lock to the activated state when the preset time arrives, obtain the touch operation from the preset operation sequence, and according to the The touch operation generates a corresponding first touch command, and the preset time is used to determine whether to change the state of the preset first operation lock.
  • the first detecting unit is further configured to detect a state of a preset second operation lock corresponding to the first video frame, where the state of the preset second operation lock includes a holding state,
  • the first video frame is a video frame corresponding to the touch operation, and the preset second operation lock is used to determine whether to respond to the first touch instruction;
  • the response unit is configured to respond to the first touch instruction and perform corresponding processing on the first video frame when detecting that the state of the preset second operation lock is the holding state.
  • the state of the preset second operation lock further includes a release state
  • the first sending unit is further configured to: when detecting that the state of the preset second operation lock is the release state, send a release second operation lock instruction to the second terminal, the release second operation
  • the lock instruction is configured to instruct the second terminal to change a state of the preset second operation lock to the release state;
  • the first receiving unit is further configured to receive a release response instruction of the second terminal, and change a state of the preset second operation lock to the holding state according to the release response instruction.
  • the first terminal further includes: a first matching unit and a first searching unit;
  • the first matching unit is configured to match the first preset instruction with the function correspondence library and the first touch instruction
  • the first searching unit is configured to: when the matching is successful, search for the first function corresponding to the first touch instruction in the first preset instruction and the function correspondence database;
  • the first display unit is configured to implement the first function on the first video frame on the first display area, where the first display area is the first video in the current display interface The display area corresponding to the frame.
  • the first function includes at least one of a function of enlarging display, reducing display, stopping, starting, or image marking the first video frame.
  • the first terminal further includes: an ejecting unit;
  • the first receiving unit is further configured to receive a first display instruction, where the first display instruction is used to display a virtual operation list on the current display interface;
  • the pop-up unit is configured to display the virtual operation list on the current display interface according to the first display instruction
  • the first receiving unit is configured to receive a touch selection operation on the virtual operation list.
  • the first detecting unit is configured to detect whether the second touch command sent by the second terminal is received; when detecting that the second touch sent by the second terminal is not received And instructing, by the instruction, that the state of the preset first operation lock is the activation state; and when detecting the receiving the second touch instruction sent by the second terminal, characterizing the preset first operation lock The state of the prohibition state.
  • the acquiring unit is further configured to acquire a video frame collected by itself and a video frame collected by the second terminal acquired by the first application;
  • the first display unit is further configured to display the video frame collected by the self and the video frame collected by the second terminal acquired by the first application respectively in different display areas of the current display interface.
  • the current display interface includes the first display area and the second display area.
  • An embodiment of the present invention provides a first terminal, including a first memory, a first receiver, a first transmitter, a first display, a first processor, and is stored in the first memory and operable on the first processor.
  • the computer program, the first receiver and the first transmitter perform operations according to the first processor, and when the program is executed by the first processor, perform the following operations:
  • the first receiver is configured to receive a touch operation on the current display interface when performing video communication with the second terminal;
  • the first processor is configured to respond to the first touch instruction generated by the touch operation
  • the first display is configured to display the response result in a first display area corresponding to the current display interface that triggers the touch operation;
  • the first transmitter is configured to send the first touch command to the second terminal, so that the second terminal synchronously responds to the first touch command, and displays the response result in And triggering a second display area corresponding to the second terminal of the first touch instruction.
  • An embodiment of the present invention provides a first computer readable storage medium, where a first program is stored, and is applied to a first terminal, where the first program is executed by the first processor to implement any of the video processing described above. method.
  • the embodiment of the invention provides a second terminal, where the second terminal includes:
  • the second receiving unit is configured to receive the first touch instruction sent by the first terminal when performing video communication with the first terminal by using the first application;
  • a second response unit configured to respond to the first touch instruction
  • the second display unit is configured to display the response result in the second display area that triggers the first touch instruction.
  • the second terminal further includes: a second detecting unit;
  • the second detecting unit is configured to detect a state of the preset first operation lock, the preset first operation lock state includes a prohibition state, and the preset first operation lock is configured to determine whether to respond to the first Touch command
  • the second response unit is configured to respond to the first touch instruction when detecting that the state of the preset first operation lock is the prohibited state.
  • the second terminal further includes: a determining unit, a changing unit, and a second sending unit;
  • the second receiving unit is further configured to receive a release second operation lock instruction sent by the first terminal, where the release second operation lock instruction is used to set a state of a preset second operation lock corresponding to the first video frame. Change to release state;
  • the determining unit is configured to determine whether the first video frame is being processed
  • the changing unit is configured to change a state of the preset second operation lock to the release state when determining that the first video frame is not being processed;
  • the second sending unit is configured to send a release response command to the first terminal.
  • the second terminal includes: a second matching unit and a second searching unit;
  • the second matching unit is configured to match the second preset instruction with the function correspondence library and the first touch instruction
  • the second searching unit is configured to: when the matching is successful, search for the first function corresponding to the first touch instruction in the second preset instruction and the function correspondence database;
  • the second display unit is configured to implement the first function of the first video frame on a second display area, where the second display area is a current display when performing video communication with the first terminal a display area corresponding to the first video frame in the interface.
  • An embodiment of the present invention provides a second terminal, including a second memory, a second display, a second processor, and a computer program stored on the second memory and operable on the second processor, the second processor The following steps are implemented when executing the program:
  • the second display is configured to display the response result in a second display area that triggers the first touch instruction.
  • An embodiment of the present invention provides a second computer readable storage medium, where a second program is stored, which is applied to a second terminal, and when the second program is executed by the second processor, any video as described above is implemented. Approach.
  • the embodiment of the present invention provides a video processing method, a terminal, and a computer storage medium.
  • the method includes: when the first terminal performs video communication with the second terminal, receiving a touch operation on the current display interface, and generating a response by the touch operation.
  • the first touch command is displayed, and the response result is displayed in the first display area corresponding to the current display interface that triggers the touch operation; the first touch command is sent to the second terminal, so that the second terminal synchronizes to respond to the first touch Controlling the command, and displaying the response result in the second display area corresponding to the second terminal that triggers the first touch command.
  • the first terminal can generate a first touch command according to the touch operation, when the first terminal and the second terminal perform video communication, the user can perform a touch operation on the current display interface of the first terminal. Sending the first touch command to the second terminal, and synchronously responding to the first touch command with the second terminal, so that the first terminal in the video communication mode can timely operate the display content of the other party during the video call and Synchronous display.
  • FIG. 1 is a flowchart 1 of a video processing method according to an embodiment of the present invention.
  • FIG. 2 is a current display interface diagram of an exemplary first terminal according to an embodiment of the present invention.
  • FIG. 3 is a schematic structural diagram of an exemplary first terminal and a second terminal performing a video call by using a first application according to an embodiment of the present disclosure
  • FIG. 4 is a schematic structural diagram 1 of an exemplary video processing module according to an embodiment of the present disclosure.
  • FIG. 5 is a schematic structural diagram 2 of an exemplary video processing module according to an embodiment of the present disclosure.
  • FIG. 6 is a schematic diagram of an interface of an exemplary virtual operation list of a first terminal according to an embodiment of the present disclosure
  • FIG. 7 is a schematic structural diagram of an exemplary first touch instruction according to an embodiment of the present disclosure.
  • FIG. 8 is a first state diagram of an exemplary preset second operation lock according to an embodiment of the present invention.
  • FIG. 9 is a second schematic diagram of a second preset operation lock according to an embodiment of the present invention.
  • FIG. 10 is an interface display diagram of video graffiti performed by an exemplary first terminal and a second terminal according to an embodiment of the present invention
  • FIG. 11 is a second flowchart of a video processing method according to an embodiment of the present disclosure.
  • FIG. 12 is a flowchart 3 of a video processing method according to an embodiment of the present disclosure.
  • FIG. 13 is a flowchart of an exemplary method for receiving a touch command according to an embodiment of the present invention.
  • FIG. 14 is a schematic structural diagram 1 of a first terminal according to an embodiment of the present disclosure.
  • FIG. 15 is a schematic structural diagram 2 of a first terminal according to an embodiment of the present disclosure.
  • FIG. 16 is a schematic structural diagram 3 of a first terminal according to an embodiment of the present disclosure.
  • FIG. 17 is a schematic structural diagram 4 of a first terminal according to an embodiment of the present disclosure.
  • FIG. 18 is a schematic structural diagram 5 of a first terminal according to an embodiment of the present disclosure.
  • FIG. 19 is a schematic structural diagram 6 of a first terminal according to an embodiment of the present disclosure.
  • FIG. 20 is a schematic structural diagram 1 of a second terminal according to an embodiment of the present disclosure.
  • FIG. 21 is a schematic structural diagram 2 of a second terminal according to an embodiment of the present disclosure.
  • FIG. 22 is a schematic structural diagram 3 of a second terminal according to an embodiment of the present disclosure.
  • FIG. 23 is a schematic structural diagram 4 of a second terminal according to an embodiment of the present disclosure.
  • FIG. 24 is a schematic structural diagram 5 of a second terminal according to an embodiment of the present disclosure.
  • An embodiment of the present invention provides a video processing method, which is applied to a first terminal. As shown in FIG. 1 , the method may include:
  • a video processing method provided by the embodiment of the present invention is applicable to a scenario in which a first terminal and a second terminal perform video communication through an application.
  • the current display interface of the first terminal has at least two display areas, and the at least two display areas respectively display real-time collected by the first terminal.
  • the user performs a touch operation such as clicking and sliding on the first display area on the current display interface, and the first terminal receives the touch operation, and
  • the touch operation, the first display area, and the first video frame corresponding to the first display area are combined into an operation instruction.
  • the mobile phone A and the mobile phone B are in a video call.
  • the current display interface of the mobile phone A has two display areas A and B, wherein the A display area displays the camera of the mobile phone A.
  • the captured video frame, and the B display area displays the video frame captured by the camera of the mobile phone B acquired by the video call application, and the user can exchange the A display area and the B display area by clicking the A display area.
  • the video processing systems of the first terminal and the second terminal are both a video processing module, a video collection module, a screen operation module, and a video display module, as shown in FIG. 3, and an application (APP) (for example, an application such as WeChat.
  • APP application
  • the first terminal and the second terminal are capable of performing video communication by connecting the video processing module of the first terminal and the video processing module of the second terminal, and the video processing module of the first terminal separately stores the video collection module of the first terminal.
  • the video frame and the video frame acquired by the video processing module of the second terminal sent by the first application, and the video frame acquired from the video capture module is sent to the video capture module of the second terminal through the application, and then the first terminal
  • the video frame captured by the video capture module of the terminal and the video frame acquired by the video processing module of the second terminal sent by the application are sent to the video display module of the first terminal, and the video display module of the first terminal sends the video processing module to itself.
  • the video frame and the video frame of the second terminal are respectively displayed in a specified display area on the current display interface, When the user interface of the first terminal is currently displayed touch operation, the operation screen capturing module of the first terminal of the touch operation.
  • the video processing module includes a local image buffer area, a local image area, a counterpart image buffer area, and a counterpart image area, wherein the local image buffer area and the counterpart image buffer area are used to store themselves.
  • the video frame collected by the video capture module and the video frame acquired by the video processing module of the second terminal are used to process the video frame collected by the video capture module of the second terminal, and the processed image is stored in the local image area.
  • the processed image is stored in the counterpart image area.
  • the video processing module of the first terminal stores a touch command.
  • the touch command is a local touch command.
  • the screen processing module of the first terminal receives the touch operation on the current display interface of the second terminal by the first application, the touch command is a touch command of the other party.
  • the touch operation in the embodiment of the present invention includes performing a double-click gesture operation on the first display area, or performing a click operation on the first display area, or performing a long press operation on the first display area (long press operation)
  • the operation of the click duration exceeds the preset duration
  • the virtual operation list is displayed at the specified position of the current display interface, and the selection click operation on the virtual operation list is received, specifically, according to the actual situation.
  • the embodiment of the present invention is not specifically limited.
  • the first terminal When the first terminal receives the touch operation on the current display interface, the first terminal generates a first touch command according to the touch operation, responds to the first touch command, and displays the response result in the touch control operation.
  • the first display area corresponding to the current display interface.
  • the video processing module of the first terminal determines the first display area corresponding to the touch operation and the image buffer area corresponding to the first video frame, and the touch operation, the first display area, and the first video frame
  • the corresponding image buffer is encapsulated into a first touch command and sent to the video processing module of the first terminal.
  • the structure of the first touch instruction includes an instruction header, an area identifier, an operation code, and an image position, wherein the instruction header represents an identifier of the video operation instruction, and the area identifier represents an image buffer of the video operation.
  • the operation code represents a specific form of video operation, including but not limited to pause video, resume video, zoom video or video graffiti, etc.
  • the image position represents a first display area for receiving a touch operation.
  • the first terminal before the first terminal responds to the first touch command generated by the touch operation, the first terminal detects a state of the preset first operation lock, thereby determining whether the received touch operation can be triggered;
  • the preset first operation lock includes an activation state and a prohibition state, and the preset first operation lock is configured to determine whether to generate the corresponding first touch instruction according to the touch operation;
  • the terminal When receiving the second touch command sent by the second terminal, the terminal indicates that when the first terminal receives the touch operation, the second terminal is responding to the touch operation of the user to click the video communication interface with the first terminal.
  • the first operation lock state is a forbidden state; when the first terminal does not receive the second touch command sent by the second terminal, the user is not at the second terminal and the first terminal when the first terminal receives the touch operation The terminal performs a touch operation on the video call interface. At this time, the first operation lock state is an active state.
  • the first terminal when the first terminal detects that the state of the preset first operation lock is the active state, the first terminal generates a corresponding first touch instruction according to the touch operation; when the first terminal detects the preset When the state of the operation lock is the prohibition state, the first terminal stores the touch operation into the preset operation sequence, and when the preset time arrives, that is, when the operation time slice arrives, the preset first operation lock is reactivated. Changing the state of the preset first operation lock to the active state, the first terminal acquires the touch operation from the preset operation sequence, and generates a corresponding first touch command according to the touch operation to respond to the first a touch command and a process of transmitting the first touch command to the second terminal.
  • the first terminal when the first terminal generates the first touch command, the first terminal detects a state of the preset second operation lock corresponding to the first video frame, and the state of the preset second operation lock includes holding a state and a release state, the first video frame is a video frame corresponding to the touch operation, the preset second operation lock is used to determine whether to respond to the first touch instruction; when a second operation lock is preset When the state of the state is the holding state, the first terminal responds to the first touch command, and processes the first video frame according to the first touch instruction; when the state of the preset second operation lock is the release state, the first The terminal sends a release second operation lock instruction to the second terminal, where the release second operation lock instruction is used to instruct the second terminal to change the state of the preset second operation lock to the release state; When receiving the release of the second operation lock instruction, determining whether the user is operating on the first video frame, and when determining that the user is not operating the first video frame, the second terminal changes the state of the preset second
  • the first terminal matches the first touch instruction with the first preset instruction and the function correspondence database.
  • the first terminal searches in the first preset instruction and the function correspondence database.
  • the first function corresponding to the first touch command, the first function of the first video frame is implemented on the first display area, and the first display area is the first in the current display interface A display area corresponding to a video frame.
  • the first preset instruction and the function correspondence relationship library are preset in the first terminal, where the relationship between the instruction and the function is stored, wherein the first preset instruction and the function correspondence relationship on the first terminal
  • the corresponding relationship between the instruction and the function in the second preset instruction and the function correspondence library on the second terminal is the same.
  • the mobile phone A maintains the state of the lock on the local video frame, and the lock B state of the video frame of the mobile phone B is released.
  • the lock B state of the mobile phone B to the local video frame is the holding state, and the lock state of the video frame of the mobile phone A is the holding state.
  • the mobile phone A queries the state of the lock B, and when the lock B state of the mobile phone A is released, the mobile phone A sends the mobile phone B to the mobile phone B. A message asking for the status of its lock B. If the mobile phone B does not operate on its local video frame at this time, the mobile phone B changes its lock B state to release, and notifies the mobile phone A that it can hold the lock B, when the mobile phone A receives After holding the message of lock B, the state of the lock B is changed to the hold state, and the video frame of the mobile phone B is processed.
  • the mobile phone B For the mobile phone B, if the local video frame is to be operated at this time, If the status of the lock B is found to be released, the mobile phone B first sends a message to the mobile phone A to check the status of the lock B. If the lock B is held by the mobile phone A, the mobile phone B cannot temporarily operate the local image until the mobile phone After the release of A, mobile phone B will re-hold the lock B and then operate the local image.
  • the first terminal and the second terminal can process the first video frame corresponding to the preset second operation lock only when the state of the preset second operation lock is the holding state, so that two The terminals simultaneously operate on the same video frame to achieve the effect of synchronizing the operations of the video frames by the two terminals.
  • the first terminal when the first terminal determines that the preset second operation lock state is the holding state, the first terminal starts to respond to the first touch command, and at this time, the first terminal determines to respond to the first touch.
  • the first current image corresponding to the first video frame is instructed, and then the type of the touch operation is determined, and the first current image is processed correspondingly.
  • the video processing module determines that the local image buffer triggers the pause operation.
  • the current image the video processing module of the mobile phone A stores the current image to the local image area.
  • the video processing module of the mobile phone A sends the current image to the video display module and stops updating the local image buffer area, and the video display module of the mobile phone A will The current image is displayed to display the A area of the local video frame.
  • the video processing module of the mobile phone A restarts updating the local image buffer and transmits the updated video image to the local image.
  • the video display module of the mobile phone A displays the acquired local video frame in real time.
  • the video processing module of the mobile phone A determines the current image that triggers the video graffiti operation in the local image buffer area. And according to the video graffiti operation, the specified position of the current image.
  • the voice communication between the first terminal and the second terminal is not affected.
  • S103 Send the first touch command to the second terminal, so that the second terminal synchronously responds to the first touch command, and displays the response result in the second display area corresponding to the second terminal that triggers the first touch command.
  • the first terminal When the first terminal generates the first touch command according to the touch operation, the first terminal sends the first touch command to the second terminal, so that the second terminal synchronously responds to the first touch command.
  • the first terminal sends the first touch command to the second terminal by using the first application, and the second terminal first detects the state of the preset first operation lock, when the state of the preset first operation lock is prohibited.
  • the second terminal responds to the first touch command, and matches the second preset command with the function relationship library and the first touch command.
  • the second terminal is in the second preset command and function.
  • the first function corresponding to the first touch instruction is searched in the correspondence database, and the second terminal implements the first function on the first video frame on the second display area.
  • the user draws a straight line on the position 1 of the display area of the image displaying the mobile phone B, and the corresponding position on the current display interface of the mobile phone B. There is also a straight line at the same place.
  • the user when the first terminal performs video communication with the second terminal through the first application, the user can perform a touch operation on the current display interface of the first terminal, and the first terminal can be preset in the first operation.
  • the first touch command is generated according to the touch operation, and the first touch command is sent to the second terminal, and the first touch command is synchronously responded to the second terminal, so that the video communication mode is A terminal can perform the same processing on the current display interface in synchronization with the second terminal without interrupting the video call.
  • An embodiment of the present invention provides a video processing method, which is applied to a second terminal. As shown in FIG. 11, the method may include:
  • S201 Receive a first touch command sent by the first terminal when performing video communication with the first terminal.
  • a video processing method provided by the embodiment of the present invention is applicable to a scenario in which a first terminal and a second terminal perform video communication through an application.
  • the video communication interface of the second terminal when the second terminal performs video communication with the first terminal, has at least two display areas, and the at least two display areas respectively display real-time collected by the second terminal. a video frame, and a video frame acquired by the first terminal acquired by the application.
  • the video processing systems of the first terminal and the second terminal are both a video processing module, a video collection module, a screen operation module, and a video display module, as shown in FIG. 3, and an application (APP) (for example, an application such as WeChat.
  • the first terminal and the second terminal are capable of performing video communication by connecting the video processing module of the second terminal and the video processing module of the first terminal, and the video processing module of the second terminal sends the video frame collected by the video collection module through the application.
  • the video processing module of the second terminal stores the video frame collected by the video collection module and the video frame acquired by the application, respectively, and sends the video frame.
  • the video display module displays the video frame collected by itself and the video frame collected by the first terminal acquired from the application in at least two display areas of the video communication interface according to a preset display manner.
  • the video processing module includes a local image buffer area, a local image area, a counterpart image buffer area, and a counterpart image area, wherein the local image buffer area and the counterpart image buffer area are used to store themselves.
  • the video frame collected by the video capture module and the video frame acquired by the video processing module of the first terminal correspondingly, the video processing module further includes a local touch command and a touch command of the other party, and when the second terminal receives the first
  • the second terminal stores the first touch command in the touch command of the video processing module, so that the video processing module responds to the first video frame according to the first touch command. Processing.
  • the second terminal After the second terminal receives the first touch command sent by the first terminal, the second terminal responds to the first touch command to implement synchronization processing with the first terminal on the first video frame.
  • the second terminal when the second terminal receives the first touch command sent by the first terminal, the second terminal detects the state of the preset first operation lock, thereby determining whether to respond to the first touch command, the pre- Setting the state of the first operation lock includes a prohibition state, the preset first operation lock is used to determine whether to respond to the first touch instruction; and when the second terminal detects that the state of the preset first operation lock is a prohibited state
  • the second terminal parses the first touch instruction stored in the other operation instruction of the video processing module. As shown in FIG.
  • the first touch instruction includes an instruction header, an area identifier, an operation code, and an image position, where the instruction
  • the head represents the identifier of the first touch command
  • the area identifier represents an image buffer corresponding to the first touch command
  • the operation code represents a specific first touch command, including but not limited to pause video, continue video, zoom video or video graffiti
  • the image position represents a first display area corresponding to the first video frame on the first terminal corresponding to the first touch command.
  • the second terminal matches the first touch command with the second preset command and the function correspondence database.
  • the second terminal searches for the second preset command and the function correspondence database. a first function corresponding to the first touch command, and then the second terminal determines, according to the first touch command, the first video frame corresponding to the first instruction, and the second display area corresponding to the first video frame, to implement the first video a first function of the frame, and displaying the implementation result on the second display area, where the second display area is a display area corresponding to the first video frame in the current display interface when performing video communication with the first terminal .
  • the second preset instruction and the function correspondence relationship library are preset in the second terminal, where the relationship between the instruction and the function is stored, wherein the second preset instruction and the function correspondence relationship on the second terminal
  • the correspondence between the instruction and the function in the first preset instruction and function correspondence library on the first terminal is the same.
  • the voice communication in the video communication between the second terminal and the first terminal is not affected.
  • the second terminal may also receive a touch operation on the first video frame to implement different functions of the first video frame.
  • the A area and the B area of the mobile phone A respectively display the image and the local image of the mobile phone B
  • the A area and the B area of the mobile phone B respectively display the image of the local image and the mobile phone A
  • the user double-clicks on the A area of the mobile phone A to pause the image of the mobile phone B.
  • the A area of the mobile phone A and the B area of the mobile phone B perform a pause operation, and the user double-clicks on the B area of the mobile phone B to continue the image thereof.
  • the A area on the mobile phone A also begins to instruct the operation of the mobile phone B image.
  • the second terminal when the second terminal receives the first touch command sent by the first terminal, when the state of the first operation lock is detected to be in a disabled state, the second terminal displays the second display corresponding to the first video frame.
  • the first function corresponding to the first touch command is implemented on the interface, so that the second terminal in the video communication mode can perform the same processing on the current display interface in synchronization with the first terminal without interrupting the video call.
  • the embodiment of the invention provides a video processing method. As shown in FIG. 12, the method may include:
  • the first terminal When the first terminal performs video communication with the second terminal, the first terminal acquires the video frame collected by itself and the video frame collected by the second terminal acquired by the application.
  • the video processing method provided by the embodiment of the present invention is applicable to a scenario in which the first terminal and the second terminal perform video communication through the first application.
  • the current display interface of the first terminal has at least two display areas, and the at least two display areas respectively display real-time collected by the first terminal.
  • the video processing systems of the first terminal and the second terminal are both a video processing module, a video collection module, a screen operation module, and a video display module, as shown in FIG. 3, and an application (APP) (for example, an application such as WeChat.
  • the first terminal and the second terminal are capable of performing video communication by connecting the video processing module of the first terminal and the video processing module of the second terminal, and the video capture module of the first terminal collects its own video frame, and the first terminal
  • the video processing module stores the video frame acquired by the video capture module of the first terminal and the video frame acquired by the video processing module of the second terminal sent by the application, and sends the video frame acquired from the video capture module to the second terminal through the application.
  • Video capture module for example, an application such as WeChat.
  • the first terminal displays the video frame collected by itself and the video frame collected by the second terminal acquired by the application in different display areas of the current display interface, where the current display interface includes a first display area and a second display area.
  • the first terminal After the first terminal acquires the video frame collected by itself and the video frame acquired by the second terminal acquired by the application, the first terminal displays the video frame collected by itself and the video frame collected by the second terminal to the current display interface. Different display areas in the middle.
  • the first terminal sends the video frame collected by the video capture module of the first terminal and the video frame acquired by the video processing module of the second terminal sent by the application to the video display module of the first terminal, where the first terminal
  • the video display module displays the video frame of the video sent by the video processing module and the video frame of the second terminal in a specified display area on the current display interface
  • the mobile phone A and the mobile phone B are in a video call.
  • the current display interface of the mobile phone A has two display areas A and B, wherein the A display area displays the camera of the mobile phone A.
  • the captured video frame, and the B display area displays the video frame captured by the camera of the mobile phone B acquired by the video call application, and the user can exchange the A display area and the B display area by clicking the A display area.
  • the first terminal receives a touch operation on the current display interface.
  • the first terminal receives the touch operation of the current display interface by the first terminal to perform corresponding to the first video frame corresponding to the first display area in the current display interface. Operation.
  • the screen operation module of the first terminal captures the touch operation.
  • the video processing module includes a local image buffer area, a local image area, a counterpart image buffer area, and a counterpart image area, wherein the local image buffer area and the counterpart image buffer area are used to store themselves.
  • the video frame collected by the video capture module and the video frame acquired by the video processing module of the second terminal are used to process the video frame collected by the video capture module of the second terminal, and the processed image is stored in the local image area.
  • the processed image is stored in the counterpart image area.
  • the video processing module of the first terminal stores a touch command.
  • the touch command is a local touch command.
  • the screen processing module of the first terminal receives the touch operation on the current display interface of the second terminal by the first application, the touch command is a touch command of the other party.
  • the touch operation in the embodiment of the present invention includes performing a double-click gesture operation on the first display area, or performing a click operation on the first display area, or performing a long press operation on the first display area (long press operation)
  • the operation of the click duration exceeds the preset duration
  • the virtual operation list is displayed at the specified position of the current display interface, and the selection click operation on the virtual operation list is received, specifically, according to the actual situation.
  • the embodiment of the present invention is not specifically limited.
  • the first terminal detects whether the second touch command sent by the second terminal is received.
  • the first terminal When the first terminal receives the touch operation on the first video frame, the first terminal first determines whether the touch operation can be processed correspondingly. At this time, the first terminal receives the second transmission by the second terminal. The two touch commands detect the state of the preset first operation lock.
  • the first terminal determines the state of the preset first operation lock by receiving the second touch command sent by the second terminal.
  • the state of the first operation lock is a treasure store activation state and a prohibition state.
  • the state of the preset first operation lock may be represented by 0 and 1, wherein 0 represents a prohibited state, 1 represents an activated state, and when the first terminal receives the second touch command sent by the second terminal, The preset state of the first operation lock is 0. When the first terminal does not receive the second touch command sent by the second terminal, the state of the first operation lock is preset to 1.
  • the state of the first operation lock is preset to determine whether the first terminal can trigger the evaluation criterion of the received touch operation.
  • the first terminal When the first terminal detects that the second touch command sent by the second terminal is not received, the first terminal does not respond to the first video frame when the first terminal receives the touch operation, and at this time, the first terminal The state of the preset first operation lock in the terminal is an active state.
  • the first terminal when the first terminal does not receive the second touch command sent by the second terminal, when the first terminal receives the touch operation, the user does not perform video with the first terminal at the second terminal.
  • the touch operation is performed on the call interface, and the first operation lock state is activated.
  • the first terminal When the first terminal detects that the second touch command sent by the second terminal is received, when the first terminal receives the touch operation, the second terminal is responding to the first video frame, and at this time, the first terminal The state of the preset first operation lock in the middle is the prohibition state.
  • the first terminal when the first terminal receives the second touch command sent by the second terminal, when the first terminal receives the touch operation, the second terminal is responding to the user clicking the video communication with the first terminal.
  • the touch operation of the interface at this time, the first operation lock state is a prohibited state.
  • the first terminal When the first terminal detects that the state of the preset first operation lock is the prohibition state, the first terminal stores the touch operation into the preset operation sequence.
  • the first terminal when the first terminal detects that the state of the preset first operation lock is the prohibition state, the first terminal stores the touch operation into the preset operation sequence, and waits for the arrival of the preset time.
  • the first terminal changes the state of the preset first operation lock to an activated state, and acquires a touch operation from the preset operation sequence.
  • the first terminal can respond to the current display interface. At this time, the first terminal changes the state of the preset first operation lock to the active state, and obtains the touch from the preset operation sequence. operating.
  • the first terminal when the preset time arrives, changes the state of the preset first operation lock to the activated state. At this time, the first terminal reactivates the preset first operation lock, and presets the first operation lock. An operation lock state is changed to an active state. At this time, the first terminal acquires a touch operation from the preset operation sequence and generates a corresponding first touch command according to the touch operation to respond to the first touch command, and The process of transmitting the first touch command to the second terminal.
  • the second terminal is a terminal that performs video communication with the first terminal.
  • the first terminal When the first terminal detects that the state of the preset first operation lock is the active state, the first terminal generates a corresponding first touch command according to the received touch operation, and sends the first touch command to the second terminal.
  • the video processing module of the first terminal determines the first display area and the first video corresponding to the touch operation.
  • An image buffer corresponding to the frame, and the touch operation, the first display area, and the image buffer corresponding to the first video frame are encapsulated into a first touch command, sent to the video processing module of the first terminal, and the first terminal Sending the first touch command to the second terminal.
  • the structure of the first touch instruction includes an instruction header, an area identifier, an operation code, and an image position, wherein the instruction header represents an identifier of the video operation instruction, and the area identifier represents an image buffer of the video operation.
  • the operation code represents a specific form of video operation, including but not limited to pause video, resume video, zoom video or video graffiti, etc.
  • the image position represents a first display area for receiving a touch operation.
  • Steps S307-S308 and step S309 are two parallel steps after step S306, and are selected according to actual conditions, which are not specifically limited in the embodiment of the present invention.
  • the first terminal detects a state of the preset second operation lock corresponding to the first video frame, and the preset second operation lock state includes a holding state, where the first video frame is a video frame corresponding to the touch operation, and the preset The second operation lock is used to determine whether to respond to the first touch instruction.
  • the first terminal determines the state of the preset second operation lock corresponding to the first video frame.
  • the state of the preset second operation lock includes a holding state and a release state, and the state of the preset second operation lock in only one of the first terminal and the second terminal is a holding state, A terminal can respond to the first touch command only when the state of the preset second operation lock is the holding state.
  • the mobile phone A maintains the state of the lock on the local video frame, and the lock B state of the video frame of the mobile phone B is released.
  • the lock B state of the mobile phone B to the local video frame is the holding state, and the lock state of the video frame of the mobile phone A is the holding state.
  • the first terminal detects that the state of the preset second operation lock is the release state, the first terminal sends a release second operation lock instruction to the second terminal, and the release second operation lock instruction is used to indicate that the second terminal is to be pre- Set the state of the second operation lock to the release state.
  • the first terminal detects the state of the preset second operation lock
  • the state of the preset second operation lock of the second terminal is the holding state.
  • the first terminal sends a second operation lock command to the second terminal to hold the preset second operation lock.
  • the preset second operation shortening state of the second terminal is the holding state, and at this time, the first terminal is in the first state.
  • the second terminal sends an instruction to release the second operation lock to instruct the second terminal to change the state of the preset second operation lock to the release state.
  • the second terminal determines whether the first video frame is being processed.
  • the second terminal After receiving the second operation lock command sent by the first terminal, the second terminal determines whether the first video frame corresponding to the preset second operation lock is being processed.
  • the second terminal after the second terminal receives the release second operation lock command sent by the first terminal, the second terminal first determines whether the first video frame is being processed to determine whether to respond to release the butterfly operation lock command. .
  • the second terminal determines that the first video frame is not being processed, the second terminal changes the state of the preset second operation lock to a release state, and sends a release response command to the first terminal.
  • the second terminal determines that the first video frame is not being processed
  • the second terminal changes the state of the preset second operation lock to a release state, and sends a release response command to the first terminal, so that the first terminal sets itself
  • the state of the preset second operation lock is changed to the holding state.
  • the second terminal when the second terminal determines that the first video frame is not currently being processed, the second terminal changes the state of the preset second amount operation lock to the release state, and sends a release response instruction to the first terminal. .
  • the mobile phone A when the mobile phone A needs to process the video frame of the mobile phone B, the mobile phone A queries the lock B state, and when the mobile phone A lock B state is released, the mobile phone A sends the mobile phone B to the mobile phone B. A message asking for the status of its lock B. If the mobile phone B does not operate on its local video frame at this time, the mobile phone B changes its lock B state to release, and notifies the mobile phone A that it can hold the lock B, when the mobile phone A receives After holding the message of lock B, the state of the lock B is changed to the hold state, and the video frame of the mobile phone B is processed.
  • the mobile phone B For the mobile phone B, if the local video frame is to be operated at this time, If the status of the lock B is found to be released, the mobile phone B first sends a message to the mobile phone A to check the status of the lock B. If the lock B is held by the mobile phone A, the mobile phone B cannot temporarily operate the local image until the mobile phone After the release of A, mobile phone B will re-hold the lock B and then operate the local image.
  • the first terminal changes the state of the preset second operation lock to a holding state according to the release response instruction.
  • the first terminal changes the state of the preset second operation lock to the holding state according to the received release response instruction.
  • the first terminal after the first terminal receives the release response command sent by the second terminal, the first terminal changes the state of the preset second operation lock to the holding state, and is first according to the first touch command.
  • the video frame is processed.
  • the first terminal When the first terminal detects that the state of the preset second operation lock is the holding state, the first terminal matches the generated first preset instruction with the function correspondence relationship library and the first touch instruction.
  • the first preset instruction and the function correspondence relationship library are preset in the first terminal, where the relationship between the instruction and the function is stored, and the first touch command and the first pre-read obtained by the first terminal are obtained. Set the instruction and function correspondence library to match.
  • the correspondence between the first preset instruction and the function correspondence relationship library on the first terminal and the second preset instruction and the function correspondence relationship library on the second terminal is the same as the correspondence between the instruction and the function.
  • the steps S311-S314 and the step S315 are two parallel steps after the step S310, and are specifically selected according to the actual situation, which is not specifically limited in the embodiment of the present invention.
  • the first terminal searches for the first function corresponding to the first touch instruction in the first preset instruction and the function correspondence database.
  • the first terminal searches for the first function corresponding to the first touch command in the first preset command and the function correspondence database.
  • the first terminal searches for the first touch command corresponding to the first preset command and the function correspondence database.
  • the first function when the first touch command and the first preset command and the function correspondence database are successfully matched, the first terminal searches for the first touch command corresponding to the first preset command and the function correspondence database. The first function.
  • the first terminal implements a first function on the first video frame on the first display area, where the first function includes at least one of a function of performing enlarged display, reduced display, stop, start, or image mark on the first video frame. .
  • the first terminal After the first terminal determines the first function of the first video frame, the first terminal implements the first function of the first video frame on the first display area.
  • the first terminal after the first terminal determines the first function, the first terminal implements the first function corresponding to the first video frame, and performs display in the first display area corresponding to the first video frame.
  • the video processing module determines that the local image buffer triggers the pause operation.
  • the current image the video processing module of the mobile phone A stores the current image to the local image area.
  • the video processing module of the mobile phone A sends the current image to the video display module and stops updating the local image buffer area, and the video display module of the mobile phone A will The current image is displayed to display the A area of the local video frame.
  • the video processing module of the mobile phone A restarts updating the local image buffer and transmits the updated video image to the local image.
  • the video display module of the mobile phone A displays the acquired local video frame in real time.
  • the video processing module of the mobile phone A determines the current image that triggers the video graffiti operation in the local image buffer area. And according to the video graffiti operation, the specified position of the current image
  • the voice communication between the first terminal and the second terminal is not affected.
  • the second terminal detects a state of the preset first operation lock, and the preset state of the first operation lock includes a prohibition state, and the preset first operation lock is used to determine whether to respond to the first touch instruction.
  • step S309 when the first terminal sends the first touch command to the second terminal, and the second terminal receives the first touch command, the second terminal detects the preset state of the first operation lock. Determine whether it can respond to the first touch command.
  • the second terminal When the second terminal detects that the state of the preset first operation lock is the disabled state, the second terminal matches the first touch command with the second preset command and the function correspondence database.
  • the second terminal when the second terminal detects that the state of the preset first operation lock is the prohibition state, the second terminal parses the first touch instruction stored in the counterpart operation instruction of the video processing module, as shown in FIG. 7
  • the first touch command includes an instruction header, an area identifier, an operation code, and an image position, wherein the instruction header represents an identifier of the first touch instruction, and the area identifier represents an image buffer area corresponding to the first touch instruction, and the operation code Representing a specific first touch command, including but not limited to a pause video, a resume video, a zoom video or a video graffiti, etc., where the image position represents a first display area corresponding to the first video frame on the first terminal corresponding to the first touch command .
  • the second preset instruction and the function correspondence relationship library are preset in the second terminal, where the relationship between the instruction and the function is stored, wherein the second preset instruction and the function correspondence relationship on the second terminal
  • the correspondence between the instruction and the function in the first preset instruction and function correspondence library on the first terminal is the same.
  • the voice communication in the video communication between the second terminal and the first terminal is not affected.
  • the second terminal searches for the first function corresponding to the first touch instruction in the second preset instruction and the function correspondence database.
  • the second terminal searches for the first function corresponding to the first touch command in the second preset command and the function correspondence database.
  • the second terminal searches for the first function corresponding to the first touch instruction in the second preset instruction and the function correspondence database.
  • the second terminal implements a first function on the first video frame on the second display area, where the second display area is a display area corresponding to the first video frame in the current display interface when performing video communication with the first terminal.
  • the second terminal After the second terminal determines the first function corresponding to the first touch command, the second terminal implements the first function of the first video frame on the second display area corresponding to the first video frame.
  • the second terminal when the second terminal detects that the state of the preset first operation lock is the prohibition state, the second terminal parses the first touch instruction stored in the counterpart operation instruction of the video processing module, as shown in FIG. 7
  • the first touch command includes an instruction header, an area identifier, an operation code, and an image position, wherein the instruction header represents an identifier of the first touch instruction, and the area identifier represents an image buffer area corresponding to the first touch instruction, and the operation code Representing a specific first touch command, including but not limited to a pause video, a resume video, a zoom video or a video graffiti, etc., where the image position represents a first display area corresponding to the first video frame on the first terminal corresponding to the first touch command .
  • the second terminal determines, according to the first touch instruction, the first video frame corresponding to the first instruction, and the second display area corresponding to the first video frame, to implement the first function of the first video frame, The implementation result is displayed on the second display area.
  • the second terminal may also receive a touch operation on the first video frame to implement different functions of the first video frame.
  • the A area and the B area of the mobile phone A respectively display the image and the local image of the mobile phone B
  • the A area and the B area of the mobile phone B respectively display the image of the local image and the mobile phone A
  • the user double-clicks on the A area of the mobile phone A to pause the image of the mobile phone B.
  • the A area of the mobile phone A and the B area of the mobile phone B perform a pause operation, and the user double-clicks on the B area of the mobile phone B to continue the image thereof.
  • the A area on the mobile phone A also begins to instruct the operation of the mobile phone B image.
  • the user can perform a touch operation on the current display interface of the first terminal, and the first terminal can be preset in the first operation.
  • the first touch command is generated according to the touch operation, and the first touch command is sent to the second terminal, and the first touch command is synchronously responded to the second terminal, so that the video communication mode is
  • the first terminal can perform the same processing on the current display interface in synchronization with the second terminal without interrupting the video call.
  • the method for implementing step S303 may further include:
  • the first terminal receives a first display instruction, where the first display instruction is used by the first terminal to display a virtual operation list on the current display interface.
  • the first terminal When the first terminal and the second terminal are in video communication, the first terminal receives the first display instruction, where the first display instruction is used to instruct the first terminal to display the virtual operation list on the current display interface.
  • the user performs a click operation on the first display area of the current display interface of the first terminal, and when the first terminal receives the operation of the user in the first display area, the first terminal determines that the operation in the first display area is The first display instruction.
  • S3032 The first terminal pops up a virtual operation list on the current display interface according to the first display instruction.
  • the virtual operation list is popped up on the current display interface according to the first display instruction.
  • the virtual operation list is preset on the first terminal, and the virtual operation list is used to receive an operation list of the first display area corresponding to the first display instruction.
  • the user clicks on the B display area of the mobile phone A, and an operation list of “pause, continue, enlarge, reduce, and graffiti” appears below the display interface of the mobile phone A.
  • the first terminal receives a touch operation on the virtual operation list.
  • the user may send a corresponding specific function to the first display area to the first terminal by selecting the specified operation on the virtual operation list.
  • the virtual operation list is displayed at the designated location of the first terminal, and the user selects the specified operation on the virtual operation list. At this time, the first terminal receives the designated touch operation on the first display area.
  • the embodiment of the present invention provides a first terminal 1.
  • the first terminal 1 may include:
  • the first receiving unit 10 is configured to receive a touch operation on the current display interface when performing video communication with the second terminal;
  • the response unit 11 is configured to respond to the first touch instruction generated by the touch operation
  • the first display unit 12 is configured to display the response result in a first display area corresponding to the current display interface that triggers the touch operation;
  • the first sending unit 13 is configured to send the first touch command to the second terminal, so that the second terminal synchronously responds to the first touch command, and displays the response result on the trigger a second display area corresponding to the second terminal of the first touch instruction.
  • the first terminal 1 further includes: a first detecting unit 14 and a generating unit 15;
  • the first detecting unit 14 is configured to detect a state of the preset first operation lock, the state of the preset first operation lock includes an activation state, and the preset first operation lock is used to determine whether according to the touch Controlling the operation to generate the corresponding first touch instruction;
  • the generating unit 15 is configured to generate a corresponding first touch command according to the touch operation when detecting that the state of the preset first operation lock is the activated state.
  • the first terminal 1 further includes: a storage unit 16 and an acquisition unit 17;
  • the storage unit 16 is configured to store the touch operation into a preset operation sequence when detecting that the state of the preset first operation lock is the prohibited state;
  • the acquiring unit 17 is configured to change the state of the preset first operation lock to the activated state when the preset time arrives, obtain the touch operation from the preset operation sequence, and The touch operation generates a corresponding first touch command to perform a process of responding to the first touch command and transmitting the first touch command to the second terminal.
  • the first detecting unit 14 is further configured to detect a state of a preset second operation lock corresponding to the first video frame, where the state of the preset second operation lock includes a holding state.
  • the first video frame is a video frame corresponding to the touch operation, and the preset second operation lock is used to determine whether to respond to the first touch instruction;
  • the response unit 11 is configured to respond to the first touch command and perform corresponding processing on the first video frame when detecting that the state of the preset second operation lock is the holding state .
  • the first sending unit 13 is further configured to: when detecting that the state of the preset second operation lock is the release state, send a second operation lock instruction to the second terminal.
  • the releasing the second operation lock instruction is used to instruct the second terminal to change the state of the preset second operation lock to the release state;
  • the first receiving unit 10 is configured to receive a release response instruction of the second terminal, and change a state of the preset second operation lock to the holding state according to the release response instruction.
  • the first terminal 1 further includes: a first matching unit 18 and a first searching unit 19;
  • the first matching unit 18 is configured to match the first preset instruction with the function correspondence library and the first touch instruction;
  • the first searching unit 19 is configured to search for a first function corresponding to the first touch instruction in the first preset instruction and the function correspondence relationship library when the matching is successful;
  • the first display unit 12 is configured to implement the first function on the first video frame on a first display area, where the first display area is the first video frame in the current display interface Corresponding display area.
  • the first function comprises at least one of a function of enlarging display, reducing display, stopping, starting or image marking of the first video frame.
  • the first terminal 1 further includes: an ejecting unit 110;
  • the first receiving unit 10 is further configured to receive a first display instruction, where the first display instruction is used to display a virtual operation list on the current display interface;
  • the pop-up unit 110 is configured to display the virtual operation list on the current display interface according to the first display instruction
  • the first receiving unit 10 is configured to receive a selection touch operation on the virtual operation list.
  • the first detecting unit 11 is configured to detect whether the second touch command sent by the second terminal is received; when detecting that the second touch sent by the second terminal is not received And instructing, by the instruction, that the state of the preset first operation lock is the activation state; and when detecting the receiving the second touch instruction sent by the second terminal, characterizing the preset first operation lock The state of the prohibition state.
  • the acquiring unit 17 is further configured to acquire a video frame collected by itself and a video frame collected by the second terminal acquired by the first application;
  • the first display unit 12 is further configured to display the video frame collected by the self and the video frame collected by the second terminal acquired by the first application respectively on different displays of the current display interface.
  • the current display interface includes the first display area and the second display area.
  • the first terminal may include: a first communication interface 116, a first memory 115, a first receiver 113, and a first The transmitter 114, the first display 112, the first processor 111, and the first bus 117.
  • the first detecting unit 14, the generating unit 15, the response unit 11, the storage unit 16, the obtaining unit 17, the first matching unit 18, the first searching unit 19, and the ejecting unit 110 may be the first processor located on the first terminal 1.
  • the implementation of the first processor 111 may be an application specific integrated circuit (ASIC), a digital signal processor (DSP), a digital signal processing device (DSPD, Digital Signal Processing Device), At least one of a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a Central Processing Unit (CPU), a controller, a microcontroller, and a microprocessor Kind. It is to be understood that, for different devices, the electronic device for implementing the functions of the first processor may be other, which is not specifically limited in the embodiment of the present invention.
  • the first display unit 12 is implemented by the first display 112, and the first receiving unit 10 may be implemented by a first receiver 113, which may be implemented by a first transmitter 114, which may further include a first memory 115, a first memory 115, a first display 112, a first receiver 113, and The first transmitter 114 can be coupled to the first processor 111, wherein the memory 115 is configured to store executable program code, the program code includes computer operating instructions, the memory 115 may include high speed RAM memory, and may also include non-volatile A memory, for example, at least one disk storage.
  • the first bus 117 is configured to connect the first communication interface 116, the first display 112, the first receiver 113, the first transmitter 114, the first processor 111, and the first memory 115, and the like Mutual communication between devices;
  • the first communication interface 116 is configured to perform data transmission with an external network element
  • the first memory 115 is configured to store instructions and data
  • the first receiver 113 is configured to receive a touch operation on the current display interface when performing video communication with the second terminal;
  • the first processor 111 executes the instruction for: responding to the first touch instruction generated by the touch operation;
  • the first display 112 is configured to display the response result in a first display area corresponding to the current display interface that triggers the touch operation;
  • the first transmitter 114 is configured to send the first touch command to the second terminal, so that the second terminal synchronously responds to the first touch command, and displays the response result. And a second display area corresponding to the second terminal that triggers the first touch instruction.
  • the first memory 115 may be a volatile first memory (RAM), such as a random access first memory (RAM), or a non-volatile first memory (non- Volatile memory), such as read-only memory (ROM), flash first memory (flash memory), hard disk (HDD, Hard Disk Drive) or solid state drive (SSD, Solid-State Drive); or A combination of the first types of memories of the above kind, and providing instructions and data to the first processor 111.
  • RAM volatile first memory
  • RAM random access first memory
  • non-Volatile memory such as read-only memory (ROM), flash first memory (flash memory), hard disk (HDD, Hard Disk Drive) or solid state drive (SSD, Solid-State Drive
  • ROM read-only memory
  • flash memory flash memory
  • HDD Hard Disk Drive
  • SSD Solid-State Drive
  • each functional module in this embodiment may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the above integrated unit can be implemented in the form of hardware or in the form of a software function module.
  • the integrated unit may be stored in a computer readable storage medium if it is implemented in the form of a software function module and is not sold or used as a stand-alone product.
  • the technical solution of the embodiment is essentially Said that the part contributing to the prior art or all or part of the technical solution can be embodied in the form of a software product stored in a storage medium, comprising a plurality of instructions for making a computer device (may It is a personal computer, a server, or a network device, etc. or a processor that performs all or part of the steps of the method described in this embodiment.
  • the foregoing storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a ROM, a RAM, a magnetic disk, or an optical disk.
  • the embodiment of the present invention provides a first computer readable storage medium, where the first program is stored in the first terminal, and the first program is executed by the first processor, and the first embodiment and the third embodiment are implemented. Said method.
  • the first program instruction corresponding to the video processing method in this embodiment may be stored on a storage medium such as an optical disk, a hard disk, a U disk, or the like, and corresponds to a video processing method in the storage medium.
  • the method includes the following steps: receiving a touch operation on the current display interface when performing video communication with the second terminal; and responding to the first touch generated by the touch operation And outputting the response result to the first display area corresponding to the current display interface that triggers the touch operation; sending the first touch command to the second terminal for the The second terminal synchronously responds to the first touch command, and displays the response result in a second display area corresponding to the second terminal that triggers the first touch command.
  • the embodiment of the present invention provides a second terminal 2, as shown in FIG. 20, the second terminal 2 may include:
  • the second receiving unit 20 is configured to receive a first touch instruction sent by the first terminal when performing video communication with the first terminal;
  • the second response unit 21 is configured to respond to the first touch instruction
  • the second display unit 22 is configured to display the response result in a second display area that triggers the first touch instruction.
  • the second terminal further includes: a second detecting unit 23;
  • the second detecting unit 23 is configured to detect a state of the preset first operation lock, the preset first operation lock state includes a prohibition state, and the preset first operation lock is configured to determine whether to respond to the first a touch command;
  • the second response unit 21 is configured to respond to the first touch instruction when detecting that the state of the preset first operation lock is the prohibited state.
  • the second terminal 2 further includes: a determining unit 24, a changing unit 25, and a second sending unit 26;
  • the second receiving unit 20 is further configured to receive a release second operation lock instruction sent by the first terminal, where the release second operation lock instruction is used to preset a second operation corresponding to the first video frame. The state of the lock is changed to the released state;
  • the determining unit 24 is configured to determine whether the first video frame is being processed
  • the changing unit 25 is configured to change the state of the preset second operation lock to the release state when it is determined that the first video frame is not being processed;
  • the second sending unit 26 is configured to send a release response command to the first terminal.
  • the second terminal 2 includes: a second matching unit 27 and a second searching unit 28;
  • the second matching unit 27 is configured to match the first touch command with the second preset command and the function correspondence database
  • the second searching unit 28 is configured to search for the first function corresponding to the first touch instruction in the second preset instruction and the function correspondence relationship library when the matching is successful;
  • the second display unit 22 is configured to implement the first function on the first video frame on a second display area, where the second display area is current when performing video communication with the first terminal Displaying a display area corresponding to the first video frame in the interface.
  • the second terminal may include: a second communication interface 214, a second display 210, a second receiver 211, and a second The second transmitter 212, the second memory 213, the second processor 29, and the second bus 215.
  • the second detecting unit 23, the second responding unit 21, the determining unit 24, the changing unit 25, the second matching unit 27 and the second searching unit 28 may be implemented by the second processor 29 located on the second terminal 2, the second The processor 29 can be at least one of a special purpose ASIC, DSP, DSPD, PLD, FPGA, CPU, controller, microcontroller, microprocessor. It is to be understood that, for different devices, the electronic device for implementing the functions of the first processor may be other, which is not specifically limited in the embodiment of the present invention.
  • the second display unit 22 is implemented by the second display 210, and the second receiving unit is 20 may be implemented by the second receiver 211, the second transmitting unit 26 may be implemented by the second transmitter 212, the second terminal 2 may further include a second memory 213, the second memory 213, the second display 210, and the second receiver 211 and the second transmitter 212 may be coupled to the second processor 29, wherein the second memory 213 is configured to store executable program code, the program code includes computer operating instructions, and the second memory 213 may include high speed RAM memory, or Also included is a non-volatile memory, such as at least one disk storage.
  • the second bus 215 is configured to connect the second communication interface 214, the second display 210, the second processor 29, and the second memory 213 and mutual communication between the devices;
  • the second communication interface 214 is configured to perform data transmission with an external network element
  • the second memory 213 is configured to store instructions and data
  • the second processor 29 executes the instruction to: receive a first touch instruction sent by the first terminal when performing video communication with the first terminal; and respond to the first touch instruction;
  • the second display 210 is configured to display the response result in a second display area that triggers the first touch instruction.
  • the second memory 213 may be a volatile first memory (volatile memory), such as a second RAM; or a non-volatile memory, such as a second ROM, flashing.
  • volatile memory volatile memory
  • non-volatile memory such as a second ROM, flashing.
  • flash memory HDD or SSD; or a combination of the above-described second types of memories, and provides instructions and data to the second processor 29.
  • each functional module in this embodiment may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
  • the above integrated unit can be implemented in the form of hardware or in the form of a software function module.
  • the integrated unit may be stored in a computer readable storage medium if it is implemented in the form of a software function module and is not sold or used as a stand-alone product.
  • the technical solution of the embodiment is essentially Said that the part contributing to the prior art or all or part of the technical solution can be embodied in the form of a software product stored in a storage medium, comprising a plurality of instructions for making a computer device (may It is a personal computer, a server, or a network device, etc. or a processor that performs all or part of the steps of the method described in this embodiment.
  • the foregoing storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a ROM, a RAM, a magnetic disk, or an optical disk.
  • the embodiment of the present invention provides a second computer readable storage medium, where the second program is stored in the second terminal, and the second program is executed by the second processor, as in the second embodiment and the third embodiment. Said method.
  • the second program instruction corresponding to the video processing method in this embodiment may be stored on a storage medium such as an optical disk, a hard disk, a USB disk, or the like, and corresponds to a video processing method in the storage medium.
  • the method includes the following steps: receiving a first touch command sent by the first terminal when performing video communication with the first terminal; and responding to the first touch command And displaying the response result in a second display area that triggers the first touch instruction.
  • embodiments of the present invention can be provided as a method, system, or computer program product. Accordingly, the present invention can take the form of a hardware embodiment, a software embodiment, or a combination of software and hardware. Moreover, the invention can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) including computer usable program code.
  • the computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device.
  • the apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.
  • These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device.
  • the instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.
  • the user when the first terminal performs video communication with the second terminal, the user may perform a touch operation on the current display interface of the first terminal, and the first terminal may generate the first a touch command, and sending the first touch command to the second terminal, and synchronously responding to the first touch command with the second terminal, so that the first terminal in the video communication mode can display the other party in the video call in time
  • the content operates and is displayed synchronously.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Telephone Function (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本发明实施例公开了一种视频处理方法、终端和计算机存储介质，该方法可以包括：第一终端与第二终端进行视频通信时，接收对当前显示界面的触控操作，响应由触控操作生成的第一触控指令，并将响应结果显示在触发触控操作的当前显示界面对应的第一显示区域；将第一触控指令发送至第二终端，以供第二终端同步响应第一触控指令，并将响应结果显示在触发第一触控指令的第二终端对应的第二显示区域。

Description

一种视频处理方法、终端和计算机存储介质
相关申请的交叉引用
本申请基于申请号为201710409532.4、申请日为2017年06月02日的中国专利申请提出，并要求该中国专利申请的优先权，该中国专利申请的全部内容在此以引入方式并入本申请。
技术领域
本发明涉及电子应用领域，尤其涉及一种视频处理方法、终端和计算机存储介质。
背景技术
近年来，越来越多的第三方应用安装在移动终端上，使得移动终端不仅能够实现打电话、发短信等基本功能，更能实现文档共享、视频通话和观看视频等扩展功能，这些功能大大的方便了用户的生活。用户可以通过视频通话来实时获取联系人当前摄像头录制的视频内容。
现有技术中，在用户与联系人进行视频通话模式下，当用户需要向该联系人指定对方显示内容中的某个区域时，该联系人将视频通话模式切换至拍摄模式拍摄图片，然后将该图片发送至用户，用户对该图片进行标记并发送回联系人，联系人获得标记的图片之后，切换回与用户的视频通话模式，并继续与用户的视频通话。
然而，采用现有技术时，需要切换至拍摄模式来对视频显示内容进行标记，会导致不能及时对视频通话时的对方显示内容进行操作并同步显示。
发明内容
本发明实施例期望提供一种视频处理方法、终端和计算机存储介质，能够及时对视频通话模式时的对方显示内容进行操作并同步显示。
本发明实施例提供一种视频处理方法，应用于第一终端，所述方法包括：
与第二终端进行视频通信时，接收对当前显示界面的触控操作；
响应由所述触控操作生成的第一触控指令，并将所述响应结果显示在触发所述触控操作的所述当前显示界面对应的第一显示区域；
将所述第一触控指令发送至所述第二终端，以供所述第二终端同步响应所述第一触控指令，并将所述响应结果显示在触发所述第一触控指令的所述第二终端对应的第二显示区域。
在一实施例中，所述接收对当前显示界面的触控操作之后，所述响应由所述触控操作生成的第一触控指令之前，所述方法还包括：
检测预设第一操作锁的状态，所述预设第一操作锁的状态包括激活状态，所述预设第一操作锁用于确定是否根据所述触控操作生成对应的所述第一触控指令；
当检测到所述预设第一操作锁的状态为所述激活状态时，根据所述触控操作生成所述第一触控指令。
在一实施例中，所述预设第一操作锁的状态还包括禁止状态，所述检测预设第一操作锁的状态之后，所述方法还包括：
当检测到所述预设第一操作锁的状态为所述禁止状态时，将所述触控操作存储至预设操作序列中；
在预设时间到达时，将所述预设第一操作锁的状态更改为所述激活状态，从所述预设操作序列中获取所述触控操作，并根据所述触控操作生成对应的第一触控指令，所述预设时间用于确定是否更改所述预设第一操作 锁的状态。
在一实施例中，所述响应由所述触控操作生成的第一触控指令，包括：
检测第一视频帧对应的预设第二操作锁的状态，所述预设第二操作锁的状态包括持有状态，所述第一视频帧为所述触控操作对应的视频帧，所述预设第二操作锁用于确定是否响应所述第一触控指令；
当检测到所述预设第二操作锁的状态为所述持有状态时，响应所述第一触控指令，并对所述第一视频帧进行相应的处理。
在一实施例中，所述预设第二操作锁的状态还包括释放状态，所述检测第一视频帧对应的预设第二操作锁的状态之后，所述方法还包括：
当检测到所述预设第二操作锁的状态为所述释放状态时，向所述第二终端发送释放第二操作锁指令，所述释放第二操作锁指令用于指示所述第二终端将所述预设第二操作锁的状态更改为所述释放状态；
接收所述第二终端的释放响应指令，并根据所述释放响应指令将所述预设第二操作锁的状态更改为所述持有状态。
在一实施例中，所述响应由所述触控操作生成的第一触控指令，并将所述响应结果显示在触发所述触控操作的所述当前显示界面对应的第一显示区域，包括：
将第一预设指令与功能对应关系库，以及所述第一触控指令进行匹配；
当匹配成功时，在所述第一预设指令与功能对应关系库中查找所述第一触控指令对应的第一功能；
在所述第一显示区域上实现对所述第一视频帧的所述第一功能，所述第一显示区域为所述当前显示界面中所述第一视频帧对应的显示区域。
在一实施例中，所述第一功能包括对所述第一视频帧进行放大显示、缩小显示、停止、开始或图像标记的功能中的至少一个。
在一实施例中，所述接收对当前显示界面的触控操作之前，所述方法 还包括：
接收第一显示指令，所述第一显示指令用于在所述当前显示界面上显示虚拟操作列表；
根据所述第一显示指令，在所述当前显示界面上显示所述虚拟操作列表；相应的，
所述接收对当前显示界面的触控操作，包括：
接收对所述虚拟操作列表的所述触控操作。
在一实施例中，所述检测预设第一操作锁的状态，包括：
检测是否接收到所述第二终端发送的第二触控指令；
当检测到未接收到所述第二终端发送的所述第二触控指令时，表征所述预设第一操作锁的状态为所述激活状态；
当检测到接收到所述第二终端发送的所述第二触控指令时，表征所述预设第一操作锁的状态为所述禁止状态。
在一实施例中，所述接收对当前显示界面的触控操作之前，所述方法还包括：
获取自身采集的视频帧和通过第一应用获取的所述第二终端采集的视频帧；
将所述自身采集的视频帧和所述通过所述第一应用获取的所述第二终端采集的视频帧分别显示在所述当前显示界面的不同显示区域，所述当前显示界面包括所述第一显示区域和第二显示区域。
本发明实施例还提供一种视频处理方法，应用于第二终端，所述方法包括：
与第一终端进行视频通信时，接收所述第一终端发送的第一触控指令；
响应所述第一触控指令，并将所述响应结果显示在触发所述第一触控指令的第二显示区域。
在一实施例中，所述响应所述第一触控指令，包括：
检测预设第一操作锁的状态，所述预设第一操作锁的状态包括禁止状态，所述预设第一操作锁用于确定是否响应所述第一触控指令；
当检测到所述预设第一操作锁的状态为所述禁止状态时，响应所述第一触控指令。
在一实施例中，所述接收所述第一终端发送的第一触控指令之前，所述方法还包括：
接收所述第一终端发送的释放第二操作锁指令，所述释放第二操作锁指令用于将第一视频帧对应的预设第二操作锁的状态更改为释放状态；
判断是否正在对所述第一视频帧进行处理；
当判断没有正在对所述第一视频帧进行处理时，将所述预设第二操作锁的状态更改为所述释放状态，并发送释放响应指令至所述第一终端。
在一实施例中，所述响应所述第一触控指令，并将所述响应结果显示在触发所述第一触控指令的第二显示区域，包括：
将第二预设指令与功能对应关系库，以及所述第一触控指令进行匹配；
当匹配成功时，在所述第二预设指令与功能对应关系库中查找所述第一触控指令对应的第一功能；
在第二显示区域上实现对所述第一视频帧的所述第一功能，所述第二显示区域为与所述第一终端进行视频通信时的当前显示界面中所述第一视频帧对应的显示区域。
本发明实施例还提供一种第一终端，所述第一终端包括：
第一接收单元，配置为与第二终端进行视频通信时，接收对当前显示界面的触控操作；
响应单元，配置为响应由所述触控操作生成的第一触控指令；
第一显示单元，配置为将所述响应结果显示在触发所述触控操作的所 述当前显示界面对应的第一显示区域；
第一发送单元，配置为将所述第一触控指令发送至所述第二终端，以供所述第二终端同步响应所述第一触控指令，并将所述响应结果显示在触发所述第一触控指令的所述第二终端对应的第二显示区域。
在上述第一终端中，所述第一终端还包括：第一检测单元和生成单元；
所述第一检测单元，配置为检测预设第一操作锁的状态，所述预设第一操作锁的状态包括激活状态，所述预设第一操作锁用于确定是否根据所述触控操作生成对应的所述第一触控指令；
所述生成单元，配置为当检测到所述预设第一操作锁的状态为所述激活状态时，根据所述触控操作生成所述第一触控指令。
在上述第一终端中，所述预设第一操作锁的状态还包括禁止状态，所述终端还包括：存储单元和获取单元；
所述存储单元，配置为当检测到所述预设第一操作锁的状态为所述禁止状态时，将所述触控操作存储至预设操作序列中；
所述获取单元，配置为在预设时间到达时，将所述预设第一操作锁的状态更改为所述激活状态，从所述预设操作序列中获取所述触控操作，并根据所述触控操作生成对应的第一触控指令，所述预设时间用于确定是否更改所述预设第一操作锁的状态。
在上述第一终端中，所述第一检测单元，还配置为检测第一视频帧对应的预设第二操作锁的状态，所述预设第二操作锁的状态包括持有状态，所述第一视频帧为所述触控操作对应的视频帧，所述预设第二操作锁用于确定是否响应所述第一触控指令；
所述响应单元，配置为当检测到所述预设第二操作锁的状态为所述持有状态时，响应所述第一触控指令，并对所述第一视频帧进行相应的处理。
在上述第一终端中，所述预设第二操作锁的状态还包括释放状态，
所述第一发送单元，还配置为当检测到所述预设第二操作锁的状态为所述释放状态时，向所述第二终端发送释放第二操作锁指令，所述释放第二操作锁指令用于指示所述第二终端将所述预设第二操作锁的状态更改为所述释放状态；
所述第一接收单元，还配置为接收所述第二终端的释放响应指令，并根据所述释放响应指令将所述预设第二操作锁的状态更改为所述持有状态。
在上述第一终端中，所述第一终端还包括：第一匹配单元和第一查找单元；
所述第一匹配单元，配置为将第一预设指令与功能对应关系库，以及所述第一触控指令进行匹配；
所述第一查找单元，配置为当匹配成功时，在所述第一预设指令与功能对应关系库中查找所述第一触控指令对应的第一功能；
所述第一显示单元，配置为在所述第一显示区域上实现对所述第一视频帧的所述第一功能，所述第一显示区域为所述当前显示界面中所述第一视频帧对应的显示区域。
在上述第一终端中，所述第一功能包括对所述第一视频帧进行放大显示、缩小显示、停止、开始或图像标记的功能中的至少一个。
在上述第一终端中，所述第一终端还包括：弹出单元；
所述第一接收单元，还配置为接收第一显示指令，所述第一显示指令用于在所述当前显示界面上显示虚拟操作列表；
所述弹出单元，配置为根据所述第一显示指令，在所述当前显示界面上显示所述虚拟操作列表；
所述第一接收单元，配置为接收对所述虚拟操作列表的选择触控操作。
在上述第一终端中，第一检测单元，配置为检测是否接收到所述第二 终端发送的第二触控指令；当检测到未接收到所述第二终端发送的所述第二触控指令时，表征所述预设第一操作锁的状态为所述激活状态；当检测到接收到所述第二终端发送的所述第二触控指令时，表征所述预设第一操作锁的状态为所述禁止状态。
在上述第一终端中，所述获取单元，还配置为获取自身采集的视频帧和通过第一应用获取的所述第二终端采集的视频帧；
所述第一显示单元，还配置为将所述自身采集的视频帧和所述通过所述第一应用获取的所述第二终端采集的视频帧分别显示在所述当前显示界面的不同显示区域，所述当前显示界面包括所述第一显示区域和第二显示区域。
本发明实施例提供一种第一终端，包括第一存储器、第一接收器、第一发送器、第一显示器、第一处理器及存储在第一存储器上并可在第一处理器上运行的计算机程序，所述第一接收器和所述第一发送器依赖于所述第一处理器执行操作，当所述程序被第一处理器执行时，执行如下操作：
所述第一接收器，配置为与第二终端进行视频通信时，接收对当前显示界面的触控操作；
所述第一处理器，配置为响应由所述触控操作生成的第一触控指令；
所述第一显示器，配置为所述响应结果显示在触发所述触控操作的所述当前显示界面对应的第一显示区域；
所述第一发送器，配置为将所述第一触控指令发送至所述第二终端，以供所述第二终端同步响应所述第一触控指令，并将所述响应结果显示在触发所述第一触控指令的所述第二终端对应的第二显示区域。
本发明实施例提供一种第一计算机可读存储介质，其上存储有第一程序，应用于第一终端中，该第一程序被第一处理器执行时实现上面所述任一项视频处理方法。
本发明实施例提供一种第二终端，所述第二终端包括：
第二接收单元，配置为在通过第一应用与第一终端进行视频通信时，接收所述第一终端发送的第一触控指令；
第二响应单元，配置为响应所述第一触控指令；
第二显示单元，配置为将所述响应结果显示在触发所述第一触控指令的第二显示区域。
在上述第二终端中，所述第二终端还包括：第二检测单元；
所述第二检测单元，配置为检测预设第一操作锁的状态，所述预设第一操作锁的状态包括禁止状态，所述预设第一操作锁用于确定是否响应所述第一触控指令；
所述第二响应单元，配置为当检测到所述预设第一操作锁的状态为所述禁止状态时，响应所述第一触控指令。
在上述第二终端中，所述第二终端还包括：判断单元、更改单元和第二发送单元；
所述第二接收单元，还配置为接收所述第一终端发送的释放第二操作锁指令，所述释放第二操作锁指令用于将第一视频帧对应的预设第二操作锁的状态更改为释放状态；
所述判断单元，配置为判断是否正在对所述第一视频帧进行处理；
所述更改单元，配置为当判断没有正在对所述第一视频帧进行处理时，将所述预设第二操作锁的状态更改为所述释放状态；
所述第二发送单元，配置为发送释放响应指令至所述第一终端。
在上述第二终端中，所述第二终端包括：第二匹配单元和第二查找单元；
所述第二匹配单元，配置为将第二预设指令与功能对应关系库，以及所述第一触控指令进行匹配；
所述第二查找单元，配置为当匹配成功时，在所述第二预设指令与功能对应关系库中查找所述第一触控指令对应的第一功能；
所述第二显示单元，配置为在第二显示区域上实现对所述第一视频帧的所述第一功能，所述第二显示区域为与所述第一终端进行视频通信时的当前显示界面中所述第一视频帧对应的显示区域。
本发明实施例提供一种第二终端，包括第二存储器、第二显示器、第二处理器及存储在第二存储器上并可在第二处理器上运行的计算机程序，所述第二处理器执行程序时实现如下步骤：
与第一终端进行视频通信时，接收所述第一终端发送的第一触控指令；
响应所述第一触控指令；
所述第二显示器，配置为将所述响应结果显示在触发所述第一触控指令的第二显示区域。
本发明实施例提供一种第二计算机可读存储介质，其上存储有第二程序，应用于第二终端中，该第二程序被第二处理器执行时实现如上述所述任一项视频处理方法。
本发明实施例提供了一种视频处理方法、终端和计算机存储介质，该方法包括：第一终端与第二终端进行视频通信时，接收对当前显示界面的触控操作，响应由触控操作生成的第一触控指令，并将响应结果显示在触发触控操作的当前显示界面对应的第一显示区域；将第一触控指令发送至第二终端，以供第二终端同步响应第一触控指令，并将响应结果显示在触发第一触控指令的第二终端对应的第二显示区域。采用上述方案，当第一终端与第二终端进行视频通信时，用户可以在第一终端的当前显示界面上进行触控操作，此时第一终端可以根据该触控操作生成第一触控指令，并将第一触控指令发送至第二终端，与第二终端同步响应该第一触控指令，使得在视频通信模式下的第一终端能够及时对视频通话时的对方显示内容 进行操作并同步显示。
附图说明
图1为本发明实施例提供的一种视频处理方法的流程图一；
图2为本发明实施例提供的一种示例性的第一终端的当前显示界面图；
图3为本发明实施例提供的一种示例性的第一终端和第二终端通过第一应用进行视频通话的结构示意图；
图4为本发明实施例提供的一种示例性的视频处理模块的结构示意图一；
图5为本发明实施例提供的一种示例性的视频处理模块的结构示意图二；
图6为本发明实施例提供的一种示例性的第一终端的虚拟操作列表的界面示意图；
图7为本发明实施例提供的一种示例性的第一触控指令的指令结构图；
图8为本发明实施例提供的一种示例性的预设第二操作锁的状态图一；
图9为本发明实施例提供的一种示例性的预设第二操作锁的状态图二；
图10为本发明实施例提供的示例性的第一终端和第二终端进行视频涂鸦的界面显示图；
图11为本发明实施例提供的一种视频处理方法的流程图二；
图12为本发明实施例提供的一种视频处理方法的流程图三；
图13为本发明实施例提供的一种示例性的触控指令接收方法流程图；
图14为本发明实施例提供的一种第一终端的结构示意图一；
图15为本发明实施例提供的一种第一终端的结构示意图二；
图16为本发明实施例提供的一种第一终端的结构示意图三；
图17为本发明实施例提供的一种第一终端的结构示意图四；
图18为本发明实施例提供的一种第一终端的结构示意图五；
图19为本发明实施例提供的一种第一终端的结构示意图六；
图20为本发明实施例提供的一种第二终端的结构示意图一；
图21为本发明实施例提供的一种第二终端的结构示意图二；
图22为本发明实施例提供的一种第二终端的结构示意图三；
图23为本发明实施例提供的一种第二终端的结构示意图四；
图24为本发明实施例提供的一种第二终端的结构示意图五。
具体实施方式
下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述。
实施例一
本发明实施例提供一种视频处理方法，应用于第一终端，如图1所示，该方法可以包括：
S101、与第二终端进行视频通信时，接收对当前显示界面的触控操作。
本发明实施例提供的一种视频处理方法适用于第一终端与第二终端通过应用进行视频通信的场景下。
本发明实施例中，第一终端通过应用与第二终端进行视频通信时，第一终端的当前显示界面上有至少两个显示区域，该至少两个显示区域分别实时显示第一终端自身采集的视频帧，和通过应用获取的第二终端采集的视频帧，此时用户在当前显示界面上的第一显示区域进行点击、滑动等触控操作，第一终端接收到该触控操作，并将该触控操作、第一显示区域、第一显示区域对应的第一视频帧组合成操作指令。
示例性的，如图2所示，手机甲和手机乙正在进行视频通话，此时，手机甲的当前显示界面上有A和B两个显示区域，其中A显示区域显示的是手机甲的摄像头采集的视频帧，而B显示区域显示的是通过视频通话应用获取的手机乙的摄像头采集的视频帧，用户可以通过单击A显示区域来 将A显示区域和B显示区域进行互换。
本发明实施例中，第一终端和第二终端的视频处理系统均由视频处理模块，视频采集模块、屏幕操作模块和视频显示模块，如图3所示，应用(APP)(例如微信等应用)通过连接第一终端的视频处理模块和第二终端的视频处理模块，使得第一终端和第二终端能够进行视频通信，第一终端的视频处理模块中分别存储第一终端的视频采集模块采集的视频帧和第一应用发送的第二终端的视频处理模块获取的视频帧，并将从视频采集模块获取的视频帧通过应用发送至第二终端的视频采集模块，然后，第一终端将第一终端的视频采集模块采集的视频帧和应用发送的第二终端的视频处理模块获取的视频帧，发送至第一终端的视频显示模块，第一终端的视频显示模块将视频处理模块发送的自身的视频帧和第二终端的视频帧分别显示在当前显示界面上的指定显示区域中，当用户对第一终端的当前显示界面进行触控操作时，第一终端的屏幕操作模块捕获该触控操作。
本发明实施例中，如图4所示，视频处理模块中包括本地图像缓存区、本地图像区、对方图像缓存区和对方图像区，其中，本地图像缓存区和对方图像缓存区用来存储自身的视频采集模块采集的视频帧和通过应用从第二终端的视频处理模块获取的视频帧，当对自身的视频采集模块采集的视频帧进行处理时，将处理后的图像存储至本地图像区，当对通过应用从第二终端的视频处理模块获取的视频帧进行处理时，将处理后的图像存储在对方图像区。
本发明实施例中，如图5所示，第一终端的视频处理模块存储触控指令，当用户在第一终端的当前显示界面上进行触控操作时，该触控指令为本地触控指令；当第一终端的屏幕处理模块通过第一应用接收到用户在第二终端的当前显示界面上进行触控操作时，该触控指令为对方触控指令。
在一实施例中，本发明实施例中触控操作包括对第一显示区域进行双 击等手势操作，或者对第一显示区域进行点击操作，或者对第一显示区域进行长按操作(长按操作例如点击的持续时长超过预设时长的操作)，响应于该触控操作在当前显示界面的指定位置处显示虚拟操作列表并接收在虚拟操作列表上的选择点击操作等，具体的，根据实际情况来选择，本发明实施例不做具体的限定。
示例性的，如图6所示，用户点击手机甲的B显示区域，在手机甲的显示界面的下方出现了“暂停、继续、放大、缩小、涂鸦”的操作列表，用户点击“暂停”选项，来指示手机甲暂停B显示区域的视频帧。
S102、响应由触控操作生成的第一触控指令，并将响应结果显示在触发触控操作的当前显示界面对应的第一显示区域。
当第一终端接收到对当前显示界面的触控操作时，第一终端就要根据触控操作生成第一触控指令，响应第一触控指令，并将响应结果显示在触发触控操作的当前显示界面对应的第一显示区域。
本发明实施例中，第一终端的视频处理模块确定该触控操作对应的第一显示区域和第一视频帧对应的图像缓存区，并将触控操作、第一显示区域和第一视频帧对应的图像缓存区封装成第一触控指令，发送至第一终端的视频处理模块。
示例性的，如图7所示，第一触控指令的结构包括指令头、区域标识、操作码和图像位置，其中，指令头代表视频操作指令的标识，区域标识代表视频操作的图像缓存区，操作码代表具体的视频操作的形式，包括但不限于暂停视频、继续视频、缩放视频或视频涂鸦等，图像位置代表接收触控操作的第一显示区域。
在一实施例中，在第一终端响应由触控操作生成的第一触控指令之前，第一终端检测预设第一操作锁的状态，从而判断是否可以触发接收到的触控操作；其中，所述预设第一操作锁的状态包括激活状态和禁止状态，所 述预设第一操作锁用于确定是否根据所述触控操作生成对应的所述第一触控指令；当第一终端接收到第二终端发送的第二触控指令时，表征在第一终端接收到触控操作时，第二终端正在响应用户点击与第一终端的视频通信界面的触控操作，此时，第一操作锁状态为禁止状态；当第一终端未接收到第二终端发送的第二触控指令时，表征在第一终端接收到触控操作时，用户未在第二终端的与第一终端进行视频通话界面上进行触控操作，此时，第一操作锁状态为激活状态。
在一实施例中，当第一终端检测到预设第一操作锁的状态为激活状态时，第一终端根据触控操作生成对应的第一触控指令；当第一终端检测到预设第一操作锁的状态为禁止状态时，第一终端将触控操作存储至预设操作序列中，在预设时间到达时，即等待操作时间片的到来时，重新激活预设第一操作锁，将预设第一操作锁的状态更改为激活状态，此时，第一终端从预设操作序列中获取触控操作，并根据触控操作生成对应的第一触控指令，以进行响应该第一触控指令，并将该第一触控指令发送至第二终端的过程。
本发明实施例中，当第一终端生成第一触控指令时，第一终端检测第一视频帧对应的预设第二操作锁的状态，所述预设第二操作锁的状态包括持有状态和释放状态，所述第一视频帧为所述触控操作对应的视频帧，所述预设第二操作锁用于确定是否响应所述第一触控指令；当预设第二操作锁的状态为持有状态时，第一终端响应所述第一触控指令，根据第一触控指令对第一视频帧进行处理；当预设第二操作锁的状态为释放状态时，第一终端向第二终端发送释放第二操作锁指令，所述释放第二操作锁指令用于指示所述第二终端将所述预设第二操作锁的状态更改为所述释放状态；第二终端接收到释放第二操作锁指令时，判断用户是否正在对第一视频帧进行操作，当判断用户没有在对第一视频帧进行操作时，第二终端将预设 第二操作锁的状态更改为释放状态，并发送释放响应指令至第一终端，第一终端接收到释放响应指令时，并根据所述释放响应指令将预设第二操作锁的状态更改为持有状态，并根据第一触控指令对第一视频帧进行处理。
本发明实施例中，第一终端将第一触控指令与第一预设指令与功能对应关系库进行匹配，当匹配成功时，第一终端在第一预设指令与功能对应关系库中查找第一触控指令对应的第一功能，在所述第一显示区域上实现对所述第一视频帧的所述第一功能，所述第一显示区域为所述当前显示界面中所述第一视频帧对应的显示区域。
本发明实施例中，第一终端上预先设置第一预设指令与功能对应关系库，其中存储的是指令与功能对应的关系，其中，第一终端上的第一预设指令与功能对应关系库与第二终端上的第二预设指令与功能对应关系库中的指令与功能的对应关系一致。
示例性的，如图8所示，在手机甲和手机乙进行视频通信时，手机甲对本地视频帧的锁甲状态是持有状态，对手机乙的视频帧的锁乙状态是释放状态，手机乙对本地视频帧的锁乙状态是持有状态，对手机甲的视频帧的锁甲状态是持有状态。
示例性的，如图9所示，当手机甲需要对手机乙的视频帧进行处理时，手机甲查询其锁乙状态，当手机甲的锁乙状态为释放状态时，手机甲向手机乙发送一条查询其锁乙状态的消息，如果此时手机乙没有对其本地视频帧进行操作时，手机乙将其锁乙状态更改为释放，并通知手机甲可以持有锁乙，当手机甲接收到可以持有锁乙的消息后，将其锁乙状态修改为持有状态，并对手机乙的视频帧进行处理，对于手机乙来说，如果此时，要对其本地视频帧进行操作时，发现其锁乙状态为释放状态，则手机乙首先向手机甲发送一条查询锁乙状态的消息，如果此时锁乙被手机甲持有，则手机乙暂时不能对其本地图像进行操作，直到手机甲释放后，手机乙将锁乙 重新持有后就可以对本地图像进行操作。
可以理解的是，第一终端和第二终端只有在预设第二操作锁的状态为持有状态时才能对预设第二操作锁对应的第一视频帧进行处理，这样，就可以避免两个终端同时对同一个视频帧进行操作，达到两个终端对视频帧的操作同步的效果。
本发明实施例中，第一终端在确定预设第二操作锁状态为持有状态时，第一终端就要开始响应第一触控指令了，此时，第一终端确定响应第一触控指令时第一视频帧对应的第一当前图像，然后确定触控操作的类型，并对第一当前图像进行对应的处理。
示例性的，手机甲和手机乙进行视频通信时，当手机甲接收到对本地视频帧的触控操作的类型为暂停操作时，手机甲的视频处理模块确定本地图像缓存区中触发暂停操作的当前图像，手机甲的视频处理模块将当前图像存储至本地图像区，此时，手机甲的视频处理模块将当前图像发送至视频显示模块并停止更新本地图像缓存区，手机甲的视频显示模块将当前图像显示到显示本地视频帧的A区域，当手机甲接收到对本地视频帧的继续操作时，手机甲的视频处理模块重新开始更新本地图像缓存区，并将更新的视频图像传送至本地图像区，手机甲的视频显示模块实时显示获取到的本地视频帧。
示例性的，在手机甲和手机乙进行视频通话时，手机甲接收到对本地视频帧的视频涂鸦操作时，手机甲的视频处理模块在本地图像缓存区中确定触发视频涂鸦操作的当前图像，并根据视频涂鸦操作对当前图像的指定位置。
在一实施例中，当第一终端响应第一触控指令并将触控指令发送至第二终端时，第一终端和第二终端之间的语音通信不受影响。
S103、将第一触控指令发送至第二终端，以供第二终端同步响应第一 触控指令，并将响应结果显示在触发第一触控指令的第二终端对应的第二显示区域。
当第一终端根据触控操作生成第一触控指令时，第一终端将第一触控指令发送至第二终端，以供第二终端同步响应第一触控指令。
本发明实施例中，第一终端通过第一应用将第一触控指令发送至第二终端，第二终端先检测预设第一操作锁的状态，当预设第一操作锁的状态为禁止状态时，第二终端响应第一触控指令，并将第二预设指令与功能关系库，以及第一触控指令进行匹配，当匹配成功时，第二终端在第二预设指令与功能对应关系库中查找第一触控指令对应的第一功能，第二终端在第二显示区域上实现对第一视频帧的第一功能。
示例性的，如图10所示，在手机甲的当前显示界面上，用户在显示手机乙的图像的显示区域的位置1上画了一条直线，在手机乙的当前显示界面上的相应位置1处同样出现了一条直线。
可以理解的是，当第一终端通过第一应用与第二终端进行视频通信时，用户可以在第一终端的当前显示界面上进行触控操作，此时第一终端可以在预设第一操作锁激活的状态下根据该触控操作生成第一触控指令，并第一触控指令发送至第二终端，与第二终端同步响应该第一触控指令，使得在视频通信模式下的第一终端能够在不中断视频通话的情况下，与第二终端同步对当前显示界面进行同样的处理。
实施例二
本发明实施例提供一种视频处理方法，应用于第二终端，如图11所示，该方法可以包括：
S201、与第一终端进行视频通信时，接收第一终端发送的第一触控指令。
本发明实施例提供的一种视频处理方法适用于第一终端与第二终端通 过应用进行视频通信的场景下。
本发明实施例中，第二终端通过应用与第一终端进行视频通信时，第二终端的视频通信界面上有至少两个显示区域，该至少两个显示区域分别实时显示第二终端自身采集的视频帧，和通过应用获取的第一终端采集的视频帧。
本发明实施例中，第一终端和第二终端的视频处理系统均由视频处理模块、视频采集模块、屏幕操作模块和视频显示模块，如图3所示，应用(APP)(例如微信等应用)通过连接第二终端的视频处理模块和第一终端的视频处理模块，使得第一终端和第二终端能够进行视频通信，第二终端的视频处理模块将视频采集模块采集的视频帧通过应用发送至第一终端，并通过应用接收第二终端的视频处理模块获取的视频帧，第二终端的视频处理模块将视频采集模块采集到的视频帧和通过应用获取的视频帧分别进行存储，并发送至视频显示模块，视频显示模块将自身采集的视频帧和从应用处获取的第一终端采集的视频帧按照预设显示方式分别显示在视频通信界面的至少两个显示区域中。
本发明实施例中，如图5所示，视频处理模块中包括本地图像缓存区、本地图像区、对方图像缓存区和对方图像区，其中，本地图像缓存区和对方图像缓存区用来存储自身的视频采集模块采集的视频帧和通过应用从第一终端的视频处理模块获取的视频帧，对应的，视频处理模块中还包括本地触控指令和对方触控指令，当第二终端接收到第一终端发送的第一触控指令时，第二终端将第一触控指令存储至视频处理模块的对方触控指令中，以供视频处理模块根据第一触控指令对第一视频帧进行相应的处理。
S202、响应第一触控指令，并将响应结果显示在触发第一触控指令的第二显示区域。
当第二终端接收到第一终端发送的第一触控指令之后，第二终端就要 响应第一触控指令了，来对第一视频帧实现与第一终端的同步处理了。
本发明实施例中，当第二终端接收到第一终端发送的第一触控指令时，第二终端检测预设第一操作锁的状态，从而判断是否响应第一触控指令，所述预设第一操作锁的状态包括禁止状态，所述预设第一操作锁用于确定是否响应所述第一触控指令；当第二终端检测到预设第一操作锁的状态为禁止状态时，第二终端解析存储在视频处理模块的对方操作指令中的第一触控指令，如图7所示，第一触控指令中包括指令头、区域标识、操作码和图像位置，其中，指令头代表第一触控指令的标识，区域标识代表第一触控指令对应的图像缓存区，操作码代表具体的第一触控指令，包括但不限于暂停视频、继续视频、缩放视频或视频涂鸦等，图像位置代表第一触控指令对应的第一终端上第一视频帧对应的第一显示区域。
本发明实施例中，第二终端将第一触控指令与第二预设指令与功能对应关系库进行匹配，当匹配成功时，第二终端在第二预设指令与功能对应关系库中查找第一触控指令对应的第一功能，然后第二终端根据第一触控指令确定出第一指令对应的第一视频帧，以及第一视频帧对应的第二显示区域，实现对第一视频帧的第一功能，并将实现结果显示在第二显示区域上，所述第二显示区域为与所述第一终端进行视频通信时的当前显示界面中所述第一视频帧对应的显示区域。
本发明实施例中，第二终端上预先设置第二预设指令与功能对应关系库，其中存储的是指令与功能对应的关系，其中，第二终端上的第二预设指令与功能对应关系库与第一终端上的第一预设指令与功能对应关系库中的，指令与功能的对应关系一致。
本发明实施例中，第二终端在响应第一触控指令时，第二终端与第一终端的视频通信中的语音通信不受影响。
在一实施例中，第二终端在响应接收到的第一触控指令之后，第二终 端也可以接收对第一视频帧的触控操作，以实现第一视频帧的不同的功能。
示例性的，手机甲与手机乙进行视频通话时，手机甲的A区域和B区域分别显示手机乙的图像和本地图像，手机乙的A区域和B区域分别显示本地图像和手机甲的图像，用户在手机甲的A区域上双击以暂停手机乙的图像，此时，手机甲的A区域和手机乙的B区域都执行暂停操作，用户在手机乙的B区域上双击以继续自身图像时，手机甲上的A区域也开始指令继续手机乙图像的操作。
可以理解的是，第二终端在接收到第一终端发送的第一触控指令时，在检测到第一操作锁的状态为禁止状态时，第二终端在第一视频帧对应的第二显示界面上实现第一触控指令对应的第一功能，使得在视频通信模式下的第二终端能够在不中断视频通话的情况下，与第一终端同步对当前显示界面进行同样的处理。
实施例三
本发明实施例提供一种视频处理方法，如图12所示，该方法可以包括：
S301、在第一终端与第二终端进行视频通信时，第一终端获取自身采集的视频帧和通过应用获取的第二终端采集的视频帧。
本发明实施例提供的一种视频处理方法适用于第一终端与第二终端通过第一应用进行视频通信的场景下。
本发明实施例中，第一终端通过应用与第二终端进行视频通信时，第一终端的当前显示界面上有至少两个显示区域，该至少两个显示区域分别实时显示第一终端自身采集的视频帧，和通过应用获取的第二终端采集的视频帧。
本发明实施例中，第一终端和第二终端的视频处理系统均由视频处理模块，视频采集模块、屏幕操作模块和视频显示模块，如图3所示，应用(APP)(例如微信等应用)通过连接第一终端的视频处理模块和第二终端 的视频处理模块，来使得第一终端和第二终端能够进行视频通信，第一终端的视频采集模块采集自身的视频帧，第一终端的视频处理模块中分别存储第一终端的视频采集模块采集的视频帧和应用发送的第二终端的视频处理模块获取的视频帧，并将从视频采集模块获取的视频帧通过应用发送至第二终端的视频采集模块。
S302、第一终端将自身采集的视频帧和通过应用获取的第二终端采集的视频帧分别显示在当前显示界面的不同显示区域，当前显示界面包括第一显示区域和第二显示区域。
当第一终端获取到自身采集的视频帧和通过应用获取的第二终端采集的视频帧之后，第一终端就要将自身采集的视频帧和第二终端采集的视频帧分别显示到当前显示界面中的不同显示区域了。
本发明实施例中，第一终端将第一终端的视频采集模块采集的视频帧和应用发送的第二终端的视频处理模块获取的视频帧发送至第一终端的视频显示模块，第一终端的视频显示模块将视频处理模块发送的自身的视频帧和第二终端的视频帧分别显示在当前显示界面上的指定显示区域中，
示例性的，如图2所示，手机甲和手机乙正在进行视频通话，此时，手机甲的当前显示界面上有A和B两个显示区域，其中A显示区域显示的是手机甲的摄像头采集的视频帧，而B显示区域显示的是通过视频通话应用获取的手机乙的摄像头采集的视频帧，用户可以通过单击A显示区域来将A显示区域和B显示区域进行互换。
S303、第一终端接收对当前显示界面的触控操作。
当第一终端和第二终端正常进行视频通话时，第一终端此时接收到用户对当前显示界面的触控操作，以对当前显示界面中的第一显示区域对应的第一视频帧进行相应的操作。
当用户对第一终端的当前显示界面进行触控操作时，第一终端的屏幕 操作模块捕获该触控操作。
本发明实施例中，如图4所示，视频处理模块中包括本地图像缓存区、本地图像区、对方图像缓存区和对方图像区，其中，本地图像缓存区和对方图像缓存区用来存储自身的视频采集模块采集的视频帧和通过应用从第二终端的视频处理模块获取的视频帧，当对自身的视频采集模块采集的视频帧进行处理时，将处理后的图像存储至本地图像区，当对通过应用从第二终端的视频处理模块获取的视频帧进行处理时，将处理后的图像存储在对方图像区。
本发明实施例中，如图5所示，第一终端的视频处理模块存储触控指令，当用户在第一终端的当前显示界面上进行触控操作时，该触控指令为本地触控指令；当第一终端的屏幕处理模块通过第一应用接收到用户在第二终端的当前显示界面上进行触控操作时，该触控指令为对方触控指令。
在一实施例中，本发明实施例中触控操作包括对第一显示区域进行双击等手势操作，或者对第一显示区域进行点击操作，或者对第一显示区域进行长按操作(长按操作例如点击的持续时长超过预设时长的操作)，响应于该触控操作在当前显示界面的指定位置处显示虚拟操作列表并接收在虚拟操作列表上的选择点击操作等，具体的，根据实际情况来选择，本发明实施例不做具体的限定。
示例性的，如图6所示，用户点击手机甲的B显示区域，在手机甲的显示界面的下方出现了“暂停、继续、放大、缩小、涂鸦”的操作列表，用户点击“暂停”选项，来指示手机甲暂停B显示区域的视频帧。
S304、第一终端检测是否接收到第二终端发送的第二触控指令。
当第一终端接收到对第一视频帧的触控操作时，第一终端首先判断是否能够对触控操作进行相应的处理，此时，第一终端通过检测时候接收到第二终端发送的第二触控指令来检测预设第一操作锁的状态。
本发明实施例中，第一终端通过检测时候接收到第二终端发送的第二触控指令来判断预设第一操作锁的状态。
本发明实施例中，第一操作锁的状态宝库激活状态和禁止状态。
本发明实施例中，预设第一操作锁的状态可以用0和1来表示，其中，0表示禁止状态，1表示激活状态，当第一终端接收到第二终端发送的第二触控指令时，预设第一操作锁的状态为0；当第一终端未接收到第二终端发送的第二触控指令时，预设第一操作锁的状态为1。
本发明实施例中，预设第一操作锁的状态用来判断第一终端是否可以触发接收到的触控操作的评判标准。
S305、当第一终端检测到未接收到第二终端发送的第二触控指令时，表征预设第一操作锁的状态为激活状态。
当第一终端检测到未接收到第二终端发送的第二触控指令时，表征第一终端在接收到触控操作时，第二终端未对第一视频帧响应操作，此时，第一终端中的预设第一操作锁的状态为激活状态。
本发明实施例中，当第一终端未接收到第二终端发送的第二触控指令时，表征在第一终端接收到触控操作时，用户未在第二终端的与第一终端进行视频通话界面上进行触控操作，此时，第一操作锁状态为激活状态。
S306、当第一终端检测到接收到第二终端发送的第二触控指令时，表征预设第一操作锁的状态为禁止状态，预设第一操作锁用于确定是否根据触控操作生成对应的第一触控指令。
当第一终端检测到接收到第二终端发送的第二触控指令时，表征第一终端在接收到触控操作时，第二终端正在对第一视频帧响应操作，此时，第一终端中的预设第一操作锁的状态为禁止状态。
本发明实施例中，当第一终端接收到第二终端发送的第二触控指令时，表征在第一终端接收到触控操作时，第二终端正在响应用户点击与第一终 端的视频通信界面的触控操作，此时，第一操作锁状态为禁止状态。
S307、当第一终端检测到预设第一操作锁的状态为禁止状态时，第一终端将触控操作存储至预设操作序列中。
当第一终端检测到预设第一操作锁的状态为禁止状态时，第一终端将触控操作存储至预设操作序列中。
本发明实施例中，当第一终端检测到预设第一操作锁的状态为禁止状态时，第一终端将触控操作存储至预设操作序列中，等待预设时间的到来。
S308、在预设时间到达时，第一终端将预设第一操作锁的状态更改为激活状态，并从预设操作序列中获取触控操作。
当预设时间达到时，第一终端就可以对当前显示界面响应操作了，此时，第一终端将预设第一操作锁的状态更改为激活状态，并从预设操作序列总获取触控操作。
本发明实施例中，当预设时间到达时，第一终端将预设第一操作锁的状态更改为激活状态，此时，第一终端重新激活预设第一操作锁，并将预设第一操作锁状态更改为激活状态，此时，第一终端从预设操作序列中获取触控操作并根据触控操作生成对应的第一触控指令，以进行响应该第一触控指令，并将该第一触控指令发送至第二终端的过程。
S309、当第一终端检测到预设第一操作锁的状态为激活状态时，第一终端根据触控操作生成对应的第一触控指令，并将第一触控指令发送至第二终端，第二终端为与第一终端进行视频通信的终端。
当第一终端检测到预设第一操作锁的状态为激活状态时，第一终端根据接收到的触控操作生成对应的第一触控指令，并将该第一触控指令发送至第二终端。
本发明实施例中，当第一终端检测到预设第一操作锁的状态为激活状态时，此时，第一终端的视频处理模块确定该触控操作对应的第一显示区 域和第一视频帧对应的图像缓存区，并将触控操作、第一显示区域和第一视频帧对应的图像缓存区封装成第一触控指令，发送至第一终端的视频处理模块，并且，第一终端将第一触控指令发送至第二终端。
示例性的，如图7所示，第一触控指令的结构包括指令头、区域标识、操作码和图像位置，其中，指令头代表视频操作指令的标识，区域标识代表视频操作的图像缓存区，操作码代表具体的视频操作的形式，包括但不限于暂停视频、继续视频、缩放视频或视频涂鸦等，图像位置代表接收触控操作的第一显示区域。
步骤S307-S308和步骤S309为步骤S306之后的两个并列的步骤，具体的根据实际情况进行选择，本发明实施例不做具体的限定。
S310、第一终端检测第一视频帧对应的预设第二操作锁的状态，预设第二操作锁的状态包括持有状态，第一视频帧为触控操作对应的视频帧，预设第二操作锁用于确定是否响应第一触控指令。
当第一终端得到触控操作对应的第一触控指令时，第一终端此时要判断第一视频帧对应的预设第二操作锁的状态。
本发明实施例中，预设第二操作锁的状态包括持有状态和释放状态，且第一终端和第二终端中只有一个终端中的预设第二操作锁的状态为持有状态，第一终端只有在预设第二操作锁的状态为持有状态时，才能响应第一触控指令。
示例性的，如图8所示，在手机甲和手机乙进行视频通信时，手机甲对本地视频帧的锁甲状态是持有状态，对手机乙的视频帧的锁乙状态是释放状态，手机乙对本地视频帧的锁乙状态是持有状态，对手机甲的视频帧的锁甲状态是持有状态。
S311、当第一终端检测到预设第二操作锁的状态为释放状态时，第一终端向第二终端发送释放第二操作锁指令，释放第二操作锁指令用于指示 第二终端将预设第二操作锁的状态更改为释放状态。
由于对于预设第二操作锁来说，第一终端和第二终端中只能有一个终端能够持有预设第二操作锁，因此，当第一终端检测到预设第二操作锁的状态为释放状态时，第二终端的预设第二操作锁的状态为持有状态，此时，第一终端向第二终端发送释放第二操作锁指令，以持有预设第二操作锁。
本发明实施例中，当第一终端检测到预设第二操作锁的状态为释放状态时，第二终端的预设第二操作缩短额状态为持有状态，此时，第一终端向第二终端发送释放第二操作锁的指令，以指示第二终端将预设第二操作锁的状态更改为释放状态。
S312、第二终端判断是否正在对第一视频帧进行处理。
第二终端在接收到第一终端发送的释放第二操作锁指令之后，第二终端判断是否正在对预设第二操作锁对应的第一视频帧进行处理。
本发明实施例中，当第二终端接收到第一终端发送的释放第二操作锁指令之后，第二终端首先判断是否正在对第一视频帧进行处理，来确定是否响应释放蝶儿操作锁指令。
S313、当第二终端判断没有正在对第一视频帧进行处理时，第二终端将预设第二操作锁的状态更改为释放状态，并发送释放响应指令至第一终端。
当第二终端判断没有正在对第一视频帧进行处理时，第二终端将预设第二操作锁的状态更改为释放状态，并发送释放响应指令至第一终端，以供第一终端将自身的预设第二操作锁的状态更改为持有状态。
本发明实施例中，当第二终端判断当前没有正在对第一视频帧进行处理时，第二终端将预设第二额操作锁的状态更改为释放状态，并向第一终端发送释放响应指令。
示例性的，如图9所示，当手机甲需要对手机乙的视频帧进行处理时， 手机甲查询其锁乙状态，当手机甲的锁乙状态为释放状态时，手机甲向手机乙发送一条查询其锁乙状态的消息，如果此时手机乙没有对其本地视频帧进行操作时，手机乙将其锁乙状态更改为释放，并通知手机甲可以持有锁乙，当手机甲接收到可以持有锁乙的消息后，将其锁乙状态修改为持有状态，并对手机乙的视频帧进行处理，对于手机乙来说，如果此时，要对其本地视频帧进行操作时，发现其锁乙状态为释放状态，则手机乙首先向手机甲发送一条查询锁乙状态的消息，如果此时锁乙被手机甲持有，则手机乙暂时不能对其本地图像进行操作，直到手机甲释放后，手机乙将锁乙重新持有后就可以对本地图像进行操作。
S314、第一终端根据释放响应指令，将预设第二操作锁的状态更改为持有状态。
第一终端根据接收到的释放响应指令，将预设第二操作锁的状态更改为持有状态。
本发明实施例中，第一终端在接收到第二终端发送的释放响应指令之后，第一终端将预设第二操作锁的状态更改为持有状态，并根据第一触控指令对第一视频帧进行处理。
S315、当第一终端检测到预设第二操作锁的状态为持有状态时，第一终端将第一预设指令与功能对应关系库，以及第一触控指令进行匹配。
当第一终端检测到预设第二操作锁的状态为持有状态时，第一终端将生成的第一预设指令与功能对应关系库，以及第一触控指令进行匹配。
本发明实施例中，第一终端上预先设置第一预设指令与功能对应关系库，其中存储的是指令与功能对应的关系，第一终端将获取到的第一触控指令与第一预设指令与功能对应关系库进行匹配。
本发明实施例中，第一终端上的第一预设指令与功能对应关系库与第二终端上的第二预设指令与功能对应关系库中的，指令与功能的对应关系 一致。
步骤S311-S314和步骤S315为步骤S310之后的两个并列的步骤，具体的根据实际情况进行选择，本发明实施例不做具体的限定。
S316、当匹配成功时，第一终端在第一预设指令与功能对应关系库中查找第一触控指令对应的第一功能。
当第一触控指令与第一预设指令与功能对应关系库匹配成功时，第一终端在第一预设指令与功能对应关系库中查找第一触控指令对应的第一功能。
本发明实施例中，当第一触控指令与第一预设指令与功能对应关系库匹配成功时，第一终端在第一预设指令与功能对应关系库中查找第一触控指令对应的第一功能。
S317、第一终端在第一显示区域上实现对第一视频帧的第一功能，第一功能包括对第一视频帧进行放大显示、缩小显示、停止、开始或图像标记的功能中的至少一个。
第一终端确定了对第一视频帧的第一功能之后，第一终端就要在第一显示区域上实现对第一视频帧的第一功能了。
本发明实施例中，当第一终端确定了第一功能之后，第一终端实现第一视频帧对应的第一功能，并在第一视频帧对应的第一显示区域进行显示。
示例性的，手机甲和手机乙进行视频通信时，当手机甲接收到对本地视频帧的触控操作的类型为暂停操作时，手机甲的视频处理模块确定本地图像缓存区中触发暂停操作的当前图像，手机甲的视频处理模块将当前图像存储至本地图像区，此时，手机甲的视频处理模块将当前图像发送至视频显示模块并停止更新本地图像缓存区，手机甲的视频显示模块将当前图像显示到显示本地视频帧的A区域，当手机甲接收到对本地视频帧的继续操作时，手机甲的视频处理模块重新开始更新本地图像缓存区，并将更新 的视频图像传送至本地图像区，手机甲的视频显示模块实时显示获取到的本地视频帧。
示例性的，在手机甲和手机乙进行视频通话时，手机甲接收到对本地视频帧的视频涂鸦操作时，手机甲的视频处理模块在本地图像缓存区中确定触发视频涂鸦操作的当前图像，并根据视频涂鸦操作对当前图像的指定位置
进一步地，当第一终端响应第一触控指令并将触控指令发送至第二终端时，第一终端和第二终端之间的语音通信不受影响。
S318、第二终端检测预设第一操作锁的状态，预设第一操作锁的状态包括禁止状态，预设第一操作锁用于确定是否响应第一触控指令。
在步骤S309之后，当第一终端将第一触控指令发送至第二终端，第二终端接收到该第一触控指令时，第二终端就要通过检测预设第一操作锁的状态来判断是否能够响应第一触控指令。
这里，本发明实施例的S318的描述与实施例二中的S202的描述一致，此处不再赘述。
S319、当第二终端检测到预设第一操作锁的状态为禁止状态时，第二终端将第二预设指令与功能对应关系库，以及第一触控指令进行匹配。
当第二终端检测到预设第一操作锁的状态为禁止状态时，第二终端将第一触控指令与第二预设指令与功能对应关系库进行匹配。
本发明实施例中，当第二终端检测到预设第一操作锁的状态为禁止状态时，第二终端解析存储在视频处理模块的对方操作指令中的第一触控指令，如图7所示，第一触控指令中包括指令头、区域标识、操作码和图像位置，其中，指令头代表第一触控指令的标识，区域标识代表第一触控指令对应的图像缓存区，操作码代表具体的第一触控指令，包括但不限于暂停视频、继续视频、缩放视频或视频涂鸦等，图像位置代表第一触控指令 对应的第一终端上第一视频帧对应的第一显示区域。
本发明实施例中，第二终端上预先设置第二预设指令与功能对应关系库，其中存储的是指令与功能对应的关系，其中，第二终端上的第二预设指令与功能对应关系库与第一终端上的第一预设指令与功能对应关系库中的，指令与功能的对应关系一致。
本发明实施例中，第二终端在响应第一触控指令时，第二终端与第一终端的视频通信中的语音通信不受影响。
S320、当匹配成功时，第二终端在第二预设指令与功能对应关系库中查找第一触控指令对应的第一功能。
当第一触控指令与第二预设指令与功能对应关系库匹配成功时，第二终端在第二预设指令与功能对应关系库中查找第一触控指令对应的第一功能。
本发明实施例中，当第二预设指令与功能对应关系库匹配成功时，第二终端在第二预设指令与功能对应关系库中中查找第一触控指令对应的第一功能。
S321、第二终端在第二显示区域上实现对第一视频帧的第一功能，第二显示区域为与第一终端进行视频通信时的当前显示界面中第一视频帧对应的显示区域。
当第二终端确定了第一触控指令对应的第一功能之后，第二终端就要在第一视频帧对应的第二显示区域上实现对第一视频帧的第一功能了。
本发明实施例中，当第二终端检测到预设第一操作锁的状态为禁止状态时，第二终端解析存储在视频处理模块的对方操作指令中的第一触控指令，如图7所示，第一触控指令中包括指令头、区域标识、操作码和图像位置，其中，指令头代表第一触控指令的标识，区域标识代表第一触控指令对应的图像缓存区，操作码代表具体的第一触控指令，包括但不限于暂 停视频、继续视频、缩放视频或视频涂鸦等，图像位置代表第一触控指令对应的第一终端上第一视频帧对应的第一显示区域。
本发明实施例中，第二终端根据第一触控指令确定出第一指令对应的第一视频帧，以及第一视频帧对应的第二显示区域，实现对第一视频帧的第一功能，并将实现结果显示在第二显示区域上。
进一步地，第二终端在响应接收到的第一触控指令之后，第二终端也可以接收对第一视频帧的触控操作，以实现第一视频帧的不同的功能。
示例性的，手机甲与手机乙进行视频通话时，手机甲的A区域和B区域分别显示手机乙的图像和本地图像，手机乙的A区域和B区域分别显示本地图像和手机甲的图像，用户在手机甲的A区域上双击以暂停手机乙的图像，此时，手机甲的A区域和手机乙的B区域都执行暂停操作，用户在手机乙的B区域上双击以继续自身图像时，手机甲上的A区域也开始指令继续手机乙图像的操作。
可以理解的是，当第一终端通过第一应用与第二终端进行视频通信时，用户可以在第一终端的当前显示界面上进行触控操作，此时第一终端可以在预设第一操作锁激活的状态下根据该触控操作生成第一触控指令，并将第一触控指令发送至第二终端，与第二终端同步响应该第一触控指令，使得在视频通信模式下的第一终端能够在不中断视频通话的情况下，与第二终端同步对当前显示界面进行同样的处理。
进一步地，如图13所示，实现步骤S303的方法还可以包括：
S3031、第一终端接收第一显示指令，第一显示指令用于第一终端在当前显示界面上显示虚拟操作列表。
当第一终端与第二终端正在进行视频通信时，第一终端接收第一显示指令，该第一显示指令用于指示第一终端在当前显示界面上显示虚拟操作列表。
本发明实施例中，用户在第一终端的当前显示界面的第一显示区域上进行点击等操作，第一终端接收到用户在第一显示区域的操作时，判断在第一显示区域的操作为第一显示指令。
S3032、第一终端根据第一显示指令，在当前显示界面上弹出虚拟操作列表。
当第一终端接收到第一显示指令时，根据第一显示指令在当前显示界面上弹出虚拟操作列表。
本发明实施例中，第一终端上预设虚拟操作列表，该虚拟操作列表用于对接收第一显示指令对应的第一显示区域的操作列表。
示例性的，如图6所示，用户点击手机甲的B显示区域，在手机甲的显示界面的下方出现了“暂停、继续、放大、缩小、涂鸦”的操作列表。
S3033、第一终端接收对虚拟操作列表的触控操作。
当第一终端上显示虚拟操作列表之后，用户可以通过在虚拟操作列表上选择指定的操作，来向第一终端发送对应的对第一显示区域的具体功能。
本发明实施例中，第一终端的指定位置处显示虚拟操作列表，用户在虚拟操作列表上选择指定的操作，此时，第一终端接收到对第一显示区域的指定的触控操作。
实施例四
本发明实施例提供一种第一终端1，如图14所示，该第一终端1可以包括：
第一接收单元10，配置为与第二终端进行视频通信时，接收对当前显示界面的触控操作；
响应单元11，配置为响应由所述触控操作生成的第一触控指令；
第一显示单元12，配置为将所述响应结果显示在触发所述触控操作的所述当前显示界面对应的第一显示区域；
第一发送单元13，配置为将所述第一触控指令发送至所述第二终端，以供所述第二终端同步响应所述第一触控指令，并将所述响应结果显示在触发所述第一触控指令的所述第二终端对应的第二显示区域。
在一实施例中，基于图14，如图15所示，所述第一终端1还包括：第一检测单元14和生成单元15；
所述第一检测单元14，配置为检测预设第一操作锁的状态，所述预设第一操作锁的状态包括激活状态，所述预设第一操作锁用于确定是否根据所述触控操作生成对应的所述第一触控指令；
所述生成单元15，配置为当检测到所述预设第一操作锁的状态为所述激活状态时，根据所述触控操作生成对应的第一触控指令。
在一实施例中，基于图15，如图16所示，所述第一终端1还包括：存储单元16和获取单元17；
所述存储单元16，配置为当检测到所述预设第一操作锁的状态为所述禁止状态时，将所述触控操作存储至预设操作序列中；
所述获取单元17，配置为在预设时间到达时，将所述预设第一操作锁的状态更改为所述激活状态，从所述预设操作序列中获取所述触控操作，并根据所述触控操作生成对应的第一触控指令，以进行响应所述第一触控指令以及将所述第一触控指令发送至所述第二终端的过程。
在一实施例中，所述第一检测单元14，还配置为检测所述第一视频帧对应的预设第二操作锁的状态，所述预设第二操作锁的状态包括持有状态，所述第一视频帧为所述触控操作对应的视频帧，所述预设第二操作锁用于确定是否响应所述第一触控指令；
所述响应单元11，配置为当检测到所述预设第二操作锁的状态为所述持有状态时，响应所述第一触控指令，并对所述第一视频帧进行相应的处理。
在一实施例中，所述第一发送单元13，还配置为当检测到所述预设第二操作锁的状态为所述释放状态时，向所述第二终端发送释放第二操作锁指令，所述释放第二操作锁指令用于指示所述第二终端将所述预设第二操作锁的状态更改为所述释放状态；
所述第一接收单元10，配置为接收所述第二终端的释放响应指令，并根据所述释放响应指令将所述预设第二操作锁的状态更改为所述持有状态。
在一实施例中，基于图15，如图17所示，所述第一终端1还包括：第一匹配单元18和第一查找单元19；
所述第一匹配单元18，配置为将第一预设指令与功能对应关系库，以及所述第一触控指令进行匹配；
所述第一查找单元19，配置为当匹配成功时，在所述第一预设指令与功能对应关系库中查找所述第一触控指令对应的第一功能；
所述第一显示单元12，配置为在第一显示区域上实现对所述第一视频帧的所述第一功能，所述第一显示区域为所述当前显示界面中所述第一视频帧对应的显示区域。
在一实施例中，所述第一功能包括对所述第一视频帧进行放大显示、缩小显示、停止、开始或图像标记的功能中的至少一个。
在一实施例中，基于图15，如图18所示，所述第一终端1还包括：弹出单元110；
所述第一接收单元10，还配置为接收第一显示指令，所述第一显示指令用于在所述当前显示界面上显示虚拟操作列表；
所述弹出单元110，配置为根据所述第一显示指令，在所述当前显示界面上显示所述虚拟操作列表；
所述第一接收单元10，配置为接收对所述虚拟操作列表的选择触控操 作。
在一实施例中，第一检测单元11，配置为检测是否接收到所述第二终端发送的第二触控指令；当检测到未接收到所述第二终端发送的所述第二触控指令时，表征所述预设第一操作锁的状态为所述激活状态；当检测到接收到所述第二终端发送的所述第二触控指令时，表征所述预设第一操作锁的状态为所述禁止状态。
在一实施例中，所述获取单元17，还配置为获取自身采集的视频帧和通过第一应用获取的所述第二终端采集的视频帧；
所述第一显示单元12，还配置为将所述自身采集的视频帧和所述通过所述第一应用获取的所述第二终端采集的视频帧分别显示在所述当前显示界面的不同显示区域，所述当前显示界面包括所述第一显示区域和第二显示区域。
在实际应用中，基于实施例一和实施例三的同一发明构思下，如图19所示，第一终端可以包括：第一通信接口116、第一存储器115、第一接收器113、第一发送器114、、第一显示器112、第一处理器111和第一总线117。
上述第一检测单元14、生成单元15、响应单元11、存储单元16、获取单元17、第一匹配单元18、第一查找单元19和弹出单元110可由位于第一终端1上的第一处理器111实现，上述第一处理器111可以为特定用途集成电路(ASIC，Application Specific Integrated Circuit)、数字信号处理器(DSP，Digital Signal Processor)、数字信号处理装置(DSPD，Digital Signal Processing Device)、可编程逻辑装置(PLD，Programmable Logic Device)、现场可编程门阵列(FPGA，Field Programmable Gate Array)、中央处理器(CPU，Central Processing Unit)、控制器、微控制器、微处理器中的至少一种。可以理解地，对于不同的设备，用于实现上述第一处理器功能的电子器件还可以为其它，本发明实施例不作具体限定，第一显示单元12由第 一显示器112实现，第一接收单元10可由第一接收器113实现，第一发送单元13可由第一发送器114实现，该终端1还可以包括第一存储器115，该第一存储器115、第一显示器112、第一接收器113和第一发送器114可以与第一处理器111连接，其中，存储器115用于存储可执行程序代码，该程序代码包括计算机操作指令，存储器115可能包含高速RAM存储器，也可能还包括非易失性存储器，例如，至少一个磁盘存储器。
所述第一总线117配置为连接所述第一通信接口116、第一显示器112、第一接收器113、第一发送器114、所述第一处理器111和所述第一存储器115以及这些器件之间的相互通信；
所述第一通信接口116，配置为与外部网元进行数据传输；
所述第一存储器115，配置为存储指令和数据；
所述第一接收器113，配置为与第二终端进行视频通信时，接收对当前显示界面的触控操作；
所述第一处理器111执行所述指令用于：响应由所述触控操作生成的第一触控指令；
所述第一显示器112，配置为将所述响应结果显示在触发所述触控操作的所述当前显示界面对应的第一显示区域；
所述第一发送器114，配置为将所述第一触控指令发送至所述第二终端，以供所述第二终端同步响应所述第一触控指令，并将所述响应结果显示在触发所述第一触控指令的所述第二终端对应的第二显示区域。
在实际应用中，上述第一存储器115可以是易失性第一存储器(volatile memory)，例如随机存取第一存储器(RAM，Random-Access Memory)；或者非易失性第一存储器(non-volatile memory)，例如只读第一存储器(ROM，Read-Only Memory)，快闪第一存储器(flash memory)，硬盘(HDD，Hard Disk Drive)或固态硬盘(SSD，Solid-State Drive)；或者上述种类的第一存 储器的组合，并向第一处理器111提供指令和数据。
另外，在本实施例中的各功能模块可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现，也可以采用软件功能模块的形式实现。
所述集成的单元如果以软件功能模块的形式实现并非作为独立的产品进行销售或使用时，可以存储在一个计算机可读取存储介质中，基于这样的理解，本实施例的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)或processor(处理器)执行本实施例所述方法的全部或部分步骤。而前述的存储介质包括：U盘、移动硬盘、ROM、RAM、磁碟或者光盘等各种可以存储程序代码的介质。
本发明实施例提供一种第一计算机可读存储介质，其上存储有第一程序，应用于第一终端中，该第一程序被第一处理器执行时实现如实施例一和实施例三所述的方法。
具体来讲，本实施例中的一种视频处理的方法对应的第一程序指令可以被存储在光盘，硬盘，U盘等存储介质上，当存储介质中的与一种视频处理方法对应的第一程序指令被一电子设备读取或被执行时，包括如下步骤：与第二终端进行视频通信时，接收对当前显示界面的触控操作；响应由所述触控操作生成的第一触控指令，并将所述响应结果显示在触发所述触控操作的所述当前显示界面对应的第一显示区域；将所述第一触控指令发送至所述第二终端，以供所述第二终端同步响应所述第一触控指令，并将所述响应结果显示在触发所述第一触控指令的所述第二终端对应的第二显示区域。
实施例五
本发明实施例提供一种第二终端2，如图20所示，所述第二终端2可以包括：
第二接收单元20，配置为在与第一终端进行视频通信时，接收所述第一终端发送的第一触控指令；
第二响应单元21，配置为响应所述第一触控指令；
第二显示单元22，配置为将所述响应结果显示在触发所述第一触控指令的第二显示区域。
在一实施例中，基于图20，如图21所示，所述第二终端还包括：第二检测单元23；
所述第二检测单元23，配置为检测预设第一操作锁的状态，所述预设第一操作锁的状态包括禁止状态，所述预设第一操作锁用于确定是否响应所述第一触控指令；
所述第二响应单元21，配置为当检测到所述预设第一操作锁的状态为所述禁止状态时，响应所述第一触控指令。
在一实施例中，基于图20，如图22所示，所述第二终端2还包括：判断单元24、更改单元25和第二发送单元26；
所述第二接收单元20，还配置为接收所述第一终端发送的释放第二操作锁指令，所述释放第二操作锁指令用于将所述第一视频帧对应的预设第二操作锁的状态更改为释放状态；
所述判断单元24，配置为判断是否正在对所述第一视频帧进行处理；
所述更改单元25，配置为当判断没有正在对所述第一视频帧进行处理时，将所述预设第二操作锁的状态更改为所述释放状态；
所述第二发送单元26，配置为发送释放响应指令至所述第一终端。
在一实施例中，基于图20，如图23所示，所述第二终端2包括：第二 匹配单元27和第二查找单元28；
所述第二匹配单元27，配置为将所述第一触控指令与第二预设指令与功能对应关系库进行匹配；
所述第二查找单元28，配置为当匹配成功时，在所述第二预设指令与功能对应关系库中查找所述第一触控指令对应的第一功能；
所述第二显示单元22，配置为在第二显示区域上实现对所述第一视频帧的所述第一功能，所述第二显示区域为与所述第一终端进行视频通信时的当前显示界面中所述第一视频帧对应的显示区域。
在实际应用中，基于实施例二和实施例三的同一发明构思下，如图24所示，第二终端，可以包括：第二通信接口214、第二显示器210、第二接收器211、第二发送器212、第二存储器213、第二处理器29和第二总线215。
上述第二检测单元23、第二响应单元21、判断单元24、更改单元25、第二匹配单元27和第二查找单元28可由位于第二终端2上的第二处理器29实现，上述第二处理器29可以为特定用途ASIC、DSP、DSPD、PLD、FPGA、CPU、控制器、微控制器、微处理器中的至少一种。可以理解地，对于不同的设备，用于实现上述第一处理器功能的电子器件还可以为其它，本发明实施例不作具体限定，第二显示单元22由第二显示器210实现，第二接收单元20可由第二接收器211实现，第二发送单元26可由第二发送器212实现，该第二终端2还可以包括第二存储器213，该第二存储器213、第二显示器210、第二接收器211和第二发送器212可以与第二处理器29连接，其中，第二存储器213配置为存储可执行程序代码，该程序代码包括计算机操作指令，第二存储器213可能包含高速RAM存储器，也可能还包括非易失性存储器，例如，至少一个磁盘存储器。
所述第二总线215配置为连接所述第二通信接口214、所述第二显示器 210、所述第二处理器29和所述第二存储器213以及这些器件之间的相互通信；
所述第二通信接口214，配置为与外部网元进行数据传输；
所述第二存储器213，配置为存储指令和数据；
所述第二处理器29执行所述指令配置为：在与第一终端进行视频通信时，接收所述第一终端发送的第一触控指令；响应所述第一触控指令；
所述第二显示器210，配置为将所述响应结果显示在触发所述第一触控指令的第二显示区域。
在实际应用中，上述第二存储器213可以是易失性第一存储器(volatile memory)，例如第二RAM；或者非易失性第二存储器(non-volatile memory)，例如第二ROM，快闪第二存储器(flash memory)，HDD或SSD；或者上述种类的第二存储器的组合，并向第二处理器29提供指令和数据。
另外，在本实施例中的各功能模块可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现，也可以采用软件功能模块的形式实现。
所述集成的单元如果以软件功能模块的形式实现并非作为独立的产品进行销售或使用时，可以存储在一个计算机可读取存储介质中，基于这样的理解，本实施例的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)或processor(处理器)执行本实施例所述方法的全部或部分步骤。而前述的存储介质包括：U盘、移动硬盘、ROM、RAM、磁碟或者光盘等各种可以存储程序代码的介质。
本发明实施例提供一种第二计算机可读存储介质，其上存储有第二程 序，应用于第二终端中，该第二程序被第二处理器执行时实现如实施例二和实施例三所述的方法。
具体来讲，本实施例中的一种视频处理的方法对应的第二程序指令可以被存储在光盘，硬盘，U盘等存储介质上，当存储介质中的与一种视频处理方法对应的第二程序指令被一电子设备读取或被执行时，包括如下步骤：在与第一终端进行视频通信时，接收所述第一终端发送的第一触控指令；响应所述第一触控指令，并将所述响应结果显示在触发所述第一触控指令的第二显示区域。
本领域内的技术人员应明白，本发明的实施例可提供为方法、系统、或计算机程序产品。因此，本发明可采用硬件实施例、软件实施例、或结合软件和硬件方面的实施例的形式。而且，本发明可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器和光学存储器等)上实施的计算机程序产品的形式。
本发明是参照根据本发明实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器，使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中，使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品，该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上，使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理，从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。
以上所述，仅为本发明的较佳实施例而已，并非用于限定本发明的保护范围。
工业实用性
本发明实施例的技术方案，当第一终端与第二终端进行视频通信时，用户可以在第一终端的当前显示界面上进行触控操作，此时第一终端可以根据该触控操作生成第一触控指令，并将第一触控指令发送至第二终端，与第二终端同步响应该第一触控指令，使得在视频通信模式下的第一终端能够及时对视频通话时的对方显示内容进行操作并同步显示。

Claims (32)

  1. 一种视频处理方法，应用于第一终端，所述方法包括：
    与第二终端进行视频通信时，接收对当前显示界面的触控操作；
    响应由所述触控操作生成的第一触控指令，并将所述响应结果显示在触发所述触控操作的所述当前显示界面对应的第一显示区域；
    将所述第一触控指令发送至所述第二终端，以供所述第二终端同步响应所述第一触控指令，并将所述响应结果显示在触发所述第一触控指令的所述第二终端对应的第二显示区域。
  2. 根据权利要求1所述的方法，其中，所述接收对当前显示界面的触控操作之后，所述响应由所述触控操作生成的第一触控指令之前，所述方法还包括：
    检测预设第一操作锁的状态，所述预设第一操作锁的状态包括激活状态，所述预设第一操作锁用于确定是否根据所述触控操作生成对应的所述第一触控指令；
    当检测到所述预设第一操作锁的状态为所述激活状态时，根据所述触控操作生成所述第一触控指令。
  3. 根据权利要求2所述的方法，其中，所述预设第一操作锁的状态还包括禁止状态，所述检测预设第一操作锁的状态之后，所述方法还包括：
    当检测到所述预设第一操作锁的状态为所述禁止状态时，将所述触控操作存储至预设操作序列中；
    在预设时间到达时，将所述预设第一操作锁的状态更改为所述激活状态，从所述预设操作序列中获取所述触控操作，并根据所述触控操作生成对应的第一触控指令，所述预设时间用于确定是否更改所述预设第一操作锁的状态。
  4. 根据权利要求1或2所述方法，其中，所述响应由所述触控操作生 成的第一触控指令，包括：
    检测第一视频帧对应的预设第二操作锁的状态，所述预设第二操作锁的状态包括持有状态，所述第一视频帧为所述触控操作对应的视频帧，所述预设第二操作锁用于确定是否响应所述第一触控指令；
    当检测到所述预设第二操作锁的状态为所述持有状态时，响应所述第一触控指令，并对所述第一视频帧进行相应的处理。
  5. 根据权利要求4所述的方法，其中，所述预设第二操作锁的状态还包括释放状态，所述检测第一视频帧对应的预设第二操作锁的状态之后，所述方法还包括：
    当检测到所述预设第二操作锁的状态为所述释放状态时，向所述第二终端发送释放第二操作锁指令，所述释放第二操作锁指令用于指示所述第二终端将所述预设第二操作锁的状态更改为所述释放状态；
    接收所述第二终端的释放响应指令，并根据所述释放响应指令将所述预设第二操作锁的状态更改为所述持有状态。
  6. 根据权利要求4所述的方法，其中，所述响应由所述触控操作生成的第一触控指令，并将所述响应结果显示在触发所述触控操作的所述当前显示界面对应的第一显示区域，包括：
    将第一预设指令与功能对应关系库，以及所述第一触控指令进行匹配；
    当匹配成功时，在所述第一预设指令与功能对应关系库中查找所述第一触控指令对应的第一功能；
    在所述第一显示区域上实现对所述第一视频帧的所述第一功能，所述第一显示区域为所述当前显示界面中所述第一视频帧对应的显示区域。
  7. 根据权利要求6所述的方法，其中，所述第一功能包括对所述第一视频帧进行放大显示、缩小显示、停止、开始或图像标记的功能中的至少一个。
  8. 根据权利要求1或2所述的方法，其中，所述接收对当前显示界面的触控操作之前，所述方法还包括：
    接收第一显示指令，所述第一显示指令用于在所述当前显示界面上显示虚拟操作列表；
    根据所述第一显示指令，在所述当前显示界面上显示所述虚拟操作列表；相应的，
    所述接收对当前显示界面的触控操作，包括：
    接收对所述虚拟操作列表的所述触控操作。
  9. 根据权利要求2或3所述的方法，其中，所述检测预设第一操作锁的状态，包括：
    检测是否接收到所述第二终端发送的第二触控指令；
    当检测到未接收到所述第二终端发送的所述第二触控指令时，表征所述预设第一操作锁的状态为所述激活状态；
    当检测到接收到所述第二终端发送的所述第二触控指令时，表征所述预设第一操作锁的状态为所述禁止状态。
  10. 根据权利要求6所述的方法，其中，所述接收对当前显示界面的触控操作之前，所述方法还包括：
    获取自身采集的视频帧和通过应用获取的所述第二终端采集的视频帧；
    将所述自身采集的视频帧和所述通过所述应用获取的所述第二终端采集的视频帧分别显示在所述当前显示界面的不同显示区域，所述当前显示界面包括所述第一显示区域和第二显示区域。
  11. 一种视频处理方法，应用于第二终端，所述方法包括：
    与第一终端进行视频通信时，接收所述第一终端发送的第一触控指令；
    响应所述第一触控指令，并将所述响应结果显示在触发所述第一触控 指令的第二显示区域。
  12. 根据权利要求11所述的方法，其中，所述响应所述第一触控指令，包括：
    检测预设第一操作锁的状态，所述预设第一操作锁的状态包括禁止状态，所述预设第一操作锁用于确定是否响应所述第一触控指令；
    当检测到所述预设第一操作锁的状态为所述禁止状态时，响应所述第一触控指令。
  13. 根据权利要求11所述的方法，其中，所述接收所述第一终端发送的第一触控指令之前，所述方法还包括：
    接收所述第一终端发送的释放第二操作锁指令，所述释放第二操作锁指令用于将第一视频帧对应的预设第二操作锁的状态更改为释放状态；
    判断是否正在对所述第一视频帧进行处理；
    当判断没有正在对所述第一视频帧进行处理时，将所述预设第二操作锁的状态更改为所述释放状态，并发送释放响应指令至所述第一终端。
  14. 根据权利要求13所述的方法，其中，所述响应所述第一触控指令，并将所述响应结果显示在触发所述第一触控指令的第二显示区域，包括：
    将第二预设指令与功能对应关系库，以及所述第一触控指令进行匹配；
    当匹配成功时，在所述第二预设指令与功能对应关系库中查找所述第一触控指令对应的第一功能；
    在第二显示区域上实现对所述第一视频帧的所述第一功能，所述第二显示区域为与所述第一终端进行视频通信时的当前显示界面中所述第一视频帧对应的显示区域。
  15. 一种第一终端，所述第一终端包括：
    第一接收单元，配置为与第二终端进行视频通信时，接收对当前显示界面的触控操作；
    响应单元，配置为响应由所述触控操作生成的第一触控指令；
    第一显示单元，配置为将所述响应结果显示在触发所述触控操作的所述当前显示界面对应的第一显示区域；
    第一发送单元，配置为将所述第一触控指令发送至所述第二终端，以供所述第二终端同步响应所述第一触控指令，并将所述响应结果显示在触发所述第一触控指令的所述第二终端对应的第二显示区域。
  16. 根据权利要求15所述的第一终端，其中，所述第一终端还包括：第一检测单元和生成单元；
    所述第一检测单元，配置为检测预设第一操作锁的状态，所述预设第一操作锁的状态包括激活状态，所述预设第一操作锁用于确定是否根据所述触控操作生成对应的所述第一触控指令；
    所述生成单元，配置为当检测到所述预设第一操作锁的状态为所述激活状态时，根据所述触控操作生成所述第一触控指令。
  17. 根据权利要求16所述的第一终端，其中，所述预设第一操作锁的状态还包括禁止状态，所述第一终端还包括：存储单元和获取单元；
    所述存储单元，配置为当检测到所述预设第一操作锁的状态为所述禁止状态时，将所述触控操作存储至预设操作序列中；
    所述获取单元，配置为在预设时间到达时，将所述预设第一操作锁的状态更改为所述激活状态，从所述预设操作序列中获取所述触控操作，并根据所述触控操作生成对应的第一触控指令，所述预设时间用于确定是否更改所述预设第一操作锁的状态。
  18. 根据权利要求15或16所述第一终端，其中，
    所述第一检测单元，还配置为检测第一视频帧对应的预设第二操作锁的状态，所述预设第二操作锁的状态包括持有状态，所述第一视频帧为所述触控操作对应的视频帧，所述预设第二操作锁用于确定是否响应所述第 一触控指令；
    所述响应单元，配置为当检测到所述预设第二操作锁的状态为所述持有状态时，响应所述第一触控指令，并对所述第一视频帧进行相应的处理。
  19. 根据权利要求18所述的第一终端，其中，所述预设第二操作锁的状态还包括释放状态，
    所述第一发送单元，还配置为当检测到所述预设第二操作锁的状态为所述释放状态时，向所述第二终端发送释放第二操作锁指令，所述释放第二操作锁指令用于指示所述第二终端将所述预设第二操作锁的状态更改为所述释放状态；
    所述第一接收单元，还配置为接收所述第二终端的释放响应指令，并根据所述释放响应指令将所述预设第二操作锁的状态更改为所述持有状态。
  20. 根据权利要求18所述的第一终端，其中，所述第一终端还包括：第一匹配单元和第一查找单元；
    所述第一匹配单元，配置为将第一预设指令与功能对应关系库，以及所述第一触控指令进行匹配；
    所述第一查找单元，配置为当匹配成功时，在所述第一预设指令与功能对应关系库中查找所述第一触控指令对应的第一功能；
    所述第一显示单元，配置为在所述第一显示区域上实现对所述第一视频帧的所述第一功能，所述第一显示区域为所述当前显示界面中所述第一视频帧对应的显示区域。
  21. 根据权利要求20所述的第一终端，其中，所述第一功能包括对所述第一视频帧进行放大显示、缩小显示、停止、开始或图像标记的功能中的至少一个。
  22. 根据权利要求15或16所述的第一终端，其中，所述第一终端还 包括：弹出单元；
    所述第一接收单元，还配置为接收第一显示指令，所述第一显示指令用于在所述当前显示界面上显示虚拟操作列表；
    所述弹出单元，配置为根据所述第一显示指令，在所述当前显示界面上显示所述虚拟操作列表；
    所述第一接收单元，配置为接收对所述虚拟操作列表的选择触控操作。
  23. 根据权利要求16或17所述的第一终端，其中，
    第一检测单元，配置为检测是否接收到所述第二终端发送的第二触控指令；当检测到未接收到所述第二终端发送的所述第二触控指令时，表征所述预设第一操作锁的状态为所述激活状态；当检测到接收到所述第二终端发送的所述第二触控指令时，表征所述预设第一操作锁的状态为所述禁止状态。
  24. 根据权利要求17或20所述的第一终端，其中，
    所述获取单元，还配置为获取自身采集的视频帧和通过应用获取的所述第二终端采集的视频帧；
    所述第一显示单元，还配置为将所述自身采集的视频帧和所述通过所述应用获取的所述第二终端采集的视频帧分别显示在所述当前显示界面的不同显示区域，所述当前显示界面包括所述第一显示区域和第二显示区域。
  25. 一种第一终端，包括第一存储器、第一接收器、第一发送器、第一显示器、第一处理器及存储在第一存储器上并可在第一处理器上运行的计算机程序，所述第一接收器和所述第一发送器依赖于所述第一处理器执行操作，当所述程序被第一处理器执行时，执行如下操作：
    所述第一接收器，配置为与第二终端进行视频通信时，接收对当前显示界面的触控操作；
    所述第一处理器，配置为响应由所述触控操作生成的第一触控指令；
    所述第一显示器，配置为所述响应结果显示在触发所述触控操作的所述当前显示界面对应的第一显示区域；
    所述第一发送器，配置为将所述第一触控指令发送至所述第二终端，以供所述第二终端同步响应所述第一触控指令，并将所述响应结果显示在触发所述第一触控指令的所述第二终端对应的第二显示区域。
  26. 一种第一计算机可读存储介质，其上存储有第一程序，应用于第一终端中，该第一程序被第一处理器执行时实现如权利要求1-10任一项所述的方法。
  27. 一种第二终端，所述第二终端包括：
    第二接收单元，配置为与第一终端进行视频通信时，接收所述第一终端发送的第一触控指令；
    第二响应单元，配置为响应所述第一触控指令；
    第二显示单元，配置为将所述响应结果显示在触发所述第一触控指令的第二显示区域。
  28. 根据权利要求27所述的第二终端，其中，所述第二终端还包括：第二检测单元；
    所述第二检测单元，配置为检测预设第一操作锁的状态，所述预设第一操作锁的状态包括禁止状态，所述预设第一操作锁用于确定是否响应所述第一触控指令；
    所述第二响应单元，配置为当检测到所述预设第一操作锁的状态为所述禁止状态时，响应所述第一触控指令。
  29. 根据权利要求27所述的第二终端，其中，所述第二终端还包括：判断单元、更改单元和第二发送单元；
    所述第二接收单元，还配置为接收所述第一终端发送的释放第二操作锁指令，所述释放第二操作锁指令用于将第一视频帧对应的预设第二操作 锁的状态更改为释放状态；
    所述判断单元，配置为判断是否正在对所述第一视频帧进行处理；
    所述更改单元，配置为当判断没有正在对所述第一视频帧进行处理时，将所述预设第二操作锁的状态更改为所述释放状态；
    所述第二发送单元，配置为发送释放响应指令至所述第一终端。
  30. 根据权利要求29所述的第二终端，其中，所述第二终端包括：第二匹配单元和第二查找单元；
    所述第二匹配单元，配置为将第二预设指令与功能对应关系库，以及所述第一触控指令进行匹配；
    所述第二查找单元，配置为当匹配成功时，在所述第二预设指令与功能对应关系库中查找所述第一触控指令对应的第一功能；
    所述第二显示单元，配置为在第二显示区域上实现对所述第一视频帧的所述第一功能，所述第二显示区域为与所述第一终端进行视频通信时的当前显示界面中所述第一视频帧对应的显示区域。
  31. 一种第二终端，包括第二存储器、第二显示器、第二处理器及存储在第二存储器上并可在第二处理器上运行的计算机程序，所述第二处理器执行程序时实现如下步骤：
    与第一终端进行视频通信时，接收所述第一终端发送的第一触控指令；
    响应所述第一触控指令；
    所述第二显示器，配置为将所述响应结果显示在触发所述第一触控指令的第二显示区域。
  32. 一种第二计算机可读存储介质，其上存储有第二程序，应用于第二终端中，该第二程序被第二处理器执行时实现如权利要求11-14任一项所述的方法。
PCT/CN2018/079675 2017-06-02 2018-03-20 一种视频处理方法、终端和计算机存储介质 WO2018219022A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710409532.4 2017-06-02
CN201710409532.4A CN108989900A (zh) 2017-06-02 2017-06-02 一种视频处理方法及终端

Publications (1)

Publication Number Publication Date
WO2018219022A1 true WO2018219022A1 (zh) 2018-12-06

Family

ID=64454466

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/079675 WO2018219022A1 (zh) 2017-06-02 2018-03-20 一种视频处理方法、终端和计算机存储介质

Country Status (2)

Country Link
CN (1) CN108989900A (zh)
WO (1) WO2018219022A1 (zh)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109672845B (zh) * 2018-12-29 2020-11-03 维沃移动通信有限公司 一种视频通话的方法、装置以及移动终端
CN114356463A (zh) * 2020-09-30 2022-04-15 广州三星通信技术研究有限公司 用于电子终端的应用显示方法及设备

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN203136049U (zh) * 2012-12-28 2013-08-14 上海良讯科技有限公司 一种用于远程视频系统的交互式数据共享及展示系统
CN103384874A (zh) * 2011-03-16 2013-11-06 北京大学 叠加注解输出
CN105159578A (zh) * 2015-08-24 2015-12-16 小米科技有限责任公司 视频显示模式的切换方法和装置
WO2016118678A1 (en) * 2015-01-21 2016-07-28 Microsoft Technology Licensing, Llc Method and apparatus for generating annotations for a video stream
CN106462373A (zh) * 2014-06-04 2017-02-22 苹果公司 视频通信数据的动态显示

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100748700B1 (ko) * 2006-01-18 2007-08-13 삼성전자주식회사 화이트보드를 이용한 원격회의 시스템 및 그 방법
KR20150027532A (ko) * 2013-09-04 2015-03-12 주식회사 모브릭 여러대의 액션캠 영상 동기화 제공방법 및 제공단말기
CN104348978A (zh) * 2014-11-12 2015-02-11 天津三星通信技术研究有限公司 移动终端的通话处理方法和装置
CN105701369A (zh) * 2014-11-27 2016-06-22 鸿富锦精密工业（深圳）有限公司 电子白板及电子白板控制方法
CN106506326B (zh) * 2016-09-30 2021-02-05 北京数字家圆科技有限公司 一种视频通话方法、终端及系统

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103384874A (zh) * 2011-03-16 2013-11-06 北京大学 叠加注解输出
CN203136049U (zh) * 2012-12-28 2013-08-14 上海良讯科技有限公司 一种用于远程视频系统的交互式数据共享及展示系统
CN106462373A (zh) * 2014-06-04 2017-02-22 苹果公司 视频通信数据的动态显示
WO2016118678A1 (en) * 2015-01-21 2016-07-28 Microsoft Technology Licensing, Llc Method and apparatus for generating annotations for a video stream
CN105159578A (zh) * 2015-08-24 2015-12-16 小米科技有限责任公司 视频显示模式的切换方法和装置

Also Published As

Publication number Publication date
CN108989900A (zh) 2018-12-11

Similar Documents

Publication Publication Date Title
CN107528938B (zh) 一种视频通话方法、终端及计算机可读存储介质
WO2017032086A1 (zh) 一种拍照控制方法及终端
KR101821750B1 (ko) 이미지 처리 방법 및 장치
EP3937426A1 (en) Master-slave server switching method and apparatus, electronic device and storage medium
KR101808773B1 (ko) 목표 기능의 시작 방법, 장치, 시스템, 프로그램 및 기록매체
RU2652452C2 (ru) Устройство и способ представления информации о состоянии сети
CA2866459A1 (en) Teleconference system and teleconference terminal
WO2014154003A1 (zh) 一种自拍图像的展现方法及装置
EP3640838A1 (en) Method, device, and system for issuing warning information
RU2609147C2 (ru) Способ и устройство для передачи изображений
WO2017214763A1 (zh) 上传视频的方法、装置及摄像装置
WO2014101213A1 (zh) 鼠标同步的方法、装置和系统
WO2022135005A1 (zh) 一种基于通话的屏幕共享方法、装置、设备及存储介质
CN103024200B (zh) 应用于智能终端的拍摄方法及拍摄装置
CN108965611B (zh) 拍摄界面的切换方法、装置、设备及存储介质
EP4054198A1 (en) Live broadcast method and apparatus, electronic device, and storage medium
JP2016048835A (ja) 撮像装置、撮像装置の制御方法、撮像装置の制御プログラム、及び撮像システム
WO2018219022A1 (zh) 一种视频处理方法、终端和计算机存储介质
WO2017063133A1 (zh) 一种拍摄方法和移动设备
CN111064930B (zh) 分屏显示方法、显示终端及存储装置
US20220159336A1 (en) Method and system for displaying screen
WO2017101336A1 (zh) 快捷开关的控制方法及装置
WO2024067468A1 (zh) 基于图像识别的交互控制方法、装置及设备
CN111787236B (zh) 用于全景图片拍摄的遥控装置、方法及全景图片拍摄系统
WO2019104533A1 (zh) 一种视频播放方法及装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18810756

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18810756

Country of ref document: EP

Kind code of ref document: A1