CN109561271B

CN109561271B - Method for guiding terminal operation, first terminal and second terminal

Info

Publication number: CN109561271B
Application number: CN201811379245.4A
Authority: CN
Inventors: 曹厚圣
Original assignee: Vivo Mobile Communication Co Ltd
Current assignee: Vivo Mobile Communication Co Ltd
Priority date: 2018-11-19
Filing date: 2018-11-19
Publication date: 2021-06-25
Anticipated expiration: 2038-11-19
Also published as: CN109561271A

Abstract

The invention provides a method for guiding terminal operation, a first terminal and a second terminal, which comprise the following steps: the first terminal acquires a guide video recorded by the second terminal, and the video frame of the guide video comprises the corresponding relation of an operation event, an operation area and a guide identifier; the first terminal responds to the playing operation aiming at the guide video, displays the video frame of the guide video in a first area of the first terminal, and displays an operation interface in a second area of the first terminal. The operation events, the operation areas and the guidance marks of the instructor are recorded in the guidance video, the specific operation only needs to start the screen recording and close the screen recording, the number of operation steps is small, and the instructor plays a role in reminding and learning the instructor by watching the guidance video comprising the guidance marks, so that the probability of the instructor losing operation details is greatly reduced, the guidance effect is improved, the user can watch the video and operate the video at the same time, and the guidance effect and the efficiency are improved.

Description

Method for guiding terminal operation, first terminal and second terminal

Technical Field

The embodiment of the invention relates to the technical field of communication, in particular to a method for guiding terminal operation, a first terminal and a second terminal.

Background

At present, the new functions of the intelligent mobile terminal are diversified, so that specific operations of a plurality of users on the new functions are unfamiliar, and the users are difficult to operate when the mobile terminal performs the new functions, so that the mobile terminal needs some auxiliary teaching functions to assist the users in knowing and learning the specific operations of the new functions.

In the prior art, two guidance schemes for terminal operation mainly include two, namely, a key picture operated in a mobile terminal is subjected to screen capture, then lines or characters are labeled on positions needing to be operated in a screen capture image, all labeled screen capture images are packaged and sent to a user needing to be guided, and the user needing to be guided can watch the labeled screen capture image to achieve the purpose of guiding the user. And the second scheme is to record the demonstration process of the whole operation in the mobile terminal through the recording function of the independent camera or the mobile terminal, generate a recorded video and send the recorded video to the user needing to be guided.

However, in the first scheme, when the number of terminal operation steps is large, the instructor needs to perform screen capture and labeling operations for multiple times, and the instructor needs to switch the screen capture pictures for multiple times to view, which is inefficient in guidance.

Disclosure of Invention

The embodiment of the invention provides a method for guiding terminal operation, a first terminal and a second terminal, and aims to solve the problems that in the prior art, the terminal operation guidance is complex in operation and operation details are easy to leak, so that the guidance effect is poor and the efficiency is low.

In a first aspect, an embodiment of the present invention provides a method for guiding a terminal operation, which is applied to a first terminal, and the method includes:

acquiring a guide video recorded by a second terminal, wherein a video frame of the guide video comprises a corresponding relation of an operation event, an operation area and a guide identifier;

and responding to the playing operation of the guide video, displaying the video frame of the guide video in a first area of the first terminal, and displaying an operation interface in a second area of the first terminal.

In a second aspect, an embodiment of the present invention provides a method for guiding a terminal operation, which is applied to a second terminal, and the method includes:

executing a recording start command for a screen of the second terminal;

when an operation event carried out on the second terminal is acquired, generating a guide identifier in an operation area corresponding to the operation event in the screen;

and adding the corresponding relation among the operation event, the operation area and the guidance identifier into a recorded corresponding video frame to obtain a guidance video, so that the first terminal can implement operation guidance after obtaining the guidance video.

In a third aspect, an embodiment of the present invention provides a first terminal, where the first terminal includes:

the first acquisition module is used for acquiring a guide video recorded by a second terminal, and a video frame of the guide video comprises a corresponding relation of an operation event, an operation area and a guide identifier;

and the display module is used for responding to the playing operation of the guide video, displaying the video frame of the guide video in a first area of the first terminal and displaying an operation interface in a second area of the first terminal.

In a fourth aspect, an embodiment of the present invention provides a second terminal, where the second terminal includes:

the recording starting module is used for executing a recording starting command aiming at the screen of the second terminal;

the generating module is used for generating a guide identifier in an operation area corresponding to the operation event in the screen when the operation event performed on the second terminal is acquired;

and the video acquisition module is used for adding the corresponding relation among the operation event, the operation area and the guidance identifier into the recorded corresponding video frame to obtain a guidance video so that the first terminal can implement operation guidance after acquiring the guidance video.

In a fifth aspect, an embodiment of the present invention further provides a first terminal, which includes a processor, a memory, and a computer program stored on the memory and executable on the processor, where the computer program, when executed by the processor, implements the steps of the guidance method applied to the terminal operation of the first terminal.

In a sixth aspect, the present invention further provides a readable storage medium, where instructions executed by a processor of an electronic device enable the electronic device to perform the steps of the guidance method applied to the terminal operation of the first terminal.

In a seventh aspect, an embodiment of the present invention further provides a second terminal, including a processor, a memory, and a computer program stored on the memory and executable on the processor, where the computer program, when executed by the processor, implements the steps of the guidance method applied to the terminal operation of the second terminal.

In an eighth aspect, the embodiment of the present invention further provides a readable storage medium, and instructions in the storage medium, when executed by a processor of an electronic device, enable the electronic device to execute the steps of the guidance method applied to the terminal operation of the second terminal.

In the embodiment of the invention, the mobile terminal can acquire the guide video recorded by the second terminal, and the video frame of the guide video comprises the corresponding relation of the operation event, the operation area and the guide identifier; and responding to the playing operation aiming at the guide video, displaying the video frame of the guide video in a first area of the first terminal, and displaying an operation interface in a second area of the first terminal. The operation event, the operation area and the guidance identification of the instructor are recorded in the guidance video through the screen recording function of the terminal, the specific operation only needs to start the screen recording and close the screen recording, the number of operation steps is small, and the guidance identification plays roles in reminding and learning the instructor by watching the guidance video comprising the guidance identification, so that the probability of missing the operation details of the instructor is greatly reduced, and the guidance effect is improved. And the video frame of the guide video is displayed in the first area of the first terminal, and the operation interface is displayed in the second area of the first terminal, so that the user can watch the video and operate the video at the same time, and the guide effect and efficiency are improved.

The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.

Drawings

Fig. 1 is a flowchart illustrating steps of a method for guiding a terminal operation of a first terminal according to an embodiment of the present invention;

fig. 2 is an interface diagram of a method for guiding terminal operation according to an embodiment of the present invention;

fig. 3 is an interface diagram of another guidance method for terminal operation according to an embodiment of the present invention;

fig. 4 is a flowchart illustrating steps of a method for guiding a terminal operation of a second terminal according to an embodiment of the present invention;

fig. 5 is a flowchart illustrating interaction of specific steps of a method for guiding a terminal operation according to an embodiment of the present invention;

fig. 6 is an interface diagram of another guidance method for terminal operation according to the embodiment of the present invention;

fig. 7 is a block diagram of a first terminal according to an embodiment of the present invention;

fig. 8 is a block diagram of a second terminal according to an embodiment of the present invention;

fig. 9 is a block diagram of a mobile terminal according to another embodiment of the present invention;

fig. 10 is a schematic structural diagram of a mobile terminal according to another embodiment of the present invention.

Detailed Description

Exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the invention are shown in the drawings, it should be understood that the invention can be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art.

Fig. 1 is a flowchart of steps of a method for guiding a terminal operation according to an embodiment of the present invention, where the method is applied to a first terminal, and as shown in fig. 1, the method may include:

step 101, obtaining a guide video recorded by a second terminal, wherein a video frame of the guide video comprises a corresponding relation of an operation event, an operation area and a guide identifier.

In the embodiment of the present invention, the first terminal may be a terminal used by an instructor to apply corresponding instructions, the first terminal may be a smart phone, a computer, a multimedia player, an e-reader, a wearable device, and the like, and the first terminal may implement a video playing function.

Specifically, in this step, the second terminal may send the guidance video to the first terminal that needs to be guided through a wireless or wired network, and in addition, the second terminal may also upload the guidance video to the internet or a cloud disk, so that the first terminal downloads the guidance video. In addition, when the video frame of the guide video comprises the operation event generated at the second terminal when the video frame is extracted, the operation area corresponding to the operation event and the guide identifier, so that the guided person can complete the guidance of the operation by watching the information included in the video frame.

For example, referring to fig. 2, an interface diagram of a guidance method for terminal operation according to an embodiment of the present invention is shown, where the interface is shown for the operation event 3 of clicking a hot spot configuration menu or the operation event 5 of opening or closing a hot spot button, where the operations of the operation event 3 and the operation event 5 may be click touch operations, specifically, according to the operation event 3, a trigger coordinate of a corresponding control may be obtained by querying as an entire menu area 31, that is, a user may enter the hot spot configuration interface by performing a click touch operation in the menu area 31. According to the operation event 5, the trigger coordinate of the corresponding control can be found as the button area 51 in the menu area, that is, the user can open or close the hot spot by performing a click touch operation on the button area 51.

Therefore, after the menu area 31 is determined to be the operation area of the operation event 3 and the button area 51 is determined to be the operation area of the operation event 5, a frame with a striking color may be further generated at the edges of the menu area 31 and the button area 51, and a guidance text of "click" may be added at the peripheral blank positions of the menu area 31 and the button area 51 according to the trigger type of the control corresponding to the operation event 3 and the operation event 5 as a click touch operation, where the guidance text and the frame at the edges of the menu area 31 and the button area 51 are guidance marks for providing guidance for a guided person.

And 102, responding to the playing operation of the guide video, displaying the video frame of the guide video in a first area of the first terminal, and displaying an operation interface in a second area of the first terminal.

In this step, when the guided person performs the target operation event on the first terminal, the video frames corresponding to the target operation event may be displayed in the first area of the screen of the first terminal, for example, the operation event filling the hotspot configuration information may correspond to 5 video frames, and then the pictures of the 5 video frames may be sequentially played in the first area of the screen of the first terminal, where the 5 video frames may include the operation area corresponding to the operation event and the guidance identifier, and the guided person may learn and understand the specific implementation of the operation event by watching the video frames through the guidance identifier therein.

Specifically referring to fig. 3, an interface diagram of another guidance method for terminal operation according to an embodiment of the present invention is shown, assuming that the guided person needs to perform an operation event 4 of hot spot configuration information filling, a first area 41 of a first terminal screen may be set as an area for displaying a video frame, a second area 42 is a user interface for the guided person to perform a specific operation, when the user performs the operation event 4, a video frame corresponding to the operation event 4 is directly displayed in the first area 41, the video frame includes a password configuration information filling area 43 of the hot spot, and a guidance text identifier of "click, enter password" is included in the video frame, the guided person may further find a corresponding user password configuration information filling area 44 in the user interface of the second area 42 according to viewing and learning of the video frame displayed in the first area 41, and completes the hot spot configuration information filling by clicking the field 44 and inputting the number.

To sum up, the method for guiding terminal operation provided by the embodiment of the present invention includes acquiring a guidance video recorded by a second terminal, where a video frame of the guidance video includes a corresponding relationship between an operation event, an operation area, and a guidance identifier; and responding to the playing operation aiming at the guide video, displaying the video frame of the guide video in a first area of the first terminal, and displaying an operation interface in a second area of the first terminal. The operation event, the operation area and the guidance identification of the instructor are recorded in the guidance video through the screen recording function of the terminal, the specific operation only needs to start the screen recording and close the screen recording, the number of operation steps is small, and the guidance identification plays roles in reminding and learning the instructor by watching the guidance video comprising the guidance identification, so that the probability of missing the operation details of the instructor is greatly reduced, and the guidance effect is improved. And the video frame of the guide video is displayed in the first area of the first terminal, and the operation interface is displayed in the second area of the first terminal, so that the user can watch the video and operate the video at the same time, and the guide effect and efficiency are improved.

Fig. 4 is a flowchart of steps of a method for guiding terminal operation according to an embodiment of the present invention, where the method is applied to a second terminal, and as shown in fig. 4, the method may include:

step 201, executing a recording start command for the screen of the second terminal.

In the embodiment of the present invention, the second terminal may be a terminal used by a mentor to provide corresponding guidance, the second terminal may be a smart phone, a computer, a multimedia player, an e-reader, a wearable device, and the like, and the second terminal may implement a screen recording function.

The screen recording function specifically means that after the instructor executes a screen recording starting command, the second terminal displays a current picture of a currently recorded screen, extracts current picture frames in the screen continuously, and arranges the extracted picture frames according to a time sequence to generate a video stream sequence after stopping screen recording, wherein the video stream sequence can be a recorded video.

Step 202, when an operation event performed on the second terminal is acquired, generating a guidance identifier in an operation area corresponding to the operation event in the screen.

In the embodiment of the invention, when the recording operation is performed on the screen of the second terminal, the normal other operations performed by the instructor on the second terminal are not affected, for example, when a video is recorded, the instructor can also use the second terminal to perform operations such as making a call, sending a short message and the like.

Specifically, the instructor may perform a corresponding operation at the second terminal according to the instruction content, where the operation may trigger generation of a corresponding operation event, for example, when the user performs an operation of opening a hotspot sharing of the second terminal, the operation events 1 of opening a setting application may be sequentially triggered in sequence, the operation event 2 of a personal hotspot submenu in the setting application is entered, the operation event 3 of the hotspot configuration menu is clicked, the operation event 4 of filling in configuration information of a hotspot is performed, and the operation event 5 of opening or closing a hotspot button is performed.

The specific content of each operation event can be obtained by calling an interface of a task manager in the second terminal, and the name, the resource occupation condition and the like of the operation event can be inquired through the task manager.

Further, the operation area corresponding to the operation event may be determined according to a specific physical operation (e.g., a gesture operation, a click operation, etc.) performed by the instructor when the operation event is executed, and the specific implementation is that according to a control triggered by the operation event in the second terminal, an area of the control in the screen is determined to be the operation area.

After the operation area is determined, a corresponding guidance identifier for providing guidance for the guided person may be further generated according to the type of the control triggered in the second terminal by the operation event.

Step 203, adding the corresponding relation between the operation event, the operation area and the guidance identifier into the corresponding recorded video frame to obtain a guidance video.

In the embodiment of the present invention, the recording of the screen of the second terminal is a continuous process, the second terminal continuously extracts the picture frames in the screen, when an operation event occurs, the operation event can be used as a unique identifier and stored in the picture frame corresponding to the operation event, the corresponding relationship between the operation event and the picture frame is established, and meanwhile, the picture frame further includes a guidance identifier corresponding to the operation event, a graphical interface corresponding to the operation event, and an operation step sequence number.

In the recording process, the instructor continuously performs instruction operation on the second terminal, and meanwhile, the second terminal continuously extracts the picture frames comprising the corresponding relation of the operation event, the operation area and the instruction identification in the recording process according to a certain time interval, after the instruction operation is finished, the instructor can manually close the recording operation, and then the second terminal can arrange all the collected picture frames according to the time sequence to generate the instruction video.

After the guidance video is obtained, the second terminal may send the guidance video to the first terminal that needs to be guided through a wireless or wired network, and in addition, the second terminal may also upload the guidance video to the internet or a cloud disk for a user who needs to download.

To sum up, the method for guiding terminal operation provided by the embodiment of the present invention includes executing a recording start command for a screen of a second terminal; when an operation event carried out on the second terminal is acquired, generating a guide identifier in an operation area corresponding to the operation event in a screen; and adding the corresponding relation of the operation event, the operation area and the guidance identifier into the corresponding recorded video frame to obtain the guidance video. The operation event, the operation area and the guidance identification of the instructor are recorded in the guidance video through the screen recording function of the terminal, the specific operation only needs to start the screen recording and close the screen recording, the number of operation steps is small, and the guidance identification plays roles in reminding and learning the instructor by watching the guidance video comprising the guidance identification, so that the probability of missing the operation details of the instructor is greatly reduced, and the guidance effect is improved. And the video frame of the guide video is displayed in the first area of the first terminal, and the operation interface is displayed in the second area of the first terminal, so that the user can watch the video and operate the video at the same time, and the guide effect and efficiency are improved.

Fig. 5 is a flowchart illustrating specific steps of a method for guiding a terminal operation according to an embodiment of the present invention, where the method is applied to a second terminal and a first terminal, and as shown in fig. 5, the method may include:

step 301, the second terminal executes a recording start command for a screen of the second terminal.

The step may specifically refer to the description of step 201, and is not described herein again.

Step 302, when an operation event performed on the second terminal is acquired, the second terminal generates a guidance identifier in an operation area corresponding to the operation event in the screen.

This step may specifically refer to the description of step 202, which is not described herein again.

Optionally, the guidance identifier includes one or more of a text identifier, an image identifier, and an audio identifier corresponding to the operation event.

In the embodiment of the present invention, the guidance identifier is used for playing a guidance role, and therefore, the guidance identifier may be a text (such as a brief operation method), an image (such as an arrow guide), an audio (such as a recording of the brief operation method), and the like corresponding to the operation event, or may be a combination of the above identifiers.

Optionally, in an implementation manner of the embodiment of the present invention, step 302 may further include:

in sub-step 3021, if the operation event includes a touch operation on the screen, the second terminal determines the operation region according to touch coordinates of the touch operation on the screen.

In the embodiment of the present invention, when the operation event includes a touch operation on the screen, as shown in fig. 2, an interface of an operation event 3 for clicking a hot spot configuration menu or an operation event 5 for opening or closing a hot spot button is shown, where the operations of the operation event 3 and the operation event 5 may be single-click touch operations, when an instructor performs the single-click touch operation, the screen records touch coordinates of the touch operation, and according to the touch coordinates, it is determined that the area 31 and the area 51 may be areas for receiving the single-click touch operation, that is, operation areas corresponding to the operation event 3 and the operation event 5.

Sub-step 3022, the second terminal generates the guidance identifier in the operation area.

In this step, a guidance identifier corresponding to the operation event may be generated in the operation area, and the guidance identifier may include one or more of a text identifier, an image identifier, and an audio identifier of the corresponding operation event.

Optionally, in another implementation manner of the embodiment of the present invention, step 302 may further include:

sub-step 3023, if the operation event includes a control operation on an input/output device disposed on the second terminal, the second terminal determines a region where the input/output device is closest to an edge of the screen as the operation region.

In this step, when the operation event is not an operation performed on the screen of the second terminal, the operation event may include a control operation on an input/output device disposed on the second terminal, the input/output device may be a physical key disposed around the screen of the second terminal, such as a volume key, a power key, and the like, and the input/output device may be an access device interfacing with a corresponding interface of the second terminal, such as a wired headset, a charger, and the like.

In the embodiment of the present invention, since the position of the input-output device relative to the screen of the second terminal is generally fixed, when the operation event includes a control operation on the input-output device provided on the second terminal, the region where the input-output device is closest to the edge of the screen may be determined as the operation region.

For example, referring to fig. 6, an interface diagram of another guidance method for terminal operation according to an embodiment of the present invention is shown, and assuming that a director needs to record an operation event entering a game at this time, and needs to insert an external earphone device and turn up the volume before entering the game in order to ensure better experience, at this time, it may be determined that an area where an earphone hole is closest to an edge of a screen is an area a, and an area where a volume up key is closest to the edge of the screen is an area B, and then a guidance identifier of "step 1, insert an earphone into a jack at this position" may be added to the area a in sequence, and a guidance identifier of "step 2, turn up the volume by a volume up button" here "is added to the area B.

And a substep 3024, the second terminal generating the guidance identifier in the operation area.

And 303, the second terminal adds the corresponding relation among the operation event, the operation area and the guidance identifier into the recorded corresponding video frame to obtain a guidance video, and sends the guidance video to the first terminal.

The step may specifically refer to the description of step 203, which is not described herein again.

Step 304, the first terminal acquires a guide video recorded by the second terminal, wherein a video frame of the guide video comprises a corresponding relation of an operation event, an operation area and a guide identifier.

The step may specifically refer to the description of step 101, which is not described herein again.

Step 305, the first terminal responds to the playing operation of the guide video, displays the video frame of the guide video in a first area of the first terminal, and displays an operation interface in a second area of the first terminal.

The step may specifically refer to the description of step 102, which is not described herein again.

Optionally, step 305 may further include:

in sub-step 3051, the first terminal displays, in a first region of the first terminal, a video frame, a forward control and a backward control corresponding to the second target operation event.

Referring to fig. 3, when the first terminal displays a video frame corresponding to the second target operation event in the guide video in the first region 41, the first terminal may further display a back control 45, a forward control 46, or a pause control 47.

And a substep 3052, when the forward control receives a touch operation, switching the displayed video frame from the video frame corresponding to the second target operation event to the video frame corresponding to the next operation event.

The guide video comprises a plurality of operation events, each operation event has a corresponding video frame, and the video frame can be one or a plurality of video frames. The next operational event is an operational event that follows the second target operational event (i.e., the current event).

According to the interface diagram shown in fig. 3, when the forward control 46 receives the touch operation, the first terminal switches the video frame corresponding to the second target operation event to the video frame corresponding to the next operation event, so that the guided person can learn the guidance of the next operation event in advance.

And a substep 3053, when the back control receives a touch operation, switching the displayed video frame from the video frame corresponding to the second target operation event to the video frame corresponding to the previous operation event.

According to the interface diagram shown in fig. 3, when the back control 45 receives the touch operation, the first terminal switches the video frame corresponding to the second target operation event to the video frame corresponding to the previous operation event, so that the guided person can review the guidance of the previous operation event in advance.

When the pause control 47 receives the touch operation, the first terminal keeps the video frame corresponding to the current second target operation event unchanged, so that the guided person can learn the guidance of the current operation event, and the details of the current operation event are prevented from being missed.

Step 306, when the first terminal receives a first target operation event of the operation interface displayed for the second area, displaying a video frame corresponding to the first target operation event in the guide video in the first area of the first terminal.

In this step, when the first terminal receives a first target operation event of the operation interface displayed in the second region, the first target operation event may be used as a query key, a query operation is performed in a correspondence relationship between the operation event, the operation region and the guidance identifier included in the video frame, a corresponding video frame is found, and a video frame corresponding to the first target operation event in the guidance video is displayed in the first region.

For example, when a user performs an operation of opening hotspot sharing, an operation event 1 of opening a setting application is sequentially triggered according to a sequence, an operation event 2 of a personal hotspot submenu in the setting application is entered, an operation event 3 of a hotspot configuration menu is clicked, an operation event 4 of filling configuration information of a hotspot is performed, and an operation event 5 of opening or closing a hotspot button is performed, and assuming that a first target operation event received by a first terminal is the operation event 2, the first terminal automatically displays a video frame corresponding to the operation event 2 in a first area.

Optionally, in another implementation manner of the embodiment of the present invention, the method may further include the following steps:

step a1, the second terminal generates a data packet including the corresponding relationship between the operation event, the operation area and the guidance identification.

In this embodiment of the present invention, when acquiring an operation event performed on the second terminal, the second terminal may further write a corresponding relationship between the operation event, the operation area, and the guidance identifier into a data packet for storage, where the data packet is compressed to form a compressed packet, and the compressed packet may also be decompressed to obtain a corresponding data packet.

And step A2, the second terminal sends the data packet to the first terminal.

Step A3, the first terminal obtains a data packet generated by the second terminal, wherein the data packet includes the corresponding relationship between the operation event, the operation area and the guidance identification.

In this step, the first terminal may obtain, by parsing the data packet generated by the second terminal, correspondence data including the operation event, the operation area, and the guidance identifier in the data packet.

Step a4, when a target operation event performed on the first terminal is acquired, the first terminal extracts a target operation area and a target guidance identifier corresponding to the target operation event in the data packet.

In this step, when the first terminal acquires a target operation event performed on the first terminal, the target operation event is matched with the correspondence data, and a target operation area and a target guidance identifier corresponding to the target operation event are acquired.

Step A5, displaying the target guide identifier at a position corresponding to the target operation area in the screen of the first terminal.

In this step, the target guide identifier may be directly displayed at a position corresponding to the target operation area in the screen of the first terminal. For example, referring to the interface shown in fig. 2, assuming that the interface is a decoding interface of a first terminal, and a guided person clicks an operation event 3 of a hot spot configuration menu or an operation event 5 of opening or closing a hot spot button on the first terminal, when the guided person enters the interface, the first terminal may determine, according to an operation event before the guided person, that an operation event to be performed by the guided person is the operation event 3 or the operation event 5, at this time, the first terminal matches the operation event 3 and the operation event 5 with corresponding relationships obtained by parsing in a data packet, determines an operation area 31 corresponding to the operation event 3 and an operation area 51 corresponding to the operation event 5, and a same guidance identifier "click" corresponding to the operation event 3 and the operation event 5, and finally directly adds a line guidance identifier and a "click" text guidance identifier with a striking color to edges of the operation area 31 and the operation area 51, the operation guidance for the guided person is completed, and the guided person is not interfered by the corresponding guidance mark to the normal operation when executing the operation event 3 and the operation event 5.

To sum up, the method for guiding terminal operation provided by the embodiment of the present invention includes acquiring a guidance video recorded by a second terminal, where a video frame of the guidance video includes a corresponding relationship between an operation event, an operation area, and a guidance identifier; and responding to the playing operation aiming at the guide video, displaying the video frame of the guide video in a first area of the first terminal, and displaying an operation interface in a second area of the first terminal. The operation event, the operation area and the guidance identification of the instructor are recorded in the guidance video through the screen recording function of the terminal, the specific operation only needs to start the screen recording and close the screen recording, the number of operation steps is small, and the guidance identification plays roles in reminding and learning the instructor by watching the guidance video comprising the guidance identification, so that the probability of missing the operation details of the instructor is greatly reduced, and the guidance effect is improved. And the video frame of the guide video is displayed in the first area of the first terminal, and the operation interface is displayed in the second area of the first terminal, so that the user can watch the video and operate the video at the same time, and the guide effect and efficiency are improved. When the operation event comprises control operation on the input and output equipment arranged on the second terminal, the area with the closest distance between the input and output equipment and the edge of the screen can be determined as the operation area, and the guidance identification is added in the area and stored in the corresponding video frame, so that the purpose of guiding and demonstrating more types of operation is achieved.

Fig. 7 is a block diagram of a first terminal according to an embodiment of the present invention, and as shown in fig. 7, the first terminal 40 includes:

a first obtaining module 401, configured to obtain a guidance video recorded by a second terminal, where a video frame of the guidance video includes a correspondence between an operation event, an operation area, and a guidance identifier;

a displaying module 402, configured to, in response to a playing operation for the guide video, display a video frame of the guide video in a first area of the first terminal, and display an operation interface in a second area of the first terminal.

Optionally, the display module 402 includes:

the display sub-module is used for displaying a video frame, a forward control and a backward control corresponding to a second target operation event in a first area of the first terminal;

the first switching sub-module is used for switching the displayed video frame from the video frame corresponding to the second target operation event to the video frame corresponding to the next operation event when the forward control receives the touch operation;

and the second switching submodule is used for switching the displayed video frame from the video frame corresponding to the second target operation event to the video frame corresponding to the last operation event when the back control receives the touch operation.

Optionally, the first terminal further includes:

and the video frame display module is used for displaying a video frame corresponding to the first target operation event in the guide video in the first area of the first terminal when the first target operation event of the operation interface displayed aiming at the second area is received.

In summary, the first terminal provided in the embodiment of the present invention includes obtaining a guidance video recorded by the second terminal, where a video frame of the guidance video includes a corresponding relationship between an operation event, an operation area, and a guidance identifier; and responding to the playing operation aiming at the guide video, displaying the video frame of the guide video in a first area of the first terminal, and displaying an operation interface in a second area of the first terminal. The operation event, the operation area and the guidance identification of the instructor are recorded in the guidance video through the screen recording function of the terminal, the specific operation only needs to start the screen recording and close the screen recording, the number of operation steps is small, and the guidance identification plays roles in reminding and learning the instructor by watching the guidance video comprising the guidance identification, so that the probability of missing the operation details of the instructor is greatly reduced, and the guidance effect is improved. And the video frame of the guide video is displayed in the first area of the first terminal, and the operation interface is displayed in the second area of the first terminal, so that the user can watch the video and operate the video at the same time, and the guide effect and efficiency are improved.

Fig. 8 is a block diagram of a second terminal according to an embodiment of the present invention, and as shown in fig. 8, the second terminal 50 includes:

a recording start module 501, configured to execute a recording start command for a screen of the second terminal;

a generating module 502, configured to generate a guidance identifier in an operation area corresponding to an operation event in the screen when the operation event performed on the second terminal is acquired;

the video obtaining module 503 is configured to add the corresponding relationship between the operation event, the operation area, and the guidance identifier to a corresponding recorded video frame to obtain a guidance video, so that the first terminal performs operation guidance after obtaining the guidance video.

In summary, the second terminal provided in the embodiment of the present invention includes a recording start command for executing a screen of the second terminal; when an operation event carried out on the second terminal is acquired, generating a guide identifier in an operation area corresponding to the operation event in a screen; and adding the corresponding relation of the operation event, the operation area and the guidance identifier into the corresponding recorded video frame to obtain the guidance video. The operation event, the operation area and the guidance identification of the instructor are recorded in the guidance video through the screen recording function of the terminal, the specific operation only needs to start the screen recording and close the screen recording, the number of operation steps is small, and the guidance identification plays roles in reminding and learning the instructor by watching the guidance video comprising the guidance identification, so that the probability of missing the operation details of the instructor is greatly reduced, and the guidance effect is improved. And the video frame of the guide video is displayed in the first area of the first terminal, and the operation interface is displayed in the second area of the first terminal, so that the user can watch the video and operate the video at the same time, and the guide effect and efficiency are improved.

The embodiment of the present invention further provides a first terminal and a second terminal, which may be mobile terminals, and include a processor, a memory, and a computer program stored in the memory and capable of running on the processor, where the computer program, when executed by the processor, implements each process of the above-mentioned embodiment of the method for guiding a terminal operation, and can achieve the same technical effect, and is not described herein again to avoid repetition.

The embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements each process of the above-mentioned guidance method for terminal operation, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.

Fig. 9 is a block diagram of a mobile terminal according to another embodiment of the present invention. The mobile terminal may include a first terminal or a second terminal, and the mobile terminal 600 shown in fig. 9 includes: at least one processor 601, memory 602, at least one network interface 604, a user interface 603, and a camera 606. The various components in the mobile terminal 600 are coupled together by a bus system 605. It is understood that the bus system 605 is used to enable communications among the components. The bus system 605 includes a power bus, a control bus, and a status signal bus in addition to a data bus. For clarity of illustration, however, the various buses are labeled as bus system 605 in fig. 9.

The user interface 603 may include, among other things, a display, a keyboard, or a pointing device (e.g., a mouse, trackball, touch pad, or flexible screen, among others.

It will be appreciated that the memory 602 in embodiments of the invention may be either volatile memory or nonvolatile memory, or may include both volatile and nonvolatile memory. The non-volatile memory may be a Read-only memory (ROM), a programmable Read-only memory (PROM), an erasable programmable Read-only memory (erasabprom, EPROM), an electrically erasable programmable Read-only memory (EEPROM), or a flash memory. The volatile memory may be a Random Access Memory (RAM) which functions as an external cache. By way of example, but not limitation, many forms of RAM are available, such as static random access memory (staticiram, SRAM), dynamic random access memory (dynamic RAM, DRAM), synchronous dynamic random access memory (syncronous DRAM, SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM ), Enhanced Synchronous DRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), and direct memory bus RAM (DRRAM). The memory 602 of the subject systems and methods is intended to comprise, without being limited to, these and any other suitable types of memory.

In some embodiments, memory 602 stores the following elements, executable modules or data structures, or a subset thereof, or an expanded set thereof: an operating system 6021 and application programs 6022.

The operating system 6021 includes various system programs, such as a framework layer, a core library layer, a driver layer, and the like, and is used for implementing various basic services and processing hardware-based tasks. The application program 6022 includes various application programs such as a media player (MediaPlayer), a Browser (Browser), and the like, and is used to implement various application services. A program implementing the method of an embodiment of the invention can be included in the application program 6022.

In the embodiment of the present invention, by calling a program or an instruction stored in the memory 602, specifically, a program or an instruction stored in the application program 6022, the processor 601 is configured to execute the step of acquiring, by the first terminal, a guidance video recorded by the second terminal, where a video frame of the guidance video includes a corresponding relationship between an operation event, an operation area, and a guidance identifier; the first terminal responds to the playing operation aiming at the guide video, displays the video frame of the guide video in a first area of the first terminal, and displays an operation interface in a second area of the first terminal. The processor 601 may be further configured to execute a recording start command for a screen of the second terminal; when an operation event carried out on the second terminal is acquired, generating a guide identifier in an operation area corresponding to the operation event in a screen; and adding the corresponding relation of the operation event, the operation area and the guidance identifier into the corresponding recorded video frame to obtain the guidance video.

The method disclosed by the above-mentioned embodiment of the present invention can be applied to the processor 601, or implemented by the processor 601. The processor 601 may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be performed by integrated logic circuits of hardware or instructions in the form of software in the processor 601. The processor 601 may be a general-purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic device, or discrete hardware components. The various methods, steps and logic blocks disclosed in the embodiments of the present invention may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present invention may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software module may be located in ram, flash memory, rom, prom, or eprom, registers, etc. storage media as is well known in the art. The storage medium is located in the memory 602, and the processor 601 reads the information in the memory 602 and completes the steps of the method in combination with the hardware thereof.

It is to be understood that the embodiments described herein may be implemented in hardware, software, firmware, middleware, microcode, or any combination thereof. For a hardware implementation, the processing units may be implemented within one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), general purpose processors, controllers, micro-controllers, microprocessors, other electronic units configured to perform the functions described herein, or a combination thereof.

For a software implementation, the techniques described in this disclosure may be implemented with modules (e.g., procedures, functions, and so on) that perform the functions described in this disclosure. The software codes may be stored in a memory and executed by a processor. The memory may be implemented within the processor or external to the processor.

The mobile terminal 600 can implement each process implemented by the mobile terminal in the foregoing embodiments, and details are not repeated here to avoid repetition.

In the embodiment of the present invention, the mobile terminal 600 may obtain a guidance video recorded by the second terminal, where a video frame of the guidance video includes a corresponding relationship between an operation event, an operation area, and a guidance identifier; and responding to the playing operation aiming at the guide video, displaying the video frame of the guide video in a first area of the first terminal, and displaying an operation interface in a second area of the first terminal. The operation event, the operation area and the guidance identification of the instructor are recorded in the guidance video through the screen recording function of the terminal, the specific operation only needs to start the screen recording and close the screen recording, the number of operation steps is small, and the guidance identification plays roles in reminding and learning the instructor by watching the guidance video comprising the guidance identification, so that the probability of missing the operation details of the instructor is greatly reduced, and the guidance effect is improved. And the video frame of the guide video is displayed in the first area of the first terminal, and the operation interface is displayed in the second area of the first terminal, so that the user can watch the video and operate the video at the same time, and the guide effect and efficiency are improved.

Specifically, the mobile terminal may be the first terminal or the second terminal, and the mobile terminal 700 in fig. 10 may be a mobile phone, a tablet computer, a Personal Digital Assistant (PDA), or a vehicle-mounted computer.

The mobile terminal 700 in fig. 10 includes a Radio Frequency (RF) circuit 710, a memory 720, an input unit 730, a display unit 740, a processor 760, an audio circuit 770, a wireless local area network (wireless fidelity) module 780, a power supply 790, and a camera 7110.

The input unit 730 may be used, among other things, to receive numeric or character information input by a user and to generate signal inputs related to user settings and function control of the mobile terminal 700. Specifically, in the embodiment of the present invention, the input unit 730 may include a touch panel 731. The touch panel 731 is capable of collecting touch operations performed by a user (e.g. operations performed by the user on the touch panel 731 by using a finger, a stylus, or any other suitable object or accessory) and driving the corresponding connection device according to a predetermined program. Alternatively, the touch panel 731 may include two portions of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 760, and can receive and execute commands sent from the processor 760. In addition, the touch panel 731 may be implemented by various types, such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. In addition to the touch panel 731, the input unit 730 may include other input devices 732, and the other input devices 732 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like.

Among them, the display unit 740 may be used to display information input by the user or information provided to the user and various menu interfaces of the mobile terminal 700. The display unit 740 may include a display panel 741, and optionally, the display panel 741 may be configured in the form of an LCD or an organic light-emitting diode (OLED).

It should be noted that the touch panel 731 can cover the display panel 741 to form a touch display screen, and when the touch display screen detects a touch operation on or near the touch display screen, the touch display screen is transmitted to the processor 760 to determine the type of the touch event, and then the processor 760 provides a corresponding visual output on the touch display screen according to the type of the touch event.

The touch display screen comprises an application program interface display area and a common control display area. The arrangement modes of the application program interface display area and the common control display area are not limited, and can be an arrangement mode which can distinguish two display areas, such as vertical arrangement, left-right arrangement and the like. The application interface display area may be used to display an interface of an application. Each interface may contain at least one interface element such as an icon and/or widget desktop control for an application. The application interface display area may also be an empty interface that does not contain any content. The common control display area is used for displaying controls with high utilization rate, such as application icons like setting buttons, interface numbers, scroll bars, phone book icons and the like.

The processor 760 is a control center of the mobile terminal 700, connects various parts of the entire handset using various interfaces and lines, and performs various functions of the mobile terminal 700 and processes data by operating or executing software programs and/or modules stored in the first memory 721 and calling data stored in the second memory 722, thereby integrally monitoring the mobile terminal 700. Alternatively, processor 760 may include one or more processing units.

In this embodiment of the present invention, the processor 760 is configured to execute acquiring, by calling a software program and/or a module stored in the first memory 721 and/or data stored in the second memory 722, a guidance video recorded by the second terminal for the first terminal, where a video frame of the guidance video includes a corresponding relationship between an operation event, an operation area, and a guidance identifier; the first terminal responds to the playing operation aiming at the guide video, displays the video frame of the guide video in a first area of the first terminal, and displays an operation interface in a second area of the first terminal. Processor 760 may also be used to execute a record start command for a screen of a second terminal; when an operation event carried out on the second terminal is acquired, generating a guide identifier in an operation area corresponding to the operation event in a screen; and adding the corresponding relation of the operation event, the operation area and the guidance identifier into the corresponding recorded video frame to obtain the guidance video.

It can be seen that, in the embodiment of the present invention, the mobile terminal may include: acquiring a guide video recorded by a second terminal, wherein the video frame of the guide video comprises the corresponding relation of an operation event, an operation area and a guide identifier; and responding to the playing operation aiming at the guide video, displaying the video frame of the guide video in a first area of the first terminal, and displaying an operation interface in a second area of the first terminal. The operation event, the operation area and the guidance identification of the instructor are recorded in the guidance video through the screen recording function of the terminal, the specific operation only needs to start the screen recording and close the screen recording, the number of operation steps is small, and the guidance identification plays roles in reminding and learning the instructor by watching the guidance video comprising the guidance identification, so that the probability of missing the operation details of the instructor is greatly reduced, and the guidance effect is improved. And the video frame of the guide video is displayed in the first area of the first terminal, and the operation interface is displayed in the second area of the first terminal, so that the user can watch the video and operate the video at the same time, and the guide effect and efficiency are improved.

For the above device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and for the relevant points, refer to the partial description of the method embodiment.

The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.

As is readily imaginable to the person skilled in the art: any combination of the above embodiments is possible, and thus any combination between the above embodiments is an embodiment of the present invention, but the present disclosure is not necessarily detailed herein for reasons of space.

The guidance methods for terminal operation provided herein are not inherently related to any particular computer, virtual system, or other apparatus. Various general purpose systems may also be used with the teachings herein. The structure required to construct a system incorporating aspects of the present invention will be apparent from the description above. Moreover, the present invention is not directed to any particular programming language. It is appreciated that a variety of programming languages may be used to implement the teachings of the present invention as described herein, and any descriptions of specific languages are provided above to disclose the best mode of the invention.

In the description provided herein, numerous specific details are set forth. It is understood, however, that embodiments of the invention may be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.

Similarly, it should be appreciated that in the foregoing description of exemplary embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the invention and aiding in the understanding of one or more of the various inventive aspects. However, the disclosed method should not be interpreted as reflecting an intention that: that the invention as claimed requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the detailed description are hereby expressly incorporated into this detailed description, with each claim standing on its own as a separate embodiment of this invention.

Those skilled in the art will appreciate that the modules in the device in an embodiment may be adaptively changed and disposed in one or more devices different from the embodiment. The modules or units or components of the embodiments may be combined into one module or unit or component, and furthermore they may be divided into a plurality of sub-modules or sub-units or sub-components. All of the features disclosed in this specification (including any accompanying claims, abstract and drawings), and all of the processes or elements of any method or apparatus so disclosed, may be combined in any combination, except combinations where at least some of such features and/or processes or elements are mutually exclusive. Each feature disclosed in this specification (including any accompanying claims, abstract and drawings) may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stated otherwise.

Furthermore, those skilled in the art will appreciate that while some embodiments described herein include some features included in other embodiments, rather than other features, combinations of features of different embodiments are meant to be within the scope of the invention and form different embodiments. For example, in the claims, any of the claimed embodiments may be used in any combination.

The various component embodiments of the invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. It will be appreciated by those skilled in the art that a microprocessor or Digital Signal Processor (DSP) may be used in practice to implement some or all of the functions of some or all of the components of the method of identifying background music in video according to embodiments of the present invention. The present invention may also be embodied as apparatus or device programs (e.g., computer programs and computer program products) for performing a portion or all of the methods described herein. Such programs implementing the present invention may be stored on computer-readable media or may be in the form of one or more signals. Such a signal may be downloaded from an internet website or provided on a carrier signal or in any other form.

It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by one and the same item of hardware. The usage of the words first, second and third, etcetera do not indicate any ordering. These words may be interpreted as names.

Claims

1. A method for guiding terminal operation is applied to a first terminal, and is characterized in that the method comprises the following steps:

acquiring a guide video recorded by a second terminal, wherein each frame in video frames of the guide video comprises a corresponding relation of an operation event, an operation area and a guide identifier;

responding to the playing operation of the guide video, displaying a video frame of the guide video in a first area of the first terminal, and displaying an operation interface in a second area of the first terminal;

wherein, when the first area shows the video frame, the edge of the operation area is highlighted;

wherein the operation event refers to an event triggered by the operation of a user;

when a first target operation event of the operation interface displayed aiming at the second area is received, displaying a video frame corresponding to the first target operation event in the guide video in the first area of the first terminal.

2. The method of claim 1, wherein said presenting the video frame of the instructional video in the first area of the first terminal comprises:

displaying a video frame, a forward control and a backward control corresponding to a second target operation event in a first area of the first terminal;

after showing the video frame, the forward control and the backward control corresponding to the second target operation event, the method further comprises:

when the forward control receives a touch operation, switching the displayed video frame from the video frame corresponding to the second target operation event to the video frame corresponding to the next operation event;

and when the back control receives a touch operation, switching the displayed video frame from the video frame corresponding to the second target operation event to the video frame corresponding to the last operation event.

3. The method of any of claims 1 to 2, wherein the guidance identifier comprises one or more of a text identifier, an image identifier, and an audio identifier corresponding to the operation event.

4. A method for guiding terminal operation is applied to a second terminal, and is characterized in that the method comprises the following steps:

executing a recording start command for a screen of the second terminal;

adding the corresponding relation among the operation event, the operation area and the guidance identification into a recorded corresponding video frame to obtain a guidance video, so that the first terminal can implement operation guidance after obtaining the guidance video;

the video frame is a video frame displayed by the second terminal when the operation event occurs, and each frame of the video frame comprises a corresponding relation with the operation event, the operation area and the guidance identifier.

5. The method of claim 4, wherein the guidance identifier comprises one or more of a text identifier, an image identifier, and an audio identifier corresponding to the operation event.

6. A first terminal, characterized in that the first terminal comprises:

the first acquisition module is used for acquiring a guide video recorded by a second terminal, wherein each frame in video frames of the guide video comprises a corresponding relation of an operation event, an operation area and a guide identifier;

the display module is used for responding to the playing operation of the guide video, displaying the video frame of the guide video in a first area of the first terminal and displaying an operation interface in a second area of the first terminal;

7. The first terminal of claim 6, wherein the display module comprises:

8. The first terminal according to any of claims 6 to 7, wherein the guidance identifier comprises one or more of a text identifier, an image identifier, and an audio identifier corresponding to the operation event.

9. A second terminal, characterized in that the second terminal comprises:

the video acquisition module is used for adding the corresponding relation among the operation event, the operation area and the guidance identifier into a recorded corresponding video frame to obtain a guidance video so that the first terminal can implement operation guidance after acquiring the guidance video;

10. The second terminal of claim 9, wherein the guidance identifier comprises one or more of a text identifier, an image identifier, and an audio identifier corresponding to the operation event.

11. A first terminal characterized in that it comprises a processor, a memory and a computer program stored on said memory and executable on said processor, said computer program, when executed by said processor, implementing the steps of the method of guidance of the operation of a terminal according to any one of claims 1 to 3.

12. A second terminal, characterized in that it comprises a processor, a memory and a computer program stored on said memory and executable on said processor, said computer program, when executed by said processor, implementing the steps of the method of guidance of terminal operation according to any of claims 4 to 5.