WO2022089034A1

WO2022089034A1 - Method for generating video note and electronic device

Info

Publication number: WO2022089034A1
Application number: PCT/CN2021/117569
Authority: WO
Inventors: 陈俊亮
Original assignee: 华为技术有限公司
Priority date: 2020-10-30
Filing date: 2021-09-10
Publication date: 2022-05-05
Also published as: CN114449333B; CN114449333A

Abstract

A method for making a video note. The method comprises: when a user is recording a video or watching a video, setting a plurality of keywords in advance, identifying the keywords by voice during the recording process, and recording the time when the keywords are identified, to form video tags of "keyword" + "time point"; and recording a keyword, a page number, start time and end time of a note entered by the user, to form a note tag of "page number" + "keyword" + "start time" + "end time". According to the association between the note tag and the video tags, an association between the video and the note is formed. The user does not need to perform secondary editing on the video, and can complete the matching of the video and a note once the recording ends, improving the flexibility and convenience of an electronic video note.

Description

Video note generation method and electronic device

This application claims the priority of the Chinese patent application with the application number 202011193993.0 and the application title "Video Note Generation Method and Electronic Device" filed with the China Patent Office on October 30, 2020, the entire contents of which are incorporated into this application by reference .

technical field

The present application relates to the field of computer technology, and in particular, to a method for generating video notes and an electronic device.

Background technique

During classes or training sessions at school, videos are often recorded for those who haven’t come or to review for review. However, there will be a problem. The recorded video is too long, and the viewer cannot determine the key sections of the video. The recorded notes also cannot be automatically matched with the video content.

At present, most of the inventions for making video notes solve this problem by secondary editing of the video, and the user adds the note content in the corresponding section. The editing process is very time-consuming, and it also has certain requirements for video editing technology. .

SUMMARY OF THE INVENTION

The present application provides a method and electronic device for generating video notes, which can support users to record notes while recording videos or online videos, without the need for users to perform any video editing operations, and can automatically associate video content with corresponding notes to generate video notes . When viewing a video note, the user can view the video and the note content corresponding to the video in this section at the same time, allowing the user to quickly review the key content and making the video note making process more efficient.

In a first aspect, the present application provides a method for generating a video note, the method comprising: obtaining one or more video tags by an electronic device, and each video tag in the one or more video tags includes a first keyword and a first moment, The first keyword is any one of the preset keywords, and the first moment is the time point when the first keyword is recognized, wherein each video tag is generated according to the received video; the electronic device obtains one or more Note label, each note label in one or more note labels includes a second keyword and a time interval, the second keyword is any one of the preset keywords, and the time interval includes the time when the user records a note corresponding to a note label. The start time and end time, the notes are recorded by the user according to the content of the video; according to the target note tag, match the target video tag in one or more video tags, and associate the note corresponding to the target note tag with the target video tag , the target note label is any one of one or more note labels. By matching note tags with video tags, you can associate notes with videos, and generate video notes without user editing, making it easy to review key content.

In a possible implementation manner, the specific implementation of matching the target video tag in one or more video tags may include: obtaining the target keyword, and querying the above one or more video tags for the first keyword to be the same as the target keyword obtain the first video tag set, and the target keyword is the second keyword corresponding to the target note tag; obtain the start time point and the end time point corresponding to the target note tag; according to preset conditions, extract the first video tag Target video tags that meet preset conditions in the set, the preset conditions include that the first moment in the target video tag is earlier than the starting time point corresponding to the target note tag, and the first moment in the target video tag is the first video tag set the earliest moment. When users take notes, they first hear the keywords and key content that need to be recorded, and then record them. Therefore, when matching the target video tag for the target note tag, set the condition to the starting time point of the target note tag at the first moment. The first time is the earliest, and the target video tag can be quickly found.

In a possible implementation manner, each note label further includes a page number, and one or more note labels are arranged according to the page number from small to large, wherein, the smaller the page number value, the earlier the user records the note corresponding to the page number, and the preset condition It also includes: the first moment in the target video tag is later than the end time point corresponding to the first note tag, and the first note tag is arranged before the target note tag and is adjacent to the target note tag. When the user takes notes, the video interval corresponding to the note being recorded on the current page is after the video interval corresponding to the previous page of notes, so the condition can be further set as the first moment is before the start time point of the target note label, and the target After the end time point of the previous note tag before the note tag, and the first moment is the earliest, the target video tag can be quickly found.

In a possible implementation manner, the electronic device associates the note corresponding to the target note tag with the target video tag. The specific implementation may include: associating the first moment in the target video tag with the termination time point corresponding to the target note tag. The target video is associated with the note corresponding to the target note tag. The first moment of the target video label is the time when the user hears the key content, the end time of the target note label is the time when the user completes the note, and the video interval determined by the two time points is the video corresponding to the target note. section, which associates the target note with the corresponding video section.

In a possible implementation manner, the electronic device acquires the video and the voice corresponding to the video, recognizes a preset keyword according to the voice, and generates a video tag when the first keyword is recognized.

In a possible implementation manner, the electronic device obtains the second keyword selected by the user, and obtains the time point of the second keyword as the starting time point; obtains the page-turning instruction triggered by the user, and records the obtained page-turning instruction The time point is used as the end time point, and a note label is generated.

The video tag is generated by the preset keywords appearing in the speech recognition video, the note tag is generated by the obtained start time and end time of the user input note, and the note and the video are corresponding by matching the video tag and the note tag.

In a possible implementation manner, when the electronic device detects that the user is viewing the note corresponding to the target note tag, the electronic device plays the target video from the first moment in the target video tag.

With reference to the first aspect, in some embodiments, when the electronic device detects the video content before the termination time point corresponding to the target note tag after the electronic device detects the first moment in the playback target video tag, the electronic device displays on the screen the video content corresponding to the target note tag 's notes.

In a possible implementation manner, the video is a video recorded by an electronic device or a video received by the electronic device through a network.

The video in this application is not limited to the video being recorded, but can also be the video received through the network, which can be applied to various usage scenarios such as student classes and video conferences.

In a second aspect, the present application provides an electronic device. The electronic device may include: one or more functional modules, where the one or more functional modules are used to execute the first aspect or any possible implementation manner of the first aspect. the method described.

In a third aspect, the present application provides a computer device, including a memory, a processor, and a computer program stored in the memory and running on the processor, characterized in that, when the processor executes the computer program, the computer device can achieve the first Any possible implementation of any of the aspects.

A fourth aspect provides a computer-readable storage medium, where instructions are stored in the computer-readable storage medium, which, when executed on a computer, cause the computer to execute the first aspect or any possible implementation manner of the first aspect. method described.

A fifth aspect, a computer program product comprising instructions, characterized in that, when the computer program product is run on an electronic device, the electronic device is made to execute the first aspect or any possible implementation manner of the first aspect method.

Description of drawings

Fig. 1 is a kind of electronic equipment structural module diagram provided by the example of this application;

2 is a schematic flowchart of a method for generating a video note provided by an example of the present application;

3 is a schematic diagram of a user interface of an electronic device provided by an example of the present application;

4 is a schematic diagram of a user interface of an application provided by an example of the present application;

5 is a schematic diagram of a new setting page provided by an example of this application;

Figure 6-Figure 7 is a schematic diagram of a new page provided by the example of this application;

8 is a schematic diagram of an application scenario provided by an example of this application;

9 is a schematic diagram of an information recording method provided by an example of the present application;

10 is a schematic diagram of a save page provided by an example of this application;

11-12 are schematic diagrams of the video note playback interface provided by the example of this application;

FIG. 13 is a schematic structural diagram of an electronic device provided by an example of this application.

Detailed ways

The terms used in the following embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to be used as limitations of the present application. As used in the specification of this application and the appended claims, the singular expressions "a," "an," "the," "above," "the," and "the" are intended to also Plural expressions are included unless the context clearly dictates otherwise. It will also be understood that, as used in this application, the term "and/or" refers to and includes any and all possible combinations of one or more of the listed items.

At present, when users want to add corresponding notes to a video, they often need to perform secondary editing after recording, that is, manually locate the video section where they want to add notes and input the notes, which is time-consuming and requires certain video editing capabilities. That is to say, the video content recorded by the user cannot directly correspond to the recorded notes. The purpose of this application is to provide a method for making a video note, which can support a user to record a note while recording a video, automatically match the recorded note with the video content, without the need for the user to add notes by secondary editing of the video, and the operation is convenient. When users view the video, the corresponding notes will be automatically displayed, which is convenient for users to review and understand the video content.

As shown in FIG. 1 , the video note making method provided in this embodiment of the present application can be applied to an electronic device 100 including a video acquisition module 210 , a speech recognition module 220 , a processing module 230 , and a note collection module 240 . The video acquisition module 210 is used to acquire video data; the speech recognition module 220 is used to collect speech data and identify keywords; the note collection module 240 is used to acquire notes input by the user; the processing module 230 is used to complete the associated storage of videos and notes.

The following describes a video note making method provided by an embodiment of the present application. FIG. 2 is a schematic flowchart of a video note making method provided by an embodiment of the present application, and the method includes S101 to S103.

S101. The electronic device acquires the video information of the recording object, identifies the keyword, and generates a voice tag to record the keyword and the time point at which the keyword appears.

The electronic device obtains the video information of the recorded object, and there are two main ways to obtain it. You can shoot the video by turning on the camera and microphone, or you can receive the video information through the network; the speech recognizes that a preset keyword appears in the video, which is recorded as the first key. The word and the first moment, the first moment is the time point when the first keyword appears in the video, that is, the keyword and the voice time point, forming a video tag of "keyword + voice time point".

A possible example is, if the keyword set is preset as "Key points, difficult points, test points", and the keyword "Key Points" is captured 10 minutes and 11 seconds after the video starts, a video tag of "Key Points + 10:11" will be generated. .

S102, the electronic device acquires the note input by the user and the selected keyword, and generates a note tag to record the keyword and the start time and end time of the note.

The electronic device obtains the notes and the number of pages input by the user, obtains the keywords selected by the user for each page of notes, and records them as the second keyword; the video time when the user starts to input the notes is recorded as the start time point of the page of notes, and the user inputs the notes to turn pages The video time at the time of the instruction is recorded as the end time point of the note on the page; that is, the keyword of the note label, the number of pages, the start time of the note, and the end time of the note, forming the “keyword + page number + note start time + note end time”. Note label.

A possible example is, if the user selects the keyword on page 2 as "key", starts to input notes at 10 minutes and 34 seconds after the video starts, and turns the page at 17 minutes and 21 seconds after the video starts, it will generate "key + page". 2 pages +10:34+17:21” note label.

S103 , the electronic device traverses the video tag according to the "keyword" in the note tag as the primary key to perform time point merging, so as to complete the matching between the video content and the note.

Matching each note tag is called the target note tag. According to the "keyword" as the primary key, traverse the video tag to find the "voice time point" in the previous note tag "note end time" to this page note tag "note" The earliest video tag that appears in the "Start Time", that is, the target video tag, subtract 10 seconds from the "voice time point" of the target tag as the start time of the corresponding video interval, and the "note end time" of the target note label as the end of the corresponding video interval time. Each page of notes forms an associated mapping with the corresponding video interval to complete the matching of video content and notes.

The electronic device may be a mobile phone with a folding screen, a mobile phone with a non-folding screen, a tablet computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook or a personal digital assistant (PDA), etc. There is no restriction on the specific type of the electronic device.

The data acquisition module and the note collection module can be concentrated on electronic devices, such as electronic devices such as folding screen mobile phones, notebook computers, etc. that can perform video recording and note input at the same time; it can also be other devices connected to the electronic device as a data acquisition module. The device can be a camera, mobile phone, tablet computer and other devices with a camera function; as a note collection module, it can be a device with information input functions such as a mobile phone, a keyboard, and a handwriting board.

FIG. 3 shows a user interface 10 on the electronic device 100 , the user interface 10 includes an application menu 101 , a status bar 102 and a page indicator 103 . in:

Application menu 101 may include one or more application icons including "Video Notes" application 101A; status bar 102 may include one or more signal strength indicators of mobile communication signals, one of wireless fidelity (WiFi) signals or more signal strength indicators, battery status indicators, and time indicators.

The page indicator 103 is used to indicate the application in which page the user is currently browsing. It should be understood that when multiple applications are installed in the electronic device 100, the multiple applications may be divided into multiple pages, and the user can switch pages displayed by the electronic device 100 through a sliding operation. When detecting that the user clicks on an application icon, the electronic device 100 may display the user interface of the application.

The user interface 10 shown in FIG. 3 may be a home screen.

In some other embodiments, the electronic device 100 may also include a home screen key. The home screen key can be a physical key or a virtual key. The home screen key can be used to receive the user's instruction and return the currently displayed user interface to the main interface, so that it is convenient for the user to view the main interface at any time.

It can be understood that, FIG. 3 only exemplarily shows a user interface on the electronic device 100, and should not constitute a limitation to the embodiments of the present application.

The following describes in detail an operation process and an exemplary user interface for making a video note according to the method provided by the embodiment of the present application.

The video note making method involved in this application can be applied to scenarios where students record teacher lectures, video conferences and other scenarios where video or online video can be recorded.

In a specific implementation manner, the video acquisition module 210 and the note collection module 240 are located on the same electronic device. Next, a folding screen mobile phone is used as the electronic device to introduce the process of making video notes.

As shown in FIG. 3 , the electronic device 100 listens to a user operation of opening the “Video Notes” application 101A, and in response to the operation, the electronic device 100 displays the user interface 20 of the “Video Notes” application 101A. For example, the user operation for opening the "video note" application 101A may be clicking on the icon of the application, or operations such as voice, long press, double click, etc., which are not limited in this embodiment of the present application.

FIG. 4 is an exemplary user interface 20 of a “video note” application 101A provided by an embodiment of the present application. The user interface 20 includes a video note directory 201 , a video note creation control 202 and a file search control 203 . The user can view the created video notes through the video note directory 201. For example, the user can click on the video note that he wants to view to view the specific content, the user can create a new video note by clicking the video note new control 202, or he can use the file search control. 203 Enter the name to find the desired video note. It should be understood that the foregoing manner of triggering the control may also be voice, long-pressing, or double-clicking, etc., which is not limited in this embodiment of the present application.

When the user needs to create a new video note, clicks on the new control 202, the electronic device 100 responds to the user's triggering operation on the new control 202, and the electronic device 100 displays the new setting interface 30 as shown in FIG. 5 . The new setting page 30 includes a name input box 301, a keyword input box 302, a confirmation control 303A and a cancel control 303B. in:

The name input box 301 is used to receive the name input by the user, which is used as the file name of the video note, which is convenient for subsequent searching and viewing. as a name;

The keyword setting control 302 is used to receive the keyword input by the user, and the keyword is set by the user according to the content subject to be recorded. "Summary", etc.;

The confirmation control 303A is used to confirm the above-mentioned operation of the user. After the user inputs the name and keywords, the user clicks the confirmation control 303A. After the electronic device 100 detects the user's click operation, it can start to create a video note; the cancel control 303B is used to cancel the user In the above operation, the user clicks the cancel control 303B after opening the new setting page 30, and the electronic device can return to the user interface 20 of the application 101A after detecting the user's click operation. The newly created setting page 30 may include more or less input boxes or controls, which are not limited in the examples of this application.

The above-mentioned new setting page 30 shown in FIG. 5 is only an exemplary description, and in other implementation manners, the page may also have other names, which are not listed here. The opening of the video note creation mode is not limited to the above-mentioned methods. In specific implementation, there may be other opening methods, which are not listed here.

FIG. 6 is a schematic diagram of a new page provided by an embodiment of the present application. After the user inputs the name and keywords in the newly created page 30, the confirmation control 303A is triggered, and the electronic device 100 displays the newly created page 40 as shown in FIG. 6 in response to the trigger. The newly created page 40 includes a video recording area 401 , a note area 402 , a voice label bar 403 , a note label bar 404 and a title bar 405 .

The video recording area 401 is used to display the video acquired by the data acquisition module 210 . The video recording area 401 includes a recording pause control 401A, a recording start/end control 401B, a camera switching control 401C, and a zoom ratio adjustment control 401D. in:

The recording pause control 401A can be used to monitor the user operation that triggers the recording pause. The electronic device 100 can detect a user operation acting on the recording pause control 401A, and in response to the operation, the electronic device 100 can stop the video being recorded; after detecting the user operation acting on the recording pause control 401A again, continue recording.

The recording start/end control 401B can be used to monitor the user operation that triggers the recording start or stop. The electronic device 100 can detect the user operation acting on the recording start/end control 401B, and in response to the operation, the electronic device 100 can start recording through the camera; the user operation acting on the recording start/end control 401B is detected again, the electronic device 100 will stop the recording of the video and save the recorded video as a video file with the name entered in the New Settings page 30. The recording start/end control 401B may be a button or other forms of control.

The camera flip control 401C can be used to monitor user operations that trigger camera switching. The electronic device 100 may detect a user operation, such as a click operation, acting on the camera switching control 401C, and in response to the operation, the electronic device 100 may flip the camera, such as switching the rear camera to the front camera.

The zoom magnification adjustment control 401D can be used to indicate the ratio of the preview perspective transformation presented by the image displayed in the video recording area 401 . Wherein, the larger the zoom factor adjustment control 401D is, the smaller the preview angle of view presented by the image displayed in the video recording area 401 is. Conversely, the smaller the zoom magnification adjustment control 401D is, the larger the preview angle of view presented by the image displayed in the video recording area 401 is. As shown in Figure 6, 1X can default zoom ratio. When the zoom magnification adjustment control 401D is a magnification of 1X, the preview angle of view presented by the image displayed in the video recording area 401 is as large as the shooting angle of view of a common camera. This embodiment of the present application does not limit the above-mentioned default zoom magnification.

The note area 402 is used to display the notes input by the user obtained by the note collection module 240; the note area 402 has a note keyword display area 402A and a note page turning control 402B, wherein:

The note keyword display area 402A is used to monitor the triggering operation of the user selecting the note keyword. The note keyword display area 402A displays a set of keywords input by the user in advance. The electronic device 100 detects the user's triggering operation on the note keyword display area 402A, and records the keyword selected by the user. The triggering operation for the user to select a note keyword may be the user's click, double-click, long-press or hover operation.

The note page turning control 402B is used to monitor the user's triggering operation to enter the previous page or the next page of the note. The electronic device 100 may detect a user operation acting on the note page turning control 402B, and in response to the operation, display the content of the previous or next page of notes in the note area 402, and the user operation acting on the note turning control 402B may be the user Click, double-click, long-press or hover operation.

The voice tag bar 403 includes a hidden control 4031 and a voice tag table 4032. The hidden control 4031 is used to monitor the operation of the user triggering the hidden voice tag table 4032. The electronic device 100 detects the user's triggering operation on the hidden control 4031, responds to the operation and sends the voice The tag table 4032 is hidden; the voice tag table 4032 is used to display the keywords recognized according to the voice recognition module 220 and the time point tags at which the keywords are obtained. The user operation acting on the hidden control 4031 may be the user's click, double-click, long-press or hover operation.

Note tab bar 404 includes hidden controls 4041 and note tab table 4042 . The hidden control 4041 is used to monitor the user's triggering operation of the hidden note label table 4042. The electronic device 100 detects the user's trigger operation on the hidden control 4041, and responds to the operation and hides the note label table 4042; the note label table 4042 is used to display the user's The keyword, page number and time point label selected in the note keyword display area 402A. The newly created page 40 after hiding the voice label bar 403 and the note label bar 404 is shown in FIG. 7 , the call-out control 4033 is used to monitor the operation of the user triggering the display of the voice-label table 4032 , and the electronic device 100 detects the user’s trigger operation on the call-out control 4033 , in response to this operation and display the voice tag table 4032 on the new page 40; the call-out control 4043 is used to monitor the user's operation of triggering the display of the note-tag table 4042, the electronic device 100 detects the user's trigger operation on the call-out control 4043, responds to the operation and A note tag table 4042 is displayed on the new page 40 . The triggering operation of the user on the outgoing control 4033 and the outgoing control 4043 may be a user click, double click, long press or drag operation. In actual implementation, the above triggering operation may also be performed in other manners, which are not limited in this embodiment of the present application.

The title bar 405 includes a video note name 4051 and a save control 4052. The video note name displays the video note name entered by the user in the name input box 301 of the new setting page 30. The save control 4052 is used to monitor the user's triggering operation of saving the video note. The device 100 detects the user's triggering operation on the save control 4052, and displays the save page 406 as shown in FIG. 10 .

Save page 406 includes confirm control 406A and cancel control 406B. 406A is used to monitor the user's triggering confirmation to end the production and save the operation of the video note file, the electronic device 100 detects the user's trigger operation for 406A, saves the video note and returns to the user interface 20; the cancel control 406B is used to monitor the user's trigger to cancel the end of the production and save For the operation of the video note file, the electronic device 100 detects the user's trigger operation on 406B and returns to the new page 40 .

The video recorded in the video recording area 401 is obtained by the data obtaining module 210, and the video can be obtained in the following two ways:

The first is to record video through a camera module. Figure 8 exemplarily shows a usage scenario when a user records a video. The user folds the electronic device 100, the camera faces the recording object, the video recording area 401 is the first screen, the image captured by the camera is displayed in the video recording area 401, and the microphone captures the recording object's voice. The generation process of the video tag table 4032 is shown in Figure 9. The speech recognition module recognizes the voice content of the recording object, recognizes the preset keyword and records the time point, and forms the "keyword+voice time point" video tag and is recorded in the video tag. The video tag table 4032 is displayed in the voice tag column 403. If it is recognized at time t1 that the voice content of the recording object contains the preset keyword "emphasis", a video tag record of "emphasis+t1" is formed in the voice tag table 4032 and displayed in the voice tag column 403; at time t2 If it is recognized that the voice content of the recording object contains the preset keyword "error-prone point", a video tag record of "error-prone point+t2" is formed in the voice tag table 4032 and displayed in the voice tag column 403 .

The second is to receive video data sent through the network through the communication module: the screen where the video recording area 401 is located is the first screen, the video signal receiving module receives and stores the real-time video signal, and displays the video image in the video recording 401 . The generation process of the video tag table 4032 is shown in Figure 9, the speech recognition module recognizes the video voice content, recognizes the preset keyword and records the time point, and forms a "keyword+voice time point" video tag and records it in the video tag. Table 4032 and displayed in the voice tag column 403. The electronic device 100 monitors the user operation for ending the recording, and closes the data acquisition module in response to the operation.

The note area 402 is located on the second screen, the user performs a keyword selection operation on the note keyword display area 402A, and selects the keyword of each page of notes from the preset keywords, and the note collection module 240 obtains the notes input by the user. is displayed in the note area 402, and the input start time is recorded. Listen to the trigger operation of the user acting on the note page-turning control 402B to enter the next page of the note, record the end time of the page, and form a "keyword + page number + note start time + note end time" note label and record it in the note label table 4042 and Displayed in the note tab bar 404. The "note start time" is the time when the user starts to input the note on the page, and the "note end time" is the time when the user inputs an instruction to enter the next page of the note.

The note area 402 displays the content of the notes input by the user acquired by the note collection module 240; the user input method can be handwritten input in the note area 402, or the virtual keyboard input provided by the input method, and the input method is not limited to the above-mentioned several, This embodiment of the present application does not limit this.

After the video note creation is completed, the user triggers the save control 4052, the electronic device 100 displays the save page 406, and the user triggers the confirmation control 406A to end the video note creation and save the video note file. The processing module 230 matches each page of notes according to the information in the note label table 4042, the note label of this page of notes is the target note label, the "keyword" of the target note label is the second keyword, and the second keyword is The primary key traverses the video tags in the video tag table 4032, the "keyword" of the video tag is the first keyword, and the "voice time point" is the first moment, find that the first keyword in the video tag table 4032 is the same as the second keyword , and the first moment is at least one record in the time zone from the end time point corresponding to the first note tag to the start time point corresponding to the target note tag in the note tag table 4042, as the first video tag set, and the earliest among them The video tag is used as the target note tag, the first moment of the target note tag minus 10 seconds is used as the start time of the video section corresponding to the page of notes, and the "note end time" of the page note in the note tag table 4042 is used as the end of the corresponding video section Time, the corresponding video interval is used as the target video, and each page of notes is mapped to the corresponding interval of the recorded video.

Exemplarily, if the target note label of the note on page 1 in the note label table 4042 includes:

{

keyword: function

Pages: 1

Note start time: 00:04:25

Note end time: 00:10:44

}

Then look up the first video tag set of the same keyword "function" in the video tag table 4032:

{

Keywords: function

Voice time point: 00:02:13

}

{

Keywords: function

Voice time point: 00:05:34

}

{

Keywords: function

Voice time point: 00:10:28

}

The first moment is the first video tag in the time section from the end time point corresponding to the first note tag in the note tag table 4042 to the start time point corresponding to the target note tag, and this video tag is the target video tag, and the target video tag is the target video tag. The first moment of the video tag minus 10 seconds is the start time of the video section corresponding to the note on page 1, and the note "end time" on page 1 is the end time of the video section corresponding to the note on the page. The video note tag index is formed as follows:

{

Keywords: function

Pages: 1

Video interval start time: 00:02:03

End time of video interval: 00:10:44

}

The user can directly find the video note that he wants to view in the video note catalog 201 on the user interface 20 of the application 101A. The viewing methods of the user interface 20 include but are not limited to sliding view and page turning view; The interface 20 searches the name of the video note to find the video note you want to view. The triggering operation for the user to view the video note may be the user clicking, double-clicking, long-pressing, or hovering to operate the video note. In actual implementation, the above-mentioned user operation may also be performed in other ways, which are not limited in this embodiment of the present application.

FIG. 11 is an exemplary video note playback interface provided by the example of this application. The user views the video note catalog 201 on the user interface 20 of the “Video Notes” application 101A, finds the created video note file in the video note catalog 20, and clicks For a video note file, the electronic device 100 displays a video note play page 50 as shown in FIG. 11 in response to a user's trigger operation. The video note playback page 50 may include a video playback area 501 , a note display area 502 , a video directory column 503 , and a note directory column 504 . Among them, the video playback area 501 is used to play the video recorded when making the aforementioned video notes; the note display area 502 is used to display the notes added when making the aforementioned video notes; the video catalog column 503 is used to display the tag index of the video; the note catalog column 504 The index of tags used to display the note.

Exemplarily, the directory index displayed in the video directory column 503 may include the following content:

{

Keywords: function

Video interval start time: 00:02:03

End time of video interval: 00:10:44

}

Exemplarily, the directory index displayed in the note directory column 503 may include the following content:

{

Keywords: function

Pages: 1

}

The video playback area 501 includes a playback pause control 501A, a playback time display control 501B, a playback progress bar control 501C, and a volume selection control 501D. The play pause control 501A is used to monitor the user operation for pausing or starting the video playback, the electronic device 100 can detect the user operation acting on the play pause control 501B, and in response to the operation, the electronic device 100 stops playing the video displayed in the video play area 501. video, the user operation acting on the playback pause control 501B is detected again, and the electronic device 100 will continue to play the video;

The playback time display control 501B is used to display the duration of the played video and the total duration of the video;

The playback progress bar control 501C is used to display the current playback video progress, and is used to monitor the user operation that triggers the video progress jump; the electronic device 100 can detect the user operation acting on the playback progress bar control 501C, and in response to this operation, the electronic device 100 The video content corresponding to the time point selected by the user can be displayed in the video playback area 501;

The volume control 501D is used to monitor the user operation that triggers the video volume adjustment. The electronic device 100 can detect the user operation acting on the volume control 501D, and adjust the video volume in response to the operation.

The above-mentioned operation performed by the user may be the user's clicking, double-clicking, long-pressing, or hovering to operate the above-mentioned control. In actual implementation, the foregoing operations may also be performed in other manners, which are not limited in this embodiment of the present application.

The note display area 502 includes a note page turning control 502A, and the note page turning control 502A is used to monitor an operation triggered by the user to enter the previous or next page of the note. The electronic device 100 may detect a user operation acting on the note page turning control 502A, and in response to the operation, display the content of the previous or next page of notes in the note display area 502, and the user operation acting on the note page turning control 502A may be: The user operates the note page turning control 502A by clicking, double-clicking, long-pressing, or hovering.

The video directory bar 503 is used to monitor the user operation of the video section selection, the electronic device 100 can detect the user operation acting on the video directory bar 503, and in response to this operation, the video displayed in the video playback area 501 jumps to the user selection. The keyword tag corresponding to the start time of the video interval is played. The operation performed by the user may be the user clicking, double-clicking, long-pressing, or suspending operation of the video directory bar 503. In actual implementation, the above-mentioned user operation may also be performed in other ways, which are not limited in this embodiment of the present application.

The note catalog bar 504 is used to monitor the user operation of the note page selection, the electronic device 100 can detect the user operation acting on the note catalog bar 504, and in response to this operation, the note display area 502 displays the corresponding keyword tags selected by the user. Pages of notes. The above-mentioned operation performed by the user may be the user clicking, double-clicking, long-pressing, or suspending to operate the note directory bar 504. In actual implementation, the above-mentioned user operation may also be performed in other ways, which are not limited in this embodiment of the present application.

When the electronic device plays a video note on the video note playback page 50, the video playback area 501 plays the video, and the note display area 502 displays the note input by the user. After the electronic device detects the first moment in the playback target video tag, the target note tag corresponds to When the video content is before the termination time point, the electronic device displays the note corresponding to the target note tag in the note display area 502 .

The note display area 502 will display the corresponding notes along with the progress of the video played in the video playback area 501 . The user triggers the playback progress bar control 501C to perform a video jump operation, and the video played in the video playback area 501 jumps to the progress of the time point selected by the user. The time point is after the first moment in the target video tag, and the corresponding termination of the target note tag Before the time point, the note display area 502 displays the note corresponding to the target note tag. The user can also trigger the keyword in the video catalog column 503 to view the corresponding video section, and the note display area 502 will display the note content corresponding to the keyword. If the user triggers the keyword "feature" in the video catalog column 503, the video playback area 501 will jump to the start time of the corresponding video interval at 00:21:24 and start playing, and the note display area 502 displays the first page corresponding to the keyword "feature". 4 pages of notes.

The video playback area 501 will play the corresponding video as the notes displayed in the note display area 502 change. The user triggers the note page turning control 502A to perform a note page turning operation, and the notes displayed in the note display area 502 are turned to the content selected by the user. The first moment in the video tag plays the target video. The user can also trigger the keyword in the note catalog column 504 to view the corresponding note, and the video playback area 501 will play the video section corresponding to the keyword. For example, if the user triggers the keyword "summary" in the note label column, the note display area 502 displays the note on page 5 of the corresponding point, and the video playback area 501 plays and jumps to the start time of the video section corresponding to the keyword "summary" at 00:28: Play starts at 23.

The video directory bar 503 has hidden controls 5031 and a video directory table 5032 . The hidden control 5031 is used to monitor the operation of the user triggering the hidden video table of contents 5032, and the electronic device 100 detects the user's triggering operation on the hidden control 5031, and responds to the operation and hides the video table of contents 5032; the note table of contents bar 504 has hidden controls 5041 and Note Table of Contents 5042. The hidden control 5041 is used to monitor the user's triggering operation to hide the note table of contents 5042. The electronic device 100 detects the user's trigger operation on the hidden control 5041, and responds to the operation and hides the note table of contents 5042; hides the video table of contents 503 and the note table of contents The video note playback page 50 after 504 is shown in FIG. 12 , the call-out control 5033 is used to monitor the operation of the user triggering the display of the video catalog 5032, and the electronic device 100 detects the user's trigger operation on the call-out control 5033, and responds to the operation and sends the video The table of contents 4032 is displayed on the video note playback page 50; the call-out control 5043 is used to monitor the user's operation to trigger the display of the note table of contents 5042. The electronic device 100 detects the user's triggering operation on the call-out control 5043, and responds to the operation and displays the note table of contents 5042. Displayed on the video note playback page 50. The trigger operation performed by the user may be a user click, double click, long press or drag operation. In actual implementation, the above-mentioned user operations may also be performed in other manners, which are not limited in this embodiment of the present application.

In another specific implementation manner, the data acquisition module 210 and the note collection module 240 may also be on different devices. Next, the tablet computer is referred to as the electronic device 100 , and the external keyboard is used as the note collection module 240 .

The process and user interface of the user launching the "video note" application and entering the video note new page 40 are the same as in the first implementation. To create a new video note, the video obtained by the data acquisition module can be obtained in the following two ways:

The first is to record a video through a camera module, and FIG. 6 exemplarily shows a usage scenario when a user records a video. The user folds the electronic device 100, the camera faces the direction of the recording object, the video recording area 401 is located on the first screen, the image obtained by the camera is displayed in the video recording area 401, the microphone obtains the sound of the recording object, and the speech recognition module recognizes the voice of the recording object. content, the preset keyword is recognized, the time point is recorded, and a video tag of "keyword + voice time point" is formed, which is recorded in the video tag table 4032 and displayed in the voice tag column 403 . When the end recording instruction is obtained, the data acquisition module is closed.

The second is to obtain video data through the video signal receiving module: the screen where the video recording area 401 is located is the first screen, the video signal receiving module receives the real-time video signal and stores it, displays the image of the video in the video recording area 401, and the speech recognition module recognizes the video voice. content, the preset keyword is recognized, the time point is recorded, and a video tag of "keyword + voice time point" is formed, which is recorded in the video tag table 4032 and displayed in the voice tag column 403 . After receiving the video end instruction, close the data acquisition module.

The note area 402 is located on the second screen, and the note keyword display area 402A receives the keyword selection instruction input by the user, selects the keywords of each page of notes from the preset keywords, and the note area obtains the notes input by the user, and records Enter the start time, get the instruction to enter the next page of the note, record the end time of the page, and form the "keyword + page number + note start time + note end time" note label is recorded in the note label table 4042 and displayed in the note label column 404. The "note start time" is the time when the user starts to input the note on the page, and the "note end time" is the time when the user inputs an instruction to enter the next page of the note. After obtaining the end note instruction, close the note collection module.

The notes input by the user acquired in the note area are from the first input device, and the electronic device 100 is connected to the first input device, and the connection mode may be hardware connection, Bluetooth connection, WLAN connection, or the like.

Specifically, using hardware connection, the electronic device 100 is connected to the first input device through the USB interface 130; using Bluetooth connection, the electronic device 100 is connected to the first input device through Bluetooth through the wireless communication module 160; The communication module 160 is connected with the first input device WLAN. After the electronic device 100 is connected to the first input device, the note collection module 240 can obtain the notes input by the user using the first input device; the obtained notes input by the user may be input by handwriting input, or may be typing or voice input, The input methods are not limited to the above-mentioned ones, which are not limited in this embodiment of the present application.

The association of the video and the note is completed according to the mapping relationship between the video tag table and the note tag table, and the specific process is the same as that of the first embodiment.

The following describes the exemplary electronic device 100 provided in the embodiments of the present application.

FIG. 13 shows a schematic structural diagram of the electronic device 100 .

The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charge management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2 , mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, key 180, motor 181, indicator 182, camera 183, display screen 184, and user identification module ( subscriber identification module, SIM) card interface 185, etc.

It can be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 100 . In other embodiments of the present application, the electronic device 100 may include more or less components than shown, or combine some components, or separate some components, or arrange different components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (neural-network processing unit, NPU), etc. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.

The controller can generate an operation control signal according to the instruction operation code and timing signal, and complete the control of fetching and executing instructions.

A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in processor 110 is cache memory. This memory may hold instructions or data that have just been used or recycled by the processor 110 . If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby increasing the efficiency of the system.

In some embodiments, the processor 110 may include one or more interfaces. The interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous transceiver (universal asynchronous transmitter) receiver/transmitter, UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (SIM) interface, and / or universal serial bus (universal serial bus, USB) interface, etc.

In this embodiment of the present application, the processor 110 may be configured to determine whether a third-party application currently launched by the electronic device 100 has permission to use the enhanced function of the electronic device. In some embodiments, the processor 110 may be further configured to determine the enhanced function currently provided to the user under the condition that the currently launched third-party application has permission to use the enhanced function of the electronic device. For the manner in which the processor 110 determines the enhanced function currently provided to the user, reference may be made to the related descriptions in the subsequent embodiments, and details are not described herein again.

The I2C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may contain multiple sets of I2C buses. The processor 110 can be respectively coupled to the touch sensor 180K, the charger, the flash, the camera 193 and the like through different I2C bus interfaces. For example, the processor 110 may couple the touch sensor 180K through the I2C interface, so that the processor 110 and the touch sensor 180K communicate with each other through the I2C bus interface, so as to realize the touch function of the electronic device 100 .

The I2S interface can be used for audio communication. In some embodiments, the processor 110 may contain multiple sets of I2S buses. The processor 110 may be coupled with the audio module 170 through an I2S bus to implement communication between the processor 110 and the audio module 170 . In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 through the I2S interface, so as to realize the function of answering calls through a Bluetooth headset.

The PCM interface can also be used for audio communications, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 may be coupled through a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 through the PCM interface, so as to realize the function of answering calls through the Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

The UART interface is a universal serial data bus used for asynchronous communication. The bus may be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, a UART interface is typically used to connect the processor 110 with the wireless communication module 160 . For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to implement the Bluetooth function. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 through the UART interface, so as to realize the function of playing music through the Bluetooth headset.

The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193 . MIPI interfaces include camera serial interface (CSI), display serial interface (DSI), etc. In some embodiments, the processor 110 communicates with the camera 193 through a CSI interface, so as to realize the photographing function of the electronic device 100 . The processor 110 communicates with the display screen 194 through the DSI interface to implement the display function of the electronic device 100 .

The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface may be used to connect the processor 110 with the camera 193, the display screen 194, the wireless communication module 160, the audio module 170, the sensor module 180, and the like. The GPIO interface can also be configured as I2C interface, I2S interface, UART interface, MIPI interface, etc.

The USB interface 130 is an interface that conforms to the USB standard specification, and may specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, and the like. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transmit data between the electronic device 100 and peripheral devices. It can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other electronic devices, such as AR devices.

It can be understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is only a schematic illustration, and does not constitute a structural limitation of the electronic device 100 . In other embodiments of the present application, the electronic device 100 may also adopt different interface connection manners in the foregoing embodiments, or a combination of multiple interface connection manners.

The charging management module 140 is used to receive charging input from the charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from the wired charger through the USB interface 130 . In some wireless charging embodiments, the charging management module 140 may receive wireless charging input through a wireless charging coil of the electronic device 100 . While the charging management module 140 charges the battery 142 , it can also supply power to the electronic device through the power management module 141 .

The power management module 141 is used for connecting the battery 142 , the charging management module 140 and the processor 110 . The power management module 141 receives input from the battery 142 and/or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle times, battery health status (leakage, impedance). In some other embodiments, the power management module 141 may also be provided in the processor 110 . In other embodiments, the power management module 141 and the charging management module 140 may also be provided in the same device.

The wireless communication function of the electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modulation and demodulation processor, the baseband processor, and the like.

Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, the antenna 1 can be multiplexed as a diversity antenna of the wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 150 may provide wireless communication solutions including 2G/3G/4G/5G etc. applied on the electronic device 100 . The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA) and the like. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, filter and amplify the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and then turn it into an electromagnetic wave for radiation through the antenna 1 . In some embodiments, at least part of the functional modules of the mobile communication module 150 may be provided in the processor 110 . In some embodiments, at least part of the functional modules of the mobile communication module 150 may be provided in the same device as at least part of the modules of the processor 110 .

The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low frequency baseband signal to be sent into a medium and high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low frequency baseband signal. Then the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and passed to the application processor. The application processor outputs sound signals through audio devices (not limited to the speaker 170A, the receiver 170B, etc.), or displays images or videos through the display screen 194 . In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be independent of the processor 110, and may be provided in the same device as the mobile communication module 150 or other functional modules.

The wireless communication module 160 can provide applications on the electronic device 100 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellites Wireless communication solutions such as global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared technology (IR). The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2 , frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 . The wireless communication module 160 can also receive the signal to be sent from the processor 110 , perform frequency modulation on it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2 .

In some embodiments, the antenna 1 of the electronic device 100 is coupled with the mobile communication module 150, and the antenna 2 is coupled with the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), broadband Code Division Multiple Access (WCDMA), Time Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC , FM, and/or IR technology, etc. The GNSS may include global positioning system (global positioning system, GPS), global navigation satellite system (global navigation satellite system, GLONASS), Beidou navigation satellite system (beidou navigation satellite system, BDS), quasi-zenith satellite system (quasi -zenith satellite system, QZSS) and/or satellite based augmentation systems (SBAS).

The electronic device 100 implements a display function through a GPU, a display screen 194, an application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.

Display screen 194 is used to display images, videos, and the like. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (active-matrix organic light). emitting diode, AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diode (quantum dot light emitting diodes, QLED) and so on. In some embodiments, the electronic device 100 may include one or N display screens 194 , where N is a positive integer greater than one.

In this embodiment of the present application, the display screen 194 may be used to display a control, and the control may be used to monitor an operation of expanding and displaying a control corresponding to an enhanced function currently provided by the electronic device. In response to this operation, the display screen 194 may also be used to display controls corresponding to enhanced functions currently provided by the electronic device. The control corresponding to the enhanced function currently provided by the electronic device can be used to monitor the operation of enabling the corresponding enhanced function. For the manner in which the electronic device determines the enhanced function currently provided to the user, reference may be made to the related descriptions in the subsequent embodiments, and details are not described herein again.

The electronic device 100 may implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, and the like.

The ISP is used to process the data fed back by the camera 193 . For example, when taking a photo, the shutter is opened, the light is transmitted to the camera photosensitive element through the lens, the light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing, and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on image noise, brightness, and skin tone. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP may be provided in the camera 193 .

Camera 193 is used to capture still images or video. The object is projected through the lens to generate an optical image onto the photosensitive element. The photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. DSP converts digital image signals into standard RGB, YUV and other formats of image signals. In some embodiments, the electronic device 100 may include 1 or N cameras 193 , where N is a positive integer greater than 1.

A digital signal processor is used to process digital signals, in addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy and so on.

Video codecs are used to compress or decompress digital video. The electronic device 100 may support one or more video codecs. In this way, the electronic device 100 can play or record videos of various encoding formats, such as: Moving Picture Experts Group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4 and so on.

The NPU is a neural-network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transfer mode between neurons in the human brain, it can quickly process the input information, and can continuously learn by itself. Applications such as intelligent cognition of the electronic device 100 can be implemented through the NPU, such as image recognition, face recognition, speech recognition, text understanding, and the like.

The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100 . The external memory card communicates with the processor 110 through the external memory interface 120 to realize the data storage function. For example to save files like music, video etc in external memory card.

Internal memory 121 may be used to store computer executable program code, which includes instructions. The internal memory 121 may include a storage program area and a storage data area. The program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), and the like. The storage data area may store data (such as audio data, phone book, etc.) created during the use of the electronic device 100 and the like. In addition, the internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (UFS), and the like. The processor 110 executes various functional applications and data processing of the electronic device 100 by executing instructions stored in the internal memory 121 and/or instructions stored in a memory provided in the processor.

The electronic device 100 may implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, an application processor, and the like. Such as music playback, recording, etc.

The audio module 170 is used for converting digital audio information into analog audio signal output, and also for converting analog audio input into digital audio signal. Audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be provided in the processor 110 , or some functional modules of the audio module 170 may be provided in the processor 110 .

Speaker 170A, also referred to as a "speaker", is used to convert audio electrical signals into sound signals. Electronic device 100 can listen to music through speaker 170A, or listen to hands-free calls.

The receiver 170B, also referred to as "earpiece", is used to convert audio electrical signals into sound signals. When the electronic device 100 answers a call or a voice message, the voice can be answered by placing the receiver 170B close to the human ear.

The microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can make a sound by approaching the microphone 170C through a human mouth, and input the sound signal into the microphone 170C. The electronic device 100 may be provided with at least one microphone 170C. In other embodiments, the electronic device 100 may be provided with two microphones 170C, which can implement a noise reduction function in addition to collecting sound signals. In other embodiments, the electronic device 100 may further be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify sound sources, and implement directional recording functions.

The earphone jack 170D is used to connect wired earphones. The earphone interface 170D may be the USB interface 130, or may be a 3.5mm open mobile terminal platform (OMTP) standard interface, a cellular telecommunications industry association of the USA (CTIA) standard interface.

The keys 180 include a power-on key, a volume key, and the like. Keys 180 may be mechanical keys. It can also be a touch key. The electronic device 100 may receive key inputs and generate key signal inputs related to user settings and function control of the electronic device 100 .

Motor 181 can generate vibrating cues. The motor 181 can be used for incoming call vibration alerts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, playing audio, etc.) can correspond to different vibration feedback effects. The motor 181 can also correspond to different vibration feedback effects for touch operations on different areas of the display screen 194 . Different application scenarios (for example: time reminder, receiving information, alarm clock, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

The indicator 182 can be an indicator light, which can be used to indicate the charging state, the change of the power, and can also be used to indicate a message, a missed call, a notification, and the like.

The SIM card interface 185 is used to connect a SIM card. The SIM card can be inserted into the SIM card interface 185 or pulled out from the SIM card interface 185 to achieve contact and separation with the electronic device 100 . The electronic device 100 may support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 185 can support Nano SIM card, Micro SIM card, SIM card and so on. Multiple cards can be inserted into the same SIM card interface 185 at the same time. The types of the plurality of cards may be the same or different. The SIM card interface 185 can also be compatible with different types of SIM cards. The SIM card interface 185 is also compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to implement functions such as call and data communication. In some embodiments, the electronic device 100 employs an eSIM, ie: an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100 .

Claims

A method for generating video notes, comprising:

The electronic device acquires one or more video tags, and each video tag in the one or more video tags includes a first keyword and a first moment, and the first keyword is any one of the preset keywords, The first moment is the time point when the first keyword is recognized, wherein each video tag is generated according to the received video;

The electronic device acquires one or more note tags, each note tag in the one or more note tags includes a second keyword and a time interval, and the second keyword is any one of the preset keywords , the time interval includes a start time point and an end time point when the user records a note corresponding to a note label, and the note is recorded by the user according to the content of the video;

According to the target note tag, match the target video tag in the one or more video tags, and associate the note corresponding to the target note tag with the target video tag, and the target note tag is the one or more Any of the note tags.
The method according to claim 1, wherein the matching the target video tag in the one or more video tags comprises:

Obtain the target keyword, query the video tags with the same first keyword and the target keyword in the one or more video tags, and obtain the first video tag set, and the target keyword is the target note The second keyword corresponding to the tag;

Obtain the start time point and the end time point corresponding to the target note label; according to preset conditions, extract the target video labels that meet the preset conditions in the first video label set, and the preset conditions include the The first moment in the target video tag is earlier than the start time point corresponding to the target note tag, and the first moment in the target video tag is the earliest moment in the first video tag set.
The method according to claim 2, wherein each note label further includes a page number, and the one or more note labels are arranged according to the page number from small to large, wherein a smaller page number value indicates that the user record is related to the said page number. The earlier the note corresponding to the page number is, the preset conditions further include:

The first time in the target video tag is later than the end time point corresponding to the first note tag, and the first note tag is arranged before and adjacent to the target note tag.
The method according to claim 3, wherein the associating the note corresponding to the target note label with the target video label comprises:

The target video between the first moment in the target video tag and the termination time point corresponding to the target note tag is associated with the note corresponding to the target note tag.
The method according to any one of claims 1 to 4, wherein the method further comprises:

Acquire the video and the voice corresponding to the video, recognize the preset keyword according to the voice, and generate a video tag when the first keyword is recognized.
The method according to claim 5, wherein the method further comprises:

Obtain the second keyword selected by the user, and record the time point at which the second keyword is obtained as the starting time point;

The page turning instruction triggered by the user is acquired, the time point when the page turning instruction is obtained is recorded as the end time point, and a note label is generated, and the page turning instruction instructs the user to complete the recording of a page of notes.
The method according to claim 3 or 4, wherein the method further comprises:

The electronic device plays the target video when detecting that the user is viewing the note corresponding to the target note tag.
The method according to claim 4, wherein the method further comprises:

When the electronic device detects that the target video is played, the electronic device displays the note corresponding to the target note tag on the screen.
The method according to claim 8, wherein the video is a video recorded by the electronic device or a video received by the electronic device through a network.
An electronic device, comprising: one or more functional modules, the one or more functional modules are used to execute the method according to any one of claims 1-9.
A computer device, comprising a memory, a processor, and a computer program stored on the memory and running on the processor, characterized in that, when the processor executes the computer program, the computer device realizes the following: The method of any one of claims 1-9.
A computer-readable storage medium, characterized in that the computer-readable storage medium stores instructions, when executed on a computer, causing the computer to execute the method according to any one of claims 1-9 .