WO2021233293A1 - Note recording method and electronic device - Google Patents

Note recording method and electronic device Download PDF

Info

Publication number
WO2021233293A1
WO2021233293A1 PCT/CN2021/094353 CN2021094353W WO2021233293A1 WO 2021233293 A1 WO2021233293 A1 WO 2021233293A1 CN 2021094353 W CN2021094353 W CN 2021094353W WO 2021233293 A1 WO2021233293 A1 WO 2021233293A1
Authority
WO
WIPO (PCT)
Prior art keywords
target
note
input
video frame
electronic device
Prior art date
Application number
PCT/CN2021/094353
Other languages
French (fr)
Chinese (zh)
Inventor
韩桂敏
Original Assignee
维沃移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 维沃移动通信有限公司 filed Critical 维沃移动通信有限公司
Publication of WO2021233293A1 publication Critical patent/WO2021233293A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47205End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally

Definitions

  • the present invention relates to the technical field of electronic equipment, and in particular to a note recording method and electronic equipment.
  • the embodiment of the present invention provides a note recording method and electronic device, which can improve the note recording speed.
  • the electronic device plays the target video frame of the video, receiving the first input
  • an electronic device including:
  • the receiving module is configured to receive the first input when the electronic device plays the target video frame of the video;
  • the determining module is configured to determine the target data associated with the target video frame in response to the first input
  • the recording module is used to record target data and obtain target notes.
  • an embodiment of the present invention provides an electronic device, including: a memory, a processor, and a computer program stored on the memory and running on the processor;
  • an embodiment of the present invention provides a computer-readable storage medium on which a computer program is stored.
  • the computer program is executed by a processor, the note recording method of the first aspect of the embodiment of the present invention is implemented.
  • the electronic device when the electronic device plays the target video frame of the video, after the user performs the first input, the electronic device will respond to the first input to determine and record the target video frame.
  • Target data you can get the target note containing the target data. Therefore, with this method, the electronic device can automatically record notes in response to an input of the user, without the user needing to record notes by handwriting, and the note recording speed can be improved.
  • FIG. 2 is a schematic diagram of setting note types provided by an embodiment of the present invention.
  • FIG. 3 is a schematic diagram of displaying annotations according to an embodiment of the present invention.
  • FIG. 4 is a schematic diagram of displaying videos and notes in different regions according to an embodiment of the present invention.
  • FIG. 5 is a schematic diagram of displaying a list of videos and notes in different regions according to an embodiment of the present invention.
  • FIG. 6 is a schematic structural diagram of an electronic device provided by an embodiment of the present invention.
  • FIG. 7 is a schematic diagram of the hardware structure of an electronic device provided by an embodiment of the present invention.
  • FIG. 1 is a schematic flowchart of a note recording method provided by an embodiment of the present invention. As shown in Figure 1, the note recording method may include:
  • the first input may be received through a preset control (for example, "note recording control").
  • the target video frame may be the video frame currently being played.
  • the target data associated with the video frame currently being played is determined, and then the target data associated with the video frame currently being played is recorded to obtain the target note.
  • the target data in S102 may include at least one of the following items:
  • the identification information of the target note, the category of the target note, the image corresponding to the target video frame, the playback progress corresponding to the target video frame, the remark information and the identification information of the recommended data are included in the identification information of the target note, the category of the target note, the image corresponding to the target video frame, the playback progress corresponding to the target video frame, the remark information and the identification information of the recommended data.
  • the note recording method of the embodiment of the present invention can record the identification information of the note, the category of the note, the image corresponding to the video frame, the playback progress corresponding to the video frame, the identification information of the remark information and the recommended data, etc.
  • S102 may include at least one of the following items:
  • Search for recommended data that meets a preset condition and obtain identification information of the recommended data, where the preset condition is determined based on the target video frame.
  • the identification information associated with the video may include: identification information of the application used to play the video, and/or identification information of the video.
  • the identification information of the application program used to play the video and the identification information of the video can be directly used as the identification information of the target note. It is also possible to combine the identification information of the application and the identification information of the video (for example, string concatenation), and use the combined result as the identification information of the target note.
  • the identification information of the note is determined through the identification information of the application used to play the video, and/or the identification information of the video, and the identified identification information of the note and the application used to play the video are determined
  • the program or video is related and easy for the user to identify. The user can know the application used to play the video or the video corresponding to the note through the identification information of the note.
  • the types of notes shown in Figure 2 include important points, difficult points, and doubtful points.
  • the target note type is determined to be the focus.
  • the target note type is determined as the difficult point.
  • the target note type is determined to be the suspicious point.
  • the note type is determined through the input of the preset control, which is convenient for the user to set the note type.
  • the voice data after receiving the voice data input by the user, the voice data can be directly used as the remark information; the voice data can also be processed to obtain the text data corresponding to the voice data, and the text The data is used as remark information, or the voice data and text data are used as remark information.
  • the note recording method of the embodiment of the present invention determines the note information through the voice data input by the user without manual input by the user, which is convenient and quick.
  • the target video frame may be analyzed and processed based on optical character recognition (Optical Character Recognition, OCR) technology, deep learning technology, image recognition technology, etc., to obtain the characteristics of the target video frame, and then Search the database for data including features whose similarity to the feature is greater than the preset similarity, and use the identification information of the found data as identification information of the recommended data, that is, the found data is the recommended data.
  • optical character recognition Optical Character Recognition, OCR
  • OCR optical Character Recognition
  • deep learning technology deep learning technology
  • image recognition technology etc.
  • the recommended data may be learning materials related to the target video frame of the instructional video and matching from the knowledge base. Then, extract the identification information of these learning materials.
  • the note recording method of the embodiment of the present invention uses OCR technology, deep learning and image recognition technology to find recommended data that meets preset conditions, which can improve the efficiency of data search and the accuracy of data search.
  • the note recording method of the embodiment of the present invention may further include: displaying the mark corresponding to the target note at the first position in the playback progress bar of the video; A position is the position of the playback progress corresponding to the target video frame in the playback progress bar.
  • FIG. 3 is a schematic diagram of displaying annotations according to an embodiment of the present invention.
  • the user can intuitively know the playback progress corresponding to the video frame corresponding to the note.
  • the note recording method of the embodiment of the present invention may further include: Input or when it is detected that the focus of the cursor is at the first position, the target data corresponding to the target note is displayed.
  • the note recording method of the embodiment of the present invention may further include: receiving a third input; and in response to the third input, displaying a note list containing the target note.
  • the user clicks on the preset "note list control", and then displays the note list containing the target note.
  • the video may be displayed in the first display area of the electronic device, and the target data or note list corresponding to the target note may be displayed in the second display area of the electronic device.
  • FIG. 4 is a schematic diagram of displaying videos and notes by area according to an embodiment of the present invention
  • FIG. 5 is a schematic diagram of displaying videos and notes list by area according to an embodiment of the present invention.
  • the identification information of the note is XY (where the identification information of the application used to play the video is X, and the identification information of the video is Y)
  • the identification information of the recommended data is Z
  • the note category is the focus.
  • the playback progress is 15:28, and the remarks are "Hello teacher”.
  • the note list in Figure 5 includes three notes.
  • the target note or a note list containing the target note can be displayed.
  • the display of the target note or the note list containing the target note is turned off.
  • the video when the video is opened, the video may be displayed in the first display area of the electronic device, and the note list may be displayed in the second display area. At this time, the note list is empty. After you get a note, add the note to the note list. After getting another note, add another note to the note list.
  • the note recording method of the embodiment of the present invention may further include: receiving a fourth input; in response to the fourth input, starting from the first video frame Play the video, or locate the video containing the first video frame to the first video frame.
  • the first video frame is a video frame corresponding to the note selected from the note list according to the fourth input.
  • the above-mentioned video may be an instructional video.
  • the electronic device Before the electronic device receives the first input, it can receive a fifth input, and in response to the fifth input, turn on the learning mode; it can also analyze the application used to play the video, and intelligently turn on the learning mode or turn off the learning mode.
  • the user turns on the “learning mode”.
  • the method of turning on the “learning mode” may be the same as the manner of turning on the “flying mode", the “game mode”, the “eye protection mode”, etc. in the related art, which will not be described in detail in the embodiment of the present invention.
  • the application used by users for online learning can take up more resources (for example, CPU, memory, network resources), which improves the effect of the application in playing instructional videos.
  • the user learns online.
  • the user wants to take notes while the electronic device is playing the instructional video
  • the user long presses the preset "note recording control” and drags the “note recording control” in the direction of "difficulties”.
  • the electronic device determines the note type as "difficulty”.
  • the user long presses the "note recording control”, drags the "note recording control” in a certain direction, and determines that the note type is the note type corresponding to the direction.
  • the corresponding relationship between the direction and the note type can be preset.
  • the electronic device obtains the identification information of the application used to play the educational video and the identification information of the educational video, and combines the two identification information to obtain the identification information of the note.
  • the electronic device obtains the playback progress corresponding to the currently played video frame.
  • the reference material related to the content of the currently playing video frame is searched from the reference material database, and then the identification information of the found reference material is extracted.
  • the annotation corresponding to the note is displayed in the playback progress bar of the teaching video.
  • the instructional video will be played from the video frame corresponding to the note clicked by the user, or,
  • the instructional video is played from the video frame corresponding to the note.
  • teaching videos and notes can be displayed in different areas.
  • the instructional video and note list can also be displayed in different areas.
  • the embodiment of the present invention also provides an electronic device.
  • FIG. 6 is a schematic structural diagram of an electronic device provided by an embodiment of the present invention. As shown in FIG. 6, the electronic device 600 may include:
  • the receiving module 601 is configured to receive the first input when the electronic device plays the target video frame of the video;
  • the determining module 602 is configured to determine the target data associated with the target video frame in response to the first input;
  • the target data includes at least one of the following items:
  • the identification information of the target note, the category of the target note, the image corresponding to the target video frame, the playback progress corresponding to the target video frame, the remark information and the identification information of the recommended data are included in the identification information of the target note, the category of the target note, the image corresponding to the target video frame, the playback progress corresponding to the target video frame, the remark information and the identification information of the recommended data.
  • the determining module 602 is specifically used for at least one of the following items:
  • Search for recommended data that meets a preset condition and obtain identification information of the recommended data, where the preset condition is determined based on the target video frame.
  • the electronic device 600 provided in the embodiments of the present invention may further include:
  • the display module is configured to display the label corresponding to the target note at the first position in the playback progress bar of the video, where the first position is the position in the playback progress bar of the playback progress corresponding to the target video frame.
  • the display module can also be used for:
  • the target data corresponding to the target note is displayed.
  • the receiving module 601 may also be used to: receive a third input.
  • the display module can also be used for:
  • the video is displayed in the first display area of the electronic device, and the data or note list corresponding to the target note is displayed in the second display area of the electronic device.
  • the electronic device when the electronic device plays the target video frame of the video, after the user performs the first input, the electronic device will determine and record the target data associated with the target video frame in response to the first input, You can get the target note containing the target data. Therefore, with this method, the electronic device can automatically record notes in response to an input of the user, without the user needing to record notes by handwriting, and the note recording speed can be improved.
  • the electronic device provides users with wireless broadband Internet access through the network module 702, such as helping users to send and receive emails, browse web pages, and access streaming media.
  • the audio output unit 703 can convert the audio data received by the radio frequency unit 701 or the network module 702 or stored in the memory 709 into an audio signal and output it as sound. Moreover, the audio output unit 703 may also provide audio output related to a specific function performed by the electronic device 700 (for example, call signal reception sound, message reception sound, etc.).
  • the audio output unit 703 includes a speaker, a buzzer, a receiver, and the like.
  • the electronic device 700 further includes at least one sensor 705, such as a light sensor, a motion sensor, and other sensors.
  • the light sensor includes an ambient light sensor and a proximity sensor.
  • the ambient light sensor can adjust the brightness of the display panel 7061 according to the brightness of the ambient light.
  • the proximity sensor can close the display panel 7061 and the display panel 7061 when the electronic device 700 is moved to the ear. / Or backlight.
  • the display unit 706 is used to display information input by the user or information provided to the user.
  • the display unit 706 may include a display panel 7061, and the display panel 7061 may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), etc.
  • LCD liquid crystal display
  • OLED organic light-emitting diode
  • the processor 710 is the control center of the electronic device. It uses various interfaces and lines to connect the various parts of the entire electronic device, runs or executes software programs and/or modules stored in the memory 709, and calls data stored in the memory 709 , Perform various functions of electronic equipment and process data, so as to monitor the electronic equipment as a whole.
  • the processor 710 may include one or more processing units; optionally, the processor 710 may integrate an application processor and a modem processor, where the application processor mainly processes the operating system, user interface, and application programs, etc.
  • the adjustment processor mainly deals with wireless communication. It can be understood that the foregoing modem processor may not be integrated into the processor 710.
  • the embodiment of the present invention also provides a computer-readable storage medium, the computer-readable storage medium stores computer program instructions; when the computer program instructions are executed by a processor, each of the embodiments of the note recording method provided by the embodiments of the present invention is implemented The process, and can achieve the same technical effect, in order to avoid repetition, I will not repeat it here.
  • the computer-readable storage medium such as read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk, or optical disk, etc.

Abstract

Disclosed in embodiments of the present invention are a note recording method and an electronic device. The method comprises: receiving a first input when the electronic device plays back a target video frame of a video; in response to the first input, determining target data associated with the target video frame; and recording the target data to obtain a target note.

Description

笔记记录方法及电子设备Note recording method and electronic equipment
相关申请的交叉引用Cross-references to related applications
本申请主张在2020年05月20日在中国提交的中国专利申请号202010428593.7的优先权,其全部内容通过引用包含于此。This application claims the priority of Chinese Patent Application No. 202010428593.7 filed in China on May 20, 2020, the entire content of which is incorporated herein by reference.
技术领域Technical field
本发明涉及电子设备技术领域,尤其涉及一种笔记记录方法及电子设备。The present invention relates to the technical field of electronic equipment, and in particular to a note recording method and electronic equipment.
背景技术Background technique
目前,在视频播放的过程中,用户遇到其关注的内容时,仅能够通过手写来记录这些内容(即记笔记)。例如,记录某些知识点、记录某些新闻等。Currently, in the process of video playback, when a user encounters content that he or she is concerned about, he can only record the content by handwriting (ie, take notes). For example, record some knowledge points, record some news, etc.
但是,通过手写来记笔记,速度较慢。However, taking notes by handwriting is slower.
发明内容Summary of the invention
本发明实施例提供一种笔记记录方法及电子设备,能够提高笔记记录速度。The embodiment of the present invention provides a note recording method and electronic device, which can improve the note recording speed.
第一方面,本发明实施例提供一种笔记记录方法,应用于电子设备,方法包括:In the first aspect, an embodiment of the present invention provides a note recording method, which is applied to an electronic device, and the method includes:
在电子设备播放视频的目标视频帧的情况下,接收第一输入;In the case where the electronic device plays the target video frame of the video, receiving the first input;
响应于第一输入,确定与目标视频帧相关联的目标数据;In response to the first input, determine the target data associated with the target video frame;
记录目标数据,得到目标笔记。Record target data and get target notes.
第二方面,本发明实施例提供一种电子设备,包括:In a second aspect, an embodiment of the present invention provides an electronic device, including:
接收模块,用于在电子设备播放视频的目标视频帧的情况下,接收第一输入;The receiving module is configured to receive the first input when the electronic device plays the target video frame of the video;
确定模块,用于响应于第一输入,确定与目标视频帧相关联的目标数据;The determining module is configured to determine the target data associated with the target video frame in response to the first input;
记录模块,用于记录目标数据,得到目标笔记。The recording module is used to record target data and obtain target notes.
第三方面,本发明实施例提供一种电子设备,包括:存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序;In a third aspect, an embodiment of the present invention provides an electronic device, including: a memory, a processor, and a computer program stored on the memory and running on the processor;
处理器执行计算机程序时实现本发明实施例第一方面的笔记记录方法。When the processor executes the computer program, the note recording method of the first aspect of the embodiment of the present invention is implemented.
第四方面,本发明实施例提供了一种计算机可读存储介质,计算机可读存储介质上存储有计算机程序,计算机程序被处理器执行时实现本发明实施例第一方面的笔记记录方法。In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the note recording method of the first aspect of the embodiment of the present invention is implemented.
本发明实施例的笔记记录方法,在电子设备播放视频的目标视频帧的情况下,用户通过执行第一输入后,电子设备会响应于该第一输入,确定并记录与目标视频帧相关联的目标数据,即可得到包含该目标数据的目标笔记。因此,通过该方法,电子设备响应于用户的一个输入,即可自动记录笔记,无需用户通过手写来记录笔记,能够提高笔记记录速度。In the note recording method of the embodiment of the present invention, when the electronic device plays the target video frame of the video, after the user performs the first input, the electronic device will respond to the first input to determine and record the target video frame. Target data, you can get the target note containing the target data. Therefore, with this method, the electronic device can automatically record notes in response to an input of the user, without the user needing to record notes by handwriting, and the note recording speed can be improved.
附图说明Description of the drawings
为了更清楚地说明本发明实施例的技术方案,下面将对本发明实施例中所需要使用的附图作简单地介绍,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to explain the technical solutions of the embodiments of the present invention more clearly, the following will briefly introduce the accompanying drawings that need to be used in the embodiments of the present invention. For those of ordinary skill in the art, without creative work, Other drawings can be obtained from these drawings.
图1为本发明实施例提供的一种笔记记录方法的流程示意图;FIG. 1 is a schematic flowchart of a note recording method provided by an embodiment of the present invention;
图2为本发明实施例提供的设置笔记类型的示意图;2 is a schematic diagram of setting note types provided by an embodiment of the present invention;
图3为本发明实施例提供的显示标注的示意图;FIG. 3 is a schematic diagram of displaying annotations according to an embodiment of the present invention;
图4为本发明实施例提供的分区域显示视频和笔记的示意图;FIG. 4 is a schematic diagram of displaying videos and notes in different regions according to an embodiment of the present invention;
图5为本发明实施例提供的分区域显示视频和笔记列表的示意图;FIG. 5 is a schematic diagram of displaying a list of videos and notes in different regions according to an embodiment of the present invention;
图6为本发明实施例提供的一种电子设备的结构示意图;6 is a schematic structural diagram of an electronic device provided by an embodiment of the present invention;
图7为本发明实施例提供的一种电子设备的硬件结构示意图。FIG. 7 is a schematic diagram of the hardware structure of an electronic device provided by an embodiment of the present invention.
具体实施方式Detailed ways
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本发明一部分实施例,而不是全部的实施例。响应于本发明中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。The technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of them. In response to the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.
目前,用户仅能通过手写来记笔记,速度较慢。并且,用户的手写速度远小于视频播放速度,有可能笔记没记完,用户关注的内容已播放完。在视频可以暂停的情况下,用户可以暂停视频来记笔记,但是需要用户多次暂停视频,才可能记录完整的笔记。视频播放断断续续,影响用户的观看体验。基于此,本发明实施例提供一种笔记记录方法及电子设备。Currently, users can only take notes by handwriting, which is slower. In addition, the user's handwriting speed is much slower than the video playback speed. It is possible that the notes have not been finished and the content that the user is concerned about has been played. In the case that the video can be paused, the user can pause the video to take notes, but the user needs to pause the video multiple times to record a complete note. Video playback is intermittent, affecting the user's viewing experience. Based on this, the embodiments of the present invention provide a note recording method and electronic device.
下面首先对本发明实施例提供的笔记记录方法进行说明。The following first describes the note recording method provided by the embodiment of the present invention.
图1为本发明实施例提供的一种笔记记录方法的流程示意图。如图1所示,笔记记录方法可以包括:FIG. 1 is a schematic flowchart of a note recording method provided by an embodiment of the present invention. As shown in Figure 1, the note recording method may include:
S101:在电子设备播放视频的目标视频帧的情况下,接收第一输入;S101: When the electronic device plays a target video frame of the video, receive a first input;
S102:响应于第一输入,确定与目标视频帧相关联的目标数据;S102: In response to the first input, determine target data associated with the target video frame;
S103:记录目标数据,得到目标笔记。S103: Record target data to obtain target notes.
上述各步骤的具体实现方式将在下文中进行详细描述。The specific implementation of the above steps will be described in detail below.
本发明实施例的笔记记录方法,在电子设备播放视频的目标视频帧的情况下,用户通过执行第一输入后,电子设备会响应于该第一输入,确定并记录与目标视频帧相关联的目标数据,即可得到包含该目标数据的目标笔记。因此,通过该方法,电子设备响应于用户的一个输入,即可自动记录笔记,无需用户通过手写来记录笔记,能够提高笔记记录速度。In the note recording method of the embodiment of the present invention, when the electronic device plays the target video frame of the video, after the user performs the first input, the electronic device will respond to the first input to determine and record the target video frame. Target data, you can get the target note containing the target data. Therefore, with this method, the electronic device can automatically record notes in response to an input of the user, without the user needing to record notes by handwriting, and the note recording speed can be improved.
在本发明实施例的一些可能实现中,可以通过预设控件(比如,“记录笔记控件”)接收第一输入。目标视频帧可以为当前正在播放的视频帧。In some possible implementations of the embodiments of the present invention, the first input may be received through a preset control (for example, "note recording control"). The target video frame may be the video frame currently being played.
当用户点击该“记录笔记控件”后,确定与当前正在播放的视频帧相关联的目标数据,进而对与当前正在播放的视频帧相关联的目标数据进行记录,得到目标笔记。When the user clicks on the "note recording control", the target data associated with the video frame currently being played is determined, and then the target data associated with the video frame currently being played is recorded to obtain the target note.
在本发明实施例的一些可能实现中,S102中的目标数据可以包括以下所列项中的至少一种:In some possible implementations of the embodiments of the present invention, the target data in S102 may include at least one of the following items:
目标笔记的标识信息、目标笔记的类别、目标视频帧对应的图像、目标视频帧对应的播放进度、备注信息和推荐数据的标识信息。The identification information of the target note, the category of the target note, the image corresponding to the target video frame, the playback progress corresponding to the target video frame, the remark information and the identification information of the recommended data.
本发明实施例的笔记记录方法,能够对笔记的标识信息、笔记的类别、视频帧对应的图像、视频帧对应的播放进度、备注信息和推荐数据的标识信息等进行记录。The note recording method of the embodiment of the present invention can record the identification information of the note, the category of the note, the image corresponding to the video frame, the playback progress corresponding to the video frame, the identification information of the remark information and the recommended data, etc.
在本发明实施例的一些可能实现中,在接收到第一输入后,可以执行屏幕截图,将屏幕截图得到的图片作为目标视频帧对应的图像。在本发明实施例的一些可能实现中,还可以对屏幕截图得到的图片进行调整(比如调整尺寸),将调整后的图片作为目标视频帧对应的图像。In some possible implementations of the embodiments of the present invention, after receiving the first input, a screenshot may be executed, and the picture obtained by the screenshot may be used as the image corresponding to the target video frame. In some possible implementations of the embodiments of the present invention, it is also possible to adjust (for example, adjust the size) of the picture obtained by the screenshot, and use the adjusted picture as the image corresponding to the target video frame.
在本发明实施例的一些可能实现中,在接收到第一输入后,可以获取目标视频帧的播放进度,比如,获取到的目标视频帧的播放进度为第30分钟第45秒(30:45)。In some possible implementations of the embodiments of the present invention, after receiving the first input, the playback progress of the target video frame can be acquired. For example, the acquired playback progress of the target video frame is the 30th minute and the 45th second (30:45 ).
在本发明实施例的一些可能实现中,S102可以包括以下所列项中的至少一种:In some possible implementations of the embodiments of the present invention, S102 may include at least one of the following items:
获取与视频相关联的标识信息,根据与视频相关联的标识信息,确定目标笔记的标识信息;Obtain the identification information associated with the video, and determine the identification information of the target note according to the identification information associated with the video;
确定第一输入相关联的目标笔记类型,其中,第一输入为针对预设控件的输入;Determine the target note type associated with the first input, where the first input is an input for a preset control;
获取目标视频帧对应的图像;Acquiring an image corresponding to the target video frame;
获取目标视频帧对应的播放进度;Obtain the playback progress corresponding to the target video frame;
接收用户输入的语音数据,根据语音数据,确定备注信息;Receive the voice data input by the user, and determine the remark information based on the voice data;
查找满足预设条件的推荐数据,获取推荐数据的标识信息,其中,预设条件是基于目标视频帧确定的。Search for recommended data that meets a preset condition, and obtain identification information of the recommended data, where the preset condition is determined based on the target video frame.
本发明实施例的笔记记录方法,通过与视频相关联的标识信息,确定笔记的标识信息,所确定的笔记的标识信息与视频相关,且便于用户识别,用户通过笔记的标识信息即可获知与该笔记相关的视频。通过针对预设控件的输入,确定笔记类型,方便用户对用户对笔记类型进行设置。通过用户输入的语音数据,确定备注信息,无需用户手动输入,方便快捷。通过查找满足预设条件的推荐数据,能够向用户推荐满足预设条件的数据。In the note recording method of the embodiment of the present invention, the identification information of the note is determined through the identification information associated with the video. The identified identification information of the note is related to the video and is convenient for the user to recognize. The video related to the note. Through the input to the preset control, the note type is determined, which is convenient for the user to set the note type. The remark information is determined through the voice data input by the user, without manual input by the user, which is convenient and quick. By searching for recommended data that meets the preset conditions, data that meets the preset conditions can be recommended to the user.
在本发明实施例的一些可能实现中,与视频相关联的标识信息可以包括:播放视频所采用的应用程序的标识信息,和\或,视频的标识信息。In some possible implementations of the embodiments of the present invention, the identification information associated with the video may include: identification information of the application used to play the video, and/or identification information of the video.
当获取到播放视频所采用的应用程序的标识信息和视频的标识信息后,可以直接将应用程序的标识信息或视频的标识信息,作为目标笔记的标识信息。还可以将应用程序的标识信息和视频的标识信息进行组合(比如,字符串连接),将组合结果作为目标笔记的标识信息。After the identification information of the application program used to play the video and the identification information of the video are obtained, the identification information of the application program or the identification information of the video can be directly used as the identification information of the target note. It is also possible to combine the identification information of the application and the identification information of the video (for example, string concatenation), and use the combined result as the identification information of the target note.
本发明实施例的笔记记录方法,通过播放视频所采用的应用程序的标识信息,和\或,视频的标识信息,确定笔记的标识信息,所确定的笔记的标识信息与播放视频所采用的应用程序或视频相关,且便于用户识别,用户通过笔记的标识信息即可获知播放视频所采用的应用程序或笔记所对应的视频。In the note recording method of the embodiment of the present invention, the identification information of the note is determined through the identification information of the application used to play the video, and/or the identification information of the video, and the identified identification information of the note and the application used to play the video are determined The program or video is related and easy for the user to identify. The user can know the application used to play the video or the video corresponding to the note through the identification information of the note.
在本发明实施例的一些可能实现中,可以通过针对预设控件的输入,确定目标笔记类型。比如,在预设时间段,用户对预设控件的点击次数。其中,不同的点击次数可以对应不同的笔记类型。再比如,用户长按预设控件,将该预设控件向某一方向拖动,确定目标笔记的类型,如图2所示。图2为本发明实施例提供的设置笔记类型的示意图。In some possible implementations of the embodiments of the present invention, the target note type can be determined through input to a preset control. For example, in the preset time period, the number of times the user clicks on the preset control. Among them, different click times can correspond to different note types. For another example, the user long presses a preset control and drags the preset control in a certain direction to determine the type of the target note, as shown in Figure 2. FIG. 2 is a schematic diagram of setting a note type according to an embodiment of the present invention.
图2示出的笔记类型包括重点、难点和疑点。当用户向“重点”的方向拖动“记录笔记控件”后,确定目标笔记类型为重点。当用户向“难点”的方向拖动“记录笔记控件”后,确定目标笔记类型为难点。当用户向“疑点”的方向拖动“记录笔记控件”后,确定目标笔记类型为疑点。The types of notes shown in Figure 2 include important points, difficult points, and doubtful points. When the user drags the "note recording control" in the direction of "focus", the target note type is determined to be the focus. When the user drags the "note recording control" in the direction of the "difficult point", the target note type is determined as the difficult point. When the user drags the "note recording control" in the direction of the "suspicious point", the target note type is determined to be the suspicious point.
需要说明的是,在用户长按“记录笔记控件”或连击“记录笔记控件”的次数超过预设次数等操作后,图2中才显示“重点”、“难点”和“疑点”。It should be noted that only after the user long-presses the "note-taking control" or double-clicks the "note-taking control" for more than a preset number of operations, the "key points", "difficulties" and "doubts" are displayed in Figure 2.
本发明实施例的笔记记录方法,通过针对预设控件的输入,确定笔记类型,方便用户对用户对笔记类型进行设置。In the note recording method of the embodiment of the present invention, the note type is determined through the input of the preset control, which is convenient for the user to set the note type.
在本发明的一个实施例中,在接收到用户输入的语音数据之后,可以直接将该语音数据作为备注信息;还可以对该语音数据进行处理,得到该语音数据对应的文本数据,将该文本数据作为备注信息,或,将该语音数据和文本数据作为备注信息。In an embodiment of the present invention, after receiving the voice data input by the user, the voice data can be directly used as the remark information; the voice data can also be processed to obtain the text data corresponding to the voice data, and the text The data is used as remark information, or the voice data and text data are used as remark information.
本发明实施例的笔记记录方法,通过用户输入的语音数据,确定备注信息,无需用户手动输入,方便快捷。The note recording method of the embodiment of the present invention determines the note information through the voice data input by the user without manual input by the user, which is convenient and quick.
在本发明实施例的一些可能实现中,可以基于光学字符识别(Optical Character Recognition,OCR)技术、深度学习技术和图像识别技术等,对目标视频帧进行分析处理,得到目标视频帧的特征,进而在数据库中查找包括与该特征的相似度大于预设相似度的特征的数据,将查找到的数据的标识信息作为推荐数据的标识信息,也就是说,查找到的数据即为推荐数据。In some possible implementations of the embodiments of the present invention, the target video frame may be analyzed and processed based on optical character recognition (Optical Character Recognition, OCR) technology, deep learning technology, image recognition technology, etc., to obtain the characteristics of the target video frame, and then Search the database for data including features whose similarity to the feature is greater than the preset similarity, and use the identification information of the found data as identification information of the recommended data, that is, the found data is the recommended data.
示例性的,假设当前播放的视频为教学视频。推荐数据可以为从知识库中匹配到的与该教学视频的目标视频帧相关的讲解视频、练习题目等学习资料。然后,提取这些学习资料的标识信息。Exemplarily, it is assumed that the currently played video is a teaching video. The recommended data may be learning materials related to the target video frame of the instructional video and matching from the knowledge base. Then, extract the identification information of these learning materials.
本发明实施例的笔记记录方法,通过OCR技术、深度学习和图像识别技术等,查找满足预设条件的推荐数据,能够提高数据查找效率和数据查找的准确性。The note recording method of the embodiment of the present invention uses OCR technology, deep learning and image recognition technology to find recommended data that meets preset conditions, which can improve the efficiency of data search and the accuracy of data search.
在本发明实施例的一些可能实现中,在记录目标数据之后,本发明实施例的笔记记录方法还可以包括:在视频的播放进度条中的第一位置显示目标笔记对应的标注;其中,第一位置为与目标视频帧对应的播放进度在播放进度条中的位置。如图3所示,图3为本发明实施例提供的显示标注的示意图。In some possible implementations of the embodiment of the present invention, after recording the target data, the note recording method of the embodiment of the present invention may further include: displaying the mark corresponding to the target note at the first position in the playback progress bar of the video; A position is the position of the playback progress corresponding to the target video frame in the playback progress bar. As shown in FIG. 3, FIG. 3 is a schematic diagram of displaying annotations according to an embodiment of the present invention.
通过本发明实施例显示的标注,用户可以直观的获知笔记对应的视频帧对应的播放进度。Through the annotation displayed in the embodiment of the present invention, the user can intuitively know the playback progress corresponding to the video frame corresponding to the note.
在本发明实施例的一些可能实现中,在视频的播放进度条中的第一位置显示目标笔记对应的标注之后,本发明实施例的笔记记录方法还可以包括:在接收到对标注的第二输入或者在检测到光标的焦点位于第一位置的情况下,显示目标笔记对应的目标数据。In some possible implementations of the embodiments of the present invention, after the annotation corresponding to the target note is displayed in the first position in the playback progress bar of the video, the note recording method of the embodiment of the present invention may further include: Input or when it is detected that the focus of the cursor is at the first position, the target data corresponding to the target note is displayed.
在本发明实施例的一些可能实现中,在记录目标数据之后,本发明实施例的笔记记录方法还可以包括:接收第三输入;响应于第三输入,显示包含目标笔记的笔记列表。In some possible implementations of the embodiment of the present invention, after recording the target data, the note recording method of the embodiment of the present invention may further include: receiving a third input; and in response to the third input, displaying a note list containing the target note.
比如,用户点击预先设置的“笔记列表控件”,然后,显示包含目标 笔记的笔记列表。For example, the user clicks on the preset "note list control", and then displays the note list containing the target note.
通过本发明实施例显示的笔记列表,用户可以直观的获知笔记列表包括的笔记。Through the note list displayed in the embodiment of the present invention, the user can intuitively know the notes included in the note list.
在本发明实施例的一些可能实现中,可以在电子设备的第一显示区域显示视频,在电子设备的第二显示区域显示目标笔记对应的目标数据或笔记列表。如图4和图5所示。图4为本发明实施例提供的分区域显示视频和笔记的示意图;图5为本发明实施例提供的分区域显示视频和笔记列表的示意图。其中,由图4可知,笔记的标识信息为XY(其中,播放视频所采用的应用程序的标识信息为X,视频的标识信息为Y),推荐数据的标识信息为Z,笔记类别为重点,播放进度为15:28,备注信息为“老师好”。图5的笔记列表中包括三个笔记。In some possible implementations of the embodiments of the present invention, the video may be displayed in the first display area of the electronic device, and the target data or note list corresponding to the target note may be displayed in the second display area of the electronic device. As shown in Figure 4 and Figure 5. FIG. 4 is a schematic diagram of displaying videos and notes by area according to an embodiment of the present invention; FIG. 5 is a schematic diagram of displaying videos and notes list by area according to an embodiment of the present invention. Among them, it can be seen from Figure 4 that the identification information of the note is XY (where the identification information of the application used to play the video is X, and the identification information of the video is Y), the identification information of the recommended data is Z, and the note category is the focus. The playback progress is 15:28, and the remarks are "Hello teacher". The note list in Figure 5 includes three notes.
本发明实施例的笔记记录方法,通过分区域显示视频、笔记对应的数据或笔记列表,便于用户获知笔记信息、且不影响用户观看视频。In the note recording method of the embodiment of the present invention, the video and the data corresponding to the note or the note list are displayed in different areas, so that the user can learn the note information without affecting the user's viewing of the video.
在本发明实施例的一些可能实现中,在显示目标笔记的目标数据后,当用户点击目标数据中的推荐数据的标识信息后,显示该推荐数据。In some possible implementations of the embodiments of the present invention, after the target data of the target note is displayed, when the user clicks the identification information of the recommended data in the target data, the recommended data is displayed.
示例性的,假设当前播放的视频为教学视频。推荐数据可以为从知识库中匹配到的与该教学视频的目标视频帧相关的讲解视频、练习题目等学习资料。然后,提取这些学习资料的标识信息,显示包括这些学习资料的标识信息的目标数据,建立所显示的学习资料的标识信息与其对应的学习资料的链接。当用户点击这些学习资料的标识信息中的某一个学习资料的标识信息后,显示用户点击的标识信息对应的学习资料。Exemplarily, it is assumed that the currently played video is a teaching video. The recommended data may be learning materials related to the target video frame of the instructional video and matching from the knowledge base. Then, the identification information of these learning materials is extracted, the target data including the identification information of the learning materials are displayed, and the link between the identification information of the displayed learning materials and the corresponding learning materials is established. When the user clicks on the identification information of a certain learning material in the identification information of these learning materials, the learning material corresponding to the identification information clicked by the user is displayed.
在本发明实施例的一些可能实现中,对于柔性电子设备,在记录目标数据之后,若用户弯折电子设备,则可以显示目标笔记或包含目标笔记的笔记列表。在显示目标笔记或包含目标笔记的笔记列表时,若用户将电子设备弯折至未显示目标笔记或包含目标笔记的笔记列表之前的状态,则关闭目标笔记或包含目标笔记的笔记列表的显示。In some possible implementations of the embodiments of the present invention, for a flexible electronic device, after recording the target data, if the user bends the electronic device, the target note or a note list containing the target note can be displayed. When displaying the target note or the note list containing the target note, if the user bends the electronic device to a state before displaying the target note or the note list containing the target note, the display of the target note or the note list containing the target note is turned off.
在本发明实施例的一些可能实现中,可以在打开视频时,在电子设备的第一显示区域显示视频,第二显示区域无显示。在得到一个笔记后,将该笔记对应的数据显示在第二显示区域。在得到另一个笔记后,将另一个 笔记对应的数据显示在第二显示区域,之前的笔记不再显示。In some possible implementations of the embodiments of the present invention, when the video is opened, the video may be displayed in the first display area of the electronic device, and no display is displayed in the second display area. After a note is obtained, the data corresponding to the note is displayed in the second display area. After getting another note, the data corresponding to the other note is displayed in the second display area, and the previous note is no longer displayed.
本发明实施例的笔记记录方法,第二显示区域始终显示最新的笔记对应的数据。In the note recording method of the embodiment of the present invention, the second display area always displays data corresponding to the latest note.
在本发明实施例的一些可能实现中,可以在打开视频时,在电子设备的第一显示区域显示视频,第二显示区域显示笔记列表,此时笔记列表为空。在得到一个笔记后,将该笔记添加到该笔记列表中。在得到另一个笔记后,将另一个笔记添加到该笔记列表中。In some possible implementations of the embodiments of the present invention, when the video is opened, the video may be displayed in the first display area of the electronic device, and the note list may be displayed in the second display area. At this time, the note list is empty. After you get a note, add the note to the note list. After getting another note, add another note to the note list.
本发明实施例的笔记记录方法,第二显示区域始终显示笔记列表。In the note recording method of the embodiment of the present invention, the second display area always displays the note list.
在本发明实施例的一些可能实现中,在电子设备的第二显示区域显示目标笔记对应的数据或笔记列表之后,本发明实施例的笔记记录方法还可以包括:接收用户针对显示区域的调整输入;响应于该调整输入,调整第一显示区域和第二显示区域。In some possible implementations of the embodiment of the present invention, after the data or note list corresponding to the target note is displayed in the second display area of the electronic device, the note recording method of the embodiment of the present invention may further include: receiving a user's adjustment input for the display area ; In response to the adjustment input, adjust the first display area and the second display area.
比如,用户拖动第一显示区域或第二显示区域的边缘,调整第一显示区域和第二显示区域的比例关系。For example, the user drags the edge of the first display area or the second display area to adjust the proportional relationship between the first display area and the second display area.
再比如,用户直接输入第一显示区域和第二显示区域的比例关系,根据用户输入的比例关系进行调整。For another example, the user directly inputs the proportional relationship between the first display area and the second display area, and adjusts according to the proportional relationship input by the user.
通过本发明实施例提供的笔记记录方法,用户可以根据自己的需求设置第一显示区域和第二显示区域的大小,比例关系等。笔记列表和笔记的显示能更加符合用户的需要。Through the note recording method provided by the embodiment of the present invention, the user can set the size, ratio relationship, etc. of the first display area and the second display area according to their own needs. The note list and the display of notes can better meet the needs of users.
在本发明实施例的一些可能实现中,在显示包含目标笔记的笔记列表后,本发明实施例的笔记记录方法还可以包括:接收第四输入;响应于第四输入,从第一视频帧开始播放视频,或,将包含第一视频帧的视频定位到第一视频帧。其中,第一视频帧为根据第四输入从笔记列表中选择的笔记对应的视频帧。In some possible implementations of the embodiment of the present invention, after displaying the note list containing the target note, the note recording method of the embodiment of the present invention may further include: receiving a fourth input; in response to the fourth input, starting from the first video frame Play the video, or locate the video containing the first video frame to the first video frame. Wherein, the first video frame is a video frame corresponding to the note selected from the note list according to the fourth input.
通过本发明实施例提供的笔记记录方法,能够快速的从用户选择的笔记对应的视频帧开始播放包括该视频帧的视频或快速定位到用户选择的笔记对应的视频帧。Through the note recording method provided by the embodiment of the present invention, it is possible to quickly start playing a video including the video frame from the video frame corresponding to the note selected by the user or quickly locate the video frame corresponding to the note selected by the user.
在本发明实施例的一些可能实现中,第一视频帧可以为从笔记列表中选择的上述目标笔记对应的目标视频帧。也就是说,用户在执行第四输入 时,恰好从笔记列表中选择了上述目标笔记。In some possible implementations of the embodiments of the present invention, the first video frame may be a target video frame corresponding to the aforementioned target note selected from the note list. That is to say, when the user performs the fourth input, he happens to select the above-mentioned target note from the note list.
在本发明实施例的一些可能实现中,上述视频可以为教学视频。在电子设备接收第一输入之前,可以接收第五输入,响应于第五输入,开启学习模式;还可以对播放视频所采用的应用程序进行分析,智能开启学习模式或关闭学习模式。In some possible implementations of the embodiments of the present invention, the above-mentioned video may be an instructional video. Before the electronic device receives the first input, it can receive a fifth input, and in response to the fifth input, turn on the learning mode; it can also analyze the application used to play the video, and intelligently turn on the learning mode or turn off the learning mode.
比如,用户打开某一在线教育应用程序,观看其中的视频时,电子设备检测到有视频播放,且播放该视频的应用程序为与教育相关的应用程序,则开启学习模式。For example, when a user opens an online education application and watches a video in it, the electronic device detects that the video is playing, and the application playing the video is an education-related application, and the learning mode is started.
下面以在线学习场景为例,对本发明实施例提供的笔记记录方法进行说明。The following takes an online learning scenario as an example to describe the note recording method provided by the embodiment of the present invention.
首先,用户开启“学习模式”。其中,开启“学习模式”的方式与相关技术中开启“飞行模式”、“游戏模式”、“护眼模式”等的方式可以相同,本发明实施例在此不对其进行赘述。在“学习模式”下,用户在线学习所使用的应用程序可以占用较多的资源(比如,CPU、内存、网络资源),提高该应用程序播放教学视频的效果。在“学习模式”下,还可以关闭某些应用程序(比如,聊天程序,购物程序,游戏程序等),还可以关闭某些应用程序的消息推送,使用户专心学习,提高学习效率。First, the user turns on the "learning mode". The method of turning on the "learning mode" may be the same as the manner of turning on the "flying mode", the "game mode", the "eye protection mode", etc. in the related art, which will not be described in detail in the embodiment of the present invention. In the "learning mode", the application used by users for online learning can take up more resources (for example, CPU, memory, network resources), which improves the effect of the application in playing instructional videos. In the "learning mode", you can also close some applications (such as chat programs, shopping programs, game programs, etc.), you can also turn off the message push of some applications, so that users can concentrate on learning and improve learning efficiency.
然后,用户在线学习,在电子设备播放教学视频的过程中,当用户想记录笔记时,用户长按预先设置的“记录笔记控件”并向“难点”的方向拖动该“记录笔记控件”后,电子设备确定笔记类型为“难点”。其中,用户长按“记录笔记控件”,将该“记录笔记控件”向某一方向拖动,确定笔记类型为与该方向对应的笔记类型。其中,方向与笔记类型的对应关系可以预先设置。Then, the user learns online. When the user wants to take notes while the electronic device is playing the instructional video, the user long presses the preset "note recording control" and drags the "note recording control" in the direction of "difficulties". , The electronic device determines the note type as "difficulty". Among them, the user long presses the "note recording control", drags the "note recording control" in a certain direction, and determines that the note type is the note type corresponding to the direction. Among them, the corresponding relationship between the direction and the note type can be preset.
电子设备获取播放该教育视频所采用的应用程序的标识信息和该教育视频的标识信息,将两个标识信息进行组合,得到笔记的标识信息。The electronic device obtains the identification information of the application used to play the educational video and the identification information of the educational video, and combines the two identification information to obtain the identification information of the note.
电子设备执行屏幕截图,得到当前播放的视频帧对应的屏幕截图图像。The electronic device executes the screenshot, and obtains the screenshot image corresponding to the currently playing video frame.
电子设备获取当前播放的视频帧对应的播放进度。The electronic device obtains the playback progress corresponding to the currently played video frame.
基于OCR技术、深度学习技术和图像识别技术等,从参考资料数据库中查找与当前播放的视频帧的内容相关的参考资料,然后提取查找到的 参考资料的标识信息。Based on OCR technology, deep learning technology and image recognition technology, the reference material related to the content of the currently playing video frame is searched from the reference material database, and then the identification information of the found reference material is extracted.
同时,电子设备可以显示一提示信息,提示用户使用语音输入该笔记的备注。当用户输入语音数据后,对该语音数据进行处理,得到该语音数据对应的文本数据,将该语音数据和文本数据作为该笔记的备注信息。At the same time, the electronic device can display a prompt message to prompt the user to input the remarks of the note by voice. After the user inputs voice data, the voice data is processed to obtain text data corresponding to the voice data, and the voice data and text data are used as remarks of the note.
然后,对上述的笔记类型、笔记的标识信息、当前播放的视频帧对应的屏幕截图图像、当前播放的视频帧对应的播放进度、参考资料的标识信息和笔记的备注信息进行记录,得到一个笔记。Then, record the note type, the identification information of the note, the screenshot image corresponding to the currently played video frame, the playback progress corresponding to the currently played video frame, the identification information of the reference material and the note information of the note to obtain a note .
当得到一个笔记后,在该教学视频的播放进度条中显示该笔记对应的标注。When a note is obtained, the annotation corresponding to the note is displayed in the playback progress bar of the teaching video.
当用户点击该标注或光标的焦点处于该标注的位置时,显示该笔记。When the user clicks the mark or the focus of the cursor is at the position of the mark, the note is displayed.
当用户点击该笔记所处的位置时,从该笔记对应的视频帧播放该教学视频。When the user clicks on the location of the note, the instructional video is played from the video frame corresponding to the note.
或者,当得到一个笔记后,显示包括该笔记的笔记列表。Or, when a note is obtained, a list of notes including the note is displayed.
当用户点击该笔记列表中的某一个笔记后,从用户点击的笔记对应的视频帧播放该教学视频,或,When the user clicks on a note in the note list, the instructional video will be played from the video frame corresponding to the note clicked by the user, or,
当用户点击该笔记列表中的某一个笔记后,显示该笔记对应的数据。When the user clicks on a note in the note list, the data corresponding to the note is displayed.
当用户点击该笔记的“类型”或视频帧对应的播放进度后,从该笔记对应的视频帧播放该教学视频。When the user clicks on the "type" of the note or the playback progress corresponding to the video frame, the instructional video is played from the video frame corresponding to the note.
当用户点击该笔记的推荐数据的标识信息后,显示推荐数据。When the user clicks on the identification information of the recommended data of the note, the recommended data is displayed.
其中,该教学视频和笔记可以分区域显示。该教学视频和笔记列表也可以分区域显示。Among them, the teaching videos and notes can be displayed in different areas. The instructional video and note list can also be displayed in different areas.
与上述的方法实施例相对应,本发明实施例还提供一种电子设备。Corresponding to the foregoing method embodiment, the embodiment of the present invention also provides an electronic device.
图6为本发明实施例提供的一种电子设备的结构示意图。如图6所示,电子设备600可以包括:FIG. 6 is a schematic structural diagram of an electronic device provided by an embodiment of the present invention. As shown in FIG. 6, the electronic device 600 may include:
接收模块601,用于在电子设备播放视频的目标视频帧的情况下,接收第一输入;The receiving module 601 is configured to receive the first input when the electronic device plays the target video frame of the video;
确定模块602,用于响应于第一输入,确定与目标视频帧相关联的目标数据;The determining module 602 is configured to determine the target data associated with the target video frame in response to the first input;
记录模块603,用于记录目标数据,得到目标笔记。The recording module 603 is used to record target data and obtain target notes.
在本发明实施例的一些可能实现中,目标数据包括以下所列项中的至少一种:In some possible implementations of the embodiments of the present invention, the target data includes at least one of the following items:
目标笔记的标识信息、目标笔记的类别、目标视频帧对应的图像、目标视频帧对应的播放进度、备注信息和推荐数据的标识信息。The identification information of the target note, the category of the target note, the image corresponding to the target video frame, the playback progress corresponding to the target video frame, the remark information and the identification information of the recommended data.
在本发明实施例的一些可能实现中,确定模块602具体用于以下所列项中的至少一种:In some possible implementations of the embodiments of the present invention, the determining module 602 is specifically used for at least one of the following items:
获取与视频相关联的标识信息,根据与视频相关联的标识信息,确定目标笔记的标识信息;Obtain the identification information associated with the video, and determine the identification information of the target note according to the identification information associated with the video;
确定第一输入相关联的目标笔记类型,其中,第一输入为针对预设控件的输入;Determine the target note type associated with the first input, where the first input is an input for a preset control;
获取所述目标视频帧对应的图像;Acquiring an image corresponding to the target video frame;
获取所述目标视频帧对应的播放进度;Acquiring the playback progress corresponding to the target video frame;
接收用户输入的语音数据,根据语音数据,确定备注信息;Receive the voice data input by the user, and determine the remark information based on the voice data;
查找满足预设条件的推荐数据,获取推荐数据的标识信息,其中,预设条件是基于目标视频帧确定的。Search for recommended data that meets a preset condition, and obtain identification information of the recommended data, where the preset condition is determined based on the target video frame.
在本发明实施例的一些可能实现中,本发明实施例提供的电子设备600还可以包括:In some possible implementations of the embodiments of the present invention, the electronic device 600 provided in the embodiments of the present invention may further include:
显示模块,用于在视频的播放进度条中的第一位置显示目标笔记对应的标注,其中,第一位置为与目标视频帧对应的播放进度在播放进度条中的位置。The display module is configured to display the label corresponding to the target note at the first position in the playback progress bar of the video, where the first position is the position in the playback progress bar of the playback progress corresponding to the target video frame.
在本发明实施例的一些可能实现中,显示模块还可以用于:In some possible implementations of the embodiments of the present invention, the display module can also be used for:
在接收到对标注的第二输入或者在检测到光标的焦点位于第一位置的情况下,显示目标笔记对应的目标数据。When the second input to the annotation is received or the focus of the cursor is detected at the first position, the target data corresponding to the target note is displayed.
在本发明实施例的一些可能实现中,接收模块601还可以用于:接收第三输入。相应地,显示模块还可以用于:In some possible implementations of the embodiments of the present invention, the receiving module 601 may also be used to: receive a third input. Correspondingly, the display module can also be used for:
响应于第三输入,显示包含目标笔记的笔记列表。In response to the third input, a note list containing the target note is displayed.
在本发明实施例的一些可能实现中,显示模块具体可以用于:In some possible implementations of the embodiments of the present invention, the display module may be specifically used for:
在电子设备的第一显示区域显示视频,在电子设备的第二显示区域显示目标笔记对应的数据或笔记列表。The video is displayed in the first display area of the electronic device, and the data or note list corresponding to the target note is displayed in the second display area of the electronic device.
在本发明实施例的一些可能实现中,接收模块601还可以用于:接收第四输入。电子设备600还可以包括:In some possible implementations of the embodiments of the present invention, the receiving module 601 may also be used to: receive a fourth input. The electronic device 600 may also include:
第二播放定位模块,用于响应于第四输入,从第一视频帧开始播放视频,或,将包含第一视频帧的视频定位到第一视频帧,其中,第一视频帧为根据第四输入从笔记列表中选择的笔记对应的视频帧。The second play positioning module is used to respond to the fourth input, start playing the video from the first video frame, or locate the video containing the first video frame to the first video frame, where the first video frame is based on the fourth input Enter the video frame corresponding to the note selected from the note list.
对于本发明实施例的电子设备而言,由于其基本相似于本发明实施例的笔记记录方法实施例,所以描述的比较简单,相关之处参见本发明实施例的笔记记录方法实施例的部分说明即可。本发明实施例在此不对其进行赘述。For the electronic device of the embodiment of the present invention, since it is basically similar to the note recording method embodiment of the embodiment of the present invention, the description is relatively simple. For related details, please refer to the part of the description of the note recording method embodiment of the embodiment of the present invention. That's it. The embodiments of the present invention will not be repeated here.
在电子设备播放视频的情况下,用户通过执行第一输入后,电子设备会响应于该第一输入,确定并记录与目标视频帧相关联的目标数据,即可得到包含该目标数据的目标笔记。因此,通过该方法,电子设备响应于用户的一个输入,即可自动记录笔记,无需用户通过手写来记录笔记,能够提高笔记记录速度。In the case of an electronic device playing a video, after the user performs the first input, the electronic device will determine and record the target data associated with the target video frame in response to the first input to obtain the target note containing the target data . Therefore, with this method, the electronic device can automatically record notes in response to an input of the user, without the user needing to record notes by handwriting, and the note recording speed can be improved.
图7为本发明实施例提供的一种电子设备的硬件结构示意图。该电子设备700包括但不限于:射频单元701、网络模块702、音频输出单元703、输入单元704、传感器705、显示单元706、用户输入单元707、接口单元708、存储器709、处理器710、以及电源711等部件。本领域技术人员可以理解,图7中示出的电子设备结构并不构成对电子设备的限定,电子设备可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。在本发明实施例中,电子设备包括但不限于手机、平板电脑、笔记本电脑、掌上电脑、车载终端、可穿戴设备、以及计步器等。FIG. 7 is a schematic diagram of the hardware structure of an electronic device provided by an embodiment of the present invention. The electronic device 700 includes, but is not limited to: a radio frequency unit 701, a network module 702, an audio output unit 703, an input unit 704, a sensor 705, a display unit 706, a user input unit 707, an interface unit 708, a memory 709, a processor 710, and Power 711 and other components. Those skilled in the art can understand that the structure of the electronic device shown in FIG. 7 does not constitute a limitation on the electronic device. The electronic device may include more or less components than those shown in the figure, or a combination of certain components, or different components. Layout. In the embodiment of the present invention, electronic devices include, but are not limited to, mobile phones, tablet computers, notebook computers, palmtop computers, vehicle-mounted terminals, wearable devices, and pedometers.
处理器710用于:在电子设备播放视频的目标视频帧的情况下,接收第一输入;响应于第一输入,确定与目标视频帧相关联的目标数据;记录目标数据,得到目标笔记。The processor 710 is configured to: when the electronic device plays a target video frame of the video, receive a first input; in response to the first input, determine target data associated with the target video frame; record the target data to obtain a target note.
通过本发明实施例,在电子设备播放视频的目标视频帧的情况下,用户通过执行第一输入后,电子设备会响应于该第一输入,确定并记录与目标视频帧相关联的目标数据,即可得到包含该目标数据的目标笔记。因此,通过该方法,电子设备响应于用户的一个输入,即可自动记录笔记,无需 用户通过手写来记录笔记,能够提高笔记记录速度。Through the embodiment of the present invention, when the electronic device plays the target video frame of the video, after the user performs the first input, the electronic device will determine and record the target data associated with the target video frame in response to the first input, You can get the target note containing the target data. Therefore, with this method, the electronic device can automatically record notes in response to an input of the user, without the user needing to record notes by handwriting, and the note recording speed can be improved.
应理解的是,本发明实施例中,射频单元701可用于收发信息或通话过程中,信号的接收和发送,具体的,将来自基站的下行数据接收后,给处理器710处理;另外,将上行的数据发送给基站。通常,射频单元701包括但不限于天线、至少一个放大器、收发信机、耦合器、低噪声放大器、双工器等。此外,射频单元701还可以通过无线通信系统与网络和其他设备通信。It should be understood that, in the embodiment of the present invention, the radio frequency unit 701 can be used to receive and send signals during information transmission or communication. Specifically, the downlink data from the base station is received and processed by the processor 710; in addition, Uplink data is sent to the base station. Generally, the radio frequency unit 701 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 701 can also communicate with the network and other devices through a wireless communication system.
电子设备通过网络模块702为用户提供了无线的宽带互联网访问,如帮助用户收发电子邮件、浏览网页和访问流式媒体等。The electronic device provides users with wireless broadband Internet access through the network module 702, such as helping users to send and receive emails, browse web pages, and access streaming media.
音频输出单元703可以将射频单元701或网络模块702接收的或者在存储器709中存储的音频数据转换成音频信号并且输出为声音。而且,音频输出单元703还可以提供与电子设备700执行的特定功能相关的音频输出(例如,呼叫信号接收声音、消息接收声音等等)。音频输出单元703包括扬声器、蜂鸣器以及受话器等。The audio output unit 703 can convert the audio data received by the radio frequency unit 701 or the network module 702 or stored in the memory 709 into an audio signal and output it as sound. Moreover, the audio output unit 703 may also provide audio output related to a specific function performed by the electronic device 700 (for example, call signal reception sound, message reception sound, etc.). The audio output unit 703 includes a speaker, a buzzer, a receiver, and the like.
输入单元704用于接收音频或视频信号。输入单元704可以包括图形处理器(Graphics Processing Unit,GPU)7041和麦克风7042,图形处理器7041对在视频捕获模式或图像捕获模式中由图像捕获装置(如摄像头)获得的静态图片或视频的图像数据进行处理。处理后的图像帧可以显示在显示单元706上。经图形处理器7041处理后的图像帧可以存储在存储器709(或其它存储介质)中或者经由射频单元701或网络模块702进行发送。麦克风7042可以接收声音,并且能够将这样的声音处理为音频数据。处理后的音频数据可以在电话通话模式的情况下转换为可经由射频单元701发送到移动通信基站的格式输出。The input unit 704 is used to receive audio or video signals. The input unit 704 may include a graphics processing unit (GPU) 7041 and a microphone 7042. The graphics processor 7041 is used for the image of a still picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. Data is processed. The processed image frame may be displayed on the display unit 706. The image frame processed by the graphics processor 7041 may be stored in the memory 709 (or other storage medium) or sent via the radio frequency unit 701 or the network module 702. The microphone 7042 can receive sound, and can process such sound into audio data. The processed audio data can be converted into a format that can be sent to the mobile communication base station via the radio frequency unit 701 for output in the case of a telephone call mode.
电子设备700还包括至少一种传感器705,比如光传感器、运动传感器以及其他传感器。具体地,光传感器包括环境光传感器及接近传感器,其中,环境光传感器可根据环境光线的明暗来调节显示面板7061的亮度,接近传感器可在电子设备700移动到耳边时,关闭显示面板7061和/或背光。作为运动传感器的一种,加速计传感器可检测各个方向上(一般为三轴)加速度的大小,静止时可检测出重力的大小及方向,可用于识别电子 设备姿态(比如横竖屏切换、相关游戏、磁力计姿态校准)、振动识别相关功能(比如计步器、敲击)等;传感器705还可以包括指纹传感器、压力传感器、虹膜传感器、分子传感器、陀螺仪、气压计、湿度计、温度计、红外线传感器等,在此不再赘述。The electronic device 700 further includes at least one sensor 705, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor. The ambient light sensor can adjust the brightness of the display panel 7061 according to the brightness of the ambient light. The proximity sensor can close the display panel 7061 and the display panel 7061 when the electronic device 700 is moved to the ear. / Or backlight. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in various directions (usually three axes), and can detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of electronic devices (such as horizontal and vertical screen switching, related games) , Magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tap), etc.; sensor 705 can also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, Infrared sensors, etc., will not be repeated here.
显示单元706用于显示由用户输入的信息或提供给用户的信息。显示单元706可包括显示面板7061,可以采用液晶显示器(Liquid Crystal Display,LCD)、有机发光二极管(Organic Light-Emitting Diode,OLED)等形式来配置显示面板7061。The display unit 706 is used to display information input by the user or information provided to the user. The display unit 706 may include a display panel 7061, and the display panel 7061 may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), etc.
用户输入单元707可用于接收输入的数字或字符信息,以及产生与电子设备的用户设置以及功能控制有关的键信号输入。具体地,用户输入单元707包括触控面板7071以及其他输入设备7072。触控面板7071,也称为触摸屏,可收集用户在其上或附近的触摸操作(比如用户使用手指、触笔等任何适合的物体或附件在触控面板7071上或在触控面板7071附近的操作)。触控面板7071可包括触摸检测装置和触摸控制器两个部分。其中,触摸检测装置检测用户的触摸方位,并检测触摸操作带来的信号,将信号传送给触摸控制器;触摸控制器从触摸检测装置上接收触摸信息,并将它转换成触点坐标,再送给处理器710,接收处理器710发来的命令并加以执行。此外,可以采用电阻式、电容式、红外线以及表面声波等多种类型实现触控面板7071。除了触控面板7071,用户输入单元707还可以包括其他输入设备7072。具体地,其他输入设备7072可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆,在此不再赘述。The user input unit 707 may be used to receive inputted numeric or character information, and generate key signal input related to user settings and function control of the electronic device. Specifically, the user input unit 707 includes a touch panel 7071 and other input devices 7072. The touch panel 7071, also called a touch screen, can collect user touch operations on or near it (for example, the user uses any suitable objects or accessories such as fingers, stylus, etc.) on the touch panel 7071 or near the touch panel 7071. operate). The touch panel 7071 may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch position, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and then sends it To the processor 710, the command sent by the processor 710 is received and executed. In addition, the touch panel 7071 can be implemented in multiple types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 7071, the user input unit 707 may also include other input devices 7072. Specifically, other input devices 7072 may include, but are not limited to, a physical keyboard, function keys (such as volume control buttons, switch buttons, etc.), trackball, mouse, and joystick, which will not be repeated here.
进一步的,触控面板7071可覆盖在显示面板7061上,当触控面板7071检测到在其上或附近的触摸操作后,传送给处理器710以确定触摸事件的类型,随后处理器710根据触摸事件的类型在显示面板7061上提供相应的视觉输出。虽然在图7中,触控面板7071与显示面板7061是作为两个独立的部件来实现电子设备的输入和输出功能,但是在某些实施例中,可以将触控面板7071与显示面板7061集成而实现电子设备的输入和输出功能,具体此处不做限定。Further, the touch panel 7071 can be overlaid on the display panel 7061. When the touch panel 7071 detects a touch operation on or near it, it is transmitted to the processor 710 to determine the type of the touch event, and then the processor 710 determines the type of touch event according to the touch. The type of event provides corresponding visual output on the display panel 7061. Although in FIG. 7, the touch panel 7071 and the display panel 7061 are used as two independent components to implement the input and output functions of the electronic device, in some embodiments, the touch panel 7071 and the display panel 7061 can be integrated The implementation of the input and output functions of the electronic device is not specifically limited here.
接口单元708为外部装置与电子设备700连接的接口。例如,外部装置可以包括有线或无线头戴式耳机端口、外部电源(或电池充电器)端口、有线或无线数据端口、存储卡端口、用于连接具有识别模块的装置的端口、音频输入/输出(I/O)端口、视频I/O端口、耳机端口等等。接口单元708可以用于接收来自外部装置的输入(例如,数据信息、电力等等)并且将接收到的输入传输到电子设备700内的一个或多个元件或者可以用于在电子设备700和外部装置之间传输数据。The interface unit 708 is an interface for connecting an external device and the electronic device 700. For example, the external device may include a wired or wireless headset port, an external power source (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, audio input/output (I/O) port, video I/O port, headphone port, etc. The interface unit 708 can be used to receive input (for example, data information, power, etc.) from an external device and transmit the received input to one or more elements in the electronic device 700 or can be used to connect the electronic device 700 to an external device. Transfer data between devices.
存储器709可用于存储软件程序以及各种数据。存储器709可主要包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需的应用程序(比如声音播放功能、图像播放功能等)等;存储数据区可存储根据手机的使用所创建的数据(比如音频数据、电话本等)等。此外,存储器709可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。The memory 709 can be used to store software programs and various data. The memory 709 may mainly include a program storage area and a data storage area. The program storage area may store an operating system, an application program required by at least one function (such as a sound playback function, an image playback function, etc.), etc.; Data created by the use of mobile phones (such as audio data, phone book, etc.), etc. In addition, the memory 709 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state storage devices.
处理器710是电子设备的控制中心,利用各种接口和线路连接整个电子设备的各个部分,通过运行或执行存储在存储器709内的软件程序和/或模块,以及调用存储在存储器709内的数据,执行电子设备的各种功能和处理数据,从而对电子设备进行整体监控。处理器710可包括一个或多个处理单元;可选的,处理器710可集成应用处理器和调制解调处理器,其中,应用处理器主要处理操作系统、用户界面和应用程序等,调制解调处理器主要处理无线通信。可以理解的是,上述调制解调处理器也可以不集成到处理器710中。The processor 710 is the control center of the electronic device. It uses various interfaces and lines to connect the various parts of the entire electronic device, runs or executes software programs and/or modules stored in the memory 709, and calls data stored in the memory 709 , Perform various functions of electronic equipment and process data, so as to monitor the electronic equipment as a whole. The processor 710 may include one or more processing units; optionally, the processor 710 may integrate an application processor and a modem processor, where the application processor mainly processes the operating system, user interface, and application programs, etc. The adjustment processor mainly deals with wireless communication. It can be understood that the foregoing modem processor may not be integrated into the processor 710.
电子设备700还可以包括给各个部件供电的电源711(比如电池),可选的,电源711可以通过电源管理系统与处理器710逻辑相连,从而通过电源管理系统实现管理充电、放电、以及功耗管理等功能。The electronic device 700 may also include a power source 711 (such as a battery) for supplying power to various components. Optionally, the power source 711 may be logically connected to the processor 710 through a power management system, so as to manage charging, discharging, and power consumption through the power management system. Management and other functions.
另外,电子设备700包括一些未示出的功能模块,在此不再赘述。In addition, the electronic device 700 includes some functional modules not shown, which will not be repeated here.
可选的,本发明实施例还提供一种电子设备,包括处理器710,存储器709,存储在存储器709上并可在处理器710上运行的计算机程序,该计算机程序被处理器710执行时实现本发明实施例提供的笔记记录方法实 施例的各个过程,且能达到相同的技术效果,为避免重复,这里不再赘述。Optionally, an embodiment of the present invention further provides an electronic device, including a processor 710, a memory 709, and a computer program stored on the memory 709 and running on the processor 710. The computer program is implemented when the processor 710 is executed. The various processes of the note recording method embodiment provided by the embodiment of the present invention can achieve the same technical effect. To avoid repetition, details are not repeated here.
本发明实施例还提供一种计算机可读存储介质,该计算机可读存储介质上存储有计算机程序指令;该计算机程序指令被处理器执行时实现本发明实施例提供的笔记记录方法实施例的各个过程,且能达到相同的技术效果,为避免重复,这里不再赘述。其中,所述的计算机可读存储介质,如只读存储器(Read-Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、磁碟或者光盘等。The embodiment of the present invention also provides a computer-readable storage medium, the computer-readable storage medium stores computer program instructions; when the computer program instructions are executed by a processor, each of the embodiments of the note recording method provided by the embodiments of the present invention is implemented The process, and can achieve the same technical effect, in order to avoid repetition, I will not repeat it here. Wherein, the computer-readable storage medium, such as read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk, or optical disk, etc.
需要说明的是,在本文中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。It should be noted that in this article, the terms "include", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, It also includes other elements that are not explicitly listed, or elements inherent to the process, method, article, or device. If there are no more restrictions, the element defined by the sentence "including a..." does not exclude the existence of other identical elements in the process, method, article, or device that includes the element.
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。响应于这样的理解,本发明的技术方案本质上或者说对相关技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中,包括若干指令用以使得一台终端(可以是手机,计算机,服务器,空调器,或者网络设备等)执行本发明各个实施例所述的方法。Through the description of the above implementation manners, those skilled in the art can clearly understand that the above-mentioned embodiment method can be implemented by means of software plus the necessary general hardware platform, of course, it can also be implemented by hardware, but in many cases the former is better.的实施方式。 In response to this understanding, the technical solution of the present invention essentially or the part that contributes to the related technology can be embodied in the form of a software product, and the computer software product is stored in a storage medium (such as ROM/RAM, magnetic disk, The optical disc) includes several instructions to make a terminal (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the method described in each embodiment of the present invention.
上面结合附图对本发明的实施例进行了描述,但是本发明并不局限于上述的具体实施方式,上述的具体实施方式仅仅是示意性的,而不是限制性的,本领域的普通技术人员在本发明的启示下,在不脱离本发明宗旨和权利要求所保护的范围情况下,还可做出很多形式,均属于本发明的保护之内。The embodiments of the present invention are described above with reference to the accompanying drawings, but the present invention is not limited to the above-mentioned specific embodiments. The above-mentioned specific embodiments are only illustrative and not restrictive. Those of ordinary skill in the art are Under the enlightenment of the present invention, many forms can be made without departing from the purpose of the present invention and the scope of protection of the claims, and they all fall within the protection of the present invention.

Claims (20)

  1. 一种笔记记录方法,应用于电子设备,所述方法包括:A note recording method, applied to an electronic device, the method including:
    在所述电子设备播放视频的目标视频帧的情况下,接收第一输入;Receiving the first input when the electronic device plays the target video frame of the video;
    响应于所述第一输入,确定与所述目标视频帧相关联的目标数据;In response to the first input, determining target data associated with the target video frame;
    记录所述目标数据,得到目标笔记。Record the target data to obtain target notes.
  2. 根据权利要求1所述的方法,其中,所述目标数据包括以下所列项中的至少一种:The method according to claim 1, wherein the target data includes at least one of the following items:
    所述目标笔记的标识信息、所述目标笔记的类别、所述目标视频帧对应的图像、所述目标视频帧对应的播放进度、备注信息和推荐数据的标识信息。The identification information of the target note, the category of the target note, the image corresponding to the target video frame, the playback progress corresponding to the target video frame, the remark information and the identification information of the recommended data.
  3. 根据权利要求2所述的方法,其中,所述确定与所述目标视频帧相关联的目标数据,包括以下所列项中的至少一种:The method according to claim 2, wherein the determining the target data associated with the target video frame includes at least one of the following items:
    获取与所述视频相关联的标识信息,根据与所述视频相关联的标识信息,确定所述目标笔记的标识信息;Acquiring identification information associated with the video, and determining identification information of the target note according to the identification information associated with the video;
    确定所述第一输入相关联的目标笔记类型,其中,所述第一输入为针对预设控件的输入;Determining a target note type associated with the first input, where the first input is an input for a preset control;
    获取所述目标视频帧对应的图像;Acquiring an image corresponding to the target video frame;
    获取所述目标视频帧对应的播放进度;Acquiring the playback progress corresponding to the target video frame;
    接收用户输入的语音数据,根据所述语音数据,确定所述备注信息;Receiving voice data input by a user, and determining the remark information according to the voice data;
    查找满足预设条件的推荐数据,获取所述推荐数据的标识信息,其中,所述预设条件是基于所述目标视频帧确定的。Search for recommended data that meets a preset condition, and obtain identification information of the recommended data, where the preset condition is determined based on the target video frame.
  4. 根据权利要求1所述的方法,其中,在所述记录所述目标数据之后,所述方法还包括:The method according to claim 1, wherein after said recording said target data, said method further comprises:
    在所述视频的播放进度条中的第一位置显示所述目标笔记对应的标注,其中,所述第一位置为与所述目标视频帧对应的播放进度在所述播放进度条中的位置。The label corresponding to the target note is displayed at the first position in the playback progress bar of the video, where the first position is the position in the playback progress bar of the playback progress corresponding to the target video frame.
  5. 根据权利要求4所述的方法,其中,在所述视频的播放进度条中的第一位置显示所述目标笔记对应的标注之后,所述方法还包括:The method according to claim 4, wherein, after displaying the annotation corresponding to the target note at the first position in the playback progress bar of the video, the method further comprises:
    在接收到对所述标注的第二输入或者在检测到光标的焦点位于所述第一位置的情况下,显示所述目标笔记对应的所述目标数据。When the second input of the annotation is received or the focus of the cursor is detected at the first position, the target data corresponding to the target note is displayed.
  6. 根据权利要求1所述的方法,其中,在记录所述目标数据之后,所述方法还包括:The method according to claim 1, wherein after recording the target data, the method further comprises:
    接收第三输入;Receive the third input;
    响应于所述第三输入,显示包含所述目标笔记的笔记列表。In response to the third input, a note list containing the target note is displayed.
  7. 根据权利要求5或6所述的方法,其中,在所述电子设备的第一显示区域显示所述视频,在所述电子设备的第二显示区域显示所述目标笔记对应的所述目标数据或所述笔记列表。The method according to claim 5 or 6, wherein the video is displayed in the first display area of the electronic device, and the target data corresponding to the target note is displayed in the second display area of the electronic device. List of said notes.
  8. 根据权利要求6所述的方法,其中,在所述显示包含所述目标笔记的笔记列表之后,所述方法还包括:The method according to claim 6, wherein, after the displaying the note list containing the target note, the method further comprises:
    接收第四输入;Receive the fourth input;
    响应于所述第四输入,从第一视频帧开始播放视频,或,将包含所述第一视频帧的视频定位到所述第一视频帧,其中,所述第一视频帧为根据第四输入从所述笔记列表中选择的笔记对应的视频帧。In response to the fourth input, start playing the video from the first video frame, or locate the video containing the first video frame to the first video frame, wherein the first video frame is based on the fourth Input the video frame corresponding to the note selected from the note list.
  9. 一种电子设备,包括:An electronic device including:
    接收模块,用于在所述电子设备播放视频的目标视频帧的情况下,接收第一输入;A receiving module, configured to receive a first input when the electronic device plays a target video frame of the video;
    确定模块,用于响应于所述第一输入,确定与目标视频帧相关联的目标数据;A determining module, configured to determine the target data associated with the target video frame in response to the first input;
    记录模块,用于记录所述目标数据,得到目标笔记。The recording module is used to record the target data and obtain target notes.
  10. 根据权利要求9所述的电子设备,其中,所述目标数据包括以下所列项中的至少一种:The electronic device according to claim 9, wherein the target data includes at least one of the following items:
    所述目标笔记的标识信息、所述目标笔记的类别、所述目标视频帧对应的图像、所述目标视频帧对应的播放进度、备注信息和推荐数据的标识信息。The identification information of the target note, the category of the target note, the image corresponding to the target video frame, the playback progress corresponding to the target video frame, the remark information and the identification information of the recommended data.
  11. 根据权利要求10所述的电子设备,其中,所述确定模块具体用于以下所列项中的至少一种:The electronic device according to claim 10, wherein the determining module is specifically used for at least one of the following items:
    获取与所述视频相关联的标识信息,根据与所述视频相关联的标识信息,确定所述目标笔记的标识信息;Acquiring identification information associated with the video, and determining identification information of the target note according to the identification information associated with the video;
    确定所述第一输入相关联的目标笔记类型,其中,所述第一输入为针对预设控件的输入;Determining a target note type associated with the first input, where the first input is an input for a preset control;
    获取所述目标视频帧对应的图像;Acquiring an image corresponding to the target video frame;
    获取所述目标视频帧对应的播放进度;Acquiring the playback progress corresponding to the target video frame;
    接收用户输入的语音数据,根据所述语音数据,确定所述备注信息;Receiving voice data input by a user, and determining the remark information according to the voice data;
    查找满足预设条件的推荐数据,获取所述推荐数据的标识信息,其中,所述预设条件是基于所述目标视频帧确定的。Search for recommended data that meets a preset condition, and obtain identification information of the recommended data, where the preset condition is determined based on the target video frame.
  12. 根据权利要求9所述的电子设备,还包括:The electronic device according to claim 9, further comprising:
    显示模块,用于在所述视频的播放进度条中的第一位置显示所述目标笔记对应的标注,其中,所述第一位置为与所述目标视频帧对应的播放进度在所述播放进度条中的位置。The display module is configured to display the annotation corresponding to the target note in the first position in the playback progress bar of the video, wherein the first position is the playback progress corresponding to the target video frame in the playback progress The position in the bar.
  13. 根据权利要求12所述的电子设备,其中,所述显示模块还用于:The electronic device according to claim 12, wherein the display module is further used for:
    在接收到对所述标注的第二输入或者在检测到光标的焦点位于所述第一位置的情况下,显示所述目标笔记对应的所述目标数据。When the second input of the annotation is received or the focus of the cursor is detected at the first position, the target data corresponding to the target note is displayed.
  14. 根据权利要求12所述的电子设备,其中,所述接收模块还用于:The electronic device according to claim 12, wherein the receiving module is further used for:
    接收第三输入;Receive the third input;
    所述显示模块还用于:The display module is also used for:
    响应于所述第三输入,显示包含所述目标笔记的笔记列表。In response to the third input, a note list containing the target note is displayed.
  15. 根据权利要求14所述的电子设备,其中,所述显示模块具体用于:The electronic device according to claim 14, wherein the display module is specifically configured to:
    在所述电子设备的第一显示区域显示所述视频,在所述电子设备的第二显示区域显示所述目标笔记对应的所述目标数据或所述笔记列表。The video is displayed in the first display area of the electronic device, and the target data or the note list corresponding to the target note is displayed in the second display area of the electronic device.
  16. 根据权利要求14所述的电子设备,其中,所述接收模块还用于:The electronic device according to claim 14, wherein the receiving module is further used for:
    接收第四输入;Receive the fourth input;
    所述电子设备还包括:The electronic device also includes:
    第二播放定位模块,用于响应于所述第四输入,从第一视频帧开始播放视频,或,将包含所述第一视频帧的视频定位到所述第一视频帧,其中, 所述第一视频帧为根据第四输入从所述笔记列表中选择的笔记对应的视频帧。The second play positioning module is configured to start playing the video from the first video frame in response to the fourth input, or locate the video containing the first video frame to the first video frame, wherein the The first video frame is a video frame corresponding to the note selected from the note list according to the fourth input.
  17. 一种电子设备,包括:存储器、处理器及存储在所述存储器上并可在所述处理器上运行的计算机程序;An electronic device, including: a memory, a processor, and a computer program stored on the memory and running on the processor;
    所述处理器执行所述计算机程序时实现如权利要求1至8任一项所述的笔记记录方法。When the processor executes the computer program, the note recording method according to any one of claims 1 to 8 is implemented.
  18. 一种电子设备,被配置为用于执行如权利要求1至8中任一项所述的笔记记录方法的步骤。An electronic device configured to perform the steps of the note recording method according to any one of claims 1 to 8.
  19. 一种计算机可读存储介质,所述计算机可读存储介质上存储计算机程序,所述计算机程序被处理器执行时实现如权利要求1至8中任一项所述的笔记记录方法的步骤。A computer-readable storage medium storing a computer program on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the note recording method according to any one of claims 1 to 8 are realized.
  20. 一种计算机程序产品,所述计算机程序产品可被处理器执行以实现如权利要求1至8中任一项所述的笔记记录方法的步骤。A computer program product that can be executed by a processor to implement the steps of the note recording method according to any one of claims 1 to 8.
PCT/CN2021/094353 2020-05-20 2021-05-18 Note recording method and electronic device WO2021233293A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010428593.7 2020-05-20
CN202010428593.7A CN111556371A (en) 2020-05-20 2020-05-20 Note recording method and electronic equipment

Publications (1)

Publication Number Publication Date
WO2021233293A1 true WO2021233293A1 (en) 2021-11-25

Family

ID=72002099

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/094353 WO2021233293A1 (en) 2020-05-20 2021-05-18 Note recording method and electronic device

Country Status (2)

Country Link
CN (1) CN111556371A (en)
WO (1) WO2021233293A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114501112A (en) * 2022-01-24 2022-05-13 北京百度网讯科技有限公司 Method, apparatus, device, medium and product for generating video notes

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111556371A (en) * 2020-05-20 2020-08-18 维沃移动通信有限公司 Note recording method and electronic equipment
CN112087656B (en) * 2020-09-08 2022-10-04 远光软件股份有限公司 Online note generation method and device and electronic equipment
CN112087657B (en) * 2020-09-21 2024-02-09 腾讯科技(深圳)有限公司 Data processing method and device
CN113099256B (en) * 2021-04-01 2022-11-08 读书郎教育科技有限公司 Method and system for playing back videos and adding voice notes in smart class
CN113126865A (en) * 2021-04-23 2021-07-16 百度在线网络技术(北京)有限公司 Note generation method and device in video learning process, electronic equipment and medium
CN113395605B (en) * 2021-07-20 2022-12-13 上海哔哩哔哩科技有限公司 Video note generation method and device

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040169683A1 (en) * 2003-02-28 2004-09-02 Fuji Xerox Co., Ltd. Systems and methods for bookmarking live and recorded multimedia documents
CN103491450A (en) * 2013-09-25 2014-01-01 深圳市金立通信设备有限公司 Setting method of playback fragment of media stream and terminal
CN103488661A (en) * 2013-03-29 2014-01-01 吴晗 Audio/video file annotation system
US20140033040A1 (en) * 2012-07-24 2014-01-30 Apple Inc. Portable device with capability for note taking while outputting content
US20150373063A1 (en) * 2014-06-23 2015-12-24 Adobe Systems Incorporated Method and apparatus for timeline-synchronized note taking during a web conference
CN106303723A (en) * 2016-08-11 2017-01-04 网易(杭州)网络有限公司 Method for processing video frequency and device
CN107291343A (en) * 2017-05-18 2017-10-24 网易(杭州)网络有限公司 Recording method, device and the computer-readable recording medium of notes
CN109672940A (en) * 2018-12-11 2019-04-23 北京新鼎峰软件科技有限公司 Video playback method and video playback system based on note contents
CN110083319A (en) * 2019-03-25 2019-08-02 维沃移动通信有限公司 Take down notes display methods, device, terminal and storage medium
CN110381382A (en) * 2019-07-23 2019-10-25 腾讯科技(深圳)有限公司 Video takes down notes generation method, device, storage medium and computer equipment
CN111556371A (en) * 2020-05-20 2020-08-18 维沃移动通信有限公司 Note recording method and electronic equipment

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7647555B1 (en) * 2000-04-13 2010-01-12 Fuji Xerox Co., Ltd. System and method for video access from notes or summaries
CN102833490A (en) * 2011-06-15 2012-12-19 新诺亚舟科技(深圳)有限公司 Method and system for editing and playing interactive video, and electronic learning device
CN103530320A (en) * 2013-09-18 2014-01-22 中兴通讯股份有限公司 Multimedia file processing method and device and terminal
CN104822092B (en) * 2015-04-30 2018-08-24 无锡天脉聚源传媒科技有限公司 Video gets ready, indexes and subtitle merging treatment method and device
CN107015979B (en) * 2016-01-27 2021-04-06 斑马智行网络(香港)有限公司 Data processing method and device and intelligent terminal
CN106375861A (en) * 2016-10-10 2017-02-01 合网络技术(北京)有限公司 Video playing method and device
CN109543048B (en) * 2018-12-12 2020-11-06 广东小天才科技有限公司 Note generation method and terminal equipment
CN110457879A (en) * 2019-06-26 2019-11-15 维沃移动通信有限公司 Object displaying method and terminal device
CN110879679B (en) * 2019-11-12 2022-02-22 维沃移动通信有限公司 Display control method, electronic equipment and computer readable storage medium

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040169683A1 (en) * 2003-02-28 2004-09-02 Fuji Xerox Co., Ltd. Systems and methods for bookmarking live and recorded multimedia documents
US20140033040A1 (en) * 2012-07-24 2014-01-30 Apple Inc. Portable device with capability for note taking while outputting content
CN103488661A (en) * 2013-03-29 2014-01-01 吴晗 Audio/video file annotation system
CN103491450A (en) * 2013-09-25 2014-01-01 深圳市金立通信设备有限公司 Setting method of playback fragment of media stream and terminal
US20150373063A1 (en) * 2014-06-23 2015-12-24 Adobe Systems Incorporated Method and apparatus for timeline-synchronized note taking during a web conference
CN106303723A (en) * 2016-08-11 2017-01-04 网易(杭州)网络有限公司 Method for processing video frequency and device
CN107291343A (en) * 2017-05-18 2017-10-24 网易(杭州)网络有限公司 Recording method, device and the computer-readable recording medium of notes
CN109672940A (en) * 2018-12-11 2019-04-23 北京新鼎峰软件科技有限公司 Video playback method and video playback system based on note contents
CN110083319A (en) * 2019-03-25 2019-08-02 维沃移动通信有限公司 Take down notes display methods, device, terminal and storage medium
CN110381382A (en) * 2019-07-23 2019-10-25 腾讯科技(深圳)有限公司 Video takes down notes generation method, device, storage medium and computer equipment
CN111556371A (en) * 2020-05-20 2020-08-18 维沃移动通信有限公司 Note recording method and electronic equipment

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114501112A (en) * 2022-01-24 2022-05-13 北京百度网讯科技有限公司 Method, apparatus, device, medium and product for generating video notes
CN114501112B (en) * 2022-01-24 2024-03-22 北京百度网讯科技有限公司 Method, apparatus, device, medium, and article for generating video notes

Also Published As

Publication number Publication date
CN111556371A (en) 2020-08-18

Similar Documents

Publication Publication Date Title
WO2021233293A1 (en) Note recording method and electronic device
US11675442B2 (en) Image processing method and flexible-screen terminal
WO2020011076A1 (en) Method for displaying background application and mobile terminal
WO2021136159A1 (en) Screenshot method and electronic device
WO2021077897A1 (en) File sending method and apparatus, and electronic device
WO2020199934A1 (en) Information processing method and terminal device
WO2021073478A1 (en) Bullet screen information recognition method, display method, server and electronic device
WO2020238938A1 (en) Information input method and mobile terminal
CN107943390B (en) Character copying method and mobile terminal
WO2020192394A1 (en) Note displaying method and device, terminal, and storage medium
WO2019196929A1 (en) Video data processing method and mobile terminal
WO2020220999A1 (en) Screenshot method and terminal device
WO2021036553A1 (en) Icon display method and electronic device
CN110830362B (en) Content generation method and mobile terminal
WO2021004426A1 (en) Content selection method, and terminal
WO2021109961A1 (en) Method for generating shortcut icon, electronic apparatus, and medium
WO2020151513A1 (en) Information processing method and terminal device
WO2020199988A1 (en) Content copying method and terminal
WO2019223569A1 (en) Information processing method and mobile terminal
WO2020057258A1 (en) Information processing method and terminal
WO2021104160A1 (en) Editing method and electronic device
WO2021031843A1 (en) Object position adjustment method, and electronic apparatus
WO2020192299A1 (en) Information display method and terminal device
WO2021129818A1 (en) Video playback method and electronic device
WO2021104232A1 (en) Display method and electronic device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21809573

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 03.05.2023)

122 Ep: pct application non-entry in european phase

Ref document number: 21809573

Country of ref document: EP

Kind code of ref document: A1