CN110083319B - Note display method, device, terminal and storage medium - Google Patents
Note display method, device, terminal and storage medium Download PDFInfo
- Publication number
- CN110083319B CN110083319B CN201910228159.1A CN201910228159A CN110083319B CN 110083319 B CN110083319 B CN 110083319B CN 201910228159 A CN201910228159 A CN 201910228159A CN 110083319 B CN110083319 B CN 110083319B
- Authority
- CN
- China
- Prior art keywords
- video clip
- screen
- language
- video
- note
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
- G06F3/1438—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display using more than one graphics controller
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/02—Electrically-operated educational appliances with visual presentation of the material to be studied, e.g. using film strip
Abstract
The invention discloses a note display method, a note display device, a note display terminal and a storage medium. The method is applied to a terminal, the terminal comprises a first screen and a second screen, and the method comprises the following steps: displaying multimedia data on a first screen; after receiving the marking instruction, displaying a marking component on a first screen, wherein the marking component is used for marking the multimedia data; determining note content from the content marked by the marking component; displaying the note content on the second screen. By the embodiment of the invention, the note content can be watched while the multimedia data is learned.
Description
Technical Field
The present invention relates to the field of computer technologies, and in particular, to a note display method, apparatus, terminal, and storage medium.
Background
The intuition of multimedia learning materials is helpful for understanding concepts and mastering methods. The multimedia data has excellent image-text sound image, and can arouse the emotion, attention and interest of students from multiple angles. The dynamic property of the multimedia data is beneficial to reflecting concepts and processes, and can effectively break through teaching difficulties. The multimedia data can cultivate the advantages of exploration, creativity and the like of students by reproducing and simulating real scenes. Therefore, multimedia learning materials are gradually used by most people to learn, such as english videos, technical learning videos, and the like.
Paper learning materials can be freely taken notes on books, but the notes on multimedia learning materials are not convenient enough. In the current multimedia learning, the terminal is only used as a medium for displaying multimedia learning materials. It is very inconvenient to go back to study, take notes at any time and so on through the multimedia learning mode. At present, when multimedia data are learned, if notes need to be taken, videos need to be stopped, notes are taken on a paper notebook, and the good experience of users is reduced by the aid of the method for taking notes.
Moreover, the advantages of multimedia learning in review, such as audio reading and dynamic reading, cannot be reflected by taking notes on a paper notebook. For example, for a language-class video material, the focus of the reader on learning through the video is often the current scene, the mood of the human expression and the reading simulation. It is important to make a note at a terminal while watching multimedia learning materials and to display the made note at the terminal.
Disclosure of Invention
The embodiment of the invention provides a note display method, a note display device, a terminal and a storage medium, and aims to solve the problem that note contents made in the terminal cannot be displayed while multimedia data are watched.
In order to solve the technical problem, the invention is realized as follows: a note display method is applied to a terminal, the terminal comprises a first screen and a second screen, and the method comprises the following steps:
displaying multimedia data on a first screen;
after receiving a note marking function starting instruction, displaying a mark note function component on a first screen, wherein the mark note component is used for marking multimedia data;
determining note content from the content marked by the marking component;
displaying the note content on the second screen.
In a first aspect, an embodiment of the present invention further provides an apparatus for displaying notes, where the apparatus is applied to a terminal, and the terminal includes a first screen and a second screen, and the apparatus includes:
the multimedia data display module is used for displaying multimedia data on the first screen;
the marking component display module is used for displaying a marking component on the first screen after receiving the marking instruction, and the marking component is used for marking the multimedia data;
the note content determining module is used for determining note content according to the content marked by the marking component;
and the note content display module is used for displaying the note content on the second screen.
In a second aspect, an embodiment of the present invention further provides a terminal, where the terminal includes a processor, a memory, and a computer program stored in the memory and being executable on the processor, and when the computer program is executed by the processor, the note display method as described above is implemented.
In a third aspect, an embodiment of the present invention further provides a computer storage medium, where computer program instructions are stored on the computer storage medium, and when the computer program instructions are executed by a processor, the computer program instructions implement the note display method described above.
In the embodiment of the invention, the multimedia learning materials are displayed on the first screen of the terminal, and the made note contents are simultaneously displayed on the second screen of the terminal, so that the simultaneous operation of multiple applications is realized, a user can record and watch notes at any time while learning the multimedia materials, and the learning convenience is improved.
Drawings
The present invention will be better understood from the following description of specific embodiments thereof taken in conjunction with the accompanying drawings, in which like or similar reference characters designate like or similar features.
FIG. 1 is a flow chart diagram of a note display method according to an embodiment of the invention;
FIG. 2 is a flow chart diagram of a note display method according to another embodiment of the present invention;
FIG. 3 is a diagram illustrating a tag of note content according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of a language-class video note template according to an embodiment of the present invention;
FIG. 5 is a schematic diagram of a non-video note template according to an embodiment of the invention;
FIG. 6 is a schematic structural diagram of a note display device according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of a terminal according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 1 is a flowchart illustrating a note displaying method 100 applied to a terminal according to an embodiment of the present invention. As shown in fig. 1, the note display method in the embodiment of the present invention is applied to a terminal, where the terminal includes a first screen and a second screen, and the method includes the following steps:
s110, displaying the multimedia data on the first screen.
S120, after the marking instruction is received, a marking component is displayed on the first screen, and the marking component is used for marking the multimedia data.
S130, determining note content according to the content marked by the marking component.
And S140, displaying the note content on the second screen.
According to the note display method provided by the embodiment of the invention, the multimedia learning materials are displayed on the first screen of the terminal, and the made note contents are displayed on the second screen of the terminal at the same time, so that the simultaneous operation of multiple applications is realized, a user can record and watch notes at any time while learning the multimedia materials, and the learning convenience is improved.
The following describes in detail an implementation of the note display method provided by the embodiment of the present invention with reference to a specific example.
It should be noted that the first screen and the second screen of the embodiment of the present invention may be two independent screens on the same terminal, for example, a terminal with a dual-sided screen. Alternatively, the first screen and the second screen may be two different areas of the same screen of the terminal, for example, a terminal having a folded screen.
As shown in fig. 2, when the multimedia data is displayed on the first screen, if the mark command is triggered, the notebook mode is entered.
In the embodiment of the invention, when the preset physical key or the preset area of the first screen is triggered, the marking instruction is triggered. Specifically, the marking instruction may be triggered in at least one of the following ways:
the method comprises the steps of contacting with a first screen, enabling the number of times of contact to reach a time threshold within a specified time range, continuously contacting with the first screen, enabling the contact duration to reach a time threshold, contacting with the first screen, forming a sliding track along a preset direction, and emitting a preset sound signal. The triggering mode of the marking instruction can be customized by a user.
In the embodiment of the invention, the triggering mode of the marking instruction is various, and the marking instruction can be set by a user according to the habit of the user, so that the flexibility is high.
As a specific example, the user of the terminal triggers the marking instruction by long pressing at a certain corner of the first screen.
After receiving the marking instruction, judging whether the multimedia data displayed on the first screen is video data or not, and determining the type of the marking component according to the judgment result.
In the embodiment of the invention, the corresponding marking components are displayed according to different types of the multimedia data, so that the time for selecting the marking components by a user is shortened, and the efficiency and good experience of the user in taking notes are improved.
The multimedia data is video data
In an embodiment of the present invention, if the multimedia material is a video material, a video clip component is displayed on the first screen for the user to mark the start position and the end position of the video segment to be captured. That is, the video clip component is used for user tagging of highlight video material portions.
After the marks made by the video clip component are received, namely the starting position and the ending position of the video segment marked by the user are received by the background, whether the video segment marked by the video clip component comprises the subtitles is judged.
If the video clip marked by the video clip component does not comprise subtitles and only comprises voice, converting the voice information of the video clip into text information, and taking the video clip, the voice information corresponding to the video clip and the text information converted by the language information as the note content of the marked video clip.
And if the video segment marked by the video clip component comprises the subtitles, judging whether the video segment is a video segment of the first language. If the video clip is a first language video clip, acquiring first language subtitle information of the video clip and second language subtitle information of the video clip. And then taking the video clip, the first language subtitle information and the second language subtitle information as note content.
As an example, the first language and the second language may be languages preset by a user. In order to meet the requirements of users and facilitate the learning of the users, for the learning materials of the first language, the subtitle information of two different languages, namely the subtitle information of the first language and the subtitle information of the second language, is provided for the users.
If the video segment includes the first language subtitle information but does not include the second language subtitle information, the second language subtitle information corresponding to the first language subtitle information may be obtained from a preset database.
Similarly, if the video segment includes the second language subtitle information but does not include the first language subtitle information, the first language subtitle information corresponding to the second language subtitle information may be obtained from a preset database.
If the video segment includes the subtitle in the first language and the subtitle in the second language, the subtitle information in the first language and the subtitle information in the second language of the video segment can be directly analyzed from the video segment.
And if the marked video clip is not the first language video clip, directly acquiring the subtitle information and the voice information of the video clip, and taking the video clip, the subtitle information and the voice information as the note content.
In other examples, referring to fig. 2, the first language is a non-native language, i.e., the first language is a foreign language and the second language is a native language. As an example, whether the marked video clip is a foreign language video clip can be determined according to the voice, the subtitle and the native language of the user in the video clip. The native language of the user can be judged according to the reading habit and the typing habit of the user.
As an example, if the pronunciation of the tagged video clip is different from the pronunciation of the native language, or the language type of the caption is different from the language type of the native language, the video clip can be determined as the "foreign language type" learning material.
In some embodiments of the present invention, in order to facilitate the backtracking learning of the user, when it is determined that the marked key video clip is a foreign language video clip, the foreign language subtitles and the native language subtitles of the video clip need to be recorded, so as to facilitate the backtracking learning of the user.
Therefore, if the marked video clip is a foreign language video clip, the native language caption information of the foreign language video clip and the foreign language caption information of the foreign language video clip are obtained. And then taking the video clip, the foreign language subtitle information and the native language subtitle information as the note content of the foreign language video clip.
In some embodiments of the present invention, the marked foreign language video clip may not include the native language subtitles, and therefore, when the marked highlight video clip is determined as the foreign language video clip, it is further required to determine whether the subtitles of the foreign language video clip include the subtitles of the native language and the foreign language.
And if the subtitle of the foreign language video clip only comprises the foreign language subtitle and does not comprise the mother language subtitle, acquiring the foreign language subtitle information of the foreign language video clip as the note content. And then, obtaining the native language subtitle information corresponding to the foreign language subtitle information from a preset database to be used as note content.
That is, if the marked foreign language video clip does not have the cross-reference caption of the mother language and the foreign language and only includes the foreign language caption, the mother language caption information corresponding to the foreign language caption information of the video clip is obtained from the big data, and both the mother language caption information and the foreign language caption information are used as the note content.
Similarly, if the marked foreign language video clip only comprises the native language subtitle, the foreign language subtitle information corresponding to the native language subtitle information of the video clip is obtained from the big data, and the video clip, the native language subtitle information of the video clip and the foreign language subtitle information are all used as the note content.
If the subtitle of the foreign language video clip comprises the contrast subtitle of the native language and the foreign language, directly acquiring all subtitle information of the foreign language video clip, and taking the video clip and all subtitle information of the video clip as the note content.
In the embodiment of the invention, if the marked video clip is not a foreign language video clip, the voice information and the subtitle information of the foreign language video clip are acquired, and the foreign language video clip, the voice information of the foreign language video clip and the subtitle information are taken as the note content.
In the embodiment of the invention, the native language subtitle information and the foreign language subtitle information of the foreign language learning video material are both used as the note content, so that the user can more conveniently review the video material, and the good experience of the user is improved.
In some embodiments of the invention, it may also be determined whether the video clip tagged by the video clip component includes blackboard-writing information prior to displaying the note content of the tagged video clip. The blackboard writing information is a general term of teaching information which is presented by teaching tools in a way of condensing and concise characters, symbols, diagrams and the like in order to help students understand and master knowledge in the teaching process. For example, the blackboard writing information in the video clip can be teaching information presented by a teacher on a blackboard or multimedia courseware in the video clip.
If the video clip comprises the blackboard-writing information, an option of judging whether the blackboard-writing information is intercepted or not is provided on the first screen, so that a user can determine whether the blackboard-writing information is intercepted or not according to the requirement of the user.
And if the user selects the option of intercepting the blackboard writing information, taking the intercepted blackboard writing information as the note content.
In the embodiment of the invention, the option of intercepting the blackboard writing information is provided, so that the user can determine the note content according to the requirement of the user, and the good experience of the user is improved.
In some embodiments of the present invention, when the user views the recorded note content on the second screen, a marker may be set to the note content according to his or her own needs. Wherein the markers are used to characterize the importance of the note content.
The method comprises the steps of firstly obtaining the position of a video clip in each note content in original video data, and then setting a marker of the note content at the playing position of the video clip in each note content on a playing progress bar of the video data, so that a user can conveniently view the note content with emphasis according to the marker when playing the video.
It should be noted that the mark made by the video clip component refers to a mark of the user for the start position of the video segment and a mark of the end position of the video segment. Note content refers to content such as voice information, subtitle information, and video information of a video clip marked by a video clip component.
As shown in fig. 3, on the second screen, the user marks different highlight note contents with different markers. On the first screen, corresponding markers are set at positions of the original video material for notes corresponding to the important note content, so that a user can conveniently view the notes with emphasis.
(II) the multimedia data is non-video data
In an embodiment of the present invention, if the multimedia data is non-video data, the marking component is a brush component. The mode of taking notes with a pen in the real life is simulated, and a 'drawing coincident point pen' is provided for a user. The user can select a "re-click pen" to mark a line of emphasis under the text, or to frame a picture.
The key lines drawn by the painting brush assembly or the frames drawn on the pictures are marked by the painting brush assembly.
And then, the background acquires the character information and the picture information corresponding to the marks made by the brush assembly, and takes the character information and the picture information as note content. And finally, displaying the note content on a second screen according to a preset template.
In an embodiment of the invention, the note content further includes a link of the note corresponding to the note content, and the link points to the position of the video clip in the note content in the multimedia material. As an example, if the user sets the start point and the end point of the intercepted video segment through the video clip component to mark the video material, the link corresponding to the note content of the video segment points to the playing position of the start point in the original video material. As another example, if the user marks a highlight line on the non-video material through the brush component to take a note of the non-video material, the link corresponding to the note points to the position of the highlight line in the original non-video material.
In an embodiment of the present invention, after the user stops marking with the marking element, the marked multimedia material slides from the first screen to the second screen. In actual processing, after the background receives the marks made by the user through the marking component, the key content marked by the user is automatically captured. And then, the background typesets the note content according to different data classifications and a template mode defined by a user.
As an example, fig. 4 illustrates a note template of a language class video displayed on the second screen. As shown in fig. 4, the note template of the language video includes the content of a tag, a foreign language caption, a native language caption, voice information, a link of the note to the original video material, a marked video clip, a summary thank you, and a blocking bar. And the user can also drag or edit the small units in the typesetting.
As another example, FIG. 5 is a non-video class note template. As shown in fig. 5, the non-video note template includes note labels, marked texts, and pictures corresponding to the texts. As a specific example, the note label is yang-brightness, the left side of the note is the text explanation of yang-brightness, and the right side is the schematic diagram of yang-brightness.
The embodiment of the invention fully utilizes the advantages of two screens of the terminal, and on one hand, the first screen is used for displaying multimedia data; and on the other hand, the position of the user considered to be the key point in the multimedia data is circled to be recorded as a note, the part of the data considered to be the key point or worth to be reviewed by the user is circled to the second screen, information such as screen text information and voice information in the data is automatically acquired to form a note effect, and note content is displayed on the second screen. Meanwhile, the positions of the notes in the original multimedia data are marked to form links, so that the following backtracking learning is facilitated.
The note display method provided by the embodiment of the invention realizes the simultaneous operation of multiple applications, simultaneously displays note contents such as text information, voice information, picture information and the like of marked key data on the second screen while the first screen plays multimedia data, provides a simple and effective note reading mode in multimedia learning, and improves the experience effect of the multimedia learning.
The note display method provided by the embodiment of the invention enables the mode of 'better memorability than rotten pen points' to be more modern, convenient and interesting, not only keeps the note mode of the traditional note, but also combines the advantages of the modern technology, and enables learning to be more convenient, convenient and interesting.
Corresponding to the method of the embodiment of the invention, the invention also provides a note display device. FIG. 6 illustrates a schematic structural diagram of a note display apparatus provided by some embodiments of the present invention. The note display device provided by the embodiment of the invention is applied to a terminal, the terminal comprises a first screen and a second screen, and the device comprises:
the multimedia data display module 610 is configured to display multimedia data on the first screen.
And a marking component displaying module 620, configured to display a marking component on the first screen after receiving the marking instruction, where the marking component is used to mark the multimedia data.
A note content determining module 630, configured to determine note content according to the content marked by the marking component.
And a note content display module 640 for displaying note content on the second screen.
In an embodiment of the present invention, the note display device further includes a marking component type determining module, and the marking component type determining module is configured to:
judging whether the multimedia data are video data or not, and determining the type of the note component according to the judgment result;
if the multimedia data is video data, the marking component is a video clipping component.
In an embodiment of the present invention, the note content determining module 630 is specifically configured to:
judging whether the video clip marked by the video clip component comprises subtitles or not;
if the video clip comprises the subtitle, judging whether the video clip is a first language video clip;
if the video clip is a first language video clip, acquiring first language subtitle information of the video clip and second language subtitle information of the video clip;
and taking the video clip, the first language subtitle information and the second language subtitle information as note content.
In an embodiment of the present invention, the note content determining module 630 is specifically configured to:
and if the video clip comprises the first language subtitle information and the video clip does not comprise the second language subtitle information, acquiring the second language subtitle information corresponding to the first language subtitle information from a preset database.
In an embodiment of the present invention, the note content determining module 630 is further configured to:
if the video clip does not comprise the caption, converting the voice information of the video clip into character information;
and taking the video clip, the voice information and the text information as note content.
In an embodiment of the present invention, the note display device further includes a blackboard-writing information providing module, the blackboard-writing information providing module is configured to:
judging whether the video clips marked by the video clipping component comprise blackboard writing information or not;
and if the video clip comprises the blackboard-writing information, providing an option of judging whether the blackboard-writing information is intercepted or not on the first screen.
According to the note display device provided by the embodiment of the invention, the multimedia learning materials are displayed on the first screen of the terminal, and the made note contents are simultaneously displayed on the second screen, so that the simultaneous operation of multiple applications is realized, a user can record and watch notes at any time while learning the multimedia materials, and the convenience of learning is improved.
An embodiment of the present invention further provides a terminal, where the terminal includes:
a memory for storing a program;
a processor for executing the program stored in the memory to perform the steps of the note display method according to the embodiment of the present invention, wherein the method includes: displaying multimedia data on a first screen; after receiving the marking instruction, displaying a marking component on a first screen, wherein the marking component is used for marking the multimedia data; determining note content from the content marked by the marking component; displaying the note content on the second screen.
The terminal provided by the embodiment of the present invention can implement each process in the method embodiments of fig. 1 to fig. 5, and is not described here again to avoid repetition. According to the embodiment of the invention, the multimedia learning materials are displayed on the first screen of the terminal, and the made note contents are simultaneously displayed on the second screen, so that simultaneous operation of multiple applications is realized, a user can record and watch notes at any time while learning the multimedia materials, and the learning convenience is improved.
Figure 7 is a schematic diagram of a hardware configuration of a mobile terminal implementing various embodiments of the present invention,
the mobile terminal 700 includes, but is not limited to: a radio frequency unit 701, a network module 702, an audio output unit 703, an input unit 704, a sensor 705, a display unit 706, a user input unit 707, an interface unit 708, a memory 709, a processor 710, a power supply 711, and the like. The mobile terminal 700 further includes a first screen and a second screen. Those skilled in the art will appreciate that the mobile terminal architecture shown in fig. 7 is not intended to be limiting of mobile terminals, and that a mobile terminal may include more or fewer components than shown, or some components may be combined, or a different arrangement of components. In the embodiment of the present invention, the mobile terminal includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal, a wearable device, a pedometer, and the like.
The processor 710 is configured to display multimedia data on a first screen; after receiving the marking instruction, displaying a marking component on a first screen, wherein the marking component is used for marking the multimedia data; determining note content from the content marked by the marking component; displaying the note content on the second screen.
According to the embodiment of the invention, the multimedia learning materials are displayed on the first screen of the terminal, and the note contents are simultaneously displayed on the second screen, so that simultaneous operation of multiple applications is realized, a user can watch notes at any time while learning the multimedia materials, and the learning convenience is improved.
It should be understood that, in the embodiment of the present invention, the radio frequency unit 701 may be used for receiving and sending signals during a message transmission and reception process or a call process, and specifically, receives downlink data from a base station and then processes the received downlink data to the processor 710; in addition, the uplink data is transmitted to the base station. In general, radio frequency unit 701 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 701 may also communicate with a network and other devices through a wireless communication system.
The mobile terminal provides the user with wireless broadband internet access via the network module 702, such as helping the user send and receive e-mails, browse web pages, and access streaming media.
The audio output unit 703 may convert audio data received by the radio frequency unit 701 or the network module 702 or stored in the memory 709 into an audio signal and output as sound. Also, the audio output unit 703 may also provide audio output related to a specific function performed by the mobile terminal 700 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 703 includes a speaker, a buzzer, a receiver, and the like.
The input unit 704 is used to receive audio or video signals. The input Unit 704 may include a Graphics Processing Unit (GPU) 7041 and a microphone 7042, and the Graphics processor 7041 processes image data of a still picture or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 706. The image frames processed by the graphic processor 7041 may be stored in the memory 709 (or other storage medium) or transmitted via the radio unit 701 or the network module 702. The microphone 7042 may receive sounds and may be capable of processing such sounds into audio data. The processed audio data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 701 in case of a phone call mode.
The mobile terminal 700 also includes at least one sensor 705, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor that can adjust the brightness of the display panel 7061 according to the brightness of ambient light, and a proximity sensor that can turn off the display panel 7061 and/or a backlight when the mobile terminal 700 is moved to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of the mobile terminal (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), and vibration identification related functions (such as pedometer, tapping); the sensors 705 may also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., which are not described in detail herein.
The display unit 706 is used to display information input by the user or information provided to the user. The Display unit 706 may include a Display panel 7061, and the Display panel 7061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.
The user input unit 707 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the mobile terminal. Specifically, the user input unit 707 includes a touch panel 7071 and other input devices 7072. The touch panel 7071, also referred to as a touch screen, may collect touch operations by a user on or near the touch panel 7071 (e.g., operations by a user on or near the touch panel 7071 using a finger, a stylus, or any other suitable object or attachment). The touch panel 7071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 710, receives a command from the processor 710, and executes the command. In addition, the touch panel 7071 can be implemented by various types such as resistive, capacitive, infrared, and surface acoustic wave. The user input unit 707 may include other input devices 7072 in addition to the touch panel 7071. In particular, the other input devices 7072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described herein again.
Further, the touch panel 7071 may be overlaid on the display panel 7061, and when the touch panel 7071 detects a touch operation on or near the touch panel 7071, the touch operation is transmitted to the processor 710 to determine the type of the touch event, and then the processor 710 provides a corresponding visual output on the display panel 7061 according to the type of the touch event. Although the touch panel 7071 and the display panel 7061 are shown in fig. 7 as two separate components to implement the input and output functions of the mobile terminal, in some embodiments, the touch panel 7071 and the display panel 7061 may be integrated to implement the input and output functions of the mobile terminal, which is not limited herein.
The interface unit 708 is an interface through which an external device is connected to the mobile terminal 700. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 708 may be used to receive input (e.g., data information, power, etc.) from external devices and transmit the received input to one or more elements within the mobile terminal 700 or may be used to transmit data between the mobile terminal 700 and external devices.
The memory 709 may be used to store software programs as well as various data. The memory 709 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 709 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
The processor 710 is a control center of the mobile terminal, connects various parts of the entire mobile terminal using various interfaces and lines, and performs various functions of the mobile terminal and processes data by operating or executing software programs and/or modules stored in the memory 709 and calling data stored in the memory 709, thereby integrally monitoring the mobile terminal. Processor 710 may include one or more processing units; preferably, the processor 710 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 710.
The mobile terminal 700 may also include a power supply 711 (e.g., a battery) for powering the various components, and the power supply 711 may be logically coupled to the processor 710 via a power management system that may enable managing charging, discharging, and power consumption by the power management system.
In addition, the mobile terminal 700 includes some functional modules that are not shown, and thus will not be described in detail herein.
Preferably, an embodiment of the present invention further provides a mobile terminal, where the terminal includes a first screen and a second screen, and further includes a processor 710, a memory 709, and a computer program stored in the memory 709 and capable of running on the processor 710, where the computer program, when executed by the processor 710, implements each process of the above-mentioned note display method embodiment, and can achieve the same technical effect, and is not described herein again to avoid repetition.
The embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements each process of the embodiment of the note display method, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.
Claims (9)
1. A note display method is applied to a terminal, and is characterized in that the terminal comprises a first screen and a second screen, and the method comprises the following steps:
displaying multimedia data on the first screen;
after receiving a marking instruction, displaying a marking component on the first screen, wherein the marking component is used for marking the multimedia material;
determining note content from the content tagged by the tagging component;
displaying the note content on the second screen;
if the multimedia data is video data, the marking component is a video clipping component; the determining note content from content tagged by the tagging component comprises:
determining whether subtitles are included in the video segments marked by the video clip component;
if the video clip comprises the subtitles, judging whether the video clip is a first language video clip;
if the video clip is the first language video clip, acquiring first language subtitle information of the video clip and second language subtitle information of the video clip;
taking the video clip, the first language subtitle information and the second language subtitle information as the note content;
the first language subtitle information is foreign language subtitle information, and the second language subtitle information is native language subtitle information;
the displaying the note content on the second screen includes:
typesetting the note content according to the type of the multimedia data and a preset template;
and displaying the typeset note content on the second screen.
2. The method of claim 1, wherein after receiving the marking instruction, prior to displaying a marking component on the first screen, the method further comprises:
judging whether the multimedia data is video data or not, and determining the type of the marking component according to the judgment result.
3. The method of claim 1, wherein said obtaining caption information in a first language of said video segment and caption information in a second language of said video segment if said video segment is said video segment in said first language comprises:
and if the video clip comprises the first language subtitle information and the video clip does not comprise the second language subtitle information, acquiring the second language subtitle information corresponding to the first language subtitle information from a preset database.
4. The method of claim 1, further comprising:
if the video clip does not comprise the caption, converting the voice information of the video clip into character information;
and taking the video clip, the voice information and the text information as the note content.
5. The method of claim 1, wherein after determining note content from content tagged by the tagging component, prior to displaying the note content on the second screen, the method further comprises:
determining whether the video clip marked by the video clip component includes blackboard writing information;
and if the video clip comprises the blackboard writing information, providing an option whether to intercept the blackboard writing information on the first screen.
6. An apparatus for displaying notes, applied to a terminal, the terminal comprising a first screen and a second screen, the apparatus comprising:
the multimedia data display module is used for displaying multimedia data on the first screen;
the marking component display module is used for displaying a marking component on the first screen after receiving a marking instruction, and the marking component is used for marking the multimedia data;
a note content determination module for determining note content according to the content marked by the marking component;
a note content display module for displaying the note content on the second screen;
if the multimedia data is video data, the marking component is a video clipping component; the note content determination module is specifically configured to:
determining whether subtitles are included in the video segments marked by the video clip component;
if the video clip comprises the subtitles, judging whether the video clip is a first language video clip;
if the video clip is the first language video clip, acquiring first language subtitle information of the video clip and second language subtitle information of the video clip;
taking the video clip, the first language subtitle information and the second language subtitle information as the note content;
the first language subtitle information is foreign language subtitle information, and the second language subtitle information is native language subtitle information;
the note content display module is also used for typesetting the note content according to the type of the multimedia data and a preset template;
and displaying the typeset note content on the second screen.
7. The apparatus of claim 6, further comprising a marking element type determining module for determining whether the multimedia material is a video material and determining the type of the marking element according to the determination result.
8. A terminal, characterized in that the terminal comprises a first screen and a second screen, the terminal further comprising a processor, a memory and a computer program stored on the memory and executable on the processor, the computer program, when executed by the processor, implementing the steps of the note display method according to any one of claims 1 to 5.
9. A computer storage medium, characterized in that a computer program is stored on the computer readable storage medium, which computer program, when being executed by a processor, carries out the steps of the note display method according to any one of claims 1 to 5.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910228159.1A CN110083319B (en) | 2019-03-25 | 2019-03-25 | Note display method, device, terminal and storage medium |
| PCT/CN2020/078201 WO2020192394A1 (en) | 2019-03-25 | 2020-03-06 | Note displaying method and device, terminal, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910228159.1A CN110083319B (en) | 2019-03-25 | 2019-03-25 | Note display method, device, terminal and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110083319A CN110083319A (en) | 2019-08-02 |
| CN110083319B true CN110083319B (en) | 2021-07-16 |
Family
ID=67413493
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910228159.1A Active CN110083319B (en) | 2019-03-25 | 2019-03-25 | Note display method, device, terminal and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN110083319B (en) |
| WO (1) | WO2020192394A1 (en) |
Families Citing this family (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20200078932A (en) | 2018-12-24 | 2020-07-02 | 삼성전자주식회사 | Electronic device and controlling method of electronic device |
| CN110083319B (en) * | 2019-03-25 | 2021-07-16 | 维沃移动通信有限公司 | Note display method, device, terminal and storage medium |
| CN111556371A (en) * | 2020-05-20 | 2020-08-18 | 维沃移动通信有限公司 | Note recording method and electronic equipment |
| CN111723816B (en) * | 2020-06-28 | 2023-10-27 | 北京联想软件有限公司 | Acquisition method of teaching notes and electronic equipment |
| CN111859856A (en) * | 2020-06-30 | 2020-10-30 | 维沃移动通信有限公司 | Information display method and device, electronic equipment and storage medium |
| CN111858686A (en) * | 2020-07-08 | 2020-10-30 | 深圳市富途网络科技有限公司 | Data display method and device, terminal equipment and storage medium |
| CN112087656B (en) * | 2020-09-08 | 2022-10-04 | 远光软件股份有限公司 | Online note generation method and device and electronic equipment |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104703055A (en) * | 2015-03-13 | 2015-06-10 | 天脉聚源（北京）教育科技有限公司 | Locating method and device of video playing |
| CN106445144A (en) * | 2016-09-27 | 2017-02-22 | 宇龙计算机通信科技(深圳)有限公司 | Note taking method, device and terminal |
| CN107066619A (en) * | 2017-05-10 | 2017-08-18 | 广州视源电子科技股份有限公司 | User's notes generation method, device and terminal based on multimedia resource |
| CN107451139A (en) * | 2016-05-30 | 2017-12-08 | 北京三星通信技术研究有限公司 | File resource methods of exhibiting, device and corresponding smart machine |
| CN107992455A (en) * | 2017-10-31 | 2018-05-04 | 努比亚技术有限公司 | A kind of text handling method, terminal and computer-readable recording medium |
| CN108197286A (en) * | 2018-01-16 | 2018-06-22 | 维沃移动通信有限公司 | A kind of method for information display and mobile terminal |
| CN108646994A (en) * | 2018-03-28 | 2018-10-12 | 广东欧珀移动通信有限公司 | Information processing method, device, mobile terminal and storage medium |
| CN108762640A (en) * | 2018-05-28 | 2018-11-06 | 维沃移动通信有限公司 | A kind of display methods and terminal of barrage information |
| CN109462692A (en) * | 2018-10-29 | 2019-03-12 | 努比亚技术有限公司 | Split screen display available operating method, mobile terminal and computer readable storage medium |
Family Cites Families (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4815962B2 (en) * | 2005-09-12 | 2011-11-16 | ソニー株式会社 | REPRODUCTION DEVICE AND REPRODUCTION METHOD, PROGRAM, AND PROGRAM STORAGE MEDIUM |
| CN101502104A (en) * | 2006-06-30 | 2009-08-05 | 索尼株式会社 | Information processing device, information processing method, recording medium, and program |
| CN101924863A (en) * | 2010-05-21 | 2010-12-22 | 中山大学 | Digital television equipment |
| CN102347044B (en) * | 2011-05-20 | 2014-01-22 | 合一网络技术(北京)有限公司 | Synchronous displaying and control method used in embedded media player, system and equipment thereof |
| US9066145B2 (en) * | 2011-06-30 | 2015-06-23 | Hulu, LLC | Commenting correlated to temporal point of video data |
| WO2013006002A2 (en) * | 2011-07-06 | 2013-01-10 | (주)터치엔 | Digital-based knowledge information card, and method, system, and computer-readable recording medium for generating the card, and method for generating a cardbook using the digital-based knowledge information card |
| US20140033040A1 (en) * | 2012-07-24 | 2014-01-30 | Apple Inc. | Portable device with capability for note taking while outputting content |
| US20150206447A1 (en) * | 2014-01-23 | 2015-07-23 | Zyante, Inc. | System and method for authoring content for web viewable textbook data object |
| JP6320982B2 (en) * | 2014-11-26 | 2018-05-09 | ネイバー コーポレーションＮＡＶＥＲ Ｃｏｒｐｏｒａｔｉｏｎ | Translated sentence editor providing apparatus and translated sentence editor providing method |
| CN104795082B (en) * | 2015-03-26 | 2019-06-21 | 广州酷狗计算机科技有限公司 | Audio caption presentation method, device and player |
| CN105681890A (en) * | 2016-01-26 | 2016-06-15 | 广东欧珀移动通信有限公司 | Caption display method and device for video playing terminal |
| CN107203498A (en) * | 2016-03-18 | 2017-09-26 | 北京京东尚科信息技术有限公司 | A kind of method, system and its user terminal and server for creating e-book |
| CN105912192A (en) * | 2016-03-31 | 2016-08-31 | 联想(北京)有限公司 | Display control method and electronic equipment |
| CN207410451U (en) * | 2017-09-26 | 2018-05-25 | 贵州格林耐特科技股份有限公司 | A kind of interactive Internet teaching VOD system |
| CN108121987B (en) * | 2018-01-02 | 2022-04-22 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| CN110083319B (en) * | 2019-03-25 | 2021-07-16 | 维沃移动通信有限公司 | Note display method, device, terminal and storage medium |
| CN110032350A (en) * | 2019-04-16 | 2019-07-19 | 维沃移动通信有限公司 | A kind of information processing method and terminal |
-
2019
- 2019-03-25 CN CN201910228159.1A patent/CN110083319B/en active Active
-
2020
- 2020-03-06 WO PCT/CN2020/078201 patent/WO2020192394A1/en active Application Filing
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104703055A (en) * | 2015-03-13 | 2015-06-10 | 天脉聚源（北京）教育科技有限公司 | Locating method and device of video playing |
| CN107451139A (en) * | 2016-05-30 | 2017-12-08 | 北京三星通信技术研究有限公司 | File resource methods of exhibiting, device and corresponding smart machine |
| CN106445144A (en) * | 2016-09-27 | 2017-02-22 | 宇龙计算机通信科技(深圳)有限公司 | Note taking method, device and terminal |
| CN107066619A (en) * | 2017-05-10 | 2017-08-18 | 广州视源电子科技股份有限公司 | User's notes generation method, device and terminal based on multimedia resource |
| CN107992455A (en) * | 2017-10-31 | 2018-05-04 | 努比亚技术有限公司 | A kind of text handling method, terminal and computer-readable recording medium |
| CN108197286A (en) * | 2018-01-16 | 2018-06-22 | 维沃移动通信有限公司 | A kind of method for information display and mobile terminal |
| CN108646994A (en) * | 2018-03-28 | 2018-10-12 | 广东欧珀移动通信有限公司 | Information processing method, device, mobile terminal and storage medium |
| CN108762640A (en) * | 2018-05-28 | 2018-11-06 | 维沃移动通信有限公司 | A kind of display methods and terminal of barrage information |
| CN109462692A (en) * | 2018-10-29 | 2019-03-12 | 努比亚技术有限公司 | Split screen display available operating method, mobile terminal and computer readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110083319A (en) | 2019-08-02 |
| WO2020192394A1 (en) | 2020-10-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110083319B (en) | Note display method, device, terminal and storage medium | |
| CN108090855B (en) | Learning plan recommendation method and mobile terminal | |
| WO2021233293A1 (en) | Note recording method and electronic device | |
| CN110557565B (en) | Video processing method and mobile terminal | |
| CN109857905B (en) | Video editing method and terminal equipment | |
| CN110830362B (en) | Content generation method and mobile terminal | |
| US20090251338A1 (en) | Ink Tags In A Smart Pen Computing System | |
| CN111010610B (en) | Video screenshot method and electronic equipment | |
| CN107943390B (en) | Character copying method and mobile terminal | |
| CN110855893A (en) | Video shooting method and electronic equipment | |
| CN107864353B (en) | A kind of video recording method and mobile terminal | |
| WO2019120192A1 (en) | Method for editing text, and mobile device | |
| CN107358227A (en) | A kind of mark recognition method, mobile terminal and computer-readable recording medium | |
| CN109756626B (en) | Reminding method and mobile terminal | |
| CN111445927B (en) | Audio processing method and electronic equipment | |
| CN110995919B (en) | Message processing method and electronic equipment | |
| CN112652200A (en) | Man-machine interaction system, man-machine interaction method, server, interaction control device and storage medium | |
| CN111372029A (en) | Video display method and device and electronic equipment | |
| CN112312217A (en) | Image editing method and device, computer equipment and storage medium | |
| CN111402367A (en) | Image processing method and electronic equipment | |
| CN108133708B (en) | Voice assistant control method and device and mobile terminal | |
| CN108600079B (en) | Chat record display method and mobile terminal | |
| CN110062281B (en) | Play progress adjusting method and terminal equipment thereof | |
| CN109672845B (en) | Video call method and device and mobile terminal | |
| CN109947988B (en) | Information processing method and device, terminal equipment and server |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |