CN111638835B - Note generation method and electronic equipment - Google Patents
Note generation method and electronic equipment Download PDFInfo
- Publication number
- CN111638835B CN111638835B CN202010352542.0A CN202010352542A CN111638835B CN 111638835 B CN111638835 B CN 111638835B CN 202010352542 A CN202010352542 A CN 202010352542A CN 111638835 B CN111638835 B CN 111638835B
- Authority
- CN
- China
- Prior art keywords
- note
- content
- user
- display screen
- display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04842—Selection of displayed objects or displayed text elements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/103—Formatting, i.e. changing of presentation of documents
- G06F40/106—Display of layout of documents; Previewing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/103—Formatting, i.e. changing of presentation of documents
- G06F40/117—Tagging; Marking up; Designating a block; Setting of attributes
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Health & Medical Sciences (AREA)
- Artificial Intelligence (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Computational Linguistics (AREA)
- General Health & Medical Sciences (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention provides a note generation method and electronic equipment, comprising the following steps: receiving a note input by a user in a case where the first content is displayed; determining second content from the first content according to the sight of the user in the note input process; according to the method and the device, the user can determine the second content corresponding to the note in the first content of the display screen according to the sight of the user in the process of inputting the note, and establish the association between the note and the second content, so that the content in the electronic book corresponding to the note added by the user can be quickly and conveniently determined according to the sight of the user, the efficiency of the note adding process of the user is improved, meanwhile, due to the fact that the association exists between the note and the second content, when the user inquires the generated note, the electronic book content associated with the note can be quickly determined from the electronic book, and the reading experience of the user is improved.
Description
Technical Field
The embodiment of the invention relates to the technical field of terminals, in particular to a note generation method and electronic equipment.
Background
With the rapid development of electronic devices and the extensive development and popularization of electronic reading applications, the reading mode of people has been gradually changed from the traditional paper book to the electronic book read in the electronic devices.
In the process of reading an electronic book by using an electronic device, a user often needs to label or add notes to a specific segment in the electronic book and collect the generated notes so as to review the book at a later date.
However, in the current solution, the user needs to manually select the content part of the electronic book to which the label or note needs to be added, which is cumbersome and time-consuming.
Disclosure of Invention
The embodiment of the invention provides a note generation method and electronic equipment, and aims to solve the problems that in the prior art, a user has complex operation and long time consumption in the process of adding notes to an electronic book.
In a first aspect, an embodiment of the present invention provides a method for generating a note, where the method includes:
receiving a note input by a user in a case where the first content is displayed;
determining second content from the first content according to the line of sight of the user in the process of inputting the note;
and establishing an incidence relation between the second content and the note.
In a second aspect, an embodiment of the present invention provides an electronic device, where the electronic device includes:
the receiving module is used for receiving notes input by a user under the condition that the first content is displayed;
the first determination module is used for determining second content from the first content according to the sight of the user in the note inputting process;
and the association module is used for establishing the association relationship between the second content and the note.
In a third aspect, an embodiment of the present invention further provides an electronic device, which includes a processor, a memory, and a computer program stored on the memory and executable on the processor, where the computer program, when executed by the processor, implements the steps of the method for generating a note provided by the present invention.
In a fourth aspect, the embodiments of the present invention further provide a readable storage medium, where instructions in the storage medium, when executed by a processor of an electronic device, enable the electronic device to perform the steps of the method for generating a note provided by the present invention.
In the embodiment of the invention, under the condition that the first content is displayed, a note input by a user is received; determining second content from the first content according to the sight of the user in the note input process; according to the method and the device, the user can determine the second content corresponding to the note in the first content of the display screen according to the sight of the user in the process of inputting the note, and establish the association between the note and the second content, so that the content in the electronic book corresponding to the note added by the user can be quickly and conveniently determined according to the sight of the user, the efficiency of the note adding process of the user is improved, meanwhile, due to the fact that the association exists between the note and the second content, when the user inquires the generated note, the electronic book content associated with the note can be quickly determined from the electronic book, and the reading experience of the user is improved.
The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.
Drawings
FIG. 1 is a flowchart illustrating steps of a method for generating a note according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating steps of another note generation method according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of a target movement trajectory of a line of sight according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the present invention;
FIG. 5 is a schematic diagram of an embodiment of a marker tag provided herein;
FIG. 6 is a schematic diagram illustrating a note list of an electronic book according to an embodiment of the present invention;
FIG. 7 is a schematic diagram illustrating a note list of another electronic book according to an embodiment of the present invention;
FIG. 8 is a diagram illustrating a trigger show operation according to an embodiment of the present invention;
FIG. 9 is a block diagram of an electronic device provided by an embodiment of the invention;
fig. 10 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present invention.
Detailed Description
Exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the invention are shown in the drawings, it should be understood that the invention can be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art.
Fig. 1 is a flowchart of steps of a note generation method provided in an embodiment of the present invention, and as shown in fig. 1, the method may include:
and 101, receiving a note input by a user under the condition that the first content is displayed.
In this step, in the case where the first content is displayed in the display screen, a note input by the user may be received.
In the embodiment of the present invention, when a user uses the electronic device to read an electronic book, the content of the electronic book opened by the user is displayed in the screen of the electronic device, that is, the first content. The first content may be rich text including text content, pictures, audio and video, or may be plain text containing only text content. In addition, the electronic device can not only display the content of the electronic book, but also display the rich text content of the third-party information application such as a note, a notepad, a browser and the like, so that the user can add, store and inquire notes in the rich text content of the third-party information application such as the note, the notepad, the browser and the like.
Correspondingly, the note can include: any one or more of image information input by a user, text information input by a user, and text segment information selected by a user from the first content.
Specifically, the electronic device may receive a note adding operation of the user on the display screen through a user input unit disposed in the display screen, including a note adding operation of the user on the display screen by using any suitable object or accessory such as a finger or a stylus pen, so as to obtain a note input by the user.
The note adding operation comprises operations of doodling, drawing, selecting, adding a read-after feeling and the like of first content displayed in the display screen, namely a user can input image information for the first content displayed in the display screen, for example, a doodle image or a drawing image is input, and a corresponding note is the image information input by the user; when the note adding operation is that a user inputs a read feeling, a memo or a comment text aiming at the first content displayed in the display screen, the corresponding note is the text information input by the user; the user can also select the interesting text segment from the first content displayed in the display screen, and the corresponding note is the text segment information selected by the user from the first content.
And 102, determining second content from the first content according to the sight of the user in the note inputting process.
In the embodiment of the present invention, when a user uses an electronic device to read an electronic book, what is shown in a screen of the electronic device is content of the electronic book opened by the user, that is, the first content, which may be rich text including text content, pictures, audio, and video, or plain text including only text content. Correspondingly, the second content can be partial text content, pictures, audio and video selected by the user in the display screen.
In this step, second content may be determined from the first content according to the user's line of sight during the entry of the note.
In one implementation, a user may select a text segment from a first content displayed on a display screen by using a gaze tracking technology of an electronic device, and use the text segment as a second content, specifically, the electronic device may detect a gaze direction of the user in real time by using a camera device disposed in the electronic device, and determine a position of a gaze of the user in the display screen in real time according to the gaze direction of the user and the position of the display screen, so as to track the gaze of the user, determine a movement track of the gaze of the user in the display screen, further, if it is detected that a time that the gaze of the user stays on a certain text segment in the display screen exceeds a preset time or a number of times that the gaze of the user browses a certain text segment in the display screen exceeds a preset number of times according to the movement track of the gaze, determine the text segment as a segment that the user is interested in, and selecting the text segment from the first content as second content in the electronic book corresponding to the note added by the user.
In addition, the user may also use a microphone device of the electronic device to select a text segment from the first content displayed on the display screen and use the text segment as the second content, specifically, the electronic device may detect a sound made by the user in real time through the microphone device provided in the electronic device, and if it is detected that a certain text segment in the first content is read by the user, the text segment may be determined to be a segment in which the user is interested, and the text segment may be selected from the first content as the second content in the electronic book corresponding to the note added by the user.
And 103, establishing an association relationship between the second content and the note.
In this step, an association relationship between the second content and the note may be established, so that a correspondence relationship between the note and the second content may be established, so that after the user queries the note, the content in the electronic book corresponding to the note may be directly and quickly determined, or a correspondence relationship between the note and the chapter position where the second content is located may be established, so that after the user queries the note, the chapter position where the content in the electronic book corresponding to the note is located may be quickly located.
In summary, the method for generating a note provided in the embodiment of the present invention includes: receiving a note input by a user in a case where the first content is displayed; determining second content from the first content according to the sight of the user in the note input process; according to the method and the device, the user can determine the second content corresponding to the note in the first content of the display screen according to the sight of the user in the process of inputting the note, and establish the association between the note and the second content, so that the content in the electronic book corresponding to the note added by the user can be quickly and conveniently determined according to the sight of the user, the efficiency of the note adding process of the user is improved, meanwhile, due to the fact that the association exists between the note and the second content, when the user inquires the generated note, the electronic book content associated with the note can be quickly determined from the electronic book, and the reading experience of the user is improved.
Fig. 2 is a flowchart of steps of another note generation method provided in an embodiment of the present invention, and as shown in fig. 2, the method may include:
The implementation of this step is similar to the implementation of step 101 described above.
In this step, the electronic device may detect, in real time, a line of sight of the user during the process of inputting the note through a camera installed in the electronic device, determine a line of sight direction of the line of sight, and determine, in real time, a line of sight position of the line of sight of the user in the display screen according to a relative position of the line of sight direction of the user and the display screen, so that the line of sight of the user may be tracked, and a movement trajectory of the line of sight of the user in the display screen may be determined.
For example, the following method may be employed to detect the gaze of the user:
(1) pupillary-corneal reflex method: generating corneal reflection by adopting an infrared light source, and estimating the sight line direction by calculating a vector between the pupil center and the corneal reflection;
(2) corneal reflection matrix method: the multi-infrared light source generates a plurality of corneal reflections on the cornea to form a corneal reflection matrix, and the sight line direction is estimated by calculating the corneal reflections and the position characteristics of the pupil center;
(3) direction of ellipse normal: and calculating the normal direction of the iris boundary circle to estimate the sight line direction by recording the high-resolution eye image.
In this step, if it is detected that the moving speed of the gaze position is less than or equal to the first preset speed, it indicates that the user is interested in the part being read when reading the electronic book, and therefore the gaze moving speed of the user is slow, or indicates that the user is interested in the electronic book content corresponding to the note during the process of adding the note, and therefore the gaze moving speed of the user is slow, so that when the moving speed of the gaze position is less than or equal to the first preset speed, the gaze moving trajectory of the user is determined as the target moving trajectory, and further, the second content can be determined from the first content according to the target moving trajectory.
And 204, determining the display content defined by the target movement track as the second content.
In this step, according to the target movement track, the display content defined by the target movement track in the first content displayed on the display screen of the electronic device may be determined, and the display content may be determined as the second content.
Fig. 3 is a schematic diagram of a target movement trajectory of a line of sight according to an embodiment of the present invention, as shown in fig. 3, a curve 80 is the detected target movement trajectory, a movement speed of a line of sight position of a user corresponding to the target movement trajectory is less than or equal to a first preset speed, a display content defined by the target movement trajectory 80 is a partial content in the first content included in the graph 90, and the partial content is determined as a second content.
The implementation of this step is similar to the implementation of step 103 described above.
And step 206, determining a first display screen on which the user is reading in the plurality of display screens according to the sight line.
In the embodiment of the present invention, the electronic device may have a plurality of display screens, that is, the electronic device may have a folding screen, a double-sided screen, a multi-sided screen, a waterfall screen, a surround screen, or a stretched screen, so that in the electronic device, the screen of the electronic device may be conveniently set as the plurality of display screens to respectively display the content and the notes of the electronic book.
In this step, after the note is generated, the note may be displayed in the second display screen on which the user does not perform the reading operation, so that the blocking of the e-book content displayed in the first display screen and being read by the user may be avoided. Therefore, it is first necessary to determine the first display screen on which the user is performing the reading operation among the plurality of display screens of the electronic device.
Specifically, the first display screen on which the user is performing the reading operation may be determined among the plurality of display screens according to the line of sight of the user.
Fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the present invention, and as shown in fig. 4, the electronic device may be a folding-screen electronic device including a first display screen 10 and a second display screen 20, the electronic device includes a processor 30, the processor 30 is in communication connection with the first display screen 10 and the second display screen 20, receives relevant operation information input by a user through the first display screen 10 and the second display screen 20, and controls the first display screen 10 and the second display screen 20 to display corresponding content according to the relevant operation information.
For example, during the process of reading the electronic book by the user using the electronic device, the processor 30 may track the line of sight of the user through a camera installed in the electronic device, determine a display screen on which the user is performing a reading operation at this time according to the line of sight of the user, determine the display screen as the first display screen 10, determine another display screen as the second display screen 20 on which the user is not performing the reading operation at this time, control the first display screen 10 to display the content of the electronic book on which the user is reading, and control the second display screen 20 to display the generated notes.
And step 207, displaying the note in a second display screen different from the first display screen in the plurality of display screens.
In this step, since the first display screen on which the user is performing the reading operation is determined in the above step, among the plurality of display screens of the electronic device, a display screen different from the first display screen is determined as a second display screen on which the user is not performing the reading operation, and the note list is displayed in the second display screen.
Optionally, step 207 specifically includes:
substep 2071, generating a note tag from the note and the second content.
In this step, the electronic device may generate a note tag according to the received note and the second content having an association relationship with the note, which is determined by the line of sight of the user.
Specifically, the note tag may be a floating frame displayed in the display screen, where the note and the corresponding second content are recorded in the floating frame, fig. 5 is a schematic diagram of a note tag according to an embodiment of the present invention, and as shown in fig. 5, the note tag 50 is a text fragment in the first display screen 10, that is, the second content: "his heart is full of carelessness, some \245628;" shank uneasiness ", and the" feeling after reading "of input, i.e., the text information" the heart activity delineates the part ", is the resulting note label.
Preferably, the note and the corresponding second content may be partially displayed in the note tag, so that the content of the electronic book displayed in the display screen is prevented from being blocked.
Substep 2072, displaying the note tag in the second display screen.
In this step, the note tag generated in the above step may be displayed in any one of the plurality of display screens except for the first display screen, that is, the note tag is displayed in the second display screen.
Specifically, since the first display screen is a display screen on which the user is performing reading operation, in order to avoid the generated note tag from blocking the content on which the user is performing reading, the note tag may be displayed on any one of the display screens except the first display screen.
For example, referring to fig. 5, the note tag 50 is a tag for the second content in the first display screen that the user is reading, and since the user is reading the content displayed in the first display screen 10 at this time, the note tag may be displayed in the second display screen 20 in order to avoid the note tag 50 from blocking the content that the user is reading.
Preferably, the user may edit the note for the second time in the note tag, or may confirm the content of the note tag by receiving a confirmation operation of the user after obtaining the note tag, where the confirmation operation may be an operation of detecting that the user performs a heading operation by the electronic device, or an operation of detecting that the user presses the note tag for a long time by the electronic device.
And step 208, adding the note tag to a list corresponding to the electronic book to obtain a note list when receiving the storage operation of the note tag.
In this step, when the storage operation for the note tab is received, it indicates that the user needs to store the note tab at this time and store the note tab in the note list.
Wherein the receiving operation may include: and dragging the note label from the display screen where the note label is located to another display screen.
For example, as shown in fig. 5, after the accepting operation 60 selects the note tab 50 for the user's finger, the note tab is dragged from the first display screen 10 to the position of the upper right corner of the second display screen 20.
Preferably, a dynamic effect may be set for the storage operation, so as to improve the experience of the user in the use process, for example, in the process of dragging the note tag 50, a list corresponding to the electronic book created in advance may be displayed in the second display screen 20, the list may include the note tag already added in the list, and the user may drag the note tag 50 to the list, so as to add the note tag 50 to the list, thereby obtaining the note list. In addition, the speed of adding the note tab 50 to the list can be set to be consistent with the dragging speed of the user dragging the note tab 50.
And 209, displaying the note list in the second display screen.
In this step, the generated note list may be presented in the second display screen.
Specifically, the first display screen on which the user is performing the reading operation is determined in the above steps, so that a display screen different from the first display screen among the plurality of display screens of the electronic device is determined as a second display screen on which the user is not performing the reading operation, and the note list is displayed in the second display screen.
Specifically, the process of displaying the note list in the second display screen may be that the note tags included in the note list are displayed in the second display screen according to a preset arrangement rule, so that the user can view the note tags included in the note list.
For example, fig. 6 is a schematic diagram illustrating a note list of an electronic book according to an embodiment of the present invention, as shown in fig. 6, a first display 10 on which a user is performing a reading operation is a display on the left side, so that the note list 70 is displayed on the second display 20, specifically, a plurality of note tags 50 included in the note list 70 are sequentially displayed in a list on the second display 20.
In addition, the content displayed in the note tab 50 may be a note corresponding to the note tab, and when the user clicks the note tab 50, the note recorded in the note tab 50 and the second content corresponding to the note may be displayed; the content displayed in the note tab 50 may also be second content corresponding to the note tab 50, and when the user clicks the note tab 50, the second content recorded in the note tab 50 and a note corresponding to the second content may be displayed.
In the embodiment of the invention, the automatic switching mode of the note tag can be turned on by default, so that the sight line position of the sight line of the user in the display screens is detected in real time, and the display screens for displaying the note list are switched after the fact that the reading operation of the user is transferred from one display screen to another display screen is detected.
For example, fig. 7 is a schematic diagram illustrating another ebook note list according to an embodiment of the present invention, as shown in fig. 6 and 7, the first display 10 of fig. 6 where the user is performing a reading operation is a left display, and therefore, the note list 70 including the plurality of note tags 50 is displayed in the second display 20 on the right, and when it is detected that the display on which the user is performing a reading operation is switched to the right display, that is, after the user finishes reading the ebook content in the left display, and prepares to read the ebook content in the right display, the display position of the ebook reading notes is automatically switched to the display position shown in fig. 7, that is, the first display 10 on which the user is performing a reading operation is switched to the right display, and therefore, the note list 70 including the plurality of note tags 50 is displayed in the second display 20 on the left, therefore, the reading process of the user is not influenced while the note list is displayed in the electronic equipment.
In addition, all the note labels can be controlled to be displayed in the second display screen in a rolling mode along a preset direction at a preset speed.
Specifically, all note tags in the note list can be controlled to be displayed in a rolling mode in the second display screen along the preset direction at the preset speed, and a user can conveniently inquire the note tags.
The preset direction may be from bottom to top in the second display screen or from top to bottom in the second display screen, and the preset speed may be to update the note tags displayed in the second display screen every 1 second.
In the embodiment of the present invention, when it is detected that the user performs a sliding operation in the edge area of the note list, the speed of performing a scroll display on the note tag may be adjusted according to the sliding operation, for example, when the note tag performs a scroll display in the second display screen from top to bottom, if it is detected that the finger or the stylus of the user slides downward in the edge area of the note list, the speed of performing a scroll display on the note tag in the second display screen is increased; and if the condition that the finger or the touch pen of the user slides upwards in the edge area of the note list is detected, slowing down the speed of scrolling and displaying the note label in the second display screen.
In the embodiment of the present invention, the direction of the scroll display of the note tag in the second display screen may also be determined by detecting the gaze position of the user in the second display screen, for example, if it is detected that the movement track of the gaze position of the user is from top to bottom in the second display screen, the direction of the scroll display of the note tag in the second display screen may be determined to be from top to bottom in the second display screen; if the movement track of the sight line position of the user is detected to be from bottom to top in the second display screen, the direction of the rolling display of the note label in the second display screen can be determined to be from bottom to top in the second display screen.
Optionally, before the step of displaying the note list in the second display screen, it may be detected whether a trigger display operation for the note list is received, and in a case that the trigger display operation for the note list is detected, the note list is displayed in the second display screen.
Specifically, the electronic device may receive a trigger display operation of a user on the display screen through a user input unit disposed in the display screen, where the trigger display operation includes a trigger display operation of the user on the display screen by using any suitable object or accessory such as a finger or a stylus, and may also obtain a movement track of the user's sight line in the display screen through an input unit disposed in the display screen, such as a camera, where the trigger display operation may be an operation in which the user's sight line moves along a specific track.
For example, fig. 8 is a schematic diagram of a triggering display operation provided by an embodiment of the present invention, and as shown in fig. 8, the triggering display operation 40 may be an operation in which the line of sight of the user moves along a "Z" shaped path in the display screen quickly, that is, the line of sight of the user may move horizontally along the upper left corner of the first display screen 10 to the upper right corner of the second display screen 20, then move to the lower left corner of the first display screen 10, and then move horizontally to the lower right corner of the second display screen 20.
In summary, the method for generating a note provided in the embodiment of the present invention includes: receiving a note input by a user in a case where the first content is displayed; determining second content from the first content according to the sight of the user in the note input process; according to the method and the device, the user can determine the second content corresponding to the note in the first content of the display screen according to the sight of the user in the process of inputting the note, and establish the association between the note and the second content, so that the content in the electronic book corresponding to the note added by the user can be quickly and conveniently determined according to the sight of the user, the efficiency of the note adding process of the user is improved, meanwhile, due to the fact that the association exists between the note and the second content, when the user inquires the generated note, the electronic book content associated with the note can be quickly determined from the electronic book, and the reading experience of the user is improved.
In addition, a note tag can be generated according to the note and the second content, a note list comprising a plurality of note tags is further obtained, the note tags contained in the note list are arranged in the second display screen according to a preset arrangement rule, and the note list is displayed in a rolling mode at a preset speed along a preset direction, so that a user can conveniently, quickly and accurately inquire the note and the second content recorded in the note tag, which are needed to be checked by the user.
Fig. 9 is a block diagram of an electronic device according to an embodiment of the present invention, and as shown in fig. 9, the electronic device 300 includes:
a receiving module 301, configured to receive a note input by a user in a case where the first content is displayed;
a first determining module 302, configured to determine a second content from the first content according to the line of sight of the user during the note input process;
optionally, the first determining module includes:
the first determining submodule is used for determining the sight line direction of the sight line according to the sight line of the user in the note inputting process, and determining the sight line position of the sight line in the display screen according to the relative position of the sight line direction and the display screen;
the second determining submodule is used for determining the moving track of the sight line position as a target moving track under the condition that the moving speed of the sight line position is less than or equal to a first preset speed;
and the third determining submodule is used for determining the display content defined by the target moving track as the second content.
An association module 303, configured to establish an association relationship between the second content and the note.
Optionally, the electronic device further includes:
the second determining module is used for determining a first display screen on which the user is reading in a plurality of display screens according to the sight;
a first display module to display the note in a second display screen of the plurality of display screens different from the first display screen.
Optionally, the first display module includes:
the generation submodule is used for generating a note label according to the note and the second content;
and the display sub-module is used for displaying the note tag in the second display screen.
Optionally, the electronic device further includes:
the adding module is used for adding the note tag to a list corresponding to the electronic book to obtain a note list under the condition that the storage operation aiming at the note tag is received;
the second display module is used for displaying the note list in the second display screen;
wherein the receiving operation comprises: and dragging the note label from the display screen where the note label is located to another display screen.
In summary, an electronic device provided in an embodiment of the present invention includes: receiving a note input by a user in a case where the first content is displayed; determining second content from the first content according to the sight of the user in the note input process; according to the method and the device, the user can determine the second content corresponding to the note in the first content of the display screen according to the sight of the user in the process of inputting the note, and establish the association between the note and the second content, so that the content in the electronic book corresponding to the note added by the user can be quickly and conveniently determined according to the sight of the user, the efficiency of the note adding process of the user is improved, meanwhile, due to the fact that the association exists between the note and the second content, when the user inquires the generated note, the electronic book content associated with the note can be quickly determined from the electronic book, and the reading experience of the user is improved.
The electronic device provided by the embodiment of the invention can realize each process of the above-mentioned note generation method embodiment, and can achieve the same technical effect, and for avoiding repetition, the details are not repeated here.
Fig. 10 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present invention, and as shown in fig. 10, the electronic device 400 includes, but is not limited to: radio frequency unit 401, network module 402, audio output unit 403, input unit 404, sensor 405, display unit 406, user input unit 407, interface unit 408, memory 409, processor 410, and power supply 411. Those skilled in the art will appreciate that the electronic device configuration shown in fig. 10 does not constitute a limitation of the electronic device, and that the electronic device may include more or fewer components than shown, or some components may be combined, or a different arrangement of components. In the embodiment of the present invention, the electronic device includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal, a wearable device, a pedometer, and the like.
Wherein, the user input unit 407 is configured to receive a note input by a user in a case where the first content is displayed.
It should be understood that, in the embodiment of the present invention, the radio frequency unit 401 may be used for receiving and sending signals during a message sending and receiving process or a call process, and specifically, receives downlink data from a base station and then processes the received downlink data to the processor 410; in addition, the uplink data is transmitted to the base station. Typically, radio unit 401 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. Further, the radio unit 401 can also communicate with a network and other devices through a wireless communication system.
The electronic device provides wireless broadband internet access to the user via the network module 402, such as assisting the user in sending and receiving e-mails, browsing web pages, and accessing streaming media.
The audio output unit 403 may convert audio data received by the radio frequency unit 401 or the network module 402 or stored in the memory 409 into an audio signal and output as sound. Also, the audio output unit 403 may also provide audio output related to a specific function performed by the electronic apparatus 400 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 403 includes a speaker, a buzzer, a receiver, and the like.
The input unit 404 is used to receive audio or video signals. The input Unit 404 may include a Graphics Processing Unit (GPU) 4041 and a microphone 4042, and the Graphics processor 4041 processes image data of a still picture or video obtained by an image capturing apparatus (such as a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 406. The image frames processed by the graphic processor 4041 may be stored in the memory 409 (or other storage medium) or transmitted via the radio frequency unit 401 or the network module 402. The microphone 4042 may receive sound, and may be capable of processing such sound into audio data. The processed audio data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 401 in case of the phone call mode.
The electronic device 400 also includes at least one sensor 405, such as light sensors, motion sensors, and other sensors. Specifically, the light sensor includes an ambient light sensor that adjusts the brightness of the display panel 4061 according to the brightness of ambient light, and a proximity sensor that turns off the display panel 4061 and/or the backlight when the electronic apparatus 400 is moved to the ear. As one type of motion sensor, an accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of an electronic device (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), and vibration identification related functions (such as pedometer, tapping); the sensors 405 may also include a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, etc., which will not be described in detail herein.
The display unit 406 is used to display information input by the user or information provided to the user. The Display unit 406 may include a Display panel 4061, and the Display panel 4061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.
The user input unit 407 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the electronic device. Specifically, the user input unit 407 includes a touch panel 4071 and other input devices 4072. Touch panel 4071, also referred to as a touch screen, may collect touch operations by a user on or near it (e.g., operations by a user on or near touch panel 4071 using a finger, a stylus, or any suitable object or attachment). The touch panel 4071 may include two parts, a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 410, receives a command from the processor 410, and executes the command. In addition, the touch panel 4071 can be implemented by using various types such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. In addition to the touch panel 4071, the user input unit 407 may include other input devices 4072. Specifically, the other input devices 4072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a track ball, a mouse, and a joystick, which are not described herein again.
Further, the touch panel 4071 can be overlaid on the display panel 4061, and when the touch panel 4071 detects a touch operation thereon or nearby, the touch operation is transmitted to the processor 410 to determine the type of the touch event, and then the processor 410 provides a corresponding visual output on the display panel 4061 according to the type of the touch event. Although in fig. 5, the touch panel 4071 and the display panel 4061 are two independent components to implement the input and output functions of the electronic device, in some embodiments, the touch panel 4071 and the display panel 4061 may be integrated to implement the input and output functions of the electronic device, which is not limited herein.
The interface unit 408 is an interface for connecting an external device to the electronic apparatus 400. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 408 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the electronic apparatus 400 or may be used to transmit data between the electronic apparatus 400 and an external device.
The memory 409 may be used to store software programs as well as various data. The memory 409 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 409 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
The processor 410 is a control center of the electronic device, connects various parts of the entire electronic device using various interfaces and lines, performs various functions of the electronic device and processes data by operating or executing software programs and/or modules stored in the memory 409 and calling data stored in the memory 409, thereby performing overall monitoring of the electronic device. Processor 410 may include one or more processing units; preferably, the processor 410 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 410.
The electronic device 400 may further include a power supply 411 (e.g., a battery) for supplying power to various components, and preferably, the power supply 411 may be logically connected to the processor 410 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system.
In addition, the electronic device 400 includes some functional modules that are not shown, and are not described in detail herein.
Preferably, an embodiment of the present invention further provides an electronic device, which includes a processor 410, a memory 409, and a computer program that is stored in the memory 409 and can be run on the processor 410, and when being executed by the processor 410, the computer program implements each process of the above-mentioned note generation method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not described here again.
According to the electronic device provided by the embodiment of the invention, in the process of inputting notes by a user, the second content corresponding to the notes in the first content of the display screen can be determined according to the sight of the user, and the incidence relation between the notes and the second content is established, so that the content in the electronic book corresponding to the notes added by the user can be quickly and conveniently determined according to the sight of the user, the efficiency of the note adding process of the user is improved, meanwhile, due to the incidence relation between the notes and the second content, when the user inquires the generated notes, the electronic book content related to the notes can be quickly determined from the electronic book, and the reading experience of the user is improved.
The embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements each process of the above-mentioned method for generating a note, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.
While the preferred embodiments of the present invention have been described, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention as defined in the following claims.
Claims (9)
1. A method for generating a note, the method comprising:
receiving a note input by a user in a case where the first content is displayed;
determining second content from the first content according to the line of sight of the user in the process of inputting the note;
establishing an incidence relation between the second content and the note;
the step of determining second content from the first content according to the line of sight of the user in the process of inputting the note comprises the following steps:
determining the sight line direction of the sight line according to the sight line of the user in the note input process, and determining the sight line position of the sight line in the display screen according to the relative position of the sight line direction and the display screen;
determining a moving track of the sight line position as a target moving track under the condition that the moving speed of the sight line position is less than or equal to a first preset speed;
and determining the display content defined by the target movement track as the second content.
2. The method of claim 1, wherein after the step of establishing an associative relationship between the second content and the note, the method further comprises:
determining a first display screen on which the user is reading in a plurality of display screens according to the sight;
displaying the note in a second display screen of the plurality of display screens different from the first display screen.
3. The method of claim 2, wherein the step of presenting the note in a second display screen of the plurality of display screens different from the first display screen comprises:
generating a note label according to the note and the second content;
displaying the note tag in the second display screen.
4. The method of claim 3, wherein after the step of presenting the note tab in the second display screen, the method further comprises:
under the condition that the storage operation aiming at the note tag is received, adding the note tag into a list corresponding to the electronic book to obtain a note list;
displaying the note list in the second display screen;
wherein the receiving operation comprises: and dragging the note label from the display screen where the note label is located to another display screen.
5. An electronic device, characterized in that the electronic device comprises:
the receiving module is used for receiving notes input by a user under the condition that the first content is displayed;
the first determination module is used for determining second content from the first content according to the sight of the user in the note inputting process;
the association module is used for establishing an association relationship between the second content and the note;
the first determining module includes:
the first determining submodule is used for determining the sight line direction of the sight line according to the sight line of the user in the note inputting process, and determining the sight line position of the sight line in the display screen according to the relative position of the sight line direction and the display screen;
the second determining submodule is used for determining the moving track of the sight line position as a target moving track under the condition that the moving speed of the sight line position is less than or equal to a first preset speed;
and the third determining submodule is used for determining the display content defined by the target moving track as the second content.
6. The electronic device of claim 5, further comprising:
the second determining module is used for determining a first display screen on which the user is reading in a plurality of display screens according to the sight;
a first display module to display the note in a second display screen of the plurality of display screens different from the first display screen.
7. The electronic device of claim 6, wherein the first presentation module comprises:
the generation submodule is used for generating a note label according to the note and the second content;
and the display sub-module is used for displaying the note tag in the second display screen.
8. The electronic device of claim 7, further comprising:
the adding module is used for adding the note tag to a list corresponding to the electronic book to obtain a note list under the condition that the storage operation aiming at the note tag is received;
the second display module is used for displaying the note list in the second display screen;
wherein the receiving operation comprises: and dragging the note label from the display screen where the note label is located to another display screen.
9. An electronic device comprising a processor, a memory and a computer program stored on the memory and executable on the processor, the computer program, when executed by the processor, implementing the steps of the method of generating a note according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010352542.0A CN111638835B (en) | 2020-04-28 | 2020-04-28 | Note generation method and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010352542.0A CN111638835B (en) | 2020-04-28 | 2020-04-28 | Note generation method and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111638835A CN111638835A (en) | 2020-09-08 |
| CN111638835B true CN111638835B (en) | 2022-03-01 |
Family
ID=72333247
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010352542.0A Active CN111638835B (en) | 2020-04-28 | 2020-04-28 | Note generation method and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111638835B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113360801A (en) * | 2021-06-29 | 2021-09-07 | 读书郎教育科技有限公司 | System and method for automatically generating bookmark |
| CN114296627B (en) * | 2021-10-22 | 2023-06-23 | 腾讯科技（深圳）有限公司 | Content display method, device, equipment and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107992249A (en) * | 2017-12-14 | 2018-05-04 | 维沃移动通信有限公司 | The generation method and device of a kind of reading note |
| CN107992250A (en) * | 2017-12-20 | 2018-05-04 | 维沃移动通信有限公司 | A kind of display methods of electronic book documentary content, mobile terminal |
| CN109085965A (en) * | 2018-07-19 | 2018-12-25 | 掌阅科技股份有限公司 | Take down notes generation method, electronic equipment and computer storage medium |
| CN109190101A (en) * | 2018-08-29 | 2019-01-11 | 北京字节跳动网络技术有限公司 | Note reading generation method, device and electronic equipment |
| CN109782913A (en) * | 2019-01-10 | 2019-05-21 | 中科创达软件股份有限公司 | A kind of method and device that control screen content is shown |
| CN110032350A (en) * | 2019-04-16 | 2019-07-19 | 维沃移动通信有限公司 | A kind of information processing method and terminal |
| CN110244848A (en) * | 2019-06-17 | 2019-09-17 | Oppo广东移动通信有限公司 | Reading control method and relevant device |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8643680B2 (en) * | 2011-04-08 | 2014-02-04 | Amazon Technologies, Inc. | Gaze-based content display |
| KR102081930B1 (en) * | 2013-03-21 | 2020-02-26 | 엘지전자 주식회사 | Display device detecting gaze location and method for controlling thereof |
| CN104104576A (en) * | 2013-04-03 | 2014-10-15 | 中国移动通信集团广东有限公司 | Method, system and terminal for sharing reading notes |
| US20160170591A1 (en) * | 2014-12-12 | 2016-06-16 | Kobo Incorporated | Method and system for e-book annotations navigation and interface therefor |
| US10955985B2 (en) * | 2017-10-11 | 2021-03-23 | International Business Machines Corporation | Optimizing an arrangement of content on a display of a user device based on user focus |
| CN107797664B (en) * | 2017-10-27 | 2021-05-07 | Oppo广东移动通信有限公司 | Content display method and device and electronic device |
| CN110738031A (en) * | 2018-07-03 | 2020-01-31 | 广州阿里巴巴文学信息技术有限公司 | Method, device and equipment for generating reading note |
-
2020
- 2020-04-28 CN CN202010352542.0A patent/CN111638835B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107992249A (en) * | 2017-12-14 | 2018-05-04 | 维沃移动通信有限公司 | The generation method and device of a kind of reading note |
| CN107992250A (en) * | 2017-12-20 | 2018-05-04 | 维沃移动通信有限公司 | A kind of display methods of electronic book documentary content, mobile terminal |
| CN109085965A (en) * | 2018-07-19 | 2018-12-25 | 掌阅科技股份有限公司 | Take down notes generation method, electronic equipment and computer storage medium |
| CN109190101A (en) * | 2018-08-29 | 2019-01-11 | 北京字节跳动网络技术有限公司 | Note reading generation method, device and electronic equipment |
| CN109782913A (en) * | 2019-01-10 | 2019-05-21 | 中科创达软件股份有限公司 | A kind of method and device that control screen content is shown |
| CN110032350A (en) * | 2019-04-16 | 2019-07-19 | 维沃移动通信有限公司 | A kind of information processing method and terminal |
| CN110244848A (en) * | 2019-06-17 | 2019-09-17 | Oppo广东移动通信有限公司 | Reading control method and relevant device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111638835A (en) | 2020-09-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107734175B (en) | Notification message prompting method and mobile terminal | |
| CN108073343B (en) | display interface adjusting method and mobile terminal | |
| US11733862B2 (en) | Information display method and terminal | |
| US20220300302A1 (en) | Application sharing method and electronic device | |
| CN111338530B (en) | Control method of application program icon and electronic equipment | |
| CN107707953B (en) | Resource data display method and mobile terminal | |
| CN107943390B (en) | Character copying method and mobile terminal | |
| WO2019184947A1 (en) | Image viewing method and mobile terminal | |
| US11354017B2 (en) | Display method and mobile terminal | |
| CN107613095B (en) | Incoming call processing method and mobile terminal | |
| CN110795402B (en) | Method and device for displaying file list and electronic equipment | |
| CN109407949B (en) | Display control method and terminal | |
| CN110825295B (en) | Application program control method and electronic equipment | |
| CN107741814B (en) | Display control method and mobile terminal | |
| CN108228902B (en) | File display method and mobile terminal | |
| CN111638835B (en) | Note generation method and electronic equipment | |
| US20220171521A1 (en) | Icon display method and terminal | |
| US11669237B2 (en) | Operation method and terminal device | |
| CN108984062B (en) | Content display method and terminal | |
| CN109597546B (en) | Icon processing method and terminal equipment | |
| CN111158548A (en) | Screen folding method and electronic equipment | |
| CN111443860B (en) | Touch control method and electronic equipment | |
| CN110456959B (en) | Terminal control method and terminal | |
| CN109739430B (en) | Display method and mobile terminal | |
| CN110928616A (en) | Shortcut icon management method and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |