WO2017127991A1 - 一种标记方法及屏显设备 - Google Patents

一种标记方法及屏显设备 Download PDF

Info

Publication number
WO2017127991A1
WO2017127991A1 PCT/CN2016/072028 CN2016072028W WO2017127991A1 WO 2017127991 A1 WO2017127991 A1 WO 2017127991A1 CN 2016072028 W CN2016072028 W CN 2016072028W WO 2017127991 A1 WO2017127991 A1 WO 2017127991A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
cursor
area
viewpoint
display
Prior art date
Application number
PCT/CN2016/072028
Other languages
English (en)
French (fr)
Inventor
余亮
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to CN201680032184.7A priority Critical patent/CN107615216B/zh
Priority to PCT/CN2016/072028 priority patent/WO2017127991A1/zh
Publication of WO2017127991A1 publication Critical patent/WO2017127991A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer

Definitions

  • the present invention relates to the field of electronic technologies, and in particular, to a marking method and a screen display device.
  • the display display device instead of paper text to view a variety of materials.
  • the user constantly judges which screen-displayed content is worthy of marking, which screen-displayed content is not worthy of marking, and when the user thinks that the marking is required, the manual marking is performed by various drawing means, for example, manually selecting on the word document.
  • the text segment is highlighted, underlined, highlighted, or manually drawn underlined, text highlighted, etc. on the PDF document.
  • the content manually marked by the user may be only the content that the user's line of sight passes but the user does not actually recognize, or the screen-displayed content that the user has identified is not marked by the user in time. That is to say, as shown in FIG. 1 , it is difficult to accurately distinguish the screen-displayed content and the unidentified screen-displayed content by the user by manual marking, so that it is difficult to effectively guide the user to view the unidentified screen-displayed content to eliminate the cognitive blind spot, thereby reducing The efficiency of reading.
  • the embodiment of the invention provides a marking method and a screen display device, which can solve the problem in the prior art that when the screen display content is viewed, it is difficult to accurately distinguish the screened content and the unidentified screen display content by the manual marking, which is difficult to effectively The user is guided to view the unrecognized on-screen content, resulting in low browsing efficiency.
  • a marking method comprising:
  • a second aspect provides a display device, including a display unit, a determining unit, and a marking unit, wherein the display unit is configured to open a viewing object in a display area on a display screen, and display screen of the display device Included at least one of the display areas; the determining unit is configured to determine a valid view point, wherein the valid view point is a plurality of consecutive user view points that are densely arranged in a user view point falling within the display area; Used to automatically mark the valid viewpoint.
  • a display device includes a display screen and a processor, wherein the display screen is configured to open a viewing object in a display area on the display screen, the display screen including at least one of the displays
  • the processor is configured to determine a valid viewpoint, the plurality of consecutive user viewpoints that are densely arranged in a user viewpoint falling within the display area, and mark the valid viewpoint.
  • the plurality of consecutive user viewpoints that are densely arranged in the user's viewpoint in the display area marked by the on-screen display device have sufficient time for the user to recognize and understand the corresponding on-screen content.
  • the effective viewpoint so that the user can recognize the screen-displayed content corresponding to the effective viewpoint and the user does not recognize the screen-displayed content, effectively guide the user to view the unidentified screen-displayed content, and improve the browsing efficiency of the user.
  • the screen display device automatically marks the effective viewpoint, and can record the temporary interruption point in time, so that the user can quickly return to the interruption point after the interruption to continue reading, thereby improving the browsing efficiency of the user.
  • the on-screen display device can further improve the browsing efficiency of the user by automatically marking the effective viewpoint without requiring the user to disperse power and effort for additional marking operations.
  • a plurality of viewing objects can be simultaneously opened in a plurality of display areas of the display screen, and the viewing objects in each display area can be independently marked, and the display screen can be fully utilized. Space resources.
  • determining the valid viewpoint includes:
  • the determining unit is specifically configured to:
  • the determining, by the processor, the valid view includes:
  • the consecutive plurality of user viewpoints are concentrated on The vicinity of the specific screen display content, and the user's line of sight stays for a long enough time, so that the human brain has sufficient authentication time to recognize and understand the viewed content, and thus it can be determined that the consecutive k user viewpoints are valid viewpoints.
  • the marking the valid view comprises:
  • the overlapping regions are marked according to the number of overlaps corresponding to the overlapping regions, and the presets are filled in the view regions other than the overlapping regions.
  • Transparent color block of color
  • the area corresponding to the viewpoint area in the clear coating is erased.
  • the marking unit is specifically configured to:
  • the overlapping regions are marked according to the number of overlaps corresponding to the overlapping regions, and the presets are filled in the view regions other than the overlapping regions.
  • Transparent color block of color
  • the area corresponding to the viewpoint area in the clear coating is erased.
  • the overlapping regions are marked according to the number of overlaps corresponding to the overlapping regions, and the presets are filled in the view regions other than the overlapping regions.
  • Transparent color block of color
  • the area corresponding to the viewpoint area in the clear coating is erased.
  • the screen display device marks the effective viewpoint in the above manner, and can highlight the user-recognized content corresponding to the effective viewpoint. Among them, since the transparent color block and the transparent coating layer do not completely block the screen display content, the normal viewing of the user is not affected.
  • marking the overlapping area according to the number of overlapping corresponding to the overlapping area includes:
  • an overlap number identifier is displayed at a corresponding position of the overlap region.
  • the marking unit is specifically configured to:
  • an overlap number identifier is displayed at a corresponding position of the overlap region.
  • the processor is configured to mark the overlapping area according to an overlap number corresponding to the overlapping area Specifically include:
  • an overlap number identifier is displayed at a corresponding position of the overlap region.
  • the overlapping regions are marked according to the overlapping times corresponding to the overlapping regions, so that the degree of attention of the corresponding screen display content in the overlapping region can be identified, and the screen repeatedly viewed by the user is emphasized. Display content.
  • a fourth possible implementation manner of any of the foregoing aspects after the viewing object is opened in the display area, time is displayed in the display area An axis on which at least one cursor that is slidable is disposed.
  • the screen display device displays the mark status on the viewing object corresponding to the cursor position according to the real-time position of the cursor on the time axis during the sliding process, so that the marked user viewpoint can be reviewed in chronological order. To review the user's visual trajectory.
  • a first cursor is disposed on a time axis in the display area, and the method further include:
  • a first cursor is disposed on a time axis in the display area
  • the determining unit is further configured to: when the first cursor on the time axis is slid, determine a first sampling moment corresponding to a cursor position of the first cursor; and determine, according to the mapping relationship, Displaying a first identity and a first coordinate corresponding to the first sampling moment;
  • the display unit is further configured to: display, in the display area, a user viewpoint corresponding to the first target page corresponding to the first coordinate at the first sampling moment in a viewing object corresponding to the first identity identifier The status of the tag.
  • a first cursor is disposed on a time axis in the display area
  • the processor is further configured to: when the first cursor on the time axis slips, determine a first sampling moment corresponding to a cursor position of the first cursor; and determine, according to the mapping relationship, Displaying a first identity and a first coordinate corresponding to the first sampling moment;
  • the display screen is further configured to: display, in the display area, a user viewpoint corresponding to the first target page corresponding to the first coordinate at the first sampling moment in a viewing object corresponding to the first identity identifier The status of the tag.
  • the user can use the sliding cursor to review the sampling time corresponding to the cursor position to the marked user point of view at the initial time.
  • a second cursor and a third cursor are disposed on a time axis in the display area, The second cursor is located on a side of the time axis that is close to the initial time, and the method further includes:
  • the second cursor and the third cursor are disposed on a time axis in the display area, The second cursor is located on a side of the time axis near an initial time;
  • the determining unit is further configured to: when the second cursor on the time axis is slid, determine a second sampling moment corresponding to a cursor position of the second cursor, and a cursor position corresponding to the third cursor a third sampling moment; determining, according to the mapping relationship, a second identity identifier and a second coordinate corresponding to the display area and the second sampling moment;
  • the display unit is further configured to display, in the display area, the browsing object corresponding to the second identity identifier, after the second sampling moment and before the third sampling moment, the second a mark status of the user view corresponding to the second target page corresponding to the coordinate;
  • the determining unit is further configured to: when the third cursor on the time axis is slid, determine a third sampling moment corresponding to a cursor position of the third cursor; and determine, according to the mapping relationship, a third identity identifier and a third coordinate corresponding to the display area and the third sampling moment;
  • the display unit is further configured to display, in the display area, the third object, the third sampling time, and after the second sampling time, the third The mark status of the user view corresponding to the third target page corresponding to the coordinate.
  • the second cursor and the third cursor are disposed on a time axis in the display area, The second cursor is located on a side of the time axis near an initial time;
  • the processor is further configured to: when the second cursor on the time axis slips, determine a second sampling moment corresponding to a cursor position of the second cursor, and a cursor position corresponding to the third cursor a third sampling moment; determining, according to the mapping relationship, a second identity identifier and a second coordinate corresponding to the display area and the second sampling moment;
  • the display screen is further configured to: display, in the display area, the browsing object corresponding to the second identity, after the second sampling moment and before the third sampling moment, the second a mark status of the user view corresponding to the second target page corresponding to the coordinate;
  • the processor is further configured to: when the third cursor on the time axis is slid, determine a third sampling moment corresponding to a cursor position of the third cursor; and determine, according to the mapping relationship, a third identity identifier and a third coordinate corresponding to the display area and the third sampling moment;
  • the display screen is further configured to display, in the display area, the third object, the third sampling time, and after the second sampling time, the third The mark status of the user view corresponding to the third target page corresponding to the coordinate.
  • the user can review the marked user viewpoints between the sampling moments corresponding to the two cursor positions by means of the sliding cursor.
  • the user can review the marked user viewpoints in a specific time period, thereby improving the user experience.
  • the display area includes at least one sub-aree, each of the sub-areas for displaying one of the browsing objects .
  • the adjacent sub-areas display pages adjacent in the order in which the text is arranged.
  • the adjacent pages in the mark order are displayed in the adjacent sub-areas in the same display area, including the target page corresponding to the cursor position.
  • Eye Tracking A technique for tracking a user's line of sight based on eye movement information. When the user looks at different locations, the eye changes slightly, and these changes produce features that can be extracted, which can be extracted by image capture or scanning to track the user's viewpoint in real time.
  • an infrared device, an image acquisition device, and the like can perform eyeball tracking according to changes in characteristics of the eyeball and the periphery of the eyeball, or eyeball tracking according to changes in iris angle, or extracting feature changes by actively projecting a beam of infrared rays or the like to the iris, thereby performing eyeball tracking. .
  • the screen display device uses the camera and other devices to detect the drop of the user's line of sight on the display screen by the eye tracking technology.
  • On-screen display device A device that has a display and is capable of displaying electronic materials.
  • Viewing objects non-animated screen data such as documents, web pages, pictures, and interfaces that are displayed by the user through the display screen.
  • On-screen content The content corresponding to the viewing object displayed on the display.
  • FIG. 1 is a schematic diagram of distribution of screen content displayed by a user and screen content not recognized by a user according to the prior art
  • FIG. 2 is a schematic diagram of an application scenario according to an embodiment of the present disclosure
  • FIG. 3 is a flowchart of a marking method according to an embodiment of the present invention.
  • 4a is a schematic diagram of distribution of a display area on a display screen according to an embodiment of the present invention.
  • 4b is a schematic diagram of distribution of a display area on another display screen according to an embodiment of the present invention.
  • FIG. 5 is a schematic diagram of a distribution of sub-regions in a display area according to an embodiment of the present disclosure
  • FIG. 6 is a schematic diagram of distribution of an effective view point and an invalid view point according to an embodiment of the present invention.
  • FIG. 7 is a schematic diagram of a user's objectively viewed on-screen display content and a user's objective unread screen display content distribution according to an embodiment of the present invention
  • FIG. 8 is a flowchart of another marking method according to an embodiment of the present invention.
  • FIG. 9 is a schematic structural diagram of a time axis according to an embodiment of the present invention.
  • FIG. 10 is a schematic diagram of a view point and a view point area according to an embodiment of the present invention.
  • FIG. 11 is a schematic diagram of a visual ink effect according to an embodiment of the present invention.
  • FIG. 12 is a schematic diagram of another visual ink effect according to an embodiment of the present invention.
  • FIG. 13 is a schematic diagram of another visual ink effect according to an embodiment of the present invention.
  • FIG. 14 is a schematic diagram of another visual ink effect according to an embodiment of the present invention.
  • FIG. 15 is a schematic diagram of another visual ink effect according to an embodiment of the present invention.
  • 16a is a schematic diagram of a state of a mark displayed during a slider sliding process according to an embodiment of the present invention
  • FIG. 16b is a schematic diagram of a state of a mark displayed during another cursor sliding process according to an embodiment of the present invention.
  • FIG. 17a is a schematic diagram of another state of a marker displayed during a slider sliding process according to an embodiment of the present invention.
  • FIG. 17b is a schematic diagram of another state of a mark displayed during a slider sliding process according to an embodiment of the present invention.
  • FIG. 17c is a diagram showing another mark displayed during the sliding process of the cursor according to an embodiment of the present invention. State diagram
  • FIG. 17 is a schematic diagram of a mark state displayed during another cursor sliding process according to an embodiment of the present invention.
  • FIG. 18a is a schematic diagram showing a display effect of multiple sub-areas in a display area according to an embodiment of the present invention.
  • FIG. 18b is a schematic diagram showing a display effect of multiple sub-regions in another display area according to an embodiment of the present invention.
  • FIG. 18c is a schematic diagram showing a display effect of multiple sub-regions in another display area according to an embodiment of the present invention.
  • FIG. 18 is a schematic diagram showing a display effect of multiple sub-regions in another display area according to an embodiment of the present invention.
  • FIG. 19 is a schematic structural diagram of a screen display device according to an embodiment of the present disclosure.
  • FIG. 20 is a schematic structural diagram of another display device according to an embodiment of the present disclosure.
  • FIG. 21 is a schematic structural diagram of another display device according to an embodiment of the present invention.
  • the screen display device may include a display screen, a tracking component, a processor, and a memory.
  • the screen display device tracks the drop point of the user's line of sight on the display device display screen by tracking the eyeball tracking technology of the component, and determines by the processor.
  • a plurality of consecutive viewpoints arranged in a user's viewpoint on the display screen wherein the plurality of consecutive viewpoints have sufficient time for the user to recognize and understand the effective viewpoint of the corresponding on-screen display content, thereby automatically marking the effective viewpoint
  • the plurality of consecutive viewpoints have sufficient time for the user to recognize and understand the effective viewpoint of the corresponding on-screen display content, thereby automatically marking the effective viewpoint
  • the screen display device in the following embodiments of the present invention refers to an electronic device that can provide on-screen content to the user through the display screen and has eyeball tracking capability, such as a smart phone, an iPad, and the like.
  • the display screen can be a touch screen or a non-touch screen for displaying the data to be viewed to the user;
  • the tracking component can be an infrared tracking device, an image capturing device and the like having an eye tracking capability (such as a camera), which can be used to track the user's line of sight on the display screen.
  • the present invention will provide a detailed description of the labeling method and the screen display device provided by the following embodiments.
  • An embodiment of the present invention provides a marking method. Referring to FIG. 3, the method may include:
  • the display screen includes at least one display area.
  • the on-screen display device can open the viewing object in the display area on the display screen for the user to browse.
  • the entire display screen of the display device can be used as a display area; or the display screen of the display device can be divided into multiple display areas, and the position and size of different display areas can be set according to actual needs.
  • the display screen of the display device is divided into two display areas on the left and the right. Specifically, the user can view different viewing objects in the same display area, and the corresponding viewing objects in different display areas are independent of each other. After the viewing object is opened in the display area, the display device can collect the user's viewpoint and mark it according to the marking method provided by the embodiment of the present invention.
  • the marking method provided by the embodiment of the present invention is independently performed in each display area, and the display device determines the display area corresponding to the user's viewpoint according to the position of the user's viewpoint.
  • the display device determines the display area corresponding to the user's viewpoint according to the position of the user's viewpoint.
  • FIG. 4b when the user's line of sight falls in the display area 1 at the sampling time 11-16, the user viewpoint collected at the sampling time 11-16 falls within the display area 1, and the screen display device is displayed.
  • the viewing object in the area 1 is marked; when the user's line of sight falls in the display area 2 at the sampling time 17-20, the user viewpoint collected at the sampling time 17-20 falls within the display area 2, and the screen display device is The viewing object in the display area 2 is marked; when the user's line of sight returns to the display area 1 after the sampling time 20, the display device continues to mark the marking state corresponding to the sampling time 16.
  • each display area may further include at least one sub-area, and each sub-area is used to display one page in the viewing object.
  • pages adjacent in the order of text arrangement may be displayed in adjacent sub-areas within the same display area.
  • the display area 1 in FIG. 4b can also be divided into two upper and lower sub-areas as shown in FIG. 5, and the sub-area 2 can display the page 5 and the sub-area in the browsing object 1 corresponding to the current user viewpoint.
  • the page 1 in the browsing object 1 which is arranged in front of the page 5 in the order of text can be displayed.
  • the marking method provided by the embodiment of the present invention will be described below by taking the display area 1 shown in FIG. 4b as an example.
  • the marking methods corresponding to each of the other display areas are similar.
  • the screen display device determines a valid viewpoint, and the effective viewpoint is a plurality of consecutive user viewpoints that are densely arranged in a user viewpoint falling within the display area.
  • the display device can collect the user's viewpoint of the viewing user through the eyeball tracking technology and the tracking component at a preset plurality of sampling moments.
  • the time interval between sampling moments may be a preset value, for example, 0.1 s. If the user's eyes are closed at the current sampling time (eg, the moment the eye is closed when blinking), the tracking component does not capture the user's viewpoint. If the user's eyes are open, but the screen of the display device is not looked at, the tracking component cannot collect the user's viewpoint.
  • the tracking component can track the drop point of the user's line of sight on the display screen, that is, the tracking component can collect the user's viewpoint.
  • the collected user viewpoint When the collected user viewpoint does not fall within the display area 1 of the display screen and falls to other positions of the display screen, it may indicate that the user does not view the on-screen display content in the display area 1, and the user viewpoint at this time is for the display area. 1 can be called a null viewpoint.
  • the collected user viewpoint falls within the display area 1 of the display screen, it may indicate that the user is viewing the user viewpoint pair in the display area 1.
  • the screen display content, the user viewpoint at this time may be referred to as a non-empty viewpoint for the display area 1.
  • the screen display content corresponding to the non-empty view point in the display area 1 is the screen display content in the display area 1 that the user has objectively viewed.
  • the screen display content that the user corresponding to the user's viewpoint corresponding to the user's viewpoint in the display area 1 has been objectively viewed is not necessarily the screen display content that the user has already recognized, but may also be the screen display content that the user has passed the line of sight but the user does not actually recognize. Therefore, the screen display device can determine from the user viewpoint falling within the display area 1 that the user can identify the effective viewpoint of the corresponding screen display content, and mark it in a certain form to distinguish that the screen is not recognized by the user. The user's viewpoint of the content.
  • the effective view point may be collected at consecutive multiple sampling moments, and falls within the user view point in the display area 1 and is arranged in a plurality of consecutive user view points, so that the user has enough time to recognize and understand the corresponding screen.
  • the user's viewpoint of the content refer to user viewpoints collected at successive sampling times.
  • a plurality of consecutive sampling moments refer to a plurality of sampling moments sequentially adjacent in time series, such as sampling timings mt, (m+1)t, (m+2)t, ..., etc., where m is an integer .
  • the plurality of consecutive user viewpoints arranged in a dense manner means that the consecutive user viewpoints collected at a plurality of consecutive sampling moments are relatively close to each other and are arranged in a concentrated manner.
  • the screen display device determining that the effective viewpoint can include:
  • the distance between any two adjacent user viewpoints is less than or equal to the preset distance threshold in the consecutive k user viewpoints in the display area 1, it is determined that the consecutive k user viewpoints are valid viewpoints, where k is a pre- Set a positive integer.
  • the distance here may refer to the length of the line of the two user viewpoints on the display screen, and the distance threshold is a length value preset according to needs.
  • the interval between the user viewpoints may be considered to be relatively close.
  • the distance between the adjacent user viewpoints is less than or equal to the preset.
  • the threshold is a distance, the k consecutive user viewpoints can be considered to be densely arranged.
  • the preset distance threshold may be 2 cm, and the preset positive integer k may be a positive integer having a smaller value such as 2, 3, or 5.
  • the on-screen device When the viewing object is opened, the on-screen device initializes the value n of the continuous valid viewpoint counter. Is 0;
  • the on-screen display device determines the current user view point and Whether the distance between the previous non-empty viewpoints of the current user viewpoint is less than or equal to the preset distance threshold;
  • the display device determines the relationship between n and the preset positive integer k;
  • n is greater than the preset positive integer k, the display device determines that the current user viewpoint is a valid viewpoint, and adds n to 1;
  • n is equal to the preset positive integer k
  • the screen display device determines that the current user viewpoint and the k-1 non-empty viewpoints before the current user viewpoint are valid viewpoints, and adds n to 1;
  • n is less than the preset positive integer k, the display device adds n to 1;
  • the display device If the distance between the current user view point and the previous non-empty view point of the current user view point is greater than the preset distance threshold, the display device resets n to 0;
  • n is reset to 0.
  • the previous user view point of the current user view point refers to the user view point collected at the adjacent sampling time before the current sampling time.
  • Another optional implementation manner of the screen display device determining the effective viewpoint may be specifically:
  • the screen display device may determine the current user viewpoint and The k-1 viewpoints (total of k viewpoints) before the current user viewpoint are valid viewpoints.
  • the above method for determining whether the user viewpoint is a valid viewpoint is that if the distance between any two adjacent user viewpoints falls within the consecutive k user viewpoints in the display area 1, the distance between any two adjacent user viewpoints is less than or equal to a preset distance threshold, and k To preset a positive integer, you can indicate multiple consecutive user views.
  • the points are concentrated near the specific on-screen content, and the user's line of sight stays long enough, so that the human brain has sufficient authentication time to recognize and understand what is seen, so these user viewpoints can be defined as valid viewpoints.
  • the distance between the adjacent user viewpoints is large, and the user viewpoints are not concentrated (for example, the user's line of sight passes over the display area 1), although the user's sight is swept.
  • the screen display contents corresponding to the user viewpoints the screen display contents belong to the user's objectively viewing the screen display content, but the user's line of sight continues to stay for a long time, and the human brain does not have sufficient authentication time to recognize and understand the screen display contents, and thus these users
  • a viewpoint is not a valid viewpoint and can be called an invalid viewpoint. That is, the invalid viewpoint is a user viewpoint that falls within the user viewpoint of the display area 1 except for the effective viewpoint.
  • FIG. 6 a schematic diagram of the distribution of valid viewpoints and invalid viewpoints in the display area 1 can be seen in FIG. 6, in which black dots represent valid viewpoints and white dots represent invalid viewpoints.
  • the on-screen device marks a valid viewpoint.
  • the on-screen device can automatically mark the effective viewpoint, so that the screen-recognition content recognized by the user corresponding to the effective viewpoint can be accurately identified.
  • the plurality of consecutive valid viewpoints marked form a collectively presented trace strip, which may be referred to as visual ink.
  • the on-screen device may not mark; or the on-screen device may mark the invalid viewpoint in the form of a mark different from the effective viewpoint.
  • the effective view point and the invalid view point can be accurately distinguished, that is, the user-identified on-screen display content corresponding to the valid view point can be accurately and clearly marked, and the user-recognized screen display content corresponding to the valid view point and the invalid view point can be accurately distinguished.
  • the user does not recognize the on-screen content, so the user can effectively guide the user to view the unidentified on-screen content, thereby preventing the user from missing details or serial, missing lines, etc. while browsing the on-screen content, and can quickly locate a specific target and improve User's reading efficiency.
  • the user needs to distract attention continuously to determine which screen display contents are worthy of marking, and which screen display contents are not worthy of marking, and thus the marked screen display contents are screen display contents that the user subjectively thinks is worthy of marking. It is not always possible to accurately cover all the content that the user has objectively viewed, that is, it cannot accurately distinguish the guests in all the on-screen contents as shown in FIG. Viewing the on-screen content and objectively unreading the on-screen content, the user can not consciously view the objective unread screen content according to the mark. Specifically, the box in FIG.
  • the screen display content corresponding to the user viewpoint falling on the display screen is the screen display content that the user has objectively viewed, and the effective viewpoint and the invalid viewpoint falling on the display screen are performed.
  • the screen-displayed content corresponding to the marked user's viewpoint is that the user has objectively viewed the screen-displayed content, and the other parts of the screen-displayed content are the screen-displayed content that the user has not objectively viewed.
  • the marking method provided by the embodiment of the present invention automatically marks the screen-displayed content of the user corresponding to the effective viewpoint by automatically marking the effective viewpoint when the user views the screen-displayed content, without distracting the user's attention and energy through additional The operation is manually marked, so that the user's reading efficiency can be further improved.
  • the temporary interruption point can be marked in time, so that the user can quickly locate the reading before the interruption when the user returns to the viewing.
  • the screen display content can further improve the reading efficiency.
  • An embodiment of the present invention provides a marking method.
  • the display device can automatically mark a plurality of consecutive viewpoints that are densely arranged on the display screen.
  • the plurality of consecutive viewpoints marked are sufficient time for the user to recognize and understand the effective viewpoint of the corresponding on-screen display content, so that the user can accurately distinguish the screen-displayed content and the unidentified screen-displayed content, thereby effectively guiding the user to browse.
  • the screen display content is not recognized, and the browsing efficiency of the user is improved.
  • the embodiment of the present invention provides another marking method.
  • the display area 1 shown in FIG. 4b is taken as an example, and the undescribed parts in Embodiment 1 are described in detail. The same parts as those in Embodiment 1 will not be described again in the embodiments of the present invention.
  • the marking method provided by the embodiment of the present invention may further include:
  • the on-screen display device displays a time axis, and at least one cursor is disposed on the time axis.
  • the time axis is set at an appropriate position in the display area 1, and the time axis can be freely dragged within the current display area.
  • the time axis can be set at the bottom of the display area, and the time axis is represented by an axis with at least one slidable cursor.
  • One end of the time axis is the initial time, and the initial time is within the display area 1. The moment when the first object is opened, the other end points to the future moment, and each sampling moment corresponds to a point on the time axis.
  • the number of sampling moments corresponding to the unit length on the time axis may be fixed, and the length of the time axis may increase with time; or the length of the time axis may be fixed, and the number of sampling moments corresponding to the unit length with time The passage of the increase.
  • the method provided by the embodiment of the present invention may further include:
  • the screen display device determines a view area corresponding to the effective view point.
  • Each valid view point may correspond to a view area, which is an area having a preset size and a preset shape centered on the effective view point.
  • the preset size and preset shape can be set as needed.
  • step 103 After determining the view area of the effective view in step 105, an optional implementation of step 103 may be:
  • the display device fills a transparent color block of a preset color in a view area of the effective viewpoint.
  • a transparent color block of a preset color in a viewpoint area of the effective viewpoint to mark the effective viewpoint that is, the visual ink is patterned into a transparent color block of a suitable size and shape to cover the screen display content corresponding to the effective viewpoint, which A form of mark can be called a prominent form.
  • the transparent color block is transparent, the screen display content corresponding to the effective viewpoint is not completely blocked, so that the normal viewing of the user is not affected.
  • the preset color for example, a color corresponding to different ratios of the three primary colors of RGB, and one of them may be selected according to actual needs.
  • a schematic diagram of the visual ink effect formed by highlighting the effective viewpoint formation can be seen in FIG.
  • step 103 may be:
  • the display device marks the overlap area according to the overlap number corresponding to the overlap area, and fills the transparent color of the preset color in the view area other than the overlap area. Color block.
  • the viewpoint area of the effective viewpoint is an area centered on the effective viewpoint and having a certain size and shape
  • the viewpoint area corresponds to a certain coverage.
  • the coverage corresponding to the view area may be specifically determined according to the coordinates of the effective view and the size and shape of the view area.
  • the area formed by the points in the coverage area of the viewpoint area 1 and the viewpoint area 2 is the overlapping area of the viewpoint area 1 and the viewpoint area 2, and the number of overlaps is 1;
  • the area formed by the points in the coverage of the viewpoint area 1, the viewpoint area 2, and the viewpoint area 3 is an overlapping area of the viewpoint area 1, the viewpoint area 2, and the viewpoint area 3, and the number of times of overlap is two.
  • the on-screen display device can determine the overlap times of the overlap region and the overlap region according to the number of view regions in which the points on the same reading object displayed on the display screen are located.
  • the number of overlaps of the overlapping regions may be less than 1 for the number of all the view regions covering the overlapping region.
  • the overlapping area of the in-view area of the display area 1 it may be marked according to the number of overlaps, and in the viewpoint area other than the overlapping area, the transparent color block of the preset color may be filled as in step 1031.
  • the overlapping area is an overlapping portion of the viewpoint area of the effective viewpoint
  • the overlapping The screen corresponding content of the area is that the user has recognized the screen display content.
  • the screen display device marks the overlapping area according to different overlapping times of the overlapping areas, and can intuitively indicate the number of times the user corresponding to the overlapping area has recognized the number of times of recognition and the degree of attention, thereby easily distinguishing the plurality of viewing areas.
  • the screen overlapped content repeatedly viewed and thought by the user corresponding to the overlapped area of the second overlap, and the screen display content of the view point area with less overlap or less overlap of the view area corresponding to the user, so that the user can be visually marked
  • the key content that has been seen is convenient for users to quickly review key points and quickly find blind spots in understanding.
  • the screen display device may mark the overlap region according to the number of overlaps corresponding to the overlap region, and may include:
  • the screen display device fills the transparent color block in the overlapping area of the viewpoint area, and the color of the transparent color block corresponds to the overlapping number of overlapping areas.
  • the screen display device may fill the transparent color block of the color corresponding to the overlap number in the overlapping area of the view area corresponding to the effective view point, so as to identify the screen display content corresponding to the overlap area by using different colors of the transparent color block. The number of times and the level of attention.
  • a transparent color block of a preset color may be filled in the view area, and the preset color may be light gray (see the mesh fill part in FIG. 12) when different
  • the color of the transparent color block filled in the overlap area may be blue (see the vertical line fill portion in FIG. 12), and the non-overlapping portion in the overlapped view area may be filled.
  • the non-overlapping portions of the overlapping viewpoint regions may be filled with light gray transparent color patches; when different viewpoint regions overlap and the overlap number corresponding to the overlapping regions is 3, the color of the transparent color patches filled in the overlapping regions may be red, overlapping Non-overlapping portions of the view area can be filled with light gray transparent patches.
  • the color of the transparent patch filled in the overlap region is a transparent patch covering a preset color (for example, light gray) filled in all view regions of the overlap region.
  • the superposition of the colors the more the number of viewpoint areas covering the overlapping area, the more overlapping times of the overlapping areas, and the deeper the superimposed colors.
  • the transparent color block filled in the view area of the effective view is light gray
  • the color of the transparent color block in the overlapping area of the two view areas is filled in the two view areas where the overlap occurs.
  • Superposition of light gray transparent patches; the color of the transparent patches in the overlapping regions of the three viewpoint regions is the superposition of the light gray transparent patches filled in the three viewpoint regions where the overlap occurs.
  • the screen display device may further mark the overlapping area according to the number of times of overlap corresponding to the overlapping area, and may further include:
  • the on-screen display device displays the number of overlap times in the corresponding position of the overlap region.
  • the on-screen display device may display an overlap number identifier at a corresponding position of the overlap region of the view region corresponding to the effective viewpoint to highlight the degree of attention of the screen display content.
  • the corresponding position can be set according to actual conditions, for example, it can be located in the upper middle, upper left or upper right corner in the overlapping area.
  • the number of overlaps may be in the form of Arabic numerals, Roman numerals or Chinese characters, or other forms, such as identifying the number of overlaps in the order of the English alphabet, B indicating the number of overlaps is 2, and C indicates the number of overlaps is 3.
  • the specific form of the overlap number identification is not limited here. Illustratively, a schematic diagram of the number of overlaps in the repeating region can be seen in FIG.
  • the content corresponding to the viewing object may be pre-covered with a transparent coating of a preset color.
  • another optional implementation of marking the valid view in step 103 may be:
  • the screen display device erases an area corresponding to the view area in the transparent coating.
  • the mark form corresponding to the area corresponding to the view area in the transparent coating of the preset color (for example, light gray) covered on the erased object may be referred to as an erase type, and the visual ink is expressed as a transparent coat corresponding to the erased view area. And the void that appears.
  • this type of marking it is possible to completely cover the entire contents of the viewing object with a clear coating when the viewing object is opened in the display area.
  • a schematic diagram of the effect of erasing the visual ink formed by the effective viewpoint can be seen in FIG.
  • the on-screen display device may mark the valid viewpoints therein by the above step 103, and for the invalid viewpoints, the screen display device may not mark or may be different from the effective viewpoint.
  • the marking of the viewpoint is marked in the form of a mark, which is not limited in the embodiment of the present invention.
  • marking method provided by the embodiment of the present invention may further include:
  • the display device saves the sampling time of the user's viewpoint falling in the display area, the display area corresponding to the user's viewpoint, the identification of the viewing object to which the screen-displayed content corresponding to the user's viewpoint belongs, and the coordinates of the user's viewpoint relative to the viewing object.
  • the screen display device may also save the sampling time of the user's viewpoint, the display area 1 corresponding to the user's viewpoint, the identification of the viewing object to which the screen-displayed content corresponding to the user's viewpoint belongs, and the relative viewpoint of the user
  • the cursor can be displayed on the time axis, and the sampling time on the time axis is displayed according to the mapping relationship. Corresponding tag status.
  • the screen display device can uniquely identify a viewing object by using the identifier of the preset viewing object.
  • the identifier of the viewing object may be automatically generated by the screen display device, or may be manually set by the user on the screen display device, and is not specifically limited herein.
  • the coordinates of the user viewpoint relative to the viewing object are used to locate a specific location of the user viewpoint in the current viewing object.
  • the current user viewpoint may be a point corresponding to the *th column of the *th page of the current viewing object, and the corresponding coordinate may be the *th page *the fourth column.
  • the marking method provided by the embodiment of the present invention may further include: when the cursor on the time axis slides, the display device may display the corresponding marking state according to the sampling moment corresponding to the real-time position of the cursor, wherein The marked state includes the viewing object and the mark made to the user viewpoint on the viewing object in step 103, so that the marked user viewpoint can be reviewed in chronological order, and the user's visual trajectory can be reviewed.
  • the user viewpoint herein may include a valid viewpoint and an invalid viewpoint.
  • the display device can temporarily stop capturing the viewpoint through the tracking component (this process is similar to sliding video in the prior art)
  • the video is paused, the user's point of view can be collected and marked, which is not limited in the embodiment of the present invention.
  • the method may further include:
  • the first display time corresponding to the cursor position of the first cursor is determined when the first cursor of the screen display device slides on the time axis;
  • the mark status of the user view corresponding to the first target page corresponding to the first coordinate at the first sampling time is displayed in the viewing object corresponding to the first identity.
  • the user can slide the first cursor on the time axis (for example, by sliding the cursor with a mouse or a touch), and the screen display device can according to the real-time position of the first cursor in the sliding process. And determining a first sampling moment corresponding to the first cursor.
  • the first sampling moment corresponding to the first cursor may be a sampling moment on the time axis that is closest to the first cursor.
  • the display device may determine the first identity and the first coordinate corresponding to the display area 1 and the first sampling time according to the mapping relationship determined in step 106, thereby displaying the first in the display area 1.
  • the flag state of the user view corresponding to the first sampling time is cut off on the first target page corresponding to the first coordinate.
  • the first cursor when the first cursor is not slid, if the current sampling time is the sampling time 30, the user has browsed to the lower half of the page 1, and the screen display device has collected the sampling time 1-30 according to the above step 103.
  • the user view is marked, and the mark status of page 1 corresponding to the sampling time 30 can be as shown in FIG. 16a.
  • the first cursor slides to a certain position, if the corresponding first sampling time is the sampling time 5, the user cuts off the sampling time to the first half of the page 1 and displays the screen.
  • the device has marked the user view points collected in the sampling time 1-5 according to the above step 103, that is, the mark status of the page 1 corresponding to the first sampling time (sampling time 5) may be as shown in FIG. 16b.
  • the method may further include:
  • the first sampling time corresponding to the cursor position of the second cursor and the third sampling time corresponding to the cursor position of the third cursor are determined when the second cursor of the screen display device slides on the time axis;
  • the mark status of the user view corresponding to the second target page corresponding to the second coordinate after the second sampling time and before the third sampling time is displayed in the viewing object corresponding to the second identity.
  • the first sampling time corresponding to the cursor position of the third cursor is determined when the third cursor of the screen display device slides on the time axis;
  • the mark status of the user view corresponding to the third target page corresponding to the third coordinate is displayed before the third sampling time and after the second sampling time in the viewing object corresponding to the third identity.
  • the second cursor is located on a side of the time axis close to the initial time, and the sampling time corresponding to the second cursor is chronologically preceded by the sampling moment corresponding to the third cursor.
  • the second sampling time corresponding to the second cursor may be the sampling time closest to the second cursor on the time axis
  • the third sampling time corresponding to the third cursor may be the sampling time closest to the third cursor on the time axis.
  • the second sampling moment corresponding to the second cursor is an initial moment
  • the third sampling moment corresponding to the third cursor is a sampling moment 60
  • the second target page corresponding to the two sampling moments is page 1.
  • the user has browsed to the upper half of the page 2, and the screen display device has marked the user viewpoints in the page 1 and the page 2 collected by the sampling time 1-60 according to the above step 103, wherein the sampling Time 45 corresponds to the last user view in page 1, the mark status of page 1 can be seen in Figure 17a, and the mark status of page 2 can be seen in Figure 17b.
  • the mark status on the second target page (page 1) can be as shown in Fig. 17c. Since the user viewpoint collected at the sampling time 46-60 is not on the second target page (page 1), and only the mark state on the second target page (page 1) is displayed in FIG. 17c, only the display in FIG. 17c is actually displayed. The corresponding flag state on page 1 before the sampling time 46 after the second sampling time.
  • the second cursor position is stopped at the sampling time 5, and the third cursor is started to slide.
  • the third sampling moment corresponding to the third cursor is the sampling time 50
  • the third target page corresponding to the third sampling moment is page 2.
  • the corresponding mark state on the third target page (page 2) may be as shown in FIG. 17d.
  • the actual display in FIG. 17d is before the sampling time 50 after the sampling time 46.
  • the first sampling time corresponding to the first cursor is different, and the marking states on the corresponding first target page and the first target page are also different.
  • the cursor on the time axis When a slide occurs, the target page can be displayed in one of the sub-areas, and the pages adjacent in the mark order are displayed in the adjacent sub-areas.
  • the target page corresponds to the position of the cursor on the timeline. If the time axis includes the first cursor described in the above step 107, when the first cursor is slid, the target page is the first target page corresponding to the cursor position of the first cursor.
  • the target page is the second target page corresponding to the cursor position of the second cursor;
  • the target page is a third target page corresponding to the cursor position of the third cursor.
  • the pages are arranged according to the order of the marks, that is, the pages are arranged according to the user's reading order. That is, if at least one sub-area is included in the display area 1, when the cursor on the time axis is slid, pages adjacent to each other in the browsing order of the user can be displayed in adjacent sub-areas in the display area 1. According to the foregoing, if at least one sub-area is included in the display area 1, when the cursor on the time axis does not slip, the adjacent pages in the text arrangement order can be displayed in the adjacent sub-areas in the display area 1.
  • the target page when the cursor on the time axis slides, the target page may be displayed in the first sub-area, the target page corresponding to the position of the cursor on the time axis, and A page listed before/after the target page according to the mark order (user viewing order) is displayed in the second sub-area.
  • the display area 1 includes the sub-area 1 and the sub-area 2 as shown in FIG. 5, the example in which the position of the second cursor is stopped at the sampling time 5 and the third cursor is slid is taken as an example.
  • the second sampling time corresponds to the sampling time 5
  • the third sampling time corresponds to the sampling time 50
  • the user browses the page 5 and the page 6 after viewing the page 1 and the page 2
  • the third target can be displayed in the sub-area 2 Page (page 2), in the sub-area 1, the page 1 before the third target page in the mark order (user browsing order) can be displayed; or, referring to FIG. 18b, the third target page (page 2) can be displayed in the sub-area 1.
  • the page 5 ranked after the third target page on the mark order (user viewing order) can be displayed.
  • the on-screen display device can display the third target page (page 2) in the sub-area 2, and display the mark order (user viewing order) in the sub-area 1 on the page.
  • Page 1 before 2, and in the sub-area 3, the mark order (user viewing order) is displayed on page 5 after page 3.
  • the mark order is displayed on page 5 after page 3.
  • a third target page (page 2) may also be displayed in the sub-area 1, and a page order 5 in which the mark order (user viewing order) is arranged after the page 2 is displayed in the sub-area 2, and in the sub-area 3
  • the inside display mark order (user viewing order) is listed on page 6 after page 5.
  • the mark status of each page displayed in the above-mentioned FIGS. 18a, 18b, 18c, and 18d is the mark status corresponding to each page before the third sampling time after the second sampling time.
  • the flag status corresponding to page 1 is the corresponding mark status before the sampling time 46 after the second sampling time (sampling time 5) shown in FIG. 17c;
  • the mark status of the third target page (page 2) can be as shown in FIG. 17d.
  • the page 5 and the page 6 have not been viewed, and thus the pages 5 and 6 are not marked.
  • the display area includes a plurality of sub-areas, a plurality of pages adjacent to the target page corresponding to the cursor position in the viewing order can be simultaneously displayed in the display area, thereby facilitating the user. Get more information about the marked user's viewpoints from a macro perspective, learn more about the viewing content, and improve the user experience.
  • the second sampling time corresponding to the second cursor is different, and the marking states on the corresponding second target page and the second target page are also different.
  • the second cursor is slid, since the third cursor position is temporarily fixed, in the process of sliding the second cursor, the second target page corresponding to the second cursor changes anyway, before the third sampling moment corresponding to the third cursor. The page that the user has viewed.
  • the third sampling time corresponding to the third cursor is different, and the marking states on the corresponding third target page and the third target page are also different.
  • the third target page corresponding to the third cursor changes anyway, and is also after the second sampling moment corresponding to the second cursor. The page that the user has viewed.
  • the target page displayed in the display area 1 automatically jumps in accordance with the time sequence of the user's browsing, and displays the corresponding mark on the target page.
  • the status, the tag status includes the tag on the target page for the user's viewpoint, so the process can be equivalent to "rolling back" the marked user view through the timeline.
  • the timeline and cursor to "roll back" the marked user viewpoints, it helps users to review their visual trajectories in chronological order, as well as the cognitive process of the on-screen content, quickly locate specific content that users want to look back, and improve viewing efficiency. .
  • the user when a cursor is set on the time axis, the user can use the sliding cursor to review the sampling time corresponding to the cursor position to the marked user point of the initial time; when two cursors are set on the time axis, the user can use the sliding cursor Review the marked user viewpoints between the sampling moments corresponding to the two cursor positions.
  • the sliding cursor Review the marked user viewpoints between the sampling moments corresponding to the two cursor positions.
  • Rolling back text also means that there is a need for content that many users have never seen or recognized, and the length of the text that is rolled back exceeds the time axis of use.
  • the cursor scrolls back and forth the length of the user's viewpoint, which reduces the user's viewing efficiency and reduces the user's experience. For example, A is on page 1, B is on page 3, and the user has not seen page 2. In the process of reviewing A from B, the rollback text needs to go through page 2. Rolling back the marked user view will jump directly from page 3. Go to page 1 without going through page 2.
  • the marking state before the restarting can be maintained on the viewing object, and when needed, Clear the mark made before; or, restart it Afterwards, the mark made on the viewing object before restarting can also be directly emptied, and no specific limitation is made here.
  • the embodiment of the present invention provides a marking method, in which the screen display device distinguishes the overlapping regions according to the overlapping times corresponding to the overlapping regions of the viewpoint regions of the effective viewpoint, so as to identify different degrees of attention of the screen display content corresponding to the overlapping regions, and highlight
  • the user repeatedly views the key content, which is convenient for the user to quickly review the key points and quickly find the blind spots on the understanding; and review the marked user viewpoint through the timeline and the cursor, so that the user can review his visual trajectory and the cognition of the screen display content in chronological order.
  • the process quickly locates specific content that you want to look back, further improving the user's viewing efficiency.
  • the embodiment of the invention provides an on-screen display device 200, which can be used to perform the marking methods provided in the first embodiment and the second embodiment.
  • the display device 200 can include:
  • the display unit 201 can be configured to open the viewing object in a display area on the display screen, and the display screen includes at least one display area.
  • the determining unit 202 can be configured to determine a valid viewpoint, where the effective viewpoint is a plurality of consecutive user viewpoints that are densely arranged in a user viewpoint falling within the display area.
  • the marking unit 203 can be used to mark a valid viewpoint.
  • the determining unit 202 can be specifically configured to:
  • the distance between any two adjacent user viewpoints is less than or equal to the preset distance threshold in the consecutive k user viewpoints in the display area, it is determined that the consecutive k user viewpoints are valid viewpoints, where k is a preset A positive integer.
  • the determining unit 202 can also be used to:
  • the viewpoint area corresponding to the effective viewpoint is determined, wherein each valid viewpoint corresponds to one viewpoint area, and the viewpoint area is an area having a preset size and a preset shape centered on the effective viewpoint.
  • the marking unit 203 may be specifically configured to:
  • marking unit 203 can be specifically configured to:
  • the overlap area is marked according to the overlap number corresponding to the overlap area, and the transparent color block of the preset color is filled in the view area other than the overlap area.
  • the marking unit 203 can be specifically configured to:
  • a transparent patch is filled in the overlap region, and the color of the transparent patch corresponds to the number of overlaps of the overlap region.
  • the marking unit 203 may be specifically configured to:
  • the overlap number indicator is displayed at the corresponding position of the overlap area.
  • the content corresponding to the viewing object is covered with a transparent coating of a preset color
  • the marking unit 203 may be specifically configured to:
  • the display device 200 may further include:
  • the saving unit 204 can be configured to save the sampling time of the user's viewpoint falling within the display area, the display area corresponding to the user's viewpoint, the identification of the viewing object to which the screen-displayed content corresponding to the user's viewpoint belongs, and the user's viewpoint relative to the viewing object.
  • the display area may include at least one sub-area, and each sub-area is used to display one page in the viewing object.
  • the display unit 201 shown can also be used to:
  • the time axis is displayed, and at least one cursor is set on the time axis.
  • a first cursor may be disposed on a time axis in the display area
  • the determining unit 202 is further configured to: when the first cursor on the time axis slips, determine a first sampling moment corresponding to the cursor position of the first cursor; and determine, according to the mapping relationship, the first corresponding to the display region and the first sampling moment An identity and a first coordinate;
  • the display unit 201 is further configured to display, in the display area, the mark status of the user view corresponding to the first target page corresponding to the first coordinate at the first sampling time in the viewing object corresponding to the first identity.
  • a second cursor and a third cursor may be disposed on a time axis in the display area, and the second cursor is located on a side of the time axis near an initial time;
  • the determining unit 202 is further configured to: when the second cursor on the time axis slips, determine a second sampling moment corresponding to the cursor position of the second cursor, and a third sampling moment corresponding to the cursor position of the third cursor; a relationship, determining a second identity and a second coordinate corresponding to the display area and the second sampling moment;
  • the display unit 201 is further configured to display, in the display area, the second target page corresponding to the second coordinate, after the second sampling time and before the third sampling time, in the viewing object corresponding to the second identity
  • the determining unit 202 is further configured to: when the third cursor on the time axis slips, determine a third sampling moment corresponding to the cursor position of the third cursor; and determine, according to the mapping relationship, the first corresponding to the display area and the third sampling moment Three identity and third coordinates;
  • the display unit 201 is further configured to: display, in the display area, a third target page corresponding to the third coordinate, before the third sampling time and after the second sampling time, in the viewing object corresponding to the third identity The tag status of the user's viewpoint.
  • the display unit 201 may be specifically configured to:
  • a target page is displayed in the first sub-area, the target page corresponds to the cursor position, and a page before/after the target page according to the mark order is displayed in the second sub-area.
  • An on-screen display device provided by an embodiment of the present invention can automatically mark a plurality of densely arranged icons falling on a display screen when a viewing object is opened in a display area on a display device of the display device for viewing by a user.
  • the continuous viewpoint, the plurality of consecutive viewpoints marked for the user have sufficient time for the user to recognize and understand the effective viewpoint of the corresponding on-screen content, so that the user can accurately distinguish the screen-displayed content and the unidentified screen-displayed content, and effectively guide User viewing is not recognized in the screen To improve the user's reading efficiency.
  • the on-screen display device can mark the temporary interruption point during the user's browsing process in time, thereby helping the user to quickly return to the interruption point after the interruption to continue the browsing, thereby further providing the user's browsing efficiency.
  • the determining unit 202 and the marking unit 203 in the embodiment of the present invention may be a separately set processor, or may be integrated in a processor of the screen display device, or may be in the form of program code. It is stored in the memory of the on-screen display device, and is called by one of the processors of the on-screen display device 200 and performs the functions of the above determining unit 202 and the marking unit 203.
  • the processor herein may be a Central Processing Unit (CPU), a microprocessor, or an Application Specific Integrated Circuit (ASIC), or one or more configured to implement an embodiment of the present invention. Integrated circuits.
  • the embodiment of the present invention provides a display device 200.
  • the display device 200 adopts a general computer system structure, and program code for executing the solution of the present invention is stored in a memory and controlled by a processor.
  • the display device 200 can include a bus 214, a display 211, a processor 212, a memory 213, and the like.
  • the bus 214 may include a data bus, a power bus, a control bus, a status signal bus, etc., but for clarity of description, various buses are labeled as a bus in FIG. 21 for transferring information between various components of the computer. .
  • the display screen 211 can be used to implement the functions of the display unit in the above embodiment 3.
  • the memory 213 may be a read-only memory (ROM) or other type of static storage device that can store static information and instructions, a random access memory (RAM) or other type that can store information and instructions.
  • ROM read-only memory
  • RAM random access memory
  • the memory 213 is connected to the processor 212 via a bus for storing the operating system and the program for executing the solution of the present invention. Specifically, the function of the saving unit in the second embodiment can be executed.
  • the operating system is a program that controls the running of other programs and manages system resources.
  • the program code for carrying out the inventive arrangement is stored in memory 213 and is controlled by processor 212 for execution.
  • the program stored in the memory 213 is used by the instruction processor 212 to implement the marking method described in the first embodiment and the second embodiment. Specifically, it may include:
  • the display screen 211 can be used to open the viewing object in the display area on the display screen 211, and the display screen 211 includes at least one display area.
  • the processor 212 can be configured to determine a valid view point, which is a plurality of consecutive user view points that are densely arranged in a user view point falling within the display area; mark a valid view point.
  • the determining, by the processor 212, the valid view may specifically include:
  • the distance between any two adjacent user viewpoints is less than or equal to the preset distance threshold in the consecutive k user viewpoints in the display area, it is determined that the consecutive k user viewpoints are valid viewpoints, where k is a preset A positive integer.
  • the processor 212 can also be used to: before marking the valid viewpoint:
  • a view area corresponding to the effective view point is determined, wherein each valid view point corresponds to one view point area, and the view point area is an area having a preset size and a preset shape centered on the effective view point.
  • the processor 212 is configured to mark the valid view.
  • the processor 212 is configured to mark the valid view.
  • the overlap area is marked according to the overlap number corresponding to the overlap area, and the transparent color block of the preset color is filled in the view area other than the overlap area.
  • the processor 212 is configured to mark the overlapping area according to the number of times of overlap corresponding to the overlapping area.
  • a transparent patch is filled in the overlap region, and the color of the transparent patch corresponds to the number of overlaps of the overlap region.
  • the processor 212 is configured to mark the overlapping area according to the number of times of overlap corresponding to the overlapping area.
  • the overlap number indicator is displayed at the corresponding position of the overlap area.
  • the content corresponding to the viewing object is covered with a transparent coating of a preset color, and the processor 212 is configured to mark the valid viewpoint.
  • processor 212 can also be used to:
  • the invalid viewpoint is marked in a mark form different from the effective view point, and the invalid view point is a user view point falling in the display area, other than the valid view point.
  • the memory 213 can be configured to save the sampling time of the user's viewpoint falling within the display area, the display area corresponding to the user's viewpoint, the identification of the viewing object to which the screen-displayed content corresponding to the user's viewpoint belongs, and the user's viewpoint relative to the viewing. The mapping between the coordinates of the object.
  • the display area may include at least one sub-area, and each sub-area is used to display one page in the viewing object.
  • the display screen 211 can also be used to:
  • the time axis is displayed, and at least one cursor is set on the time axis.
  • a first cursor may be disposed on a time axis in the display area
  • the processor 212 is further configured to: when the first cursor on the time axis slips, determine a first sampling moment corresponding to the cursor position of the first cursor; and determine, according to the mapping relationship, the first corresponding to the display area and the first sampling moment An identity and a first coordinate;
  • the display screen 211 is further configured to display, in the display area, the mark status of the user view point corresponding to the first target page corresponding to the first coordinate at the first sampling time in the viewing object corresponding to the first identity.
  • a second cursor and a third cursor may be disposed on a time axis in the display area, and the second cursor is located on a side of the time axis near an initial time;
  • the processor 212 is further configured to: when the second cursor on the time axis slips, determine a second sampling moment corresponding to the cursor position of the second cursor, and a third sampling moment corresponding to the cursor position of the third cursor; a relationship, determining a second identity and a second coordinate corresponding to the display area and the second sampling moment;
  • the display screen 211 is further configured to: display, in the display area, a second target page corresponding to the second coordinate, after the second sampling time and before the third sampling time, in the viewing object corresponding to the second identity
  • the tag status of the user's viewpoint
  • the processor 212 is further configured to: when the third cursor on the time axis slips, determine a third sampling moment corresponding to the cursor position of the third cursor; and determine, according to the mapping relationship, the first corresponding to the display area and the third sampling moment Three identity and third coordinates;
  • the display screen 211 is further configured to display, in the display area, a third target page corresponding to the third coordinate, before the third sampling time and after the second sampling time, in the viewing object corresponding to the third identity identifier.
  • the display screen 211 can be specifically used to:
  • a target page is displayed in the first sub-area, the target page corresponds to the cursor position, and a page before/after the target page according to the mark order is displayed in the second sub-area.
  • An on-screen display device provided by an embodiment of the present invention can automatically mark a plurality of densely arranged icons falling on a display screen when a viewing object is opened in a display area on a display device of the display device for viewing by a user.
  • the continuous viewpoint, the plurality of consecutive viewpoints marked for the user have sufficient time for the user to recognize and understand the effective viewpoint of the corresponding on-screen content, so that the user can accurately distinguish the screen-displayed content and the unidentified screen-displayed content, and effectively guide The user browses the unrecognized screen display content and improves the user's browsing efficiency.
  • the on-screen display device can mark the temporary interruption point during the user's browsing process in time, thereby helping the user to quickly return to the interruption point after the interruption to continue the browsing, thereby further providing the user's browsing efficiency.
  • the disclosed apparatus and method may be implemented in other manners.
  • the device embodiments described above are merely illustrative.
  • the division of the unit is only a logical function division.
  • there may be another division manner for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored or not executed.
  • Another point, the phase shown or discussed The coupling or direct coupling or communication connection between each other may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
  • each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may be physically included separately, or two or more units may be integrated into one unit.
  • the above integrated unit can be implemented in the form of hardware or in the form of hardware plus software functional units.
  • the above-described integrated unit implemented in the form of a software functional unit can be stored in a computer readable storage medium.
  • the software functional units described above are stored in a storage medium and include instructions for causing a computer device (which may be a personal computer, server, or network device, etc.) to perform portions of the steps of the methods described in various embodiments of the present invention.
  • the foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like, and the program code can be stored. Medium.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

一种标记方法及屏显设备,涉及电子技术领域,能够解决现有技术中在阅览屏显内容时,由于通过手动标记难以准确区分用户已识别屏显内容和未识别屏显内容,从而难以有效引导用户阅览未识别屏显内容,因而导致的阅览效率低的问题。具体方案为:在显示屏上的显示区域内打开阅览对象(101),确定有效视点(102),标记有效视点(103)。本方法用于在屏显设备上进行标记。

Description

一种标记方法及屏显设备 技术领域
本发明涉及电子技术领域,尤其涉及一种标记方法及屏显设备。
背景技术
目前,越来越多的人选择通过显示屏显示设备代替纸质文本来阅览各种各样的资料。在阅览屏显资料时,用户不断判断哪些屏显内容值得标记,哪些屏显内容不值得标记,并在用户主观认为需要标记时,通过各种绘图手段进行手动标记,例如在word文档上手动选定文本段高亮、下划线、突显,或者在PDF文档上手动绘制下划线标记、文本高亮标记等。
现有技术中,在阅览屏显内容时,用户手动标记的内容可能只是用户的视线掠过但用户并未真正识别的内容,或者,用户已识别的屏显内容未被用户及时标记。也就是说,如图1所示,通过手动标记难以准确区分用户已识别屏显内容和未识别屏显内容,从而难以有效引导用户阅览未识别屏显内容以消除认知上的盲点,因而降低了阅览效率。其中,图1中的方框表示全部屏显内容,右斜线填充部分表示用户未识别屏显内容,网格填充的实线椭圆内部表示用户已识别屏显内容,虚线椭圆内部表示用户主观标记的屏显内容。
发明内容
本发明实施例提供一种标记方法及屏显设备,能够解决现有技术中在阅览屏显内容时,由于通过手动标记难以准确区分用户已识别屏显内容和未识别屏显内容,从而难以有效引导用户阅览未识别屏显内容,因而导致的阅览效率低的问题。
为达到上述目的,本发明的实施例采用如下技术方案:
第一方面,提供了一种标记方法,包括:
在显示屏上的显示区域内打开阅览对象,所述显示屏上包括至少一个所述显示区域,确定有效视点,所述有效视点为落在所述显示区域内的 用户视点中排列密集的多个连续的用户视点,并标记所述有效视点。
第二方面,提供一种屏显设备,包括显示单元、确定单元和标记单元;其中,所述显示单元用于,在显示屏上的显示区域内打开阅览对象,所述屏显设备的显示屏上包括至少一个所述显示区域;所述确定单元用于,确定有效视点,所述有效视点为落在所述显示区域内的用户视点中排列密集的多个连续的用户视点;所述标记单元用于,自动标记所述有效视点。
第三方面,提供一种屏显设备,包括显示屏和处理器;其中,所述显示屏用于,在显示屏上的显示区域内打开阅览对象,所述显示屏上包括至少一个所述显示区域;所述处理器用于,确定有效视点,所述有效视点为落在所述显示区域内的用户视点中排列密集的多个连续的用户视点,并标记所述有效视点。
结合上述第一至第三方面中,屏显设备标记的落在显示区域内的用户视点中排列密集的多个连续的用户视点,为用户有足够的时间识别和理解其对应的屏显内容的有效视点,因而可以准确区分有效视点对应的用户已识别屏显内容和用户未识别屏显内容,有效引导用户阅览未识别屏显内容,提高用户的阅览效率。
并且,屏显设备自动对有效视点进行标记,可以及时记录临时中断点,方便用户在中断后快速返回中断点继续阅览,从而可以提高用户的阅览效率。而且,屏显设备通过自动对有效视点进行标记,无需用户分散力和精力进行额外的标记操作,因而可以进一步提高用户的阅览效率。
另外,当显示屏上包括多个显示区域时,可以在显示屏的多个显示区域内同时打开多个阅览对象,并针对每个显示区域中的阅览对象独立进行标记,还可以充分利用显示屏的空间资源。
结合第一方面,在第一方面的第一种可能的实现方式中,确定有效视点包括:
如果落在所述显示区域内的连续k(预设正整数)个用户视点中,任 意两个相邻用户视点之间的距离小于或者等于预设距离阈值,则确定所述连续k个用户视点为有效视点。
结合第二方面,在第二方面的第一种可能的实现方式中,所述确定单元具体用于:
若落在所述显示区域内的连续k(预设正整数)个用户视点中,任意两个相邻用户视点之间的距离小于或者等于预设距离阈值,则确定所述连续k个用户视点为有效视点。
结合第三方面,在第三方面的第一种可能的实现方式中,所述处理器用于确定述有效视点具体包括:
若落在所述显示区域内的连续k(预设正整数)个用户视点中,任意两个相邻用户视点之间的距离小于或者等于预设距离阈值,则确定所述连续k个用户视点为有效视点。
当落在所述显示区域内的连续k(预设正整数)个用户视点中,任意两个相邻用户视点之间的距离小于或者等于预设距离阈值时,所述连续多个用户视点集中于特定屏显内容附近,且用户视线持续停留的时间足够长,使得人脑有充分的认证时间识别和理解所看内容,因而可以确定所述连续k个用户视点为有效视点。
结合第一方面或第一方面的第一种可能的实现方式,在第一方面的第二种可能的实现方式中,所述标记所述有效视点包括:
在所述有效视点的视点区域内填充预设颜色的透明色块;
或者,若确定不同所述有效视点对应的视点区域的覆盖范围发生重叠,则根据重叠区域对应的重叠次数对所述重叠区域进行标记,并在所述重叠区域以外的视点区域内,填充预设颜色的透明色块;
或者,擦除所述透明涂层中所述视点区域对应的区域。
结合第二方面或第二方面的第一种可能的实现方式,在第二方面的第二种可能的实现方式中,所述标记单元具体用于:
在所述有效视点的视点区域内填充预设颜色的透明色块;
或者,若确定不同所述有效视点对应的视点区域的覆盖范围发生重叠,则根据重叠区域对应的重叠次数对所述重叠区域进行标记,并在所述重叠区域以外的视点区域内,填充预设颜色的透明色块;
或者,擦除所述透明涂层中所述视点区域对应的区域。
结合第三方面或第三方面的第一种可能的实现方式,在第三方面的第二种可能的实现方式中,所述处理器用于标记所述有效视点具体包括:
在所述有效视点的视点区域内填充预设颜色的透明色块;
或者,若确定不同所述有效视点对应的视点区域的覆盖范围发生重叠,则根据重叠区域对应的重叠次数对所述重叠区域进行标记,并在所述重叠区域以外的视点区域内,填充预设颜色的透明色块;
或者,擦除所述透明涂层中所述视点区域对应的区域。
屏显设备通过上述方式对有效视点进行标记,可以突显有效视点对应的用户已识别内容。其中,由于透明色块和透明涂层不会完全遮挡屏显内容,因而不会影响用户的正常阅览。
结合第一方面至第一方面的第二种可能的实现方式,在第一方面的第三种可能的实现方式中,根据重叠区域对应的重叠次数对所述重叠区域进行标记包括:
在所述重叠区域内填充透明色块,所述透明色块的颜色与所述重叠区域的重叠次数相对应;
或者,在所述重叠区域的对应位置显示重叠次数标识。
结合第二方面至第二方面的第二种可能的实现方式,在第二方面的第三种可能的实现方式中,所述标记单元具体用于:
在所述重叠区域内填充透明色块,所述透明色块的颜色与所述重叠区域的重叠次数相对应;
或者,在所述重叠区域的对应位置显示重叠次数标识。
结合第三方面至第三方面的第二种可能的实现方式,在第三方面的第三种可能的实现方式中,所述处理器用于根据重叠区域对应的重叠次数对所述重叠区域进行标记具体包括:
在所述重叠区域内填充透明色块,所述透明色块的颜色与所述重叠区域的重叠次数相对应;
或者,在所述重叠区域的对应位置显示重叠次数标识。
当不同有效视点的视点区域的覆盖范围发生了重叠时,根据重叠区域对应的重叠次数对重叠区域进行标记,可以标识重叠区域内对应的屏显内容的被关注程度,强调被用户反复阅览的屏显内容。
结合上述任一方面至任一方面的第三种可能的实现方式,在上述任一方面的第四种可能的实现方式中,在所述显示区域内打开阅览对象后,显示区域内显示有时间轴,所述时间轴上设置有可以滑动的至少一个游标。当游标在时间轴上发生滑动时,屏显设备根据滑动过程中游标在时间轴上的实时位置,显示与游标位置对应的阅览对象上的标记状态,从而可以按照时间顺序回顾已标记的用户视点,从而回顾用户的视觉轨迹。
结合第一方面至第一方面的第四种可能的实现方式,在第一方面的第五种可能的实现方式中,所述显示区域内的时间轴上设置有第一游标,所述方法还包括:
在所述时间轴上的所述第一游标发生滑动时,确定所述第一游标的游标位置对应的第一采样时刻;
根据所述映射关系,确定与所述显示区域和所述第一采样时刻对应的第一身份标识和第一坐标;
在所述显示区域内,显示所述第一身份标识对应的阅览对象中,所述第一坐标对应的第一目标页面在所述第一采样时刻对应的用户视点的标记状态。
结合第二方面至第二方面的第四种可能的实现方式,在第二方面的第五种可能的实现方式中,所述显示区域内的时间轴上设置有第一游标;
所述确定单元还用于,在所述时间轴上的所述第一游标发生滑动时,确定所述第一游标的游标位置对应的第一采样时刻;根据所述映射关系,确定与所述显示区域和所述第一采样时刻对应的第一身份标识和第一坐标;
所述显示单元还用于,在所述显示区域内,显示所述第一身份标识对应的阅览对象中,所述第一坐标对应的第一目标页面在所述第一采样时刻对应的用户视点的标记状态。
结合第三方面至第三方面的第四种可能的实现方式,在第三方面的第五种可能的实现方式中,所述显示区域内的时间轴上设置有第一游标;
所述处理器还用于,在所述时间轴上的所述第一游标发生滑动时,确定所述第一游标的游标位置对应的第一采样时刻;根据所述映射关系,确定与所述显示区域和所述第一采样时刻对应的第一身份标识和第一坐标;
所述显示屏还用于,在所述显示区域内,显示所述第一身份标识对应的阅览对象中,所述第一坐标对应的第一目标页面在所述第一采样时刻对应的用户视点的标记状态。
当时间轴上设置有一个游标时,用户可以借助滑动游标,回顾游标位置对应的采样时刻至初始时刻已标记的用户视点。
结合第一方面至第一方面的第五种可能的实现方式,在第一方面的第六种可能的实现方式中,所述显示区域内的时间轴上设置有第二游标和第三游标,所述第二游标位于时间轴上靠近初始时刻的一侧,所述方法还包括:
在所述时间轴上的所述第二游标发生滑动时,确定所述第二游标的游标位置对应的第二采样时刻,以及第三游标的游标位置对应的第三采样时刻;
根据所述映射关系,确定与所述显示区域和所述第二采样时刻对应的第二身份标识和第二坐标;
在所述显示区域内,显示所述第二身份标识对应的阅览对象中,在所述第二采样时刻之后且在所述第三采样时刻之前,所述第二坐标对应的第二目标页面所对应的用户视点的标记状态;
在所述时间轴上的所述第三游标发生滑动时,确定所述第三游标的游标位置对应的第三采样时刻;
根据所述映射关系,确定与所述显示区域和所述第三采样时刻对应的第三身份标识和第三坐标;
在所述显示区域内,显示所述第三身份标识对应的阅览对象中,在所述第三采样时刻之前且在所述第二采样时刻之后,所述第三坐标对应的第三目标页面所对应的用户视点的标记状态。
结合第二方面至第二方面的第五种可能的实现方式,在第二方面的第六种可能的实现方式中,所述显示区域内的时间轴上设置有第二游标和第三游标,所述第二游标位于时间轴上靠近初始时刻的一侧;
所述确定单元还用于,在所述时间轴上的所述第二游标发生滑动时,确定所述第二游标的游标位置对应的第二采样时刻,以及第三游标的游标位置对应的第三采样时刻;根据所述映射关系,确定与所述显示区域和所述第二采样时刻对应的第二身份标识和第二坐标;
所述显示单元还用于,在所述显示区域内,显示所述第二身份标识对应的阅览对象中,在所述第二采样时刻之后且在所述第三采样时刻之前,所述第二坐标对应的第二目标页面所对应的用户视点的标记状态;
所述确定单元还用于,在所述时间轴上的所述第三游标发生滑动时,确定所述第三游标的游标位置对应的第三采样时刻;根据所述映射关系,确定与所述显示区域和所述第三采样时刻对应的第三身份标识和第三坐标;
所述显示单元还用于,在所述显示区域内,显示所述第三身份标识对应的阅览对象中,在所述第三采样时刻之前且在所述第二采样时刻之后,所述第三坐标对应的第三目标页面所对应的用户视点的标记状态。
结合第三方面至第三方面的第五种可能的实现方式,在第三方面的第六种可能的实现方式中,所述显示区域内的时间轴上设置有第二游标和第三游标,所述第二游标位于时间轴上靠近初始时刻的一侧;
所述处理器还用于,在所述时间轴上的所述第二游标发生滑动时,确定所述第二游标的游标位置对应的第二采样时刻,以及第三游标的游标位置对应的第三采样时刻;根据所述映射关系,确定与所述显示区域和所述第二采样时刻对应的第二身份标识和第二坐标;
所述显示屏还用于,在所述显示区域内,显示所述第二身份标识对应的阅览对象中,在所述第二采样时刻之后且在所述第三采样时刻之前,所述第二坐标对应的第二目标页面所对应的用户视点的标记状态;
所述处理器还用于,在所述时间轴上的所述第三游标发生滑动时,确定所述第三游标的游标位置对应的第三采样时刻;根据所述映射关系,确定与所述显示区域和所述第三采样时刻对应的第三身份标识和第三坐标;
所述显示屏还用于,在所述显示区域内,显示所述第三身份标识对应的阅览对象中,在所述第三采样时刻之前且在所述第二采样时刻之后,所述第三坐标对应的第三目标页面所对应的用户视点的标记状态。
当时间轴上设置有两个游标时,用户可以借助滑动游标,回顾两个游标位置分别对应的采样时刻之间已标记的用户视点。与时间轴上仅设置有一个游标相比,当时间轴上设置有两个游标时,可以便于用户回顾特定时间段内的已标记用户视点,提高用户体验。
结合上述任一方面的任一种可能的实现方式,在一种可能的实现方式中,所述显示区域包括至少一个子区域,每个所述子区域用于显示所述阅览对象中的一个页面。
结合上述任一方面的第三种至第五种可能的实现方式,在上述任一方面的第六种可能的实现方式中,当时间轴上的游标未发生滑动时,在同一显示区域内的相邻子区域内显示在文本排列顺序上相邻的页面。当时间 轴上的游标发生滑动时,在同一显示区域内的相邻子区域内显示在标记顺序上相邻的页面,其中包括游标位置对应的目标页面。
当显示区域内包括多个子区域时,每个显示区域内可以同时显示多个页面,便于用户了解更多的阅览内容。
为便于理解,示例的给出了部分与本发明相关概念的说明以供参考,如下所示:
眼球追踪:一种根据眼球运动信息追踪用户视线的技术。当用户看向不同位置时,眼部会发生细微的变化,这些变化会产生可以提取的特征,通过图像捕捉或扫描可以提取这些特征,从而实时追踪用户视点。例如红外装置、图像采集装置等装置,可以根据眼球和眼球周边的特征变化进行眼球追踪,或者根据虹膜角度变化进行眼球追踪,或者通过主动投射红外线等光束到虹膜来提取特征变化,从而进行眼球追踪。
用户视点:屏显设备通过摄像头等装置,采用眼球追踪技术检测到的用户视线在显示屏上的落点。
屏显设备:具有显示屏且能够显示电子资料的设备。
阅览对象:通过显示屏供用户阅览的文档、网页、图片、界面等非动画屏显资料。
屏显内容:通过显示屏显示的阅览对象对应的内容。
附图说明
为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。
图1为现有技术提供的一种用户已识别屏显内容和用户未识别屏显内容的分布示意图;
图2为本发明实施例提供的一种应用场景示意图;
图3为本发明实施例提供的一种标记方法流程图;
图4a为本发明实施例提供的一种显示屏上显示区域的分布示意图;
图4b为本发明实施例提供的另一种显示屏上显示区域的分布示意图;
图5为本发明实施例提供的一种显示区域中子区域的分布示意图;
图6为本发明实施例提供的一种有效视点和无效视点的分布示意图;
图7为本发明实施例提供的一种用户客观已阅览屏显内容和用户客观未阅览屏显内容分布示意图;
图8为本发明实施例提供的另一种标记方法流程图;
图9为本发明实施例提供的一种时间轴的结构示意图;
图10为本发明实施例提供的一种视点和视点区域的示意图;
图11为本发明实施例提供的一种视觉墨迹效果示意图;
图12为本发明实施例提供的另一种视觉墨迹效果示意图;
图13为本发明实施例提供的另一种视觉墨迹效果示意图;
图14为本发明实施例提供的另一种视觉墨迹效果示意图;
图15为本发明实施例提供的另一种视觉墨迹效果示意图;
图16a为本发明实施例提供的一种游标滑动过程中显示的标记状态示意图;
图16b为本发明实施例提供的另一种游标滑动过程中显示的标记状态示意图;
图17a为本发明实施例提供的另一种游标滑动过程中显示的标记状态示意图;
图17b为本发明实施例提供的另一种游标滑动过程中显示的标记状态示意图;
图17c为本发明实施例提供的另一种游标滑动过程中显示的标记状 态示意图;
图17d为本发明实施例提供的另一种游标滑动过程中显示的标记状态示意图;
图18a为本发明实施例提供的一种显示区域中多子区域的显示效果示意图;
图18b为本发明实施例提供的另一种显示区域中多子区域的显示效果示意图;
图18c为本发明实施例提供的另一种显示区域中多子区域的显示效果示意图;
图18d为本发明实施例提供的另一种显示区域中多子区域的显示效果示意图;
图19为本发明实施例提供的一种屏显设备的结构示意图;
图20为本发明实施例提供的另一种屏显设备的结构示意图;
图21为本发明实施例提供的另一种屏显设备的结构示意图。
具体实施方式
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。
在阅览屏显内容时,针对现有技术中用户通过手动标记不能准确地区分已识别屏显内容和未识别屏显内容的问题,在本发明以下实施例提供的标记方法中,参见图2,屏显设备可以包括显示屏、追踪部件、处理器以及存储器等部件,屏显设备通过追踪部件所具有的眼球追踪技术,追踪用户视线在屏显设备显示屏上的落点,并通过处理器确定落在显示屏上的用户视点中排列密集的多个连续视点,该多个连续视点为用户有足够的时间识别和理解其对应的屏显内容的有效视点,从而对有效视点进行自动标 记,以准确地区分用户已识别屏显内容和未识别屏显内容。
本发明以下实施例中的屏显设备是指,可以通过显示屏为用户提供屏显内容且具有眼球追踪能力的电子设备,例如智能手机、iPad等。显示屏可以是触摸屏也可以是非触摸屏,用于向用户显示待阅览资料;追踪部件可以为红外装置、图像采集装置等具有眼球追踪能力的部件(例如摄像头),可以用于追踪用户视线在显示屏上的落点;存储器用于存储数据和指令。
具体的,本发明将通过以下实施例对所提供的标记方法和屏显设备进行详细说明。
实施例1
本发明实施例提供一种标记方法,参见图3,可以包括:
101、在屏显设备显示屏上的显示区域内打开阅览对象,显示屏上包括至少一个显示区域。
其中,屏显设备可以在显示屏上的显示区域内打开阅览对象,以供用户进行阅览。参见图4a,屏显设备的整个显示屏可以作为一个显示区域;或者,屏显设备的显示屏也可以被划分为多个显示区域,不同显示区域的位置和大小可以根据实际需要进行设定。示例性的,参见图4b所示的划分示意图,屏显设备的显示屏被划分为左右2个显示区域。具体的,用户在同一个显示区域内可以阅览不同的阅览对象,不同显示区域内对应的阅览对象相互独立。在显示区域内打开阅览对象后,屏显设备可以采集用户视点,并根据本发明实施例提供的标记方法进行标记。
本发明实施例提供的标记方法在每个显示区域内独立进行,屏显设备根据用户视点的位置确定用户视点对应的显示区域。示例性的,以图4b为例,当用户的视线在采样时刻11-16落在显示区域1中时,采样时刻11-16采集到的用户视点落在显示区域1内,屏显设备在显示区域1内的阅览对象上进行标记;当用户的视线在采样时刻17-20落在显示区域2中时,采样时刻17-20采集到的用户视点落在显示区域2内,屏显设备在 显示区域2内的阅览对象上进行标记;当用户的视线在采样时刻20之后又回到显示区域1中时,屏显设备接着采样时刻16对应的标记状态继续进行标记。
进一步地,每个显示区域内还可以包括至少一个子区域,每个子区域用于显示阅览对象中的一个页面。可选地,同一个显示区域内的相邻子区域内可以显示文本排列顺序上相邻的页面。示例性的,图4b中的显示区域1内还可划分为如图5所示的上、下2个子区域,子区域2中可以显示当前用户视点对应的阅览对象1中的页面5,子区域1中可以显示阅览对象1中按照文本顺序上排在页面5之前的页面4。
需要说明的是,当显示区域内包括多个子区域时,同一个显示区域内可以呈现多个页面,方便用户了解更多的阅览内容,并且可以使得用户不需要进行翻页,就可以方便、快速地阅览前一页或后一页的内容,同时还可以使得显示屏的空间资源得到充分利用。
以下将以图4b所示的显示区域1为例,对本发明实施例提供的标记方法进行说明,其它每个显示区域对应的标记方法类似。
102、屏显设备确定有效视点,有效视点为落在显示区域内的用户视点中排列密集的多个连续的用户视点。
在显示区域1内打开阅览对象后,屏显设备可以在预设的多个采样时刻,通过眼球追踪技术和追踪部件采集阅览用户的用户视点。其中,采样时刻之间的时间间隔可以为预设值例如0.1s。若当前采样时刻用户的眼睛是闭合的(例如在眨眼时眼睛闭合的瞬间),则追踪部件采集不到用户视点。若用户的眼睛是睁开的,但并未注视屏显设备的屏幕,则追踪部件也无法采集到用户视点。当用户正在注视屏显设备的显示屏时,追踪部件可以追踪到用户视线在显示屏上的落点,即追踪部件可以采集到用户视点。当采集到的用户视点未落在显示屏的显示区域1内,而落在显示屏的其它位置时,可以表明用户并未阅览显示区域1中的屏显内容,此时的用户视点对于显示区域1来说可以称为空视点。当采集到的用户视点落在显示屏的显示区域1内时,可以表明用户正在阅览显示区域1内用户视点对 应的屏显内容,此时的用户视点对于显示区域1来说可以称为非空视点。其中,显示区域1内非空视点对应的屏显内容,是显示区域1内用户已客观阅览的屏显内容。
然而,落在显示区域1内的用户视点对应的用户已客观阅览的屏显内容,不一定是用户已经识别的屏显内容,也可能是用户视线掠过但用户未真正识别的屏显内容。因而,屏显设备可以从落在显示区域1内的用户视点中,确定用户可以识别其对应的屏显内容的有效视点,并通过一定的形式进行标记,以区别于用户未识别其对应的屏显内容的用户视点。
其中有效视点可以是连续的多个采样时刻采集到的,且落在显示区域1内的用户视点中,排列密集的多个连续的用户视点,是用户有足够的时间识别和理解其对应的屏显内容的用户视点。多个连续的用户视点是指连续的多个采样时刻采集到的用户视点。连续的多个采样时刻是指在时间顺序上依次相邻的多个采样时刻,例如采样时刻mt,(m+1)t,(m+2)t,...等,其中,m为整数。排列密集的多个连续的用户视点是指,多个连续采样时刻采集到的连续的用户视点之间的间隔较近,排列较为集中。
可选地,屏显设备确定有效视点可以包括:
若落在显示区域1内的连续k个用户视点中,任意两个相邻用户视点之间的距离小于或者等于预设距离阈值,则确定连续k个用户视点为有效视点,其中,k为预设正整数。
这里的距离可以指两个用户视点在显示屏上的直线长度,距离阈值为根据需要预设的长度值。当相邻的用户视点之间的距离小于预设距离阈值时,可以认为用户视点之间的间隔较近,当k个连续的用户视点中,相邻用户视点之间的距离小于或者等于预设距离阈值时,可以认为该k个连续的用户视点排列密集。示例性的,这里的预设距离阈值可以为2cm,预设正整数k可以为2、3、5等数值较小的正整数。
其中,屏显设备确定有效视点的一种可选的实施方式具体可以为:
在打开阅览对象时,屏显设备将连续有效视点计数器的值n初始化 为0;
若当前采样时刻采集到的当前用户视点落在显示区域1内,存在当前用户视点的前一个用户视点,且当前用户视点的前一个用户视点为非空视点,则屏显设备确定当前用户视点与当前用户视点的前一个非空视点之间的距离是否小于或者等于预设距离阈值;
若当前用户视点与当前用户视点的前一个非空视点之间的距离,小于或者等于预设距离阈值,则屏显设备确定n与预设正整数k的关系;
若n大于预设正整数k,则屏显设备确定当前用户视点为有效视点,并将n加1;
若n等于预设正整数k,则屏显设备确定当前用户视点及当前用户视点之前的k-1个非空视点为有效视点,并将n加1;
若n小于预设正整数k,则屏显设备将n加1;
若当前用户视点与当前用户视点的前一个非空视点之间的距离大于预设距离阈值,则屏显设备将n重置为0;
若当前采样时刻采集到的当前用户视点为未落在显示区域1内的空视点,则将n重置为0。
其中,当前用户视点的前一个用户视点是指当前采样时刻之前的相邻采样时刻采集到的用户视点。
或者,屏显设备确定有效视点的另一种可选的实施方式具体可以为:
若屏显设备确定当前用户视点与当前用户视点之前的k-1个连续非空视点中,任意两个视点之间的直线距离均小于预设距离阈值,则屏显设备可以确定当前用户视点与当前用户视点之前的k-1个视点(共k个视点)为有效视点。
上述确定用户视点是否为有效视点的方法的意义在于,若落在显示区域1内的连续k个用户视点中,任意两个相邻用户视点之间的距离小于或者等于预设距离阈值,且k为预设正整数,则可以表明连续多个用户视 点集中于特定屏显内容附近,且用户视线持续停留的时间足够长,使得人脑有充分的认证时间识别和理解所看内容,因而可以把这些用户视点定义为有效视点。
此外,对于落在显示区域1内的用户视点中,相邻用户视点之间的距离较大,且用户视点排列不集中的情况(例如用户视线掠过显示区域1),虽然用户的视线扫到了这些用户视点对应的屏显内容,这些屏显内容属于用户客观已阅览屏显内容,但用户视线持续停留的时间不够长,人脑没有充分的认证时间识别和理解这些屏显内容,因而这些用户视点不是有效视点,可以称为无效视点。即,无效视点为落在显示区域内1的用户视点中,除有效视点以外的用户视点。
示例性的,显示区域1内有效视点和无效视点的分布示意图可以参见图6,其中,黑点表示有效视点,白点表示无效视点。
103、屏显设备标记有效视点。
在确定用户能够识别其对应的屏显内容的有效视点时,屏显设备可以对有效视点进行自动标记,从而可以准确地标识有效视点对应的用户已识别屏显内容。其中,被标记的多个连续的有效视点会形成集中呈现的痕迹条,可以称为视觉墨迹。而对于落在显示区域1内的用户视点中的无效视点,屏显设备可以不进行标记;或者,屏显设备也可以以区别于有效视点的标记形式,标记无效视点。从而,可以准确地区分有效视点和无效视点,即可以准确并明确地标记出有效视点对应的用户已识别屏显内容,并能够准确地区分有效视点对应的用户已识别屏显内容和无效视点对应的用户未识别屏显内容,因而可以有效引导用户阅览未识别屏显内容,从而可以避免用户在阅览屏显内容时漏过细节或者串行、漏行等,并且可以快速地定位特定目标,提高用户的阅览效率。
在现有技术中的手动标记方法中,需要用户分散注意力不断地判断哪些屏显内容值得标记,哪些屏显内容不值得标记,因而所标记屏显内容为用户主观认为值得标记的屏显内容,不一定能够准确地涵盖用户客观已阅览的所有内容,即不能够准确地区分如图7所示的全部屏显内容中的客 观已阅览屏显内容和客观未阅览屏显内容,使得用户不能根据所做的标记有意识地阅览客观未阅览屏显内容。具体的,图7中的方框表示全部屏显内容,左斜线填充部分表示用户客观未阅览屏显内容,较大的椭圆内部表示用户客观已阅览屏显内容,较小的椭圆内部表示用户主观标记的屏显内容。而在本发明实施例提供的标记方法中,落在显示屏上的用户视点对应的屏显内容为用户已客观阅览的屏显内容,当将落在显示屏上的有效视点和无效视点均进行标记后,已标记的用户视点对应的屏显内容即为用户客观已阅览屏显内容,其它部分屏显内容即为用户客观未阅览的屏显内容。
并且,本发明实施例提供的标记方法在用户阅览屏显内容时通过自动标记有效视点,可以自动标记有效视点对应的用户已识别屏显内容,而不需要分散用户的注意力和精力通过额外的操作进行手动标记,因而可以进一步提高用户的阅览效率。
进一步地,在现有技术中的手动标记方法中,用户在阅览屏显内容时,由于不能预测临时的阅览中断点,因而不会及时手动标记出临时中断点的位置,从而不能在返回阅读时快速定位到刚才的临时中断点,从而降低了阅览效率。例如,当一位会计正在做财务报表时,同事临时打断他的工作,由于该会计不能预知临时的中断点,因而未能及时在目前正在计算的数据上标记,从而使得其在返回工作时需要花费较多时间重新搜索刚才正在计算的数据。而在本发明实施例提供的标记方法中,由于可以对用户落在显示屏上的用户视点进行自动标记,因而可以及时标记临时中断点,从而可以在用户返回阅览时快速定位到中断前正在阅览的屏显内容,从而可以进一步提高阅览效率。
本发明实施例提供一种标记方法,在屏显设备显示屏上的显示区域内打开阅览对象以供用户进行阅览时,屏显设备可以自动标记落在显示屏上的排列密集的多个连续视点,标记的该多个连续视点为用户有足够的时间识别和理解其对应的屏显内容的有效视点,从而可以准确地区分用户已识别屏显内容和未识别屏显内容,有效地引导用户阅览未识别屏显内容,提高用户的阅览效率。
实施例2
参见图8,在实施例1的基础上,本发明实施例提供另一种标记方法,仍以图4b所示的显示区域1为例,对实施例1中的未述部分进行详细描述,对于与实施例1中相同的部分,本发明实施例中将不再赘述。
在步骤101中的显示区域1内打开阅览对象后,本发明实施例提供的标记方法还可以包括:
104、屏显设备显示时间轴,时间轴上设置有至少一个游标。
屏显设备可以在显示区域1内打开阅览对象后,在显示区域1内的适当位置设置时间轴,时间轴可以在当前显示区域内随意拖动。示例性的,参见图9,时间轴可以设置在显示区域的底部,时间轴以带有至少一个可滑动游标的坐标轴的形式表示,时间轴的一端为初始时刻,初始时刻为显示区域1内打开第一个阅览对象的时刻,另一端指向未来时刻,每个采样时刻对应于时间轴上的一个点。
其中,时间轴上单位长度对应的采样时刻的数量可以固定,时间轴的长度可以随着时间的推移而增大;或者,时间轴的长度可以固定,单位长度对应的采样时刻的数量随着时间的推移而增大。
在步骤103中标记有效视点之前,本发明实施例提供的方法还可以包括:
105、屏显设备确定有效视点对应的视点区域。
其中,每个有效视点可以对应一个视点区域,该视点区域为以有效视点为中心,具有预设大小和预设形状的区域。其中的预设大小和预设形状具体可以根据需要进行设定。示例性的,有效视点及其对应的视点区域的示意图可以参见图10。
在步骤105中确定有效视点的视点区域之后,步骤103一种可选的实现方式可以为:
1031、屏显设备在有效视点的视点区域内填充预设颜色的透明色块。
在有效视点的视点区域内填充预设颜色的透明色块以对有效视点进行标记,也就是将视觉墨迹图形化为大小、形状合适的透明色块覆盖在有效视点对应的屏显内容上,这种标记形式可以称为突显式。其中,由于透明色块是透明的,因而不会完全遮挡有效视点对应的屏显内容,从而不会影响到用户的正常阅览。预设颜色的可选项可以有多种,例如可以在RGB三原色的不同配比对应的颜色,具体可以根据实际需要选择其中一种进行标记。示例性的,采用突显式标记有效视点形成的视觉墨迹效果示意图可以参见图11。
或者,在步骤105中确定有效视点的视点区域之后,步骤103的另一种可选的实现方式可以为:
1032、若确定不同有效视点对应的视点区域的覆盖范围发生重叠,则屏显设备根据重叠区域对应的重叠次数对重叠区域进行标记,并在重叠区域以外的视点区域内,填充预设颜色的透明色块。
由于有效视点的视点区域是以有效视点为中心且具有一定大小和形状的区域,因而视点区域对应一定的覆盖范围。视点区域对应的覆盖范围具体可以根据有效视点的坐标以及视点区域的大小和形状确定。例如,在显示区域1内的阅览对象上,同时在视点区域1和视点区域2的覆盖范围内的点形成的区域为视点区域1和视点区域2的重叠区域,且重叠次数为1;同时在视点区域1、视点区域2和视点区域3的覆盖范围内的点形成的区域为视点区域1、视点区域2和视点区域3的重叠区域,且重叠次数为2。因而,屏显设备可以根据显示屏上显示的同一阅读对象上的点所在的视点区域的数量,确定重叠区域以及重叠区域对应的重叠次数。其中,重叠区域的重叠次数可以为覆盖该重叠区域的所有视点区域的数量值减1。
对于显示区域1内视点区域的重叠区域,可以根据重叠次数对其进行标记,而在重叠区域以外的视点区域内,可以像步骤1031中那样填充预设颜色的透明色块。
其中,由于重叠区域是有效视点的视点区域的重叠部分,因而重叠 区域对应的屏显内容为用户已识别屏显内容。屏显设备根据重叠区域的不同重叠次数采用不同的标记形式对重叠区域进行标记,可以直观地指示重叠区域对应的用户已识别屏显内容的识别次数和被关注程度,从而很容易区分视点区域多次重叠的重叠区域对应的用户反复阅览和思考过的屏显内容,以及视点区域少次重叠部分或未出现重叠的视点区域对应的用户思量较少的屏显内容,从而可以直观标示出用户细看过的重点内容,便于用户迅速回顾要点以及快速发现理解上的盲点。
可选地,在步骤1032中,屏显设备根据重叠区域对应的重叠次数对重叠区域进行标记可以包括:
屏显设备在视点区域的重叠区域内填充透明色块,透明色块的颜色与重叠区域的重叠次数相对应。
具体的,屏显设备可以在有效视点对应的视点区域的重叠区域内,填充于重叠次数对应的颜色的透明色块,以通过透明色块的不同颜色标识重叠区域对应的屏显内容的被识别次数及被关注程度。
示例性的,参见图12,当视点区域未发生重叠时,可以在视点区域内填充预设颜色的透明色块,预设颜色可以为浅灰色(参见图12中网格填充部分),当不同视点区域发生重叠且重叠区域对应的重叠次数为1时,重叠区域填充的透明色块的颜色可以为蓝色(参见图12中竖线填充部分),发生重叠的视点区域内非重叠部分可以填充浅灰色的透明色块;当不同视点区域发生重叠且重叠区域对应的重叠次数为2时,重叠区域内填充的透明色块的颜色可以为黄色(参见图12中左斜线填充部分),发生重叠的视点区域内非重叠部分可以填充浅灰色的透明色块;当不同视点区域发生重叠且重叠区域对应的重叠次数为3时,重叠区域内填充的透明色块的颜色可以为红色,发生重叠的视点区域内非重叠部分可以填充浅灰色的透明色块。
可选地,重叠区域对应的重叠次数越大,重叠区域内填充的透明色块的颜色可以越深。示例性的,重叠区域内填充的透明色块的颜色,为覆盖重叠区域的所有视点区域内填充的预设颜色(例如浅灰色)的透明色块 的颜色的叠加,覆盖重叠区域的视点区域的数量越多,重叠区域对应的重叠次数就增大,叠加后的颜色也越深。示例性的,参见图13,若有效视点的视点区域内填充的透明色块为浅灰色,则两个视点区域的重叠区域内透明色块的颜色为发生重叠的这两个视点区域内填充的浅灰色透明色块的叠加;三个视点区域的重叠区域内透明色块的颜色为发生重叠的这三个视点区域内填充的浅灰色透明色块的叠加。
可选地,在步骤1032中,屏显设备根据重叠区域对应的重叠次数对重叠区域进行标记还可以包括:
屏显设备在重叠区域的对应位置显示重叠次数标识。
屏显设备可以在有效视点对应的视点区域的重叠区域的对应位置显示重叠次数标识,以突显屏显内容的被关注程度。其中的对应位置可以根据实际情况进行设定,例如可以位于重叠区域内的中上方、左上角或右上角等。重叠次数标识可以是阿拉伯数字形式、罗马数字形式或中文汉子数字形式,也可以是其他形式,例如按照英文字母表的顺序来标识重叠次数,B表示重叠次数为2次,C表示重叠次数为3次等,这里对重叠次数标识的具体形式不做限定。示例性的,重复区域内重叠次数标识的示意图可以参见图14。
此外,阅览对象对应的内容上还可以预先覆盖有预设颜色的透明涂层。该种情况下,在步骤105中确定有效视点的视点区域之后,步骤103中标记有效视点的另一种可选的实现方式可以为:
1033、屏显设备擦除透明涂层中视点区域对应的区域。
擦除阅览对象上覆盖的预设颜色(例如浅灰色)的透明涂层中视点区域对应的区域所对应的标记形式可以称为擦除式,视觉墨迹表现为擦除视点区域对应的透明涂层而出现的空洞。采用该种标记方式时,可以在显示区域内打开阅览对象时,用透明涂层完全覆盖阅览对象上的全部内容。示例性的,采用擦除式标记有效视点形成的视觉墨迹的效果示意图可以参见图15。
此外,对于落在显示区域1内的用户视点,屏显设备可以通过上述步骤103对其中的有效视点进行标记,而对于其中的无效视点,屏显设备可以不进行标记,也可以以区别于有效视点的标记形式对其进行标记,本发明实施例不做限定。
进一步地,本发明实施例提供的标记方法还可以包括:
106、屏显设备保存落在显示区域内的用户视点的采样时刻,用户视点对应的显示区域,用户视点对应的屏显内容所属的阅览对象的身份标识,以及用户视点相对于阅览对象的坐标之间的映射关系。
对于落在显示区域1内的用户视点,屏显设备还可以保存用户视点的采样时刻,用户视点对应的显示区域1,用户视点对应的屏显内容所属的阅览对象的身份标识,以及用户视点相对于阅览对象的坐标之间的映射关系,以便于在对落在显示区域1内的用户视点进行标记之后,可以在滑动时间轴上的游标时,根据该映射关系显示与时间轴上的采样时刻对应的标记状态。
由于显示区域1内对应的阅览对象可以为一个或多个,屏显设备可以通过预设的阅览对象的身份标识唯一标识一个阅览对象。其中,阅览对象的身份标识可以是屏显设备自动生成的,也可以是用户在屏显设备上手动设置的,这里不进行具体限定。用户视点相对于阅览对象的坐标用以定位用户视点在当前阅览对象中的具体位置。例如,当前用户视点可以为当前阅览对象上第*页第*行第*列对应的点,对应的坐标可以为第*页第*行第*列。
在上述步骤101-106之后,本发明实施例提供的标记方法还可以包括,在时间轴上的游标发生滑动时,屏显设备可以根据游标实时位置对应的采样时刻显示对应的标记状态,其中的标记状态包括阅览对象及在步骤103中对阅览对象上的用户视点所进行的标记,从而可以按照时间顺序回顾已标记的用户视点,回顾用户的视觉轨迹。其中,这里的用户视点可以包括有效视点和无效视点。当时间轴上的游标发生滑动时,屏显设备可以暂时停止通过追踪部件采集视点(该过程类似于现有技术中在滑动视频进 度条时暂停视频播放),也可以继续采集用户视点并进行标记,本发明实施例不做限定。
以下将通过两种具体情况进行详细说明:
(1)、若显示区域1内仅包括一个子区域,则在滑动时间轴上的游标时,在显示区域1内显示一个页面。
具体的,当显示区域1内的时间轴上设置有第一游标时,在上述步骤101-106之后,该方法还可以包括:
107、屏显设备在时间轴上的第一游标发生滑动时,确定第一游标的游标位置对应的第一采样时刻;
根据映射关系,确定与显示区域和第一采样时刻对应的第一身份标识和第一坐标;
在显示区域内,显示第一身份标识对应的阅览对象中,第一坐标对应的第一目标页面在第一采样时刻对应的用户视点的标记状态。
当显示区域1内的时间轴上设置有第一游标时,用户可以滑动时间轴上的第一游标(例如通过鼠标或触摸滑动游标),屏显设备可以根据滑动过程中第一游标的实时位置,确定第一游标对应的第一采样时刻。其中,第一游标对应的第一采样时刻,可以为时间轴上距离第一游标最近的一个采样时刻。在确定第一采样时刻之后,屏显设备可以根据步骤106中确定的映射关系,确定与显示区域1和第一采样时刻对应的第一身份标识和第一坐标,从而在显示区域1内显示第一身份标识对应的阅览对象中,第一坐标对应的第一目标页面上截止第一采样时刻对应的用户视点的标记状态。
示例性的,在未滑动第一游标时,若当前采样时刻为采样时刻30,用户已阅览至页面1的下半页,屏显设备已根据上述步骤103对采样时刻1-30中采集到的用户视点进行了标记,采样时刻30对应的页面1的标记状态可以如图16a所示。在第一游标滑动至某一位置时,若对应的第一采样时刻为采样时刻5,截止采样时刻5用户阅览至页面1的上半页,屏显 设备已根据上述步骤103对采样时刻1-5中采集到的用户视点进行了标记,即第一采样时刻(采样时刻5)对应的页面1的标记状态可以如图16b所示。
当显示区域1内的时间轴上设置有第二游标和第三游标,且第二游标位于时间轴上靠近初始时刻的一侧时,在上述步骤101-106之后,该方法还可以包括:
1081、屏显设备在时间轴上的第二游标发生滑动时,确定第二游标的游标位置对应的第二采样时刻,以及第三游标的游标位置对应的第三采样时刻;
根据映射关系,确定与显示区域和第二采样时刻对应的第二身份标识和第二坐标;
在显示区域内,显示第二身份标识对应的阅览对象中,在第二采样时刻之后且在第三采样时刻之前,第二坐标对应的第二目标页面所对应的用户视点的标记状态。
1082、屏显设备在时间轴上的第三游标发生滑动时,确定第三游标的游标位置对应的第三采样时刻;
根据映射关系,确定与显示区域和第三采样时刻对应的第三身份标识和第三坐标;
在显示区域内,显示第三身份标识对应的阅览对象中,在第三采样时刻之前且在第二采样时刻之后,第三坐标对应的第三目标页面所对应的用户视点的标记状态。
其中,第二游标位于时间轴上靠近初始时刻的一侧,则第二游标对应的采样时刻在时间顺序上先于第三游标对应的采样时刻。第二游标对应的第二采样时刻,可以为时间轴上距离第二游标最近的采样时刻,第三游标对应的第三采样时刻,可以为时间轴上距离第三游标最近的采样时刻。
示例性的,在未滑动第二游标和第三游标时,第二游标对应的第二采样时刻为初始时刻,第三游标对应的第三采样时刻为采样时刻60,第 二采样时刻对应的第二目标页面为页面1。截止采样时刻60,用户已阅览至页面2的上半页,屏显设备已根据上述步骤103对采样时刻1-60采集到的对页面1和页面2中的用户视点进行了标记,其中,采样时刻45对应页面1中的最后一个用户视点,页面1的标记状态可以参见图17a,页面2的标记状态可以参见图17b。
在第二游标滑动至某一位置时,若对应的第二采样时刻为采样时刻5,则第二游标对应的第二目标页面为页面1,第二采样时刻对应的采样时刻5之后第三采样时刻对应的采样时刻60之前,第二目标页面(页面1)上的标记状态可以如图17c所示。由于采样时刻46-60采集到的用户视点并不在第二目标页面(页面1)上,而图17c中仅显示第二目标页面(页面1)上的标记状态,因而图17c中事实上仅显示了第二采样时刻之后采样时刻46之前,页面1上对应的标记状态。
进一步的,将第二游标位置停止在采样时刻5,开始滑动第三游标。在滑动第三游标的过程中,若第三游标对应的第三采样时刻为采样时刻50,第三采样时刻对应的第三目标页面为页面2。则在第二采样时刻(采样时刻5)之后第三采样时刻(采样时刻50)之前,第三目标页面(页面2)上对应的标记状态可以如图17d所示。其中,由于屏显设备在采样时刻46之前采集到的用户视点在页面1上,不在第三目标页面(页面2)上,因而在图17d中实际显示的是采样时刻46之后采样时刻50之前,页面2上对应的标记状态。
需要说明的是,当第一游标位置发生滑动时,第一游标对应的第一采样时刻不同,对应的第一目标页面及第一目标页面上的标记状态也不同。
(2)、若显示区域内包括至少两个子区域,则在时间轴上的游标发生滑动时,在其中一个子区域内显示目标页面,在其它子区域内显示其它页面,本发明实施例对其它子区域内显示的其它页面与目标页面的具体关系不做具体限定。
可选地,若显示区域内包括至少两个子区域,则在时间轴上的游标 发生滑动时,可以在其中一个子区域内显示目标页面,在相邻子区域内显示在标记顺序上相邻的页面。其中的目标页面与游标在时间轴上的位置相对应。若时间轴上包括上述步骤107中所描述的第一游标,则当第一游标发生滑动时,目标页面为与第一游标的游标位置对应的第一目标页面。若时间轴上包括上述步骤1081和1082中所描述的第二游标和第三游标,则当第二游标发生滑动时,目标页面为与第二游标的游标位置对应的第二目标页面;当第三游标发生滑动时,目标页面为与第三游标的游标位置对应的第三目标页面。
需要说明的是,由于屏显设备是根据用户的阅览顺序进行标记的,因而根据标记顺序排列页面也就是根据用户的阅览顺序排列页面。也就是说,若显示区域1内包括至少一个子区域,则在时间轴上的游标发生滑动时,可以在显示区域1内的相邻子区域内显示在用户的阅览顺序上相邻的页面。而根据前文,若显示区域1内包括至少一个子区域,则当时间轴上的游标未发生滑动时,可以在显示区域1内的相邻子区域内显示文本排列顺序上相邻的页面。
具体的,若显示区域1内包括两个子区域,则在时间轴上的游标发生滑动时,可以在第一子区域内显示目标页面,该目标页面与游标在时间轴上的位置相对应,并在第二子区域内显示根据标记顺序(用户阅览顺序)排在目标页面之前/后的一个页面。
示例性的,当显示区域1内包括如图5所示的子区域1和子区域2时,以上述第二游标的位置停止在采样时刻5,并滑动第三游标时所举示例为例,第二采样时刻对应采样时刻5,第三采样时刻对应采样时刻50,且用户在阅览页面1和页面2之后又阅览了页面5和页面6,则参见图18a,子区域2内可以显示第三目标页面(页面2),子区域1内可以显示标记顺序(用户阅览顺序)上在第三目标页面之前的页面1;或者,参见图18b,子区域1内可以显示第三目标页面(页面2),子区域2内可以显示标记顺序(用户阅览顺序)上排在第三目标页面之后的页面5。
当然,显示区域1内也可以包括两个以上的子区域。示例性的,参 见图18c,当显示区域1内包括3个子区域时,屏显设备可以在子区域2内显示第三目标页面(页面2),在子区域1内显示标记顺序(用户阅览顺序)排在页面2之前的页面1,并在子区域3内显示标记顺序(用户阅览顺序)排在页面3之后的页面5。或者,参见图18d,也可以在子区域1内显示第三目标页面(页面2),在子区域2内显示标记顺序(用户阅览顺序)排在页面2之后的页面5,并在子区域3内显示标记顺序(用户阅览顺序)排在页面5之后的页面6。
值得注意的是,上述图18a、18b、18c、18d中显示的各页面的标记状态,均为各页面在第二采样时刻之后第三采样时刻之前对应的标记状态。具体的,页面1对应的标记状态,为图17c所示的第二采样时刻(采样时刻5)之后采样时刻46之前对应的标记状态;第三目标页面(页面2)的标记状态可以如图17d所示;由于在第三采样时刻,用户仍在阅览页面2中的内容,尚未阅览至页面5和页面6,因而页面5和页面6上没有进行标记。
因此,在时间轴上的游标发生滑动时,若显示区域内包括多个子区域,则显示区域内可以同时显示在阅览顺序上与游标位置对应的目标页面相邻的多个页面,从而可以便于用户从宏观上获知更多已标记用户视点的情况,了解更多的阅览内容,提高用户的体验。
需要说明的是,当第二游标位置发生滑动时,第二游标对应的第二采样时刻不同,对应的第二目标页面及第二目标页面上的标记状态也不同。在滑动第二游标时,由于第三游标位置暂时固定,因而在滑动第二游标的过程中,第二游标对应的第二目标页面无论怎样变化,也是在第三游标对应的第三采样时刻之前用户阅览过的页面。
同样,当第三游标位置发生滑动时,第三游标对应的第三采样时刻不同,对应的第三目标页面及第三目标页面上的标记状态也不同。在滑动第三游标时,由于第二游标位置暂时固定,因而在滑动第三游标的过程中,第三游标对应的第三目标页面无论怎样变化,也是在第二游标对应的第二采样时刻之后用户阅览过的页面。
在上述(1)、(2)两种情况中,当游标在时间轴上滑动时,显示区域1内显示的目标页面按照用户阅览的时间顺序自动进行跳转,并且显示目标页面上对应的标记状态,标记状态包括目标页面上对用户视点进行的标记,因而该过程可以相当于通过时间轴“回滚”已标记的用户视点。借助时间轴和游标“回滚”已标记的用户视点,能够帮助用户按照时间顺序回顾自己的视觉轨迹,以及对屏显内容的认知过程,迅速定位用户希望回头寻找的特定内容,提高阅览效率。
其中,当时间轴上设置有一个游标时,用户可以借助滑动游标,回顾游标位置对应的采样时刻至初始时刻已标记的用户视点;当时间轴上设置有两个游标时,用户可以借助滑动游标,回顾两个游标位置分别对应的采样时刻之间已标记的用户视点。与时间轴上仅设置有一个游标相比,当时间轴上设置有两个游标时,可以便于用户回顾特定时间段内的已标记用户视点,提高用户体验。
示例性的,用户在阅览某份文档时,若看到某一部分B的内容和自己在几分钟前看到的另一部分A互成印证,需要回顾先前那一部分A,那么由于在用户阅览顺序上A在B之前,因而可以往回滑动时间轴上的游标,按时序逆向找到A。而通过现有技术中常用的回滚文本的方法则要笨拙得多,不仅因为按照文本排列顺序A不一定就在B之前(例如A在页面3,B在页面1),而且即使按照文本排列顺序A就在B前(例如A在页面1,B在页面3),回滚文本也意味着需要途径许多用户根本没看过或没有识别的内容,其回滚文本的长度超过使用时间轴上的游标来回滚用户视点的长度,从而降低了用户阅览效率,也降低了用户的体验。例如,A在页面1,B在页面3,且用户没有看过页面2,从B回顾A的过程中,回滚文本需要经过页面2,回滚已标记的用户视点则会直接从页面3跳转到页面1,而不会经过页面2。
此外,在本发明实施例提供的标记方法中,在屏显设备重启之后,在显示区域1内打开重启之前打开过的阅览对象时,阅览对象上可以保持重启之前的标记状态,并在需要时清空之前所做的标记;或者,在重启之 后也可以直接清空重启之前阅览对象上所做的标记,这里不做具体限定。
本发明实施例提供一种标记方法,屏显设备根据有效视点的视点区域的重叠区域对应的重叠次数,对重叠区域进行区别标记,以标识重叠区域对应的屏显内容被关注的不同程度,突显用户反复阅览的重点内容,便于用户迅速回顾要点以及快速发现理解上的盲点;并且通过时间轴和游标回顾已标记用户视点,便于用户按时间顺序回顾自己的视觉轨迹以及对屏显内容的认知过程,迅速定位希望回头寻找的特定内容,从而进一步提高了用户的阅览效率。
实施例3
本发明实施例提供一种屏显设备200,可以用于执行上述实施例1和实施例2提供的标记方法。参见图19,该屏显设备200可以包括:
显示单元201,可以用于在显示屏上的显示区域内打开阅览对象,显示屏上包括至少一个显示区域。
确定单元202,可以用于确定有效视点,有效视点为落在显示区域内的用户视点中排列密集的多个连续的用户视点。
标记单元203,可以用于标记有效视点。
其中,确定单元202可以具体用于:
若落在显示区域内的连续k个用户视点中,任意两个相邻用户视点之间的距离小于或者等于预设距离阈值,则确定连续k个用户视点为有效视点,其中,k为预设正整数。
此外,确定单元202还可以用于:
在标记单元203标记有效视点之前,确定有效视点对应的视点区域,其中,每个有效视点对应一个视点区域,视点区域为以有效视点为中心,具有预设大小和预设形状的区域。
可选地,标记单元203可以具体用于:
在有效视点的视点区域内填充预设颜色的透明色块。
进一步地,标记单元203可以具体用于:
若确定不同有效视点对应的视点区域的覆盖范围发生重叠,则根据重叠区域对应的重叠次数对重叠区域进行标记,并在重叠区域以外的视点区域内,填充预设颜色的透明色块。
或者,标记单元203可以具体用于:
在重叠区域内填充透明色块,透明色块的颜色与重叠区域的重叠次数相对应。
可选地,标记单元203可以具体用于:
在重叠区域的对应位置显示重叠次数标识。
可选地,阅览对象对应的内容上覆盖有预设颜色的透明涂层,标记单元203可以具体用于:
擦除透明涂层中视点区域对应的区域。
参见图20,该屏显设备200还可以包括:
保存单元204,可以用于保存落在显示区域内的用户视点的采样时刻,用户视点对应的显示区域,用户视点对应的屏显内容所属的阅览对象的身份标识,以及用户视点相对于阅览对象的坐标之间的映射关系。
其中,显示区域可以包括至少一个子区域,每个子区域用于显示阅览对象中的一个页面。
此外,所示显示单元201还可以用于:
在显示区域内打开阅览对象后,显示时间轴,时间轴上设置有至少一个游标。
可选地,显示区域内的时间轴上可以设置有第一游标;
确定单元202还可以用于,在时间轴上的第一游标发生滑动时,确定第一游标的游标位置对应的第一采样时刻;根据映射关系,确定与显示区域和第一采样时刻对应的第一身份标识和第一坐标;
显示单元201还可以用于,在显示区域内,显示第一身份标识对应的阅览对象中,第一坐标对应的第一目标页面在第一采样时刻对应的用户视点的标记状态。
可选地,显示区域内的时间轴上可以设置有第二游标和第三游标,第二游标位于时间轴上靠近初始时刻的一侧;
确定单元202还可以用于,在时间轴上的第二游标发生滑动时,确定第二游标的游标位置对应的第二采样时刻,以及第三游标的游标位置对应的第三采样时刻;根据映射关系,确定与显示区域和第二采样时刻对应的第二身份标识和第二坐标;
显示单元201还可以用于,在显示区域内,显示第二身份标识对应的阅览对象中,在第二采样时刻之后且在第三采样时刻之前,第二坐标对应的第二目标页面所对应的用户视点的标记状态;
确定单元202还可以用于,在时间轴上的第三游标发生滑动时,确定第三游标的游标位置对应的第三采样时刻;根据映射关系,确定与显示区域和第三采样时刻对应的第三身份标识和第三坐标;
显示单元201还可以用于,在显示区域内,显示第三身份标识对应的阅览对象中,在第三采样时刻之前且在第二采样时刻之后,第三坐标对应的第三目标页面所对应的用户视点的标记状态。
进一步地,若显示区域内包括至少两个子区域,则在时间轴上的游标发生滑动时,显示单元201可以具体用于:
在第一子区域内显示目标页面,目标页面与游标位置相对应,并在第二子区域内显示根据标记顺序排在目标页面之前/后的一个页面。
本发明实施例提供的一种屏显设备,在屏显设备显示屏上的显示区域内打开阅览对象以供用户进行阅览时,屏显设备可以自动标记落在显示屏上的排列密集的多个连续视点,标记的该多个连续视点为用户有足够的时间识别和理解其对应的屏显内容的有效视点,从而可以准确地区分用户已识别屏显内容和未识别屏显内容,有效地引导用户阅览未识别屏显内 容,提高用户的阅览效率。
而且,屏显设备通过标记有效视点,可以及时标记用户阅览过程中的临时中断点,从而帮助用户在中断后快速返回到中断点继续阅览,从而可以进一步提供用户的阅览效率。
需要说明的是,本发明实施例中的确定单元202和标记单元203可以为单独设立的处理器,也可以集成在屏显设备的某一个处理器中实现,此外,也可以以程序代码的形式存储于屏显设备的存储器中,由屏显设备200的某一个处理器调用并执行以上确定单元202和标记单元203的功能。这里的处理器可以是一个中央处理器(Central Processing Unit,CPU),微处理器,或者是特定集成电路(Application Specific Integrated Circuit,ASIC),或者是被配置成实施本发明实施例的一个或多个集成电路。
实施例4
本发明实施例提供一种屏显设备200,参见图21,该屏显设备200采用通用计算机系统结构,执行本发明方案的程序代码保存在存储器中,并由处理器来控制执行。屏显设备200可以包括总线214,显示屏211,处理器212,存储器213等。其中,总线214可包括数据总线、电源总线、控制总线、状态信号总线等,但是为了清楚说明起见,在图21中将各种总线都标为一条总线,用于在计算机各个部件之间传送信息。显示屏211,可以用于实现上述实施例3中显示单元的功能。存储器213,可以是只读存储器read-only memory(ROM)或可存储静态信息和指令的其他类型的静态存储设备,随机存取存储器random access memory(RAM)或者可存储信息和指令的其他类型的动态存储设备,也可以是磁盘存储器。存储器213通过总线与处理器212相连接,用于保存操作系统和执行本发明方案的程序,具体可以执行上述实施例2中保存单元的功能。操作系统是用于控制其他程序运行,管理系统资源的程序。执行本发明方案的程序代码保存在存储器213中,并由处理器212来控制执行。
存储器213中存储的程序用于指令处理器212实现上述实施例1和实施例2描述的标记方法。具体可以包括:
显示屏211,可以用于在显示屏211上的显示区域内打开阅览对象,显示屏211上包括至少一个显示区域。
处理器212,可以用于确定有效视点,有效视点为落在显示区域内的用户视点中排列密集的多个连续的用户视点;标记有效视点。
其中,处理器212用于确定有效视点具体可以包括:
若落在显示区域内的连续k个用户视点中,任意两个相邻用户视点之间的距离小于或者等于预设距离阈值,则确定连续k个用户视点为有效视点,其中,k为预设正整数。
处理器212在标记有效视点之前,还可以用于:
确定有效视点对应的视点区域,其中,每个有效视点对应一个视点区域,视点区域为以有效视点为中心,具有预设大小和预设形状的区域。
可选地,处理器212用于标记有效视点具体可以包括:
在有效视点的视点区域内填充预设颜色的透明色块。
可选地,处理器212用于标记有效视点具体可以包括:
若确定不同有效视点对应的视点区域的覆盖范围发生重叠,则根据重叠区域对应的重叠次数对重叠区域进行标记,并在重叠区域以外的视点区域内,填充预设颜色的透明色块。
进一步地,处理器212用于根据重叠区域对应的重叠次数对重叠区域进行标记具体可以包括:
在重叠区域内填充透明色块,透明色块的颜色与重叠区域的重叠次数相对应。
或者,处理器212用于根据重叠区域对应的重叠次数对重叠区域进行标记具体可以包括:
在重叠区域的对应位置显示重叠次数标识。
可选地,阅览对象对应的内容上覆盖有预设颜色的透明涂层,处理器212用于标记有效视点具体可以包括:
擦除透明涂层中视点区域对应的区域。
此外,处理器212还可以用于:
以区别于有效视点的标记形式标记无效视点,无效视点为落在显示区域内的用户视点中,除有效视点以外的用户视点。
进一步地,存储器213可以用于,保存落在显示区域内的用户视点的采样时刻,用户视点对应的显示区域,用户视点对应的屏显内容所属的阅览对象的身份标识,以及用户视点相对于阅览对象的坐标之间的映射关系。
其中,显示区域可以包括至少一个子区域,每个子区域用于显示阅览对象中的一个页面。
更进一步地,显示屏211还可以用于:
在显示区域内打开阅览对象后,显示时间轴,时间轴上设置有至少一个游标。
可选地,显示区域内的时间轴上可以设置有第一游标;
处理器212还可以用于,在时间轴上的第一游标发生滑动时,确定第一游标的游标位置对应的第一采样时刻;根据映射关系,确定与显示区域和第一采样时刻对应的第一身份标识和第一坐标;
显示屏211还可以用于,在显示区域内,显示第一身份标识对应的阅览对象中,第一坐标对应的第一目标页面在第一采样时刻对应的用户视点的标记状态。
可选地,显示区域内的时间轴上可以设置有第二游标和第三游标,第二游标位于时间轴上靠近初始时刻的一侧;
处理器212还可以用于,在时间轴上的第二游标发生滑动时,确定第二游标的游标位置对应的第二采样时刻,以及第三游标的游标位置对应的第三采样时刻;根据映射关系,确定与显示区域和第二采样时刻对应的第二身份标识和第二坐标;
显示屏211还可以用于,在显示区域内,显示第二身份标识对应的阅览对象中,在第二采样时刻之后且在第三采样时刻之前,第二坐标对应的第二目标页面所对应的用户视点的标记状态;
处理器212还可以用于,在时间轴上的第三游标发生滑动时,确定第三游标的游标位置对应的第三采样时刻;根据映射关系,确定与显示区域和第三采样时刻对应的第三身份标识和第三坐标;
显示屏211还可以用于,在显示区域内,显示第三身份标识对应的阅览对象中,在第三采样时刻之前且在第二采样时刻之后,第三坐标对应的第三目标页面所对应的用户视点的标记状态。
另外,若显示区域内包括至少两个子区域,则在时间轴上的游标发生滑动时,显示屏211具体可以用于:
在第一子区域内显示目标页面,目标页面与游标位置相对应,并在第二子区域内显示根据标记顺序排在目标页面之前/后的一个页面。
本发明实施例提供的一种屏显设备,在屏显设备显示屏上的显示区域内打开阅览对象以供用户进行阅览时,屏显设备可以自动标记落在显示屏上的排列密集的多个连续视点,标记的该多个连续视点为用户有足够的时间识别和理解其对应的屏显内容的有效视点,从而可以准确地区分用户已识别屏显内容和未识别屏显内容,有效地引导用户阅览未识别屏显内容,提高用户的阅览效率。
而且,屏显设备通过标记有效视点,可以及时标记用户阅览过程中的临时中断点,从而帮助用户在中断后快速返回到中断点继续阅览,从而可以进一步提供用户的阅览效率。
在本申请所提供的几个实施例中,应该理解到,所揭露的设备和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相 互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。另外,在本发明各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理包括,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用硬件加软件功能单元的形式实现。
上述以软件功能单元的形式实现的集成的单元,可以存储在一个计算机可读取存储介质中。上述软件功能单元存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本发明各个实施例所述方法的部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(Read-Only Memory,简称ROM)、随机存取存储器(Random Access Memory,简称RAM)、磁碟或者光盘等各种可以存储程序代码的介质。
关于装置、系统或设备的一些具体功能可参照之前方法实施例的描述。
最后应说明的是:以上实施例仅用以说明本发明的技术方案,而非对其限制;尽管参照前述实施例对本发明进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本发明各实施例技术方案的精神和范围。

Claims (45)

  1. 一种标记方法,其特征在于,包括:
    在显示屏上的显示区域内打开阅览对象,所述显示屏上包括至少一个所述显示区域;
    确定有效视点,所述有效视点为落在所述显示区域内的用户视点中排列密集的多个连续的用户视点;
    标记所述有效视点。
  2. 根据权利要求1所述的方法,其特征在于,所述确定有效视点包括:
    若落在所述显示区域内的连续k个用户视点中,任意两个相邻用户视点之间的距离小于或者等于预设距离阈值,则确定所述连续k个用户视点为有效视点,其中,k为预设正整数。
  3. 根据权利要求2所述的方法,其特征在于,在所述标记所述有效视点之前还包括:
    确定所述有效视点对应的视点区域,其中,每个所述有效视点对应一个视点区域,所述视点区域为以所述有效视点为中心,具有预设大小和预设形状的区域。
  4. 根据权利要求3所述的方法,其特征在于,所述标记所述有效视点包括:
    在所述有效视点的视点区域内填充预设颜色的透明色块。
  5. 根据权利要求3所述的方法,其特征在于,所述标记所述有效视点包括:
    若确定不同所述有效视点对应的视点区域的覆盖范围发生重叠,则根据重叠区域对应的重叠次数对所述重叠区域进行标记,并在所述重叠区域以外的视点区域内,填充预设颜色的透明色块。
  6. 根据权利要求5所述的方法,其特征在于,所述根据重叠区域对应的重叠次数对所述重叠区域进行标记包括:
    在所述重叠区域内填充透明色块,所述透明色块的颜色与所述重叠区域的重叠次数相对应。
  7. 根据权利要求5所述的方法,其特征在于,所述根据重叠区域对应的重叠次数对所述重叠区域进行标记包括:
    在所述重叠区域的对应位置显示重叠次数标识。
  8. 根据权利要求3所述的方法,其特征在于,所述阅览对象对应的内容上覆盖有预设颜色的透明涂层,所述标记所述有效视点包括:
    擦除所述透明涂层中所述视点区域对应的区域。
  9. 根据权利要求1-8任一项所述的方法,其特征在于,所述方法还包括:
    以区别于所述有效视点的标记形式标记无效视点,所述无效视点为落在所述显示区域内的用户视点中,除所述有效视点以外的用户视点。
  10. 根据权利要求1-9任一项所述的方法,其特征在于,所述方法还包括:
    保存落在所述显示区域内的用户视点的采样时刻,用户视点对应的显示区域,用户视点对应的屏显内容所属的阅览对象的身份标识,以及用户视点相对于所述阅览对象的坐标之间的映射关系。
  11. 根据权利要求1-10任一项所述的方法,其特征在于,所述显示区域包括至少一个子区域,每个所述子区域用于显示所述阅览对象中的一个页面。
  12. 根据权利要求11所述的方法,其特征在于,所述方法还包括:
    在所述显示区域内打开阅览对象后,显示时间轴,所述时间轴上设置有至少一个游标。
  13. 根据权利要求12所述的方法,其特征在于,所述显示区域内的时间轴上设置有第一游标,所述方法还包括:
    在所述时间轴上的所述第一游标发生滑动时,确定所述第一游标的游标位置对应的第一采样时刻;
    根据所述映射关系,确定与所述显示区域和所述第一采样时刻对应的第一身份标识和第一坐标;
    在所述显示区域内,显示所述第一身份标识对应的阅览对象中,所述第一坐标对应的第一目标页面在所述第一采样时刻对应的用户视点 的标记状态。
  14. 根据权利要求12所述的方法,其特征在于,所述显示区域内的时间轴上设置有第二游标和第三游标,所述第二游标位于时间轴上靠近初始时刻的一侧,所述方法还包括:
    在所述时间轴上的所述第二游标发生滑动时,确定所述第二游标的游标位置对应的第二采样时刻,以及第三游标的游标位置对应的第三采样时刻;
    根据所述映射关系,确定与所述显示区域和所述第二采样时刻对应的第二身份标识和第二坐标;
    在所述显示区域内,显示所述第二身份标识对应的阅览对象中,在所述第二采样时刻之后且在所述第三采样时刻之前,所述第二坐标对应的第二目标页面所对应的用户视点的标记状态;
    在所述时间轴上的所述第三游标发生滑动时,确定所述第三游标的游标位置对应的第三采样时刻;
    根据所述映射关系,确定与所述显示区域和所述第三采样时刻对应的第三身份标识和第三坐标;
    在所述显示区域内,显示所述第三身份标识对应的阅览对象中,在所述第三采样时刻之前且在所述第二采样时刻之后,所述第三坐标对应的第三目标页面所对应的用户视点的标记状态。
  15. 根据权利要求13或14所述的方法,其特征在于,所述显示区域内包括至少两个子区域,在所述时间轴上的游标发生滑动时,在第一子区域内显示目标页面,所述目标页面与游标位置相对应,并在第二子区域内显示根据标记顺序排在所述目标页面之前/后的一个页面。
  16. 一种屏显设备,其特征在于,包括:
    显示单元,用于在显示屏上的显示区域内打开阅览对象,所述显示屏上包括至少一个所述显示区域;
    确定单元,用于确定有效视点,所述有效视点为落在所述显示区域内的用户视点中排列密集的多个连续的用户视点;
    标记单元,用于标记所述有效视点。
  17. 根据权利要求16所述的设备,其特征在于,所述确定单元具体用于:
    若落在所述显示区域内的连续k个用户视点中,任意两个相邻用户视点之间的距离小于或者等于预设距离阈值,则确定所述连续k个用户视点为有效视点,其中,k为预设正整数。
  18. 根据权利要求17所述的设备,其特征在于,所述确定单元还用于:
    在所述标记单元标记所述有效视点之前,确定所述有效视点对应的视点区域,其中,每个所述有效视点对应一个视点区域,所述视点区域为以所述有效视点为中心,具有预设大小和预设形状的区域。
  19. 根据权利要求18所述的设备,其特征在于,所述标记单元具体用于:
    在所述有效视点的视点区域内填充预设颜色的透明色块。
  20. 根据权利要求18所述的设备,其特征在于,所述标记单元具体用于:
    若确定不同所述有效视点对应的视点区域的覆盖范围发生重叠,则根据重叠区域对应的重叠次数对所述重叠区域进行标记,并在所述重叠区域以外的视点区域内,填充预设颜色的透明色块。
  21. 根据权利要求20所述的设备,其特征在于,所述标记单元具体用于:
    在所述重叠区域内填充透明色块,所述透明色块的颜色与所述重叠区域的重叠次数相对应。
  22. 根据权利要求20所述的设备,其特征在于,所述标记单元具体用于:
    在所述重叠区域的对应位置显示重叠次数标识。
  23. 根据权利要求18所述的设备,其特征在于,所述阅览对象对应的内容上覆盖有预设颜色的透明涂层,所述标记单元具体用于:
    擦除所述透明涂层中所述视点区域对应的区域。
  24. 根据权利要求16-23任一项所述的设备,其特征在于,所述标 记单元还用于:
    以区别于所述有效视点的标记形式标记无效视点,所述无效视点为落在所述显示区域内的用户视点中,除所述有效视点以外的用户视点。
  25. 根据权利要求16-24任一项所述的设备,其特征在于,所述设备还包括:
    保存单元,用于保存落在所述显示区域内的用户视点的采样时刻,用户视点对应的显示区域,用户视点对应的屏显内容所属的阅览对象的身份标识,以及用户视点相对于所述阅览对象的坐标之间的映射关系。
  26. 根据权利要求16-25任一项所述的设备,其特征在于,所述显示区域包括至少一个子区域,每个所述子区域用于显示所述阅览对象中的一个页面。
  27. 根据权利要求26所述的设备,其特征在于,所示显示单元还用于:
    在所述显示区域内打开阅览对象后,显示时间轴,所述时间轴上设置有至少一个游标。
  28. 根据权利要求27所述的设备,其特征在于,所述显示区域内的时间轴上设置有第一游标;
    所述确定单元还用于,在所述时间轴上的所述第一游标发生滑动时,确定所述第一游标的游标位置对应的第一采样时刻;根据所述映射关系,确定与所述显示区域和所述第一采样时刻对应的第一身份标识和第一坐标;
    所述显示单元还用于,在所述显示区域内,显示所述第一身份标识对应的阅览对象中,所述第一坐标对应的第一目标页面在所述第一采样时刻对应的用户视点的标记状态。
  29. 根据权利要求27所述的设备,其特征在于,所述显示区域内的时间轴上设置有第二游标和第三游标,所述第二游标位于时间轴上靠近初始时刻的一侧;
    所述确定单元还用于,在所述时间轴上的所述第二游标发生滑动时,确定所述第二游标的游标位置对应的第二采样时刻,以及第三游标 的游标位置对应的第三采样时刻;根据所述映射关系,确定与所述显示区域和所述第二采样时刻对应的第二身份标识和第二坐标;
    所述显示单元还用于,在所述显示区域内,显示所述第二身份标识对应的阅览对象中,在所述第二采样时刻之后且在所述第三采样时刻之前,所述第二坐标对应的第二目标页面所对应的用户视点的标记状态;
    所述确定单元还用于,在所述时间轴上的所述第三游标发生滑动时,确定所述第三游标的游标位置对应的第三采样时刻;根据所述映射关系,确定与所述显示区域和所述第三采样时刻对应的第三身份标识和第三坐标;
    所述显示单元还用于,在所述显示区域内,显示所述第三身份标识对应的阅览对象中,在所述第三采样时刻之前且在所述第二采样时刻之后,所述第三坐标对应的第三目标页面所对应的用户视点的标记状态。
  30. 根据权利要求28或29所述的设备,其特征在于,所述显示区域内包括两个子区域,在所述时间轴上的游标发生滑动时,所述显示单元具体用于:
    在第一子区域内显示目标页面,所述目标页面与游标位置相对应,并在第二子区域内显示根据标记顺序排在所述目标页面之前/后的一个页面。
  31. 一种屏显设备,其特征在于,包括:
    显示屏,用于在显示屏上的显示区域内打开阅览对象,所述显示屏上包括至少一个所述显示区域;
    处理器,用于确定有效视点,所述有效视点为落在所述显示区域内的用户视点中排列密集的多个连续的用户视点;标记所述有效视点。
  32. 根据权利要求31所述的设备,其特征在于,所述处理器用于确定有效视点具体包括:
    若落在所述显示区域内的连续k个用户视点中,任意两个相邻用户视点之间的距离小于或者等于预设距离阈值,则确定所述连续k个用户视点为有效视点,其中,k为预设正整数。
  33. 根据权利要求32所述的设备,其特征在于,所述处理器在标 记所述有效视点之前,还用于:
    确定所述有效视点对应的视点区域,其中,每个所述有效视点对应一个视点区域,所述视点区域为以所述有效视点为中心,具有预设大小和预设形状的区域。
  34. 根据权利要求33所述的设备,其特征在于,所述处理器用于标记所述有效视点具体包括:
    在所述有效视点的视点区域内填充预设颜色的透明色块。
  35. 根据权利要求33所述的设备,其特征在于,所述处理器用于标记所述有效视点具体包括:
    若确定不同所述有效视点对应的视点区域的覆盖范围发生重叠,则根据重叠区域对应的重叠次数对所述重叠区域进行标记,并在所述重叠区域以外的视点区域内,填充预设颜色的透明色块。
  36. 根据权利要求35所述的设备,其特征在于,所述处理器用于根据重叠区域对应的重叠次数对所述重叠区域进行标记具体包括:
    在所述重叠区域内填充透明色块,所述透明色块的颜色与所述重叠区域的重叠次数相对应。
  37. 根据权利要求35所述的设备,其特征在于,所述处理器用于根据重叠区域对应的重叠次数对所述重叠区域进行标记具体包括:
    在所述重叠区域的对应位置显示重叠次数标识。
  38. 根据权利要求33所述的设备,其特征在于,所述阅览对象对应的内容上覆盖有预设颜色的透明涂层,所述处理器用于标记所述有效视点具体包括:
    擦除所述透明涂层中所述视点区域对应的区域。
  39. 根据权利要求31-38任一项所述的设备,其特征在于,所述处理器还用于:
    以区别于所述有效视点的标记形式标记无效视点,所述无效视点为落在所述显示区域内的用户视点中,除所述有效视点以外的用户视点。
  40. 根据权利要求31-39任一项所述的设备,其特征在于,所述设备还包括:
    存储器,用于保存落在所述显示区域内的用户视点的采样时刻,用户视点对应的显示区域,用户视点对应的屏显内容所属的阅览对象的身份标识,以及用户视点相对于所述阅览对象的坐标之间的映射关系。
  41. 根据权利要求31-40任一项所述的设备,其特征在于,所述显示区域包括至少一个子区域,每个所述子区域用于显示所述阅览对象中的一个页面。
  42. 根据权利要求41所述的设备,其特征在于,所述显示屏还用于:
    在所述显示区域内打开阅览对象后,显示时间轴,所述时间轴上设置有至少一个游标。
  43. 根据权利要求42所述的设备,其特征在于,所述显示区域内的时间轴上设置有第一游标;
    所述处理器还用于,在所述时间轴上的所述第一游标发生滑动时,确定所述第一游标的游标位置对应的第一采样时刻;根据所述映射关系,确定与所述显示区域和所述第一采样时刻对应的第一身份标识和第一坐标;
    所述显示屏还用于,在所述显示区域内,显示所述第一身份标识对应的阅览对象中,所述第一坐标对应的第一目标页面在所述第一采样时刻对应的用户视点的标记状态。
  44. 根据权利要求42所述的设备,其特征在于,所述显示区域内的时间轴上设置有第二游标和第三游标,所述第二游标位于时间轴上靠近初始时刻的一侧;
    所述处理器还用于,在所述时间轴上的所述第二游标发生滑动时,确定所述第二游标的游标位置对应的第二采样时刻,以及第三游标的游标位置对应的第三采样时刻;根据所述映射关系,确定与所述显示区域和所述第二采样时刻对应的第二身份标识和第二坐标;
    所述显示屏还用于,在所述显示区域内,显示所述第二身份标识对应的阅览对象中,在所述第二采样时刻之后且在所述第三采样时刻之前,所述第二坐标对应的第二目标页面所对应的用户视点的标记状态;
    所述处理器还用于,在所述时间轴上的所述第三游标发生滑动时,确定所述第三游标的游标位置对应的第三采样时刻;根据所述映射关系,确定与所述显示区域和所述第三采样时刻对应的第三身份标识和第三坐标;
    所述显示屏还用于,在所述显示区域内,显示所述第三身份标识对应的阅览对象中,在所述第三采样时刻之前且在所述第二采样时刻之后,所述第三坐标对应的第三目标页面所对应的用户视点的标记状态。
  45. 根据权利要求43或44所述的设备,其特征在于,所述显示区域内包括两个子区域,在所述时间轴上的游标发生滑动时,所述显示屏具体用于:
    在第一子区域内显示目标页面,所述目标页面与游标位置相对应,并在第二子区域内显示根据标记顺序排在所述目标页面之前/后的一个页面。
PCT/CN2016/072028 2016-01-25 2016-01-25 一种标记方法及屏显设备 WO2017127991A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201680032184.7A CN107615216B (zh) 2016-01-25 2016-01-25 一种标记方法及屏显设备
PCT/CN2016/072028 WO2017127991A1 (zh) 2016-01-25 2016-01-25 一种标记方法及屏显设备

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2016/072028 WO2017127991A1 (zh) 2016-01-25 2016-01-25 一种标记方法及屏显设备

Publications (1)

Publication Number Publication Date
WO2017127991A1 true WO2017127991A1 (zh) 2017-08-03

Family

ID=59397079

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/072028 WO2017127991A1 (zh) 2016-01-25 2016-01-25 一种标记方法及屏显设备

Country Status (2)

Country Link
CN (1) CN107615216B (zh)
WO (1) WO2017127991A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111782215A (zh) * 2020-07-21 2020-10-16 致诚阿福技术发展(北京)有限公司 一种为目标对象动态添加标识特征的方法和装置

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110304606A1 (en) * 2010-06-14 2011-12-15 Oto Technologies, Llc Method and system for implementing look-ahead protection in a computing device
CN104169838A (zh) * 2012-04-12 2014-11-26 英特尔公司 基于人眼追踪而选择性地使显示器背光
WO2015026751A1 (en) * 2013-08-21 2015-02-26 Microsoft Corporation Navigating fixed format document in e-reader application

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2002322B1 (en) * 2006-03-23 2009-07-15 Koninklijke Philips Electronics N.V. Hotspots for eye track control of image manipulation
JP5694890B2 (ja) * 2011-10-04 2015-04-01 日本電信電話株式会社 注視領域データ生成装置およびその動作方法
CN103257712A (zh) * 2013-05-30 2013-08-21 苏州福丰科技有限公司 基于面部识别的阅读标记终端
CN103268152A (zh) * 2013-05-30 2013-08-28 苏州福丰科技有限公司 一种阅读方法

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110304606A1 (en) * 2010-06-14 2011-12-15 Oto Technologies, Llc Method and system for implementing look-ahead protection in a computing device
CN104169838A (zh) * 2012-04-12 2014-11-26 英特尔公司 基于人眼追踪而选择性地使显示器背光
WO2015026751A1 (en) * 2013-08-21 2015-02-26 Microsoft Corporation Navigating fixed format document in e-reader application

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111782215A (zh) * 2020-07-21 2020-10-16 致诚阿福技术发展(北京)有限公司 一种为目标对象动态添加标识特征的方法和装置

Also Published As

Publication number Publication date
CN107615216A (zh) 2018-01-19
CN107615216B (zh) 2020-06-09

Similar Documents

Publication Publication Date Title
EP3058512B1 (en) Organizing digital notes on a user interface
CN104123078B (zh) 输入信息的方法和设备
US9829984B2 (en) Motion-assisted visual language for human computer interfaces
US9916081B2 (en) Techniques for image-based search using touch controls
EP2724209B1 (en) Computer device operable with user's eye movement and method for operating the computer device
US8994674B2 (en) Information viewing apparatus, control program and controlling method
US9372874B2 (en) Content processing apparatus, content processing method, and program
US20170160799A1 (en) Eye-tracking-based methods and systems of managing multi-screen view on a single display screen
CN106484266A (zh) 一种文本处理方法及装置
US9430132B2 (en) Information processing apparatus, information processing method, and program
EP2954692B1 (en) Telestration system for command processing
CN104317474A (zh) 窗口切换方法及装置
US20140189593A1 (en) Electronic device and input method
WO2021088422A1 (zh) 应用消息的通知方法及装置
JP2008250948A (ja) 情報処理装置、情報処理方法、情報処理プログラム、情報処理プログラムを記録した記憶媒体、並びに情報表示装置
EP3100208A1 (en) Note capture and recognition with manual assist
CN105183338A (zh) 对象处理方法
TW201322049A (zh) 電子設備及其文本導讀方法
CN110968227B (zh) 智能交互平板的控制方法和装置
CN104699237A (zh) 辨识使用者操作的方法及相关互动装置与计算机可读介质
CN106383636A (zh) 一种索引信息的显示方法及装置
CN112286614A (zh) 用户界面的显示方法和装置、电子设备及存储介质
CN104571811B (zh) 一种信息处理方法及电子设备
WO2017127991A1 (zh) 一种标记方法及屏显设备
Müller et al. Designing for noticeability: Understanding the impact of visual importance on desktop notifications

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16886878

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16886878

Country of ref document: EP

Kind code of ref document: A1