WO2023030198A1 - 批注方法和电子设备 - Google Patents
批注方法和电子设备 Download PDFInfo
- Publication number
- WO2023030198A1 WO2023030198A1 PCT/CN2022/115223 CN2022115223W WO2023030198A1 WO 2023030198 A1 WO2023030198 A1 WO 2023030198A1 CN 2022115223 W CN2022115223 W CN 2022115223W WO 2023030198 A1 WO2023030198 A1 WO 2023030198A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- interface
- annotation
- application
- application interface
- user
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 120
- 230000004044 response Effects 0.000 claims abstract description 38
- 230000008569 process Effects 0.000 claims description 54
- 238000004590 computer program Methods 0.000 claims description 22
- 239000000725 suspension Substances 0.000 claims description 4
- 230000006870 function Effects 0.000 description 34
- 230000006854 communication Effects 0.000 description 30
- 238000004891 communication Methods 0.000 description 29
- 238000007667 floating Methods 0.000 description 28
- 238000007726 management method Methods 0.000 description 22
- 238000012545 processing Methods 0.000 description 18
- 241001422033 Thestylus Species 0.000 description 16
- 238000010586 diagram Methods 0.000 description 14
- 238000010295 mobile communication Methods 0.000 description 11
- 238000005516 engineering process Methods 0.000 description 8
- 230000005236 sound signal Effects 0.000 description 7
- 230000002452 interceptive effect Effects 0.000 description 5
- 229920001621 AMOLED Polymers 0.000 description 4
- 238000013528 artificial neural network Methods 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 230000001360 synchronised effect Effects 0.000 description 3
- 238000013500 data storage Methods 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 230000007774 longterm Effects 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 239000002096 quantum dot Substances 0.000 description 2
- 230000005855 radiation Effects 0.000 description 2
- 238000009877 rendering Methods 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 230000003416 augmentation Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000007175 bidirectional communication Effects 0.000 description 1
- 230000002457 bidirectional effect Effects 0.000 description 1
- 238000013529 biological neural network Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 210000000988 bone and bone Anatomy 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000019771 cognition Effects 0.000 description 1
- 239000000945 filler Substances 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 230000003862 health status Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 210000002569 neuron Anatomy 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000001568 sexual effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/0485—Scrolling or panning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04842—Selection of displayed objects or displayed text elements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/166—Editing, e.g. inserting or deleting
- G06F40/169—Annotation, e.g. comment data or footnotes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/166—Editing, e.g. inserting or deleting
- G06F40/171—Editing, e.g. inserting or deleting by use of digital ink
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/048—Indexing scheme relating to G06F3/048
- G06F2203/04803—Split screen, i.e. subdividing the display area or the window area into separate subareas
Definitions
- the present application relates to the technical field of terminals, in particular to an annotation method and electronic equipment.
- Electronic devices such as mobile phones and tablets have been increasingly used in people's work and study.
- some electronic devices provide annotation functions, through which users can annotate texts, pictures, and other content.
- the user can open the "Gallery” application program (application, APP) on the tablet to control the tablet to enter the annotation mode; after entering the annotation mode, as shown in (b) in Figure 1 It shows that the user can annotate the picture with a stylus on the annotation interface.
- a toolbar can be provided in the annotation interface, and the user can adjust the content of the annotation through the toolbar.
- the present application provides an annotation method and an electronic device, which are used to enrich the application scenarios of the annotation function and improve the flexibility of the user to perform annotation.
- the embodiment of the present application provides an annotation method, including:
- the first interface includes a first application interface and a second application interface displayed on a split screen
- the second interface In response to the first scrolling operation, display a second interface, the second interface includes a first application interface and a second application interface displayed in split screen, the second interface is different from the first interface;
- a first annotation image is generated, and the first annotation image includes: the first annotation, the second annotation, the first interface, and the second interface.
- the electronic device when it is displaying the first application interface and the second application interface on a split screen, it can receive the user's comment trigger operation, enter the comment mode, and display the comment interface (ie, the above-mentioned first interface); the first interface can continue to split the screen
- the first application interface and the second application interface are displayed, and an annotation layer can be loaded on the displayed application interface.
- the annotation layer can be transparent, and the annotation layer can also include a toolbar.
- the above-mentioned first annotation operation and second annotation operation may be annotation operations performed by the user on the screen with a stylus or fingers.
- the user inputs an upward or downward scrolling operation, and the electronic device can scroll the first application interface and/or the second application interface to realize left and right split screens. Scroll up and down annotations in screen scenes.
- the user inputs a scroll operation to the left or right, and the electronic device can scroll the first application interface and/or the second application interface to realize up and down split screens Left and right scrolling comments under the scene.
- the electronic device can enter the annotation mode in the split-screen scene for the user to make annotations.
- the annotation mode the user can make annotations on the first application interface and the second application interface displayed on the split screen , and the user can perform scrolling annotations, therefore, this method can enrich the application scenarios of the annotation function, improve the flexibility of the user's annotation, and improve the user's annotation experience.
- the displaying the second interface in response to the first scrolling operation specifically includes:
- the first application interface displayed in split screen is switched from the first sub-interface of the first application to the second sub-interface of the first application.
- the electronic device can respond to the user's scrolling operation, and update the displayed interface content of the first application interface, so that the user can scroll the interface content of the first application interface in the annotation mode, thereby improving the flexibility of the user's annotation.
- the method further includes:
- the second application interface displayed in split screen is switched from the third subinterface of the second application to the fourth subinterface of the second application.
- the first scrolling operation is an upward scrolling operation
- the first subinterface in the first annotation picture is located above the second subinterface
- the first subinterface is located above the second subinterface.
- the third sub-interface is located above the fourth sub-interface.
- the user can view the interface content behind the first application interface and the second application interface by scrolling up during the annotation process.
- the first scrolling operation is a scrolling down operation
- the first subinterface in the first annotation picture is located below the second subinterface
- the The third sub-interface is located below the fourth sub-interface.
- the user can scroll down to view the interface content in front of the first application interface and the second application interface during the annotation process.
- the first application interface is located on the left side of the second application interface
- the first sub-interface in the first annotation picture is located on the third sub-interface On the left side
- the second sub-interface is located on the left side of the fourth sub-interface
- the first application interface is located on the right side of the second application interface
- the first sub-interface in the first annotation picture is located on the right side of the third sub-interface
- the second sub-interface is located on the right side of the third sub-interface. The right side of the four sub-interface.
- the user can make scrolling annotations in the left and right split-screen scenes.
- the fourth sub-interface is a filling page. In this way, for the application interface that cannot continue to scroll, the user can use more comment space through the filled page.
- the first application interface further includes a first component fixedly displayed at the bottom of the first application interface
- the method further includes:
- the first component After receiving the user's first scrolling operation on the first interface, the first component is no longer displayed.
- the components fixedly displayed at the bottom of the first application interface such as the menu bar, are not displayed during the scrolling annotation process, so that the user can view more interface content on the screen and improve the user's annotation experience.
- the first application interface further includes a second component fixedly displayed on the top of the first application interface
- the method further includes:
- the second component After receiving the user's first scrolling operation on the first interface, the second component is no longer displayed.
- the components fixedly displayed on the top of the first application interface such as the status bar, are not displayed during the scrolling annotation process, so that the user can view more interface content on the screen and improve the user's annotation experience.
- the method further includes:
- the third interface includes a third application interface and a fourth application interface displayed on a split screen
- a second annotation image is generated, the second annotation image including: the third annotation and the third application interface.
- the electronic device can display which application interface in full screen when the user scrolls which application interface, so as to realize the upper and lower split screen scenarios. to scroll up and down annotations.
- the electronic device can display which application interface in full screen when the user scrolls which application interface, so as to realize left and right split screens. Left and right scrolling comments under the scene.
- the application scenarios of the annotation function can be further enriched, the flexibility of annotation by the user can be improved, and the annotation experience of the user can be improved.
- the method further includes:
- the fourth interface includes a fifth application interface and a sixth application interface displayed in split screen;
- a third annotation picture is generated, where the third annotation image includes: the fifth application interface, the sixth application interface and the fourth annotation displayed in full screen.
- the user can add annotations, scroll the interface, etc. on the fifth application interface.
- the annotations added on the application interface are combined into one annotation image
- the sixth application interface displayed during the annotation process and the annotations added by the user on the sixth application interface are combined into one annotation image, and then the two annotation images are stitched together and saved .
- the application scenarios of the annotation function can be further enriched, the flexibility of annotation by the user can be improved, and the annotation experience of the user can be improved.
- the method further includes:
- the fifth interface includes a seventh application interface and an eighth application interface displayed in split screen;
- the fifth annotation overlaps with the boundary line between the seventh application interface and the eighth application interface;
- a fourth annotation image and a fifth annotation image are generated;
- the fourth annotation image includes: the seventh application interface and the fifth annotation displayed in full screen, the
- the fifth comment image includes the fifth interface and the fifth comment.
- the application scenarios of the annotation function can be further enriched, the flexibility of annotation by the user can be improved, and the annotation experience of the user can be improved.
- the method further includes:
- the sixth interface includes a ninth application interface displayed in full screen and a tenth application interface displayed in suspension on the ninth application interface;
- the tenth application interface displayed in suspension is hidden or the ninth application interface and the tenth application interface are displayed on a split screen.
- the electronic device can enable the user to enter the annotation mode in the floating window scene, so as to further enrich the application scenarios of the annotation function, improve the flexibility of the user's annotation, and improve the user's annotation experience.
- an embodiment of the present application provides an electronic device, including: a memory and a processor, the memory is used to store a computer program; the processor is used to execute the above-mentioned first aspect or any implementation manner of the first aspect when calling the computer program the method described.
- the embodiments of the present application provide a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the method described in the above-mentioned first aspect or any implementation manner of the first aspect is implemented.
- an embodiment of the present application provides a computer program product, which, when running on an electronic device, causes the electronic device to execute the method described in the first aspect or any implementation manner of the first aspect.
- the embodiment of the present application provides a chip system, including a processor, the processor is coupled with the memory, and the processor executes the computer program stored in the memory, so as to realize the above-mentioned first aspect or any of the first aspects.
- the chip system may be a single chip, or a chip module composed of multiple chips.
- Figure 1 is a schematic diagram of an existing annotation scene
- Fig. 2 is a schematic flow chart of the annotation method provided by the embodiment of the present application.
- FIG. 3 is a schematic diagram of an annotation scene provided by an embodiment of the present application.
- FIG. 4 is a schematic diagram of the floating menu triggering process provided by the embodiment of the present application.
- FIGS. 5 to 17 are schematic diagrams of some annotation scenarios provided by the embodiments of this application.
- FIG. 18 is a schematic structural diagram of an interactive system provided by an embodiment of the present application.
- FIG. 19 is a schematic diagram of the software architecture of the electronic device provided by the embodiment of the present application.
- Fig. 20 is a schematic diagram of the principle of scrolling annotation provided by the embodiment of the present application.
- FIG. 21 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.
- Fig. 22 is a schematic structural diagram of an annotation device provided by an embodiment of the present application.
- the embodiment of the present application provides a technical solution, in which the electronic device can enter the annotation mode in a multi-window scene for the user to make annotations.
- the above-mentioned electronic device may be a display device such as a mobile phone, a tablet, a notebook computer, an e-reader, etc., which is not particularly limited in this embodiment of the present application. .
- the windows included in the multi-window scene can be two or more, and the multiple windows included in the multi-window scene can be arranged horizontally (for example, a left-right split-screen scene), or vertically (for example, a top-bottom split-screen scene), It can also be arranged overlappingly (such as a floating window scene).
- the technical solution of the present application will be described below by taking the left and right split screen scene, the top and bottom split screen scene, and the floating window scene as examples.
- FIG. 2 is a schematic flow chart of the annotation method provided by the embodiment of the present application. As shown in Figure 2, the annotation method provided by this embodiment may include the following steps:
- S110 Display a split-screen interface, where the split-screen interface includes a first application interface and a second application interface arranged horizontally.
- the first application interface is the application interface of the "Gallery” APP
- the second application interface is the application interface of the "Memorandum” APP
- the "Gallery” APP and the “Memo” APP are displayed on the left and right split screens
- the first application interface is located on the left side of the second application interface.
- the following description will also take this positional relationship as an example.
- the application interface of the same APP can also be displayed in the left and right split screens, that is, the APPs corresponding to the first application interface and the second application interface can be the same, and the user can control the first application interface and the second application interface to display the same or For different content, this display mode can also be called parallel horizon.
- the left and right split screens can also divide the application interface of the same APP into columns.
- the first application interface and the second application interface are used as different APP interface
- the application interface is taken as an example for illustration.
- the annotation triggering operation may be an operation performed by the user on the screen of the electronic device.
- annotation triggering operation may be a triggering operation on a target control in the floating menu.
- the electronic device can display a floating menu 10 on the screen after establishing a connection with the stylus, and an annotation control (ie, a target control) can be provided in the floating menu 10, and the user can click on the The control triggers the electronics to enter annotation mode.
- an annotation control ie, a target control
- FIG. 4 shows another implementation of the floating menu.
- the user can slide inward from the first corner of the screen (here, the upper right corner for example) to open the floating menu 10.
- the floating menu 10 can be in a semi-circular shape and displayed along the upper and right edges of the screen; similar to FIG. 3 , a comment control can be provided in the floating menu 10, and the user can Clicking on the control triggers the electronic device to enter annotation mode.
- the annotation triggering operation may include an operation of triggering the electronic device to display a floating menu and an operation of clicking an annotation control.
- the operation of triggering the electronic device to display the floating menu is not limited to the above-mentioned operation of sliding in from the upper right corner of the screen, and may also be other operations.
- the device displays a floating menu.
- the user can trigger the electronic device to close the floating menu by clicking an area outside the floating menu or performing other operations.
- other functional controls may also be provided in the floating menu, and here, the control corresponding to function A is exemplarily included.
- some functional controls can be displayed in the floating menu, for example, two functional controls are displayed, and other functional controls can be hidden. The user can slide upward or downward along the extension direction of the floating menu to control Function controls displayed in the floating menu.
- the comment triggering operation performed by the user on the screen of the electronic device may also be a preset gesture operation.
- the user can slide in from the second corner (such as the lower left corner) of the screen to trigger the electronic device to enter the comment mode; the user may also execute The target's air gesture operation triggers the electronic device to enter the annotation mode.
- This embodiment does not specifically limit the gesture operation.
- the touch operation performed on the screen of the electronic device may be a touch operation performed by the user through a finger, or a touch operation performed by the user through a stylus.
- the stylus is used as an example. sexual description.
- annotation triggering operation may also be an operation performed by the user on the stylus.
- the user can double-click the pen shaft of the stylus, shake the pen shaft or press a target button on the stylus to trigger the electronic device to enter the annotation mode.
- the displayed first annotation interface may include the interface content 21 of the split-screen interface and the annotation layer covering the interface content 21 .
- the annotation layer may include a transparent area 22 and a toolbar 23 .
- the user can view the interface content 21 under the annotation layer through the transparent area 22 , and make annotations on the interface content 21 in the transparent area 22 .
- Toolbar 23 is provided with functional options for adjusting the annotation content, and (b) in Figure 3 exemplarily shows several functional options, which are in turn from left to right: the option to exit the annotation mode, the option to adjust the thickness of the line , an option to adjust the line color, an eraser option, and an option to save annotations.
- function options in the toolbar 23 are not limited to the options shown in FIG. 3 , and may include more or less options, which is not particularly limited in this embodiment.
- the toolbar 23 can be positioned at the bottom of the first annotation interface by default, and the user can also drag the toolbar 23 to change the position of the toolbar 23 .
- the user can add annotations (that is, the first annotation) to the interface content 21 in the transparent area 22 through the stylus, and the electronic device can display in real time the content added by the user. comments.
- annotations that is, the first annotation
- the user can select the function options in the toolbar 23 to adjust the thickness and color of the annotation lines or erase the annotation lines.
- the user may input an operation of scrolling the screen (ie, a scrolling operation) on the screen.
- the electronic device receives the scrolling operation input by the user, it can scroll the interface and update the interface content displayed in the annotation interface; then, the user can continue to add annotations on the scrolled annotation interface (ie, the second annotation interface) (i.e. the second annotation); after completing the annotation, the annotation can be saved by the option of saving the annotation in the toolbar 23, or the electronic device can automatically save the application interface and the user's display in the annotation process after each annotation operation is completed by the user.
- the user saves the annotation through the toolbar 23 as an example for illustration.
- the scrolling operation may be an up-swipe operation or a slide-down operation performed by the user on the screen, or a left-swipe operation or a right-swipe operation performed by the user on the screen, wherein the scroll annotation process corresponding to various scroll operations is similar,
- the main difference lies in the different scrolling directions.
- the following swipe up operation is taken as an example for illustration.
- the electronic device may scroll and display the first application interface and the second application interface synchronously.
- the following examples illustrate several possible scrolling annotation scenarios.
- the interface content of the first application interface can be scrolled, such as email APP, weather APP, etc.
- the interface content included in the application interface of these APPs is usually not enough to be displayed on the screen.
- the interface content of the second application interface cannot be scrolled, such as calculator APP, compass APP, etc.
- the interface content included in the application interface can usually be completely displayed on the screen, that is, the interface content has reached the bottom, and when the APP responds to the user's scrolling operation, the interface content does not scroll in the application interface.
- the interface content displayed in the first annotation interface before scrolling includes: the interface content 1-1 of the first application interface and the interface content 2 of the second application interface;
- the annotation content includes: A batch of annotations, wherein the first annotation is located in the central area of the screen, and the first annotation straddles the interface content 1-1 and interface content 2, and the first annotation in the subsequent scene 02 to scene 06 in the first annotation interface
- the location is also described as an example.
- the electronic device can scroll up the interface content of the first application interface and the interface content of the second application interface, and scroll the annotation layer synchronously.
- the interface content of the first application interface can be scrolled, and new interface content can be displayed during the scrolling process; the interface content of the second application interface cannot be scrolled, that is, the interface content has reached the bottom.
- the bottom of the interface content of the second application interface is filled with preset content.
- the filling content may be a white page or a background page of the second application interface, etc. In this embodiment, the white page is taken as an example for illustration.
- the electronic device scrolls up the interface content of the first application interface, the interface content of the second application interface and the annotation layer, and in the second annotation interface displayed after scrolling, the first application interface From top to bottom, the interface content in may include: the partial interface content 1-1 of the first application interface displayed in the first annotation interface and the newly displayed interface content 1-2 of the first application interface;
- the interface content from top to bottom may include: the partial interface content 2 of the second application interface displayed in the first annotation interface and the filling content of the second application interface; the first annotation scrolls up synchronously, moving from the middle area of the screen to the bottom of the screen upper area.
- the user can continue to add a second annotation in the second annotation interface, as shown in (b) in Figure 5, the second annotation is located on the newly displayed interface content in the second annotation interface, and the second annotation horizontally The area where the interface content 1-2 of the first application interface is located and the area where the filling content of the second application interface is located. It can be understood that, in the scrolled second annotation interface, the user may also add annotations on the interface content 1 - 1 of the first application interface and the interface content 2 of the second application interface.
- the user can input the annotation save operation to save the annotation interface.
- the electronic device After the electronic device receives the user's annotation saving operation, it can combine the interface content of the first application interface displayed during the entire annotation process, the interface content of the second application interface and the annotation in the annotation layer, and the obtained annotation The picture is saved.
- the interface content of the first application interface may include from top to bottom: all interface contents 1-1 and 1-1 of the first application interface displayed in the first annotation interface
- the interface content of the second application interface may include from top to bottom: all interface contents 2 and 2 of the second application interface displayed in the first annotation interface
- the annotation content may include, from top to bottom: the first annotation and the second annotation added by the user.
- the electronic device when the electronic device saves the commented picture, it can save the commented picture in the default path, for example, it can be saved in the photo album or in the memo; the user can also set the saving path, such as selecting the option of saving the comment in the toolbar 23 Finally, the electronic device may display a pop-up window for the user to set a saving path, and then save the annotation picture in the path set by the user.
- the electronic device after the electronic device generates the commented picture, it can also display a preview interface. For example, it can display the commented picture through a pop-up window in the preview interface in a manner similar to that of a screenshot. Operation, you can save the commented picture in the default path; if you receive the operation of clicking the commented picture by the user within the preset time, you can display the picture editing interface.
- the picture editing interface can include the commented picture and some editing controls, for example, delete the control , save control, mosaic control, and share control, etc., users can delete the commented picture in the picture editing interface, or save and/or share the picture after relevant editing.
- the newly displayed content of interface scrolling is related to the sliding distance in the scrolling operation. Therefore, the interface content in the second annotation interface displayed after scrolling can be all or equal to the interface content in the first annotation interface displayed before scrolling.
- this embodiment uses partly different as an example for illustration.
- the tool bar 23 is omitted in (a) and (b) in FIG. 5 , and subsequent figures are similar.
- Scene 02 Refer to (a) in Figure 6, the interface content of the first application interface and the second application interface can be scrolled, and the interface content displayed in the first annotation interface before scrolling includes: interface content 1 of the first application interface -1 and interface content 2-1 of the second application interface.
- the electronic device can scroll up the interface content of the first application interface, the interface content of the second application interface and the annotation layer.
- the interface contents of the first application interface and the second application interface can be scrolled, and new interface contents can be displayed during the scrolling process.
- the interface content in the first application interface may include from top to bottom: the part of the first application interface displayed in the first annotation interface The interface content 1-1 and the newly displayed interface content 1-2 of the first application interface; the interface content in the second application interface may include from top to bottom: part of the interface content of the second application interface displayed in the first annotation interface 2-1 and the interface content 2-2 of the newly displayed second application interface; the first annotation scrolls up synchronously, moving from the middle area of the screen to the upper area of the screen.
- the user can save the annotation interface after adding the second annotation in the second annotation interface, wherein the second annotation spans the interface content 1-2 of the first application interface and the second The interface content of the application interface is on 2-2.
- the interface content of the first application interface may include from top to bottom: the first annotation displayed in the first annotation interface All interface content 1-1 of an application interface and the interface content 1-2 of the first application interface newly displayed in the second annotation interface;
- the interface content of the second application interface may include from top to bottom: displayed in the first annotation interface The entire interface content 2-1 of the second application interface and the interface content 2-2 of the second application interface newly displayed in the second annotation interface;
- the annotation content may include from top to bottom: the first annotation added by the user and the second annotation.
- the application interface of some APPs will include one or more components with fixed positions. When the APP responds to the scrolling operation, the positions of these components will not move accordingly; among them, the interface content of some components can be scrolled, and the interface content of some components cannot be scrolled. , for example, the text content in the gallery APP, contact APP, memo APP, etc. can be scrolled, but the content in the navigation bar and menu bar cannot be scrolled; some apps include toolbars, and the content in the toolbar is usually not scrollable; Each component can include one or more controls.
- the position and other content of the control in this component can be moved when the APP responds to the user's scrolling operation; for the interface content, it cannot
- a scrollable component referred to as a non-scrollable component
- the position and other content of the controls in the component do not move when the APP responds to the user's scrolling operation.
- the interface can be filled at the bottom of the content of the non-scrollable component when scrolling; if the non-scrollable component is at the bottom or top of the scrollable component, the interface content of the non-scrollable component can be fixedly displayed when scrolling , or you can hide and display the interface content of the non-scrollable component.
- interface padding may be performed at the bottom of the interface content of the APP.
- the application interface of the first application includes components 1 and 3 arranged horizontally, and component 3 is located on the left side of component 1; the application interface of the second application includes component 2, Among them, the interface content in component 1 and component 2 can be scrolled, and the interface content in component 3 cannot be scrolled.
- component 1 is the component corresponding to the content area in the first application interface, and the text content is displayed in component 1; component 3 It is the side toolbar in the first application interface.
- the interface content in component 1 can be scrolled accordingly, and the interface content in component 3 remains unchanged.
- the interface content displayed in the first annotation interface before scrolling includes: interface content 1-1 of component 1, interface content 2-1 of component 2, and interface content 3 of component 3;
- the content of the annotation includes: the first annotation, wherein, the first A comment is located in the central area of the screen, and the first comment straddles the interface content 1-1 and the interface content 2-1.
- the electronic device can scroll up the interface content of component 1, the interface content of component 2, the interface content of component 3 and the annotation layer.
- the interface content of component 1 and component 2 can be scrolled, and new interface content can be displayed during the scrolling process; the interface content of component 3 cannot be scrolled, and the interface can be filled.
- the interface content in the first application interface may include left and right parts, wherein the right part may include from top to bottom: Part of the interface content 1-1 of component 1 displayed in the first annotation interface and the interface content 1-2 of the newly displayed component 1; the left part of the content may include from top to bottom: part of the interface of component 3 displayed in the first annotation interface Filler content for content3 and component3.
- the interface content in the second application interface may include from top to bottom: part of the interface content 2-1 of the second application displayed in the first annotation interface and the newly displayed interface content 2-2 of the second application; the synchronization of the first annotation Scroll up to move from the middle area of the screen to the upper area of the screen.
- the user can save the annotation interface after adding the second annotation in the second annotation interface, wherein the second annotation spans the interface content 1-2 of the first application interface and the second The interface content of the application interface is on 2-2.
- the interface content of the first application interface may include left and right parts, wherein the right part is from top to bottom.
- the following may include: the entire interface content 1-1 of the first application displayed in the first annotation interface and the interface content 1-2 of the first application newly displayed in the second annotation interface; the content of the left part may include from top to bottom: The entire interface content 3 of component 3 displayed in the first annotation interface and the filling content of component 3 displayed in the second annotation interface.
- the interface content of the second application interface may include from top to bottom: all interface content 2-1 of the second application displayed in the first annotation interface and interface content 2-2 of the second application newly displayed in the second annotation interface;
- the annotation content may include, from top to bottom: the first annotation and the second annotation added by the user.
- Scenario 04 See (a) in Figure 8, the application interface of the first application includes components 1 and 3 arranged vertically, and component 3 is located at the bottom of component 1, for example, component 3 is the menu in the first application interface column; the application interface of the second application includes component 2, wherein the interface content of component 1 can be scrolled, and the interface content of component 2 and component 3 cannot be scrolled.
- the interface content displayed on the first annotation interface before scrolling includes: interface content 1-1 of component 1, interface content 2 of component 2, and interface content 3 of component 3.
- the electronic device can scroll up the interface content of component 1, the interface content of component 2 and the annotation layer, and hide and display the interface content of component 3.
- the interface content of component 1 can be scrolled, and new interface content can be displayed during the scrolling process; the interface content of component 2 cannot be scrolled, and the interface can be filled.
- the interface content in the first application interface may include from top to bottom: part of the interface content of component 1 displayed in the first annotation interface 1-1 and the interface content 1-2 of the newly displayed component 1;
- the interface content in the second application interface may include from top to bottom: part of the interface content 2 of the second application displayed in the first annotation interface and the second application Filling content of ;
- the first comment scrolls up synchronously, moving from the middle area of the screen to the upper area of the screen.
- the user can save the annotation interface after adding the second annotation in the second annotation interface, wherein the second annotation spans the interface content 1-2 and the second application interface of the first application interface.
- the interface content of the first application interface may include from top to bottom: the first annotation displayed in the first annotation interface All interface content 1-1 of an application, interface content 1-2 of the first application newly displayed in the second annotation interface, and all interface content 3 of component 3 displayed in the first annotation interface;
- interface content of the second application interface From top to bottom may include: the entire interface content 2 of the second application displayed in the first annotation interface and the filling content displayed in the second annotation interface; the annotation content may include the first annotation and the second annotation added by the user from top to bottom annotation.
- Scenario 05 Referring to (a) in Figure 9, the application interface of the first application includes component 1 and component 3 arranged vertically, component 3 is located at the bottom of component 1, and the application interface of the second application includes component 2, where , the interface content in component 1 and component 2 can be scrolled, and the interface content in component 3 cannot be scrolled.
- the interface content displayed in the first annotation interface before scrolling includes: interface content 1-1 of component 1, interface content 2-1 of component 2 and interface content 3 of component 3.
- the electronic device can scroll up the interface content of component 1, the interface content of component 2 and the annotation layer, and hide and display the interface content of component 3.
- the interface content of component 1 and component 2 can be scrolled, and new interface content can be displayed during the scrolling process.
- the interface content in the first application interface may include from top to bottom: part of the interface content of component 1 displayed in the first annotation interface 1-1 and the interface content 1-2 of the newly displayed component 1;
- the interface content in the second application interface may include from top to bottom: part of the interface content 2-1 of the second application displayed in the first annotation interface and the new The displayed interface content 2-2 of the second application;
- the first annotation scrolls up synchronously, moving from the middle area of the screen to the upper area of the screen.
- the user can save the annotation interface after adding the second annotation in the second annotation interface, wherein the second annotation spans the interface content 1-2 and the second application interface of the first application interface.
- the interface content of the application interface is on 2-2.
- the interface content of the first application interface may include from top to bottom: the first annotation displayed in the first annotation interface All interface content 1-1 of an application, interface content 1-2 of the first application newly displayed in the second annotation interface, and all interface content 3 of component 3 displayed in the first annotation interface; interface content of the second application interface From top to bottom, it may include: the entire interface content 2-1 of the second application displayed in the first annotation interface, the interface content 2-2 of the second application newly displayed in the second annotation interface, and the new interface corresponding to component 3.
- the displayed interface content 2-3 of the second application; the annotation content may include the first annotation and the second annotation added by the user from top to bottom.
- the interface content of component 3 when saving, if the interface content of component 3 is spliced at the bottom of the interface content 1-2 of component 1, a part of the interface content can be displayed after the interface content 2-2 of component 2, so that the saved annotation
- the lengths of the first application interface and the second application interface in the picture are the same. It can be understood that the interface padding can also be performed at the bottom of the interface content 2-2 of the component 2.
- Scenario 06 See (a) in Figure 10, the application interface of the first application includes vertically arranged components 1 and 3, component 3 is located at the bottom of component 1, and the application interface of the second application includes vertically arranged Component 2 and Component 4, Component 4 is located at the bottom of Component 2, where the interface content in Component 1 and Component 2 can be scrolled, and the interface content in Component 3 and Component 4 cannot be scrolled.
- the interface content displayed on the first annotation interface before scrolling includes: interface content 1-1 of component 1, interface content 2-1 of component 2, interface content 3 of component 3, and interface content 4 of component 4.
- the electronic device can scroll up the interface content of component 1, the interface content of component 2 and the annotation layer, and hide and display the interface content of component 3 and component 4.
- the interface content of component 1 and component 2 can be scrolled, and new interface content can be displayed during the scrolling process.
- the interface content in the first application interface may include from top to bottom: part of the interface content of component 1 displayed in the first annotation interface 1-1 and the interface content 1-2 of the newly displayed component 1;
- the interface content in the second application interface may include from top to bottom: part of the interface content 2-1 of the second application displayed in the first annotation interface and the new The displayed interface content 2-2 of the second application;
- the first annotation scrolls up synchronously, moving from the middle area of the screen to the upper area of the screen.
- the user can save the annotation interface after adding the second annotation in the second annotation interface, wherein the second annotation spans the interface content 1-2 of the first application interface and the second The interface content of the application interface is on 2-2.
- the interface content of the first application interface may include from top to bottom: the first application interface displayed in the first annotation interface All interface content 1-1 of an application, interface content 1-2 of the first application newly displayed in the second annotation interface, and all interface content 3 of component 3 displayed in the first annotation interface; interface content of the second application interface From top to bottom, it may include: the entire interface content 2-1 of the second application displayed in the first annotation interface, the interface content 2-2 of the second application newly displayed in the second annotation interface, and the content displayed in the first annotation interface
- annotation content may include, from top to bottom: the first annotation and the second annotation added by the user.
- the height of component 3 and component 4 is the same as an example for illustration. It can be understood that the height of component 3 and component 4 can also be different.
- a part of the interface content can be re-displayed above the components with a lower height among components 3 and 4, so that the lengths of the first application interface and the second application interface in the saved annotation picture are consistent. For example, if the height of component 3 is lower than that of component 4, a part of the interface content may be displayed after the interface content 1-2 of component 1.
- the electronic device may only scroll and display the application interface targeted by the scrolling operation, and other application interfaces may not scroll, that is, each application interface scrolls asynchronously;
- the interface can be filled to make the length of each application interface consistent.
- cross-screen annotations can be prohibited. The following takes scene 02 as an example for illustration.
- the interface content of the first application and the second application can be scrolled, and the interface content displayed in the first annotation interface before scrolling includes: the interface content 1-1 of the first application and the interface content of the second application interface content 2; the first annotation includes: annotation 11 and annotation 12, annotation 11 is located in the middle area of interface content 1-1, and annotation 12 is located in the middle area of interface content 2.
- the electronic device can scroll up the interface content of the first application interface, as shown in (b) in Figure 11, after scrolling
- the interface content in the first application interface may include from top to bottom: part of the interface content 1-1 of the first application displayed in the first annotation interface and the newly displayed interface content of the first application 1-2; the interface content in the second application interface remains unchanged.
- the user can save the annotation interface after adding the second annotation in the second annotation interface, wherein the second annotation includes annotation 21 and annotation 22, and annotation 21 is located on the interface content 1-2 , Annotation 22 is located on interface content 2 and below Annotation 12.
- the interface content of the first application interface may include from top to bottom: the first annotation displayed in the first annotation interface The entire interface content 1-1 of an application and the interface content 1-2 of the first application newly displayed in the second annotation interface; the interface content of the second application interface may include from top to bottom: the first application displayed in the first annotation interface All interface content 2 of the second application and filling content of the second application; annotation content may include: annotation 11 and annotation 21 located in the first application interface, annotation 12 and annotation 22 located in the second application interface.
- the asynchronous scrolling process is illustrated by taking scene 02 as an example above, and the asynchronous scrolling process in other scenes is similar and will not be repeated here.
- the application interface of different APPs can be displayed in the upper and lower split screens, and the application interface of the same APP can also be displayed. This embodiment does not specifically limit this.
- the upper screen displays the first application interface and the lower screen displays the second
- the second application interface is used as an example to illustrate the scrolling annotation process.
- annotations added by the user may span screens, that is, the annotations span the first application interface and the second application interface.
- the annotation added by the user may not be across screens, that is, the annotation is located in the first application interface or the second application interface, and these cases will be described respectively below.
- Scenario 11 Referring to (a) in FIG. 12 , when the electronic device receives a user's scrolling operation, there is no annotation on the annotation interface. In this case, the electronic device can display the APP targeted by the user's scrolling operation in full screen. For example, as shown in (a) and (b) in FIG. The first application interface is displayed.
- the user can add annotations to the first application interface on the screen, scroll the interface, etc.
- the electronic device can display the interface content of the first application interface displayed during the annotation process and Annotations added by users are merged into annotated pictures and saved.
- the comment interface is saved, wherein the comment added by the user is located in the middle area of the first application interface; as shown in Figure 12
- the saved annotation image may include: the interface content of the first application interface displayed in full screen and the annotation added by the user.
- Scenario 12 Referring to (a) in Figure 13, when the electronic device receives the user's scrolling operation, the annotation interface includes annotation 11 and annotation 12, annotation 11 is located in the first application interface, and annotation 12 is located in the second application interface , Annotation 11 and Annotation 12 are not across the screen.
- the electronic device can display the APP targeted by the user's scrolling operation in full screen, for example, as shown in (a) and (b) in FIG.
- the first application interface is displayed.
- the user can add annotations, scroll the interface, etc. to the first application interface on the screen, and after the user inputs the annotation saving operation, the electronic device can combine the first application interface displayed during the annotation process and the user's added information on the first application interface.
- the annotations are merged into the first annotation image
- the second application interface displayed during the annotation process and the annotations added by the user on the second application interface are merged into the second annotation image, and then the second annotation image is stitched at the bottom of the first annotation image to save.
- the annotation interface is saved, wherein the annotation 2 is located below the annotation 11; as shown in (c) in Figure 13
- the interface content in the saved annotation picture may include from top to bottom: the interface content of the first application interface displayed in full screen and the interface content of the second application interface displayed before scrolling,
- the annotation content may include: annotation 11 on the first application interface, annotation 2 and annotation 12 on the second application interface.
- Scenario 13 Referring to (a) in FIG. 14 , when the electronic device receives a user's scrolling operation on the first application interface, the annotation interface includes annotation 1, and annotation 1 spans the screen. For this case, as shown in (b) in Figure 14, the electronic device can pop up a window to prompt the user whether to save the current annotation content, and after the user selects, as shown in (c) in Figure 14, the first application interface.
- the user can add comments on the first application interface on the screen, scroll the interface, etc., and after the user inputs the comment saving operation, the electronic device can combine the first application interface displayed during the annotation process with the user's first application interface.
- the annotation added on the above is merged into the annotation picture for saving.
- the electronic device can simultaneously save the content of the annotation in (a) in Figure 14
- the displayed application interface and annotation 1 are combined into an annotation picture and saved.
- the user selects the option "Yes" and adds annotation 2 on the first application interface, then saves the annotation interface, wherein annotation 2 is located in annotation 1 below.
- one of the saved annotation pictures may include: the first application interface displayed in full screen, annotation 1 and annotation 2 ;
- Another saved annotation picture may include: the first application interface and the second application interface displayed from top to bottom before scrolling, and the annotation 1 spanning the first application interface and the second application interface.
- annotation 1 may not be displayed.
- Scenario 14 Referring to (a) in FIG. 15 , when the electronic device receives a user's scrolling operation on the second application interface, the annotation interface includes annotation 1, and annotation 1 spans the screen.
- the electronic device can scroll up the first application interface and the second application interface, and during the scrolling process, the first application interface shown in (a) in Figure 15 The interface content is gradually hidden from top to bottom, and the second application interface continuously displays new interface content.
- annotation 2 is located in the second application interface and below annotation 1 .
- the interface content of the first application interface shown in (a) in Figure 15 is completely hidden, and the second application interface presents a state of full-screen display; annotation 1 and annotation 2 scroll up synchronously, annotation 1 scrolls to the top of the screen, and the part located in the first application interface is hidden, and annotation 2 scrolls to the upper area of the screen.
- the electronic device After the user continues to add annotation 3, save the annotation interface, where annotation 3 is located below annotation 2; after the electronic device receives the user's annotation saving operation, it can combine the application interface displayed during the annotation process and the annotation added by the user into an annotation image Save; as shown in (d) in Figure 15, the interface content in the saved annotation picture may include from top to bottom: the interface content of the first application interface and the second application interface displayed before scrolling, and the new application interface after two scrolls.
- the displayed interface content of the second application interface, the annotation content from top to bottom may include: annotation 1 across the first application interface and the second application interface, annotation 2 and annotation 3 located in the second application interface.
- the electronic device displays the first application interface in full screen, and displays the second application interface in the floating window, in this scenario, the user clicks the annotation control in the floating menu 10; as shown in Figure 16
- the electronic device receives the user's comment trigger operation, it enters the comment mode and can hide the floating window.
- the user can add annotations, scroll the interface, etc. on the screen for the first application interface, and after the user inputs the annotation saving operation, the electronic device can combine the first application interface displayed during the annotation process and the annotations added by the user into an annotation image for storage.
- the user scrolls the interface, wherein annotation 1 is located in the middle of the screen; as shown in (c) in Figure 16, the electronic After receiving the user's scrolling operation, the device scrolls the interface content of the first application interface, and the lower part of the screen displays the new interface content of the first application interface.
- the annotation 1 scrolls up to the upper part of the screen synchronously; Add annotation 2 on , and then save the annotation interface, wherein annotation 2 is located on the newly displayed interface content.
- the interface content in the saved annotation picture may include from top to bottom: the interface content of the first application interface displayed before scrolling and the interface content after scrolling.
- the newly displayed interface content of the first application interface may include annotation 1 and annotation 2 from top to bottom.
- the electronic device displays the first application interface in full screen, and displays the second application interface in the floating window.
- the user inputs a comment trigger operation by clicking the comment control in the floating menu 10 , and after the electronic device enters the comment mode, it can display the first application interface and the second application interface in split screens.
- the left and right split screens are taken as an example, and it is understandable that the up and down split screens can also be split when performing split screens.
- the interface content 1-1 of the first application can be scrolled, and the interface content 2 of the second application cannot be scrolled.
- the user enters the scrolling operation after adding annotation 1, wherein annotation 1 is located in the middle of the screen, And straddle the first application interface and the second application interface.
- the electronic device scrolls up the interface content of the first application interface, the interface content of the second application interface and the annotation layer, and scrolls up at the bottom of the interface content of the second application. Fill in the interface.
- the interface content in the first application interface may include from top to bottom: part of the interface content 1-1 of the first application shown in (b) in FIG.
- the interface content in the second application interface may include from top to bottom: part of the interface content 2 of the second application and the filling content of the second application, and the annotation 1 scrolls up synchronously, scrolling from the middle of the screen to the top of the screen.
- the user After adding the annotation 2, the user inputs the annotation saving operation to save the annotation interface, wherein the annotation 2 spans the area where the interface content 1-2 of the first application interface is located and the area where the filled content of the second application interface is located.
- the interface content of the first application interface may include from top to bottom: all interface content 1-1 shown in Figure 17 (b) and Figure 17
- the newly displayed interface content 1-2 of the first application in (c) the interface content of the second application interface may include from top to bottom: all interface content 2 of the second application and the filling content of the second application, annotations
- annotations may include from top to bottom: annotation 1 and annotation 2 added by the user.
- the electronic device can enter the annotation mode in a multi-window scene for users to make annotations, which can enrich the application scenarios of the annotation function, improve the flexibility of the user's annotation, and improve the user's annotation experience.
- FIG. 18 is a schematic structural diagram of the interactive system provided by the embodiment of the present application.
- the interactive system may include: an electronic device 100 and a stylus 200 .
- the electronic device 100 may be a display device such as a mobile phone, a tablet, a notebook computer, or an e-reader.
- the stylus 200 can be a resistive stylus 200 or a capacitive stylus 200 and so on.
- the electronic device 100 and the stylus 200 can communicate through wireless communication methods such as Bluetooth and wireless fidelity (Wi-Fi) network.
- wireless communication methods such as Bluetooth and wireless fidelity (Wi-Fi) network.
- buttons can be set on the stylus 200, and the buttons can be physical buttons or virtual buttons.
- the user can control the stylus 200 to perform corresponding operations through the buttons on the stylus 200. For example, after the user clicks the first button, the stylus 200 establishes a communication connection with the electronic device 100; Device 100 enters annotation mode.
- the electronic device 100 After the electronic device 100 establishes communication with the stylus 200 , the user can input a touch operation through the stylus 200 , and in the annotation mode, the electronic device 100 can display the movement trajectory formed by the stylus 200 on the screen.
- the software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture or a cloud architecture.
- the software structure of the electronic device 100 is exemplarily described by taking an Android system with a layered architecture as an example.
- FIG. 19 is a schematic diagram of the software architecture of the electronic device 100 provided by the embodiment of the present application.
- the software system of the electronic device 100 can be divided into several layers.
- the Android system can be divided into application layers from top to bottom. Program layer, application framework layer, Android runtime and system library, and kernel layer.
- the application layer can include a series of applications.
- the application programs may include application programs such as camera, gallery, calendar, call, WLAN, Bluetooth, music, memo, short message, annotation, and browser.
- the application framework layer provides an application programming interface (Application Programming Interface, API) and a programming framework for applications in the application layer.
- API Application Programming Interface
- the application framework layer includes some predefined functions.
- the application framework layer may include a window manager, a content provider, a view system, a resource manager, a notification manager, a screenshot module, and the like.
- a window manager is used to manage window programs.
- the window manager can get the size of the display screen, determine whether there is a status bar, lock the screen, capture the screen, etc.
- Content providers are used to store and retrieve data and make it accessible to applications. Said data may include video, images, audio, calls made and received, browsing history and bookmarks, phonebook, etc.
- the view system includes visual controls, such as controls for displaying text, controls for displaying pictures, and so on.
- the view system can be used to build applications.
- a display interface can consist of one or more views. For example, a display interface including a text message notification icon may include a view for displaying text and a view for displaying pictures.
- the resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and so on.
- the notification manager enables the application to display notification information in the status bar, which can be used to convey notification-type messages, and can automatically disappear after a short stay without user interaction.
- the notification manager is used to notify the download completion, message reminder, etc.
- the notification manager can also be a notification that appears on the top status bar of the system in the form of a chart or scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is prompted in the status bar, a prompt sound is issued, the electronic device 100 vibrates, an indicator light flashes, and the like.
- the screenshot module can take a screenshot of the display interface of the electronic device 100 .
- the Android Runtime includes core library and virtual machine.
- the Android runtime is responsible for the scheduling and management of the Android system.
- the core library consists of two parts: one part is the function function that the java language needs to call, and the other part is the core library of Android.
- the application layer and the application framework layer run in virtual machines.
- the virtual machine executes the java files of the application program layer and the application program framework layer as binary files.
- the virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.
- a system library can include multiple function modules. For example: Surface Manager (Surface Manager), Media Library (Media Libraries), 3D graphics processing library (eg: OpenGL ES), 2D graphics engine (eg: SGL) and input module, etc.
- Surface Manager Surface Manager
- Media Libraries Media Libraries
- 3D graphics processing library eg: OpenGL ES
- 2D graphics engine eg: SGL
- input module etc.
- the surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.
- the media library supports playback and recording of various commonly used audio and video formats, as well as still image files, etc.
- the media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
- the 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing, etc.
- 2D graphics engine is a drawing engine for 2D drawing.
- the input module is used for transmitting the touch event generated by the touch operation input by the user to the corresponding application program.
- the kernel layer is a layer between hardware and software, which is used to provide core system services for the Android kernel, such as security services, network services, memory management services, detection management services, and driver models.
- the kernel layer can contain display drivers, camera drivers, audio drivers and sensor drivers.
- the touch sensor in the hardware device can generate a corresponding hardware interrupt and send it to the kernel layer, and the kernel layer can encapsulate the touch operation into a touch event (for example, touch down (action down) event, touch move (action move) events and touch up (action up) events, etc.), and can report touch events to the upper-layer APP through the input module in the system library.
- a touch event for example, touch down (action down) event, touch move (action move) events and touch up (action up) events, etc.
- the electronic device 100 after the electronic device 100 enters the annotation mode, it can load the annotation layer on the application interface, so that the touch event generated by the scrolling operation input by the user will be processed by the annotation layer and located below the annotation layer.
- the APP cannot receive touch events, so that the interface scrolling cannot be realized.
- the interface scrolling in annotation mode can be realized by simulating touch events.
- a content sensor can be added in the application framework layer, and the annotation application can use the content sensor to realize the scrolling annotation process. The principle of scrolling annotation is described below.
- Figure 20 is a schematic diagram of the scrolling annotation principle provided by the embodiment of the present application.
- the input module can transmit the touch event generated by the annotation trigger operation to the annotation application (step S1); the annotation application receives After a touch event is received, an interface information request command may be sent to the window manager in response to the touch event (step S2), so as to acquire APP interface information.
- the interface information of the currently displayed APP (herein referred to as the target APP) can be transmitted to the content sensor (step S3); then, the content sensor can transmit the interface information of the target APP Pass it to the annotation application (step S4).
- the target APP may include one or more.
- the target APP may include the “Gallery” APP and the “Memorandum” APP shown in Figure 3 above.
- the processing process of each target APP is similar, and here is an example. Exemplary instructions.
- the annotation application After the annotation application obtains the interface information of the target APP, it can determine the position of the content display control in the target APP interface (herein referred to as the first target position) according to the interface layout information therein, and then can send a screenshot command to the screenshot module ( Step S5), notify the screenshot module to take a screenshot of the first target location.
- the screenshot module After the screenshot module completes the screenshot, it can return the screenshot to the annotation application (step S6); then, the annotation application can load the annotation layer on the screenshot and display it (step S7).
- the input module can pass the touch event corresponding to the first annotation to the annotation application (step S8); the annotation application can respond to the touch event, and display the user's addition on the annotation layer.
- the first comment (step S9).
- the annotation application can simulate the touch event corresponding to the scroll operation (referred to as the scroll touch event for short), and then send the simulated scroll touch event to the window manager (step S10) to notify the window manager
- the controller passes the simulated scroll touch event to the target APP.
- the target APP After the window manager transmits the simulated scrolling touch event to the target APP (step S11), the target APP can execute the corresponding scrolling process (step S12).
- the target APP when the interface content is scrollable, the target APP can scroll the interface content; when the interface content is not scrollable, that is, the interface content has reached the bottom, the target APP does not need to scroll the interface content.
- the annotation application After the annotation application sends the simulated scrolling touch event to the window manager, it can determine the position of the scrollable control (referred to as the second target position here) according to the interface information of the target APP obtained earlier, and then send a screenshot to the screenshot module order (step S13), to notify the screenshot module to take a screenshot of the second target position.
- the second target position the position of the scrollable control
- step S13 the screenshot module order
- the annotation application can determine whether the interface content in the control can be scrolled according to the type of the control.
- the scrollable controls can include RecycleView, ListView, ScrollView, PageView, and WebView.
- the main page of the "Gallery" APP generally uses The RecycleView control
- the ListView control is generally used in the news APP
- the ScrollView control is generally used in the “Contact” APP
- the PageView control is generally used in the slideshow APP
- the WebView control is generally used in the webpage APP.
- the annotation application may determine the position of the scrollable control as the second target position, and instruct the screenshot module to take a screenshot of the position.
- the screenshot can be returned to the annotation application (step S14); then, the annotation application can perform image deduplication and image splicing, and update the displayed screenshot after generating a long screenshot (step S15).
- the annotation application can compare the screenshot obtained this time with the screenshot obtained last time. If all the interface content of the screenshot obtained this time already exists in the screenshot obtained last time, it means that the interface content of the target APP has been scrolled to the bottom At this time, the interface can be filled at the bottom of the interface content of the target APP, for example, filled with a white page. If the screenshot obtained last time does not include all the interface content in the screenshot obtained this time, you can splice the newly loaded interface content in the screenshot obtained this time to the bottom of the interface content in the screenshot obtained last time to generate a long screenshot .
- the input module can pass the touch event corresponding to the scrolling operation to the annotation application (step S16); the annotation application can respond to the touch event, scroll the long screenshot and the annotation layer, and update the display interface content (step S17).
- step S15 if it is determined that the interface content of the target APP has not reached the bottom, that is, the interface content of the target APP can continue to scroll, the annotation application can return to step S10 to update the long screenshot, that is, the electronic device 100 can repeat Steps S10-S15 are executed until the preset condition is met.
- the preset condition may be that the interface content of the target APP reaches the bottom, or the electronic device 100 exits the annotation mode.
- next long screenshot update process can be performed after each execution of the long screenshot update process; or every time the long screenshot update process is completed After the update process, after waiting for the preset duration, the next long screenshot update process is performed, wherein, the preset duration between each two long screenshot update processes can be equal or different, for example, the preset duration can be Gradually increase.
- the window manager when implementing the scrolling annotation function, can also be modified so that the annotation application can directly obtain APP interface information from the window manager.
- the way of adding the content sensor in the application framework layer can reduce the modification of the original framework structure and reduce the difficulty of implementation.
- the structure of the electronic device 100 will be described below.
- FIG. 21 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.
- the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, and an antenna 2 , mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, earphone jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194, and A subscriber identification module (subscriber identification module, SIM) card interface 195 and the like.
- SIM subscriber identification module
- the sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, bone conduction sensor 180M, etc.
- the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100 .
- the electronic device 100 may include more or fewer components than shown in the figure, or combine certain components, or separate certain components, or arrange different components.
- the illustrated components can be realized in hardware, software or a combination of software and hardware.
- the processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (sgraphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU) wait.
- application processor application processor
- AP application processor
- modem processor graphics processing unit
- ISP image signal processor
- controller memory
- video codec digital signal processor
- DSP digital signal processor
- baseband processor baseband processor
- neural network processor neural-network processing unit, NPU
- the controller may be the nerve center and command center of the electronic device 100 .
- the controller can generate an operation control signal according to the instruction opcode and timing signal, and complete the control of fetching and executing the instruction.
- a memory may also be provided in the processor 110 for storing instructions and data.
- the memory in processor 110 is a cache memory.
- the memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. Repeated access is avoided, and the waiting time of the processor 110 is reduced, thereby improving the efficiency of the system.
- processor 110 may include one or more interfaces.
- the interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous transmitter (universal asynchronous receiver/transmitter, UART) interface, mobile industry processor interface (mobile industry processor interface, MIPI), general-purpose input and output (general-purpose input/output, GPIO) interface, subscriber identity module (subscriber identity module, SIM) interface, and /or universal serial bus (universal serial bus, USB) interface, etc.
- I2C integrated circuit
- I2S integrated circuit built-in audio
- PCM pulse code modulation
- PCM pulse code modulation
- UART universal asynchronous transmitter
- MIPI mobile industry processor interface
- GPIO general-purpose input and output
- subscriber identity module subscriber identity module
- SIM subscriber identity module
- USB universal serial bus
- the I2C interface is a bidirectional synchronous serial bus, including a serial data line (serial data line, SDA) and a serial clock line (serail clock line, SCL).
- the I2S interface can be used for audio communication.
- the PCM interface can also be used for audio communication, sampling, quantizing and encoding the analog signal.
- the UART interface is a universal serial data bus for asynchronous communication; the bus can be a bidirectional communication bus, which converts the data to be transmitted between serial communication and parallel communication.
- the MIPI interface can be used to connect the peripheral devices such as the processor 110 and the display screen 194, the camera 193; the MIPI interface includes a camera serial interface (camera serial interface, CSI), a display serial interface (display serial interface, DSI) and the like.
- the GPIO interface can be configured by software, and the GPIO interface can be configured as a control signal or as a data signal.
- the USB interface 130 is an interface conforming to the USB standard specification, specifically, it can be a Mini USB interface, a Micro USB interface, a USB Type C interface, and the like.
- the USB interface 130 can be used to connect a charger to charge the electronic device 100 , and can also be used to transmit data between the electronic device 100 and peripheral devices. It can also be used to connect headphones and play audio through them. This interface can also be used to connect other electronic devices, such as AR devices.
- the interface connection relationship between the modules shown in the embodiment of the present application is only a schematic illustration, and does not constitute a structural limitation of the electronic device 100 .
- the electronic device 100 may also adopt different interface connection manners in the foregoing embodiments, or a combination of multiple interface connection manners.
- the charging management module 140 is configured to receive a charging input from a charger.
- the charger may be a wireless charger or a wired charger.
- the charging management module 140 can receive charging input from the wired charger through the USB interface 130 .
- the charging management module 140 may receive a wireless charging input through a wireless charging coil of the electronic device 100 . While the charging management module 140 is charging the battery 142 , it can also provide power for electronic devices through the power management module 141 .
- the power management module 141 is used for connecting the battery 142 , the charging management module 140 and the processor 110 .
- the power management module 141 receives the input from the battery 142 and/or the charging management module 140 to provide power for the processor 110 , the internal memory 121 , the external memory, the display screen 194 , the camera 193 , and the wireless communication module 160 .
- the power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle times, and battery health status (leakage, impedance).
- the power management module 141 can also be set in the processor 110.
- the power management module 141 and the charging management module 140 may also be set in the same device.
- the wireless communication function of the electronic device 100 can be realized by the antenna 1 , the antenna 2 , the mobile communication module 150 , the wireless communication module 160 , a modem processor, a baseband processor, and the like.
- Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.
- Each antenna in electronic device 100 may be used to cover single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of the antennas.
- Antenna 1 can be multiplexed as a diversity antenna of a wireless local area network.
- the antenna may be used in conjunction with a tuning switch.
- the mobile communication module 150 can provide wireless communication solutions including 2G/3G/4G/5G applied on the electronic device 100 .
- the mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA) and the like.
- the mobile communication module 150 can receive electromagnetic waves through the antenna 1, filter and amplify the received electromagnetic waves, and send them to the modem processor for demodulation.
- the mobile communication module 150 can also amplify the signals modulated by the modem processor, and convert them into electromagnetic waves through the antenna 1 for radiation.
- at least part of the functional modules of the mobile communication module 150 may be set in the processor 110 .
- at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 may be set in the same device.
- a modem processor may include a modulator and a demodulator.
- the modulator is used for modulating the low-frequency baseband signal to be transmitted into a medium-high frequency signal.
- the demodulator is used to demodulate the received electromagnetic wave signal into a low frequency baseband signal. Then the demodulator sends the demodulated low-frequency baseband signal to the baseband processor for processing.
- the low-frequency baseband signal is passed to the application processor after being processed by the baseband processor.
- the application processor outputs sound signals through audio equipment (not limited to speaker 170A, receiver 170B, etc.), or displays images or videos through display screen 194 .
- the modem processor may be a stand-alone device.
- the modem processor may be independent from the processor 110, and be set in the same device as the mobile communication module 150 or other functional modules.
- the wireless communication module 160 can provide wireless local area networks (wireless local area networks, WLAN) (such as wireless fidelity (Wireless Fidelity, Wi-Fi) network), bluetooth (bluetooth, BT), global navigation satellite, etc. applied on the electronic device 100.
- System global navigation satellite system, GNSS
- frequency modulation frequency modulation, FM
- near field communication technology near field communication, NFC
- infrared technology infrared, IR
- the wireless communication module 160 may be one or more devices integrating at least one communication processing module.
- the wireless communication module 160 receives electromagnetic waves via the antenna 2 , frequency-modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 .
- the wireless communication module 160 can also receive the signal to be sent from the processor 110 , frequency-modulate it, amplify it, and convert it into electromagnetic waves through the antenna 2 for radiation.
- the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology.
- the wireless communication technology may include global system for mobile communications (GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access, CDMA), broadband Code division multiple access (wideband code division multiple access, WCDMA), time division synchronous code division multiple access (time division-synchronous code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), BT, GNSS, WLAN , NFC, FM, and/or IR technology, etc.
- GSM global system for mobile communications
- general packet radio service general packet radio service
- CDMA code division multiple access
- CDMA broadband Code division multiple access
- WCDMA wideband code division multiple access
- time division synchronous code division multiple access time division-synchronous code division multiple access
- LTE long term evolution
- BT GNSS
- WLAN NFC
- the GNSS may include a global positioning system (global positioning system, GPS), a global navigation satellite system (global navigation satellite system, GNSS), a Beidou navigation satellite system (beidou navigation satellite system, BDS), a quasi-zenith satellite system (quasi -zenith satellite system (QZSS) and/or satellite based augmentation systems (SBAS).
- GPS global positioning system
- GNSS global navigation satellite system
- BDS Beidou navigation satellite system
- QZSS quasi-zenith satellite system
- SBAS satellite based augmentation systems
- the electronic device 100 realizes the display function through the GPU, the display screen 194 , and the application processor.
- the GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering.
- Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.
- the display screen 194 is used to display images, videos and the like.
- the display screen 194 includes a display panel.
- the display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light emitting diode or an active matrix organic light emitting diode (active-matrix organic light emitting diode, AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Mini LED, Micro LED, quantum dot light emitting diodes (quantum dot light emitting diodes, QLED), etc.
- the electronic device 100 may include 1 or N display screens 194 , where N is a positive integer greater than 1.
- the electronic device 100 can realize the shooting function through the ISP, the camera 193 , the video codec, the GPU, the display screen 194 and the application processor.
- the ISP is used for processing the data fed back by the camera 193 .
- Camera 193 is used to capture still images or video.
- Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals.
- Video codecs are used to compress or decompress digital video.
- the NPU is a neural-network (NN) computing processor.
- NN neural-network
- Applications such as intelligent cognition of the electronic device 100 can be realized through the NPU, such as image recognition, face recognition, speech recognition, text understanding, and the like.
- the internal memory 121 may be used to store computer-executable program codes including instructions.
- the processor 110 executes various functional applications and data processing of the electronic device 100 by executing instructions stored in the internal memory 121 .
- the internal memory 121 may include an area for storing programs and an area for storing data.
- the storage program area can store an operating system and at least one application program required by a function (such as a sound playing function, an image playing function, etc.) and the like.
- the storage data area can store data created during the use of the electronic device 100 (such as audio data, phonebook, etc.) and the like.
- the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (universal flash storage, UFS) and the like.
- the external memory interface 120 may be used to connect an external memory, such as a Micro SD card, to expand the storage capacity of the electronic device 100.
- the external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. Such as saving music, video and other files in the external memory card.
- the electronic device 100 can implement audio functions through the audio module 170 , the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor. Such as music playback, recording, etc.
- the audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signal.
- the audio module 170 may also be used to encode and decode audio signals.
- the audio module 170 may be set in the processor 110 , or some functional modules of the audio module 170 may be set in the processor 110 .
- Speaker 170A also referred to as a "horn” is used to convert audio electrical signals into sound signals.
- Receiver 170B also called “earpiece”, is used to convert audio electrical signals into sound signals.
- the microphone 170C also called “microphone” or “microphone” is used to convert sound signals into electrical signals.
- the earphone interface 170D is used for connecting wired earphones.
- the earphone interface 170D can be a USB interface 130, or a 3.5mm open mobile terminal platform (open mobile terminal platform, OMTP) standard interface, or a cellular telecommunications industry association of the USA (CTIA) standard interface.
- CTIA
- the keys 190 include a power key, a volume key and the like.
- the key 190 may be a mechanical key. It can also be a touch button.
- the electronic device 100 can receive key input and generate key signal input related to user settings and function control of the electronic device 100 .
- the motor 191 can generate a vibrating reminder.
- the motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback.
- the indicator 192 can be an indicator light, and can be used to indicate charging status, power change, and can also be used to indicate messages, missed calls, notifications, and the like.
- the SIM card interface 195 is used for connecting a SIM card.
- the SIM card can be connected and separated from the electronic device 100 by inserting it into the SIM card interface 195 or pulling it out from the SIM card interface 195 .
- the electronic device 100 may support 1 or N SIM card interfaces, where N is a positive integer greater than 1.
- SIM card interface 195 can support Nano SIM card, Micro SIM card, SIM card etc.
- the interactive system provided in this embodiment can execute the above-mentioned method embodiment, and its implementation principle and technical effect are similar, and will not be repeated here.
- the embodiment of the present application provides an annotation device. The details will be described one by one, but it should be clear that the device in this embodiment can correspondingly implement all the content in the foregoing method embodiments.
- Figure 22 is a schematic structural diagram of the annotation device provided by the embodiment of the present application. As shown in Figure 22, the device provided by this embodiment includes:
- a display module 210 an input module 220 , a processing module 230 and a communication module 240 .
- the display module 210 is used to support the electronic device to perform the interface display operation in the above embodiments and/or other processes used in the technology described herein.
- the display module can be a touch screen or other hardware or a combination of hardware and software.
- the input module 220 is used to receive the user's input on the display interface of the electronic device, such as touch input, voice input, gesture input, etc., and the input module is used to support the electronic device to perform the steps of receiving the user's call answering operation in the above embodiments and/or Or other procedures for the techniques described herein.
- the input module can be a touch screen or other hardware or a combination of hardware and software.
- the processing module 230 is configured to support the electronic device to perform processing operations related to the annotation process in the above embodiments and/or other processes for the technologies described herein.
- the communication module 240 is used to support the electronic device to perform operations related to the communication process between the stylus in the above embodiments and/or other processes used in the technology described herein.
- the device provided in this embodiment can execute the above-mentioned method embodiment, and its implementation principle and technical effect are similar, and details are not repeated here.
- the embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the method described in the foregoing method embodiment is implemented.
- An embodiment of the present application further provides a computer program product, which, when the computer program product is run on an electronic device, enables the electronic device to implement the method described in the foregoing method embodiments.
- An embodiment of the present application further provides a chip system, including a processor, the processor is coupled to a memory, and the processor executes a computer program stored in the memory, so as to implement the method described in the above method embodiment.
- the chip system may be a single chip, or a chip module composed of multiple chips.
- all or part of them may be implemented by software, hardware, firmware or any combination thereof.
- software When implemented using software, it may be implemented in whole or in part in the form of a computer program product.
- the computer program product includes one or more computer instructions.
- the computer can be a general purpose computer, a special purpose computer, a computer network, or other programmable devices.
- the computer instructions may be stored in or transmitted via a computer-readable storage medium.
- the computer instructions may be transmitted from one web site, computer, server, or data center to another web site, computer, server or data center for transmission.
- the computer-readable storage medium may be any available medium that can be accessed by a computer, or a data storage device such as a server or a data center integrated with one or more available media.
- the available medium may be a magnetic medium (such as a floppy disk, a hard disk, or a magnetic tape), an optical medium (such as a DVD), or a semiconductor medium (such as a solid state disk (Solid State Disk, SSD)), etc.
- the processes can be completed by computer programs to instruct related hardware.
- the programs can be stored in computer-readable storage media.
- When the programs are executed may include the processes of the foregoing method embodiments.
- the aforementioned storage medium may include: ROM or random access memory RAM, magnetic disk or optical disk, and other media capable of storing program codes.
- the disclosed device/device and method can be implemented in other ways.
- the device/device embodiments described above are only illustrative.
- the division of the modules or units is only a logical function division.
- the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.
- plural means two or more than two.
- At least one of the following or similar expressions refer to any combination of these items, including any combination of single items or plural items.
- at least one of a, b, or c can represent: a, b, c, a-b, a-c, b-c, or a-b-c, wherein a, b, c can be single or multiple.
- the term “if” may be construed, depending on the context, as “when” or “once” or “in response to determining” or “in response to detecting “.
- the phrase “if determined” or “if [the described condition or event] is detected” may be construed, depending on the context, to mean “once determined” or “in response to the determination” or “once detected [the described condition or event] ]” or “in response to detection of [described condition or event]”.
- references to "one embodiment” or “some embodiments” or the like in the specification of the present application means that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the present application.
- appearances of the phrases “in one embodiment,” “in some embodiments,” “in other embodiments,” “in other embodiments,” etc. in various places in this specification are not necessarily All refer to the same embodiment, but mean “one or more but not all embodiments” unless specifically stated otherwise.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Software Systems (AREA)
- Health & Medical Sciences (AREA)
- Artificial Intelligence (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Computational Linguistics (AREA)
- General Health & Medical Sciences (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
Claims (15)
- 一种批注方法,其特征在于,包括:显示第一界面,所述第一界面包括分屏显示的第一应用界面和第二应用界面;接收用户对所述第一界面的第一批注操作;响应于所述第一批注操作,在所述第一界面上显示第一批注;接收用户对所述第一界面的第一滚动操作;响应于所述第一滚动操作,显示第二界面,所述第二界面包括分屏显示的第一应用界面和第二应用界面,所述第二界面与所述第一界面不同;接收用户对所述第二界面的第二批注操作;响应于所述第二批注操作,在所述第二界面上显示第二批注;生成第一批注图片,所述第一批注图片包括:所述第一批注,所述第二批注,所述第一界面,以及所述第二界面。
- 根据权利要求1所述的方法,其特征在于,所述响应于所述第一滚动操作,显示第二界面,具体包括:响应于所述第一滚动操作,分屏显示的所述第一应用界面由第一应用的第一子界面切换为第一应用的第二子界面。
- 根据权利要求2所述的方法,其特征在于,所述方法还包括:响应于所述第一滚动操作,分屏显示的所述第二应用界面由第二应用的第三子界面切换为第二应用的第四子界面。
- 根据权利要求3所述的方法,其特征在于,若所述第一滚动操作为向上滚动操作,所述第一批注图片中所述第一子界面位于所述第二子界面上方,所述第三子界面位于所述第四子界面上方。
- 根据权利要求4所述的方法,其特征在于,若所述第一应用界面位于所述第二应用界面左侧,所述第一批注图片中所述第一子界面位于所述第三子界面左侧,所述第二子界面位于所述第四子界面左侧;若所述第一应用界面位于所述第二应用界面右侧,所述第一批注图片中所述第一子界面位于所述第三子界面右侧,所述第二子界面位于所述第四子界面右侧。
- 根据权利要求3至5任一项所述的方法,其特征在于,所述第四子界面为填充页面。
- 根据权利要求3至6任一项所述的方法,其特征在于,所述第一应用界面还包括固定显示在所述第一应用界面底部的第一组件,则所述方法还包括:接收用户对所述第一界面的第一滚动操作之后,不再显示所述第一组件。
- 根据权利要求1-7任一项所述的方法,其特征在于,所述方法还包括:显示第三界面,所述第三界面包括分屏显示的第三应用界面和第四应用界面;接收用户对所述第三界面中显示的第三应用界面的第二滚动操作;响应于所述第二滚动操作,全屏显示第三应用界面;接收用户对所述第三应用界面的第三批注操作;响应于所述第三批注操作,在所述第三应用界面上显示第三批注;生成第二批注图片,所述第二批注图片包括:所述第三批注和所述第三应用界面。
- 根据权利要求1-8任一项所述的方法,其特征在于,所述方法还包括:显示第四界面,所述第四界面包括分屏显示的第五应用界面和第六应用界面;接收用户对所述第五应用界面或所述第六应用界面的第四批注操作;响应于所述第四批注操作,在所述第五应用界面或所述第六应用界面上显示第四批注;接收用户对所述第五应用界面的第三滚动操作;响应于所述第三滚动操作,全屏显示所述第五应用界面。
- 根据权利要求1-9任一项所述的方法,其特征在于,所述方法还包括:显示第五界面,所述第五界面包括分屏显示的第七应用界面和第八应用界面;接收用户对所述第五界面的第五批注操作;响应于所述第五批注操作,显示第五批注,所述第五批注与所述第七应用界面和第八应用界面的分界线重叠;接收用户对所述第五界面的第四滚动操作;响应于所述第四滚动操作,显示提示界面以供用户选择是否保存批注。
- 根据权利要求1-10任一项所述的方法,其特征在于,所述方法还包括:显示第六界面,所述第六界面包括全屏显示的第九应用界面和在所述第九应用界面上悬浮显示的第十应用界面;响应于批注触发操作,隐藏悬浮显示的所述第十应用界面或分屏显示所述第九应用界面和所述第十应用界面。
- 一种电子设备,其特征在于,包括:存储器和处理器,所述存储器用于存储计算机程序;所述处理器用于在调用所述计算机程序时执行如权利要求1-11任一项所述的方法。
- 一种计算机可读存储介质,其上存储有计算机程序,其特征在于,所述计算机程序被处理器执行时实现如权利要求1-11任一项所述的方法。
- 一种计算机程序产品,其特征在于,当计算机程序产品在电子设备上运行时,使得电子设备执行如权利要求1-11任一项所述的方法。
- 一种芯片系统,其特征在于,所述芯片系统包括处理器,所述处理器与存储器耦合,所述处理器执行存储器中存储的计算机程序,以实现如权利要求1-11任一项所述的方法。
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP22863335.0A EP4375822A1 (en) | 2021-09-06 | 2022-08-26 | Annotation method and electronic device |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202111039715.4 | 2021-09-06 | ||
CN202111039715.4A CN115774511A (zh) | 2021-09-06 | 2021-09-06 | 批注方法和电子设备 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2023030198A1 true WO2023030198A1 (zh) | 2023-03-09 |
Family
ID=85387472
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2022/115223 WO2023030198A1 (zh) | 2021-09-06 | 2022-08-26 | 批注方法和电子设备 |
Country Status (3)
Country | Link |
---|---|
EP (1) | EP4375822A1 (zh) |
CN (1) | CN115774511A (zh) |
WO (1) | WO2023030198A1 (zh) |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070239831A1 (en) * | 2006-04-06 | 2007-10-11 | Yahoo! Inc. | Interface for editing, binding, and displaying an annotation for a message |
CN104978110A (zh) * | 2015-07-27 | 2015-10-14 | 联想(北京)有限公司 | 显示处理方法和显示处理设备 |
CN105786713A (zh) * | 2016-03-28 | 2016-07-20 | 努比亚技术有限公司 | 移动终端的分屏排查方法、装置及移动终端 |
CN107797971A (zh) * | 2017-10-11 | 2018-03-13 | 广州视源电子科技股份有限公司 | 文档批注方法、装置和电子设备 |
CN108459836A (zh) * | 2018-01-19 | 2018-08-28 | 广州视源电子科技股份有限公司 | 批注显示方法、装置、设备及存储介质 |
CN110196675A (zh) * | 2019-04-17 | 2019-09-03 | 华为技术有限公司 | 一种添加批注的方法及电子设备 |
-
2021
- 2021-09-06 CN CN202111039715.4A patent/CN115774511A/zh active Pending
-
2022
- 2022-08-26 WO PCT/CN2022/115223 patent/WO2023030198A1/zh active Application Filing
- 2022-08-26 EP EP22863335.0A patent/EP4375822A1/en active Pending
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20070239831A1 (en) * | 2006-04-06 | 2007-10-11 | Yahoo! Inc. | Interface for editing, binding, and displaying an annotation for a message |
CN104978110A (zh) * | 2015-07-27 | 2015-10-14 | 联想(北京)有限公司 | 显示处理方法和显示处理设备 |
CN105786713A (zh) * | 2016-03-28 | 2016-07-20 | 努比亚技术有限公司 | 移动终端的分屏排查方法、装置及移动终端 |
CN107797971A (zh) * | 2017-10-11 | 2018-03-13 | 广州视源电子科技股份有限公司 | 文档批注方法、装置和电子设备 |
CN108459836A (zh) * | 2018-01-19 | 2018-08-28 | 广州视源电子科技股份有限公司 | 批注显示方法、装置、设备及存储介质 |
CN110196675A (zh) * | 2019-04-17 | 2019-09-03 | 华为技术有限公司 | 一种添加批注的方法及电子设备 |
Also Published As
Publication number | Publication date |
---|---|
CN115774511A (zh) | 2023-03-10 |
EP4375822A1 (en) | 2024-05-29 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2021027747A1 (zh) | 一种界面显示方法及设备 | |
WO2021057830A1 (zh) | 一种信息处理方法及电子设备 | |
WO2020211709A1 (zh) | 一种添加批注的方法及电子设备 | |
WO2021036571A1 (zh) | 一种桌面的编辑方法及电子设备 | |
WO2021103981A1 (zh) | 分屏显示的处理方法、装置及电子设备 | |
WO2021115194A1 (zh) | 一种应用图标的显示方法及电子设备 | |
US11687235B2 (en) | Split-screen method and electronic device | |
WO2021121052A1 (zh) | 一种多屏协同方法、系统及电子设备 | |
WO2022057512A1 (zh) | 分屏方法、装置及电子设备 | |
CN113132526B (zh) | 一种页面绘制方法及相关装置 | |
CN110633043A (zh) | 一种分屏处理方法及终端设备 | |
CN114816167B (zh) | 应用图标的显示方法、电子设备及可读存储介质 | |
CN113986070B (zh) | 一种应用卡片的快速查看方法及电子设备 | |
WO2020155875A1 (zh) | 电子设备的显示方法、图形用户界面及电子设备 | |
WO2023130921A1 (zh) | 一种适配多设备的页面布局的方法及电子设备 | |
CN112068907A (zh) | 一种界面显示方法和电子设备 | |
WO2023051511A1 (zh) | 一种图标移动方法、相关图形界面及电子设备 | |
WO2023236794A1 (zh) | 一种音轨标记方法及电子设备 | |
WO2021052488A1 (zh) | 一种信息处理方法及电子设备 | |
WO2021042881A1 (zh) | 消息通知方法及电子设备 | |
CN113448658A (zh) | 截屏处理的方法、图形用户接口及终端 | |
EP4365722A1 (en) | Method for displaying dock bar in launcher and electronic device | |
WO2023005751A1 (zh) | 渲染方法及电子设备 | |
WO2023030198A1 (zh) | 批注方法和电子设备 | |
CN115661301A (zh) | 添加批注的方法、电子设备、存储介质及程序产品 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22863335 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2022863335 Country of ref document: EP |
|
ENP | Entry into the national phase |
Ref document number: 2022863335 Country of ref document: EP Effective date: 20240223 |
|
REG | Reference to national code |
Ref country code: BR Ref legal event code: B01A Ref document number: 112024004449 Country of ref document: BR |
|
NENP | Non-entry into the national phase |
Ref country code: DE |