WO2024255888A1 - 信息传输方法及电子设备 - Google Patents

信息传输方法及电子设备 Download PDF

Info

Publication number
WO2024255888A1
WO2024255888A1 PCT/CN2024/099417 CN2024099417W WO2024255888A1 WO 2024255888 A1 WO2024255888 A1 WO 2024255888A1 CN 2024099417 W CN2024099417 W CN 2024099417W WO 2024255888 A1 WO2024255888 A1 WO 2024255888A1
Authority
WO
WIPO (PCT)
Prior art keywords
interface
icon
service
area
application
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2024/099417
Other languages
English (en)
French (fr)
Inventor
卢海生
陈虹
孔大超
强成仓
孙丁永
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Honor Device Co Ltd
Original Assignee
Honor Device Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from CN202310725366.4A external-priority patent/CN119148893A/zh
Priority claimed from CN202310788791.8A external-priority patent/CN119225609A/zh
Application filed by Honor Device Co Ltd filed Critical Honor Device Co Ltd
Priority to CN202480033942.1A priority Critical patent/CN121263767A/zh
Publication of WO2024255888A1 publication Critical patent/WO2024255888A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04817Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons

Definitions

  • the present application relates to the field of terminal technology, and in particular to an information transmission method and an electronic device.
  • smart devices such as mobile phones and tablets have become indispensable products in our daily life, work and entertainment.
  • users When users use smart devices, they usually open multiple applications in the smart devices at the same time to work together. Users also often use smart devices to transmit information across applications, that is, to share and upload information in one application through another application.
  • the purpose of the present application is to provide an information transmission method and an electronic device.
  • the electronic device can directly respond to the user's operation on the information and display multiple application service icons in the interface, so that the user can put the information into the target application service, so that the electronic device can efficiently and quickly complete the information transmission between applications, effectively reduce the operation steps required for the user to complete the cross-application information transmission, improve the interaction efficiency between the user and the electronic device, and thus improve the user experience.
  • the present application provides an information transmission method, the method comprising: displaying a first interface, the first interface comprising a first sub-interface and a second sub-interface, the first sub-interface being used to display an application interface of a first application, the second sub-interface being used to display an application interface of a second application, the first sub-interface comprising first information, and the second sub-interface being used to transmit the first information to the second application under a first operation on the first information; displaying a second interface in response to a second operation on the first information; the second interface comprising the first information and at least one application service icon; and transmitting the first information to an application service corresponding to a target icon in response to a third operation on the first information, the target icon being any one of the at least one application service icons.
  • the first interface may be a smart multi-window interface displayed by an electronic device, that is, there are multiple windows in the first interface, each of which corresponds to a sub-interface, and the application corresponding to each sub-interface displayed may be different.
  • the first sub-interface and the second sub-interface are two of the multiple sub-interfaces corresponding to the multiple windows.
  • the number of the plurality of windows may be 2, and the sub-interfaces corresponding to the two windows are the first sub-interface and the second sub-interface.
  • the information element displayed in any of the sub-interfaces corresponding to the multiple windows can be moved to another sub-interface under the drag of the user to complete the cross-application transmission of information.
  • the information element can be transferred from the application corresponding to the first sub-interface to the application corresponding to the second sub-interface.
  • the display area of the electronic device due to the limitation of the display area of the electronic device, the number of windows (sub-interfaces) in the first interface is limited, the number of application interfaces that can be displayed is limited, and the user needs to open these applications in advance through corresponding user operations, and the application interfaces of these applications need to be displayed in split screens.
  • the user wants to share the element dragged in the first interface to an application that is not opened (i.e., the application interface cannot be displayed in the first interface)
  • the sub-interface displayed in the first interface cannot meet his needs.
  • the second operation can be used to make the electronic device display the "cross-application transmission interface" provided in this application, that is, the second interface is used to share the information element of the first interface to an unopened application (that is, the application interface cannot be displayed in the first interface).
  • the side of the interface can display the service icon of the application recommended by the electronic device for the information element; then, the user places the dragged information element on the icon and releases it, and the information element can be transferred to the application service corresponding to the icon and the corresponding application service function is started.
  • the second operation can be used to select the first information.
  • the second operation can be an operation of long pressing the first information and then dragging it to the side of the first interface (i.e., the side of the display screen). If the user does not let go, the dragged first information moves in the first interface along with the user's fingertips.
  • the electronic device can display the second interface.
  • the application services corresponding to the at least one application service icon are all application services that can receive the above-mentioned first information.
  • the beautification service provided by the electronic device can beautify the image, and the search service provided by the electronic device can perform intelligent search on the image, etc. Therefore, the at least one application service icon can include application service icons corresponding to these services.
  • the at least one application service icon may include multiple application service icons corresponding to one application at the same time. It should be noted that the at least one application service icon is an application service icon rather than an application icon, and the at least one application service icon may not be displayed in the first interface. When the user drags the dragged information (such as the first information) to an icon among the at least one application service icon, the information may be directly received by the application service corresponding to the icon.
  • the user needs to associate the first information with the target icon through the third operation, and the electronic device can transmit the first information to the application service corresponding to the target icon in response to the third operation.
  • the third operation can be an operation of dragging the first information close to the target icon, or an operation of dragging the first information onto the target icon and releasing it, or other operations of associating the first information with the target icon, as long as the third operation can select the target icon required by the user from the at least one application service icon and associate the first information with the target icon.
  • the information transmission process provided by the present application is continuous from the user dragging up the first information to the first information being placed into the application service corresponding to the target icon.
  • continuous here means that the user has no There is no need to perform operations such as copying and pasting, nor is there any need to switch applications. The user's fingers do not need to leave the screen of the electronic device during the entire operation process. The operation is simple and fast, which can effectively improve the user's efficiency in transmitting information across applications and enhance the user experience.
  • the second interface may also display a third sub-interface.
  • the element content displayed in the third sub-interface is the same as the element content displayed in the first interface (except the status bar).
  • the third sub-interface displayed in the second interface can be considered as the interface obtained by the electronic device after three-dimensional transformation of all the element content of the first interface (except the status bar).
  • the sub-interface can create a visual effect of the original interface (i.e., the first interface) being pushed inward on the screen.
  • this "opening door” visual effect metaphorically transmits the behavior of the element (i.e., the first information), which is more intuitive than copying and pasting, and this information transmission method ensures the effective browsing area of the user interface, and can transmit the first information to other application services while viewing the historical application interface (i.e., the first interface) through the sub-interface, which can further enhance the user experience.
  • the background behind the sub-interface can be set to the desktop background (i.e., desktop wallpaper) of the electronic device, and the resulting picture after the blur effect is superimposed, so as to provide users with better visual effects.
  • the first sub-interface and the second sub-interface are displayed in a top-bottom split screen or a left-right split screen; or, the first sub-interface and the second sub-interface are displayed in a picture-in-picture format.
  • the present application does not limit the relative positions of the first sub-interface and the second sub-interface in the first sub-interface.
  • the first sub-interface can be displayed above the second sub-interface, or below the second sub-interface.
  • the first sub-interface and the second sub-interface are displayed in the form of picture-in-picture
  • the first sub-interface is a full-screen interface
  • the second sub-interface can be an interface displayed in a floating window (small window);
  • the first sub-interface can also be an interface displayed in a floating window (small window), and
  • the second sub-interface can be an interface displayed in a full-screen interface, and this application does not limit this.
  • the user when information is transmitted between two applications corresponding to the first sub-interface and the second sub-interface, the user can drag the information elements in the interface displayed in the floating window (small window) to the full-screen interface, or drag the information elements in the interface displayed in the full-screen interface to the interface displayed in the floating window (small window).
  • the user can also drag the information elements in the interface displayed in the floating window (small window) or the information elements in the interface displayed in the full-screen to the side of the screen, so that the electronic device displays the "cross-application transmission interface", that is, the second interface.
  • the second operation is an operation of associating the first information with the target icon.
  • the second operation is an operation of moving the first information to the target icon.
  • moving the first information to the target icon may be moving the first information around the target icon so that the target icon is the icon closest to the first information among the at least one application service icon; or, moving the first information to the target icon may be moving the first information above the target icon.
  • the “above” mentioned here refers to the first information and the target icon.
  • the target icon overlaps, and the first information is displayed overlaid on the target icon.
  • the second operation may also include leaving the first information on (or around) the target icon for a period of time (for example, 120ms), or dragging the first information onto (or around) the target icon and then directly releasing it, so as to trigger the transmission of the first information to the application service corresponding to the target icon.
  • a period of time for example, 120ms
  • the target icon in the process of moving the first information to the target icon, the target icon is enlarged and/or the position of the target icon in the first interface is moved, and the direction of moving the target icon is opposite to the direction of moving the first information.
  • the target icon in order to guide the user to accurately place the first information into the application service they need, in the process of dragging the first information to the target icon, when the first information is close to the target icon (it is assumed here that the target icon is always the icon closest to the first information among the at least one application service icon during the entire dragging process), the target icon can be enlarged, and the target icon can be moved in the second interface to make the target icon closer to the first information, creating a visual effect in the second interface that the target icon is absorbed by the first information (that is, the moving direction of the first information is opposite to the moving direction of the target icon, and both are approaching each other), so as to prompt the user that the first information has been associated with the target icon. If the user lets go here, the first information will be transmitted to the application service corresponding to the target icon.
  • the electronic device will enlarge the target icon in the second interface and/or move the position of the target icon in the first interface only when the distance between the first information and the target icon is less than a first threshold.
  • the at least one application service icon includes at least one first icon, and the at least one first icon is an application service icon recommended based on the first information.
  • the electronic device can recommend icons to the user based on the content contained in the first information. Specifically, for the icons recommended by the electronic device to the user, the electronic device can first identify the first information that is dragged up (the electronic device has not yet displayed the second user interface), and obtain the application service icon that meets the user's needs in the second interface based on the identification result.
  • the identification result may include the type of the first information and the element content contained in the first information.
  • the electronic device can identify the QR code image in the first information, and display the application service icon that can scan the QR code for the user in the second interface, such as WeChat-Scan, Alipay-Scan, etc.;
  • the first information is a picture containing a face image
  • the user can identify the face image in the first information, and display the application service icon that can beautify the image or can be used to share the image in the second interface, such as Meitu-Portrait Beautification, WeChat-Friends Circle, etc.
  • the electronic device can recognize the location information in the text and display application service icons for the user to navigate or take a taxi to the location information in the second interface, such as map application A-navigation, map application A-one-click taxi, etc.; assuming that the above-mentioned first information is text containing time and location information, the electronic device recommends schedule-related application service icons to the user, such as schedule-add schedule, etc.
  • the at least one application service icon displayed on the electronic device based on the two elements may also be different; it should be understood that the "different" mentioned here may include different icon types and different icon orders.
  • the icon of the application service recommended to the user that is, the at least one first icon
  • the icon corresponding to the application service that is more in line with the current user's intention will be located higher up in the icon area.
  • the current user's intention can be determined based on the element content contained in the dragged information. For example, when the information is an image and contains a QR code image, icons corresponding to application services such as WeChat-Scan and Alipay-Scan can be displayed at the top of the at least one application service icon; when the information is text and contains location information, icons corresponding to application services such as Map Application A-Navigation, Map Application A-One-click Taxi, etc. can be displayed at the top of the at least one application service icon.
  • application services such as WeChat-Scan and Alipay-Scan
  • icons corresponding to application services such as Map Application A-Navigation, Map Application A-One-click Taxi, etc.
  • the method after transmitting the first information to the application service corresponding to the target icon, the method also includes: displaying a third interface, the third interface including all the contents of the first interface, and the third interface also includes any one of a floating window and an information feedback bar, the floating window is used to display the target icon or the application service interface corresponding to the target icon, and the information feedback bar is used to prompt the electronic device of the transmission result of the first information.
  • the electronic device can also provide the user with different prompt methods and display different interface effects according to the type of application service entered by the information and the result of the information transmission, so as to prompt the user to know the transmission result of the first information and proceed to the next step.
  • the third interface includes a floating window, which is used to display the target icon.
  • the third interface also includes second information.
  • the method After displaying the third interface, the method also includes: in response to a fourth operation on the second information, transmitting the second information to an application service corresponding to the target icon, and the fourth operation is an operation of associating the second information with the floating window.
  • the content of the third interface is the same as that of the first interface.
  • the floating window is a minimized floating window, which may not display the application interface but only the target icon, and the floating window may be displayed close to the right or left edge of the third interface to reduce the obstruction of the third interface, so that the user can continue to transmit the information in the third interface (such as the second information) to the application service corresponding to the target icon.
  • the floating window can be expanded in response to a user's click operation.
  • the floating window can be displayed in the third interface (at this time, the floating window can no longer be displayed edge to edge, but it is still not displayed in full screen), and it can display an expansion control, which can display the application interface in the floating window in full screen on the screen in response to user operation.
  • the third interface includes a floating window, which is used to display the application service interface corresponding to the target icon, and the floating window includes an expansion control.
  • the method also includes: in response to a fifth operation on the expansion control, displaying the application service interface displayed in the floating window in full screen.
  • the floating window is a floating window that is displayed on top of the third interface.
  • the third interface can still display the content in the first interface, and the floating window can display the application service interface corresponding to the target icon.
  • the third interface includes an information feedback bar
  • the information feedback bar includes a jump control
  • the method further includes: in response to the jump control
  • the sixth operation is to display a fourth interface, where the fourth interface is an application service interface corresponding to the target icon.
  • the target icon corresponds to an application service such as global collection
  • the electronic device does not need to directly jump to its corresponding application interface, but only needs to inform the user of the result of the information transmission. Therefore, the third interface may display the information feedback bar to prompt the user of the result of the first information transmission.
  • the information feedback bar is a jump bar, which may include the jump control, so that the user can quickly enter the application service interface corresponding to the target icon by clicking the jump control to view the processing result of the application service corresponding to the target icon on the first information.
  • the first interface also includes a first trigger area and a second trigger area, the first trigger area is larger than the second trigger area, the second operation includes a first sub-operation and a second sub-operation, the first sub-operation is an operation of moving the first information to the first trigger area, and the second sub-operation is an operation of moving the first information to the second trigger area, and the second interface is displayed in response to the second operation on the first information in the first interface, including: in response to the first sub-operation, when the first information stays in the first trigger area for a first time length, displaying a light band guide effect in the first interface, the light band guide effect is used to indicate that the first information is moved to the second trigger area; in response to the second sub-operation, displaying the second interface.
  • the first interface may include the first trigger area and the second trigger area.
  • the specific size and position of the first trigger area and the second trigger area may not be displayed in the user interface, that is, the user cannot directly observe the specific outlines of the two areas in the first interface, and the size and position of the two areas may be stored in the electronic device only in a form perceptible to the electronic device (such as program code).
  • the electronic device may display special effects in the first interface (such as the edge of the first interface) to prompt the user to further drag the image closer to the second trigger area;
  • the special effect may be a user-visible special effect such as a luminous special effect, a shadow special effect, or other user-perceptible special effects, which is not limited in this application;
  • the electronic device may also display special effects in the first interface only after the user drags the first information to the first trigger area and keeps the first information in the first trigger area for a period of time T.
  • T may be set to 600 milliseconds.
  • the electronic device can immediately respond to the operation and display the second interface.
  • the second interface also includes a door closing trigger area.
  • the electronic device may no longer display the second interface, but redisplay the first interface, and when the first interface is redisplayed, the first information is displayed in the door closing trigger area.
  • the first information in the first interface is still in a state of being dragged up by the user, so that the user can reselect a method for transmitting the information across applications.
  • the first trigger area exists in both the first interface and the second sub-interface
  • the second trigger area exists in both the first interface and the second sub-interface
  • the electronic device can respond to the user operation in a timely manner to guide the opening of the "cross-application transmission interface".
  • the second interface also includes an icon area, the at least one application service icon is displayed in the icon area, the at least one application service icon also includes at least one second icon, the at least one second icon is a custom displayed application service icon, and the at least one first icon is displayed above the at least one second icon.
  • the at least one application service icon is displayed in the icon area, and the at least one application service icon in the second interface can be divided into two parts, one of which is a fixedly displayed icon (i.e., the at least one second icon), and the other part of the icon can be an application service icon recommended to the user based on the first information.
  • a dividing line for distinguishing between the two parts of icons can be displayed.
  • the at least one second icon is an icon that the user customizes to display according to his own usage habits and frequency of use.
  • the electronic device can include this part of icons in the icons displayed based on the information to meet the needs of the user as much as possible; and the at least one first icon is recommended by the electronic device based on the elements contained in the first information.
  • the recommended application service icon can be different from the icon in the at least one first icon.
  • the at least one application service icon includes at least one icon displayed in the icon area and at least one icon not displayed in the icon area, the target icon is not displayed in the icon area, the second interface also includes a third trigger area, and before responding to the second operation on the first information, the method also includes: in response to a seventh operation on the first information, updating the at least one icon displayed in the icon area until the target icon is displayed in the icon area, and the seventh operation is an operation to move the first information to the third trigger area.
  • the electronic device can recommend multiple application services that can receive the first information to the user based on the first information, and display the icons of these application services on the right side of the second interface.
  • the upper limit of the number of these application service icons can be 20.
  • the electronic device can only display a part of these application service icons (for example, 7) in the second interface at the same time when displaying; when none of the icons currently displayed on the second interface are the application services expected by the user, the user can also place the first information in the third trigger area to enable the electronic device to update the icons in the icon area.
  • the third trigger area can be set directly above and/or directly below the icon area.
  • an area of the first information in the second interface is smaller than an area of the first information in the first interface.
  • the first information in the second interface contains the same content as the first information in the first interface.
  • the area of the first information can be reduced to facilitate the user to select the application service icon.
  • the first information is any one of an image, text, an audio file, a video file, and a document file.
  • the present application provides a method for information transmission, including: in response to any one of a global screenshot operation, a local screenshot operation, and a long screenshot operation on a fifth interface, displaying a sixth interface, the sixth interface including a first image obtained by screenshotting the fifth interface; in response to an eighth operation on the first image in the sixth interface, displaying a seventh interface; the seventh interface including the first image and at least one application service icon; in response to a ninth operation on the first image in the seventh interface, transmitting the first image to the application service corresponding to the target icon, the target icon being any one of the at least one application service icon.
  • most smart devices provide users with a quick screenshot function.
  • users can double-click the screen or slide down with three fingers to take a full-screen screenshot of the current interface of the electronic device; in some embodiments, the electronic device can also temporarily display the image captured by the user through the full-screen screenshot operation in the form of a thumbnail in the interface. Therefore, in this embodiment, after the user captures an image through the full-screen screenshot operation, the image is displayed in the first interface in the form of a thumbnail, and the user can use the quick screenshot function and the transmission method provided by this application to more quickly transmit the captured image to the application service corresponding to the target icon.
  • the first image is an image obtained by performing a global screenshot operation on the fifth interface
  • the display of the seventh interface in response to the eighth operation on the first image in the six interfaces includes: in response to a click operation on the first image in the sixth interface, an editing interface is displayed, the editing interface includes the first image and editing options, and the editing options are used to edit the first image; in response to the editing operation on the first image through the editing option, after the image content of the first image in the editing interface is updated, in response to the move operation on the first image in the editing interface, the seventh interface is displayed, and the eighth operation includes the click operation, the editing operation and the move operation.
  • the user may also need to edit the obtained image, such as further capturing the captured image to change its image area, or marking important content in the image with a brush, and then sharing or uploading the edited image to other applications.
  • the electronic device after the electronic device briefly displays the image captured by the user through the full-screen screenshot operation in the form of a thumbnail (i.e., the first image) in the sixth interface, the user can enter the image editing interface through the click operation; in the editing interface, the user can edit the first image accordingly, and after the editing operation is completed, the electronic device still displays the editing interface, and the user can directly use the move operation in the editing interface to make the electronic device display the second interface, and transmit the edited image (i.e., the first information) to the application service corresponding to the target icon through the ninth operation.
  • the edited image i.e., the first information
  • the present application provides a method for information transmission, comprising: in response to a partial screenshot operation of an eighth interface, displaying a ninth interface, the ninth interface including a second image obtained by a partial screenshot operation of the eighth interface and a text recognition control, the text recognition control being used to recognize text contained in the second image; in response to a click operation on the text recognition control, displaying a tenth interface, the tenth interface including a second image obtained by a partial screenshot operation of the eighth interface.
  • a first text message obtained by line identification in response to a tenth operation on the first text message in the tenth interface, an eleventh interface is displayed; the eleventh interface includes the first text message and at least one application service icon; in response to the eleventh operation on the first text message in the eleventh interface, the first text message is transmitted to the application service corresponding to the target icon, and the target icon is any one of the at least one application service icon.
  • some smart devices After the user takes a screenshot, some smart devices also provide the user with a recognition function in this scenario, which is used to recognize the image captured by the user (for example, extracting text from the image or translating text, etc.). Therefore, with respect to the screenshot function provided by the electronic device, in this method, the electronic device can quickly obtain the image selected by the user using the knuckle frame through the local screenshot operation, and display the ninth interface.
  • the user can recognize the text information contained in the image selected by the local screenshot frame by clicking the text recognition control; thereafter, the user can perform the tenth operation on the first text information obtained by the recognition so that the electronic device displays the "cross-application transmission interface" provided in this application, that is, the tenth interface, and transmit the text information (that is, the first information) to the application service corresponding to the target icon through the eleventh operation.
  • the text information contained in the image selected by the local screenshot box can be selected by the first cursor and the last cursor box, and the user can also adjust the position of the first cursor and the last cursor to further filter the text information to obtain the first text information that he needs to transmit.
  • the present application provides an electronic device, comprising: one or more processors and a memory; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the electronic device to execute the method in the first aspect or any possible implementation of the first aspect, the method in the second aspect or any possible implementation of the second aspect, and the method in the third aspect.
  • the present application provides a chip system, which is applied to an electronic device, and the chip system includes one or more processors, and the processors are used to call computer instructions so that the electronic device executes the method in the first aspect or any possible implementation of the first aspect, the method in the second aspect or any possible implementation of the second aspect, and the method in the third aspect.
  • the present application provides a computer-readable storage medium comprising instructions.
  • the electronic device executes the method in the first aspect or any possible implementation of the first aspect, the method in the second aspect or any possible implementation of the second aspect, and the method in the third aspect.
  • the present application provides a computer program product comprising instructions, which, when the above-mentioned computer program product is run on an electronic device, enables the above-mentioned electronic device to execute the method in the first aspect or any possible implementation of the first aspect, the method in the second aspect or any possible implementation of the second aspect, and the method in the third aspect.
  • a data sharing method may include: displaying a first interface, the first interface including a first element; detecting a drag operation on the first element;
  • the drag operation is a first drag operation
  • the touch start point of the first drag operation is on the first element and located in the first area of the display screen
  • the touch end point is located in the second area of the display screen
  • a first menu bar is displayed, the first menu bar includes an icon of the first application and an icon of the second application, and the first area and the second area do not overlap; after detecting that the first element is continued to be dragged into the area where the icon of the first application is located and released, first data corresponding to the first element is shared with the first application;
  • the touch start point of the second drag operation is on the first element and is located in the second area, the touch endpoint is located in the second area of the display screen, the track of the second drag operation is located in the second area, and the first menu bar is not displayed;
  • the touch start point of the third drag operation is on the first element and located in the second area, the touch end point is located in the second area, and the track of the third drag operation passes through the first area, and the first menu bar is displayed.
  • the electronic device will display the first menu bar after detecting the operation of dragging the first element from the first area to the second area, or detecting the operation of dragging the first element from the second area to the first area and then to the second area, and the electronic device will not display the first menu bar after detecting the operation of dragging the first element within the second area.
  • This can provide users with a convenient, simple, fast, smooth and intuitive data sharing solution, facilitate users to share data when needed, and can avoid displaying the first menu bar when the touch point is first located in the second area, so as to achieve an anti-mistouch effect.
  • a first menu bar is displayed in response to the first drag operation; when the drag operation is a second drag operation, the first menu bar is displayed without responding to the second drag operation; when the drag operation is a third drag operation, the first menu bar is displayed in response to the third drag operation.
  • the drag operation when the drag operation is a first drag operation, the first menu bar is displayed after the touch endpoint of the first drag operation stays in the second area for a first time period; when the drag operation is a second drag operation, the first menu bar is not displayed after the touch endpoint of the second drag operation stays in the second area for a first time period; when the drag operation is a third drag operation, the first menu bar is displayed after the touch endpoint of the third drag operation stays in the second area for a first time period.
  • the electronic device displays the first menu bar again, which can provide the user with a data sharing service more accurately and avoid accidentally triggering the first menu bar.
  • the first dragging operation, and the operation of continuing to drag the first element into the area where the icon of the first application is located and releasing it, are continuous and uninterrupted.
  • the method may further include: displaying a second interface, the second interface including text; detecting an operation of selecting a first text in the text, displaying a toolbar on the first text, the toolbar including a plurality of controls for processing the first text; displaying the first interface, including: detecting a long press operation on the first text, stopping displaying the toolbar, and displaying the first interface; wherein the first element includes a preview image of the first text, and the first data includes the first text.
  • the method before displaying the first interface, may further include: when displaying the second interface, detecting a screenshot operation; displaying the first interface, including: in response to the screenshot operation, displaying the first interface, the first element including a preview of the screenshot image of the second interface, and the first data including the screenshot image.
  • the electronic device can conveniently share screenshots.
  • the method before displaying the first interface, may further include: displaying the second interface, the second interface including an icon of the first image and an icon of the second image; detecting an operation of selecting the icon of the first image; displaying the first interface, including: detecting a long press operation on the icon of the first image, and displaying the first interface; wherein the first element includes a preview image of the icon of the first image, and the first data includes the first image.
  • images which may include pictures, animated images, videos, and other types.
  • the first menu bar and the second area where the touch endpoint of the first drag operation or the third drag operation is located are on the same side of the display screen. That is, the electronic device displays the first menu bar in the direction in which the user drags the first element, which can provide the user with a better user experience.
  • the first interface when the drag operation is the first drag operation, or when the drag operation is the third drag operation, when the first menu bar is displayed, the first interface is also adjusted to a perspective style of the first side, where the first side is a side of the first menu bar in the display screen. In this way, the first interface and the first menu bar in the perspective style of the first side can vividly form an "open door" effect.
  • the first interface also includes a video being played
  • the method may further include: when the dragging operation is a first dragging operation, or when the dragging operation is a third dragging operation, when the first menu bar is displayed, a screenshot image of the first interface is displayed, and the screenshot image of the first interface is displayed in a perspective style of the first side, and the first side is a side of the first menu bar in the display screen.
  • the second area includes: a rectangular area at the left edge of the display screen, and a rectangular area at the right edge of the display screen, and the height of the rectangular area is the same as the height of the display screen.
  • the method may also include: in response to the operation of dragging the first element to the third area in the first drag operation, displaying a light band, the light band and the first menu bar are located on the same side of the display screen; displaying the first menu bar includes: in response to the operation of dragging the first element to the third area and then to the second area in the first drag operation, stopping displaying the light band and displaying the first menu bar.
  • the electronic device displays the light band to prompt the user to continue dragging in the same direction to trigger the display of the first menu bar, thereby sharing data.
  • the third area includes: a rectangular area at a left edge of the display screen, and a rectangular area at a right edge of the display screen, and a height of the third area is the same as a height of the display screen.
  • the first menu bar also includes an icon of a third application and an icon of a fourth application, and the icon of the first application, the icon of the second application, the icon of the third application, and the icon of the fourth application are arranged in sequence from top to bottom; after displaying the first menu bar, the method may also include: detecting a fourth drag operation of continuing to drag the first element in a fourth area, the fourth area includes the second area where the touch end point of the first drag operation or the third drag operation is located, the touch starting point of the fourth drag operation is the same as the touch end point of the first drag operation or the third drag operation, and the touch end point of the fourth drag operation is closest to the icon of the second application in the first menu bar; in response to the fourth drag operation, displaying the icon of the fourth application as the basic size, displaying the icon of the second application as a size enlarged by a first ratio on the basic size, and displaying the icon of the first application and the icon of the third application as sizes enlarged by a second ratio
  • the closer the touch point of the user and the display screen is to the icon of the application in the first menu bar the larger the icon of the corresponding application can be.
  • the effect of the icon of the application in the first menu bar being attracted by the user's finger can be presented, and the user can focus on the icon of the corresponding application by enlarging the size of the application icon.
  • the fourth area includes: a rectangular area including the second area where the touch endpoint of the first drag operation or the third drag operation is located, and the height of the fourth area is the same as the height of the display screen.
  • the method may further include: detecting a fifth drag operation of continuing to drag the first element to the fifth area, and the fifth area and the fourth area do not overlap; in response to the fifth drag operation, displaying each icon in the first menu bar as the basic size.
  • the method may further include: detecting that the first element is continued to be dragged A sixth drag operation is performed to the sixth area, the sixth area and the second area do not overlap, and the sixth area is located on the opposite side of the first menu bar in the display screen; in response to the sixth drag operation, the first menu bar stops being displayed.
  • the electronic device provides a sixth area for stopping displaying the first menu bar. After the user mistakenly triggers the electronic device to display the first menu bar, the user can stop the mistaken operation simply, conveniently and quickly.
  • the touch start point of the sixth drag operation is the same as the touch end point of the first drag operation or the third drag operation, that is, the sixth drag operation and the first drag operation or the third drag operation are continuous and uninterrupted. In this way, the user does not need to leave the display screen of the electronic device and keeps in continuous contact with the display screen, thereby conveniently and quickly avoiding misoperation.
  • the sixth region and the fifth region do not overlap.
  • the method may also include: displaying a third interface, the third interface including a second element; detecting a drag operation on the second element; when the drag operation is a seventh drag operation, the touch starting point of the seventh drag operation is on the second element and located in the seventh area of the display screen, and the touch end point is located in the eighth area of the display screen, and a second menu bar is displayed, and the seventh area and the eighth area do not overlap; when the drag operation is an eighth drag operation, the touch starting point of the eighth drag operation is on the second element and located in the eighth area, and the touch end point is located in the eighth area of the display screen, the trajectory of the eighth drag operation passes through the seventh area, and a second menu bar is displayed; when the drag operation is not the seventh drag operation or the eighth drag operation, the second menu bar is not displayed; wherein the eighth area is a partial area of the second area.
  • the eighth area includes: a rectangular area at the left edge of the display screen, and a rectangular area at the right edge of the display screen; the height of the eighth area is the same as that of the second area, and the width of the eighth area is half of the width of the second area.
  • the third interface is provided by a fifth application, and the fifth application includes a text editing application.
  • the icons of applications included in the second menu bar and the icons of applications included in the first menu bar may be different.
  • the icons included in the first menu bar may include icons of applications that support receiving the first data
  • the icons included in the second menu bar may include icons of applications that support receiving the second data corresponding to the second element.
  • the second area when the display screen is in the horizontal state is different from the second area when the display screen is in the vertical state.
  • the first interface is provided by a sixth application, and the sixth application is different from the first application.
  • the method can realize cross-application data transmission.
  • an electronic device comprising: a memory, a processor, and a computer program stored in the memory, wherein the processor executes the computer program to implement the method provided in the eighth aspect or any one of the embodiments of the eighth aspect.
  • a computer-readable storage medium on which a computer program is stored.
  • the computer program is executed by a processor, the method provided in the eighth aspect or any one of the embodiments of the eighth aspect is implemented.
  • a computer program product which includes a computer program, and when the computer program is executed by a processor, it implements the method provided in the eighth aspect or any one of the embodiments of the eighth aspect.
  • a method for recommending services is provided, which is applied to an electronic device.
  • the method may include: acquiring a first content; converting the first content into a first entity, the first entity including an entity category and an entity value; identifying a corresponding first intent based on the first entity; determining a service that supports the first intent; and displaying an icon of the service on a display screen.
  • the electronic device can recommend desired services to the user based on the user's personal intentions, making it easier for the user to use these services.
  • the electronic device may determine the entity category of the first entity and/or the first intent category corresponding to the modality to which the first content belongs based on a mapping relationship between the entity category and/or modality and the intent category; and determine the first intent based on the first intent category and the entity value. In this way, the electronic device may determine the user's intent category based on the entity category and/or modality.
  • the electronic device may determine the intent based on the global intent system. Specifically, the electronic device may find the first intent category of the entity category labeled as the first entity in the global intent system; fill the entity value of the first entity into the slot indicated by the first intent category to obtain the first intent; wherein the global intent system includes information on multiple types of intents, and the information on each type of intent includes the following items of the corresponding category: label, slot name.
  • the information of each category of intent also includes one or more of the following for the corresponding category: identification, level, category of the value filled in the slot, necessity of the slot.
  • the global intent system is pre-stored in the electronic device, or downloaded from a network by the electronic device.
  • the electronic device may also search for services based on the global service system. Specifically, the electronic device may find a service whose supported intent category is identified as a first identifier in the global service system, where the first identifier is an identifier of a category to which the first intent belongs; and determine the service whose supported intent category in the global service system is identified as the first identifier as a service that supports the first intent; wherein the global service system includes information on multiple services, and the information on each service includes: an identifier of an intent category supported by the corresponding service.
  • the information of each service also includes one or more of the following for the corresponding service: ID, name, icon, type, slot name, package name of the application to which it belongs, component name, URL, and parameter name for transmitting data.
  • the global service system is pre-stored in the electronic device, or is downloaded from the network by the electronic device.
  • the information of each service also includes: a slot name, a parameter name for transmitting data
  • the method of the twelfth aspect may also include: receiving a user operation of the icon of the first service among the icons acting on the services; passing the value of the first slot in the first intention to the first parameter of the first service, the first slot being the slot indicated by the slot name of the information of the first service, and the first parameter being the parameter indicated by the parameter name of the information of the first service; and starting the first service based on the first parameter.
  • the electronic device can obtain the first content through the entrance of the first service; before obtaining the first content, the method may also include: subscribing to the intent category supported by the first service, and the first intent belongs to the intent category supported by the first service.
  • the electronic device may obtain the first content through the entrance of the first service; before obtaining the first content, the method may also include: subscribing to a service supported by the first service, the first service belonging to the services supported by the first service.
  • the method may also include: sorting multiple services that support the first intent, and arranging the service icons displayed on the display screen in sequence according to the sorting of the multiple services.
  • there may be multiple rules for sorting multiple services such as most recently used first, most frequently used first, intent categories with high confidence (i.e., high levels) corresponding to the intent, user's application preference order, etc.
  • the method may further include: sorting the multiple first intents corresponding to the first entity, and the sorting of the multiple services is obtained according to the sorting of the multiple first intents.
  • the manner in which an electronic device sorts multiple first intentions corresponding to a first entity may include: using a click-through rate prediction model to sort multiple first intentions corresponding to the first entity; wherein the click-through rate prediction model is trained based on multiple groups of first historical behavior data, and a group of first historical behavior data includes: time features, content features, and click-through rate features; the time features indicate one or more of the following: whether the time when the electronic device historically acquired content was a weekday, a holiday, or a time period; the content features indicate one or more of the following: the source application of the content acquired by the electronic device, the length of the content, the entity category of the entity corresponding to the content, and the modality of the content; the click-through rate features indicate: after the electronic device acquires the content and recommends the service, the user's click rate on the recommended service.
  • mapping relationship mining method is provided, and the electronic device can mine the mapping relationship from subsequent behaviors that are not clicked after the recommendation, thereby supplementing and recalling the mapping relationship and better providing recommendation services for users.
  • the electronic device can also learn undefined intent categories. Specifically, the electronic device can obtain multiple sets of second historical behavior data; determine the third intent category based on the multiple sets of second historical behavior data; wherein a set of second historical behavior data includes: after the electronic device displays the icon of the recommended service on the display screen according to the content corresponding to the first entity category and/or the first modality input by the user, and does not receive the user operation acting on the icon of the service, the electronic device starts the service under the trigger of the user within the first time period after stopping displaying the icon of the service; the third intent category is defined according to the N services with the highest startup frequency in the multiple sets of second historical behavior data.
  • a method for mining new intent categories is provided.
  • the electronic device can mine potential undefined new intent categories from subsequent behaviors that are not clicked after the recommendation, and define the mapping relationship between the new intent category and the entity category and/or modality, thereby supplementing the recall of the intent category and the mapping relationship to better provide recommendation services for users.
  • the method may further include: determining that the first entity category and/or the first modality has a mapping relationship with the third intent category.
  • the electronic device can also preload the resources required for subsequent use. For example, the electronic device can load the mapping relationship between entity categories and/or modalities and intent categories, or load the global intent system, or load the global service system. In this way, the electronic device can load the required resources in advance, speeding up the download process. Processing of subsequent steps.
  • the electronic device can extract features of multimodal content in parallel. Specifically, the electronic device can start a first thread and a second thread in parallel, the first thread is used to extract features of the content of the first modality, and the second thread is used to extract features of the content of the second modality; according to the features of the content of the first modality and the features of the content of the second modality, the first entity is obtained.
  • the first thread includes one or more threads
  • the second thread includes one or more threads
  • one thread is used to call an entity recognition capability to recognize an entity.
  • an electronic device comprising: a memory, a processor, and a computer program stored in the memory, wherein the processor executes the computer program to implement the method provided in the twelfth aspect or any one of the embodiments of the twelfth aspect.
  • a computer-readable storage medium on which a computer program is stored.
  • the computer program is executed by a processor, the method provided in the twelfth aspect or any one of the embodiments of the twelfth aspect is implemented.
  • a computer program product which includes a computer program, and when the computer program is executed by a processor, it implements the method provided in the twelfth aspect or any one of the embodiments of the twelfth aspect.
  • FIG1 is a schematic diagram of a process for transmitting information across applications provided by an embodiment of the present application
  • FIG2 is a schematic diagram of a process for transmitting information across applications provided by an embodiment of the present application
  • FIG3A is a schematic diagram of a process of transmitting an image across applications provided by an embodiment of the present application.
  • FIG3B is a structure of a framework for recommending services provided in an embodiment of the present application.
  • FIG3C is another structure of a framework for recommending services provided in an embodiment of the present application.
  • FIG3D is a flow chart of a method for performing self-learning of intentions in a service recommendation process by an electronic device provided by an embodiment of the present application;
  • FIG4 is a schematic diagram of a process of transmitting text across applications provided by an embodiment of the present application.
  • FIG5 is a schematic diagram of a process of transmitting information across applications in a horizontal screen state provided by an embodiment of the present application
  • FIG6 is a schematic diagram of a process for transmitting a global screenshot image across applications provided by an embodiment of the present application
  • FIG7 is a schematic diagram of a process for transmitting a partial screenshot image across applications provided by an embodiment of the present application
  • FIG8 is a schematic diagram of a process for transmitting text in a partial screenshot image across applications provided by an embodiment of the present application
  • FIG9 is a schematic diagram of a process of triggering an “inter-application transmission interface” operation provided by an embodiment of the present application.
  • FIG10 is a schematic diagram of an operation process of closing a “cross-application transmission interface” provided in an embodiment of the present application.
  • FIG11 is a schematic diagram of an operation process of closing a “cross-application transmission interface” provided in an embodiment of the present application.
  • FIG12 is an interface diagram of some cross-application transmissions through a split-screen function provided in an embodiment of the present application.
  • FIG13 is an interface diagram of cross-application transmission via the “cross-application transmission interface” in some split-screen states provided by an embodiment of the present application
  • FIG14 is an interface diagram of some picture-in-picture functions for cross-application transmission provided in an embodiment of the present application.
  • FIG15 is an interface diagram of cross-application transmission via the “cross-application transmission interface” in some picture-in-picture states provided by an embodiment of the present application
  • FIG16 is an interface diagram of a snack bar providing feedback after some information is transmitted across applications provided by an embodiment of the present application
  • FIG17 is a schematic diagram of an interface for providing feedback in a capsule after some information is transmitted across applications according to an embodiment of the present application
  • FIG. 18 is a schematic diagram of a process of performing secondary transmission through a capsule and then unfolding the capsule according to an embodiment of the present application
  • FIG. 19 is a schematic diagram of an interface for providing feedback in a floating window after some information is transmitted across applications according to an embodiment of the present application
  • FIG. 20 is a schematic diagram of an interface for providing feedback in a snackbar after some information is transmitted across devices according to an embodiment of the present application;
  • FIG21 is a schematic diagram of an interface for providing feedback in the form of toast after some information fails to be transmitted across devices according to an embodiment of the present application;
  • 22A-22N are a set of user interfaces for implementing data sharing on an electronic device provided in an embodiment of the present application.
  • FIG23 is a schematic diagram of various hot zones of a mobile phone in portrait mode provided by an embodiment of the present application.
  • FIG24 is a schematic diagram of hot spots in a horizontal screen state of a mobile phone provided by an embodiment of the present application.
  • 25A-25F are a set of user interfaces for sharing screenshots provided in an embodiment of the present application.
  • FIG25G is a user interface for preventing accidental touches provided in an embodiment of the present application.
  • 25H-25L are another user interface for preventing accidental touches provided in an embodiment of the present application.
  • 25M-25R are another user interface for preventing accidental touches provided in an embodiment of the present application.
  • 26A-26B are a set of user interfaces for moving a floating window provided in an embodiment of the present application.
  • 26C-26L are user interfaces for preventing accidental touches in a floating window scenario provided by an embodiment of the present application.
  • FIG27 is a schematic diagram of a process of updating icons in an icon area provided by an embodiment of the present application.
  • FIG28 is an interface diagram of some application service icons displayed to users based on location information provided by an embodiment of the present application
  • FIG29 is an interface diagram showing some application service icons for users based on location and time information provided by an embodiment of the present application
  • FIG30 is an interface diagram of some application service icons displayed to users based on QR code images provided in an embodiment of the present application
  • FIG31 is an interface diagram of some application service icons displayed to users based on face images provided in an embodiment of the present application.
  • FIG32 is an interface diagram of some information transmission via chat interface thumbnails in the “cross-application transmission interface” provided by an embodiment of the present application.
  • FIG33 is an interface diagram of some cross-application information transmission via sidebar icons provided in an embodiment of the present application.
  • FIG34 is an interface diagram of some custom sidebar icons provided in an embodiment of the present application.
  • FIG35 is a schematic diagram of a process for transmitting a screen recording file across applications provided by an embodiment of the present application
  • FIG36 is a schematic diagram of a process of transmitting an edited screenshot image across applications provided by an embodiment of the present application.
  • FIG37 is a schematic diagram of a process for transmitting a long screenshot image across applications provided by an embodiment of the present application
  • FIG38 is a diagram of a system setting interface related to some “smart flow” functions provided in an embodiment of the present application.
  • FIG39 is a diagram of a system setting interface related to some “smart flow” functions provided in an embodiment of the present application.
  • FIG40 is a schematic diagram of an electronic device according to an embodiment of the present application.
  • Figure 41 is a flowchart of an information transmission method provided in an embodiment of the present application.
  • Cross-application information transmission refers to the transmission of information between two applications in the same device, that is, obtaining target information through one application and sharing, collecting or editing the target information through another application. For example, forwarding text or images on a web page in a browser to a WeChat friend, or sending pictures sent by a WeChat friend to a QQ friend, etc.
  • Cross-device information transmission refers to the transmission of information between two devices after establishing a communication connection based on Wi-Fi, Bluetooth, cellular networks, etc.
  • Wi-Fi Wireless Fidelity
  • Bluetooth Wireless Fidelity
  • cellular networks etc.
  • users use Bluetooth to transfer pictures between two devices, or share pictures on a mobile phone to a personal computer in the same network environment.
  • the above information may be pictures, texts, videos, voices, links, documents, etc.
  • the "cross-application transmission interface” (or cross-application transmission interface) is an interactive method provided by the electronic device based on the user's demand for cross-application and cross-device information transmission.
  • this function can also be called “smart flow”.
  • smart flow As its name suggests, in any interface displayed by the electronic device, when the user needs to transmit the information in the interface across applications or across devices, the user only needs to long press the information element in the interface and drag it to the edge of the screen.
  • the electronic device will transform the original interface displayed on the screen in three dimensions, create a visual effect of the original interface being pushed inward on the screen, and display the electronic device's recommended icon for the element on the side of the screen (for details, please refer to the relevant description of the subsequent embodiments, which will not be repeated here).
  • the recommended icon can be the service icon of the application; after that, the user places the dragged information element on the icon and lets go, and the information element can be transferred to the application service corresponding to the icon and the corresponding application service function is started.
  • an application APP installed in an electronic device may have multiple application services.
  • the service icons of the applications displayed may include some or all of the application service icons provided by the same application APP. The present application does not limit this.
  • “Small window” is a system tool of smart devices. It can float the operation window of the application above the interface or on the desktop, allowing users to easily switch the most recently used application. As a reduced application interface, the floating window can be displayed on top of other application interfaces (such as the application interface displayed in full screen), and the small window can still display the inherent interface style and function list of its corresponding application. Users can directly operate the controls in the floating window interface to use the corresponding functions of the controls without closing or exiting the application interface of other applications. For example, when playing games or watching videos in full screen, you suddenly receive messages from WeChat, QQ, etc., and the corresponding chat interface can be directly above the game interface in the form of a floating window. Users can view and reply to messages in the chat interface displayed in the small window without switching or exiting the currently open application.
  • Capsule is a form of mini-window after mini-window is minimized. It is named because of its shape similar to a capsule. Unlike mini-window, it generally cannot display the inherent interface style and function list of its corresponding application. It will only be displayed as a small icon on the side of the electronic device screen. Users can expand the capsule by clicking on it. After expanding, the capsule will be displayed as the application. The form of the interface (such as a small window) is displayed on top of the screen.
  • Toast feedback is a lightweight feedback method and a form of non-modal pop-up window. Common toast feedback is expressed in the form of text or a combination of icon + text. The location of the page will be designed at the top, middle or bottom of the page according to different scenarios. It will disappear automatically after a certain time interval (3s to 5s), or it will disappear automatically when the user clicks on other locations. Toast feedback will not interrupt the user's current operation process and will cause minimal disturbance to the user. Its disadvantage is that it is easily ignored by users and is not suitable for displaying too much information. It may disappear before the user has finished reading the information.
  • Snack bar is a lightweight feedback method that is slightly heavier than toast. It contains a line of text related to the ongoing operation and may contain corresponding jump controls to facilitate users to browse the application interface related to the aforementioned ongoing operation. Snack bar is also a non-modal pop-up window, generally used to notify users of the process that is occurring or about to occur in the program, and its content must be related to the user's current operation. It usually appears briefly at the bottom of the screen, does not interrupt the user experience, does not require any user operation, and disappears automatically after a period of time. In addition, in some embodiments, if a snack bar appears in the interface, the user can make the snack bar disappear by clicking an area outside the snack bar.
  • the "sidebar” is a quick function area displayed on the side of the electronic device screen that can accommodate multiple application icons, and users can customize the types of applications in the sidebar and the order of application icons.
  • users can swipe inward from the edge of the screen and pause to call out the sidebar, click on the application icon, and open the corresponding application. After the application is opened, it will generally be displayed at the top of the interface in the form of a small window.
  • Global collection is an application service provided by the embodiment of the present application, which can be used to collect elements such as pictures, texts, voices, web pages, etc. that users have browsed based on electronic devices.
  • users can also edit the collected elements, such as adding tags to the collected videos to mark key points, so that users can efficiently review the key information carried by the elements when they watch them again.
  • the user can perform a three-finger swipe operation on the element to add the element to the global collection application service, or add the element to the global collection application service through the cross-application transmission interface provided by this application.
  • the electronic device After successfully adding the element to the global collection application service, the electronic device can display the capsule corresponding to the global collection application service in the interface, so that the user can add other elements in the interface to the global collection application service. Please refer to the relevant description of the subsequent embodiments for details, which will not be repeated here.
  • smart devices such as mobile phones and tablets have become indispensable products in our daily life, work and entertainment.
  • users When users use smart devices, they usually open multiple applications in the smart devices at the same time to work together. Users also often use smart devices to transfer information across applications, that is, to process, share, upload, etc. information in one application through another application.
  • users when users need to transfer information across applications, they need to perform complex and tedious operations to complete the information transfer.
  • FIG. 1 shows a specific process in which a user adds text in the application “Novel Reading” to the application “Notes”.
  • the user interface 01 shown in (A) of FIG1 is the interface displayed by the electronic device after the user opens a novel in the application "Novel Reading".
  • the user interface 01 includes a status bar 011, text information 012, a text option list 013 and a navigation bar 014, wherein:
  • the status bar 011 may include the name of the operator (eg, China Mobile), time, WI-FI icon, signal strength, and current remaining power.
  • the text information 012 can be divided into two parts.
  • the text information "ABCDEFGHIJKLMN" is the text that the user wants to transfer to other applications (for example, to extract to the note application), so this part of the text has been selected by the user and is in the dark area; while the text information "OPQRSTUVWXYZ" is not selected by the user, so it is not in the dark area. It should be understood that although it is not shown in Figure 1, when selecting text, the user can adjust the positions of the first cursor 0121 and the tail cursor 0122 after the first cursor 0121 and the tail cursor 0122 appear to complete the selection of the text by long pressing the text information 012.
  • the text option list 013 includes a copy option, a select all option, a search option, a translation option, and a share option.
  • the copy option is used to copy the text information selected by the user. After copying, the user can paste this part of the selected text information in other text boxes of the electronic device; the select all option is used to select all the text information in the interface 01 with one click; the search option is used to call the search function provided by the electronic device to search the text selected by the user; the translation option is used to translate the text selected by the user, such as Chinese to English or English to Chinese, etc.; the share option is used to share the text selected by the user. Any option can be used to respond to the user's operation, such as a click operation, so that the electronic device performs the operation corresponding to the option.
  • the navigation bar 014 may include system navigation keys such as a return button 0141, a home screen button 0142, and an outgoing task history button 0143.
  • the electronic device may display the previous user interface of the current user interface.
  • the electronic device may display the home screen interface set by the user for the electronic device.
  • the electronic device may display the tasks that the user has recently opened.
  • the names of the navigation keys may also be other names, for example, the return button may be called Back Button, the home screen button may be called Home button, and the outgoing task history button may be called Menu Button, and this application does not impose any restrictions on this.
  • the navigation keys in the navigation bar are not limited to virtual buttons, but may also be implemented as physical buttons.
  • the user interface 02 may include a status bar 021, a calendar weather widget 022, an application area 023, a dock area 024, and a navigation bar 025, wherein:
  • the calendar weather widget 022 can be used to indicate the current time, such as date, day of the week, hour and minute information, etc., and can be used to indicate the weather type, such as cloudy to sunny, light rain, etc., and can also be used to indicate information such as temperature, and can also be used to indicate location.
  • the weather type such as cloudy to sunny, light rain, etc.
  • information such as temperature, and can also be used to indicate location.
  • the application area 023 may include, for example, an application icon for "novel reading", an application icon 0231 for “notes”, etc., and may also include icons of other applications, which are not limited in the present embodiment. Any application icon may be used to respond to a user operation, such as a touch operation, so that the electronic device starts the application corresponding to the icon.
  • the dock area 024 may include, for example, a "phone” icon, a "text message” icon, a “browser” icon, and a “camera” icon, and may also include icons of other applications, which are not limited in the present embodiment. Any application icon may be used to respond to a user operation, such as a touch operation, so that the electronic device starts the application corresponding to the icon. No matter how the user switches the screen interface, the size of the dock area 024 and the applications it contains on the screen interface will never change and will always be displayed on the current interface.
  • the user In order to put the previously selected and copied text information into the excerpt page of the application note, as shown in (B) of FIG. 1 , the user needs to first open the application "Note” by clicking on the application icon 0231; the electronic device can respond to the user's click operation on the application icon 0231 and display the user interface 03 as shown in (C) of FIG. 1 .
  • the user In the user interface 03, the user can first long-press the blank area in the input area 031 to call up the input option box 032, and then click the paste option in the input option box 032 to paste the previously selected text information into the input area 031.
  • the interface displayed by the electronic device can refer to the user interface 04 shown in (D) of FIG. 1.
  • the text information selected by the user in the application "Novel Reading” has been successfully input into the application "Notes”.
  • the electronic device can save the latest note created by the user in response to the user clicking the confirmation control 042.
  • FIG. 2 shows a specific process in which a user uses the split-screen function provided by an electronic device to add pictures in the application “Album” to the application “Notes”.
  • the user interface 05 includes a first display area 051 and a second display area 052.
  • the first display area 051 is used to display the application interface of the application "Notes”
  • the second display area 052 is used to display the application interface of the application "Album”.
  • the first display area 051 includes an input area 0511 and a function list 052, wherein:
  • the input area 0511 is used to receive and display the note information such as text, images, etc. input by the user.
  • the function list 052 may include a share option, a favorite option, a delete option, and more options. Any of the options may respond to a click operation by the user, so that the electronic device executes the function corresponding to the option for the current note.
  • the second display area 052 includes an image display area and an image thumbnail set 0522, wherein:
  • the image display area 0521 is used to display the images saved by the user in the gallery;
  • Image thumbnail set 0522 is a thumbnail set formed when the user selects and drags multiple images from the image display area 0521 (i.e., the images that the user currently wants to put into the note).
  • the number "3" displayed in the superscript in the upper left corner indicates that the user has selected three images in total.
  • the user can press and hold the image thumbnail set 0522 and drag it to the first display area 051 and then release it, so that the multiple images corresponding to the image thumbnail set 0522 can be placed in the application "Notes", and the details can be referred to the user interface 06 shown in (B) of FIG2 .
  • the user interface 06 due to the limitation of the area of the first display area 061, the three images selected by the user (i.e., the three images corresponding to the image thumbnail set 0522) have all been added to the application "Notes", but they are not fully displayed in the first display area 061.
  • the present application provides an information transmission method and an electronic device, which can be used to implement the method.
  • the electronic device can display a cross-application transmission interface, so that the electronic device can efficiently and quickly complete the information transmission between applications, effectively reducing the number of operation steps required for users to complete the cross-application information transmission, improving the interaction efficiency between users and electronic devices, and thereby improving user experience.
  • any interface displayed by an electronic device when a user needs to transfer information in the interface across applications or across devices, the user can long press the information element in the interface and drag it to the edge of the screen.
  • the electronic device will transform the interface originally displayed on the screen in three dimensions, create a visual effect of the original interface being pushed inward on the screen, and display the recommended application service icon on the side of the screen of the electronic device.
  • the user interface displayed by the electronic device is the cross-application transmission interface. After that, the user places the dragged information element on the application service icon and lets go, and the information can be transferred to the application service corresponding to the icon, and the corresponding application service function is started.
  • information elements can be elements such as pictures, texts, videos, voices, links, documents, etc., and can also be other elements, which are not limited in this application.
  • cross-application transmission interface is just some names used in the embodiments of this application, and the meanings represented by them have been recorded in the embodiments of this application, and their names cannot constitute any limitation on this embodiment.
  • FIG. 3A is a schematic diagram of a process of changing the interface of an electronic device when a user transfers an image across applications based on the cross-application transfer interface.
  • the user interface 07 may be an application interface of an application “browser” in an electronic device, or an application
  • the application interface of the present invention may be an application interface of another application, which is not limited in the present application.
  • the user interface 07 may include an image 071, text 072, text 073, and a status bar 074.
  • the electronic device may respond to a user operation on the image 071, such as a long press operation shown in (A) of FIG. 3A, and display a user interface 08 as shown in (B) of FIG. 3A.
  • the original image 071 forms an image 081 under the user's long press operation. If the user does not let go, the image 081 can move in the user interface 08 with the user's fingertips, and the image 081 can be displayed on top in the user interface 08 (i.e., the image 081 can cover any element in the user interface 08 ). It should be understood that the image content displayed by the image 081 is the same as the image content displayed by the image 071.
  • the image 081 can be a thumbnail obtained by the electronic device after reducing the image 071, that is, there is no difference between the image 081 and the image 071 except for the size of the area.
  • the electronic device can still display the image 071 in the user interface 08 and perform a virtual or blurred process on the image 071, that is, the clarity of the image 071 in the user interface 08 can be lower than the clarity of the image 071 in the user interface 07, to prompt the user that the image 071 has been selected and dragged up.
  • the electronic device may display the user interface 09 as shown in (C) of FIG. 3A in response to a user operation on the image 081 , such as a drag operation as shown in (B) of FIG. 3A .
  • the electronic device displays a user interface 09, which will be described in detail later and will not be described here.
  • the user interface 09 is the cross-application transmission interface mentioned in the above description, which may include a sub-interface 091, an icon area 092 and an image 093. Among them:
  • sub-interface 091 The element content (such as text, pictures, etc.) displayed in sub-interface 091 is the same as the element content (except the status bar) displayed in user interface 07.
  • sub-interface 091 can be considered as the interface obtained by the electronic device after a three-dimensional transformation of all the element contents (except the status bar) of the original user interface 07.
  • sub-interface 091 can create a visual effect of the original interface (i.e., user interface 07) being pushed inward on the screen. Understandably, this "opening the door” visual effect metaphorically transmits the behavior of elements (information), which is more intuitive than copying and pasting.
  • the background behind sub-interface 091 can be set to the desktop background (i.e., desktop wallpaper) of the electronic device, and the resulting picture after the blur effect is superimposed.
  • the icon area 092 may be used to display application service icons recommended by one or more electronic devices based on the information element (ie, image 071 in the embodiment of the present application) selected by the user.
  • each icon in the icon area 092 has a corresponding text description below it, and these text descriptions can be used to explain the specific application name or application service name corresponding to the icon.
  • the icon 0921 is an application
  • the text 0922 can be "Friends Circle” or “WeChat Friends Circle”.
  • the application service icon of the application service "Scan” is displayed, the text 0922 can be "Scan” or "WeChat Scan”. It should be understood that the text below each application service icon is only for the user to understand the specific application or specific application function corresponding to the icon, but the specific icon style and specific text content are not limited in this application.
  • image 093 The image content displayed by image 093 is the same as that displayed by image 071 and image 081.
  • image 093 may be a thumbnail obtained by reducing image 081 by the electronic device.
  • image 093 is the same as image 081 and image 071 except for the size. In this way, when the user selects the application service he wants in icon area 092, image 093 will not cause a large area of blocking of the icons and texts in icon area 092, making it more convenient for the user to select the icon.
  • image 081 may no longer be displayed in user interface 09. That is, image 081 may be regarded as an image obtained by the electronic device after copying image 071 and then reducing it, while image 093 may be regarded as an image obtained by the electronic device directly reducing image 081.
  • the user places the dragged information element (i.e., image 093) on the corresponding icon in the icon area 092 and lets go.
  • the electronic device can transmit the information element to the application service corresponding to the icon in response to the user operation, and display the application interface or feedback information corresponding to the application service icon. This will be explained in more detail later and will not be repeated here.
  • the icon approached by image 093 can display certain special effects, for example, the icon and the text corresponding to the icon can be attracted and brought close by image 093, and the icon and the text corresponding to the icon can be enlarged.
  • icon 0923 and its corresponding text 0924 in user interface 09 as an example, when image 093 is close to icon 0923, icon 0923 and text 0924 are further to the left than other icons and texts, that is, closer to image 093 than other icons and texts.
  • Image 093; in addition, icon 0923 is also enlarged to remind the user that if the user lets go here, image 093 (or image 071) will be transmitted to the application service corresponding to icon 094.
  • the cross-application information sharing process shown in Figure 3A is continuous from the user dragging up the element to the element being placed in the target application service.
  • the "continuous” here means that the user does not need to perform operations such as copying and pasting, nor does he need to switch applications.
  • the user's fingers do not need to leave the screen of the electronic device during the entire operation process, and the operation is simple and fast.
  • This information transmission method ensures the effective browsing area of the user interface, which can effectively improve the user's efficiency in transmitting information across applications and improve the user experience.
  • the electronic device can determine the recommended service in the icon area 092. It is not limited to the electronic device recommending services in the icon area 092 in the "Smart Flow" function, and the electronic device can also recommend services in other scenarios. For example, after receiving an event that the user copies text, the electronic device can also display an icon area on the display screen to recommend services. For another example, after receiving an event that the user drags content, the electronic device can also display an icon area on the display screen to recommend services.
  • the process may include:
  • the electronic device first monitors a copy event, which can trigger subsequent steps.
  • the electronic device can determine that a copy event is monitored when it is confirmed that there is new content in the clipboard (also called a clipboard, pasteboard, etc.).
  • the electronic device filters the copied content.
  • the filtering operation refers to identifying and ignoring the copied content that does not need to be recommended for service, leaving only the copied content that needs to be recommended for service. For example, if the copied content is a verification code, there is no need to make a service recommendation, and there is no need to perform subsequent steps, such as de-redundancy processing and content refinement of the copied content.
  • An entity refers to an object, concept, or item.
  • the types of entities may include, for example, passwords, addresses, TV series and film titles, dates, product names, food names, email addresses, flight numbers, express numbers, phone numbers, etc.
  • Each entity contains a specific value, which is the specific content of the entity. For example, for the text copied by the user, "XX City, XX District, XX Road, XX Building, XX", the text is an entity, its entity category is address, and its specific content is "XX City, XX District, XX Road, XX Building, XX".
  • an entity of date type its entity value is a specific date, such as "April 18, 2024”.
  • step 3 The purpose of step 3 is to identify the entity in the filtered copy content and obtain the type and value of the entity.
  • the electronic device may first translate the foreign language text into a local language and then perform entity recognition.
  • the electronic device can sort the multiple entities according to a preset rule.
  • the present application does not limit the preset rule, for example, it can be a preset order, a sequence of identification, etc.
  • an address-type entity corresponds to a navigation service and a taxi service
  • a flight number-type entity corresponds to a flight query service
  • a mailbox-type entity corresponds to a mailbox application.
  • the electronic device can identify the service list corresponding to the entity based on the preset mapping relationship.
  • Sort the services in the obtained service list There may be many sorting rules, which are not limited here.
  • Service execution that is, in response to a user operation on an icon of a service, jumping to the user interface of the service.
  • the service recommendation process can be executed by a service recommendation engine in the electronic device.
  • the service recommendation process in other similar scenarios is similar to the above process. For example, when the user drags other data (such as screenshot images, text), the service can also be recommended according to the above process.
  • the service recommendation process has the following shortcomings:
  • the entire service recommendation process depends on specific events (such as replication events) and will only be triggered after the replication event is monitored;
  • service acquisition, service sorting, and service execution are all separate processes customized for the entity.
  • the capabilities of electronic devices cannot be reused, and the workload is large when making service recommendations;
  • the embodiments of the present application provide a framework for recommending services, which can solve the above problems.
  • Fig. 3B exemplarily shows the structure of a framework for recommending services.
  • the framework may include two parts, one part is located on the electronic device side, and the other part is located on the cloud device side.
  • the electronic device side may include: a display portal, a software development kit (SDK), a multi-mode recommendation service, and a service management framework.
  • the multi-mode recommendation service may also be referred to as a multi-mode service recommendation engine, which may include the following modules: a service subscription module, a multi-mode content understanding module, an intent recognition module, a service recall module, a service sorting module, a service notification module, an intent self-learning module, etc.
  • the display entry on the electronic device side can be located in the application layer, and the remaining modules can be located in the framework layer or service layer, which is not limited here.
  • the display entry can refer to the entry of each business that can provide service recommendation functions, such as the entry for recommending services by copying, the entry for recommending services by dragging content in the "Smart Flow" function, which is used to receive user input content, etc.
  • service recommendation functions such as the entry for recommending services by copying, the entry for recommending services by dragging content in the "Smart Flow" function, which is used to receive user input content, etc.
  • the relationship between the display entry and the interaction method mentioned above is not limited to the interaction method mentioned above.
  • the SDK is used to provide an interface for the display entry to use the multi-mode recommendation service.
  • the framework shown in Figure 3B defines a unified multi-mode content input interface (i.e., display entry).
  • the display module display entry can obtain input content from the clipboard and drag events, and then transmit the input content to the SDK, thereby triggering the subsequent service recommendation performed by the multi-mode recommendation service.
  • the multi-mode recommendation service does not need to obtain content from the clipboard and drag events, which improves the efficiency of information processing.
  • the multi-mode recommendation service is used to recommend services for each business at the application layer.
  • the service subscription module is used to subscribe to the services and/or intent categories supported by each business
  • the multi-mode content understanding module is used to identify the content received from the application layer business.
  • the intent recognition module is used to identify entities
  • the intent recognition module is used to find the corresponding intent according to the identified entity
  • the service recall module is used to find the service corresponding to the intent
  • the service sorting module is used to sort the services
  • the service notification module is used to pass the sorted service list to the services at the application layer
  • the intent self-learning module is used to learn new intent categories.
  • the specific functions of each module in the multi-mode recommendation service can be referred to the specific introduction of the method embodiment below.
  • the cloud device side may include: a decision cloud platform and an intelligent service platform (ISP).
  • ISP intelligent service platform
  • the decision cloud platform may be a physical server, a cloud server, a server cluster, etc.
  • the decision cloud platform may be provided uniformly by a device manufacturer of electronic equipment.
  • the decision cloud platform is used to define the following items:
  • the global intent system includes information on multiple types of intent.
  • Intent refers to the purpose that the user wants to achieve. Intent can be divided into many categories, including but not limited to opening passwords, navigation, map search, taxi, shopping, ordering takeout, etc. An intent category can also be understood as a less specific intent.
  • Each type of intent may include one or more of the following information: intent identification, intent level (intentlevel), intent tag (tag), intent slot information (slotInfoList).
  • intent identification indicates the intent category and may include one or more of the following: intent identification number (identity, ID), intent code.
  • intent level indicates the confidence of the intent.
  • intent slot information may include one or more of the following: slot name, data type filled in the slot, Chinese name of the data filled in the slot, indication information on whether the slot is necessary, etc.
  • the slot can be regarded as a parameter, and the data type may include string type (string), number, etc.
  • the decision cloud platform defines four types of intents, namely, video.WATCH, HAIL_TAXI, ADDRESS_SEARCH, and RECOGNIZE_CODE.
  • the second taxi intent has a level of 5 and a label of address. It contains a slot named destination, a slot position type of string, and an entity type corresponding to the slot of address.
  • the decision cloud platform standardizes the expression of intents and constructs a database containing various types of intent information, that is, it builds an intent framework.
  • the concrete intent can be divided into two categories: valid and invalid, depending on whether the required slots are filled with values. If the required slots are filled with values, the intent is valid; whether the non-essential slots are filled with values does not affect the validity of the intent.
  • Entity information may include entity category and entity value.
  • Entity information can be implemented in the following format: "entity category”: [”entity value”]. The following are some examples of entities:
  • the entity value in the above entity is replaced by the value type, and the actual entity value needs to be filled with a concrete numerical value.
  • mapping relationship from entity categories to intent categories can be pre-defined by the decision cloud platform.
  • the mapping relationship may include: the entity category of the entity and the label in the intent information. If they are the same, the entity corresponds to the intent type. That is, an entity can be mapped to an intent class whose intent label is the type of the entity. For example, the entity "location":["Address”] corresponds to the taxi-hailing intent shown in Table 1.
  • the mapping relationship can be configured manually or learned and continuously improved by machines.
  • An entity can be mapped to one intent category or to multiple intent categories.
  • the decision cloud platform may also predefine a mapping relationship between modalities and intent categories. For example, a text modality may be mapped to a search intent or a note intent; a video modality may be mapped to a play intent, etc.
  • the decision cloud platform may also predefine the mapping relationship between entities and modalities and intents, which is equivalent to a fusion of the above two mapping relationships.
  • the cold start phase refers to the phase before the electronic device has learned the user's preferences.
  • the service sorting rules in the cold start phase can be set according to group preferences.
  • the group's preference order for each service can be: taxi service, collection service, shopping service, etc.
  • the above information configured by the decision cloud platform can be sent to electronic devices.
  • the decision cloud platform can share the information of multiple types of configured intents and the mapping relationship from entity categories to mapping categories with the intent recognition module, and share the service sorting rules in the cold start phase with the service sorting module.
  • the smart service platform is used to open to third parties that provide services, so that they can define or edit the information of the services they provide.
  • the information provided by the third parties obtained by the smart service platform can be called a global service system.
  • the information of the service defined by the third party may include one or more of the following: service ID, service name, service icon, service type, identifier of the intent category supported by the service, slot name of the service, application package name, component name, uniform resource locator (URL) for jumping to the service, and parameter name.
  • the service type refers to the form of providing the service, for example, it may include widgets, deep links, Android shared content (share intent), non-Android mini programs/light apps/Hypertext Markup Language (HTML) web pages, etc.
  • the intent supported by the service refers to the intent category that the service can satisfy. This item can be selected by the third party from the intent category defined by the decision cloud platform, and the number of this item can be one or more.
  • the slot name of the service is used to indicate the slot used to obtain parameters from the intent when starting the service. This item can be selected by the third party from the slot name of the intent category supported by the service defined by the decision cloud platform, and the number of this item can be one or more.
  • the application package name refers to the package name of the application to which the service belongs.
  • the component name refers to the name of the component to which the service belongs.
  • the parameter name refers to the parameter used to pass the value filled in the slot represented by the above slot name when the service is executed. Not all of the above items are necessary, and some of them can be deleted according to actual needs.
  • the smart service platform can flexibly expand the new services, and the service provider can register the new services to the service management framework in the standard format required by the smart service platform, and the electronic device can subsequently start the new services.
  • the service provider does not need to modify the service code adaptively, but only needs to register the service information in the standard format to allow the service to be connected.
  • the smart service platform standardizes the access form of services and generates a database containing various service information based on the services accessed by each party. This is equivalent to mapping the differentiated execution interfaces and parameters of different services (including system services and third-party services) to the business side through the custom rules provided in the embodiment of this application, so that the business side can run various services through a unified standard interface.
  • the process of the recommendation service provided in the embodiment of the present application may include the following steps:
  • Step S1 A first service subscribes to supported intent categories and/or services.
  • the first service referred to here refers to a service with the function of recommending services, such as a smart flow service in an electronic device, a service that recommends services by copying, a service that recommends services by dragging and dropping, etc.
  • the first service can initiate a subscription to the service subscription module in order to subscribe to the intent category range and/or service range required by the first service.
  • the intent category and/or service subscribed by the first service can be one or more.
  • the electronic device can identify the intent category within the intent category range subscribed by the first service, and can also recommend services within the service range subscribed by the first service based on the identified intent.
  • Different first services can subscribe to different intent category ranges and/or service ranges to meet the personalized needs of different service parties.
  • the first service can dynamically subscribe to the intent range and service range according to its own needs, that is, support the first service to dynamically expand the supported intent categories and/or services.
  • the intent category range and service range subscribed by the first service can be specifically determined by the developer of the electronic device.
  • the above service list contains the codes of the subscribed services, indicating that the subscribed services include the following: taxi service, navigation service, search service, and global favorites service.
  • the above intent category list contains the codes of the subscription intent categories, indicating that the subscription intent categories include the following categories: social sharing intent, email sharing intent, printing intent, note-taking intent, taxi-hailing intent, collection intent, trip creation intent, video watching intent, etc.
  • the multi-mode recommendation service in FIG3B will pre-load the required resources, such as the information of the subscribed intent category, according to the intent category and service subscribed by the first service.
  • the multi-mode recommendation service can also notify the first service side to pre-load static resources such as icons of the subscribed services. This can speed up the efficiency of service recommendation.
  • step S1 The purpose of step S1 is to allow the first service to subscribe to the intent categories and/or services supported, so that the electronic device can find the corresponding intent category from the intent categories subscribed to the first service in the subsequent S4, and to facilitate the electronic device to query the corresponding service from the service scope subscribed to the first service in the subsequent S5. Therefore, S1 can be executed before S4 and S5, and this application does not specifically limit its execution time.
  • Step S1 is an optional step, and in some implementations, step S1 may not be performed.
  • each service may subscribe to all intent categories and/or all services supported by the electronic device by default, without requiring each service to actively subscribe.
  • the framework may also include a smart cloud, which may be located on the cloud device side.
  • the smart cloud is used to define capability exposure policies and to compile capability usage reports.
  • the capability exposure policy indicates the recommended policy for open services in electronic devices, and the capability usage report compiles information such as the frequency of each capability used in the electronic device, such as the frequency of use of each service and each entity recognition capability.
  • the click-through rate prediction model can be trained based on multiple sets of historical behavior data of users. Each set of historical behavior data is analyzed from multiple samples.
  • a sample refers to the information of whether the user clicks (i.e. chooses to select) a service after the electronic device recommends the service to the user.
  • a label can be used to indicate whether the user has clicked the intention. It should be noted here that the user clicks on the icon of the service recommended by the electronic device, and the service corresponds to a supported intent category, so it can also be considered that the user clicks on the intent category.
  • the electronic device can use time features and content features as inputs and click-through rate features as standard outputs to train the click-through rate prediction model. After training with multiple sets of historical behavior data, a usable click-through rate prediction model can be obtained.
  • the training process can also be executed by the cloud side.
  • each electronic device can upload historical behavior data to the cloud decision platform.
  • the cloud decision platform trains the click-through rate prediction model
  • the click-through rate prediction model is sent to each electronic device.
  • the trained click rate prediction model can execute step S22. Specifically, the electronic device can extract the time feature and content feature of the current user input content, input these two features into the click rate prediction model, and then the click rate prediction model can output the arrangement order of the defined intent categories. Then, the electronic device can obtain the arrangement order of the intent categories identified in S21 according to the arrangement order.
  • the electronic device may first refer to step S5 in Figure 3B to query the service corresponding to the intent, and then refer to S6 to sort the multiple services found. The difference is that in the process shown in Figure 3D, the electronic device may sort the services according to the sorting of the intent categories in S22.
  • the electronic device may obtain the services corresponding to each intent category in S22, roughly sort the services according to the order of the intent categories, and then further sort the services in each intent category according to the strategy in S6.
  • the electronic device displays the sorted service icons.
  • the electronic device obtains the user's behavior data after a service is recommended and the user does not click on the icon of the recommended service.
  • the electronic device recommends a service
  • the user does not click on the icon of the recommended service, it means that the service recommended by the electronic device cannot meet the actual needs of the user, so the electronic device needs to improve the preceding steps of recommending the service.
  • the mapping relationship predefined by the decision cloud platform does not include the mapping relationship between the entity category and/or modality of the user input content and a certain intent category. Even if the decision cloud platform defines the intent category, the electronic device cannot recognize the intent category from the current input content, and cannot recommend the services required by the user.
  • the electronic device learns the mapping relationship between entity categories and/or modalities and defined intent categories based on the user's historical behavior data as a supplementary recall of the mapping relationship.
  • the user's historical data includes multiple groups, and each group of behavior data may include: the user inputs a certain category of entities (such as the first entity category) and/or the content of a certain mode (such as the first mode), and the user manually opens the service within a period of time after the electronic device recommends the service, without clicking the icon of the recommended service.
  • the period of time can be set according to actual needs, for example, it can be 5 minutes.
  • the above period of time can be calculated from the time when the electronic device closes the first service, for example, it can be calculated from the time when the recommended service is stopped.
  • the electronic device can count the K services that are manually opened by the user and are supported by the service management framework and opened manually by the user with the highest frequency in the user's historical data, and confirm that there is a mapping relationship between the intent categories corresponding to these services and the entity categories and/or modalities of the user input content, and the mapping relationship can be recalled as supplementary information.
  • K can be set as needed and is not limited here.
  • the electronic device first counts the historical data after the user inputs the video, that is, after the user inputs the video to the electronic device, the user manually opens the service behavior sequence when the user does not click on the icon of the recommended service.
  • the entity category and modality of the video are both video.
  • the user manually opens services such as Meituan Group Buying, Taobao Pailitao, Baidu Search, Meituan Xiuxiu, and JD Photo Buying.
  • the electronic device filters out the services that are supported by the service management framework, which may include, for example, Meituan Group Buying, Baidu Search, Taobao Pailitao, and JD Photo Buying.
  • the filtered services are then sorted by opening frequency, and the K services with the highest opening frequency in the above process are found, and it is determined that there is a mapping relationship between the video entity category and/or the video modality and the intent category supported by the K services, and then the mapping relationship is determined.
  • the mapping relationship is supplemented to the local mapping relationship of the electronic device.
  • the electronic device may also upload the mapping relationship learned locally to the decision cloud platform, so that the decision cloud platform can count the mapping relationships learned by multiple electronic devices to make the mapping relationship more complete.
  • the first solution mentioned above aims at the situation where the mapping relationship from entity categories and/or modalities to intent categories is incomplete.
  • a mapping relationship mining method is proposed to mine the mapping relationship from the subsequent behaviors that are not clicked after the recommendation, so as to supplement the recall of the mapping relationship.
  • the intent categories predefined by the decision cloud platform do not include the intent category to which the user's actual intent belongs. Therefore, the electronic device cannot recognize the intent category and cannot recommend the services required by the user.
  • electronic devices can learn new intent categories that are not defined by the decision cloud platform based on the user's historical behavior data, and learn the mapping relationship between entity categories and/or modalities and the new intent categories as a supplement to the intent categories and the mapping relationship.
  • the electronic device can first filter out the services that are manually opened by the user and are not supported by the service management framework but support input content (such as supporting the storage of text, pictures, files, etc.) from the user's historical data, and then filter out the N services that are most frequently manually opened by the user from these services. Then, the electronic device can define a new intent category based on the N services as a supplement to the intent category. The N services can satisfy the intents belonging to the new intent category. In addition, the electronic device can also recall the new intent category as a supplement to the above mapping relationship. N can be set as needed and is not limited here. When counting services, it is not necessary to count services that are not supported by the service management framework, and statistics can also be counted across the entire service range.
  • input content such as supporting the storage of text, pictures, files, etc.
  • the electronic device first counts the historical data after the user inputs the video, that is, after the user inputs the video to the electronic device, the user manually opens the service without clicking the icon of the recommended service.
  • the entity category and modality of the video are both video.
  • the user manually opens services such as Meituan Ticketing, Tao Piao Piao, Douban Film Review, Wen Xin Yi Yan, and WeChat Reading.
  • the electronic device filters out the services that the service management framework does not support and supports the input content from the various services manually opened by the user, such as Meituan Ticketing, Tao Piao Piao, Douban Film Review, and Wen Xin Yi Yan.
  • the filtered services are sorted by the opening frequency to find the N services with the highest opening frequency, and the N services may include Meituan Ticketing and Tao Piao Piao, for example.
  • the electronic device can define a new intent category based on the N services, and the new intent category may be, for example, an intent category for buying movie tickets.
  • the electronic device can add the intent category for buying movie tickets to the predefined intent category, and can also determine that there is a mapping relationship between the video entity category and/or the video modality and the intent category for buying movie tickets, and add the mapping relationship to the local mapping relationship of the electronic device.
  • the smart service platform can also obtain information about the above N services defined by a third party, so as to facilitate the subsequent sharing of the information of these services to the service management framework of the electronic device, so that the electronic device can find these services based on the supplemented new intent categories.
  • the electronic device can also upload new intent categories and mapping relationships learned locally to the decision cloud platform, so that the decision cloud platform can count the intent category mapping relationships learned by multiple electronic devices to make the mapping relationships more complete.
  • the second solution above proposes a method for mining new intent categories in response to the situation where the user's actual intent exceeds the scope of the intent categories defined by the decision cloud platform. It mines potential undefined new intent categories from the subsequent behaviors that are not clicked after the recommendation, and defines the mapping relationship between the new intent category and the entity category and/or modality, so as to Perform supplementary recall on intent categories and mapping relationships.
  • FIG. 4 is a schematic diagram of the interface change process of the electronic device when the user transmits text across applications based on the “cross-application transmission interface”.
  • the user interface 11 may be an application interface of an application “browser” in an electronic device, or an application
  • the user interface 11 may include text 111, text 112, image 113 and text option list 114, wherein:
  • Text 111 is the text that the user wants to transfer to other applications, so this part of the text has been selected by the user and is in the dark area; correspondingly, text 112 is the unselected text. It should be understood that, unlike the independence of pictures, the text itself has continuity. For a whole paragraph of text, the user may often only need a part of the text in the whole paragraph when sharing the text. Therefore, although not shown in Figure 4, when selecting the text in the user interface 11, the user can perform a long press operation on any text information in the user interface 11, and after the first cursor 111A and the tail cursor 111B appear, the selection of the text is completed by adjusting the position of the first cursor 111A and the tail cursor 111B. As shown in (A) in Figure 4, the user has selected the text 111 by adjusting the position of the first cursor 111A and the tail cursor 111B.
  • the text option list 114 includes a copy option, a select all option, a search option, a translation option, and a share option. Any one of the options can be used to respond to a user's operation, such as a click operation, so that the electronic device performs an operation corresponding to the option.
  • the electronic device may also respond to a user operation on the text 111, such as a long press and drag operation as shown in (A) in FIG. 4 , to display a user interface 12 as shown in (B) in FIG. 4 .
  • the original text 111 is lifted up by the user's long press operation. If the user does not let go, the text 121 can move in the user interface 12 with the user's fingertips, and the text 121 can be displayed on top in the user interface 12 (that is, the text 121 can cover any element in the user interface 08). It should be understood that the text content contained in the text 111 is the same as the text content contained in the text 121.
  • the text 121 can also be the text obtained after the electronic device shrinks the text 111, and after the text 111 is dragged up to form the text 121, the electronic device can still display the text 111 in the user interface 12, and perform a virtual or blurred process on the text 111, that is, the clarity of the text 111 in the user interface 12 can be lower than the clarity of the image text 111 in the user interface 11, to prompt the user that the text 111 has been selected and dragged up.
  • the electronic device may display a user interface 13 as shown in FIG. 4 (C) in response to a user operation on the text 121, such as a drag operation as shown in FIG. 4 (B).
  • the user interface 13 is the cross-application transmission interface mentioned in the above description, which may include a sub-interface 131, an icon area 132, and text 133. Among them:
  • text 133 is the text obtained by the electronic device after shrinking text 121; that is, after the "cross-application transmission interface" is opened, the electronic device also shrinks the text dragged by the user to a certain extent, so that text 133 will not cause a large area of blocking the icons and texts in icon area 132, making it easier for users to select.
  • the user places the dragged information element (i.e., text 133) on the corresponding icon in the icon area 132 and releases the dragged information element.
  • the electronic device can transmit the information element to the corresponding icon in response to the user operation.
  • the application interface or feedback information corresponding to the application service icon is displayed.
  • the user places text 223 on the corresponding icon in the icon area 222 and releases it.
  • the electronic device can transmit the text 223 to the application service corresponding to the icon in response to the user operation, and display the application interface or feedback information corresponding to the application service icon.
  • the user interface 23 is the cross-application transmission interface.
  • the user interface 23 may include a sub-interface 231, an icon area 232, and an image 233, wherein:
  • the electronic device can reduce the image in the partial screenshot frame 202 to obtain the image 233.
  • the shape of the partial screenshot frame 202 will be retained, that is, the shape of the image 233 is the same as the shape displayed by the partial screenshot frame 202.
  • the user places the image 233 on the corresponding icon in the icon area 232 and releases it.
  • the electronic device can transmit the image 233 to the application service corresponding to the icon in response to the user operation, and display the application interface or feedback information corresponding to the application service icon.
  • the user interface 20 may be referred to as the “sixth interface”, and the user interface 23 may be referred to as the “first interface”.
  • the operation of placing the image 233 on the corresponding icon in the icon area 232 and releasing the icon can be called the "ninth operation”.
  • FIG. 9 is a schematic diagram for illustrating cross-application transmission interface triggering rules provided in an embodiment of the present application.
  • the user interface 24 may be an application interface of an application “browser” in an electronic device, or an application
  • the application interface may also be the application interface of other applications, which is not limited in this application.
  • the image 241 of the user interface 24 is used as an example for description.
  • the user can drag the image 241 up by long pressing the image 241.
  • the electronic device can display the user interface 25 as shown in (B) of FIG. 9 .
  • the user interface 25 may include an image 241, an image 251, a left trigger area 252L, and a right trigger area 252R.
  • the left trigger area 252L and the right trigger area 252R may be collectively referred to as a “first trigger area”, wherein:
  • Image 251 is a thumbnail formed when the user drags up image 241. If the user does not let go, image 251 can move in the user interface 08 along with the user's fingertips. For details, please refer to the above-mentioned related instructions, which will not be repeated here.
  • the left trigger area 252L is a rectangular area bounded by the left border of the electronic screen
  • the right trigger area 252R is a rectangular area bounded by the right border of the electronic screen.
  • the length of the left trigger area 252L can be d1, and the width can be W
  • the length of the right trigger area 252R can be d1, and the width can be W.
  • d1 can be set to 25% of the width of the electronic device screen, as shown in (A) of Figure 9, the width of the screen is L
  • W can be the height of the electronic device screen, as shown in (A) of Figure 9, the height of the screen is h.
  • the left trigger area 252L and the right trigger area 252R are displayed as dark transparent areas only to facilitate the user to understand the specific position and area of the two areas.
  • the specific size and position of the two areas may not be displayed in the user interface, that is, the user cannot directly observe the specific outlines of the two areas in the user interface 25, and the size and position of the two areas can only be stored in the electronic device in a form that can be perceived by the electronic device (such as program code).
  • the electronic device can display special effects at the edge of the screen; optionally, after the user drags the image 251 to the left trigger area 252L or the right trigger area 252R and the image stays in the left trigger area 252L or the right trigger area 252R for a period of time T, the electronic device can display special effects at the edge of the screen to prompt the user to further drag the image closer to the side of the screen.
  • T can be set to 600 milliseconds.
  • dragging the image 251 to the left trigger area 252L or the right trigger area 252R means that after the user drags the image 251, the contact point between the user's finger and the screen (i.e., the anchor point) enters the left trigger area 252L or the right trigger area 252R, and does not mean that the image 251 completely enters the left trigger area 252L or the right trigger area 252R.
  • the electronic device can respond to the operation and display the user interface 26 as shown in (C) of FIG9 .
  • the user interface 26 may include the image 241, the image 251, and the special effect area 261.
  • the special effect area 261 may display the user's special effects such as light effects and shadow effects. Visual special effects may also display other special effects that are perceptible to the user, and this application does not limit this.
  • the above-mentioned special effects area 261 can prompt the user to further drag the image closer to the side of the screen to trigger the "cross-application transfer interface" interface to transfer the element to other applications. Therefore, in an embodiment of the present application, after the element is dragged up, a door opening area is also provided in the user interface. When the user further drags the dragged element to the door opening area, the electronic device can respond to the operation and display the cross-application transfer interface. As shown in (C) in Figure 9, when the user drags the image 251 to the right until it enters the door opening area, the electronic device can respond to the operation and display the user interface 27 shown in (D) in Figure 9.
  • the user interface 27 may include an image 241, an image 251, a left door opening area 271L, and a right door opening area 271R.
  • the left door opening area 271L and the right door opening area 271R may be collectively referred to as a “second trigger area”, wherein:
  • the left door opening area 271L is a rectangular area bounded by the left border of the electronic screen
  • the right door opening area 271R is a rectangular area bounded by the right border of the electronic screen.
  • the length of the left door opening area 271L is d2, and the width is W
  • the length of the right door opening area 271R is also d2, and the width is also W, wherein d2 can be set to 36 pixel units, and W can be the height of the electronic device screen.
  • d2 can be set to 36 pixel units
  • W can be the height of the electronic device screen.
  • the specific size and position of these two areas may not be displayed in the user interface, that is, the user cannot directly observe the specific outlines of the two areas in the user interface 27, and the size and position of these two areas can only be stored in the electronic device in a form that is perceptible to the electronic device (such as program code).
  • the electronic device can immediately respond to the operation and display the cross-application transmission interface, that is, the user interface 28 shown in (E) of Figure 9.
  • the user interface 28 includes a sub-interface 281, an icon area 282, and an image 283. Among them:
  • the elements displayed in the sub-interface 281, such as text, pictures, etc., are the same as the elements displayed in the user interface 24 (except the status bar).
  • the specific content and functions of the sub-interface 281 can refer to the above-mentioned related descriptions, which will not be repeated here.
  • the electronic device can display one or more application service icons recommended based on the element selected by the user (i.e., image 241 in the embodiment of the present application) in the icon area 282.
  • the icon area 282 can be a rectangular area bounded by the right border of the electronic screen.
  • the length and width of the icon area 282 can be d3 and W, respectively, where d3 is greater than the aforementioned d2.
  • d3 can be set to 120 pixel units
  • W can be the height of the electronic device screen (i.e., h in the aforementioned description).
  • the icon area 282 is displayed as a dark transparent area only to facilitate the user to understand the specific position and area of the area.
  • the specific size and position of the area may not be displayed in the user interface, that is, the user cannot directly observe the specific outline of the area in the user interface 28, and the size and position of the area can be stored in the electronic device only in a form that is perceptible to the electronic device (e.g., program code).
  • image 283 is the same as the image content displayed by image 251 and image 241, but the area is different. It should be noted that compared with image 51 in user interfaces 25 to 27, image 283 in user interface 28 is smaller. This is because when the electronic device displays user interface 28, image 251 in the original user interface 27 is reduced to prevent the image from being too large and blocking the icons and text in icon area 282, thereby interfering with the user's selection. In other words, image 241 can be reduced twice during the entire cross-application transmission process.
  • the first time occurs when the user drags it up.
  • the second time occurs when the electronic device starts to display the "cross-application transmission interface", and for details, please refer to image 251 shown in (D) of FIG. 9 and image 283 shown in (E) of FIG. 9 .
  • the user places the dragged information element (i.e., image 283) on the corresponding icon in the icon area 282 and lets go.
  • the electronic device can transmit the information element to the application service corresponding to the icon in response to the user operation, and display the application interface or feedback information corresponding to the application service icon. This will be explained in more detail later and will not be repeated here.
  • the user interface 31 may be a cross-application transmission interface displayed by the electronic device after the user drags an image in the history interface and drags it to the side.
  • the user interface 31 includes a sub-interface 311, an icon area 312, a door closing area 313, and an image 314, wherein:
  • the door closing area 313 can be a rectangular area bounded by the left border of the electronic screen.
  • the length and width of the door closing area 313 can be d4 and W, respectively.
  • d4 can be set to half the width of the electronic device screen (i.e., L in the above description), and W can be the height of the electronic device screen (i.e., h in the above description).
  • the icon area 312 and the door closing area 313 are displayed as dark transparent areas only to facilitate the user to understand the specific position and area of the area.
  • the specific size and position of these two areas may not be displayed in the user interface, that is, the user cannot directly observe the specific outlines of the two areas in the user interface 31, and the size and position of these two areas can only be stored in the electronic device in a form that is perceptible to the electronic device (such as program code).
  • the user interface 32 may include an image 321 and an image 322, wherein:
  • Image 321 is the thumbnail obtained when the user just drags up image 322. Unlike image 314, image 321 is a thumbnail obtained by the electronic device shrinking image 322 once, while image 314 is a thumbnail obtained by the electronic device shrinking image 321 twice after the cross-application transmission interface is opened.
  • FIG. 11 shows the process of the user exiting the cross-application transmission interface by directly releasing the finger.
  • the user interface 33 may be a cross-application transmission interface displayed by the electronic device after the user drags an image in the history interface and drags it to the side.
  • the user interface 33 includes a sub-interface 331, an icon area 332, a door closing area 333, and an image 334, wherein:
  • this part of the area can be a rectangular area 335 with a length of d5 and a width of h.
  • the electronic device can close the “cross-application transfer interface” and display the user interface 34 as shown in (B) of FIG. 11 .
  • user interface 34 is the original interface where image 314 is located. It may include image 341. Unlike user interface 32 in the above description, since the user has let go, the thumbnail obtained by the user dragging up image 341 is no longer displayed in user interface 34. If the user wants to transfer image 341 to other applications again through the "cross-application transfer interface", the user needs to long-press image 341 again to drag it up to obtain the corresponding thumbnail, and drag the thumbnail to the side of the screen to trigger the cross-application transfer interface again.
  • FIG. 12 shows the process of a user completing cross-application information transmission through the split-screen function of an electronic device in split-screen state.
  • the user interface 35 includes a first display area 351 and a second display area 352.
  • the first display area 351 is used to display the application interface of the application "Notes”
  • the second display area 352 is used to display the application interface of the application "Album”.
  • the user interface 35 can be referred to as the "first interface”
  • the first display area 351 can be referred to as the "second sub-interface”
  • the second display area 352 can be referred to as the "first sub-interface”.
  • the user long-presses the image 3521 in the second display area 352 and drags it up, obtaining a thumbnail 3522 of the image 3521.
  • the image 3521 or the thumbnail 3522 may be referred to as "first information”.
  • first information the image 3521 or the thumbnail 3522
  • area 353L and area 353R are the left trigger area and the right trigger area, respectively; area 354L and area 354R are the left door opening area and the right door opening area, respectively.
  • area 353L and area 353R can be collectively referred to as the "first trigger area”, and area 354L and area 354R can be collectively referred to as the "second trigger area”.
  • the electronic device can display special effects at the edge of the screen; when the user continues to drag the image 3522 to the left door area 354L or the right door area 354R, the electronic device will respond to the operation and display the corresponding cross-application transmission interface. However, if the user drags the image 3522 from the second display area 352 to the first display area 351 without letting the image 3522 touch the left door area 354L and the right door area 354R, the electronic device can still transfer the image 3522 (or image 3521) to the "Notes" application and display it in the first display area 351.
  • the user can drag the image 3522 to the first display area 351 in the direction indicated by the dotted arrow shown in (A) of FIG. 12 .
  • the operation of dragging the image 3522 to the first display area 351 can be referred to as the "first operation”; in this process, as long as the image 3522 does not touch the left door area 354L and the right door area 354R, the image 3522 can directly transfer the image 3522 (or image 3521) to the "Notes" application without opening the "cross-application transmission interface” and display it in the first display area 351.
  • the user interface 36 shown in (B) of FIG. 12 it should be noted that even if the image 3522 briefly touches the left door area 354L or the right door area 354R during this process, the electronic device will only display the corresponding special effects on the side, and will not directly trigger the "cross-application transmission interface".
  • FIG13 shows the process of a user completing cross-application transmission of information through the “cross-application transmission interface” of an electronic device in a split-screen state.
  • the content of the elements included in the user interface 35 and the functions of each element can be referred to the aforementioned description of FIG. 12 and will not be repeated here.
  • this application may not be the "note” application. Therefore, as shown in (A) and (B) of FIG. 13 , the user can drag the image 3522 to the right door opening area 354R in the direction indicated by the dotted arrow shown in (A) of FIG. 13 ; when the image 3522 enters the right door opening area 354R, the electronic device can immediately display the user interface 37 shown in (C) of FIG. 13 .
  • the user interface 37 may include a sub-interface 371 , an icon area 372 , and an image 373 .
  • sub-interface 371 in the split-screen state, after the user triggers the "cross-application transfer interface" through operation, the display screen in sub-interface 371 is still in split-screen mode, and it still includes two display areas, namely the first display area 3711 and the second display area 3712 shown in (C) of Figure 13.
  • the image content displayed by image 373 is the same as the image content displayed by image 3521 and image 3522, except for the difference in area size.
  • the user places the dragged information element, i.e., image 373, on the corresponding icon in the icon area 372 and lets go, and the electronic device can transmit the information element to the application service corresponding to the icon in response to the user operation and display the corresponding application interface.
  • the dragged information element i.e., image 373
  • the user interface 35 can be referred to as the "first interface”, the image 3521 thumbnail 3522, or the image 373 can be referred to as the "first information”, the operation of dragging the image 3522 to the right door opening area 354R can be referred to as the "second operation”, the operation of placing the image 373 on the corresponding icon in the icon area 372 and letting go can be referred to as the "third operation”, the user interface 37 can be referred to as the "second interface”, and the icon displayed in the icon area 372 in the user interface 37 can be referred to as "at least one application service icon”.
  • FIG. 14 and 15 respectively show the process of the user completing the cross-application transmission of information through the split-screen function of the electronic device and the "cross-application transmission interface" in the small window state.
  • the user interface displayed by the electronic device may include application interfaces of two different applications, one of which is displayed in full screen, and the other is displayed in a small window (floating window) on top.
  • the user can directly drag and drop elements in one application interface to another application interface through the multi-window function, and the specific operation process is similar to the operation process of cross-application transmission in the split-screen state in Figure 12.
  • the transmission method of information can be dragged from the top small window (floating window) to the full-screen display interface, or it can be dragged from the full-screen display interface to the top small window (floating window).
  • users can also transfer through the "cross-application transfer interface".
  • the specific operation process is similar to the operation process shown in Figure 13, so no further details will be given here. Please refer to Figures 14 and 15 for details, and combine them with the aforementioned related explanations of Figures 12 and 13 for understanding.
  • the electronic device After using the "cross-application transmission interface” to transmit information across applications, the electronic device can also provide different prompts and display different interface effects for the user according to the type of application service that the information enters and the result of the information transmission.
  • the interface styles that may be displayed by the electronic device after the user uses the "cross-application transmission interface” to transmit information across applications are described.
  • the snack bar is used to prompt the user, please refer to Figure 16.
  • the user interface 41 is a cross-application transmission interface for the user to perform cross-application transmission of the image 411.
  • the user is placing the dragged information element, that is, the image 411, on the "note" icon on the right.
  • the electronic device may transmit the image 411 to the "Notes" application service in response to the user operation; if the transmission is successful, the electronic device may display a user interface 42 as shown in (B) in FIG. 16 .
  • a snack bar 421 may be displayed below the user interface 42.
  • the snack bar 421 may include a prompt message 4211 and a jump control 4212, wherein:
  • the prompt information 4211 may include four characters “Transfer successful” to prompt the user that the electronic device has successfully transferred the image 411 to the “Notes” application service.
  • the jump control 4212 can respond to the user's touch operation to enable the electronic device to jump from the current interface to the application service interface.
  • the Notes interface can respond to the user's touch operation to enable the electronic device to jump from the current interface to the application service interface.
  • snack bar 421 may automatically disappear after being displayed for a period of time (e.g., 2s-3s); or, when snack bar 421 is still displayed in user interface 42, the user may make snack bar 421 disappear through other locations in electronic user interface 42 except where snack bar 421 is located.
  • a period of time e.g. 2s-3s
  • the electronic device can respond to the operation and display the user interface 43 shown in (C) of FIG. 16 .
  • the user interface 43 is the interface of the application service "Notes", and it can be seen from the user interface 43 that the image 411 has been transferred to the "Notes" by the electronic device.
  • FIG. 16 is only an exemplary illustration of the user interface provided by the embodiment of the present application, and it should not constitute a limitation on the embodiment of the present application.
  • the electronic device can still use the snack bar in the interface to prompt the user.
  • user interface 44 is a cross-application transmission interface for a user to perform cross-application transmission of an image 441.
  • the user may place the dragged information element, i.e., image 441, on the icon of "global collection" on the right.
  • the electronic device may transfer image 441 to the global collection (i.e., add image 441 to the global collection folder) in response to the user operation; if the collection is successful, the electronic device may display a user interface 45 as shown in (B) in FIG. 16 .
  • a capsule 451 may be displayed on the right side of the user interface 45.
  • a "global favorites" icon 4511 may be displayed in capsule 451.
  • the user can change the specific position of capsule 451 on the right side by pressing and dragging it.
  • the user can also click on capsule 451 as shown in (B) in Figure 17 to make the electronic device jump from the current interface to the interface of the application service "global favorites".
  • the interface of the "global favorites" after the jump can be specifically referred to the user interface 43 shown in (B) in Figure 16 and the aforementioned related instructions, which will not be repeated here.
  • capsule 451 may automatically disappear after being displayed on the side of the screen for a period of time.
  • capsule 451 may continue to be displayed on the side of the screen, so that the user can continue to drag up other information elements included in the current display interface of the electronic device and put them into the "global collection", please refer to Figure 18 for details.
  • the user interface 45 is the user interface 45 shown in (B) of FIG. 17 above. It is understandable that at this time, the user has already collected the image 441 into the "global collection", and the capsule 451 is still displayed in the user interface 45. If the user wants to collect other elements in the interface into the "global collection” next, the user can drag the elements in the interface and move them to the capsule 451 and then let go. As shown in (A) of FIG. 18 , after the user selects the text 452, the user can press and hold the text 452 to drag it up and directly drag it to the capsule 451, and the electronic device can respond to the user operation and display the user interface 46 shown in (B) of FIG. 18 .
  • the electronic device may enlarge capsule 451 to facilitate user operation, that is, capsule 451 in user interface 46 may be larger than capsule 451 in user interface 45, and the electronic device may reduce the original text 452 to text 461 in user interface 46.
  • the electronic device may respond to the user operation and enlarge text 461. (or text 452) is transmitted to the global collection (ie, text 461 is collected in the global favorites). If the collection is successful, the electronic device can display the user interface 47 as shown in (C) in Figure 18.
  • capsule 451 is still displayed in user interface 47.
  • the user can open the interface of the application service "Global Favorites” by clicking capsule 451 as shown in (C) of FIG. 18 .
  • the electronic device can display the interface of the application service "Global Favorites” in the form of a small window in the interface, please refer to user interface 48 shown in (D) of FIG. 18 for details.
  • the user interface 48 may include a main interface 481 and a sub-interface 482.
  • the main interface 481 may be an application interface of the application “browser” in the electronic device
  • the sub-interface 482 is a small window interface of the application service “global collection”.
  • the sub-interface 482 may include an image 4821, text 4822, and a function expansion control 4823, wherein:
  • Image 4821 corresponds to image 441 in the above description
  • the text 4822 corresponds to the text 452 or the text 461 in the above description
  • the function expansion control 4823 can respond to a user's touch operation, such as a click operation as shown in (D) in FIG. 18 , so that the electronic device displays a user interface 49 as shown in (E) in FIG. 18 .
  • the sub-interface 482 displays an expand control 4824 , a minimize control 4825 , and a close control 4826 , wherein:
  • the minimization control 4825 can respond to a user operation to cause the electronic device to collapse the sub-interface 482 and display it in a capsule form on the side of the screen.
  • the close control 4826 can respond to user operation to cause the electronic device to close the sub-interface 482.
  • the expansion control 4824 can respond to the user operation to enable the electronic device to display the interface of the application service "Global Favorites” in full screen. As shown in (E) of FIG. 18 , the electronic device can respond to the user's click operation on the expansion control 4824 to display the user interface 50 shown in (F) of FIG. 18 . It can be seen from the user interface 50 that the electronic device has now displayed the interface of the application service "Global Favorites” in full screen, and the text image 441 and text 452 previously collected by the user are also displayed in the user interface 50 accordingly.
  • the user interface 51 is The user can long-press the text 511, drag the text 511 containing the location information, and drag it to the side of the electronic screen; the electronic device can respond to the operation and display the user interface 52 as shown in (B) in FIG. 19 .
  • user interface 52 is the cross-application transmission interface.
  • the user can drag the text 521 obtained by shrinking the text 511 to any icon in the icon bar on the right side of the user interface 52 and then let go, and the text 521 (or text 511) can be transferred to the application service corresponding to the icon.
  • the electronic device can respond to the user operation and display the user interface 53 shown in (C) of Figure 19.
  • the user interface 53 may include a main interface 531 and a sub-interface 532.
  • the main interface 531 may be an application interface in an electronic device.
  • the application interface of The user can adjust the position of the sub-interface 532 in the user interface 53 by pressing and dragging it.
  • the sub-interface 532 may include an expansion control 5321, a minimize control 5322, and a close control 5323, wherein:
  • the minimization control 5322 can respond to user operations to cause the electronic device to collapse the sub-interface 532 and display it in the form of a capsule on the side of the screen.
  • the close control 5323 can respond to user operation to cause the electronic device to close the sub-interface 532.
  • the expansion control 5321 can respond to user operations to enable the electronic device to display the application in full screen. As shown in (C) of FIG. 19 , the electronic device may respond to the user's click operation on the expansion control 4824 by displaying the user interface 54. It can be seen from the user interface 54 that the electronic device has now displayed the application in full screen. interface.
  • the electronic device may not display the user interface 53 as shown in (C) in Figure 19, but directly display the user interface 54 as shown in (D) in Figure 19, that is, directly display the new application interface in full screen.
  • the snack bar is displayed in the original interface to prompt the user, and other devices are controlled to use small windows or directly display the new application interface in full screen, please refer to Figure 20.
  • the electronic device after the electronic device establishes a communication connection with other smart devices, the electronic device can also perform cross-device transmission of information based on the "cross-application transmission interface" provided by the present application.
  • Figure 20 exemplifies the specific process of an electronic device, when establishing a communication connection with a vehicle-mounted terminal, using the "cross-application transmission interface" to send text information containing location information in WeChat to the vehicle-mounted terminal, and using the vehicle-mounted terminal to navigate to the location information.
  • the electronic device 1900 has established a communication connection with the vehicle terminal through Bluetooth, Wi-Fi, etc.
  • the electronic device 1900 can be an electronic device supporting the "cross-application transmission interface" interaction mode provided in the embodiment of the present application.
  • the user interface 55 is The user can long-press the text 551 to drag the text 551 containing the location information and drag it to the side of the electronic device screen; the electronic device 1900 can respond to the operation and display the user interface 56 as shown in (B) of FIG. 20 .
  • the specific functions of the elements included in the user interface 56 can refer to the above-mentioned description of the user interface 52 in FIG. 19 , wherein the text 561 corresponds to the above-mentioned text 521 , and the “driving navigation” icon 562 corresponds to the above-mentioned “map navigation” icon 522 .
  • “driving navigation” is a vehicle navigation service provided by the electronic device 1900 . After the electronic device 1900 establishes a communication connection with other vehicle terminals, such as the vehicle terminal 1901 , the user can control the vehicle terminal to navigate through the “driving navigation” service provided by the electronic device 1900 . As shown in (B) of FIG.
  • the electronic device 1900 can respond to the user operation and display the user interface 57 shown in (C) of FIG. 20 , and transmit the text 561 to the vehicle terminal 1901 , so that the vehicle terminal 1901 displays the user interface 58 shown in (D) of FIG. 20 .
  • a snack bar 571 may be displayed below the user interface 57.
  • the snack bar 571 may be used to display a prompt message “Successfully opened, please go to the associated device to view”, which is used to prompt the user that the electronic device 1900 has successfully sent the text 561 containing the location information to the vehicle terminal 1901, and the vehicle terminal 1901 has opened the navigation application based on the received text 561 and navigated to the above location information.
  • the user interface 58 is a user interface displayed after the vehicle terminal 1901 receives the text transmitted by the electronic device 1900 based on the “cross-application transmission interface”.
  • the user interface 58 may be a navigation application (e.g.
  • the user interface 58 may also display an information bar 582, which may be used to prompt the user of the source device of the location information and prompt the user to confirm whether to navigate to the location corresponding to the location information.
  • the electronic device not every cross-application transmission of information using the "cross-application transmission interface" will be successful. For example, when the size of an information element exceeds the upper limit specified by the target application service, or the format of the information element does not comply with the regulations of the target application service, the information element cannot be transmitted to the target application service through the "cross-application transmission interface". In this case, the electronic device can display toast feedback in the interface to prompt the user that the information has not been successfully transmitted.
  • the user interface 60 is an application interface of the “Album” application, which displays 11 images, namely, images 601 to 611.
  • the 10 images namely, images 601 to 610, are images that have been selected by the user.
  • the user can long press any one of the 10 images (such as the image 610 shown in (A) of FIG. 21 ) and then drag it to the side, so that the electronic device displays the user interface 61 shown in (B) of FIG. 21 .
  • user interface 61 is the cross-application transmission interface.
  • image thumbnail set 612 is the thumbnail set formed after the user drags and pulls up images 601 to 610 in user interface 60.
  • the number "10" displayed in the superscript in the upper left corner indicates that the user has selected a total of 10 images. If the transmission is successful, the electronic device can display
  • the contact interface of the application is used to facilitate the user to share all the images contained in the image thumbnail set 612 with WeChat friends.
  • WeChat has a limit on the number of images that a user can send at a time (here it is assumed that the number does not exceed 9), and the image thumbnail set 612 contains a total of 10 images, which has exceeded the number limit specified by WeChat, the transmission process of images 601-610 through the "cross-application transmission interface" will not be successful. Therefore, after the user can press and hold the image thumbnail set 612 and drag it to the application service icon of "Friends WeChat" and then release it, in response to the operation, the electronic device can display the user interface 62 shown in (C) in Figure 21.
  • toast feedback 621 may be displayed below the user interface 62. Specifically, toast feedback 621 may display a prompt message “The file has exceeded the transfer limit” to prompt the user that the number of files transferred exceeds the limit of the target application service, and therefore the transfer process fails. Unlike the snack bar 421 mentioned in the above description, toast feedback 621 generally does not display controls for interface jumps.
  • the toast feedback 621 may automatically disappear after being displayed for a period of time (e.g., 2s-3s); or, when the toast feedback 621 is still displayed in the user interface 62, the user may make the toast feedback 621 disappear through other locations in the electronic user interface 62 except the location where the toast feedback 621 is located.
  • a period of time e.g. 2s-3s
  • the electronic device after the electronic device obtains the data to be transmitted, it generates a corresponding floating element. After the electronic device detects that the user drags the floating element into a preset hot zone, it can trigger the smart flow service, that is, display one or more icons of applications that can be used to receive the above data to be transmitted. After that, the electronic device can detect the operation of continuously dragging the floating element to the area where any application icon is located and releasing it, and then send the data to be transmitted to the corresponding app.
  • the smart flow service that is, display one or more icons of applications that can be used to receive the above data to be transmitted.
  • the method provides a convenient, simple, fast, smooth and intuitive data sharing solution for users, which is convenient for users to share data when needed and can improve the user's terminal usage experience.
  • the information transmission method provided in the embodiment of the present application can also be called a data sharing method.
  • the dragging operation mentioned in the method can be performed by the user's finger, or by an information input device such as a stylus pen or a mouse.
  • the data to be transmitted is the information mentioned in the above embodiments.
  • the data to be transmitted can be stored locally in the electronic device, for example, in a storage path corresponding to some applications (such as a gallery) in the electronic device, or can also be stored in a cloud device.
  • the data to be transmitted can include various types, and several examples are listed below:
  • the text may be text in a web page displayed on an electronic device, text in a browser, text in a social software, text recognized in an image (such as an image stored in a gallery of an electronic device, a screenshot (also known as a screenshot), etc.), text converted from speech, etc.
  • Documents may include text documents, table documents, code documents, etc.
  • Pictures may include static pictures or dynamic pictures. Pictures may also include full-screen screenshots, partial screenshots (i.e., screenshots of irregular shapes), edited screenshots, etc.
  • Videos may include videos shot by electronic devices, videos downloaded from the Internet, screen recordings, etc.
  • the electronic device can display the data to be transmitted, and after the user inputs a user operation (such as a long press operation) for the data to be transmitted, the electronic device can generate a corresponding floating element.
  • a user operation such as a long press operation
  • a floating element refers to an element displayed on the display screen, suspended above other interface elements displayed on the display screen, and can be dragged by the user to any position on the display screen.
  • the floating element can be implemented as a thumbnail or preview of the corresponding data to be transmitted, and of course it can also be implemented in other forms such as a name, a mark, part or all of the content of the data to be transmitted, etc., which is not limited in this application.
  • a hotspot is an area on the display of an electronic device that is used to trigger a specific function.
  • the data sharing method provided in this application may involve a variety of hot zones for triggering different functions during execution, which will be described in detail later.
  • the size (i.e., dimensions), position, shape, etc. of each hot zone in this application can be set according to user needs and usage experience.
  • Each hot zone provided in this application is an area that the electronic device processes itself, and there is no need to prompt the user. That is, the electronic device does not need to prompt the user of each hot zone of the display screen.
  • the electronic device when the electronic device uses a function corresponding to a hot zone for the first time, the electronic device may provide a usage guide to prompt the user the location of each hot zone and the specific function that can be triggered by the hot zone.
  • the electronic device may also prompt the user with the hot zone, for example, each hot zone may be highlighted in a shadow, color, etc., so that the user can know it.
  • the smart transfer service is the "smart transfer" mentioned above. It is a system service or system function provided by the electronic device in this application, which can support the electronic device to easily transfer data from one application to another. Specifically, the smart transfer service supports the electronic device to display one or more icons of applications that can be used to receive the above-mentioned data to be transmitted on the display screen, and after detecting the operation of continuously dragging the floating element to the area where any application icon is located and releasing it, the data to be transmitted is sent to the corresponding application.
  • the smart circulation service is just a term used in this embodiment, and its meaning has been recorded in this embodiment, and its name does not constitute any limitation to this embodiment.
  • the smart circulation service can also be called other terms.
  • 22A-22N are a set of user interfaces for implementing data sharing on the electronic device 100 .
  • FIG. 22A is a user interface provided by an embodiment of the present application.
  • the application that provides the user interface may be a system application or a third-party application.
  • a system application refers to an application directly provided by the operating system of the electronic device 100 for implementing a specific function.
  • a third-party application refers to an application provided by other developers and obtained by the electronic device 100 through the Internet for implementing a specific function.
  • the user interface may also be the homepage, negative one screen, lock screen interface, etc. of the electronic device 100, and this application does not impose any restrictions on this.
  • the electronic device 100 may detect a long press operation on the display screen. It is not limited to a long press operation, but may also be a double-click operation, a preset specific track sliding operation, and other user operations, which are not limited in this application. In response to the above operation, the electronic device 100 may obtain the text in the area where the long press operation is located in the user interface, and display the following content on this part of the text: a text selection box, a drag bar at the start position and the end position of the text selection box, and a toolbar above the text selection box.
  • the text selection box may be displayed only on a small part of the text (e.g., 1-2 words in the area where the touch point of the long press operation is located).
  • the drag bar at the start position of the text selection box and the drag bar at the end position can be dragged by the user to adjust the size of the text selection box, that is, to adjust the selected text.
  • the toolbar may include multiple controls for processing the selected text, such as a cut control, a copy control, a paste control, a share control, and the like.
  • the electronic device 100 may detect a user operation to adjust the selected text (such as dragging the position of the drag bar of the start position or end position of the text selection box to adjust the area or size of the text selection box).
  • the electronic device 100 may determine the target text that the user wants to select based on the user operation of selecting the text. Referring to FIG22B , illustratively, after the user adjusts the text selection box to the size shown in FIG22B , the electronic device 100 may determine the target text 111 based on the user operation.
  • the electronic device 100 may detect a long press operation on the target text 111. In response to the above operation, the electronic device 100 may display a control 112 in a suspended state corresponding to the target text 111.
  • the control 112 may be located at the touch point position acting on the display screen when the user inputs the long press operation.
  • the electronic device in response to a long press operation on the target text 111, can generate a suspended control 112 using the touch point of the long press operation on the display screen as an anchor point.
  • the touch point as an anchor point means that the control
  • a certain position point of the control 112 (such as the middle upper position, the middle point of the upper edge, the center point, the middle point of the right edge or other points) is at the anchor point.
  • FIG22D takes a certain position on the right side of the control 112 as an example to illustrate the anchor point.
  • the target text 111 may be displayed in the control 112.
  • the control 112 may display part of the target text 111, such as the first sentence of the target text 111, or a summary of the target text 111.
  • the control 112 may also be implemented as a preview or thumbnail of the target text 111.
  • the suspended control 112 generated in FIG. 22D is the floating element in the present application.
  • the suspended control 112 can adjust the display position in real time according to the dragging operation performed by the user on the control 112 .
  • control 112 when the user drags the control 112, if the touch point enters the edge of the display screen, part of the content of the control 112 may exceed the screen and not be displayed, or the electronic device may reduce the size of the control 112 to avoid incomplete display.
  • the text selection box below continues to be displayed to keep the corresponding text selected, but the drag bars at the start and end positions of the text selection box and the toolbar above the text selection box are no longer displayed.
  • a vibration signal may also be output to prompt the user that the suspended control 112 can be dragged.
  • the light band guidance hot zone is used to trigger the light band effect of the guidance direction, which refers to the dragging direction that triggers the smart flow service.
  • the electronic device 100 after the electronic device 100 generates the suspended control 112, the electronic device 100 generates a light band guide hot zone.
  • the light band guide hot zone may include an area 113A enclosed by the dotted line L1 on the left side of the display screen and the upper edge E1, left edge E3, and lower edge E2 of the display screen, and an area 113B enclosed by the dotted line L2 on the right side of the display screen and the upper edge E1, right edge E4, and lower edge E2 of the display screen.
  • the heights of the areas 113A and 113B are the same as the height of the display screen, and the widths may be 25% of the width x of the display screen.
  • the electronic device 100 can detect a user operation in which the user drags the control 112 to slide to the right side of the display screen. After detecting that the touch point of the user's finger in the display screen enters the light band guide hot zone 113B on the right side of the display screen, the electronic device 100 can display the light band 114 as shown in Figure 22F on the right edge of the display screen. Alternatively, after detecting that the touch point of the user's finger in the display screen enters the light band guide hot zone 113B on the right side of the display screen and stays in the light band guide hot zone 113B for a period of time (such as 600ms), the electronic device 100 can display the light band.
  • the long press operation for generating a suspended control 112, and the operation of dragging the control 112 to slide can be a continuous and uninterrupted operation, or two operations with an interval in between.
  • the light strip 114 may be a strip interface element with attributes such as color, shadow, gradient, graphic fill (such as grid fill, oblique line fill), etc. In some embodiments, the light strip 114 may also present dynamic effects, such as changing color, flashing display, etc.
  • the light band 114 at the right edge of the display screen can be used to prompt the following information: 1.
  • the current control 112 has been dragged to the right side of the display screen; 2.
  • Continuing to drag to the right is the dragging direction that triggers the smart flow service, that is, if the user continues to drag the control 112 to the right, the smart flow service can be triggered.
  • the electronic device 100 may reduce the size of the control 112 to reduce obstruction of other content on the display screen.
  • the electronic device 100 may display a light band at the left edge of the display screen.
  • the light band may be used to prompt the following information: 1.
  • the current control 112 has been dragged to the left side of the display screen; 2.
  • the dragging direction to the left is the dragging direction that triggers the smart flow service, that is, if the user continues to drag the control 112 to the left, the smart flow service may be triggered.
  • the door opening hot zone is used to trigger the smart flow service.
  • the electronic device 100 after the electronic device 100 generates the control 112 in the suspended state, the electronic device 100 generates the door opening hot zone.
  • the door opening hot zone may include an area 115A enclosed by the dotted line L3 on the left side of the display screen and the upper edge E1, left edge E3, and lower edge E2 of the display screen, and an area 115B enclosed by the dotted line L4 on the right side of the display screen and the upper edge E1, right edge E4, and lower edge E2 of the display screen.
  • the height of area 115A and area 115B are the same as the height of the display screen, and the width can account for 40 (density-independent pixel, dp) of the width of the display screen.
  • dp is an abstract unit based on screen density
  • 1dp*pixel density/160 actual number of pixels. Therefore, the width of area 115A and area 115B is related to the pixel density of the display screen. The larger the pixel density, the larger its width.
  • the electronic device 100 can detect the user operation of the user continuing to drag the control 112 to the right side of the display screen. After detecting that the touch point of the user's finger in the display screen enters the door opening hot zone 115B on the right side of the display screen, the electronic device 100 can stop displaying the light band and trigger the smart flow service. Alternatively, after detecting that the touch point of the user's finger in the display screen enters the door opening hot zone 115B on the right side of the display screen and stays in the door opening hot zone 115B for a period of time (such as 600ms), the electronic device 100 can stop displaying the light band and trigger the smart flow service. The duration can be set as needed and is not limited here.
  • Smart flow service means that the electronic device 100 matches the application that can receive the data to be transmitted, and provides the user with a service to quickly send the data to be transmitted to other target applications.
  • the data corresponding to the floating element that the user acts on when the smart flow service is triggered is the data to be transmitted.
  • the target text 111 corresponding to the control 112 is the data to be transmitted.
  • the electronic device 100 may display a menu bar 116 including icons of one or more candidate applications on the right side of the display screen.
  • the menu bar 116 may include a favorites icon, a search icon, a share icon, a note icon, a text message icon, and the like.
  • the favorites application corresponding to the favorites icon may be a system application, which provides a global system favorites function.
  • the note application corresponding to the note icon may be a system application or a third-party application, which may provide in-application recording, collection, and other functions.
  • Candidate applications are applications that support receiving data to be transmitted, which are selected by the electronic device 100 from all installed applications. The electronic device 100 may determine candidate applications based on the information type and semantic information of the data to be transmitted.
  • the candidate applications may include global applications that support receiving any type of data (such as favorites applications, search applications, share applications, email applications, etc.), and may also include applications that only support receiving some types of data (such as picture editing applications that only support receiving pictures, applications that only support receiving text messages, etc.). Supports navigation applications that receive text, etc.). Different data to be transmitted can correspond to different menu bars.
  • the control 112 may be further scaled to avoid blocking the menu bar 116. For example, the electronic device may reduce the control 112 so that the height of the control 112 is consistent with the height of the icon of the candidate application in the menu bar 116.
  • the electronic device 100 displays a menu bar 116 including icons of candidate applications on the right side of the display screen.
  • the electronic device 100 can adjust the original foreground user interface to a right perspective style, which forms an "opening door" animation effect with the menu bar 116.
  • the foreground user interface may refer to an interface composed of other contents displayed on the display screen excluding the status bar, or may refer to all contents displayed on the display screen including the status bar.
  • the electronic device can take a screenshot to obtain a screenshot image of the user interface, and then adjust the screenshot image to a perspective style.
  • the perspective style interface can be a screenshot obtained by the operating system of the electronic device.
  • the electronic device can also adjust the original user interface to a perspective style, and continue to play dynamic effects in the perspective style user interface, such as continuing to play videos, animated images, etc.
  • the electronic device 100 can display a menu bar containing icons of candidate applications on the left side of the display screen, and adjust the original foreground user interface to a left perspective style, forming an "opening the door" animation effect with the menu bar.
  • the width of the door opening hot zone can be narrower than the width of the light band guidance hot zone, so that when the electronic device 100 drags the control 112, it will first enter the light band guidance hot zone to trigger the guiding light band effect, and then enter the door opening hot zone to trigger the smart flow service.
  • the display screen has a corresponding hover zoom hotspot.
  • the hover zoom hotspot is used to trigger the proximity hover effect.
  • the hover zoom hotspot may include an area 117 enclosed by the dotted line L5 on the right side of the display screen and the upper edge E1, right edge E4, and lower edge E2 of the display screen.
  • the height of the area 117 is the same as the height of the display screen, and the width may occupy 120dp of the width of the display screen.
  • the proximity hover effect means that after the user drags the control 112 and the touch point on the display screen enters the hover magnification hot zone, the icon of the candidate application closest to the touch point in the menu bar 116 is enlarged in basic size, and the application icons adjacent to the icon of the candidate application before and after are also enlarged accordingly, but the degree of enlargement is less than that of the icon of the candidate application.
  • the basic size can be set as needed and is not limited here.
  • the icon of the candidate application closest to the touch point can be enlarged to a first ratio of the basic size (such as 150% or other ratios), and its enlarged state can be called a hover state.
  • the application icons adjacent to and before the icon of the candidate application closest to the touch point can be enlarged to a second ratio of the basic size (such as 120% or other ratios), and their enlarged state can be called a nearby hover state.
  • the first ratio is greater than the second ratio, and the first ratio and the second ratio can be preset.
  • the electronic device first detects whether the touch point is located in the hover magnification area, and if so, determines the distance from the touch point.
  • the icon of the candidate application that is closest to the control point For example, the electronic device 100 first determines the position of the icons of each candidate application of the basic size in the display screen, and then draws a straight line in the horizontal direction parallel to the display screen with the touch point, and the icon of the candidate application that coincides with the straight line is the icon of the candidate application that is closest.
  • the electronic device 100 first determines the position of the icons of each candidate application of the basic size in the display screen, and then calculates the distance between the touch point and the center point of each candidate application icon, and the icon of the candidate application with the smallest distance is the icon of the candidate application that is closest.
  • the touch point of the user's finger on the display screen enters the hover magnification hot zone 117, and the touch point is closest to the note icon in the menu bar 116, so the note icon is enlarged, and the sharing icons and information icons adjacent to it are secondarily enlarged, and the corresponding text at the bottom of the icon can also be enlarged accordingly.
  • the touch point also moves to the position shown in FIG22I .
  • the user's finger and the touch point of the display screen are closest to the search icon in the menu bar 116, so the share icon is enlarged, and the collection icon and share icon adjacent to it are secondary enlarged, and the corresponding text at the bottom of the icon can also be enlarged accordingly.
  • the icon of the candidate application in the menu bar 116 can be presented as being attracted by the user's finger, and the user can focus on the icon of the corresponding candidate application by enlarging the size of the application icon.
  • the electronic device 100 may first display the icons of the candidate applications of the basic size, and then enlarge the icons of some of the candidate applications according to the position of the touch point in the hover enlargement hot zone, presenting a dynamic change process.
  • the processing speed of the electronic device 100 is fast enough, and there is no need to first display the icons of the candidate applications of the basic size, but the icons of some of the candidate applications after enlargement may be directly displayed according to the position of the touch point in the hover enlargement hot zone.
  • the electronic device 100 displays a menu bar containing icons of candidate applications on the left side of the display screen, and adjusts the original foreground user interface to a left perspective style, the electronic device 100 generates a hover zoom hotspot on the left side of the display screen.
  • the hover zoom hotspot on the left side of the display screen can be used to trigger the hover animation of the menu bar on the left side of the display screen.
  • both the left and right sides of the display screen in the electronic device 100 may include hover hotspots, and both may trigger hover effects.
  • the hover hotspot is always located in the direction of the menu bar in the display screen.
  • the electronic device can also perform other effects on the icon of a candidate application closest to the touch point in the menu bar 116, such as increasing the display brightness of the candidate application icon, marking the candidate application icon with a striking color, and so on.
  • the electronic device 100 displays a menu bar containing icons of candidate applications on the side of the display screen.
  • the display screen corresponds to the door closing hot zone.
  • the door closing hot zone is used to close the smart flow service.
  • the electronic device 100 displays a menu bar 116 containing icons of candidate applications on the right side of the display screen.
  • the electronic device 100 After adjusting the original foreground user interface to the right perspective style, the electronic device 100 generates a closing hot zone 118 surrounded by a dotted line L6 on the left side of the display screen and the upper edge E1, left edge E3, and lower edge E2 of the display screen.
  • the height of the closing hot zone 118 is the same as the height of the display screen, and the width can be half of the width x of the display screen.
  • the electronic device 100 may detect a user operation in which the user continues to drag the control 112 to the left side of the display screen.
  • the electronic device detects that the user drags the control 112 from the hover zoom hot zone 117 to a partial area in the middle of the display screen, which is outside the hover zoom hot zone 117 and the door closing hot zone 118, so the electronic device 100 stops displaying the approach hover animation. That is, referring to Figure 22J, the sizes of the icons in the menu bar 116 are the same and are the basic size.
  • the electronic device 100 can turn off the smart flow service.
  • the electronic device 100 can turn off the smart flow service.
  • the duration can be set as needed and is not limited here.
  • closing the smart flow service means that the electronic device 100 stops displaying the menu bar 116 on the right side of the display screen, and adjusts the original foreground user interface (excluding the status bar) from the right perspective style to the non-perspective style.
  • the style adjustment of the foreground user interface and the menu bar 116 no longer displayed can vividly form a "closing" animation effect.
  • the electronic device 100 displays a menu bar containing icons of candidate applications on the left side of the display screen, and adjusts the original foreground user interface to a left perspective style, the electronic device 100 generates a door closing hotspot on the right side of the display screen.
  • the door closing hotspot on the right side of the display screen can be used to trigger the "door closing" animation of the menu bar on the left side of the display screen.
  • both the left and right sides of the display screen in the electronic device 100 may include a door closing hot zone, and both may trigger the "door closing" animation effect.
  • the door closing hot zone is always located in the opposite direction of the menu bar in the display screen.
  • the user's finger and the display screen may be in continuous contact, that is, the dragging operation may be continuous and uninterrupted.
  • the electronic device 100 After the electronic device 100 detects that the user's finger and the touch point of the display screen enter the door opening hot zone, and starts the smart flow service (i.e., displays the menu bar 116), if the user's finger leaves the display screen, that is, if the electronic device does not detect the touch point, the electronic device 100 will turn off the smart flow service (i.e., stop displaying the menu bar 116). For example, if the finger touch point shown in FIG22H disappears, the electronic device will also stop displaying the menu bar 116 in FIG22H. In other words, in this application, the user can turn off the smart flow service by closing the door hot zone or by stopping touching the display screen.
  • Figures 22M-22N show the user interface for transmitting data through the smart flow service.
  • the electronic device 100 after the electronic device 100 detects that the user drags the control 112 to the door opening hot zone 115B on the right and displays the menu bar 116, it can detect the user operation of the user continuing to drag the control 112 to the area where the icon of any candidate application is located in the menu bar 116 and then releasing it. Specifically, referring to FIG22M, the electronic device 100 can detect the user operation of the user continuing to drag the control 112 to the note application icon and releasing it. Thus, the electronic device 100 can confirm that the note application is the target application.
  • the electronic device 100 can highlight the note application icon, such as increasing it, changing its color, increasing its brightness, and can also output a vibration signal, etc., to prompt the user that the note application is currently selected as the target application to avoid mistransmission.
  • the electronic device 100 after the electronic device 100 detects the user operation of continuing to drag the control 112 to the area where the icon of any candidate application is located in the menu bar 116 and then releasing it, it can also display that the control 112 is sucked into or received into the menu bar 116.
  • the icon of the corresponding candidate application is animated to prompt the user that the electronic device will transfer the data to be transmitted to the corresponding candidate application.
  • the electronic device 100 may write the data to be transmitted (ie, the target text 111 ) corresponding to the control 112 into the note application.
  • the electronic device 100 may close the menu bar 116 of the smart flow service and redisplay the original user interface.
  • the electronic device 100 may also display a prompt window 119.
  • the prompt window 119 may prompt the user that the flow is successful, that is, the data to be transmitted selected by the user has been successfully written to the target application.
  • the prompt window 119 may also include a control 120.
  • the control 120 can be used to open the target application that receives the aforementioned data to be transmitted, such as a note application, so that the user can continue to edit the data written by the smart flow service in the target application.
  • the electronic device 100 shown in FIG. 22N is not limited to directly writing the data to be transmitted into the target application.
  • the electronic device 100 can also display a window provided by the target application.
  • One or more options can be displayed in the window.
  • the user can set the usage of the data to be transmitted in the target application (such as printing parameters, sharing to contacts, etc.) according to the above one or more options.
  • the target application can process the data to be transmitted according to the usage set by the above one or more options.
  • FIG. 23 shows examples of various hot spots when the mobile phone is in portrait mode.
  • a shows the door opening hot zone, which includes two areas on the left and right sides of the display, each occupying 40dp of the display width.
  • the light band guide hot zone including two areas on the left and right sides of the display screen, each occupying 1/4 of the width of the display screen.
  • c shows the hover zoom hotspot for “right door open”, which includes an area on the right side of the display, occupying 120dp of the display width.
  • d shows the door closing hot zone when “door open right”, including an area on the left side of the display screen, occupying 1/2 of the width of the display screen.
  • e shows the hover zoomed-in hotspot for “door open left”, including an area on the left side of the display that occupies 120dp of the display width.
  • f shows the door closing hot zone when "door open to the left” includes an area on the right side of the display screen, which occupies 1/2 of the width of the display screen.
  • FIG. 22A to 22N and Figure 23 all take a mobile phone-shaped electronic device as an example, and list various hot zones and functions of the mobile phone in the portrait mode.
  • the hot zones of the same electronic device in different states may be different.
  • the states here may include the portrait mode and the landscape mode.
  • FIG. 24 which exemplarily shows various hot zones when the mobile phone is in landscape mode.
  • each edge in Figure 24 can correspond to each edge with the same label in Figures 22A-22N.
  • the area enclosed by the dotted line L3 and the display screen edge E1, edge E4, and edge E3, and the area enclosed by the dotted line L4 and the display screen edge E2, edge E4, and edge E3 are the door opening hot zone;
  • the area enclosed by the dotted line L1 and the display screen edges E1, E4 and E3, and the area enclosed by the dotted line L2 and the display screen edges E2, E4 and E3 are light band guidance hot areas;
  • the area enclosed by the dotted line L5 and the display screen edges E2, E4, and E3 is the hover area under the "right-open door” effect. Zoom in on hot spots;
  • the area enclosed by the dotted line L6 and the display screen edges E1, E4, and E3 is the door closing hot zone under the "right-open door” effect.
  • Electronic devices are not limited to mobile phones. Other electronic devices such as foldable screen mobile phones and tablets can also have different hot zones in landscape and portrait modes. The areas of each hot zone in the display are similar to the hot zones in the mobile phone mentioned above, and you can refer to the relevant content in the previous article.
  • each hot zone mentioned in the present application can be measured as a percentage of the height of the display screen, or as a dp of the height of the display screen.
  • the width is similar and is not limited here.
  • the size (i.e., dimensions), position, shape, etc. of each hot zone mentioned in the above UI in the display screen are all examples.
  • the size (i.e., dimensions), position, shape, etc. of each hot zone in the electronic device can be set according to user needs and usage experience, and this application does not make any specific restrictions on this.
  • the hotspots shown with gray filling effects are only for illustration, and in the user interface actually presented to the user by the electronic device, the corresponding hotspots do not include gray filling effects. That is, the electronic device does not need to prompt the user with the location of each hotspot, and the user can feel the existence of each hotspot when using the functions of each hotspot.
  • 25A-25F illustrate a method of sharing screenshots.
  • the electronic device 100 may detect a screenshot operation.
  • the screenshot operation may be implemented by acting on a physical button of the electronic device 100, such as a power button or a volume button, or by a touch operation on the display screen of the electronic device 100, such as a three-finger swipe operation, etc., and the present application does not limit this.
  • the electronic device 100 can save a frame of the user interface on the current display screen, namely a screenshot image, also called a screenshot.
  • the electronic device 100 can write the screenshot into the memory of the electronic device 100 for storage, so that the user can browse the screenshot at any time through the access operation.
  • the electronic device 100 may also display a preview of the above screenshot on the display screen to prompt the user to obtain a frame of screenshot.
  • FIG25B is a user interface of an electronic device displaying a screenshot preview image on a display screen.
  • the electronic device 100 may display an image 411 in the lower left corner area of the display screen.
  • Image 411 may be a screenshot preview image of the user interface shown in FIG25A .
  • the user may preview the screenshot obtained by the aforementioned screenshot operation through the above image 411.
  • the above lower left corner area of the display screen may be referred to as a default screenshot display area.
  • the default screenshot display area may also be the upper right corner, lower right corner, upper left corner, etc. of the display screen, which is not limited in the embodiments of the present application.
  • the electronic device 100 may keep displaying the image 411 for a period of time according to a preset timer.
  • the period of time may be, for example, 3 seconds. After the timer ends, the electronic device 100 may no longer display the image 411.
  • the electronic device 100 may detect whether there is any user operation acting on the image 411 .
  • the electronic device 100 may detect a long press operation on the display screen (hereinafter referred to as the long press operation) acting on the image 411, and the touch point of the user's finger is located in other areas outside the door opening hot zone 412A and the door opening hot zone 412B.
  • the electronic device 100 may switch the image 411 to a suspended state as shown in FIG25D .
  • the suspended image 411 may adjust the display position in real time following the motion trajectory of the user's touch operation.
  • the suspended image 411 is the floating element of the present application.
  • no prompt information may be output on the user interface, that is, it looks like there is no difference before and after the switch.
  • some prompt information may be output on the user interface (for example, adding a black border to the image 411 in FIG. 25D, or displaying other dynamic effects around the image 411), thereby prompting the user that the image 411 can currently be dragged by the user.
  • the electronic device 100 after the electronic device 100 generates the suspended image 411, it can detect the operation of continuously dragging the suspended image 411 to the right side of the display screen to the door opening hot zone 412B. In response to this operation, the electronic device 100 can start the smart flow service, that is, display a menu bar containing icons of multiple candidate applications on the right side of the display screen. Afterwards, the electronic device 100 can also detect the operation of continuing to drag the suspended image 411 into the area where the icon of a candidate application is located in the menu bar, and in response to this operation, send the original screenshot of the image 411 to the application corresponding to the icon of the candidate application.
  • the electronic device 100 after the electronic device 100 generates the suspended image 411, it can detect the operation of continuously dragging the suspended image 411 to the right side of the display screen to the door opening hot zone 412B. In response to this operation, the electronic device 100 can start the smart flow service, that is, display a menu bar containing icons of multiple candidate applications on the right side of the display screen. Afterwards
  • the electronic device 100 After the user triggers the electronic device 100 to generate a floating element, there may be multiple intentions, such as dragging the floating element to the door opening hot zone to trigger the smart flow service, or dragging the floating element to other locations on the display screen (such as dragging a preview image of a screenshot, dragging the location of the text in a memo), etc.
  • the door opening hot zone and other locations on the above display screen may overlap, so when the user drags the floating element, the electronic device 100 needs to accurately identify the user's intention, and then accurately respond to the user's needs to avoid misoperation.
  • FIG. 25G shows a solution for preventing accidental touches by reducing the door opening hot zone.
  • the user interface shown in FIG. 25G may be displayed by the electronic device when a long press operation is detected on the image 411 in FIG. 25B .
  • the door opening hot zone in the user interface includes: the area 412A enclosed by the dotted line L7, the dotted line L8, and the upper edge E1 and the left edge E3 of the display screen, and the area 412B enclosed by the dotted line L4 and the upper edge E1, the right edge E4, and the lower edge E2 of the display screen.
  • the door opening hot zone in FIG. 25G has made any one or more of the following adjustments:
  • the height of the door opening hot zone 412A on the same side can be from the top of the display screen to a certain position in the middle of the display screen rather than directly reaching the bottom of the display screen.
  • the height of the door opening hot zone 412A can be from the top of the display screen to the position where the top of the image 411 is located.
  • the door opening hot zone adjusted based on any one or more of the above items has a smaller range than the conventional door opening hot zone.
  • the probability of the touch point directly entering the door opening hot zone is reduced, which also reduces the probability of directly triggering the smart flow service after the floating image 411.
  • the user can more easily and conveniently choose to trigger the smart flow service during the process of dragging the image 411. Or just move the position of image 411 in the display screen. Specifically, the user drags image 411 to the left door opening hot zone 412A or the right door opening hot zone 412B in FIG. 25G to trigger the smart flow service. The user drags image 411 to an area outside the door opening hot zone in FIG. 25G to move the position of image 411 in the display screen.
  • the door opening hot zone after the floating element is generated can be adjusted accordingly according to the default screenshot display area. For example, if the default screenshot display area is located in the upper right corner, the width of the door opening hot zone on the right side of the display screen can be half the width of the conventional right door opening hot zone, and its height starts from the top to the bottom of the screenshot preview image.
  • Figures 25H-25L show that entering the door opening hot zone twice will trigger the smart flow service, thereby preventing accidental touches.
  • the electronic device 100 displays the image 411 in the lower left corner area of the display screen in response to the user's screenshot operation.
  • the electronic device 100 may detect a long press operation (hereinafter referred to as a long press operation) on the image 411. In response to the above user operation, the electronic device 100 may switch the image 411 to a suspended state as shown in FIG. 25I.
  • a long press operation hereinafter referred to as a long press operation
  • the electronic device 100 detects a long press operation on the image 411, the touch point of the user's finger on the display screen is located in the door opening hot zone on the left side of the display screen. At this time, although the touch point enters the door opening hot zone, the electronic device will not trigger the smart flow service, that is, the "door opening" animation effect will not be triggered.
  • the electronic device 100 can detect the user operation of dragging the image 411 outside the door opening hot zone on the left and then dragging the image 411 back to the door opening hot zone on the left. After detecting that the touch point of the user's finger on the display screen enters the door opening hot zone for the second time, the electronic device will trigger the smart flow service, that is, trigger the "door opening" animation effect.
  • FIG. 25L which shows the menu bar displayed after the electronic device triggers the smart flow service after the user's finger touches the touch point on the display screen and enters the door opening hot zone for the second time.
  • the smart flow service will not be triggered.
  • the smart flow service will be triggered only when the touch point of the user's finger on the display screen moves out of the door opening hot zone and then enters the door opening hot zone for the second time.
  • the first touch point located in the door opening hot zone here means that the touch point of the user operation used to make the element float in the display screen is located in the door opening hot zone.
  • the door opening hot zones where the two touch points are located can be the door opening hot zone on the left side of the display screen and the door opening hot zone on the right side, respectively, or they can both be the door opening hot zones on the same side.
  • the user can more easily and conveniently choose to trigger the smart flow service or simply move the position of the image 411 on the display screen while dragging the image 411.
  • the user can trigger the smart flow service by dragging the image 411 to the door opening hot zone in FIG. 25D for the second time; the user can move the position of the image 411 on the display screen by directly dragging the image 411 to an area outside the door opening hot zone in FIG. 25D.
  • the operation of triggering the smart flow service may include, in addition to the touch point being located in the door opening hot zone, staying in the door opening hot zone for a period of time (e.g., 600ms).
  • the time can be set as needed and is not limited here.
  • 25M-25R show a solution for preventing accidental touches by combining the above two methods.
  • the electronic device reduces the door opening hot zone, and the smart flow service is triggered only after the touch point operated by the user enters the door opening hot zone twice.
  • FIG. 25M shows a user interface provided by the electronic device 100 .
  • Fig. 25N shows a floating control 413 generated after the electronic device 100 detects the user operation in Fig. 25M.
  • the specific generation process of the control 413 can refer to the related description of Fig. 22A to Fig. 22D above.
  • FIG. 25N and 25O there are two corresponding door opening hot zones in the display screen: area 412A enclosed by the dotted line L9 and the upper edge E1, left edge E3, and lower edge E2 of the display screen, and area 412B enclosed by the dotted line L4 and the upper edge E1, right edge E4, and lower edge E2 of the display screen.
  • the width of the door opening hot zone 414B on the right side of the display screen may also be shorter than the width of the conventional right door opening hot zone.
  • the width of the door opening hot zone 414B in Figure 25N may be 1/2 of the width of the door opening hot zone 412B in Figure 25C.
  • the electronic device 100 detects a long press operation on the control 413, the touch point of the user's finger on the display screen is located in the door opening hot zone 414A on the left side of the display screen. At this time, although the touch point enters the door opening hot zone, the electronic device will not trigger the smart flow service, that is, the "door opening" animation effect will not be triggered.
  • the electronic device 100 can detect the user operation of dragging the control 413 outside the door opening hot zone on the left and then dragging the control 413 back to the door opening hot zone on the left.
  • the electronic device after detecting that the touch point of the user's finger on the display screen enters the door opening hot zone for the second time, the electronic device will trigger the smart flow service, that is, trigger the "door opening" animation.
  • the definition of the first and second entry into the door opening hot zone here can refer to the relevant introduction in the previous text.
  • the width of the door opening hot zone is shortened, and the smart flow service is triggered only after entering the door opening hot zone twice. Either one of them can be executed, but not both.
  • the electronic device 100 can execute the above-mentioned anti-mistouch scheme combining the two methods for a scenario where the data to be transmitted is text and the position of the text in the user interface can be dragged.
  • Such scenarios are usually provided by text editing applications, so the electronic device can execute the above-mentioned anti-mistouch scheme when it recognizes that a text editing application is currently started, or when it recognizes that the foreground application is a text editing application.
  • the above-mentioned anti-mistouch scheme can be executed for the text in the memo. Specifically, after the electronic device 100 recognizes that it is currently in the above-mentioned scenario, it can execute the above-mentioned anti-mistouch scheme.
  • a floating window can be obtained based on a split-screen operation and can float on top of other user interfaces.
  • the floating element is a floating window
  • the interaction between the user and the floating window involves the avoidance between the intelligent flow service and the smart flow service, which is explained in different situations below.
  • FIG26A is a user interface provided by the electronic device 100 in a split screen scenario. As shown in FIG26A , the user interface simultaneously displays content provided by two applications, including a user interface provided by a gallery application at the bottom layer, and, A window 511 provided by the note application is suspended on the upper layer.
  • the electronic device 100 can detect the user's drag operation at any position of the window 511 or at the horizontal bar at the top of the window 511, and then adjust the position of the window 511 in the display screen in real time according to the movement trajectory of the user's drag operation. In this process, even if the touch point of the drag operation moves to the door opening hot zone, the electronic device 100 will not trigger the smart flow service, but only adjust the position of the window 511 in the display screen.
  • the user interface provided by the bottom layer of the gallery displays one or more icons, and one icon corresponds to one image (such as a photo or video, etc.).
  • the electronic device can detect a user operation (such as a click operation) acting on one or more of the icons, and in response to the operation, the electronic device 100 selects the corresponding icon and displays a selected mark on the selected icon.
  • the electronic device 100 may detect a long press operation on the screen. In response to the above operation, the electronic device 100 may display a suspended control 512.
  • the control 512 may include a preview or thumbnail of the selected icon, and a superscript (e.g., "2") in the upper right corner, which is used to indicate the number of selected icons, that is, the number of selected images.
  • FIG. 26E there are two corresponding door opening hot zones in the display screen, namely the door opening hot zone on the left side of the display screen and the door opening hot zone on the right side of the display screen.
  • the electronic device can detect the operation of dragging the control 512 to the door opening hot zone on the right, and in response to the operation, the electronic device can start the smart flow service.
  • the electronic device in response to the control 512 being dragged to the door opening hot zone on the right, the electronic device displays a menu bar including icons of multiple candidate applications on the right side of the display screen, and adjusts the original user interface to a perspective style.
  • the electronic device can start the smart flow service after detecting that the touch point of the finger dragging the control 512 stays in the door opening hot zone on the right for a period of time.
  • the touch point of the user's finger is also located in the hover magnification hot zone, so the icons of the candidate applications in the menu bar also present a motion effect close to hover.
  • the electronic device can detect that the control 512 continues to be dragged from the right door opening hot zone to the partial area in the middle of the display screen, which is outside the hover zoom hot zone and the door closing hot zone, so the electronic device 100 stops displaying the approach hover animation. That is, referring to FIG. 22H , the sizes of the icons in the menu bar 116 are the same and are the basic size.
  • the electronic device can detect the operation of continuing to drag the control 512 to the door closing hot zone on the left side of the display screen. Referring to Figure 26J, in response to this operation, the electronic device will close the smart flow service, that is, the menu bar will no longer be displayed, and the door opening effect will no longer be presented.
  • FIGS 26C to 26L can provide users with a quick and convenient way to close the smart circulation service after the user mistakenly starts the smart circulation service, and can also not interrupt the user's next operation. Specifically, assuming that the original purpose of the user dragging control 512 in Figure 26E is to drag control 512 to window 511 to send the image corresponding to control 512 to the note application, but the user mistakenly drags control 512 to the door opening hot zone shown in Figure 26F, after which the electronic device displays the "door opening" effect as shown in Figure 26G.
  • the "door opening" effect shown in Figure 26G The effect is not what the user wants, so the user can continue to drag the control 512 to the door closing hot zone on the left side of the display screen to turn off the "door opening” effect.
  • the user can continue to drag the control 512 and drag it to the window 511 and release it to complete the data transmission, thereby achieving the original purpose.
  • the user although the user accidentally triggered the smart flow service, the user can turn off the smart flow service by continuously dragging the control 512 and achieve the original purpose.
  • the user continues to drag the control 512, that is, the user can avoid misoperation simply, conveniently and quickly, and can achieve the original purpose without leaving the finger on the display screen.
  • the door opening hot zone may also be referred to as the second zone, and the area outside the door opening hot zone may be referred to as the first zone, and the first zone and the second zone do not overlap.
  • the second area may include the door opening hot zone 115A and the door opening hot zone 115B shown in Figures 22G-22H
  • the first area may include other display screen areas other than the door opening hot zone 115A and the door opening hot zone 115B in Figures 22G-22H.
  • the second area may include the door opening hot zone 412A and the door opening hot zone 412B shown in Figures 25C-25R
  • the first area may include other display screen areas other than the door opening hot zone 412A and the door opening hot zone 412B in Figures 25C-25R.
  • the second area may include the left door opening hot zone and the right door opening hot zone shown in Figure 26F
  • the first area may include other display screen areas other than the left door opening hot zone and the right door opening hot zone in Figure 26F.
  • the light guide hot zone may also be referred to as the third area, and the third area includes the second area.
  • the light guide hot zone reference may be made to the introduction of the above UI embodiment.
  • the hover zoom hot zone can also be referred to as the fourth area, and the fourth area includes the second area on the side where the menu bar is located, or includes the second area where the touch end point of the first drag operation or the third drag operation is located.
  • hover zoom hot zones please refer to the introduction of the previous UI embodiment.
  • first drag operation and the third drag operation please refer to the subsequent description.
  • the second area on the side where the menu bar is located, or the second area where the touch endpoint of the first drag operation or the third drag operation is located refers to a partial area in the second area, such as an area on one side.
  • the partial area in the second area may include the door opening hot area 115B shown in Figures 22G-22H, the door opening hot area 412B shown in Figures 25C-25F, the door opening hot area 412A shown in Figures 25H-25R, the right door opening hot area shown in Figure 26G, etc.
  • the area other than the hover zoom hot zone and the door closing hot zone in the display screen may also be referred to as the fifth area.
  • Examples of the fifth area may include the area other than the hover zoom hot zone 117 and the door closing hot zone 118 in FIG. 22J , or the area other than the hover zoom hot zone and the door closing hot zone in FIG. 26H .
  • the door closing hot zone may also be referred to as the sixth zone.
  • the door closing hot zone reference may be made to the introduction of the above UI embodiment.
  • the floating element may be referred to as a first element, and the user interface displaying the floating element may be referred to as a first interface.
  • an example of the first interface may include the interface shown in FIG. 22D
  • an example of the first element may include the control 112 in a suspended state in FIG. 22D .
  • an example of the first interface may include the interfaces shown in Figures 25B-25D, or Figure 25G, or Figures 25H-25I
  • an example of the first element may include image 411 in Figures 25B-25D, or Figure 25G, or Figures 25H-25I.
  • an example of the first interface may include the interface shown in FIG. 25N
  • an example of the first element may include the control 413 in the suspended state in FIG. 25N .
  • an example of the first interface may include the interface shown in FIG. 26E
  • an example of the first element may include the control 512 in the suspended state in FIG. 26E .
  • the data corresponding to the floating element may be referred to as first data.
  • examples of the first data may include the selected text in FIG. 22C , or a screenshot of the user interface shown in FIG. 25A , or an image corresponding to the selected icon in FIG. 26D .
  • the application providing the first interface may be referred to as the sixth application, such as the browser application shown in FIGS. 22A and 25A , the memo application shown in FIG. 25M , the gallery application shown in FIG. 26C , and the like.
  • an example of the second interface may include the user interfaces shown in Figures 22A-22C.
  • the text selected by the user may be referred to as the first text.
  • an example of the second interface may include the user interface shown in FIG. 25A .
  • an example of the second interface may include the user interfaces shown in Figures 26C-26D.
  • the selected icon may be referred to as the icon of the first image
  • the unselected icon may be referred to as the icon of the second image.
  • multiple drag operations on the first element may be included. Among them:
  • a first drag operation in which a touch start point of the first drag operation is on a first element and located in a first area of the display screen, and a touch end point is located in a second area of the display screen.
  • an example of the first drag operation may include the operation of dragging the control 112 from other display screen areas other than the door opening hot zone 115A and the door opening hot zone 115B to the door opening hot zone 115B as shown in FIGS. 22D-22G .
  • an example of the first drag operation may include the operation shown in Figures 25D-25E of dragging the image 411 from other display screen areas other than the door opening hot zone 412A and the door opening hot zone 412B to the door opening hot zone 412B.
  • a third drag operation wherein the touch start point of the third drag operation is on the first element and located in the second area, the touch end point is located in the second area, and the track of the third drag operation passes through the first area.
  • an example of the third drag operation may include the operation shown in Figures 25I-25K of dragging the control 112 from the door opening hot zone 412A to the non-door opening area, and then dragging it to the door opening hot zone 412A.
  • an example of the third drag operation may include the operation shown in Figures 25N-25Q of dragging the control 413 from the door opening hot zone 414A to the non-door opening area, and then dragging it to the door opening hot zone 414A.
  • the dragging operation on the first element that is not used to trigger the smart flow service or the door opening effect may include a second dragging operation.
  • the touch start point of the second dragging operation is on the first element and located in the second area, the touch end point is located in the second area of the display screen, and the track of the second dragging operation is located in the second area.
  • examples of the second drag operation may include a drag operation within the door opening hot zone 115A or the door opening hot zone 115B in Figures 22D-22G, or a drag operation within the door opening hot zone 412A or the door opening hot zone 412B in Figures 25D-25E, or a drag operation within the door opening hot zone 412A or the door opening hot zone 412B in Figures 25I-25K, or a drag operation within the door opening hot zone 414A or the door opening hot zone 414B in Figures 25N-25Q.
  • the touch start point and touch end point of the first drag operation, the second drag operation, and the third drag operation only represent The start and end positions of the drag operation should be indicated.
  • the touch start point does not necessarily mean that the user's finger touches the display screen at the start time of the drag operation
  • the touch end point does not necessarily mean that the user's finger leaves the display screen at the end time of the drag operation. That is, before the first drag operation, the second drag operation, and the third drag operation, there may be other operations that continuously and continuously touch the display screen, and of course there may be no other operations that continuously and continuously touch the display screen. After the first drag operation, the second drag operation, and the third drag operation, there may be other operations that continuously and continuously touch the display screen.
  • a menu bar including icons of one or more candidate applications displayed by an electronic device may be referred to as a first menu bar.
  • Examples of the first menu bar may include menu bar 116 in Figures 22H-22K and 22M, and may also include menu bars shown in Figures 25F, 25L, 25R, and 26G-26I.
  • the electronic device after the electronic device displays the first menu bar, it can also detect an operation of continuing to drag the first element into the area where the icon of the candidate application in the first menu bar is located and releasing it.
  • the candidate application can be referred to as the first application.
  • An example of the first application may include the note application in FIG. 22M.
  • the electronic device after the electronic device displays the first menu bar, it can also detect a fourth drag operation of continuing to drag the first element in the fourth area, the touch start point of the fourth drag operation is the same as the touch end point of the first drag operation or the third drag operation, and the touch end point of the fourth drag operation is closest to the icon of the second application in the first menu bar. That is, the fourth drag operation and the first drag operation or the third drag operation are continuous and uninterrupted.
  • Examples of the fourth drag operation may include the operations of dragging control 112 illustrated in FIGS. 22H-22I .
  • the icon of the candidate application closest to the user's touch point can be called the icon of the second application
  • the application icons before and after the second application icon can be respectively called the icon of the first application and the icon of the third application
  • the icons of other applications can be called icons of the fourth application.
  • the touch start point of the fifth drag operation is the same as the touch end point of the fourth drag operation, that is, the fifth drag operation and the fourth drag operation are continuous and uninterrupted.
  • the electronic device after the electronic device displays the first menu bar, it can also detect a sixth drag operation of dragging the first element to a sixth area, the sixth area and the second area do not overlap, and the sixth area is located on the opposite side of the first menu bar in the display screen; in response to the sixth drag operation, the first menu bar stops being displayed.
  • Examples of the sixth drag operation may include the drag operations illustrated in FIGS. 22H-22K , or the drag operations illustrated in FIGS. 26G-26I .
  • the touch endpoint is located in the eighth area of the display screen, the trajectory of the eighth drag operation passes through the seventh area, and the second menu bar is displayed; when the drag operation is not the seventh drag operation or the eighth drag operation, the second menu bar is not displayed; wherein the eighth area is a partial area of the second area.
  • the eighth area is the reduced door opening hot zone
  • the seventh area is the display screen area outside the reduced door opening hot zone.
  • the eighth region includes the door opening hot zone 412A and the door opening hot zone 412B, and the seventh region includes the display screen area other than the door opening hot zone 412A and the door opening hot zone 412B.
  • the eighth region includes the door opening hot zone 412A and the door opening hot zone 412B, and the seventh region includes the display screen area other than the door opening hot zone 412A and the door opening hot zone 412B.
  • the electronic device can recommend multiple application services that can receive the information to the user based on the information, and display the icons of these application services on the right side of the cross-application transmission interface.
  • the upper limit of the number of these application service icons can be 20; optionally, when the number of these application service icons exceeds a certain threshold (for example, 7), in order to ensure the neatness and visibility of the interface, the electronic device may only display a part of these application service icons (for example, 7) at the same time in the cross-application transmission interface when displaying; when the icons currently displayed on the cross-application transmission interface are not the application services expected by the user, the user can also place the dragged element in the blank space above or below the "cross-application transmission interface” icon area to enable the electronic device to update the icons in the icon area. Please refer to Figure 27 for details.
  • the user interface 63 is a cross-application transmission interface for the user to perform cross-application transmission of an image 631.
  • the icon area 632 of the user interface 63 there are displayed seven icons, namely, an icon 6321 of “global collection”, an icon 6322 of “search”, an icon 6323 of “edit”, an icon 6324 of “print”, an icon 6325 of “friends WeChat”, an icon 6326 of “scan” and an icon 6327 of “mail”.
  • the user can drag the image 631 to the bottom of the icon area 6321, and the electronic device can respond to the user operation, update the icons in the icon area 632 (scroll up to update), and display the user interface 65 shown in (C) of Figure 27.
  • the user can also drag the image 631 to the top of the icon area 6321.
  • the electronic device can respond to the user operation, update the icons in the icon area 632 (scroll down to update), and display the user interface 67 shown in (E) of Figure 27.
  • the electronic device may further divide the icon area into two parts, one part of which is used to display fixed icons, and the other part of which is used to display icons that the electronic device recommends to the user. Specifically, for the icons that this part of the electronic device recommends to the user, the electronic device may first identify the information element that is dragged, and obtain the application service icon that meets the user's needs in the cross-application transmission interface based on the identification result.
  • the icons in the icon area of each user interface may also be different; it should be understood that the "different” mentioned here may include different types of icons and different icon orders.
  • the electronic device may display the icons that meet the current needs of the user more at the top of the icon area. Please refer to Figures 28-31 for details.
  • FIG28 is a schematic diagram of a cross-application transmission interface displayed to a user by an electronic device based on location information contained in text according to an embodiment of the present application.
  • the user interface 68 is The chat interface of the application.
  • the user can long press the text 681 to drag up the text 681 containing the location information.
  • the electronic device can respond to the operation and identify the text information; after the electronic device recognizes that the text 681 contains location information, the electronic device determines based on the location information that the user currently has the intention to travel to the location.
  • the electronic device will recommend corresponding application services to the user based on the user's intention, and in the subsequent "cross-application transmission interface" interface, the icons of the application services recommended to the user are displayed in the icon area, and are sorted according to the application services.
  • the icons corresponding to the application services that are more in line with the current user's intention will be located higher in the icon area.
  • the electronic device may respond to the operation and display a user interface 69 as shown in (B) of FIG. 28 .
  • the fixed icon area 692 may include a "global collection” icon 6921 and a “search” icon 6922. It is understandable that no matter what element the user shares based on the electronic device, the electronic device will display the cross-application transmission interface based on the element and the fixed icon area 692 will be displayed, and the icons contained therein are the "global collection” icon 6921 and the "search” icon 6922.
  • the recommended icon area 693 may include an icon 6931 for "map navigation", an icon 6932 for “one-click taxi hailing", an icon 6933 for “driving navigation”, an icon 6934 for "WeChat”, and an icon 6935 for "memo”.
  • the "map navigation" icon 6931 can be used to open the map software in the electronic device to navigate to the location and enter the navigation application interface;
  • the "one-click taxi” icon 6932 can be used to enter the taxi service application interface based on the taxi service provided by the map software;
  • the "driving navigation” icon 6933 is mainly used to transmit the above-mentioned location information across devices to the vehicle terminal connected to the electronic device for communication.
  • FIG. 20 For details, please refer to the aforementioned relevant description of Figure 20.
  • the electronic device can determine that the user currently has the intention to set off for the location based on the location information. Therefore, in the recommended icon area 693, the "map navigation" icon 6931, the "one-click taxi” icon 6932, and the “driving navigation” icon 6933 are displayed in the upper position of the recommended icon area 693 because they are most in line with the current user's intention, so as to facilitate the user to select.
  • Figure 29 is a schematic diagram of a cross-application transmission interface displayed to a user by an electronic device based on information such as time and location contained in a text provided by an embodiment of the present application.
  • user interface 70 is an application interface of the application "browser".
  • the user can long-press text 701 to drag up text 701 containing location information.
  • the electronic device can respond to the operation and identify the text information; after the electronic device identifies that text 701 contains time and location information, the electronic device determines that the text information may contain specific schedule information based on the time and location information.
  • the electronic device will recommend corresponding application services to the user based on the user's intention, and in the subsequent "cross-application transmission interface" interface, the icons of the application services recommended to the user are displayed in the icon area, and the icons corresponding to the application services that are more in line with the current user's intention will be located higher in the icon area according to the application service sorting.
  • the electronic device may respond to the operation and display a user interface 71 as shown in (B) of FIG. 29 .
  • user interface 71 is a cross-application transmission interface.
  • text 711 is the text obtained by reducing text 711, and the icon area on the right can be divided into a fixed icon area 712 and a recommended icon area 713, and a separator line 714 can be used to distinguish between the two areas;
  • the fixed icon area 712 may include a "global collection” icon 7121 and a “search” icon 7122. It is understandable that no matter what element the user shares based on the electronic device, the electronic device will display the cross-application transmission interface based on the element and the fixed icon area 712 will be displayed, and the icons contained therein are the "global collection” icon 7121 and the "search” icon 7122.
  • the recommended icon area 713 may include a "share” icon 7131, a “schedule” icon 7132, a “friend WeChat” icon 7133, a “print” icon 7134, and a “translation” icon 7135.
  • the "share” icon 7131 may be used to share the text 701 to other devices via Bluetooth, email, etc. based on the sharing service provided by the electronic device; the "schedule” icon 7132 is mainly used to add the time and location information in the text 701 to the schedule; and the "friend WeChat” icon 7133 may be used to send the text 701 to WeChat friends via the WeChat chat interface.
  • the electronic device can determine that the text information may contain specific schedule information based on the time and location information, and the user currently has the intention to share or add the schedule. Therefore, in the recommended icon area 713, the "Share” icon 7131, the "Schedule” icon 7132, and the "Friend WeChat” icon 7133 are displayed in the upper position of the recommended icon area 713 because they best meet the current user's intention, so that the user can make a selection.
  • Figure 30 is a schematic diagram of a cross-application transmission interface displayed to a user by an electronic device based on a QR code image contained in an image provided by an embodiment of the present application.
  • user interface 72 is an interface of the application “browser”.
  • the user can long-press image 721 to drag up image 721 containing a QR code image 7211 (the QR code image 7211 shown in FIG. 30 is only for ease of understanding, and can be expressed in other forms in actual application scenarios, which is not limited in this application).
  • the electronic device can respond to the operation and identify image 721; after the electronic device recognizes that image 721 contains a QR code image, the electronic device determines based on the QR code image that the user is likely to need to scan the QR code in image 721 at this time, and the electronic device will recommend corresponding application services to the user based on the user's intention, and in the subsequent “cross-application transmission interface” interface, the icons of the application services recommended to the user are displayed in the icon area, and the icons corresponding to the application services that are more in line with the current user's intention will be located at the top of the icon area according to the application service sorting.
  • the electronic device may respond to the operation and display a user interface 73 as shown in (B) of FIG. 30 .
  • user interface 73 is a cross-application transmission interface.
  • image 731 is an image obtained by reducing image 721, and the icon area on the right can be divided into a fixed icon area 732 and a recommended icon area 733, and a separator line 734 can be used to distinguish between the two areas;
  • the specific functions of the fixed icon area 732 can refer to the aforementioned related description of the fixed icon area 712, which will not be repeated here.
  • the recommended icon area 733 may include a "Scan Camera” icon 7331, a “Print” icon 7332, a “Share” icon 7333, a "Friends WeChat” icon 7334, and an “Album” icon 7335.
  • the "Scan Camera” icon 7331 may be used to scan an image 731 based on a "Scan” service provided by the "Camera” application; the "Print” icon 7332 is mainly used to send the image 731 to a printing device for printing; and the "Share” icon 7333 may be used to share the image 731 with other devices via Bluetooth, email, etc. based on a sharing service provided by an electronic device.
  • image 721 contains a QR code
  • the electronic device can determine based on the QR code image that the user may need to scan the image, or the user wants to print or share the image. Therefore, in the recommended icon area 733, the "Scan Camera” icon 7331, the “Print” icon 7332, and the “Share” icon 7333 are displayed in the upper position of the recommended icon area 733 because they best meet the current user's intentions, so as to facilitate user selection.
  • Figure 31 is a schematic diagram of a cross-application transmission interface displayed to a user by an electronic device based on a facial image contained in an image provided by an embodiment of the present application.
  • user interface 74 is the interface of the “camera” application.
  • the user can long-press image 741 to drag up image 741 containing a face image.
  • the electronic device can respond to the operation and identify image 741; after the electronic device recognizes that image 741 contains a face image, the electronic device can determine based on the face image that the user is likely to beautify image 741 or share it to social software at this time.
  • the electronic device will recommend corresponding application services to the user based on the user's intention, and in the subsequent “cross-application transmission interface” interface, the icons of the application services recommended to the user are displayed in the icon area, and the icons corresponding to the application services that are more in line with the current user's intention will be located higher in the icon area.
  • the electronic device may display a user interface 75 as shown in (B) of FIG. 31 .
  • user interface 75 is a cross-application transmission interface.
  • image 751 is an image obtained by reducing image 751, and the icon area on the right can be divided into a fixed icon area 752 and a recommended icon area 753, and a separator line 754 can be used to distinguish between the two areas;
  • the specific functions of the fixed icon area 752 can refer to the aforementioned related description of the fixed icon area 712, which will not be repeated here.
  • the recommended icon area 753 may include an icon 7531 of "Meitu”, an icon 7532 of "Friends Circle”, an icon 7533 of "QQ Space", an icon 7534 of "Friends WeChat”, and an icon 7535 of "Share”.
  • the icon 7531 of "Meitu” can be used to beautify the image 751;
  • the icon 7532 of "Friends Circle” is mainly used to share the image 751 to the WeChat Friends Circle; and the icon 7533 of "QQ" can be used to share the image 751 to the QQ Space.
  • the electronic device can determine that the user may need to beautify the image 741 or share it to social software based on the face image, so in the recommended icon area 753, the icon 7531 of "Meitu”, the icon 7532 of "Friends Circle”, and the icon 7533 of "QQ Space” are displayed at the upper position of the recommended icon area 753 because they are most in line with the current user's intention, so as to facilitate the user to select.
  • the icon area in the cross-application transmission interface can be used to display thumbnails of application interfaces of applications running in the background of the electronic device in addition to the icons of application services.
  • the information element will be transmitted to the application interface corresponding to the thumbnail. Please refer to Figure 32 for details.
  • the user interface 76 is Chat interface of friend (Xiao Ming) of the application.
  • the user slides upward at the lower border of the electronic device screen; the electronic device can respond to the operation and display the user interface 77 as shown in (B) of FIG. 32 .
  • the user interface 77 is an application navigation interface, in which the application interface thumbnails of all applications currently opened by the electronic device can be displayed, wherein the application interface thumbnail 771 is The application interface thumbnail 772 is a thumbnail of the chat interface with a friend (Xiao Ming) in the application, and the application interface thumbnail 774 is a thumbnail of the web browsing interface in the application "browser".
  • the application corresponding to the application interface displayed by the electronic device is called the foreground application
  • the application that has been opened but has not displayed the application interface on the electronic screen is called the background application.
  • the user can click on any application interface thumbnail displayed in the user interface 77 to switch the application corresponding to the application interface thumbnail to the foreground application, and display the application interface thumbnail in full screen on the screen.
  • the user can click on the application interface thumbnail 772 to cause the electronic device to switch the application "browser" to the foreground application. It should be understood that at this time, the application It is not closed, it will run in the background.
  • the electronic device When the user opens the application through the application navigation interface When switching to the foreground application, the electronic device will still display the user interface 76 on the screen.
  • the electronic device can display the user interface 78 shown in (C) of FIG. 32 .
  • the user interface 78 can be an application interface of a "browser" application in an electronic device.
  • the user can long press and drag the image 781 in the user interface 78 to make the electronic device display the user interface 79 as shown in (D) in Figure 32.
  • user interface 79 may include sub-interface 791, image 792, application interface thumbnail 793, and text description 794.
  • Image 792 is a thumbnail obtained by reducing image 781, and text description 794 may be used to explain to the user the application and the corresponding contact corresponding to application interface thumbnail 793.
  • Thumbnail 793 is a thumbnail of the aforementioned user interface 76.
  • the user interface 80 may be a chat interface for a friend (Xiao Ming) of the “WeChat” application. It can be seen from the user interface 80 that the user has sent the image 781 obtained from the application “browser” to the WeChat friend “Xiao Ming”. In other words, when the user drags the image 792 in the user interface 79 onto the application interface thumbnail 793 and lets go, the user does not need to perform any other operations, and the electronic device can spontaneously send the image 792 (or image 781) to the WeChat friend Xiao Ming.
  • FIG. 32 is only an exemplary illustration of the user interface provided in the embodiment of the present application, and it should not constitute a limitation on the embodiment of the present application. Background applications such as can also be displayed in the cross-application transmission interface, and this application does not limit this.
  • the electronic device can directly call out the side application bar and display the corresponding application service icon for the user in the side application bar.
  • FIG. 33 shows two different methods for bringing up the side application bar of an electronic device.
  • the user can bring up the side application bar of the electronic device by conventionally swiping inward on the side of the screen.
  • the user interface 81 may be an application interface of an application “browser” in an electronic device, or an application
  • the application interface of the electronic device may be an application interface of another application, which is not limited in this application.
  • the user can call out the icon 811 of the application bar on the side of the electronic device by sliding leftward from the right side of the screen (without releasing the hand at this time); then, if the user releases the hand, the electronic device may respond to the operation and display the user interface 82 as shown in FIG. 33 (B).
  • a side application bar 821 may be displayed in the user interface 82.
  • the side application bar 821 may display one or more application icons added to the side application bar 821 by the user, such as the application icons shown in (B) of FIG. 33 .
  • the user can also continue to add other application icons to the side application bar 821 through the application list control 8213. Any icon can respond to user operations to enable the electronic device to open the corresponding application.
  • the electronic device can display the two application interfaces in split screens. The user can transfer information elements provided by one application to another application based on the two interfaces (for details, please refer to the aforementioned description of Figure 2). This is the "smart multi-window function" provided by the electronic device.
  • users can call out the side application bar of the electronic device by long pressing and dragging the information elements in the interface.
  • the user interface 83 may be an application interface of an application “browser” in an electronic device, or an application
  • the application interface of the user interface 83 may also be the application interface of other applications, which is not limited in this application; specifically, the user interface 83 may be the same interface as the user interface 81 in the above description.
  • the user can drag the text 831 selected by the user in the user interface 83 by long pressing; after the user drags the text 831 (without dragging it to the side), the electronic device can respond to the operation and display the user interface 84 shown in (D) in Figure 33.
  • the smart flow icon area 8411 can display multiple application service icons. It should be understood that the icons displayed in the smart flow icon area 8411 can all be used to transmit the elements dragged by the user (i.e., text 842) across applications without the need for the split-screen function provided by the electronic device. This transmission method and the transmission method through the "cross-application transmission interface" user and interface in the aforementioned embodiment can be referred to as the "smart flow" function of the electronic device in this application.
  • the icons displayed in the smart flow icon area 8411 may also include fixed display icons set by the user and icons recommended and displayed by the electronic device to the user based on the content in the text 842.
  • the “Global Favorites” icon 84111 and the “Search” icon 84112 may be fixed display icons, while the “Schedule” icon 84113 and the “Memo” icon 84114 may be icons recommended and displayed by the electronic device to the user based on the content in the text 842.
  • the smart multi-window icon area 8412 may display one or more application icons, which may be all or part of the icons contained in the side application bar 821 in the user interface 82 shown in FIG. 33 (B). Unlike the smart flow icon area 8411, the icons in this area cannot be used to transfer the text 842 across applications, and are only displayed in the user interface 84. In addition, if the number of application service icons recommended by the electronic device for the text 842 exceeds a certain number, the application service icons recommended by the electronic device for the text 842 may be displayed preferentially in the side application bar, and the smart multi-window icon area 8412 and the application icons contained therein are no longer displayed.
  • the application list control 8414 can be used to display icons that can be added to the side application bar 841, including application service icons that can be added to the smart flow icon area 8411 for fixed display, and application icons that can be added to the smart multi-window icon area 8412. Please refer to Figure 34 for details.
  • FIG. 34 shows the specific process of a user adding an icon to the side application bar.
  • the electronic device may display a user interface 8A as shown in (A) of FIG. 34 .
  • the user interface 8A may include a side application bar 8A1 and an icon display interface 8A2, wherein:
  • the side application bar 8A1 may include a smart flow icon area 8A11, a smart multi-window icon area 8A12, and an adding control 8A13 for adding icons to the icons in the side application bar 8A1.
  • the icon display interface 8A2 may display a smart multi-window icon display area 8A21 and a smart flow icon display area 8A22. It is understandable that the icons in the smart multi-window icon display area 8A21 may be added to the smart multi-window icon area 8A12 in the side application bar 8A1; the icons in the smart flow icon display area 8A22 may be added to the smart flow icon area in the side application bar 8A1.
  • the electronic device may display a user interface 8B as shown in (B) of FIG34 .
  • a symbol to be added is displayed in the upper right corner of each icon displayed in the icon display interface 8B2, and both the smart flow icon area 8B11 and the smart multi-window icon area 8B12 in the side application bar 8B1 have blank spaces for storing icons newly added by the user.
  • the user can click on any icon in the smart multi-window icon display area 8B21 or the smart flow icon display area 8B22 to add the icon to the blank icon position of the smart flow icon area 8B11 or the smart multi-window icon area 8B12.
  • the user can click on the "memo" in the smart multi-window icon display area 8B21 to add the icon to the blank icon position of the smart flow icon area 8B11 or the smart multi-window icon area 8B12.
  • the user can click the icon to add it to the blank position 8B121 in the smart multi-window icon area 8B12, or the user can click the "Scan the camera" icon in the smart flow icon display area 8B22 to add it to the blank position 8B111 in the smart flow icon area 8B11.
  • the user can click the confirmation control 8B14 in the side application bar 8B1, and the electronic device can save the icon option added by the user, and display the newly added icon in the side application bar when the side application bar is displayed next time.
  • the user interface 85 may be an application interface of an application “browser” in an electronic device, or an application
  • the application interface may also be the application interface of other applications, which is not limited in this application.
  • the screen recording function box may include a microphone control 8511, a time control 8512, and an option control 8513, wherein;
  • the microphone control 8511 can respond to user operations to enable the electronic device to start/stop recording external sounds
  • the time control 8512 can be used to display the duration of the recording in real time, and it can also respond to user operations to stop the electronic device from recording the screen;
  • the option control 8513 can respond to user operations to enable the electronic device to display more screen recording setting options, such as whether to record the user's operation trajectory on the screen.
  • the electronic device may stop the screen recording process and display a user interface 86 as shown in (B) in FIG. 35 .
  • the user interface 86 may include a video file 861.
  • the video file 861 is a video recorded by the electronic device in response to the user's screen recording operation. After the screen is recorded, the video file 861 may be displayed in the user interface 86 and generally lasts for two to three seconds, so that the user can directly click on the video file 861 to edit, save, etc.; if the user does not operate the video file 861, the electronic device may automatically save it to the album.
  • the user can long-press the video file 861, drag it to the side of the electronic device screen, and then transfer it across applications through the "cross-application transfer interface".
  • the electronic device can respond to the user's long-pressing and dragging operation of the video file 861 to the side, and display the user interface 87 shown in (C) of FIG. 35 .
  • the user interface 87 is the cross-application transmission interface.
  • the user interface 87 may include a sub-interface 871, an icon area 872, and a video file 873, wherein:
  • the electronic device shrinks the original video file 861 to obtain a video file 873 .
  • the user interface 88 may be an application interface of an application “browser” in an electronic device, or an application
  • the electronic device can quickly obtain a full-screen image of user interface 88 and display a user interface 89 as shown in (B) of FIG36 .
  • the user interface 89 may include a screenshot image 891.
  • the screenshot image 891 is an image obtained by the electronic device in response to the user taking a knuckle screenshot of the user interface 88. After the screenshot is taken, the screenshot image 891 may be displayed in the user interface 89 and generally lasts for two to three seconds, so that the user can directly click on the screenshot image 891 to edit, save, etc.; if the user does not operate the screenshot image 891, the electronic device may automatically save it to the album.
  • the electronic device may respond to the user's click operation on the screenshot image 891 as shown in (B) of FIG. 36 , and display the user interface 90 as shown in (C) of FIG. 36 .
  • the user interface 90 is an editing interface of the screenshot image 891, which may include a thumbnail 901 and a doodle option 902, wherein:
  • Thumbnail 901 may be a thumbnail of the aforementioned user interface 88 .
  • the graffiti option 902 may respond to a user operation, so that the electronic device responds to the user's touch operation on the screen and draws the user's touch track on the screen onto the thumbnail 901 .
  • the user can doodle on the thumbnail 901 according to the track shown by the dotted line with direction shown in (D) of FIG. 36 , and the electronic device can respond to the user operation (in the embodiment of the present application, the operation can be referred to as the "eighth operation"), draw the track shown by the dotted line with direction onto the thumbnail 901, and display the user interface 91 shown in (D) of FIG. 36 .
  • user interface 91 is still an image editing interface.
  • the user can also long-press thumbnail 901, drag it to the side of the electronic device screen, and transfer it across applications through the "cross-application transfer interface".
  • the electronic device can respond to the user's long-pressing and dragging operation of thumbnail 901 (at this time, thumbnail 901 already has a pattern drawn by the user, namely, triangle pattern 911) to the side.
  • the user interface 92 as shown in (E) in FIG. 36 is displayed.
  • the user interface 92 is the cross-application transmission interface.
  • the user interface 92 may include a sub-interface 921, an icon area 922, and an image 923, wherein:
  • the electronic device further reduces the original thumbnail 901 to obtain an image 923 (the image 923 also contains a pattern drawn by the user, namely, a triangle pattern 911).
  • the electronic device can transmit the information element to the application service corresponding to the icon in response to the user operation and display the corresponding application interface.
  • user interface 88 can be called the "fifth interface”
  • user interface 89 can be called the “sixth interface”
  • user interface 91 can be called the “seventh interface”
  • user interface 90 can be called the “editing interface”
  • image 891 and image 901 can be called the "first image”
  • user interface 95 can be called the "seventh interface”
  • the user's click operation on the screenshot image 891, the user's operation of graffiti on the thumbnail 901 according to the trajectory indicated by the directional dotted line shown in (D) in Figure 36, and the user's operation of long pressing the thumbnail 901 and dragging it to the side of the electronic device screen can be collectively referred to as the "eighth operation”.
  • the electronic device also provides the user with a long screenshot function.
  • Long screenshot also known as scrolling screenshot
  • Scrolling screenshot is an effective method to capture the current content of the interface, which can obtain all the content in the interface, rather than just capturing the visible part. It can be widely used in web browsing scenarios, and is very useful for investigating web information or collecting materials.
  • the process of scrolling screenshot is to first scroll the web page using the scrolling function, and continuously capture the web page content. After the web page content is captured, the program will automatically combine all the content together to form a complete long picture.
  • the "cross-application transmission interface" provided in this application is also applicable to images captured by users through the long screenshot function. Please refer to Figure 37 for details.
  • the user interface 94 may include a long screenshot image 941.
  • the long screenshot image 941 is an image obtained by the electronic device in response to the user performing a long screenshot operation on the user interface 93. After the long screenshot, the user can edit, save, and perform other operations on the long screenshot image 941 through relevant editing options in the user interface 94.
  • the electronic device may also display a user interface 95 as shown in (C) in FIG. 37 in response to a user pressing and dragging the long screenshot image 941 to the side as shown in (B) in FIG. 37 .
  • the user interface 95 is the cross-application transmission interface.
  • the user interface 95 may include a sub-interface 951, an icon area 952, and an image 953, wherein:
  • the electronic device shrinks it to obtain image 953 .
  • the electronic device can transmit the information element to the application service corresponding to the icon in response to the user operation and display the corresponding application interface.
  • the long screenshot image 941 when the size of the long screenshot image 941 exceeds the upper limit specified by the application service, or the format of the long screenshot image 941 does not comply with the requirements of the target application service, the long screenshot image 941 cannot be transmitted to the target application service through the "cross-application transmission interface".
  • the electronic device can also display toast feedback in the interface to prompt the user that the information has not been successfully transmitted.
  • the electronic device may display a user interface 96 as shown in (D) of FIG. 37 .
  • a toast feedback 961 may be displayed below the user interface 96.
  • the toast feedback 961 may display a prompt message "The image exceeds the upper limit of the smart stream transmission, please crop it before transmitting.” to prompt the user that the transmitted image exceeds the limit of the target application service, so the transmission process fails.
  • toast feedback 961 may automatically disappear after being displayed for a period of time (e.g., 2s-3s); or, when toast feedback is still displayed in user interface 96, the user may make toast feedback 961 disappear through other locations in electronic user interface 96 except for the location where toast feedback 961 is located.
  • a period of time e.g. 2s-3s
  • user interface 93 can be called the "fifth interface”
  • user interface 94 can be called the “sixth interface”
  • long screenshot image 941 or image 953 can be called the “first image”
  • user interface 95 can be called the "seventh interface”
  • the operation of the user placing image 953 on the corresponding icon in the icon area 952 and releasing it can be called the "ninth operation”.
  • the user interface 97 may be a navigation interface displayed by the electronic device to the user when the user first turns on the electronic device after the electronic device leaves the factory.
  • the smart flow service tab 971 may include a switch control 9711, which may be set to an on state by default, that is, the electronic device has turned on the "smart flow” function by default. Of course, the user can also turn off the "smart flow" function of the electronic device by clicking the switch control 9711.
  • users can also turn on or off the "smart flow” function through the relevant interface in the electronic device system settings.
  • the user can open the "smart flow” setting interface in the system settings, that is, the user interface 98, and turn on or off the "smart flow” function by manipulating the switch control 9811 in the "smart flow” tab 981. If the switch control 9711 is displayed as off at this time, the user can turn on the "smart flow” function by clicking the switch control 9811, and the electronic device will respond to the user operation and display the user interface 99 shown in (C) in Figure 38.
  • the user interface 99 may include a prompt box 991, which may be used to ask the user whether to agree to open the electronic device screen to "Smart Flow".
  • the prompt box 991 may include an "Always Allow” option 9911, an "Allow Only During Use” option 9912, and a "Prohibit” option 9913.
  • the user clicks the "Always Allow” option 9911 the user is prompted to allow the user to open the electronic device screen to "Smart Flow".
  • the electronic device can successfully activate the "Smart Flow”function; when the user clicks the "Prohibit” option 9913, the electronic device will not be able to activate the "Smart Flow” function.
  • FIG39 shows some system setting interfaces for understanding the “Smart Flow” function and editing application service icons in the Smart Flow page.
  • the user interface 00 is an interface related to the “Smart Assistant” function in the “System Settings” of the electronic device.
  • the user can click the “Smart Flow” tab to make the electronic device display the user interface 38 shown in (B) of FIG39 .
  • the user interface 38 may be the same user interface as the user interface 98 in the above description.
  • a “Learn Details” control 381 and a “Customize Service” tab 382 may be displayed, wherein:
  • the "Learn Details" control 381 can respond to the user's click operation to enable the electronic device to display a user interface 39 as shown in (C) of FIG39.
  • the user interface 39 is a user interface provided by the system setting, which can be used to show the user the specific function and specific operation steps of the "Smart Flow” function.
  • the "Custom Service” tab 382 can respond to the user's click operation to enable the electronic device to display the user interface 40 as shown in (D) in Figure 39.
  • some icons are icons customized by the user and fixedly displayed in the icon area, while the other icons are icons recommended by the electronic device to the user based on the elements dragged by the user. Therefore, in the user interface 40, the icons displayed in the icon display card 401 are the icons that the user has determined to be fixedly displayed in the icon area, while the icons displayed in the icon display card 402 are the icons that the user has not set to be fixedly displayed in the icon area.
  • the user can click the removal symbol "-" in the upper right corner of any icon in the icon display card 401 to make the icon no longer fixedly displayed in the icon area of the cross-application transmission interface; similarly, the user can click the addition symbol "+" in the upper right corner of any icon in the icon display card 402 to make the icon fixedly displayed in the icon area of the cross-application transmission interface (after being added, the icon will also be displayed in the blank icon area of the icon display card 401, such as 4011).
  • Figures 38 and 39 are merely exemplary illustrations of the user interface related to "system settings" provided in the embodiment of the present application, and should not constitute a limitation on the embodiment of the present application.
  • the icon display card 402 it may contain more or fewer application service icons, and the present application does not limit this.
  • the electronic device may be a mobile phone, a tablet computer, a wearable device, a car-mounted device, an augmented reality (AR)/virtual reality (VR) device, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA) or a dedicated camera (such as a SLR camera, a card camera), etc.
  • AR augmented reality
  • VR virtual reality
  • UMPC ultra-mobile personal computer
  • PDA personal digital assistant
  • a dedicated camera such as a SLR camera, a card camera
  • FIG40 exemplarily shows the structure of the electronic device.
  • the electronic device 100 may include a processor 110 , an external memory interface 120 , an internal memory 121 , an antenna 1 , an antenna 2 , a mobile communication module 150 , a wireless communication module 160 , a camera 193 , a display screen 194 , and the like.
  • the structure shown in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100.
  • the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently.
  • the components shown in the figure may be hardware, software, or software and hardware. Combination of parts.
  • the processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and/or a neural-network processing unit (NPU), etc.
  • AP application processor
  • GPU graphics processor
  • ISP image signal processor
  • DSP digital signal processor
  • NPU neural-network processing unit
  • Different processing units may be independent devices or integrated in one or more processors.
  • the controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.
  • the processor 110 may also be provided with a memory for storing instructions and data.
  • the memory in the processor 110 is a cache memory.
  • the memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
  • the wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.
  • Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas.
  • antenna 1 can be reused as a diversity antenna for a wireless local area network.
  • the antenna can be used in combination with a tuning switch.
  • the mobile communication module 150 can provide wireless communication solutions including 2G/3G/4G/5G etc. applied on the electronic device 100 .
  • a modem processor may include a modulator and a demodulator.
  • the wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) network), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) and the like applied to the electronic device 100.
  • WLAN wireless local area networks
  • BT wireless fidelity
  • GNSS global navigation satellite system
  • FM frequency modulation
  • NFC near field communication
  • IR infrared
  • the wireless communication module 160 can be one or more devices integrating at least one communication processing module.
  • the wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering processing, and sends the processed signal to the processor 110.
  • the wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of the signal, amplify the signal, and convert it into electromagnetic waves for radiation through the antenna 2.
  • antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, so that electronic device 100 can communicate with the network and other devices through wireless communication technology.
  • the electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor.
  • the GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor.
  • the GPU is used to perform mathematical and geometric calculations for graphics rendering.
  • the processor 110 may include one or more GPUs that execute program instructions to generate or change display information.
  • the display screen 194 is used to display images, videos, etc.
  • the display screen 194 includes a display panel.
  • the display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light emitting diode (QLED), etc.
  • the electronic device 100 may include 1 or N display screens 194 , where N is a positive integer greater than 1.
  • the electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.
  • the external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100.
  • the external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music and videos can be stored in the external memory card.
  • the internal memory 121 can be used to store computer executable program codes, which include instructions.
  • the internal memory 121 may include a program storage area and a data storage area.
  • the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.
  • the data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc.
  • the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.
  • the processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the internal memory 121 and/or instructions stored in a memory provided in the processor.
  • the internal memory 121 is used to store a computer program for implementing the information transmission method, as well as a computer program for a method for recommending services involved in the information transmission method, and the processor 110 is used to execute the above-mentioned computer program to implement the information transmission method and the method for recommending services.
  • the GPU in the electronic device can perform a three-dimensional transformation on the content according to the content displayed on the display screen 194, thereby creating a visual effect of the original interface being pushed inward on the screen, and displaying recommended application and/or service icons on the side of the screen of the electronic device.
  • the processor 110 can identify the information element, including identifying the type of the information element and the specific content in the information element, and determine the corresponding application icon and/or application service icon based on the identification result, and generate corresponding program instructions, which can be used to change the display information of the display screen 194, such as updating the interface in the display screen to a cross-application transmission interface, and the icon displayed in the cross-application transmission interface is the application icon and/or application service icon determined by the aforementioned processor 110 based on the identification result.
  • the processor 110 can also obtain the application service to which the user transmits the information, and generate corresponding program instructions based on the obtained results, and combine with the GPU to display the corresponding interface on the screen (for example, the interface can display a snack bar, capsules, small windows, etc.) to feedback the results of the information element transmission to the user.
  • the display screen 194 is used to display the user interface shown in the above UI embodiments.
  • the display screen 194 can also be used to receive user operations performed by the user on the display screen.
  • the processor 110 is used to respond to user operations detected by the electronic device 100, determine the location of various hot zones, and respond to user operations performed by the user on various hot zones to trigger the functions corresponding to the hot zones.
  • the operations performed by each device in the electronic device 100 can be specifically referred to the relevant description of the above method embodiments, which will not be expanded in detail here.
  • the electronic device displays a first interface.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本申请提供了一种信息传输方法及电子设备。实施该方法,电子设备可直接响应于用户对信息的操作将多个应用服务图标显示在界面中,以便于用户将信息放入目标应用服务中,使电子设备能高效、快捷的完成应用之间的信息传输,有效减少用户完成信息跨应用传输所需的操作步骤,提高用户与电子设备之间的交互效率,进而提升用户体验。

Description

信息传输方法及电子设备
本申请要求于2023年06月16日提交中国专利局、申请号为202310725366.4、申请名称为“信息传输方法及电子设备”,以及于2023年06月29日提交中国专利局、申请号为202310788791.8、申请名称为“数据分享方法、相关设备”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请涉及终端技术领域,尤其涉及信息传输方法及电子设备。
背景技术
随着电子信息技术的不断发展,手机、平板等智能设备已经成为我们日常生活、工作和娱乐中不可或缺的产品。在用户使用智能设备的过程中,通常会同时打开智能设备中的多个应用协同工作,用户也时常会利用智能设备对信息进行跨应用传输,即将一个应用中的信息通过另一个应用进行分享、上传等。
但是,当用户需要对信息进行跨应用传输时,通常需要对信息进行复杂且繁琐的操作来完成。例如,当用户需要将浏览器中网页上的文字或者图像转发给微信好友时,一般需要在浏览器中将文字、图像等信息先进行复制或保存,再切换到微信后,才能通过微信对这些信息进行分享、上传等操作。这样的信息传输方法使得用户与智能设备的交互效率低下,也严重影响了用户体验。
因此,需要研究更为高效和便捷的信息传输方法。
发明内容
本申请的目的在于提供一种信息传输方法及电子设备。实施该方法,电子设备可直接响应于用户对信息的操作将多个应用服务图标显示在界面中,以便于用户将信息放入目标应用服务中,使电子设备能高效、快捷的完成应用之间的信息传输,有效减少用户完成信息跨应用传输所需的操作步骤,提高用户与电子设备之间的交互效率,进而提升用户体验。
上述目标和其他目标将通过独立权利要求中的特征来达成。进一步的实现方式在从属权利要求、说明书和附图中体现。
第一方面,本申请了提供一种信息传输方法,所述方法包括:显示第一界面,所述第一界面包括第一子界面和第二子界面,所述第一子界面用于显示第一应用的应用界面,所述第二子界面用于显示第二应用的应用界面,所述第一子界面包括第一信息,所述第二子界面用于在对所述第一信息的第一操作下将所述第一信息传输至所述第二应用中;响应于针对所述第一信息的第二操作,显示第二界面;所述第二界面包括所述第一信息和至少一个应用服务图标;响应于针对所述第一信息的第三操作,将所述第一信息传输到目标图标对应的应用服务中,所述目标图标为所述至少一个应用服务图标中的任意一个应用服务图标。
在本方法中,所述第一界面可以是电子设备显示的智慧多窗界面,即所述第一界面中存在多个窗口,其中每个窗口均对应一个子界面,每个子所显示的应用界面对应的应用可以均不同。所述第一子界面和所述第二子界面即为所述多个窗口对应的多个子界面中的两 个子界面。可选的,所述多个窗口的数量可以为2个,这两个窗口对应的子界面即为所述第一子界面和所述第二子界面。
在所述第一界面中,所述多个窗口对应的子界面中任意一个子界面显示的信息元素可以在用户的拖拽下移动到另一个子界面中,以完成信息的跨应用传输。例如,当用户将所述第一子界面中的第一信息拖拽至所述第二子界面中之后,该信息元素即可以从所述第一子界面对应的应用中传输所述第二子界面对应的应用中。
但是,由于电子设备显示屏面积的限制,所述第一界面中窗口(子界面)的数量是有限的,其可以显示的应用界面的数量是有限的,且用户需要提前通过相应的用户操作打开这些应用,并且需要使这些应用的应用界面分屏显示。当用户想将在第一界面中拖起的元素分享至未打开的(即应用界面未能在所述第一界面中显示)的应用中时,则所述第一界面显示的子界面并不能满足其需求。
因此,在本方法中,可以通过所述第二操作使电子设备显示本申请提供的“跨应用传输界面”,即所述第二界面来所述第一界面的信息元素分享至未打开的(即应用界面未能在所述第一界面中显示)的应用中。在所述“跨应用传输界面”中,界面的侧边可以显示电子设备的为该信息元素推荐的应用的服务图标;之后,用户将拖起的信息元素放置在图标上松手,即可将该信息元素传输到图标对应的应用服务中并启动相应的应用服务功能。
所述第二操作可以用于选中所述第一信息,具体的,所述第二操作可以是对所述第一信息长按后拖拽至所述第一界面的侧边(即显示屏侧边)的操作。在用户不松手的情况下,被拖起的所述第一信息随着用户的指尖在所述第一界面中移动。在用户将所述第一信息拖动至离屏幕右侧边或左侧边的距离小于一定阈值的情况下,电子设备即可显示所述第二界面。在所述第二界面中,所述至少一个应用服务图标所对应的应用服务都是可以接收上述第一信息的应用服务,例如,在上述第一信息为图像的情况下,的好友聊天服务可以发送该图像,的朋友圈服务可以用于分享该图像,的美化服务可以对该图像进行美化,电子设备提供的搜索服务可以对该图像进行智能搜索等,因此,所述至少一个应用服务图标中可以包括这些服务对应的应用服务图标。
可选的,所述至少一个应用服务图标可以同时包括一个应用对应的多个应用服务图标。需要特别说明的是,所述至少一个应用服务图标均为应用服务图标而并非应用图标,且所述至少一个应用服务图标可以不显示在所述第一界面中。当用户将拖起的信息(例如所述第一信息)拖拽至所述至少一个应用服务图标中的某个图标上时,该信息可以直接被该图标对应的应用服务接收。
在所述第二界面中,用户要通过所述第三操作将所述第一信息与所述目标图标关联,电子设备即可响应于所述第三操作将所述第一信息传输到所述目标图标对应的应用服务中。具体的,所述第三操作可以是将所述第一信息拖拽靠近所述目标图标的操作,也可以是将所述第一信息拖拽至所述目标图标上并松手的操作,还可以是其他将所述第一信息与所述目标图标相关联操作,只要所述第三操作可以在所述至少一个应用服务图标中挑选出用户需要的所述目标图标,并将所述第一信息与所述目标图标相关联即可。
可理解的,本申请提供的信息传输过程从用户拖起所述第一信息到将所述第一信息放入所述目标图标对应的应用服务的整个过程都是连续的,这里所说的“连续”是指用户无 需进行复制、粘贴等操作、也无需进行应用切换操作,整个操作过程用户的手指可以无需离开电子设备的屏幕,操作简单快捷,可以有效提升用户对信息进行跨应用传输的效率,提升用户体验。
可选的,上述第二界面还可以显示有第三子界面。所述第三子界面中所显示的元素内容与所述第一界面中所显示的元素内容(除状态栏之外)一样。实际上,显示在所述第二界面中的所述第三子界面可以认为是电子设备将所述第一界面的全部元素内容(除状态栏之外)进行三维变换后所得到的界面。在所述第二界面中,所述子界面可以在屏幕中营造出原始界面(即所述第一界面)向内推开的视觉效果。可理解的,这种“开门”的视觉效果隐喻了传输元素(即所述第一信息)的行为,相比于复制粘贴更具直观性,且这种信息传输方式保证了用户界面的有效浏览区域,能在通过所述子界面观看到历史应用界面(即所述第一界面)的同时将所述第一信息传输至其他应用服务中,能进一步提升用户体验。可选的,在所述第二界面中,所述子界面后面的背景可以被设定为电子设备的桌面背景(即桌面壁纸)叠加模糊效果后的所得的画面,以为用户提供更好的视觉效果。
结合第一方面,在一个可能的实施方式中,所述第一子界面和所述第二子界面以上下分屏或左右分屏的方式显示;或者,所述第一子界面和所述第二子界面以画中画的形式显示。
在本实施方式中,当所述第一子界面和所述第二子界面以上下分屏或左右分屏的方式显示时,本申请对所述第一子界面和所述第二子界面在所述第一子界面中的相对位置不作限定。例如,所述第一子界面可以显示于所述第二子界面的上方,也可以显示于所述第二子界面的下方。
当所述第一子界面和所述第二子界面以画中画的形式显示时,所述第一子界面是全屏显示的界面,则所述第二子界面可以是以悬浮窗(小窗口)显示的界面;所述第一子界面也可以是以悬浮窗(小窗口)显示的界面,则所述第二子界面可以是全屏显示的界面,本申请对此不作限定。相应的,在所述第一子界面与所述第二子界面之间对应的两个应用之间进行信息传输时,用户可以将悬浮窗(小窗口)显示的界面中的信息元素拖拽至全屏显示的界面中,也可以将全屏显示的界面中的信息元素拖拽至悬浮窗(小窗口)显示的界面中。在利用本申请提供的“跨应用传输界面”将所述第一界面中的信息元素分享至其他未在所述第一界面中显示有应用界面的应用中时,用户也同样可以将悬浮窗(小窗口)显示的界面中的信息元素或全屏显示的界面中的信息元素拖拽至屏幕的侧边,以使电子设备显示“跨应用传输界面”,即所述第二界面。
结合第一方面,在一个可能的实施方式中,所述第二操作为将所述第一信息与所述目标图标关联的操作。
结合第一方面,在一个可能的实施方式中,所述第二操作为将所述第一信息移动至所述目标图标的操作。
具体的,在本实施方式中,将所述第一信息移动至所述目标图标可以是将所述第一信息移动到所述目标图标周围,使得所述目标图标为所述至少一个应用服务图标中距离所述第一信息最近的图标;或者,将所述第一信息移动至所述目标图标也可以是将所述第一信息移动至所述目标图标的上方,需理解,这里所说的“上方”是指所述第一信息与所述目 标图标重叠,并且所述第一信息覆盖显示在所述目标图标上。
可选的,所述第二操作还可以包括将所述第一信息在所述目标图标上(或者周围)停留一段时长(例如120ms),或者将所述第一信息拖拽至所述目标图标上(或者周围)后直接松手的操作,以此来触发将所述第一信息传输至所述目标图标对应的应用服务中。
结合第一方面,在一个可能的实施方式中,在移动所述第一信息至所述目标图标上的过程中,放大所述目标图标和/或移动所述目标图标在所述第一界面中的位置,移动所述目标图标的方向与移动所述第一信息的方向相向。
在本实施方式中,为了能引导用户将所述第一信息精准地放入到自己需要的应用服务中,在拖拽所述第一信息至所述目标图标上的过程中,当所述第一信息靠近所述目标图标时(这里假设在整个拖拽过程中所述目标图标一直是所述至少一个应用服务图标中距离所述第一信息最近的图标),所述目标图标可以被放大,并且所述目标图标在所述第二界面中可以被移动,以使所述目标图标更靠近所述第一信息,在所述第二界面中营造出所述目标图标被所述第一信息吸附(即所述第一信息的移动方向与所述目标图标的移动方向相向,二者均在向对方靠近)的视觉效果,以提示用户所述第一信息已经与所述目标图标关联,若在此处松手,所述第一信息将被传输至所述目标图标对应的应用服务中。
可选的,在所述第一信息与所述目标图标的距离小于第一阈值的情况下,电子设备才会在所述第二界面中放大所述目标图标和/或移动所述目标图标在所述第一界面中的位置。
结合第一方面,在一个可能的实施方式中,所述至少一个应用服务图标包括至少一个第一图标,所述至少一个第一图标为基于所述第一信息推荐的应用服务图标。
在本实施方式中,电子设备可以基于所述第一信息中包含的内容为用户个性推荐的图标。具体的,对于这部分电子设备为用户个性推荐的图标,电子设备可以先对拖起的所述第一信息进行识别(此时电子设备还未显示所述第二用户界面),基于识别结果获取在所述第二界面中提供贴合用户需求的应用服务图标,所述识别结果可以包括所述第一信息的类型和所述第一信息中包含的元素内容。例如,假设所述第一信息为包含二维码图像图片,则电子设备可以识别所述第一信息中的二维码图像,在所述第二界面中为用户显示可以对二维码进行扫描的应用服务图标,例如微信-扫一扫,支付宝-扫一扫等;假设所述第一信息为包含人脸图像的图片,则用户可以识别所述第一信息中的人脸图像,在所述第二界面中为用户显示可以对图像进行美化、或者可用于分享该图像的应用服务图标,例如美图-人像美化,微信-朋友圈等。再比如,假设所述第一信息为包含地点信息的文本,则电子设备可以识别文本中的地点信息,并在所述第二界面中为用户显示可以对该地点信息进行导航或者打车的应用服务图标,例如地图应用A-导航,地图应用A-一键打车等;假设上述第一信息为包含有时间、地点信息的文本时,电子设备为用户推荐日程相关的应用服务图标,例如日程-添加日程等。
也就是说,当用户先后拖起两个信息元素,即使这两个信息元素为相同类型的信息元素(例如均为文本或者均为图像),在两个信息元素所包含的内容不同的情况下(例如图像内容不同或者文本中文字不同),则在电子设备基于这两个元素所显示的所述至少一个应用服务图标也可以不同;需理解,这里所说的“不同”可以包括图标种类的不同以及图标顺序的不同。可选的,将其为用户推荐的应用服务的图标(即所述至少一个第一图标)显示 在图标区域中;所述至少一个第一图标中,越符合当前用户意图的应用服务所对应的图标将位于图标区域的越上方,当前用户意图可以根据拖起的信息所包含的元素内容进行确定,例如,当信息为图像且包含二维码图像时,微信-扫一扫,支付宝-扫一扫等应用服务对应的图标可以在所述至少一个应用服务图标中的置顶显示;当信息为文字且包含地点信息时,地图应用A-导航,地图应用A-一键打车等等应用服务对应的图标可以在所述至少一个应用服务图标中的置顶显示。
结合第一方面,在一个可能的实施方式中,在将所述第一信息传输到所述目标图标对应的应用服务中之后,所述方法还包括:显示第三界面,所述第三界面包括所述第一界面的全部内容,且所述第三界面还包括悬浮窗、信息反馈栏中的任意一种,所述悬浮窗用于显示所述目标图标或所述目标图标对应的应用服务界面,所述信息反馈栏用于提示所述电子设备对所述第一信息的传输结果。
在本实施方式中,在通过所述第二界面对信息进行跨应用传输之后,电子设备还可以根据信息所进入应用服务的种类以及信息传输的结果为用户提供不同的提示方式、显示不同的界面效果,以提示用户知晓所述第一信息的传输结果,并进行下一步操作。
结合第一方面,在一个可能的实施方式中,所述第三界面包括悬浮窗,所述悬浮窗用于显示所述目标图标,所述第三界面还包括第二信息,所述显示第三界面之后,所述方法还包括:响应于针对所述第二信息的第四操作,将所述第二信息传输到所述目标图标对应的应用服务中,所述第四操作为将所述第二信息与所述悬浮窗相关联的操作。
在本实施方式中,可理解的,除所述悬浮窗外,所述第三界面的内容与所述第一界面中的内容一样。所述悬浮窗为最小化悬浮窗,该悬浮窗中可以不显示应用界面,只显示所述目标图标,并且所述悬浮窗可以紧靠在所述第三界面的右侧边或左侧边显示,减小对所述第三界面的遮挡,以便于用户继续将所述第三界面中的信息(例如所述第二信息)传输至所述目标图标对应的应用服务中。
可选的,在本实施方式中,所述悬浮窗可以响应于用户的点击操作被展开,被展开后悬浮窗可以显示在所述第三界面中(此时悬浮窗可以不再贴边显示,但还是未全屏显示),并且其可以显示有展开控件,该展开控件可以响应于用户操作,将悬浮窗中的应用界面全屏显示在屏幕中。
结合第一方面,在一个可能的实施方式中,所述第三界面包括悬浮窗,所述悬浮窗用于显示所述目标图标对应的应用服务界面,所述悬浮窗包括展开控件,所述显示第三界面之后,所述方法还包括:响应于对所述展开控件的第五操作,将所述悬浮窗中显示的应用服务界面全屏显示。
当所述目标图标对应应用服务是导航、搜索此类需要即可显示新的应用服务界面的应用服务时,则电子设备就需要将所述目标图标对应的应用服务界面立即展示给用户。因此,在本实施方式中,所述悬浮窗为置顶显示在所述第三界面中的悬浮窗,所述第三界面可以依旧显示所述第一界面中的内容,而所述悬浮窗可以显示所述目标图标对应的应用服务界面。
结合第一方面,在一个可能的实施方式中,所述第三界面包括信息反馈栏,所述信息反馈栏包括跳转控件,所述显示第三界面之后,所述方法还包括:响应于对所述跳转控件 的第六操作,显示第四界面,所述第四界面为所述目标图标对应的应用服务界面。
当所述目标图标对应应用服务是类似全局收藏此类应用服务时,在这类应用服务接收到上述第一信息后,用户可能并不需要理解浏览该应用服务的界面,只需要知晓电子设备是否成功接收到所述第一信息,因此在本实施方式中,当所述第一信息传输至所述目标图标对应的应用服务中后,电子设备在无需直接跳转到其对应的应用界面,只需要将信息传输的结果告知用户即可,因此,所述第三界面中可以显示有所述信息反馈栏,以用于提示用户所述第一信息传输的结果。所述信息反馈栏为sanck bar,其可以包含有所述跳转控件,以便用户可以通过点击所述跳转控件快速进入所述目标图标对应的应用服务界面,查看所述目标图标对应的应用服务对所述第一信息的处理结果。
结合第一方面,在一个可能的实施方式中,所述第一界面还包括第一触发区域和第二触发区域,所述第一触发区域大于所述第二触发区域,所述第二操作包括第一子操作和第二子操作,所述第一子操作为将所述第一信息移动至所述第一触发区域中的操作,所述第二子操作为将所述第一信息移动至所述第二触发区域的操作,所述响应于针对第一界面中第一信息的第二操作,显示第二界面,包括:响应于所述第一子操作,在所述第一信息在所述第一触发区域中停留时间达到第一时长的情况下,在所述第一界面中显示光带指引特效,所述光带指引特效用于指示将所述第一信息移动至所述第二触发区域;响应于所述第二子操作,显示所述第二界面。
由于所述第一界面中将信息在不同的子界面中拖拽也能完成信息跨应用传输,且在日常使用电子设备的过程中,用户也经常会对一些元素进行拖拽操作,这些拖拽操作可能并不是为了将拖拽的元素进行跨应用传输(例如文档编辑中拖拽文字改变文字的位置或段落),因此,如何为结合用户操作为,并结合用户的操作习惯引导用户使用本申请提供的传输方法,并为用户设定本方法中“跨应用传输界面”的触发规则,是进一步提升用户与电子设备交互效率的关键。
因此,在本实施方式中,所述第一界面可以包括所述第一触发区域以及所述第二触发区域,可选的,所述第一触发区域和所述第二触发区域的具体大小位置可以不显示在用户界面中,即用户在所述第一界面中并不能直接观察到这两个区域的具体轮廓,这两个区域的大小、位置可以仅以电子设备可感知(例如程序代码)的形式存储在电子设备中。在用户将所述第一信息拖拽至所述第一触发区域中时,电子设备可以在所述第一界面中(例如第一界面的边缘)显示出特效,以提示用户将图像进一步将图像往更靠近所述第二触发区域的方向拖动;所述特效可以是有发光特效、阴影特效等用户可视的特效,也可以是其他用户可感知的特效,本申请对此不作限定;可选的,电子设备也可以在用户将所述第一信息拖拽至所述第一触发区域中、并将所述第一信息所述第一触发区域中持续停留时长T之后,才在所述第一界面中显示出特效,具体的,所述T可以被设定为600毫秒。
当用户将所述第一信息继续拖动到所述第二触发区域中时,电子设备可以即刻响应于该操作,显示所述第二界面。
在一个可选的实施方式中,在所述第二界面中还包括第关门触发区域。当用户将拖起的所述第一信息拖拽至所述关门触发区域中时,电子设备可以不再显示所述第二界面,而重新显示所述第一界面,且在用户不松手的情况下,在重新显示所述第一界面时,在所述 第一界面中所述第一信息依旧处于被用户拖起的状态,以便于用户重新选择将信息进行跨应用传输的方式。
结合第一方面,在一个可能的实施方式中,在所述第一子界面和所述第二子界面以上下分屏或左右分屏的方式显示的情况下,所述第一触发区域同时存在与所述第一界面和所述第二子界面中,且所述第二触发区域同时存在与所述第一界面和所述第二子界面中。
在本实施方式中,无论用户拖拽的元素属于哪个子界面,在所述第一触发区域同时存在与所述第一界面和所述第二子界面中,且所述第二触发区域同时存在与所述第一界面和所述第二子界面中的情况下,电子设备均能及时响应用户操作为引导开启“跨应用传输界面”。
结合第一方面,在一个可能的实施方式中,所述第二界面还包括图标区域,所述至少一个应用服务图标显示在所述图标区域中,所述至少一个应用服务图标还包括至少一个第二图标,所述至少一个第二图标为自定义显示的应用服务图标,所述至少一个第一图标显示在所述至少一个第二图标的上方。
在本实施方式中,所述至少一个应用服务图标显示在所述图标区域中,且所述第二界面中的至少一个应用服务图标可以分为两部分,其中一部分为右为固定显示的图标(即所述至少一个第二图标),另一部分图标可以是用户基于所述第一信息为用户推荐的应用服务图标。可选的,这两部分图标之间可以显示有用于区分的分隔线。其中,所述至少一个第二图标是用户根据自己的使用习惯、使用频率自定义显示的图标,无论用户基于电子设备分享何种信息,电子设备为基于该信息显示的图标中可以均包含这部分图标,以最大可能贴合用户的需求;而所述至少一个第一图标是电子设备根据所述第一信息所包含的元素推荐的,在用户通过本方法分享其他信息时,其推荐的应用服务图标可以与所述至少一个第一图标中的图标不同。
结合第一方面,在一个可能的实施方式中,所述至少一个应用服务图标包括至少一个显示在所述图标区域中的图标以及至少一个未显示在所述图标区域中的图标,所述目标图标未显示在所述图标区域中,所述第二界面中还包括第三触发区域,在响应于针对所述第一信息的第二操作之前,所述方法还包括:响应于对所述第一信息的第七操作,将所述至少一个显示在所述图标区域中的图标进行更新,直至所述目标图标显示在所述图标区域中,所述第七操作为将所述第一信息移动至所述第三触发区域中的操作。
电子设备可以为基于所述第一信息为用户推荐能够接收所述第一信息的多个应用服务,并在所述第二界面中的右侧展示这些应用服务的图标,具体的,这些应用服务图标的数量上限可以为20个。在本实施方式中,当这些应用服务图标的数量超过一定阈值(例如7个)时,为了保证界面的整洁和可观性,电子设备在显示时,可以只将这些应用服务图标的一部分(例如7个)同时展示在所述第二界面中;当所述第二界面当前展示的图标均不是用户期望的应用服务时,用户还可以将所述第一信息放置在所述第三触发区域中,以使电子设备更新所述图标区域中的图标。具体的,所述第三触发区域可以设定在所述图标区域的正上方和/或正下方。
结合第一方面,在一个可能的实施方式中,所述第二界面中所述第一信息的面积小于所述第一界面中所述第一信息的面积。
可理解的,在本申请提供的方法中,所述第二界面中所述第一信息与所述第一界面中所述第一信息所包含的内容是一样的。但是,为了减小所述第一信息在所述第二界面中对所述至少一个应用服务图标造成大面积的遮挡,在本实施方式中,在进入所述第二界面之后,所述第一信息的面积可以被缩小,以方便用户对应用服务图标进行选择。
结合第一方面,在一个可能的实施方式中,所述第一信息为图像、文本、音频文件、视频文件、文档文件中的任意一种。
第二方面,本申请提供了一种信息传输的方法,包括:响应于对第五界面的全局截屏操作、局部截屏操作、长截屏操作中的任意一种操作,显示第六界面,所述第六界面中包括对所述第五界面进行截屏所得的第一图像;响应于针对所述六界面中所述第一图像的第八操作,显示第七界面;所述第七界面包括所述第一图像和至少一个应用服务图标;响应于针对所述第七界面中所述第一图像的第九操作,将所述第一图像传输到目标图标对应的应用服务中,所述目标图标为所述至少一个应用服务图标中的任意一个应用服务图标。
目前大部分的智能设备都为用户提供了快捷的截图功能,例如在一些场景中,用户可以通过双击屏幕或三指下滑来对电子设备当前的界面进行全屏截图;在一些实施例中,电子设备还可以将用户通过全屏截图操作截取的图像以缩略图的形式短暂的显示在界面中。因此,在本实施方式中,当用户通过全屏截图操作所截取的图像之后,该图像以缩略图的形式显示在所述第一界面中,用户可以通过快捷的截图功能以及本申请提供的传输方法更快速的将截取的图像传输至所述目标图标对应的应用服务中。
结合第二方面,在一种可能的实施方式中,所述第一图像为对所述第五界面进行全局截屏操作所得图像,所述响应于针对所述六界面中所述第一图像的第八操作,显示第七界面包括:响应于对所述第六界面中第一图像点击操作,显示编辑界面,所述编辑界面包括所述第一图像以及编辑选项,所述编辑选项用于对所述第一图像进行编辑;响应于通过所述编辑选项对所述第一图像的编辑操作,对所述编辑界面中的所述第一图像的图像内容进行更新之后,响应于针对所述编辑界面中所述第一图像的移动操作,显示所述第七界面,所述第八操作包括所述点击操作、所述编辑操作和所述移动操作。
可以理解的,在使用快捷截图功能截取到图像之后,用户可能还需要对所得的图像进行编辑,例如对所截图像进行进一步的截取改变其图像面积,或者通过画笔将图像中重要的内容标注出来之后,再将编辑好的图像分享或者上传至其他应用。因此,在本实施方式中,电子设备将用户通过全屏截图操作截取的图像以缩略图的形式(即所述第一图像)短暂的显示在所述第六界面中之后,用户可以通过所述点击操作进入图像编辑界面;在所述编辑界面中,用户可以对所述第一图像进行编辑相应的,所述编辑操作完成之后,电子设备所显示的依旧为编辑界面,用户可以直接在该编辑界面中通过所述移动操作使电子设备显示所述第二界面,并通过所述第九操作将所述编辑后的图像(即所述第一信息)传输至所述目标图标对应的应用服务中。
第三方面,本申请提供了一种信息传输的方法,包括:响应于对第八界面的局部截屏操作,显示第九界面,所述第九界面中包括对所述第八界面进行局部截屏操作所得的第二图像以及文本识别控件,所述文本识别控件用于识别所述第二图像中所包含的文本;响应于对所述文本识别控件的点击操作,显示第十界面,所述第十界面包含对所述第二图像进 行识别得到的第一文本信息;响应于针对所述十界面中所述第一文本信息的第十操作,显示第十一界面;所述第十一界面包括所述第一文本信息和至少一个应用服务图标;响应于针对所述第十一界面中所述第一文本信息的第十一操作,将所述第一文本信息传输到目标图标对应的应用服务中,所述目标图标为所述至少一个应用服务图标中的任意一个应用服务图标。
在用户截屏之后,一些智能设备还在该场景下为用户提供了识别功能,用于对用户所截图像进行识别(例如提取图片中的文字或者翻译文字等)。因此,针对电子设备提供的截屏功能,在本方法中,电子设备可以通过所述局部截图操作快速获取用户利用指关节框选出的图像,并显示所述第九界面,在所述第九界面中,用户可以通过对所述文本识别控件的点击操作,对局部截屏框所框选中的图像所包含的文本信息进行识别;之后,用户可以对识别所得的第一文本信息执行所述第十操作使电子设备显示本申请提供的“跨应用传输界面”,即所述第十界面,并通过所述第十一操作将所述文本信息(即所述第一信息)传输至所述目标图标对应的应用服务中。
可选的,在使用所述文本识别控件对所述文本信息进行识别之后,局部截屏框所框选中的图像所包含的文本信息可以被首光标和尾光标框选中,用户还可以调整所述首光标和尾光标的位置对所述文本信息进行进一步的筛选,得到自己需要传输的所述第一文本信息。
第四方面,本申请提供了一种电子设备,所述电子设备包括:一个或多个处理器和存储器;所述存储器与所述一个或多个处理器耦合,所述存储器用于存储计算机程序代码,所述计算机程序代码包括计算机指令,所述一个或多个处理器调用所述计算机指令以使得所述电子设备执行如第一方面或第一方面任一可能的实现方式中的方法、第二方面或第二方面任一可能的实现方式中的方法以及第三方面中的方法。
第五方面,本申请提供了提供一种芯片系统,所述芯片系统应用于电子设备,所述芯片系统包括一个或多个处理器,所述处理器用于调用计算机指令以使得所述电子设备执行如第一方面或第一方面任一可能的实施方式中的方法,第二方面或第二方面任一可能的实现方式中的方法以及第三方面中的方法。
第六方面,本申请提供了提供一种计算机可读存储介质,包括指令,当上述指令在电子设备上运行时,使得上述电子设备执行如第一方面或第一方面任一可能的实施方式中的方法、第二方面或第二方面任一可能的实现方式中的方法以及第三方面中的方法。
第七方面,本申请提供了一种包含指令的计算机程序产品,当上述计算机程序产品在电子设备上运行时,使得上述电子设备执行如第一方面或第一方面任一可能的实施方式中的方法、第二方面或第二方面任一可能的实现方式中的方法以及第三方面中的方法。
第八方面,提供一种数据分享方法,该方法可包括:显示第一界面,第一界面包括第一元素;检测到对第一元素的拖动操作;
当拖动操作为第一拖动操作,第一拖动操作的触控起始点在第一元素上并且位于显示屏的第一区域,触控终点位于显示屏的第二区域,显示第一菜单栏,第一菜单栏包含第一应用的图标和第二应用的图标,第一区域和第二区域不重叠;检测到继续将第一元素拖入第一应用的图标所在的区域并释放的操作后,将第一元素对应的第一数据分享到第一应用;
当拖动操作为第二拖动操作,第二拖动操作的触控起始点在第一元素上并且位于第二 区域,触控终点位于显示屏的第二区域,第二拖动操作的轨迹位于第二区域,不显示第一菜单栏;
当拖动操作为第三拖动操作,第三拖动操作的触控起始点在第一元素上并且位于第二区域,触控终点位于第二区域,第三拖动操作的轨迹经过第一区域,显示第一菜单栏。
实施第八方面的方法,电子设备在检测到将第一元素由第一区域拖动至第二区域的操作,或者,检测到将第一元素由第二区域拖动至第一区域然后再拖动至第二区域的操作后,将显示第一菜单栏,而电子设备在检测到将第一元素在第二区域内拖动的操作后不显示第一菜单栏,这样可以为用户提供方便简单、快速流畅且直观的数据分享方案,方便用户在有需求时分享数据,并且能够避免触控点首次位于第二区域时显示第一菜单栏,以实现防误触效果。
结合第八方面,在一些实施方式中,当拖动操作为第一拖动操作,响应于第一拖动操作,显示第一菜单栏;当拖动操作为第二拖动操作,不响应于第二拖动操作而显示第一菜单栏;当拖动操作为第三拖动操作,响应于第三拖动操作,显示第一菜单栏。
结合第八方面,在一些实施方式中,当拖动操作为第一拖动操作,第一拖动操作的触控终点在第二区域停留第一时长后显示第一菜单栏;当拖动操作为第二拖动操作,第二拖动操作的触控终点在第二区域停留第一时长后,不显示第一菜单栏;当拖动操作为第三拖动操作,第三拖动操作的触控终点在第二区域停留第一时长后显示第一菜单栏。触控终点在第二区域停留第一时长,可以认为用户有分享数据的需求,因而电子设备再显示第一菜单栏,可以更加精准地为用户提供数据分享服务,避免误触发第一菜单栏。
结合第八方面,在一些实施方式中,第一拖动操作,和,继续将第一元素拖入第一应用的图标所在的区域并释放的操作,是连续且不中断的。
结合第八方面,在一些实施方式中,显示第一界面之前,该方法还可包括:显示第二界面,第二界面包括文本;检测到选中文本中的第一文本的操作,在第一文本上显示工具栏,工具栏包括多个用于对第一文本做处理的控件;显示第一界面,包括:检测到作用于第一文本的长按操作,停止显示工具栏,显示第一界面;其中,第一元素包括第一文本的预览图,第一数据包括第一文本。相当于,电子设备可以方便地分享用户选中的文本。
结合第八方面,在一些实施方式中,显示第一界面之前,该方法还可包括:在显示第二界面时,检测到截屏操作;显示第一界面,包括:响应于截屏操作,显示第一界面,第一元素包括第二界面的截屏图像的预览图,第一数据包括截屏图像。相当于,电子设备可以方便地分享截图。
结合第八方面,在一些实施方式中,显示第一界面之前,该方法还可包括:显示第二界面,第二界面包括第一图像的图标和第二图像的图标;检测到选中第一图像的图标的操作;显示第一界面,包括:检测到作用于第一图像的图标的长按操作,显示第一界面;其中,第一元素包括第一图像的图标的预览图,第一数据包括第一图像。相当于,电子设备可以方便地分享图像,图像可包括图片、动图、视频等类型。
结合第八方面,在一些实施方式中,第一菜单栏,和,第一拖动操作或第三拖动操作的触控终点所在的第二区域,在显示屏中的同侧。即,用户往哪个方向拖动第一元素,电子设备就在哪个方向显示第一菜单栏,可以给用户较好的使用体验。
结合第八方面,在一些实施方式中,当拖动操作为第一拖动操作,或者,当拖动操作为第三拖动操作,在显示第一菜单栏时,还将第一界面调整为第一侧的透视样式,第一侧为第一菜单栏在显示屏中的一侧。这样,第一侧的透视样式的第一界面和第一菜单栏可以形象地构成“开门”效果。
结合第八方面,在一些实施方式中,第一界面还包括播放中的视频,该方法还可包括:当拖动操作为第一拖动操作,或者,当拖动操作为第三拖动操作,在显示第一菜单栏时,显示第一界面的截屏图像,并且第一界面的截屏图像显示为第一侧的透视样式,第一侧为第一菜单栏在显示屏中的一侧。
结合第八方面,在一些实施方式中,第二区域包括:显示屏中左侧边缘的矩形区域,和,显示屏中右侧边缘的矩形区域,矩形区域的高度和显示屏的高度相同。
结合第八方面,在一些实施方式中,当拖动操作为第一拖动操作,第一拖动操作的轨迹经过第三区域,第三区域包含第二区域;该方法还可包括:响应于第一拖动操作中将第一元素拖动至第三区域的操作,显示光带,光带和第一菜单栏位于显示屏中的同侧;显示第一菜单栏,包括:响应于第一拖动操作中将第一元素拖动至第三区域后再拖动至第二区域的操作,停止显示光带,显示第一菜单栏。电子设备显示光带,可以提示用户继续往同方向拖拽就可以触发显示第一菜单栏,进而分享数据。
在一些实施方式中,第三区域包括:显示屏中左侧边缘的矩形区域,和,显示屏中右侧边缘的矩形区域,第三区域的高度和显示屏的高度相同。
结合第八方面,在一些实施方式中,第一菜单栏还包含第三应用的图标和第四应用的图标,第一应用的图标、第二应用的图标、第三应用的图标、第四应用的图标由上至下依次排列;显示第一菜单栏之后,该方法还可包括:检测到将第一元素继续在第四区域内拖动的第四拖动操作,第四区域包含第一拖动操作或第三拖动操作的触控终点所在的第二区域,第四拖动操作的触控起始点,和,第一拖动操作或第三拖动操作的触控终点相同,第四拖动操作的触控终点距离第一菜单栏中的第二应用的图标最近;响应于第四拖动操作,将第四应用的图标显示为基础尺寸,将第二应用的图标显示为在基础尺寸上放大第一比例后的尺寸,将第一应用的图标和第三应用的图标显示为在基础尺寸上放大第二比例后的尺寸;第一比例大于第二比例。
通过上一实施方式,用户和显示屏的触控点距离第一菜单栏中应用的图标越近,对应的应用的图标可以越大。这样可以呈现出第一菜单栏的应用的图标被用户手指吸附的效果,并且可以通过放大应用图标的尺寸让用户关注到对应应用的图标。
结合上一实施方式,第四区域包括:包含第一拖动操作或第三拖动操作的触控终点所在的第二区域的矩形区域,第四区域的高度和显示屏的高度相同。
结合第八方面,在一些实施方式中,检测到将第一元素继续在第四区域内拖动的第四拖动操作之后,该方法还可包括:检测到继续将第一元素拖动至第五区域的第五拖动操作,第五区域和第四区域不重叠;响应于第五拖动操作,将第一菜单栏中的各个图标显示为基础尺寸。
结合第八方面,在一些实施方式中,当拖动操作为第一拖动操作,或者,当拖动操作为第三拖动操作,在显示第一菜单栏之后,该方法还可包括:检测到继续将第一元素拖动 至第六区域的第六拖动操作,第六区域和第二区域不重叠,且第六区域位于第一菜单栏在显示屏中的相对侧;响应于第六拖动操作,停止显示第一菜单栏。
通过上一实施方式,电子设备提供了用于停止显示第一菜单栏的第六区域,在用户误触发电子设备显示第一菜单栏后,可以方便用户简单、方便且快捷地停止该误操作。
在一些实施方式中,第六拖动操作的触控起始点,和,第一拖动操作或第三拖动操作的触控终点相同,即第六拖动操作和第一拖动操作或第三拖动操作是连续且不中断的。这样用户手指无需离开电子设备的显示屏,保持持续接触显示屏,就可以方便快捷地避免误操作。
在一些实施方式中,第六区域和第五区域不重叠。
结合第八方面,在一些实施方式中,该方法还可包括:显示第三界面,第三界面包括第二元素;检测到对第二元素的拖动操作;当拖动操作为第七拖动操作,第七拖动操作的触控起始点在第二元素上并且位于显示屏的第七区域,触控终点位于显示屏的第八区域,显示第二菜单栏,第七区域和第八区域不重叠;当拖动操作为第八拖动操作,第八拖动操作的触控起始点在第二元素上并且位于第八区域,触控终点位于显示屏的第八区域,第八拖动操作的轨迹经过第七区域,显示第二菜单栏;当拖动操作并非第七拖动操作或第八拖动操作,不显示第二菜单栏;其中,第八区域为第二区域的部分区域。
通过上一实施方式,相当于将用于触发显示菜单栏的区域由第二区域缩小至第八区域,通过缩小该区域,可以避免用户误触发菜单栏的概率。
在一些实施方式中,第八区域包括:显示屏中左侧边缘的矩形区域,和,显示屏中右侧边缘的矩形区域;第八区域的高度和第二区域的高度相同,第八区域的宽度为第二区域宽度的一半。
在一些实施方式中,第三界面由第五应用提供,第五应用包括文字编辑类应用。
在一些实施方式中,第二菜单栏包含的应用的图标,和,第一菜单栏包含的应用的图标,可以不同。其中,第一菜单栏包含的图标可包括支持接收第一数据的应用的图标,第二菜单栏包含的图标可包括支持接收第二元素对应的第二数据的应用的图标。
结合第八方面,在一些实施方式中,显示屏处于横屏状态时的第二区域,和,显示屏处于竖屏状态时的第二区域,不同。
结合第八方面,在一些实施方式中,第一界面由第六应用提供,第六应用不同于第一应用。相当于,该方法可以实现跨应用的数据传输。
第九方面,提供一种电子设备,包括:存储器、处理器及存储在存储器上的计算机程序,处理器执行计算机程序以实现如第八方面或第八方面的任一种实施方式提供的方法。
第十方面,提供一种计算机可读存储介质,其上存储有计算机程序,计算机程序被处理器执行时实现如第八方面或第八方面的任一种实施方式提供的方法。
第十一方面,提供一种计算机程序产品,该计算机程序产品包括计算机程序,计算机程序被处理器执行时实现如第八方面或第八方面的任一种实施方式提供的方法。
第十二方面,提供一种推荐服务的方法,应用于电子设备,该方法可包括:获取第一内容;将第一内容转换为第一实体,第一实体包括实体类别和实体值;根据第一实体识别到对应的第一意图;确定支持第一意图的服务;在显示屏中显示服务的图标。
实施第十二方面的方法,在用户向电子设备输入内容后,电子设备可以结合用户的个人意图为用户推荐其想要的服务,方便用户使用这些服务。
结合第十二方面,在一些实施方式中,电子设备可以根据实体类别和/或模态与意图类别之间的映射关系,确定第一实体的实体类别和/或第一内容所属模态对应的第一意图类别;根据第一意图类别和实体值,确定第一意图。这样,电子设备可以根据实体类别和/或模态,来确定用户的意图类别。
结合第十二方面,在一些实施方式中,电子设备可以根据全局意图体系来确定意图。具体的,电子设备可以在全局意图体系中,找到标签为第一实体的实体类别的第一意图类别;将第一实体的实体值填充进第一意图类别所指示的槽位中,得到第一意图;其中,全局意图体系包括多类意图的信息,每一类意图的信息包括对应类别的以下几项:标签,槽位名。
在一些实施方式中,每一类意图的信息还包括对应类别的以下一项或多项:标识、等级、槽位中填充的值的类别、槽位的必要性。
在一些实施方式中,全局意图体系预存在电子设备中,或者,由电子设备从网络中下载。
在一些实施方式中,电子设备还可以根据全局服务体系来查找服务。具体的,电子设备可以在全局服务体系中,找到支持的意图类别的标识为第一标识的服务,第一标识为第一意图所属的类别的标识;将全局服务体系中支持的意图类别的标识为第一标识的服务,确定为支持第一意图的服务;其中,全局服务体系包括多个服务的信息,每一个服务的信息包括:对应服务支持的意图类别的标识。
在一些实施方式中,每一个服务的信息还包括对应服务的以下一项或多项:ID、名称、图标、类型、槽位名、所属应用的包名、组件的名称、URL、用于传递数据的参数名称。
在一些实施方式中,全局服务体系预存在电子设备中,或者,由电子设备从网络中下载。
在一些实施方式中,每一个服务的信息还包括:槽位名、用于传递数据的参数名称,第十二方面的方法还可包括:接收到作用于服务的图标中第一服务的图标的用户操作;将第一意图中第一槽位的值,传递给第一服务的第一参数,第一槽位为第一服务的信息的槽位名所指示的槽位,第一参数为第一服务的信息的参数名称所指示的参数;基于第一参数来启动第一服务。
结合第十二方面,在一些实施方式中,电子设备可以通过第一业务的入口获取第一内容;在获取第一内容之前,该方法还可包括:订阅第一业务支持的意图类别,第一意图属于第一业务支持的意图类别。
结合第十二方面,在一些实施方式中,电子设备可以通过第一业务的入口获取第一内容;在获取第一内容之前,该方法还可包括:订阅第一业务支持的服务,第一服务属于第一业务支持的服务。
结合第十二方面,在一些实施方式中,在确定支持第一意图的服务之后,在显示屏中显示服务的图标之前,该方法还可包括:对支持第一意图的多个服务排序,显示屏中显示的服务的图标按照对多个服务的排序依次排列。
在一些实施方式中,对多个服务排序的规则可以有多种,例如可以是最近使用优先、使用频率高的优先、对应意图的意图类别的置信度高(即等级高)的优先、用户的应用偏好顺序等。
在一些实施方式中,对支持第一意图的多个服务排序之前,该方法还可包括:对第一实体对应的多个第一意图排序,多个服务的排序依据多个第一意图的排序得到。
在一些实施方式中,电子设备对第一实体对应的多个第一意图排序的方式可包括:使用点击率预估模型来对第一实体对应的多个第一意图排序;其中,点击率预估模型基于多组第一历史行为数据训练得到,一组第一历史行为数据包括:时间特征、内容特征、点击率特征;时间特征指示了以下一项或多项:电子设备历史获取内容的时间是否为工作日、是否为节假日、时段;内容特征指示了以下一项或多项:电子设备获取的内容的来源应用、内容的长度、内容对应的实体的实体类别、内容的模态;点击率特征指示了:电子设备获取内容并推荐服务后,用户对推荐的服务的点击率。
结合第十二方面,在一些实施方式中,电子设备还可以学习未定义的实体类别和/或模态和意图类别间的映射关系。具体的,电子设备可以获取多组第二历史行为数据;根据多组第二历史行为数据,确定第一实体类别和/或第一模态,与第二意图类别之间具有映射关系;其中,一组第二历史行为数据包括:电子设备根据用户输入的对应第一实体类别和/或第一模态的内容后,在显示屏上显示推荐的服务的图标后,未接收到作用于服务的图标的用户操作,在停止显示服务的图标之后的第一时长内,电子设备在用户的触发下启动服务的行为数据;在多组第二历史行为数据中,启动频率最高的K个服务支持第二意图类别。
这样,针对实体类别和/或模态到意图类别的映射关系不全的情况,提供了一种映射关系的挖掘方法,电子设备可以从推荐后未点击的后续行为中挖掘出映射关系,从而对映射关系进行补充召回,更好地为用户推荐服务。
结合第十二方面,在一些实施方式中,电子设备还可以学习未定义的意图类别。具体的,电子设备可以获取多组第二历史行为数据;根据多组第二历史行为数据,确定第三意图类别;其中,一组第二历史行为数据包括:电子设备根据用户输入的对应第一实体类别和/或第一模态的内容后,在显示屏上显示推荐的服务的图标后,未接收到作用于服务的图标的用户操作,在停止显示服务的图标之后的第一时长内,电子设备在用户的触发下启动服务的行为数据;第三意图类别根据多组第二历史行为数据中启动频率最高的N个服务定义。
这样,针对用户的实际意图超出决策云平台已定义意图类别的范围的情况,提供了一种新意图类别的挖掘方法,电子设备可以从推荐后未点击的后续行为中挖掘出潜在的未定义的新意图类别,并且定义该新的意图类别与实体类别和/或模态之间的映射关系,从而对意图类别和映射关系进行补充召回,更好地为用户推荐服务。
在一些实施方式中,该方法还可包括:确定第一实体类别和/或第一模态,与第三意图类别之间具有映射关系。
在一些实施方式中,获取第一内容之后,电子设备还可以预加载后续所需的资源。例如,电子设备可以加载实体类别和/或模态与意图类别之间的映射关系,或者,加载全局意图体系,或者,加载全局服务体系。这样,电子设备能够提前将所需的资源加载好,加快 后续步骤的处理。
结合第十二方面,在一些实施方式中,电子设备可以对多模态内容并行提取特征。具体的,电子设备可以并行启动第一线程和第二线程,第一线程用于提取第一模态的内容的特征,第二线程用于提取第二模态的内容的特征;根据第一模态的内容的特征、第二模态的内容的特征,得到第一实体。通过多路并发提取特征,能够有效的减少单一模态信息提取异常带来的整体业务阻塞问题,提高了业务的稳定性。
在一些实施方式中,第一线程包含一个或多个线程,第二线程包含一个或多个线程,一个线程用于调用一种实体识别能力来识别实体。
第十三方面,提供一种电子设备,包括:存储器、处理器及存储在存储器上的计算机程序,处理器执行计算机程序以实现如第十二方面或第十二方面的任一种实施方式提供的方法。
第十四方面,提供一种计算机可读存储介质,其上存储有计算机程序,计算机程序被处理器执行时实现如第十二方面或第十二方面的任一种实施方式提供的方法。
第十五方面,提供一种计算机程序产品,该计算机程序产品包括计算机程序,计算机程序被处理器执行时实现如第十二方面或第十二方面的任一种实施方式提供的方法。
附图说明
图1为本申请实施例提供的一种对信息进行跨应用传输的过程示意图;
图2为本申请实施例提供的一种对信息进行跨应用传输的过程示意图;
图3A为本申请实施例提供的一种对图像进行跨应用传输的过程示意图;
图3B为本申请实施例提供的用于推荐服务的框架的结构;
图3C为本申请实施例提供的用于推荐服务的框架的另一种结构;
图3D为本申请实施例提供的电子设备在推荐服务的过程进行意图自学习的方法的流程;
图4为本申请实施例提供的一种对文字进行跨应用传输的过程示意图;
图5为本申请实施例提供的一种横屏状态下对信息进行跨应用传输的过程示意图;
图6为本申请实施例提供的一种对全局截屏图像进行跨应用传输的过程示意图;
图7为本申请实施例提供的一种对局部截屏图像进行跨应用传输的过程示意图;
图8为本申请实施例提供的一种对局部截屏图像中的文字进行跨应用传输的过程示意图;
图9为本申请实施例提供的一种触发“跨应用传输界面”操作过程的示意图;
图10为本申请实施例提供的一种关闭“跨应用传输界面”操作过程的示意图;
图11为本申请实施例提供的一种关闭“跨应用传输界面”操作过程的示意图;
图12为本申请实施例提供的一些通过分屏功能进行跨应用传输的界面图;
图13为本申请实施例提供的一些分屏状态下经“跨应用传输界面”进行跨应用传输的界面图;
图14为本申请实施例提供的一些画中画状功能进行跨应用传输的界面图;
图15为本申请实施例提供的一些画中画状态下经“跨应用传输界面”进行跨应用传输的界面图;
图16为本申请实施例提供的一些信息跨应用传输后界面以snack bar进行反馈的界面图;
图17为本申请实施例提供的一些信息跨应用传输后以胶囊进行反馈的界面示意图;
图18为本申请实施例提供的一种通过胶囊进行二次传输后并展开胶囊的过程示意图;
图19为本申请实施例提供的一些信息跨应用传输后以悬浮窗进行反馈的界面示意图;
图20为本申请实施例提供的一些信息跨设备传输后以snackbar进行反馈的界面示意图;
图21为本申请实施例提供的一些信息跨设备传输失败后以toast进行反馈的界面示意图;
图22A-图22N为本申请实施例提供的一组在电子设备上实现数据分享的用户界面;
图23为本申请实施例提供的手机在竖屏状态下的各类热区的示意图;
图24为本申请实施例提供的手机在横屏状态下的热区示意图;
图25A-图25F为本申请实施例提供的一组分享截图的用户界面;
图25G为本申请实施例提供的一种防误触的用户界面;
图25H-图25L为本申请实施例提供的另一种防误触的用户界面;
图25M-图25R为本申请实施例提供的又一种防误触的用户界面;
图26A-图26B为本申请实施例提供的用于移动悬浮窗口的一组用户界面;
图26C-图26L为本申请实施例提供的悬浮窗口场景下防误触的用户界面;
图27为本申请实施例提供的一种更新图标区域中图标的过程示意图;
图28为本申请实施例提供的一些基于地点信息为用户显示应用服务图标的界面图;
图29为本申请实施例提供的一些基于地点、时间信息为用户显示应用服务图标的界面图;
图30为本申请实施例提供的一些基于二维码图像为用户显示应用服务图标的界面图;
图31为本申请实施例提供的一些基于人脸图像为用户显示应用服务图标的界面图;
图32为本申请实施例提供的一些通过“跨应用传输界面”中聊天界面缩略图传输信息的界面图;
图33为本申请实施例提供的一些通过侧边栏图标对信息进行跨应用传输的界面图;
图34为本申请实施例提供的一些自定义侧边栏图标的界面图;
图35为本申请实施例提供的一种对录屏文件进行跨应用传输的过程示意图;
图36为本申请实施例提供的一种对编辑后的截屏图像进行跨应用传输的过程示意图;
图37为本申请实施例提供的一种对长截屏图像进行跨应用传输的过程示意图;
图38为本申请实施例提供的一些“智慧流转”功能相关的系统设置界面图;
图39为本申请实施例提供的一些“智慧流转”功能相关的系统设置界面图;
图40为本申请实施例提供的一种电子设备的架构图;
图41为本申请实施例提供的一种信息传输方法的流程图。
具体实施方式
本申请以下实施例中所使用的术语只是为了描述特定实施例的目的,而并非旨在作为对本申请的限制。如在本申请的说明书和所附权利要求书中所使用的那样,单数表达形式 “一个”、“一种”、“所述”、“上述”、“该”和“这一”旨在也包括复数表达形式,除非其上下文中明确地有相反指示。还应当理解,本申请中使用的术语“和/或”是指并包含一个或多个所列出项目的任何或所有可能组合。
为了便于理解,下面先对本申请实施例涉及的相关术语进行介绍。
(1)信息的跨应用传输和跨设备传输
信息的跨应用传输是指同一个设备中的两个应用之间的信息传输,也就是通过一个应用来获取目标信息,并通过另一个应用对该目标信息进行分享、收藏或编辑的操作。例如将浏览器中网页上的文字或者图像转发给微信好友,或者将微信好友发送的图片发送给QQ好友等。
信息的跨设备传输是两个设备之间基于Wi-Fi、蓝牙、蜂窝网络等进行通信连接后进行信息传输建立通信连接后进行信息传输。例如用户利用蓝牙在两个设备之间传输图片、或者将手机上的图片分享至同一网络环境中的个人电脑上等。
具体的,上述信息可以是图片、文本、视频、语音、链接、文档等。
(2)跨应用传输界面
在本申请中,“跨应用传输界面”(或者称跨应用传输界面)是电子设备基于用户对信息跨应用传输和跨设备传输需求所提供的一种交互方式,在本申请的一些实施例中,该功能还可以被称为“智慧流转”。正如它的名称那样,在电子设备所显示的任意界面下,当用户需要将界面中信息进行跨应用传输或跨设备传输时候,用户只需长按界面中的信息元素并将其拖拽到屏幕边缘,电子设备就会将屏幕中原始显示的界面进行三维变换,在屏幕中营造出原始界面向内推开的视觉效果,并在屏幕侧边显示电子设备的为该元素推荐的图标(具体可以参考后续实施例的相关说明,此处先不赘述),推荐的图标可以是应用的服务图标;之后,用户将拖起的信息元素放置在图标上松手,即可将该信息元素传输到图标对应的应用服务中并启动相应的应用服务功能。具体的,在本申请中,电子设备中安装的某个应用APP可以有多个应用服务,在本申请提供的跨应用传输界面中,其所展示的应用的服务图标可以包含同一个应用APP所提用的部分或全部的应用服务图标,本申请对此不作限定。
(3)小窗口、胶囊、snack bar、toast反馈和侧边应用栏
“小窗口”是智能设备的系统工具,它可以将应用的操作窗口悬浮在界面上方或桌面上,让用户轻松切换最近使用的应用。悬浮窗作为一种被缩小的应用界面,其可以置顶显示在其他的应用界面(例如全屏显示的应用界面)上,且小窗口依旧可以显示其对应应用固有的界面样式以及功能列表,用户可以在不关闭或退出其他应用的应用界面的情况下,直接操作悬浮窗界面中的控件来使用该控件对应的功能。例如,在全屏玩游戏或看视频时突然收到微信、QQ等消息,其对应的聊天界面可以在以悬浮窗的形式直接在游戏界面的上方,用户可以在小窗口所显示的聊天界面查看和回复消息,无需切换或退出当前打开的应用。
“胶囊”是小窗口最小化后的一种表现形式,因为形状形似胶囊得名。与小窗口不同之处在于,其一般无法显示其对应应用固有的界面样式以及功能列表,只会以小图标的形式显示在电子设备屏幕的侧边。用户可以通过点击胶囊将胶囊展开,胶囊展开后将以应用 界面的形式(例如小窗口)置顶显示在屏幕中。
“toast反馈”是一种轻量型的反馈方式,属于非模态弹窗的一种表现形式。常见的toast反馈的表现方式为文字或者图标+文字的组合方式。出现的位置会根据场景的不同设计在页面的顶部、中间或者底部。经过一定的时间间隔(3s~5s)后自动消失,或者用户点击其他位置也会自动消失。toast反馈不会打断用户当前的操作流程,对用户的打扰是最小。其缺点是容易被用户忽视,而且不适合展示过多的信息,可能在用户还没读完信息之前就消失了。
“snack bar”是比toast稍重一点的轻量型反馈方式,包含一行与进行中的操作相关的文案,并且可以包含相应的跳转控件,便于用户浏览与前述进行中的操作相关的应用界面。snack bar也是一种非模态弹窗,一般用于通知用户该程序正在发生或者即将发生的进程,它的内容一定是和用户当前操作相关的。其一般短暂的出现在屏幕的底部,不中断用户体验,也不需要用户任何操作,在一段时间后就会自动消失。此外,在一些实施例中,若界面中出现snack bar,用户可以通过点击snack bar之外的区域使得snack bar消失。
“侧边应用栏”是一种显示在电子设备屏幕侧边,可容纳多个应用图标的快捷功能区域,且用户可以自定义侧边栏应用栏里面的应用种类以及应用图标的顺序。在任何界面下,用户都可以从屏幕边缘向内滑并停顿调出侧边应用栏,点击应用图标,打开相应的应用,且应用打开后一般会以小窗口的形式置顶显示在界面中。
(4)全局收藏
全局收藏为本申请实施例提供的一种应用服务,其可以用于收藏用户基于电子设备浏览过的图片、文本、语音、网页等元素。在将元素收藏至全局收藏应用服务中之后,用户还可以对收藏的元素进行编辑,例如在收藏的视频中加入标签标记重点等,便于用户在对元素进行回看时可以高效回顾元素所携带的关键信息。
用户可以对元素进行三指下滑的操作将元素收藏至全局收藏应用服务中,也可以通过本申请提供的跨应用传输界面将元素收藏至全局收藏应用服务中。在成功将元素收藏至全局收藏应用服务中之后,电子设备可以在界面中显示全局收藏应用服务对应的胶囊,便于用户将界面中的其他元素收藏至全局收藏应用服务中。具体请参考后续实施例的相关说明,此处先不赘述。
随着电子信息技术的不断发展,手机、平板等智能设备已经成为我们日常生活、工作和娱乐中不可或缺的产品。在用户使用智能设备的过程中,通常会同时打开智能设备中的多个应用协同工作,用户也时常会利用智能设备对信息进行跨应用传输,即将一个应用中的信息通过另一个应用进行处理、分享、上传等。但是,当用户需要对信息进行跨应用传输时,需要对信息进行复杂且繁琐的操作来完成。
图1示出了用户将应用“小说阅读”中的文字添加到应用“笔记”中的具体过程。
图1中的(A)所示的用户界面01为用户在应用“小说阅读”中打开某本小说后,电子设备所显示的界面。用户界面01包括状态栏011、文本信息012、文本选项列表013以及导航栏014,其中:
状态栏011中可以包括运营商的名称(例如中国移动)、时间、WI-FI图标、信号强度和当前剩余电量。
文本信息012可以分为两部分。其中文本信息“ABCDEFGHIJKLMN”为用户期望传输到其他应用(例如摘抄到笔记应用)中的文字,因此该部分文本此时已被用户选中而处于深色区域中;而文本信息“OPQRSTUVWXYZ”则未被用户选中,因此也未处于深色区域中。需理解,尽管图1中未示出,在对文本进行选择时,用户可以通过对文本信息012的长按操作,在首光标0121以及尾光标0122出现后,调整首光标0121以及尾光标0122的位置来完成对文本的选择。
文本选项列表013包括复制选项、全选选项、搜索选项、翻译选项以及分享选项。其中,复制选项用于将用户选中的文本信息进行复制,在复制之后,用户可以在电子设备其他文本框中粘贴这部分被选中的文本信息;全选选项用于一键将界面01中的文本信息全部选中;搜索选项用于调用电子设备提供的搜索功能对用户选中的文本进行搜索;翻译选项用于对用户选择的文本进行翻译,例如汉译英或者英译汉等;分享选项用于对用户选中的文本进行分享。任何一个选项均可用于响应用户的操作,例如点击操作,使得电子设备执行选项对应的操作。
导航栏014可以包括:返回按键0141、主界面(home screen)按键0142、呼出任务历史按键0143等系统导航键。当检测到用户点击上述返回按键0141时,电子设备可显示当前用户界面的上一个用户界面。当检测到用户点击上述主界面按键0142时,电子设备可显示用户为电子设备设定的主屏幕界面。当检测到用户点击呼出任务历史按键0143时,电子设备可显示用户最近打开过的任务。各导航键的命名还可以为其他,比如,上述返回按键可以叫Back Button,上述主界面按键可以叫Home button,上述呼出任务历史按键可以叫Menu Button,本申请对此不做限制。此外,上述导航栏中的各导航键不限于虚拟按键,也可以实现为物理按键。
在用户将文本选中之后,用户可以先通过图1中的(A)所示的对复制选项的点击操作复制选中的文本信息。之后,为了将复制的文本信息放入笔记应用的摘抄页当中,用户再通过图1中的(A)所示的对主界面按键0142点击操作,以使的电子设备退出当前用户界面01并显示主界面。主界面的具体样式可以参考图1中的(B)所示的用户界面02。用户界面02可以包括状态栏021、日历天气小工具022、应用区域023和dock区024以及导航栏025,其中:
状态栏021、导航栏025的具体功能可以参考前述对用户界面01的相关说明,此处不再赘述。
日历天气小工具022可用于指示当前时间,例如日期、星期几、时分信息等,并可用于指示天气类型,例如多云转晴、小雨等,还可以用于指示气温等信息,还可以用于指示地点。
应用区域023可以包含例如“小说阅读”的应用图标、“笔记”的应用图标0231等,还可以包含其他应用的图标,本申请实施例对此不作限定。任一个应用的图标可用于响应用户的操作,例如触摸操作,使得电子设备启动图标对应的应用。
dock区域024可以包含例如“电话”的图标、“短信”的图标、“浏览器”的图标以及“相机”的图标,还可以包含其他应用的图标,本申请实施例对此不作限定。任何一个应用的图标可用于响应用户的操作,例如触摸操作,使得电子设备启动图标对应的应用。无 论用户如何切换屏幕界面,在屏幕界面上dock区域024的大小和其包含的应用永远不变,且一直显示在当前界面上。
为了将之前选中并复制好的文本信息放入应用笔记的摘抄页中,如图1中的(B)所示,用户需要先通过对应用图标0231的点击操作打开应用“笔记”;电子设备可响应于用户对应用图标0231的点击操作,显示如图1中的(C)所示的用户界面03。在用户界面03中,用户可以先对输入区域031中的空白区域进行长按操作以调出输入选项框032,再点击输入选项框032中的粘贴选项,将之前选中的文本信息粘贴至输入区域031中。
完成文本信息的粘贴后,电子设备所显示的界面可以参考图1中的(D)所示的用户界面04。如用户界面04所示,此时用户在应用“小说阅读”中选中的文本信息已经成功输入到应用“笔记”中了。之后,电子设备可以响应于用户对确认控件042的点击操作,保存用户最新创建的笔记。
从图1所示的文本跨应用传输的具体过程可以看出,这种信息跨应用传输的方法在执行时需要经过多个操作步骤,并且涉及多个应用和页面的跳转,用户与电子设备之间的交互效率很低,严重影响了用户体验。
图2示出了用户利用电子设备提供的分屏功能将应用“相册”中的图片添加到应用“笔记”中的具体过程。
如图2中的(A)所示,用户界面05包括第一显示区域051以及第二显示区域052。其中,第一显示区域051中用于显示应用“笔记”的应用界面,第二显示区域052用于显示应用“相册”的应用界面。具体的:
第一显示区域051包括输入区域0511,功能列表052,其中:
输入区域0511用于接收并显示用户输入的文本、图像等笔记信息。
功能列表052可以包括分享选项、收藏选项、删除选项以及更多选项。任意一个选项均可以响应于用户的点击操作,使得电子设备针对当前的笔记执行选项对应的功能。
第二显示区域052包括图像显示区域,以及图像缩略图集0522,其中:
图像显示区域0521用于显示用户保存在图库中的图像;
图像缩略图集0522为用户从图像显示区域0521中选中多张图像并拖拽拉起后形成的缩略图集(即用户当前想要放入笔记中的图像),其左上角的角标所显示的数字“3”表示用户总共选中了三张图像。
如图2中的(A)所示,用户可以按住图像缩略图集0522并将其拖拽至第一显示区域051中后送松手,即可以将图像缩略图集0522所对应的多张图像放入至应用“笔记”中,具体可以参考图2中的(B)所示的用户界面06。需要说明的是,在用户界面06中,由于第一显示区域061面积的限制,用户所选中的三张图像(即图像缩略图集0522对应的三张图像)虽然已经全部添加到应用“笔记”中了,但是其未能完全显示在第一显示区域061中。
虽然图2所示的信息跨应用传输的过程在一定程度上简化了用户的操作步骤,但是在过程中电子设备需要保持2个应用界面同时显示,用户的阅读效果不佳;此外,用户还需要对电子屏幕进行操作以2个应用界面分屏显示,这个过程所需要的操作也很繁琐,用户与电子设备之间的交互效率并没有得到提升,用户体验依旧欠佳。
针对图1和图2中信息跨应用传输方法存在的缺陷,本申请提供了一种信息的传输方法及电子设备,该电子设备可用于实施该方法,在实施该方法时,电子设备可以显示一种跨应用传输界面,使电子设备能高效、快捷的完成应用之间的信息传输,有效减少用户完成信息跨应用传输所需的操作步骤,提高用户与电子设备之间的交互效率,进而提升用户体验。
具体的,在电子设备所显示的任意界面下,当用户需要将界面中信息进行跨应用传输或跨设备传输时候,用户可以长按界面中信息元素并拖拽到屏幕边缘,电子设备会将屏幕原始显示的界面进行三维变换,在屏幕中营造出原始界面向内推开的视觉效果,并在电子设备的屏幕侧边显示推荐的应用服务图标。此时电子设备所显示的用户界面即跨应用传输界面。之后,用户将拖起的信息元素放置在应用服务图标上松手,即可将该信息传输到图标对应的应用服务中,并启动相应的应用服务功能。需要说明的是,上述信息元素可以图片、文本、视频、语音、链接、文档等元素,还可以是其他的元素,本申请对此不作限定。此外“跨应用传输界面”只是本申请实施例所使用的一些名称,其代表的含义在本申请实施例中已经记载,其名称并不能对本实施例构成任何限制。
下面介绍本申请实施例提供的用户界面。
首先,介绍上述跨应用传输界面的触发过程所涉及的用户界面。
图3A为用户基于跨应用传输界面对图像进行跨应用传输时电子设备界面变化过程的示意图。
如图3A中的(A)所示,用户界面07可以是电子设备中应用“浏览器”的应用界面,也可以是应用的应用界面,还可以是其他应用的应用界面,本申请对此不作限定。用户界面07可以包括图像071、文本072、文本073以及状态栏074。电子设备可以响应于用户对图像071的用户操作,例如图3A中的(A)所示的长按操作,显示如图3A中的(B)所示的用户界面08。
如图3A中的(B)所示,在用户界面08中,原来的图像071在用户的长按操作下形成了图像081,在用户不松手的情况下,图像081可以随着用户的指尖在用户界面08中移动,且图像081可以置顶显示在用户界面08中(即图像081可以将用户界面08中任意元素覆盖)。需要理解的是,图像081所显示的图像内容与图像071所显示的图像内容是一样的。可选的,图像081可以是电子设备将图像071缩小后所得的缩略图,也就是说,图像081与图像071除了面积大小之外没有差异。可选的,在图像071被拖起形成图像081之后,电子设备可以依旧将图像071显示在用户界面08中,并对图像071进行虚化处理或模糊处理,即在用户界面08中图像071的清晰度可以比用户界面07中图像071的清晰度更低,以提示用户图像071已处于被选中并被拖起的状态。
电子设备可以响应于用户对图像081的用户操作,例如图3A中的(B)所示的拖动操作,显示如图3A中的(C)所示的用户界面09。
可选的,在用户将图像081拖动至离屏幕右侧边或左侧边的距离小于一定阈值的情况下,电子设备显示用户界面09,后续会对此进行详细说明,此处先不赘述。如图3A中的 (C)所示,用户界面09即为前述说明中提及的跨应用传输界面,其可以包括子界面091、图标区域092以及图像093。其中:
子界面091中所显示的元素内容(例如文本、图片等)与用户界面07中所显示的元素内容(除状态栏之外)一样。实际上,子界面091可以认为是电子设备将与原始的用户界面07的全部元素内容(除状态栏之外)进行三维变换后所得到的界面。在用户界面09中,子界面091可以在屏幕中营造出原始界面(即用户界面07)向内推开的视觉效果。可理解的,这种“开门”的视觉效果隐喻了传输元素(信息)的行为,相比于复制粘贴更具直观性。可选的,在用户界面09中,子界面091后面的背景可以被设定为电子设备的桌面背景(即桌面壁纸)叠加模糊效果后的所得的画面。
图标区域092可以用于显示一个或者多个电子设备基于用户选中的信息元素(在本申请实施例中即图像071)推荐的应用服务图标。
可选的,图标区域092中的每一个图标下方都有相应的文字说明,这些文字说明可以用于解释图标对应的具体应用名称或者应用服务名称。以图标0921以及文字0922为例,当图标0921为应用的图标时,文字0922可以是“微信”;当图标0921为应用 中应用服务“朋友圈”的应用服务图标时,文字0922可以是“朋友圈”或者“微信朋友圈”,当图标0921为应用中应用服务“扫一扫”的应用服务图标时,文字0922可以是“扫一扫”或者“微信扫一扫”。需理解,每个应用服务图标下方的文字只是仅为了便于用户明白图标对应的具体应用或具体的应用功能,但是对于具体的图标样式以及具体的文字内容,本申请对此不作限定。
图像093所显示的图像内容与图像071以及图像081所显示的图像内容是一样的。可选的,图像093可以是电子设备将图像081缩小后所得的缩略图,同理,图像093与图像081、图像071除了面积大小之外没有差异。这样,在用户在图标区域092中选择自己想要的应用服务时,图像093则不会对图标区域092中的图标和文字造成大面积的遮挡,更方便用户对图标进行选择。
需要说明的是,不同于图像071的缩小过程,当图像081被缩小得到图像093之后,图像081可以不再显示在用户界面09中。即图像081可以视为电子设备将图像071进行复制之后再进行缩小所得的图像,而图像093可视为电子设备将图像081直接进行缩小所得的图像。
在用户界面09中,用户将拖起的信息元素(即图像093)放置在图标区域092中对应的图标上并松手,电子设备即可响应于该用户操作将该信息元素传输到图标对应的应用服务中,并显示与应用服务图标对应的应用界面或者反馈信息,后续会对此进行更为详细的说明,此处先不赘述。
此外,为了能引导用户将拖起的元素精准地放入到自己需要的应用服务中,当图像093靠近图标区域092中的某个图标时,或者说图像093与图标区域092中的某个图标的距离小于某个阈值时,这个被图像093靠近的图标可以显示出一定的特效,例如该图标和该图标对应的文字可以被图像093吸附靠近,并且该图标和该图标对应的文字可以被放大。以用户界面09中的图标0923及其对应的文字0924为例,当图像093靠近图标0923时,图标0923、文字0924相较于其他的图标和文字更靠左一些,即比其他图标和文字更靠近图 像093;此外,图标0923也被放大,以提示用户若在此处松手,图像093(或者说图像071)将被传输至图标094对应的应用服务中。
可理解的,图3A所示出的信息跨应用分享过程从用户拖起元素到将元素放入目标应用服务的整个过程都是连续的,这里所说的“连续”是指用户无需进行复制、粘贴等操作、也无需进行应用切换操作,整个操作过程用户的手指均无需离开电子设备的屏幕,操作简单快捷;且这种信息传输方式保证了用户界面的有效浏览区域,可以有效提升用户对信息进行跨应用传输的效率,提升用户体验。
前述跨应用传输方法中,电子设备可以确定图标区域092中推荐的服务。不限于“智慧流转”功能中电子设备在图标区域092中推荐服务,在其他场景下电子设备也可以推荐服务。例如,电子设备在接收到用户复制文本的事件后,也可以在显示屏上显示图标区域以推荐服务。又例如,电子设备在接收到用户拖拽内容的事件后,也可以在显示屏上显示图标区域以推荐服务。
下面以复制场景为例,介绍电子设备实现前述跨应用传输方法中确定推荐图标092区域推荐的推荐服务的一种流程。该流程可包括:
1.电子设备首先监听到复制事件,该复制事件可触发后续步骤。具体实现中,电子设备可在确认剪贴板(也可称为剪切板、粘贴板等)中有新增内容的情况下,确定监听到复制事件。
2.电子设备过滤所复制的内容。过滤操作指识别到无需做服务推荐的复制内容并忽略,仅留下需要做服务推荐的复制内容。例如,如果复制内容为验证码,则无需做服务推荐,也就无需执行后续步骤例如可包括对复制内容做一些去冗余处理、内容提炼等。
3.实体识别。
实体指对象、概念或物品等。实体的类型例如可包括口令、地址、影视剧名、日期、商品名称、美食名称、邮箱、航班号、快递单号、电话号码等。每个实体都包含具体的值,就是实体的具体内容。例如,对于用户复制的文本“xx市xx区xx路xx号xx栋”,该文本是一个实体,其实体类别为地址,其具体内容为“xx市xx区xx路xx号xx栋”。又例如,日期类型的实体,其实体值是具体的日期,如“2024年4月18号”。
步骤3的目的是识别过滤后的复制内容中的实体,获取该实体的类型和值。
如果复制内容为外文文本,则在步骤3中,电子设备可以先将外文文本翻译为本地使用的语言,再做实体识别。
4.实体排序。
当识别到多个实体时,电子设备可以按照预设规则对多个实体进行排序。本申请对该预设规则不做限定,例如可以是预设顺序、识别到的先后顺序等。
5.根据识别到的实体获取服务列表。
通常不同类型的实体和服务列表之间有预设的映射关系,例如地址类的实体对应导航服务和打车服务,航班号类的实体对应航班查询服务,邮箱类的实体对应邮箱应用。电子设备可根据该预设的映射关系,识别实体对应的服务列表。
6.对获取到的服务列表中的各个服务排序。排序规则可包括多种,这里不做限定。
7.根据排序在菜单栏(例如图标区域092)中显示各个服务的图标。
8.服务执行,即响应于用户在某个服务的图标上的用户操作,跳转至该服务的用户界面。
上述服务推荐流程可以由电子设备中的服务推荐引擎来执行。其他类似场景下的服务推荐流程和上述流程类似,例如用户在拖动其他数据(如截屏图像、文本)的过程中,也可以按照上述流程来推荐服务。
该服务推荐流程具有如下不足:
1.整个服务推荐流程依赖于特定事件(如复制事件),在监听到复制事件之后才会触发;
2.不同的服务有不同的执行方式,没有统一的标准,无法复用引擎能力;在不同的场景下,例如“智慧流转”和复制推荐服务,各自对应的服务有不同的实现标准,复杂且冗余;
3.对于不同的实体,获取服务、服务排序、服务执行等都是单独的针对实体定制的流程,电子设备的能力无法复用,在做服务推荐时工作量大;
4.如果需要接入三方服务,即让三方服务能够通过电子设备显示的菜单来启动,那么需要对该三方服务做定制开发;由于每个三方服务的执行参数都不同,因此需要多次定制开发,三方服务的接入周期过长。
此外,现有的安卓(Android)系统中的服务推荐也有其他的实现方式,但这些方案通常具有以下不足:仅支持接入安卓共享内容(share intent)的应用,无法复用三方应用已有的服务(例如使用深度链接(deeplink)拉起的服务);不支持接入非安卓生态的应用,如快应用(light APP)、支付宝小程序等;仅能根据实体按照固定的对应关系推荐服务,并没有结合用户的个人意图,不能很好地满足用户需求等。
本申请实施例提供了一种用于推荐服务的框架,可以解决上述问题。
参考图3B,图3B示例性示出了用于推荐服务的框架的结构。该框架可包括两部分,一部分位于电子设备侧,另一部分位于云设备侧。
如图3B所示,电子设备侧可包括:显示入口、软件开发工具包(software development kit,SDK)、多模推荐服务、服务管理框架。多模推荐服务也可称为多模服务推荐引擎,其可包含以下几个模块:服务订阅模块、多模内容理解模块、意图识别模块、服务召回模块、服务排序模块、服务通知模块、意图自学习模块等。
电子设备侧中的显示入口可以位于应用层,其余模块可位于框架层或服务层,这里不做限定。显示入口可以指各个能提供服务推荐功能的业务的入口,如通过复制推荐服务的入口、“智慧流转”功能中通过拖拽内容推荐服务的入口,用于接收用户的输入内容等。显示入口和上文提到的交互方式的关系,不限于上文提到的交互方式。
SDK用于为显示入口使用多模推荐服务提供接口。图3B所示的框架定义了统一的多模内容输入接口(即显示入口),显示模块显示入口可以从剪贴板、拖拽事件中获取到输入内容,再将输入内容传输给SDK,进而触发后续多模推荐服务执行的服务推荐。这样,多模推荐服务无需从剪贴板、拖拽事件中获取内容,提高了信息的处理效率。
多模推荐服务用于为应用层的各个业务推荐服务。具体的,服务订阅模块用于订阅各个业务支持的服务和/或意图类别,多模内容理解模块用于从应用层业务接收到的内容中识 别实体,意图识别模块用于根据识别到的实体找到对应的意图,服务召回模块用于找到意图对应的服务,服务排序模块用于对各服务进行排序,服务通知模块用于将排序后的服务列表传递给应用层的各业务,意图自学习模块用于学习新的意图类别。多模推荐服务中各模块的具体功能可参考后文方法实施例的具体介绍。
如图3B所示,云设备侧可包括:决策云平台、智慧服务平台(intelligent service platform,ISP)。
决策云平台可以是物理服务器、云服务器、服务器集群等。决策云平台可以由电子设备的设备厂商统一提供。
决策云平台用于定义以下几项:
1.全局意图体系
全局意图体系包括多类意图的信息。
意图指用户想要的达到的目的。意图可以分为多种类别,例如可包括但不限于打开口令、导航、地图搜索、打车、购物、点外卖等类别。一个意图类别也可以理解为一个不那么具体的意图。
每一类意图都可包括以下一项或多项信息:意图标识,意图等级(intentlevel),意图标签(tag),意图槽位信息(slotInfoList)。其中,意图标识指示了意图类别,可以包括以下一个或多个:意图的识别号码(identity,ID),意图编码。意图等级表示意图的置信度。意图槽位信息可以包括以下一项或多项:槽位名、槽位中填充的数据类型、槽位中填充的数据的中文名、该槽位是否必要的指示信息等。槽位可以看做是一个参数,数据类型可包括字符串类型(string)、数字等。
决策云平台所做的事情是,定义多类意图所包括的信息,如意图标识和意图槽位信息。
下面示出决策云平台定义的信息的示例:
"video.WATCH":{},
"HAIL_TAXI":{"intentLevel":5,"tag":"location","slotInfoList":[{"slotName":"end_name",
"slotType":"String","srcKey":"location"}]},
"ADDRESS_SEARCH":{},
"RECOGNIZE_CODE":{}
上述示例中,决策云平台定义了4类意图,分别是观看视频类意图video.WATCH、打车类意图HAIL_TAXI、搜索地址类意图ADDRESS_SEARCH、识别码信息类意图RECOGNIZE_CODE。其中,第二个打车类意图的等级为5,标签为地址,其包含一个槽位,该槽位的名称是目的地,槽位置类型为字符串,槽位对应的实体类型为地址。
参考表1,其示出了决策云平台定义的打车类意图所包含的信息。
表1

不同类意图包括的信息不同。相当于,决策云平台标准化了意图的表达形式,并且构造了一个包含各类意图信息的数据库,即搭建了一个意图框架。
如果需要新增意图类别,决策云平台仅需要针对该新增的意图类别定义其包括的信息,即可让电子设备识别到该新增的意图类别。
在意图信息的槽位中,填充进具体的值,就能得到一个具象化的意图。参考表2,其示出了一个具象化的打车类意图所包含的信息。
表2
该具象化的打车类意图可以是“从深圳荣耀科技园打车到深圳机场”。
具象化的意图可以分为有效和无效两类,这取决于必要槽位中是否填充进了值。如果必要槽位中填充进了值,则得到的意图为有效意图;而非必要槽位中是否填充进了值,不影响意图的有效性。
2.实体类别到意图类别的映射关系
实体信息可包括实体类别和实体值。
实体信息可以实现为如下格式:"实体类别":[“实体值"]。下面示例性例举几种实体:
"code":[“口令码"]
"location":[“地址"]
"video":[“电影名"]
"time":[“日期"]
"commodity":[“商品名"]
"delicacy":[“美食名"]
"multiLocation":["地址1","地址2"]
上述实体中的实体值以值的类型替代,实际的实体值需填充具象化的数值。
实体类别到意图类别的映射关系可以由决策云平台预先定义。
例如,该映射关系可包括:实体的实体类别,和,意图信息中的标签,相同时,则该实体和该意图类型相对应。即,一个实体可以映射到意图标签为该实体的类型的意图类。例如,"location":[“地址"]这一实体对应表1示出的打车类意图。
该映射关系可以由人工配置,也可以由机器学习到并不断完善。
一个实体可以映射到一个意图类别,也可以映射到多个意图类别。
在一些实施方式中,决策云平台还可以预定义模态到意图类别的映射关系。例如,文本模态可映射到搜索类意图、笔记类意图;视频模态可映射到播放类意图等。
在一些实施方式中,决策云平台还可预定义实体和模态到意图的映射关系,相当于对上面的两种映射关系做了融合。
3.冷启动阶段的服务排序规则
冷启动阶段指电子设备侧还未学习到用户偏好之前的阶段。冷启动阶段的服务排序规则可以根据群体偏好来设定,例如群体对各服务的偏好顺序可以为:打车服务、收藏服务、购物服务等。
决策云平台配置的上述信息可以下发给电子设备,例如决策云平台可以将配置的多类意图的信息、实体类别到映射类别的映射关系分享给意图识别模块,将冷启动阶段的服务排序规则分享给服务排序模块。
智慧服务平台用于开放给提供服务的第三方,便于第三方定义或编辑所提供的服务的信息。智慧服务平台所获取到的上述第三方提供的信息,可以被称为全局服务体系。
第三方定义的服务的信息可包括以下一项或多项:服务ID、服务名称、服务的图标、服务类型、服务支持的意图类别的标识、服务的槽位名、应用包名、组件名、跳转至该服务的统一资源定位符(uniform resource locator,URL)、参数名称。其中,服务类型指提供服务的形式,例如可包括微件(widget)、深度链接(deeplink)、安卓共享内容(share intent)、非安卓的小程序/快应用(light APP)/超文本标记语言(HyperText Markup Language,HTML)网页等。服务支持的意图是指该服务能够满足的意图类别,该项可以由第三方在决策云平台定义的意图类别中选择,该项的数量可以为一个或多个。服务的槽位名用来指示启动服务时用来从意图中获取参数的槽位,该项可以由第三方在决策云平台定义的该服务支持的意图类别的槽位名中选择,该项的数量可以为一个或多个。应用包名指服务所属的应用的包名。组件名指服务所属的组件的名称。参数名称指服务在执行时,用于传递上述槽位名所表示的槽位中所填充值的参数。上述几项并非都是必要的,其中的某些项可以根据实际需求删减。
如果有新增的服务需要接入电子设备,智慧服务平台可以灵活扩展该新增的服务,服务提供方可以将新增的服务按照智慧服务平台要求的标准格式注册到服务管理框架,电子设备后续便可启动该新的服务。这样,服务提供方也无需适应性修改服务代码,仅需要按照标准格式注册服务信息,即可让服务接入。
参考表3,其示出了某第三方通过智慧服务平台定义的一个服务的信息。
表3
可见,表3描述的服务支持编码为“com.hihonor.intent.navigation”的意图类别。
举例来说,如果地图应用A提供了打车服务,在该打车服务的信息中,可以指定将槽位名为“end_name”的槽位中填充的数据(例如“深圳机场”)传输到地图应用A的“keyword”这一参数中,这样可以方便后续启动服务时分享数据。如果地图应用B也提供了打车服务,则该打车服务的信息中,可以指定将槽位名为“end_name”的槽位中填充的数据(例如“深 圳机场”)传输到地图应用B的“dname”这一参数中,这样可以方便后续启动服务时分享数据。可见,不同的服务在传递数据时可以有不同的实现方式。可见,不同的第三方提供的服务信息可以不同。
下面示例性示出了地图应用A和地图应用B分别提供的打车服务的部分信息。
app:地图应用A
应用包名:com.autonavi.minimap
URL:Deeplink:amap://navigation
参数:keyword
app:地图应用B
应用包名:com.autonavi.minimap
URL:Deeplink:baidu://navigation
参数:dname
智慧服务平台在获取到各个第三方定义的服务信息后,可以将这些服务信息分享给电子设备的服务管理框架。
基于前文介绍可知,智慧服务平台标准化了服务的接入形式,并且根据各方接入的服务生成了一个包含各类服务信息的数据库。相当于将不同服务(包括系统服务、三方服务)差异化的执行接口和参数,通过本申请实施例提供的自定义规则映射到业务侧,使得业务侧可以通过统一的标准接口来运行各服务。
下面将结合推荐服务的具体流程,来解释上述框架中各模块的作用。
如图3B所示,本申请实施例提供的推荐服务的流程可包括如下步骤:
步骤S1.第一业务订阅支持的意图类别和/或服务。
这里所指的第一业务是指具有推荐服务这一功能的业务,例如可以为电子设备中的智慧流转服务、通过复制推荐服务的业务、通过拖拽推荐服务的业务等。
第一业务可以向服务订阅这一模块发起订阅,目的是订阅第一业务所需的意图类别范围和/或服务范围。第一业务订阅的意图类别和/或服务均可以为一个或多个。第一业务启动后,电子设备可以识别属于该第一业务订阅的意图类别范围内的意图类别,还可以根据识别到的意图推荐属于该第一业务订阅的服务范围内的服务。
不同的第一业务可以订阅不同的意图类别范围和/或服务范围,以满足不同业务方的个性化需求。第一业务可以根据自身需求动态订阅意图范围和服务范围,即支持第一业务动态扩展支持的意图类别和/或服务。第一业务订阅的意图类别范围和服务范围具体可以由电子设备的开发人员来决定。
下面以列表形式示例性示出了某个第一业务订阅的服务范围和意图类别范围:
订阅的服务列表:
["打车服务","导航服务",
"搜索服务","全局收藏服务"]
订阅的意图类别列表:
["social.SHARE",
"email.SEND",
"office_software.PRINT",
"note.TAKE",
"HAIL_TAXI",
"favorites.ADD",
"schedule.CREATE",
"video.WATCH",]
上述服务列表包含订阅的服务的编码,表示订阅的服务包括以下几个:打车服务、导航服务、搜索服务、全局收藏服务。
上述意图类别列表包含订阅的意图类别的编码,表示订阅的意图类别包括以下几类:社交分享类意图、邮件分享类意图、打印类意图、笔记类意图、打车类意图、收藏类意图、创建行程类意图、观看视频类意图等。
第一业务订阅意图类别和服务后,如果电子设备启动该第一业务,图3B中的多模推荐服务会根据该第一业务订阅的意图类别和服务,提前加载所需要的资源,如订阅的意图类别的信息。多模推荐服务还可以通知第一业务侧提前加载订阅的服务的图标等静态资源。这样可以加快服务推荐的效率。
步骤S1的目的是让第一业务订阅支持的意图类别和/或服务,以便电子设备在后续的S4中从第一业务订阅的意图类别中找到对应的意图类别,以及便于电子设备在后续的S5中从第一业务订阅的服务范围中查询对应的服务。因此,S1在S4及S5之前执行即可,本申请对其执行时间不做具体限定。
步骤S1是可选步骤,在一些实施方式中,也可以无需执行步骤S1。例如,可以默认各个业务订阅电子设备支持的所有意图类别和/或所有服务,无需各个业务主动订阅。
步骤S2.电子设备接收用户对第一业务输入的第一内容。
电子设备可以通过第一业务提供的入口接收用户输入的第一内容。
S2可以在电子设备启动“智慧流转”业务的过程中执行。
例如,参考图3A,用户长按图像071后,电子设备生成图像081,用户拖动图像081至离屏幕右侧边或左侧边的距离小于一定阈值的情况下,可以触发S1,此种情况下图像071即为电子设备通过“智慧流转”业务的入口接收到的第一内容。
又例如,参考后续的图4,用户长按用户界面11中的文本111后,电子设备生成文本121,用户拖动文本121至离屏幕右侧边或左侧边的距离小于一定阈值的情况下,可以触发S1,此种情况下文本111即为电子设备通过“智慧流转”业务的入口接收到的第一内容。
又例如,参考后续的图6,用户长按用户界面17中的截屏图像171后拖动截屏图像171,将截屏图像171拖动至离屏幕右侧边或左侧边的距离小于一定阈值的情况下,可以触发S1,此种情况下截屏图像171即为电子设备通过“智慧流转”业务的入口接收到的第一内容。
又例如,参考后续的图7,用户可以点击用户界面20中的识别控件203,触发电子设备对局部截屏框202的文本信息进行识别,之后,用户可以长按识别到的文本信息并拖动该文本信息,将文本信息拖动至离屏幕右侧边或左侧边的距离小于一定阈值的情况下,可以触发S1,此种情况下该文本信息即为电子设备通过“智慧流转”业务的入口接收到的第一内容。
又例如,参考后续图8,用户可以长按并拖动局部截屏框202所截取的图像,将该图像拖动至离屏幕右侧边或左侧边的距离小于一定阈值的情况下,可以触发S1,此种情况下局部截屏框202所截取的图像即为电子设备通过“智慧流转”业务的入口接收到的第一内容。
又例如,参考后续的图22C-图22D、图22F-图22G,用户可以长按目标文本111,触发电子设备生成对应的控件112,用户拖动控件112至屏幕右侧边缘或屏幕左侧边缘后,可以触发S1,此种情况下目标文本111即为电子设备通过“智慧流转”业务的入口接收到的第一内容。
又例如,参考后续的图25A-图25F,用户可以长按截屏生成的图像411,并将图像411拖动至显示屏右侧边缘或屏幕左侧边缘,以触发S1,此种情况下图像411即为电子设备通过“智慧流转”业务的入口接收到的第一内容。
又例如,参考后续的图26A-图26I,用户可以长按显示屏,触发电子设备显示悬浮态的控件512,之后用户可以拖动控件512至屏幕左侧或右侧的开门热区,以触发S1,此种情况下控件512对应的图像即为电子设备通过“智慧流转”业务的入口接收到的第一内容。
S2还可以在电子设备启动“智慧流转”以外的其他业务的过程中执行。例如,电子设备可以在接收到用户复制文本的操作后,执行S2,用户复制的文本即为电子设备通过复制业务的入口接收到的第一内容。又例如,电子设备可以在接收到用户拖拽内容(如文本、图像等)的操作后,执行S2,用户拖拽的内容即为电子设备通过拖拽业务的入口接收到的第一内容。
这里提及的用户输入的第一内容和前后文提及的待传输数据、传输的信息是相同的概念。用户输入的第一内容可以是单模态的,也可以是多模态的。模态可以指内容的类别,内容的类别例如可包括文本、图片、视频、文档等。
步骤S3.电子设备调用多模推荐服务中的多模内容理解模块,将接收到的内容转换为第一实体。
多模内容理解模块可以调用实体识别能力,将接收到的内容转换为第一实体。对于不同类型的输入内容,电子设备可以分别调用不同的实体识别能力来提取内容的特征,并将其转换为实体,例如,对于文本,可以采用自然语言处理(natural language processing,NLP)来提取其特征;对于图片,可以采用计算机视觉(computer vision,CV)、光学字符识别(optical character recognition,OCR)等能力来提取其特征。实体识别能力可以包括电子设备本地的能力,也可包括云侧的识别能力。实体识别能力可以基于电子设备的多路识别框架来提供。如果有新增的实体识别能力,则可以通过插件方式扩展电子设备的实体识别能力,使得电子设备能够使用该新的实体识别能力来识别实体。
本申请的实体可以表示为标准格式,即包含实体类别和实体值。步骤S3相当于电子设备根据接收到的内容获取实体的类别和值。对于实体类别和实体值的定义,可参考前文相关描述。在本申请实施例中,实体类别,可以在电子设备支持的实体类别范围内选择。即,电子设备转换而来的实体都属于预设范围内的实体类别。
电子设备转换而来的第一实体可以有一个或多个,并且多个第一实体的类别可以不同。
如果有新增的模态,则图3B中多模推荐服务的多模内容理解这一模块可以增加插件, 该插件定义了新增模态的信息。这样,通过插件方式快速扩展新模态,使得电子设备能够对新增模态的内容进行分析。
步骤S4.电子设备调用多模推荐服务中的意图识别模块,识别第一实体对应的第一意图。
第一意图是具象化的意图。
具体的,电子设备可以先根据实体类别到意图类别的映射关系,在决策云平台定义的意图类别中找到第一实体对应的意图类别,例如可称为第一意图类别。实体和意图的映射关系可参考前文的介绍。然后,电子设备可以在第一意图类别的槽位中填充进具体的值,就能得到具象化的第一意图。槽位中填充的值,可以是第一实体的值,也可以是电子设备通过定位、学习等其他方式获取到。
第一意图可以被限定为有效意图,即电子设备识别第一实体对应的有效意图。有效意图的定义可参考前文。
举例来说,假设第一实体为:"multiLocation":["深圳荣耀科技园","深圳机场"],则该第一实体对应的第一意图类别可以如前文的表2所示,得到的具象化的第一意图可以如表2所示。
在一些实施方式中,如果执行了步骤S1,则电子设备可以在第一业务订阅的意图类别中,找到第一实体对应的意图类别,并进一步找到具象化的第一意图。
在一些实施方式中,电子设备还可以根据第一内容的模态找到对应的第一意图类别。模态和意图类别的对应关系通常是按照群体用户习惯来设置的,例如文本模态可以对应复制类意图、搜索类意图、翻译类意图;图片模态可以对应分享至社交应用类意图;视频模块可以对应播放类意图等。
第一实体对应的第一意图类别的数量可以为一个,也可以为多个。第一实体对应的第一意图的数量可以为一个,也可以为多个。
在前文S2-S4中,电子设备先获取输入的内容,然后将输入的内容转换为实体,再识别实体对应的意图。在此过程中,用户输入的内容可能包括多种模态,并且该输入内容转换而来的实体也可能包含多个。
一种对于多模态内容的识别过程的重要步骤包括如下几个:
加载意图元数据和业务规则(也可称为信息融合规则)。其中,意图元数据指的是全局意图体系中的信息,如各类意图的编码、槽位等。业务规则可包括实体类别和/或模态与意图类别的映射关系、全局服务体系中的内容等。加载的意图元数据和业务规则将在后续步骤中使用到,具体可参考前文图3B中S3-S4的相关介绍。
判断模态类型及加载各类实体识别能力模型。其中,实体识别能力模型可包括但不限于NLP模型、CV模型等。
NLP文本识别、CV图像识别。这一步实际是针对不同模态的内容串行识别其实体。
上述过程具有如下不足:
1.电子设备接收到输入的多模内容后,串行加载所需的资源,存在实体、意图识别耗时过程,推荐服务的时长过程,用户体验不佳的问题。
2.对于不同模态,识别实体、识别意图等都是单独的流程,导致电子设备接收到多模 内容时推荐服务的效率不高。
3.对于多模内容,如果其中一种模态的实体识别时间过程,会导致电子设备当前启动的业务(如智慧流转服务)的异常。
本申请提供了性能优化的几种方式,可以分别解决上述的几个问题。
本申请提供的性能优化方法可用于替换图3B中的S3-S4,该方法可包括:
S11.资源预加载。
该步骤可以在图3B的S2之后执行,即电子设备接收到输入的第一内容后,即可以执行资源预加载。例如,在智慧流转服务中,电子设备生成浮起元素后,如果电子设备接收到用户开始拖拽该浮起元素的操作,该电子设备就可以开始执行资源预加载。
这里预加载的资源可包括但不限于:意图元数据、业务规则、各类实体识别能力模型。上述各项资源的定义可参考前文的相关介绍。
电子设备可以并行加载各类资源。
以加载意图元数据为例,电子设备可以首先判断本地是否存在最新版本的意图元数据,若没有,则从云侧(如决策云平台)请求最新版本的意图元数据,然后将意图元数据加载至缓存中。
以加载业务规则为例,电子设备可以首先判断本地是否存在最新版本的业务规则,若没有,则从云侧(如决策云平台、智慧服务平台等)请求最新版本的业务规则,然后将业务规则加载至缓存中。
以加载NLP模型为例,电子设备可以首先判断NLP模型是否初始化,若没有,则通知人工智能插件(如AIplugin)加载NLP模型,之后人工智能插件即可加载NLP模型。
以加载CV模型为例,电子设备可以首先判断CV模型是否初始化,若没有,则通知人工智能插件(如AIplugin)加载CV模型,之后人工智能插件即可加载CV模型。
通过预加载相关资源,可以缩短电子设备识别意图的时延,可以提升用户体验。通过实验可知,预加载资源平均能够缩短20%~30%的时延。
S12.特征提取。
该步骤对应图3B中的S3-S4,即S12的目的是识别用户输入内容对应的实体,并识别该实体对应的意图。
对于用户输入的多模内容,针对每种模态都并发调用该模态对应的实体识别能力来提取该模态内容的特征。其中,每种模态对应的实体识别能力可以按照通用规则定义,例如文本模态对应的实体识别能力可包括位置信息提取、日程信息提取、影视实体提取、商品实体提取、口令实体提取等能力,图像模态对应的实体识别能力可包括图像识别能力、OCR识别能力等。电子设备可以拉起多个线程,每个线程用于调用一种实体识别能力。
具体的,如果用户输入了同时包括文本和图片两种模态的内容,则同步进行文本语义的提取和图像信息的提取。对于文本语义的提取,电子设备可以启动多个线程,分别提取文本携带的不同特征;对于图像信息的提取,电子设备也可以启动多个线程,分别提取图像携带的不同特征。
对每种模态提取出特征后,可以将该特征转换为实体,例如可以转换为标准格式的实体类别和实体值。之后,电子设备可以识别该实体对应的意图。多种模态同步进行,每种 模态都可以执行上述流程,以得到对应的意图。在识别到多个意图后,可以对多意图做融合处理,得到最终意图。
通过多路并发提取特征,能够有效的减少单一模态信息提取异常带来的整体业务阻塞问题,提高了业务的稳定性。
在一些实施方式中,当电子设备识别到具象化的意图后,可以终止当前还在进行的用于识别实体的各个线程,这样可以缩短识别意图的时延,不会因为单一线程过长而阻塞整体业务。例如,电子设备接收到文本和图像两种模态的内容,使用两个线程分别对文本模态和图像模态的内容提取特征及识别意图,当文本内容对应的线程从文本内容中识别到具体的意图,则可以中断另一个线程,以提升整体业务的响应效率。
步骤S5.电子设备调用多模推荐服务中的服务召回模块,基于服务管理框架提供的服务信息,查询第一意图对应的服务。
具体的,电子设备可以搜索服务管理框架提供的服务信息,查询和第一意图类别的标识相匹配的服务。如果服务支持的意图类别的标识和第一意图类别的标识相同,说明该服务能满足属于第一意图类别的意图,即能满足第一意图。例如,如果第一意图如表2所示,那么表3所表示服务支持的意图类别的编码和表2的意图编码一致,则认为表3表示的服务匹配表2表示的意图。
在一些实施方式中,如果执行了步骤S1,即电子设备中的第一业务订阅了服务范围,则电子设备在执行步骤S5时,可以在第一业务订阅的服务范围中,查询第一意图对应的服务。
第一意图对应的服务的数量可以为一个,也可以为多个,这里不做限定。
步骤S6.电子设备调用多模推荐服务中的服务排序模块,对查询到的多个服务进行排序。
如果步骤S5中查询到多个服务,则可以执行步骤S6。电子设备对多个服务排序的规则可包括多种,例如可以是最近使用优先、使用频率高的优先、对应意图的意图类别的置信度高(即等级高)的优先、用户的应用偏好顺序等,这里不做限定。
步骤S6为可选步骤,在一些实施方式中,也可以不必对多个服务排序。
步骤S7.电子设备调用服务通知模块,将获取到的服务的信息返回给第一业务。
电子设备可以将多个服务的信息以列表形式返回给第一业务。若有排序,电子设备可以将排序后的服务的信息返回给第一业务,让第一业务获知排序。服务的信息可参考前文相关介绍。在此之外,电子设备还会先确定服务的槽位名,然后找到第一意图中相同槽位名的值,将该值同步返回给第一业务。这方便电子设备快速启动第一业务,具体参考后续步骤。
举例来说,如果第一意图如表2所示,服务如表3所示,电子设备可以将第一意图中名称为“end_name”的槽位的值(即“深圳机场”)随服务的信息一起返回给第一业务。
步骤S8.电子设备在第一业务提供的用户界面上,显示步骤S7中获取到的服务的图标。
如果步骤S7中获取到了排序信息,电子设备可以按照排序从上到下依次显示获取到的各个服务的图标。这里,电子设备所显示的内容可以参考前文及后续介绍的各UI实施例。
例如,电子设备可以在图3A的用户界面09的图标区域092中显示S7获取到的服务 的图标,或者在图4的用户界面13的图标区域132中显示S7获取到的服务的图标,或者在图6的用户界面18的图表区域182中显示S7获取到的服务的图标,或者在图7的用户界面22的图表区域222中显示S7获取到的服务的图标,或者在图8的用户界面23的图表区域232中显示S7获取到的服务的图标,或者在图22H-图22K、图22M的菜单栏116中显示S7获取到的服务的图标等。
步骤S9.电子设备接收到作用于第一服务的图标的用户操作,响应该用户操作,第一业务将第一内容分享至该第一服务。
例如,参考图3A,电子设备接收到将图像081拖动至图标0923上释放的用户操作后,将图像071传输至图标0923对应的应用服务中。又例如,参考图8,电子设备接收到将图像233拖动至图标区域232中图标上释放的操作后,将图像233传输至该图标对应的应用服务中。又例如,参考图13,电子设备接收到将图像372拖动至图标区域372中图标上释放的操作后,将图像373传输至该图标对应的应用服务中。又例如,参考图17,电子设备接收到将图像441拖动至“全局收藏”的图标上释放的操作后,将图像441传输至“全局收藏”中。又例如,参考图19,电子设备接收到用户将文本521拖拽至“地图导航”图标522上释放后,将文本521传输至“地图导航”。又例如,参考图21,电子设备接收到将图像缩略图集612拖拽至“好友微信”的应用服务图标上释放的用户操作后,将图像缩略图集612中所包含的全部图像分享给微信好友。又例如,参考图22M,电子设备100可检测到用户拖动控件112到笔记应用图标并释放的用户操作,将目标文本111写入笔记应用。
参考步骤S7,电子设备的第一业务可以按照该服务的信息来启动服务,例如找到该服务的应用包名以启动该服务所属的应用,然后根据该服务的跳转URL跳转至该服务,然后将获取到的该服务的槽位值传递给该服务指定的参数,即可将第一内容分享至该服务。
举例来说,如果用户选中地图应用A的打车服务,则电子设备会将用户输入的地址“xx市xx区xx路xx号xx栋”通过“keyword”这一参数传递至打车服务,电子设备启动打车服务后,会显示终点填充为该地址的打车页面。
在图3B示出的流程中,依次调用的模块为第一业务入口、多模内容理解模块、意图识别模块、服务召回模块、服务排序模块、服务通知模块。在步骤S2之后电子设备将用户输入的内容由第一业务传输给上述各个模块,在步骤S7中服务通知模块将获取到的服务信息返回给第一业务。
第一业务给多模内容理解模块传输请求参数,该请求参数可包括调用方信息(如第一业务名称、第一业务的来源应用)、输入内容(如内容的类型、内容本身、内容所在文件的类型及路径)、服务的筛选规则(如服务类型、服务所属类型的安装状态、服务所属应用的可用状态)。其中,服务的筛选规则可用于步骤S5中服务召回模块查询服务,查询到的服务需满足该筛选规则,例如查询到的服务的类型需和筛选规则指示的服务类型一致、查询到的服务所属应用的安装状态和筛选规则指示的安装状态一致、查询到的服务所属应用的可用状态和筛选规则指示的可用状态一致。服务的筛选规则可以由发起请求的第一业务来指定。
服务通知模块返回的服务信息可参考步骤S7的相关介绍。
通过前文的介绍,可以获知图3B所示的框架中电子设备侧各模块的功能。
图3C示例性示出了用于推荐服务的框架的另一部分结构。
如图3C所示,该框架还可包括智慧云,智慧云可位于云设备侧。智慧云用于定义能力开放策略,还用于统计能力使用报表。能力开放策略指示了电子设备中开放服务推荐的策略,能力使用报表统计了电子设备中使用的各个能力的频率等信息,如各个服务、各个实体识别能力的使用频率。
电子设备的多模推荐服务还可包括能力开放管理模块、能力调用打点模块、鉴权/流控/校验模块、查询类模块、订阅类模块、服务分发模块、订阅状态管理模块、触发通知模块。上述各模块用于辅助图3B所示框架中多模推荐服务各模块的使用。
图3C所示的多模推荐服务中的多个模块,可位于图3B中多模推荐服务中各模块的上层或同侧,用于将图3B中多模推荐服务中各模块封装为统一接口,以供业务侧调用。
图3B所示的框架中包含意图自学习模块,这一模块的功能是主动学习新的意图类别,还可将学习到的新意图类别同步给决策云平台。下面将展开介绍该意图自学习模块的功能。
从图3B的步骤S4可知,电子设备可以通过输入内容的模态和实体类别来确定意图。
模态和/或实体类别到意图的映射关系通常根据人工经验预先制定,存在以下问题:
1.通过人工制定的映射规则得到的意图没有先后顺序,无法快速地找到用户所需的服务;
2.人工制定的映射规则可能不全,可能存在无法找到用户所需服务的情况;
3.用户的真正意图可能在决策云平台预定义的意图类别之外,人工制定的映射规则无法发现用户的新意图,无法找到用户所需的服务。
本申请提供了在电子设备推荐服务的过程,进行意图自学习的几种方法,可以分别解决上述的几个问题。
图3D示例性示出了该方法的整体流程。如图3D所示,该流程可包括:
S21.意图类别召回。
这一步骤的目的是从用户输入的内容中识别到对应的意图类别。识别的方式可包括以下几种:
(1)根据内容识别到相关联的意图类别。
电子设备可以理解内容的语义,根据该语义识别相关联的意图类别。例如,可以识别内容对应的实体,根据实体类别找到标签为该实体类别的意图类别。举例来说,如果输入内容为地址“xx市xx区xx路xx号xx栋”,则可以根据语义理解,识别到相关联的导航类意图、打车类意图。
(2)根据输入内容的模态识别到对应的通用意图类别。
电子设备还可以根据输入内容的模态来识别意图类别。例如,如果输入内容的模态为文本,则可识别到搜索类意图、笔记类意图。如果输入内容的模态为视频,则可以识别到播放类意图。模态和意图类别的映射关系,可以由人工根据经验制定。
(3)兜底意图类别。
兜底意图类别可以认为是经常使用到的意图类别,可以预定义。例如,可以对文本类的输入内容,可以预定义其相关的意图类别可包括打车类意图、导航类意图、点外卖类意 图,如果根据前两种识别方式已经识别到该文本类输入内容的意图类别包括打车类意图和导航类意图,则点外卖类意图就视为兜底意图类别。
S22.意图类别排序。
该步骤可以对前一步骤识别到的多个意图类别进行合并排序。
排序规则可以是预设规则,例如电子设备中可以预存已定义的各个意图类别的顺序。排序规则还可以按照用户的使用频率来确定,例如电子设备可以将用户使用频率越高的意图类别排在最前面。又例如,排序规则可以是依据上述三种识别方式依次排序,例如按照第(1)种识别方式识别的意图类别的排序最高,按照第(2)种识别方式识别的意图类别的排序居中,按照第(3)种识别方式识别的意图类别的排序最末。又例如,排序规则可以是等级越高的意图类别排序越靠前。
在一些实施方式中,电子设备可以基于点击率预估模型来对意图类别进行排序。点击率预估模型的作用为,将以下一个或多个特征作为输入:时间特征、用户输入内容的特征,输出决策云平台中已定义意图类别的排列顺序。该排列顺序可以反映在用户输入内容的时间和内容本身的影响下,预估的意图类别点击率顺序。
该点击率预估模型可以基于用户的多组历史行为数据来训练。每组历史行为数据都由多个样本分析而来。一个样本指电子设备为用户推荐服务后,用户是否点击(即选择选择)服务的信息。在样本中,可以用标签指示用户是否点击意图。这里需说明,用户点击的是电子设备推荐的服务的图标,该服务对应有支持的意图类别,因此也可以认为用户点击的是意图类别。
一组历史行为数据可包括以下几项:
1.时间特征:用于表示用户输入内容的时间是否是工作日,是否是节假日,以及输入内容的具体时段中的一项或多项。
2.内容特征:用于表示用户输入内容的来源APP、长度、实体类别、模态等中的一项或多项。
3.点击率特征:表示群体使用推荐服务的过程中,在符合上述时间特征和内容特征的情况下群体对各意图类别的点击率,该项可以从网络中搜集到;表示个体(例如电子设备的当前用户)使用推荐服务的过程中,在符合上述时间特征和内容特征的情况下用户对各意图类别的点击率。上述群体点击率和个体点击率可以融合处理。
在训练过程中,电子设备可以时间特征和内容特征为输入,以点击率特征作为标准输出,来训练点击率预估模型。使用多组历史行为数据训练后,可以得到一个可用的点击率预估模型。
该训练过程也可以由云侧执行,例如各个电子设备可以将历史行为数据上传给云决策平台,由云决策平台训练好点击率预估模型后,将点击率预估模型下发给各电子设备。
训练好的点击率预估模型可以执行步骤S22。具体的,电子设备可以提取当前用户输入内容的时间特征和内容特征,将这两个特征输入至点击率预估模型,然后点击率预估模型就能输出已定义意图类别的排列顺序。然后,电子设备可以根据该排列顺序,获取S21中识别到的意图类别的排列顺序。
步骤S22可以对上述提及的第1个问题。电子设备对意图类别排序后,后续步骤可以 按照排序的意图类别为用户推荐服务,让推荐出来的越靠前的服务越能够满足用户的实际意图,让用户更方便、快速地找到其所需的服务。
S23.服务排序。
电子设备可以首先参考图3B中的步骤S5,查询到意图对应的服务,然后再参考S6对查询到的多个服务进行排序。不同之处在于,在图3D所示的流程中,电子设备可以根据S22中意图类别的排序来对各个服务排序。
例如,电子设备可以获取到S22中每个意图类别对应的服务,先按照意图类别的顺序对这些服务粗略排序,然后再对每一个意图类别中的服务按照S6中的策略来进一步排序。
S24.电子设备显示经过排序后的服务的图标。
S25.电子设备获取在推荐服务并且用户未点击推荐服务的图标之后,用户的行为数据。
电子设备推荐服务之后,如果用户未点击推荐服务的图标,则说明电子设备推荐的服务无法满足用户的实际需求,因此电子设备需要对推荐服务的前序步骤进行改进。
电子设备推荐的服务无法满足用户的实际需求的原因及对应的解决方案可包括以下两种:
1.决策云平台预定义的映射关系中,未包括用户输入内容的实体类别和/或模态到某个意图类别的映射关系,那么即使决策云平台定义了该意图类别,电子设备也无法从当前输入的内容中识别到该意图类别,也就无法推荐用户所需的服务。
为了解决该问题,电子设备会根据用户的历史行为数据来学习实体类别和/或模态到已定义的意图类别的映射关系,作为映射关系的补充召回。
用户的历史数据包括多组,每组行为数据均可包括:用户输入某个类别的实体(如第一实体类别)和/或某个模态(如第一模态)的内容,电子设备推荐服务之后,在用户未点击推荐服务的图标的情况下,一段时间内用户手动打开服务的行为数据。该一段时间可以根据实际需求设置,例如可以为5min。上述的一段时间可以从电子设备关闭第一业务开始计算,例如可以从停止推荐服务的时间开始计算。
在电子设备推荐的服务无法满足用户需求时,用户可能会手动打开自己需要的服务,因此上述历史数据可用于补充实体类别和/或模态到已定义的意图类别的映射关系。具体的,电子设备可以统计用户的历史数据中,用户手动打开的属于服务管理框架已支持且用户手动打开频率最高的K个服务,并确认这些服务对应的意图类别和用户输入内容的实体类别和/或模态间存在映射关系,并可将该映射关系作为补充信息召回。K可以按需设置,这里不做限定。在统计服务时,在属于服务管理框架支持的服务中统计并非是必要的,也可以在全服务范围内统计。
在一个具体示例中,电子设备先统计用户输入视频后的历史数据,即用户向电子设备输入视频后,在用户未点击推荐服务的图标的情况下,用户手动打开服务的行为序列。视频的实体类别和模态均为视频。之后,用户手动打开了美团团购、淘宝拍立淘、百度搜索、美团秀秀、京东拍照购等服务。然后,电子设备从用户手动打开的各个服务中,过滤出服务管理框架已支持的服务,例如可包括美团团购、百度搜索、淘宝拍立淘、京东拍照购。然后再对过滤出来的服务进行打开频率的排序,找到在上述过程中打开频率最高的K个服务,确定视频类实体类别和/或视频模态到该K个服务支持的意图类别存在映射关系,并将 该映射关系补充到电子设备本地的映射关系中。
在一些实施方式中,电子设备还可以将本地学习到的映射关系上传到决策云平台,这样决策云平台可以统计多个电子设备学习到的映射关系,让映射关系更为完善。
上述第1种解决方案针对实体类别和/或模态到意图类别的映射关系不全的情况,提出了一种映射关系的挖掘方法,从推荐后未点击的后续行为中挖掘出映射关系,从而对映射关系进行补充召回。
2.决策云平台预定义的意图类别中,未包括用户真实意图所属的意图类别,因此电子设备也无法识别到该意图类别,也就无法推荐用户所需的服务。
为了解决该问题,电子设备可以根据用户的历史行为数据来学习新的未被决策云平台定义的意图类别,并学习实体类别和/或模态到该新的意图类别之间的映射关系,作为意图类别的补充及映射关系的补充。
用户的历史数据可参考前文第1点中的相关描述。
具体的,电子设备可以在用户的历史数据中,先筛选出用户手动打开的服务管理框架不支持且支持输入内容(如支持储物文本、图片、文件等)的服务,然后在这些服务中筛选出用户手动打开频率最高的N个服务。然后,电子设备可以根据该N个服务定义新的意图类别,作为意图类别的补充。该N个服务能够满足属于新意图类别的意图。并且,电子设备还可以将该新的意图类别作为上述映射关系的补充召回。N可以按需设置,这里不做限定。在统计服务时,在属于服务管理框架不支持的服务中统计并非是必要的,也可以在全服务范围内统计。
在一个具体的示例中,电子设备先统计用户输入视频后的历史数据,即用户向电子设备输入视频后,在用户未点击推荐服务的图标的情况下,用户手动打开服务的行为序列。视频的实体类别和模态均为视频。之后,用户手动打开了美团购票、淘票票、豆瓣影评、文心一言、微信读书等服务。然后,电子设备从用户手动打开的各个服务中,过滤出服务管理框架不支持且同时支持输入内容的服务,例如可包括美团购票、淘票票、豆瓣影评、文心一言。然后再对过滤出来的服务进行打开频率的排序,找到打开频率最高的N个服务,该N个服务例如可包括美团购票和淘票票。然后,电子设备可根据该N个服务定义新的意图类别,该新的意图类别例如可以是购买电影票的意图类别。之后,电子设备可以将该购买电影票的意图类别补充到预定义的意图类别中,还可确定视频类实体类别和/或视频模态到该购买电影票的意图类别存在映射关系,并将该映射关系补充到电子设备本地的映射关系中。在一些实施方式中,智慧服务平台还可以获取第三方定义的上述N个服务的信息,便于后续将这些服务的信息分享给电子设备的服务管理框架,从而让电子设备能够根据补充的新的意图类别找到这些服务。
在一些实施方式中,电子设备还可以将本地学习到的新的意图类别和映射关系上传到决策云平台,这样决策云平台可以统计多个电子设备学习到的意图类别映射关系,让映射关系更为完善。
上述第2种解决方案,针对用户的实际意图超出决策云平台已定义意图类别的范围的情况,提出了一种新意图类别的挖掘方法,从推荐后未点击的后续行为中挖掘出潜在的未定义的新意图类别,并且定义该新的意图类别与实体类别和/或模态之间的映射关系,从而 对意图类别和映射关系进行补充召回。
图4为用户基于“跨应用传输界面”对文字进行跨应用传输时电子设备的界面变化过程的示意图。
如图4中的(A)所示,用户界面11可以是电子设备中应用“浏览器”的应用界面,也可以是应用的应用界面,还可以是其他应用的应用界面,本申请对此不作限定。用户界面11可以包括文本111、文本112、图像113以及文本选项列表114,其中:
文本111为用户期望传输到其他应用中的文字,因此该部分文本此时已被用户选中而处于深色区域中;相应的,文本112即为未被选中的文字。需理解,不同于图片的独立性,文本本身就具有连续性。对于一整段的文字,用户在对文字进行分享往往可能只需要整段文字中的一部分文字。因此,尽管图4中未示出,在对用户界面11中的文本进行选择时,用户可以通过对用户界面11中任意的文本信息进行长按操作,在首光标111A以及尾光标111B出现后,通过调整首光标111A以及尾光标111B的位置来完成对文本的选择。如图4中的(A)所示,用户已经通过调整首光标111A以及尾光标111B的位置将文本111选中。
文本选项列表114包括复制选项、全选选项、搜索选项、翻译选项以及分享选项。任何一个选项均可用于响应用户的操作,例如点击操作,使得电子设备执行选项对应的操作。
与将图片的拖起操作一样,电子设备同样可以响应于用户对文本111的用户操作,例如图4中的(A)所示的长按后拖动的操作,显示如图4中的(B)所示的用户界面12。
如图4中的(B)所示,在用户界面12中,原来的文本111在用户的长按操作下得到被托起的文本121,在用户不松手的情况下,文本121可以随着用户的指尖在用户界面12中移动,且文本121可以置顶显示在用户界面12中(即文本121可以将用户界面08中任意元素覆盖)。需要理解的是,文本111所包含的文字内容与文本121所包含的文字内容是一样的。可选的,文本121也可以是电子设备对文本111进行缩小之后所得的文本,且在文本111被拖起形成文本121之后,电子设备可以依旧将文本111显示在用户界面12中,并对文本111进行虚化处理或模糊处理,即在用户界面12中文本111的清晰度可以比用户界面11中图像文本111的清晰度更低,以提示用户文本111已处于被选中并被拖起的状态。
电子设备可以响应于用户对文本121的用户操作,例如图4中的(B)所示的拖动操作,显示如图4中的(C)所示的用户界面13。如图4中的(C)所示,用户界面13即为前述说明中提及的跨应用传输界面,其可以包括子界面131、图标区域132以及文本133。其中:
子界面131以及图标区域132的具体样式和功能可以参考前述对图3A中用户界面09的相关说明,此处不再赘述。
需要特别说明的是,文本133所所包含的文字内容与文本111、文本121所包含的文字内容是一样的。但从用户界面12以及用户界面13中可以看出,文本133是电子设备对文本121进行缩小后所得的文本;即在“跨应用传输界面”打开之后,电子设备同样对用户拖起的文本进行了一定程度的缩小,这样文本133就不会对图标区域132中的图标和文字造成大面积的遮挡,更便于用户进行选择。
同理,在用户界面13中,用户将拖起的信息元素(即文本133)放置在图标区域132中对应的图标上并松手,电子设备即可响应于该用户操作将该信息元素传输到图标对应的 应用服务中,并显示与应用服务图标对应的应用界面或者反馈信息。
当然,在电子设备处于横屏状态时,用户依旧可以通过“跨应用传输界面”对当前界面上的元素进行跨应用传输,其具体的过程以及界面样式可以参考前述对图2、图3A的相关说明以及图5所示的用户界面14、用户界面15,这里不再做过多的赘述。
需理解,目前大部分的智能设备都为用户提供了快捷的截图功能,例如在一些场景中,用户可以通过双击屏幕或三指下滑来对电子设备当前的界面进行全屏截图;此外,在用户截屏之后,一些智能设备还在该场景下为用户提供了识别功能,用于对用户所截图像进行识别(例如提取图片中的文字或者翻译文字等)。因此,针对电子设备提供的截屏功能,接下来结合图6以及图7对截屏场景下使用跨应用传输界面对所截图像或所截图像中的文字进行跨应用传输的过程进行说明。
图6为用户基于跨应用传输界面对所截图像进行跨应用传输时电子设备的界面变化过程的示意图。
如图6中的(A)所示,用户界面16可以是电子设备中应用“浏览器”的应用界面,也可以是应用的应用界面,还可以是其他应用的应用界面,本申请对此不作限定。响应于用户对用户界面16的快速截屏操作,例如图6中的(A)所示的指关节双击操作,电子设备可以快速获取用户界面16的全屏图像,并显示如图6中的(B)所示的用户界面17。
如图6中的(B)所示,用户界面17中可以包括截屏图像171。截屏图像171即为电子设备响应于用户对用户界面16进行指关节截屏所获得的图像。在截屏之后,截屏图像171可以显示在用户界面17中,且一般会持续两到三秒,以便于用户能直接点击截屏图像171以对其进行编辑、保存等操作;若用户并未对截屏图像171进行操作,则电子设备可以自动将其保存至相册中。
而在本申请实施例中,在电子设备将截屏图像171显示在用户界面17中的这段时长内,用户可以对截屏图像171进行长按操作后拖动或者直接拖动,将其拖动至电子设备屏幕的侧边后,通过“跨应用传输界面”对其进行跨应用传输。如图6中的(B)所示,电子设备可以响应于用户对截屏图像171的拖动至侧边的操作,显示如图6中的(C)所示的用户界面18。
如图6中的(C)所示,用户界面18即为跨应用传输界面。用户界面18可以包括子界面181、图标区域182、图像183,其中:
子界面181以及图标区域182的具体内容和功能可以参考前述说明,此处不再赘述。
同理,为了不对图标区域182造成过多的遮挡,在截屏图像171靠近图标区域时,电子设备对原先的截屏图像171进行了缩小,得到了图像183。
同样的,在用户界面18中,用户将图像183放置在图标区域182中对应的图标上并松手,电子设备即可响应于该用户操作将该信息元素传输到图标对应的应用服务中,并显示与应用服务图标对应的应用界面或者反馈信息。
若用户在将图像183放置在图标区域182中对应的图标上之前松手,则电子设备可以响应于该操作,重新显示用户界面17。
本申请实施例中,用户界面16可以被称为“第五界面”,用户界面17可以被称为“第六界面”,截屏图像171或图像183均可以被称为“第一图像”,用户界面18可以被称为“第七界面”,用户将图像183放置在图标区域182中对应的图标上并松手的操作可以被称为“第九操作”。
图7为用户基于跨应用传输界面对所截图像中的文字进行跨应用传输时电子设备的界面变化过程的示意图。
如图7中的(A)所示,用户界面19可以是电子设备中应用“浏览器”的应用界面,也可以是应用的应用界面,还可以是其他应用的应用界面,本申请对此不作限定。响应于用户对用户界面19的快速截屏操作,例如图7中的(A)所示的指关节框选操作(即利用指关节在屏幕中画出一个区域),电子设备可以快速获取用户利用指关节框选出的图像,并显示如图7中的(B)所示的用户界面20。
如图7中的(B)所示,用户界面20中可以包括缩略图201、局部截屏框202,识别控件203、分享控件205以及形状选项框204。其中:
缩略图201可以是前述用户界面19的缩略图。
局部截屏框202即为电子设备响应于用户对用户界面19的指关节框选截屏操作所确定的截屏区域,用户可以通过拖动局部截屏框的边缘对局部截屏框202的边缘进行调整,还可以按住局部截屏框202的中心区域调整局部截屏框在缩略图201中的具体位置。需理解,对于电子设备而言,此时局部截屏框202仅用于对缩略图211中的图像进行框选,电子设备并不能获取到局部截屏框202中图像所包含的信息(例如文本信息)。
识别控件203用于对局部截屏框202中的图像所包含的文本信息进行识别。
分享控件205用于对局部截屏框202中的图像进行分享。
形状选项框204包括自由图形选项、矩形选项、椭圆形选项以及心形选项,电子设备可以响应于用户对任意一个选项的触摸操作,例如点击操作,将局部截屏框202的具体形状调整为选项对应的形状。
如图7中的(B)所示,电子设备可以响应于用户对识别控件203的点击操作,对局部截屏框202中的图像所包含的文本信息进行识别。在对文本信息进行识别之后,局部截屏框202中的图像所包含的文本信息可以被首光标和尾光标框选中,具体可以参考图7中的(C)用户界面21中文本框212中所显示的内容。之后,用户可以对识别所得的文本信息进行长按操作,并将其拖动至电子设备屏幕的侧边,通过“跨应用传输界面”对识别所得的文本进行跨应用传输。
如图7中的(C)所示,用户界面21可以包括缩略图211、局部截屏框202、文本2121以及文本信息213,其中:
缩略图211可以是前述用户界面19的缩略图。
局部截屏框202即为前述说明中的局部截屏框202。局部截屏框202所框选的图像中的文本信息已经被电子设备识别并提取,这部分文本即为图7中的(C)所示的文本2121。
文本213为用户对文本信息211进行长按操作(图7中未示出)后拖起的文本。如图7中的(C)所示,在用户将文本213拖起后,用户可以将文本信息213拖拽至电子设备屏幕 的侧边,电子设备即可响应于该用户操作,显示如图7中的(D)所示的用户界面22。
如图7中的(D)所示,用户界面22即为跨应用传输界面。用户界面22可以包括子界面221、图标区域222、文本223,其中:
子界面221以及图标区域222的具体内容和功能可以参考前述说明,此处不再赘述。
同理,为了不对图标区域222中造成过多的遮挡,在文本223靠近图标时,电子设备对文本213进行了缩小,得到了文本223。
同样的,在用户界面22中,用户将文本223放置在图标区域222中对应的图标上并松手,电子设备即可响应于该用户操作将文本223传输到图标对应的应用服务中,并显示与应用服务图标对应的应用界面或者反馈信息。
本申请实施例中,用户界面19可以被称为“第八界面”,用户界面20可以被称为“第九界面”,文本2121、文本223、文本213均可以被称为“第一文本信息”,识别控件203可以被称为“文本识别控件”,用户界面21可以被称为“第十界面”,用户将文本信息213拖拽至电子设备屏幕的侧边的操作可以被称为“第十操作”,用户界面22可以被称为“第十一界面”,用户将文本223放置在图标区域222中对应的图标上并松手的操作可以被成为“第十一操作”。
当然,用户通过局部截屏功能所截取的图像也可以通过跨应用传输界面进行传输。图8示出了用户将局部截屏功能截取的图像通过跨应用传输界面进行分享的过程。
如图8中的(A)所示出的用户界面20即为前图7中的(B)所示出的用户界面20。结合图8以及前述说明可知,用户界面20中可以包括缩略图201、局部截屏框202,识别控件203、分享控件205以及形状选项框204。其中,局部截屏框202即为电子设备响应于用户对用户界面19的指关节框选截屏操作所确定的截屏区域。需要理解的是,虽然局部截屏框202中包含文字,但是由于此时用户并没有点击识别控件203,因此局部截屏框202所截取的是包含文字的图像。同样的,如图8中的(A)所示,用户可以对局部截屏框202所截取的图像进行长按后拖动的操作,并将其拖动至电子设备屏幕的侧边,通过“跨应用传输界面”对局部截屏框202所截取的图像进行跨应用传输。
如图8中的(B)所示,用户界面23即为跨应用传输界面。用户界面23可以包括子界面231、图标区域232、图像233,其中:
子界面231以及图标区域232的具体内容和功能可以参考前述说明,此处不再赘述。
同理,为了不对图标区域232中造成过多的遮挡,在局部截屏框202中的图像被拖起并靠近图标时,电子设备可以对局部截屏框202中的图像进行缩小,得到了图像233。需要说明的是,在利用“跨应用传输界面”对局部截屏框202中的图像进行分享时,局部截屏框202的形状会被保留下来,即图像233的形状与局部截屏框202所显示出来的形状是一样的。
同样的,在用户界面23中,用户将图像233放置在图标区域232中对应的图标上并松手,电子设备即可响应于该用户操作将图像233传输到图标对应的应用服务中,并显示与应用服务图标对应的应用界面或者反馈信息。
本申请实施例中,用户界面20可以被称为“第六界面”,用户界面23可以被称为“第 七界面”,用户将图像233放置在图标区域232中对应的图标上并松手的操作可以被称为“第九操作”。
需理解,在日常使用电子设备的过程中,用户也经常会对一些元素进行拖拽操作,因此,如何为结合用户操作为跨应用传输界面确定相应的触发规则,并结合用户的操作习惯引导用户触发电子设备显示“跨应用传输界面”,是进一步提升用户与电子设备交互效率的关键。因此,接下来将结合图9-图11,来对跨应用传输界面的触发规则进行说明。
图9为本申请实施例提供的一种用于说明跨应用传输界面触发规则的示意图。
如图9中的(A)所示,用户界面24可以是电子设备中应用“浏览器”的应用界面,也可以是应用的应用界面,还可以是其他应用的应用界面,本申请对此不作限定。
接下来以用户界面24的图像241为例进行说明。如图9中的(A)所示,结合前述说明可知,用户可以通过对图像241的长按操作将图像241拖起。响应于用户对图像241的拖起操作,电子设备可以显示如图9中的(B)所示的用户界面25。
如图9中的(B)所示,用户界面25可以包括图像241、图像251、左触发区域252L以及右触发区域252R,本申请实施例中,左触发区域252L以及右触发区域252R可以一起被称为“第一触发区域”,其中:
图像251为用户将图像241拖起后形成的缩略图,在用户不松手的情况下,图像251可以随着用户的指尖在用户界面08中移动,具体可参考前述相关说明,此处不再赘述。
左触发区域252L为以电子屏幕的左边界为界的矩形区域,右触发区域252R为以电子屏幕的右边界为界的矩形区域。具体的,左触发区域252L的长可以为d1,宽可以为W;右触发区域252R的长可以为d1,宽可以为W。其中,d1可以被设定为电子设备屏幕的宽度的25%,如图9中的(A)所示,屏幕的宽度为L,W可以为电子设备屏幕的高度,如图9中的(A)所示,屏幕的高度为h。需要说明的是,在用户界面25中,左触发区域252L以及右触发区域252R被显示为深色透明区域仅为了便于用户理解这两个区域的具体位置和面积,在实际的应用场景中,这两个区域的具体大小位置可以不显示在用户界面中,即用户在用户界面25中并不能直接观察到这两个区域的具体轮廓,这两个区域的大小、位置可以仅以电子设备可感知(例如程序代码)的形式存储在电子设备中。
当用户将图像251拖动到左触发区域252L或右触发区域252R中时,电子设备可以在屏幕的边缘显示出特效;可选的,电子设备也可以在用户将图像251拖动到左触发区域252L或右触发区域252R中、并将图像在左触发区域252L或右触发区域252R中持续停留时长T之后,在屏幕的边缘显示出特效,以提示用户将图像进一步将图像往更靠近屏幕侧边的方向拖动。具体的,上述T可以被设定为600毫秒。
需理解,这里所说的“将图像251拖动到左触发区域252L或右触发区域252R中”表示用户将图像251拖动后用户手指与屏幕的触点(即锚点)进入左触发区域252L或右触发区域252R即可,并非代表图像251完全进入左触发区域252L或右触发区域252R。
如图9中的(B)所示,当用户将图像241拖入右触发区域252R中时,电子设备可以响应于该操作,显示如图9中的(C)所示的用户界面26。用户界面26中可以包括图像241、图像251以及特效区域261。其中,特效区域261可以显示有发光特效、阴影特效等用户 可视的特效,也可以显示有其他用户可感知的特效,本申请对此不作限定。
结合前述说明可知,上述特效区域261的可以提示用户将图像进一步将图像往更靠近屏幕侧边的方向拖动,以触发“跨应用传输界面”界面将元素传输到其他应用。因此,在本申请实施例中,在元素被拖起后,用户界面中还设有开门区域,当用户将拖起的元素进一步拖动到开门区域时,电子设备可以响应于该操作,显示跨应用传输界面。如图9中的(C)所示的,当用户将图像251向右侧拖动,直至进入开门区域,电子设备即可响应于该操作,显示如图9中的(D)所示的用户界面27。
如图9中的(D)所示的用户界面27所示,用户界面27可以包括图像241、图像251、左开门区域271L以及右开门区域271R,本申请实施例中,左开门区域271L以及右开门区域271R可以一起被称为“第二触发区域”,其中:
左开门区域271L为以电子屏幕的左边界为界的矩形区域,右开门区域271R为以电子屏幕的右边界为界的矩形区域。具体的,左开门区域271L的长为d2,宽为W;及右开门区域271R的长也d2为,宽也为W,其中,d2可以被设定为36个像素单位,W可以为电子设备屏幕的高度。需要说明的是,在用户界面27中,左开门区域271L以及右开门区域271R被显示为深色透明区域仅为了便于读者理解这两个区域的具体位置和面积,在实际的应用场景中,这两个区域的具体大小位置可以不显示在用户界面中,即用户在用户界面27中并不能直接观察到这两个区域的具体轮廓,这两个区域的大小、位置可以仅以电子设备可感知(例如程序代码)的形式存储在电子设备中。
当用户将图像251拖动到左开门区域271L或右开门区域271R中时,电子设备可以即刻响应于该操作,显示跨应用传输界面,即图9中的(E)所示的用户界面28。如图9中的(E)所示,用户界面28包括子界面281、图标区域282以及图像283。其中:
子界面281中所显示的元素内容,例如文本、图片等,与用户界面24中所显示的元素内容(除状态栏之外)一样。子界面281的具体内容和功能可以参考前述相关说明,此处不再赘述。
电子设备可以在图标区域282显示一个或者多个基于用户选中的元素(在本申请实施例中即图像241)推荐的应用服务图标。此外,图标区域282可以为以电子屏幕的右边界为界的矩形区域。具体的,图标区域282的长和宽可以分别为d3和W,其中,d3大于前述d2。具体的,d3可以被设定为120个像素单位,W可以为电子设备屏幕的高度(即前述说明中的h)。同理,在用户界面28中,图标区域282被显示为深色透明区域仅为了便于用户理解该区域的具体位置和面积,在实际的应用场景中,该区域的具体大小位置可以不显示在用户界面中,即用户在用户界面28中并不能直接观察该区域的具体轮廓,该区域的大小、位置可以仅以电子设备可感知(例如程序代码)的形式存储在电子设备中。
图像283所显示的图像内容与图像251以及图像241所显示的图像内容是一样的,只是在面积大小上有区别。需要说明的是,相较于用户界面25至用户界面27中的图像51而言,用户界面28中的图像283面积更小,这是因为在电子设备在显示用户界面28时,将原先用户界面27中的图像251进行了缩小,以防止图像过大对图标区域282中的图标以及文字造成遮挡,干扰用户的选择。也就是说,图像241在整个跨应用传输的过程中可以被缩小两次,第一次发生在用户将其拖起时,具体可以参考图9中的(B)中图像251以及图 像241,第二次发生在电子设备开始显示“跨应用传输界面”时,具体可以参考图9中的(D)所示的图像251以及图9中的(E)所示的图像283。
在用户界面28中,用户将拖起的信息元素(即图像283)放置在图标区域282中对应的图标上并松手,电子设备即可响应于该用户操作将该信息元素传输到图标对应的应用服务中,并显示与应用服务图标对应的应用界面或者反馈信息,后续会对此进行更为详细的说明,此处先不赘述。
此外,为了能引导用户将拖起的元素精准地放入到自己需要的应用服务中,在用户界面28中,当用户拖拽图像283靠近图标区域282中的某个图标时,或者说图像283与图标区域282中的某个图标的距离小于某个阈值时,这个被图像283靠近的图标可以显示出一定的特效,例如该图标和该图标对应的文字可以被图像283吸附靠近,并且可以被放大。
如图9中的(E)所示,在用户界面28中,当用户将图像283拖向“好友微信”图标之后,电子设备可以显示如图9中的(F)所示的用户界面29。从用户界面29中的图标区域282可以看出,当图像283向“好友微信”图标284靠近后,“好友微信”图标284以及其对应的文字285相较于其他的图标和文字更靠左一些,即比其他图标和文字更靠近图像283;此外,“好友微信”图标284也被放大,以提示用户若在此处松手,图像283(或者说图像241)将被传输至“好友微信”图标对应的应用(即微信)或应用服务(微信-好友聊天)中。
此外,在跨应用传输界面被打开的情况下,用户还可以通过相应的操作退出跨应用传输界面,具体请参考图10和图11。
图10示出了用户通过关门区域退出跨应用传输界面的过程。
如图10中的(A)所示,用户界面31可以是用户将历史界面中的图像拖起并拖拽至侧边后电子设备显示的跨应用传输界面。用户界面31中包括子界面311、图标区域312、关门区域313以及图像314,其中:
子界面311为图像314所在的原始界面进行变换所得的界面;
图标区域312为用于显示一个或者多个电子设备基于用户选中的元素(在本申请实施例中即图像314)推荐的应用服务图标的区域。其具体样式和功能可以参考前述对图9的相关说明,此处不再赘述。
关门区域313可以为以电子屏幕的左边界为界的矩形区域。具体的,关门区域313的长和宽可以分别为d4和W。具体的,d4可以被设定为电子设备屏幕的宽度(即前述说明中的L)的一半,W可以为电子设备屏幕的高度(即前述说明中的h)。同理,在用户界面31中,图标区域312以及关门区域313被显示为深色透明区域仅为了便于用户理解该区域的具体位置和面积,在实际的应用场景中,这两个区域的具体大小位置可以不显示在用户界面中,即用户在用户界面31中并不能直接观察到这两个区域的具体轮廓,这两个区域的大小、位置可以仅以电子设备可感知(例如程序代码)的形式存储在电子设备中。
如图10中的(A)所示,当用户将图像314拖拽至关门区域313中之后,若用户此时依旧按住图像314未松手,则电子设备可以关闭“跨应用传输界面”,并显示如图10中的(B)所示的用户界面32。
如图10中的(B)所示,用户界面32可以包括图像321、图像322,其中:
图像321即为用户刚将图像322拖起时所得的缩略图。不同于图像314,图像321为电子设备将图像322进行一次缩小所得的缩略图,而图像314是电子设备在跨应用传输界面被打开后,对图像321进行二次缩小所得的缩略图。
在用户未将图像321松开的情况下,用户可以将图像321拖拽至屏幕的侧边再次触发显示跨应用传输界面。
图11示出了用户通过直接松手退出跨应用传输界面的过程。
如图11中的(A)所示,用户界面33可以是用户将历史界面中的图像拖起并拖拽至侧边后电子设备显示的跨应用传输界面。用户界面33中包括子界面331,图标区域332、关门区域333以及图像334,其中:
子界面331以及关门区域333的具体功能可以参考前述相关说明,此处不再赘述。
不难理解的,当d4和d3的总长度小于电子屏幕的宽度L时,则在用户界面33中还存在一部分区域,这部分区域既不属于图标区域332,也不属于关门区域333。在用户界面33中,这部分区域可以是长为d5,宽为h的矩形区域335。
如图11中的(A)所示,当用户将图像334拖拽矩形区域335中之后,若用户此时直接松手,则电子设备可以关闭“跨应用传输界面”,并显示如图11中的(B)所示的用户界面34。
如图11中的(B)所示,用户界面34即为图像314所在的原始界面。其可以包括图像341,与前述说明中的用户界面32不同的是,由于用户已经松手,用户界面34中不再显示用户对图像341拖起所得的缩略图。若用户之后想要再次通过“跨应用传输界面”将图像341传输至其他应用,则用户需要再次对图像341进行长按操作将其拖起得到对应的缩略图,并将该缩略图拖拽至屏幕的侧边才能再次触发跨应用传输界面。
在后续实施例中,用户触发“跨应用传输界面”的具体操作以及关闭“跨应用传输界面”以及电子设备相应的界面变化过程可以参考前述实施例的相关说明,后续不再赘述。
需理解,在日常使用电子设备的过程中,用户也经常会对一些元素进行拖拽操作。例如,当用户使用“智慧分屏”功能打开两个应用界面之后,或者以小窗口或者“画中画”的形式打开两个应用界面之后,用户也经常会在这种模式下进行信息的跨应用传输;且在本申请实施例中,在分屏状态下以及小窗口状态下,用户可以直接通过分屏功能完成信息的跨应用传输,也可以使用本申请提供的“跨应用传输界面”完成信息的跨应用传输。结合前述对“跨应用传输界面”触发规则的相关说明,接下来针对电子设备在分屏状态下以及小窗口状态下进行信息跨应用传输的不同方式进行说明,具体请参阅图12-图15。
图12示出了在分屏状态下用户通过电子设备分屏功能完成信息的跨应用传输的过程。
如图12中的(A)所示,用户界面35包括第一显示区域351以及第二显示区域352。其中,第一显示区域351中用于显示应用“笔记”的应用界面,第二显示区域352用于显示应用“相册”的应用界面。本申请实施例中,用户界面35可以被称为“第一界面”,第一显示区域351可以被称为“第二子界面”,第二显示区域352可以被称为“第一子界面”。
此时,用户对第二显示区域352中的图像3521进行了长按操作并将其拖拽起,得到了图像3521的缩略图3522。本申请实施例中,图像3521或者缩略图3522可以被称为“第一信息”。此外,结合前述说明可知,在图像3521被拖拽起之后,用户界面35中可以存在两对判定区域,分别为用户界面35中区域353L以及区域353R,以及用户界面35中虚线框中框选的区域354L以及区域354R。其中,区域353L以及区域353R分别为左触发区域以及右触发区域;区域354L以及区域354R分别为左开门区域以及右开门区域。本申请实施例中,区域353L以及区域353R可以一起被称为“第一触发区域”,区域354L以及区域354R可以一起被称为“第二触发区域”结合前述说明可知,当用户将图像3522拖动到左触发区域354L或右触发区域354R中并持续停留时长T之后,电子设备可以在屏幕的边缘显示出特效;当用户将图像3522继续拖动到左开门区域354L或右开门区域354R中时,电子设备则会响于应该操作显示相应的跨应用传输界面。然而,若用户在不让图像3522触碰到左开门区域354L和右开门区域354R的情况下,将图像3522从第二显示区域352拖入第一显示区域351中时,电子设备依旧可以将图像3522(或者说图像3521)传输至“笔记”应用中,并将其显示在第一显示区域351中。
如图12中的(A)所示,用户可以按照图12中的(A)所示的虚线箭头所指示的方向将图像3522拖拽至第一显示区域351中。本申请实施例中,将图像3522拖拽至第一显示区域351中的操作可以被称为“第一操作”;在这个过程中,只要图像3522不触碰到左开门区域354L和右开门区域354R,图像3522就可以在不打开“跨应用传输界面”的情况下直接将图像3522(或者说图像3521)传输至“笔记”应用中,并将其显示在第一显示区域351中,具体可以参考图12中的(B)所示出的用户界面36。需要说明的是,即使在这个过程中图像3522短暂地触碰到左开门区域354L或右开门区域354R,电子设备也只会在侧边显示出相应的特效,并不会直接触发“跨应用传输界面”。
同样以前述说明中的用户界面35为例,图13示出了在分屏状态下用户通过电子设备“跨应用传输界面”完成信息的跨应用传输的过程。
如图13中的(A)所示,用户界面35所包含的元素内容以及各元素的功能作用可以参考前述对图12的相关说明此处不再赘述。但是不同于图12中所示的对选中元素(即图像3522)的拖拽方式,由于用户此刻希望通过“跨应用传输界面”将图像3522传输至其他的应用中,这个应用可以不是“笔记”应用,因此,如图13中的(A)和(B)所示,用户可以按照图13中的(A)所示的虚线箭头所指示的方向将图像3522拖拽至右开门区域354R;在图像3522进入右开门区域354R时,电子设备可以即刻显示如图13中的(C)所示的用户界面37。
如图13中的(C)所示,用户界面37可以包括子界面371、图标区域372以及图像373。
其中:
子界面371的具体内容和功能可以参考前述相关说明,此处不再赘述。但是需要特别说明的是,在分屏状态下,用户通过操作触发“跨应用传输界面”之后,子界面371中显示画面依旧为分屏模式,其依旧包含两个显示区域,即图13中的(C)所示的第一显示区域3711以及第二显示区域3712。
图标区域372的具体内容和功能可以参考前述相关说明,此处不再赘述。
图像373所显示的图像内容与图像3521以及图像3522所显示的图像内容是一样的,只是在面积大小上有区别。
在用户界面37中,用户将拖起的信息元素,即图像373,放置在图标区域372中对应的图标上并松手,电子设备即可响应于该用户操作将该信息元素传输到图标对应的应用服务中,并显示相应的应用界面。本申请实施例中,用户界面35可以被称为“第一界面”,图像3521缩略图3522、或图像373可以被称为“第一信息”,将图像3522拖拽至右开门区域354R中的操作可以被称为“第二操作”,将图像373放置在图标区域372中对应的图标上并松手的操作可以被称为“第三操作”,用户界面37可以被称为“第二界面”,用户界面37中图标区域372中所显示的图标可以被称为“至少一个应用服务图标”。
同理,在电子设备处于小窗口的多窗状态下,用户也可以通过多窗功能或是“跨应用传输界面”完成信息的跨应用传输的过程。图14和图15分别示出了在小窗口状态下用户通过电子设备的分屏功能以及“跨应用传输界面”完成信息的跨应用传输的过程。在小窗口状态下,电子设备所显示的用户界面可以包括两个不同应用的应用界面,其中一个应用的应用界面全屏显示,另一个应用的应用界面在置顶的小窗口(悬浮窗)中显示。在小窗口状态进行信息跨应用传输时,用户可以通过多窗功能直接将一个应用界面中的元素拖拽至另一个应用界面中,其具体操作过程与图12中分屏状态下进行跨应用传输的操作过程类似。可以理解的,在小窗口状态下下,信息的传输方式可以是从置顶的小窗口(悬浮窗)中拖拽至全屏显示的界面中,也可以是从全屏显示的界面中拖拽至置顶的小窗口(悬浮窗)中。此外,在小窗口状态下,用户也可以通过“跨应用传输界面”进行传输,其具体操作过程图13所示的操作过程类似,因此这里不再做过多的赘述,具体可以参阅图14和图15,并结合前述对图12、图13的相关说明进行了解。
在使用“跨应用传输界面”对信息进行跨应用传输之后,电子设备还可以根据信息所进入应用服务的种类以及信息传输的结果为用户提供不同的提示方式、显示不同的界面效果。接下来结合图16-图21对用户使用“跨应用传输界面”对信息进行跨应用传输之后,电子设备可能显示的界面样式进行说明。
①传输完之后采用snack bar提示用户,请参阅图16。
如图16中的(A)所示,用户界面41为用户对图像411进行跨应用传输的跨应用传输界面。用户此时正将拖起的信息元素,即图像411,放置在右侧“笔记”的图标上。
随着用户松手,电子设备可以响应于该用户操作,将图像411传输至“笔记”应用服务中;若传输成功,则电子设备可以显示如图16中的(B)所示的用户界面42。
如图16中的(B)所示,在用户界面42的下方可以显示snack bar 421。具体的,snack bar 421可以包括提示信息4211以及跳转控件4212,其中:
提示信息4211可包含“传输成功”四个文字,用于提示用户电子设备已经将图像411成功传输至“笔记”应用服务中。
跳转控件4212可以响应于用户的触摸操作,以使电子设备从当前界面跳转至应用服务 “笔记”的界面。
此外,若用户不对snack bar 421进行任何操作,snack bar 421还可以在显示一段时间(例如2s-3s)之后自动消失;或者,当snack bar 421还显示在用户界面42中时,用户可以通过电子用户界面42中除了snack bar 421所在位置之外的其他位置,以使snack bar 421消失。
如图16中的(B)所示,在用户点击跳转控件4212后,电子设备可以响应于该操作,显示如图16中的(C)所示的用户界面43。用户界面43即为应用服务“笔记”的界面,从用户界面43中可以看出,图像411已经被电子设备传输至“笔记”中。
需理解,图16仅示例性示出了本申请实施例提供的用户界面,其不应构成对本申请实施例的限定。例如,当用户将拖起的元素传输至其他沉浸式场景下的应用服务时电子设备依旧可以在界面中使用snack bar提示用户。
②传输完之后生成胶囊提示用户,请参阅图17-图18。
如图17中的(A)所示,用户界面44为用户对图像441进行跨应用传输的跨应用传输界面。用户可以此时正将拖起的信息元素,即图像441,放置在右侧“全局收藏”的图标上。
随着用户松手,电子设备可以响应于用户操作,将图像441传输至全局收藏中(即将图像441收藏至全局收藏夹中);若收藏成功,则电子设备可以显示如图16中的(B)所示的用户界面45。
如图17中的(B)所示,若电子设备成功收藏图像411至全局收藏夹中,则在用户界面45的右侧边可以显示有胶囊451。具体的,胶囊451中可以显示有“全局收藏”的图标4511。此外,用户可以通过按住胶囊451后将其拖动来改变其在右侧边上的具体位置。此外,用户还可以通过如图17中的(B)所示的对胶囊451的点击操作,以使电子设备从当前界面跳转至应用服务“全局收藏”的界面,跳转后的“全局收藏”的界面具体可以参考图16中的(B)所示的用户界面43以及前述相关说明,此处不再赘述。
可选的,胶囊451可以在屏幕侧边显示一段时间后自动消失。或者,在用户不主动关闭胶囊451的情况下,胶囊451还可以一直显示在屏幕侧边,以便于用户可以继续将电子设备当前显示界面中包含的其他信息元素拖起并放入“全局收藏”中,具体请参考图18。
如图18中的(A)所示,用户界面45即为前述图17中的(B)所示的用户界面45。可以理解的,此时用户已经将图像441收藏至“全局收藏”中了,且此时用户界面45中依旧显示有胶囊451。若用户接下来还想将界面中的其他元素收入至“全局收藏”中,则用户可以将界面中的元素拖起后移至胶囊451上松手即可。如图18中的(A)所示,在用户将文本452选中后,用户可以通过长按文本452将其拖起后直接拖拽至胶囊451上,电子设备即可以响应于该用户操作,显示如图18中的(B)所示的用户界面46。
如图18中的(B)所示,在用户界面46中,当文本452被拖拽至胶囊451上之后,为了便于用户操作,电子设备可以将胶囊451放大,即用户界面46中的胶囊451可以比用户界面45中的胶囊451更大,且电子设备可以将原先的文本452缩小为用户界面46中的文本461。此时,若用户对文本461松手,则电子设备可以响应于该用户操作,将文本461 (或者说文本452)传输至全局收藏中(即将文本461收藏至全局收藏夹中),若收藏成功,电子设备可以显示如图18中的(C)所示的用户界面47。
如图18中的(C)所示,胶囊451依旧显示在用户界面47中。用户可以通过如图18中的(C)所示的对胶囊451的点击操作,打开应用服务“全局收藏”的界面。作为一个可能的实施方式,当用户点击胶囊451之后,电子设备可以将应用服务“全局收藏”的界面以小窗口的形式显示在界面中,具体请参考图18中的(D)所示的用户界面48。
如图18中的(D)所示,用户界面48可以包括主界面481以及子界面482。其中,主界面481可以是电子设备中应用“浏览器”的应用界面,子界面482即为应用服务“全局收藏”的小窗口界面。从用户界面48可以看出,子界面482可以包括图像4821、文本4822、功能展开控件4823,其中:
图像4821即对应于前述说明中的图像441;
文本4822即对应于前述说明中的文本452或文本461;
功能展开控件4823可响应于用户的触摸操作,例如图18中的(D)所示的点击操作,以使电子设备显示如图18中的(E)所示的用户界面49。
如图18中的(E)所示,在用户界面49中,子界面482中显示有展开控件4824、最小化控件4825以及关闭控件4826,其中:
最小化控件4825可响应于用户操作,以使电子设备将子界面482收起并以胶囊的形式显示在屏幕的侧边。
关闭控件4826可响应于用户操作,以使电子设备关闭子界面482。
展开控件4824可响应于用户操作,以使电子设备全屏显示应用服务“全局收藏”的界面。如图18中的(E)所示,电子设备可以响应于用户对展开控件4824的点击操作,显示如图18中的(F)所示的用户界面50。从用户界面50可以看出,此时电子设备已经全屏显示应用服务“全局收藏”的界面,且用户之前收藏的文本图像441以及文本452也相应地显示在用户界面50中。
③传输完之后在原始界面中展示应用小窗口或直接全屏显示新的应用界面,请参阅图19。
如图19中的(A)所示,用户界面51为应用的聊天界面。用户可以对文本511进行长按操作,将包含地点信息的文本511拖起,并将其拖拽至电子屏幕的侧边;电子设备可以响应于该操作,显示如图19中的(B)所示的用户界面52。
如图19中的(B)所示,用户界面52即为跨应用传输界面。结合前述说明可知,用户可以将文本511进行缩小后所得的文本521拖拽至用户界面52右侧的图标栏中的任意一个图标上后松手,就可以将文本521(或者说文本511)传输至其该图标对应的应用服务中。如图19中的(B)所示,当用户将文本521拖拽至“地图导航”图标522上后松手之后,电子设备即可以响应于该用户操作,显示如图19中的(C)所示的用户界面53。
如图19中的(C)所示,用户界面53可以包括主界面531以及子界面532。其中,主界面531可以是电子设备中应用的应用界面,子界面532即为应用 的小窗口界面,用户可以通过按住子界面532进行拖拽来调整其在用户界面53中的 具体位置。从用户界面53可以看出,子界面532可以包括展开控件5321、最小化控件5322以及关闭控件5323,其中:
最小化控件5322可响应于用户操作,以使电子设备将子界面532收起并以胶囊的形式显示在屏幕的侧边。
关闭控件5323可响应于用户操作,以使电子设备关闭子界面532。
展开控件5321可响应于用户操作,以使电子设备全屏显示应用的界面,即将子界面532全屏显示。如图19中的(C)所示,电子设备可以响应于用户对展开控件4824的点击操作所示的用户界面54。从用户界面54可以看出,此时电子设备已经全屏显示应用的界面。
可选的,在用户将文本521放在“地图导航”图标522上后松手之后,响应于该用户操作,电子设备也可以不显示如图19中的(C)所示的用户界面53,而是直接显示如图19中的(D)所示的用户界面54,即直接全屏显示新的应用界面。
④跨设备传输完之后,在原始界面中展示snack bar提示用户,并控制其他设备应用小窗口或直接全屏显示新的应用界面,请参阅图20。
需要提前说明的是,在本申请实施例中,当电子设备与其他的智能设备建立通信连接之后,电子设备还可以基于本申请提供的“跨应用传输界面”进行信息的跨设备传输。
图20示例性示出了电子设备在与车载终端建立通信连接的情况下,利用“跨应用传输界面”将微信中包含地点信息的文本信息发送给车载终端,并使用车载终端对该地点信息进行导航的具体过程。
如图20所示,电子设备1900与车载终端已经通过蓝牙、Wi-Fi等方式建立了通信连接。其中,电子设备1900可以是本申请实施例提供的支持“跨应用传输界面”交互方式的电子设备。
如图20中的(A)所示,用户界面55为应用的聊天界面。用户可以对文本551的进行长按操作将包含地点信息的文本551拖起,并将其拖拽至电子设备屏幕的侧边;电子设备1900可以响应于该操作,显示如图20中的(B)所示的用户界面56。
如图20中的(B)所示,用户界面56中所包含的元素的具体功能可以参考前述对图19中用户界面52的相关说明,其中文本561与前述文本521对应,“驾驶导航”图标562与前述“地图导航”图标522对应。其中,“驾驶导航”为电子设备1900提供的一种车机导航服务,在电子设备1900与其他车载终端,例如车载终端1901建立通信连接之后,用户就可以通过电子设备1900提供的“驾驶导航”服务控制车载终端进行导航。在。如图20中的(B)所示,用户将文本561放在“驾驶导航”图标562上后送松手,电子设备1900即可以响应于该用户操作,显示如图20中的(C)所示的用户界面57,并将文本561传输至车载终端1901中,以使车载终端1901显示如图20中的(D)所示的用户界面58。
如图20中的(C)所示,用户界面57的下方可以显示snack bar 571。具体的,snack bar571可用于显示提示信息“已成功打开,请前往关联设备查看”,用于提示用户电子设备1900已经将包含地点信息的文本561成功发送至车载终端1901中,且车载终端1901以及基于接收到的文本561打开了导航应用,并进行对上述地点信息进行导航。
如图20中的(D)所示,用户界面58为车载终端1901接收到电子设备1900基于“跨应用传输界面”传输过来的文本之后所显示的用户界面。具体的,用户界面58可以是车载终端1901中所安装的导航应用(例如)的应用界面。用户界面58中还可以显示有信息栏582,信息栏582其可以用于提示用户地点信息的来源设备,并提示用户确认是否确定导航至上述地点信息对应的地点。
⑤信息跨设备传输未成功,在原始界面中展示toast反馈提示用户,请参阅图21。
需理解,对于本申请提供电子设备而言,并非每次利用“跨应用传输界面”进行信息的跨应用传输都能成功。例如,当信息元素的大小超出目标应用服务规定的上限时、或者信息元素的格式不符合目标应用服务的规定时,信息元素也就不能通过“跨应用传输界面”传输至目标应用服务了。在这种情况下,电子设备可以在界面中展示toast反馈,以提示用户信息未能传输成功。
如图21中的(A)所示,用户界面60为应用“相册”的应用界面,其显示有图像601-图像611共11张图像。其中,图像601-图像610这10张图像为已经被用户勾选的图像。用户可以通过这10张图像中的任意一张图像(例如图21中的(A)所示的图像610)进行长按后拖动至侧边的操作,以使电子设备显示如图21中的(B)所示的用户界面61。
如图21中的(B)所示,用户界面61即为跨应用传输界面。在用户界面61中,图像缩略图集612即为用户将用户界面60中的图像601至图像610拖拽拉起后形成的缩略图集,其左上角的角标所显示的数字“10”表示用户总共选中了10张图像。若传输成功,电子设备可以显示应用的联系人界面,以便于用户将图像缩略图集612中所包含的全部图像分享给微信好友。但是,由于微信对用户单次发送的图像有数量限制(这里假设数量最多不超过9张),而图像缩略图集612中总共包含了10张图像,已经超过了微信所规定的数量限制,则通过“跨应用传输界面”对图像601-图像610的传输过程将无法成功。因此,在用户可以按住图像缩略图集612并将其拖拽至“好友微信”的应用服务图标上后送松手之后,响应于该操作,电子设备可以显示如图21中的(C)所示的用户界面62。
如图21中的(C)所示,用户界面62的下方可以显示toast反馈621。具体的,toast反馈621可显示提示信息“文件已超出传输上限”,用于提示用户传输的文件数量超出了目标应用服务的限制,因此传输过程失败。与前述说明中提及的snack bar 421不同之处在于,toast反馈621一般不会显示用于界面跳转的控件。
此外,若用户不对toast反馈621进行任何操作,toast反馈621还可以在显示一段时间(例如2s-3s)之后自动消失;或者,当toast反馈621还显示在用户界面62中时,用户可以通过电子用户界面62中除了toast反馈621所在位置之外的其他位置,以使toast反馈621消失。
基于前文介绍,在本申请提供的方法中,电子设备在获取待传输数据后,生成对应的浮起元素。电子设备检测到用户拖动该浮起元素进入预设热区后,可触发智慧流转服务,即显示一个或多个可用于接收上述待传输数据的应用的图标。之后,电子设备可检测到持续拖动浮起元素至任一应用图标所在区域并释放的操作,然后将待传输数据发送至对应的 应用程序。
该方法为用户提供了方便简单、快速流畅且直观的数据分享方案,方便用户在有需求时分享数据,可以提升用户的终端使用体验。本申请实施例提供的信息传输方法也可以被称为数据分享方法。
该方法中提及的拖动操作可以由用户的手指执行,也可以由手写笔、鼠标等信息输入设备执行。
下面主要从热区的角度再次介绍本申请实施例提供的方法。
先介绍几个概念,如下:
待传输数据
待传输数据即前文实施例中提及的信息。待传输数据可以存储于电子设备本地,例如电子设备中一些应用(如图库)对应的存储路径中,或者,也可以存储云端设备中。
待传输数据可以包括多种类型,以下列出几种示例:
(1)文字。文字可以是电子设备显示的网页中的文字、浏览器中的文字、社交软件中的文字、图片(如电子设备的图库中存储的图片、截屏图像(也称截图)等)中识别到的文字、语音转换而来的文字等等。
(2)文档。文档可包括文字类文档、表格类文档、代码类文档等。
(3)图片。图片可包括静态图片,也可包括动态图片。图片还可包括全屏截图、局部截图(即不规则形状的截图)、经过编辑后的截图等等。
(4)视频。视频可包括电子设备拍摄的视频,从网络下载的视频,录屏等等。
(5)超链接。
浮起元素
电子设备可以展示待传输数据,待用户针对这些待传输数据输入用户操作(如长按操作)后,电子设备就能生成对应的浮起元素。
浮起元素是指显示在显示屏中,悬浮于显示屏显示的其他界面元素之上,可以被用户拖动至显示屏中任意位置的元素。浮起元素可以实现为对应的待传输数据的缩略图或预览图,当然也可以实现为其他形式如名称、标记、待传输数据的部分或全部内容等,本申请对此不限定。
热区
热区是指电子设备的显示屏中,用于触发特定功能的区域。
本申请提供的数据分享方法在执行过程中,可涉及多种用于触发不同功能的热区,后续将展开详细的介绍。本申请中的各个热区的大小(即尺寸)、位置、形状等,可以根据用户需求和使用感受而设置。
本申请提供的各个热区均是电子设备自行处理的区域,可以无需提示给用户知晓。即,电子设备无需将显示屏的各个热区提示给用户。
一些实施方式中,电子设备首次使用热区对应的功能时,电子设备可提供使用指导,以提示用户各个热区所在的位置以及其所能够触发的特定功能。
在其他一些实施方式中,电子设备也可以将热区提示给用户。例如,可以将各个热区以阴影、颜色等方式突出,以让用户获知。
智慧流转服务
智慧流转服务即前文所称的“智慧流转”,其是本申请中电子设备提供的一项系统服务或系统功能,可以支持电子设备将数据方便地由一个应用传输至另一个应用。具体的,智慧流转服务支持电子设备在显示屏上显示一个或多个可用于接收上述待传输数据的应用的图标,并在检测到持续拖动浮起元素至任一应用图标所在区域并释放的操作后,将待传输数据发送至对应的应用程序。
智慧流转服务仅仅是本实施例中所使用的一个词语,其代表的含义在本实施例中已经记载,其名称并不能对本实施例构成任何限制。另外,在本申请其他一些实施例中,智慧流转服务也可以被称为其他名词。
下面以本申请提供的示例性UI,来介绍数据分享方法。
图22A-图22N为一组在电子设备100上实现数据分享的用户界面。
生成浮起元素
图22A是本申请实施例提供的一个用户界面。
提供该用户界面的应用程序可以是系统应用程序,也可以是三方应用程序。在本申请实施例中,系统应用程序是指由电子设备100的操作系统直接提供的用于实现特定功能的应用程序。三方应用程序是指电子设备100通过互联网获取的其他开发商提供的用于实现特定功能的应用程序。
在一些实施方式中,上述用户界面还可以是电子设备100的主界面(homepage)、负一屏、锁屏界面等等,本申请对此不作限制。
在显示图22A所示的用户界面的过程中,电子设备100可检测到作用于显示屏的长按操作。不限于长按操作,也可以是双击操作、预设的特定轨迹的滑动操作等用户操作,本申请对此不作限制。响应于上述操作,电子设备100可获取用户界面中该长按操作所在区域的文本,在这部分文本上显示以下内容:文本选择框,文本选择框的开始位置和结束位置的拖动条,文本选择框上方的工具栏。电子设备100初始检测到长按操作时,可以仅在少部分文本(例如长按操作的触控点所在区域的1-2个字)上显示文本选择框。文本选择框开始位置的拖动条、结束位置的拖动条均可以被用户拖动,以调整文本选择框的大小,即调整被选中的文本。工具栏可包括用于对被选中的文本做处理的多个控件,如剪切控件、复制控件、粘贴控件、分享控件等等。
然后,电子设备100可检测到调整被选择文本的用户操作(如拖动文本选择框开始位置或结束位置的拖动条所在位置,以调节文本选择框所在的区域或大小)。电子设备100可根据上述选择文本的用户操作确定用户想要选择的目标文本。参考图22B,示例性的,用户将文本选择框调整为图22B中所示的大小后,电子设备100可根据用户操作确定目标文本111。
参考图22C-图22D,在确定目标文本111之后,电子设备100可检测到作用于目标文本111的长按操作。响应于上述操作,电子设备100可显示对应于目标文本111的悬浮态的控件112。控件112可位于用户输入长按操作时作用于显示屏的触控点位置处。
在一些实施方式中,电子设备响应于作用于目标文本111的长按操作,可以以该长按操作在显示屏中的触控点为锚点,来生成悬浮态的控件112。以触控点为锚点是指,控件 112的某个位置点(如中间偏上的位置、上边缘中点、中心点、右边缘中点或其他点)在该锚点处。图22D中以控件112右侧靠里的某个位置在该锚点为例进行说明。
可选的,控件112中可显示有上述目标文本111。在一些实施方式中,当目标文本111的内容较多时,控件112中可显示部分的目标文本111,例如目标文本111的首句,或目标文本111的摘要等。在一些实施方式中,控件112还可以实现为目标文本111的预览图或缩略图等。
图22D中生成的悬浮态的控件112即为本申请中的浮起元素。
悬浮态的控件112可跟随用户作用于该控件112的拖拽操作实时地调整显示位置。
在一些实施方式中,用户拖拽控件112时,如果触控点进入显示屏的边缘位置,则控件112可以有部分内容超出屏幕而不被显示,或者,电子设备也可以缩小该控件112的尺寸以避免显示不全。
参考图22D,电子设备生成悬浮态的控件112之后,下方的文本选择框持续显示,以让对应的文本保持被选择状态,但文本选择框的开始位置和结束位置的拖动条,以及,文本选择框上方的工具栏不再显示。在一些实施方式中,电子设备生成悬浮态的控件112时,还可以输出震动信号,以提示用户当前该悬浮态的控件112可以被拖动。
光带指引热区
显示屏中对应有光带指引热区。光带指引热区用于触发指引方向的光带效果,该方向是指触发智慧流转服务的拖拽方向。
参考图22D,电子设备100生成悬浮态的控件112之后,电子设备100生成光带指引热区。如图22D所示,光带指引热区可包括显示屏中左侧的虚线L1和显示屏的上边缘E1、左边缘E3、下边缘E2围合的区域113A,显示屏中右侧的虚线L2和显示屏上边缘E1、右边缘E4、下边缘E2围合的区域113B。区域113A、区域113B的高度均和显示屏高度相同,宽度均可以为显示屏宽度x的25%。
参考图22D-图22E,电子设备100可检测到用户拖动控件112向显示屏右侧边滑动的用户操作。在检测到用户手指在显示屏中的触控点进入显示屏右侧的光带指引热区113B后,电子设备100可以在显示屏右侧边缘显示如图22F所示的光带114。或者,在检测到户手指在显示屏中的触控点进入显示屏右侧的光带指引热区113B并且在光带指引热区113B停留一段时长(如600ms)后,电子设备100可以显示光带。用于生成悬浮态的控件112的长按操作,和,拖动控件112滑动的操作,可以是连续无中断的操作,也可以是中间有间隔的两个操作。
光带114可以是带有颜色、阴影、渐变、图形填充(如格纹填充、斜线填充)等属性的条状界面元素。在一些实施方式中,光带114还可以呈现动态效果,例如变换颜色、闪烁显示等等。
显示屏右侧边缘的光带114可用于提示以下信息:1.当前控件112已被拖动至显示屏右侧;2.继续向右的拖拽方向就是触发智慧流转服务的拖拽方向,即如果用户继续将控件112向右侧拖拽,则可以触发智慧流转服务。
参考图22D-图22E所示的控件112,在拖动控件112滑动的过程中,电子设备100可缩小控件112的尺寸,以减少对显示屏中其他内容的遮挡。
在其他实施方式中,如果电子设备100检测到用户将图22D中的控件112拖动至显示屏左侧的光带指引热区113A,则电子设备100可以在显示屏左侧边缘显示光带。该光带可用于提示以下信息:1.当前控件112已被拖动至显示屏左侧;2.继续向左的拖拽方向就是触发智慧流转服务的拖拽方向,即如果用户继续将控件112向左侧拖拽,则可以触发智慧流转服务。
相当于,将控件112拖拽至显示屏左侧或者向右侧的光带指引热区,均可触发光带的显示。
开门热区
显示屏中对应有开门热区。开门热区用于触发智慧流转服务。
参考图22G,电子设备100生成悬浮态的控件112之后,电子设备100生成开门热区。如图22G所示,开门热区可包括显示屏中左侧的虚线L3和显示屏的上边缘E1、左边缘E3、下边缘E2围合的区域115A,显示屏中右侧的虚线L4和显示屏的上边缘E1、右边缘E4、下边缘E2围合的区域115B。区域115A、区域115B的高度均和显示屏高度相同,宽度均可以占显示屏宽度的40(density-independent pixel,dp)。其中,dp是一种基于屏幕密度的抽象单位,1dp*像素密度/160=实际像素数。因而,区域115A、区域115B的宽度和显示屏的像素密度相关,像素密度越大,其宽度也越大。
参考图22F-图22G,电子设备100可检测到用户将控件112继续向显示屏右侧边拖动的用户操作。在检测到用户手指在显示屏中的触控点进入显示屏右侧的开门热区115B后,电子设备100可以停止显示光带,并触发智慧流转服务。或者,在检测到户手指在显示屏中的触控点进入显示屏右侧的开门热区115B并且在开门热区115B停留一段时长(如600ms)后,电子设备100可以停止显示光带,并触发智慧流转服务。该时长可以按需设置,这里不做限定。
智慧流转服务是指电子设备100匹配可接收待传输数据的应用程序,为用户提供将待传输数据快速发送到其他目标应用程序中的服务。触发智慧流转服务时用户作用于的浮起元素所对应的数据,即为待传输数据。例如,在图22F-图22H所示的拖动控件112右滑进入右侧边开门热区115B以触发智慧流转服务的场景中,控件112对应的目标文本111即为待传输数据。
参考图22H,在检测到用户手指在显示屏中的触控点进入显示屏右侧的开门热区115B后,或者在检测到户手指在显示屏中的触控点进入显示屏右侧的开门热区115B并且在开门热区115B停留一段时长(如600ms)后,电子设备100可在显示屏右侧显示包括一个或多个候选应用的图标的菜单栏116。
菜单栏116中可包括收藏图标、搜索图标、分享图标、笔记图标、短信图标等。其中,收藏图标对应的收藏应用可以为系统应用,提供全局的系统收藏功能。笔记图标对应的笔记应用可以是系统应用,也可以是第三方应用,其可以提供应用内的记录、收藏等功能。候选应用是电子设备100从安装的全部应用程序中筛选出来的支持接收待传输数据的应用程序。电子设备100可根据待传输数据的信息类型、语义信息等确定候选应用。候选应用中可包括支持接收任何类型数据的全局应用(如收藏应用、搜索应用、分享应用、邮件应用等),也可包括仅支持接收部分类型数据的应用(如仅支持接收图片的图片编辑应用、仅 支持接收文本的导航应用等)。不同的待传输数据可以对应不同的菜单栏。
在一些实施方式中,电子设备100显示菜单栏116时,可以对控件112做进一步缩放,以避免遮挡菜单栏116。例如,电子设备可以将控件112缩小,让该控件112的高度和菜单栏116中候选应用的图标的高度保持一致。
参考图22H,电子设备100在显示屏右侧显示包含候选应用的图标的菜单栏116,同时,电子设备100可将原来的前台用户界面调整为右透视样式,与上述菜单栏116形象地构成“开门”的动画效果。该前台用户界面可以是指显示屏中显示的不包括状态栏的其他内容构成的界面,也可以是指显示屏中显示的包括状态栏的全部内容。
如果电子设备100原来显示的前台用户界面中包括动态效果,如视频、动图等,则电子设备可以截屏获取一张该用户界面的截屏图像,再将该截屏图像调整为透视样式。也即是说,透视样式的界面可以是电子设备的操作系统处理得到的一张截图。在其他一些实施方式中,电子设备也可以将原用户界面调整为透视样式,并且还持续在该透视样式的用户界面中播放动态效果,如继续播放视频、动图等。
在其他实施方式中,如果电子设备100检测到用户将图22D-图22F中的控件112拖动至显示屏左侧的开门热区115A,则电子设备100可以在显示屏左侧显示包含候选应用的图标的菜单栏,并且将原来的前台用户界面调整为左透视样式,与该菜单栏构成“开门”的动画效果。
相当于,将控件112拖拽至显示屏左侧边缘或者向右侧的开门热区,均可触发“开门”动效,也均可触发智慧流转服务。
开门热区的宽度可以窄于光带指引热区的宽度,这样电子设备100在拖拽控件112的过程中,将会先进入光带指引热区而触发指引的光带效果,然后再进入开门热区而触发智慧流转服务。
hover放大热区
显示屏中对应有hover放大热区。hover放大热区用于触发接近hover动效。
参考图22H,电子设备100显示菜单栏116之后,生成hover放大热区。如图22H所示,hover放大热区可包括显示屏中右侧的虚线L5和显示屏的上边缘E1、右边缘E4、下边缘E2围合的区域117。区域117的高度和显示屏高度相同,宽度可以占显示屏宽度的120dp。
接近hover动效是指:用户拖拽控件112在显示屏中的触控点进入hover放大热区后,菜单栏116中距离该触控点最近的一个候选应用的图标在基础尺寸上被放大,该候选应用的图标前后各相邻的一个应用图标也相应地被放大,但放大程度小于该候选应用的图标的放大程度。
其中,基础尺寸可以按需设置,这里不做限定。距离触控点最近的候选应用的图标可以被放大至基础尺寸的第一比例(如150%或其他比例),其被放大后的状态可以被称为hover态。该距离触控点最近的候选应用的图标前后各相邻的一个应用图标可以被放大至基础尺寸的第二比例(如120%或其他比例),其被放大后的状态可以被称为临近hover态。第一比例大于第二比例,第一比例、第二比例可以预设。
具体的,电子设备首先检测触控点是否位于hover放大区域,若是,则确定距离该触 控点最近的候选应用的图标。例如,电子设备100首先确定包含基础尺寸的各候选应用的图标在显示屏中的位置,然后以触控点往显示屏的横向平行方向拉出一条直线,和该直线重合的候选应用的图标即为距离最近的候选应用的图标。又例如,电子设备100首先确定基础尺寸的各候选应用的图标在显示屏中的位置,然后计算触控点和各个候选应用的图标中心点之间的距离,此距离最小的候选应用的图标即为距离最近的候选应用的图标。
参考图22H,用户手指在显示屏中的触控点进入了hover放大热区117,并且触控点距离菜单栏116中的笔记图标最近,因而笔记图标被放大,其前后相邻的分享图标、信息图标被次级放大,图标底部对应的文字也可相应放大。
参考图22I,随着用户持续拖动控件112,触控点也随之移动至图22I所示的位置处。在图22I中,用户手指和显示屏的触控点距离菜单栏116中的搜索图标最近,因而分享图标被放大,其前后相邻的收藏图标、分享图标被次级放大,图标底部对应的文字也可相应放大。
从图22H-图22I可以看出,在接近hover动效中,用户和显示屏的触控点距离菜单栏116中的候选应用的图标越近,对应的候选应用的图标可以越大。这样可以呈现出菜单栏116中的候选应用的图标被用户手指吸附的效果,并且可以通过放大应用图标的尺寸让用户关注到对应的候选应用的图标。
在一些实施方式中,电子设备100可以先显示基础尺寸的候选应用的图标,然后再根据触控点在hover放大热区中的位置放大部分候选应用的图标,呈现一种动态变化过程。在其他一些实施方式中,电子设备100的处理速度足够快,无需先显示基础尺寸的候选应用的图标,而可以直接根据触控点在hover放大热区中的位置显示放大后的部分候选应用的图标。
在其他实施方式中,如果电子设备100在显示屏左侧显示包含候选应用的图标的菜单栏,将原来的前台用户界面调整为左透视样式,则电子设备100生成显示屏左侧的hover放大热区。该显示屏左侧的hover放大热区可用于触发显示屏左侧的菜单栏的hover动效。
相当于,电子设备100中显示屏的左侧和右侧均可包括hover热区,均可触发hover动效。hover热区总是位于显示屏中菜单栏所在的方向。
除了上述介绍的hover热区触发的接近hover动效,在一些实施方式中,用户拖拽控件112在显示屏中的触控点进入hover放大热区后,电子设备还可以对菜单栏116中距离该触控点最近的一个候选应用的图标做其他效果的处理,例如增加该候选应用的图标的显示亮度、用醒目的颜色将该候选应用的图标标注出来等等。
关门热区
电子设备100在显示屏边侧显示包含候选应用的图标的菜单栏,将原来的前台用户界面调整为透视样式后,即触发开门效果后,显示屏就对应有关门热区。关门热区用于关闭智慧流转服务。
参考图22J,电子设备100在显示屏右侧显示包含候选应用的图标的菜单栏116,将原来的前台用户界面调整为右透视样式后,电子设备100生成显示屏中左侧的虚线L6和显示屏的上边缘E1、左边缘E3、下边缘E2围合的关门热区118。关门热区118的高度和显示屏高度相同,宽度可以为显示屏宽度x的一半。
参考图22J-图22K,电子设备100可检测到用户继续将控件112持续向显示屏左侧拖动的用户操作。
如图22I-图22J所示,电子设备检测到用户将控件112由hover放大热区117拖向显示屏中间的部分区域,该部分区域在hover放大热区117和关门热区118之外,因而电子设备100停止显示接近hover动效。即,参考图22J,菜单栏116中的各个图标的大小相同且为基础尺寸。
如图22K所示,在检测到用户手指在显示屏中的触控点进入显示屏左侧的关门热区118后,电子设备100可以关闭智慧流转服务。或者,在检测到户手指在显示屏中的触控点进入显示屏左侧的关门热区118并且在关门热区118停留一段时长(如600ms)后,电子设备100可以关闭智慧流转服务。该时长可以按需设置,这里不做限定。
参考图22L,关闭智慧流转服务是指,电子设备100停止在显示屏右侧显示菜单栏116,并且将原来的前台用户界面(不包括状态栏)由右透视样式调整为无透视样式。结合图22K和图22L,前台用户界面的样式调整和不再显示的菜单栏116,可形象地构成“关门”的动画效果。
在其他实施方式中,如果电子设备100在显示屏左侧显示包含候选应用的图标的菜单栏,并且将原来的前台用户界面调整为左透视样式,则电子设备100生成显示屏右侧的关门热区。该显示屏右侧的关门热区可用于触发显示屏左侧的菜单栏的“关门”动效。
相当于,电子设备100中显示屏的左侧和右侧均可包括关门热区,均可触发“关门”动效。关门热区总是位于显示屏中菜单栏所在的反方向。
在本申请中,上述图22E-图22J示出的拖动控件112的过程中,用户手指和显示屏可以持续接触,即该拖动操作可以是持续性且无中断的。
在电子设备100检测到用户手指和显示屏的触控点进入开门热区,并且启动了智慧流转服务(即显示菜单栏116)后,如果用户手指离开显示屏,即电子设备如果未检测到触控点,则电子设备100将关闭智慧流转服务(即停止显示菜单栏116)。例如,如果图22H中所示的手指触控点消失,则电子设备也将停止显示图22H中的菜单栏116。相当于,在本申请中,用户既可以通过关门热区来关闭智慧流转服务,也可以通过停止触控显示屏来关闭智慧流转服务。
传输数据
图22M-图22N示出了通过智慧流转服务传输数据的用户界面。
参考图22M,电子设备100在检测到用户拖动控件112到右侧的开门热区115B,并显示菜单栏116之后,可检测到用户继续拖动控件112到菜单栏116中任一候选应用的图标所在区域后释放的用户操作。具体的,参考图22M,电子设备100可检测到用户继续拖动控件112到笔记应用图标并释放的用户操作。于是,电子设备100可确认笔记应用为目标应用。在检测到拖动控件112到笔记应用图标之后,电子设备100可突出显示笔记应用图标,例如增大、变色、提高亮度,还可输出震动信号等等,以提示用户当前选中笔记应用作为目标应用,避免误传输。
在一些实施方式中,电子设备100检测到用户继续拖动控件112到菜单栏116中任一候选应用的图标所在区域后释放的用户操作之后,还可以显示该控件112被吸入或收入对 应的候选应用的图标的动效,以提示用户电子设备会将待传输数据传输到对应的候选应用中。
随后,电子设备100可将控件112对应的待传输数据(即目标文本111)写入到笔记应用中。
参考图22N,在将目标文本111写入笔记应用之后,电子设备100可关闭智慧流转服务的菜单栏116,重新显示原来的用户界面。可选的,电子设备100还可以显示提示窗119。提示窗119可提示用户流转成功,即已成功将用户选择的待传输数据写入到目标应用。其中,提示窗119还可包括控件120。控件120可用于打开接收前述待传输数据的目标应用,例如笔记应用,以供用户在目标应用中继续编辑通过智慧流转服务写入的数据。
不限于图22N所示的电子设备100直接将待传输数据写入目标应用,在其他一些实施方式中,电子设备100确定目标应用之后,还可显示该目标应用提供的窗口。该窗口中可显示一个或多个选项。用户可根据上述一个或多个选项设定待传输数据在目标应用中的使用方式(如打印的参数、分享至的联系人等)。然后,目标应用可按照上述一个或多个选项设定的使用方式对待传输数据进行处理。
手机中的各类热区
图23示出了手机在竖屏状态下的各类热区的示例。
在图23中:
a示出了开门热区,包括显示屏左侧和右侧的两个区域,各自占显示屏宽度的40dp。
b示出了光带指引热区,包括显示屏左侧和右侧的两个区域,各自占显示屏宽度的1/4。
c示出了“右开门”时的hover放大热区,包括显示屏右侧的一个区域,占显示屏宽度的120dp。
d示出了“右开门”时的关门热区,包括显示屏左侧的一个区域,占显示屏宽度的1/2。
e示出了“左开门”时的hover放大热区,包括显示屏左侧的一个区域,占显示屏宽度的120dp。
f示出了“左开门”时的关门热区,包括显示屏右侧的一个区域,占显示屏宽度的1/2。
前文图22A-图22N以及图23均是以手机形态的电子设备为例,列举了手机在竖屏状态下的各个热区及功能。在本申请实施例中,同一形态的电子设备,在不同状态下的热区可以有所不同。这里的状态可包括竖屏状态、横屏状态。
参考图24,图24示例性示出了手机在横屏状态下的各个热区。
和图22A-图22N及图2中竖屏状态不同,由于图24中手机处于横屏状态,因而各个边缘面相对用户的位置有所变化。图24中各个边缘可对应上图22A-图22N中相同标号的各边缘。
在图24中:
虚线L3和显示屏边缘E1、边缘E4、边缘E3围合的区域,以及,虚线L4和显示屏边缘E2、边缘E4、边缘E3围合的区域,为开门热区;
虚线L1和显示屏边缘E1、边缘E4、边缘E3围合的区域,以及,虚线L2和显示屏边缘E2、边缘E4、边缘E3围合的区域,为光带指引热区;
虚线L5和显示屏边缘E2、边缘E4、边缘E3围合的区域,为“右开门”效果下的hover 放大热区;
虚线L6和显示屏边缘E1、边缘E4、边缘E3围合的区域,为“右开门”效果下的关门热区。
当然,在“左开门”效果下,图24中的hover放大热区、关门热区均在目前示出的反侧方向上。
不限于手机形态的电子设备,其他形态的电子设备如折叠屏手机、平板电脑等在横屏状态、竖屏状态下也可以有不同的热区。各个热区在显示屏中的区域和前文手机中的热区类似,可参考前文相关内容。
本申请所提及的上述各个热区的高度可以按照显示屏高度的百分比来衡量,也可以按照占显示屏高度的dp来衡量,其宽度同理,这里不做限定。
本申请所提及的上述各个热区的名字仅为示例,各热区的作用在前文中已经记载,其名称不构成对本申请的限定。
上述UI提及的各个热区在显示屏中的大小(即尺寸)、位置、形状等均为示例,具体实现中,电子设备中各个热区的大小(即尺寸)、位置、形状等可以根据用户需求和使用感受而设置,本申请对此不做具体限制。
上述UI实施例中用灰色填充效果示出的各个热区仅为作说明,电子设备实际呈现给用户的用户界面中,对应热区不包含灰色填充效果。即,电子设备无需将各个热区所在的位置提示给用户,用户可以在使用各热区功能的过程中感受到各个热区的存在。
开门热区的防误触
图25A-图25F示出一种分享截图的方式。
参考图25A,在显示图25A所示的用户界面的过程中,电子设备100可检测到截屏操作。上述截屏操作可以是通过作用于电子设备100的实体按键实现的,例如电源键、音量键,也可以是通过作用于电子设备100的显示屏的触控操作实现的,例如三指下滑操作等等,本申请对此不作限制。
响应于上述截屏操作,电子设备100可将当前时刻显示屏中的用户界面保存一帧图像,即截屏图像,也称截图。电子设备100可将截图写入到电子设备100的存储器中保存,以供用户随时通过访问操作浏览上述截图。
在本申请实施例中,电子设备100还可在显示屏中显示上述截图的预览图,以提示用户获得一帧截图。
图25B是电子设备在显示屏中显示截图预览图的用户界面。如图25B所示,电子设备100可在显示屏的左下角区域显示图像411。图像411可以是图25A所示的用户界面的截图预览图。用户可通过上述图像411预览前述截屏操作获得的截图。上述显示屏左下角区域可称为默认截屏显示区域。不限于左下角,默认截屏显示区域还可以是显示屏的右上角、右下角、左上角等等,本申请实施例对此不作限制。
电子设备100可按预设的计时器保持显示图像411一段时间。上述一段时间例如3秒。在计时器计时结束后,电子设备100可不再显示图像411。
在本申请实施例中,在显示图像411的过程中,电子设备100可检测是否有作用于图像411的用户操作。
参考图25C,电子设备100可检测到作用于图像411的长按显示屏的操作(后续简称长按操作),并且用户手指的触控点位于开门热区412A和开门热区412B以外的其他区域。响应于上述用户操作,电子设备100可将图像411切换到如图25D所示的悬浮态。悬浮态的图像411可跟随用户触控操作的运动轨迹实时地调整显示位置。悬浮态的图像411即为本申请的浮起元素。
在一些实施方式中,电子设备100将图像411切换为悬浮态后,用户界面上可以不输出任何提示信息,即看起来切换前后并无不同。在另一些实施方式中,电子设备100将图像411切换为悬浮态后,用户界面上可以输出一些提示信息(例如图25D中的为图像411加上黑色边框,或者,在图像411周围显示其他动效),从而提示用户图像411当前可以被用户拖动。
参考图25D-图25E,电子设备100生成悬浮态的图像411之后,可检测到持续将该悬浮态的图像411往显示屏右侧拖动至开门热区412B的操作。响应于该操作,电子设备100可启动智慧流转服务,即在显示屏右侧显示包含多个候选应用的图标的菜单栏。之后,电子设备100还可检测到继续将悬浮态的图像411拖入至菜单栏中的某个候选应用的图标所在区域的操作,并响应该操作将图像411的原始截图发送至该候选应用的图标对应的应用。
用户触发电子设备100生成浮起元素之后,可能有多种意图,例如将浮起元素拖动至开门热区而触发智慧流转服务,或者,将浮起元素拖动至显示屏中的其他位置(例如拖动截图的预览图像、拖动备忘录中文本所在的位置)等等。开门热区和上述显示屏中的其他位置可能有重叠,因而在用户拖动浮起元素时,电子设备100需要准确地识别用户意图,进而准确地响应用户的需求,避免误操作。
图25G示出了通过缩小开门热区以防误触的方案。
图25G所示的用户界面可以是电子设备在检测到作用于图25B中的图像411上的长按操作而显示的。
如图25G所示,其所示用户界面中的开门热区包括:虚线L7、虚线L8、和显示屏的上边缘E1、左边缘E3围合的区域412A,以及,虚线L4和显示屏的上边缘E1、右边缘E4、下边缘E2围合的区域412B。
相比于未启用防误触方案前的常规开门热区(如图22G或图25G中的开门热区),图25G中的开门热区做了以下任一项或多项调整:
1.由于图25G中电子设备的默认截屏显示区域位于显示屏的左下角,因而同侧(即显示屏左侧)的开门热区412A的宽度短于常规同侧开门热区的宽度。例如,图25G中开门热区412A的宽度可以为图25C中开门热区412A的宽度的1/2。
2.由于图25G中电子设备的默认截屏显示区域位于显示屏的左下角,因而同侧(即显示屏左侧)的开门热区412A的高度可以从显示屏顶部至显示屏的中间某个位置而非直达显示屏底部。例如开门热区412A的高度可以从显示屏顶部,至图像411的顶部所在位置。
基于上述任一项或多项调整后的开门热区,其范围相比常规开门热区的范围更小。用户在通过用户操作(如长按操作)浮起图像411的过程中,降低了触控点直接进入开门热区的概率,也就降低了浮起图像411后直接触发智慧流转服务的概率。
这样,用户能够更加自如、便捷地在拖动图像411的过程中,选择触发智慧流转服务 或是仅仅移动图像411在显示屏中的位置。具体的,用户将图像411拖动至图25G中左侧的开门热区412A或右侧开门热区412B,即可触发智慧流转服务。用户将图像411拖动至图25G中开门热区以外的区域,能够移动图像411在显示屏中的位置。
在其他实施方式中,如果默认截屏显示区域位于电子设备显示屏的其他区域,则生成浮起元素之后的开门热区可以根据该默认截屏显示区域做相应的调整。例如,如果默认截屏显示区域位于右上角,则显示屏右侧的开门热区的宽度可以为常规右侧开门热区宽度的一半,其高度从顶部开始至截图的预览图底部所在位置。
图25H-图25L示出了两次进入开门热区才触发智慧流转服务,从而防误触的方案。
参考图25H,电子设备100响应用户的截屏操作,在显示屏的左下角区域显示图像411。
之后,电子设备100可检测到作用于图像411的长按操作(后续简称长按操作)。响应于上述用户操作,电子设备100可将图像411切换到如图25I所示的悬浮态。
如图25H所示,电子设备100检测到针对图像411的长按操作时,用户手指在显示屏中的触控点位于显示屏左侧的开门热区中。此时,虽然触控点进入了开门热区,但电子设备不会触发智慧流转服务,即不触发“开门”动效。
参考图25I-图25L,电子设备100可以检测到用户将图像411拖动至左侧的开门热区之外后,再将图像411拖回至左侧的开门热区的用户操作。在检测到用户手指在显示屏中的触控点第2次进入开门热区后,电子设备才会触发智慧流转服务,即触发“开门”动效。
参考图25L,图25L示出了用户手指在显示屏中的触控点第2次进入开门热区后,电子设备触发智慧流转服务后显示的菜单栏。
可见,在生成浮起元素后,如果第1次用户手指在显示屏中的触控点位于开门热区,则不触发智慧流转服务,待用户手指在显示屏中的触控点移出开门热区然后第2次进入开门热区,才会触发智慧流转服务。这里的第1次触控点位于开门热区是指,用于让元素浮起的用户操作在显示屏中的触控点位于开门热区。2次触控点所在的开门热区可以分别是显示屏左侧的开门热区、右侧的开门热区,也可以均是同一侧的开门热区。
这样,用户能够更加自如、便捷地在拖动图像411的过程中,选择触发智慧流转服务或是仅仅移动图像411在显示屏中的位置。具体的,用户将图像411第2次拖动至图25D中的开门热区,即可触发智慧流转服务;用户将图像411直接拖动至图25D中开门热区以外的区域,能够移动图像411在显示屏中的位置。
在其他实施方式中,如果电子设备检测到针对图像411的长按操作时,用户手指在显示屏中的触控点位于开门热区之外,则之后检测到用户将图像411首次拖动至开门热区后,即可触发智慧流转服务。
上述各实施方式中,触发智慧流转服务时的操作,除了触控点位于开门热区,还可包括在该开门热区停留一段时长(如600ms)。该时长可以按需设置,这里不做限定。
不限于针对截图类型的待传输数据,其他类型的待传输数据对应生成浮起元素后,也可采用上述任意一种方式来防误触。
图25M-图25R示出了结合上述两种方式的防误触方案。
在图25M-图25R所示的防误触方案中,电子设备缩小了开门热区,并且在用户操作的触控点两次进入开门热区后才触发智慧流转服务。
图25M示出了电子设备100提供的一个用户界面。
图25N示出了电子设备100检测到作用于图25M中的用户操作后,生成的悬浮态的控件413。控件413的具体生成过程可参考前文图22A-图22D的相关描述。
参考图25N及图25O,显示屏中对应有两个开门热区:虚线L9和显示屏的上边缘E1、左边缘E3、下边缘E2围合的区域412A,以及,虚线L4和显示屏的上边缘E1、右边缘E4、下边缘E2围合的区域412B。
相比于未启用防误触方案前的常规开门热区(如图22G中的开门热区),显示屏左侧的开门热区414A的宽度短于常规左侧开门热区的宽度,例如图25N中的开门热区414A的宽度可以为图25C中的开门热区412A的宽度的1/2。
在一些实施方式中,显示屏右侧的开门热区414B的宽度也可以短于常规右侧开门热区的宽度,例如,图25N中的开门热区414B的宽度可以为图25C中的开门热区412B的宽度的1/2。
如图25N所示,电子设备100检测到针对控件413的长按操作时,用户手指在显示屏中的触控点位于显示屏左侧的开门热区414A中。此时,虽然触控点进入了开门热区,但电子设备不会触发智慧流转服务,即不触发“开门”动效。
参考图25N-图25R,电子设备100可以检测到用户将控件413拖动至左侧的开门热区之外后,再将控件413拖回至左侧的开门热区的用户操作。参考图25R,在检测到用户手指在显示屏中的触控点第2次进入开门热区后,电子设备才会触发智慧流转服务,即触发“开门”动效。这里首次和第2次进入开门热区的定义,可参考前文相关介绍。
在一些实施方式中,电子设备100生成悬浮态的控件413之后,缩短开门热区的宽度,和,2次进入开门热区才触发智慧流转服务,可以任选其一执行,而不必都执行。
在一些实施方式中,电子设备100可以针对待传输数据为文本,并且文本在用户界面中的位置可以被拖动的场景执行上述结合两种方式的防误触方案。这类场景通常由文字编辑类应用提供,因而电子设备可以在识别到当前启动了文字编辑类应用,或者,识别到前台应用为文字编辑类应用时,执行上述防误触方案。例如,针对备忘录中的文本,可以执行上述防误触方案。具体的,电子设备100识别到当前处于上述场景后,可以执行上述防误触方案。
不限于针对文本类型的待传输数据,其他类型的待传输数据对应生成浮起元素后,也可采用上述缩短开门热区的宽度,和,2次进入开门热区才触发智慧流转服务的结合方案来防误触。
窗口避让
浮起元素的一种类别是悬浮窗口。悬浮窗口可以是根据分屏操作得到的,可以悬浮于其他用户界面之上。
当浮起元素为悬浮窗口时,显示屏中也对应有开门热区。用户和该悬浮窗口之间的交互,涉及与智慧流转服务之间的避让,下面分情况说明。
拖动悬浮窗口,不触发智慧流转服务
图26A是电子设备100在分屏场景下提供的一个用户界面。如图26A所示,该用户界面同时显示有两个应用程序提供的内容,包括在底下一层的图库应用提供的用户界面,和, 悬浮于上层的由笔记应用提供的窗口511。
参考图26A-图26B,电子设备100可检测到用户作用于窗口511的任意位置或者作用于窗口511顶部的横条处的拖拽操作,然后随着用户拖拽操作的运动轨迹实时地调整窗口511在显示屏中的位置。在此过程中,拖拽操作的触控点即使移动至开门热区,电子设备100也不会触发智慧流转服务,而仅调整窗口511在显示屏中的位置。
悬浮窗口场景下的防误触
参考图26C,底下一层图库提供的用户界面中显示有一个或多个图标,一个图标对应一个图像(如照片或视频等)。如图26C-图26D所示,电子设备可检测到作用于其中一个或多个图标的用户操作(如点击操作),响应于该操作,电子设备100选中对应的图标,并在被选中的图标上显示被选中的标记。
参考图26D-图26E,在选中一个或多个图标之后,电子设备100可检测到作用于屏幕的长按操作。响应于上述操作,电子设备100可显示悬浮态的控件512。控件512可包括被选中图标的预览图或缩略图,以及右上角角标(例如“2”),角标用于指示选中的图标的数量,即选择的图像的数量。
参考图26E,显示屏中对应有两个开门热区,即显示屏左侧的开门热区和右侧的开门热区。
如图26E-图26F所示,电子设备可检测到将控件512拖动至右侧的开门热区的操作,响应于该操作,电子设备可启动智慧流转服务。参考图26G,响应于控件512被拖动至右侧的开门热区,电子设备在显示屏右侧显示包括多个候选应用的图标的菜单栏,并且将原来的用户界面调整为透视样式。在一些实施方式中,电子设备可以在检测到手指拖动控件512的触控点在右侧开门热区停留一段时间之后,再启动智慧流转服务。如图26G所示,用户手指的触控点还位于hover放大热区中,因而菜单栏中的候选应用的图标也呈现出接近hover动效。
如图26G-图26H所示,电子设备可检测到继续将控件512由右侧的开门热区拖动至显示屏中间的部分区域,该部分区域在hover放大热区和关门热区之外,因而电子设备100停止显示接近hover动效。即,参考图22H,菜单栏116中的各个图标的大小相同且为基础尺寸。
如图26H-图26I所示,电子设备可检测到继续将控件512拖动至显示屏左侧的关门热区的操作。参考图26J,响应于该操作,电子设备将关闭智慧流转服务,即不再显示菜单栏,也不再呈现开门效果。
如图26J-图26L所示,在检测到继续拖动控件512到窗口511的用户操作并释放的操作之后,电子设备100可将控件512对应的图像发送到窗口511对应的笔记应用中去。然后,电子设备100可在窗口511显示上述被选中图标对应的图像。
图26C-图26L所示的示例,可以在用户误操作启动智慧流转服务之后,为用户提供快捷、方便的关闭智慧流转服务的方式,并且还能不中断用户的下一步操作。具体的,假设用户在图26E中拖动控件512的原始目的是为了将控件512拖动至窗口511中,以将控件512对应的图像发送到笔记应用中,然而用户误将控件512拖动至了图26F所示的开门热区中,此后电子设备显示了如图26G所示的“开门”效果。但是,图26G所示的“开门” 效果并非用户想要的结果,因而用户可以继续将控件512拖动至显示屏左侧的关门热区,以关闭“开门”效果。并且,在关闭“开门”效果后,用户还可以持续地拖动控件512并将其拖动至窗口511中释放以完成数据传输,从而达到原始目的。在此过程中,虽然用户误触发了智慧流转服务,但是用户可以通过持续地拖动控件512来关闭智慧流转服务,并且达到原始目的。在此过程中,用户持续地拖动控件512,即用户可以简单、方便且快捷地避免误操作,既能实现原始目的,又无需手指离开显示屏。
在本申请实施例中,开门热区也可以被称为第二区域,开门热区以外的区域可以被称为第一区域,第一区域和第二区域不重叠。
例如,第二区域可包括图22G-图22H所示的开门热区115A和开门热区115B,第一区域可包括图22G-图22H中开门热区115A、开门热区115B以外的其他显示屏区域。
又例如,第二区域可包括图25C-图25R所示的开门热区412A和开门热区412B,第一区域可包括图25C-图25R中开门热区412A、开门热区412B以外的其他显示屏区域。
又例如,第二区域可包括图26F所示的左侧开门热区和右侧开门热区,第一区域可包括图26F中左侧开门热区、右侧开门热区以外的其他显示屏区域。
在本申请实施例中,光带指引热区也可被称为第三区域,第三区域包含第二区域。光带指引热区的示例可参考前文UI实施例的介绍。
在本申请实施例中,hover放大热区也可被称为第四区域,第四区域包含菜单栏所在侧的第二区域,或者,包含第一拖动操作或第三拖动操作的触控终点所在的第二区域。hover放大热区的示例可参考前文UI实施例的介绍。第一拖动操作、第三拖动操作可参考后续说明。
其中,菜单栏所在侧的第二区域,或者,包含第一拖动操作或第三拖动操作的触控终点所在的第二区域,指,第二区域中的部分区域,例如某一侧的区域。示例性地,该第二区域中的部分区域可包括图22G-图22H所示的开门热区115B、图25C-图25F所示的开门热区412B、图25H-图25R所示的开门热区412A、图26G所示的右侧开门热区等。
在本申请实施例中,显示屏中hover放大热区和关门热区以外的区域也可被称为第五区域。第五区域的示例可包括图22J中hover放大热区117和关门热区118以外的区域,或者,图26H中hover放大热区和关门热区以外的区域。
在本申请实施例中,关门热区也可被称为第六区域。关门热区的示例可参考前文UI实施例的介绍。
在本申请实施例中,浮起元素可以被称为第一元素,显示有浮起元素的用户界面可以被称为第一界面。
例如,第一界面的示例可包括图22D所示的界面,第一元素的示例可包括图22D中悬浮态的控件112。
又例如,第一界面的示例可包括图25B-图25D,或图25G,或图25H-图25I所示的界面,第一元素的示例可包括图25B-图25D,或图25G,或图25H-图25I中的图像411。
又例如,第一界面的示例可包括图25N所示的界面,第一元素的示例可包括图25N中悬浮态的控件413。
又例如,第一界面的示例可包括图26E所示的界面,第一元素的示例可包括图26E中悬浮态的控件512。
在本申请实施例中,浮起元素对应的数据,可以被称为第一数据。
例如,第一数据的示例可包括图22C中被选中的文本,或图25A所示用户界面的截图,或图26D中被选中图标对应的图像。
提供第一界面的应用可以被称为第六应用,例如图22A、图25A所示的浏览器应用,图25M所示的备忘录应用,图26C示出的图库应用等。
在本申请实施例中,在显示浮起元素之前,用于生成该浮起元素的用户界面可以被称为第二界面。
例如,第二界面的示例可包括图22A-图22C所示的用户界面。在图22A-图22C的用户界面中,被用户选中的文本可以被称为第一文本。
又例如,第二界面的示例可包括图25A所示的用户界面。
又例如,第二界面的示例可包括图26C-图26D所示的用户界面。在图26C-图26D所示的用户界面中,被选中的图标可以被称为第一图像的图标,未被选中的图标可以被称为第二图像的图标。
在本申请实施例中,可包括多种对第一元素的拖动操作。其中:
用于触发智慧流转服务或者用于触发开门效果的对第一元素的拖动操作,可包括以下两种:
1.第一拖动操作,第一拖动操作的触控起始点在第一元素上并且位于显示屏的第一区域,触控终点位于显示屏的第二区域。
例如,第一拖动操作的示例可包括图22D-图22G示出的将控件112由开门热区115A和开门热区115B以外的其他显示屏区域拖动至开门热区115B的操作。
又例如,第一拖动操作的示例可包括图25D-图25E示出的将图像411由开门热区412A和开门热区412B以外的其他显示屏区域拖动至开门热区412B的操作。
2.第三拖动操作,第三拖动操作的触控起始点在所述第一元素上并且位于所述第二区域,触控终点位于所述第二区域,所述第三拖动操作的轨迹经过所述第一区域。
例如,第三拖动操作的示例可包括图25I-图25K示出的将控件112由开门热区412A拖动至非开门区域,然后再拖动至开门热区412A的操作。
又例如,第三拖动操作的示例可包括图25N-图25Q示出的将控件413由开门热区414A拖动至非开门区域,然后再拖动至开门热区414A的操作。
不用于触发智慧流转服务或者不用于触发开门效果的对第一元素的拖动操作,可包括第二拖动操作。第二拖动操作的触控起始点在所述第一元素上并且位于所述第二区域,触控终点位于所述显示屏的第二区域,所述第二拖动操作的轨迹位于所述第二区域。
例如,第二拖动操作的示例可包括在图22D-图22G中开门热区115A或开门热区115B内的拖动操作,或者,在图25D-图25E中开门热区412A或开门热区412B内的拖动操作,或者,在图25I-图25K中开门热区412A或开门热区412B内的拖动操作,或者,在图25N-图25Q中开门热区414A或开门热区414B内的拖动操作。
上述第一拖动操作,第二拖动操作,第三拖动操作的触控起始点、触控终点仅代表对 应拖动操作的开始和结束所在位置,触控起始点并不一定表示用户手指在该拖动操作的开始时间点才触控显示屏,触控终点也不表示用户手指在该拖动操作的结束时间点离开显示屏。即,在第一拖动操作,第二拖动操作,第三拖动操作之前,均可以有连续且持续接触显示屏的其他操作,当然也可以没有连续且持续接触显示屏的其他操作。在第一拖动操作,第二拖动操作,第三拖动操作之后,均可以有连续且持续接触显示屏的其他操作。
在本申请实施例中,电子设备显示的包括一个或多个候选应用的图标的菜单栏,可以被称为第一菜单栏。第一菜单栏的示例可包括图22H-图22K,图22M中的菜单栏116,也可包括图25F、图25L、图25R、图26G-图26I中示出的菜单栏。
在本申请实施例中,电子设备显示第一菜单栏之后,还可检测到继续将所述第一元素拖入第一菜单栏中的候选应用的图标所在的区域并释放的操作。该候选应用可以被称为第一应用。第一应用的示例可包括图22M中的笔记应用。
在本申请实施例中,电子设备显示第一菜单栏之后,还可检测到将第一元素继续在第四区域内拖动的第四拖动操作,所述第四拖动操作的触控起始点,和,所述第一拖动操作或所述第三拖动操作的触控终点相同,所述第四拖动操作的触控终点距离所述第一菜单栏中的所述第二应用的图标最近。即,第四拖动操作和第一拖动操作或第三拖动操作是连续且不中断的。
第四拖动操作的示例可包括图22H-图22I示出的拖动控件112的操作。
在显示第一菜单栏时,接近hover动效中,距离用户触控点最近的候选应用的图标可以被称为第二应用的图标,第二应用的图标前后各相邻的一个应用图标可以分别被称为第一应用的图标、第三应用的图标,其他应用的图标可以被称为第四应用的图标。
图22I示出的菜单栏116中的收藏图标、搜索图标、分享图标、笔记图标可以分别为第一应用的图标、第二应用的图标、第三应用的图标、第四应用的图标的示例。
在本申请实施例中,电子设备检测到第四拖动操作之后,还可检测到继续将所述第一元素拖动至第五区域的第五拖动操作,所述第五区域和所述第四区域不重叠;响应于所述第五拖动操作,将所述第一菜单栏中的各个图标显示为所述基础尺寸。第五拖动操作的示例可参考图22I-图22J所示的拖动操作,或者,图26G-图26H所示的拖动操作。
第五拖动操作的触控起始点,和,第四拖动操作的触控终点相同。即,第五拖动操作和第四拖动操作是连续且不中断的。
在本申请实施例中,电子设备显示第一菜单栏之后,还可检测到将第一元素拖动至第六区域的第六拖动操作,所述第六区域和所述第二区域不重叠,且所述第六区域位于所述第一菜单栏在显示屏中的相对侧;响应于所述第六拖动操作,停止显示所述第一菜单栏。
第六拖动操作的示例可包括图22H-图22K所示的拖动操作,或者,图26G-图26I所示的拖动操作。
在本申请实施例中,针对上述介绍的通过缩小开门热区以防误触的方案,电子设备可以显示第三界面,所述第三界面包括第二元素;检测到对所述第二元素的拖动操作;当所述拖动操作为第七拖动操作,所述第七拖动操作的触控起始点在所述第二元素上并且位于显示屏的第七区域,触控终点位于所述显示屏的第八区域,显示第二菜单栏;当所述拖动操作为第八拖动操作,所述第八拖动操作的触控起始点在所述第二元素上并且位于所述第 八区域,触控终点位于所述显示屏的第八区域,所述第八拖动操作的轨迹经过所述第七区域,显示所述第二菜单栏;当所述拖动操作并非所述第七拖动操作或所述第八拖动操作,不显示所述第二菜单栏;其中,所述第八区域为所述第二区域的部分区域。
其中,第八区域为缩小后的开门热区,第七区域为缩小后的开门热区以外的显示屏区域。
例如,参考图25G,第八区域包括开门热区412A和开门热区412B,第七区域包括开门热区412A和开门热区412B以外的显示屏区域。
又例如,参考图25N-图25R,第八区域包括开门热区412A和开门热区412B,第七区域包括开门热区412A和开门热区412B以外的显示屏区域。
此外,当用户通过“跨应用传输界面”对信息进行传输时,电子设备可以为基于该信息为用户推荐能够接收该信息的多个及应用服务,并在跨应用传输界面中的右侧展示这些应用服务的图标,具体的,这些应用服务图标的数量上限可以为20个;可选的,当这些应用服务图标的数量超过一定阈值(例如7个)时,为了保证界面的整洁和可观性,电子设备在显示时,可以只将这些应用服务图标的一部分(例如7个)同时展示在跨应用传输界面中;当跨应用传输界面当前展示的图标均不是用户期望的应用服务时,用户还可以将拖起的元素放置在“跨应用传输界面”图标区域的上方或者下方的空白处,以使电子设备更新图标区域中的图标,具体请参考图27。
如图27中的(A)所示,用户界面63为用户对图像631进行跨应用传输的跨应用传输界面。在用户界面63中的图标区域632中,显示有“全局收藏”的图标6321、“搜索”的图标6322、“编辑”的图标6323、“打印”的图标6324、“好友微信”的图标6325、“扫一扫”的图标6326以及“邮件”的图标6327共七个图标。
假设此时用户界面63中所显示的图标其对应的应用服务均不是用户的目标应用服务,则如图27的(B)所示出的用户界面64,用户可以将图像631拖拽至图标区域6321的底部,电子设备即可以响应于该用户操作,更新图标区域632中的图标(向上滚动更新),并显示如图27中的(C)所示的用户界面65。
如图27中的(C)所示,在用户界面65中,图标区域632中同样显示了七个图标,即“搜索”的图标6322、“编辑”的图标6323、“打印”的图标6324、“好友微信”的图标6325、“扫一扫”的图标6326、“邮件”的图标6327以及“淘宝”的图标6328。结合图27中(A)所示的用户界面63可以看出,原先显示在图标区域632中顶部的“全局收藏”的图标6321因为更新而不再显示用户界面65中,且相比于用户界面63,在用户界面65中,原先的“搜索”的图标6322、“编辑”的图标6323、“打印”的图标6324、“好友微信”的图标6325、“扫一扫”的图标6326以及“邮件”的图标6327均向上移动了一个位置,其最底部的位置即为新显示的图标,即“淘宝”的图标6328。
同理,如图27的(D)所示出的用户界面66所示,用户也可以将图像631拖拽至图标区域6321的顶部,电子设备即可以响应于该用户操作,更新图标区域632中的图标(向下滚动更新),并显示如图27中的(E)所示的用户界面67。
如图27中的(E)所示,在用户界面67中,图标区域632中同样显示了七个图标,即 “打印”的图标、“全局收藏”的图标6321、“搜索”的图标6322、“编辑”的图标6323、“打印”的图标6324、“好友微信”的图标6325以及“扫一扫”的图标6326。结合图27中(A)所示的用户界面63可以看出,原先显示在图标区域632中底部的“邮件”的图标6327因为更新而不再显示用户界面65中,且相比于用户界面63,在用户界面65中,原先的“全局收藏”的图标6321、“搜索”的图标6322、“编辑”的图标6323、“打印”的图标6324、“好友微信”的图标6325以及“扫一扫”的图标6326均向下移动了一个位置,其最顶部的位置即为新显示的图标,即“笔记”的图标6329。
此外,在一些实施例中,电子设备还可以将图标区域分为两部分,其中一部分区域用于显示固定的图标,另一部分区域用于显示电子设备为用户个性推荐的图标。具体的,对于这部分电子设备为用户个性推荐的图标,电子设备可以先对拖起的信息元素进行识别,基于识别结果获取在跨应用传输界面中提供贴合用户需求的应用服务图标。也就是说,当用户先后拖起两个元素,即使这两个元素为相同类型的元素(例如均为文本或者均为图像),在两个元素所包含的内容不同的情况下(例如图像内容不同或者文本中文字不同),则在电子设备基于这两个元素显示的“跨应用传输界面”两个用户界面中,每个用户界面中图标区域中的图标也可以不同;需理解,这里所说的“不同”可以包括图标种类的不同以及图标顺序的不同。在本申请实施例中,电子设备可以将越符合用户当前需求的图标显示在图标区域的越上方。具体请参阅图28-图31。
图28为本申请实施例提供的一种电子设备基于文本中包含的地点信息为用户显示的跨应用传输界面的示意图。
如图28中的(A)所示,用户界面68为应用的聊天界面。用户可以对文本681进行长按操作将包含地点信息的文本681拖起。在用户拖起文本681之后,电子设备可以响应于该操作,对文本信息进行识别;在电子设备识别到文本681中包含有地点信息之后,电子设备基于该地点信息判定用户当前存在出发前往该地点的意图,此时电子设备就会基于该用户意图,为用户推荐相应的应用服务,并在后续的“跨应用传输界面”界面中,将其为用户推荐的应用服务的图标显示在图标区域中,并根据应用服务排序,越符合当前用户意图的应用服务所对应的图标将位于图标区域的越上方。
如图28中的(A)所示,当用户将文本681拖起并将其拖拽至电子屏幕的侧边之后,电子设备可以响应于该操作,显示如图28中的(B)所示的用户界面69。
如图28中的(B)所示,用户界面69为跨应用传输界面。在用户界面69中,文本691为文本681进行缩小之后所得的文本,右侧的图标区域可以分为固定图标区域692以及推荐图标区域693,这两个区域之间可以用分隔线694以示区分;其中:
固定图标区域692中可以包含“全局收藏”的图标6921以及“搜索”的图标6922。可理解的,无论用户基于电子设备分享何种元素,电子设备为基于该元素显示的跨应用传输界面均会显示固定图标区域692,且其中包含的图标均为“全局收藏”的图标6921以及“搜索”的图标6922。
推荐图标区域693中可以包含“地图导航”的图标6931、“一键打车”的图标6932、“驾驶导航”的图标6933、“微信”的图标6934以及“备忘录”的图标6935。其中,“地 图导航”的图标6931可用于打开电子设备中的地图软件对地点导航并进入导航的应用界面;“一键打车”的图标6932可用于基于地图软件提供的打车服务进入打车服务的应用界面;“驾驶导航”的图标6933主要用于将上述地点信息跨设备传输至与电子设备通信连接的车载终端中,具体可以参考前述对图20的相关说明。可以理解的,因为文本信息681中包含有地点信息,因此电子设备基于该地点信息可以判定用户当前存在出发前往该地点的意图,于是在推荐图标区域693中,“地图导航”的图标6931、“一键打车”的图标6932、“驾驶导航”的图标6933由于最符合当前用户意图被显示在推荐图标区域693中靠上方的位置,以便于用户进行选择。
图29为本申请实施例提供的一种电子设备基于文本中包含的时间、地点等信息为用户显示的跨应用传输界面的示意图。
如图29中的(A)所示,用户界面70为应用“浏览器”的应用界面。用户可以对文本701进行长按操作将包含地点信息的文本701拖起。在用户拖起文本701之后,电子设备可以响应于该操作,对文本信息进行识别;在电子设备识别到文本701中包含有时间、地点信息之后,电子设备基于该时间、地点信息判定该文本信息可能包含具体的日程信息,此时电子设备就会基于该用户意图,为用户推荐相应的应用服务,并在后续的“跨应用传输界面”界面中,将其为用户推荐的应用服务的图标显示在图标区域中,并根据应用服务排序,越符合当前用户意图的应用服务所对应的图标将位于图标区域的越上方。
如图29中的(A)所示,当用户将文本701拖起并将其拖拽至电子屏幕的侧边之后,电子设备可以响应于该操作,显示如图29中的(B)所示的用户界面71。
如图29中的(B)所示,用户界面71为跨应用传输界面。在用户界面71中,文本711为文本711进行缩小之后所得的文本,右侧的图标区域可以分为固定图标区域712以及推荐图标区域713,这两个区域之间可以用分隔线714以示区分;其中:
固定图标区域712中可以包含“全局收藏”的图标7121以及“搜索”的图标7122。可理解的,无论用户基于电子设备分享何种元素,电子设备为基于该元素显示的跨应用传输界面均会显示固定图标区域712,且其中包含的图标均为“全局收藏”的图标7121以及“搜索”的图标7122。
推荐图标区域713中可以包含“分享”的图标7131、“日程”的图标7132、“好友微信”的图标7133、“打印”的图标7134以及“翻译”的图标7135。其中,“分享”的图标7131可用于基于电子设备提供的分享服务将文本701通过蓝牙、邮件等分享给其他设备;“日程”的图标7132主要用于将文本701中的时间、地点信息添加到日程中;“好友微信”的图标7133可用于将文本701通过微信的聊天界面发送给微信好友。可以理解的,因为文本701中包含有时间、地点信息,因此电子设备基于该时间、地点信息可以判定该文本信息可能包含具体的日程信息,则用户当前存在分享该日程或者添加该日程的意图,于是在推荐图标区域713中,“分享”的图标7131、“日程”的图标7132、“好友微信”的图标7133由于最符合当前用户意图被显示在推荐图标区域713中靠上方的位置,以便于用户进行选择。
图30为本申请实施例提供的一种电子设备基于图像中包含的二维码图像为用户显示的跨应用传输界面的示意图。
如图30中的(A)所示,用户界面72为应用“浏览器”应用的界面。用户可以对图像721进行长按操作将包含二维码图像7211(图30中所示出的二维码图像7211仅为便于理解,在实际的应用场景中可以表现为别的形式,本申请对其不做限定)的图像721拖起。在用户拖起图像721之后,电子设备可以响应于该操作,对图像721进行识别;在电子设备识别到图像721中包含有二维码图像之后,电子设备基于该二维码图像判定用户此时很可能需要扫描图像721中的二维码,此时电子设备就会基于该用户意图,为用户推荐相应的应用服务,并在后续的“跨应用传输界面”界面中,将其为用户推荐的应用服务的图标显示在图标区域中,并根据应用服务排序,越符合当前用户意图的应用服务所对应的图标将位于图标区域的越上方。
如图30中的(A)所示,当用户将图像721拖起并将其拖拽至电子屏幕的侧边之后,电子设备可以响应于该操作,显示如图30中的(B)所示的用户界面73。
如图30中的(B)所示,用户界面73为跨应用传输界面。在用户界面73中,图像731为图像721进行缩小之后所得的图像,右侧的图标区域可以分为固定图标区域732以及推荐图标区域733,这两个区域之间可以用分隔线734以示区分;其中:
固定图标区域732的具体功能可以参考前述对固定图标区域712的相关说明,这里不再赘述。
推荐图标区域733中可以包含“扫一扫相机”的图标7331、“打印”的图标7332、“分享”的图标7333、“好友微信”的图标7334以及“相册”的图标7335。其中,“扫一扫相机”的图标7331可用于基于“相机”应用提供的“扫一扫”服务扫描图像731;“打印”的图标7332主要用于将图像731发送至打印设备进行打印;“分享”的图标7333可用于基于电子设备提供的分享服务将图像731通过蓝牙、邮件等分享给其他设备。可以理解的,因为图像721中包含有二维码,因此电子设备基于二维码图像可以判定用户可能需要扫描该图像,又或是用户想要打印或者分享该图像,于是在推荐图标区域733中,“扫一扫相机”的图标7331、“打印”的图标7332、“分享”的图标7333由于最符合当前用户意图被显示在推荐图标区域733中靠上方的位置,以便于用户进行选择。
图31为本申请实施例提供的一种电子设备基于图像中包含的人脸图像为用户显示的跨应用传输界面的示意图。
如图31中的(A)所示,用户界面74为“相机”应用的界面。用户可以对图像741进行长按操作将包含人脸图像的图像741拖起。在用户拖起图像741之后,电子设备可以响应于该操作,对图像741进行识别;在电子设备识别到图像741中包含有人脸图像之后,电子设备可基于该人脸图像判定用户此时很可能需要对图像741进行美化或者分享至社交软件,此时电子设备就会基于该用户意图,为用户推荐相应的应用服务,并在后续的“跨应用传输界面”界面中,将其为用户推荐的应用服务的图标显示在图标区域中,并根据应用服务排序,越符合当前用户意图应用服务所对应的图标将位于图标区域的越上方。
如图31中的(A)所示,当用户将图像741拖起并将其拖拽至电子屏幕的侧边之后, 电子设备可以响应于该操作,显示如图31中的(B)所示的用户界面75。
如图31中的(B)所示,用户界面75为跨应用传输界面。在用户界面75中,图像751为图像751进行缩小之后所得的图像,右侧的图标区域可以分为固定图标区域752以及推荐图标区域753,这两个区域之间可以用分隔线754以示区分;其中:
固定图标区域752的具体功能可以参考前述对固定图标区域712的相关说明,这里不再赘述。
推荐图标区域753中可以包含“美图”的图标7531、“朋友圈”的图标7532、“QQ空间”的图标7533、“好友微信”的图标7534以及“分享”的图标7535。其中,“美图”的图标7531可用于对图像751进行美化;“朋友圈”的图标7532主要用于将图像751分享分到微信朋友圈中;“QQ”的图标7533可用于将图像751分享到QQ空间中。可以理解的,因为图像751中包含有二维码,因此电子设备基于人脸图像可以判定用户可能需要对图像741进行美化或者将其分享至社交软件,于是在推荐图标区域753中,“美图”的图标7531、“朋友圈”的图标7532、“QQ空间”的图标7533由于最符合当前用户意图被显示在推荐图标区域753中靠上方的位置,以便于用户进行选择。
在一些实施例中,跨应用传输界面中的图标区域除了可以用于显示应用服务的图标之外,还可以用于显示电子设备后台运行应用的应用界面的缩略图。当用户将拖起的信息元素放在该缩略图上并松手之后,该信息元素即会传输到该缩略图对应的应用界面中。具体请参阅图32。
如图32中的(A)所示,用户界面76为应用的好友(小明)聊天界面。用户在电子设备屏幕的下方边界处向上滑动;电子设备可以响应于该操作,显示如图32中的(B)所示的用户界面77。
如图32中的(B)所示,用户界面77为应用导航界面,在该界面中可以显示电子设备目前打开的所有应用的应用界面缩略图,其中,应用界面缩略图771即为应用中的好友(小明)聊天界面的缩略图,应用界面缩略图772为应用“浏览器”中网页浏览界面的缩略图。这里将电子设备所显示的应用界面对应的应用称为前台应用,将已经打开但是并未在电子屏幕中显示应用界面的应用称为后台应用。则在用户界面77中,用户可以通过点击用户界面77中显示的任意一张应用界面缩略图,将该应用界面缩略图对应的应用切换为前台应用,并将该应用界面缩略图全屏显示在屏幕中。如图32中的(B)所示,用户可以点击应用界面缩略图772以使电子设备将该应用“浏览器”切换为前台应用,需理解,此时应用并未关闭,其将在后台运行,当用户通过应用导航界面将应用切换为前台应用时,电子设备依旧会在屏幕中显示用户界面76。响应于将该应用“浏览器”切换为前台应用的用户操作,电子设备可以显示如图32中的(C)所示的用户界面78。
如图32中的(C)所示,用户界面78可以是电子设备中应用“浏览器”的应用界面,用户可以通过对用户界面78中图像781的长按拖拽操作,以使电子设备显示如图32中的(D)所示的用户界面79。
如图32中的(D)所示,用户界面79可以包括,子界面791,图像792、应用界面缩略图793以及文字说明794。其中,图像792为图像781进行缩小所得的缩略图,文字说明794可以用于向用户解释应用界面缩略图793对应的应用以及对应的联系人,应用界面 缩略图793即为前述用户界面76的缩略图。当用户将图像792拖拽至应用界面缩略图793上并松手之后,电子设备可以响应于该用户操作,显示如图32中的(E)所示的用户界面80。
如图32中的(E)所示,用户界面80可以是“微信”应用的好友(小明)聊天界面。从用户界面80可以看出,此时用户已经将从应用“浏览器”中获取的图像781发送给微信好友“小明”了。也就是说,当用户将用户界面79中的图像792拖拽至应用界面缩略图793上并松手之后,用户可以无需再进行其他操作,电子设备就能自发的将该图像792(或者说图像781)发送给微信好友小明。
需理解,图32仅示例性示出了本申请实施例提供的用户界面,其不应构成对本申请实施例的限定。例如,对于应用等后台应用也可以显示在跨应用传输界面中,本申请对此不作限定。
此外,在一些实施例中,用户在将信息元素拖起后,电子设备可以直接调出侧边应用栏,并在侧边应用栏中为用户显示其相应的应用服务图标。接下来结合图33-图34进行说明。
图33示出了用于调出电子设备侧边应用栏的两种不同的方式。
首先,用户可以通过常规的在屏幕侧边内滑的操作调出电子设备的侧边应用栏。
如图33中的(A)所示,用户界面81可以是电子设备中应用“浏览器”的应用界面,也可以是应用的应用界面,还可以是其他应用的应用界面,本申请对此不作限定。用户可以通过在屏幕右侧向屏幕内左滑的操作(此时用户不松手),调出电子设备侧边应用栏的图标811;之后,若用户松手,则电子设备可以响应于该操作,显示如图33中(B)所示的用户界面82。
如图33中的(B)所示,用户界面82中可以显示有侧边应用栏821。侧边应用栏中821可以显示一个或者多个用户自己添加到侧边应用栏821中的应用图标,例如图33中的(B)所示的的图标8211、的图标8212。不限于此,用户还可以通过应用列表控件8213继续向侧边应用栏821中添加其他的应用图标。任意一个图标均可以响应于用户操作,使得电子设备打开相应的应用,当用户在当前应用界面中通过侧边应用栏821打开另一个应用时,则电子设备可以分屏显示这两个应用界面,用户可以基于这两个界面将其中一个应用提供的信息元素传输至另一个应用(具体可以参考前述对图2的相关说明),这也就是电子设备提供的“智慧多窗功能”。
其次,用户可以通过将界面内信息元素长按拖起的操作调出电子设备的侧边应用栏。
如图33中的(C)所示,用户界面83可以是电子设备中应用“浏览器”的应用界面,也可以是应用的应用界面,还可以是其他应用的应用界面,本申请对此不作限定;具体的,用户界面83与前述说明中的用户界面81可以是同一个界面。用户可以通过长按用户界面83中用户已经选中的文本831,将文本831拖起;在用户将文本831拖起之后(可以无需拖拽至侧边),电子设备即可响应该操作,显示如图33中(D)所示的用户界面84。
如图33中的(D)所示,用户界面84中可以显示有文本842以及侧边应用栏821。文本842即为文本831被拖起后进行缩小所得的文本,侧边应用栏中841可以包含应用列表 控件8414以及智慧流转图标区域8411、智慧多窗图标区域8412两个区域,这两个区域之间可以用分隔线8413分隔开,其中:
智慧流转图标区域8411可以显示有多个应用服务图标,需理解,智慧流转图标区域8411所显示的图标均可以用于对用户拖起的元素(即文本842)进行跨应用传输,且无需借助电子设备提供的分屏功能,这种传输方式与前述实施例中通过“跨应用传输界面”用户及界面进行传输的方式在本申请中可以称作电子设备的“智慧流转”功能。可选的,智慧流转图标区域8411中显示的图标也可以包括用户设置的固定显示的图标以及电子设备基于文本842中的内容为用户推荐并显示的图标,例如,在图33中的(D)所示的“全局收藏”的图标84111、“搜索”的图标84112、“日程”的图标84113、“备忘录”的图标84114中,“全局收藏”的图标84111、“搜索”的图标84112可以是固定显示的图标,而“日程”的图标84113、“备忘录”的图标84114可以是电子设备基于文本842中的内容为用户推荐显示的图标。
智慧多窗图标区域8412可以显示有一个或者多个应用图标,这部分图标可以是图33中(B)所示的用户界面82中侧边应用栏821所包含的全部或者部分图标。与智慧流转图标区域8411不同的是,该区域中的图标不可以用于对文本842进行跨应用传输,其仅仅显示在用户界面84中。此外,若电子设备为文本842推荐的应用服务图标超过一定数量时,侧边应用栏中可以优先显示电子设备为文本842推荐的应用服务图标,并不再显示智慧多窗图标区域8412以及其中所包含的应用图标。
应用列表控件8414可用于展示可添加至侧边应用栏841中图标,包括可添加至智慧流转图标区域8411中固定显示的应用服务图标,以及可添加至智慧多窗图标区域8412中的应用图标,具体可以参考图34。
图34示出了用户向侧边应用栏中添加图标的具体过程。
响应于用户对侧边应用栏中应用列表控件(例如前述说明中的应用列表控件8213或者应用列表控件8414)的点击操作,电子设备可以显如图34中的(A)中所示的用户界面8A。用户界面8A可以包括侧边应用栏8A1以及图标展示界面8A2,其中:
侧边应用栏8A1中可以包括智慧流转图标区域8A11、智慧多窗图标区域8A12以及用于向侧边应用栏8A1中图标添加图标的添加控件8A13。
图标展示界面8A2可以显示有智慧多窗图标展示区域8A21以及智慧流转图标展示区域8A22。可理解的,智慧多窗图标展示区域8A21中的图标可以添加至侧边应用栏8A1中的智慧多窗图标区域8A12;智慧流转图标展示区域8A22中的图标可以添加至侧边应用栏8A1中的智慧流转图标区域。
如图34中的(A)所示,响应于电子设备对添加控件8A11的点击操作,电子设备可以显示如图34中的(B)中所示的用户界面8B。如用户界面8B所示,图标展示界面8B2中的所展示的每个图标的右上角都显示有待添加的符号,且侧边应用栏8B1中的智慧流转图标区域8B11、智慧多窗图标区域8B12均显示有空白位置,用于存放用户新添加的图标。
具体的,用户可以通过点击智慧多窗图标展示区域8B21或智慧流转图标展示区域8B22中的任意一个图标,将该图标添加至智慧流转图标区域8B11或智慧多窗图标区域8B12的空白图标位置中。例如,用户可以通过点击智慧多窗图标展示区域8B21中的“备忘录”的 图标,将其添加至智慧多窗图标区域8B12中的空白位置8B121中,或者用户可以通过点击智慧流转图标展示区域8B22中的“扫一扫相机”的图标,将其添加至智慧流转图标区域8B11中的空白位置8B111中。之后,用户可以通过点击侧边应用栏8B1中的确认控件8B14,电子设备即可保存用户添加的图标选项,在下次显示出侧边应用栏的时候,将新加入的图标显示在侧边应用栏中。
目前大部分的智能设备还为用户提供了快捷的录屏功能,例如在一些场景中,用户可以通过双指关节双击屏幕下来对电子设备当前的界面演示过程进行录屏。因此,针对电子设备提供的快捷录屏功能,接下来结合图35对录屏场景下使用跨应用传输界面对所录视频进行跨应用传输的过程进行说明。
图35为用户基于跨应用传输界面对所录视频进行跨应用传输时电子设备的界面变化过程的示意图。
如图35中的(A)所示,用户界面85可以是电子设备中应用“浏览器”的应用界面,也可以是应用的应用界面,还可以是其他应用的应用界面,本申请对此不作限定。此时用户已经通过相关操作开启了电子设备的录屏功能。在用户界面85中,录屏功能框可以包括麦克风控件8511、时间控件8512以及选项控件8513,其中;
麦克风控件8511可响应于用户操作,以使电子设备开始/停止对外界声音进行录制;
时间控件8512可用于实时显示录制的时长,且其还可响应于用户操作,以使电子设备停止录屏;
选项控件8513可响应于用户操作,以使电子设备展示更多的录屏设置选项,例如是否录制用户对屏幕的操作轨迹等。
例如图35中的(A)所示,响应于用户对时间控件8512的点击操作,电子设备可以停止录屏过程,并显示如图35中的(B)所示的用户界面86。
如图35中的(B)所示,用户界面86可以包括视频文件861。视频文件861即为电子设备响应于用户的录屏操作所录取的视频。在录屏之后,视频文件861可以显示在用户界面86中,且一般会持续两到三秒,以便于用户能直接点击视频文件861以对其进行编辑、保存等操作;若用户并未对视频文件861进行操作,则电子设备可以自动将其保存至相册中。
而在本申请实施例中,在电子设备将视频文件861显示在用户界面86中的这段时长内,用户可以对视频文件861进行长按操作,将其拖动至电子设备屏幕的侧边后,通过“跨应用传输界面”对其进行跨应用传输。如图35中的(B)所示,电子设备可以响应于用户对视频文件861的长按并拖动至侧边的操作,显示如图35中的(C)所示的用户界面87。
如图35中的(C)所示,用户界面87即为跨应用传输界面。用户界面87可以包括子界面871、图标区域872、视频文件873,其中:
子界面871以及图标区域872的具体内容和功能可以参考前述说明,此处不再赘述。
同理,为了不对图标区域872造成过多的遮挡,在视频文件861靠近图标区域时,电子设备对原先的视频文件861进行了缩小,得到了视频文件873。
同样的,在用户界面87中,用户将视频文件873放置在图标区域872中对应的图标上 并松手,电子设备即可响应于该用户操作将该信息元素传输到图标对应的应用服务中,并显示相应的应用界面。
此外,在用户使用快捷截屏功能截取电子设备的图像之后,用户还可以对所截取的图像进行编辑后,在编辑页面中利用“跨应用传输界面”对编辑后的图像进行传输,具体请参阅图36。
如图36中的(A)所示,用户界面88可以是电子设备中应用“浏览器”的应用界面,也可以是应用的应用界面,还可以是其他应用的应用界面,本申请对此不作限定。响应于用户对用户界面88的快速截屏操作,例如图36中的(A)所示的指关节双击操作,电子设备可以快速获取用户界面88的全屏图像,并显示如图36中的(B)所示的用户界面89。
如图36中的(B)所示,用户界面89中可以包括截屏图像891。截屏图像891即为电子设备响应于用户对用户界面88进行指关节截屏所获得的图像。在截屏之后,截屏图像891可以显示在用户界面89中,且一般会持续两到三秒,以便于用户能直接点击截屏图像891以对其进行编辑、保存等操作;若用户并未对截屏图像891进行操作,则电子设备可以自动将其保存至相册中。
而在本申请实施例中,在电子设备将截屏图像891显示在用户界面89中的这段时长内,电子设备可以响应于如图36中的(B)所示的用户对截屏图像891的点击操作,显示如图36中的(C)所示的用户界面90。用户界面90即为截屏图像891的编辑界面,其可以包括缩略图901以及涂鸦选项902,其中:
缩略图901可以是前述用户界面88的缩略图。
涂鸦选项902可响应于用户操作,以使电子设备响应于用户对屏幕的触摸操作,将用户在屏幕上的触摸轨迹绘制到缩略图901上。
如图36中的(C)所示,用户可以按照图36中的(D)所示带方向的虚线所示的轨迹在缩略图901上进行涂鸦,电子设备可以响应该用户操作(本申请实施例中,该操作可以被称为“第八操作”),将上述带方向的虚线所示的轨迹绘制到缩略图901上,并显示如图36中的(D)所示的用户界面91。可选的,在用户界面90中,缩略图901中所包含的图像同样可以被用户长按后拖起以使电子设备显示本申请提供的跨应用传输界面,并基于跨应用传输界面进行传输;当用户点击用户界面90中的文本识别控件之后,电子设备同样可以识别图像901中所包含的文本,该文本同样可以被用户长按后拖起以使电子设备显示本申请提供的跨应用传输界面,并基于跨应用传输界面进行传输,具体可以参考前述对图7和图8的相关说明,此处不再赘述。
如图36中的(D)所示,在用户界面91中,缩略图901上已经显示有用户绘制的三角图案911了。
可以理解的,用户界面91依旧是图像的编辑界面,在用户界面91中,用户同样可以对缩略图901进行长按操作,将其拖动至电子设备屏幕的侧边后,通过“跨应用传输界面”对其进行跨应用传输。如图36中的(D)所示,电子设备可以响应于用户对缩略图901(此时缩略图901已经带有用户绘制的图案,即三角图案911了)的长按并拖动至侧边的操作, 显示如图36中的(E)所示的用户界面92。
如图36中的(E)所示,用户界面92即为跨应用传输界面。用户界面92可以包括子界面921、图标区域922、图像923,其中:
子界面921以及图标区域922的具体内容和功能可以参考前述说明,此处不再赘述。
同理,为了不对图标区域922造成过多的遮挡,在缩略图901靠近图标区域时,电子设备对原先的缩略图901进行了再次缩小,得到了图像923(图像923中也带有用户绘制的图案,即三角图案911)。
同样的,在用户界面92中,用户将图像923放置在图标区域922中对应的图标上并松手,电子设备即可响应于该用户操作将该信息元素传输到图标对应的应用服务中,并显示相应的应用界面。
在本申请实施例中,用户界面88可以被称为“第五界面”,用户界面89可以被称为“第六界面”,用户界面91可以被称为“第七界面”,用户界面90可以被称为“编辑界面”,图像891、图像901可以被称为“第一图像”,用户界面95可以被称为“第七界面”,用户对截屏图像891的点击操作、用户可以按照图36中的(D)所示带方向的虚线所示的轨迹在缩略图901上进行涂鸦的操作、用户对缩略图901进行长按操作并将其拖动至电子设备屏幕的侧边的操作可以一起被称为“第八操作”。
此外,在一些实施例中,电子设备还为用户提供了长截屏的功能。长截屏,也称为滚动截屏,是一种截取界面当前内容的有效方法,能够获得界面中的全部内容,而非只截取可见的部分。它在网页浏览场景下可以发挥广泛的应用,对于调查网页信息或搜集素材都很有用处。一般情况下,滚动截屏的流程是先使用滚动函数对网页进行滚动,不断的截取网页内容。网页内容截取完成之后,程序会自动将全部内容组合在一起,形成一张完整的长图。本申请的提供的“跨应用传输界面”也同样适用于用户通过长截屏的功能截取的图像,具体请参阅图37。
如图37中的(A)所示,在如图37中的(A)所示,用户界面93可以是电子设备中应用“浏览器”的应用界面,也可以是应用的应用界面,还可以是其他应用的应用界面,本申请对此不作限定。响应于用户对用户界面93的长截屏操作,例如图37中的(A)所示的指关节敲击后画出“S”轨迹的操作,电子设备可以快对网页进行滚动,不断的截取网页内容。当用户再次点击屏幕后(图37中的(A)未示出该操作),即表示用户需要的网页内容已经截取完成,之后,电子设备会将截取的全部内容组合在一起,形成一张完整的长图,并显示如图37中的(B)所示的用户界面94。
如图37中的(B)所示,用户界面94中可以包括长截屏图像941。长截屏图像941即为电子设备响应于用户对用户界面93进行长截屏操作所获得的图像。在长截屏之后,用户可以在用户界面94中通过相关的编辑选项对长截屏图像941进行编辑、保存等操作。
在本申请实施例中,电子设备还可以响应于如图37中的(B)所示的用户对长截屏图像941长按并拖动至侧边的操作,显示如图37中的(C)所示的用户界面95。
如图37中的(C)所示,用户界面95即为跨应用传输界面。用户界面95可以包括子界面951、图标区域952、图像953,其中:
子界面951以及图标区域952的具体内容和功能可以参考前述说明,此处不再赘述。
同理,为了不对图标区域952造成过多的遮挡,在长截屏图像941靠近图标区域时,电子设备对其进行了缩小,得到了图像953。
同样的,在用户界面95中,用户将图像953放置在图标区域952中对应的图标上并松手,电子设备即可响应于该用户操作将该信息元素传输到图标对应的应用服务中,并显示相应的应用界面。
可选的,当长截屏图像941大小超出应用服务规定的上限时、或者长截屏图像941的格式不符合目标应用服务的规定时,长截屏图像941也就不能通过“跨应用传输界面”传输至目标应用服务了。在这种情况下,电子设备同样可以在界面中展示toast反馈,以提示用户信息未能传输成功。
例如,当长截屏图像941传输失败时,电子设备可以如图37中的(D)所示的用户界面96。用户界面96的下方可以显示有toast反馈961。具体的,toast反馈961可以显示提示信息“图片超过智慧流传输上限,请裁剪后再传输。”,以提示用户传输的图像超出了目标应用服务的限制,因此传输过程失败。
同样的,若用户不对toast反馈961进行任何操作,toast反馈961可以在显示一段时间(例如2s-3s)之后自动消失;或者,当toast反馈还显示在用户界面96中时,用户可以通过电子用户界面96中除了toast反馈961所在位置之外的其他位置,以使toast反馈961消失。
本申请实施例中,用户界面93可以被称为“第五界面”,用户界面94可以被称为“第六界面”,长截屏图像941或图像953可以被称为“第一图像”,用户界面95可以被称为“第七界面”,用户将图像953放置在图标区域952中对应的图标上并松手的操作可以被称为“第九操作”。
下面介绍“智慧流转”功能所涉及的系统设置界面。
首先结合图38介绍电子设备开启“智慧流转”功能所涉及的用户界面。
如图38中的(A)所示,用户界面97可以是电子设备出厂后,用户初次开机时电子设备为用户显示的使用导航界面。在用户界面97中,智慧流转服务选项卡971中可以包含开关控件9711,其可以默认设置为开启状态,即电子设备已经默认打开“智慧流转”功能。当然,用户也可以通过点击开关控件9711,以使电子设备关闭“智慧流转”功能。
此外,在用户日常使用电子设备的过程中,用户也可以通过电子设备系统设置里面的相关界面开启或者关闭“智慧流转”功能。如图38中的(B)所示,用户可以打开系统设置里面的“智慧流转”设置界面,即用户界面98,并通过操控“智慧流转”选项卡981中的开关控件9811来启或者关闭“智慧流转”功能。若此时开关控件9711显示为关闭状态,则用户可以通过点击开关控件9811将“智慧流转”功能开启,电子设备也会响应该用户操作,显示如图38中(C)所示的用户界面99。
如图38中(C)所示,用户界面99中可以包括提示框991,其可用于询问用户是否同意将电子设备屏幕画面开放给“智慧流转”。提示框991中可以包括“始终允许”选项9911,“仅使用期间允许”选项9912以及“禁止”选项9913。当用户点击“始终允许”选项9911 或“仅使用期间允许”选项9912后,电子设备即可成功开启“智慧流转”功能;当用户点击“禁止”选项9913后,电子设备将无法开启“智慧流转”功能。
图39示出了一些用于了解“智慧流转”功能以及编辑智慧流转页面中应用服务图标的系统设置界面。
如图39中的(A)所示,用户界面00为电子设备中“系统设置”中与“智慧助手”功能相关的界面。在用户界面00中,用户可以通过点击“智慧流转”选项卡,以使电子设备显示如图39中的(B)所示的用户界面38。
如图39中的(B)所示,用户界面38与前述说明中的用户界面98可以是同一个用户界面。在用户界面38中,可以显示有“了解详情”控件381以及“自定义服务”选项卡382,其中:
“了解详情”控件381可响应于用户的点击操作,以使电子设备显示如图39中的(C)所示的用户界面39。用户界面39为系统设置提供的用户界面,其可用于向用户展示“智慧流转”功能的具体作用以及具体的操作步骤等。
“自定义服务”选项卡382可响应于用户的点击操作,以使电子设备显示如图39中的(D)所示的用户界面40。结合前述说明可知,在跨应用传输界面所显示的图标中,有一部分图标是用户自定义的且固定显示在图标区域中的图标,而另一部分图标则是电子设备基于用户拖起的元素为用户推荐的图标。因此,在用户界面40中,图标展示卡401中所展示的即为用户已经确定用于固定显示在图标区域中的图标,而图标展示卡402中所展示的图标为用户还未设置固定展示在图标区域中的图标。用户可以通过点击图标展示卡401中任意一个图标右上角的移除符号“-”,以使该图标不再固定显示在跨应用传输界面的图标区域中;同样,用户可以通过点击图标展示卡402中任意一个图标右上角的添加符号“+”,以使该图标固定显示在跨应用传输界面的图标区域中(被添加之后,该图标也会同时显示在图标展示卡401的空白图标区域,例如4011中)。
需理解,图38-图39仅示例性示出了本申请实施例提供的与“系统设置”相关的用户界面,其不应构成对本申请实施例的限定。例如,对于图标展示卡402,其可以包含更多或者更少的应用服务图标,本申请对此不作限定。
接下来介绍本申请提供的电子设备。
该电子设备以是手机、平板电脑、可穿戴设备、车载设备、增强现实(augmented reality,AR)/虚拟现实(virtual reality,VR)设备、笔记本电脑、超级移动个人计算机(ultra-mobile personal computer,UMPC)、上网本、个人数字助理(personaldigital assistant,PDA)或专门的照相机(例如单反相机、卡片式相机)等,本申请对该电子设备的具体类型不作任何限制。
图40示例性示出了该电子设备的结构。
如图40所示,电子设备100可以包括处理器110,外部存储器接口120,内部存储器121,天线1,天线2,移动通信模块150,无线通信模块160,摄像头193,显示屏194等。
可以理解的是,本发明实施例示意的结构并不构成对电子设备100的具体限定。在本申请另一些实施例中,电子设备100可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬 件的组合实现。
处理器110可以包括一个或多个处理单元,例如:处理器110可以包括应用处理器(application processor,AP),调制解调处理器,图形处理器(graphics processing unit,GPU),图像信号处理器(image signal processor,ISP),控制器,视频编解码器,数字信号处理器(digital signal processor,DSP),基带处理器,和/或神经网络处理器(neural-network processing unit,NPU)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。
控制器可以根据指令操作码和时序信号,产生操作控制信号,完成取指令和执行指令的控制。
处理器110中还可以设置存储器,用于存储指令和数据。在一些实施例中,处理器110中的存储器为高速缓冲存储器。该存储器可以保存处理器110刚用过或循环使用的指令或数据。如果处理器110需要再次使用该指令或数据,可从所述存储器中直接调用。避免了重复存取,减少了处理器110的等待时间,因而提高了系统的效率。
电子设备100的无线通信功能可以通过天线1,天线2,移动通信模块150,无线通信模块160,调制解调处理器以及基带处理器等实现。
天线1和天线2用于发射和接收电磁波信号。电子设备100中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用,以提高天线的利用率。例如:可以将天线1复用为无线局域网的分集天线。在另外一些实施例中,天线可以和调谐开关结合使用。
移动通信模块150可以提供应用在电子设备100上的包括2G/3G/4G/5G等无线通信的解决方案。
调制解调处理器可以包括调制器和解调器。
无线通信模块160可以提供应用在电子设备100上的包括无线局域网(wireless local area networks,WLAN)(如无线保真(wireless fidelity,Wi-Fi)网络),蓝牙(bluetooth,BT),全球导航卫星系统(global navigation satellite system,GNSS),调频(frequency modulation,FM),近距离无线通信技术(near field communication,NFC),红外技术(infrared,IR)等无线通信的解决方案。无线通信模块160可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块160经由天线2接收电磁波,将电磁波信号调频以及滤波处理,将处理后的信号发送到处理器110。无线通信模块160还可以从处理器110接收待发送的信号,对其进行调频,放大,经天线2转为电磁波辐射出去。
在一些实施例中,电子设备100的天线1和移动通信模块150耦合,天线2和无线通信模块160耦合,使得电子设备100可以通过无线通信技术与网络以及其他设备通信。
电子设备100通过GPU,显示屏194,以及应用处理器等实现显示功能。GPU为图像处理的微处理器,连接显示屏194和应用处理器。GPU用于执行数学和几何计算,用于图形渲染。处理器110可包括一个或多个GPU,其执行程序指令以生成或改变显示信息。
显示屏194用于显示图像,视频等。显示屏194包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display,LCD),有机发光二极管(organic light-emitting diode,OLED),有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode的,AMOLED),柔性发光二极管(flex light-emitting diode,FLED),Miniled,MicroLed,Micro-oLed,量子点发光二极管(quantum dot light emitting diodes,QLED)等。在一些实施 例中,电子设备100可以包括1个或N个显示屏194,N为大于1的正整数。
电子设备100可以通过ISP,摄像头193,视频编解码器,GPU,显示屏194以及应用处理器等实现拍摄功能。
外部存储器接口120可以用于连接外部存储卡,例如Micro SD卡,实现扩展电子设备100的存储能力。外部存储卡通过外部存储器接口120与处理器110通信,实现数据存储功能。例如将音乐,视频等文件保存在外部存储卡中。
内部存储器121可以用于存储计算机可执行程序代码,所述可执行程序代码包括指令。内部存储器121可以包括存储程序区和存储数据区。其中,存储程序区可存储操作系统,至少一个功能所需的应用程序(比如声音播放功能,图像播放功能等)等。存储数据区可存储电子设备100使用过程中所创建的数据(比如音频数据,电话本等)等。此外,内部存储器121可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件,闪存器件,通用闪存存储器(universal flash storage,UFS)等。处理器110通过运行存储在内部存储器121的指令,和/或存储在设置于处理器中的存储器的指令,执行电子设备100的各种功能应用以及数据处理。
在本申请实施例中,内部存储器121用于存储实现信息传输方法的计算机程序,以及,信息传输方法中涉及到的推荐服务的方法的计算机程序,处理器110用于执行上述计算机程序,以实现该信息传输方法和推荐服务的方法。
在本申请中,电子设备中的GPU可以在用户对界面中的信息元素拖起后,根据显示屏194中所显示的内容,对该内容进行三维变换,在屏幕中营造出原始界面向内推开的视觉效果,并在电子设备的屏幕侧边显示推荐的应用和/或服务图标。
此外,在本申请实施例中,当用户将界面中的信息元素拖起之后,处理器110可以对该信息元素进行识别,包括识别该信息元素的种类以及信息元素中的具体内容,并基于识别结果确定相应的应用图标和/或应用服务图标,并生成相应的程序指令,该程序指令可以用于改变显示屏194的显示信息,例如更新显示屏中的界面为跨应用传输界面,该跨应用传输界面中所显示的图标即为前述处理器110基于识别结果确定应用图标和/或应用服务图标。
在一些实施例中,当用户利用“跨应用传输界面”完成信息的传输之后,处理器110还可以获取用户将信息传输给何种应用服务,并基于获取到的结果生成相应的程序指令,结合GPU为在屏幕中显示出相应的界面(例如该界面中可以显示有snack bar、胶囊、小窗口等),以将信息元素传输的结果反馈给用户。
在本申请实施例中,显示屏194用于显示前文各UI实施例所示的用户界面。显示屏194还可用于接收用户作用于显示屏中的用户操作。处理器110用于响应于电子设备100检测到的用户操作,确定各类热区所在的位置,并响应用户作用于各类热区的用户操作,触发热区对应的功能。电子设备100中各器件所执行的操作,具体可参考前文方法实施例的相关描述,这里不再详细展开。
接下来介绍本申请提供的一种信息的传输方法,实施该方法,电子设备可以在用户对信息元素进行长按后拖拽的用户操作下,在界面中为用户显示相应的应用服务图标,用户 可以将拖起的元素放在相应的图标上,将该元素传输至图标对应的应用服务中。该方法能使电子设备能高效、快捷的完成应用之间的信息传输,有效减少用户完成信息跨应用传输所需的操作步骤,提高用户与电子设备之间的交互效率,进而提升用户体验。如图41所示,该方法可以包括但不限于以下步骤:
S101、电子设备显示第一界面。
上述电子设备可以是前述说明中的电子设备100。所述第一界面包括第一子界面和第二子界面,所述第一子界面用于显示第一应用的应用界面,所述第二子界面用于显示第二应用的应用界面,所述第一子界面包括第一信息,所述第二子界面用于在对所述第一信息的第一操作下将所述第一信息传输至所述第二应用中。
上述第一信息为图像、文本、音频文件、视频文件、文档文件中的任意一种,还可以是其他形式的信息,本申请对此不作限定。
S102、电子设备响应于针对第一信息的第二操作,显示第二界面。
所述第二操作可以用于选中所述第一信息,具体的,所述第二操作可以是对所述第一信息长按后拖拽至所述第一界面的侧边(即显示屏侧边)的操作。在用户不松手的情况下,被拖起的所述第一信息随着用户的指尖在所述第一界面中移动。在用户将上述第一信息拖动至离屏幕右侧边或左侧边的距离小于一定阈值的情况下,电子设备即可显示上述第二界面。在上述第二界面中,上述至少一个应用服务图标所对应的应用服务都是可以接收上述第一信息的应用服务,例如,在上述第一信息为图像的情况下,的好友聊天服务可以发送该图像,的朋友圈服务可以用于分享该图像,的人像美化服务可以对该图像进行美化,电子设备提供的搜索服务可以对该图像进行智能搜索等,因此,上述至少一个应用服务图标中可以包括这些服务对应的应用服务图标。
在一个可能的实施方式中,上述至少一个应用服务图标可以包括至少一个第一图标,上述至少一个第一图标为基于上述第一信息推荐的应用服务图标。可选的,上述第二界面还包括图标区域,上述至少一个应用服务图标显示在上述图标区域中,上述至少一个应用服务图标还包括至少一个第二图标,上述至少一个第二图标为自定义显示的应用服务图标,上述至少一个第一图标显示在上述至少一个第二图标的上方。
也就是说,且上述第二界面中的至少一个应用服务图标可以分为两部分,其中一部分为右为固定显示的图标(即上述至少一个第二图标),另一部分图标可以是用户基于上述第一信息为用户推荐的应用服务图标。可选的,这两部分图标之间可以显示有用于区分的分隔线。其中,上述至少一个第二图标是用户根据自己的使用习惯、使用频率自定义显示的图标,无论用户基于电子设备分享何种信息,电子设备为基于该信息显示的图标中可以均包含这部分图标,以最大可能贴合用户的需求;而上述至少一个第一图标是电子设备根据上述第一信息所包含的元素推荐的,在用户通过本方法分享其他信息时,其推荐的应用服务图标可以与上述至少一个第一图标中的图标不同,具体可以参考前述对图28-图31的相关说明,这里不再赘述。
需理解,在日常使用电子设备的过程中,用户也经常会对一些元素进行拖拽操作,这些拖拽操作可能并不是为了将拖拽的元素进行跨应用传输(例如文档编辑中拖拽文字改变文字的位置或段落),因此,如何为结合用户操作为,并结合用户的操作习惯引导用户使用 本申请提供的传输方法,并为用户设定本方法的触发规则,是进一步提升用户与电子设备交互效率的关键。因此,在一个可能的实施方式中,上述第一界面还包括第一触发区域和第二触发区域,上述第一触发区域大于上述第二触发区域,上述第二操作包括第一子操作和第二子操作,上述第一子操作为将上述第一信息移动至上述第一触发区域中的操作,上述第二子操作为将上述第一信息移动至上述第二触发区域的操作,上述响应于针对第一界面中第一信息的第二操作,显示第二界面,包括:响应于上述第一子操作,在上述第一信息在上述第一触发区域中停留时间达到第一时长的情况下,在上述第一界面中显示光带指引特效,上述光带指引特效用于指示将上述第一信息移动至上述第二触发区域;响应于上述第二子操作,显示上述第二界面。
在本实施方式中,上述第一界面可以包括上述第一触发区域以及上述第二触发区域,可选的,上述第一触发区域和上述第二触发区域的具体大小位置可以不显示在用户界面中,即用户在上述第一界面中并不能直接观察到这两个区域的具体轮廓,这两个区域的大小、位置可以仅以电子设备可感知(例如程序代码)的形式存储在电子设备中。在用户将上述第一信息拖拽至上述第一触发区域中时,电子设备可以在上述第一界面中(例如第一界面的边缘)显示出特效,以提示用户将图像进一步将图像往更靠近上述第二触发区域的方向拖动;上述特效可以是有发光特效、阴影特效等用户可视的特效,也可以是其他用户可感知的特效,本申请对此不作限定;可选的,电子设备也可以在用户将上述第一信息拖拽至上述第一触发区域中、并将上述第一信息上述第一触发区域中持续停留时长T之后,才在上述第一界面中显示出特效,具体的,上述T可以被设定为600毫秒。当用户将上述第一信息继续拖动到上述第二触发区域中时,电子设备可以即刻响应于该操作,显示上述第二界面。
在一个可选的实施方式中,在所述第二界面中还包括关门触发区域。当用户将拖起的所述第一信息拖拽至所述第三触发区域中时,电子设备可以不再显示所述第二界面,而重新显示所述第一界面,且在用户不松手的情况下,在重新显示所述第一界面时,在所述第一界面中所述第一信息依旧处于被用户拖起的状态,以便于用户重新选择将信息进行跨应用传输的方式。具体可以参考前述对图9-图15的相关说明,此处不再赘述。
S103、电子设备响应于针对上述第一信息的第三操作,将上述第一信息传输到目标图标对应的应用服务中。
可选的,上述第三操作为将上述第一信息与上述目标图标关联的操作。例如,上述第三操作为将上述第一信息移动至上述目标图标的操作。
在上述第二界面中,用户通过上述第三操作将上述第一信息与上述目标图标关联,电子设备即可响应于上述第三操作将上述第一信息传输到上述目标图标对应的应用服务中。具体的,上述第三操作可以是将上述第一信息拖拽靠近上述目标图标的操作,也可以是将上述第一信息拖拽至上述目标图标上并松手的操作,还可以是其他将上述第一信息与上述目标图标相关联操作,只要上述第三操作可以在上述至少一个应用服务图标中挑选出用户需要的上述目标图标,并将上述第一信息与上述目标图标相关联即可。
可理解的,本申请提供的信息传输过程从用户拖起上述第一信息到将上述第一信息放入上述目标图标对应的应用服务的整个过程都是连续的,这里所说的“连续”是指用户无 需进行复制、粘贴等操作、也无需进行应用切换操作,整个操作过程用户的手指可以无需离开电子设备的屏幕,操作简单快捷,可以有效提升用户对信息进行跨应用传输的效率,提升用户体验。
可选的,上述第二界面还可以显示有子界面。上述子界面中所显示的元素内容与上述第一界面中所显示的元素内容(除状态栏之外)一样。实际上,显示在上述第二界面中的上述子界面可以认为是电子设备将上述第一界面的全部元素内容(除状态栏之外)进行三维变换后所得到的界面。在上述第二界面中,上述子界面可以在屏幕中营造出原始界面(即上述第一界面)向内推开的视觉效果。可理解的,这种“开门”的视觉效果隐喻了传输元素(即上述第一信息)的行为,相比于复制粘贴更具直观性,且这种信息传输方式保证了用户界面的有效浏览区域,能在通过上述子界面观看到历史应用界面(即上述第一界面)的同时将上述第一信息传输至其他应用服务中,能进一步提升用户体验。可选的,在上述第二界面中,上述子界面后面的背景可以被设定为电子设备的桌面背景(即桌面壁纸)叠加模糊效果后的所得的画面,以为用户提供更好的视觉效果。
可以理解的,电子设备可以为基于上述第一信息为用户推荐能够接收上述第一信息的多个应用服务,并在上述第二界面中的右侧展示这些应用服务的图标,具体的,这些应用服务图标的数量上限可以为20个。在一个可能的实施方式中,上述至少一个应用图标包括至少一个显示在上述图标区域中的图标以及至少一个未显示在上述图标区域中的图标,上述目标图标未显示在上述图标区域中,上述第二界面中还包括第三触发区域,电子设备可以响应于对上述第一信息的第七操作,将上述至少一个显示在上述图标区域中的图标进行更新,直至上述目标图标显示在上述图标区域中,上述第七操作为将上述第一信息移动至上述第三触发区域中的操作。也就是说,当这些应用服务图标的数量超过一定阈值(例如7个)时,为了保证界面的整洁和可观性,电子设备在显示时,可以只将这些应用服务图标的一部分(例如7个)同时展示在上述第二界面中;当上述第二界面当前展示的图标均不是用户期望的应用服务时,用户还可以将上述第一信息放置在上述第三触发区域中,以使电子设备更新上述图标区域中的图标。具体的,上述第三触发区域可以设定在上述图标区域的正上方和/或正下方,具体可以参考前述对图27的相关说明。
为了能引导用户将上述第一信息精准地放入到自己需要的应用服务中,在拖拽上述第一信息至上述目标图标上的过程中,当上述第一信息靠近上述目标图标时(这里假设在整个拖拽过程中上述目标图标一直是上述至少一个应用图标中距离上述第一信息最近的图标),上述目标图标可以被放大,并且上述目标图标在上述第二界面中可以被移动,以使上述目标图标更靠近上述第一信息,在上述第二界面中营造出上述目标图标被上述第一信息吸附(即上述第一信息的移动方向与上述目标图标的移动方向相向,二者均在向对方靠近)的视觉效果,以提示用户上述第一信息已经与上述目标图标关联,若在此处松手,上述第一信息将被传输至上述目标图标对应的应用服务中。可选的,在上述第一信息与上述目标图标的距离小于第一阈值的情况下,电子设备才会在上述第二界面中放大上述目标图标和/或移动上述目标图标在上述第一界面中的位置。
在将上述第一信息传输到上述目标图标对应的应用服务中之后,电子设备还可以显示第三界面,上述第三界面可以根据上述第一信息所进入应用服务的种类以及信息传输的结 果设定为不同的界面效果。例如,上述第三界面可以显示悬浮窗、胶囊(最小化悬浮窗)、snack bar、toast反馈、上述目标图标对应的应用服务界面(全屏显示)中的一项或多项,以提示用户知晓上述第一信息的传输结果,便于用户进行下一步操作。具体可以参考前述对图16-图21的相关说明,这里不再赘述。
本申请实施例还提供了一种电子设备,该电子设备包括:一个或多个处理器和存储器;
其中,存储器与所述一个或多个处理器耦合,该存储器用于存储计算机程序代码,该计算机程序代码包括计算机指令,该一个或多个处理器调用该计算机指令以使得所述电子设备执行前述实施例中所示的方法。
上述实施例中所用,根据上下文,术语“当…时”可以被解释为意思是“如果…”或“在…后”或“响应于确定…”或“响应于检测到…”。类似地,根据上下文,短语“在确定…时”或“如果检测到(所陈述的条件或事件)”可以被解释为意思是“如果确定…”或“响应于确定…”或“在检测到(所陈述的条件或事件)时”或“响应于检测到(所陈述的条件或事件)”。
在上述实施例中,可以全部或部分地通过软件、硬件、固件或者其任意组合来实现。当使用软件实现时,可以全部或部分地以计算机程序产品的形式实现。所述计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行所述计算机程序指令时,全部或部分地产生按照本申请实施例所述的流程或功能。所述计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。所述计算机指令可以存储在计算机可读存储介质中,或者从一个计算机可读存储介质向另一个计算机可读存储介质传输,例如,所述计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线)或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。所述计算机可读存储介质可以是计算机能够存取的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。所述可用介质可以是磁性介质,(例如,软盘、硬盘、磁带)、光介质(例如DVD)、或者半导体介质(例如固态硬盘)等。
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,该流程可以由计算机程序来指令相关的硬件完成,该程序可存储于计算机可读取存储介质中,该程序在执行时,可包括如上述各方法实施例的流程。而前述的存储介质包括:ROM或随机存储记忆体RAM、磁碟或者光盘等各种可存储程序代码的介质。
以上所述,仅为本发明的具体实施方式,但本发明的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本发明揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本发明的保护范围之内。因此,本发明的保护范围应以所述权利要求的保护范围为准。

Claims (73)

  1. 一种信息传输方法,其特征在于,所述方法包括:
    显示第一界面,所述第一界面包括第一子界面和第二子界面,所述第一子界面用于显示第一应用的应用界面,所述第二子界面用于显示第二应用的应用界面,所述第一子界面包括第一信息,所述第二子界面用于在对所述第一信息的第一操作下将所述第一信息传输至所述第二应用中;
    响应于针对所述第一信息的第二操作,显示第二界面;所述第二界面包括所述第一信息和至少一个应用服务图标;
    响应于针对所述第一信息的第三操作,将所述第一信息传输到目标图标对应的应用服务中,所述目标图标为所述至少一个应用服务图标中的任意一个应用服务图标。
  2. 根据权利要求1所述的方法,其特征在于,在所述第一界面中,
    所述第一子界面和所述第二子界面以上下分屏或左右分屏的方式显示;
    或者,所述第一子界面和所述第二子界面以画中画的形式显示。
  3. 根据权利要求1或2所述的方法,其特征在于,所述第三操作为将所述第一信息与所述目标图标关联的操作。
  4. 根据权利要求1-3任一项所述的方法,其特征在于,所述第三操作为将所述第一信息移动至所述目标图标的操作。
  5. 根据权利要求3或4所述的方法,其特征在于,在移动所述第一信息至所述目标图标上的过程中,放大所述目标图标和/或移动所述目标图标在所述第一界面中的位置,移动所述目标图标的方向与移动所述第一信息的方向相向。
  6. 根据权利要求1至5任一项所述的方法,其特征在于,所述至少一个应用服务图标包括至少一个第一图标,所述至少一个第一图标为基于所述第一信息推荐的应用服务图标。
  7. 根据权利要求1至6任一项所述的方法,其特征在于,所述目标图标包含对应的文字说明,所述文字说明用于提示所述目标图标对应的应用或应用服务功能。
  8. 根据权利要求1-7任一项所述的方法,其特征在于,在将所述第一信息传输到所述目标图标对应的应用服务中之后,所述方法还包括:
    显示第三界面,所述第三界面包括所述第一界面中的全部内容,且所述第三界面还包括悬浮窗、信息反馈栏中的任意一种,所述悬浮窗用于显示所述目标图标或所述目标图标对应的应用服务界面,所述信息反馈栏用于提示所述电子设备对所述第一信息的传输结果。
  9. 根据权利要求8所述的方法,其特征在于,所述第三界面包括悬浮窗,所述悬浮窗 用于显示所述目标图标,所述第三界面还包括第二信息,所述显示第三界面之后,所述方法还包括:
    响应于针对所述第二信息的第四操作,将所述第二信息传输到所述目标图标对应的应用服务中,所述第四操作为将所述第二信息与所述悬浮窗相关联的操作。
  10. 根据权利要求8所述的方法,其特征在于,所述第三界面包括悬浮窗,所述悬浮窗用于显示所述目标图标对应的应用服务界面,所述悬浮窗包括展开控件,所述显示第三界面之后,所述方法还包括:
    响应于对所述展开控件的第五操作,将所述悬浮窗中显示的应用服务界面全屏显示。
  11. 根据权利要求8所述的方法,其特征在于,所述第三界面包括信息反馈栏,所述信息反馈栏包括跳转控件,所述显示第三界面之后,所述方法还包括:
    响应于对所述跳转控件的第六操作,显示第四界面,所述第四界面为所述目标图标对应的应用服务界面。
  12. 根据权利要求1-11任一项所述的方法,其特征在于,所述第一界面还包括第一触发区域和第二触发区域,所述第一触发区域大于所述第二触发区域,所述第二操作包括第一子操作和第二子操作,所述第一子操作为将所述第一信息移动至所述第一触发区域中的操作,所述第二子操作为将所述第一信息移动至所述第二触发区域的操作,所述响应于针对第一界面中第一信息的第二操作,显示第二界面,包括:
    响应于所述第一子操作,在所述第一信息在所述第一触发区域中停留时间达到第一时长的情况下,在所述第一界面中显示光带指引特效,所述光带指引特效用于指示将所述第一信息移动至所述第二触发区域;
    响应于所述第二子操作,显示所述第二界面。
  13. 根据权利要求12所述的方法,其特征在于,在所述第一子界面和所述第二子界面以上下分屏或左右分屏的方式显示的情况下,所述第一触发区域同时存在与所述第一界面和所述第二子界面中,且所述第二触发区域同时存在与所述第一界面和所述第二子界面中。
  14. 根据权利要求6-13任一项所述的方法,其特征在于,所述第二界面还包括图标区域,所述至少一个应用服务图标显示在所述图标区域中,所述至少一个应用服务图标还包括至少一个第二图标,所述至少一个第二图标为自定义显示的应用服务图标,所述至少一个第一图标显示在所述至少一个第二图标的上方。
  15. 根据权利要求14所述的方法,其特征在于,所述至少一个应用服务图标包括至少一个显示在所述图标区域中的图标以及至少一个未显示在所述图标区域中的图标,所述目标图标未显示在所述图标区域中,所述第二界面还包括第三触发区域,在响应于针对所述第一信息的第二操作之前,所述方法还包括:
    响应于对所述第一信息的第七操作,将所述至少一个显示在所述图标区域中的图标进行更新,直至所述目标图标显示在所述图标区域中,所述第七操作为将所述第一信息移动至所述第三触发区域中的操作。
  16. 根据权利要求1-15任一项所述的方法,其特征在于,所述第二界面中所述第一信息的面积小于所述第一界面中所述第一信息的面积。
  17. 一种信息传输的方法,其特征在于,包括:
    响应于对第五界面的全局截屏操作、局部截屏操作、长截屏操作中的任意一种操作,显示第六界面,所述第六界面中包括对所述第五界面进行截屏所得的第一图像;
    响应于针对所述六界面中所述第一图像的第八操作,显示第七界面;所述第七界面包括所述第一图像和至少一个应用服务图标;
    响应于针对所述第七界面中所述第一图像的第九操作,将所述第一图像传输到目标图标对应的应用服务中,所述目标图标为所述至少一个应用服务图标中的任意一个应用服务图标。
  18. 根据权利要求17所述的方法,其特征在于,所述第一图像为对所述第五界面进行全局截屏操作所得图像,所述响应于针对所述六界面中所述第一图像的第八操作,显示第七界面包括:
    响应于对所述第六界面中第一图像点击操作,显示编辑界面,所述编辑界面包括所述第一图像以及编辑选项,所述编辑选项用于对所述第一图像进行编辑;
    响应于通过所述编辑选项对所述第一图像的编辑操作,对所述编辑界面中的所述第一图像的图像内容进行更新之后,响应于针对所述编辑界面中所述第一图像的移动操作,显示所述第七界面,所述第八操作包括所述点击操作、所述编辑操作和所述移动操作。
  19. 一种信息传输的方法,其特征在于,包括:
    响应于对第八界面的局部截屏操作,显示第九界面,所述第九界面中包括对所述第八界面进行局部截屏操作所得的第二图像以及文本识别控件,所述文本识别控件用于识别所述第二图像中所包含的文本;
    响应于对所述文本识别控件的点击操作,显示第十界面,所述第十界面包含对所述第二图像进行识别得到的第一文本信息;
    响应于针对所述第十界面中所述第一文本信息的第十操作,显示第十一界面;所述第十一界面包括所述第一文本信息和至少一个应用服务图标;
    响应于针对所述第十一界面中所述第一文本信息的第十一操作,将所述第一文本信息传输到目标图标对应的应用服务中,所述目标图标为所述至少一个应用服务图标中的任意一个应用服务图标。
  20. 一种电子设备,其特征在于,所述电子设备包括:一个或多个处理器、存储器和显 示屏;
    所述存储器与所述一个或多个处理器耦合,所述存储器用于存储计算机程序代码,所述计算机程序代码包括计算机指令,所述一个或多个处理器调用所述计算机指令以使得所述电子设备执行如权利要求1-19中任一项所述的方法。
  21. 一种芯片系统,其特征在于,所述芯片系统应用于电子设备,所述芯片系统包括一个或多个处理器,所述处理器用于调用计算机指令以使得所述电子设备执行如权利要求1-19中任一项所述的方法。
  22. 一种计算机可读存储介质,包括指令,其特征在于,当所述指令在电子设备上运行时,使得所述电子设备执行如权利要求1-19中任一项所述的方法。
  23. 一种计算机程序产品,其特征在于,所述计算机程序产品包括计算机程序,所述计算机程序被处理器执行时实现如权利要求1-19中任一项所述的方法。
  24. 一种数据分享方法,其特征在于,所述方法包括:
    显示第一界面,所述第一界面包括第一元素;
    检测到对所述第一元素的拖动操作;
    当所述拖动操作为第一拖动操作,所述第一拖动操作的触控起始点在所述第一元素上并且位于显示屏的第一区域,触控终点位于所述显示屏的第二区域,显示第一菜单栏,所述第一菜单栏包含第一应用的图标和第二应用的图标,所述第一区域和所述第二区域不重叠;
    检测到继续将所述第一元素拖入所述第一应用的图标所在的区域并释放的操作后,将所述第一元素对应的第一数据分享到所述第一应用;
    当所述拖动操作为第二拖动操作,所述第二拖动操作的触控起始点在所述第一元素上并且位于所述第二区域,触控终点位于所述显示屏的第二区域,所述第二拖动操作的轨迹位于所述第二区域,不显示所述第一菜单栏;
    当所述拖动操作为第三拖动操作,所述第三拖动操作的触控起始点在所述第一元素上并且位于所述第二区域,触控终点位于所述第二区域,所述第三拖动操作的轨迹经过所述第一区域,显示所述第一菜单栏。
  25. 根据权利要求24所述的方法,其特征在于,
    当所述拖动操作为第一拖动操作,响应于所述第一拖动操作,显示所述第一菜单栏;
    当所述拖动操作为第二拖动操作,不响应于所述第二拖动操作而显示所述第一菜单栏;
    当所述拖动操作为第三拖动操作,响应于所述第三拖动操作,显示所述第一菜单栏。
  26. 根据权利要求24或25所述的方法,其特征在于,
    当所述拖动操作为第一拖动操作,所述第一拖动操作的触控终点在所述第二区域停留 第一时长后显示所述第一菜单栏;
    当所述拖动操作为第二拖动操作,所述第二拖动操作的触控终点在所述第二区域停留所述第一时长后,不显示所述第一菜单栏;
    当所述拖动操作为第三拖动操作,所述第三拖动操作的触控终点在所述第二区域停留所述第一时长后显示所述第一菜单栏。
  27. 根据权利要求24-26任一项所述的方法,其特征在于,所述第一拖动操作,和,继续将所述第一元素拖入所述第一应用的图标所在的区域并释放的操作,是连续且不中断的。
  28. 根据权利要求24-27任一项所述的方法,其特征在于,所述显示第一界面之前,所述方法还包括:
    显示第二界面,所述第二界面包括文本;
    检测到选中所述文本中的第一文本的操作,在所述第一文本上显示工具栏,所述工具栏包括多个用于对所述第一文本做处理的控件;
    所述显示第一界面,包括:
    检测到作用于所述第一文本的长按操作,停止显示所述工具栏,显示所述第一界面;
    其中,所述第一元素包括所述第一文本的预览图,所述第一数据包括所述第一文本。
  29. 根据权利要求24-28任一项所述的方法,其特征在于,所述显示第一界面之前,所述方法还包括:
    在显示第二界面时,检测到截屏操作;
    所述显示第一界面,包括:
    响应于所述截屏操作,显示所述第一界面,所述第一元素包括所述第二界面的截屏图像的预览图,所述第一数据包括所述截屏图像。
  30. 根据权利要求24-29任一项所述的方法,其特征在于,所述显示第一界面之前,所述方法还包括:
    显示第二界面,所述第二界面包括第一图像的图标和第二图像的图标;
    检测到选中所述第一图像的图标的操作;
    所述显示第一界面,包括:
    检测到作用于所述第一图像的图标的长按操作,显示所述第一界面;
    其中,所述第一元素包括所述第一图像的图标的预览图,所述第一数据包括所述第一图像。
  31. 根据权利要求24-30任一项所述的方法,其特征在于,
    所述第一菜单栏,和,所述第一拖动操作或所述第三拖动操作的触控终点所在的所述第二区域,在所述显示屏中的同侧。
  32. 根据权利要求24-31任一项所述的方法,其特征在于,所述方法还包括:
    当所述拖动操作为第一拖动操作,或者,当所述拖动操作为第三拖动操作,在显示所述第一菜单栏时,还将所述第一界面调整为第一侧的透视样式,所述第一侧为所述第一菜单栏在所述显示屏中的一侧。
  33. 根据权利要求24-32任一项所述的方法,其特征在于,所述第一界面还包括播放中的视频,所述方法还包括:
    当所述拖动操作为第一拖动操作,或者,当所述拖动操作为第三拖动操作,在显示所述第一菜单栏时,显示所述第一界面的截屏图像,并且所述第一界面的截屏图像显示为第一侧的透视样式,所述第一侧为所述第一菜单栏在所述显示屏中的一侧。
  34. 根据权利要求24-33任一项所述的方法,其特征在于,所述第二区域包括:所述显示屏中左侧边缘的矩形区域,和,所述显示屏中右侧边缘的矩形区域,所述矩形区域的高度和所述显示屏的高度相同。
  35. 根据权利要求24-34任一项所述的方法,其特征在于,当所述拖动操作为第一拖动操作,所述第一拖动操作的轨迹经过所述第三区域,所述第三区域包含所述第二区域;
    所述方法还包括:
    响应于所述第一拖动操作中将所述第一元素拖动至所述第三区域的操作,显示光带,所述光带和所述第一菜单栏位于所述显示屏中的同侧;
    所述显示第一菜单栏,包括:
    响应于所述第一拖动操作中将所述第一元素拖动至所述第三区域后再拖动至所述第二区域的操作,停止显示所述光带,显示第一菜单栏。
  36. 根据权利要求35所述的方法,其特征在于,所述第三区域包括:所述显示屏中左侧边缘的矩形区域,和,所述显示屏中右侧边缘的矩形区域,所述第三区域的高度和所述显示屏的高度相同。
  37. 根据权利要求24-36任一项所述的方法,其特征在于,所述第一菜单栏还包含第三应用的图标和第四应用的图标,所述第一应用的图标、所述第二应用的图标、所述第三应用的图标、所述第四应用的图标由上至下依次排列;所述显示第一菜单栏之后,所述方法还包括:
    检测到将所述第一元素继续在第四区域内拖动的第四拖动操作,所述第四区域包含所述第一拖动操作或所述第三拖动操作的触控终点所在的所述第二区域,所述第四拖动操作的触控起始点,和,所述第一拖动操作或所述第三拖动操作的触控终点相同,所述第四拖动操作的触控终点距离所述第一菜单栏中的所述第二应用的图标最近;
    响应于所述第四拖动操作,将所述第四应用的图标显示为基础尺寸,将所述第二应用的图标显示为在所述基础尺寸上放大第一比例后的尺寸,将所述第一应用的图标和所述第 三应用的图标显示为在所述基础尺寸上放大第二比例后的尺寸;所述第一比例大于所述第二比例。
  38. 根据权利要求37所述的方法,其特征在于,
    所述第四区域包括:包含所述第一拖动操作或所述第三拖动操作的触控终点所在的所述第二区域的矩形区域,所述第四区域的高度和所述显示屏的高度相同。
  39. 根据权利要求37或38所述的方法,其特征在于,检测到将所述第一元素继续在第四区域内拖动的第四拖动操作之后,所述方法还包括:
    检测到继续将所述第一元素拖动至第五区域的第五拖动操作,所述第五区域和所述第四区域不重叠;
    响应于所述第五拖动操作,将所述第一菜单栏中的各个图标显示为所述基础尺寸。
  40. 根据权利要求24-39任一项所述的方法,其特征在于,当所述拖动操作为第一拖动操作,或者,当所述拖动操作为第三拖动操作,在显示所述第一菜单栏之后,所述方法还包括:
    检测到继续将所述第一元素拖动至第六区域的第六拖动操作,所述第六区域和所述第二区域不重叠,且所述第六区域位于所述第一菜单栏在显示屏中的相对侧;
    响应于所述第六拖动操作,停止显示所述第一菜单栏。
  41. 根据权利要求24-40任一项所述的方法,其特征在于,所述方法还包括:
    显示第三界面,所述第三界面包括第二元素;
    检测到对所述第二元素的拖动操作;
    当所述拖动操作为第七拖动操作,所述第七拖动操作的触控起始点在所述第二元素上并且位于显示屏的第七区域,触控终点位于所述显示屏的第八区域,显示第二菜单栏,所述第七区域和所述第八区域不重叠;
    当所述拖动操作为第八拖动操作,所述第八拖动操作的触控起始点在所述第二元素上并且位于所述第八区域,触控终点位于所述显示屏的第八区域,所述第八拖动操作的轨迹经过所述第七区域,显示所述第二菜单栏;
    当所述拖动操作并非所述第七拖动操作或所述第八拖动操作,不显示所述第二菜单栏;
    其中,所述第八区域为所述第二区域的部分区域。
  42. 根据权利要求41所述的方法,其特征在于,
    所述第八区域包括:所述显示屏中左侧边缘的矩形区域,和,所述显示屏中右侧边缘的矩形区域;所述第八区域的高度和所述第二区域的高度相同,所述第八区域的宽度为所述第二区域宽度的一半。
  43. 根据权利要求41或42所述的方法,其特征在于,所述第三界面由第五应用提供, 所述第五应用包括文字编辑类应用。
  44. 根据权利要求24-43任一项所述的方法,其特征在于,
    所述显示屏处于横屏状态时的所述第二区域,和,所述显示屏处于竖屏状态时的所述第二区域,不同。
  45. 根据权利要求24-44任一项所述的方法,其特征在于,
    所述第一界面由第六应用提供,所述第六应用不同于所述第一应用。
  46. 一种电子设备,其特征在于,包括:存储器、处理器及存储在所述存储器上的计算机程序,所述处理器执行所述计算机程序以实现如权利要求24-45中任一项所述的方法。
  47. 一种计算机可读存储介质,其特征在于,其上存储有计算机程序,所述计算机程序被处理器执行时实现如权利要求24-45中任一项所述的方法。
  48. 一种计算机程序产品,其特征在于,所述计算机程序产品包括计算机程序,所述计算机程序被处理器执行时实现如权利要求24-45中任一项所述的方法。
  49. 一种推荐服务的方法,其特征在于,所述方法应用于电子设备,所述方法包括:
    获取第一内容;
    将所述第一内容转换为第一实体,所述第一实体包括实体类别和实体值;
    根据所述第一实体识别到对应的第一意图;
    确定支持所述第一意图的服务;
    在显示屏中显示所述服务的图标。
  50. 根据权利要求49所述的方法,其特征在于,根据所述第一实体识别到对应的第一意图,具体包括:
    根据实体类别和/或模态与意图类别之间的映射关系,确定所述第一实体的实体类别和/或所述第一内容所属模态对应的第一意图类别;
    根据所述第一意图类别和所述实体值,确定第一意图。
  51. 根据权利要求49或50所述的方法,其特征在于,根据所述第一实体识别到对应的第一意图,具体包括:
    在全局意图体系中,找到标签为所述第一实体的实体类别的第一意图类别;
    将所述第一实体的实体值填充进所述第一意图类别所指示的槽位中,得到所述第一意图;
    其中,所述全局意图体系包括多类意图的信息,每一类意图的信息包括对应类别的以下几项:标签,槽位名。
  52. 根据权利要求51所述的方法,其特征在于,每一类意图的信息还包括对应类别的以下一项或多项:标识、等级、槽位中填充的值的类别、槽位的必要性。
  53. 根据权利要求51或52所述的方法,其特征在于,所述全局意图体系预存在所述电子设备中,或者,由所述电子设备从网络中下载。
  54. 根据权利要求51-53任一项所述的方法,其特征在于,每一类意图的信息还包括对应类别的标识,确定支持所述第一意图的服务,具体包括:
    在全局服务体系中,找到支持的意图类别的标识为第一标识的服务,所述第一标识为所述第一意图所属的类别的标识;
    将所述全局服务体系中支持的意图类别的标识为所述第一标识的服务,确定为支持所述第一意图的服务;
    其中,所述全局服务体系包括多个服务的信息,每一个服务的信息包括:对应服务支持的意图类别的标识。
  55. 根据权利要求54所述的方法,其特征在于,每一个服务的信息还包括对应服务的以下一项或多项:ID、名称、图标、类型、槽位名、所属应用的包名、所述组件的名称、URL、用于传递数据的参数名称。
  56. 根据权利要求55所述的方法,其特征在于,所述全局服务体系预存在所述电子设备中,或者,由所述电子设备从网络中下载。
  57. 根据权利要求55或56所述的方法,其特征在于,每一个服务的信息还包括:槽位名、用于传递数据的参数名称,所述方法还包括:
    接收到作用于所述服务的图标中第一服务的图标的用户操作;
    将所述第一意图中第一槽位的值,传递给所述第一服务的第一参数,所述第一槽位为所述第一服务的信息的槽位名所指示的槽位,所述第一参数为所述第一服务的信息的参数名称所指示的参数;
    基于所述第一参数来启动所述第一服务。
  58. 根据权利要求49-57任一项所述的方法,其特征在于,获取第一内容,具体包括:通过第一业务的入口获取第一内容;
    获取第一内容之前,所述方法还包括:
    订阅所述第一业务支持的意图类别,所述第一意图属于所述第一业务支持的意图类别。
  59. 根据权利要求49-57任一项所述的方法,其特征在于,获取第一内容,具体包括:通过第一业务的入口获取第一内容;
    获取第一内容之前,所述方法还包括:
    订阅所述第一业务支持的服务,所述第一服务属于所述第一业务支持的服务。
  60. 根据权利要求49-59任一项所述的方法,其特征在于,在确定支持所述第一意图的服务之后,在显示屏中显示所述服务的图标之前,所述方法还包括:
    对支持所述第一意图的多个服务排序,所述显示屏中显示的所述服务的图标按照对所述多个服务的排序依次排列。
  61. 根据权利要求60所述的方法,其特征在于,对支持所述第一意图的多个服务排序之前,所述方法还包括:
    对所述第一实体对应的多个第一意图排序,所述多个服务的排序依据所述多个第一意图的排序得到。
  62. 根据权利要求61所述的方法,其特征在于,对所述第一实体对应的多个第一意图排序,具体包括:
    使用点击率预估模型来对所述第一实体对应的多个第一意图排序;
    其中,
    所述点击率预估模型基于多组第一历史行为数据训练得到,一组第一历史行为数据包括:时间特征、内容特征、点击率特征;
    所述时间特征指示了以下一项或多项:电子设备历史获取内容的时间是否为工作日、是否为节假日、时段;
    所述内容特征指示了以下一项或多项:电子设备获取的所述内容的来源应用、所述内容的长度、所述内容对应的实体的实体类别、所述内容的模态;
    所述点击率特征指示了:电子设备获取所述内容并推荐服务后,用户对推荐的服务的点击率。
  63. 根据权利要求49-62任一项所述的方法,其特征在于,所述方法还包括:
    获取多组第二历史行为数据;
    根据所述多组第二历史行为数据,确定第一实体类别和/或第一模态,与第二意图类别之间具有映射关系;
    其中,一组第二历史行为数据包括:电子设备根据用户输入的对应第一实体类别和/或第一模态的内容后,在显示屏上显示推荐的服务的图标后,未接收到作用于所述服务的图标的用户操作,在停止显示所述服务的图标之后的第一时长内,所述电子设备在用户的触发下启动服务的行为数据;
    在所述多组第二历史行为数据中,启动频率最高的K个服务支持所述第二意图类别。
  64. 根据权利要求49-63任一项所述的方法,其特征在于,所述方法还包括:
    获取多组第二历史行为数据;
    根据所述多组第二历史行为数据,确定第三意图类别;
    其中,一组第二历史行为数据包括:电子设备根据用户输入的对应第一实体类别和/或第一模态的内容后,在显示屏上显示推荐的服务的图标后,未接收到作用于所述服务的图标的用户操作,在停止显示所述服务的图标之后的第一时长内,所述电子设备在用户的触发下启动服务的行为数据;
    所述第三意图类别根据所述多组第二历史行为数据中启动频率最高的N个服务定义。
  65. 根据权利要求64所述的方法,其特征在于,所述方法还包括:
    确定所述第一实体类别和/或所述第一模态,与第三意图类别之间具有映射关系。
  66. 根据权利要求50所述的方法,其特征在于,获取第一内容之后,所述方法还包括:
    加载实体类别和/或模态与意图类别之间的映射关系。
  67. 根据权利要求50-52任一项所述的方法,其特征在于,获取第一内容之后,所述方法还包括:
    加载所述全局意图体系。
  68. 根据权利要求53-56任一项所述的方法,其特征在于,获取第一内容之后,所述方法还包括:
    加载所述全局服务体系。
  69. 根据权利要求49-68任一项所述的方法,其特征在于,所述第一内容包括第一模态的内容和第二模态的内容,将所述第一内容转换为第一实体,具体包括:
    并行启动第一线程和第二线程,所述第一线程用于提取所述第一模态的内容的特征,所述第二线程用于提取所述第二模态的内容的特征;
    根据所述第一模态的内容的特征、所述第二模态的内容的特征,得到第一实体。
  70. 根据权利要求69所述的方法,其特征在于,所述第一线程包含一个或多个线程,所述第二线程包含一个或多个线程,一个线程用于调用一种实体识别能力来识别实体。
  71. 一种电子设备,其特征在于,包括:存储器、处理器及存储在所述存储器上的计算机程序,所述处理器执行所述计算机程序以实现如权利要求49-70中任一项所述的方法。
  72. 一种计算机可读存储介质,其特征在于,其上存储有计算机程序,所述计算机程序被处理器执行时实现如权利要求49-70中任一项所述的方法。
  73. 一种计算机程序产品,其特征在于,所述计算机程序产品包括计算机程序,所述计算机程序被处理器执行时实现如权利要求49-70中任一项所述的方法。
PCT/CN2024/099417 2023-06-16 2024-06-14 信息传输方法及电子设备 Ceased WO2024255888A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202480033942.1A CN121263767A (zh) 2023-06-16 2024-06-14 信息传输方法及电子设备

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN202310725366.4A CN119148893A (zh) 2023-06-16 2023-06-16 信息传输方法及电子设备
CN202310725366.4 2023-06-16
CN202310788791.8A CN119225609A (zh) 2023-06-29 2023-06-29 数据分享方法、相关设备
CN202310788791.8 2023-06-29

Publications (1)

Publication Number Publication Date
WO2024255888A1 true WO2024255888A1 (zh) 2024-12-19

Family

ID=93851380

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2024/099417 Ceased WO2024255888A1 (zh) 2023-06-16 2024-06-14 信息传输方法及电子设备

Country Status (2)

Country Link
CN (1) CN121263767A (zh)
WO (1) WO2024255888A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN120087378A (zh) * 2025-04-30 2025-06-03 清枫(北京)科技有限公司 基于交互式增强学习的游戏实时智能翻译方法及装置

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150339030A1 (en) * 2014-05-22 2015-11-26 Alibaba Group Holding Limited Method, apparatus, and system for data transfer across applications
CN106844067A (zh) * 2017-01-24 2017-06-13 维沃移动通信有限公司 一种内容的处理方法及移动终端
CN109782976A (zh) * 2019-01-15 2019-05-21 Oppo广东移动通信有限公司 文件处理方法、装置、终端及存储介质
CN110737386A (zh) * 2019-09-06 2020-01-31 华为技术有限公司 一种屏幕截取方法及相关设备
CN114020197A (zh) * 2021-09-30 2022-02-08 荣耀终端有限公司 跨应用的消息的处理方法、电子设备及可读存储介质
CN114706520A (zh) * 2022-04-01 2022-07-05 杭州逗酷软件科技有限公司 信息分享方法、装置、设备和计算机可读存储介质
CN115701576A (zh) * 2021-08-02 2023-02-10 北京小米移动软件有限公司 信息处理方法、装置、电子设备和存储介质

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150339030A1 (en) * 2014-05-22 2015-11-26 Alibaba Group Holding Limited Method, apparatus, and system for data transfer across applications
CN106844067A (zh) * 2017-01-24 2017-06-13 维沃移动通信有限公司 一种内容的处理方法及移动终端
CN109782976A (zh) * 2019-01-15 2019-05-21 Oppo广东移动通信有限公司 文件处理方法、装置、终端及存储介质
CN110737386A (zh) * 2019-09-06 2020-01-31 华为技术有限公司 一种屏幕截取方法及相关设备
CN115701576A (zh) * 2021-08-02 2023-02-10 北京小米移动软件有限公司 信息处理方法、装置、电子设备和存储介质
CN114020197A (zh) * 2021-09-30 2022-02-08 荣耀终端有限公司 跨应用的消息的处理方法、电子设备及可读存储介质
CN114706520A (zh) * 2022-04-01 2022-07-05 杭州逗酷软件科技有限公司 信息分享方法、装置、设备和计算机可读存储介质

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN120087378A (zh) * 2025-04-30 2025-06-03 清枫(北京)科技有限公司 基于交互式增强学习的游戏实时智能翻译方法及装置

Also Published As

Publication number Publication date
CN121263767A (zh) 2026-01-02

Similar Documents

Publication Publication Date Title
US20240053879A1 (en) Object Drag Method and Device
JP7217357B2 (ja) ミニプログラムのデータバインディング方法、装置、デバイス及びコンピュータプログラム
CN107111496B (zh) 可定制刀片应用
US12333137B2 (en) Configuration of application execution spaces and sub-spaces for sharing data on a mobile touch screen device
CN105683895B (zh) 提供用户交互的用户终端设备及其方法
US12204602B2 (en) Page display method and electronic device
CN107291560A (zh) 一种智能设备的内容确定方法和装置
WO2022062898A1 (zh) 一种窗口显示方法及设备
TW201923547A (zh) 處理方法、裝置、設備和機器可讀媒體
CN111225108A (zh) 一种通信终端及负屏界面的卡片显示方法
JP7596521B2 (ja) スクリーンキャプチャ方法、装置及び電子機器
WO2021179904A1 (zh) 标记数据处理方法、设备及存储介质
CN103838469A (zh) 好友列表的展示控制方法及系统
CN113849092A (zh) 内容分享方法、装置和电子设备
CN111324398B (zh) 最近内容的处理方法、装置、终端及存储介质
CN121263767A (zh) 信息传输方法及电子设备
EP4682712A1 (en) Display method and electronic device
CN112269520A (zh) 元素显示控制方法、装置、交互平板及存储介质
CN116301505A (zh) 侧边栏显示方法、装置、终端及存储介质
CN114385153A (zh) 界面编辑方法、编辑终端及计算机可读存储介质
CN116974431A (zh) 一种文档的显示控制方法、装置、电子设备和存储介质
WO2025184905A1 (zh) 触控方法及相关设备
EP4726518A1 (en) Display method and electronic device
WO2026056574A1 (zh) 一种虚拟助手显示方法及电子设备
CN121560188A (zh) 桌面显示方法及相关设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 24822835

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE